Login
[x]
Log in using an account from:
Fedora Account System
Red Hat Associate
Red Hat Customer
Or login using a Red Hat Bugzilla account
Forgot Password
Login:
Hide Forgot
Create an Account
Red Hat Bugzilla – Attachment 917046 Details for
Bug 1103844
[scale][storage] Use a single lock to update multiple OVFs on the master domain
[?]
New
Simple Search
Advanced Search
My Links
Browse
Requests
Reports
Current State
Search
Tabular reports
Graphical reports
Duplicates
Other Reports
User Changes
Plotly Reports
Bug Status
Bug Severity
Non-Defaults
|
Product Dashboard
Help
Page Help!
Bug Writing Guidelines
What's new
Browser Support Policy
5.0.4.rh83 Release notes
FAQ
Guides index
User guide
Web Services
Contact
Legal
This site requires JavaScript to be enabled to function correctly, please enable it.
vdsm.log
vdsm_bz1103844.log (text/x-log), 14.33 MB, created by
Yuri Obshansky
on 2014-07-10 11:19:58 UTC
(
hide
)
Description:
vdsm.log
Filename:
MIME Type:
Creator:
Yuri Obshansky
Created:
2014-07-10 11:19:58 UTC
Size:
14.33 MB
patch
obsolete
>Thread-15::DEBUG::2014-07-10 08:01:02,516::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/e01a3a36-d2ce-4153-bb57-d6e65b7ed08c/metadata bs=4096 count=1' (cwd None) >Thread-15::DEBUG::2014-07-10 08:01:02,575::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.0012733 s, 3.2 MB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-07-10 08:01:02,730::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-07-10 08:01:02,864::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0350398 s, 29.2 MB/s\n'; <rc> = 0 >Thread-1042::DEBUG::2014-07-10 08:01:03,171::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-1042::DEBUG::2014-07-10 08:01:03,181::task::595::TaskManager.Task::(_updateState) Task=`c1623757-8818-48d0-88d4-91b8da596af5`::moving from state init -> state preparing >Thread-1042::INFO::2014-07-10 08:01:03,182::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='411039e4-4af2-4192-9de0-67dc1ed83ba9', options=None) >Thread-1042::INFO::2014-07-10 08:01:03,182::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2}} >Thread-1042::DEBUG::2014-07-10 08:01:03,182::task::1185::TaskManager.Task::(prepare) Task=`c1623757-8818-48d0-88d4-91b8da596af5`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2}} >Thread-1042::DEBUG::2014-07-10 08:01:03,183::task::595::TaskManager.Task::(_updateState) Task=`c1623757-8818-48d0-88d4-91b8da596af5`::moving from state preparing -> state finished >Thread-1042::DEBUG::2014-07-10 08:01:03,183::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-1042::DEBUG::2014-07-10 08:01:03,183::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1042::DEBUG::2014-07-10 08:01:03,183::task::990::TaskManager.Task::(_decref) Task=`c1623757-8818-48d0-88d4-91b8da596af5`::ref 0 aborting False >Thread-1043::DEBUG::2014-07-10 08:01:03,187::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-1043::DEBUG::2014-07-10 08:01:03,187::task::595::TaskManager.Task::(_updateState) Task=`0a484331-bad8-40e2-918d-e6a3ce073af7`::moving from state init -> state preparing >Thread-1043::INFO::2014-07-10 08:01:03,188::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='411039e4-4af2-4192-9de0-67dc1ed83ba9', options=None) >Thread-1043::DEBUG::2014-07-10 08:01:03,188::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9`ReqID=`0ec173c8-3fa9-4686-a612-5247b80c30f1`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo' >Thread-1043::DEBUG::2014-07-10 08:01:03,189::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' for lock type 'shared' >Thread-1043::DEBUG::2014-07-10 08:01:03,189::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' is free. Now locking as 'shared' (1 active user) >Thread-1043::DEBUG::2014-07-10 08:01:03,189::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9`ReqID=`0ec173c8-3fa9-4686-a612-5247b80c30f1`::Granted request >Thread-1043::DEBUG::2014-07-10 08:01:03,190::task::827::TaskManager.Task::(resourceAcquired) Task=`0a484331-bad8-40e2-918d-e6a3ce073af7`::_resourcesAcquired: Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9 (shared) >Thread-1043::DEBUG::2014-07-10 08:01:03,190::task::990::TaskManager.Task::(_decref) Task=`0a484331-bad8-40e2-918d-e6a3ce073af7`::ref 1 aborting False >Thread-1043::INFO::2014-07-10 08:01:03,191::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DC-REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2, 'domains': u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': 'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c': {'status': u'Active', 'diskfree': '1137495244800', 'isoprefix': '', 'alerts': [], 'disktotal': '1152393412608', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '533841575936', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-1043::DEBUG::2014-07-10 08:01:03,191::task::1185::TaskManager.Task::(prepare) Task=`0a484331-bad8-40e2-918d-e6a3ce073af7`::finished: {'info': {'name': 'DC-REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2, 'domains': u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': 'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c': {'status': u'Active', 'diskfree': '1137495244800', 'isoprefix': '', 'alerts': [], 'disktotal': '1152393412608', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '533841575936', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-1043::DEBUG::2014-07-10 08:01:03,191::task::595::TaskManager.Task::(_updateState) Task=`0a484331-bad8-40e2-918d-e6a3ce073af7`::moving from state preparing -> state finished >Thread-1043::DEBUG::2014-07-10 08:01:03,192::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9': < ResourceRef 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9', isValid: 'True' obj: 'None'>} >Thread-1043::DEBUG::2014-07-10 08:01:03,192::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1043::DEBUG::2014-07-10 08:01:03,193::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' >Thread-1043::DEBUG::2014-07-10 08:01:03,193::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' (0 active users) >Thread-1043::DEBUG::2014-07-10 08:01:03,193::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' is free, finding out if anyone is waiting for it. >Thread-1043::DEBUG::2014-07-10 08:01:03,193::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9', Clearing records. >Thread-1043::DEBUG::2014-07-10 08:01:03,193::task::990::TaskManager.Task::(_decref) Task=`0a484331-bad8-40e2-918d-e6a3ce073af7`::ref 0 aborting False >Thread-14::DEBUG::2014-07-10 08:01:03,559::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lion.qa.lab.tlv.redhat.com:_export_yuri2_backup2/6a70504d-00df-4869-8695-0f442053f6b6/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-14::DEBUG::2014-07-10 08:01:03,616::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n369 bytes (369 B) copied, 0.000429159 s, 860 kB/s\n'; <rc> = 0 >Thread-1042::DEBUG::2014-07-10 08:01:04,133::task::595::TaskManager.Task::(_updateState) Task=`23807ccc-b1b6-4365-ad2b-371f755d8766`::moving from state init -> state preparing >Thread-1042::INFO::2014-07-10 08:01:04,134::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-1042::INFO::2014-07-10 08:01:04,134::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0012733', 'lastCheck': '1.5', 'valid': True}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000429159', 'lastCheck': '0.5', 'valid': True}} >Thread-1042::DEBUG::2014-07-10 08:01:04,134::task::1185::TaskManager.Task::(prepare) Task=`23807ccc-b1b6-4365-ad2b-371f755d8766`::finished: {u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0012733', 'lastCheck': '1.5', 'valid': True}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000429159', 'lastCheck': '0.5', 'valid': True}} >Thread-1042::DEBUG::2014-07-10 08:01:04,135::task::595::TaskManager.Task::(_updateState) Task=`23807ccc-b1b6-4365-ad2b-371f755d8766`::moving from state preparing -> state finished >Thread-1042::DEBUG::2014-07-10 08:01:04,135::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-1042::DEBUG::2014-07-10 08:01:04,135::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1042::DEBUG::2014-07-10 08:01:04,135::task::990::TaskManager.Task::(_decref) Task=`23807ccc-b1b6-4365-ad2b-371f755d8766`::ref 0 aborting False >Dummy-36::DEBUG::2014-07-10 08:01:04,879::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-07-10 08:01:05,011::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0316964 s, 32.3 MB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-07-10 08:01:07,026::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-07-10 08:01:07,153::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0296387 s, 34.5 MB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-07-10 08:01:09,168::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-07-10 08:01:09,305::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0380296 s, 26.9 MB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-07-10 08:01:11,321::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-07-10 08:01:11,460::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0386542 s, 26.5 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-07-10 08:01:12,605::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/e01a3a36-d2ce-4153-bb57-d6e65b7ed08c/metadata bs=4096 count=1' (cwd None) >Thread-15::DEBUG::2014-07-10 08:01:12,667::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00094511 s, 4.3 MB/s\n'; <rc> = 0 >Thread-1042::DEBUG::2014-07-10 08:01:13,221::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-1042::DEBUG::2014-07-10 08:01:13,222::task::595::TaskManager.Task::(_updateState) Task=`4823a37d-9191-48bb-b1b6-cf61dc17e1f2`::moving from state init -> state preparing >Thread-1042::INFO::2014-07-10 08:01:13,222::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='411039e4-4af2-4192-9de0-67dc1ed83ba9', options=None) >Thread-1042::INFO::2014-07-10 08:01:13,223::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2}} >Thread-1042::DEBUG::2014-07-10 08:01:13,223::task::1185::TaskManager.Task::(prepare) Task=`4823a37d-9191-48bb-b1b6-cf61dc17e1f2`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2}} >Thread-1042::DEBUG::2014-07-10 08:01:13,223::task::595::TaskManager.Task::(_updateState) Task=`4823a37d-9191-48bb-b1b6-cf61dc17e1f2`::moving from state preparing -> state finished >Thread-1042::DEBUG::2014-07-10 08:01:13,223::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-1042::DEBUG::2014-07-10 08:01:13,223::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1042::DEBUG::2014-07-10 08:01:13,224::task::990::TaskManager.Task::(_decref) Task=`4823a37d-9191-48bb-b1b6-cf61dc17e1f2`::ref 0 aborting False >Thread-1043::DEBUG::2014-07-10 08:01:13,227::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-1043::DEBUG::2014-07-10 08:01:13,228::task::595::TaskManager.Task::(_updateState) Task=`a4241bb2-bb55-4513-948c-c5111b556067`::moving from state init -> state preparing >Thread-1043::INFO::2014-07-10 08:01:13,228::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='411039e4-4af2-4192-9de0-67dc1ed83ba9', options=None) >Thread-1043::DEBUG::2014-07-10 08:01:13,228::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9`ReqID=`3a3558aa-4e75-46cd-87af-2f3b66ef7e6f`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo' >Thread-1043::DEBUG::2014-07-10 08:01:13,229::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' for lock type 'shared' >Thread-1043::DEBUG::2014-07-10 08:01:13,229::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' is free. Now locking as 'shared' (1 active user) >Thread-1043::DEBUG::2014-07-10 08:01:13,229::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9`ReqID=`3a3558aa-4e75-46cd-87af-2f3b66ef7e6f`::Granted request >Thread-1043::DEBUG::2014-07-10 08:01:13,230::task::827::TaskManager.Task::(resourceAcquired) Task=`a4241bb2-bb55-4513-948c-c5111b556067`::_resourcesAcquired: Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9 (shared) >Thread-1043::DEBUG::2014-07-10 08:01:13,230::task::990::TaskManager.Task::(_decref) Task=`a4241bb2-bb55-4513-948c-c5111b556067`::ref 1 aborting False >Thread-1043::INFO::2014-07-10 08:01:13,231::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DC-REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2, 'domains': u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': 'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c': {'status': u'Active', 'diskfree': '1137495244800', 'isoprefix': '', 'alerts': [], 'disktotal': '1152393412608', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '533841575936', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-1043::DEBUG::2014-07-10 08:01:13,231::task::1185::TaskManager.Task::(prepare) Task=`a4241bb2-bb55-4513-948c-c5111b556067`::finished: {'info': {'name': 'DC-REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2, 'domains': u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': 'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c': {'status': u'Active', 'diskfree': '1137495244800', 'isoprefix': '', 'alerts': [], 'disktotal': '1152393412608', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '533841575936', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-1043::DEBUG::2014-07-10 08:01:13,231::task::595::TaskManager.Task::(_updateState) Task=`a4241bb2-bb55-4513-948c-c5111b556067`::moving from state preparing -> state finished >Thread-1043::DEBUG::2014-07-10 08:01:13,231::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9': < ResourceRef 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9', isValid: 'True' obj: 'None'>} >Thread-1043::DEBUG::2014-07-10 08:01:13,231::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1043::DEBUG::2014-07-10 08:01:13,232::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' >Thread-1043::DEBUG::2014-07-10 08:01:13,232::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' (0 active users) >Thread-1043::DEBUG::2014-07-10 08:01:13,232::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' is free, finding out if anyone is waiting for it. >Thread-1043::DEBUG::2014-07-10 08:01:13,232::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9', Clearing records. >Thread-1043::DEBUG::2014-07-10 08:01:13,232::task::990::TaskManager.Task::(_decref) Task=`a4241bb2-bb55-4513-948c-c5111b556067`::ref 0 aborting False >Dummy-36::DEBUG::2014-07-10 08:01:13,475::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-07-10 08:01:13,602::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0320916 s, 31.9 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 08:01:13,647::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lion.qa.lab.tlv.redhat.com:_export_yuri2_backup2/6a70504d-00df-4869-8695-0f442053f6b6/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-14::DEBUG::2014-07-10 08:01:13,709::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n369 bytes (369 B) copied, 0.000522107 s, 707 kB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-07-10 08:01:15,617::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-07-10 08:01:15,748::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0351568 s, 29.1 MB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-07-10 08:01:17,763::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-07-10 08:01:17,903::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0408346 s, 25.1 MB/s\n'; <rc> = 0 >Thread-1042::DEBUG::2014-07-10 08:01:19,303::task::595::TaskManager.Task::(_updateState) Task=`cd8b737d-a648-4d21-bdb6-3b0f90c71af2`::moving from state init -> state preparing >Thread-1042::INFO::2014-07-10 08:01:19,304::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-1042::INFO::2014-07-10 08:01:19,304::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00094511', 'lastCheck': '6.6', 'valid': True}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000522107', 'lastCheck': '5.6', 'valid': True}} >Thread-1042::DEBUG::2014-07-10 08:01:19,304::task::1185::TaskManager.Task::(prepare) Task=`cd8b737d-a648-4d21-bdb6-3b0f90c71af2`::finished: {u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00094511', 'lastCheck': '6.6', 'valid': True}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000522107', 'lastCheck': '5.6', 'valid': True}} >Thread-1042::DEBUG::2014-07-10 08:01:19,304::task::595::TaskManager.Task::(_updateState) Task=`cd8b737d-a648-4d21-bdb6-3b0f90c71af2`::moving from state preparing -> state finished >Thread-1042::DEBUG::2014-07-10 08:01:19,305::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-1042::DEBUG::2014-07-10 08:01:19,305::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1042::DEBUG::2014-07-10 08:01:19,305::task::990::TaskManager.Task::(_decref) Task=`cd8b737d-a648-4d21-bdb6-3b0f90c71af2`::ref 0 aborting False >Dummy-36::DEBUG::2014-07-10 08:01:19,918::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-07-10 08:01:20,044::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.029143 s, 35.1 MB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-07-10 08:01:22,063::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-07-10 08:01:22,205::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0430276 s, 23.8 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-07-10 08:01:22,696::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/e01a3a36-d2ce-4153-bb57-d6e65b7ed08c/metadata bs=4096 count=1' (cwd None) >Thread-15::DEBUG::2014-07-10 08:01:22,756::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000790561 s, 5.2 MB/s\n'; <rc> = 0 >Thread-1042::DEBUG::2014-07-10 08:01:23,263::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-1042::DEBUG::2014-07-10 08:01:23,264::task::595::TaskManager.Task::(_updateState) Task=`9e8a4a8d-2172-4794-9cfb-8784614c95f2`::moving from state init -> state preparing >Thread-1042::INFO::2014-07-10 08:01:23,264::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='411039e4-4af2-4192-9de0-67dc1ed83ba9', options=None) >Thread-1042::INFO::2014-07-10 08:01:23,264::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2}} >Thread-1042::DEBUG::2014-07-10 08:01:23,265::task::1185::TaskManager.Task::(prepare) Task=`9e8a4a8d-2172-4794-9cfb-8784614c95f2`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2}} >Thread-1042::DEBUG::2014-07-10 08:01:23,265::task::595::TaskManager.Task::(_updateState) Task=`9e8a4a8d-2172-4794-9cfb-8784614c95f2`::moving from state preparing -> state finished >Thread-1042::DEBUG::2014-07-10 08:01:23,265::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-1042::DEBUG::2014-07-10 08:01:23,265::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1042::DEBUG::2014-07-10 08:01:23,265::task::990::TaskManager.Task::(_decref) Task=`9e8a4a8d-2172-4794-9cfb-8784614c95f2`::ref 0 aborting False >Thread-1043::DEBUG::2014-07-10 08:01:23,269::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-1043::DEBUG::2014-07-10 08:01:23,270::task::595::TaskManager.Task::(_updateState) Task=`c96407b1-83f7-4490-9874-a7fbfac5ba08`::moving from state init -> state preparing >Thread-1043::INFO::2014-07-10 08:01:23,270::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='411039e4-4af2-4192-9de0-67dc1ed83ba9', options=None) >Thread-1043::DEBUG::2014-07-10 08:01:23,271::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9`ReqID=`e085ae1b-7d50-4c81-90a8-1d4a5106a064`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo' >Thread-1043::DEBUG::2014-07-10 08:01:23,271::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' for lock type 'shared' >Thread-1043::DEBUG::2014-07-10 08:01:23,271::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' is free. Now locking as 'shared' (1 active user) >Thread-1043::DEBUG::2014-07-10 08:01:23,271::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9`ReqID=`e085ae1b-7d50-4c81-90a8-1d4a5106a064`::Granted request >Thread-1043::DEBUG::2014-07-10 08:01:23,272::task::827::TaskManager.Task::(resourceAcquired) Task=`c96407b1-83f7-4490-9874-a7fbfac5ba08`::_resourcesAcquired: Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9 (shared) >Thread-1043::DEBUG::2014-07-10 08:01:23,272::task::990::TaskManager.Task::(_decref) Task=`c96407b1-83f7-4490-9874-a7fbfac5ba08`::ref 1 aborting False >Thread-1043::INFO::2014-07-10 08:01:23,273::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DC-REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2, 'domains': u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': 'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c': {'status': u'Active', 'diskfree': '1137495244800', 'isoprefix': '', 'alerts': [], 'disktotal': '1152393412608', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '533841575936', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-1043::DEBUG::2014-07-10 08:01:23,273::task::1185::TaskManager.Task::(prepare) Task=`c96407b1-83f7-4490-9874-a7fbfac5ba08`::finished: {'info': {'name': 'DC-REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2, 'domains': u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': 'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c': {'status': u'Active', 'diskfree': '1137495244800', 'isoprefix': '', 'alerts': [], 'disktotal': '1152393412608', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '533841575936', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-1043::DEBUG::2014-07-10 08:01:23,274::task::595::TaskManager.Task::(_updateState) Task=`c96407b1-83f7-4490-9874-a7fbfac5ba08`::moving from state preparing -> state finished >Thread-1043::DEBUG::2014-07-10 08:01:23,274::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9': < ResourceRef 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9', isValid: 'True' obj: 'None'>} >Thread-1043::DEBUG::2014-07-10 08:01:23,274::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1043::DEBUG::2014-07-10 08:01:23,274::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' >Thread-1043::DEBUG::2014-07-10 08:01:23,274::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' (0 active users) >Thread-1043::DEBUG::2014-07-10 08:01:23,275::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' is free, finding out if anyone is waiting for it. >Thread-1043::DEBUG::2014-07-10 08:01:23,275::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9', Clearing records. >Thread-1043::DEBUG::2014-07-10 08:01:23,275::task::990::TaskManager.Task::(_decref) Task=`c96407b1-83f7-4490-9874-a7fbfac5ba08`::ref 0 aborting False >Thread-14::DEBUG::2014-07-10 08:01:23,738::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lion.qa.lab.tlv.redhat.com:_export_yuri2_backup2/6a70504d-00df-4869-8695-0f442053f6b6/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-14::DEBUG::2014-07-10 08:01:23,796::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n369 bytes (369 B) copied, 0.000562114 s, 656 kB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-07-10 08:01:24,220::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-07-10 08:01:24,353::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.037474 s, 27.3 MB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-07-10 08:01:26,368::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-07-10 08:01:26,536::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0312848 s, 32.7 MB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-07-10 08:01:28,551::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-07-10 08:01:28,687::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0336857 s, 30.4 MB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-07-10 08:01:30,702::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-07-10 08:01:30,838::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0380582 s, 26.9 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-07-10 08:01:32,786::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/e01a3a36-d2ce-4153-bb57-d6e65b7ed08c/metadata bs=4096 count=1' (cwd None) >Dummy-36::DEBUG::2014-07-10 08:01:32,854::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Thread-15::DEBUG::2014-07-10 08:01:32,935::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.0116051 s, 353 kB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-07-10 08:01:33,291::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.33017 s, 3.1 MB/s\n'; <rc> = 0 >Thread-1042::DEBUG::2014-07-10 08:01:33,299::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-1042::DEBUG::2014-07-10 08:01:33,303::task::595::TaskManager.Task::(_updateState) Task=`2049e627-4f85-4741-89f1-43abc85f1daf`::moving from state init -> state preparing >Thread-1042::INFO::2014-07-10 08:01:33,305::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='411039e4-4af2-4192-9de0-67dc1ed83ba9', options=None) >Thread-1042::INFO::2014-07-10 08:01:33,308::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2}} >Thread-1042::DEBUG::2014-07-10 08:01:33,309::task::1185::TaskManager.Task::(prepare) Task=`2049e627-4f85-4741-89f1-43abc85f1daf`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2}} >Thread-1042::DEBUG::2014-07-10 08:01:33,310::task::595::TaskManager.Task::(_updateState) Task=`2049e627-4f85-4741-89f1-43abc85f1daf`::moving from state preparing -> state finished >Thread-1042::DEBUG::2014-07-10 08:01:33,312::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-1042::DEBUG::2014-07-10 08:01:33,313::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1042::DEBUG::2014-07-10 08:01:33,314::task::990::TaskManager.Task::(_decref) Task=`2049e627-4f85-4741-89f1-43abc85f1daf`::ref 0 aborting False >Thread-1043::DEBUG::2014-07-10 08:01:33,324::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-1043::DEBUG::2014-07-10 08:01:33,326::task::595::TaskManager.Task::(_updateState) Task=`40b0a757-ea97-4a56-96d1-49a17c57b784`::moving from state init -> state preparing >Thread-1043::INFO::2014-07-10 08:01:33,328::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='411039e4-4af2-4192-9de0-67dc1ed83ba9', options=None) >Thread-1043::DEBUG::2014-07-10 08:01:33,332::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9`ReqID=`7d6587bb-f4a7-421d-94ff-c9df538cf0b6`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo' >Thread-1043::DEBUG::2014-07-10 08:01:33,333::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' for lock type 'shared' >Thread-1043::DEBUG::2014-07-10 08:01:33,336::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' is free. Now locking as 'shared' (1 active user) >Thread-1043::DEBUG::2014-07-10 08:01:33,337::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9`ReqID=`7d6587bb-f4a7-421d-94ff-c9df538cf0b6`::Granted request >Thread-1043::DEBUG::2014-07-10 08:01:33,343::task::827::TaskManager.Task::(resourceAcquired) Task=`40b0a757-ea97-4a56-96d1-49a17c57b784`::_resourcesAcquired: Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9 (shared) >Thread-1043::DEBUG::2014-07-10 08:01:33,344::task::990::TaskManager.Task::(_decref) Task=`40b0a757-ea97-4a56-96d1-49a17c57b784`::ref 1 aborting False >Thread-1043::INFO::2014-07-10 08:01:33,351::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DC-REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2, 'domains': u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': 'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c': {'status': u'Active', 'diskfree': '1137495244800', 'isoprefix': '', 'alerts': [], 'disktotal': '1152393412608', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '533841575936', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-1043::DEBUG::2014-07-10 08:01:33,353::task::1185::TaskManager.Task::(prepare) Task=`40b0a757-ea97-4a56-96d1-49a17c57b784`::finished: {'info': {'name': 'DC-REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2, 'domains': u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': 'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c': {'status': u'Active', 'diskfree': '1137495244800', 'isoprefix': '', 'alerts': [], 'disktotal': '1152393412608', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '533841575936', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-1043::DEBUG::2014-07-10 08:01:33,354::task::595::TaskManager.Task::(_updateState) Task=`40b0a757-ea97-4a56-96d1-49a17c57b784`::moving from state preparing -> state finished >Thread-1043::DEBUG::2014-07-10 08:01:33,355::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9': < ResourceRef 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9', isValid: 'True' obj: 'None'>} >Thread-1043::DEBUG::2014-07-10 08:01:33,357::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1043::DEBUG::2014-07-10 08:01:33,359::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' >Thread-1043::DEBUG::2014-07-10 08:01:33,361::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' (0 active users) >Thread-1043::DEBUG::2014-07-10 08:01:33,362::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' is free, finding out if anyone is waiting for it. >Thread-1043::DEBUG::2014-07-10 08:01:33,363::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9', Clearing records. >Thread-1043::DEBUG::2014-07-10 08:01:33,365::task::990::TaskManager.Task::(_decref) Task=`40b0a757-ea97-4a56-96d1-49a17c57b784`::ref 0 aborting False >Thread-14::DEBUG::2014-07-10 08:01:33,825::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lion.qa.lab.tlv.redhat.com:_export_yuri2_backup2/6a70504d-00df-4869-8695-0f442053f6b6/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-14::DEBUG::2014-07-10 08:01:33,889::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n369 bytes (369 B) copied, 0.000359713 s, 1.0 MB/s\n'; <rc> = 0 >Thread-1042::DEBUG::2014-07-10 08:01:34,465::task::595::TaskManager.Task::(_updateState) Task=`30aa71bc-1eea-4e81-9a17-c2a976d48ba6`::moving from state init -> state preparing >Thread-1042::INFO::2014-07-10 08:01:34,465::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-1042::INFO::2014-07-10 08:01:34,466::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0116051', 'lastCheck': '1.2', 'valid': True}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000359713', 'lastCheck': '0.6', 'valid': True}} >Thread-1042::DEBUG::2014-07-10 08:01:34,466::task::1185::TaskManager.Task::(prepare) Task=`30aa71bc-1eea-4e81-9a17-c2a976d48ba6`::finished: {u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0116051', 'lastCheck': '1.2', 'valid': True}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000359713', 'lastCheck': '0.6', 'valid': True}} >Thread-1042::DEBUG::2014-07-10 08:01:34,466::task::595::TaskManager.Task::(_updateState) Task=`30aa71bc-1eea-4e81-9a17-c2a976d48ba6`::moving from state preparing -> state finished >Thread-1042::DEBUG::2014-07-10 08:01:34,466::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-1042::DEBUG::2014-07-10 08:01:34,466::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1042::DEBUG::2014-07-10 08:01:34,467::task::990::TaskManager.Task::(_decref) Task=`30aa71bc-1eea-4e81-9a17-c2a976d48ba6`::ref 0 aborting False >Dummy-36::DEBUG::2014-07-10 08:01:35,379::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-07-10 08:01:35,515::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0321022 s, 31.9 MB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-07-10 08:01:37,530::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-07-10 08:01:37,664::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0324478 s, 31.6 MB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-07-10 08:01:39,679::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-07-10 08:01:39,810::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0348502 s, 29.4 MB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-07-10 08:01:41,824::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-07-10 08:01:41,981::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0596104 s, 17.2 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-07-10 08:01:43,237::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/e01a3a36-d2ce-4153-bb57-d6e65b7ed08c/metadata bs=4096 count=1' (cwd None) >Thread-15::DEBUG::2014-07-10 08:01:43,300::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000912052 s, 4.5 MB/s\n'; <rc> = 0 >Thread-1042::DEBUG::2014-07-10 08:01:43,397::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-1042::DEBUG::2014-07-10 08:01:43,398::task::595::TaskManager.Task::(_updateState) Task=`1db03bd3-6f13-4ac6-8c9a-660d9e7e64d0`::moving from state init -> state preparing >Thread-1042::INFO::2014-07-10 08:01:43,398::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='411039e4-4af2-4192-9de0-67dc1ed83ba9', options=None) >Thread-1042::INFO::2014-07-10 08:01:43,399::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2}} >Thread-1042::DEBUG::2014-07-10 08:01:43,399::task::1185::TaskManager.Task::(prepare) Task=`1db03bd3-6f13-4ac6-8c9a-660d9e7e64d0`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2}} >Thread-1042::DEBUG::2014-07-10 08:01:43,399::task::595::TaskManager.Task::(_updateState) Task=`1db03bd3-6f13-4ac6-8c9a-660d9e7e64d0`::moving from state preparing -> state finished >Thread-1042::DEBUG::2014-07-10 08:01:43,399::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-1042::DEBUG::2014-07-10 08:01:43,400::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1042::DEBUG::2014-07-10 08:01:43,400::task::990::TaskManager.Task::(_decref) Task=`1db03bd3-6f13-4ac6-8c9a-660d9e7e64d0`::ref 0 aborting False >Thread-1043::DEBUG::2014-07-10 08:01:43,404::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-1043::DEBUG::2014-07-10 08:01:43,404::task::595::TaskManager.Task::(_updateState) Task=`77c8dff9-13de-424f-8990-da2024607320`::moving from state init -> state preparing >Thread-1043::INFO::2014-07-10 08:01:43,404::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='411039e4-4af2-4192-9de0-67dc1ed83ba9', options=None) >Thread-1043::DEBUG::2014-07-10 08:01:43,405::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9`ReqID=`681a6f76-5f05-44c0-8ec4-9424fe051eaf`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo' >Thread-1043::DEBUG::2014-07-10 08:01:43,405::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' for lock type 'shared' >Thread-1043::DEBUG::2014-07-10 08:01:43,406::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' is free. Now locking as 'shared' (1 active user) >Thread-1043::DEBUG::2014-07-10 08:01:43,406::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9`ReqID=`681a6f76-5f05-44c0-8ec4-9424fe051eaf`::Granted request >Thread-1043::DEBUG::2014-07-10 08:01:43,407::task::827::TaskManager.Task::(resourceAcquired) Task=`77c8dff9-13de-424f-8990-da2024607320`::_resourcesAcquired: Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9 (shared) >Thread-1043::DEBUG::2014-07-10 08:01:43,407::task::990::TaskManager.Task::(_decref) Task=`77c8dff9-13de-424f-8990-da2024607320`::ref 1 aborting False >Thread-1043::INFO::2014-07-10 08:01:43,408::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DC-REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2, 'domains': u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': 'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c': {'status': u'Active', 'diskfree': '1137495244800', 'isoprefix': '', 'alerts': [], 'disktotal': '1152393412608', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '533841575936', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-1043::DEBUG::2014-07-10 08:01:43,408::task::1185::TaskManager.Task::(prepare) Task=`77c8dff9-13de-424f-8990-da2024607320`::finished: {'info': {'name': 'DC-REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2, 'domains': u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': 'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c': {'status': u'Active', 'diskfree': '1137495244800', 'isoprefix': '', 'alerts': [], 'disktotal': '1152393412608', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '533841575936', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-1043::DEBUG::2014-07-10 08:01:43,408::task::595::TaskManager.Task::(_updateState) Task=`77c8dff9-13de-424f-8990-da2024607320`::moving from state preparing -> state finished >Thread-1043::DEBUG::2014-07-10 08:01:43,409::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9': < ResourceRef 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9', isValid: 'True' obj: 'None'>} >Thread-1043::DEBUG::2014-07-10 08:01:43,409::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1043::DEBUG::2014-07-10 08:01:43,409::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' >Thread-1043::DEBUG::2014-07-10 08:01:43,409::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' (0 active users) >Thread-1043::DEBUG::2014-07-10 08:01:43,409::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' is free, finding out if anyone is waiting for it. >Thread-1043::DEBUG::2014-07-10 08:01:43,410::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9', Clearing records. >Thread-1043::DEBUG::2014-07-10 08:01:43,410::task::990::TaskManager.Task::(_decref) Task=`77c8dff9-13de-424f-8990-da2024607320`::ref 0 aborting False >Thread-14::DEBUG::2014-07-10 08:01:43,893::domainMonitor::192::Storage.DomainMonitorThread::(_monitorDomain) Refreshing domain 6a70504d-00df-4869-8695-0f442053f6b6 >Thread-14::DEBUG::2014-07-10 08:01:43,922::fileSD::150::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/lion.qa.lab.tlv.redhat.com:_export_yuri2_backup2/6a70504d-00df-4869-8695-0f442053f6b6 >Thread-14::DEBUG::2014-07-10 08:01:43,924::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend >Thread-14::DEBUG::2014-07-10 08:01:43,927::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Backup', 'DESCRIPTION=test', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=0', 'POOL_UUID=411039e4-4af2-4192-9de0-67dc1ed83ba9', 'REMOTE_PATH=lion.qa.lab.tlv.redhat.com:/export/yuri2/backup2', 'ROLE=Regular', 'SDUUID=6a70504d-00df-4869-8695-0f442053f6b6', 'TYPE=NFS', 'VERSION=0', '_SHA_CKSUM=c52897a45cbc3ed0a0146ef350774e5cecebe6cf'] >Thread-14::DEBUG::2014-07-10 08:01:43,928::fileSD::609::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images [] >Thread-14::INFO::2014-07-10 08:01:43,929::sd::384::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 6a70504d-00df-4869-8695-0f442053f6b6_imageNS already registered >Thread-14::INFO::2014-07-10 08:01:43,929::sd::392::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 6a70504d-00df-4869-8695-0f442053f6b6_volumeNS already registered >Thread-14::DEBUG::2014-07-10 08:01:43,954::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lion.qa.lab.tlv.redhat.com:_export_yuri2_backup2/6a70504d-00df-4869-8695-0f442053f6b6/dom_md/metadata bs=4096 count=1' (cwd None) >Dummy-36::DEBUG::2014-07-10 08:01:44,021::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Thread-14::DEBUG::2014-07-10 08:01:44,119::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n369 bytes (369 B) copied, 0.000451474 s, 817 kB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-07-10 08:01:44,637::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.518035 s, 2.0 MB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-07-10 08:01:46,652::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-07-10 08:01:46,783::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0322928 s, 31.7 MB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-07-10 08:01:48,798::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-07-10 08:01:48,933::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.035394 s, 28.9 MB/s\n'; <rc> = 0 >Thread-1042::DEBUG::2014-07-10 08:01:49,626::task::595::TaskManager.Task::(_updateState) Task=`cf944f72-31a2-4e80-91df-03a549d93fdc`::moving from state init -> state preparing >Thread-1042::INFO::2014-07-10 08:01:49,627::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-1042::INFO::2014-07-10 08:01:49,627::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000912052', 'lastCheck': '6.3', 'valid': True}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000451474', 'lastCheck': '5.5', 'valid': True}} >Thread-1042::DEBUG::2014-07-10 08:01:49,627::task::1185::TaskManager.Task::(prepare) Task=`cf944f72-31a2-4e80-91df-03a549d93fdc`::finished: {u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000912052', 'lastCheck': '6.3', 'valid': True}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000451474', 'lastCheck': '5.5', 'valid': True}} >Thread-1042::DEBUG::2014-07-10 08:01:49,627::task::595::TaskManager.Task::(_updateState) Task=`cf944f72-31a2-4e80-91df-03a549d93fdc`::moving from state preparing -> state finished >Thread-1042::DEBUG::2014-07-10 08:01:49,628::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-1042::DEBUG::2014-07-10 08:01:49,628::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1042::DEBUG::2014-07-10 08:01:49,628::task::990::TaskManager.Task::(_decref) Task=`cf944f72-31a2-4e80-91df-03a549d93fdc`::ref 0 aborting False >Dummy-36::DEBUG::2014-07-10 08:01:50,948::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-07-10 08:01:51,079::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0325583 s, 31.5 MB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-07-10 08:01:53,094::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-07-10 08:01:53,228::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0354308 s, 28.9 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-07-10 08:01:53,330::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/e01a3a36-d2ce-4153-bb57-d6e65b7ed08c/metadata bs=4096 count=1' (cwd None) >Thread-15::DEBUG::2014-07-10 08:01:53,392::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000739158 s, 5.5 MB/s\n'; <rc> = 0 >Thread-1042::DEBUG::2014-07-10 08:01:53,438::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-1042::DEBUG::2014-07-10 08:01:53,439::task::595::TaskManager.Task::(_updateState) Task=`5d78b081-6bc5-42d7-b186-4ad0f8931433`::moving from state init -> state preparing >Thread-1042::INFO::2014-07-10 08:01:53,439::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='411039e4-4af2-4192-9de0-67dc1ed83ba9', options=None) >Thread-1042::INFO::2014-07-10 08:01:53,440::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2}} >Thread-1042::DEBUG::2014-07-10 08:01:53,440::task::1185::TaskManager.Task::(prepare) Task=`5d78b081-6bc5-42d7-b186-4ad0f8931433`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2}} >Thread-1042::DEBUG::2014-07-10 08:01:53,440::task::595::TaskManager.Task::(_updateState) Task=`5d78b081-6bc5-42d7-b186-4ad0f8931433`::moving from state preparing -> state finished >Thread-1042::DEBUG::2014-07-10 08:01:53,440::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-1042::DEBUG::2014-07-10 08:01:53,440::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1042::DEBUG::2014-07-10 08:01:53,441::task::990::TaskManager.Task::(_decref) Task=`5d78b081-6bc5-42d7-b186-4ad0f8931433`::ref 0 aborting False >Thread-1043::DEBUG::2014-07-10 08:01:53,445::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-1043::DEBUG::2014-07-10 08:01:53,445::task::595::TaskManager.Task::(_updateState) Task=`a7a49725-9a05-46a7-a2b3-272f55fd4ca6`::moving from state init -> state preparing >Thread-1043::INFO::2014-07-10 08:01:53,445::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='411039e4-4af2-4192-9de0-67dc1ed83ba9', options=None) >Thread-1043::DEBUG::2014-07-10 08:01:53,446::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9`ReqID=`a30e1906-b080-403c-ae0c-57a3e2337548`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo' >Thread-1043::DEBUG::2014-07-10 08:01:53,446::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' for lock type 'shared' >Thread-1043::DEBUG::2014-07-10 08:01:53,446::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' is free. Now locking as 'shared' (1 active user) >Thread-1043::DEBUG::2014-07-10 08:01:53,450::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9`ReqID=`a30e1906-b080-403c-ae0c-57a3e2337548`::Granted request >Thread-1043::DEBUG::2014-07-10 08:01:53,451::task::827::TaskManager.Task::(resourceAcquired) Task=`a7a49725-9a05-46a7-a2b3-272f55fd4ca6`::_resourcesAcquired: Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9 (shared) >Thread-1043::DEBUG::2014-07-10 08:01:53,451::task::990::TaskManager.Task::(_decref) Task=`a7a49725-9a05-46a7-a2b3-272f55fd4ca6`::ref 1 aborting False >Thread-1043::INFO::2014-07-10 08:01:53,452::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DC-REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2, 'domains': u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': 'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c': {'status': u'Active', 'diskfree': '1137495244800', 'isoprefix': '', 'alerts': [], 'disktotal': '1152393412608', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '533841575936', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-1043::DEBUG::2014-07-10 08:01:53,456::task::1185::TaskManager.Task::(prepare) Task=`a7a49725-9a05-46a7-a2b3-272f55fd4ca6`::finished: {'info': {'name': 'DC-REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2, 'domains': u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': 'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c': {'status': u'Active', 'diskfree': '1137495244800', 'isoprefix': '', 'alerts': [], 'disktotal': '1152393412608', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '533841575936', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-1043::DEBUG::2014-07-10 08:01:53,457::task::595::TaskManager.Task::(_updateState) Task=`a7a49725-9a05-46a7-a2b3-272f55fd4ca6`::moving from state preparing -> state finished >Thread-1043::DEBUG::2014-07-10 08:01:53,457::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9': < ResourceRef 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9', isValid: 'True' obj: 'None'>} >Thread-1043::DEBUG::2014-07-10 08:01:53,457::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1043::DEBUG::2014-07-10 08:01:53,457::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' >Thread-1043::DEBUG::2014-07-10 08:01:53,458::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' (0 active users) >Thread-1043::DEBUG::2014-07-10 08:01:53,458::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' is free, finding out if anyone is waiting for it. >Thread-1043::DEBUG::2014-07-10 08:01:53,458::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9', Clearing records. >Thread-1043::DEBUG::2014-07-10 08:01:53,458::task::990::TaskManager.Task::(_decref) Task=`a7a49725-9a05-46a7-a2b3-272f55fd4ca6`::ref 0 aborting False >Thread-14::DEBUG::2014-07-10 08:01:54,166::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lion.qa.lab.tlv.redhat.com:_export_yuri2_backup2/6a70504d-00df-4869-8695-0f442053f6b6/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-14::DEBUG::2014-07-10 08:01:54,225::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n369 bytes (369 B) copied, 0.000448236 s, 823 kB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-07-10 08:01:55,243::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-07-10 08:01:55,378::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0332215 s, 30.8 MB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-07-10 08:01:57,393::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-07-10 08:01:57,525::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0353486 s, 29.0 MB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-07-10 08:01:59,540::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-07-10 08:01:59,668::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0323925 s, 31.6 MB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-07-10 08:02:01,683::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-07-10 08:02:01,813::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.032795 s, 31.2 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-07-10 08:02:03,422::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/e01a3a36-d2ce-4153-bb57-d6e65b7ed08c/metadata bs=4096 count=1' (cwd None) >Thread-15::DEBUG::2014-07-10 08:02:03,484::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000839959 s, 4.9 MB/s\n'; <rc> = 0 >Thread-1042::DEBUG::2014-07-10 08:02:03,490::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-1042::DEBUG::2014-07-10 08:02:03,493::task::595::TaskManager.Task::(_updateState) Task=`d2a61a31-9e9c-4fe5-85cc-f281acf9f4f8`::moving from state init -> state preparing >Thread-1042::INFO::2014-07-10 08:02:03,495::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='411039e4-4af2-4192-9de0-67dc1ed83ba9', options=None) >Thread-1042::INFO::2014-07-10 08:02:03,497::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2}} >Thread-1042::DEBUG::2014-07-10 08:02:03,498::task::1185::TaskManager.Task::(prepare) Task=`d2a61a31-9e9c-4fe5-85cc-f281acf9f4f8`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2}} >Thread-1042::DEBUG::2014-07-10 08:02:03,500::task::595::TaskManager.Task::(_updateState) Task=`d2a61a31-9e9c-4fe5-85cc-f281acf9f4f8`::moving from state preparing -> state finished >Thread-1042::DEBUG::2014-07-10 08:02:03,501::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-1042::DEBUG::2014-07-10 08:02:03,503::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1042::DEBUG::2014-07-10 08:02:03,504::task::990::TaskManager.Task::(_decref) Task=`d2a61a31-9e9c-4fe5-85cc-f281acf9f4f8`::ref 0 aborting False >Thread-1043::DEBUG::2014-07-10 08:02:03,513::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-1043::DEBUG::2014-07-10 08:02:03,515::task::595::TaskManager.Task::(_updateState) Task=`b797a9f9-0c06-4cdf-bc75-e77cb95c6297`::moving from state init -> state preparing >Thread-1043::INFO::2014-07-10 08:02:03,517::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='411039e4-4af2-4192-9de0-67dc1ed83ba9', options=None) >Thread-1043::DEBUG::2014-07-10 08:02:03,520::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9`ReqID=`f8072486-dabf-4821-a389-b1053894d513`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo' >Thread-1043::DEBUG::2014-07-10 08:02:03,521::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' for lock type 'shared' >Thread-1043::DEBUG::2014-07-10 08:02:03,524::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' is free. Now locking as 'shared' (1 active user) >Thread-1043::DEBUG::2014-07-10 08:02:03,525::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9`ReqID=`f8072486-dabf-4821-a389-b1053894d513`::Granted request >Thread-1043::DEBUG::2014-07-10 08:02:03,529::task::827::TaskManager.Task::(resourceAcquired) Task=`b797a9f9-0c06-4cdf-bc75-e77cb95c6297`::_resourcesAcquired: Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9 (shared) >Thread-1043::DEBUG::2014-07-10 08:02:03,530::task::990::TaskManager.Task::(_decref) Task=`b797a9f9-0c06-4cdf-bc75-e77cb95c6297`::ref 1 aborting False >Thread-1043::INFO::2014-07-10 08:02:03,537::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DC-REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2, 'domains': u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': 'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c': {'status': u'Active', 'diskfree': '1137495244800', 'isoprefix': '', 'alerts': [], 'disktotal': '1152393412608', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '533841575936', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-1043::DEBUG::2014-07-10 08:02:03,539::task::1185::TaskManager.Task::(prepare) Task=`b797a9f9-0c06-4cdf-bc75-e77cb95c6297`::finished: {'info': {'name': 'DC-REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2, 'domains': u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': 'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c': {'status': u'Active', 'diskfree': '1137495244800', 'isoprefix': '', 'alerts': [], 'disktotal': '1152393412608', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '533841575936', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-1043::DEBUG::2014-07-10 08:02:03,540::task::595::TaskManager.Task::(_updateState) Task=`b797a9f9-0c06-4cdf-bc75-e77cb95c6297`::moving from state preparing -> state finished >Thread-1043::DEBUG::2014-07-10 08:02:03,542::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9': < ResourceRef 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9', isValid: 'True' obj: 'None'>} >Thread-1043::DEBUG::2014-07-10 08:02:03,543::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1043::DEBUG::2014-07-10 08:02:03,546::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' >Thread-1043::DEBUG::2014-07-10 08:02:03,548::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' (0 active users) >Thread-1043::DEBUG::2014-07-10 08:02:03,549::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' is free, finding out if anyone is waiting for it. >Thread-1043::DEBUG::2014-07-10 08:02:03,550::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9', Clearing records. >Thread-1043::DEBUG::2014-07-10 08:02:03,553::task::990::TaskManager.Task::(_decref) Task=`b797a9f9-0c06-4cdf-bc75-e77cb95c6297`::ref 0 aborting False >Dummy-36::DEBUG::2014-07-10 08:02:03,828::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-07-10 08:02:03,965::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0422006 s, 24.3 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 08:02:04,251::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lion.qa.lab.tlv.redhat.com:_export_yuri2_backup2/6a70504d-00df-4869-8695-0f442053f6b6/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-14::DEBUG::2014-07-10 08:02:04,313::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n369 bytes (369 B) copied, 0.000391426 s, 943 kB/s\n'; <rc> = 0 >Thread-1042::DEBUG::2014-07-10 08:02:04,765::task::595::TaskManager.Task::(_updateState) Task=`ff0a0590-5b2a-451d-85dd-30524051af2f`::moving from state init -> state preparing >Thread-1042::INFO::2014-07-10 08:02:04,765::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-1042::INFO::2014-07-10 08:02:04,766::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000839959', 'lastCheck': '1.2', 'valid': True}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000391426', 'lastCheck': '0.4', 'valid': True}} >Thread-1042::DEBUG::2014-07-10 08:02:04,766::task::1185::TaskManager.Task::(prepare) Task=`ff0a0590-5b2a-451d-85dd-30524051af2f`::finished: {u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000839959', 'lastCheck': '1.2', 'valid': True}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000391426', 'lastCheck': '0.4', 'valid': True}} >Thread-1042::DEBUG::2014-07-10 08:02:04,766::task::595::TaskManager.Task::(_updateState) Task=`ff0a0590-5b2a-451d-85dd-30524051af2f`::moving from state preparing -> state finished >Thread-1042::DEBUG::2014-07-10 08:02:04,766::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-1042::DEBUG::2014-07-10 08:02:04,767::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1042::DEBUG::2014-07-10 08:02:04,767::task::990::TaskManager.Task::(_decref) Task=`ff0a0590-5b2a-451d-85dd-30524051af2f`::ref 0 aborting False >Dummy-36::DEBUG::2014-07-10 08:02:05,981::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-07-10 08:02:06,113::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0352487 s, 29.1 MB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-07-10 08:02:08,129::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-07-10 08:02:08,265::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0381953 s, 26.8 MB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-07-10 08:02:10,280::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-07-10 08:02:10,406::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0301141 s, 34.0 MB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-07-10 08:02:12,421::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-07-10 08:02:12,555::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0382016 s, 26.8 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-07-10 08:02:13,575::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/e01a3a36-d2ce-4153-bb57-d6e65b7ed08c/metadata bs=4096 count=1' (cwd None) >Thread-1042::DEBUG::2014-07-10 08:02:13,634::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-1042::DEBUG::2014-07-10 08:02:13,636::task::595::TaskManager.Task::(_updateState) Task=`f7f8c38b-4c1c-4414-9fe5-54d61fbe5d52`::moving from state init -> state preparing >Thread-1042::INFO::2014-07-10 08:02:13,636::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='411039e4-4af2-4192-9de0-67dc1ed83ba9', options=None) >Thread-1042::INFO::2014-07-10 08:02:13,637::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2}} >Thread-1042::DEBUG::2014-07-10 08:02:13,637::task::1185::TaskManager.Task::(prepare) Task=`f7f8c38b-4c1c-4414-9fe5-54d61fbe5d52`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2}} >Thread-1042::DEBUG::2014-07-10 08:02:13,637::task::595::TaskManager.Task::(_updateState) Task=`f7f8c38b-4c1c-4414-9fe5-54d61fbe5d52`::moving from state preparing -> state finished >Thread-1042::DEBUG::2014-07-10 08:02:13,637::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-1042::DEBUG::2014-07-10 08:02:13,637::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1042::DEBUG::2014-07-10 08:02:13,638::task::990::TaskManager.Task::(_decref) Task=`f7f8c38b-4c1c-4414-9fe5-54d61fbe5d52`::ref 0 aborting False >Thread-1043::DEBUG::2014-07-10 08:02:13,643::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-1043::DEBUG::2014-07-10 08:02:13,645::task::595::TaskManager.Task::(_updateState) Task=`04f3d16a-b995-4037-955f-141177140741`::moving from state init -> state preparing >Thread-1043::INFO::2014-07-10 08:02:13,647::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='411039e4-4af2-4192-9de0-67dc1ed83ba9', options=None) >Thread-1043::DEBUG::2014-07-10 08:02:13,650::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9`ReqID=`359c84e1-7c93-4381-a463-0de88f504bea`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo' >Thread-1043::DEBUG::2014-07-10 08:02:13,651::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' for lock type 'shared' >Thread-1043::DEBUG::2014-07-10 08:02:13,653::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' is free. Now locking as 'shared' (1 active user) >Thread-1043::DEBUG::2014-07-10 08:02:13,654::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9`ReqID=`359c84e1-7c93-4381-a463-0de88f504bea`::Granted request >Thread-1043::DEBUG::2014-07-10 08:02:13,657::task::827::TaskManager.Task::(resourceAcquired) Task=`04f3d16a-b995-4037-955f-141177140741`::_resourcesAcquired: Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9 (shared) >Thread-1043::DEBUG::2014-07-10 08:02:13,658::task::990::TaskManager.Task::(_decref) Task=`04f3d16a-b995-4037-955f-141177140741`::ref 1 aborting False >Thread-15::DEBUG::2014-07-10 08:02:13,658::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00665753 s, 615 kB/s\n'; <rc> = 0 >Thread-1043::INFO::2014-07-10 08:02:13,663::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DC-REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2, 'domains': u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': 'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c': {'status': u'Active', 'diskfree': '1137495244800', 'isoprefix': '', 'alerts': [], 'disktotal': '1152393412608', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '533841575936', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-1043::DEBUG::2014-07-10 08:02:13,664::task::1185::TaskManager.Task::(prepare) Task=`04f3d16a-b995-4037-955f-141177140741`::finished: {'info': {'name': 'DC-REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2, 'domains': u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': 'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c': {'status': u'Active', 'diskfree': '1137495244800', 'isoprefix': '', 'alerts': [], 'disktotal': '1152393412608', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '533841575936', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-1043::DEBUG::2014-07-10 08:02:13,665::task::595::TaskManager.Task::(_updateState) Task=`04f3d16a-b995-4037-955f-141177140741`::moving from state preparing -> state finished >Thread-1043::DEBUG::2014-07-10 08:02:13,667::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9': < ResourceRef 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9', isValid: 'True' obj: 'None'>} >Thread-1043::DEBUG::2014-07-10 08:02:13,668::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1043::DEBUG::2014-07-10 08:02:13,671::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' >Thread-1043::DEBUG::2014-07-10 08:02:13,673::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' (0 active users) >Thread-1043::DEBUG::2014-07-10 08:02:13,674::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' is free, finding out if anyone is waiting for it. >Thread-1043::DEBUG::2014-07-10 08:02:13,675::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9', Clearing records. >Thread-1043::DEBUG::2014-07-10 08:02:13,678::task::990::TaskManager.Task::(_decref) Task=`04f3d16a-b995-4037-955f-141177140741`::ref 0 aborting False >Thread-14::DEBUG::2014-07-10 08:02:14,341::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lion.qa.lab.tlv.redhat.com:_export_yuri2_backup2/6a70504d-00df-4869-8695-0f442053f6b6/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-14::DEBUG::2014-07-10 08:02:14,395::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n369 bytes (369 B) copied, 0.000358511 s, 1.0 MB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-07-10 08:02:14,571::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-07-10 08:02:15,107::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.035419 s, 28.9 MB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-07-10 08:02:17,148::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-07-10 08:02:17,278::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0321573 s, 31.8 MB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-07-10 08:02:19,293::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-07-10 08:02:19,428::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0329849 s, 31.0 MB/s\n'; <rc> = 0 >Thread-1042::DEBUG::2014-07-10 08:02:19,914::task::595::TaskManager.Task::(_updateState) Task=`a6f749d0-28ae-4637-a6b7-1c1675cd82e6`::moving from state init -> state preparing >Thread-1042::INFO::2014-07-10 08:02:19,915::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-1042::INFO::2014-07-10 08:02:19,915::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00665753', 'lastCheck': '6.2', 'valid': True}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000358511', 'lastCheck': '5.5', 'valid': True}} >Thread-1042::DEBUG::2014-07-10 08:02:19,915::task::1185::TaskManager.Task::(prepare) Task=`a6f749d0-28ae-4637-a6b7-1c1675cd82e6`::finished: {u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00665753', 'lastCheck': '6.2', 'valid': True}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000358511', 'lastCheck': '5.5', 'valid': True}} >Thread-1042::DEBUG::2014-07-10 08:02:19,916::task::595::TaskManager.Task::(_updateState) Task=`a6f749d0-28ae-4637-a6b7-1c1675cd82e6`::moving from state preparing -> state finished >Thread-1042::DEBUG::2014-07-10 08:02:19,916::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-1042::DEBUG::2014-07-10 08:02:19,916::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1042::DEBUG::2014-07-10 08:02:19,916::task::990::TaskManager.Task::(_decref) Task=`a6f749d0-28ae-4637-a6b7-1c1675cd82e6`::ref 0 aborting False >Dummy-36::DEBUG::2014-07-10 08:02:21,443::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-07-10 08:02:21,579::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0383737 s, 26.7 MB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-07-10 08:02:23,594::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Thread-15::DEBUG::2014-07-10 08:02:23,716::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/e01a3a36-d2ce-4153-bb57-d6e65b7ed08c/metadata bs=4096 count=1' (cwd None) >Thread-1042::DEBUG::2014-07-10 08:02:23,787::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-1042::DEBUG::2014-07-10 08:02:23,798::task::595::TaskManager.Task::(_updateState) Task=`3d0b297a-cb06-486a-bf5d-c5a0d482dda7`::moving from state init -> state preparing >Thread-1042::INFO::2014-07-10 08:02:23,804::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='411039e4-4af2-4192-9de0-67dc1ed83ba9', options=None) >Thread-1042::INFO::2014-07-10 08:02:23,813::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2}} >Thread-1042::DEBUG::2014-07-10 08:02:23,819::task::1185::TaskManager.Task::(prepare) Task=`3d0b297a-cb06-486a-bf5d-c5a0d482dda7`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2}} >Thread-1042::DEBUG::2014-07-10 08:02:23,825::task::595::TaskManager.Task::(_updateState) Task=`3d0b297a-cb06-486a-bf5d-c5a0d482dda7`::moving from state preparing -> state finished >Thread-1042::DEBUG::2014-07-10 08:02:23,830::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-1042::DEBUG::2014-07-10 08:02:23,835::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1042::DEBUG::2014-07-10 08:02:23,842::task::990::TaskManager.Task::(_decref) Task=`3d0b297a-cb06-486a-bf5d-c5a0d482dda7`::ref 0 aborting False >Thread-1043::DEBUG::2014-07-10 08:02:23,870::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-1043::DEBUG::2014-07-10 08:02:23,880::task::595::TaskManager.Task::(_updateState) Task=`296273b0-6ee3-46de-8e0a-0aec9683e830`::moving from state init -> state preparing >Thread-1043::INFO::2014-07-10 08:02:23,886::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='411039e4-4af2-4192-9de0-67dc1ed83ba9', options=None) >Thread-1043::DEBUG::2014-07-10 08:02:23,900::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9`ReqID=`394ecb67-59bb-4986-a5a0-96a4baaa07b0`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo' >Thread-15::DEBUG::2014-07-10 08:02:23,903::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00058142 s, 7.0 MB/s\n'; <rc> = 0 >Thread-1043::DEBUG::2014-07-10 08:02:23,905::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' for lock type 'shared' >Thread-1043::DEBUG::2014-07-10 08:02:23,914::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' is free. Now locking as 'shared' (1 active user) >Thread-1043::DEBUG::2014-07-10 08:02:23,919::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9`ReqID=`394ecb67-59bb-4986-a5a0-96a4baaa07b0`::Granted request >Thread-1043::DEBUG::2014-07-10 08:02:23,931::task::827::TaskManager.Task::(resourceAcquired) Task=`296273b0-6ee3-46de-8e0a-0aec9683e830`::_resourcesAcquired: Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9 (shared) >Thread-1043::DEBUG::2014-07-10 08:02:23,936::task::990::TaskManager.Task::(_decref) Task=`296273b0-6ee3-46de-8e0a-0aec9683e830`::ref 1 aborting False >Thread-1043::INFO::2014-07-10 08:02:23,962::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DC-REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2, 'domains': u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': 'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c': {'status': u'Active', 'diskfree': '1137495244800', 'isoprefix': '', 'alerts': [], 'disktotal': '1152393412608', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '533841575936', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-1043::DEBUG::2014-07-10 08:02:23,968::task::1185::TaskManager.Task::(prepare) Task=`296273b0-6ee3-46de-8e0a-0aec9683e830`::finished: {'info': {'name': 'DC-REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2, 'domains': u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': 'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c': {'status': u'Active', 'diskfree': '1137495244800', 'isoprefix': '', 'alerts': [], 'disktotal': '1152393412608', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '533841575936', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-1043::DEBUG::2014-07-10 08:02:23,973::task::595::TaskManager.Task::(_updateState) Task=`296273b0-6ee3-46de-8e0a-0aec9683e830`::moving from state preparing -> state finished >Thread-1043::DEBUG::2014-07-10 08:02:23,978::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9': < ResourceRef 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9', isValid: 'True' obj: 'None'>} >Thread-1043::DEBUG::2014-07-10 08:02:23,983::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1043::DEBUG::2014-07-10 08:02:23,992::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' >Thread-1043::DEBUG::2014-07-10 08:02:24,000::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' (0 active users) >Thread-1043::DEBUG::2014-07-10 08:02:24,004::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' is free, finding out if anyone is waiting for it. >Thread-1043::DEBUG::2014-07-10 08:02:24,009::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9', Clearing records. >Thread-1043::DEBUG::2014-07-10 08:02:24,017::task::990::TaskManager.Task::(_decref) Task=`296273b0-6ee3-46de-8e0a-0aec9683e830`::ref 0 aborting False >Dummy-36::DEBUG::2014-07-10 08:02:24,306::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0391805 s, 26.1 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 08:02:24,424::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lion.qa.lab.tlv.redhat.com:_export_yuri2_backup2/6a70504d-00df-4869-8695-0f442053f6b6/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-14::DEBUG::2014-07-10 08:02:24,482::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n369 bytes (369 B) copied, 0.000436178 s, 846 kB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-07-10 08:02:26,321::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-07-10 08:02:26,465::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.033117 s, 30.9 MB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-07-10 08:02:28,481::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-07-10 08:02:28,612::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0327833 s, 31.2 MB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-07-10 08:02:30,627::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-07-10 08:02:30,764::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0380447 s, 26.9 MB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-07-10 08:02:32,779::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-07-10 08:02:32,911::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0341637 s, 30.0 MB/s\n'; <rc> = 0 >Thread-1042::DEBUG::2014-07-10 08:02:34,072::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-1042::DEBUG::2014-07-10 08:02:34,073::task::595::TaskManager.Task::(_updateState) Task=`033f74e0-9f1b-4d21-92dd-263304b85530`::moving from state init -> state preparing >Thread-1042::INFO::2014-07-10 08:02:34,074::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='411039e4-4af2-4192-9de0-67dc1ed83ba9', options=None) >Thread-1042::INFO::2014-07-10 08:02:34,074::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2}} >Thread-1042::DEBUG::2014-07-10 08:02:34,075::task::1185::TaskManager.Task::(prepare) Task=`033f74e0-9f1b-4d21-92dd-263304b85530`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2}} >Thread-1042::DEBUG::2014-07-10 08:02:34,075::task::595::TaskManager.Task::(_updateState) Task=`033f74e0-9f1b-4d21-92dd-263304b85530`::moving from state preparing -> state finished >Thread-1042::DEBUG::2014-07-10 08:02:34,075::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-1042::DEBUG::2014-07-10 08:02:34,075::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1042::DEBUG::2014-07-10 08:02:34,076::task::990::TaskManager.Task::(_decref) Task=`033f74e0-9f1b-4d21-92dd-263304b85530`::ref 0 aborting False >Thread-1043::DEBUG::2014-07-10 08:02:34,079::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-1043::DEBUG::2014-07-10 08:02:34,080::task::595::TaskManager.Task::(_updateState) Task=`4fbebdf2-b3ae-445c-858b-ba1bb77f48e9`::moving from state init -> state preparing >Thread-1043::INFO::2014-07-10 08:02:34,080::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='411039e4-4af2-4192-9de0-67dc1ed83ba9', options=None) >Thread-1043::DEBUG::2014-07-10 08:02:34,081::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9`ReqID=`a0503ddf-142d-40e8-93fb-4f9addff403b`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo' >Thread-1043::DEBUG::2014-07-10 08:02:34,081::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' for lock type 'shared' >Thread-1043::DEBUG::2014-07-10 08:02:34,081::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' is free. Now locking as 'shared' (1 active user) >Thread-1043::DEBUG::2014-07-10 08:02:34,082::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9`ReqID=`a0503ddf-142d-40e8-93fb-4f9addff403b`::Granted request >Thread-1043::DEBUG::2014-07-10 08:02:34,082::task::827::TaskManager.Task::(resourceAcquired) Task=`4fbebdf2-b3ae-445c-858b-ba1bb77f48e9`::_resourcesAcquired: Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9 (shared) >Thread-1043::DEBUG::2014-07-10 08:02:34,082::task::990::TaskManager.Task::(_decref) Task=`4fbebdf2-b3ae-445c-858b-ba1bb77f48e9`::ref 1 aborting False >Thread-1043::INFO::2014-07-10 08:02:34,084::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DC-REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2, 'domains': u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': 'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c': {'status': u'Active', 'diskfree': '1137495244800', 'isoprefix': '', 'alerts': [], 'disktotal': '1152393412608', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '533841575936', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-1043::DEBUG::2014-07-10 08:02:34,084::task::1185::TaskManager.Task::(prepare) Task=`4fbebdf2-b3ae-445c-858b-ba1bb77f48e9`::finished: {'info': {'name': 'DC-REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2, 'domains': u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': 'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c': {'status': u'Active', 'diskfree': '1137495244800', 'isoprefix': '', 'alerts': [], 'disktotal': '1152393412608', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '533841575936', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-1043::DEBUG::2014-07-10 08:02:34,084::task::595::TaskManager.Task::(_updateState) Task=`4fbebdf2-b3ae-445c-858b-ba1bb77f48e9`::moving from state preparing -> state finished >Thread-1043::DEBUG::2014-07-10 08:02:34,084::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9': < ResourceRef 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9', isValid: 'True' obj: 'None'>} >Thread-1043::DEBUG::2014-07-10 08:02:34,084::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1043::DEBUG::2014-07-10 08:02:34,085::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' >Thread-1043::DEBUG::2014-07-10 08:02:34,085::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' (0 active users) >Thread-1043::DEBUG::2014-07-10 08:02:34,085::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' is free, finding out if anyone is waiting for it. >Thread-1043::DEBUG::2014-07-10 08:02:34,085::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9', Clearing records. >Thread-1043::DEBUG::2014-07-10 08:02:34,085::task::990::TaskManager.Task::(_decref) Task=`4fbebdf2-b3ae-445c-858b-ba1bb77f48e9`::ref 0 aborting False >Thread-15::DEBUG::2014-07-10 08:02:34,294::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/e01a3a36-d2ce-4153-bb57-d6e65b7ed08c/metadata bs=4096 count=1' (cwd None) >Thread-15::DEBUG::2014-07-10 08:02:34,361::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00603975 s, 678 kB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 08:02:34,511::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lion.qa.lab.tlv.redhat.com:_export_yuri2_backup2/6a70504d-00df-4869-8695-0f442053f6b6/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-14::DEBUG::2014-07-10 08:02:34,570::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n369 bytes (369 B) copied, 0.000467364 s, 790 kB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-07-10 08:02:34,926::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Thread-1042::DEBUG::2014-07-10 08:02:35,093::task::595::TaskManager.Task::(_updateState) Task=`de49feaa-a30e-4bf1-a506-24f5ffe24941`::moving from state init -> state preparing >Thread-1042::INFO::2014-07-10 08:02:35,099::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-1042::INFO::2014-07-10 08:02:35,103::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00603975', 'lastCheck': '0.7', 'valid': True}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000467364', 'lastCheck': '0.5', 'valid': True}} >Thread-1042::DEBUG::2014-07-10 08:02:35,105::task::1185::TaskManager.Task::(prepare) Task=`de49feaa-a30e-4bf1-a506-24f5ffe24941`::finished: {u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00603975', 'lastCheck': '0.7', 'valid': True}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000467364', 'lastCheck': '0.5', 'valid': True}} >Thread-1042::DEBUG::2014-07-10 08:02:35,108::task::595::TaskManager.Task::(_updateState) Task=`de49feaa-a30e-4bf1-a506-24f5ffe24941`::moving from state preparing -> state finished >Thread-1042::DEBUG::2014-07-10 08:02:35,110::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-1042::DEBUG::2014-07-10 08:02:35,112::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1042::DEBUG::2014-07-10 08:02:35,115::task::990::TaskManager.Task::(_decref) Task=`de49feaa-a30e-4bf1-a506-24f5ffe24941`::ref 0 aborting False >Dummy-36::DEBUG::2014-07-10 08:02:35,948::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0456625 s, 22.4 MB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-07-10 08:02:37,963::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-07-10 08:02:38,098::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0331357 s, 30.9 MB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-07-10 08:02:40,113::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-07-10 08:02:40,245::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0379335 s, 27.0 MB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-07-10 08:02:42,254::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-07-10 08:02:42,387::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0326699 s, 31.3 MB/s\n'; <rc> = 0 >Thread-1042::DEBUG::2014-07-10 08:02:44,113::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-1042::DEBUG::2014-07-10 08:02:44,115::task::595::TaskManager.Task::(_updateState) Task=`e53ddf47-4ba1-4fbb-b918-a0a40fec1b81`::moving from state init -> state preparing >Thread-1042::INFO::2014-07-10 08:02:44,115::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='411039e4-4af2-4192-9de0-67dc1ed83ba9', options=None) >Thread-1042::INFO::2014-07-10 08:02:44,116::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2}} >Thread-1042::DEBUG::2014-07-10 08:02:44,116::task::1185::TaskManager.Task::(prepare) Task=`e53ddf47-4ba1-4fbb-b918-a0a40fec1b81`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2}} >Thread-1042::DEBUG::2014-07-10 08:02:44,116::task::595::TaskManager.Task::(_updateState) Task=`e53ddf47-4ba1-4fbb-b918-a0a40fec1b81`::moving from state preparing -> state finished >Thread-1042::DEBUG::2014-07-10 08:02:44,116::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-1042::DEBUG::2014-07-10 08:02:44,116::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1042::DEBUG::2014-07-10 08:02:44,117::task::990::TaskManager.Task::(_decref) Task=`e53ddf47-4ba1-4fbb-b918-a0a40fec1b81`::ref 0 aborting False >Thread-1043::DEBUG::2014-07-10 08:02:44,121::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-1043::DEBUG::2014-07-10 08:02:44,121::task::595::TaskManager.Task::(_updateState) Task=`035fea4c-dc87-46ca-b9a9-2ceaba693dbd`::moving from state init -> state preparing >Thread-1043::INFO::2014-07-10 08:02:44,121::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='411039e4-4af2-4192-9de0-67dc1ed83ba9', options=None) >Thread-1043::DEBUG::2014-07-10 08:02:44,122::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9`ReqID=`96e53718-631e-40ef-922f-67dd1fd16740`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo' >Thread-1043::DEBUG::2014-07-10 08:02:44,122::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' for lock type 'shared' >Thread-1043::DEBUG::2014-07-10 08:02:44,123::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' is free. Now locking as 'shared' (1 active user) >Thread-1043::DEBUG::2014-07-10 08:02:44,123::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9`ReqID=`96e53718-631e-40ef-922f-67dd1fd16740`::Granted request >Thread-1043::DEBUG::2014-07-10 08:02:44,126::task::827::TaskManager.Task::(resourceAcquired) Task=`035fea4c-dc87-46ca-b9a9-2ceaba693dbd`::_resourcesAcquired: Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9 (shared) >Thread-1043::DEBUG::2014-07-10 08:02:44,126::task::990::TaskManager.Task::(_decref) Task=`035fea4c-dc87-46ca-b9a9-2ceaba693dbd`::ref 1 aborting False >Thread-1043::INFO::2014-07-10 08:02:44,127::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DC-REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2, 'domains': u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': 'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c': {'status': u'Active', 'diskfree': '1137495244800', 'isoprefix': '', 'alerts': [], 'disktotal': '1152393412608', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '533841575936', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-1043::DEBUG::2014-07-10 08:02:44,127::task::1185::TaskManager.Task::(prepare) Task=`035fea4c-dc87-46ca-b9a9-2ceaba693dbd`::finished: {'info': {'name': 'DC-REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2, 'domains': u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': 'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c': {'status': u'Active', 'diskfree': '1137495244800', 'isoprefix': '', 'alerts': [], 'disktotal': '1152393412608', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '533841575936', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-1043::DEBUG::2014-07-10 08:02:44,127::task::595::TaskManager.Task::(_updateState) Task=`035fea4c-dc87-46ca-b9a9-2ceaba693dbd`::moving from state preparing -> state finished >Thread-1043::DEBUG::2014-07-10 08:02:44,128::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9': < ResourceRef 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9', isValid: 'True' obj: 'None'>} >Thread-1043::DEBUG::2014-07-10 08:02:44,128::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1043::DEBUG::2014-07-10 08:02:44,128::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' >Thread-1043::DEBUG::2014-07-10 08:02:44,128::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' (0 active users) >Thread-1043::DEBUG::2014-07-10 08:02:44,129::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' is free, finding out if anyone is waiting for it. >Thread-1043::DEBUG::2014-07-10 08:02:44,129::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9', Clearing records. >Thread-1043::DEBUG::2014-07-10 08:02:44,129::task::990::TaskManager.Task::(_decref) Task=`035fea4c-dc87-46ca-b9a9-2ceaba693dbd`::ref 0 aborting False >Thread-15::DEBUG::2014-07-10 08:02:44,390::domainMonitor::192::Storage.DomainMonitorThread::(_monitorDomain) Refreshing domain e01a3a36-d2ce-4153-bb57-d6e65b7ed08c >Thread-15::ERROR::2014-07-10 08:02:44,391::sdc::137::Storage.StorageDomainCache::(_findDomain) looking for unfetched domain e01a3a36-d2ce-4153-bb57-d6e65b7ed08c >Thread-15::ERROR::2014-07-10 08:02:44,391::sdc::154::Storage.StorageDomainCache::(_findUnfetchedDomain) looking for domain e01a3a36-d2ce-4153-bb57-d6e65b7ed08c >Thread-15::DEBUG::2014-07-10 08:02:44,391::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with LvMetadataRW backend >Thread-15::DEBUG::2014-07-10 08:02:44,392::blockSD::336::Storage.Misc.excCmd::(readlines) '/bin/dd iflag=direct skip=0 bs=2048 if=/dev/e01a3a36-d2ce-4153-bb57-d6e65b7ed08c/metadata count=1' (cwd None) >Dummy-36::DEBUG::2014-07-10 08:02:44,461::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Thread-15::DEBUG::2014-07-10 08:02:44,538::blockSD::336::Storage.Misc.excCmd::(readlines) SUCCESS: <err> = '1+0 records in\n1+0 records out\n2048 bytes (2.0 kB) copied, 0.000836453 s, 2.4 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-07-10 08:02:44,539::misc::282::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '2048 bytes (2.0 kB) copied, 0.000836453 s, 2.4 MB/s'], size: 2048 >Thread-15::DEBUG::2014-07-10 08:02:44,539::persistentDict::234::Storage.PersistentDict::(refresh) read lines (LvMetadataRW)=[] >Thread-15::WARNING::2014-07-10 08:02:44,539::persistentDict::256::Storage.PersistentDict::(refresh) data has no embedded checksum - trust it as it is >Thread-15::DEBUG::2014-07-10 08:02:44,539::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with VGTagMetadataRW backend >Thread-15::DEBUG::2014-07-10 08:02:44,540::lvm::503::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-15::DEBUG::2014-07-10 08:02:44,540::lvm::505::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-15::DEBUG::2014-07-10 08:02:44,541::lvm::513::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-15::DEBUG::2014-07-10 08:02:44,541::lvm::525::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-15::DEBUG::2014-07-10 08:02:44,541::lvm::373::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-15::DEBUG::2014-07-10 08:02:44,542::lvm::296::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/3600601601282300032826addbbdae311|/dev/mapper/360060160f4a030003840ec867ddee311|/dev/mapper/367cad74c2fcba00019e6afd20c781e67|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name e01a3a36-d2ce-4153-bb57-d6e65b7ed08c' (cwd None) >Thread-14::DEBUG::2014-07-10 08:02:44,904::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lion.qa.lab.tlv.redhat.com:_export_yuri2_backup2/6a70504d-00df-4869-8695-0f442053f6b6/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-15::DEBUG::2014-07-10 08:02:45,023::lvm::296::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-15::DEBUG::2014-07-10 08:02:45,041::lvm::415::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-14::DEBUG::2014-07-10 08:02:45,048::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n369 bytes (369 B) copied, 0.000459116 s, 804 kB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-07-10 08:02:45,050::persistentDict::234::Storage.PersistentDict::(refresh) read lines (VGTagMetadataRW)=['LEASETIMESEC=60', 'CLASS=Data', 'VERSION=3', u'PV1=pv:360060160f4a030003840ec867ddee311,uuid:0eUwla-dsA3-g6ia-RU23-cual-0rt9-KzkxLj,pestart:0,pecount:397,mapoffset:8189', u'PV0=pv:3600601601282300032826addbbdae311,uuid:ZdReOp-Yf8A-beQm-ne4I-pN3J-rxgm-9Ew0S1,pestart:0,pecount:8189,mapoffset:0', 'LOGBLKSIZE=512', 'LEASERETRIES=3', 'IOOPTIMEOUTSEC=10', 'LOCKRENEWALINTERVALSEC=5', 'PHYBLKSIZE=512', 'SDUUID=e01a3a36-d2ce-4153-bb57-d6e65b7ed08c', 'DESCRIPTION=SD-REAL', 'LOCKPOLICY=', 'VGUUID=GJcVo5-Y0kU-CDub-zITS-zfoL-Z7hz-SeVeIe', 'TYPE=ISCSI', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=DC-REAL', 'ROLE=Master', 'POOL_UUID=411039e4-4af2-4192-9de0-67dc1ed83ba9', 'POOL_SPM_ID=1', u'POOL_DOMAINS=6a70504d-00df-4869-8695-0f442053f6b6:Active,e01a3a36-d2ce-4153-bb57-d6e65b7ed08c:Active', '_SHA_CKSUM=cefcf6543a5de3bd5b35901e3ca494c6a6185b63', 'POOL_SPM_LVER=2'] >Thread-15::INFO::2014-07-10 08:02:45,078::sd::384::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace e01a3a36-d2ce-4153-bb57-d6e65b7ed08c_imageNS already registered >Thread-15::INFO::2014-07-10 08:02:45,082::sd::392::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace e01a3a36-d2ce-4153-bb57-d6e65b7ed08c_volumeNS already registered >Thread-15::INFO::2014-07-10 08:02:45,084::blockSD::452::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace e01a3a36-d2ce-4153-bb57-d6e65b7ed08c_lvmActivationNS already registered >Thread-15::DEBUG::2014-07-10 08:02:45,093::lvm::296::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgck --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/3600601601282300032826addbbdae311|/dev/mapper/360060160f4a030003840ec867ddee311|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } " e01a3a36-d2ce-4153-bb57-d6e65b7ed08c' (cwd None) >Dummy-36::DEBUG::2014-07-10 08:02:45,206::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.633357 s, 1.6 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-07-10 08:02:45,331::lvm::296::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-15::DEBUG::2014-07-10 08:02:45,332::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/e01a3a36-d2ce-4153-bb57-d6e65b7ed08c/metadata bs=4096 count=1' (cwd None) >Thread-15::DEBUG::2014-07-10 08:02:45,392::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000820127 s, 5.0 MB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-07-10 08:02:47,222::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-07-10 08:02:47,358::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0324838 s, 31.5 MB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-07-10 08:02:49,374::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-07-10 08:02:49,508::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0339335 s, 30.2 MB/s\n'; <rc> = 0 >Thread-1042::DEBUG::2014-07-10 08:02:50,809::task::595::TaskManager.Task::(_updateState) Task=`dbddd444-8578-4c81-91c5-fb04df5e198f`::moving from state init -> state preparing >Thread-1042::INFO::2014-07-10 08:02:50,809::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-1042::INFO::2014-07-10 08:02:50,810::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000820127', 'lastCheck': '5.4', 'valid': True}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000459116', 'lastCheck': '5.7', 'valid': True}} >Thread-1042::DEBUG::2014-07-10 08:02:50,810::task::1185::TaskManager.Task::(prepare) Task=`dbddd444-8578-4c81-91c5-fb04df5e198f`::finished: {u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000820127', 'lastCheck': '5.4', 'valid': True}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000459116', 'lastCheck': '5.7', 'valid': True}} >Thread-1042::DEBUG::2014-07-10 08:02:50,810::task::595::TaskManager.Task::(_updateState) Task=`dbddd444-8578-4c81-91c5-fb04df5e198f`::moving from state preparing -> state finished >Thread-1042::DEBUG::2014-07-10 08:02:50,810::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-1042::DEBUG::2014-07-10 08:02:50,810::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1042::DEBUG::2014-07-10 08:02:50,811::task::990::TaskManager.Task::(_decref) Task=`dbddd444-8578-4c81-91c5-fb04df5e198f`::ref 0 aborting False >Dummy-36::DEBUG::2014-07-10 08:02:51,523::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-07-10 08:02:51,659::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0384343 s, 26.6 MB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-07-10 08:02:53,700::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-07-10 08:02:53,848::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0402826 s, 25.4 MB/s\n'; <rc> = 0 >Thread-1042::DEBUG::2014-07-10 08:02:54,154::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-1042::DEBUG::2014-07-10 08:02:54,155::task::595::TaskManager.Task::(_updateState) Task=`50e0fdd3-21d1-459a-b934-d47dd58ed4b9`::moving from state init -> state preparing >Thread-1042::INFO::2014-07-10 08:02:54,156::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='411039e4-4af2-4192-9de0-67dc1ed83ba9', options=None) >Thread-1042::INFO::2014-07-10 08:02:54,156::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2}} >Thread-1042::DEBUG::2014-07-10 08:02:54,157::task::1185::TaskManager.Task::(prepare) Task=`50e0fdd3-21d1-459a-b934-d47dd58ed4b9`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2}} >Thread-1042::DEBUG::2014-07-10 08:02:54,157::task::595::TaskManager.Task::(_updateState) Task=`50e0fdd3-21d1-459a-b934-d47dd58ed4b9`::moving from state preparing -> state finished >Thread-1042::DEBUG::2014-07-10 08:02:54,157::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-1042::DEBUG::2014-07-10 08:02:54,157::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1042::DEBUG::2014-07-10 08:02:54,157::task::990::TaskManager.Task::(_decref) Task=`50e0fdd3-21d1-459a-b934-d47dd58ed4b9`::ref 0 aborting False >Thread-1043::DEBUG::2014-07-10 08:02:54,161::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-1043::DEBUG::2014-07-10 08:02:54,162::task::595::TaskManager.Task::(_updateState) Task=`4576f197-170c-4f9d-b502-86a9388fac06`::moving from state init -> state preparing >Thread-1043::INFO::2014-07-10 08:02:54,162::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='411039e4-4af2-4192-9de0-67dc1ed83ba9', options=None) >Thread-1043::DEBUG::2014-07-10 08:02:54,163::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9`ReqID=`6d476d4a-701d-49fa-9c60-7995348c1e96`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo' >Thread-1043::DEBUG::2014-07-10 08:02:54,163::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' for lock type 'shared' >Thread-1043::DEBUG::2014-07-10 08:02:54,163::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' is free. Now locking as 'shared' (1 active user) >Thread-1043::DEBUG::2014-07-10 08:02:54,163::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9`ReqID=`6d476d4a-701d-49fa-9c60-7995348c1e96`::Granted request >Thread-1043::DEBUG::2014-07-10 08:02:54,164::task::827::TaskManager.Task::(resourceAcquired) Task=`4576f197-170c-4f9d-b502-86a9388fac06`::_resourcesAcquired: Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9 (shared) >Thread-1043::DEBUG::2014-07-10 08:02:54,164::task::990::TaskManager.Task::(_decref) Task=`4576f197-170c-4f9d-b502-86a9388fac06`::ref 1 aborting False >Thread-1043::INFO::2014-07-10 08:02:54,165::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DC-REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2, 'domains': u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': 'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c': {'status': u'Active', 'diskfree': '1137495244800', 'isoprefix': '', 'alerts': [], 'disktotal': '1152393412608', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '533841575936', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-1043::DEBUG::2014-07-10 08:02:54,166::task::1185::TaskManager.Task::(prepare) Task=`4576f197-170c-4f9d-b502-86a9388fac06`::finished: {'info': {'name': 'DC-REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2, 'domains': u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': 'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c': {'status': u'Active', 'diskfree': '1137495244800', 'isoprefix': '', 'alerts': [], 'disktotal': '1152393412608', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '533841575936', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-1043::DEBUG::2014-07-10 08:02:54,166::task::595::TaskManager.Task::(_updateState) Task=`4576f197-170c-4f9d-b502-86a9388fac06`::moving from state preparing -> state finished >Thread-1043::DEBUG::2014-07-10 08:02:54,166::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9': < ResourceRef 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9', isValid: 'True' obj: 'None'>} >Thread-1043::DEBUG::2014-07-10 08:02:54,166::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1043::DEBUG::2014-07-10 08:02:54,167::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' >Thread-1043::DEBUG::2014-07-10 08:02:54,167::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' (0 active users) >Thread-1043::DEBUG::2014-07-10 08:02:54,167::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' is free, finding out if anyone is waiting for it. >Thread-1043::DEBUG::2014-07-10 08:02:54,167::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9', Clearing records. >Thread-1043::DEBUG::2014-07-10 08:02:54,167::task::990::TaskManager.Task::(_decref) Task=`4576f197-170c-4f9d-b502-86a9388fac06`::ref 0 aborting False >Thread-14::DEBUG::2014-07-10 08:02:55,107::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lion.qa.lab.tlv.redhat.com:_export_yuri2_backup2/6a70504d-00df-4869-8695-0f442053f6b6/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-14::DEBUG::2014-07-10 08:02:55,170::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n369 bytes (369 B) copied, 0.00049249 s, 749 kB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-07-10 08:02:55,421::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/e01a3a36-d2ce-4153-bb57-d6e65b7ed08c/metadata bs=4096 count=1' (cwd None) >Thread-15::DEBUG::2014-07-10 08:02:55,480::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000790929 s, 5.2 MB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-07-10 08:02:55,864::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-07-10 08:02:56,222::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0380297 s, 26.9 MB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-07-10 08:02:58,378::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-07-10 08:02:58,512::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.032687 s, 31.3 MB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-07-10 08:03:00,527::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-07-10 08:03:00,665::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0381931 s, 26.8 MB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-07-10 08:03:02,680::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-07-10 08:03:02,812::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0328878 s, 31.1 MB/s\n'; <rc> = 0 >Thread-1042::DEBUG::2014-07-10 08:03:04,189::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [5132c7ff] >Thread-1042::DEBUG::2014-07-10 08:03:04,190::task::595::TaskManager.Task::(_updateState) Task=`98e89922-fc33-4f6a-898a-77fa690fb4db`::moving from state init -> state preparing >Thread-1042::INFO::2014-07-10 08:03:04,191::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='411039e4-4af2-4192-9de0-67dc1ed83ba9', options=None) >Thread-1042::INFO::2014-07-10 08:03:04,191::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2}} >Thread-1042::DEBUG::2014-07-10 08:03:04,191::task::1185::TaskManager.Task::(prepare) Task=`98e89922-fc33-4f6a-898a-77fa690fb4db`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2}} >Thread-1042::DEBUG::2014-07-10 08:03:04,192::task::595::TaskManager.Task::(_updateState) Task=`98e89922-fc33-4f6a-898a-77fa690fb4db`::moving from state preparing -> state finished >Thread-1042::DEBUG::2014-07-10 08:03:04,192::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-1042::DEBUG::2014-07-10 08:03:04,192::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1042::DEBUG::2014-07-10 08:03:04,192::task::990::TaskManager.Task::(_decref) Task=`98e89922-fc33-4f6a-898a-77fa690fb4db`::ref 0 aborting False >Thread-1043::DEBUG::2014-07-10 08:03:04,196::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [5132c7ff] >Thread-1043::DEBUG::2014-07-10 08:03:04,197::task::595::TaskManager.Task::(_updateState) Task=`0d6add65-2b2e-46f3-b0a1-8f3fb313fba4`::moving from state init -> state preparing >Thread-1043::INFO::2014-07-10 08:03:04,197::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='411039e4-4af2-4192-9de0-67dc1ed83ba9', options=None) >Thread-1043::DEBUG::2014-07-10 08:03:04,198::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9`ReqID=`50a1d440-4f9d-4635-8249-7e139216b79c`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo' >Thread-1043::DEBUG::2014-07-10 08:03:04,198::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' for lock type 'shared' >Thread-1043::DEBUG::2014-07-10 08:03:04,198::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' is free. Now locking as 'shared' (1 active user) >Thread-1043::DEBUG::2014-07-10 08:03:04,198::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9`ReqID=`50a1d440-4f9d-4635-8249-7e139216b79c`::Granted request >Thread-1043::DEBUG::2014-07-10 08:03:04,199::task::827::TaskManager.Task::(resourceAcquired) Task=`0d6add65-2b2e-46f3-b0a1-8f3fb313fba4`::_resourcesAcquired: Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9 (shared) >Thread-1043::DEBUG::2014-07-10 08:03:04,199::task::990::TaskManager.Task::(_decref) Task=`0d6add65-2b2e-46f3-b0a1-8f3fb313fba4`::ref 1 aborting False >Thread-1043::INFO::2014-07-10 08:03:04,200::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DC-REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2, 'domains': u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': 'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c': {'status': u'Active', 'diskfree': '1137495244800', 'isoprefix': '', 'alerts': [], 'disktotal': '1152393412608', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '533841575936', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-1043::DEBUG::2014-07-10 08:03:04,201::task::1185::TaskManager.Task::(prepare) Task=`0d6add65-2b2e-46f3-b0a1-8f3fb313fba4`::finished: {'info': {'name': 'DC-REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2, 'domains': u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': 'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c': {'status': u'Active', 'diskfree': '1137495244800', 'isoprefix': '', 'alerts': [], 'disktotal': '1152393412608', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '533841575936', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-1043::DEBUG::2014-07-10 08:03:04,201::task::595::TaskManager.Task::(_updateState) Task=`0d6add65-2b2e-46f3-b0a1-8f3fb313fba4`::moving from state preparing -> state finished >Thread-1043::DEBUG::2014-07-10 08:03:04,201::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9': < ResourceRef 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9', isValid: 'True' obj: 'None'>} >Thread-1043::DEBUG::2014-07-10 08:03:04,201::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1043::DEBUG::2014-07-10 08:03:04,201::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' >Thread-1043::DEBUG::2014-07-10 08:03:04,202::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' (0 active users) >Thread-1043::DEBUG::2014-07-10 08:03:04,202::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' is free, finding out if anyone is waiting for it. >Thread-1043::DEBUG::2014-07-10 08:03:04,202::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9', Clearing records. >Thread-1043::DEBUG::2014-07-10 08:03:04,202::task::990::TaskManager.Task::(_decref) Task=`0d6add65-2b2e-46f3-b0a1-8f3fb313fba4`::ref 0 aborting False >Dummy-36::DEBUG::2014-07-10 08:03:04,827::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-07-10 08:03:04,960::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0329567 s, 31.1 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 08:03:05,202::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lion.qa.lab.tlv.redhat.com:_export_yuri2_backup2/6a70504d-00df-4869-8695-0f442053f6b6/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-14::DEBUG::2014-07-10 08:03:05,265::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n369 bytes (369 B) copied, 0.000474592 s, 778 kB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-07-10 08:03:05,509::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/e01a3a36-d2ce-4153-bb57-d6e65b7ed08c/metadata bs=4096 count=1' (cwd None) >Thread-15::DEBUG::2014-07-10 08:03:05,575::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000862043 s, 4.8 MB/s\n'; <rc> = 0 >Thread-1042::DEBUG::2014-07-10 08:03:05,963::task::595::TaskManager.Task::(_updateState) Task=`a8e42164-a765-4351-8dd3-e56564ffb2df`::moving from state init -> state preparing >Thread-1042::INFO::2014-07-10 08:03:05,964::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-1042::INFO::2014-07-10 08:03:05,964::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000862043', 'lastCheck': '0.4', 'valid': True}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000474592', 'lastCheck': '0.7', 'valid': True}} >Thread-1042::DEBUG::2014-07-10 08:03:05,964::task::1185::TaskManager.Task::(prepare) Task=`a8e42164-a765-4351-8dd3-e56564ffb2df`::finished: {u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000862043', 'lastCheck': '0.4', 'valid': True}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000474592', 'lastCheck': '0.7', 'valid': True}} >Thread-1042::DEBUG::2014-07-10 08:03:05,964::task::595::TaskManager.Task::(_updateState) Task=`a8e42164-a765-4351-8dd3-e56564ffb2df`::moving from state preparing -> state finished >Thread-1042::DEBUG::2014-07-10 08:03:05,965::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-1042::DEBUG::2014-07-10 08:03:05,965::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1042::DEBUG::2014-07-10 08:03:05,965::task::990::TaskManager.Task::(_decref) Task=`a8e42164-a765-4351-8dd3-e56564ffb2df`::ref 0 aborting False >Dummy-36::DEBUG::2014-07-10 08:03:06,975::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-07-10 08:03:07,117::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0381757 s, 26.8 MB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-07-10 08:03:09,132::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-07-10 08:03:09,267::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0358162 s, 28.6 MB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-07-10 08:03:11,282::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-07-10 08:03:11,413::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0332619 s, 30.8 MB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-07-10 08:03:13,429::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-07-10 08:03:13,560::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0329495 s, 31.1 MB/s\n'; <rc> = 0 >Thread-1042::DEBUG::2014-07-10 08:03:14,235::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-1042::DEBUG::2014-07-10 08:03:14,238::task::595::TaskManager.Task::(_updateState) Task=`77dd75f7-fc0e-409e-a646-cf7e021a10b4`::moving from state init -> state preparing >Thread-1042::INFO::2014-07-10 08:03:14,238::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='411039e4-4af2-4192-9de0-67dc1ed83ba9', options=None) >Thread-1042::INFO::2014-07-10 08:03:14,239::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2}} >Thread-1042::DEBUG::2014-07-10 08:03:14,239::task::1185::TaskManager.Task::(prepare) Task=`77dd75f7-fc0e-409e-a646-cf7e021a10b4`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2}} >Thread-1042::DEBUG::2014-07-10 08:03:14,239::task::595::TaskManager.Task::(_updateState) Task=`77dd75f7-fc0e-409e-a646-cf7e021a10b4`::moving from state preparing -> state finished >Thread-1042::DEBUG::2014-07-10 08:03:14,239::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-1042::DEBUG::2014-07-10 08:03:14,240::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1042::DEBUG::2014-07-10 08:03:14,240::task::990::TaskManager.Task::(_decref) Task=`77dd75f7-fc0e-409e-a646-cf7e021a10b4`::ref 0 aborting False >Thread-1043::DEBUG::2014-07-10 08:03:14,244::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-1043::DEBUG::2014-07-10 08:03:14,244::task::595::TaskManager.Task::(_updateState) Task=`f47db673-61fc-4049-84cf-9ccdae4438e2`::moving from state init -> state preparing >Thread-1043::INFO::2014-07-10 08:03:14,245::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='411039e4-4af2-4192-9de0-67dc1ed83ba9', options=None) >Thread-1043::DEBUG::2014-07-10 08:03:14,245::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9`ReqID=`3559ded0-8fd9-4228-ae2b-7243fca23e38`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo' >Thread-1043::DEBUG::2014-07-10 08:03:14,246::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' for lock type 'shared' >Thread-1043::DEBUG::2014-07-10 08:03:14,246::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' is free. Now locking as 'shared' (1 active user) >Thread-1043::DEBUG::2014-07-10 08:03:14,246::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9`ReqID=`3559ded0-8fd9-4228-ae2b-7243fca23e38`::Granted request >Thread-1043::DEBUG::2014-07-10 08:03:14,247::task::827::TaskManager.Task::(resourceAcquired) Task=`f47db673-61fc-4049-84cf-9ccdae4438e2`::_resourcesAcquired: Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9 (shared) >Thread-1043::DEBUG::2014-07-10 08:03:14,247::task::990::TaskManager.Task::(_decref) Task=`f47db673-61fc-4049-84cf-9ccdae4438e2`::ref 1 aborting False >Thread-1043::INFO::2014-07-10 08:03:14,248::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DC-REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2, 'domains': u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': 'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c': {'status': u'Active', 'diskfree': '1137495244800', 'isoprefix': '', 'alerts': [], 'disktotal': '1152393412608', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '533841575936', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-1043::DEBUG::2014-07-10 08:03:14,249::task::1185::TaskManager.Task::(prepare) Task=`f47db673-61fc-4049-84cf-9ccdae4438e2`::finished: {'info': {'name': 'DC-REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2, 'domains': u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': 'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c': {'status': u'Active', 'diskfree': '1137495244800', 'isoprefix': '', 'alerts': [], 'disktotal': '1152393412608', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '533841575936', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-1043::DEBUG::2014-07-10 08:03:14,249::task::595::TaskManager.Task::(_updateState) Task=`f47db673-61fc-4049-84cf-9ccdae4438e2`::moving from state preparing -> state finished >Thread-1043::DEBUG::2014-07-10 08:03:14,249::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9': < ResourceRef 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9', isValid: 'True' obj: 'None'>} >Thread-1043::DEBUG::2014-07-10 08:03:14,249::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1043::DEBUG::2014-07-10 08:03:14,249::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' >Thread-1043::DEBUG::2014-07-10 08:03:14,250::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' (0 active users) >Thread-1043::DEBUG::2014-07-10 08:03:14,250::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' is free, finding out if anyone is waiting for it. >Thread-1043::DEBUG::2014-07-10 08:03:14,250::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9', Clearing records. >Thread-1043::DEBUG::2014-07-10 08:03:14,250::task::990::TaskManager.Task::(_decref) Task=`f47db673-61fc-4049-84cf-9ccdae4438e2`::ref 0 aborting False >Thread-14::DEBUG::2014-07-10 08:03:15,296::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lion.qa.lab.tlv.redhat.com:_export_yuri2_backup2/6a70504d-00df-4869-8695-0f442053f6b6/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-14::DEBUG::2014-07-10 08:03:15,358::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n369 bytes (369 B) copied, 0.000444348 s, 830 kB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-07-10 08:03:15,575::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Thread-15::DEBUG::2014-07-10 08:03:15,641::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/e01a3a36-d2ce-4153-bb57-d6e65b7ed08c/metadata bs=4096 count=1' (cwd None) >Thread-15::DEBUG::2014-07-10 08:03:15,733::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000575492 s, 7.1 MB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-07-10 08:03:15,970::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.291417 s, 3.5 MB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-07-10 08:03:17,984::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-07-10 08:03:18,130::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0358059 s, 28.6 MB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-07-10 08:03:20,146::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-07-10 08:03:20,282::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0368125 s, 27.8 MB/s\n'; <rc> = 0 >Thread-1042::DEBUG::2014-07-10 08:03:21,127::task::595::TaskManager.Task::(_updateState) Task=`a5abd3e8-5e11-493b-b2c9-867e9b69f063`::moving from state init -> state preparing >Thread-1042::INFO::2014-07-10 08:03:21,128::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-1042::INFO::2014-07-10 08:03:21,128::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000575492', 'lastCheck': '5.2', 'valid': True}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000444348', 'lastCheck': '5.8', 'valid': True}} >Thread-1042::DEBUG::2014-07-10 08:03:21,128::task::1185::TaskManager.Task::(prepare) Task=`a5abd3e8-5e11-493b-b2c9-867e9b69f063`::finished: {u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000575492', 'lastCheck': '5.2', 'valid': True}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000444348', 'lastCheck': '5.8', 'valid': True}} >Thread-1042::DEBUG::2014-07-10 08:03:21,128::task::595::TaskManager.Task::(_updateState) Task=`a5abd3e8-5e11-493b-b2c9-867e9b69f063`::moving from state preparing -> state finished >Thread-1042::DEBUG::2014-07-10 08:03:21,129::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-1042::DEBUG::2014-07-10 08:03:21,129::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1042::DEBUG::2014-07-10 08:03:21,129::task::990::TaskManager.Task::(_decref) Task=`a5abd3e8-5e11-493b-b2c9-867e9b69f063`::ref 0 aborting False >Dummy-36::DEBUG::2014-07-10 08:03:22,296::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-07-10 08:03:22,430::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0347221 s, 29.5 MB/s\n'; <rc> = 0 >Thread-1042::DEBUG::2014-07-10 08:03:24,279::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-1042::DEBUG::2014-07-10 08:03:24,280::task::595::TaskManager.Task::(_updateState) Task=`7cc1206e-9103-4701-a450-07bcff0ce1a7`::moving from state init -> state preparing >Thread-1042::INFO::2014-07-10 08:03:24,281::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='411039e4-4af2-4192-9de0-67dc1ed83ba9', options=None) >Thread-1042::INFO::2014-07-10 08:03:24,281::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2}} >Thread-1042::DEBUG::2014-07-10 08:03:24,281::task::1185::TaskManager.Task::(prepare) Task=`7cc1206e-9103-4701-a450-07bcff0ce1a7`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2}} >Thread-1042::DEBUG::2014-07-10 08:03:24,282::task::595::TaskManager.Task::(_updateState) Task=`7cc1206e-9103-4701-a450-07bcff0ce1a7`::moving from state preparing -> state finished >Thread-1042::DEBUG::2014-07-10 08:03:24,282::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-1042::DEBUG::2014-07-10 08:03:24,282::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1042::DEBUG::2014-07-10 08:03:24,282::task::990::TaskManager.Task::(_decref) Task=`7cc1206e-9103-4701-a450-07bcff0ce1a7`::ref 0 aborting False >Thread-1043::DEBUG::2014-07-10 08:03:24,286::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-1043::DEBUG::2014-07-10 08:03:24,286::task::595::TaskManager.Task::(_updateState) Task=`d6ab73ec-d2d7-4eb7-803a-cd13f5188d9e`::moving from state init -> state preparing >Thread-1043::INFO::2014-07-10 08:03:24,287::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='411039e4-4af2-4192-9de0-67dc1ed83ba9', options=None) >Thread-1043::DEBUG::2014-07-10 08:03:24,287::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9`ReqID=`0c5306d5-50ea-46f6-9387-d3d7624f517a`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo' >Thread-1043::DEBUG::2014-07-10 08:03:24,287::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' for lock type 'shared' >Thread-1043::DEBUG::2014-07-10 08:03:24,288::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' is free. Now locking as 'shared' (1 active user) >Thread-1043::DEBUG::2014-07-10 08:03:24,288::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9`ReqID=`0c5306d5-50ea-46f6-9387-d3d7624f517a`::Granted request >Thread-1043::DEBUG::2014-07-10 08:03:24,289::task::827::TaskManager.Task::(resourceAcquired) Task=`d6ab73ec-d2d7-4eb7-803a-cd13f5188d9e`::_resourcesAcquired: Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9 (shared) >Thread-1043::DEBUG::2014-07-10 08:03:24,289::task::990::TaskManager.Task::(_decref) Task=`d6ab73ec-d2d7-4eb7-803a-cd13f5188d9e`::ref 1 aborting False >Thread-1043::INFO::2014-07-10 08:03:24,290::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DC-REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2, 'domains': u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': 'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c': {'status': u'Active', 'diskfree': '1137495244800', 'isoprefix': '', 'alerts': [], 'disktotal': '1152393412608', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '533841575936', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-1043::DEBUG::2014-07-10 08:03:24,290::task::1185::TaskManager.Task::(prepare) Task=`d6ab73ec-d2d7-4eb7-803a-cd13f5188d9e`::finished: {'info': {'name': 'DC-REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2, 'domains': u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': 'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c': {'status': u'Active', 'diskfree': '1137495244800', 'isoprefix': '', 'alerts': [], 'disktotal': '1152393412608', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '533841575936', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-1043::DEBUG::2014-07-10 08:03:24,290::task::595::TaskManager.Task::(_updateState) Task=`d6ab73ec-d2d7-4eb7-803a-cd13f5188d9e`::moving from state preparing -> state finished >Thread-1043::DEBUG::2014-07-10 08:03:24,291::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9': < ResourceRef 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9', isValid: 'True' obj: 'None'>} >Thread-1043::DEBUG::2014-07-10 08:03:24,291::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1043::DEBUG::2014-07-10 08:03:24,291::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' >Thread-1043::DEBUG::2014-07-10 08:03:24,291::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' (0 active users) >Thread-1043::DEBUG::2014-07-10 08:03:24,292::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' is free, finding out if anyone is waiting for it. >Thread-1043::DEBUG::2014-07-10 08:03:24,292::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9', Clearing records. >Thread-1043::DEBUG::2014-07-10 08:03:24,292::task::990::TaskManager.Task::(_decref) Task=`d6ab73ec-d2d7-4eb7-803a-cd13f5188d9e`::ref 0 aborting False >Dummy-36::DEBUG::2014-07-10 08:03:24,445::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-07-10 08:03:24,613::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0721236 s, 14.2 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 08:03:25,385::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lion.qa.lab.tlv.redhat.com:_export_yuri2_backup2/6a70504d-00df-4869-8695-0f442053f6b6/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-14::DEBUG::2014-07-10 08:03:25,446::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n369 bytes (369 B) copied, 0.000450382 s, 819 kB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-07-10 08:03:25,917::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/e01a3a36-d2ce-4153-bb57-d6e65b7ed08c/metadata bs=4096 count=1' (cwd None) >Thread-15::DEBUG::2014-07-10 08:03:25,974::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000624108 s, 6.6 MB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-07-10 08:03:26,628::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-07-10 08:03:26,768::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0373969 s, 27.4 MB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-07-10 08:03:28,783::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-07-10 08:03:28,915::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0347211 s, 29.5 MB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-07-10 08:03:30,930::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-07-10 08:03:31,069::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0379963 s, 26.9 MB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-07-10 08:03:33,084::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-07-10 08:03:33,215::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0329375 s, 31.1 MB/s\n'; <rc> = 0 >Thread-1042::DEBUG::2014-07-10 08:03:34,320::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-1042::DEBUG::2014-07-10 08:03:34,321::task::595::TaskManager.Task::(_updateState) Task=`69271d81-4d75-413b-82bc-82185b519c34`::moving from state init -> state preparing >Thread-1042::INFO::2014-07-10 08:03:34,322::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='411039e4-4af2-4192-9de0-67dc1ed83ba9', options=None) >Thread-1042::INFO::2014-07-10 08:03:34,322::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2}} >Thread-1042::DEBUG::2014-07-10 08:03:34,323::task::1185::TaskManager.Task::(prepare) Task=`69271d81-4d75-413b-82bc-82185b519c34`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2}} >Thread-1042::DEBUG::2014-07-10 08:03:34,323::task::595::TaskManager.Task::(_updateState) Task=`69271d81-4d75-413b-82bc-82185b519c34`::moving from state preparing -> state finished >Thread-1042::DEBUG::2014-07-10 08:03:34,323::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-1042::DEBUG::2014-07-10 08:03:34,323::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1042::DEBUG::2014-07-10 08:03:34,323::task::990::TaskManager.Task::(_decref) Task=`69271d81-4d75-413b-82bc-82185b519c34`::ref 0 aborting False >Thread-1043::DEBUG::2014-07-10 08:03:34,327::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-1043::DEBUG::2014-07-10 08:03:34,327::task::595::TaskManager.Task::(_updateState) Task=`3f03de62-3e97-4803-be7c-332cd2f78dba`::moving from state init -> state preparing >Thread-1043::INFO::2014-07-10 08:03:34,327::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='411039e4-4af2-4192-9de0-67dc1ed83ba9', options=None) >Thread-1043::DEBUG::2014-07-10 08:03:34,328::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9`ReqID=`39872b9f-f1ff-44d4-8613-a25fee526741`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo' >Thread-1043::DEBUG::2014-07-10 08:03:34,328::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' for lock type 'shared' >Thread-1043::DEBUG::2014-07-10 08:03:34,329::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' is free. Now locking as 'shared' (1 active user) >Thread-1043::DEBUG::2014-07-10 08:03:34,329::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9`ReqID=`39872b9f-f1ff-44d4-8613-a25fee526741`::Granted request >Thread-1043::DEBUG::2014-07-10 08:03:34,329::task::827::TaskManager.Task::(resourceAcquired) Task=`3f03de62-3e97-4803-be7c-332cd2f78dba`::_resourcesAcquired: Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9 (shared) >Thread-1043::DEBUG::2014-07-10 08:03:34,329::task::990::TaskManager.Task::(_decref) Task=`3f03de62-3e97-4803-be7c-332cd2f78dba`::ref 1 aborting False >Thread-1043::INFO::2014-07-10 08:03:34,330::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DC-REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2, 'domains': u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': 'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c': {'status': u'Active', 'diskfree': '1137495244800', 'isoprefix': '', 'alerts': [], 'disktotal': '1152393412608', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '533841575936', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-1043::DEBUG::2014-07-10 08:03:34,331::task::1185::TaskManager.Task::(prepare) Task=`3f03de62-3e97-4803-be7c-332cd2f78dba`::finished: {'info': {'name': 'DC-REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2, 'domains': u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': 'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c': {'status': u'Active', 'diskfree': '1137495244800', 'isoprefix': '', 'alerts': [], 'disktotal': '1152393412608', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '533841575936', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-1043::DEBUG::2014-07-10 08:03:34,331::task::595::TaskManager.Task::(_updateState) Task=`3f03de62-3e97-4803-be7c-332cd2f78dba`::moving from state preparing -> state finished >Thread-1043::DEBUG::2014-07-10 08:03:34,331::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9': < ResourceRef 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9', isValid: 'True' obj: 'None'>} >Thread-1043::DEBUG::2014-07-10 08:03:34,331::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1043::DEBUG::2014-07-10 08:03:34,331::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' >Thread-1043::DEBUG::2014-07-10 08:03:34,332::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' (0 active users) >Thread-1043::DEBUG::2014-07-10 08:03:34,332::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' is free, finding out if anyone is waiting for it. >Thread-1043::DEBUG::2014-07-10 08:03:34,332::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9', Clearing records. >Thread-1043::DEBUG::2014-07-10 08:03:34,332::task::990::TaskManager.Task::(_decref) Task=`3f03de62-3e97-4803-be7c-332cd2f78dba`::ref 0 aborting False >Dummy-36::DEBUG::2014-07-10 08:03:35,230::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-07-10 08:03:35,365::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0351171 s, 29.2 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 08:03:35,484::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lion.qa.lab.tlv.redhat.com:_export_yuri2_backup2/6a70504d-00df-4869-8695-0f442053f6b6/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-14::DEBUG::2014-07-10 08:03:35,549::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n369 bytes (369 B) copied, 0.000377743 s, 977 kB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-07-10 08:03:36,003::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/e01a3a36-d2ce-4153-bb57-d6e65b7ed08c/metadata bs=4096 count=1' (cwd None) >Thread-15::DEBUG::2014-07-10 08:03:36,060::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00083807 s, 4.9 MB/s\n'; <rc> = 0 >Thread-1042::DEBUG::2014-07-10 08:03:36,267::task::595::TaskManager.Task::(_updateState) Task=`cf83037a-e8f7-454f-a464-2c73be71179f`::moving from state init -> state preparing >Thread-1042::INFO::2014-07-10 08:03:36,267::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-1042::INFO::2014-07-10 08:03:36,268::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00083807', 'lastCheck': '0.2', 'valid': True}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000377743', 'lastCheck': '0.7', 'valid': True}} >Thread-1042::DEBUG::2014-07-10 08:03:36,268::task::1185::TaskManager.Task::(prepare) Task=`cf83037a-e8f7-454f-a464-2c73be71179f`::finished: {u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00083807', 'lastCheck': '0.2', 'valid': True}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000377743', 'lastCheck': '0.7', 'valid': True}} >Thread-1042::DEBUG::2014-07-10 08:03:36,268::task::595::TaskManager.Task::(_updateState) Task=`cf83037a-e8f7-454f-a464-2c73be71179f`::moving from state preparing -> state finished >Thread-1042::DEBUG::2014-07-10 08:03:36,269::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-1042::DEBUG::2014-07-10 08:03:36,269::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1042::DEBUG::2014-07-10 08:03:36,269::task::990::TaskManager.Task::(_decref) Task=`cf83037a-e8f7-454f-a464-2c73be71179f`::ref 0 aborting False >Dummy-36::DEBUG::2014-07-10 08:03:37,381::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-07-10 08:03:37,512::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0326211 s, 31.4 MB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-07-10 08:03:39,527::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-07-10 08:03:39,658::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0348834 s, 29.4 MB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-07-10 08:03:41,673::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-07-10 08:03:41,804::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0329148 s, 31.1 MB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-07-10 08:03:43,819::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-07-10 08:03:43,944::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0293474 s, 34.9 MB/s\n'; <rc> = 0 >Thread-1042::DEBUG::2014-07-10 08:03:44,355::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-1042::DEBUG::2014-07-10 08:03:44,356::task::595::TaskManager.Task::(_updateState) Task=`dc3fa095-b985-4197-8fb1-9408f2450271`::moving from state init -> state preparing >Thread-1042::INFO::2014-07-10 08:03:44,356::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='411039e4-4af2-4192-9de0-67dc1ed83ba9', options=None) >Thread-1042::INFO::2014-07-10 08:03:44,357::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2}} >Thread-1042::DEBUG::2014-07-10 08:03:44,357::task::1185::TaskManager.Task::(prepare) Task=`dc3fa095-b985-4197-8fb1-9408f2450271`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2}} >Thread-1042::DEBUG::2014-07-10 08:03:44,357::task::595::TaskManager.Task::(_updateState) Task=`dc3fa095-b985-4197-8fb1-9408f2450271`::moving from state preparing -> state finished >Thread-1042::DEBUG::2014-07-10 08:03:44,357::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-1042::DEBUG::2014-07-10 08:03:44,357::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1042::DEBUG::2014-07-10 08:03:44,357::task::990::TaskManager.Task::(_decref) Task=`dc3fa095-b985-4197-8fb1-9408f2450271`::ref 0 aborting False >Thread-1043::DEBUG::2014-07-10 08:03:44,361::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-1043::DEBUG::2014-07-10 08:03:44,362::task::595::TaskManager.Task::(_updateState) Task=`9e4e499e-b558-4479-88d3-de885a616dcb`::moving from state init -> state preparing >Thread-1043::INFO::2014-07-10 08:03:44,362::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='411039e4-4af2-4192-9de0-67dc1ed83ba9', options=None) >Thread-1043::DEBUG::2014-07-10 08:03:44,363::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9`ReqID=`781e316d-2c5e-4964-8570-80f229064c7f`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo' >Thread-1043::DEBUG::2014-07-10 08:03:44,363::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' for lock type 'shared' >Thread-1043::DEBUG::2014-07-10 08:03:44,363::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' is free. Now locking as 'shared' (1 active user) >Thread-1043::DEBUG::2014-07-10 08:03:44,363::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9`ReqID=`781e316d-2c5e-4964-8570-80f229064c7f`::Granted request >Thread-1043::DEBUG::2014-07-10 08:03:44,364::task::827::TaskManager.Task::(resourceAcquired) Task=`9e4e499e-b558-4479-88d3-de885a616dcb`::_resourcesAcquired: Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9 (shared) >Thread-1043::DEBUG::2014-07-10 08:03:44,364::task::990::TaskManager.Task::(_decref) Task=`9e4e499e-b558-4479-88d3-de885a616dcb`::ref 1 aborting False >Thread-1043::INFO::2014-07-10 08:03:44,365::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DC-REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2, 'domains': u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': 'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c': {'status': u'Active', 'diskfree': '1137495244800', 'isoprefix': '', 'alerts': [], 'disktotal': '1152393412608', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '533841575936', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-1043::DEBUG::2014-07-10 08:03:44,365::task::1185::TaskManager.Task::(prepare) Task=`9e4e499e-b558-4479-88d3-de885a616dcb`::finished: {'info': {'name': 'DC-REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2, 'domains': u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': 'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c': {'status': u'Active', 'diskfree': '1137495244800', 'isoprefix': '', 'alerts': [], 'disktotal': '1152393412608', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '533841575936', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-1043::DEBUG::2014-07-10 08:03:44,366::task::595::TaskManager.Task::(_updateState) Task=`9e4e499e-b558-4479-88d3-de885a616dcb`::moving from state preparing -> state finished >Thread-1043::DEBUG::2014-07-10 08:03:44,366::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9': < ResourceRef 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9', isValid: 'True' obj: 'None'>} >Thread-1043::DEBUG::2014-07-10 08:03:44,366::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1043::DEBUG::2014-07-10 08:03:44,366::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' >Thread-1043::DEBUG::2014-07-10 08:03:44,366::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' (0 active users) >Thread-1043::DEBUG::2014-07-10 08:03:44,367::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' is free, finding out if anyone is waiting for it. >Thread-1043::DEBUG::2014-07-10 08:03:44,367::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9', Clearing records. >Thread-1043::DEBUG::2014-07-10 08:03:44,367::task::990::TaskManager.Task::(_decref) Task=`9e4e499e-b558-4479-88d3-de885a616dcb`::ref 0 aborting False >Thread-14::DEBUG::2014-07-10 08:03:45,579::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lion.qa.lab.tlv.redhat.com:_export_yuri2_backup2/6a70504d-00df-4869-8695-0f442053f6b6/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-14::DEBUG::2014-07-10 08:03:45,637::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n369 bytes (369 B) copied, 0.000324505 s, 1.1 MB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-07-10 08:03:45,958::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Thread-15::DEBUG::2014-07-10 08:03:46,093::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/e01a3a36-d2ce-4153-bb57-d6e65b7ed08c/metadata bs=4096 count=1' (cwd None) >Dummy-36::DEBUG::2014-07-10 08:03:46,094::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0394344 s, 26.0 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-07-10 08:03:46,187::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000756037 s, 5.4 MB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-07-10 08:03:48,302::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-07-10 08:03:48,437::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0293568 s, 34.9 MB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-07-10 08:03:50,453::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-07-10 08:03:50,588::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0376408 s, 27.2 MB/s\n'; <rc> = 0 >Thread-1042::DEBUG::2014-07-10 08:03:51,419::task::595::TaskManager.Task::(_updateState) Task=`a86f6df3-c4d0-4ce8-ac79-843ed1997227`::moving from state init -> state preparing >Thread-1042::INFO::2014-07-10 08:03:51,419::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-1042::INFO::2014-07-10 08:03:51,420::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000756037', 'lastCheck': '5.1', 'valid': True}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000324505', 'lastCheck': '5.8', 'valid': True}} >Thread-1042::DEBUG::2014-07-10 08:03:51,420::task::1185::TaskManager.Task::(prepare) Task=`a86f6df3-c4d0-4ce8-ac79-843ed1997227`::finished: {u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000756037', 'lastCheck': '5.1', 'valid': True}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000324505', 'lastCheck': '5.8', 'valid': True}} >Thread-1042::DEBUG::2014-07-10 08:03:51,420::task::595::TaskManager.Task::(_updateState) Task=`a86f6df3-c4d0-4ce8-ac79-843ed1997227`::moving from state preparing -> state finished >Thread-1042::DEBUG::2014-07-10 08:03:51,420::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-1042::DEBUG::2014-07-10 08:03:51,421::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1042::DEBUG::2014-07-10 08:03:51,421::task::990::TaskManager.Task::(_decref) Task=`a86f6df3-c4d0-4ce8-ac79-843ed1997227`::ref 0 aborting False >Dummy-36::DEBUG::2014-07-10 08:03:52,602::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-07-10 08:03:52,734::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.032848 s, 31.2 MB/s\n'; <rc> = 0 >Thread-1042::DEBUG::2014-07-10 08:03:54,422::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-1042::DEBUG::2014-07-10 08:03:54,423::task::595::TaskManager.Task::(_updateState) Task=`316cafe4-76f5-4136-b556-1c069d17f2b5`::moving from state init -> state preparing >Thread-1042::INFO::2014-07-10 08:03:54,424::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='411039e4-4af2-4192-9de0-67dc1ed83ba9', options=None) >Thread-1042::INFO::2014-07-10 08:03:54,424::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2}} >Thread-1042::DEBUG::2014-07-10 08:03:54,424::task::1185::TaskManager.Task::(prepare) Task=`316cafe4-76f5-4136-b556-1c069d17f2b5`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2}} >Thread-1042::DEBUG::2014-07-10 08:03:54,424::task::595::TaskManager.Task::(_updateState) Task=`316cafe4-76f5-4136-b556-1c069d17f2b5`::moving from state preparing -> state finished >Thread-1042::DEBUG::2014-07-10 08:03:54,425::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-1042::DEBUG::2014-07-10 08:03:54,425::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1042::DEBUG::2014-07-10 08:03:54,425::task::990::TaskManager.Task::(_decref) Task=`316cafe4-76f5-4136-b556-1c069d17f2b5`::ref 0 aborting False >Thread-1043::DEBUG::2014-07-10 08:03:54,429::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-1043::DEBUG::2014-07-10 08:03:54,430::task::595::TaskManager.Task::(_updateState) Task=`a034c7bd-937c-403e-8d51-0b7b001c07aa`::moving from state init -> state preparing >Thread-1043::INFO::2014-07-10 08:03:54,430::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='411039e4-4af2-4192-9de0-67dc1ed83ba9', options=None) >Thread-1043::DEBUG::2014-07-10 08:03:54,431::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9`ReqID=`ce45c35c-308b-45e9-bb4c-1fc22a776e02`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo' >Thread-1043::DEBUG::2014-07-10 08:03:54,431::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' for lock type 'shared' >Thread-1043::DEBUG::2014-07-10 08:03:54,431::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' is free. Now locking as 'shared' (1 active user) >Thread-1043::DEBUG::2014-07-10 08:03:54,431::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9`ReqID=`ce45c35c-308b-45e9-bb4c-1fc22a776e02`::Granted request >Thread-1043::DEBUG::2014-07-10 08:03:54,432::task::827::TaskManager.Task::(resourceAcquired) Task=`a034c7bd-937c-403e-8d51-0b7b001c07aa`::_resourcesAcquired: Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9 (shared) >Thread-1043::DEBUG::2014-07-10 08:03:54,432::task::990::TaskManager.Task::(_decref) Task=`a034c7bd-937c-403e-8d51-0b7b001c07aa`::ref 1 aborting False >Thread-1043::INFO::2014-07-10 08:03:54,433::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DC-REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2, 'domains': u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': 'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c': {'status': u'Active', 'diskfree': '1137495244800', 'isoprefix': '', 'alerts': [], 'disktotal': '1152393412608', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '533841575936', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-1043::DEBUG::2014-07-10 08:03:54,434::task::1185::TaskManager.Task::(prepare) Task=`a034c7bd-937c-403e-8d51-0b7b001c07aa`::finished: {'info': {'name': 'DC-REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2, 'domains': u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': 'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c': {'status': u'Active', 'diskfree': '1137495244800', 'isoprefix': '', 'alerts': [], 'disktotal': '1152393412608', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '533841575936', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-1043::DEBUG::2014-07-10 08:03:54,434::task::595::TaskManager.Task::(_updateState) Task=`a034c7bd-937c-403e-8d51-0b7b001c07aa`::moving from state preparing -> state finished >Thread-1043::DEBUG::2014-07-10 08:03:54,434::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9': < ResourceRef 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9', isValid: 'True' obj: 'None'>} >Thread-1043::DEBUG::2014-07-10 08:03:54,434::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1043::DEBUG::2014-07-10 08:03:54,435::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' >Thread-1043::DEBUG::2014-07-10 08:03:54,435::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' (0 active users) >Thread-1043::DEBUG::2014-07-10 08:03:54,435::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' is free, finding out if anyone is waiting for it. >Thread-1043::DEBUG::2014-07-10 08:03:54,435::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9', Clearing records. >Thread-1043::DEBUG::2014-07-10 08:03:54,435::task::990::TaskManager.Task::(_decref) Task=`a034c7bd-937c-403e-8d51-0b7b001c07aa`::ref 0 aborting False >Dummy-36::DEBUG::2014-07-10 08:03:54,750::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-07-10 08:03:54,884::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0381076 s, 26.9 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 08:03:55,669::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lion.qa.lab.tlv.redhat.com:_export_yuri2_backup2/6a70504d-00df-4869-8695-0f442053f6b6/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-14::DEBUG::2014-07-10 08:03:55,730::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n369 bytes (369 B) copied, 0.000386885 s, 954 kB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-07-10 08:03:56,313::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/e01a3a36-d2ce-4153-bb57-d6e65b7ed08c/metadata bs=4096 count=1' (cwd None) >Thread-15::DEBUG::2014-07-10 08:03:56,371::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000710339 s, 5.8 MB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-07-10 08:03:56,899::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-07-10 08:03:57,042::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0382371 s, 26.8 MB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-07-10 08:03:59,057::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-07-10 08:03:59,184::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0296264 s, 34.6 MB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-07-10 08:04:01,200::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-07-10 08:04:01,331::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0381463 s, 26.8 MB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-07-10 08:04:03,340::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-07-10 08:04:03,467::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0298702 s, 34.3 MB/s\n'; <rc> = 0 >Thread-1042::DEBUG::2014-07-10 08:04:04,462::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-1042::DEBUG::2014-07-10 08:04:04,463::task::595::TaskManager.Task::(_updateState) Task=`1d76b84f-185a-4304-b658-66029559dda3`::moving from state init -> state preparing >Thread-1042::INFO::2014-07-10 08:04:04,463::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='411039e4-4af2-4192-9de0-67dc1ed83ba9', options=None) >Thread-1042::INFO::2014-07-10 08:04:04,464::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2}} >Thread-1042::DEBUG::2014-07-10 08:04:04,464::task::1185::TaskManager.Task::(prepare) Task=`1d76b84f-185a-4304-b658-66029559dda3`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2}} >Thread-1042::DEBUG::2014-07-10 08:04:04,464::task::595::TaskManager.Task::(_updateState) Task=`1d76b84f-185a-4304-b658-66029559dda3`::moving from state preparing -> state finished >Thread-1042::DEBUG::2014-07-10 08:04:04,464::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-1042::DEBUG::2014-07-10 08:04:04,464::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1042::DEBUG::2014-07-10 08:04:04,464::task::990::TaskManager.Task::(_decref) Task=`1d76b84f-185a-4304-b658-66029559dda3`::ref 0 aborting False >Thread-1043::DEBUG::2014-07-10 08:04:04,468::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-1043::DEBUG::2014-07-10 08:04:04,468::task::595::TaskManager.Task::(_updateState) Task=`e15102a0-d0b6-480f-816b-73257f563849`::moving from state init -> state preparing >Thread-1043::INFO::2014-07-10 08:04:04,469::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='411039e4-4af2-4192-9de0-67dc1ed83ba9', options=None) >Thread-1043::DEBUG::2014-07-10 08:04:04,469::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9`ReqID=`741aa6ca-3783-4263-a112-5fcefcb1f8c1`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo' >Thread-1043::DEBUG::2014-07-10 08:04:04,469::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' for lock type 'shared' >Thread-1043::DEBUG::2014-07-10 08:04:04,470::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' is free. Now locking as 'shared' (1 active user) >Thread-1043::DEBUG::2014-07-10 08:04:04,470::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9`ReqID=`741aa6ca-3783-4263-a112-5fcefcb1f8c1`::Granted request >Thread-1043::DEBUG::2014-07-10 08:04:04,470::task::827::TaskManager.Task::(resourceAcquired) Task=`e15102a0-d0b6-480f-816b-73257f563849`::_resourcesAcquired: Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9 (shared) >Thread-1043::DEBUG::2014-07-10 08:04:04,470::task::990::TaskManager.Task::(_decref) Task=`e15102a0-d0b6-480f-816b-73257f563849`::ref 1 aborting False >Thread-1043::INFO::2014-07-10 08:04:04,471::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DC-REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2, 'domains': u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': 'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c': {'status': u'Active', 'diskfree': '1137495244800', 'isoprefix': '', 'alerts': [], 'disktotal': '1152393412608', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '533841575936', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-1043::DEBUG::2014-07-10 08:04:04,472::task::1185::TaskManager.Task::(prepare) Task=`e15102a0-d0b6-480f-816b-73257f563849`::finished: {'info': {'name': 'DC-REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2, 'domains': u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': 'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c': {'status': u'Active', 'diskfree': '1137495244800', 'isoprefix': '', 'alerts': [], 'disktotal': '1152393412608', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '533841575936', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-1043::DEBUG::2014-07-10 08:04:04,472::task::595::TaskManager.Task::(_updateState) Task=`e15102a0-d0b6-480f-816b-73257f563849`::moving from state preparing -> state finished >Thread-1043::DEBUG::2014-07-10 08:04:04,472::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9': < ResourceRef 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9', isValid: 'True' obj: 'None'>} >Thread-1043::DEBUG::2014-07-10 08:04:04,472::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1043::DEBUG::2014-07-10 08:04:04,472::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' >Thread-1043::DEBUG::2014-07-10 08:04:04,472::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' (0 active users) >Thread-1043::DEBUG::2014-07-10 08:04:04,473::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' is free, finding out if anyone is waiting for it. >Thread-1043::DEBUG::2014-07-10 08:04:04,473::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9', Clearing records. >Thread-1043::DEBUG::2014-07-10 08:04:04,473::task::990::TaskManager.Task::(_decref) Task=`e15102a0-d0b6-480f-816b-73257f563849`::ref 0 aborting False >Dummy-36::DEBUG::2014-07-10 08:04:05,482::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-07-10 08:04:05,643::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0642371 s, 15.9 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 08:04:05,760::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lion.qa.lab.tlv.redhat.com:_export_yuri2_backup2/6a70504d-00df-4869-8695-0f442053f6b6/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-14::DEBUG::2014-07-10 08:04:05,821::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n369 bytes (369 B) copied, 0.000492882 s, 749 kB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-07-10 08:04:06,400::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/e01a3a36-d2ce-4153-bb57-d6e65b7ed08c/metadata bs=4096 count=1' (cwd None) >Thread-15::DEBUG::2014-07-10 08:04:06,463::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00638355 s, 642 kB/s\n'; <rc> = 0 >Thread-1042::DEBUG::2014-07-10 08:04:06,555::task::595::TaskManager.Task::(_updateState) Task=`c27b2ea3-f6a7-4bf2-b2f8-32eb5b0323c0`::moving from state init -> state preparing >Thread-1042::INFO::2014-07-10 08:04:06,555::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-1042::INFO::2014-07-10 08:04:06,556::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00638355', 'lastCheck': '0.1', 'valid': True}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000492882', 'lastCheck': '0.7', 'valid': True}} >Thread-1042::DEBUG::2014-07-10 08:04:06,556::task::1185::TaskManager.Task::(prepare) Task=`c27b2ea3-f6a7-4bf2-b2f8-32eb5b0323c0`::finished: {u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00638355', 'lastCheck': '0.1', 'valid': True}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000492882', 'lastCheck': '0.7', 'valid': True}} >Thread-1042::DEBUG::2014-07-10 08:04:06,556::task::595::TaskManager.Task::(_updateState) Task=`c27b2ea3-f6a7-4bf2-b2f8-32eb5b0323c0`::moving from state preparing -> state finished >Thread-1042::DEBUG::2014-07-10 08:04:06,556::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-1042::DEBUG::2014-07-10 08:04:06,556::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1042::DEBUG::2014-07-10 08:04:06,557::task::990::TaskManager.Task::(_decref) Task=`c27b2ea3-f6a7-4bf2-b2f8-32eb5b0323c0`::ref 0 aborting False >Dummy-36::DEBUG::2014-07-10 08:04:07,658::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-07-10 08:04:07,801::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0415611 s, 24.6 MB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-07-10 08:04:09,816::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-07-10 08:04:10,036::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.124207 s, 8.2 MB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-07-10 08:04:12,052::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-07-10 08:04:12,203::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0511044 s, 20.0 MB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-07-10 08:04:14,218::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-07-10 08:04:14,371::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0559338 s, 18.3 MB/s\n'; <rc> = 0 >Thread-1042::DEBUG::2014-07-10 08:04:14,496::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-1042::DEBUG::2014-07-10 08:04:14,497::task::595::TaskManager.Task::(_updateState) Task=`c8d4e091-c2ed-410c-8361-e915d3f5a0d7`::moving from state init -> state preparing >Thread-1042::INFO::2014-07-10 08:04:14,498::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='411039e4-4af2-4192-9de0-67dc1ed83ba9', options=None) >Thread-1042::INFO::2014-07-10 08:04:14,498::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2}} >Thread-1042::DEBUG::2014-07-10 08:04:14,498::task::1185::TaskManager.Task::(prepare) Task=`c8d4e091-c2ed-410c-8361-e915d3f5a0d7`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2}} >Thread-1042::DEBUG::2014-07-10 08:04:14,499::task::595::TaskManager.Task::(_updateState) Task=`c8d4e091-c2ed-410c-8361-e915d3f5a0d7`::moving from state preparing -> state finished >Thread-1042::DEBUG::2014-07-10 08:04:14,499::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-1042::DEBUG::2014-07-10 08:04:14,499::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1042::DEBUG::2014-07-10 08:04:14,499::task::990::TaskManager.Task::(_decref) Task=`c8d4e091-c2ed-410c-8361-e915d3f5a0d7`::ref 0 aborting False >Thread-1043::DEBUG::2014-07-10 08:04:14,503::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-1043::DEBUG::2014-07-10 08:04:14,504::task::595::TaskManager.Task::(_updateState) Task=`3f396646-0fd5-4c8f-8b74-8f0498ddbc00`::moving from state init -> state preparing >Thread-1043::INFO::2014-07-10 08:04:14,504::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='411039e4-4af2-4192-9de0-67dc1ed83ba9', options=None) >Thread-1043::DEBUG::2014-07-10 08:04:14,505::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9`ReqID=`bdaa2bd6-0c7a-434f-90e6-3b5048726ed0`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo' >Thread-1043::DEBUG::2014-07-10 08:04:14,505::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' for lock type 'shared' >Thread-1043::DEBUG::2014-07-10 08:04:14,505::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' is free. Now locking as 'shared' (1 active user) >Thread-1043::DEBUG::2014-07-10 08:04:14,506::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9`ReqID=`bdaa2bd6-0c7a-434f-90e6-3b5048726ed0`::Granted request >Thread-1043::DEBUG::2014-07-10 08:04:14,506::task::827::TaskManager.Task::(resourceAcquired) Task=`3f396646-0fd5-4c8f-8b74-8f0498ddbc00`::_resourcesAcquired: Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9 (shared) >Thread-1043::DEBUG::2014-07-10 08:04:14,506::task::990::TaskManager.Task::(_decref) Task=`3f396646-0fd5-4c8f-8b74-8f0498ddbc00`::ref 1 aborting False >Thread-1043::INFO::2014-07-10 08:04:14,508::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DC-REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2, 'domains': u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': 'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c': {'status': u'Active', 'diskfree': '1137495244800', 'isoprefix': '', 'alerts': [], 'disktotal': '1152393412608', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '533841575936', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-1043::DEBUG::2014-07-10 08:04:14,508::task::1185::TaskManager.Task::(prepare) Task=`3f396646-0fd5-4c8f-8b74-8f0498ddbc00`::finished: {'info': {'name': 'DC-REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2, 'domains': u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': 'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c': {'status': u'Active', 'diskfree': '1137495244800', 'isoprefix': '', 'alerts': [], 'disktotal': '1152393412608', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '533841575936', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-1043::DEBUG::2014-07-10 08:04:14,508::task::595::TaskManager.Task::(_updateState) Task=`3f396646-0fd5-4c8f-8b74-8f0498ddbc00`::moving from state preparing -> state finished >Thread-1043::DEBUG::2014-07-10 08:04:14,508::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9': < ResourceRef 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9', isValid: 'True' obj: 'None'>} >Thread-1043::DEBUG::2014-07-10 08:04:14,508::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1043::DEBUG::2014-07-10 08:04:14,509::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' >Thread-1043::DEBUG::2014-07-10 08:04:14,509::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' (0 active users) >Thread-1043::DEBUG::2014-07-10 08:04:14,509::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' is free, finding out if anyone is waiting for it. >Thread-1043::DEBUG::2014-07-10 08:04:14,509::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9', Clearing records. >Thread-1043::DEBUG::2014-07-10 08:04:14,510::task::990::TaskManager.Task::(_decref) Task=`3f396646-0fd5-4c8f-8b74-8f0498ddbc00`::ref 0 aborting False >Thread-14::DEBUG::2014-07-10 08:04:15,857::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lion.qa.lab.tlv.redhat.com:_export_yuri2_backup2/6a70504d-00df-4869-8695-0f442053f6b6/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-14::DEBUG::2014-07-10 08:04:15,923::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n369 bytes (369 B) copied, 0.000544216 s, 678 kB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-07-10 08:04:16,387::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Thread-15::DEBUG::2014-07-10 08:04:16,499::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/e01a3a36-d2ce-4153-bb57-d6e65b7ed08c/metadata bs=4096 count=1' (cwd None) >Thread-15::DEBUG::2014-07-10 08:04:16,598::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00256046 s, 1.6 MB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-07-10 08:04:17,479::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.04259 s, 24.0 MB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-07-10 08:04:19,545::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-07-10 08:04:19,722::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.08084 s, 12.7 MB/s\n'; <rc> = 0 >Thread-1042::DEBUG::2014-07-10 08:04:21,690::task::595::TaskManager.Task::(_updateState) Task=`a3fca1d5-480b-4165-8df2-cc0b8b0030bb`::moving from state init -> state preparing >Thread-1042::INFO::2014-07-10 08:04:21,691::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-1042::INFO::2014-07-10 08:04:21,691::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00256046', 'lastCheck': '4.4', 'valid': True}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000544216', 'lastCheck': '5.8', 'valid': True}} >Thread-1042::DEBUG::2014-07-10 08:04:21,692::task::1185::TaskManager.Task::(prepare) Task=`a3fca1d5-480b-4165-8df2-cc0b8b0030bb`::finished: {u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00256046', 'lastCheck': '4.4', 'valid': True}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000544216', 'lastCheck': '5.8', 'valid': True}} >Thread-1042::DEBUG::2014-07-10 08:04:21,692::task::595::TaskManager.Task::(_updateState) Task=`a3fca1d5-480b-4165-8df2-cc0b8b0030bb`::moving from state preparing -> state finished >Thread-1042::DEBUG::2014-07-10 08:04:21,692::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-1042::DEBUG::2014-07-10 08:04:21,692::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1042::DEBUG::2014-07-10 08:04:21,692::task::990::TaskManager.Task::(_decref) Task=`a3fca1d5-480b-4165-8df2-cc0b8b0030bb`::ref 0 aborting False >Dummy-36::DEBUG::2014-07-10 08:04:21,738::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-07-10 08:04:21,905::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0675162 s, 15.2 MB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-07-10 08:04:23,920::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-07-10 08:04:24,065::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0479053 s, 21.4 MB/s\n'; <rc> = 0 >Thread-1042::DEBUG::2014-07-10 08:04:24,538::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-1042::DEBUG::2014-07-10 08:04:24,539::task::595::TaskManager.Task::(_updateState) Task=`ef105ad3-76dc-4f9e-bca1-79b99a9aee4f`::moving from state init -> state preparing >Thread-1042::INFO::2014-07-10 08:04:24,540::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='411039e4-4af2-4192-9de0-67dc1ed83ba9', options=None) >Thread-1042::INFO::2014-07-10 08:04:24,540::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2}} >Thread-1042::DEBUG::2014-07-10 08:04:24,541::task::1185::TaskManager.Task::(prepare) Task=`ef105ad3-76dc-4f9e-bca1-79b99a9aee4f`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2}} >Thread-1042::DEBUG::2014-07-10 08:04:24,541::task::595::TaskManager.Task::(_updateState) Task=`ef105ad3-76dc-4f9e-bca1-79b99a9aee4f`::moving from state preparing -> state finished >Thread-1042::DEBUG::2014-07-10 08:04:24,541::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-1042::DEBUG::2014-07-10 08:04:24,541::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1042::DEBUG::2014-07-10 08:04:24,541::task::990::TaskManager.Task::(_decref) Task=`ef105ad3-76dc-4f9e-bca1-79b99a9aee4f`::ref 0 aborting False >Thread-1043::DEBUG::2014-07-10 08:04:24,545::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-1043::DEBUG::2014-07-10 08:04:24,546::task::595::TaskManager.Task::(_updateState) Task=`06bc566f-454c-40a5-b4a9-0b8fed7ff021`::moving from state init -> state preparing >Thread-1043::INFO::2014-07-10 08:04:24,546::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='411039e4-4af2-4192-9de0-67dc1ed83ba9', options=None) >Thread-1043::DEBUG::2014-07-10 08:04:24,547::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9`ReqID=`5164ea04-c451-43f8-9f83-2f597ec36f6a`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo' >Thread-1043::DEBUG::2014-07-10 08:04:24,547::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' for lock type 'shared' >Thread-1043::DEBUG::2014-07-10 08:04:24,547::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' is free. Now locking as 'shared' (1 active user) >Thread-1043::DEBUG::2014-07-10 08:04:24,548::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9`ReqID=`5164ea04-c451-43f8-9f83-2f597ec36f6a`::Granted request >Thread-1043::DEBUG::2014-07-10 08:04:24,548::task::827::TaskManager.Task::(resourceAcquired) Task=`06bc566f-454c-40a5-b4a9-0b8fed7ff021`::_resourcesAcquired: Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9 (shared) >Thread-1043::DEBUG::2014-07-10 08:04:24,548::task::990::TaskManager.Task::(_decref) Task=`06bc566f-454c-40a5-b4a9-0b8fed7ff021`::ref 1 aborting False >Thread-1043::INFO::2014-07-10 08:04:24,549::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DC-REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2, 'domains': u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': 'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c': {'status': u'Active', 'diskfree': '1137495244800', 'isoprefix': '', 'alerts': [], 'disktotal': '1152393412608', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '533841575936', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-1043::DEBUG::2014-07-10 08:04:24,550::task::1185::TaskManager.Task::(prepare) Task=`06bc566f-454c-40a5-b4a9-0b8fed7ff021`::finished: {'info': {'name': 'DC-REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2, 'domains': u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': 'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c': {'status': u'Active', 'diskfree': '1137495244800', 'isoprefix': '', 'alerts': [], 'disktotal': '1152393412608', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '533841575936', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-1043::DEBUG::2014-07-10 08:04:24,550::task::595::TaskManager.Task::(_updateState) Task=`06bc566f-454c-40a5-b4a9-0b8fed7ff021`::moving from state preparing -> state finished >Thread-1043::DEBUG::2014-07-10 08:04:24,550::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9': < ResourceRef 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9', isValid: 'True' obj: 'None'>} >Thread-1043::DEBUG::2014-07-10 08:04:24,550::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1043::DEBUG::2014-07-10 08:04:24,551::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' >Thread-1043::DEBUG::2014-07-10 08:04:24,551::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' (0 active users) >Thread-1043::DEBUG::2014-07-10 08:04:24,551::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' is free, finding out if anyone is waiting for it. >Thread-1043::DEBUG::2014-07-10 08:04:24,551::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9', Clearing records. >Thread-1043::DEBUG::2014-07-10 08:04:24,551::task::990::TaskManager.Task::(_decref) Task=`06bc566f-454c-40a5-b4a9-0b8fed7ff021`::ref 0 aborting False >Thread-14::DEBUG::2014-07-10 08:04:25,948::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lion.qa.lab.tlv.redhat.com:_export_yuri2_backup2/6a70504d-00df-4869-8695-0f442053f6b6/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-14::DEBUG::2014-07-10 08:04:26,010::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n369 bytes (369 B) copied, 0.000474133 s, 778 kB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-07-10 08:04:26,090::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-07-10 08:04:26,263::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0685726 s, 14.9 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-07-10 08:04:27,264::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/e01a3a36-d2ce-4153-bb57-d6e65b7ed08c/metadata bs=4096 count=1' (cwd None) >Thread-15::DEBUG::2014-07-10 08:04:27,335::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00823296 s, 498 kB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-07-10 08:04:28,278::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-07-10 08:04:28,427::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0466368 s, 22.0 MB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-07-10 08:04:30,442::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-07-10 08:04:30,579::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.038013 s, 26.9 MB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-07-10 08:04:32,594::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-07-10 08:04:32,727::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0322088 s, 31.8 MB/s\n'; <rc> = 0 >Thread-1042::DEBUG::2014-07-10 08:04:34,570::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-1042::DEBUG::2014-07-10 08:04:34,571::task::595::TaskManager.Task::(_updateState) Task=`575d71b6-a612-4bb3-ad29-f17ef6eef473`::moving from state init -> state preparing >Thread-1042::INFO::2014-07-10 08:04:34,571::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='411039e4-4af2-4192-9de0-67dc1ed83ba9', options=None) >Thread-1042::INFO::2014-07-10 08:04:34,572::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2}} >Thread-1042::DEBUG::2014-07-10 08:04:34,572::task::1185::TaskManager.Task::(prepare) Task=`575d71b6-a612-4bb3-ad29-f17ef6eef473`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2}} >Thread-1042::DEBUG::2014-07-10 08:04:34,572::task::595::TaskManager.Task::(_updateState) Task=`575d71b6-a612-4bb3-ad29-f17ef6eef473`::moving from state preparing -> state finished >Thread-1042::DEBUG::2014-07-10 08:04:34,572::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-1042::DEBUG::2014-07-10 08:04:34,573::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1042::DEBUG::2014-07-10 08:04:34,573::task::990::TaskManager.Task::(_decref) Task=`575d71b6-a612-4bb3-ad29-f17ef6eef473`::ref 0 aborting False >Thread-1043::DEBUG::2014-07-10 08:04:34,576::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-1043::DEBUG::2014-07-10 08:04:34,577::task::595::TaskManager.Task::(_updateState) Task=`60a658c6-c7e5-4bfd-8872-4beebd8ca1f0`::moving from state init -> state preparing >Thread-1043::INFO::2014-07-10 08:04:34,577::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='411039e4-4af2-4192-9de0-67dc1ed83ba9', options=None) >Thread-1043::DEBUG::2014-07-10 08:04:34,578::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9`ReqID=`40fcb04e-ba2c-43fe-8ec0-7fc9dbe21646`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo' >Thread-1043::DEBUG::2014-07-10 08:04:34,578::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' for lock type 'shared' >Thread-1043::DEBUG::2014-07-10 08:04:34,578::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' is free. Now locking as 'shared' (1 active user) >Thread-1043::DEBUG::2014-07-10 08:04:34,578::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9`ReqID=`40fcb04e-ba2c-43fe-8ec0-7fc9dbe21646`::Granted request >Thread-1043::DEBUG::2014-07-10 08:04:34,579::task::827::TaskManager.Task::(resourceAcquired) Task=`60a658c6-c7e5-4bfd-8872-4beebd8ca1f0`::_resourcesAcquired: Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9 (shared) >Thread-1043::DEBUG::2014-07-10 08:04:34,579::task::990::TaskManager.Task::(_decref) Task=`60a658c6-c7e5-4bfd-8872-4beebd8ca1f0`::ref 1 aborting False >Thread-1043::INFO::2014-07-10 08:04:34,580::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DC-REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2, 'domains': u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': 'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c': {'status': u'Active', 'diskfree': '1137495244800', 'isoprefix': '', 'alerts': [], 'disktotal': '1152393412608', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '533841575936', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-1043::DEBUG::2014-07-10 08:04:34,580::task::1185::TaskManager.Task::(prepare) Task=`60a658c6-c7e5-4bfd-8872-4beebd8ca1f0`::finished: {'info': {'name': 'DC-REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2, 'domains': u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': 'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c': {'status': u'Active', 'diskfree': '1137495244800', 'isoprefix': '', 'alerts': [], 'disktotal': '1152393412608', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '533841575936', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-1043::DEBUG::2014-07-10 08:04:34,580::task::595::TaskManager.Task::(_updateState) Task=`60a658c6-c7e5-4bfd-8872-4beebd8ca1f0`::moving from state preparing -> state finished >Thread-1043::DEBUG::2014-07-10 08:04:34,580::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9': < ResourceRef 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9', isValid: 'True' obj: 'None'>} >Thread-1043::DEBUG::2014-07-10 08:04:34,581::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1043::DEBUG::2014-07-10 08:04:34,581::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' >Thread-1043::DEBUG::2014-07-10 08:04:34,581::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' (0 active users) >Thread-1043::DEBUG::2014-07-10 08:04:34,581::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' is free, finding out if anyone is waiting for it. >Thread-1043::DEBUG::2014-07-10 08:04:34,581::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9', Clearing records. >Thread-1043::DEBUG::2014-07-10 08:04:34,582::task::990::TaskManager.Task::(_decref) Task=`60a658c6-c7e5-4bfd-8872-4beebd8ca1f0`::ref 0 aborting False >Dummy-36::DEBUG::2014-07-10 08:04:34,742::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-07-10 08:04:34,873::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0326941 s, 31.3 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 08:04:36,041::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lion.qa.lab.tlv.redhat.com:_export_yuri2_backup2/6a70504d-00df-4869-8695-0f442053f6b6/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-14::DEBUG::2014-07-10 08:04:36,106::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n369 bytes (369 B) copied, 0.000384781 s, 959 kB/s\n'; <rc> = 0 >Thread-1042::DEBUG::2014-07-10 08:04:36,824::task::595::TaskManager.Task::(_updateState) Task=`d753c4e6-c76a-4d06-a500-c3d6817f90ff`::moving from state init -> state preparing >Thread-1042::INFO::2014-07-10 08:04:36,825::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-1042::INFO::2014-07-10 08:04:36,825::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00823296', 'lastCheck': '9.5', 'valid': True}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000384781', 'lastCheck': '0.7', 'valid': True}} >Thread-1042::DEBUG::2014-07-10 08:04:36,826::task::1185::TaskManager.Task::(prepare) Task=`d753c4e6-c76a-4d06-a500-c3d6817f90ff`::finished: {u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00823296', 'lastCheck': '9.5', 'valid': True}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000384781', 'lastCheck': '0.7', 'valid': True}} >Thread-1042::DEBUG::2014-07-10 08:04:36,826::task::595::TaskManager.Task::(_updateState) Task=`d753c4e6-c76a-4d06-a500-c3d6817f90ff`::moving from state preparing -> state finished >Thread-1042::DEBUG::2014-07-10 08:04:36,826::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-1042::DEBUG::2014-07-10 08:04:36,826::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1042::DEBUG::2014-07-10 08:04:36,826::task::990::TaskManager.Task::(_decref) Task=`d753c4e6-c76a-4d06-a500-c3d6817f90ff`::ref 0 aborting False >Dummy-36::DEBUG::2014-07-10 08:04:36,889::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-07-10 08:04:37,028::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0377778 s, 27.1 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-07-10 08:04:37,365::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/e01a3a36-d2ce-4153-bb57-d6e65b7ed08c/metadata bs=4096 count=1' (cwd None) >Thread-15::DEBUG::2014-07-10 08:04:37,425::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000725533 s, 5.6 MB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-07-10 08:04:39,043::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-07-10 08:04:39,185::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0381762 s, 26.8 MB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-07-10 08:04:41,200::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-07-10 08:04:41,333::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0322516 s, 31.8 MB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-07-10 08:04:43,348::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-07-10 08:04:43,480::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0335726 s, 30.5 MB/s\n'; <rc> = 0 >Thread-1042::DEBUG::2014-07-10 08:04:44,604::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-1042::DEBUG::2014-07-10 08:04:44,605::task::595::TaskManager.Task::(_updateState) Task=`ca6e133f-2fdc-49af-bde8-c0ebb0b56171`::moving from state init -> state preparing >Thread-1042::INFO::2014-07-10 08:04:44,605::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='411039e4-4af2-4192-9de0-67dc1ed83ba9', options=None) >Thread-1042::INFO::2014-07-10 08:04:44,606::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2}} >Thread-1042::DEBUG::2014-07-10 08:04:44,606::task::1185::TaskManager.Task::(prepare) Task=`ca6e133f-2fdc-49af-bde8-c0ebb0b56171`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2}} >Thread-1042::DEBUG::2014-07-10 08:04:44,606::task::595::TaskManager.Task::(_updateState) Task=`ca6e133f-2fdc-49af-bde8-c0ebb0b56171`::moving from state preparing -> state finished >Thread-1042::DEBUG::2014-07-10 08:04:44,606::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-1042::DEBUG::2014-07-10 08:04:44,607::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1042::DEBUG::2014-07-10 08:04:44,607::task::990::TaskManager.Task::(_decref) Task=`ca6e133f-2fdc-49af-bde8-c0ebb0b56171`::ref 0 aborting False >Thread-1043::DEBUG::2014-07-10 08:04:44,611::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-1043::DEBUG::2014-07-10 08:04:44,611::task::595::TaskManager.Task::(_updateState) Task=`25b8e0a1-a26d-4563-b051-5b227b1c4996`::moving from state init -> state preparing >Thread-1043::INFO::2014-07-10 08:04:44,611::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='411039e4-4af2-4192-9de0-67dc1ed83ba9', options=None) >Thread-1043::DEBUG::2014-07-10 08:04:44,612::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9`ReqID=`da1a5e96-0f4e-44f7-b60f-667d8607b692`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo' >Thread-1043::DEBUG::2014-07-10 08:04:44,612::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' for lock type 'shared' >Thread-1043::DEBUG::2014-07-10 08:04:44,613::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' is free. Now locking as 'shared' (1 active user) >Thread-1043::DEBUG::2014-07-10 08:04:44,613::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9`ReqID=`da1a5e96-0f4e-44f7-b60f-667d8607b692`::Granted request >Thread-1043::DEBUG::2014-07-10 08:04:44,613::task::827::TaskManager.Task::(resourceAcquired) Task=`25b8e0a1-a26d-4563-b051-5b227b1c4996`::_resourcesAcquired: Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9 (shared) >Thread-1043::DEBUG::2014-07-10 08:04:44,613::task::990::TaskManager.Task::(_decref) Task=`25b8e0a1-a26d-4563-b051-5b227b1c4996`::ref 1 aborting False >Thread-1043::INFO::2014-07-10 08:04:44,615::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DC-REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2, 'domains': u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': 'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c': {'status': u'Active', 'diskfree': '1137495244800', 'isoprefix': '', 'alerts': [], 'disktotal': '1152393412608', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '533841575936', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-1043::DEBUG::2014-07-10 08:04:44,615::task::1185::TaskManager.Task::(prepare) Task=`25b8e0a1-a26d-4563-b051-5b227b1c4996`::finished: {'info': {'name': 'DC-REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2, 'domains': u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': 'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c': {'status': u'Active', 'diskfree': '1137495244800', 'isoprefix': '', 'alerts': [], 'disktotal': '1152393412608', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '533841575936', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-1043::DEBUG::2014-07-10 08:04:44,615::task::595::TaskManager.Task::(_updateState) Task=`25b8e0a1-a26d-4563-b051-5b227b1c4996`::moving from state preparing -> state finished >Thread-1043::DEBUG::2014-07-10 08:04:44,615::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9': < ResourceRef 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9', isValid: 'True' obj: 'None'>} >Thread-1043::DEBUG::2014-07-10 08:04:44,616::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1043::DEBUG::2014-07-10 08:04:44,616::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' >Thread-1043::DEBUG::2014-07-10 08:04:44,616::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' (0 active users) >Thread-1043::DEBUG::2014-07-10 08:04:44,616::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' is free, finding out if anyone is waiting for it. >Thread-1043::DEBUG::2014-07-10 08:04:44,616::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9', Clearing records. >Thread-1043::DEBUG::2014-07-10 08:04:44,617::task::990::TaskManager.Task::(_decref) Task=`25b8e0a1-a26d-4563-b051-5b227b1c4996`::ref 0 aborting False >Dummy-36::DEBUG::2014-07-10 08:04:45,495::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-07-10 08:04:45,626::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0353151 s, 29.0 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 08:04:46,136::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lion.qa.lab.tlv.redhat.com:_export_yuri2_backup2/6a70504d-00df-4869-8695-0f442053f6b6/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-14::DEBUG::2014-07-10 08:04:46,195::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n369 bytes (369 B) copied, 0.000431704 s, 855 kB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-07-10 08:04:47,454::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/e01a3a36-d2ce-4153-bb57-d6e65b7ed08c/metadata bs=4096 count=1' (cwd None) >Thread-15::DEBUG::2014-07-10 08:04:47,516::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000862998 s, 4.7 MB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-07-10 08:04:47,644::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-07-10 08:04:47,783::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0428697 s, 23.9 MB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-07-10 08:04:49,798::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-07-10 08:04:49,938::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0435575 s, 23.5 MB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-07-10 08:04:51,953::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Thread-1042::DEBUG::2014-07-10 08:04:52,026::task::595::TaskManager.Task::(_updateState) Task=`57f1d56a-09e7-4613-9c66-528e71bbbcd5`::moving from state init -> state preparing >Thread-1042::INFO::2014-07-10 08:04:52,030::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-1042::INFO::2014-07-10 08:04:52,034::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000862998', 'lastCheck': '4.5', 'valid': True}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000431704', 'lastCheck': '5.8', 'valid': True}} >Thread-1042::DEBUG::2014-07-10 08:04:52,036::task::1185::TaskManager.Task::(prepare) Task=`57f1d56a-09e7-4613-9c66-528e71bbbcd5`::finished: {u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000862998', 'lastCheck': '4.5', 'valid': True}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000431704', 'lastCheck': '5.8', 'valid': True}} >Thread-1042::DEBUG::2014-07-10 08:04:52,038::task::595::TaskManager.Task::(_updateState) Task=`57f1d56a-09e7-4613-9c66-528e71bbbcd5`::moving from state preparing -> state finished >Thread-1042::DEBUG::2014-07-10 08:04:52,040::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-1042::DEBUG::2014-07-10 08:04:52,042::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1042::DEBUG::2014-07-10 08:04:52,044::task::990::TaskManager.Task::(_decref) Task=`57f1d56a-09e7-4613-9c66-528e71bbbcd5`::ref 0 aborting False >Dummy-36::DEBUG::2014-07-10 08:04:52,296::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.244022 s, 4.2 MB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-07-10 08:04:54,311::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-07-10 08:04:54,438::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0296832 s, 34.5 MB/s\n'; <rc> = 0 >Thread-1042::DEBUG::2014-07-10 08:04:54,646::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-1042::DEBUG::2014-07-10 08:04:54,646::task::595::TaskManager.Task::(_updateState) Task=`f0df08a0-0d60-4387-9702-ea15b5301ecb`::moving from state init -> state preparing >Thread-1042::INFO::2014-07-10 08:04:54,647::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='411039e4-4af2-4192-9de0-67dc1ed83ba9', options=None) >Thread-1042::INFO::2014-07-10 08:04:54,647::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2}} >Thread-1042::DEBUG::2014-07-10 08:04:54,647::task::1185::TaskManager.Task::(prepare) Task=`f0df08a0-0d60-4387-9702-ea15b5301ecb`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2}} >Thread-1042::DEBUG::2014-07-10 08:04:54,648::task::595::TaskManager.Task::(_updateState) Task=`f0df08a0-0d60-4387-9702-ea15b5301ecb`::moving from state preparing -> state finished >Thread-1042::DEBUG::2014-07-10 08:04:54,648::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-1042::DEBUG::2014-07-10 08:04:54,648::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1042::DEBUG::2014-07-10 08:04:54,648::task::990::TaskManager.Task::(_decref) Task=`f0df08a0-0d60-4387-9702-ea15b5301ecb`::ref 0 aborting False >Thread-1043::DEBUG::2014-07-10 08:04:54,652::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-1043::DEBUG::2014-07-10 08:04:54,652::task::595::TaskManager.Task::(_updateState) Task=`17c1351e-8246-4a88-ae26-db1bcb2a05a2`::moving from state init -> state preparing >Thread-1043::INFO::2014-07-10 08:04:54,653::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='411039e4-4af2-4192-9de0-67dc1ed83ba9', options=None) >Thread-1043::DEBUG::2014-07-10 08:04:54,653::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9`ReqID=`c101fdf4-d193-4a9b-87d2-f21663bf5a67`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo' >Thread-1043::DEBUG::2014-07-10 08:04:54,653::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' for lock type 'shared' >Thread-1043::DEBUG::2014-07-10 08:04:54,654::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' is free. Now locking as 'shared' (1 active user) >Thread-1043::DEBUG::2014-07-10 08:04:54,654::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9`ReqID=`c101fdf4-d193-4a9b-87d2-f21663bf5a67`::Granted request >Thread-1043::DEBUG::2014-07-10 08:04:54,655::task::827::TaskManager.Task::(resourceAcquired) Task=`17c1351e-8246-4a88-ae26-db1bcb2a05a2`::_resourcesAcquired: Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9 (shared) >Thread-1043::DEBUG::2014-07-10 08:04:54,655::task::990::TaskManager.Task::(_decref) Task=`17c1351e-8246-4a88-ae26-db1bcb2a05a2`::ref 1 aborting False >Thread-1043::INFO::2014-07-10 08:04:54,656::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DC-REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2, 'domains': u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': 'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c': {'status': u'Active', 'diskfree': '1137495244800', 'isoprefix': '', 'alerts': [], 'disktotal': '1152393412608', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '533841575936', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-1043::DEBUG::2014-07-10 08:04:54,656::task::1185::TaskManager.Task::(prepare) Task=`17c1351e-8246-4a88-ae26-db1bcb2a05a2`::finished: {'info': {'name': 'DC-REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2, 'domains': u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': 'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c': {'status': u'Active', 'diskfree': '1137495244800', 'isoprefix': '', 'alerts': [], 'disktotal': '1152393412608', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '533841575936', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-1043::DEBUG::2014-07-10 08:04:54,656::task::595::TaskManager.Task::(_updateState) Task=`17c1351e-8246-4a88-ae26-db1bcb2a05a2`::moving from state preparing -> state finished >Thread-1043::DEBUG::2014-07-10 08:04:54,656::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9': < ResourceRef 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9', isValid: 'True' obj: 'None'>} >Thread-1043::DEBUG::2014-07-10 08:04:54,657::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1043::DEBUG::2014-07-10 08:04:54,657::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' >Thread-1043::DEBUG::2014-07-10 08:04:54,657::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' (0 active users) >Thread-1043::DEBUG::2014-07-10 08:04:54,657::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' is free, finding out if anyone is waiting for it. >Thread-1043::DEBUG::2014-07-10 08:04:54,658::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9', Clearing records. >Thread-1043::DEBUG::2014-07-10 08:04:54,658::task::990::TaskManager.Task::(_decref) Task=`17c1351e-8246-4a88-ae26-db1bcb2a05a2`::ref 0 aborting False >Thread-14::DEBUG::2014-07-10 08:04:56,220::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lion.qa.lab.tlv.redhat.com:_export_yuri2_backup2/6a70504d-00df-4869-8695-0f442053f6b6/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-14::DEBUG::2014-07-10 08:04:56,278::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n369 bytes (369 B) copied, 0.000454753 s, 811 kB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-07-10 08:04:56,454::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-07-10 08:04:56,601::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0471384 s, 21.7 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-07-10 08:04:57,545::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/e01a3a36-d2ce-4153-bb57-d6e65b7ed08c/metadata bs=4096 count=1' (cwd None) >Thread-15::DEBUG::2014-07-10 08:04:57,774::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.128225 s, 31.9 kB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-07-10 08:04:58,616::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-07-10 08:04:58,747::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0296621 s, 34.5 MB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-07-10 08:05:00,762::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-07-10 08:05:00,898::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0382651 s, 26.8 MB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-07-10 08:05:02,913::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-07-10 08:05:03,047::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0357706 s, 28.6 MB/s\n'; <rc> = 0 >Thread-1042::DEBUG::2014-07-10 08:05:04,687::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-1042::DEBUG::2014-07-10 08:05:04,688::task::595::TaskManager.Task::(_updateState) Task=`b6e20c27-f27b-4f2e-bb45-0fcaa1ecd2ce`::moving from state init -> state preparing >Thread-1042::INFO::2014-07-10 08:05:04,688::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='411039e4-4af2-4192-9de0-67dc1ed83ba9', options=None) >Thread-1042::INFO::2014-07-10 08:05:04,689::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2}} >Thread-1042::DEBUG::2014-07-10 08:05:04,689::task::1185::TaskManager.Task::(prepare) Task=`b6e20c27-f27b-4f2e-bb45-0fcaa1ecd2ce`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2}} >Thread-1042::DEBUG::2014-07-10 08:05:04,689::task::595::TaskManager.Task::(_updateState) Task=`b6e20c27-f27b-4f2e-bb45-0fcaa1ecd2ce`::moving from state preparing -> state finished >Thread-1042::DEBUG::2014-07-10 08:05:04,689::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-1042::DEBUG::2014-07-10 08:05:04,689::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1042::DEBUG::2014-07-10 08:05:04,690::task::990::TaskManager.Task::(_decref) Task=`b6e20c27-f27b-4f2e-bb45-0fcaa1ecd2ce`::ref 0 aborting False >Thread-1043::DEBUG::2014-07-10 08:05:04,693::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-1043::DEBUG::2014-07-10 08:05:04,693::task::595::TaskManager.Task::(_updateState) Task=`9e735b0b-f3a5-4a8a-af30-2291d8119781`::moving from state init -> state preparing >Thread-1043::INFO::2014-07-10 08:05:04,694::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='411039e4-4af2-4192-9de0-67dc1ed83ba9', options=None) >Thread-1043::DEBUG::2014-07-10 08:05:04,694::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9`ReqID=`73a8b2d5-90a3-4846-9514-a609349591a9`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo' >Thread-1043::DEBUG::2014-07-10 08:05:04,694::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' for lock type 'shared' >Thread-1043::DEBUG::2014-07-10 08:05:04,697::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' is free. Now locking as 'shared' (1 active user) >Thread-1043::DEBUG::2014-07-10 08:05:04,697::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9`ReqID=`73a8b2d5-90a3-4846-9514-a609349591a9`::Granted request >Thread-1043::DEBUG::2014-07-10 08:05:04,697::task::827::TaskManager.Task::(resourceAcquired) Task=`9e735b0b-f3a5-4a8a-af30-2291d8119781`::_resourcesAcquired: Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9 (shared) >Thread-1043::DEBUG::2014-07-10 08:05:04,697::task::990::TaskManager.Task::(_decref) Task=`9e735b0b-f3a5-4a8a-af30-2291d8119781`::ref 1 aborting False >Thread-1043::INFO::2014-07-10 08:05:04,698::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DC-REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2, 'domains': u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': 'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c': {'status': u'Active', 'diskfree': '1137495244800', 'isoprefix': '', 'alerts': [], 'disktotal': '1152393412608', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '533841575936', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-1043::DEBUG::2014-07-10 08:05:04,699::task::1185::TaskManager.Task::(prepare) Task=`9e735b0b-f3a5-4a8a-af30-2291d8119781`::finished: {'info': {'name': 'DC-REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2, 'domains': u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': 'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c': {'status': u'Active', 'diskfree': '1137495244800', 'isoprefix': '', 'alerts': [], 'disktotal': '1152393412608', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '533841575936', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-1043::DEBUG::2014-07-10 08:05:04,699::task::595::TaskManager.Task::(_updateState) Task=`9e735b0b-f3a5-4a8a-af30-2291d8119781`::moving from state preparing -> state finished >Thread-1043::DEBUG::2014-07-10 08:05:04,699::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9': < ResourceRef 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9', isValid: 'True' obj: 'None'>} >Thread-1043::DEBUG::2014-07-10 08:05:04,699::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1043::DEBUG::2014-07-10 08:05:04,699::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' >Thread-1043::DEBUG::2014-07-10 08:05:04,700::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' (0 active users) >Thread-1043::DEBUG::2014-07-10 08:05:04,700::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' is free, finding out if anyone is waiting for it. >Thread-1043::DEBUG::2014-07-10 08:05:04,700::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9', Clearing records. >Thread-1043::DEBUG::2014-07-10 08:05:04,700::task::990::TaskManager.Task::(_decref) Task=`9e735b0b-f3a5-4a8a-af30-2291d8119781`::ref 0 aborting False >Dummy-36::DEBUG::2014-07-10 08:05:05,062::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-07-10 08:05:05,195::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0323467 s, 31.7 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 08:05:06,308::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lion.qa.lab.tlv.redhat.com:_export_yuri2_backup2/6a70504d-00df-4869-8695-0f442053f6b6/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-14::DEBUG::2014-07-10 08:05:06,371::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n369 bytes (369 B) copied, 0.000498229 s, 741 kB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-07-10 08:05:07,210::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-07-10 08:05:07,353::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0390781 s, 26.2 MB/s\n'; <rc> = 0 >Thread-1042::DEBUG::2014-07-10 08:05:07,368::task::595::TaskManager.Task::(_updateState) Task=`349eda48-d1df-49d6-8229-05f6cfc5a9ac`::moving from state init -> state preparing >Thread-1042::INFO::2014-07-10 08:05:07,369::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-1042::INFO::2014-07-10 08:05:07,371::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.128225', 'lastCheck': '9.4', 'valid': True}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000498229', 'lastCheck': '1.0', 'valid': True}} >Thread-1042::DEBUG::2014-07-10 08:05:07,371::task::1185::TaskManager.Task::(prepare) Task=`349eda48-d1df-49d6-8229-05f6cfc5a9ac`::finished: {u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.128225', 'lastCheck': '9.4', 'valid': True}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000498229', 'lastCheck': '1.0', 'valid': True}} >Thread-1042::DEBUG::2014-07-10 08:05:07,372::task::595::TaskManager.Task::(_updateState) Task=`349eda48-d1df-49d6-8229-05f6cfc5a9ac`::moving from state preparing -> state finished >Thread-1042::DEBUG::2014-07-10 08:05:07,373::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-1042::DEBUG::2014-07-10 08:05:07,374::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1042::DEBUG::2014-07-10 08:05:07,375::task::990::TaskManager.Task::(_decref) Task=`349eda48-d1df-49d6-8229-05f6cfc5a9ac`::ref 0 aborting False >Thread-15::DEBUG::2014-07-10 08:05:07,982::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/e01a3a36-d2ce-4153-bb57-d6e65b7ed08c/metadata bs=4096 count=1' (cwd None) >Thread-15::DEBUG::2014-07-10 08:05:08,069::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000740868 s, 5.5 MB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-07-10 08:05:09,437::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-07-10 08:05:09,571::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0374692 s, 27.3 MB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-07-10 08:05:11,586::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-07-10 08:05:11,717::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0322373 s, 31.8 MB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-07-10 08:05:13,732::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-07-10 08:05:13,866::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0325291 s, 31.5 MB/s\n'; <rc> = 0 >Thread-1042::DEBUG::2014-07-10 08:05:14,720::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-1042::DEBUG::2014-07-10 08:05:14,721::task::595::TaskManager.Task::(_updateState) Task=`c72a4f86-8bf3-41e6-a389-559d7222372e`::moving from state init -> state preparing >Thread-1042::INFO::2014-07-10 08:05:14,722::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='411039e4-4af2-4192-9de0-67dc1ed83ba9', options=None) >Thread-1042::INFO::2014-07-10 08:05:14,722::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2}} >Thread-1042::DEBUG::2014-07-10 08:05:14,722::task::1185::TaskManager.Task::(prepare) Task=`c72a4f86-8bf3-41e6-a389-559d7222372e`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2}} >Thread-1042::DEBUG::2014-07-10 08:05:14,723::task::595::TaskManager.Task::(_updateState) Task=`c72a4f86-8bf3-41e6-a389-559d7222372e`::moving from state preparing -> state finished >Thread-1042::DEBUG::2014-07-10 08:05:14,723::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-1042::DEBUG::2014-07-10 08:05:14,723::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1042::DEBUG::2014-07-10 08:05:14,723::task::990::TaskManager.Task::(_decref) Task=`c72a4f86-8bf3-41e6-a389-559d7222372e`::ref 0 aborting False >Thread-1043::DEBUG::2014-07-10 08:05:14,727::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-1043::DEBUG::2014-07-10 08:05:14,727::task::595::TaskManager.Task::(_updateState) Task=`5a0f35e6-7e5e-4adc-9977-97b64cac6dd9`::moving from state init -> state preparing >Thread-1043::INFO::2014-07-10 08:05:14,728::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='411039e4-4af2-4192-9de0-67dc1ed83ba9', options=None) >Thread-1043::DEBUG::2014-07-10 08:05:14,728::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9`ReqID=`3f58f70d-92f9-4e7b-9446-eeb4cf5af399`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo' >Thread-1043::DEBUG::2014-07-10 08:05:14,729::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' for lock type 'shared' >Thread-1043::DEBUG::2014-07-10 08:05:14,729::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' is free. Now locking as 'shared' (1 active user) >Thread-1043::DEBUG::2014-07-10 08:05:14,729::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9`ReqID=`3f58f70d-92f9-4e7b-9446-eeb4cf5af399`::Granted request >Thread-1043::DEBUG::2014-07-10 08:05:14,730::task::827::TaskManager.Task::(resourceAcquired) Task=`5a0f35e6-7e5e-4adc-9977-97b64cac6dd9`::_resourcesAcquired: Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9 (shared) >Thread-1043::DEBUG::2014-07-10 08:05:14,730::task::990::TaskManager.Task::(_decref) Task=`5a0f35e6-7e5e-4adc-9977-97b64cac6dd9`::ref 1 aborting False >Thread-1043::INFO::2014-07-10 08:05:14,731::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DC-REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2, 'domains': u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': 'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c': {'status': u'Active', 'diskfree': '1137495244800', 'isoprefix': '', 'alerts': [], 'disktotal': '1152393412608', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '533841575936', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-1043::DEBUG::2014-07-10 08:05:14,731::task::1185::TaskManager.Task::(prepare) Task=`5a0f35e6-7e5e-4adc-9977-97b64cac6dd9`::finished: {'info': {'name': 'DC-REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2, 'domains': u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': 'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c': {'status': u'Active', 'diskfree': '1137495244800', 'isoprefix': '', 'alerts': [], 'disktotal': '1152393412608', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '533841575936', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-1043::DEBUG::2014-07-10 08:05:14,732::task::595::TaskManager.Task::(_updateState) Task=`5a0f35e6-7e5e-4adc-9977-97b64cac6dd9`::moving from state preparing -> state finished >Thread-1043::DEBUG::2014-07-10 08:05:14,732::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9': < ResourceRef 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9', isValid: 'True' obj: 'None'>} >Thread-1043::DEBUG::2014-07-10 08:05:14,732::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1043::DEBUG::2014-07-10 08:05:14,732::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' >Thread-1043::DEBUG::2014-07-10 08:05:14,732::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' (0 active users) >Thread-1043::DEBUG::2014-07-10 08:05:14,733::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' is free, finding out if anyone is waiting for it. >Thread-1043::DEBUG::2014-07-10 08:05:14,733::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9', Clearing records. >Thread-1043::DEBUG::2014-07-10 08:05:14,733::task::990::TaskManager.Task::(_decref) Task=`5a0f35e6-7e5e-4adc-9977-97b64cac6dd9`::ref 0 aborting False >Dummy-36::DEBUG::2014-07-10 08:05:15,881::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-07-10 08:05:16,015::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0355756 s, 28.8 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 08:05:16,402::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lion.qa.lab.tlv.redhat.com:_export_yuri2_backup2/6a70504d-00df-4869-8695-0f442053f6b6/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-14::DEBUG::2014-07-10 08:05:16,464::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n369 bytes (369 B) copied, 0.000475842 s, 775 kB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-07-10 08:05:18,033::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Thread-15::DEBUG::2014-07-10 08:05:18,108::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/e01a3a36-d2ce-4153-bb57-d6e65b7ed08c/metadata bs=4096 count=1' (cwd None) >Thread-15::DEBUG::2014-07-10 08:05:18,332::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00441165 s, 928 kB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-07-10 08:05:19,197::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 1.06301 s, 963 kB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-07-10 08:05:21,214::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-07-10 08:05:21,350::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.032463 s, 31.5 MB/s\n'; <rc> = 0 >Thread-1042::DEBUG::2014-07-10 08:05:22,635::task::595::TaskManager.Task::(_updateState) Task=`fe88395f-cff7-4371-a386-97d86a0d0f3c`::moving from state init -> state preparing >Thread-1042::INFO::2014-07-10 08:05:22,635::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-1042::INFO::2014-07-10 08:05:22,636::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00441165', 'lastCheck': '3.5', 'valid': True}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000475842', 'lastCheck': '6.2', 'valid': True}} >Thread-1042::DEBUG::2014-07-10 08:05:22,636::task::1185::TaskManager.Task::(prepare) Task=`fe88395f-cff7-4371-a386-97d86a0d0f3c`::finished: {u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00441165', 'lastCheck': '3.5', 'valid': True}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000475842', 'lastCheck': '6.2', 'valid': True}} >Thread-1042::DEBUG::2014-07-10 08:05:22,636::task::595::TaskManager.Task::(_updateState) Task=`fe88395f-cff7-4371-a386-97d86a0d0f3c`::moving from state preparing -> state finished >Thread-1042::DEBUG::2014-07-10 08:05:22,636::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-1042::DEBUG::2014-07-10 08:05:22,637::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1042::DEBUG::2014-07-10 08:05:22,637::task::990::TaskManager.Task::(_decref) Task=`fe88395f-cff7-4371-a386-97d86a0d0f3c`::ref 0 aborting False >Dummy-36::DEBUG::2014-07-10 08:05:23,365::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-07-10 08:05:23,504::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.038136 s, 26.9 MB/s\n'; <rc> = 0 >Thread-1042::DEBUG::2014-07-10 08:05:24,763::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-1042::DEBUG::2014-07-10 08:05:24,764::task::595::TaskManager.Task::(_updateState) Task=`e4cf635c-9911-4b40-9e4e-5d6f9e2bc01f`::moving from state init -> state preparing >Thread-1042::INFO::2014-07-10 08:05:24,764::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='411039e4-4af2-4192-9de0-67dc1ed83ba9', options=None) >Thread-1042::INFO::2014-07-10 08:05:24,764::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2}} >Thread-1042::DEBUG::2014-07-10 08:05:24,765::task::1185::TaskManager.Task::(prepare) Task=`e4cf635c-9911-4b40-9e4e-5d6f9e2bc01f`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2}} >Thread-1042::DEBUG::2014-07-10 08:05:24,765::task::595::TaskManager.Task::(_updateState) Task=`e4cf635c-9911-4b40-9e4e-5d6f9e2bc01f`::moving from state preparing -> state finished >Thread-1042::DEBUG::2014-07-10 08:05:24,765::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-1042::DEBUG::2014-07-10 08:05:24,765::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1042::DEBUG::2014-07-10 08:05:24,765::task::990::TaskManager.Task::(_decref) Task=`e4cf635c-9911-4b40-9e4e-5d6f9e2bc01f`::ref 0 aborting False >Thread-1043::DEBUG::2014-07-10 08:05:24,769::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-1043::DEBUG::2014-07-10 08:05:24,770::task::595::TaskManager.Task::(_updateState) Task=`a8d7df1e-2e47-4a48-ad2f-bffa0cc89f36`::moving from state init -> state preparing >Thread-1043::INFO::2014-07-10 08:05:24,770::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='411039e4-4af2-4192-9de0-67dc1ed83ba9', options=None) >Thread-1043::DEBUG::2014-07-10 08:05:24,771::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9`ReqID=`4b5ae0d7-d109-4129-a3dd-320001f66409`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo' >Thread-1043::DEBUG::2014-07-10 08:05:24,771::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' for lock type 'shared' >Thread-1043::DEBUG::2014-07-10 08:05:24,771::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' is free. Now locking as 'shared' (1 active user) >Thread-1043::DEBUG::2014-07-10 08:05:24,771::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9`ReqID=`4b5ae0d7-d109-4129-a3dd-320001f66409`::Granted request >Thread-1043::DEBUG::2014-07-10 08:05:24,772::task::827::TaskManager.Task::(resourceAcquired) Task=`a8d7df1e-2e47-4a48-ad2f-bffa0cc89f36`::_resourcesAcquired: Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9 (shared) >Thread-1043::DEBUG::2014-07-10 08:05:24,772::task::990::TaskManager.Task::(_decref) Task=`a8d7df1e-2e47-4a48-ad2f-bffa0cc89f36`::ref 1 aborting False >Thread-1043::INFO::2014-07-10 08:05:24,773::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DC-REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2, 'domains': u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': 'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c': {'status': u'Active', 'diskfree': '1137495244800', 'isoprefix': '', 'alerts': [], 'disktotal': '1152393412608', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '533841575936', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-1043::DEBUG::2014-07-10 08:05:24,774::task::1185::TaskManager.Task::(prepare) Task=`a8d7df1e-2e47-4a48-ad2f-bffa0cc89f36`::finished: {'info': {'name': 'DC-REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2, 'domains': u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': 'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c': {'status': u'Active', 'diskfree': '1137495244800', 'isoprefix': '', 'alerts': [], 'disktotal': '1152393412608', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '533841575936', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-1043::DEBUG::2014-07-10 08:05:24,774::task::595::TaskManager.Task::(_updateState) Task=`a8d7df1e-2e47-4a48-ad2f-bffa0cc89f36`::moving from state preparing -> state finished >Thread-1043::DEBUG::2014-07-10 08:05:24,774::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9': < ResourceRef 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9', isValid: 'True' obj: 'None'>} >Thread-1043::DEBUG::2014-07-10 08:05:24,774::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1043::DEBUG::2014-07-10 08:05:24,774::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' >Thread-1043::DEBUG::2014-07-10 08:05:24,775::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' (0 active users) >Thread-1043::DEBUG::2014-07-10 08:05:24,775::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' is free, finding out if anyone is waiting for it. >Thread-1043::DEBUG::2014-07-10 08:05:24,775::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9', Clearing records. >Thread-1043::DEBUG::2014-07-10 08:05:24,775::task::990::TaskManager.Task::(_decref) Task=`a8d7df1e-2e47-4a48-ad2f-bffa0cc89f36`::ref 0 aborting False >Dummy-36::DEBUG::2014-07-10 08:05:25,519::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-07-10 08:05:25,648::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0303764 s, 33.7 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 08:05:26,494::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lion.qa.lab.tlv.redhat.com:_export_yuri2_backup2/6a70504d-00df-4869-8695-0f442053f6b6/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-14::DEBUG::2014-07-10 08:05:26,561::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n369 bytes (369 B) copied, 0.000448075 s, 824 kB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-07-10 08:05:27,663::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-07-10 08:05:27,809::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0476851 s, 21.5 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-07-10 08:05:29,250::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/e01a3a36-d2ce-4153-bb57-d6e65b7ed08c/metadata bs=4096 count=1' (cwd None) >Thread-15::DEBUG::2014-07-10 08:05:29,330::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00080515 s, 5.1 MB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-07-10 08:05:29,824::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-07-10 08:05:29,968::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.03814 s, 26.8 MB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-07-10 08:05:31,983::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-07-10 08:05:32,113::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0320274 s, 32.0 MB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-07-10 08:05:34,129::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-07-10 08:05:34,268::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0383769 s, 26.7 MB/s\n'; <rc> = 0 >Thread-1042::DEBUG::2014-07-10 08:05:34,849::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-1042::DEBUG::2014-07-10 08:05:34,851::task::595::TaskManager.Task::(_updateState) Task=`1510ea64-702c-417e-a519-4ab83e78580a`::moving from state init -> state preparing >Thread-1042::INFO::2014-07-10 08:05:34,851::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='411039e4-4af2-4192-9de0-67dc1ed83ba9', options=None) >Thread-1042::INFO::2014-07-10 08:05:34,851::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2}} >Thread-1042::DEBUG::2014-07-10 08:05:34,852::task::1185::TaskManager.Task::(prepare) Task=`1510ea64-702c-417e-a519-4ab83e78580a`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2}} >Thread-1042::DEBUG::2014-07-10 08:05:34,852::task::595::TaskManager.Task::(_updateState) Task=`1510ea64-702c-417e-a519-4ab83e78580a`::moving from state preparing -> state finished >Thread-1042::DEBUG::2014-07-10 08:05:34,852::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-1042::DEBUG::2014-07-10 08:05:34,852::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1042::DEBUG::2014-07-10 08:05:34,852::task::990::TaskManager.Task::(_decref) Task=`1510ea64-702c-417e-a519-4ab83e78580a`::ref 0 aborting False >Thread-1043::DEBUG::2014-07-10 08:05:34,856::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-1043::DEBUG::2014-07-10 08:05:34,856::task::595::TaskManager.Task::(_updateState) Task=`f3c29ecd-a3e0-4bc8-a339-4ea9a5ec95e4`::moving from state init -> state preparing >Thread-1043::INFO::2014-07-10 08:05:34,856::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='411039e4-4af2-4192-9de0-67dc1ed83ba9', options=None) >Thread-1043::DEBUG::2014-07-10 08:05:34,857::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9`ReqID=`b32bd158-a938-4f0b-b746-327db38e0146`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo' >Thread-1043::DEBUG::2014-07-10 08:05:34,857::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' for lock type 'shared' >Thread-1043::DEBUG::2014-07-10 08:05:34,858::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' is free. Now locking as 'shared' (1 active user) >Thread-1043::DEBUG::2014-07-10 08:05:34,858::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9`ReqID=`b32bd158-a938-4f0b-b746-327db38e0146`::Granted request >Thread-1043::DEBUG::2014-07-10 08:05:34,858::task::827::TaskManager.Task::(resourceAcquired) Task=`f3c29ecd-a3e0-4bc8-a339-4ea9a5ec95e4`::_resourcesAcquired: Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9 (shared) >Thread-1043::DEBUG::2014-07-10 08:05:34,859::task::990::TaskManager.Task::(_decref) Task=`f3c29ecd-a3e0-4bc8-a339-4ea9a5ec95e4`::ref 1 aborting False >Thread-1043::INFO::2014-07-10 08:05:34,860::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DC-REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2, 'domains': u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': 'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c': {'status': u'Active', 'diskfree': '1137495244800', 'isoprefix': '', 'alerts': [], 'disktotal': '1152393412608', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '533841575936', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-1043::DEBUG::2014-07-10 08:05:34,860::task::1185::TaskManager.Task::(prepare) Task=`f3c29ecd-a3e0-4bc8-a339-4ea9a5ec95e4`::finished: {'info': {'name': 'DC-REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2, 'domains': u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': 'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c': {'status': u'Active', 'diskfree': '1137495244800', 'isoprefix': '', 'alerts': [], 'disktotal': '1152393412608', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '533841575936', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-1043::DEBUG::2014-07-10 08:05:34,860::task::595::TaskManager.Task::(_updateState) Task=`f3c29ecd-a3e0-4bc8-a339-4ea9a5ec95e4`::moving from state preparing -> state finished >Thread-1043::DEBUG::2014-07-10 08:05:34,860::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9': < ResourceRef 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9', isValid: 'True' obj: 'None'>} >Thread-1043::DEBUG::2014-07-10 08:05:34,860::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1043::DEBUG::2014-07-10 08:05:34,861::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' >Thread-1043::DEBUG::2014-07-10 08:05:34,861::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' (0 active users) >Thread-1043::DEBUG::2014-07-10 08:05:34,861::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' is free, finding out if anyone is waiting for it. >Thread-1043::DEBUG::2014-07-10 08:05:34,861::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9', Clearing records. >Thread-1043::DEBUG::2014-07-10 08:05:34,861::task::990::TaskManager.Task::(_decref) Task=`f3c29ecd-a3e0-4bc8-a339-4ea9a5ec95e4`::ref 0 aborting False >Dummy-36::DEBUG::2014-07-10 08:05:36,283::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-07-10 08:05:36,415::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.03236 s, 31.6 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 08:05:36,597::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lion.qa.lab.tlv.redhat.com:_export_yuri2_backup2/6a70504d-00df-4869-8695-0f442053f6b6/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-14::DEBUG::2014-07-10 08:05:36,662::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n369 bytes (369 B) copied, 0.000413437 s, 893 kB/s\n'; <rc> = 0 >Thread-1042::DEBUG::2014-07-10 08:05:37,773::task::595::TaskManager.Task::(_updateState) Task=`627bad81-acdd-4727-b266-800e2d1b1fe6`::moving from state init -> state preparing >Thread-1042::INFO::2014-07-10 08:05:37,773::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-1042::INFO::2014-07-10 08:05:37,773::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00080515', 'lastCheck': '8.4', 'valid': True}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000413437', 'lastCheck': '1.1', 'valid': True}} >Thread-1042::DEBUG::2014-07-10 08:05:37,774::task::1185::TaskManager.Task::(prepare) Task=`627bad81-acdd-4727-b266-800e2d1b1fe6`::finished: {u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00080515', 'lastCheck': '8.4', 'valid': True}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000413437', 'lastCheck': '1.1', 'valid': True}} >Thread-1042::DEBUG::2014-07-10 08:05:37,774::task::595::TaskManager.Task::(_updateState) Task=`627bad81-acdd-4727-b266-800e2d1b1fe6`::moving from state preparing -> state finished >Thread-1042::DEBUG::2014-07-10 08:05:37,774::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-1042::DEBUG::2014-07-10 08:05:37,774::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1042::DEBUG::2014-07-10 08:05:37,774::task::990::TaskManager.Task::(_decref) Task=`627bad81-acdd-4727-b266-800e2d1b1fe6`::ref 0 aborting False >Dummy-36::DEBUG::2014-07-10 08:05:38,430::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-07-10 08:05:38,575::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0377962 s, 27.1 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-07-10 08:05:39,360::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/e01a3a36-d2ce-4153-bb57-d6e65b7ed08c/metadata bs=4096 count=1' (cwd None) >Thread-15::DEBUG::2014-07-10 08:05:39,423::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00072293 s, 5.7 MB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-07-10 08:05:40,590::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-07-10 08:05:40,726::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0322048 s, 31.8 MB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-07-10 08:05:42,741::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-07-10 08:05:42,877::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0380377 s, 26.9 MB/s\n'; <rc> = 0 >Thread-1042::DEBUG::2014-07-10 08:05:44,888::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-1042::DEBUG::2014-07-10 08:05:44,889::task::595::TaskManager.Task::(_updateState) Task=`2a96ffdf-7765-49cd-8222-6409e24086a6`::moving from state init -> state preparing >Thread-1042::INFO::2014-07-10 08:05:44,889::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='411039e4-4af2-4192-9de0-67dc1ed83ba9', options=None) >Thread-1042::INFO::2014-07-10 08:05:44,890::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2}} >Thread-1042::DEBUG::2014-07-10 08:05:44,890::task::1185::TaskManager.Task::(prepare) Task=`2a96ffdf-7765-49cd-8222-6409e24086a6`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2}} >Thread-1042::DEBUG::2014-07-10 08:05:44,890::task::595::TaskManager.Task::(_updateState) Task=`2a96ffdf-7765-49cd-8222-6409e24086a6`::moving from state preparing -> state finished >Thread-1042::DEBUG::2014-07-10 08:05:44,890::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-1042::DEBUG::2014-07-10 08:05:44,890::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1042::DEBUG::2014-07-10 08:05:44,891::task::990::TaskManager.Task::(_decref) Task=`2a96ffdf-7765-49cd-8222-6409e24086a6`::ref 0 aborting False >Dummy-36::DEBUG::2014-07-10 08:05:44,892::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Thread-1043::DEBUG::2014-07-10 08:05:44,952::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-1043::DEBUG::2014-07-10 08:05:44,955::task::595::TaskManager.Task::(_updateState) Task=`a8d58a45-cf31-4e3c-a0e7-c3bf5506ead4`::moving from state init -> state preparing >Thread-1043::INFO::2014-07-10 08:05:44,955::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='411039e4-4af2-4192-9de0-67dc1ed83ba9', options=None) >Thread-1043::DEBUG::2014-07-10 08:05:44,957::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9`ReqID=`f6648fad-5f0c-4a60-86d6-fb064225f149`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo' >Thread-1043::DEBUG::2014-07-10 08:05:44,957::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' for lock type 'shared' >Thread-1043::DEBUG::2014-07-10 08:05:44,958::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' is free. Now locking as 'shared' (1 active user) >Thread-1043::DEBUG::2014-07-10 08:05:44,958::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9`ReqID=`f6648fad-5f0c-4a60-86d6-fb064225f149`::Granted request >Thread-1043::DEBUG::2014-07-10 08:05:44,959::task::827::TaskManager.Task::(resourceAcquired) Task=`a8d58a45-cf31-4e3c-a0e7-c3bf5506ead4`::_resourcesAcquired: Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9 (shared) >Thread-1043::DEBUG::2014-07-10 08:05:44,959::task::990::TaskManager.Task::(_decref) Task=`a8d58a45-cf31-4e3c-a0e7-c3bf5506ead4`::ref 1 aborting False >Thread-1043::INFO::2014-07-10 08:05:44,962::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DC-REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2, 'domains': u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': 'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c': {'status': u'Active', 'diskfree': '1137495244800', 'isoprefix': '', 'alerts': [], 'disktotal': '1152393412608', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '533841575936', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-1043::DEBUG::2014-07-10 08:05:44,963::task::1185::TaskManager.Task::(prepare) Task=`a8d58a45-cf31-4e3c-a0e7-c3bf5506ead4`::finished: {'info': {'name': 'DC-REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2, 'domains': u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': 'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c': {'status': u'Active', 'diskfree': '1137495244800', 'isoprefix': '', 'alerts': [], 'disktotal': '1152393412608', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '533841575936', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-1043::DEBUG::2014-07-10 08:05:44,963::task::595::TaskManager.Task::(_updateState) Task=`a8d58a45-cf31-4e3c-a0e7-c3bf5506ead4`::moving from state preparing -> state finished >Thread-1043::DEBUG::2014-07-10 08:05:44,964::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9': < ResourceRef 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9', isValid: 'True' obj: 'None'>} >Thread-1043::DEBUG::2014-07-10 08:05:44,965::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1043::DEBUG::2014-07-10 08:05:44,966::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' >Thread-1043::DEBUG::2014-07-10 08:05:44,966::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' (0 active users) >Thread-1043::DEBUG::2014-07-10 08:05:44,967::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' is free, finding out if anyone is waiting for it. >Thread-1043::DEBUG::2014-07-10 08:05:44,967::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9', Clearing records. >Thread-1043::DEBUG::2014-07-10 08:05:44,968::task::990::TaskManager.Task::(_decref) Task=`a8d58a45-cf31-4e3c-a0e7-c3bf5506ead4`::ref 0 aborting False >Dummy-36::DEBUG::2014-07-10 08:05:45,037::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0432346 s, 23.7 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 08:05:46,688::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lion.qa.lab.tlv.redhat.com:_export_yuri2_backup2/6a70504d-00df-4869-8695-0f442053f6b6/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-14::DEBUG::2014-07-10 08:05:46,751::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n369 bytes (369 B) copied, 0.000471358 s, 783 kB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-07-10 08:05:47,052::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-07-10 08:05:47,193::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0380841 s, 26.9 MB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-07-10 08:05:49,208::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Thread-15::DEBUG::2014-07-10 08:05:49,463::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/e01a3a36-d2ce-4153-bb57-d6e65b7ed08c/metadata bs=4096 count=1' (cwd None) >Thread-15::DEBUG::2014-07-10 08:05:49,687::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000894353 s, 4.6 MB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-07-10 08:05:50,713::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0390768 s, 26.2 MB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-07-10 08:05:52,727::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-07-10 08:05:52,861::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0325742 s, 31.4 MB/s\n'; <rc> = 0 >Thread-1042::DEBUG::2014-07-10 08:05:52,941::task::595::TaskManager.Task::(_updateState) Task=`ba133206-ba5a-4605-88fc-113e2b47d47a`::moving from state init -> state preparing >Thread-1042::INFO::2014-07-10 08:05:52,942::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-1042::INFO::2014-07-10 08:05:52,942::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000894353', 'lastCheck': '2.3', 'valid': True}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000471358', 'lastCheck': '6.2', 'valid': True}} >Thread-1042::DEBUG::2014-07-10 08:05:52,942::task::1185::TaskManager.Task::(prepare) Task=`ba133206-ba5a-4605-88fc-113e2b47d47a`::finished: {u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000894353', 'lastCheck': '2.3', 'valid': True}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000471358', 'lastCheck': '6.2', 'valid': True}} >Thread-1042::DEBUG::2014-07-10 08:05:52,942::task::595::TaskManager.Task::(_updateState) Task=`ba133206-ba5a-4605-88fc-113e2b47d47a`::moving from state preparing -> state finished >Thread-1042::DEBUG::2014-07-10 08:05:52,943::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-1042::DEBUG::2014-07-10 08:05:52,943::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1042::DEBUG::2014-07-10 08:05:52,943::task::990::TaskManager.Task::(_decref) Task=`ba133206-ba5a-4605-88fc-113e2b47d47a`::ref 0 aborting False >Dummy-36::DEBUG::2014-07-10 08:05:54,877::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Thread-1042::DEBUG::2014-07-10 08:05:55,013::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-1042::DEBUG::2014-07-10 08:05:55,018::task::595::TaskManager.Task::(_updateState) Task=`94b0e2f2-6aa8-48b7-9b05-65d803dbd30f`::moving from state init -> state preparing >Thread-1042::INFO::2014-07-10 08:05:55,021::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='411039e4-4af2-4192-9de0-67dc1ed83ba9', options=None) >Thread-1042::INFO::2014-07-10 08:05:55,026::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2}} >Thread-1042::DEBUG::2014-07-10 08:05:55,028::task::1185::TaskManager.Task::(prepare) Task=`94b0e2f2-6aa8-48b7-9b05-65d803dbd30f`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2}} >Thread-1042::DEBUG::2014-07-10 08:05:55,030::task::595::TaskManager.Task::(_updateState) Task=`94b0e2f2-6aa8-48b7-9b05-65d803dbd30f`::moving from state preparing -> state finished >Thread-1042::DEBUG::2014-07-10 08:05:55,033::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-1042::DEBUG::2014-07-10 08:05:55,035::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1042::DEBUG::2014-07-10 08:05:55,037::task::990::TaskManager.Task::(_decref) Task=`94b0e2f2-6aa8-48b7-9b05-65d803dbd30f`::ref 0 aborting False >Thread-1043::DEBUG::2014-07-10 08:05:55,050::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-1043::DEBUG::2014-07-10 08:05:55,054::task::595::TaskManager.Task::(_updateState) Task=`07f8c597-3f8d-46de-8039-5facf375442a`::moving from state init -> state preparing >Thread-1043::INFO::2014-07-10 08:05:55,057::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='411039e4-4af2-4192-9de0-67dc1ed83ba9', options=None) >Thread-1043::DEBUG::2014-07-10 08:05:55,063::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9`ReqID=`6b77d482-afde-494f-abd0-95797bec73fb`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo' >Thread-1043::DEBUG::2014-07-10 08:05:55,065::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' for lock type 'shared' >Thread-1043::DEBUG::2014-07-10 08:05:55,069::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' is free. Now locking as 'shared' (1 active user) >Thread-1043::DEBUG::2014-07-10 08:05:55,072::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9`ReqID=`6b77d482-afde-494f-abd0-95797bec73fb`::Granted request >Thread-1043::DEBUG::2014-07-10 08:05:55,079::task::827::TaskManager.Task::(resourceAcquired) Task=`07f8c597-3f8d-46de-8039-5facf375442a`::_resourcesAcquired: Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9 (shared) >Dummy-36::DEBUG::2014-07-10 08:05:55,080::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0379375 s, 27.0 MB/s\n'; <rc> = 0 >Thread-1043::DEBUG::2014-07-10 08:05:55,081::task::990::TaskManager.Task::(_decref) Task=`07f8c597-3f8d-46de-8039-5facf375442a`::ref 1 aborting False >Thread-1043::INFO::2014-07-10 08:05:55,092::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DC-REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2, 'domains': u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': 'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c': {'status': u'Active', 'diskfree': '1137495244800', 'isoprefix': '', 'alerts': [], 'disktotal': '1152393412608', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '533841575936', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-1043::DEBUG::2014-07-10 08:05:55,094::task::1185::TaskManager.Task::(prepare) Task=`07f8c597-3f8d-46de-8039-5facf375442a`::finished: {'info': {'name': 'DC-REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2, 'domains': u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': 'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c': {'status': u'Active', 'diskfree': '1137495244800', 'isoprefix': '', 'alerts': [], 'disktotal': '1152393412608', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '533841575936', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-1043::DEBUG::2014-07-10 08:05:55,095::task::595::TaskManager.Task::(_updateState) Task=`07f8c597-3f8d-46de-8039-5facf375442a`::moving from state preparing -> state finished >Thread-1043::DEBUG::2014-07-10 08:05:55,097::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9': < ResourceRef 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9', isValid: 'True' obj: 'None'>} >Thread-1043::DEBUG::2014-07-10 08:05:55,098::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1043::DEBUG::2014-07-10 08:05:55,100::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' >Thread-1043::DEBUG::2014-07-10 08:05:55,102::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' (0 active users) >Thread-1043::DEBUG::2014-07-10 08:05:55,104::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' is free, finding out if anyone is waiting for it. >Thread-1043::DEBUG::2014-07-10 08:05:55,105::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9', Clearing records. >Thread-1043::DEBUG::2014-07-10 08:05:55,107::task::990::TaskManager.Task::(_decref) Task=`07f8c597-3f8d-46de-8039-5facf375442a`::ref 0 aborting False >Thread-14::DEBUG::2014-07-10 08:05:56,776::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lion.qa.lab.tlv.redhat.com:_export_yuri2_backup2/6a70504d-00df-4869-8695-0f442053f6b6/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-14::DEBUG::2014-07-10 08:05:56,839::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n369 bytes (369 B) copied, 0.000480663 s, 768 kB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-07-10 08:05:57,128::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-07-10 08:05:57,265::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0342597 s, 29.9 MB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-07-10 08:05:59,280::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-07-10 08:05:59,412::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0321975 s, 31.8 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-07-10 08:06:00,688::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/e01a3a36-d2ce-4153-bb57-d6e65b7ed08c/metadata bs=4096 count=1' (cwd None) >Thread-15::DEBUG::2014-07-10 08:06:00,794::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000899453 s, 4.6 MB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-07-10 08:06:01,428::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-07-10 08:06:01,559::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0352118 s, 29.1 MB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-07-10 08:06:03,569::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-07-10 08:06:03,706::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0371213 s, 27.6 MB/s\n'; <rc> = 0 >Thread-1042::DEBUG::2014-07-10 08:06:05,137::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-1042::DEBUG::2014-07-10 08:06:05,138::task::595::TaskManager.Task::(_updateState) Task=`4625f22d-bf1d-4258-bdb1-485af29b45d9`::moving from state init -> state preparing >Thread-1042::INFO::2014-07-10 08:06:05,138::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='411039e4-4af2-4192-9de0-67dc1ed83ba9', options=None) >Thread-1042::INFO::2014-07-10 08:06:05,139::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2}} >Thread-1042::DEBUG::2014-07-10 08:06:05,139::task::1185::TaskManager.Task::(prepare) Task=`4625f22d-bf1d-4258-bdb1-485af29b45d9`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2}} >Thread-1042::DEBUG::2014-07-10 08:06:05,139::task::595::TaskManager.Task::(_updateState) Task=`4625f22d-bf1d-4258-bdb1-485af29b45d9`::moving from state preparing -> state finished >Thread-1042::DEBUG::2014-07-10 08:06:05,139::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-1042::DEBUG::2014-07-10 08:06:05,140::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1042::DEBUG::2014-07-10 08:06:05,140::task::990::TaskManager.Task::(_decref) Task=`4625f22d-bf1d-4258-bdb1-485af29b45d9`::ref 0 aborting False >Thread-1043::DEBUG::2014-07-10 08:06:05,143::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-1043::DEBUG::2014-07-10 08:06:05,143::task::595::TaskManager.Task::(_updateState) Task=`e1683113-6f40-4984-aa89-35e11dd26fd1`::moving from state init -> state preparing >Thread-1043::INFO::2014-07-10 08:06:05,144::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='411039e4-4af2-4192-9de0-67dc1ed83ba9', options=None) >Thread-1043::DEBUG::2014-07-10 08:06:05,144::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9`ReqID=`d1254e73-e177-45b9-ba3a-e3ec264c1320`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo' >Thread-1043::DEBUG::2014-07-10 08:06:05,144::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' for lock type 'shared' >Thread-1043::DEBUG::2014-07-10 08:06:05,145::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' is free. Now locking as 'shared' (1 active user) >Thread-1043::DEBUG::2014-07-10 08:06:05,145::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9`ReqID=`d1254e73-e177-45b9-ba3a-e3ec264c1320`::Granted request >Thread-1043::DEBUG::2014-07-10 08:06:05,145::task::827::TaskManager.Task::(resourceAcquired) Task=`e1683113-6f40-4984-aa89-35e11dd26fd1`::_resourcesAcquired: Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9 (shared) >Thread-1043::DEBUG::2014-07-10 08:06:05,146::task::990::TaskManager.Task::(_decref) Task=`e1683113-6f40-4984-aa89-35e11dd26fd1`::ref 1 aborting False >Thread-1043::INFO::2014-07-10 08:06:05,147::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DC-REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2, 'domains': u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': 'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c': {'status': u'Active', 'diskfree': '1137495244800', 'isoprefix': '', 'alerts': [], 'disktotal': '1152393412608', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '533841575936', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-1043::DEBUG::2014-07-10 08:06:05,147::task::1185::TaskManager.Task::(prepare) Task=`e1683113-6f40-4984-aa89-35e11dd26fd1`::finished: {'info': {'name': 'DC-REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2, 'domains': u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': 'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c': {'status': u'Active', 'diskfree': '1137495244800', 'isoprefix': '', 'alerts': [], 'disktotal': '1152393412608', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '533841575936', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-1043::DEBUG::2014-07-10 08:06:05,147::task::595::TaskManager.Task::(_updateState) Task=`e1683113-6f40-4984-aa89-35e11dd26fd1`::moving from state preparing -> state finished >Thread-1043::DEBUG::2014-07-10 08:06:05,147::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9': < ResourceRef 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9', isValid: 'True' obj: 'None'>} >Thread-1043::DEBUG::2014-07-10 08:06:05,147::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1043::DEBUG::2014-07-10 08:06:05,148::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' >Thread-1043::DEBUG::2014-07-10 08:06:05,148::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' (0 active users) >Thread-1043::DEBUG::2014-07-10 08:06:05,148::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' is free, finding out if anyone is waiting for it. >Thread-1043::DEBUG::2014-07-10 08:06:05,148::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9', Clearing records. >Thread-1043::DEBUG::2014-07-10 08:06:05,148::task::990::TaskManager.Task::(_decref) Task=`e1683113-6f40-4984-aa89-35e11dd26fd1`::ref 0 aborting False >Dummy-36::DEBUG::2014-07-10 08:06:05,721::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-07-10 08:06:05,862::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.041871 s, 24.5 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 08:06:06,870::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lion.qa.lab.tlv.redhat.com:_export_yuri2_backup2/6a70504d-00df-4869-8695-0f442053f6b6/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-14::DEBUG::2014-07-10 08:06:06,931::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n369 bytes (369 B) copied, 0.000565196 s, 653 kB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-07-10 08:06:07,877::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-07-10 08:06:07,999::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0295063 s, 34.7 MB/s\n'; <rc> = 0 >Thread-1042::DEBUG::2014-07-10 08:06:08,073::task::595::TaskManager.Task::(_updateState) Task=`09ed397a-24d2-4b05-ae46-b592c0c51ad9`::moving from state init -> state preparing >Thread-1042::INFO::2014-07-10 08:06:08,074::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-1042::INFO::2014-07-10 08:06:08,074::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000899453', 'lastCheck': '7.0', 'valid': True}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000565196', 'lastCheck': '1.1', 'valid': True}} >Thread-1042::DEBUG::2014-07-10 08:06:08,074::task::1185::TaskManager.Task::(prepare) Task=`09ed397a-24d2-4b05-ae46-b592c0c51ad9`::finished: {u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000899453', 'lastCheck': '7.0', 'valid': True}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000565196', 'lastCheck': '1.1', 'valid': True}} >Thread-1042::DEBUG::2014-07-10 08:06:08,075::task::595::TaskManager.Task::(_updateState) Task=`09ed397a-24d2-4b05-ae46-b592c0c51ad9`::moving from state preparing -> state finished >Thread-1042::DEBUG::2014-07-10 08:06:08,075::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-1042::DEBUG::2014-07-10 08:06:08,075::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1042::DEBUG::2014-07-10 08:06:08,075::task::990::TaskManager.Task::(_decref) Task=`09ed397a-24d2-4b05-ae46-b592c0c51ad9`::ref 0 aborting False >Dummy-36::DEBUG::2014-07-10 08:06:10,015::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-07-10 08:06:10,156::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0412688 s, 24.8 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-07-10 08:06:11,103::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/e01a3a36-d2ce-4153-bb57-d6e65b7ed08c/metadata bs=4096 count=1' (cwd None) >Thread-15::DEBUG::2014-07-10 08:06:11,235::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00998882 s, 410 kB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-07-10 08:06:12,171::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-07-10 08:06:12,311::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0379107 s, 27.0 MB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-07-10 08:06:14,326::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-07-10 08:06:14,463::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0376395 s, 27.2 MB/s\n'; <rc> = 0 >Thread-1042::DEBUG::2014-07-10 08:06:15,171::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-1042::DEBUG::2014-07-10 08:06:15,172::task::595::TaskManager.Task::(_updateState) Task=`c0272a8f-e5df-44b0-bb93-423a06665666`::moving from state init -> state preparing >Thread-1042::INFO::2014-07-10 08:06:15,173::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='411039e4-4af2-4192-9de0-67dc1ed83ba9', options=None) >Thread-1042::INFO::2014-07-10 08:06:15,173::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2}} >Thread-1042::DEBUG::2014-07-10 08:06:15,173::task::1185::TaskManager.Task::(prepare) Task=`c0272a8f-e5df-44b0-bb93-423a06665666`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2}} >Thread-1042::DEBUG::2014-07-10 08:06:15,174::task::595::TaskManager.Task::(_updateState) Task=`c0272a8f-e5df-44b0-bb93-423a06665666`::moving from state preparing -> state finished >Thread-1042::DEBUG::2014-07-10 08:06:15,174::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-1042::DEBUG::2014-07-10 08:06:15,174::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1042::DEBUG::2014-07-10 08:06:15,174::task::990::TaskManager.Task::(_decref) Task=`c0272a8f-e5df-44b0-bb93-423a06665666`::ref 0 aborting False >Thread-1043::DEBUG::2014-07-10 08:06:15,178::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-1043::DEBUG::2014-07-10 08:06:15,178::task::595::TaskManager.Task::(_updateState) Task=`75dfb238-ab0f-44f3-aa4d-f4e4baceeb83`::moving from state init -> state preparing >Thread-1043::INFO::2014-07-10 08:06:15,179::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='411039e4-4af2-4192-9de0-67dc1ed83ba9', options=None) >Thread-1043::DEBUG::2014-07-10 08:06:15,179::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9`ReqID=`8fc94075-f410-46b6-91b5-6bb23e38e803`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo' >Thread-1043::DEBUG::2014-07-10 08:06:15,179::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' for lock type 'shared' >Thread-1043::DEBUG::2014-07-10 08:06:15,180::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' is free. Now locking as 'shared' (1 active user) >Thread-1043::DEBUG::2014-07-10 08:06:15,180::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9`ReqID=`8fc94075-f410-46b6-91b5-6bb23e38e803`::Granted request >Thread-1043::DEBUG::2014-07-10 08:06:15,181::task::827::TaskManager.Task::(resourceAcquired) Task=`75dfb238-ab0f-44f3-aa4d-f4e4baceeb83`::_resourcesAcquired: Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9 (shared) >Thread-1043::DEBUG::2014-07-10 08:06:15,181::task::990::TaskManager.Task::(_decref) Task=`75dfb238-ab0f-44f3-aa4d-f4e4baceeb83`::ref 1 aborting False >Thread-1043::INFO::2014-07-10 08:06:15,182::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DC-REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2, 'domains': u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': 'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c': {'status': u'Active', 'diskfree': '1137495244800', 'isoprefix': '', 'alerts': [], 'disktotal': '1152393412608', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '533841575936', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-1043::DEBUG::2014-07-10 08:06:15,182::task::1185::TaskManager.Task::(prepare) Task=`75dfb238-ab0f-44f3-aa4d-f4e4baceeb83`::finished: {'info': {'name': 'DC-REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2, 'domains': u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': 'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c': {'status': u'Active', 'diskfree': '1137495244800', 'isoprefix': '', 'alerts': [], 'disktotal': '1152393412608', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '533841575936', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-1043::DEBUG::2014-07-10 08:06:15,182::task::595::TaskManager.Task::(_updateState) Task=`75dfb238-ab0f-44f3-aa4d-f4e4baceeb83`::moving from state preparing -> state finished >Thread-1043::DEBUG::2014-07-10 08:06:15,183::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9': < ResourceRef 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9', isValid: 'True' obj: 'None'>} >Thread-1043::DEBUG::2014-07-10 08:06:15,183::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1043::DEBUG::2014-07-10 08:06:15,183::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' >Thread-1043::DEBUG::2014-07-10 08:06:15,183::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' (0 active users) >Thread-1043::DEBUG::2014-07-10 08:06:15,184::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' is free, finding out if anyone is waiting for it. >Thread-1043::DEBUG::2014-07-10 08:06:15,184::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9', Clearing records. >Thread-1043::DEBUG::2014-07-10 08:06:15,184::task::990::TaskManager.Task::(_decref) Task=`75dfb238-ab0f-44f3-aa4d-f4e4baceeb83`::ref 0 aborting False >Dummy-36::DEBUG::2014-07-10 08:06:16,478::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-07-10 08:06:16,612::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.035621 s, 28.7 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 08:06:16,961::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lion.qa.lab.tlv.redhat.com:_export_yuri2_backup2/6a70504d-00df-4869-8695-0f442053f6b6/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-14::DEBUG::2014-07-10 08:06:17,025::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n369 bytes (369 B) copied, 0.000551785 s, 669 kB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-07-10 08:06:18,628::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-07-10 08:06:18,768::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0379963 s, 26.9 MB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-07-10 08:06:20,783::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-07-10 08:06:20,917::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0327208 s, 31.3 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-07-10 08:06:21,588::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/e01a3a36-d2ce-4153-bb57-d6e65b7ed08c/metadata bs=4096 count=1' (cwd None) >Thread-15::DEBUG::2014-07-10 08:06:21,710::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000858951 s, 4.8 MB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-07-10 08:06:22,932::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-07-10 08:06:23,061::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0291552 s, 35.1 MB/s\n'; <rc> = 0 >Thread-1042::DEBUG::2014-07-10 08:06:23,258::task::595::TaskManager.Task::(_updateState) Task=`fb37d0cd-f72d-4d0f-ab3b-d07016fca926`::moving from state init -> state preparing >Thread-1042::INFO::2014-07-10 08:06:23,259::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-1042::INFO::2014-07-10 08:06:23,259::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000858951', 'lastCheck': '1.2', 'valid': True}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000551785', 'lastCheck': '6.2', 'valid': True}} >Thread-1042::DEBUG::2014-07-10 08:06:23,259::task::1185::TaskManager.Task::(prepare) Task=`fb37d0cd-f72d-4d0f-ab3b-d07016fca926`::finished: {u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000858951', 'lastCheck': '1.2', 'valid': True}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000551785', 'lastCheck': '6.2', 'valid': True}} >Thread-1042::DEBUG::2014-07-10 08:06:23,260::task::595::TaskManager.Task::(_updateState) Task=`fb37d0cd-f72d-4d0f-ab3b-d07016fca926`::moving from state preparing -> state finished >Thread-1042::DEBUG::2014-07-10 08:06:23,260::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-1042::DEBUG::2014-07-10 08:06:23,260::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1042::DEBUG::2014-07-10 08:06:23,260::task::990::TaskManager.Task::(_decref) Task=`fb37d0cd-f72d-4d0f-ab3b-d07016fca926`::ref 0 aborting False >Dummy-36::DEBUG::2014-07-10 08:06:25,076::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-07-10 08:06:25,210::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0348636 s, 29.4 MB/s\n'; <rc> = 0 >Thread-1042::DEBUG::2014-07-10 08:06:25,216::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-1042::DEBUG::2014-07-10 08:06:25,220::task::595::TaskManager.Task::(_updateState) Task=`bc6dbf4d-cdad-4a62-a8aa-d61f56832900`::moving from state init -> state preparing >Thread-1042::INFO::2014-07-10 08:06:25,223::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='411039e4-4af2-4192-9de0-67dc1ed83ba9', options=None) >Thread-1042::INFO::2014-07-10 08:06:25,226::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2}} >Thread-1042::DEBUG::2014-07-10 08:06:25,227::task::1185::TaskManager.Task::(prepare) Task=`bc6dbf4d-cdad-4a62-a8aa-d61f56832900`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2}} >Thread-1042::DEBUG::2014-07-10 08:06:25,229::task::595::TaskManager.Task::(_updateState) Task=`bc6dbf4d-cdad-4a62-a8aa-d61f56832900`::moving from state preparing -> state finished >Thread-1042::DEBUG::2014-07-10 08:06:25,230::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-1042::DEBUG::2014-07-10 08:06:25,232::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1042::DEBUG::2014-07-10 08:06:25,233::task::990::TaskManager.Task::(_decref) Task=`bc6dbf4d-cdad-4a62-a8aa-d61f56832900`::ref 0 aborting False >Thread-1043::DEBUG::2014-07-10 08:06:25,243::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-1043::DEBUG::2014-07-10 08:06:25,245::task::595::TaskManager.Task::(_updateState) Task=`7bdac748-ab62-4c61-b678-c4649a981842`::moving from state init -> state preparing >Thread-1043::INFO::2014-07-10 08:06:25,247::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='411039e4-4af2-4192-9de0-67dc1ed83ba9', options=None) >Thread-1043::DEBUG::2014-07-10 08:06:25,251::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9`ReqID=`2d8b3f0d-bb94-4a0c-af0c-b793ce310f27`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo' >Thread-1043::DEBUG::2014-07-10 08:06:25,252::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' for lock type 'shared' >Thread-1043::DEBUG::2014-07-10 08:06:25,254::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' is free. Now locking as 'shared' (1 active user) >Thread-1043::DEBUG::2014-07-10 08:06:25,256::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9`ReqID=`2d8b3f0d-bb94-4a0c-af0c-b793ce310f27`::Granted request >Thread-1043::DEBUG::2014-07-10 08:06:25,259::task::827::TaskManager.Task::(resourceAcquired) Task=`7bdac748-ab62-4c61-b678-c4649a981842`::_resourcesAcquired: Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9 (shared) >Thread-1043::DEBUG::2014-07-10 08:06:25,260::task::990::TaskManager.Task::(_decref) Task=`7bdac748-ab62-4c61-b678-c4649a981842`::ref 1 aborting False >Thread-1043::INFO::2014-07-10 08:06:25,268::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DC-REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2, 'domains': u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': 'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c': {'status': u'Active', 'diskfree': '1137495244800', 'isoprefix': '', 'alerts': [], 'disktotal': '1152393412608', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '533841575936', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-1043::DEBUG::2014-07-10 08:06:25,269::task::1185::TaskManager.Task::(prepare) Task=`7bdac748-ab62-4c61-b678-c4649a981842`::finished: {'info': {'name': 'DC-REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2, 'domains': u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': 'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c': {'status': u'Active', 'diskfree': '1137495244800', 'isoprefix': '', 'alerts': [], 'disktotal': '1152393412608', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '533841575936', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-1043::DEBUG::2014-07-10 08:06:25,271::task::595::TaskManager.Task::(_updateState) Task=`7bdac748-ab62-4c61-b678-c4649a981842`::moving from state preparing -> state finished >Thread-1043::DEBUG::2014-07-10 08:06:25,272::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9': < ResourceRef 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9', isValid: 'True' obj: 'None'>} >Thread-1043::DEBUG::2014-07-10 08:06:25,273::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1043::DEBUG::2014-07-10 08:06:25,275::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' >Thread-1043::DEBUG::2014-07-10 08:06:25,277::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' (0 active users) >Thread-1043::DEBUG::2014-07-10 08:06:25,279::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' is free, finding out if anyone is waiting for it. >Thread-1043::DEBUG::2014-07-10 08:06:25,280::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9', Clearing records. >Thread-1043::DEBUG::2014-07-10 08:06:25,282::task::990::TaskManager.Task::(_decref) Task=`7bdac748-ab62-4c61-b678-c4649a981842`::ref 0 aborting False >Thread-14::DEBUG::2014-07-10 08:06:27,050::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lion.qa.lab.tlv.redhat.com:_export_yuri2_backup2/6a70504d-00df-4869-8695-0f442053f6b6/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-14::DEBUG::2014-07-10 08:06:27,114::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n369 bytes (369 B) copied, 0.000460497 s, 801 kB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-07-10 08:06:27,297::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-07-10 08:06:27,441::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0378021 s, 27.1 MB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-07-10 08:06:29,456::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-07-10 08:06:29,600::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0382276 s, 26.8 MB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-07-10 08:06:31,615::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-07-10 08:06:31,743::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0302563 s, 33.8 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-07-10 08:06:32,087::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/e01a3a36-d2ce-4153-bb57-d6e65b7ed08c/metadata bs=4096 count=1' (cwd None) >Thread-15::DEBUG::2014-07-10 08:06:32,207::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000902216 s, 4.5 MB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-07-10 08:06:33,758::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-07-10 08:06:33,897::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0356466 s, 28.7 MB/s\n'; <rc> = 0 >Thread-1042::DEBUG::2014-07-10 08:06:35,322::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-1042::DEBUG::2014-07-10 08:06:35,323::task::595::TaskManager.Task::(_updateState) Task=`a8743286-8270-4f20-955b-e48943d68883`::moving from state init -> state preparing >Thread-1042::INFO::2014-07-10 08:06:35,323::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='411039e4-4af2-4192-9de0-67dc1ed83ba9', options=None) >Thread-1042::INFO::2014-07-10 08:06:35,324::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2}} >Thread-1042::DEBUG::2014-07-10 08:06:35,324::task::1185::TaskManager.Task::(prepare) Task=`a8743286-8270-4f20-955b-e48943d68883`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2}} >Thread-1042::DEBUG::2014-07-10 08:06:35,324::task::595::TaskManager.Task::(_updateState) Task=`a8743286-8270-4f20-955b-e48943d68883`::moving from state preparing -> state finished >Thread-1042::DEBUG::2014-07-10 08:06:35,324::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-1042::DEBUG::2014-07-10 08:06:35,325::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1042::DEBUG::2014-07-10 08:06:35,325::task::990::TaskManager.Task::(_decref) Task=`a8743286-8270-4f20-955b-e48943d68883`::ref 0 aborting False >Thread-1043::DEBUG::2014-07-10 08:06:35,329::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-1043::DEBUG::2014-07-10 08:06:35,329::task::595::TaskManager.Task::(_updateState) Task=`fcac9bbf-96aa-4f3d-b4cc-1ece7a679bf8`::moving from state init -> state preparing >Thread-1043::INFO::2014-07-10 08:06:35,329::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='411039e4-4af2-4192-9de0-67dc1ed83ba9', options=None) >Thread-1043::DEBUG::2014-07-10 08:06:35,330::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9`ReqID=`b48cf006-c023-423d-b8e5-ed29f1ce6bed`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo' >Thread-1043::DEBUG::2014-07-10 08:06:35,330::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' for lock type 'shared' >Thread-1043::DEBUG::2014-07-10 08:06:35,331::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' is free. Now locking as 'shared' (1 active user) >Thread-1043::DEBUG::2014-07-10 08:06:35,331::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9`ReqID=`b48cf006-c023-423d-b8e5-ed29f1ce6bed`::Granted request >Thread-1043::DEBUG::2014-07-10 08:06:35,331::task::827::TaskManager.Task::(resourceAcquired) Task=`fcac9bbf-96aa-4f3d-b4cc-1ece7a679bf8`::_resourcesAcquired: Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9 (shared) >Thread-1043::DEBUG::2014-07-10 08:06:35,331::task::990::TaskManager.Task::(_decref) Task=`fcac9bbf-96aa-4f3d-b4cc-1ece7a679bf8`::ref 1 aborting False >Thread-1043::INFO::2014-07-10 08:06:35,332::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DC-REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2, 'domains': u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': 'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c': {'status': u'Active', 'diskfree': '1137495244800', 'isoprefix': '', 'alerts': [], 'disktotal': '1152393412608', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '533841575936', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-1043::DEBUG::2014-07-10 08:06:35,333::task::1185::TaskManager.Task::(prepare) Task=`fcac9bbf-96aa-4f3d-b4cc-1ece7a679bf8`::finished: {'info': {'name': 'DC-REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2, 'domains': u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': 'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c': {'status': u'Active', 'diskfree': '1137495244800', 'isoprefix': '', 'alerts': [], 'disktotal': '1152393412608', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '533841575936', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-1043::DEBUG::2014-07-10 08:06:35,333::task::595::TaskManager.Task::(_updateState) Task=`fcac9bbf-96aa-4f3d-b4cc-1ece7a679bf8`::moving from state preparing -> state finished >Thread-1043::DEBUG::2014-07-10 08:06:35,333::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9': < ResourceRef 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9', isValid: 'True' obj: 'None'>} >Thread-1043::DEBUG::2014-07-10 08:06:35,333::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1043::DEBUG::2014-07-10 08:06:35,333::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' >Thread-1043::DEBUG::2014-07-10 08:06:35,333::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' (0 active users) >Thread-1043::DEBUG::2014-07-10 08:06:35,334::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' is free, finding out if anyone is waiting for it. >Thread-1043::DEBUG::2014-07-10 08:06:35,334::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9', Clearing records. >Thread-1043::DEBUG::2014-07-10 08:06:35,334::task::990::TaskManager.Task::(_decref) Task=`fcac9bbf-96aa-4f3d-b4cc-1ece7a679bf8`::ref 0 aborting False >Dummy-36::DEBUG::2014-07-10 08:06:35,912::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-07-10 08:06:36,045::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0321103 s, 31.9 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 08:06:37,145::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lion.qa.lab.tlv.redhat.com:_export_yuri2_backup2/6a70504d-00df-4869-8695-0f442053f6b6/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-14::DEBUG::2014-07-10 08:06:37,205::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n369 bytes (369 B) copied, 0.000354094 s, 1.0 MB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-07-10 08:06:38,060::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-07-10 08:06:38,191::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.029289 s, 35.0 MB/s\n'; <rc> = 0 >Thread-1042::DEBUG::2014-07-10 08:06:38,419::task::595::TaskManager.Task::(_updateState) Task=`53ca31fc-44c0-40e6-a567-3385986e76e1`::moving from state init -> state preparing >Thread-1042::INFO::2014-07-10 08:06:38,419::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-1042::INFO::2014-07-10 08:06:38,420::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000902216', 'lastCheck': '5.9', 'valid': True}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000354094', 'lastCheck': '1.2', 'valid': True}} >Thread-1042::DEBUG::2014-07-10 08:06:38,420::task::1185::TaskManager.Task::(prepare) Task=`53ca31fc-44c0-40e6-a567-3385986e76e1`::finished: {u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000902216', 'lastCheck': '5.9', 'valid': True}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000354094', 'lastCheck': '1.2', 'valid': True}} >Thread-1042::DEBUG::2014-07-10 08:06:38,420::task::595::TaskManager.Task::(_updateState) Task=`53ca31fc-44c0-40e6-a567-3385986e76e1`::moving from state preparing -> state finished >Thread-1042::DEBUG::2014-07-10 08:06:38,420::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-1042::DEBUG::2014-07-10 08:06:38,421::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1042::DEBUG::2014-07-10 08:06:38,421::task::990::TaskManager.Task::(_decref) Task=`53ca31fc-44c0-40e6-a567-3385986e76e1`::ref 0 aborting False >Dummy-36::DEBUG::2014-07-10 08:06:40,209::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-07-10 08:06:40,347::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0378394 s, 27.1 MB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-07-10 08:06:42,363::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-07-10 08:06:42,490::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0304238 s, 33.7 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-07-10 08:06:42,565::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/e01a3a36-d2ce-4153-bb57-d6e65b7ed08c/metadata bs=4096 count=1' (cwd None) >Thread-15::DEBUG::2014-07-10 08:06:42,679::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000595105 s, 6.9 MB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-07-10 08:06:44,505::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-07-10 08:06:44,670::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0708375 s, 14.5 MB/s\n'; <rc> = 0 >Thread-1042::DEBUG::2014-07-10 08:06:45,354::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-1042::DEBUG::2014-07-10 08:06:45,355::task::595::TaskManager.Task::(_updateState) Task=`1307824e-5ccb-4336-b885-5a7191710b39`::moving from state init -> state preparing >Thread-1042::INFO::2014-07-10 08:06:45,355::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='411039e4-4af2-4192-9de0-67dc1ed83ba9', options=None) >Thread-1042::INFO::2014-07-10 08:06:45,356::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2}} >Thread-1042::DEBUG::2014-07-10 08:06:45,356::task::1185::TaskManager.Task::(prepare) Task=`1307824e-5ccb-4336-b885-5a7191710b39`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2}} >Thread-1042::DEBUG::2014-07-10 08:06:45,356::task::595::TaskManager.Task::(_updateState) Task=`1307824e-5ccb-4336-b885-5a7191710b39`::moving from state preparing -> state finished >Thread-1042::DEBUG::2014-07-10 08:06:45,357::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-1042::DEBUG::2014-07-10 08:06:45,357::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1042::DEBUG::2014-07-10 08:06:45,357::task::990::TaskManager.Task::(_decref) Task=`1307824e-5ccb-4336-b885-5a7191710b39`::ref 0 aborting False >Thread-1043::DEBUG::2014-07-10 08:06:45,361::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-1043::DEBUG::2014-07-10 08:06:45,361::task::595::TaskManager.Task::(_updateState) Task=`042e4fc5-3b83-4a3d-a78d-063528873982`::moving from state init -> state preparing >Thread-1043::INFO::2014-07-10 08:06:45,362::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='411039e4-4af2-4192-9de0-67dc1ed83ba9', options=None) >Thread-1043::DEBUG::2014-07-10 08:06:45,363::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9`ReqID=`840e7fdd-24da-46ab-9590-b3e73969be63`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo' >Thread-1043::DEBUG::2014-07-10 08:06:45,364::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' for lock type 'shared' >Thread-1043::DEBUG::2014-07-10 08:06:45,364::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' is free. Now locking as 'shared' (1 active user) >Thread-1043::DEBUG::2014-07-10 08:06:45,364::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9`ReqID=`840e7fdd-24da-46ab-9590-b3e73969be63`::Granted request >Thread-1043::DEBUG::2014-07-10 08:06:45,365::task::827::TaskManager.Task::(resourceAcquired) Task=`042e4fc5-3b83-4a3d-a78d-063528873982`::_resourcesAcquired: Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9 (shared) >Thread-1043::DEBUG::2014-07-10 08:06:45,365::task::990::TaskManager.Task::(_decref) Task=`042e4fc5-3b83-4a3d-a78d-063528873982`::ref 1 aborting False >Thread-1043::INFO::2014-07-10 08:06:45,366::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DC-REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2, 'domains': u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': 'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c': {'status': u'Active', 'diskfree': '1137495244800', 'isoprefix': '', 'alerts': [], 'disktotal': '1152393412608', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '533841575936', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-1043::DEBUG::2014-07-10 08:06:45,366::task::1185::TaskManager.Task::(prepare) Task=`042e4fc5-3b83-4a3d-a78d-063528873982`::finished: {'info': {'name': 'DC-REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2, 'domains': u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': 'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c': {'status': u'Active', 'diskfree': '1137495244800', 'isoprefix': '', 'alerts': [], 'disktotal': '1152393412608', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '533841575936', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-1043::DEBUG::2014-07-10 08:06:45,367::task::595::TaskManager.Task::(_updateState) Task=`042e4fc5-3b83-4a3d-a78d-063528873982`::moving from state preparing -> state finished >Thread-1043::DEBUG::2014-07-10 08:06:45,367::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9': < ResourceRef 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9', isValid: 'True' obj: 'None'>} >Thread-1043::DEBUG::2014-07-10 08:06:45,367::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1043::DEBUG::2014-07-10 08:06:45,367::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' >Thread-1043::DEBUG::2014-07-10 08:06:45,368::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' (0 active users) >Thread-1043::DEBUG::2014-07-10 08:06:45,368::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' is free, finding out if anyone is waiting for it. >Thread-1043::DEBUG::2014-07-10 08:06:45,368::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9', Clearing records. >Thread-1043::DEBUG::2014-07-10 08:06:45,368::task::990::TaskManager.Task::(_decref) Task=`042e4fc5-3b83-4a3d-a78d-063528873982`::ref 0 aborting False >Dummy-36::DEBUG::2014-07-10 08:06:46,685::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-07-10 08:06:46,813::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0295158 s, 34.7 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 08:06:47,208::domainMonitor::192::Storage.DomainMonitorThread::(_monitorDomain) Refreshing domain 6a70504d-00df-4869-8695-0f442053f6b6 >Thread-14::DEBUG::2014-07-10 08:06:47,238::fileSD::150::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/lion.qa.lab.tlv.redhat.com:_export_yuri2_backup2/6a70504d-00df-4869-8695-0f442053f6b6 >Thread-14::DEBUG::2014-07-10 08:06:47,240::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend >Thread-14::DEBUG::2014-07-10 08:06:47,243::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Backup', 'DESCRIPTION=test', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=0', 'POOL_UUID=411039e4-4af2-4192-9de0-67dc1ed83ba9', 'REMOTE_PATH=lion.qa.lab.tlv.redhat.com:/export/yuri2/backup2', 'ROLE=Regular', 'SDUUID=6a70504d-00df-4869-8695-0f442053f6b6', 'TYPE=NFS', 'VERSION=0', '_SHA_CKSUM=c52897a45cbc3ed0a0146ef350774e5cecebe6cf'] >Thread-14::DEBUG::2014-07-10 08:06:47,244::fileSD::609::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images [] >Thread-14::INFO::2014-07-10 08:06:47,245::sd::384::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 6a70504d-00df-4869-8695-0f442053f6b6_imageNS already registered >Thread-14::INFO::2014-07-10 08:06:47,245::sd::392::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 6a70504d-00df-4869-8695-0f442053f6b6_volumeNS already registered >Thread-14::DEBUG::2014-07-10 08:06:47,269::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lion.qa.lab.tlv.redhat.com:_export_yuri2_backup2/6a70504d-00df-4869-8695-0f442053f6b6/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-14::DEBUG::2014-07-10 08:06:47,330::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n369 bytes (369 B) copied, 0.000468153 s, 788 kB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-07-10 08:06:48,828::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-07-10 08:06:48,968::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0378347 s, 27.1 MB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-07-10 08:06:50,983::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-07-10 08:06:51,118::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.035423 s, 28.9 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-07-10 08:06:53,011::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/e01a3a36-d2ce-4153-bb57-d6e65b7ed08c/metadata bs=4096 count=1' (cwd None) >Thread-15::DEBUG::2014-07-10 08:06:53,125::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000749195 s, 5.5 MB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-07-10 08:06:53,141::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Thread-1042::DEBUG::2014-07-10 08:06:53,741::task::595::TaskManager.Task::(_updateState) Task=`865de045-2d77-4199-b80a-090bd62363e6`::moving from state init -> state preparing >Thread-1042::INFO::2014-07-10 08:06:53,750::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-1042::INFO::2014-07-10 08:06:53,763::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000595105', 'lastCheck': '10.7', 'valid': True}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000468153', 'lastCheck': '6.4', 'valid': True}} >Thread-1042::DEBUG::2014-07-10 08:06:53,770::task::1185::TaskManager.Task::(prepare) Task=`865de045-2d77-4199-b80a-090bd62363e6`::finished: {u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000595105', 'lastCheck': '10.7', 'valid': True}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000468153', 'lastCheck': '6.4', 'valid': True}} >Thread-1042::DEBUG::2014-07-10 08:06:53,778::task::595::TaskManager.Task::(_updateState) Task=`865de045-2d77-4199-b80a-090bd62363e6`::moving from state preparing -> state finished >Thread-1042::DEBUG::2014-07-10 08:06:53,785::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-1042::DEBUG::2014-07-10 08:06:53,792::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1042::DEBUG::2014-07-10 08:06:53,800::task::990::TaskManager.Task::(_decref) Task=`865de045-2d77-4199-b80a-090bd62363e6`::ref 0 aborting False >Dummy-36::DEBUG::2014-07-10 08:06:54,511::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 1.27266 s, 805 kB/s\n'; <rc> = 0 >Thread-1042::DEBUG::2014-07-10 08:06:55,396::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-1042::DEBUG::2014-07-10 08:06:55,397::task::595::TaskManager.Task::(_updateState) Task=`850b6e77-9a60-4932-b2a7-a7ed70eef20b`::moving from state init -> state preparing >Thread-1042::INFO::2014-07-10 08:06:55,397::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='411039e4-4af2-4192-9de0-67dc1ed83ba9', options=None) >Thread-1042::INFO::2014-07-10 08:06:55,398::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2}} >Thread-1042::DEBUG::2014-07-10 08:06:55,398::task::1185::TaskManager.Task::(prepare) Task=`850b6e77-9a60-4932-b2a7-a7ed70eef20b`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2}} >Thread-1042::DEBUG::2014-07-10 08:06:55,398::task::595::TaskManager.Task::(_updateState) Task=`850b6e77-9a60-4932-b2a7-a7ed70eef20b`::moving from state preparing -> state finished >Thread-1042::DEBUG::2014-07-10 08:06:55,398::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-1042::DEBUG::2014-07-10 08:06:55,399::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1042::DEBUG::2014-07-10 08:06:55,399::task::990::TaskManager.Task::(_decref) Task=`850b6e77-9a60-4932-b2a7-a7ed70eef20b`::ref 0 aborting False >Thread-1043::DEBUG::2014-07-10 08:06:55,403::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-1043::DEBUG::2014-07-10 08:06:55,403::task::595::TaskManager.Task::(_updateState) Task=`92aae20c-2d38-476b-80df-4bf861f94426`::moving from state init -> state preparing >Thread-1043::INFO::2014-07-10 08:06:55,403::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='411039e4-4af2-4192-9de0-67dc1ed83ba9', options=None) >Thread-1043::DEBUG::2014-07-10 08:06:55,404::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9`ReqID=`221bb106-438d-424b-b6ac-87e2f8561d8c`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo' >Thread-1043::DEBUG::2014-07-10 08:06:55,404::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' for lock type 'shared' >Thread-1043::DEBUG::2014-07-10 08:06:55,405::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' is free. Now locking as 'shared' (1 active user) >Thread-1043::DEBUG::2014-07-10 08:06:55,405::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9`ReqID=`221bb106-438d-424b-b6ac-87e2f8561d8c`::Granted request >Thread-1043::DEBUG::2014-07-10 08:06:55,405::task::827::TaskManager.Task::(resourceAcquired) Task=`92aae20c-2d38-476b-80df-4bf861f94426`::_resourcesAcquired: Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9 (shared) >Thread-1043::DEBUG::2014-07-10 08:06:55,406::task::990::TaskManager.Task::(_decref) Task=`92aae20c-2d38-476b-80df-4bf861f94426`::ref 1 aborting False >Thread-1043::INFO::2014-07-10 08:06:55,407::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DC-REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2, 'domains': u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': 'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c': {'status': u'Active', 'diskfree': '1137495244800', 'isoprefix': '', 'alerts': [], 'disktotal': '1152393412608', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '533841575936', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-1043::DEBUG::2014-07-10 08:06:55,407::task::1185::TaskManager.Task::(prepare) Task=`92aae20c-2d38-476b-80df-4bf861f94426`::finished: {'info': {'name': 'DC-REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2, 'domains': u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': 'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c': {'status': u'Active', 'diskfree': '1137495244800', 'isoprefix': '', 'alerts': [], 'disktotal': '1152393412608', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '533841575936', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-1043::DEBUG::2014-07-10 08:06:55,407::task::595::TaskManager.Task::(_updateState) Task=`92aae20c-2d38-476b-80df-4bf861f94426`::moving from state preparing -> state finished >Thread-1043::DEBUG::2014-07-10 08:06:55,407::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9': < ResourceRef 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9', isValid: 'True' obj: 'None'>} >Thread-1043::DEBUG::2014-07-10 08:06:55,408::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1043::DEBUG::2014-07-10 08:06:55,408::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' >Thread-1043::DEBUG::2014-07-10 08:06:55,408::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' (0 active users) >Thread-1043::DEBUG::2014-07-10 08:06:55,408::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' is free, finding out if anyone is waiting for it. >Thread-1043::DEBUG::2014-07-10 08:06:55,408::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9', Clearing records. >Thread-1043::DEBUG::2014-07-10 08:06:55,409::task::990::TaskManager.Task::(_decref) Task=`92aae20c-2d38-476b-80df-4bf861f94426`::ref 0 aborting False >Dummy-36::DEBUG::2014-07-10 08:06:56,526::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-07-10 08:06:56,659::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0331466 s, 30.9 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 08:06:57,360::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lion.qa.lab.tlv.redhat.com:_export_yuri2_backup2/6a70504d-00df-4869-8695-0f442053f6b6/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-14::DEBUG::2014-07-10 08:06:57,420::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n369 bytes (369 B) copied, 0.000474555 s, 778 kB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-07-10 08:06:58,674::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-07-10 08:06:58,809::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0330354 s, 31.0 MB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-07-10 08:07:00,825::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-07-10 08:07:00,961::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0353157 s, 29.0 MB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-07-10 08:07:02,976::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-07-10 08:07:03,106::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0326565 s, 31.4 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-07-10 08:07:04,131::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/e01a3a36-d2ce-4153-bb57-d6e65b7ed08c/metadata bs=4096 count=1' (cwd None) >Thread-15::DEBUG::2014-07-10 08:07:04,191::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000895921 s, 4.6 MB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-07-10 08:07:05,121::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-07-10 08:07:05,262::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0345023 s, 29.7 MB/s\n'; <rc> = 0 >Thread-1042::DEBUG::2014-07-10 08:07:05,437::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-1042::DEBUG::2014-07-10 08:07:05,438::task::595::TaskManager.Task::(_updateState) Task=`ba360a59-7bc0-43b9-b38d-8707e36ec14d`::moving from state init -> state preparing >Thread-1042::INFO::2014-07-10 08:07:05,438::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='411039e4-4af2-4192-9de0-67dc1ed83ba9', options=None) >Thread-1042::INFO::2014-07-10 08:07:05,439::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2}} >Thread-1042::DEBUG::2014-07-10 08:07:05,439::task::1185::TaskManager.Task::(prepare) Task=`ba360a59-7bc0-43b9-b38d-8707e36ec14d`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2}} >Thread-1042::DEBUG::2014-07-10 08:07:05,439::task::595::TaskManager.Task::(_updateState) Task=`ba360a59-7bc0-43b9-b38d-8707e36ec14d`::moving from state preparing -> state finished >Thread-1042::DEBUG::2014-07-10 08:07:05,439::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-1042::DEBUG::2014-07-10 08:07:05,439::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1042::DEBUG::2014-07-10 08:07:05,440::task::990::TaskManager.Task::(_decref) Task=`ba360a59-7bc0-43b9-b38d-8707e36ec14d`::ref 0 aborting False >Thread-1043::DEBUG::2014-07-10 08:07:05,444::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-1043::DEBUG::2014-07-10 08:07:05,444::task::595::TaskManager.Task::(_updateState) Task=`62c6860e-2766-44ef-a2b7-e2249090edc8`::moving from state init -> state preparing >Thread-1043::INFO::2014-07-10 08:07:05,444::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='411039e4-4af2-4192-9de0-67dc1ed83ba9', options=None) >Thread-1043::DEBUG::2014-07-10 08:07:05,445::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9`ReqID=`66a92180-4a5b-4365-9a2b-527866cfdf6c`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo' >Thread-1043::DEBUG::2014-07-10 08:07:05,445::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' for lock type 'shared' >Thread-1043::DEBUG::2014-07-10 08:07:05,446::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' is free. Now locking as 'shared' (1 active user) >Thread-1043::DEBUG::2014-07-10 08:07:05,446::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9`ReqID=`66a92180-4a5b-4365-9a2b-527866cfdf6c`::Granted request >Thread-1043::DEBUG::2014-07-10 08:07:05,446::task::827::TaskManager.Task::(resourceAcquired) Task=`62c6860e-2766-44ef-a2b7-e2249090edc8`::_resourcesAcquired: Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9 (shared) >Thread-1043::DEBUG::2014-07-10 08:07:05,446::task::990::TaskManager.Task::(_decref) Task=`62c6860e-2766-44ef-a2b7-e2249090edc8`::ref 1 aborting False >Thread-1043::INFO::2014-07-10 08:07:05,447::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DC-REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2, 'domains': u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': 'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c': {'status': u'Active', 'diskfree': '1137495244800', 'isoprefix': '', 'alerts': [], 'disktotal': '1152393412608', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '533841575936', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-1043::DEBUG::2014-07-10 08:07:05,448::task::1185::TaskManager.Task::(prepare) Task=`62c6860e-2766-44ef-a2b7-e2249090edc8`::finished: {'info': {'name': 'DC-REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2, 'domains': u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': 'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c': {'status': u'Active', 'diskfree': '1137495244800', 'isoprefix': '', 'alerts': [], 'disktotal': '1152393412608', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '533841575936', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-1043::DEBUG::2014-07-10 08:07:05,448::task::595::TaskManager.Task::(_updateState) Task=`62c6860e-2766-44ef-a2b7-e2249090edc8`::moving from state preparing -> state finished >Thread-1043::DEBUG::2014-07-10 08:07:05,448::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9': < ResourceRef 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9', isValid: 'True' obj: 'None'>} >Thread-1043::DEBUG::2014-07-10 08:07:05,448::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1043::DEBUG::2014-07-10 08:07:05,449::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' >Thread-1043::DEBUG::2014-07-10 08:07:05,449::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' (0 active users) >Thread-1043::DEBUG::2014-07-10 08:07:05,449::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' is free, finding out if anyone is waiting for it. >Thread-1043::DEBUG::2014-07-10 08:07:05,449::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9', Clearing records. >Thread-1043::DEBUG::2014-07-10 08:07:05,449::task::990::TaskManager.Task::(_decref) Task=`62c6860e-2766-44ef-a2b7-e2249090edc8`::ref 0 aborting False >Dummy-36::DEBUG::2014-07-10 08:07:07,277::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-07-10 08:07:07,413::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0378107 s, 27.1 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 08:07:07,490::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lion.qa.lab.tlv.redhat.com:_export_yuri2_backup2/6a70504d-00df-4869-8695-0f442053f6b6/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-14::DEBUG::2014-07-10 08:07:07,554::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n369 bytes (369 B) copied, 0.000469281 s, 786 kB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-07-10 08:07:09,473::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Thread-1042::DEBUG::2014-07-10 08:07:09,587::task::595::TaskManager.Task::(_updateState) Task=`650aec2c-b6a1-48a4-9edd-dbcf22f1f168`::moving from state init -> state preparing >Thread-1042::INFO::2014-07-10 08:07:09,589::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-1042::INFO::2014-07-10 08:07:09,590::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000895921', 'lastCheck': '5.4', 'valid': True}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000469281', 'lastCheck': '2.0', 'valid': True}} >Thread-1042::DEBUG::2014-07-10 08:07:09,591::task::1185::TaskManager.Task::(prepare) Task=`650aec2c-b6a1-48a4-9edd-dbcf22f1f168`::finished: {u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000895921', 'lastCheck': '5.4', 'valid': True}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000469281', 'lastCheck': '2.0', 'valid': True}} >Thread-1042::DEBUG::2014-07-10 08:07:09,592::task::595::TaskManager.Task::(_updateState) Task=`650aec2c-b6a1-48a4-9edd-dbcf22f1f168`::moving from state preparing -> state finished >Thread-1042::DEBUG::2014-07-10 08:07:09,593::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-1042::DEBUG::2014-07-10 08:07:09,594::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1042::DEBUG::2014-07-10 08:07:09,596::task::990::TaskManager.Task::(_decref) Task=`650aec2c-b6a1-48a4-9edd-dbcf22f1f168`::ref 0 aborting False >Dummy-36::DEBUG::2014-07-10 08:07:09,709::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0293721 s, 34.9 MB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-07-10 08:07:11,724::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-07-10 08:07:11,856::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0324359 s, 31.6 MB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-07-10 08:07:13,871::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-07-10 08:07:13,997::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0296613 s, 34.5 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-07-10 08:07:14,221::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/e01a3a36-d2ce-4153-bb57-d6e65b7ed08c/metadata bs=4096 count=1' (cwd None) >Thread-15::DEBUG::2014-07-10 08:07:14,286::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000720929 s, 5.7 MB/s\n'; <rc> = 0 >Thread-1042::DEBUG::2014-07-10 08:07:15,473::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-1042::DEBUG::2014-07-10 08:07:15,475::task::595::TaskManager.Task::(_updateState) Task=`8f30b55e-e46d-4c7d-a762-fd12fc188e24`::moving from state init -> state preparing >Thread-1042::INFO::2014-07-10 08:07:15,475::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='411039e4-4af2-4192-9de0-67dc1ed83ba9', options=None) >Thread-1042::INFO::2014-07-10 08:07:15,476::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2}} >Thread-1042::DEBUG::2014-07-10 08:07:15,476::task::1185::TaskManager.Task::(prepare) Task=`8f30b55e-e46d-4c7d-a762-fd12fc188e24`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2}} >Thread-1042::DEBUG::2014-07-10 08:07:15,476::task::595::TaskManager.Task::(_updateState) Task=`8f30b55e-e46d-4c7d-a762-fd12fc188e24`::moving from state preparing -> state finished >Thread-1042::DEBUG::2014-07-10 08:07:15,476::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-1042::DEBUG::2014-07-10 08:07:15,477::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1042::DEBUG::2014-07-10 08:07:15,477::task::990::TaskManager.Task::(_decref) Task=`8f30b55e-e46d-4c7d-a762-fd12fc188e24`::ref 0 aborting False >Thread-1043::DEBUG::2014-07-10 08:07:15,481::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-1043::DEBUG::2014-07-10 08:07:15,481::task::595::TaskManager.Task::(_updateState) Task=`d6390d3b-0442-4fd9-8433-f3a9c53c8a6b`::moving from state init -> state preparing >Thread-1043::INFO::2014-07-10 08:07:15,482::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='411039e4-4af2-4192-9de0-67dc1ed83ba9', options=None) >Thread-1043::DEBUG::2014-07-10 08:07:15,482::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9`ReqID=`6ceeeb4e-9777-401a-aea8-970a0b49d786`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo' >Thread-1043::DEBUG::2014-07-10 08:07:15,483::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' for lock type 'shared' >Thread-1043::DEBUG::2014-07-10 08:07:15,483::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' is free. Now locking as 'shared' (1 active user) >Thread-1043::DEBUG::2014-07-10 08:07:15,483::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9`ReqID=`6ceeeb4e-9777-401a-aea8-970a0b49d786`::Granted request >Thread-1043::DEBUG::2014-07-10 08:07:15,484::task::827::TaskManager.Task::(resourceAcquired) Task=`d6390d3b-0442-4fd9-8433-f3a9c53c8a6b`::_resourcesAcquired: Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9 (shared) >Thread-1043::DEBUG::2014-07-10 08:07:15,484::task::990::TaskManager.Task::(_decref) Task=`d6390d3b-0442-4fd9-8433-f3a9c53c8a6b`::ref 1 aborting False >Thread-1043::INFO::2014-07-10 08:07:15,485::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DC-REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2, 'domains': u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': 'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c': {'status': u'Active', 'diskfree': '1137495244800', 'isoprefix': '', 'alerts': [], 'disktotal': '1152393412608', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '533841575936', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-1043::DEBUG::2014-07-10 08:07:15,485::task::1185::TaskManager.Task::(prepare) Task=`d6390d3b-0442-4fd9-8433-f3a9c53c8a6b`::finished: {'info': {'name': 'DC-REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2, 'domains': u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': 'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c': {'status': u'Active', 'diskfree': '1137495244800', 'isoprefix': '', 'alerts': [], 'disktotal': '1152393412608', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '533841575936', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-1043::DEBUG::2014-07-10 08:07:15,486::task::595::TaskManager.Task::(_updateState) Task=`d6390d3b-0442-4fd9-8433-f3a9c53c8a6b`::moving from state preparing -> state finished >Thread-1043::DEBUG::2014-07-10 08:07:15,486::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9': < ResourceRef 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9', isValid: 'True' obj: 'None'>} >Thread-1043::DEBUG::2014-07-10 08:07:15,486::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1043::DEBUG::2014-07-10 08:07:15,486::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' >Thread-1043::DEBUG::2014-07-10 08:07:15,486::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' (0 active users) >Thread-1043::DEBUG::2014-07-10 08:07:15,487::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' is free, finding out if anyone is waiting for it. >Thread-1043::DEBUG::2014-07-10 08:07:15,487::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9', Clearing records. >Thread-1043::DEBUG::2014-07-10 08:07:15,487::task::990::TaskManager.Task::(_decref) Task=`d6390d3b-0442-4fd9-8433-f3a9c53c8a6b`::ref 0 aborting False >Dummy-36::DEBUG::2014-07-10 08:07:16,014::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-07-10 08:07:16,150::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0376832 s, 27.2 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 08:07:17,579::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lion.qa.lab.tlv.redhat.com:_export_yuri2_backup2/6a70504d-00df-4869-8695-0f442053f6b6/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-14::DEBUG::2014-07-10 08:07:17,650::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n369 bytes (369 B) copied, 0.000477786 s, 772 kB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-07-10 08:07:18,165::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-07-10 08:07:18,305::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0350331 s, 29.2 MB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-07-10 08:07:20,320::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-07-10 08:07:20,447::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0325091 s, 31.5 MB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-07-10 08:07:22,463::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-07-10 08:07:22,604::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0406747 s, 25.2 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-07-10 08:07:24,316::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/e01a3a36-d2ce-4153-bb57-d6e65b7ed08c/metadata bs=4096 count=1' (cwd None) >Thread-15::DEBUG::2014-07-10 08:07:24,380::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00084618 s, 4.8 MB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-07-10 08:07:24,619::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-07-10 08:07:24,762::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0381141 s, 26.9 MB/s\n'; <rc> = 0 >Thread-1042::DEBUG::2014-07-10 08:07:24,814::task::595::TaskManager.Task::(_updateState) Task=`242a23fe-ccfc-4c70-8db5-7f2b8e011348`::moving from state init -> state preparing >Thread-1042::INFO::2014-07-10 08:07:24,814::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-1042::INFO::2014-07-10 08:07:24,815::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00084618', 'lastCheck': '0.4', 'valid': True}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000477786', 'lastCheck': '7.2', 'valid': True}} >Thread-1042::DEBUG::2014-07-10 08:07:24,815::task::1185::TaskManager.Task::(prepare) Task=`242a23fe-ccfc-4c70-8db5-7f2b8e011348`::finished: {u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00084618', 'lastCheck': '0.4', 'valid': True}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000477786', 'lastCheck': '7.2', 'valid': True}} >Thread-1042::DEBUG::2014-07-10 08:07:24,815::task::595::TaskManager.Task::(_updateState) Task=`242a23fe-ccfc-4c70-8db5-7f2b8e011348`::moving from state preparing -> state finished >Thread-1042::DEBUG::2014-07-10 08:07:24,815::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-1042::DEBUG::2014-07-10 08:07:24,815::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1042::DEBUG::2014-07-10 08:07:24,816::task::990::TaskManager.Task::(_decref) Task=`242a23fe-ccfc-4c70-8db5-7f2b8e011348`::ref 0 aborting False >Thread-1042::DEBUG::2014-07-10 08:07:25,550::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-1042::DEBUG::2014-07-10 08:07:25,550::task::595::TaskManager.Task::(_updateState) Task=`e72aa007-a3f6-4b54-ba75-27e8d7585c5c`::moving from state init -> state preparing >Thread-1042::INFO::2014-07-10 08:07:25,551::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='411039e4-4af2-4192-9de0-67dc1ed83ba9', options=None) >Thread-1042::INFO::2014-07-10 08:07:25,551::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2}} >Thread-1042::DEBUG::2014-07-10 08:07:25,551::task::1185::TaskManager.Task::(prepare) Task=`e72aa007-a3f6-4b54-ba75-27e8d7585c5c`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2}} >Thread-1042::DEBUG::2014-07-10 08:07:25,552::task::595::TaskManager.Task::(_updateState) Task=`e72aa007-a3f6-4b54-ba75-27e8d7585c5c`::moving from state preparing -> state finished >Thread-1042::DEBUG::2014-07-10 08:07:25,552::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-1042::DEBUG::2014-07-10 08:07:25,552::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1042::DEBUG::2014-07-10 08:07:25,552::task::990::TaskManager.Task::(_decref) Task=`e72aa007-a3f6-4b54-ba75-27e8d7585c5c`::ref 0 aborting False >Thread-1043::DEBUG::2014-07-10 08:07:25,556::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-1043::DEBUG::2014-07-10 08:07:25,557::task::595::TaskManager.Task::(_updateState) Task=`c3a49b34-74ac-46ee-8c70-7ecce95ce10b`::moving from state init -> state preparing >Thread-1043::INFO::2014-07-10 08:07:25,557::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='411039e4-4af2-4192-9de0-67dc1ed83ba9', options=None) >Thread-1043::DEBUG::2014-07-10 08:07:25,558::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9`ReqID=`5254cd13-663b-4761-868d-8540f44ba01b`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo' >Thread-1043::DEBUG::2014-07-10 08:07:25,558::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' for lock type 'shared' >Thread-1043::DEBUG::2014-07-10 08:07:25,558::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' is free. Now locking as 'shared' (1 active user) >Thread-1043::DEBUG::2014-07-10 08:07:25,558::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9`ReqID=`5254cd13-663b-4761-868d-8540f44ba01b`::Granted request >Thread-1043::DEBUG::2014-07-10 08:07:25,559::task::827::TaskManager.Task::(resourceAcquired) Task=`c3a49b34-74ac-46ee-8c70-7ecce95ce10b`::_resourcesAcquired: Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9 (shared) >Thread-1043::DEBUG::2014-07-10 08:07:25,559::task::990::TaskManager.Task::(_decref) Task=`c3a49b34-74ac-46ee-8c70-7ecce95ce10b`::ref 1 aborting False >Thread-1043::INFO::2014-07-10 08:07:25,560::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DC-REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2, 'domains': u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': 'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c': {'status': u'Active', 'diskfree': '1137495244800', 'isoprefix': '', 'alerts': [], 'disktotal': '1152393412608', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '533841575936', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-1043::DEBUG::2014-07-10 08:07:25,560::task::1185::TaskManager.Task::(prepare) Task=`c3a49b34-74ac-46ee-8c70-7ecce95ce10b`::finished: {'info': {'name': 'DC-REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2, 'domains': u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': 'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c': {'status': u'Active', 'diskfree': '1137495244800', 'isoprefix': '', 'alerts': [], 'disktotal': '1152393412608', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '533841575936', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-1043::DEBUG::2014-07-10 08:07:25,561::task::595::TaskManager.Task::(_updateState) Task=`c3a49b34-74ac-46ee-8c70-7ecce95ce10b`::moving from state preparing -> state finished >Thread-1043::DEBUG::2014-07-10 08:07:25,561::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9': < ResourceRef 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9', isValid: 'True' obj: 'None'>} >Thread-1043::DEBUG::2014-07-10 08:07:25,561::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1043::DEBUG::2014-07-10 08:07:25,561::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' >Thread-1043::DEBUG::2014-07-10 08:07:25,561::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' (0 active users) >Thread-1043::DEBUG::2014-07-10 08:07:25,562::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' is free, finding out if anyone is waiting for it. >Thread-1043::DEBUG::2014-07-10 08:07:25,562::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9', Clearing records. >Thread-1043::DEBUG::2014-07-10 08:07:25,562::task::990::TaskManager.Task::(_decref) Task=`c3a49b34-74ac-46ee-8c70-7ecce95ce10b`::ref 0 aborting False >Dummy-36::DEBUG::2014-07-10 08:07:26,778::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-07-10 08:07:26,914::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0385004 s, 26.6 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 08:07:27,680::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lion.qa.lab.tlv.redhat.com:_export_yuri2_backup2/6a70504d-00df-4869-8695-0f442053f6b6/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-14::DEBUG::2014-07-10 08:07:27,744::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n369 bytes (369 B) copied, 0.000454584 s, 812 kB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-07-10 08:07:28,929::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-07-10 08:07:29,066::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0333338 s, 30.7 MB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-07-10 08:07:31,082::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-07-10 08:07:31,222::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0379682 s, 27.0 MB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-07-10 08:07:33,237::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-07-10 08:07:33,368::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0326605 s, 31.4 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-07-10 08:07:34,410::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/e01a3a36-d2ce-4153-bb57-d6e65b7ed08c/metadata bs=4096 count=1' (cwd None) >Thread-15::DEBUG::2014-07-10 08:07:34,475::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000734776 s, 5.6 MB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-07-10 08:07:35,384::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-07-10 08:07:35,515::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0300424 s, 34.1 MB/s\n'; <rc> = 0 >Thread-1042::DEBUG::2014-07-10 08:07:35,587::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-1042::DEBUG::2014-07-10 08:07:35,588::task::595::TaskManager.Task::(_updateState) Task=`3fe48fe7-2d60-43ba-bd62-aa2f85418b46`::moving from state init -> state preparing >Thread-1042::INFO::2014-07-10 08:07:35,589::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='411039e4-4af2-4192-9de0-67dc1ed83ba9', options=None) >Thread-1042::INFO::2014-07-10 08:07:35,589::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2}} >Thread-1042::DEBUG::2014-07-10 08:07:35,589::task::1185::TaskManager.Task::(prepare) Task=`3fe48fe7-2d60-43ba-bd62-aa2f85418b46`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2}} >Thread-1042::DEBUG::2014-07-10 08:07:35,590::task::595::TaskManager.Task::(_updateState) Task=`3fe48fe7-2d60-43ba-bd62-aa2f85418b46`::moving from state preparing -> state finished >Thread-1042::DEBUG::2014-07-10 08:07:35,590::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-1042::DEBUG::2014-07-10 08:07:35,590::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1042::DEBUG::2014-07-10 08:07:35,590::task::990::TaskManager.Task::(_decref) Task=`3fe48fe7-2d60-43ba-bd62-aa2f85418b46`::ref 0 aborting False >Thread-1043::DEBUG::2014-07-10 08:07:35,594::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-1043::DEBUG::2014-07-10 08:07:35,595::task::595::TaskManager.Task::(_updateState) Task=`7fe3da8c-3b17-48b0-acfe-e65231f34e58`::moving from state init -> state preparing >Thread-1043::INFO::2014-07-10 08:07:35,595::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='411039e4-4af2-4192-9de0-67dc1ed83ba9', options=None) >Thread-1043::DEBUG::2014-07-10 08:07:35,596::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9`ReqID=`e8c9a896-0fd7-41bf-b144-d3b4a281b8b1`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo' >Thread-1043::DEBUG::2014-07-10 08:07:35,596::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' for lock type 'shared' >Thread-1043::DEBUG::2014-07-10 08:07:35,596::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' is free. Now locking as 'shared' (1 active user) >Thread-1043::DEBUG::2014-07-10 08:07:35,596::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9`ReqID=`e8c9a896-0fd7-41bf-b144-d3b4a281b8b1`::Granted request >Thread-1043::DEBUG::2014-07-10 08:07:35,597::task::827::TaskManager.Task::(resourceAcquired) Task=`7fe3da8c-3b17-48b0-acfe-e65231f34e58`::_resourcesAcquired: Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9 (shared) >Thread-1043::DEBUG::2014-07-10 08:07:35,597::task::990::TaskManager.Task::(_decref) Task=`7fe3da8c-3b17-48b0-acfe-e65231f34e58`::ref 1 aborting False >Thread-1043::INFO::2014-07-10 08:07:35,598::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DC-REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2, 'domains': u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': 'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c': {'status': u'Active', 'diskfree': '1137495244800', 'isoprefix': '', 'alerts': [], 'disktotal': '1152393412608', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '533841575936', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-1043::DEBUG::2014-07-10 08:07:35,599::task::1185::TaskManager.Task::(prepare) Task=`7fe3da8c-3b17-48b0-acfe-e65231f34e58`::finished: {'info': {'name': 'DC-REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2, 'domains': u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': 'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c': {'status': u'Active', 'diskfree': '1137495244800', 'isoprefix': '', 'alerts': [], 'disktotal': '1152393412608', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '533841575936', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-1043::DEBUG::2014-07-10 08:07:35,599::task::595::TaskManager.Task::(_updateState) Task=`7fe3da8c-3b17-48b0-acfe-e65231f34e58`::moving from state preparing -> state finished >Thread-1043::DEBUG::2014-07-10 08:07:35,599::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9': < ResourceRef 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9', isValid: 'True' obj: 'None'>} >Thread-1043::DEBUG::2014-07-10 08:07:35,599::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1043::DEBUG::2014-07-10 08:07:35,599::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' >Thread-1043::DEBUG::2014-07-10 08:07:35,600::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' (0 active users) >Thread-1043::DEBUG::2014-07-10 08:07:35,600::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' is free, finding out if anyone is waiting for it. >Thread-1043::DEBUG::2014-07-10 08:07:35,600::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9', Clearing records. >Thread-1043::DEBUG::2014-07-10 08:07:35,600::task::990::TaskManager.Task::(_decref) Task=`7fe3da8c-3b17-48b0-acfe-e65231f34e58`::ref 0 aborting False >Dummy-36::DEBUG::2014-07-10 08:07:37,530::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-07-10 08:07:37,662::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0377734 s, 27.1 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 08:07:37,770::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lion.qa.lab.tlv.redhat.com:_export_yuri2_backup2/6a70504d-00df-4869-8695-0f442053f6b6/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-14::DEBUG::2014-07-10 08:07:37,832::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n369 bytes (369 B) copied, 0.000454027 s, 813 kB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-07-10 08:07:39,671::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-07-10 08:07:39,802::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0353933 s, 28.9 MB/s\n'; <rc> = 0 >Thread-1042::DEBUG::2014-07-10 08:07:39,965::task::595::TaskManager.Task::(_updateState) Task=`4c51e625-4855-4bc7-bbaf-072ba402b2c9`::moving from state init -> state preparing >Thread-1042::INFO::2014-07-10 08:07:39,965::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-1042::INFO::2014-07-10 08:07:39,966::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000734776', 'lastCheck': '5.5', 'valid': True}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000454027', 'lastCheck': '2.1', 'valid': True}} >Thread-1042::DEBUG::2014-07-10 08:07:39,966::task::1185::TaskManager.Task::(prepare) Task=`4c51e625-4855-4bc7-bbaf-072ba402b2c9`::finished: {u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000734776', 'lastCheck': '5.5', 'valid': True}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000454027', 'lastCheck': '2.1', 'valid': True}} >Thread-1042::DEBUG::2014-07-10 08:07:39,966::task::595::TaskManager.Task::(_updateState) Task=`4c51e625-4855-4bc7-bbaf-072ba402b2c9`::moving from state preparing -> state finished >Thread-1042::DEBUG::2014-07-10 08:07:39,966::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-1042::DEBUG::2014-07-10 08:07:39,967::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1042::DEBUG::2014-07-10 08:07:39,967::task::990::TaskManager.Task::(_decref) Task=`4c51e625-4855-4bc7-bbaf-072ba402b2c9`::ref 0 aborting False >Dummy-36::DEBUG::2014-07-10 08:07:41,817::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-07-10 08:07:41,954::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0379183 s, 27.0 MB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-07-10 08:07:43,968::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-07-10 08:07:44,094::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0297262 s, 34.4 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-07-10 08:07:44,504::domainMonitor::192::Storage.DomainMonitorThread::(_monitorDomain) Refreshing domain e01a3a36-d2ce-4153-bb57-d6e65b7ed08c >Thread-15::ERROR::2014-07-10 08:07:44,505::sdc::137::Storage.StorageDomainCache::(_findDomain) looking for unfetched domain e01a3a36-d2ce-4153-bb57-d6e65b7ed08c >Thread-15::ERROR::2014-07-10 08:07:44,505::sdc::154::Storage.StorageDomainCache::(_findUnfetchedDomain) looking for domain e01a3a36-d2ce-4153-bb57-d6e65b7ed08c >Thread-15::DEBUG::2014-07-10 08:07:44,505::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with LvMetadataRW backend >Thread-15::DEBUG::2014-07-10 08:07:44,506::blockSD::336::Storage.Misc.excCmd::(readlines) '/bin/dd iflag=direct skip=0 bs=2048 if=/dev/e01a3a36-d2ce-4153-bb57-d6e65b7ed08c/metadata count=1' (cwd None) >Thread-15::DEBUG::2014-07-10 08:07:44,568::blockSD::336::Storage.Misc.excCmd::(readlines) SUCCESS: <err> = '1+0 records in\n1+0 records out\n2048 bytes (2.0 kB) copied, 0.000818777 s, 2.5 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-07-10 08:07:44,569::misc::282::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '2048 bytes (2.0 kB) copied, 0.000818777 s, 2.5 MB/s'], size: 2048 >Thread-15::DEBUG::2014-07-10 08:07:44,569::persistentDict::234::Storage.PersistentDict::(refresh) read lines (LvMetadataRW)=[] >Thread-15::WARNING::2014-07-10 08:07:44,569::persistentDict::256::Storage.PersistentDict::(refresh) data has no embedded checksum - trust it as it is >Thread-15::DEBUG::2014-07-10 08:07:44,569::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with VGTagMetadataRW backend >Thread-15::DEBUG::2014-07-10 08:07:44,570::lvm::503::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-15::DEBUG::2014-07-10 08:07:44,570::lvm::505::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-15::DEBUG::2014-07-10 08:07:44,570::lvm::513::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-15::DEBUG::2014-07-10 08:07:44,571::lvm::525::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-15::DEBUG::2014-07-10 08:07:44,571::lvm::373::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-15::DEBUG::2014-07-10 08:07:44,572::lvm::296::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/3600601601282300032826addbbdae311|/dev/mapper/360060160f4a030003840ec867ddee311|/dev/mapper/367cad74c2fcba00019e6afd20c781e67|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name e01a3a36-d2ce-4153-bb57-d6e65b7ed08c' (cwd None) >Thread-15::DEBUG::2014-07-10 08:07:45,031::lvm::296::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-15::DEBUG::2014-07-10 08:07:45,033::lvm::415::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-15::DEBUG::2014-07-10 08:07:45,033::persistentDict::234::Storage.PersistentDict::(refresh) read lines (VGTagMetadataRW)=['LEASETIMESEC=60', 'CLASS=Data', 'VERSION=3', u'PV1=pv:360060160f4a030003840ec867ddee311,uuid:0eUwla-dsA3-g6ia-RU23-cual-0rt9-KzkxLj,pestart:0,pecount:397,mapoffset:8189', u'PV0=pv:3600601601282300032826addbbdae311,uuid:ZdReOp-Yf8A-beQm-ne4I-pN3J-rxgm-9Ew0S1,pestart:0,pecount:8189,mapoffset:0', 'LOGBLKSIZE=512', 'LEASERETRIES=3', 'IOOPTIMEOUTSEC=10', 'LOCKRENEWALINTERVALSEC=5', 'PHYBLKSIZE=512', 'SDUUID=e01a3a36-d2ce-4153-bb57-d6e65b7ed08c', 'DESCRIPTION=SD-REAL', 'LOCKPOLICY=', 'VGUUID=GJcVo5-Y0kU-CDub-zITS-zfoL-Z7hz-SeVeIe', 'TYPE=ISCSI', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=DC-REAL', 'ROLE=Master', 'POOL_UUID=411039e4-4af2-4192-9de0-67dc1ed83ba9', 'POOL_SPM_ID=1', u'POOL_DOMAINS=6a70504d-00df-4869-8695-0f442053f6b6:Active,e01a3a36-d2ce-4153-bb57-d6e65b7ed08c:Active', '_SHA_CKSUM=cefcf6543a5de3bd5b35901e3ca494c6a6185b63', 'POOL_SPM_LVER=2'] >Thread-15::INFO::2014-07-10 08:07:45,035::sd::384::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace e01a3a36-d2ce-4153-bb57-d6e65b7ed08c_imageNS already registered >Thread-15::INFO::2014-07-10 08:07:45,035::sd::392::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace e01a3a36-d2ce-4153-bb57-d6e65b7ed08c_volumeNS already registered >Thread-15::INFO::2014-07-10 08:07:45,035::blockSD::452::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace e01a3a36-d2ce-4153-bb57-d6e65b7ed08c_lvmActivationNS already registered >Thread-15::DEBUG::2014-07-10 08:07:45,036::lvm::296::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgck --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/3600601601282300032826addbbdae311|/dev/mapper/360060160f4a030003840ec867ddee311|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } " e01a3a36-d2ce-4153-bb57-d6e65b7ed08c' (cwd None) >Thread-15::DEBUG::2014-07-10 08:07:45,275::lvm::296::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-15::DEBUG::2014-07-10 08:07:45,277::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/e01a3a36-d2ce-4153-bb57-d6e65b7ed08c/metadata bs=4096 count=1' (cwd None) >Thread-15::DEBUG::2014-07-10 08:07:45,337::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000807389 s, 5.1 MB/s\n'; <rc> = 0 >Thread-1042::DEBUG::2014-07-10 08:07:45,646::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-1042::DEBUG::2014-07-10 08:07:45,647::task::595::TaskManager.Task::(_updateState) Task=`71858199-43b0-42e2-a44e-4179dd4df812`::moving from state init -> state preparing >Thread-1042::INFO::2014-07-10 08:07:45,648::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='411039e4-4af2-4192-9de0-67dc1ed83ba9', options=None) >Thread-1042::INFO::2014-07-10 08:07:45,648::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2}} >Thread-1042::DEBUG::2014-07-10 08:07:45,649::task::1185::TaskManager.Task::(prepare) Task=`71858199-43b0-42e2-a44e-4179dd4df812`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2}} >Thread-1042::DEBUG::2014-07-10 08:07:45,649::task::595::TaskManager.Task::(_updateState) Task=`71858199-43b0-42e2-a44e-4179dd4df812`::moving from state preparing -> state finished >Thread-1042::DEBUG::2014-07-10 08:07:45,649::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-1042::DEBUG::2014-07-10 08:07:45,649::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1042::DEBUG::2014-07-10 08:07:45,649::task::990::TaskManager.Task::(_decref) Task=`71858199-43b0-42e2-a44e-4179dd4df812`::ref 0 aborting False >Thread-1043::DEBUG::2014-07-10 08:07:45,653::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-1043::DEBUG::2014-07-10 08:07:45,654::task::595::TaskManager.Task::(_updateState) Task=`23dd214f-1337-4544-b78c-0a59948aead2`::moving from state init -> state preparing >Thread-1043::INFO::2014-07-10 08:07:45,654::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='411039e4-4af2-4192-9de0-67dc1ed83ba9', options=None) >Thread-1043::DEBUG::2014-07-10 08:07:45,655::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9`ReqID=`bd7841a3-451f-4e9f-b093-2375768cf6fa`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo' >Thread-1043::DEBUG::2014-07-10 08:07:45,655::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' for lock type 'shared' >Thread-1043::DEBUG::2014-07-10 08:07:45,655::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' is free. Now locking as 'shared' (1 active user) >Thread-1043::DEBUG::2014-07-10 08:07:45,656::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9`ReqID=`bd7841a3-451f-4e9f-b093-2375768cf6fa`::Granted request >Thread-1043::DEBUG::2014-07-10 08:07:45,656::task::827::TaskManager.Task::(resourceAcquired) Task=`23dd214f-1337-4544-b78c-0a59948aead2`::_resourcesAcquired: Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9 (shared) >Thread-1043::DEBUG::2014-07-10 08:07:45,656::task::990::TaskManager.Task::(_decref) Task=`23dd214f-1337-4544-b78c-0a59948aead2`::ref 1 aborting False >Thread-1043::INFO::2014-07-10 08:07:45,657::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DC-REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2, 'domains': u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': 'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c': {'status': u'Active', 'diskfree': '1137495244800', 'isoprefix': '', 'alerts': [], 'disktotal': '1152393412608', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '533841575936', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-1043::DEBUG::2014-07-10 08:07:45,658::task::1185::TaskManager.Task::(prepare) Task=`23dd214f-1337-4544-b78c-0a59948aead2`::finished: {'info': {'name': 'DC-REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2, 'domains': u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': 'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c': {'status': u'Active', 'diskfree': '1137495244800', 'isoprefix': '', 'alerts': [], 'disktotal': '1152393412608', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '533841575936', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-1043::DEBUG::2014-07-10 08:07:45,658::task::595::TaskManager.Task::(_updateState) Task=`23dd214f-1337-4544-b78c-0a59948aead2`::moving from state preparing -> state finished >Thread-1043::DEBUG::2014-07-10 08:07:45,658::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9': < ResourceRef 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9', isValid: 'True' obj: 'None'>} >Thread-1043::DEBUG::2014-07-10 08:07:45,658::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1043::DEBUG::2014-07-10 08:07:45,659::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' >Thread-1043::DEBUG::2014-07-10 08:07:45,659::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' (0 active users) >Thread-1043::DEBUG::2014-07-10 08:07:45,659::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' is free, finding out if anyone is waiting for it. >Thread-1043::DEBUG::2014-07-10 08:07:45,659::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9', Clearing records. >Thread-1043::DEBUG::2014-07-10 08:07:45,659::task::990::TaskManager.Task::(_decref) Task=`23dd214f-1337-4544-b78c-0a59948aead2`::ref 0 aborting False >Dummy-36::DEBUG::2014-07-10 08:07:46,138::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-07-10 08:07:46,282::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0398249 s, 25.7 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 08:07:47,857::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lion.qa.lab.tlv.redhat.com:_export_yuri2_backup2/6a70504d-00df-4869-8695-0f442053f6b6/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-14::DEBUG::2014-07-10 08:07:47,920::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n369 bytes (369 B) copied, 0.000436736 s, 845 kB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-07-10 08:07:48,297::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-07-10 08:07:48,439::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0382359 s, 26.8 MB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-07-10 08:07:50,455::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-07-10 08:07:50,587::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.032759 s, 31.3 MB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-07-10 08:07:52,602::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-07-10 08:07:52,736::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0329391 s, 31.1 MB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-07-10 08:07:54,751::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-07-10 08:07:54,891::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0406761 s, 25.2 MB/s\n'; <rc> = 0 >Thread-1042::DEBUG::2014-07-10 08:07:55,130::task::595::TaskManager.Task::(_updateState) Task=`440effb1-2de3-45ee-823b-a31088da2b2d`::moving from state init -> state preparing >Thread-1042::INFO::2014-07-10 08:07:55,131::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-1042::INFO::2014-07-10 08:07:55,131::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000807389', 'lastCheck': '9.8', 'valid': True}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000436736', 'lastCheck': '7.2', 'valid': True}} >Thread-1042::DEBUG::2014-07-10 08:07:55,131::task::1185::TaskManager.Task::(prepare) Task=`440effb1-2de3-45ee-823b-a31088da2b2d`::finished: {u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000807389', 'lastCheck': '9.8', 'valid': True}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000436736', 'lastCheck': '7.2', 'valid': True}} >Thread-1042::DEBUG::2014-07-10 08:07:55,132::task::595::TaskManager.Task::(_updateState) Task=`440effb1-2de3-45ee-823b-a31088da2b2d`::moving from state preparing -> state finished >Thread-1042::DEBUG::2014-07-10 08:07:55,132::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-1042::DEBUG::2014-07-10 08:07:55,132::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1042::DEBUG::2014-07-10 08:07:55,132::task::990::TaskManager.Task::(_decref) Task=`440effb1-2de3-45ee-823b-a31088da2b2d`::ref 0 aborting False >Thread-15::DEBUG::2014-07-10 08:07:55,368::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/e01a3a36-d2ce-4153-bb57-d6e65b7ed08c/metadata bs=4096 count=1' (cwd None) >Thread-15::DEBUG::2014-07-10 08:07:55,435::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000911815 s, 4.5 MB/s\n'; <rc> = 0 >Thread-1042::DEBUG::2014-07-10 08:07:55,687::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-1042::DEBUG::2014-07-10 08:07:55,688::task::595::TaskManager.Task::(_updateState) Task=`e2ae3e6d-224f-4108-8c89-f8ebe232713b`::moving from state init -> state preparing >Thread-1042::INFO::2014-07-10 08:07:55,688::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='411039e4-4af2-4192-9de0-67dc1ed83ba9', options=None) >Thread-1042::INFO::2014-07-10 08:07:55,689::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2}} >Thread-1042::DEBUG::2014-07-10 08:07:55,689::task::1185::TaskManager.Task::(prepare) Task=`e2ae3e6d-224f-4108-8c89-f8ebe232713b`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2}} >Thread-1042::DEBUG::2014-07-10 08:07:55,689::task::595::TaskManager.Task::(_updateState) Task=`e2ae3e6d-224f-4108-8c89-f8ebe232713b`::moving from state preparing -> state finished >Thread-1042::DEBUG::2014-07-10 08:07:55,689::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-1042::DEBUG::2014-07-10 08:07:55,689::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1042::DEBUG::2014-07-10 08:07:55,690::task::990::TaskManager.Task::(_decref) Task=`e2ae3e6d-224f-4108-8c89-f8ebe232713b`::ref 0 aborting False >Thread-1043::DEBUG::2014-07-10 08:07:55,693::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-1043::DEBUG::2014-07-10 08:07:55,693::task::595::TaskManager.Task::(_updateState) Task=`13889d84-2822-4354-9feb-3b72f4adfbb9`::moving from state init -> state preparing >Thread-1043::INFO::2014-07-10 08:07:55,694::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='411039e4-4af2-4192-9de0-67dc1ed83ba9', options=None) >Thread-1043::DEBUG::2014-07-10 08:07:55,694::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9`ReqID=`d534d5b9-a1c0-4386-91bc-ae035b61c627`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo' >Thread-1043::DEBUG::2014-07-10 08:07:55,694::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' for lock type 'shared' >Thread-1043::DEBUG::2014-07-10 08:07:55,695::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' is free. Now locking as 'shared' (1 active user) >Thread-1043::DEBUG::2014-07-10 08:07:55,695::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9`ReqID=`d534d5b9-a1c0-4386-91bc-ae035b61c627`::Granted request >Thread-1043::DEBUG::2014-07-10 08:07:55,695::task::827::TaskManager.Task::(resourceAcquired) Task=`13889d84-2822-4354-9feb-3b72f4adfbb9`::_resourcesAcquired: Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9 (shared) >Thread-1043::DEBUG::2014-07-10 08:07:55,695::task::990::TaskManager.Task::(_decref) Task=`13889d84-2822-4354-9feb-3b72f4adfbb9`::ref 1 aborting False >Thread-1043::INFO::2014-07-10 08:07:55,696::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DC-REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2, 'domains': u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': 'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c': {'status': u'Active', 'diskfree': '1137495244800', 'isoprefix': '', 'alerts': [], 'disktotal': '1152393412608', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '533841575936', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-1043::DEBUG::2014-07-10 08:07:55,697::task::1185::TaskManager.Task::(prepare) Task=`13889d84-2822-4354-9feb-3b72f4adfbb9`::finished: {'info': {'name': 'DC-REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2, 'domains': u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': 'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c': {'status': u'Active', 'diskfree': '1137495244800', 'isoprefix': '', 'alerts': [], 'disktotal': '1152393412608', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '533841575936', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-1043::DEBUG::2014-07-10 08:07:55,697::task::595::TaskManager.Task::(_updateState) Task=`13889d84-2822-4354-9feb-3b72f4adfbb9`::moving from state preparing -> state finished >Thread-1043::DEBUG::2014-07-10 08:07:55,697::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9': < ResourceRef 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9', isValid: 'True' obj: 'None'>} >Thread-1043::DEBUG::2014-07-10 08:07:55,697::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1043::DEBUG::2014-07-10 08:07:55,697::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' >Thread-1043::DEBUG::2014-07-10 08:07:55,698::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' (0 active users) >Thread-1043::DEBUG::2014-07-10 08:07:55,698::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' is free, finding out if anyone is waiting for it. >Thread-1043::DEBUG::2014-07-10 08:07:55,698::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9', Clearing records. >Thread-1043::DEBUG::2014-07-10 08:07:55,698::task::990::TaskManager.Task::(_decref) Task=`13889d84-2822-4354-9feb-3b72f4adfbb9`::ref 0 aborting False >Dummy-36::DEBUG::2014-07-10 08:07:56,906::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-07-10 08:07:57,045::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0376577 s, 27.2 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 08:07:57,951::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lion.qa.lab.tlv.redhat.com:_export_yuri2_backup2/6a70504d-00df-4869-8695-0f442053f6b6/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-14::DEBUG::2014-07-10 08:07:58,014::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n369 bytes (369 B) copied, 0.000449924 s, 820 kB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-07-10 08:07:59,061::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-07-10 08:07:59,198::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0327245 s, 31.3 MB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-07-10 08:08:01,213::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-07-10 08:08:01,349::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0389861 s, 26.3 MB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-07-10 08:08:03,364::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-07-10 08:08:03,502::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0371022 s, 27.6 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-07-10 08:08:05,465::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/e01a3a36-d2ce-4153-bb57-d6e65b7ed08c/metadata bs=4096 count=1' (cwd None) >Dummy-36::DEBUG::2014-07-10 08:08:05,526::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Thread-15::DEBUG::2014-07-10 08:08:05,601::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000771195 s, 5.3 MB/s\n'; <rc> = 0 >Thread-1042::DEBUG::2014-07-10 08:08:05,728::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-1042::DEBUG::2014-07-10 08:08:05,736::task::595::TaskManager.Task::(_updateState) Task=`30ce9005-f4b6-4fef-9fc5-62705bb494cf`::moving from state init -> state preparing >Thread-1042::INFO::2014-07-10 08:08:05,742::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='411039e4-4af2-4192-9de0-67dc1ed83ba9', options=None) >Thread-1042::INFO::2014-07-10 08:08:05,750::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2}} >Thread-1042::DEBUG::2014-07-10 08:08:05,755::task::1185::TaskManager.Task::(prepare) Task=`30ce9005-f4b6-4fef-9fc5-62705bb494cf`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2}} >Thread-1042::DEBUG::2014-07-10 08:08:05,760::task::595::TaskManager.Task::(_updateState) Task=`30ce9005-f4b6-4fef-9fc5-62705bb494cf`::moving from state preparing -> state finished >Thread-1042::DEBUG::2014-07-10 08:08:05,765::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-1042::DEBUG::2014-07-10 08:08:05,770::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1042::DEBUG::2014-07-10 08:08:05,775::task::990::TaskManager.Task::(_decref) Task=`30ce9005-f4b6-4fef-9fc5-62705bb494cf`::ref 0 aborting False >Thread-1043::DEBUG::2014-07-10 08:08:05,801::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-1043::DEBUG::2014-07-10 08:08:05,809::task::595::TaskManager.Task::(_updateState) Task=`09c93fe3-ca96-4da0-90de-566e74cc99bb`::moving from state init -> state preparing >Thread-1043::INFO::2014-07-10 08:08:05,815::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='411039e4-4af2-4192-9de0-67dc1ed83ba9', options=None) >Thread-1043::DEBUG::2014-07-10 08:08:05,827::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9`ReqID=`6aafb613-d530-4691-be2f-dc1c86d6f12c`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo' >Thread-1043::DEBUG::2014-07-10 08:08:05,831::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' for lock type 'shared' >Thread-1043::DEBUG::2014-07-10 08:08:05,839::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' is free. Now locking as 'shared' (1 active user) >Thread-1043::DEBUG::2014-07-10 08:08:05,844::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9`ReqID=`6aafb613-d530-4691-be2f-dc1c86d6f12c`::Granted request >Thread-1043::DEBUG::2014-07-10 08:08:05,855::task::827::TaskManager.Task::(resourceAcquired) Task=`09c93fe3-ca96-4da0-90de-566e74cc99bb`::_resourcesAcquired: Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9 (shared) >Thread-1043::DEBUG::2014-07-10 08:08:05,861::task::990::TaskManager.Task::(_decref) Task=`09c93fe3-ca96-4da0-90de-566e74cc99bb`::ref 1 aborting False >Thread-1043::INFO::2014-07-10 08:08:05,886::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DC-REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2, 'domains': u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': 'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c': {'status': u'Active', 'diskfree': '1137495244800', 'isoprefix': '', 'alerts': [], 'disktotal': '1152393412608', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '533841575936', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-1043::DEBUG::2014-07-10 08:08:05,891::task::1185::TaskManager.Task::(prepare) Task=`09c93fe3-ca96-4da0-90de-566e74cc99bb`::finished: {'info': {'name': 'DC-REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2, 'domains': u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': 'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c': {'status': u'Active', 'diskfree': '1137495244800', 'isoprefix': '', 'alerts': [], 'disktotal': '1152393412608', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '533841575936', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-1043::DEBUG::2014-07-10 08:08:05,896::task::595::TaskManager.Task::(_updateState) Task=`09c93fe3-ca96-4da0-90de-566e74cc99bb`::moving from state preparing -> state finished >Thread-1043::DEBUG::2014-07-10 08:08:05,901::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9': < ResourceRef 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9', isValid: 'True' obj: 'None'>} >Thread-1043::DEBUG::2014-07-10 08:08:05,906::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1043::DEBUG::2014-07-10 08:08:05,914::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' >Thread-1043::DEBUG::2014-07-10 08:08:05,921::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' (0 active users) >Thread-1043::DEBUG::2014-07-10 08:08:05,925::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' is free, finding out if anyone is waiting for it. >Thread-1043::DEBUG::2014-07-10 08:08:05,930::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9', Clearing records. >Thread-1043::DEBUG::2014-07-10 08:08:05,938::task::990::TaskManager.Task::(_decref) Task=`09c93fe3-ca96-4da0-90de-566e74cc99bb`::ref 0 aborting False >Dummy-36::DEBUG::2014-07-10 08:08:06,110::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.476943 s, 2.1 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 08:08:08,039::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lion.qa.lab.tlv.redhat.com:_export_yuri2_backup2/6a70504d-00df-4869-8695-0f442053f6b6/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-14::DEBUG::2014-07-10 08:08:08,100::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n369 bytes (369 B) copied, 0.000441923 s, 835 kB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-07-10 08:08:08,125::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-07-10 08:08:08,269::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0380461 s, 26.9 MB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-07-10 08:08:10,284::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Thread-1042::DEBUG::2014-07-10 08:08:10,371::task::595::TaskManager.Task::(_updateState) Task=`c6adf3ed-f93b-471c-a21f-1b8380e8e81e`::moving from state init -> state preparing >Thread-1042::INFO::2014-07-10 08:08:10,375::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-1042::INFO::2014-07-10 08:08:10,378::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000771195', 'lastCheck': '4.3', 'valid': True}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000441923', 'lastCheck': '2.3', 'valid': True}} >Thread-1042::DEBUG::2014-07-10 08:08:10,380::task::1185::TaskManager.Task::(prepare) Task=`c6adf3ed-f93b-471c-a21f-1b8380e8e81e`::finished: {u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000771195', 'lastCheck': '4.3', 'valid': True}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000441923', 'lastCheck': '2.3', 'valid': True}} >Thread-1042::DEBUG::2014-07-10 08:08:10,382::task::595::TaskManager.Task::(_updateState) Task=`c6adf3ed-f93b-471c-a21f-1b8380e8e81e`::moving from state preparing -> state finished >Thread-1042::DEBUG::2014-07-10 08:08:10,385::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-1042::DEBUG::2014-07-10 08:08:10,387::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1042::DEBUG::2014-07-10 08:08:10,389::task::990::TaskManager.Task::(_decref) Task=`c6adf3ed-f93b-471c-a21f-1b8380e8e81e`::ref 0 aborting False >Dummy-36::DEBUG::2014-07-10 08:08:10,644::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.262406 s, 3.9 MB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-07-10 08:08:12,659::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-07-10 08:08:12,794::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.035404 s, 28.9 MB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-07-10 08:08:14,809::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-07-10 08:08:14,939::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0323766 s, 31.6 MB/s\n'; <rc> = 0 >Thread-1042::DEBUG::2014-07-10 08:08:15,996::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-1042::DEBUG::2014-07-10 08:08:15,997::task::595::TaskManager.Task::(_updateState) Task=`820240db-c78c-435a-8a8e-00c0e6f9fefe`::moving from state init -> state preparing >Thread-1042::INFO::2014-07-10 08:08:15,997::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='411039e4-4af2-4192-9de0-67dc1ed83ba9', options=None) >Thread-1042::INFO::2014-07-10 08:08:15,998::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2}} >Thread-1042::DEBUG::2014-07-10 08:08:15,998::task::1185::TaskManager.Task::(prepare) Task=`820240db-c78c-435a-8a8e-00c0e6f9fefe`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2}} >Thread-1042::DEBUG::2014-07-10 08:08:15,998::task::595::TaskManager.Task::(_updateState) Task=`820240db-c78c-435a-8a8e-00c0e6f9fefe`::moving from state preparing -> state finished >Thread-1042::DEBUG::2014-07-10 08:08:15,998::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-1042::DEBUG::2014-07-10 08:08:15,999::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1042::DEBUG::2014-07-10 08:08:15,999::task::990::TaskManager.Task::(_decref) Task=`820240db-c78c-435a-8a8e-00c0e6f9fefe`::ref 0 aborting False >Thread-1043::DEBUG::2014-07-10 08:08:16,003::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-1043::DEBUG::2014-07-10 08:08:16,003::task::595::TaskManager.Task::(_updateState) Task=`526f9117-2687-4f8e-8d31-b32084126863`::moving from state init -> state preparing >Thread-1043::INFO::2014-07-10 08:08:16,004::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='411039e4-4af2-4192-9de0-67dc1ed83ba9', options=None) >Thread-1043::DEBUG::2014-07-10 08:08:16,004::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9`ReqID=`1f6b9d24-9b09-40f4-9cc1-41ac483fc02c`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo' >Thread-1043::DEBUG::2014-07-10 08:08:16,004::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' for lock type 'shared' >Thread-1043::DEBUG::2014-07-10 08:08:16,005::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' is free. Now locking as 'shared' (1 active user) >Thread-1043::DEBUG::2014-07-10 08:08:16,005::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9`ReqID=`1f6b9d24-9b09-40f4-9cc1-41ac483fc02c`::Granted request >Thread-1043::DEBUG::2014-07-10 08:08:16,007::task::827::TaskManager.Task::(resourceAcquired) Task=`526f9117-2687-4f8e-8d31-b32084126863`::_resourcesAcquired: Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9 (shared) >Thread-1043::DEBUG::2014-07-10 08:08:16,008::task::990::TaskManager.Task::(_decref) Task=`526f9117-2687-4f8e-8d31-b32084126863`::ref 1 aborting False >Thread-1043::INFO::2014-07-10 08:08:16,009::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DC-REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2, 'domains': u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': 'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c': {'status': u'Active', 'diskfree': '1137495244800', 'isoprefix': '', 'alerts': [], 'disktotal': '1152393412608', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '533841575936', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-1043::DEBUG::2014-07-10 08:08:16,009::task::1185::TaskManager.Task::(prepare) Task=`526f9117-2687-4f8e-8d31-b32084126863`::finished: {'info': {'name': 'DC-REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2, 'domains': u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': 'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c': {'status': u'Active', 'diskfree': '1137495244800', 'isoprefix': '', 'alerts': [], 'disktotal': '1152393412608', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '533841575936', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-1043::DEBUG::2014-07-10 08:08:16,009::task::595::TaskManager.Task::(_updateState) Task=`526f9117-2687-4f8e-8d31-b32084126863`::moving from state preparing -> state finished >Thread-1043::DEBUG::2014-07-10 08:08:16,009::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9': < ResourceRef 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9', isValid: 'True' obj: 'None'>} >Thread-1043::DEBUG::2014-07-10 08:08:16,010::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1043::DEBUG::2014-07-10 08:08:16,010::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' >Thread-1043::DEBUG::2014-07-10 08:08:16,010::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' (0 active users) >Thread-1043::DEBUG::2014-07-10 08:08:16,010::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' is free, finding out if anyone is waiting for it. >Thread-1043::DEBUG::2014-07-10 08:08:16,010::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9', Clearing records. >Thread-1043::DEBUG::2014-07-10 08:08:16,011::task::990::TaskManager.Task::(_decref) Task=`526f9117-2687-4f8e-8d31-b32084126863`::ref 0 aborting False >Thread-15::DEBUG::2014-07-10 08:08:16,057::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/e01a3a36-d2ce-4153-bb57-d6e65b7ed08c/metadata bs=4096 count=1' (cwd None) >Thread-15::DEBUG::2014-07-10 08:08:16,116::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000871669 s, 4.7 MB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-07-10 08:08:16,955::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-07-10 08:08:17,092::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0386034 s, 26.5 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 08:08:18,130::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lion.qa.lab.tlv.redhat.com:_export_yuri2_backup2/6a70504d-00df-4869-8695-0f442053f6b6/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-14::DEBUG::2014-07-10 08:08:18,194::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n369 bytes (369 B) copied, 0.000445509 s, 828 kB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-07-10 08:08:19,107::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-07-10 08:08:19,251::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0386029 s, 26.5 MB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-07-10 08:08:21,266::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-07-10 08:08:21,397::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.032978 s, 31.1 MB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-07-10 08:08:23,413::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-07-10 08:08:23,543::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0325364 s, 31.5 MB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-07-10 08:08:25,558::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-07-10 08:08:25,695::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0379649 s, 27.0 MB/s\n'; <rc> = 0 >Thread-1042::DEBUG::2014-07-10 08:08:25,737::task::595::TaskManager.Task::(_updateState) Task=`c5302bfa-6ff9-4d9d-ab89-36d81060acbe`::moving from state init -> state preparing >Thread-1042::INFO::2014-07-10 08:08:25,737::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-1042::INFO::2014-07-10 08:08:25,738::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000871669', 'lastCheck': '9.6', 'valid': True}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000445509', 'lastCheck': '7.5', 'valid': True}} >Thread-1042::DEBUG::2014-07-10 08:08:25,738::task::1185::TaskManager.Task::(prepare) Task=`c5302bfa-6ff9-4d9d-ab89-36d81060acbe`::finished: {u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000871669', 'lastCheck': '9.6', 'valid': True}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000445509', 'lastCheck': '7.5', 'valid': True}} >Thread-1042::DEBUG::2014-07-10 08:08:25,738::task::595::TaskManager.Task::(_updateState) Task=`c5302bfa-6ff9-4d9d-ab89-36d81060acbe`::moving from state preparing -> state finished >Thread-1042::DEBUG::2014-07-10 08:08:25,738::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-1042::DEBUG::2014-07-10 08:08:25,738::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1042::DEBUG::2014-07-10 08:08:25,739::task::990::TaskManager.Task::(_decref) Task=`c5302bfa-6ff9-4d9d-ab89-36d81060acbe`::ref 0 aborting False >Thread-1042::DEBUG::2014-07-10 08:08:26,069::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [70e25341] >Thread-1042::DEBUG::2014-07-10 08:08:26,070::task::595::TaskManager.Task::(_updateState) Task=`b8312988-f33f-41c7-bd8b-6605adedf468`::moving from state init -> state preparing >Thread-1042::INFO::2014-07-10 08:08:26,070::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='411039e4-4af2-4192-9de0-67dc1ed83ba9', options=None) >Thread-1042::INFO::2014-07-10 08:08:26,070::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2}} >Thread-1042::DEBUG::2014-07-10 08:08:26,071::task::1185::TaskManager.Task::(prepare) Task=`b8312988-f33f-41c7-bd8b-6605adedf468`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2}} >Thread-1042::DEBUG::2014-07-10 08:08:26,071::task::595::TaskManager.Task::(_updateState) Task=`b8312988-f33f-41c7-bd8b-6605adedf468`::moving from state preparing -> state finished >Thread-1042::DEBUG::2014-07-10 08:08:26,071::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-1042::DEBUG::2014-07-10 08:08:26,071::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1042::DEBUG::2014-07-10 08:08:26,071::task::990::TaskManager.Task::(_decref) Task=`b8312988-f33f-41c7-bd8b-6605adedf468`::ref 0 aborting False >Thread-1043::DEBUG::2014-07-10 08:08:26,075::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [70e25341] >Thread-1043::DEBUG::2014-07-10 08:08:26,075::task::595::TaskManager.Task::(_updateState) Task=`d7e0fab9-863b-4fc0-9486-8a148d63de2c`::moving from state init -> state preparing >Thread-1043::INFO::2014-07-10 08:08:26,075::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='411039e4-4af2-4192-9de0-67dc1ed83ba9', options=None) >Thread-1043::DEBUG::2014-07-10 08:08:26,076::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9`ReqID=`7a5489e5-5062-43c5-9b61-d942b73202fc`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo' >Thread-1043::DEBUG::2014-07-10 08:08:26,076::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' for lock type 'shared' >Thread-1043::DEBUG::2014-07-10 08:08:26,076::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' is free. Now locking as 'shared' (1 active user) >Thread-1043::DEBUG::2014-07-10 08:08:26,077::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9`ReqID=`7a5489e5-5062-43c5-9b61-d942b73202fc`::Granted request >Thread-1043::DEBUG::2014-07-10 08:08:26,077::task::827::TaskManager.Task::(resourceAcquired) Task=`d7e0fab9-863b-4fc0-9486-8a148d63de2c`::_resourcesAcquired: Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9 (shared) >Thread-1043::DEBUG::2014-07-10 08:08:26,077::task::990::TaskManager.Task::(_decref) Task=`d7e0fab9-863b-4fc0-9486-8a148d63de2c`::ref 1 aborting False >Thread-1043::INFO::2014-07-10 08:08:26,078::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DC-REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2, 'domains': u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': 'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c': {'status': u'Active', 'diskfree': '1137495244800', 'isoprefix': '', 'alerts': [], 'disktotal': '1152393412608', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '533840527360', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-1043::DEBUG::2014-07-10 08:08:26,078::task::1185::TaskManager.Task::(prepare) Task=`d7e0fab9-863b-4fc0-9486-8a148d63de2c`::finished: {'info': {'name': 'DC-REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2, 'domains': u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': 'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c': {'status': u'Active', 'diskfree': '1137495244800', 'isoprefix': '', 'alerts': [], 'disktotal': '1152393412608', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '533840527360', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-1043::DEBUG::2014-07-10 08:08:26,079::task::595::TaskManager.Task::(_updateState) Task=`d7e0fab9-863b-4fc0-9486-8a148d63de2c`::moving from state preparing -> state finished >Thread-1043::DEBUG::2014-07-10 08:08:26,079::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9': < ResourceRef 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9', isValid: 'True' obj: 'None'>} >Thread-1043::DEBUG::2014-07-10 08:08:26,079::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1043::DEBUG::2014-07-10 08:08:26,079::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' >Thread-1043::DEBUG::2014-07-10 08:08:26,079::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' (0 active users) >Thread-1043::DEBUG::2014-07-10 08:08:26,079::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' is free, finding out if anyone is waiting for it. >Thread-1043::DEBUG::2014-07-10 08:08:26,080::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9', Clearing records. >Thread-1043::DEBUG::2014-07-10 08:08:26,080::task::990::TaskManager.Task::(_decref) Task=`d7e0fab9-863b-4fc0-9486-8a148d63de2c`::ref 0 aborting False >Thread-15::DEBUG::2014-07-10 08:08:26,145::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/e01a3a36-d2ce-4153-bb57-d6e65b7ed08c/metadata bs=4096 count=1' (cwd None) >Thread-15::DEBUG::2014-07-10 08:08:26,210::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000924538 s, 4.4 MB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-07-10 08:08:27,707::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-07-10 08:08:27,846::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.039036 s, 26.2 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 08:08:28,224::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lion.qa.lab.tlv.redhat.com:_export_yuri2_backup2/6a70504d-00df-4869-8695-0f442053f6b6/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-14::DEBUG::2014-07-10 08:08:28,287::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n369 bytes (369 B) copied, 0.000541986 s, 681 kB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-07-10 08:08:29,861::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-07-10 08:08:29,996::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0324842 s, 31.5 MB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-07-10 08:08:32,011::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-07-10 08:08:32,177::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0687718 s, 14.9 MB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-07-10 08:08:34,192::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-07-10 08:08:34,331::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0375202 s, 27.3 MB/s\n'; <rc> = 0 >Thread-1042::DEBUG::2014-07-10 08:08:36,103::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-1042::DEBUG::2014-07-10 08:08:36,104::task::595::TaskManager.Task::(_updateState) Task=`81630ad1-1d77-4f07-a188-f5e1809a79c5`::moving from state init -> state preparing >Thread-1042::INFO::2014-07-10 08:08:36,105::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='411039e4-4af2-4192-9de0-67dc1ed83ba9', options=None) >Thread-1042::INFO::2014-07-10 08:08:36,105::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2}} >Thread-1042::DEBUG::2014-07-10 08:08:36,105::task::1185::TaskManager.Task::(prepare) Task=`81630ad1-1d77-4f07-a188-f5e1809a79c5`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2}} >Thread-1042::DEBUG::2014-07-10 08:08:36,105::task::595::TaskManager.Task::(_updateState) Task=`81630ad1-1d77-4f07-a188-f5e1809a79c5`::moving from state preparing -> state finished >Thread-1042::DEBUG::2014-07-10 08:08:36,106::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-1042::DEBUG::2014-07-10 08:08:36,106::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1042::DEBUG::2014-07-10 08:08:36,106::task::990::TaskManager.Task::(_decref) Task=`81630ad1-1d77-4f07-a188-f5e1809a79c5`::ref 0 aborting False >Thread-1043::DEBUG::2014-07-10 08:08:36,110::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-1043::DEBUG::2014-07-10 08:08:36,110::task::595::TaskManager.Task::(_updateState) Task=`5abfca3c-922d-41a1-8b77-65dcff297fcb`::moving from state init -> state preparing >Thread-1043::INFO::2014-07-10 08:08:36,110::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='411039e4-4af2-4192-9de0-67dc1ed83ba9', options=None) >Thread-1043::DEBUG::2014-07-10 08:08:36,111::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9`ReqID=`af6c96ae-2547-42a9-9dea-87f17387a918`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo' >Thread-1043::DEBUG::2014-07-10 08:08:36,111::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' for lock type 'shared' >Thread-1043::DEBUG::2014-07-10 08:08:36,111::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' is free. Now locking as 'shared' (1 active user) >Thread-1043::DEBUG::2014-07-10 08:08:36,111::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9`ReqID=`af6c96ae-2547-42a9-9dea-87f17387a918`::Granted request >Thread-1043::DEBUG::2014-07-10 08:08:36,112::task::827::TaskManager.Task::(resourceAcquired) Task=`5abfca3c-922d-41a1-8b77-65dcff297fcb`::_resourcesAcquired: Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9 (shared) >Thread-1043::DEBUG::2014-07-10 08:08:36,112::task::990::TaskManager.Task::(_decref) Task=`5abfca3c-922d-41a1-8b77-65dcff297fcb`::ref 1 aborting False >Thread-1043::INFO::2014-07-10 08:08:36,113::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DC-REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2, 'domains': u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': 'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c': {'status': u'Active', 'diskfree': '1137495244800', 'isoprefix': '', 'alerts': [], 'disktotal': '1152393412608', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '533840527360', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-1043::DEBUG::2014-07-10 08:08:36,113::task::1185::TaskManager.Task::(prepare) Task=`5abfca3c-922d-41a1-8b77-65dcff297fcb`::finished: {'info': {'name': 'DC-REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2, 'domains': u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': 'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c': {'status': u'Active', 'diskfree': '1137495244800', 'isoprefix': '', 'alerts': [], 'disktotal': '1152393412608', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '533840527360', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-1043::DEBUG::2014-07-10 08:08:36,113::task::595::TaskManager.Task::(_updateState) Task=`5abfca3c-922d-41a1-8b77-65dcff297fcb`::moving from state preparing -> state finished >Thread-1043::DEBUG::2014-07-10 08:08:36,114::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9': < ResourceRef 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9', isValid: 'True' obj: 'None'>} >Thread-1043::DEBUG::2014-07-10 08:08:36,114::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1043::DEBUG::2014-07-10 08:08:36,114::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' >Thread-1043::DEBUG::2014-07-10 08:08:36,114::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' (0 active users) >Thread-1043::DEBUG::2014-07-10 08:08:36,114::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' is free, finding out if anyone is waiting for it. >Thread-1043::DEBUG::2014-07-10 08:08:36,114::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9', Clearing records. >Thread-1043::DEBUG::2014-07-10 08:08:36,115::task::990::TaskManager.Task::(_decref) Task=`5abfca3c-922d-41a1-8b77-65dcff297fcb`::ref 0 aborting False >Thread-15::DEBUG::2014-07-10 08:08:36,240::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/e01a3a36-d2ce-4153-bb57-d6e65b7ed08c/metadata bs=4096 count=1' (cwd None) >Thread-15::DEBUG::2014-07-10 08:08:36,300::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000851049 s, 4.8 MB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-07-10 08:08:36,347::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-07-10 08:08:36,486::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0358995 s, 28.5 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 08:08:38,313::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lion.qa.lab.tlv.redhat.com:_export_yuri2_backup2/6a70504d-00df-4869-8695-0f442053f6b6/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-14::DEBUG::2014-07-10 08:08:38,375::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n369 bytes (369 B) copied, 0.000420622 s, 877 kB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-07-10 08:08:38,503::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-07-10 08:08:38,640::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.03794 s, 27.0 MB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-07-10 08:08:40,655::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-07-10 08:08:40,791::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0380096 s, 26.9 MB/s\n'; <rc> = 0 >Thread-1042::DEBUG::2014-07-10 08:08:40,874::task::595::TaskManager.Task::(_updateState) Task=`9f669c68-0887-469d-8ac0-1efd988fd909`::moving from state init -> state preparing >Thread-1042::INFO::2014-07-10 08:08:40,875::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-1042::INFO::2014-07-10 08:08:40,875::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000851049', 'lastCheck': '4.5', 'valid': True}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000420622', 'lastCheck': '2.5', 'valid': True}} >Thread-1042::DEBUG::2014-07-10 08:08:40,875::task::1185::TaskManager.Task::(prepare) Task=`9f669c68-0887-469d-8ac0-1efd988fd909`::finished: {u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000851049', 'lastCheck': '4.5', 'valid': True}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000420622', 'lastCheck': '2.5', 'valid': True}} >Thread-1042::DEBUG::2014-07-10 08:08:40,875::task::595::TaskManager.Task::(_updateState) Task=`9f669c68-0887-469d-8ac0-1efd988fd909`::moving from state preparing -> state finished >Thread-1042::DEBUG::2014-07-10 08:08:40,876::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-1042::DEBUG::2014-07-10 08:08:40,876::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1042::DEBUG::2014-07-10 08:08:40,876::task::990::TaskManager.Task::(_decref) Task=`9f669c68-0887-469d-8ac0-1efd988fd909`::ref 0 aborting False >Dummy-36::DEBUG::2014-07-10 08:08:42,806::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-07-10 08:08:42,944::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0379472 s, 27.0 MB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-07-10 08:08:44,959::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-07-10 08:08:45,088::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0301869 s, 33.9 MB/s\n'; <rc> = 0 >Thread-1042::DEBUG::2014-07-10 08:08:46,146::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-1042::DEBUG::2014-07-10 08:08:46,147::task::595::TaskManager.Task::(_updateState) Task=`f7cb6256-54db-4843-9804-a26000d01c97`::moving from state init -> state preparing >Thread-1042::INFO::2014-07-10 08:08:46,147::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='411039e4-4af2-4192-9de0-67dc1ed83ba9', options=None) >Thread-1042::INFO::2014-07-10 08:08:46,148::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2}} >Thread-1042::DEBUG::2014-07-10 08:08:46,148::task::1185::TaskManager.Task::(prepare) Task=`f7cb6256-54db-4843-9804-a26000d01c97`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2}} >Thread-1042::DEBUG::2014-07-10 08:08:46,148::task::595::TaskManager.Task::(_updateState) Task=`f7cb6256-54db-4843-9804-a26000d01c97`::moving from state preparing -> state finished >Thread-1042::DEBUG::2014-07-10 08:08:46,148::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-1042::DEBUG::2014-07-10 08:08:46,148::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1042::DEBUG::2014-07-10 08:08:46,149::task::990::TaskManager.Task::(_decref) Task=`f7cb6256-54db-4843-9804-a26000d01c97`::ref 0 aborting False >Thread-1043::DEBUG::2014-07-10 08:08:46,152::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-1043::DEBUG::2014-07-10 08:08:46,153::task::595::TaskManager.Task::(_updateState) Task=`27bc3e53-d8c3-446e-a6be-02184289aae6`::moving from state init -> state preparing >Thread-1043::INFO::2014-07-10 08:08:46,153::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='411039e4-4af2-4192-9de0-67dc1ed83ba9', options=None) >Thread-1043::DEBUG::2014-07-10 08:08:46,154::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9`ReqID=`067f3dd6-ddf5-4c60-8d61-3bd5c4b35051`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo' >Thread-1043::DEBUG::2014-07-10 08:08:46,154::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' for lock type 'shared' >Thread-1043::DEBUG::2014-07-10 08:08:46,154::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' is free. Now locking as 'shared' (1 active user) >Thread-1043::DEBUG::2014-07-10 08:08:46,154::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9`ReqID=`067f3dd6-ddf5-4c60-8d61-3bd5c4b35051`::Granted request >Thread-1043::DEBUG::2014-07-10 08:08:46,155::task::827::TaskManager.Task::(resourceAcquired) Task=`27bc3e53-d8c3-446e-a6be-02184289aae6`::_resourcesAcquired: Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9 (shared) >Thread-1043::DEBUG::2014-07-10 08:08:46,155::task::990::TaskManager.Task::(_decref) Task=`27bc3e53-d8c3-446e-a6be-02184289aae6`::ref 1 aborting False >Thread-1043::INFO::2014-07-10 08:08:46,156::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DC-REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2, 'domains': u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': 'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c': {'status': u'Active', 'diskfree': '1137495244800', 'isoprefix': '', 'alerts': [], 'disktotal': '1152393412608', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '533840527360', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-1043::DEBUG::2014-07-10 08:08:46,156::task::1185::TaskManager.Task::(prepare) Task=`27bc3e53-d8c3-446e-a6be-02184289aae6`::finished: {'info': {'name': 'DC-REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2, 'domains': u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': 'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c': {'status': u'Active', 'diskfree': '1137495244800', 'isoprefix': '', 'alerts': [], 'disktotal': '1152393412608', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '533840527360', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-1043::DEBUG::2014-07-10 08:08:46,157::task::595::TaskManager.Task::(_updateState) Task=`27bc3e53-d8c3-446e-a6be-02184289aae6`::moving from state preparing -> state finished >Thread-1043::DEBUG::2014-07-10 08:08:46,157::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9': < ResourceRef 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9', isValid: 'True' obj: 'None'>} >Thread-1043::DEBUG::2014-07-10 08:08:46,157::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1043::DEBUG::2014-07-10 08:08:46,157::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' >Thread-1043::DEBUG::2014-07-10 08:08:46,158::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' (0 active users) >Thread-1043::DEBUG::2014-07-10 08:08:46,158::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' is free, finding out if anyone is waiting for it. >Thread-1043::DEBUG::2014-07-10 08:08:46,158::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9', Clearing records. >Thread-1043::DEBUG::2014-07-10 08:08:46,158::task::990::TaskManager.Task::(_decref) Task=`27bc3e53-d8c3-446e-a6be-02184289aae6`::ref 0 aborting False >Thread-15::DEBUG::2014-07-10 08:08:46,329::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/e01a3a36-d2ce-4153-bb57-d6e65b7ed08c/metadata bs=4096 count=1' (cwd None) >Thread-15::DEBUG::2014-07-10 08:08:46,392::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000855079 s, 4.8 MB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-07-10 08:08:47,103::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-07-10 08:08:47,231::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0326837 s, 31.3 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 08:08:48,406::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lion.qa.lab.tlv.redhat.com:_export_yuri2_backup2/6a70504d-00df-4869-8695-0f442053f6b6/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-14::DEBUG::2014-07-10 08:08:48,469::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n369 bytes (369 B) copied, 0.000424481 s, 869 kB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-07-10 08:08:49,246::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-07-10 08:08:49,378::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0372031 s, 27.5 MB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-07-10 08:08:51,393::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-07-10 08:08:51,524::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0307651 s, 33.3 MB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-07-10 08:08:53,540::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-07-10 08:08:53,690::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0425501 s, 24.1 MB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-07-10 08:08:55,705::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-07-10 08:08:55,837::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0334218 s, 30.6 MB/s\n'; <rc> = 0 >Thread-1042::DEBUG::2014-07-10 08:08:56,015::task::595::TaskManager.Task::(_updateState) Task=`db616214-5fb9-43cf-9800-38f395fadf64`::moving from state init -> state preparing >Thread-1042::INFO::2014-07-10 08:08:56,016::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-1042::INFO::2014-07-10 08:08:56,016::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000855079', 'lastCheck': '9.6', 'valid': True}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000424481', 'lastCheck': '7.5', 'valid': True}} >Thread-1042::DEBUG::2014-07-10 08:08:56,017::task::1185::TaskManager.Task::(prepare) Task=`db616214-5fb9-43cf-9800-38f395fadf64`::finished: {u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000855079', 'lastCheck': '9.6', 'valid': True}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000424481', 'lastCheck': '7.5', 'valid': True}} >Thread-1042::DEBUG::2014-07-10 08:08:56,017::task::595::TaskManager.Task::(_updateState) Task=`db616214-5fb9-43cf-9800-38f395fadf64`::moving from state preparing -> state finished >Thread-1042::DEBUG::2014-07-10 08:08:56,017::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-1042::DEBUG::2014-07-10 08:08:56,017::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1042::DEBUG::2014-07-10 08:08:56,017::task::990::TaskManager.Task::(_decref) Task=`db616214-5fb9-43cf-9800-38f395fadf64`::ref 0 aborting False >Thread-1042::DEBUG::2014-07-10 08:08:56,216::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-1042::DEBUG::2014-07-10 08:08:56,216::task::595::TaskManager.Task::(_updateState) Task=`aea9bfc2-0a3e-4bc3-bd88-ef9491742e46`::moving from state init -> state preparing >Thread-1042::INFO::2014-07-10 08:08:56,217::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='411039e4-4af2-4192-9de0-67dc1ed83ba9', options=None) >Thread-1042::INFO::2014-07-10 08:08:56,217::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2}} >Thread-1042::DEBUG::2014-07-10 08:08:56,217::task::1185::TaskManager.Task::(prepare) Task=`aea9bfc2-0a3e-4bc3-bd88-ef9491742e46`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2}} >Thread-1042::DEBUG::2014-07-10 08:08:56,218::task::595::TaskManager.Task::(_updateState) Task=`aea9bfc2-0a3e-4bc3-bd88-ef9491742e46`::moving from state preparing -> state finished >Thread-1042::DEBUG::2014-07-10 08:08:56,218::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-1042::DEBUG::2014-07-10 08:08:56,218::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1042::DEBUG::2014-07-10 08:08:56,218::task::990::TaskManager.Task::(_decref) Task=`aea9bfc2-0a3e-4bc3-bd88-ef9491742e46`::ref 0 aborting False >Thread-1043::DEBUG::2014-07-10 08:08:56,222::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-1043::DEBUG::2014-07-10 08:08:56,222::task::595::TaskManager.Task::(_updateState) Task=`4d0d3355-a16c-4f2f-a859-59acbe379f98`::moving from state init -> state preparing >Thread-1043::INFO::2014-07-10 08:08:56,222::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='411039e4-4af2-4192-9de0-67dc1ed83ba9', options=None) >Thread-1043::DEBUG::2014-07-10 08:08:56,223::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9`ReqID=`fc83af1c-07d4-422b-9159-420f3db1b584`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo' >Thread-1043::DEBUG::2014-07-10 08:08:56,223::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' for lock type 'shared' >Thread-1043::DEBUG::2014-07-10 08:08:56,224::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' is free. Now locking as 'shared' (1 active user) >Thread-1043::DEBUG::2014-07-10 08:08:56,224::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9`ReqID=`fc83af1c-07d4-422b-9159-420f3db1b584`::Granted request >Thread-1043::DEBUG::2014-07-10 08:08:56,224::task::827::TaskManager.Task::(resourceAcquired) Task=`4d0d3355-a16c-4f2f-a859-59acbe379f98`::_resourcesAcquired: Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9 (shared) >Thread-1043::DEBUG::2014-07-10 08:08:56,225::task::990::TaskManager.Task::(_decref) Task=`4d0d3355-a16c-4f2f-a859-59acbe379f98`::ref 1 aborting False >Thread-1043::INFO::2014-07-10 08:08:56,226::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DC-REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2, 'domains': u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': 'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c': {'status': u'Active', 'diskfree': '1137495244800', 'isoprefix': '', 'alerts': [], 'disktotal': '1152393412608', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '533840527360', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-1043::DEBUG::2014-07-10 08:08:56,226::task::1185::TaskManager.Task::(prepare) Task=`4d0d3355-a16c-4f2f-a859-59acbe379f98`::finished: {'info': {'name': 'DC-REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2, 'domains': u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': 'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c': {'status': u'Active', 'diskfree': '1137495244800', 'isoprefix': '', 'alerts': [], 'disktotal': '1152393412608', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '533840527360', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-1043::DEBUG::2014-07-10 08:08:56,226::task::595::TaskManager.Task::(_updateState) Task=`4d0d3355-a16c-4f2f-a859-59acbe379f98`::moving from state preparing -> state finished >Thread-1043::DEBUG::2014-07-10 08:08:56,226::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9': < ResourceRef 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9', isValid: 'True' obj: 'None'>} >Thread-1043::DEBUG::2014-07-10 08:08:56,227::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1043::DEBUG::2014-07-10 08:08:56,227::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' >Thread-1043::DEBUG::2014-07-10 08:08:56,227::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' (0 active users) >Thread-1043::DEBUG::2014-07-10 08:08:56,227::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' is free, finding out if anyone is waiting for it. >Thread-1043::DEBUG::2014-07-10 08:08:56,227::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9', Clearing records. >Thread-1043::DEBUG::2014-07-10 08:08:56,228::task::990::TaskManager.Task::(_decref) Task=`4d0d3355-a16c-4f2f-a859-59acbe379f98`::ref 0 aborting False >Thread-15::DEBUG::2014-07-10 08:08:56,421::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/e01a3a36-d2ce-4153-bb57-d6e65b7ed08c/metadata bs=4096 count=1' (cwd None) >Thread-15::DEBUG::2014-07-10 08:08:56,487::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000937296 s, 4.4 MB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-07-10 08:08:57,852::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-07-10 08:08:58,016::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0633569 s, 16.2 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 08:08:58,499::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lion.qa.lab.tlv.redhat.com:_export_yuri2_backup2/6a70504d-00df-4869-8695-0f442053f6b6/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-14::DEBUG::2014-07-10 08:08:58,558::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n369 bytes (369 B) copied, 0.000399784 s, 923 kB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-07-10 08:09:00,032::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-07-10 08:09:00,167::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0322497 s, 31.8 MB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-07-10 08:09:02,182::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-07-10 08:09:02,312::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0327849 s, 31.2 MB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-07-10 08:09:04,327::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-07-10 08:09:04,465::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0383106 s, 26.7 MB/s\n'; <rc> = 0 >Thread-1042::DEBUG::2014-07-10 08:09:06,253::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-1042::DEBUG::2014-07-10 08:09:06,254::task::595::TaskManager.Task::(_updateState) Task=`e579d678-e744-480b-911b-9a4d970b7b34`::moving from state init -> state preparing >Thread-1042::INFO::2014-07-10 08:09:06,255::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='411039e4-4af2-4192-9de0-67dc1ed83ba9', options=None) >Thread-1042::INFO::2014-07-10 08:09:06,255::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2}} >Thread-1042::DEBUG::2014-07-10 08:09:06,255::task::1185::TaskManager.Task::(prepare) Task=`e579d678-e744-480b-911b-9a4d970b7b34`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2}} >Thread-1042::DEBUG::2014-07-10 08:09:06,255::task::595::TaskManager.Task::(_updateState) Task=`e579d678-e744-480b-911b-9a4d970b7b34`::moving from state preparing -> state finished >Thread-1042::DEBUG::2014-07-10 08:09:06,256::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-1042::DEBUG::2014-07-10 08:09:06,256::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1042::DEBUG::2014-07-10 08:09:06,256::task::990::TaskManager.Task::(_decref) Task=`e579d678-e744-480b-911b-9a4d970b7b34`::ref 0 aborting False >Thread-1043::DEBUG::2014-07-10 08:09:06,260::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-1043::DEBUG::2014-07-10 08:09:06,260::task::595::TaskManager.Task::(_updateState) Task=`f3d66e6a-25c7-413b-ad42-424efeda1782`::moving from state init -> state preparing >Thread-1043::INFO::2014-07-10 08:09:06,260::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='411039e4-4af2-4192-9de0-67dc1ed83ba9', options=None) >Thread-1043::DEBUG::2014-07-10 08:09:06,261::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9`ReqID=`ae2c1519-e0fd-4821-8b58-053a1adcb216`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo' >Thread-1043::DEBUG::2014-07-10 08:09:06,261::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' for lock type 'shared' >Thread-1043::DEBUG::2014-07-10 08:09:06,261::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' is free. Now locking as 'shared' (1 active user) >Thread-1043::DEBUG::2014-07-10 08:09:06,261::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9`ReqID=`ae2c1519-e0fd-4821-8b58-053a1adcb216`::Granted request >Thread-1043::DEBUG::2014-07-10 08:09:06,262::task::827::TaskManager.Task::(resourceAcquired) Task=`f3d66e6a-25c7-413b-ad42-424efeda1782`::_resourcesAcquired: Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9 (shared) >Thread-1043::DEBUG::2014-07-10 08:09:06,262::task::990::TaskManager.Task::(_decref) Task=`f3d66e6a-25c7-413b-ad42-424efeda1782`::ref 1 aborting False >Thread-1043::INFO::2014-07-10 08:09:06,263::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DC-REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2, 'domains': u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': 'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c': {'status': u'Active', 'diskfree': '1137495244800', 'isoprefix': '', 'alerts': [], 'disktotal': '1152393412608', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '533840527360', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-1043::DEBUG::2014-07-10 08:09:06,263::task::1185::TaskManager.Task::(prepare) Task=`f3d66e6a-25c7-413b-ad42-424efeda1782`::finished: {'info': {'name': 'DC-REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2, 'domains': u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': 'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c': {'status': u'Active', 'diskfree': '1137495244800', 'isoprefix': '', 'alerts': [], 'disktotal': '1152393412608', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '533840527360', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-1043::DEBUG::2014-07-10 08:09:06,264::task::595::TaskManager.Task::(_updateState) Task=`f3d66e6a-25c7-413b-ad42-424efeda1782`::moving from state preparing -> state finished >Thread-1043::DEBUG::2014-07-10 08:09:06,264::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9': < ResourceRef 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9', isValid: 'True' obj: 'None'>} >Thread-1043::DEBUG::2014-07-10 08:09:06,264::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1043::DEBUG::2014-07-10 08:09:06,264::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' >Thread-1043::DEBUG::2014-07-10 08:09:06,264::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' (0 active users) >Thread-1043::DEBUG::2014-07-10 08:09:06,264::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' is free, finding out if anyone is waiting for it. >Thread-1043::DEBUG::2014-07-10 08:09:06,265::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9', Clearing records. >Thread-1043::DEBUG::2014-07-10 08:09:06,265::task::990::TaskManager.Task::(_decref) Task=`f3d66e6a-25c7-413b-ad42-424efeda1782`::ref 0 aborting False >Dummy-36::DEBUG::2014-07-10 08:09:06,480::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Thread-15::DEBUG::2014-07-10 08:09:06,538::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/e01a3a36-d2ce-4153-bb57-d6e65b7ed08c/metadata bs=4096 count=1' (cwd None) >Thread-15::DEBUG::2014-07-10 08:09:06,672::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00234306 s, 1.7 MB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-07-10 08:09:07,117::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.539268 s, 1.9 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 08:09:08,587::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lion.qa.lab.tlv.redhat.com:_export_yuri2_backup2/6a70504d-00df-4869-8695-0f442053f6b6/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-14::DEBUG::2014-07-10 08:09:08,646::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n369 bytes (369 B) copied, 0.000358627 s, 1.0 MB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-07-10 08:09:09,132::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-07-10 08:09:09,271::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0352779 s, 29.0 MB/s\n'; <rc> = 0 >Thread-1042::DEBUG::2014-07-10 08:09:11,156::task::595::TaskManager.Task::(_updateState) Task=`eeebdd6a-b46c-4f29-9b70-61c671dc274e`::moving from state init -> state preparing >Thread-1042::INFO::2014-07-10 08:09:11,156::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-1042::INFO::2014-07-10 08:09:11,157::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00234306', 'lastCheck': '4.1', 'valid': True}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000358627', 'lastCheck': '2.5', 'valid': True}} >Thread-1042::DEBUG::2014-07-10 08:09:11,157::task::1185::TaskManager.Task::(prepare) Task=`eeebdd6a-b46c-4f29-9b70-61c671dc274e`::finished: {u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00234306', 'lastCheck': '4.1', 'valid': True}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000358627', 'lastCheck': '2.5', 'valid': True}} >Thread-1042::DEBUG::2014-07-10 08:09:11,157::task::595::TaskManager.Task::(_updateState) Task=`eeebdd6a-b46c-4f29-9b70-61c671dc274e`::moving from state preparing -> state finished >Thread-1042::DEBUG::2014-07-10 08:09:11,157::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-1042::DEBUG::2014-07-10 08:09:11,158::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1042::DEBUG::2014-07-10 08:09:11,158::task::990::TaskManager.Task::(_decref) Task=`eeebdd6a-b46c-4f29-9b70-61c671dc274e`::ref 0 aborting False >Dummy-36::DEBUG::2014-07-10 08:09:11,286::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-07-10 08:09:11,422::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0328224 s, 31.2 MB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-07-10 08:09:13,437::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-07-10 08:09:13,579::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0380156 s, 26.9 MB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-07-10 08:09:15,594::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-07-10 08:09:15,726::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0329444 s, 31.1 MB/s\n'; <rc> = 0 >Thread-1042::DEBUG::2014-07-10 08:09:16,295::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-1042::DEBUG::2014-07-10 08:09:16,297::task::595::TaskManager.Task::(_updateState) Task=`f74b3bc1-f99c-425a-a35c-6d32bcfcaeea`::moving from state init -> state preparing >Thread-1042::INFO::2014-07-10 08:09:16,297::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='411039e4-4af2-4192-9de0-67dc1ed83ba9', options=None) >Thread-1042::INFO::2014-07-10 08:09:16,298::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2}} >Thread-1042::DEBUG::2014-07-10 08:09:16,298::task::1185::TaskManager.Task::(prepare) Task=`f74b3bc1-f99c-425a-a35c-6d32bcfcaeea`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2}} >Thread-1042::DEBUG::2014-07-10 08:09:16,298::task::595::TaskManager.Task::(_updateState) Task=`f74b3bc1-f99c-425a-a35c-6d32bcfcaeea`::moving from state preparing -> state finished >Thread-1042::DEBUG::2014-07-10 08:09:16,298::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-1042::DEBUG::2014-07-10 08:09:16,298::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1042::DEBUG::2014-07-10 08:09:16,299::task::990::TaskManager.Task::(_decref) Task=`f74b3bc1-f99c-425a-a35c-6d32bcfcaeea`::ref 0 aborting False >Thread-1043::DEBUG::2014-07-10 08:09:16,303::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-1043::DEBUG::2014-07-10 08:09:16,303::task::595::TaskManager.Task::(_updateState) Task=`101f6167-9fb2-4240-8bd5-66485977d206`::moving from state init -> state preparing >Thread-1043::INFO::2014-07-10 08:09:16,304::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='411039e4-4af2-4192-9de0-67dc1ed83ba9', options=None) >Thread-1043::DEBUG::2014-07-10 08:09:16,304::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9`ReqID=`f13687c1-c1e9-4d59-9e6b-5485089faaee`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo' >Thread-1043::DEBUG::2014-07-10 08:09:16,306::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' for lock type 'shared' >Thread-1043::DEBUG::2014-07-10 08:09:16,306::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' is free. Now locking as 'shared' (1 active user) >Thread-1043::DEBUG::2014-07-10 08:09:16,307::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9`ReqID=`f13687c1-c1e9-4d59-9e6b-5485089faaee`::Granted request >Thread-1043::DEBUG::2014-07-10 08:09:16,307::task::827::TaskManager.Task::(resourceAcquired) Task=`101f6167-9fb2-4240-8bd5-66485977d206`::_resourcesAcquired: Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9 (shared) >Thread-1043::DEBUG::2014-07-10 08:09:16,307::task::990::TaskManager.Task::(_decref) Task=`101f6167-9fb2-4240-8bd5-66485977d206`::ref 1 aborting False >Thread-1043::INFO::2014-07-10 08:09:16,308::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DC-REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2, 'domains': u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': 'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c': {'status': u'Active', 'diskfree': '1137495244800', 'isoprefix': '', 'alerts': [], 'disktotal': '1152393412608', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '533840527360', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-1043::DEBUG::2014-07-10 08:09:16,309::task::1185::TaskManager.Task::(prepare) Task=`101f6167-9fb2-4240-8bd5-66485977d206`::finished: {'info': {'name': 'DC-REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2, 'domains': u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': 'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c': {'status': u'Active', 'diskfree': '1137495244800', 'isoprefix': '', 'alerts': [], 'disktotal': '1152393412608', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '533840527360', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-1043::DEBUG::2014-07-10 08:09:16,309::task::595::TaskManager.Task::(_updateState) Task=`101f6167-9fb2-4240-8bd5-66485977d206`::moving from state preparing -> state finished >Thread-1043::DEBUG::2014-07-10 08:09:16,309::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9': < ResourceRef 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9', isValid: 'True' obj: 'None'>} >Thread-1043::DEBUG::2014-07-10 08:09:16,309::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1043::DEBUG::2014-07-10 08:09:16,310::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' >Thread-1043::DEBUG::2014-07-10 08:09:16,310::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' (0 active users) >Thread-1043::DEBUG::2014-07-10 08:09:16,310::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' is free, finding out if anyone is waiting for it. >Thread-1043::DEBUG::2014-07-10 08:09:16,310::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9', Clearing records. >Thread-1043::DEBUG::2014-07-10 08:09:16,310::task::990::TaskManager.Task::(_decref) Task=`101f6167-9fb2-4240-8bd5-66485977d206`::ref 0 aborting False >Thread-15::DEBUG::2014-07-10 08:09:17,075::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/e01a3a36-d2ce-4153-bb57-d6e65b7ed08c/metadata bs=4096 count=1' (cwd None) >Thread-15::DEBUG::2014-07-10 08:09:17,139::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000821219 s, 5.0 MB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-07-10 08:09:17,741::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-07-10 08:09:17,880::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0383926 s, 26.7 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 08:09:18,678::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lion.qa.lab.tlv.redhat.com:_export_yuri2_backup2/6a70504d-00df-4869-8695-0f442053f6b6/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-14::DEBUG::2014-07-10 08:09:18,738::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n369 bytes (369 B) copied, 0.00046565 s, 792 kB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-07-10 08:09:19,895::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-07-10 08:09:20,030::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0321659 s, 31.8 MB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-07-10 08:09:22,045::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-07-10 08:09:22,181::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0379725 s, 27.0 MB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-07-10 08:09:24,196::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-07-10 08:09:24,337::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0383933 s, 26.7 MB/s\n'; <rc> = 0 >Thread-1042::DEBUG::2014-07-10 08:09:26,291::task::595::TaskManager.Task::(_updateState) Task=`10341ace-6ef4-4053-a74d-3b81f3b8f066`::moving from state init -> state preparing >Thread-1042::INFO::2014-07-10 08:09:26,292::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-1042::INFO::2014-07-10 08:09:26,292::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000821219', 'lastCheck': '9.1', 'valid': True}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00046565', 'lastCheck': '7.6', 'valid': True}} >Thread-1042::DEBUG::2014-07-10 08:09:26,293::task::1185::TaskManager.Task::(prepare) Task=`10341ace-6ef4-4053-a74d-3b81f3b8f066`::finished: {u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000821219', 'lastCheck': '9.1', 'valid': True}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00046565', 'lastCheck': '7.6', 'valid': True}} >Thread-1042::DEBUG::2014-07-10 08:09:26,293::task::595::TaskManager.Task::(_updateState) Task=`10341ace-6ef4-4053-a74d-3b81f3b8f066`::moving from state preparing -> state finished >Thread-1042::DEBUG::2014-07-10 08:09:26,293::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-1042::DEBUG::2014-07-10 08:09:26,293::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1042::DEBUG::2014-07-10 08:09:26,293::task::990::TaskManager.Task::(_decref) Task=`10341ace-6ef4-4053-a74d-3b81f3b8f066`::ref 0 aborting False >Dummy-36::DEBUG::2014-07-10 08:09:26,352::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Thread-1042::DEBUG::2014-07-10 08:09:26,410::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-1042::DEBUG::2014-07-10 08:09:26,415::task::595::TaskManager.Task::(_updateState) Task=`0a12638e-4be5-4c54-b0cf-628518fd8bb8`::moving from state init -> state preparing >Thread-1042::INFO::2014-07-10 08:09:26,415::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='411039e4-4af2-4192-9de0-67dc1ed83ba9', options=None) >Thread-1042::INFO::2014-07-10 08:09:26,416::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2}} >Thread-1042::DEBUG::2014-07-10 08:09:26,416::task::1185::TaskManager.Task::(prepare) Task=`0a12638e-4be5-4c54-b0cf-628518fd8bb8`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2}} >Thread-1042::DEBUG::2014-07-10 08:09:26,416::task::595::TaskManager.Task::(_updateState) Task=`0a12638e-4be5-4c54-b0cf-628518fd8bb8`::moving from state preparing -> state finished >Thread-1042::DEBUG::2014-07-10 08:09:26,416::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-1042::DEBUG::2014-07-10 08:09:26,417::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1042::DEBUG::2014-07-10 08:09:26,417::task::990::TaskManager.Task::(_decref) Task=`0a12638e-4be5-4c54-b0cf-628518fd8bb8`::ref 0 aborting False >Thread-1043::DEBUG::2014-07-10 08:09:26,463::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-1043::DEBUG::2014-07-10 08:09:26,467::task::595::TaskManager.Task::(_updateState) Task=`7a018575-a106-43c9-910b-d7556ccd84b8`::moving from state init -> state preparing >Thread-1043::INFO::2014-07-10 08:09:26,470::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='411039e4-4af2-4192-9de0-67dc1ed83ba9', options=None) >Thread-1043::DEBUG::2014-07-10 08:09:26,476::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9`ReqID=`4608734c-be73-4834-bab4-91a4fffb427c`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo' >Thread-1043::DEBUG::2014-07-10 08:09:26,479::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' for lock type 'shared' >Thread-1043::DEBUG::2014-07-10 08:09:26,483::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' is free. Now locking as 'shared' (1 active user) >Thread-1043::DEBUG::2014-07-10 08:09:26,485::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9`ReqID=`4608734c-be73-4834-bab4-91a4fffb427c`::Granted request >Thread-1043::DEBUG::2014-07-10 08:09:26,490::task::827::TaskManager.Task::(resourceAcquired) Task=`7a018575-a106-43c9-910b-d7556ccd84b8`::_resourcesAcquired: Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9 (shared) >Thread-1043::DEBUG::2014-07-10 08:09:26,492::task::990::TaskManager.Task::(_decref) Task=`7a018575-a106-43c9-910b-d7556ccd84b8`::ref 1 aborting False >Thread-1043::INFO::2014-07-10 08:09:26,503::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DC-REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2, 'domains': u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': 'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c': {'status': u'Active', 'diskfree': '1137495244800', 'isoprefix': '', 'alerts': [], 'disktotal': '1152393412608', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '533840527360', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-1043::DEBUG::2014-07-10 08:09:26,505::task::1185::TaskManager.Task::(prepare) Task=`7a018575-a106-43c9-910b-d7556ccd84b8`::finished: {'info': {'name': 'DC-REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2, 'domains': u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': 'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c': {'status': u'Active', 'diskfree': '1137495244800', 'isoprefix': '', 'alerts': [], 'disktotal': '1152393412608', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '533840527360', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-1043::DEBUG::2014-07-10 08:09:26,507::task::595::TaskManager.Task::(_updateState) Task=`7a018575-a106-43c9-910b-d7556ccd84b8`::moving from state preparing -> state finished >Thread-1043::DEBUG::2014-07-10 08:09:26,509::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9': < ResourceRef 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9', isValid: 'True' obj: 'None'>} >Thread-1043::DEBUG::2014-07-10 08:09:26,511::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1043::DEBUG::2014-07-10 08:09:26,515::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' >Thread-1043::DEBUG::2014-07-10 08:09:26,518::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' (0 active users) >Thread-1043::DEBUG::2014-07-10 08:09:26,520::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' is free, finding out if anyone is waiting for it. >Thread-1043::DEBUG::2014-07-10 08:09:26,522::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9', Clearing records. >Thread-1043::DEBUG::2014-07-10 08:09:26,525::task::990::TaskManager.Task::(_decref) Task=`7a018575-a106-43c9-910b-d7556ccd84b8`::ref 0 aborting False >Dummy-36::DEBUG::2014-07-10 08:09:26,570::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0478664 s, 21.4 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-07-10 08:09:27,169::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/e01a3a36-d2ce-4153-bb57-d6e65b7ed08c/metadata bs=4096 count=1' (cwd None) >Thread-15::DEBUG::2014-07-10 08:09:27,235::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00100337 s, 4.1 MB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-07-10 08:09:28,585::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Thread-14::DEBUG::2014-07-10 08:09:28,991::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lion.qa.lab.tlv.redhat.com:_export_yuri2_backup2/6a70504d-00df-4869-8695-0f442053f6b6/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-14::DEBUG::2014-07-10 08:09:29,080::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n369 bytes (369 B) copied, 0.000455509 s, 810 kB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-07-10 08:09:29,101::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0775175 s, 13.2 MB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-07-10 08:09:31,116::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-07-10 08:09:31,258::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.037924 s, 27.0 MB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-07-10 08:09:33,273::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-07-10 08:09:33,407::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0335593 s, 30.5 MB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-07-10 08:09:35,422::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-07-10 08:09:35,556::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0369542 s, 27.7 MB/s\n'; <rc> = 0 >Thread-1042::DEBUG::2014-07-10 08:09:36,554::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-1042::DEBUG::2014-07-10 08:09:36,555::task::595::TaskManager.Task::(_updateState) Task=`580bec50-27c3-495c-b264-83f1ad21781a`::moving from state init -> state preparing >Thread-1042::INFO::2014-07-10 08:09:36,555::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='411039e4-4af2-4192-9de0-67dc1ed83ba9', options=None) >Thread-1042::INFO::2014-07-10 08:09:36,556::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2}} >Thread-1042::DEBUG::2014-07-10 08:09:36,556::task::1185::TaskManager.Task::(prepare) Task=`580bec50-27c3-495c-b264-83f1ad21781a`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2}} >Thread-1042::DEBUG::2014-07-10 08:09:36,556::task::595::TaskManager.Task::(_updateState) Task=`580bec50-27c3-495c-b264-83f1ad21781a`::moving from state preparing -> state finished >Thread-1042::DEBUG::2014-07-10 08:09:36,556::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-1042::DEBUG::2014-07-10 08:09:36,557::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1042::DEBUG::2014-07-10 08:09:36,557::task::990::TaskManager.Task::(_decref) Task=`580bec50-27c3-495c-b264-83f1ad21781a`::ref 0 aborting False >Thread-1043::DEBUG::2014-07-10 08:09:36,560::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-1043::DEBUG::2014-07-10 08:09:36,561::task::595::TaskManager.Task::(_updateState) Task=`739fb733-2f62-4b83-bc8b-050a6f7da844`::moving from state init -> state preparing >Thread-1043::INFO::2014-07-10 08:09:36,561::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='411039e4-4af2-4192-9de0-67dc1ed83ba9', options=None) >Thread-1043::DEBUG::2014-07-10 08:09:36,562::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9`ReqID=`a6edee6c-d6bf-4fd6-a702-d1a873851587`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo' >Thread-1043::DEBUG::2014-07-10 08:09:36,562::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' for lock type 'shared' >Thread-1043::DEBUG::2014-07-10 08:09:36,562::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' is free. Now locking as 'shared' (1 active user) >Thread-1043::DEBUG::2014-07-10 08:09:36,563::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9`ReqID=`a6edee6c-d6bf-4fd6-a702-d1a873851587`::Granted request >Thread-1043::DEBUG::2014-07-10 08:09:36,563::task::827::TaskManager.Task::(resourceAcquired) Task=`739fb733-2f62-4b83-bc8b-050a6f7da844`::_resourcesAcquired: Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9 (shared) >Thread-1043::DEBUG::2014-07-10 08:09:36,563::task::990::TaskManager.Task::(_decref) Task=`739fb733-2f62-4b83-bc8b-050a6f7da844`::ref 1 aborting False >Thread-1043::INFO::2014-07-10 08:09:36,565::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DC-REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2, 'domains': u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': 'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c': {'status': u'Active', 'diskfree': '1137495244800', 'isoprefix': '', 'alerts': [], 'disktotal': '1152393412608', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '533840527360', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-1043::DEBUG::2014-07-10 08:09:36,565::task::1185::TaskManager.Task::(prepare) Task=`739fb733-2f62-4b83-bc8b-050a6f7da844`::finished: {'info': {'name': 'DC-REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2, 'domains': u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': 'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c': {'status': u'Active', 'diskfree': '1137495244800', 'isoprefix': '', 'alerts': [], 'disktotal': '1152393412608', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '533840527360', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-1043::DEBUG::2014-07-10 08:09:36,565::task::595::TaskManager.Task::(_updateState) Task=`739fb733-2f62-4b83-bc8b-050a6f7da844`::moving from state preparing -> state finished >Thread-1043::DEBUG::2014-07-10 08:09:36,565::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9': < ResourceRef 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9', isValid: 'True' obj: 'None'>} >Thread-1043::DEBUG::2014-07-10 08:09:36,565::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1043::DEBUG::2014-07-10 08:09:36,566::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' >Thread-1043::DEBUG::2014-07-10 08:09:36,566::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' (0 active users) >Thread-1043::DEBUG::2014-07-10 08:09:36,566::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' is free, finding out if anyone is waiting for it. >Thread-1043::DEBUG::2014-07-10 08:09:36,566::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9', Clearing records. >Thread-1043::DEBUG::2014-07-10 08:09:36,566::task::990::TaskManager.Task::(_decref) Task=`739fb733-2f62-4b83-bc8b-050a6f7da844`::ref 0 aborting False >Thread-15::DEBUG::2014-07-10 08:09:37,264::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/e01a3a36-d2ce-4153-bb57-d6e65b7ed08c/metadata bs=4096 count=1' (cwd None) >Thread-15::DEBUG::2014-07-10 08:09:37,324::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000770944 s, 5.3 MB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-07-10 08:09:37,571::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-07-10 08:09:37,711::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0361312 s, 28.3 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 08:09:39,121::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lion.qa.lab.tlv.redhat.com:_export_yuri2_backup2/6a70504d-00df-4869-8695-0f442053f6b6/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-14::DEBUG::2014-07-10 08:09:39,181::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n369 bytes (369 B) copied, 0.000378072 s, 976 kB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-07-10 08:09:39,726::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-07-10 08:09:39,862::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0378893 s, 27.0 MB/s\n'; <rc> = 0 >Thread-1042::DEBUG::2014-07-10 08:09:41,422::task::595::TaskManager.Task::(_updateState) Task=`d30b867d-254d-4061-bacb-b954af02e28f`::moving from state init -> state preparing >Thread-1042::INFO::2014-07-10 08:09:41,423::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-1042::INFO::2014-07-10 08:09:41,423::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000770944', 'lastCheck': '4.1', 'valid': True}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000378072', 'lastCheck': '2.2', 'valid': True}} >Thread-1042::DEBUG::2014-07-10 08:09:41,424::task::1185::TaskManager.Task::(prepare) Task=`d30b867d-254d-4061-bacb-b954af02e28f`::finished: {u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000770944', 'lastCheck': '4.1', 'valid': True}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000378072', 'lastCheck': '2.2', 'valid': True}} >Thread-1042::DEBUG::2014-07-10 08:09:41,424::task::595::TaskManager.Task::(_updateState) Task=`d30b867d-254d-4061-bacb-b954af02e28f`::moving from state preparing -> state finished >Thread-1042::DEBUG::2014-07-10 08:09:41,424::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-1042::DEBUG::2014-07-10 08:09:41,424::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1042::DEBUG::2014-07-10 08:09:41,424::task::990::TaskManager.Task::(_decref) Task=`d30b867d-254d-4061-bacb-b954af02e28f`::ref 0 aborting False >Dummy-36::DEBUG::2014-07-10 08:09:41,877::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-07-10 08:09:42,003::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0291394 s, 35.1 MB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-07-10 08:09:44,018::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-07-10 08:09:44,167::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.052792 s, 19.4 MB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-07-10 08:09:46,182::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-07-10 08:09:46,316::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0349291 s, 29.3 MB/s\n'; <rc> = 0 >Thread-1042::DEBUG::2014-07-10 08:09:46,596::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-1042::DEBUG::2014-07-10 08:09:46,597::task::595::TaskManager.Task::(_updateState) Task=`ec02b5c9-1f77-4101-94e5-ff3d17d8685d`::moving from state init -> state preparing >Thread-1042::INFO::2014-07-10 08:09:46,597::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='411039e4-4af2-4192-9de0-67dc1ed83ba9', options=None) >Thread-1042::INFO::2014-07-10 08:09:46,598::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2}} >Thread-1042::DEBUG::2014-07-10 08:09:46,598::task::1185::TaskManager.Task::(prepare) Task=`ec02b5c9-1f77-4101-94e5-ff3d17d8685d`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2}} >Thread-1042::DEBUG::2014-07-10 08:09:46,598::task::595::TaskManager.Task::(_updateState) Task=`ec02b5c9-1f77-4101-94e5-ff3d17d8685d`::moving from state preparing -> state finished >Thread-1042::DEBUG::2014-07-10 08:09:46,598::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-1042::DEBUG::2014-07-10 08:09:46,599::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1042::DEBUG::2014-07-10 08:09:46,599::task::990::TaskManager.Task::(_decref) Task=`ec02b5c9-1f77-4101-94e5-ff3d17d8685d`::ref 0 aborting False >Thread-1043::DEBUG::2014-07-10 08:09:46,603::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-1043::DEBUG::2014-07-10 08:09:46,603::task::595::TaskManager.Task::(_updateState) Task=`36dd1578-ae05-4299-be38-4c676fcd2837`::moving from state init -> state preparing >Thread-1043::INFO::2014-07-10 08:09:46,603::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='411039e4-4af2-4192-9de0-67dc1ed83ba9', options=None) >Thread-1043::DEBUG::2014-07-10 08:09:46,604::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9`ReqID=`6fead290-4557-40dc-ac42-8a9cb267efc0`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo' >Thread-1043::DEBUG::2014-07-10 08:09:46,604::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' for lock type 'shared' >Thread-1043::DEBUG::2014-07-10 08:09:46,605::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' is free. Now locking as 'shared' (1 active user) >Thread-1043::DEBUG::2014-07-10 08:09:46,605::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9`ReqID=`6fead290-4557-40dc-ac42-8a9cb267efc0`::Granted request >Thread-1043::DEBUG::2014-07-10 08:09:46,605::task::827::TaskManager.Task::(resourceAcquired) Task=`36dd1578-ae05-4299-be38-4c676fcd2837`::_resourcesAcquired: Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9 (shared) >Thread-1043::DEBUG::2014-07-10 08:09:46,605::task::990::TaskManager.Task::(_decref) Task=`36dd1578-ae05-4299-be38-4c676fcd2837`::ref 1 aborting False >Thread-1043::INFO::2014-07-10 08:09:46,607::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DC-REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2, 'domains': u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': 'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c': {'status': u'Active', 'diskfree': '1137495244800', 'isoprefix': '', 'alerts': [], 'disktotal': '1152393412608', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '533840527360', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-1043::DEBUG::2014-07-10 08:09:46,607::task::1185::TaskManager.Task::(prepare) Task=`36dd1578-ae05-4299-be38-4c676fcd2837`::finished: {'info': {'name': 'DC-REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2, 'domains': u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': 'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c': {'status': u'Active', 'diskfree': '1137495244800', 'isoprefix': '', 'alerts': [], 'disktotal': '1152393412608', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '533840527360', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-1043::DEBUG::2014-07-10 08:09:46,607::task::595::TaskManager.Task::(_updateState) Task=`36dd1578-ae05-4299-be38-4c676fcd2837`::moving from state preparing -> state finished >Thread-1043::DEBUG::2014-07-10 08:09:46,607::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9': < ResourceRef 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9', isValid: 'True' obj: 'None'>} >Thread-1043::DEBUG::2014-07-10 08:09:46,607::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1043::DEBUG::2014-07-10 08:09:46,608::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' >Thread-1043::DEBUG::2014-07-10 08:09:46,608::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' (0 active users) >Thread-1043::DEBUG::2014-07-10 08:09:46,608::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' is free, finding out if anyone is waiting for it. >Thread-1043::DEBUG::2014-07-10 08:09:46,608::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9', Clearing records. >Thread-1043::DEBUG::2014-07-10 08:09:46,608::task::990::TaskManager.Task::(_decref) Task=`36dd1578-ae05-4299-be38-4c676fcd2837`::ref 0 aborting False >Thread-15::DEBUG::2014-07-10 08:09:47,353::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/e01a3a36-d2ce-4153-bb57-d6e65b7ed08c/metadata bs=4096 count=1' (cwd None) >Thread-15::DEBUG::2014-07-10 08:09:47,424::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.0043318 s, 946 kB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-07-10 08:09:48,332::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-07-10 08:09:48,465::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0379895 s, 27.0 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 08:09:49,245::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lion.qa.lab.tlv.redhat.com:_export_yuri2_backup2/6a70504d-00df-4869-8695-0f442053f6b6/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-14::DEBUG::2014-07-10 08:09:49,309::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n369 bytes (369 B) copied, 0.000504367 s, 732 kB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-07-10 08:09:50,481::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-07-10 08:09:50,618::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0344146 s, 29.8 MB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-07-10 08:09:52,633::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-07-10 08:09:52,765::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0391545 s, 26.2 MB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-07-10 08:09:54,781::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-07-10 08:09:54,916::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0354394 s, 28.9 MB/s\n'; <rc> = 0 >Thread-1042::DEBUG::2014-07-10 08:09:56,569::task::595::TaskManager.Task::(_updateState) Task=`9e3bf093-623b-4e39-b8b6-de03b9bc715f`::moving from state init -> state preparing >Thread-1042::INFO::2014-07-10 08:09:56,570::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-1042::INFO::2014-07-10 08:09:56,570::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0043318', 'lastCheck': '9.1', 'valid': True}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000504367', 'lastCheck': '7.3', 'valid': True}} >Thread-1042::DEBUG::2014-07-10 08:09:56,570::task::1185::TaskManager.Task::(prepare) Task=`9e3bf093-623b-4e39-b8b6-de03b9bc715f`::finished: {u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0043318', 'lastCheck': '9.1', 'valid': True}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000504367', 'lastCheck': '7.3', 'valid': True}} >Thread-1042::DEBUG::2014-07-10 08:09:56,570::task::595::TaskManager.Task::(_updateState) Task=`9e3bf093-623b-4e39-b8b6-de03b9bc715f`::moving from state preparing -> state finished >Thread-1042::DEBUG::2014-07-10 08:09:56,570::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-1042::DEBUG::2014-07-10 08:09:56,571::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1042::DEBUG::2014-07-10 08:09:56,571::task::990::TaskManager.Task::(_decref) Task=`9e3bf093-623b-4e39-b8b6-de03b9bc715f`::ref 0 aborting False >Thread-1042::DEBUG::2014-07-10 08:09:56,636::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-1042::DEBUG::2014-07-10 08:09:56,637::task::595::TaskManager.Task::(_updateState) Task=`3d3b47a6-09f4-4082-95db-297ccb395914`::moving from state init -> state preparing >Thread-1042::INFO::2014-07-10 08:09:56,637::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='411039e4-4af2-4192-9de0-67dc1ed83ba9', options=None) >Thread-1042::INFO::2014-07-10 08:09:56,637::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2}} >Thread-1042::DEBUG::2014-07-10 08:09:56,637::task::1185::TaskManager.Task::(prepare) Task=`3d3b47a6-09f4-4082-95db-297ccb395914`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2}} >Thread-1042::DEBUG::2014-07-10 08:09:56,638::task::595::TaskManager.Task::(_updateState) Task=`3d3b47a6-09f4-4082-95db-297ccb395914`::moving from state preparing -> state finished >Thread-1042::DEBUG::2014-07-10 08:09:56,638::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-1042::DEBUG::2014-07-10 08:09:56,638::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1042::DEBUG::2014-07-10 08:09:56,638::task::990::TaskManager.Task::(_decref) Task=`3d3b47a6-09f4-4082-95db-297ccb395914`::ref 0 aborting False >Thread-1043::DEBUG::2014-07-10 08:09:56,681::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-1043::DEBUG::2014-07-10 08:09:56,681::task::595::TaskManager.Task::(_updateState) Task=`408937d4-eb44-4658-8aa3-dd4628aa00e9`::moving from state init -> state preparing >Thread-1043::INFO::2014-07-10 08:09:56,682::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='411039e4-4af2-4192-9de0-67dc1ed83ba9', options=None) >Thread-1043::DEBUG::2014-07-10 08:09:56,682::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9`ReqID=`2a0c7c81-c65c-46e4-a5b1-a00070c307a0`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo' >Thread-1043::DEBUG::2014-07-10 08:09:56,682::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' for lock type 'shared' >Thread-1043::DEBUG::2014-07-10 08:09:56,683::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' is free. Now locking as 'shared' (1 active user) >Thread-1043::DEBUG::2014-07-10 08:09:56,683::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9`ReqID=`2a0c7c81-c65c-46e4-a5b1-a00070c307a0`::Granted request >Thread-1043::DEBUG::2014-07-10 08:09:56,683::task::827::TaskManager.Task::(resourceAcquired) Task=`408937d4-eb44-4658-8aa3-dd4628aa00e9`::_resourcesAcquired: Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9 (shared) >Thread-1043::DEBUG::2014-07-10 08:09:56,683::task::990::TaskManager.Task::(_decref) Task=`408937d4-eb44-4658-8aa3-dd4628aa00e9`::ref 1 aborting False >Thread-1043::INFO::2014-07-10 08:09:56,684::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DC-REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2, 'domains': u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': 'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c': {'status': u'Active', 'diskfree': '1137495244800', 'isoprefix': '', 'alerts': [], 'disktotal': '1152393412608', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '533840527360', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-1043::DEBUG::2014-07-10 08:09:56,685::task::1185::TaskManager.Task::(prepare) Task=`408937d4-eb44-4658-8aa3-dd4628aa00e9`::finished: {'info': {'name': 'DC-REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2, 'domains': u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': 'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c': {'status': u'Active', 'diskfree': '1137495244800', 'isoprefix': '', 'alerts': [], 'disktotal': '1152393412608', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '533840527360', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-1043::DEBUG::2014-07-10 08:09:56,685::task::595::TaskManager.Task::(_updateState) Task=`408937d4-eb44-4658-8aa3-dd4628aa00e9`::moving from state preparing -> state finished >Thread-1043::DEBUG::2014-07-10 08:09:56,685::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9': < ResourceRef 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9', isValid: 'True' obj: 'None'>} >Thread-1043::DEBUG::2014-07-10 08:09:56,685::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1043::DEBUG::2014-07-10 08:09:56,685::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' >Thread-1043::DEBUG::2014-07-10 08:09:56,686::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' (0 active users) >Thread-1043::DEBUG::2014-07-10 08:09:56,686::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' is free, finding out if anyone is waiting for it. >Thread-1043::DEBUG::2014-07-10 08:09:56,686::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9', Clearing records. >Thread-1043::DEBUG::2014-07-10 08:09:56,686::task::990::TaskManager.Task::(_decref) Task=`408937d4-eb44-4658-8aa3-dd4628aa00e9`::ref 0 aborting False >Dummy-36::DEBUG::2014-07-10 08:09:56,930::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-07-10 08:09:57,060::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0329615 s, 31.1 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-07-10 08:09:57,453::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/e01a3a36-d2ce-4153-bb57-d6e65b7ed08c/metadata bs=4096 count=1' (cwd None) >Thread-15::DEBUG::2014-07-10 08:09:57,513::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000617076 s, 6.6 MB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-07-10 08:09:59,075::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-07-10 08:09:59,207::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0297767 s, 34.4 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 08:09:59,339::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lion.qa.lab.tlv.redhat.com:_export_yuri2_backup2/6a70504d-00df-4869-8695-0f442053f6b6/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-14::DEBUG::2014-07-10 08:09:59,397::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n369 bytes (369 B) copied, 0.000487783 s, 756 kB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-07-10 08:10:01,223::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-07-10 08:10:01,372::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.038826 s, 26.4 MB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-07-10 08:10:03,387::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-07-10 08:10:03,530::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0421938 s, 24.3 MB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-07-10 08:10:05,545::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-07-10 08:10:05,681::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0296185 s, 34.6 MB/s\n'; <rc> = 0 >Thread-1042::DEBUG::2014-07-10 08:10:06,711::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-1042::DEBUG::2014-07-10 08:10:06,712::task::595::TaskManager.Task::(_updateState) Task=`c44c1cbd-0058-44cd-96c5-4de3b3b30edd`::moving from state init -> state preparing >Thread-1042::INFO::2014-07-10 08:10:06,712::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='411039e4-4af2-4192-9de0-67dc1ed83ba9', options=None) >Thread-1042::INFO::2014-07-10 08:10:06,713::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2}} >Thread-1042::DEBUG::2014-07-10 08:10:06,713::task::1185::TaskManager.Task::(prepare) Task=`c44c1cbd-0058-44cd-96c5-4de3b3b30edd`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2}} >Thread-1042::DEBUG::2014-07-10 08:10:06,713::task::595::TaskManager.Task::(_updateState) Task=`c44c1cbd-0058-44cd-96c5-4de3b3b30edd`::moving from state preparing -> state finished >Thread-1042::DEBUG::2014-07-10 08:10:06,714::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-1042::DEBUG::2014-07-10 08:10:06,714::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1042::DEBUG::2014-07-10 08:10:06,714::task::990::TaskManager.Task::(_decref) Task=`c44c1cbd-0058-44cd-96c5-4de3b3b30edd`::ref 0 aborting False >Thread-1043::DEBUG::2014-07-10 08:10:06,718::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-1043::DEBUG::2014-07-10 08:10:06,718::task::595::TaskManager.Task::(_updateState) Task=`13ff514d-df3e-4f48-ba97-a2e827f11acf`::moving from state init -> state preparing >Thread-1043::INFO::2014-07-10 08:10:06,719::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='411039e4-4af2-4192-9de0-67dc1ed83ba9', options=None) >Thread-1043::DEBUG::2014-07-10 08:10:06,720::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9`ReqID=`f266cbe6-5677-401f-87bf-6f7fe810747b`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo' >Thread-1043::DEBUG::2014-07-10 08:10:06,720::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' for lock type 'shared' >Thread-1043::DEBUG::2014-07-10 08:10:06,720::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' is free. Now locking as 'shared' (1 active user) >Thread-1043::DEBUG::2014-07-10 08:10:06,720::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9`ReqID=`f266cbe6-5677-401f-87bf-6f7fe810747b`::Granted request >Thread-1043::DEBUG::2014-07-10 08:10:06,721::task::827::TaskManager.Task::(resourceAcquired) Task=`13ff514d-df3e-4f48-ba97-a2e827f11acf`::_resourcesAcquired: Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9 (shared) >Thread-1043::DEBUG::2014-07-10 08:10:06,721::task::990::TaskManager.Task::(_decref) Task=`13ff514d-df3e-4f48-ba97-a2e827f11acf`::ref 1 aborting False >Thread-1043::INFO::2014-07-10 08:10:06,722::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DC-REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2, 'domains': u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': 'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c': {'status': u'Active', 'diskfree': '1137495244800', 'isoprefix': '', 'alerts': [], 'disktotal': '1152393412608', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '533840527360', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-1043::DEBUG::2014-07-10 08:10:06,723::task::1185::TaskManager.Task::(prepare) Task=`13ff514d-df3e-4f48-ba97-a2e827f11acf`::finished: {'info': {'name': 'DC-REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2, 'domains': u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': 'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c': {'status': u'Active', 'diskfree': '1137495244800', 'isoprefix': '', 'alerts': [], 'disktotal': '1152393412608', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '533840527360', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-1043::DEBUG::2014-07-10 08:10:06,723::task::595::TaskManager.Task::(_updateState) Task=`13ff514d-df3e-4f48-ba97-a2e827f11acf`::moving from state preparing -> state finished >Thread-1043::DEBUG::2014-07-10 08:10:06,723::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9': < ResourceRef 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9', isValid: 'True' obj: 'None'>} >Thread-1043::DEBUG::2014-07-10 08:10:06,723::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1043::DEBUG::2014-07-10 08:10:06,723::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' >Thread-1043::DEBUG::2014-07-10 08:10:06,724::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' (0 active users) >Thread-1043::DEBUG::2014-07-10 08:10:06,724::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' is free, finding out if anyone is waiting for it. >Thread-1043::DEBUG::2014-07-10 08:10:06,724::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9', Clearing records. >Thread-1043::DEBUG::2014-07-10 08:10:06,725::task::990::TaskManager.Task::(_decref) Task=`13ff514d-df3e-4f48-ba97-a2e827f11acf`::ref 0 aborting False >Thread-15::DEBUG::2014-07-10 08:10:07,542::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/e01a3a36-d2ce-4153-bb57-d6e65b7ed08c/metadata bs=4096 count=1' (cwd None) >Thread-15::DEBUG::2014-07-10 08:10:07,606::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000641867 s, 6.4 MB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-07-10 08:10:07,705::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-07-10 08:10:07,846::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0379158 s, 27.0 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 08:10:09,422::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lion.qa.lab.tlv.redhat.com:_export_yuri2_backup2/6a70504d-00df-4869-8695-0f442053f6b6/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-14::DEBUG::2014-07-10 08:10:09,485::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n369 bytes (369 B) copied, 0.000463689 s, 796 kB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-07-10 08:10:09,856::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-07-10 08:10:09,995::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0374098 s, 27.4 MB/s\n'; <rc> = 0 >Thread-1042::DEBUG::2014-07-10 08:10:11,714::task::595::TaskManager.Task::(_updateState) Task=`a17e376c-47f1-4a75-8345-3a62db12bddf`::moving from state init -> state preparing >Thread-1042::INFO::2014-07-10 08:10:11,714::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-1042::INFO::2014-07-10 08:10:11,715::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000641867', 'lastCheck': '4.1', 'valid': True}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000463689', 'lastCheck': '2.2', 'valid': True}} >Thread-1042::DEBUG::2014-07-10 08:10:11,715::task::1185::TaskManager.Task::(prepare) Task=`a17e376c-47f1-4a75-8345-3a62db12bddf`::finished: {u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000641867', 'lastCheck': '4.1', 'valid': True}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000463689', 'lastCheck': '2.2', 'valid': True}} >Thread-1042::DEBUG::2014-07-10 08:10:11,715::task::595::TaskManager.Task::(_updateState) Task=`a17e376c-47f1-4a75-8345-3a62db12bddf`::moving from state preparing -> state finished >Thread-1042::DEBUG::2014-07-10 08:10:11,715::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-1042::DEBUG::2014-07-10 08:10:11,716::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1042::DEBUG::2014-07-10 08:10:11,716::task::990::TaskManager.Task::(_decref) Task=`a17e376c-47f1-4a75-8345-3a62db12bddf`::ref 0 aborting False >Dummy-36::DEBUG::2014-07-10 08:10:12,010::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-07-10 08:10:12,142::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0324811 s, 31.5 MB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-07-10 08:10:14,157::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-07-10 08:10:14,285::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0327959 s, 31.2 MB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-07-10 08:10:16,301::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-07-10 08:10:16,444::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0415042 s, 24.7 MB/s\n'; <rc> = 0 >Thread-1042::DEBUG::2014-07-10 08:10:16,754::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-1042::DEBUG::2014-07-10 08:10:16,756::task::595::TaskManager.Task::(_updateState) Task=`2f09605c-0d32-4c07-8a74-769faac3abde`::moving from state init -> state preparing >Thread-1042::INFO::2014-07-10 08:10:16,756::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='411039e4-4af2-4192-9de0-67dc1ed83ba9', options=None) >Thread-1042::INFO::2014-07-10 08:10:16,757::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2}} >Thread-1042::DEBUG::2014-07-10 08:10:16,757::task::1185::TaskManager.Task::(prepare) Task=`2f09605c-0d32-4c07-8a74-769faac3abde`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2}} >Thread-1042::DEBUG::2014-07-10 08:10:16,757::task::595::TaskManager.Task::(_updateState) Task=`2f09605c-0d32-4c07-8a74-769faac3abde`::moving from state preparing -> state finished >Thread-1042::DEBUG::2014-07-10 08:10:16,757::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-1042::DEBUG::2014-07-10 08:10:16,758::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1042::DEBUG::2014-07-10 08:10:16,758::task::990::TaskManager.Task::(_decref) Task=`2f09605c-0d32-4c07-8a74-769faac3abde`::ref 0 aborting False >Thread-1043::DEBUG::2014-07-10 08:10:16,762::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-1043::DEBUG::2014-07-10 08:10:16,762::task::595::TaskManager.Task::(_updateState) Task=`51499bb4-ed0e-44fb-bd59-8247029132e5`::moving from state init -> state preparing >Thread-1043::INFO::2014-07-10 08:10:16,763::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='411039e4-4af2-4192-9de0-67dc1ed83ba9', options=None) >Thread-1043::DEBUG::2014-07-10 08:10:16,763::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9`ReqID=`64a1044d-d748-419e-b5a6-c15ee3f298e4`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo' >Thread-1043::DEBUG::2014-07-10 08:10:16,764::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' for lock type 'shared' >Thread-1043::DEBUG::2014-07-10 08:10:16,764::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' is free. Now locking as 'shared' (1 active user) >Thread-1043::DEBUG::2014-07-10 08:10:16,764::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9`ReqID=`64a1044d-d748-419e-b5a6-c15ee3f298e4`::Granted request >Thread-1043::DEBUG::2014-07-10 08:10:16,765::task::827::TaskManager.Task::(resourceAcquired) Task=`51499bb4-ed0e-44fb-bd59-8247029132e5`::_resourcesAcquired: Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9 (shared) >Thread-1043::DEBUG::2014-07-10 08:10:16,765::task::990::TaskManager.Task::(_decref) Task=`51499bb4-ed0e-44fb-bd59-8247029132e5`::ref 1 aborting False >Thread-1043::INFO::2014-07-10 08:10:16,766::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DC-REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2, 'domains': u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': 'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c': {'status': u'Active', 'diskfree': '1137495244800', 'isoprefix': '', 'alerts': [], 'disktotal': '1152393412608', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '533840527360', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-1043::DEBUG::2014-07-10 08:10:16,766::task::1185::TaskManager.Task::(prepare) Task=`51499bb4-ed0e-44fb-bd59-8247029132e5`::finished: {'info': {'name': 'DC-REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2, 'domains': u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': 'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c': {'status': u'Active', 'diskfree': '1137495244800', 'isoprefix': '', 'alerts': [], 'disktotal': '1152393412608', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '533840527360', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-1043::DEBUG::2014-07-10 08:10:16,767::task::595::TaskManager.Task::(_updateState) Task=`51499bb4-ed0e-44fb-bd59-8247029132e5`::moving from state preparing -> state finished >Thread-1043::DEBUG::2014-07-10 08:10:16,767::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9': < ResourceRef 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9', isValid: 'True' obj: 'None'>} >Thread-1043::DEBUG::2014-07-10 08:10:16,767::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1043::DEBUG::2014-07-10 08:10:16,767::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' >Thread-1043::DEBUG::2014-07-10 08:10:16,768::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' (0 active users) >Thread-1043::DEBUG::2014-07-10 08:10:16,768::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' is free, finding out if anyone is waiting for it. >Thread-1043::DEBUG::2014-07-10 08:10:16,768::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9', Clearing records. >Thread-1043::DEBUG::2014-07-10 08:10:16,768::task::990::TaskManager.Task::(_decref) Task=`51499bb4-ed0e-44fb-bd59-8247029132e5`::ref 0 aborting False >Thread-15::DEBUG::2014-07-10 08:10:17,635::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/e01a3a36-d2ce-4153-bb57-d6e65b7ed08c/metadata bs=4096 count=1' (cwd None) >Thread-15::DEBUG::2014-07-10 08:10:17,707::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000889208 s, 4.6 MB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-07-10 08:10:18,459::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-07-10 08:10:18,599::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0377924 s, 27.1 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 08:10:19,515::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lion.qa.lab.tlv.redhat.com:_export_yuri2_backup2/6a70504d-00df-4869-8695-0f442053f6b6/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-14::DEBUG::2014-07-10 08:10:19,577::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n369 bytes (369 B) copied, 0.000431408 s, 855 kB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-07-10 08:10:20,614::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-07-10 08:10:20,760::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0451174 s, 22.7 MB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-07-10 08:10:22,775::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-07-10 08:10:22,910::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0362648 s, 28.2 MB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-07-10 08:10:24,925::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-07-10 08:10:25,059::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.037753 s, 27.1 MB/s\n'; <rc> = 0 >Thread-1042::DEBUG::2014-07-10 08:10:26,811::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-1042::DEBUG::2014-07-10 08:10:26,812::task::595::TaskManager.Task::(_updateState) Task=`cf25882e-e19b-4aaf-8deb-36b60ab47c6c`::moving from state init -> state preparing >Thread-1042::INFO::2014-07-10 08:10:26,813::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='411039e4-4af2-4192-9de0-67dc1ed83ba9', options=None) >Thread-1042::INFO::2014-07-10 08:10:26,813::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2}} >Thread-1042::DEBUG::2014-07-10 08:10:26,813::task::1185::TaskManager.Task::(prepare) Task=`cf25882e-e19b-4aaf-8deb-36b60ab47c6c`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2}} >Thread-1042::DEBUG::2014-07-10 08:10:26,814::task::595::TaskManager.Task::(_updateState) Task=`cf25882e-e19b-4aaf-8deb-36b60ab47c6c`::moving from state preparing -> state finished >Thread-1042::DEBUG::2014-07-10 08:10:26,814::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-1042::DEBUG::2014-07-10 08:10:26,814::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1042::DEBUG::2014-07-10 08:10:26,814::task::990::TaskManager.Task::(_decref) Task=`cf25882e-e19b-4aaf-8deb-36b60ab47c6c`::ref 0 aborting False >Thread-1043::DEBUG::2014-07-10 08:10:26,818::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-1043::DEBUG::2014-07-10 08:10:26,818::task::595::TaskManager.Task::(_updateState) Task=`f94136fd-3010-4736-8dec-2b7f59246c99`::moving from state init -> state preparing >Thread-1043::INFO::2014-07-10 08:10:26,819::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='411039e4-4af2-4192-9de0-67dc1ed83ba9', options=None) >Thread-1043::DEBUG::2014-07-10 08:10:26,819::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9`ReqID=`0f22a4c5-abcd-4479-9370-a36da5e856a8`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo' >Thread-1043::DEBUG::2014-07-10 08:10:26,819::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' for lock type 'shared' >Thread-1043::DEBUG::2014-07-10 08:10:26,820::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' is free. Now locking as 'shared' (1 active user) >Thread-1043::DEBUG::2014-07-10 08:10:26,820::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9`ReqID=`0f22a4c5-abcd-4479-9370-a36da5e856a8`::Granted request >Thread-1043::DEBUG::2014-07-10 08:10:26,820::task::827::TaskManager.Task::(resourceAcquired) Task=`f94136fd-3010-4736-8dec-2b7f59246c99`::_resourcesAcquired: Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9 (shared) >Thread-1043::DEBUG::2014-07-10 08:10:26,820::task::990::TaskManager.Task::(_decref) Task=`f94136fd-3010-4736-8dec-2b7f59246c99`::ref 1 aborting False >Thread-1043::INFO::2014-07-10 08:10:26,822::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DC-REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2, 'domains': u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': 'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c': {'status': u'Active', 'diskfree': '1137495244800', 'isoprefix': '', 'alerts': [], 'disktotal': '1152393412608', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '533840527360', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-1043::DEBUG::2014-07-10 08:10:26,822::task::1185::TaskManager.Task::(prepare) Task=`f94136fd-3010-4736-8dec-2b7f59246c99`::finished: {'info': {'name': 'DC-REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2, 'domains': u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': 'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c': {'status': u'Active', 'diskfree': '1137495244800', 'isoprefix': '', 'alerts': [], 'disktotal': '1152393412608', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '533840527360', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-1043::DEBUG::2014-07-10 08:10:26,822::task::595::TaskManager.Task::(_updateState) Task=`f94136fd-3010-4736-8dec-2b7f59246c99`::moving from state preparing -> state finished >Thread-1043::DEBUG::2014-07-10 08:10:26,822::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9': < ResourceRef 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9', isValid: 'True' obj: 'None'>} >Thread-1043::DEBUG::2014-07-10 08:10:26,822::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1043::DEBUG::2014-07-10 08:10:26,822::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' >Thread-1043::DEBUG::2014-07-10 08:10:26,823::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' (0 active users) >Thread-1043::DEBUG::2014-07-10 08:10:26,823::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' is free, finding out if anyone is waiting for it. >Thread-1043::DEBUG::2014-07-10 08:10:26,823::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9', Clearing records. >Thread-1043::DEBUG::2014-07-10 08:10:26,823::task::990::TaskManager.Task::(_decref) Task=`f94136fd-3010-4736-8dec-2b7f59246c99`::ref 0 aborting False >Thread-1042::DEBUG::2014-07-10 08:10:26,847::task::595::TaskManager.Task::(_updateState) Task=`512e0aae-64e5-4267-a959-835335712954`::moving from state init -> state preparing >Thread-1042::INFO::2014-07-10 08:10:26,847::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-1042::INFO::2014-07-10 08:10:26,848::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000889208', 'lastCheck': '9.1', 'valid': True}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000431408', 'lastCheck': '7.3', 'valid': True}} >Thread-1042::DEBUG::2014-07-10 08:10:26,848::task::1185::TaskManager.Task::(prepare) Task=`512e0aae-64e5-4267-a959-835335712954`::finished: {u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000889208', 'lastCheck': '9.1', 'valid': True}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000431408', 'lastCheck': '7.3', 'valid': True}} >Thread-1042::DEBUG::2014-07-10 08:10:26,848::task::595::TaskManager.Task::(_updateState) Task=`512e0aae-64e5-4267-a959-835335712954`::moving from state preparing -> state finished >Thread-1042::DEBUG::2014-07-10 08:10:26,848::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-1042::DEBUG::2014-07-10 08:10:26,848::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1042::DEBUG::2014-07-10 08:10:26,849::task::990::TaskManager.Task::(_decref) Task=`512e0aae-64e5-4267-a959-835335712954`::ref 0 aborting False >Dummy-36::DEBUG::2014-07-10 08:10:27,074::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-07-10 08:10:27,204::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.032017 s, 32.0 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-07-10 08:10:27,737::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/e01a3a36-d2ce-4153-bb57-d6e65b7ed08c/metadata bs=4096 count=1' (cwd None) >Thread-15::DEBUG::2014-07-10 08:10:27,804::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00387943 s, 1.1 MB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-07-10 08:10:29,219::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-07-10 08:10:29,356::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0326754 s, 31.3 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 08:10:29,607::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lion.qa.lab.tlv.redhat.com:_export_yuri2_backup2/6a70504d-00df-4869-8695-0f442053f6b6/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-14::DEBUG::2014-07-10 08:10:29,670::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n369 bytes (369 B) copied, 0.000437411 s, 844 kB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-07-10 08:10:31,371::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-07-10 08:10:31,511::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0378552 s, 27.1 MB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-07-10 08:10:33,526::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-07-10 08:10:33,657::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0328607 s, 31.2 MB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-07-10 08:10:35,672::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-07-10 08:10:35,816::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.042356 s, 24.2 MB/s\n'; <rc> = 0 >Thread-1042::DEBUG::2014-07-10 08:10:36,844::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-1042::DEBUG::2014-07-10 08:10:36,845::task::595::TaskManager.Task::(_updateState) Task=`2599dfde-b1a7-4588-b025-148823d8219b`::moving from state init -> state preparing >Thread-1042::INFO::2014-07-10 08:10:36,846::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='411039e4-4af2-4192-9de0-67dc1ed83ba9', options=None) >Thread-1042::INFO::2014-07-10 08:10:36,846::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2}} >Thread-1042::DEBUG::2014-07-10 08:10:36,846::task::1185::TaskManager.Task::(prepare) Task=`2599dfde-b1a7-4588-b025-148823d8219b`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2}} >Thread-1042::DEBUG::2014-07-10 08:10:36,847::task::595::TaskManager.Task::(_updateState) Task=`2599dfde-b1a7-4588-b025-148823d8219b`::moving from state preparing -> state finished >Thread-1042::DEBUG::2014-07-10 08:10:36,847::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-1042::DEBUG::2014-07-10 08:10:36,847::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1042::DEBUG::2014-07-10 08:10:36,847::task::990::TaskManager.Task::(_decref) Task=`2599dfde-b1a7-4588-b025-148823d8219b`::ref 0 aborting False >Thread-1043::DEBUG::2014-07-10 08:10:36,851::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-1043::DEBUG::2014-07-10 08:10:36,851::task::595::TaskManager.Task::(_updateState) Task=`2867fda3-053d-470f-961b-8ea4e1c68cf9`::moving from state init -> state preparing >Thread-1043::INFO::2014-07-10 08:10:36,852::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='411039e4-4af2-4192-9de0-67dc1ed83ba9', options=None) >Thread-1043::DEBUG::2014-07-10 08:10:36,855::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9`ReqID=`89370075-40c2-4d9a-be89-086d368156ea`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo' >Thread-1043::DEBUG::2014-07-10 08:10:36,856::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' for lock type 'shared' >Thread-1043::DEBUG::2014-07-10 08:10:36,856::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' is free. Now locking as 'shared' (1 active user) >Thread-1043::DEBUG::2014-07-10 08:10:36,857::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9`ReqID=`89370075-40c2-4d9a-be89-086d368156ea`::Granted request >Thread-1043::DEBUG::2014-07-10 08:10:36,857::task::827::TaskManager.Task::(resourceAcquired) Task=`2867fda3-053d-470f-961b-8ea4e1c68cf9`::_resourcesAcquired: Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9 (shared) >Thread-1043::DEBUG::2014-07-10 08:10:36,857::task::990::TaskManager.Task::(_decref) Task=`2867fda3-053d-470f-961b-8ea4e1c68cf9`::ref 1 aborting False >Thread-1043::INFO::2014-07-10 08:10:36,858::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DC-REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2, 'domains': u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': 'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c': {'status': u'Active', 'diskfree': '1137495244800', 'isoprefix': '', 'alerts': [], 'disktotal': '1152393412608', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '533840527360', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-1043::DEBUG::2014-07-10 08:10:36,859::task::1185::TaskManager.Task::(prepare) Task=`2867fda3-053d-470f-961b-8ea4e1c68cf9`::finished: {'info': {'name': 'DC-REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2, 'domains': u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': 'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c': {'status': u'Active', 'diskfree': '1137495244800', 'isoprefix': '', 'alerts': [], 'disktotal': '1152393412608', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '533840527360', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-1043::DEBUG::2014-07-10 08:10:36,859::task::595::TaskManager.Task::(_updateState) Task=`2867fda3-053d-470f-961b-8ea4e1c68cf9`::moving from state preparing -> state finished >Thread-1043::DEBUG::2014-07-10 08:10:36,859::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9': < ResourceRef 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9', isValid: 'True' obj: 'None'>} >Thread-1043::DEBUG::2014-07-10 08:10:36,859::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1043::DEBUG::2014-07-10 08:10:36,859::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' >Thread-1043::DEBUG::2014-07-10 08:10:36,860::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' (0 active users) >Thread-1043::DEBUG::2014-07-10 08:10:36,860::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' is free, finding out if anyone is waiting for it. >Thread-1043::DEBUG::2014-07-10 08:10:36,860::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9', Clearing records. >Thread-1043::DEBUG::2014-07-10 08:10:36,860::task::990::TaskManager.Task::(_decref) Task=`2867fda3-053d-470f-961b-8ea4e1c68cf9`::ref 0 aborting False >Dummy-36::DEBUG::2014-07-10 08:10:37,832::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Thread-15::DEBUG::2014-07-10 08:10:37,891::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/e01a3a36-d2ce-4153-bb57-d6e65b7ed08c/metadata bs=4096 count=1' (cwd None) >Thread-15::DEBUG::2014-07-10 08:10:38,024::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000749079 s, 5.5 MB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-07-10 08:10:38,479::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.519622 s, 2.0 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 08:10:39,699::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lion.qa.lab.tlv.redhat.com:_export_yuri2_backup2/6a70504d-00df-4869-8695-0f442053f6b6/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-14::DEBUG::2014-07-10 08:10:39,758::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n369 bytes (369 B) copied, 0.000442775 s, 833 kB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-07-10 08:10:40,494::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-07-10 08:10:40,635::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0382714 s, 26.8 MB/s\n'; <rc> = 0 >Thread-1042::DEBUG::2014-07-10 08:10:41,994::task::595::TaskManager.Task::(_updateState) Task=`8ec3f1a6-951a-4942-a00a-9fe661e229ff`::moving from state init -> state preparing >Thread-1042::INFO::2014-07-10 08:10:41,995::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-1042::INFO::2014-07-10 08:10:41,995::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000749079', 'lastCheck': '3.6', 'valid': True}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000442775', 'lastCheck': '2.2', 'valid': True}} >Thread-1042::DEBUG::2014-07-10 08:10:41,995::task::1185::TaskManager.Task::(prepare) Task=`8ec3f1a6-951a-4942-a00a-9fe661e229ff`::finished: {u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000749079', 'lastCheck': '3.6', 'valid': True}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000442775', 'lastCheck': '2.2', 'valid': True}} >Thread-1042::DEBUG::2014-07-10 08:10:41,995::task::595::TaskManager.Task::(_updateState) Task=`8ec3f1a6-951a-4942-a00a-9fe661e229ff`::moving from state preparing -> state finished >Thread-1042::DEBUG::2014-07-10 08:10:41,995::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-1042::DEBUG::2014-07-10 08:10:41,996::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1042::DEBUG::2014-07-10 08:10:41,996::task::990::TaskManager.Task::(_decref) Task=`8ec3f1a6-951a-4942-a00a-9fe661e229ff`::ref 0 aborting False >Dummy-36::DEBUG::2014-07-10 08:10:42,649::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-07-10 08:10:42,780::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0327091 s, 31.3 MB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-07-10 08:10:44,794::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-07-10 08:10:44,923::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0301193 s, 34.0 MB/s\n'; <rc> = 0 >Thread-1042::DEBUG::2014-07-10 08:10:46,887::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-1042::DEBUG::2014-07-10 08:10:46,888::task::595::TaskManager.Task::(_updateState) Task=`199b57cb-6470-4304-91a8-25083840e912`::moving from state init -> state preparing >Thread-1042::INFO::2014-07-10 08:10:46,889::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='411039e4-4af2-4192-9de0-67dc1ed83ba9', options=None) >Thread-1042::INFO::2014-07-10 08:10:46,889::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2}} >Thread-1042::DEBUG::2014-07-10 08:10:46,889::task::1185::TaskManager.Task::(prepare) Task=`199b57cb-6470-4304-91a8-25083840e912`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2}} >Thread-1042::DEBUG::2014-07-10 08:10:46,890::task::595::TaskManager.Task::(_updateState) Task=`199b57cb-6470-4304-91a8-25083840e912`::moving from state preparing -> state finished >Thread-1042::DEBUG::2014-07-10 08:10:46,890::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-1042::DEBUG::2014-07-10 08:10:46,890::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1042::DEBUG::2014-07-10 08:10:46,890::task::990::TaskManager.Task::(_decref) Task=`199b57cb-6470-4304-91a8-25083840e912`::ref 0 aborting False >Thread-1043::DEBUG::2014-07-10 08:10:46,894::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-1043::DEBUG::2014-07-10 08:10:46,895::task::595::TaskManager.Task::(_updateState) Task=`ac160bb3-fb4c-423d-9aa7-24a1de2a0273`::moving from state init -> state preparing >Thread-1043::INFO::2014-07-10 08:10:46,895::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='411039e4-4af2-4192-9de0-67dc1ed83ba9', options=None) >Thread-1043::DEBUG::2014-07-10 08:10:46,896::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9`ReqID=`c7eb7d80-74ef-49a4-8fd8-e69d17803ebb`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo' >Thread-1043::DEBUG::2014-07-10 08:10:46,896::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' for lock type 'shared' >Thread-1043::DEBUG::2014-07-10 08:10:46,896::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' is free. Now locking as 'shared' (1 active user) >Thread-1043::DEBUG::2014-07-10 08:10:46,896::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9`ReqID=`c7eb7d80-74ef-49a4-8fd8-e69d17803ebb`::Granted request >Thread-1043::DEBUG::2014-07-10 08:10:46,897::task::827::TaskManager.Task::(resourceAcquired) Task=`ac160bb3-fb4c-423d-9aa7-24a1de2a0273`::_resourcesAcquired: Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9 (shared) >Thread-1043::DEBUG::2014-07-10 08:10:46,897::task::990::TaskManager.Task::(_decref) Task=`ac160bb3-fb4c-423d-9aa7-24a1de2a0273`::ref 1 aborting False >Thread-1043::INFO::2014-07-10 08:10:46,898::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DC-REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2, 'domains': u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': 'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c': {'status': u'Active', 'diskfree': '1137495244800', 'isoprefix': '', 'alerts': [], 'disktotal': '1152393412608', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '533840527360', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-1043::DEBUG::2014-07-10 08:10:46,898::task::1185::TaskManager.Task::(prepare) Task=`ac160bb3-fb4c-423d-9aa7-24a1de2a0273`::finished: {'info': {'name': 'DC-REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2, 'domains': u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': 'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c': {'status': u'Active', 'diskfree': '1137495244800', 'isoprefix': '', 'alerts': [], 'disktotal': '1152393412608', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '533840527360', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-1043::DEBUG::2014-07-10 08:10:46,899::task::595::TaskManager.Task::(_updateState) Task=`ac160bb3-fb4c-423d-9aa7-24a1de2a0273`::moving from state preparing -> state finished >Thread-1043::DEBUG::2014-07-10 08:10:46,899::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9': < ResourceRef 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9', isValid: 'True' obj: 'None'>} >Thread-1043::DEBUG::2014-07-10 08:10:46,899::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1043::DEBUG::2014-07-10 08:10:46,899::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' >Thread-1043::DEBUG::2014-07-10 08:10:46,900::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' (0 active users) >Thread-1043::DEBUG::2014-07-10 08:10:46,900::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' is free, finding out if anyone is waiting for it. >Thread-1043::DEBUG::2014-07-10 08:10:46,900::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9', Clearing records. >Thread-1043::DEBUG::2014-07-10 08:10:46,900::task::990::TaskManager.Task::(_decref) Task=`ac160bb3-fb4c-423d-9aa7-24a1de2a0273`::ref 0 aborting False >Dummy-36::DEBUG::2014-07-10 08:10:46,938::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-07-10 08:10:47,067::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0325928 s, 31.4 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-07-10 08:10:48,442::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/e01a3a36-d2ce-4153-bb57-d6e65b7ed08c/metadata bs=4096 count=1' (cwd None) >Thread-15::DEBUG::2014-07-10 08:10:48,502::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00100144 s, 4.1 MB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-07-10 08:10:49,082::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-07-10 08:10:49,219::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0354419 s, 28.9 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 08:10:49,789::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lion.qa.lab.tlv.redhat.com:_export_yuri2_backup2/6a70504d-00df-4869-8695-0f442053f6b6/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-14::DEBUG::2014-07-10 08:10:49,847::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n369 bytes (369 B) copied, 0.000444732 s, 830 kB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-07-10 08:10:51,235::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-07-10 08:10:51,371::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.038324 s, 26.7 MB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-07-10 08:10:53,386::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-07-10 08:10:53,512::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0299384 s, 34.2 MB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-07-10 08:10:55,527::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-07-10 08:10:55,662::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0389617 s, 26.3 MB/s\n'; <rc> = 0 >Thread-1042::DEBUG::2014-07-10 08:10:56,930::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-1042::DEBUG::2014-07-10 08:10:56,931::task::595::TaskManager.Task::(_updateState) Task=`f604e56a-0cf8-46f7-bff5-246aca439afe`::moving from state init -> state preparing >Thread-1042::INFO::2014-07-10 08:10:56,932::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='411039e4-4af2-4192-9de0-67dc1ed83ba9', options=None) >Thread-1042::INFO::2014-07-10 08:10:56,932::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2}} >Thread-1042::DEBUG::2014-07-10 08:10:56,932::task::1185::TaskManager.Task::(prepare) Task=`f604e56a-0cf8-46f7-bff5-246aca439afe`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2}} >Thread-1042::DEBUG::2014-07-10 08:10:56,933::task::595::TaskManager.Task::(_updateState) Task=`f604e56a-0cf8-46f7-bff5-246aca439afe`::moving from state preparing -> state finished >Thread-1042::DEBUG::2014-07-10 08:10:56,933::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-1042::DEBUG::2014-07-10 08:10:56,933::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1042::DEBUG::2014-07-10 08:10:56,933::task::990::TaskManager.Task::(_decref) Task=`f604e56a-0cf8-46f7-bff5-246aca439afe`::ref 0 aborting False >Thread-1043::DEBUG::2014-07-10 08:10:56,937::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-1043::DEBUG::2014-07-10 08:10:56,938::task::595::TaskManager.Task::(_updateState) Task=`0a4c67f0-da73-483a-9a3b-371e935de5c2`::moving from state init -> state preparing >Thread-1043::INFO::2014-07-10 08:10:56,938::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='411039e4-4af2-4192-9de0-67dc1ed83ba9', options=None) >Thread-1043::DEBUG::2014-07-10 08:10:56,939::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9`ReqID=`638c5260-1be5-42f7-99f4-4c9479fcc5d7`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo' >Thread-1043::DEBUG::2014-07-10 08:10:56,939::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' for lock type 'shared' >Thread-1043::DEBUG::2014-07-10 08:10:56,939::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' is free. Now locking as 'shared' (1 active user) >Thread-1043::DEBUG::2014-07-10 08:10:56,939::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9`ReqID=`638c5260-1be5-42f7-99f4-4c9479fcc5d7`::Granted request >Thread-1043::DEBUG::2014-07-10 08:10:56,940::task::827::TaskManager.Task::(resourceAcquired) Task=`0a4c67f0-da73-483a-9a3b-371e935de5c2`::_resourcesAcquired: Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9 (shared) >Thread-1043::DEBUG::2014-07-10 08:10:56,940::task::990::TaskManager.Task::(_decref) Task=`0a4c67f0-da73-483a-9a3b-371e935de5c2`::ref 1 aborting False >Thread-1043::INFO::2014-07-10 08:10:56,941::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DC-REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2, 'domains': u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': 'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c': {'status': u'Active', 'diskfree': '1137495244800', 'isoprefix': '', 'alerts': [], 'disktotal': '1152393412608', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '533840527360', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-1043::DEBUG::2014-07-10 08:10:56,941::task::1185::TaskManager.Task::(prepare) Task=`0a4c67f0-da73-483a-9a3b-371e935de5c2`::finished: {'info': {'name': 'DC-REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2, 'domains': u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': 'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c': {'status': u'Active', 'diskfree': '1137495244800', 'isoprefix': '', 'alerts': [], 'disktotal': '1152393412608', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '533840527360', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-1043::DEBUG::2014-07-10 08:10:56,942::task::595::TaskManager.Task::(_updateState) Task=`0a4c67f0-da73-483a-9a3b-371e935de5c2`::moving from state preparing -> state finished >Thread-1043::DEBUG::2014-07-10 08:10:56,942::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9': < ResourceRef 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9', isValid: 'True' obj: 'None'>} >Thread-1043::DEBUG::2014-07-10 08:10:56,942::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1043::DEBUG::2014-07-10 08:10:56,942::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' >Thread-1043::DEBUG::2014-07-10 08:10:56,943::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' (0 active users) >Thread-1043::DEBUG::2014-07-10 08:10:56,943::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' is free, finding out if anyone is waiting for it. >Thread-1043::DEBUG::2014-07-10 08:10:56,943::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9', Clearing records. >Thread-1043::DEBUG::2014-07-10 08:10:56,943::task::990::TaskManager.Task::(_decref) Task=`0a4c67f0-da73-483a-9a3b-371e935de5c2`::ref 0 aborting False >Thread-1042::DEBUG::2014-07-10 08:10:57,131::task::595::TaskManager.Task::(_updateState) Task=`a5bef511-1cc4-47b5-bfda-3cfce26da711`::moving from state init -> state preparing >Thread-1042::INFO::2014-07-10 08:10:57,131::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-1042::INFO::2014-07-10 08:10:57,131::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00100144', 'lastCheck': '8.6', 'valid': True}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000444732', 'lastCheck': '7.3', 'valid': True}} >Thread-1042::DEBUG::2014-07-10 08:10:57,131::task::1185::TaskManager.Task::(prepare) Task=`a5bef511-1cc4-47b5-bfda-3cfce26da711`::finished: {u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00100144', 'lastCheck': '8.6', 'valid': True}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000444732', 'lastCheck': '7.3', 'valid': True}} >Thread-1042::DEBUG::2014-07-10 08:10:57,132::task::595::TaskManager.Task::(_updateState) Task=`a5bef511-1cc4-47b5-bfda-3cfce26da711`::moving from state preparing -> state finished >Thread-1042::DEBUG::2014-07-10 08:10:57,132::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-1042::DEBUG::2014-07-10 08:10:57,132::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1042::DEBUG::2014-07-10 08:10:57,132::task::990::TaskManager.Task::(_decref) Task=`a5bef511-1cc4-47b5-bfda-3cfce26da711`::ref 0 aborting False >Dummy-36::DEBUG::2014-07-10 08:10:57,677::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-07-10 08:10:57,819::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0417786 s, 24.5 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-07-10 08:10:58,532::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/e01a3a36-d2ce-4153-bb57-d6e65b7ed08c/metadata bs=4096 count=1' (cwd None) >Thread-15::DEBUG::2014-07-10 08:10:58,595::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000747431 s, 5.5 MB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-07-10 08:10:59,834::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Thread-14::DEBUG::2014-07-10 08:10:59,933::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lion.qa.lab.tlv.redhat.com:_export_yuri2_backup2/6a70504d-00df-4869-8695-0f442053f6b6/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-14::DEBUG::2014-07-10 08:11:00,006::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n369 bytes (369 B) copied, 0.000518931 s, 711 kB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-07-10 08:11:00,079::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.152287 s, 6.7 MB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-07-10 08:11:02,094::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-07-10 08:11:02,223::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0301208 s, 34.0 MB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-07-10 08:11:04,237::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-07-10 08:11:04,373::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0383416 s, 26.7 MB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-07-10 08:11:06,388::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-07-10 08:11:06,523::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0355182 s, 28.8 MB/s\n'; <rc> = 0 >Thread-1042::DEBUG::2014-07-10 08:11:06,995::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-1042::DEBUG::2014-07-10 08:11:06,996::task::595::TaskManager.Task::(_updateState) Task=`4608ed54-2f73-4d3a-ab98-3881be60d122`::moving from state init -> state preparing >Thread-1042::INFO::2014-07-10 08:11:06,996::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='411039e4-4af2-4192-9de0-67dc1ed83ba9', options=None) >Thread-1042::INFO::2014-07-10 08:11:06,997::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2}} >Thread-1042::DEBUG::2014-07-10 08:11:06,997::task::1185::TaskManager.Task::(prepare) Task=`4608ed54-2f73-4d3a-ab98-3881be60d122`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2}} >Thread-1042::DEBUG::2014-07-10 08:11:06,997::task::595::TaskManager.Task::(_updateState) Task=`4608ed54-2f73-4d3a-ab98-3881be60d122`::moving from state preparing -> state finished >Thread-1042::DEBUG::2014-07-10 08:11:06,997::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-1042::DEBUG::2014-07-10 08:11:06,998::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1042::DEBUG::2014-07-10 08:11:06,998::task::990::TaskManager.Task::(_decref) Task=`4608ed54-2f73-4d3a-ab98-3881be60d122`::ref 0 aborting False >Thread-1043::DEBUG::2014-07-10 08:11:07,002::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-1043::DEBUG::2014-07-10 08:11:07,002::task::595::TaskManager.Task::(_updateState) Task=`9955126d-52d7-4d4c-a5cb-8ace19e530f9`::moving from state init -> state preparing >Thread-1043::INFO::2014-07-10 08:11:07,002::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='411039e4-4af2-4192-9de0-67dc1ed83ba9', options=None) >Thread-1043::DEBUG::2014-07-10 08:11:07,003::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9`ReqID=`4cb94652-f22b-4992-9a08-64724db5c873`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo' >Thread-1043::DEBUG::2014-07-10 08:11:07,003::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' for lock type 'shared' >Thread-1043::DEBUG::2014-07-10 08:11:07,003::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' is free. Now locking as 'shared' (1 active user) >Thread-1043::DEBUG::2014-07-10 08:11:07,004::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9`ReqID=`4cb94652-f22b-4992-9a08-64724db5c873`::Granted request >Thread-1043::DEBUG::2014-07-10 08:11:07,004::task::827::TaskManager.Task::(resourceAcquired) Task=`9955126d-52d7-4d4c-a5cb-8ace19e530f9`::_resourcesAcquired: Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9 (shared) >Thread-1043::DEBUG::2014-07-10 08:11:07,004::task::990::TaskManager.Task::(_decref) Task=`9955126d-52d7-4d4c-a5cb-8ace19e530f9`::ref 1 aborting False >Thread-1043::INFO::2014-07-10 08:11:07,005::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DC-REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2, 'domains': u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': 'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c': {'status': u'Active', 'diskfree': '1137495244800', 'isoprefix': '', 'alerts': [], 'disktotal': '1152393412608', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '533840527360', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-1043::DEBUG::2014-07-10 08:11:07,006::task::1185::TaskManager.Task::(prepare) Task=`9955126d-52d7-4d4c-a5cb-8ace19e530f9`::finished: {'info': {'name': 'DC-REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2, 'domains': u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': 'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c': {'status': u'Active', 'diskfree': '1137495244800', 'isoprefix': '', 'alerts': [], 'disktotal': '1152393412608', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '533840527360', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-1043::DEBUG::2014-07-10 08:11:07,006::task::595::TaskManager.Task::(_updateState) Task=`9955126d-52d7-4d4c-a5cb-8ace19e530f9`::moving from state preparing -> state finished >Thread-1043::DEBUG::2014-07-10 08:11:07,006::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9': < ResourceRef 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9', isValid: 'True' obj: 'None'>} >Thread-1043::DEBUG::2014-07-10 08:11:07,006::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1043::DEBUG::2014-07-10 08:11:07,007::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' >Thread-1043::DEBUG::2014-07-10 08:11:07,007::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' (0 active users) >Thread-1043::DEBUG::2014-07-10 08:11:07,007::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' is free, finding out if anyone is waiting for it. >Thread-1043::DEBUG::2014-07-10 08:11:07,007::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9', Clearing records. >Thread-1043::DEBUG::2014-07-10 08:11:07,007::task::990::TaskManager.Task::(_decref) Task=`9955126d-52d7-4d4c-a5cb-8ace19e530f9`::ref 0 aborting False >Dummy-36::DEBUG::2014-07-10 08:11:08,539::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Thread-15::DEBUG::2014-07-10 08:11:08,625::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/e01a3a36-d2ce-4153-bb57-d6e65b7ed08c/metadata bs=4096 count=1' (cwd None) >Thread-15::DEBUG::2014-07-10 08:11:08,739::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000684364 s, 6.0 MB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-07-10 08:11:09,096::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.182615 s, 5.6 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 08:11:10,043::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lion.qa.lab.tlv.redhat.com:_export_yuri2_backup2/6a70504d-00df-4869-8695-0f442053f6b6/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-14::DEBUG::2014-07-10 08:11:10,100::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n369 bytes (369 B) copied, 0.000461135 s, 800 kB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-07-10 08:11:11,111::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-07-10 08:11:11,269::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0641404 s, 16.0 MB/s\n'; <rc> = 0 >Thread-1042::DEBUG::2014-07-10 08:11:12,266::task::595::TaskManager.Task::(_updateState) Task=`7d6c6e19-8bb5-4915-9752-c6ce8871a8f4`::moving from state init -> state preparing >Thread-1042::INFO::2014-07-10 08:11:12,267::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-1042::INFO::2014-07-10 08:11:12,267::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000684364', 'lastCheck': '3.2', 'valid': True}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000461135', 'lastCheck': '2.2', 'valid': True}} >Thread-1042::DEBUG::2014-07-10 08:11:12,267::task::1185::TaskManager.Task::(prepare) Task=`7d6c6e19-8bb5-4915-9752-c6ce8871a8f4`::finished: {u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000684364', 'lastCheck': '3.2', 'valid': True}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000461135', 'lastCheck': '2.2', 'valid': True}} >Thread-1042::DEBUG::2014-07-10 08:11:12,267::task::595::TaskManager.Task::(_updateState) Task=`7d6c6e19-8bb5-4915-9752-c6ce8871a8f4`::moving from state preparing -> state finished >Thread-1042::DEBUG::2014-07-10 08:11:12,268::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-1042::DEBUG::2014-07-10 08:11:12,268::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1042::DEBUG::2014-07-10 08:11:12,268::task::990::TaskManager.Task::(_decref) Task=`7d6c6e19-8bb5-4915-9752-c6ce8871a8f4`::ref 0 aborting False >Dummy-36::DEBUG::2014-07-10 08:11:13,284::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-07-10 08:11:13,422::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0390279 s, 26.2 MB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-07-10 08:11:15,437::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-07-10 08:11:15,566::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0309242 s, 33.1 MB/s\n'; <rc> = 0 >Thread-1042::DEBUG::2014-07-10 08:11:17,037::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-1042::DEBUG::2014-07-10 08:11:17,038::task::595::TaskManager.Task::(_updateState) Task=`622c1958-6e88-49ed-ab63-aec2f2dc4be9`::moving from state init -> state preparing >Thread-1042::INFO::2014-07-10 08:11:17,038::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='411039e4-4af2-4192-9de0-67dc1ed83ba9', options=None) >Thread-1042::INFO::2014-07-10 08:11:17,039::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2}} >Thread-1042::DEBUG::2014-07-10 08:11:17,039::task::1185::TaskManager.Task::(prepare) Task=`622c1958-6e88-49ed-ab63-aec2f2dc4be9`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2}} >Thread-1042::DEBUG::2014-07-10 08:11:17,039::task::595::TaskManager.Task::(_updateState) Task=`622c1958-6e88-49ed-ab63-aec2f2dc4be9`::moving from state preparing -> state finished >Thread-1042::DEBUG::2014-07-10 08:11:17,039::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-1042::DEBUG::2014-07-10 08:11:17,039::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1042::DEBUG::2014-07-10 08:11:17,040::task::990::TaskManager.Task::(_decref) Task=`622c1958-6e88-49ed-ab63-aec2f2dc4be9`::ref 0 aborting False >Thread-1043::DEBUG::2014-07-10 08:11:17,044::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-1043::DEBUG::2014-07-10 08:11:17,044::task::595::TaskManager.Task::(_updateState) Task=`e14e05a1-f6cf-4174-9cb6-2ed74d6ed3c2`::moving from state init -> state preparing >Thread-1043::INFO::2014-07-10 08:11:17,044::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='411039e4-4af2-4192-9de0-67dc1ed83ba9', options=None) >Thread-1043::DEBUG::2014-07-10 08:11:17,045::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9`ReqID=`4438cc79-0b17-43da-9d6a-3db73e89c7ed`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo' >Thread-1043::DEBUG::2014-07-10 08:11:17,045::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' for lock type 'shared' >Thread-1043::DEBUG::2014-07-10 08:11:17,045::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' is free. Now locking as 'shared' (1 active user) >Thread-1043::DEBUG::2014-07-10 08:11:17,045::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9`ReqID=`4438cc79-0b17-43da-9d6a-3db73e89c7ed`::Granted request >Thread-1043::DEBUG::2014-07-10 08:11:17,046::task::827::TaskManager.Task::(resourceAcquired) Task=`e14e05a1-f6cf-4174-9cb6-2ed74d6ed3c2`::_resourcesAcquired: Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9 (shared) >Thread-1043::DEBUG::2014-07-10 08:11:17,046::task::990::TaskManager.Task::(_decref) Task=`e14e05a1-f6cf-4174-9cb6-2ed74d6ed3c2`::ref 1 aborting False >Thread-1043::INFO::2014-07-10 08:11:17,047::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DC-REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2, 'domains': u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': 'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c': {'status': u'Active', 'diskfree': '1137495244800', 'isoprefix': '', 'alerts': [], 'disktotal': '1152393412608', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '533840527360', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-1043::DEBUG::2014-07-10 08:11:17,047::task::1185::TaskManager.Task::(prepare) Task=`e14e05a1-f6cf-4174-9cb6-2ed74d6ed3c2`::finished: {'info': {'name': 'DC-REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2, 'domains': u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': 'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c': {'status': u'Active', 'diskfree': '1137495244800', 'isoprefix': '', 'alerts': [], 'disktotal': '1152393412608', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '533840527360', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-1043::DEBUG::2014-07-10 08:11:17,047::task::595::TaskManager.Task::(_updateState) Task=`e14e05a1-f6cf-4174-9cb6-2ed74d6ed3c2`::moving from state preparing -> state finished >Thread-1043::DEBUG::2014-07-10 08:11:17,048::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9': < ResourceRef 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9', isValid: 'True' obj: 'None'>} >Thread-1043::DEBUG::2014-07-10 08:11:17,048::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1043::DEBUG::2014-07-10 08:11:17,048::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' >Thread-1043::DEBUG::2014-07-10 08:11:17,048::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' (0 active users) >Thread-1043::DEBUG::2014-07-10 08:11:17,048::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' is free, finding out if anyone is waiting for it. >Thread-1043::DEBUG::2014-07-10 08:11:17,049::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9', Clearing records. >Thread-1043::DEBUG::2014-07-10 08:11:17,049::task::990::TaskManager.Task::(_decref) Task=`e14e05a1-f6cf-4174-9cb6-2ed74d6ed3c2`::ref 0 aborting False >Dummy-36::DEBUG::2014-07-10 08:11:17,581::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-07-10 08:11:17,729::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0493825 s, 20.7 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-07-10 08:11:19,071::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/e01a3a36-d2ce-4153-bb57-d6e65b7ed08c/metadata bs=4096 count=1' (cwd None) >Thread-15::DEBUG::2014-07-10 08:11:19,135::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00582672 s, 703 kB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-07-10 08:11:19,744::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-07-10 08:11:19,893::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0471268 s, 21.7 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 08:11:20,125::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lion.qa.lab.tlv.redhat.com:_export_yuri2_backup2/6a70504d-00df-4869-8695-0f442053f6b6/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-14::DEBUG::2014-07-10 08:11:20,184::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n369 bytes (369 B) copied, 0.0004655 s, 793 kB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-07-10 08:11:21,909::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-07-10 08:11:22,064::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.055935 s, 18.3 MB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-07-10 08:11:24,079::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-07-10 08:11:24,234::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0556726 s, 18.4 MB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-07-10 08:11:26,248::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-07-10 08:11:26,394::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.048832 s, 21.0 MB/s\n'; <rc> = 0 >Thread-1042::DEBUG::2014-07-10 08:11:27,070::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-1042::DEBUG::2014-07-10 08:11:27,072::task::595::TaskManager.Task::(_updateState) Task=`c9cff1ba-2329-4b17-ba05-735e1d90eaa4`::moving from state init -> state preparing >Thread-1042::INFO::2014-07-10 08:11:27,072::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='411039e4-4af2-4192-9de0-67dc1ed83ba9', options=None) >Thread-1042::INFO::2014-07-10 08:11:27,073::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2}} >Thread-1042::DEBUG::2014-07-10 08:11:27,073::task::1185::TaskManager.Task::(prepare) Task=`c9cff1ba-2329-4b17-ba05-735e1d90eaa4`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2}} >Thread-1042::DEBUG::2014-07-10 08:11:27,073::task::595::TaskManager.Task::(_updateState) Task=`c9cff1ba-2329-4b17-ba05-735e1d90eaa4`::moving from state preparing -> state finished >Thread-1042::DEBUG::2014-07-10 08:11:27,073::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-1042::DEBUG::2014-07-10 08:11:27,073::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1042::DEBUG::2014-07-10 08:11:27,074::task::990::TaskManager.Task::(_decref) Task=`c9cff1ba-2329-4b17-ba05-735e1d90eaa4`::ref 0 aborting False >Thread-1043::DEBUG::2014-07-10 08:11:27,078::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-1043::DEBUG::2014-07-10 08:11:27,078::task::595::TaskManager.Task::(_updateState) Task=`1914ce70-24b9-4a69-b13d-8e437c769090`::moving from state init -> state preparing >Thread-1043::INFO::2014-07-10 08:11:27,078::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='411039e4-4af2-4192-9de0-67dc1ed83ba9', options=None) >Thread-1043::DEBUG::2014-07-10 08:11:27,079::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9`ReqID=`4fee25fb-dca8-4898-ac8f-afb79dcef2a9`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo' >Thread-1043::DEBUG::2014-07-10 08:11:27,079::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' for lock type 'shared' >Thread-1043::DEBUG::2014-07-10 08:11:27,080::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' is free. Now locking as 'shared' (1 active user) >Thread-1043::DEBUG::2014-07-10 08:11:27,080::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9`ReqID=`4fee25fb-dca8-4898-ac8f-afb79dcef2a9`::Granted request >Thread-1043::DEBUG::2014-07-10 08:11:27,081::task::827::TaskManager.Task::(resourceAcquired) Task=`1914ce70-24b9-4a69-b13d-8e437c769090`::_resourcesAcquired: Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9 (shared) >Thread-1043::DEBUG::2014-07-10 08:11:27,081::task::990::TaskManager.Task::(_decref) Task=`1914ce70-24b9-4a69-b13d-8e437c769090`::ref 1 aborting False >Thread-1043::INFO::2014-07-10 08:11:27,082::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DC-REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2, 'domains': u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': 'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c': {'status': u'Active', 'diskfree': '1137495244800', 'isoprefix': '', 'alerts': [], 'disktotal': '1152393412608', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '533838430208', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-1043::DEBUG::2014-07-10 08:11:27,082::task::1185::TaskManager.Task::(prepare) Task=`1914ce70-24b9-4a69-b13d-8e437c769090`::finished: {'info': {'name': 'DC-REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2, 'domains': u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': 'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c': {'status': u'Active', 'diskfree': '1137495244800', 'isoprefix': '', 'alerts': [], 'disktotal': '1152393412608', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '533838430208', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-1043::DEBUG::2014-07-10 08:11:27,082::task::595::TaskManager.Task::(_updateState) Task=`1914ce70-24b9-4a69-b13d-8e437c769090`::moving from state preparing -> state finished >Thread-1043::DEBUG::2014-07-10 08:11:27,083::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9': < ResourceRef 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9', isValid: 'True' obj: 'None'>} >Thread-1043::DEBUG::2014-07-10 08:11:27,083::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1043::DEBUG::2014-07-10 08:11:27,083::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' >Thread-1043::DEBUG::2014-07-10 08:11:27,083::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' (0 active users) >Thread-1043::DEBUG::2014-07-10 08:11:27,083::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' is free, finding out if anyone is waiting for it. >Thread-1043::DEBUG::2014-07-10 08:11:27,084::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9', Clearing records. >Thread-1043::DEBUG::2014-07-10 08:11:27,084::task::990::TaskManager.Task::(_decref) Task=`1914ce70-24b9-4a69-b13d-8e437c769090`::ref 0 aborting False >Thread-1042::DEBUG::2014-07-10 08:11:27,420::task::595::TaskManager.Task::(_updateState) Task=`815dd489-002f-402d-bc5e-fa83675cb1f0`::moving from state init -> state preparing >Thread-1042::INFO::2014-07-10 08:11:27,420::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-1042::INFO::2014-07-10 08:11:27,420::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00582672', 'lastCheck': '8.3', 'valid': True}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.0004655', 'lastCheck': '7.2', 'valid': True}} >Thread-1042::DEBUG::2014-07-10 08:11:27,421::task::1185::TaskManager.Task::(prepare) Task=`815dd489-002f-402d-bc5e-fa83675cb1f0`::finished: {u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00582672', 'lastCheck': '8.3', 'valid': True}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.0004655', 'lastCheck': '7.2', 'valid': True}} >Thread-1042::DEBUG::2014-07-10 08:11:27,421::task::595::TaskManager.Task::(_updateState) Task=`815dd489-002f-402d-bc5e-fa83675cb1f0`::moving from state preparing -> state finished >Thread-1042::DEBUG::2014-07-10 08:11:27,421::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-1042::DEBUG::2014-07-10 08:11:27,421::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1042::DEBUG::2014-07-10 08:11:27,421::task::990::TaskManager.Task::(_decref) Task=`815dd489-002f-402d-bc5e-fa83675cb1f0`::ref 0 aborting False >Dummy-36::DEBUG::2014-07-10 08:11:28,409::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-07-10 08:11:28,545::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0352043 s, 29.1 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-07-10 08:11:29,165::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/e01a3a36-d2ce-4153-bb57-d6e65b7ed08c/metadata bs=4096 count=1' (cwd None) >Thread-15::DEBUG::2014-07-10 08:11:29,234::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00502537 s, 815 kB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 08:11:30,213::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lion.qa.lab.tlv.redhat.com:_export_yuri2_backup2/6a70504d-00df-4869-8695-0f442053f6b6/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-14::DEBUG::2014-07-10 08:11:30,271::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n369 bytes (369 B) copied, 0.000448715 s, 822 kB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-07-10 08:11:30,560::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-07-10 08:11:30,699::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.037982 s, 27.0 MB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-07-10 08:11:32,714::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-07-10 08:11:32,843::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.029297 s, 35.0 MB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-07-10 08:11:34,858::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-07-10 08:11:34,995::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0380056 s, 26.9 MB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-07-10 08:11:37,010::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Thread-1042::DEBUG::2014-07-10 08:11:37,139::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-1042::DEBUG::2014-07-10 08:11:37,142::task::595::TaskManager.Task::(_updateState) Task=`755868a6-c500-4c12-9926-573cf23bc40f`::moving from state init -> state preparing >Thread-1042::INFO::2014-07-10 08:11:37,143::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='411039e4-4af2-4192-9de0-67dc1ed83ba9', options=None) >Thread-1042::INFO::2014-07-10 08:11:37,145::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2}} >Thread-1042::DEBUG::2014-07-10 08:11:37,146::task::1185::TaskManager.Task::(prepare) Task=`755868a6-c500-4c12-9926-573cf23bc40f`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2}} >Thread-1042::DEBUG::2014-07-10 08:11:37,147::task::595::TaskManager.Task::(_updateState) Task=`755868a6-c500-4c12-9926-573cf23bc40f`::moving from state preparing -> state finished >Thread-1042::DEBUG::2014-07-10 08:11:37,148::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-1042::DEBUG::2014-07-10 08:11:37,149::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1042::DEBUG::2014-07-10 08:11:37,151::task::990::TaskManager.Task::(_decref) Task=`755868a6-c500-4c12-9926-573cf23bc40f`::ref 0 aborting False >Thread-1043::DEBUG::2014-07-10 08:11:37,158::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-1043::DEBUG::2014-07-10 08:11:37,160::task::595::TaskManager.Task::(_updateState) Task=`048cec40-c49d-4f6c-bc51-d5fc022c3479`::moving from state init -> state preparing >Thread-1043::INFO::2014-07-10 08:11:37,161::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='411039e4-4af2-4192-9de0-67dc1ed83ba9', options=None) >Thread-1043::DEBUG::2014-07-10 08:11:37,164::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9`ReqID=`7c974d74-87e8-42c7-91c3-7069adc3304f`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo' >Thread-1043::DEBUG::2014-07-10 08:11:37,165::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' for lock type 'shared' >Thread-1043::DEBUG::2014-07-10 08:11:37,167::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' is free. Now locking as 'shared' (1 active user) >Thread-1043::DEBUG::2014-07-10 08:11:37,168::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9`ReqID=`7c974d74-87e8-42c7-91c3-7069adc3304f`::Granted request >Thread-1043::DEBUG::2014-07-10 08:11:37,171::task::827::TaskManager.Task::(resourceAcquired) Task=`048cec40-c49d-4f6c-bc51-d5fc022c3479`::_resourcesAcquired: Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9 (shared) >Thread-1043::DEBUG::2014-07-10 08:11:37,172::task::990::TaskManager.Task::(_decref) Task=`048cec40-c49d-4f6c-bc51-d5fc022c3479`::ref 1 aborting False >Thread-1043::INFO::2014-07-10 08:11:37,177::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DC-REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2, 'domains': u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': 'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c': {'status': u'Active', 'diskfree': '1137495244800', 'isoprefix': '', 'alerts': [], 'disktotal': '1152393412608', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '533670658048', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-1043::DEBUG::2014-07-10 08:11:37,178::task::1185::TaskManager.Task::(prepare) Task=`048cec40-c49d-4f6c-bc51-d5fc022c3479`::finished: {'info': {'name': 'DC-REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2, 'domains': u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': 'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c': {'status': u'Active', 'diskfree': '1137495244800', 'isoprefix': '', 'alerts': [], 'disktotal': '1152393412608', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '533670658048', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-1043::DEBUG::2014-07-10 08:11:37,180::task::595::TaskManager.Task::(_updateState) Task=`048cec40-c49d-4f6c-bc51-d5fc022c3479`::moving from state preparing -> state finished >Thread-1043::DEBUG::2014-07-10 08:11:37,181::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9': < ResourceRef 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9', isValid: 'True' obj: 'None'>} >Thread-1043::DEBUG::2014-07-10 08:11:37,182::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1043::DEBUG::2014-07-10 08:11:37,184::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' >Thread-1043::DEBUG::2014-07-10 08:11:37,185::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' (0 active users) >Thread-1043::DEBUG::2014-07-10 08:11:37,186::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' is free, finding out if anyone is waiting for it. >Thread-1043::DEBUG::2014-07-10 08:11:37,187::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9', Clearing records. >Thread-1043::DEBUG::2014-07-10 08:11:37,189::task::990::TaskManager.Task::(_decref) Task=`048cec40-c49d-4f6c-bc51-d5fc022c3479`::ref 0 aborting False >Dummy-36::DEBUG::2014-07-10 08:11:37,200::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0390291 s, 26.2 MB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-07-10 08:11:39,215::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Thread-15::DEBUG::2014-07-10 08:11:39,273::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/e01a3a36-d2ce-4153-bb57-d6e65b7ed08c/metadata bs=4096 count=1' (cwd None) >Thread-15::DEBUG::2014-07-10 08:11:39,380::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000823675 s, 5.0 MB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-07-10 08:11:39,757::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.443168 s, 2.3 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 08:11:40,300::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lion.qa.lab.tlv.redhat.com:_export_yuri2_backup2/6a70504d-00df-4869-8695-0f442053f6b6/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-14::DEBUG::2014-07-10 08:11:40,359::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n369 bytes (369 B) copied, 0.000529484 s, 697 kB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-07-10 08:11:41,772::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-07-10 08:11:41,898::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0316746 s, 32.3 MB/s\n'; <rc> = 0 >Thread-1042::DEBUG::2014-07-10 08:11:42,571::task::595::TaskManager.Task::(_updateState) Task=`83d03767-a9e4-4197-b2c1-f790e92b8eaa`::moving from state init -> state preparing >Thread-1042::INFO::2014-07-10 08:11:42,572::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-1042::INFO::2014-07-10 08:11:42,572::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000823675', 'lastCheck': '2.9', 'valid': True}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000529484', 'lastCheck': '2.2', 'valid': True}} >Thread-1042::DEBUG::2014-07-10 08:11:42,573::task::1185::TaskManager.Task::(prepare) Task=`83d03767-a9e4-4197-b2c1-f790e92b8eaa`::finished: {u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000823675', 'lastCheck': '2.9', 'valid': True}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000529484', 'lastCheck': '2.2', 'valid': True}} >Thread-1042::DEBUG::2014-07-10 08:11:42,573::task::595::TaskManager.Task::(_updateState) Task=`83d03767-a9e4-4197-b2c1-f790e92b8eaa`::moving from state preparing -> state finished >Thread-1042::DEBUG::2014-07-10 08:11:42,573::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-1042::DEBUG::2014-07-10 08:11:42,573::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1042::DEBUG::2014-07-10 08:11:42,574::task::990::TaskManager.Task::(_decref) Task=`83d03767-a9e4-4197-b2c1-f790e92b8eaa`::ref 0 aborting False >Dummy-36::DEBUG::2014-07-10 08:11:43,912::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-07-10 08:11:44,047::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0327117 s, 31.3 MB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-07-10 08:11:46,062::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-07-10 08:11:46,199::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.03831 s, 26.7 MB/s\n'; <rc> = 0 >Thread-1042::DEBUG::2014-07-10 08:11:47,225::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-1042::DEBUG::2014-07-10 08:11:47,226::task::595::TaskManager.Task::(_updateState) Task=`27369276-86db-43cb-b07c-a62636580b38`::moving from state init -> state preparing >Thread-1042::INFO::2014-07-10 08:11:47,227::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='411039e4-4af2-4192-9de0-67dc1ed83ba9', options=None) >Thread-1042::INFO::2014-07-10 08:11:47,227::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2}} >Thread-1042::DEBUG::2014-07-10 08:11:47,228::task::1185::TaskManager.Task::(prepare) Task=`27369276-86db-43cb-b07c-a62636580b38`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2}} >Thread-1042::DEBUG::2014-07-10 08:11:47,228::task::595::TaskManager.Task::(_updateState) Task=`27369276-86db-43cb-b07c-a62636580b38`::moving from state preparing -> state finished >Thread-1042::DEBUG::2014-07-10 08:11:47,228::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-1042::DEBUG::2014-07-10 08:11:47,228::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1042::DEBUG::2014-07-10 08:11:47,228::task::990::TaskManager.Task::(_decref) Task=`27369276-86db-43cb-b07c-a62636580b38`::ref 0 aborting False >Thread-1043::DEBUG::2014-07-10 08:11:47,234::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-1043::DEBUG::2014-07-10 08:11:47,234::task::595::TaskManager.Task::(_updateState) Task=`b188db64-9643-456a-9896-24b64d1d679e`::moving from state init -> state preparing >Thread-1043::INFO::2014-07-10 08:11:47,234::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='411039e4-4af2-4192-9de0-67dc1ed83ba9', options=None) >Thread-1043::DEBUG::2014-07-10 08:11:47,235::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9`ReqID=`a9ef47dd-4e9c-4742-9053-c042e028957d`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo' >Thread-1043::DEBUG::2014-07-10 08:11:47,235::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' for lock type 'shared' >Thread-1043::DEBUG::2014-07-10 08:11:47,236::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' is free. Now locking as 'shared' (1 active user) >Thread-1043::DEBUG::2014-07-10 08:11:47,236::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9`ReqID=`a9ef47dd-4e9c-4742-9053-c042e028957d`::Granted request >Thread-1043::DEBUG::2014-07-10 08:11:47,237::task::827::TaskManager.Task::(resourceAcquired) Task=`b188db64-9643-456a-9896-24b64d1d679e`::_resourcesAcquired: Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9 (shared) >Thread-1043::DEBUG::2014-07-10 08:11:47,237::task::990::TaskManager.Task::(_decref) Task=`b188db64-9643-456a-9896-24b64d1d679e`::ref 1 aborting False >Thread-1043::INFO::2014-07-10 08:11:47,238::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DC-REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2, 'domains': u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': 'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c': {'status': u'Active', 'diskfree': '1137495244800', 'isoprefix': '', 'alerts': [], 'disktotal': '1152393412608', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '533670658048', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-1043::DEBUG::2014-07-10 08:11:47,238::task::1185::TaskManager.Task::(prepare) Task=`b188db64-9643-456a-9896-24b64d1d679e`::finished: {'info': {'name': 'DC-REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2, 'domains': u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': 'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c': {'status': u'Active', 'diskfree': '1137495244800', 'isoprefix': '', 'alerts': [], 'disktotal': '1152393412608', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '533670658048', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-1043::DEBUG::2014-07-10 08:11:47,238::task::595::TaskManager.Task::(_updateState) Task=`b188db64-9643-456a-9896-24b64d1d679e`::moving from state preparing -> state finished >Thread-1043::DEBUG::2014-07-10 08:11:47,239::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9': < ResourceRef 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9', isValid: 'True' obj: 'None'>} >Thread-1043::DEBUG::2014-07-10 08:11:47,239::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1043::DEBUG::2014-07-10 08:11:47,239::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' >Thread-1043::DEBUG::2014-07-10 08:11:47,239::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' (0 active users) >Thread-1043::DEBUG::2014-07-10 08:11:47,239::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' is free, finding out if anyone is waiting for it. >Thread-1043::DEBUG::2014-07-10 08:11:47,240::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9', Clearing records. >Thread-1043::DEBUG::2014-07-10 08:11:47,240::task::990::TaskManager.Task::(_decref) Task=`b188db64-9643-456a-9896-24b64d1d679e`::ref 0 aborting False >Dummy-36::DEBUG::2014-07-10 08:11:48,214::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-07-10 08:11:48,352::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0382089 s, 26.8 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-07-10 08:11:49,704::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/e01a3a36-d2ce-4153-bb57-d6e65b7ed08c/metadata bs=4096 count=1' (cwd None) >Thread-15::DEBUG::2014-07-10 08:11:49,770::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00343412 s, 1.2 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 08:11:50,363::domainMonitor::192::Storage.DomainMonitorThread::(_monitorDomain) Refreshing domain 6a70504d-00df-4869-8695-0f442053f6b6 >Dummy-36::DEBUG::2014-07-10 08:11:50,367::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Thread-14::DEBUG::2014-07-10 08:11:50,475::fileSD::150::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/lion.qa.lab.tlv.redhat.com:_export_yuri2_backup2/6a70504d-00df-4869-8695-0f442053f6b6 >Thread-14::DEBUG::2014-07-10 08:11:50,478::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend >Thread-14::DEBUG::2014-07-10 08:11:50,482::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Backup', 'DESCRIPTION=test', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=0', 'POOL_UUID=411039e4-4af2-4192-9de0-67dc1ed83ba9', 'REMOTE_PATH=lion.qa.lab.tlv.redhat.com:/export/yuri2/backup2', 'ROLE=Regular', 'SDUUID=6a70504d-00df-4869-8695-0f442053f6b6', 'TYPE=NFS', 'VERSION=0', '_SHA_CKSUM=c52897a45cbc3ed0a0146ef350774e5cecebe6cf'] >Thread-14::DEBUG::2014-07-10 08:11:50,484::fileSD::609::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images [] >Thread-14::INFO::2014-07-10 08:11:50,485::sd::384::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 6a70504d-00df-4869-8695-0f442053f6b6_imageNS already registered >Thread-14::INFO::2014-07-10 08:11:50,486::sd::392::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 6a70504d-00df-4869-8695-0f442053f6b6_volumeNS already registered >Thread-14::DEBUG::2014-07-10 08:11:50,536::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lion.qa.lab.tlv.redhat.com:_export_yuri2_backup2/6a70504d-00df-4869-8695-0f442053f6b6/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-14::DEBUG::2014-07-10 08:11:50,621::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n369 bytes (369 B) copied, 0.000543017 s, 680 kB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-07-10 08:11:50,687::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.214754 s, 4.8 MB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-07-10 08:11:52,702::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-07-10 08:11:52,839::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0387879 s, 26.4 MB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-07-10 08:11:54,854::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-07-10 08:11:54,986::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0330085 s, 31.0 MB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-07-10 08:11:57,001::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-07-10 08:11:57,128::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0293554 s, 34.9 MB/s\n'; <rc> = 0 >Thread-1042::DEBUG::2014-07-10 08:11:57,278::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-1042::DEBUG::2014-07-10 08:11:57,279::task::595::TaskManager.Task::(_updateState) Task=`12b03242-13d3-44b0-825a-d5d70886b2fc`::moving from state init -> state preparing >Thread-1042::INFO::2014-07-10 08:11:57,279::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='411039e4-4af2-4192-9de0-67dc1ed83ba9', options=None) >Thread-1042::INFO::2014-07-10 08:11:57,280::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2}} >Thread-1042::DEBUG::2014-07-10 08:11:57,280::task::1185::TaskManager.Task::(prepare) Task=`12b03242-13d3-44b0-825a-d5d70886b2fc`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2}} >Thread-1042::DEBUG::2014-07-10 08:11:57,280::task::595::TaskManager.Task::(_updateState) Task=`12b03242-13d3-44b0-825a-d5d70886b2fc`::moving from state preparing -> state finished >Thread-1042::DEBUG::2014-07-10 08:11:57,280::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-1042::DEBUG::2014-07-10 08:11:57,281::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1042::DEBUG::2014-07-10 08:11:57,281::task::990::TaskManager.Task::(_decref) Task=`12b03242-13d3-44b0-825a-d5d70886b2fc`::ref 0 aborting False >Thread-1043::DEBUG::2014-07-10 08:11:57,285::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-1043::DEBUG::2014-07-10 08:11:57,285::task::595::TaskManager.Task::(_updateState) Task=`93c991c3-b0b0-42b1-b5bf-29da7d9962b3`::moving from state init -> state preparing >Thread-1043::INFO::2014-07-10 08:11:57,286::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='411039e4-4af2-4192-9de0-67dc1ed83ba9', options=None) >Thread-1043::DEBUG::2014-07-10 08:11:57,286::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9`ReqID=`136166a9-de82-402b-b1d0-54f388c1a824`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo' >Thread-1043::DEBUG::2014-07-10 08:11:57,286::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' for lock type 'shared' >Thread-1043::DEBUG::2014-07-10 08:11:57,287::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' is free. Now locking as 'shared' (1 active user) >Thread-1043::DEBUG::2014-07-10 08:11:57,287::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9`ReqID=`136166a9-de82-402b-b1d0-54f388c1a824`::Granted request >Thread-1043::DEBUG::2014-07-10 08:11:57,288::task::827::TaskManager.Task::(resourceAcquired) Task=`93c991c3-b0b0-42b1-b5bf-29da7d9962b3`::_resourcesAcquired: Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9 (shared) >Thread-1043::DEBUG::2014-07-10 08:11:57,288::task::990::TaskManager.Task::(_decref) Task=`93c991c3-b0b0-42b1-b5bf-29da7d9962b3`::ref 1 aborting False >Thread-1043::INFO::2014-07-10 08:11:57,289::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DC-REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2, 'domains': u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': 'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c': {'status': u'Active', 'diskfree': '1137495244800', 'isoprefix': '', 'alerts': [], 'disktotal': '1152393412608', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '533343502336', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-1043::DEBUG::2014-07-10 08:11:57,289::task::1185::TaskManager.Task::(prepare) Task=`93c991c3-b0b0-42b1-b5bf-29da7d9962b3`::finished: {'info': {'name': 'DC-REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2, 'domains': u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': 'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c': {'status': u'Active', 'diskfree': '1137495244800', 'isoprefix': '', 'alerts': [], 'disktotal': '1152393412608', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '533343502336', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-1043::DEBUG::2014-07-10 08:11:57,289::task::595::TaskManager.Task::(_updateState) Task=`93c991c3-b0b0-42b1-b5bf-29da7d9962b3`::moving from state preparing -> state finished >Thread-1043::DEBUG::2014-07-10 08:11:57,289::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9': < ResourceRef 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9', isValid: 'True' obj: 'None'>} >Thread-1043::DEBUG::2014-07-10 08:11:57,290::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1043::DEBUG::2014-07-10 08:11:57,290::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' >Thread-1043::DEBUG::2014-07-10 08:11:57,290::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' (0 active users) >Thread-1043::DEBUG::2014-07-10 08:11:57,290::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' is free, finding out if anyone is waiting for it. >Thread-1043::DEBUG::2014-07-10 08:11:57,291::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9', Clearing records. >Thread-1043::DEBUG::2014-07-10 08:11:57,291::task::990::TaskManager.Task::(_decref) Task=`93c991c3-b0b0-42b1-b5bf-29da7d9962b3`::ref 0 aborting False >Thread-1042::DEBUG::2014-07-10 08:11:57,713::task::595::TaskManager.Task::(_updateState) Task=`8a3666df-5ff2-42ad-90e0-bc826251bbd5`::moving from state init -> state preparing >Thread-1042::INFO::2014-07-10 08:11:57,714::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-1042::INFO::2014-07-10 08:11:57,714::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00343412', 'lastCheck': '7.9', 'valid': True}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000543017', 'lastCheck': '7.1', 'valid': True}} >Thread-1042::DEBUG::2014-07-10 08:11:57,714::task::1185::TaskManager.Task::(prepare) Task=`8a3666df-5ff2-42ad-90e0-bc826251bbd5`::finished: {u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00343412', 'lastCheck': '7.9', 'valid': True}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000543017', 'lastCheck': '7.1', 'valid': True}} >Thread-1042::DEBUG::2014-07-10 08:11:57,714::task::595::TaskManager.Task::(_updateState) Task=`8a3666df-5ff2-42ad-90e0-bc826251bbd5`::moving from state preparing -> state finished >Thread-1042::DEBUG::2014-07-10 08:11:57,715::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-1042::DEBUG::2014-07-10 08:11:57,715::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1042::DEBUG::2014-07-10 08:11:57,715::task::990::TaskManager.Task::(_decref) Task=`8a3666df-5ff2-42ad-90e0-bc826251bbd5`::ref 0 aborting False >Dummy-36::DEBUG::2014-07-10 08:11:59,143::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-07-10 08:11:59,273::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0324112 s, 31.6 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-07-10 08:11:59,799::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/e01a3a36-d2ce-4153-bb57-d6e65b7ed08c/metadata bs=4096 count=1' (cwd None) >Thread-15::DEBUG::2014-07-10 08:11:59,872::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000814117 s, 5.0 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 08:12:00,660::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lion.qa.lab.tlv.redhat.com:_export_yuri2_backup2/6a70504d-00df-4869-8695-0f442053f6b6/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-14::DEBUG::2014-07-10 08:12:00,717::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n369 bytes (369 B) copied, 0.000421878 s, 875 kB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-07-10 08:12:01,288::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-07-10 08:12:01,421::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0356274 s, 28.7 MB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-07-10 08:12:03,436::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-07-10 08:12:03,575::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0381881 s, 26.8 MB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-07-10 08:12:05,590::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-07-10 08:12:05,718::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0299471 s, 34.2 MB/s\n'; <rc> = 0 >Thread-1042::DEBUG::2014-07-10 08:12:07,327::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-1042::DEBUG::2014-07-10 08:12:07,328::task::595::TaskManager.Task::(_updateState) Task=`e6eeb41e-557f-4569-a1ea-9691d23bc7b6`::moving from state init -> state preparing >Thread-1042::INFO::2014-07-10 08:12:07,328::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='411039e4-4af2-4192-9de0-67dc1ed83ba9', options=None) >Thread-1042::INFO::2014-07-10 08:12:07,329::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2}} >Thread-1042::DEBUG::2014-07-10 08:12:07,329::task::1185::TaskManager.Task::(prepare) Task=`e6eeb41e-557f-4569-a1ea-9691d23bc7b6`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2}} >Thread-1042::DEBUG::2014-07-10 08:12:07,329::task::595::TaskManager.Task::(_updateState) Task=`e6eeb41e-557f-4569-a1ea-9691d23bc7b6`::moving from state preparing -> state finished >Thread-1042::DEBUG::2014-07-10 08:12:07,329::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-1042::DEBUG::2014-07-10 08:12:07,329::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1042::DEBUG::2014-07-10 08:12:07,330::task::990::TaskManager.Task::(_decref) Task=`e6eeb41e-557f-4569-a1ea-9691d23bc7b6`::ref 0 aborting False >Thread-1043::DEBUG::2014-07-10 08:12:07,333::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-1043::DEBUG::2014-07-10 08:12:07,334::task::595::TaskManager.Task::(_updateState) Task=`8f9d111b-03fa-4df4-84ab-9bff35e7e3c3`::moving from state init -> state preparing >Thread-1043::INFO::2014-07-10 08:12:07,334::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='411039e4-4af2-4192-9de0-67dc1ed83ba9', options=None) >Thread-1043::DEBUG::2014-07-10 08:12:07,334::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9`ReqID=`c238c604-0820-410e-a5b9-1f23a8f805d6`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo' >Thread-1043::DEBUG::2014-07-10 08:12:07,335::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' for lock type 'shared' >Thread-1043::DEBUG::2014-07-10 08:12:07,335::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' is free. Now locking as 'shared' (1 active user) >Thread-1043::DEBUG::2014-07-10 08:12:07,335::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9`ReqID=`c238c604-0820-410e-a5b9-1f23a8f805d6`::Granted request >Thread-1043::DEBUG::2014-07-10 08:12:07,336::task::827::TaskManager.Task::(resourceAcquired) Task=`8f9d111b-03fa-4df4-84ab-9bff35e7e3c3`::_resourcesAcquired: Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9 (shared) >Thread-1043::DEBUG::2014-07-10 08:12:07,336::task::990::TaskManager.Task::(_decref) Task=`8f9d111b-03fa-4df4-84ab-9bff35e7e3c3`::ref 1 aborting False >Thread-1043::INFO::2014-07-10 08:12:07,337::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DC-REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2, 'domains': u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': 'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c': {'status': u'Active', 'diskfree': '1137495244800', 'isoprefix': '', 'alerts': [], 'disktotal': '1152393412608', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '533207187456', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-1043::DEBUG::2014-07-10 08:12:07,337::task::1185::TaskManager.Task::(prepare) Task=`8f9d111b-03fa-4df4-84ab-9bff35e7e3c3`::finished: {'info': {'name': 'DC-REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2, 'domains': u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': 'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c': {'status': u'Active', 'diskfree': '1137495244800', 'isoprefix': '', 'alerts': [], 'disktotal': '1152393412608', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '533207187456', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-1043::DEBUG::2014-07-10 08:12:07,337::task::595::TaskManager.Task::(_updateState) Task=`8f9d111b-03fa-4df4-84ab-9bff35e7e3c3`::moving from state preparing -> state finished >Thread-1043::DEBUG::2014-07-10 08:12:07,338::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9': < ResourceRef 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9', isValid: 'True' obj: 'None'>} >Thread-1043::DEBUG::2014-07-10 08:12:07,338::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1043::DEBUG::2014-07-10 08:12:07,338::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' >Thread-1043::DEBUG::2014-07-10 08:12:07,338::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' (0 active users) >Thread-1043::DEBUG::2014-07-10 08:12:07,339::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' is free, finding out if anyone is waiting for it. >Thread-1043::DEBUG::2014-07-10 08:12:07,339::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9', Clearing records. >Thread-1043::DEBUG::2014-07-10 08:12:07,339::task::990::TaskManager.Task::(_decref) Task=`8f9d111b-03fa-4df4-84ab-9bff35e7e3c3`::ref 0 aborting False >Dummy-36::DEBUG::2014-07-10 08:12:07,733::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-07-10 08:12:07,873::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0394402 s, 26.0 MB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-07-10 08:12:09,888::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Thread-15::DEBUG::2014-07-10 08:12:09,945::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/e01a3a36-d2ce-4153-bb57-d6e65b7ed08c/metadata bs=4096 count=1' (cwd None) >Thread-15::DEBUG::2014-07-10 08:12:10,038::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000687786 s, 6.0 MB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-07-10 08:12:10,259::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.273107 s, 3.7 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 08:12:10,746::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lion.qa.lab.tlv.redhat.com:_export_yuri2_backup2/6a70504d-00df-4869-8695-0f442053f6b6/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-14::DEBUG::2014-07-10 08:12:10,806::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n369 bytes (369 B) copied, 0.000468148 s, 788 kB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-07-10 08:12:12,274::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-07-10 08:12:12,406::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0328525 s, 31.2 MB/s\n'; <rc> = 0 >Thread-1042::DEBUG::2014-07-10 08:12:12,864::task::595::TaskManager.Task::(_updateState) Task=`357d312d-797b-4cc6-b73c-79e54c05e555`::moving from state init -> state preparing >Thread-1042::INFO::2014-07-10 08:12:12,865::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-1042::INFO::2014-07-10 08:12:12,866::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000687786', 'lastCheck': '2.7', 'valid': True}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000468148', 'lastCheck': '2.1', 'valid': True}} >Thread-1042::DEBUG::2014-07-10 08:12:12,866::task::1185::TaskManager.Task::(prepare) Task=`357d312d-797b-4cc6-b73c-79e54c05e555`::finished: {u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000687786', 'lastCheck': '2.7', 'valid': True}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000468148', 'lastCheck': '2.1', 'valid': True}} >Thread-1042::DEBUG::2014-07-10 08:12:12,866::task::595::TaskManager.Task::(_updateState) Task=`357d312d-797b-4cc6-b73c-79e54c05e555`::moving from state preparing -> state finished >Thread-1042::DEBUG::2014-07-10 08:12:12,866::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-1042::DEBUG::2014-07-10 08:12:12,866::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1042::DEBUG::2014-07-10 08:12:12,867::task::990::TaskManager.Task::(_decref) Task=`357d312d-797b-4cc6-b73c-79e54c05e555`::ref 0 aborting False >Dummy-36::DEBUG::2014-07-10 08:12:14,421::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-07-10 08:12:14,550::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0296589 s, 34.5 MB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-07-10 08:12:16,565::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-07-10 08:12:16,701::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0384894 s, 26.6 MB/s\n'; <rc> = 0 >Thread-1042::DEBUG::2014-07-10 08:12:17,370::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-1042::DEBUG::2014-07-10 08:12:17,371::task::595::TaskManager.Task::(_updateState) Task=`de2f52d6-4975-4fb7-9608-1b0e6f103a5b`::moving from state init -> state preparing >Thread-1042::INFO::2014-07-10 08:12:17,372::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='411039e4-4af2-4192-9de0-67dc1ed83ba9', options=None) >Thread-1042::INFO::2014-07-10 08:12:17,372::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2}} >Thread-1042::DEBUG::2014-07-10 08:12:17,372::task::1185::TaskManager.Task::(prepare) Task=`de2f52d6-4975-4fb7-9608-1b0e6f103a5b`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2}} >Thread-1042::DEBUG::2014-07-10 08:12:17,372::task::595::TaskManager.Task::(_updateState) Task=`de2f52d6-4975-4fb7-9608-1b0e6f103a5b`::moving from state preparing -> state finished >Thread-1042::DEBUG::2014-07-10 08:12:17,373::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-1042::DEBUG::2014-07-10 08:12:17,373::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1042::DEBUG::2014-07-10 08:12:17,373::task::990::TaskManager.Task::(_decref) Task=`de2f52d6-4975-4fb7-9608-1b0e6f103a5b`::ref 0 aborting False >Thread-1043::DEBUG::2014-07-10 08:12:17,377::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-1043::DEBUG::2014-07-10 08:12:17,377::task::595::TaskManager.Task::(_updateState) Task=`468d3273-79e3-4955-aa06-51c0566c398b`::moving from state init -> state preparing >Thread-1043::INFO::2014-07-10 08:12:17,378::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='411039e4-4af2-4192-9de0-67dc1ed83ba9', options=None) >Thread-1043::DEBUG::2014-07-10 08:12:17,378::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9`ReqID=`4e85f262-f613-4724-b058-7d83d4609a09`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo' >Thread-1043::DEBUG::2014-07-10 08:12:17,378::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' for lock type 'shared' >Thread-1043::DEBUG::2014-07-10 08:12:17,379::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' is free. Now locking as 'shared' (1 active user) >Thread-1043::DEBUG::2014-07-10 08:12:17,379::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9`ReqID=`4e85f262-f613-4724-b058-7d83d4609a09`::Granted request >Thread-1043::DEBUG::2014-07-10 08:12:17,379::task::827::TaskManager.Task::(resourceAcquired) Task=`468d3273-79e3-4955-aa06-51c0566c398b`::_resourcesAcquired: Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9 (shared) >Thread-1043::DEBUG::2014-07-10 08:12:17,380::task::990::TaskManager.Task::(_decref) Task=`468d3273-79e3-4955-aa06-51c0566c398b`::ref 1 aborting False >Thread-1043::INFO::2014-07-10 08:12:17,381::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DC-REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2, 'domains': u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': 'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c': {'status': u'Active', 'diskfree': '1137495244800', 'isoprefix': '', 'alerts': [], 'disktotal': '1152393412608', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '533189361664', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-1043::DEBUG::2014-07-10 08:12:17,381::task::1185::TaskManager.Task::(prepare) Task=`468d3273-79e3-4955-aa06-51c0566c398b`::finished: {'info': {'name': 'DC-REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2, 'domains': u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': 'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c': {'status': u'Active', 'diskfree': '1137495244800', 'isoprefix': '', 'alerts': [], 'disktotal': '1152393412608', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '533189361664', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-1043::DEBUG::2014-07-10 08:12:17,381::task::595::TaskManager.Task::(_updateState) Task=`468d3273-79e3-4955-aa06-51c0566c398b`::moving from state preparing -> state finished >Thread-1043::DEBUG::2014-07-10 08:12:17,381::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9': < ResourceRef 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9', isValid: 'True' obj: 'None'>} >Thread-1043::DEBUG::2014-07-10 08:12:17,381::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1043::DEBUG::2014-07-10 08:12:17,382::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' >Thread-1043::DEBUG::2014-07-10 08:12:17,382::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' (0 active users) >Thread-1043::DEBUG::2014-07-10 08:12:17,382::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' is free, finding out if anyone is waiting for it. >Thread-1043::DEBUG::2014-07-10 08:12:17,382::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9', Clearing records. >Thread-1043::DEBUG::2014-07-10 08:12:17,382::task::990::TaskManager.Task::(_decref) Task=`468d3273-79e3-4955-aa06-51c0566c398b`::ref 0 aborting False >Dummy-36::DEBUG::2014-07-10 08:12:18,716::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-07-10 08:12:18,866::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0492585 s, 20.8 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-07-10 08:12:20,207::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/e01a3a36-d2ce-4153-bb57-d6e65b7ed08c/metadata bs=4096 count=1' (cwd None) >Thread-15::DEBUG::2014-07-10 08:12:20,270::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000754105 s, 5.4 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 08:12:20,835::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lion.qa.lab.tlv.redhat.com:_export_yuri2_backup2/6a70504d-00df-4869-8695-0f442053f6b6/dom_md/metadata bs=4096 count=1' (cwd None) >Dummy-36::DEBUG::2014-07-10 08:12:20,908::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Thread-14::DEBUG::2014-07-10 08:12:20,973::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n369 bytes (369 B) copied, 0.000471905 s, 782 kB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-07-10 08:12:21,049::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0390016 s, 26.3 MB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-07-10 08:12:23,063::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-07-10 08:12:23,222::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.061031 s, 16.8 MB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-07-10 08:12:25,237::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-07-10 08:12:25,373::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0359449 s, 28.5 MB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-07-10 08:12:27,389::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Thread-1042::DEBUG::2014-07-10 08:12:27,452::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-1042::DEBUG::2014-07-10 08:12:27,455::task::595::TaskManager.Task::(_updateState) Task=`94775b60-c8b2-426f-9444-6668b533a5ad`::moving from state init -> state preparing >Thread-1042::INFO::2014-07-10 08:12:27,456::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='411039e4-4af2-4192-9de0-67dc1ed83ba9', options=None) >Thread-1042::INFO::2014-07-10 08:12:27,460::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2}} >Thread-1042::DEBUG::2014-07-10 08:12:27,461::task::1185::TaskManager.Task::(prepare) Task=`94775b60-c8b2-426f-9444-6668b533a5ad`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2}} >Thread-1042::DEBUG::2014-07-10 08:12:27,461::task::595::TaskManager.Task::(_updateState) Task=`94775b60-c8b2-426f-9444-6668b533a5ad`::moving from state preparing -> state finished >Thread-1042::DEBUG::2014-07-10 08:12:27,462::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-1042::DEBUG::2014-07-10 08:12:27,462::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1042::DEBUG::2014-07-10 08:12:27,463::task::990::TaskManager.Task::(_decref) Task=`94775b60-c8b2-426f-9444-6668b533a5ad`::ref 0 aborting False >Thread-1043::DEBUG::2014-07-10 08:12:27,469::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-1043::DEBUG::2014-07-10 08:12:27,470::task::595::TaskManager.Task::(_updateState) Task=`471440e9-6bb6-4512-a4db-23fc9597a32d`::moving from state init -> state preparing >Thread-1043::INFO::2014-07-10 08:12:27,471::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='411039e4-4af2-4192-9de0-67dc1ed83ba9', options=None) >Thread-1043::DEBUG::2014-07-10 08:12:27,472::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9`ReqID=`1a69f53a-5aa0-4b88-8289-4306c1a73d5a`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo' >Thread-1043::DEBUG::2014-07-10 08:12:27,473::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' for lock type 'shared' >Thread-1043::DEBUG::2014-07-10 08:12:27,474::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' is free. Now locking as 'shared' (1 active user) >Thread-1043::DEBUG::2014-07-10 08:12:27,475::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9`ReqID=`1a69f53a-5aa0-4b88-8289-4306c1a73d5a`::Granted request >Thread-1043::DEBUG::2014-07-10 08:12:27,476::task::827::TaskManager.Task::(resourceAcquired) Task=`471440e9-6bb6-4512-a4db-23fc9597a32d`::_resourcesAcquired: Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9 (shared) >Thread-1043::DEBUG::2014-07-10 08:12:27,477::task::990::TaskManager.Task::(_decref) Task=`471440e9-6bb6-4512-a4db-23fc9597a32d`::ref 1 aborting False >Thread-1043::INFO::2014-07-10 08:12:27,479::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DC-REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2, 'domains': u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': 'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c': {'status': u'Active', 'diskfree': '1137495244800', 'isoprefix': '', 'alerts': [], 'disktotal': '1152393412608', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '533129592832', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-1043::DEBUG::2014-07-10 08:12:27,480::task::1185::TaskManager.Task::(prepare) Task=`471440e9-6bb6-4512-a4db-23fc9597a32d`::finished: {'info': {'name': 'DC-REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2, 'domains': u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': 'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c': {'status': u'Active', 'diskfree': '1137495244800', 'isoprefix': '', 'alerts': [], 'disktotal': '1152393412608', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '533129592832', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-1043::DEBUG::2014-07-10 08:12:27,481::task::595::TaskManager.Task::(_updateState) Task=`471440e9-6bb6-4512-a4db-23fc9597a32d`::moving from state preparing -> state finished >Thread-1043::DEBUG::2014-07-10 08:12:27,482::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9': < ResourceRef 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9', isValid: 'True' obj: 'None'>} >Thread-1043::DEBUG::2014-07-10 08:12:27,483::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1043::DEBUG::2014-07-10 08:12:27,484::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' >Thread-1043::DEBUG::2014-07-10 08:12:27,485::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' (0 active users) >Thread-1043::DEBUG::2014-07-10 08:12:27,485::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' is free, finding out if anyone is waiting for it. >Thread-1043::DEBUG::2014-07-10 08:12:27,486::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9', Clearing records. >Thread-1043::DEBUG::2014-07-10 08:12:27,487::task::990::TaskManager.Task::(_decref) Task=`471440e9-6bb6-4512-a4db-23fc9597a32d`::ref 0 aborting False >Dummy-36::DEBUG::2014-07-10 08:12:27,550::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0580952 s, 17.6 MB/s\n'; <rc> = 0 >Thread-1042::DEBUG::2014-07-10 08:12:28,005::task::595::TaskManager.Task::(_updateState) Task=`7d05f851-9e81-4691-84c9-7415c6ee508d`::moving from state init -> state preparing >Thread-1042::INFO::2014-07-10 08:12:28,006::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-1042::INFO::2014-07-10 08:12:28,006::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000754105', 'lastCheck': '7.7', 'valid': True}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000471905', 'lastCheck': '7.0', 'valid': True}} >Thread-1042::DEBUG::2014-07-10 08:12:28,006::task::1185::TaskManager.Task::(prepare) Task=`7d05f851-9e81-4691-84c9-7415c6ee508d`::finished: {u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000754105', 'lastCheck': '7.7', 'valid': True}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000471905', 'lastCheck': '7.0', 'valid': True}} >Thread-1042::DEBUG::2014-07-10 08:12:28,006::task::595::TaskManager.Task::(_updateState) Task=`7d05f851-9e81-4691-84c9-7415c6ee508d`::moving from state preparing -> state finished >Thread-1042::DEBUG::2014-07-10 08:12:28,007::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-1042::DEBUG::2014-07-10 08:12:28,007::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1042::DEBUG::2014-07-10 08:12:28,007::task::990::TaskManager.Task::(_decref) Task=`7d05f851-9e81-4691-84c9-7415c6ee508d`::ref 0 aborting False >Dummy-36::DEBUG::2014-07-10 08:12:29,565::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-07-10 08:12:29,696::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0298125 s, 34.3 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-07-10 08:12:30,300::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/e01a3a36-d2ce-4153-bb57-d6e65b7ed08c/metadata bs=4096 count=1' (cwd None) >Thread-15::DEBUG::2014-07-10 08:12:30,363::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000643406 s, 6.4 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 08:12:31,003::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lion.qa.lab.tlv.redhat.com:_export_yuri2_backup2/6a70504d-00df-4869-8695-0f442053f6b6/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-14::DEBUG::2014-07-10 08:12:31,060::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n369 bytes (369 B) copied, 0.000444502 s, 830 kB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-07-10 08:12:31,711::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-07-10 08:12:31,852::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0408441 s, 25.1 MB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-07-10 08:12:33,867::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-07-10 08:12:34,001::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0351675 s, 29.1 MB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-07-10 08:12:36,016::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-07-10 08:12:36,147::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0322866 s, 31.7 MB/s\n'; <rc> = 0 >Thread-1042::DEBUG::2014-07-10 08:12:37,527::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-1042::DEBUG::2014-07-10 08:12:37,528::task::595::TaskManager.Task::(_updateState) Task=`ddbe0334-71aa-491b-b597-1e6a8b05a79a`::moving from state init -> state preparing >Thread-1042::INFO::2014-07-10 08:12:37,529::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='411039e4-4af2-4192-9de0-67dc1ed83ba9', options=None) >Thread-1042::INFO::2014-07-10 08:12:37,529::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2}} >Thread-1042::DEBUG::2014-07-10 08:12:37,530::task::1185::TaskManager.Task::(prepare) Task=`ddbe0334-71aa-491b-b597-1e6a8b05a79a`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2}} >Thread-1042::DEBUG::2014-07-10 08:12:37,530::task::595::TaskManager.Task::(_updateState) Task=`ddbe0334-71aa-491b-b597-1e6a8b05a79a`::moving from state preparing -> state finished >Thread-1042::DEBUG::2014-07-10 08:12:37,530::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-1042::DEBUG::2014-07-10 08:12:37,530::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1042::DEBUG::2014-07-10 08:12:37,530::task::990::TaskManager.Task::(_decref) Task=`ddbe0334-71aa-491b-b597-1e6a8b05a79a`::ref 0 aborting False >Thread-1043::DEBUG::2014-07-10 08:12:37,534::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-1043::DEBUG::2014-07-10 08:12:37,535::task::595::TaskManager.Task::(_updateState) Task=`a180bd97-6e0b-4611-89da-22be00c04583`::moving from state init -> state preparing >Thread-1043::INFO::2014-07-10 08:12:37,535::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='411039e4-4af2-4192-9de0-67dc1ed83ba9', options=None) >Thread-1043::DEBUG::2014-07-10 08:12:37,536::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9`ReqID=`3b6eadf8-fbd1-4123-b872-9a6db9054a4d`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo' >Thread-1043::DEBUG::2014-07-10 08:12:37,536::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' for lock type 'shared' >Thread-1043::DEBUG::2014-07-10 08:12:37,536::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' is free. Now locking as 'shared' (1 active user) >Thread-1043::DEBUG::2014-07-10 08:12:37,536::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9`ReqID=`3b6eadf8-fbd1-4123-b872-9a6db9054a4d`::Granted request >Thread-1043::DEBUG::2014-07-10 08:12:37,537::task::827::TaskManager.Task::(resourceAcquired) Task=`a180bd97-6e0b-4611-89da-22be00c04583`::_resourcesAcquired: Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9 (shared) >Thread-1043::DEBUG::2014-07-10 08:12:37,537::task::990::TaskManager.Task::(_decref) Task=`a180bd97-6e0b-4611-89da-22be00c04583`::ref 1 aborting False >Thread-1043::INFO::2014-07-10 08:12:37,538::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DC-REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2, 'domains': u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': 'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c': {'status': u'Active', 'diskfree': '1137495244800', 'isoprefix': '', 'alerts': [], 'disktotal': '1152393412608', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '533098135552', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-1043::DEBUG::2014-07-10 08:12:37,539::task::1185::TaskManager.Task::(prepare) Task=`a180bd97-6e0b-4611-89da-22be00c04583`::finished: {'info': {'name': 'DC-REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2, 'domains': u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': 'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c': {'status': u'Active', 'diskfree': '1137495244800', 'isoprefix': '', 'alerts': [], 'disktotal': '1152393412608', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '533098135552', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-1043::DEBUG::2014-07-10 08:12:37,539::task::595::TaskManager.Task::(_updateState) Task=`a180bd97-6e0b-4611-89da-22be00c04583`::moving from state preparing -> state finished >Thread-1043::DEBUG::2014-07-10 08:12:37,539::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9': < ResourceRef 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9', isValid: 'True' obj: 'None'>} >Thread-1043::DEBUG::2014-07-10 08:12:37,539::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1043::DEBUG::2014-07-10 08:12:37,539::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' >Thread-1043::DEBUG::2014-07-10 08:12:37,540::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' (0 active users) >Thread-1043::DEBUG::2014-07-10 08:12:37,540::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' is free, finding out if anyone is waiting for it. >Thread-1043::DEBUG::2014-07-10 08:12:37,540::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9', Clearing records. >Thread-1043::DEBUG::2014-07-10 08:12:37,540::task::990::TaskManager.Task::(_decref) Task=`a180bd97-6e0b-4611-89da-22be00c04583`::ref 0 aborting False >Dummy-36::DEBUG::2014-07-10 08:12:38,162::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-07-10 08:12:38,289::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0297838 s, 34.4 MB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-07-10 08:12:40,304::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Thread-15::DEBUG::2014-07-10 08:12:40,395::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/e01a3a36-d2ce-4153-bb57-d6e65b7ed08c/metadata bs=4096 count=1' (cwd None) >Thread-15::DEBUG::2014-07-10 08:12:40,513::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000647611 s, 6.3 MB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-07-10 08:12:40,868::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.256773 s, 4.0 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 08:12:41,084::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lion.qa.lab.tlv.redhat.com:_export_yuri2_backup2/6a70504d-00df-4869-8695-0f442053f6b6/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-14::DEBUG::2014-07-10 08:12:41,143::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n369 bytes (369 B) copied, 0.000368463 s, 1.0 MB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-07-10 08:12:42,883::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-07-10 08:12:43,014::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0361251 s, 28.3 MB/s\n'; <rc> = 0 >Thread-1042::DEBUG::2014-07-10 08:12:43,140::task::595::TaskManager.Task::(_updateState) Task=`a84e0284-9983-4274-b33e-00f9d7beb5e4`::moving from state init -> state preparing >Thread-1042::INFO::2014-07-10 08:12:43,140::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-1042::INFO::2014-07-10 08:12:43,141::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000647611', 'lastCheck': '2.3', 'valid': True}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000368463', 'lastCheck': '2.0', 'valid': True}} >Thread-1042::DEBUG::2014-07-10 08:12:43,141::task::1185::TaskManager.Task::(prepare) Task=`a84e0284-9983-4274-b33e-00f9d7beb5e4`::finished: {u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000647611', 'lastCheck': '2.3', 'valid': True}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000368463', 'lastCheck': '2.0', 'valid': True}} >Thread-1042::DEBUG::2014-07-10 08:12:43,141::task::595::TaskManager.Task::(_updateState) Task=`a84e0284-9983-4274-b33e-00f9d7beb5e4`::moving from state preparing -> state finished >Thread-1042::DEBUG::2014-07-10 08:12:43,141::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-1042::DEBUG::2014-07-10 08:12:43,142::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1042::DEBUG::2014-07-10 08:12:43,142::task::990::TaskManager.Task::(_decref) Task=`a84e0284-9983-4274-b33e-00f9d7beb5e4`::ref 0 aborting False >Dummy-36::DEBUG::2014-07-10 08:12:45,029::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-07-10 08:12:45,162::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0324642 s, 31.5 MB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-07-10 08:12:47,176::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-07-10 08:12:47,304::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0297198 s, 34.5 MB/s\n'; <rc> = 0 >Thread-1042::DEBUG::2014-07-10 08:12:47,578::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-1042::DEBUG::2014-07-10 08:12:47,579::task::595::TaskManager.Task::(_updateState) Task=`ce02ef62-0629-4518-b7aa-7e7faca8da68`::moving from state init -> state preparing >Thread-1042::INFO::2014-07-10 08:12:47,579::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='411039e4-4af2-4192-9de0-67dc1ed83ba9', options=None) >Thread-1042::INFO::2014-07-10 08:12:47,580::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2}} >Thread-1042::DEBUG::2014-07-10 08:12:47,580::task::1185::TaskManager.Task::(prepare) Task=`ce02ef62-0629-4518-b7aa-7e7faca8da68`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2}} >Thread-1042::DEBUG::2014-07-10 08:12:47,580::task::595::TaskManager.Task::(_updateState) Task=`ce02ef62-0629-4518-b7aa-7e7faca8da68`::moving from state preparing -> state finished >Thread-1042::DEBUG::2014-07-10 08:12:47,581::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-1042::DEBUG::2014-07-10 08:12:47,581::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1042::DEBUG::2014-07-10 08:12:47,581::task::990::TaskManager.Task::(_decref) Task=`ce02ef62-0629-4518-b7aa-7e7faca8da68`::ref 0 aborting False >Thread-1043::DEBUG::2014-07-10 08:12:47,585::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-1043::DEBUG::2014-07-10 08:12:47,585::task::595::TaskManager.Task::(_updateState) Task=`224db663-9e62-415b-acc7-280dcc0b5c6e`::moving from state init -> state preparing >Thread-1043::INFO::2014-07-10 08:12:47,585::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='411039e4-4af2-4192-9de0-67dc1ed83ba9', options=None) >Thread-1043::DEBUG::2014-07-10 08:12:47,586::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9`ReqID=`e6d236e2-f056-4bfd-84ea-cd00808b8d45`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo' >Thread-1043::DEBUG::2014-07-10 08:12:47,586::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' for lock type 'shared' >Thread-1043::DEBUG::2014-07-10 08:12:47,587::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' is free. Now locking as 'shared' (1 active user) >Thread-1043::DEBUG::2014-07-10 08:12:47,587::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9`ReqID=`e6d236e2-f056-4bfd-84ea-cd00808b8d45`::Granted request >Thread-1043::DEBUG::2014-07-10 08:12:47,587::task::827::TaskManager.Task::(resourceAcquired) Task=`224db663-9e62-415b-acc7-280dcc0b5c6e`::_resourcesAcquired: Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9 (shared) >Thread-1043::DEBUG::2014-07-10 08:12:47,588::task::990::TaskManager.Task::(_decref) Task=`224db663-9e62-415b-acc7-280dcc0b5c6e`::ref 1 aborting False >Thread-1043::INFO::2014-07-10 08:12:47,589::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DC-REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2, 'domains': u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': 'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c': {'status': u'Active', 'diskfree': '1137495244800', 'isoprefix': '', 'alerts': [], 'disktotal': '1152393412608', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '533027880960', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-1043::DEBUG::2014-07-10 08:12:47,589::task::1185::TaskManager.Task::(prepare) Task=`224db663-9e62-415b-acc7-280dcc0b5c6e`::finished: {'info': {'name': 'DC-REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2, 'domains': u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': 'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c': {'status': u'Active', 'diskfree': '1137495244800', 'isoprefix': '', 'alerts': [], 'disktotal': '1152393412608', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '533027880960', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-1043::DEBUG::2014-07-10 08:12:47,589::task::595::TaskManager.Task::(_updateState) Task=`224db663-9e62-415b-acc7-280dcc0b5c6e`::moving from state preparing -> state finished >Thread-1043::DEBUG::2014-07-10 08:12:47,589::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9': < ResourceRef 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9', isValid: 'True' obj: 'None'>} >Thread-1043::DEBUG::2014-07-10 08:12:47,590::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1043::DEBUG::2014-07-10 08:12:47,590::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' >Thread-1043::DEBUG::2014-07-10 08:12:47,590::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' (0 active users) >Thread-1043::DEBUG::2014-07-10 08:12:47,590::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' is free, finding out if anyone is waiting for it. >Thread-1043::DEBUG::2014-07-10 08:12:47,590::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9', Clearing records. >Thread-1043::DEBUG::2014-07-10 08:12:47,591::task::990::TaskManager.Task::(_decref) Task=`224db663-9e62-415b-acc7-280dcc0b5c6e`::ref 0 aborting False >Dummy-36::DEBUG::2014-07-10 08:12:49,319::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-07-10 08:12:49,455::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0392031 s, 26.1 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-07-10 08:12:50,838::domainMonitor::192::Storage.DomainMonitorThread::(_monitorDomain) Refreshing domain e01a3a36-d2ce-4153-bb57-d6e65b7ed08c >Thread-15::ERROR::2014-07-10 08:12:50,838::sdc::137::Storage.StorageDomainCache::(_findDomain) looking for unfetched domain e01a3a36-d2ce-4153-bb57-d6e65b7ed08c >Thread-15::ERROR::2014-07-10 08:12:50,839::sdc::154::Storage.StorageDomainCache::(_findUnfetchedDomain) looking for domain e01a3a36-d2ce-4153-bb57-d6e65b7ed08c >Thread-15::DEBUG::2014-07-10 08:12:50,839::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with LvMetadataRW backend >Thread-15::DEBUG::2014-07-10 08:12:50,839::blockSD::336::Storage.Misc.excCmd::(readlines) '/bin/dd iflag=direct skip=0 bs=2048 if=/dev/e01a3a36-d2ce-4153-bb57-d6e65b7ed08c/metadata count=1' (cwd None) >Thread-15::DEBUG::2014-07-10 08:12:50,897::blockSD::336::Storage.Misc.excCmd::(readlines) SUCCESS: <err> = '1+0 records in\n1+0 records out\n2048 bytes (2.0 kB) copied, 0.000811227 s, 2.5 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-07-10 08:12:50,898::misc::282::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '2048 bytes (2.0 kB) copied, 0.000811227 s, 2.5 MB/s'], size: 2048 >Thread-15::DEBUG::2014-07-10 08:12:50,898::persistentDict::234::Storage.PersistentDict::(refresh) read lines (LvMetadataRW)=[] >Thread-15::WARNING::2014-07-10 08:12:50,898::persistentDict::256::Storage.PersistentDict::(refresh) data has no embedded checksum - trust it as it is >Thread-15::DEBUG::2014-07-10 08:12:50,899::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with VGTagMetadataRW backend >Thread-15::DEBUG::2014-07-10 08:12:50,899::lvm::503::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-15::DEBUG::2014-07-10 08:12:50,900::lvm::505::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-15::DEBUG::2014-07-10 08:12:50,900::lvm::513::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-15::DEBUG::2014-07-10 08:12:50,900::lvm::525::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-15::DEBUG::2014-07-10 08:12:50,900::lvm::373::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-15::DEBUG::2014-07-10 08:12:50,902::lvm::296::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/3600601601282300032826addbbdae311|/dev/mapper/360060160f4a030003840ec867ddee311|/dev/mapper/367cad74c2fcba00019e6afd20c781e67|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name e01a3a36-d2ce-4153-bb57-d6e65b7ed08c' (cwd None) >Thread-14::DEBUG::2014-07-10 08:12:51,180::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lion.qa.lab.tlv.redhat.com:_export_yuri2_backup2/6a70504d-00df-4869-8695-0f442053f6b6/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-14::DEBUG::2014-07-10 08:12:51,249::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n369 bytes (369 B) copied, 0.000447343 s, 825 kB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-07-10 08:12:51,283::lvm::296::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-15::DEBUG::2014-07-10 08:12:51,286::lvm::415::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-15::DEBUG::2014-07-10 08:12:51,287::persistentDict::234::Storage.PersistentDict::(refresh) read lines (VGTagMetadataRW)=['LEASETIMESEC=60', 'CLASS=Data', 'VERSION=3', u'PV1=pv:360060160f4a030003840ec867ddee311,uuid:0eUwla-dsA3-g6ia-RU23-cual-0rt9-KzkxLj,pestart:0,pecount:397,mapoffset:8189', u'PV0=pv:3600601601282300032826addbbdae311,uuid:ZdReOp-Yf8A-beQm-ne4I-pN3J-rxgm-9Ew0S1,pestart:0,pecount:8189,mapoffset:0', 'LOGBLKSIZE=512', 'LEASERETRIES=3', 'IOOPTIMEOUTSEC=10', 'LOCKRENEWALINTERVALSEC=5', 'PHYBLKSIZE=512', 'SDUUID=e01a3a36-d2ce-4153-bb57-d6e65b7ed08c', 'DESCRIPTION=SD-REAL', 'LOCKPOLICY=', 'VGUUID=GJcVo5-Y0kU-CDub-zITS-zfoL-Z7hz-SeVeIe', 'TYPE=ISCSI', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=DC-REAL', 'ROLE=Master', 'POOL_UUID=411039e4-4af2-4192-9de0-67dc1ed83ba9', 'POOL_SPM_ID=1', u'POOL_DOMAINS=6a70504d-00df-4869-8695-0f442053f6b6:Active,e01a3a36-d2ce-4153-bb57-d6e65b7ed08c:Active', '_SHA_CKSUM=cefcf6543a5de3bd5b35901e3ca494c6a6185b63', 'POOL_SPM_LVER=2'] >Thread-15::INFO::2014-07-10 08:12:51,288::sd::384::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace e01a3a36-d2ce-4153-bb57-d6e65b7ed08c_imageNS already registered >Thread-15::INFO::2014-07-10 08:12:51,288::sd::392::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace e01a3a36-d2ce-4153-bb57-d6e65b7ed08c_volumeNS already registered >Thread-15::INFO::2014-07-10 08:12:51,289::blockSD::452::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace e01a3a36-d2ce-4153-bb57-d6e65b7ed08c_lvmActivationNS already registered >Thread-15::DEBUG::2014-07-10 08:12:51,289::lvm::296::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgck --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/3600601601282300032826addbbdae311|/dev/mapper/360060160f4a030003840ec867ddee311|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } " e01a3a36-d2ce-4153-bb57-d6e65b7ed08c' (cwd None) >Dummy-36::DEBUG::2014-07-10 08:12:51,470::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Thread-15::DEBUG::2014-07-10 08:12:51,536::lvm::296::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-15::DEBUG::2014-07-10 08:12:51,539::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/e01a3a36-d2ce-4153-bb57-d6e65b7ed08c/metadata bs=4096 count=1' (cwd None) >Thread-15::DEBUG::2014-07-10 08:12:51,666::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000704577 s, 5.8 MB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-07-10 08:12:52,085::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.515376 s, 2.0 MB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-07-10 08:12:54,100::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-07-10 08:12:54,239::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.038101 s, 26.9 MB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-07-10 08:12:56,254::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-07-10 08:12:56,385::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0327104 s, 31.3 MB/s\n'; <rc> = 0 >Thread-1042::DEBUG::2014-07-10 08:12:57,612::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-1042::DEBUG::2014-07-10 08:12:57,613::task::595::TaskManager.Task::(_updateState) Task=`02f85564-a2fd-4d19-8443-04e040b2ad21`::moving from state init -> state preparing >Thread-1042::INFO::2014-07-10 08:12:57,614::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='411039e4-4af2-4192-9de0-67dc1ed83ba9', options=None) >Thread-1042::INFO::2014-07-10 08:12:57,614::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2}} >Thread-1042::DEBUG::2014-07-10 08:12:57,614::task::1185::TaskManager.Task::(prepare) Task=`02f85564-a2fd-4d19-8443-04e040b2ad21`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2}} >Thread-1042::DEBUG::2014-07-10 08:12:57,615::task::595::TaskManager.Task::(_updateState) Task=`02f85564-a2fd-4d19-8443-04e040b2ad21`::moving from state preparing -> state finished >Thread-1042::DEBUG::2014-07-10 08:12:57,615::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-1042::DEBUG::2014-07-10 08:12:57,615::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1042::DEBUG::2014-07-10 08:12:57,615::task::990::TaskManager.Task::(_decref) Task=`02f85564-a2fd-4d19-8443-04e040b2ad21`::ref 0 aborting False >Thread-1043::DEBUG::2014-07-10 08:12:57,619::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-1043::DEBUG::2014-07-10 08:12:57,620::task::595::TaskManager.Task::(_updateState) Task=`e455cc92-11e6-4195-aa28-bb32661bec72`::moving from state init -> state preparing >Thread-1043::INFO::2014-07-10 08:12:57,620::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='411039e4-4af2-4192-9de0-67dc1ed83ba9', options=None) >Thread-1043::DEBUG::2014-07-10 08:12:57,621::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9`ReqID=`0a1893e1-1a20-42c8-a3bd-eea02eadf2b4`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo' >Thread-1043::DEBUG::2014-07-10 08:12:57,621::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' for lock type 'shared' >Thread-1043::DEBUG::2014-07-10 08:12:57,621::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' is free. Now locking as 'shared' (1 active user) >Thread-1043::DEBUG::2014-07-10 08:12:57,621::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9`ReqID=`0a1893e1-1a20-42c8-a3bd-eea02eadf2b4`::Granted request >Thread-1043::DEBUG::2014-07-10 08:12:57,622::task::827::TaskManager.Task::(resourceAcquired) Task=`e455cc92-11e6-4195-aa28-bb32661bec72`::_resourcesAcquired: Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9 (shared) >Thread-1043::DEBUG::2014-07-10 08:12:57,622::task::990::TaskManager.Task::(_decref) Task=`e455cc92-11e6-4195-aa28-bb32661bec72`::ref 1 aborting False >Thread-1043::INFO::2014-07-10 08:12:57,623::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DC-REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2, 'domains': u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': 'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c': {'status': u'Active', 'diskfree': '1137495244800', 'isoprefix': '', 'alerts': [], 'disktotal': '1152393412608', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532923023360', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-1043::DEBUG::2014-07-10 08:12:57,624::task::1185::TaskManager.Task::(prepare) Task=`e455cc92-11e6-4195-aa28-bb32661bec72`::finished: {'info': {'name': 'DC-REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2, 'domains': u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': 'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c': {'status': u'Active', 'diskfree': '1137495244800', 'isoprefix': '', 'alerts': [], 'disktotal': '1152393412608', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532923023360', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-1043::DEBUG::2014-07-10 08:12:57,624::task::595::TaskManager.Task::(_updateState) Task=`e455cc92-11e6-4195-aa28-bb32661bec72`::moving from state preparing -> state finished >Thread-1043::DEBUG::2014-07-10 08:12:57,624::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9': < ResourceRef 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9', isValid: 'True' obj: 'None'>} >Thread-1043::DEBUG::2014-07-10 08:12:57,624::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1043::DEBUG::2014-07-10 08:12:57,624::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' >Thread-1043::DEBUG::2014-07-10 08:12:57,625::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' (0 active users) >Thread-1043::DEBUG::2014-07-10 08:12:57,625::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' is free, finding out if anyone is waiting for it. >Thread-1043::DEBUG::2014-07-10 08:12:57,625::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9', Clearing records. >Thread-1043::DEBUG::2014-07-10 08:12:57,625::task::990::TaskManager.Task::(_decref) Task=`e455cc92-11e6-4195-aa28-bb32661bec72`::ref 0 aborting False >Thread-1042::DEBUG::2014-07-10 08:12:58,292::task::595::TaskManager.Task::(_updateState) Task=`a6961fc7-62f2-4fa9-ba94-22a083d8d92b`::moving from state init -> state preparing >Thread-1042::INFO::2014-07-10 08:12:58,293::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-1042::INFO::2014-07-10 08:12:58,295::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000704577', 'lastCheck': '6.3', 'valid': True}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000447343', 'lastCheck': '7.0', 'valid': True}} >Thread-1042::DEBUG::2014-07-10 08:12:58,295::task::1185::TaskManager.Task::(prepare) Task=`a6961fc7-62f2-4fa9-ba94-22a083d8d92b`::finished: {u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000704577', 'lastCheck': '6.3', 'valid': True}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000447343', 'lastCheck': '7.0', 'valid': True}} >Thread-1042::DEBUG::2014-07-10 08:12:58,295::task::595::TaskManager.Task::(_updateState) Task=`a6961fc7-62f2-4fa9-ba94-22a083d8d92b`::moving from state preparing -> state finished >Thread-1042::DEBUG::2014-07-10 08:12:58,296::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-1042::DEBUG::2014-07-10 08:12:58,296::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1042::DEBUG::2014-07-10 08:12:58,296::task::990::TaskManager.Task::(_decref) Task=`a6961fc7-62f2-4fa9-ba94-22a083d8d92b`::ref 0 aborting False >Dummy-36::DEBUG::2014-07-10 08:12:58,400::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-07-10 08:12:58,535::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0382278 s, 26.8 MB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-07-10 08:13:00,550::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-07-10 08:13:00,690::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0379009 s, 27.0 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 08:13:01,279::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lion.qa.lab.tlv.redhat.com:_export_yuri2_backup2/6a70504d-00df-4869-8695-0f442053f6b6/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-14::DEBUG::2014-07-10 08:13:01,343::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n369 bytes (369 B) copied, 0.000434381 s, 849 kB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-07-10 08:13:02,036::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/e01a3a36-d2ce-4153-bb57-d6e65b7ed08c/metadata bs=4096 count=1' (cwd None) >Thread-15::DEBUG::2014-07-10 08:13:02,101::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00788556 s, 519 kB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-07-10 08:13:02,705::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-07-10 08:13:02,838::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0381041 s, 26.9 MB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-07-10 08:13:04,853::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-07-10 08:13:04,997::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0410207 s, 25.0 MB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-07-10 08:13:07,012::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-07-10 08:13:07,142::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0323927 s, 31.6 MB/s\n'; <rc> = 0 >Thread-1042::DEBUG::2014-07-10 08:13:07,661::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-1042::DEBUG::2014-07-10 08:13:07,662::task::595::TaskManager.Task::(_updateState) Task=`31d64faa-6440-4cec-867a-0b54888219d1`::moving from state init -> state preparing >Thread-1042::INFO::2014-07-10 08:13:07,662::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='411039e4-4af2-4192-9de0-67dc1ed83ba9', options=None) >Thread-1042::INFO::2014-07-10 08:13:07,663::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2}} >Thread-1042::DEBUG::2014-07-10 08:13:07,663::task::1185::TaskManager.Task::(prepare) Task=`31d64faa-6440-4cec-867a-0b54888219d1`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2}} >Thread-1042::DEBUG::2014-07-10 08:13:07,663::task::595::TaskManager.Task::(_updateState) Task=`31d64faa-6440-4cec-867a-0b54888219d1`::moving from state preparing -> state finished >Thread-1042::DEBUG::2014-07-10 08:13:07,663::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-1042::DEBUG::2014-07-10 08:13:07,663::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1042::DEBUG::2014-07-10 08:13:07,664::task::990::TaskManager.Task::(_decref) Task=`31d64faa-6440-4cec-867a-0b54888219d1`::ref 0 aborting False >Thread-1043::DEBUG::2014-07-10 08:13:07,667::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-1043::DEBUG::2014-07-10 08:13:07,668::task::595::TaskManager.Task::(_updateState) Task=`3985d5a3-8092-4a06-859a-369ced2f4f9e`::moving from state init -> state preparing >Thread-1043::INFO::2014-07-10 08:13:07,668::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='411039e4-4af2-4192-9de0-67dc1ed83ba9', options=None) >Thread-1043::DEBUG::2014-07-10 08:13:07,669::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9`ReqID=`3167d453-5033-48fd-8648-149e5032a489`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo' >Thread-1043::DEBUG::2014-07-10 08:13:07,669::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' for lock type 'shared' >Thread-1043::DEBUG::2014-07-10 08:13:07,670::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' is free. Now locking as 'shared' (1 active user) >Thread-1043::DEBUG::2014-07-10 08:13:07,671::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9`ReqID=`3167d453-5033-48fd-8648-149e5032a489`::Granted request >Thread-1043::DEBUG::2014-07-10 08:13:07,671::task::827::TaskManager.Task::(resourceAcquired) Task=`3985d5a3-8092-4a06-859a-369ced2f4f9e`::_resourcesAcquired: Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9 (shared) >Thread-1043::DEBUG::2014-07-10 08:13:07,671::task::990::TaskManager.Task::(_decref) Task=`3985d5a3-8092-4a06-859a-369ced2f4f9e`::ref 1 aborting False >Thread-1043::INFO::2014-07-10 08:13:07,673::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DC-REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2, 'domains': u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': 'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c': {'status': u'Active', 'diskfree': '1137495244800', 'isoprefix': '', 'alerts': [], 'disktotal': '1152393412608', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532767834112', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-1043::DEBUG::2014-07-10 08:13:07,673::task::1185::TaskManager.Task::(prepare) Task=`3985d5a3-8092-4a06-859a-369ced2f4f9e`::finished: {'info': {'name': 'DC-REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2, 'domains': u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': 'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c': {'status': u'Active', 'diskfree': '1137495244800', 'isoprefix': '', 'alerts': [], 'disktotal': '1152393412608', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532767834112', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-1043::DEBUG::2014-07-10 08:13:07,673::task::595::TaskManager.Task::(_updateState) Task=`3985d5a3-8092-4a06-859a-369ced2f4f9e`::moving from state preparing -> state finished >Thread-1043::DEBUG::2014-07-10 08:13:07,673::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9': < ResourceRef 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9', isValid: 'True' obj: 'None'>} >Thread-1043::DEBUG::2014-07-10 08:13:07,673::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1043::DEBUG::2014-07-10 08:13:07,674::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' >Thread-1043::DEBUG::2014-07-10 08:13:07,674::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' (0 active users) >Thread-1043::DEBUG::2014-07-10 08:13:07,674::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' is free, finding out if anyone is waiting for it. >Thread-1043::DEBUG::2014-07-10 08:13:07,674::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9', Clearing records. >Thread-1043::DEBUG::2014-07-10 08:13:07,674::task::990::TaskManager.Task::(_decref) Task=`3985d5a3-8092-4a06-859a-369ced2f4f9e`::ref 0 aborting False >Dummy-36::DEBUG::2014-07-10 08:13:09,157::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-07-10 08:13:09,343::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0679541 s, 15.1 MB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-07-10 08:13:11,365::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Thread-14::DEBUG::2014-07-10 08:13:11,430::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lion.qa.lab.tlv.redhat.com:_export_yuri2_backup2/6a70504d-00df-4869-8695-0f442053f6b6/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-14::DEBUG::2014-07-10 08:13:11,525::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n369 bytes (369 B) copied, 0.00168014 s, 220 kB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-07-10 08:13:11,608::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.14049 s, 7.3 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-07-10 08:13:12,131::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/e01a3a36-d2ce-4153-bb57-d6e65b7ed08c/metadata bs=4096 count=1' (cwd None) >Thread-15::DEBUG::2014-07-10 08:13:12,199::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00979001 s, 418 kB/s\n'; <rc> = 0 >Thread-1042::DEBUG::2014-07-10 08:13:13,424::task::595::TaskManager.Task::(_updateState) Task=`65eb0d07-df8f-4630-aa1e-f9b7beb8f8b1`::moving from state init -> state preparing >Thread-1042::INFO::2014-07-10 08:13:13,424::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-1042::INFO::2014-07-10 08:13:13,425::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00979001', 'lastCheck': '1.2', 'valid': True}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00168014', 'lastCheck': '1.9', 'valid': True}} >Thread-1042::DEBUG::2014-07-10 08:13:13,425::task::1185::TaskManager.Task::(prepare) Task=`65eb0d07-df8f-4630-aa1e-f9b7beb8f8b1`::finished: {u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00979001', 'lastCheck': '1.2', 'valid': True}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00168014', 'lastCheck': '1.9', 'valid': True}} >Thread-1042::DEBUG::2014-07-10 08:13:13,425::task::595::TaskManager.Task::(_updateState) Task=`65eb0d07-df8f-4630-aa1e-f9b7beb8f8b1`::moving from state preparing -> state finished >Thread-1042::DEBUG::2014-07-10 08:13:13,425::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-1042::DEBUG::2014-07-10 08:13:13,425::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1042::DEBUG::2014-07-10 08:13:13,426::task::990::TaskManager.Task::(_decref) Task=`65eb0d07-df8f-4630-aa1e-f9b7beb8f8b1`::ref 0 aborting False >Dummy-36::DEBUG::2014-07-10 08:13:13,623::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-07-10 08:13:13,763::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0380635 s, 26.9 MB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-07-10 08:13:15,782::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-07-10 08:13:16,160::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.274066 s, 3.7 MB/s\n'; <rc> = 0 >Thread-1042::DEBUG::2014-07-10 08:13:17,711::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-1042::DEBUG::2014-07-10 08:13:17,712::task::595::TaskManager.Task::(_updateState) Task=`63cee34a-b793-4a8d-bf43-f6b4620315bd`::moving from state init -> state preparing >Thread-1042::INFO::2014-07-10 08:13:17,713::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='411039e4-4af2-4192-9de0-67dc1ed83ba9', options=None) >Thread-1042::INFO::2014-07-10 08:13:17,713::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2}} >Thread-1042::DEBUG::2014-07-10 08:13:17,713::task::1185::TaskManager.Task::(prepare) Task=`63cee34a-b793-4a8d-bf43-f6b4620315bd`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2}} >Thread-1042::DEBUG::2014-07-10 08:13:17,713::task::595::TaskManager.Task::(_updateState) Task=`63cee34a-b793-4a8d-bf43-f6b4620315bd`::moving from state preparing -> state finished >Thread-1042::DEBUG::2014-07-10 08:13:17,714::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-1042::DEBUG::2014-07-10 08:13:17,714::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1042::DEBUG::2014-07-10 08:13:17,714::task::990::TaskManager.Task::(_decref) Task=`63cee34a-b793-4a8d-bf43-f6b4620315bd`::ref 0 aborting False >Thread-1043::DEBUG::2014-07-10 08:13:17,718::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-1043::DEBUG::2014-07-10 08:13:17,718::task::595::TaskManager.Task::(_updateState) Task=`9312dfa8-a2a5-4e70-ae1b-24e5b8bb4130`::moving from state init -> state preparing >Thread-1043::INFO::2014-07-10 08:13:17,718::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='411039e4-4af2-4192-9de0-67dc1ed83ba9', options=None) >Thread-1043::DEBUG::2014-07-10 08:13:17,719::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9`ReqID=`e30a552d-65b3-41dc-b436-851082797055`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo' >Thread-1043::DEBUG::2014-07-10 08:13:17,719::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' for lock type 'shared' >Thread-1043::DEBUG::2014-07-10 08:13:17,719::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' is free. Now locking as 'shared' (1 active user) >Thread-1043::DEBUG::2014-07-10 08:13:17,720::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9`ReqID=`e30a552d-65b3-41dc-b436-851082797055`::Granted request >Thread-1043::DEBUG::2014-07-10 08:13:17,720::task::827::TaskManager.Task::(resourceAcquired) Task=`9312dfa8-a2a5-4e70-ae1b-24e5b8bb4130`::_resourcesAcquired: Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9 (shared) >Thread-1043::DEBUG::2014-07-10 08:13:17,720::task::990::TaskManager.Task::(_decref) Task=`9312dfa8-a2a5-4e70-ae1b-24e5b8bb4130`::ref 1 aborting False >Thread-1043::INFO::2014-07-10 08:13:17,721::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DC-REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2, 'domains': u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': 'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c': {'status': u'Active', 'diskfree': '1137495244800', 'isoprefix': '', 'alerts': [], 'disktotal': '1152393412608', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532629422080', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-1043::DEBUG::2014-07-10 08:13:17,721::task::1185::TaskManager.Task::(prepare) Task=`9312dfa8-a2a5-4e70-ae1b-24e5b8bb4130`::finished: {'info': {'name': 'DC-REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2, 'domains': u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': 'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c': {'status': u'Active', 'diskfree': '1137495244800', 'isoprefix': '', 'alerts': [], 'disktotal': '1152393412608', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532629422080', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-1043::DEBUG::2014-07-10 08:13:17,722::task::595::TaskManager.Task::(_updateState) Task=`9312dfa8-a2a5-4e70-ae1b-24e5b8bb4130`::moving from state preparing -> state finished >Thread-1043::DEBUG::2014-07-10 08:13:17,722::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9': < ResourceRef 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9', isValid: 'True' obj: 'None'>} >Thread-1043::DEBUG::2014-07-10 08:13:17,722::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1043::DEBUG::2014-07-10 08:13:17,722::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' >Thread-1043::DEBUG::2014-07-10 08:13:17,722::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' (0 active users) >Thread-1043::DEBUG::2014-07-10 08:13:17,722::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' is free, finding out if anyone is waiting for it. >Thread-1043::DEBUG::2014-07-10 08:13:17,723::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9', Clearing records. >Thread-1043::DEBUG::2014-07-10 08:13:17,723::task::990::TaskManager.Task::(_decref) Task=`9312dfa8-a2a5-4e70-ae1b-24e5b8bb4130`::ref 0 aborting False >Dummy-36::DEBUG::2014-07-10 08:13:18,175::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-07-10 08:13:18,306::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0329552 s, 31.1 MB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-07-10 08:13:20,321::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-07-10 08:13:20,469::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0463902 s, 22.1 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 08:13:21,568::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lion.qa.lab.tlv.redhat.com:_export_yuri2_backup2/6a70504d-00df-4869-8695-0f442053f6b6/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-14::DEBUG::2014-07-10 08:13:21,631::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n369 bytes (369 B) copied, 0.000386949 s, 954 kB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-07-10 08:13:22,230::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/e01a3a36-d2ce-4153-bb57-d6e65b7ed08c/metadata bs=4096 count=1' (cwd None) >Thread-15::DEBUG::2014-07-10 08:13:22,290::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000925285 s, 4.4 MB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-07-10 08:13:22,484::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-07-10 08:13:22,638::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0505178 s, 20.3 MB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-07-10 08:13:24,661::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-07-10 08:13:24,800::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0294485 s, 34.8 MB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-07-10 08:13:26,814::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-07-10 08:13:26,950::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0324457 s, 31.6 MB/s\n'; <rc> = 0 >Thread-1042::DEBUG::2014-07-10 08:13:27,762::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-1042::DEBUG::2014-07-10 08:13:27,763::task::595::TaskManager.Task::(_updateState) Task=`e1883eef-0342-4492-82ea-2958f81784fb`::moving from state init -> state preparing >Thread-1042::INFO::2014-07-10 08:13:27,763::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='411039e4-4af2-4192-9de0-67dc1ed83ba9', options=None) >Thread-1042::INFO::2014-07-10 08:13:27,764::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2}} >Thread-1042::DEBUG::2014-07-10 08:13:27,764::task::1185::TaskManager.Task::(prepare) Task=`e1883eef-0342-4492-82ea-2958f81784fb`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2}} >Thread-1042::DEBUG::2014-07-10 08:13:27,764::task::595::TaskManager.Task::(_updateState) Task=`e1883eef-0342-4492-82ea-2958f81784fb`::moving from state preparing -> state finished >Thread-1042::DEBUG::2014-07-10 08:13:27,764::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-1042::DEBUG::2014-07-10 08:13:27,765::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1042::DEBUG::2014-07-10 08:13:27,765::task::990::TaskManager.Task::(_decref) Task=`e1883eef-0342-4492-82ea-2958f81784fb`::ref 0 aborting False >Thread-1043::DEBUG::2014-07-10 08:13:27,769::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-1043::DEBUG::2014-07-10 08:13:27,769::task::595::TaskManager.Task::(_updateState) Task=`9e22ada0-0151-4d84-a7c3-a83d291c26d9`::moving from state init -> state preparing >Thread-1043::INFO::2014-07-10 08:13:27,770::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='411039e4-4af2-4192-9de0-67dc1ed83ba9', options=None) >Thread-1043::DEBUG::2014-07-10 08:13:27,770::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9`ReqID=`982835cb-3a8e-4cec-bd58-b351b257d10b`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo' >Thread-1043::DEBUG::2014-07-10 08:13:27,770::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' for lock type 'shared' >Thread-1043::DEBUG::2014-07-10 08:13:27,771::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' is free. Now locking as 'shared' (1 active user) >Thread-1043::DEBUG::2014-07-10 08:13:27,771::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9`ReqID=`982835cb-3a8e-4cec-bd58-b351b257d10b`::Granted request >Thread-1043::DEBUG::2014-07-10 08:13:27,772::task::827::TaskManager.Task::(resourceAcquired) Task=`9e22ada0-0151-4d84-a7c3-a83d291c26d9`::_resourcesAcquired: Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9 (shared) >Thread-1043::DEBUG::2014-07-10 08:13:27,772::task::990::TaskManager.Task::(_decref) Task=`9e22ada0-0151-4d84-a7c3-a83d291c26d9`::ref 1 aborting False >Thread-1043::INFO::2014-07-10 08:13:27,773::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DC-REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2, 'domains': u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': 'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c': {'status': u'Active', 'diskfree': '1137495244800', 'isoprefix': '', 'alerts': [], 'disktotal': '1152393412608', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532567556096', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-1043::DEBUG::2014-07-10 08:13:27,773::task::1185::TaskManager.Task::(prepare) Task=`9e22ada0-0151-4d84-a7c3-a83d291c26d9`::finished: {'info': {'name': 'DC-REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2, 'domains': u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': 'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c': {'status': u'Active', 'diskfree': '1137495244800', 'isoprefix': '', 'alerts': [], 'disktotal': '1152393412608', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532567556096', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-1043::DEBUG::2014-07-10 08:13:27,773::task::595::TaskManager.Task::(_updateState) Task=`9e22ada0-0151-4d84-a7c3-a83d291c26d9`::moving from state preparing -> state finished >Thread-1043::DEBUG::2014-07-10 08:13:27,774::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9': < ResourceRef 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9', isValid: 'True' obj: 'None'>} >Thread-1043::DEBUG::2014-07-10 08:13:27,774::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1043::DEBUG::2014-07-10 08:13:27,774::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' >Thread-1043::DEBUG::2014-07-10 08:13:27,774::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' (0 active users) >Thread-1043::DEBUG::2014-07-10 08:13:27,774::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' is free, finding out if anyone is waiting for it. >Thread-1043::DEBUG::2014-07-10 08:13:27,775::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9', Clearing records. >Thread-1043::DEBUG::2014-07-10 08:13:27,775::task::990::TaskManager.Task::(_decref) Task=`9e22ada0-0151-4d84-a7c3-a83d291c26d9`::ref 0 aborting False >Thread-1042::DEBUG::2014-07-10 08:13:28,583::task::595::TaskManager.Task::(_updateState) Task=`fcec045d-4965-4954-a69e-8f24894ac7f0`::moving from state init -> state preparing >Thread-1042::INFO::2014-07-10 08:13:28,584::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-1042::INFO::2014-07-10 08:13:28,584::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000925285', 'lastCheck': '6.3', 'valid': True}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000386949', 'lastCheck': '6.9', 'valid': True}} >Thread-1042::DEBUG::2014-07-10 08:13:28,584::task::1185::TaskManager.Task::(prepare) Task=`fcec045d-4965-4954-a69e-8f24894ac7f0`::finished: {u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000925285', 'lastCheck': '6.3', 'valid': True}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000386949', 'lastCheck': '6.9', 'valid': True}} >Thread-1042::DEBUG::2014-07-10 08:13:28,584::task::595::TaskManager.Task::(_updateState) Task=`fcec045d-4965-4954-a69e-8f24894ac7f0`::moving from state preparing -> state finished >Thread-1042::DEBUG::2014-07-10 08:13:28,585::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-1042::DEBUG::2014-07-10 08:13:28,585::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1042::DEBUG::2014-07-10 08:13:28,585::task::990::TaskManager.Task::(_decref) Task=`fcec045d-4965-4954-a69e-8f24894ac7f0`::ref 0 aborting False >Dummy-36::DEBUG::2014-07-10 08:13:28,966::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-07-10 08:13:29,098::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0355361 s, 28.8 MB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-07-10 08:13:31,114::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-07-10 08:13:31,251::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0380916 s, 26.9 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 08:13:31,661::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lion.qa.lab.tlv.redhat.com:_export_yuri2_backup2/6a70504d-00df-4869-8695-0f442053f6b6/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-14::DEBUG::2014-07-10 08:13:31,738::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n369 bytes (369 B) copied, 0.000576274 s, 640 kB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-07-10 08:13:32,319::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/e01a3a36-d2ce-4153-bb57-d6e65b7ed08c/metadata bs=4096 count=1' (cwd None) >Thread-15::DEBUG::2014-07-10 08:13:32,385::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00066954 s, 6.1 MB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-07-10 08:13:33,266::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-07-10 08:13:33,403::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0348409 s, 29.4 MB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-07-10 08:13:35,418::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-07-10 08:13:35,551::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0338141 s, 30.3 MB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-07-10 08:13:37,566::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-07-10 08:13:37,698::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0352212 s, 29.1 MB/s\n'; <rc> = 0 >Thread-1042::DEBUG::2014-07-10 08:13:37,861::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-1042::DEBUG::2014-07-10 08:13:37,862::task::595::TaskManager.Task::(_updateState) Task=`52d6f179-9803-4f5b-9f95-d8e374bf5b05`::moving from state init -> state preparing >Thread-1042::INFO::2014-07-10 08:13:37,862::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='411039e4-4af2-4192-9de0-67dc1ed83ba9', options=None) >Thread-1042::INFO::2014-07-10 08:13:37,863::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2}} >Thread-1042::DEBUG::2014-07-10 08:13:37,863::task::1185::TaskManager.Task::(prepare) Task=`52d6f179-9803-4f5b-9f95-d8e374bf5b05`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2}} >Thread-1042::DEBUG::2014-07-10 08:13:37,863::task::595::TaskManager.Task::(_updateState) Task=`52d6f179-9803-4f5b-9f95-d8e374bf5b05`::moving from state preparing -> state finished >Thread-1042::DEBUG::2014-07-10 08:13:37,863::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-1042::DEBUG::2014-07-10 08:13:37,864::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1042::DEBUG::2014-07-10 08:13:37,864::task::990::TaskManager.Task::(_decref) Task=`52d6f179-9803-4f5b-9f95-d8e374bf5b05`::ref 0 aborting False >Thread-1043::DEBUG::2014-07-10 08:13:37,867::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-1043::DEBUG::2014-07-10 08:13:37,868::task::595::TaskManager.Task::(_updateState) Task=`974fb5a2-a0c4-445e-ae1b-513a034402ce`::moving from state init -> state preparing >Thread-1043::INFO::2014-07-10 08:13:37,868::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='411039e4-4af2-4192-9de0-67dc1ed83ba9', options=None) >Thread-1043::DEBUG::2014-07-10 08:13:37,869::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9`ReqID=`79c76f21-9401-43dd-8a12-89f1feac58cb`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo' >Thread-1043::DEBUG::2014-07-10 08:13:37,869::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' for lock type 'shared' >Thread-1043::DEBUG::2014-07-10 08:13:37,869::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' is free. Now locking as 'shared' (1 active user) >Thread-1043::DEBUG::2014-07-10 08:13:37,869::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9`ReqID=`79c76f21-9401-43dd-8a12-89f1feac58cb`::Granted request >Thread-1043::DEBUG::2014-07-10 08:13:37,870::task::827::TaskManager.Task::(resourceAcquired) Task=`974fb5a2-a0c4-445e-ae1b-513a034402ce`::_resourcesAcquired: Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9 (shared) >Thread-1043::DEBUG::2014-07-10 08:13:37,870::task::990::TaskManager.Task::(_decref) Task=`974fb5a2-a0c4-445e-ae1b-513a034402ce`::ref 1 aborting False >Thread-1043::INFO::2014-07-10 08:13:37,871::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DC-REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2, 'domains': u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': 'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c': {'status': u'Active', 'diskfree': '1137495244800', 'isoprefix': '', 'alerts': [], 'disktotal': '1152393412608', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532385103872', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-1043::DEBUG::2014-07-10 08:13:37,871::task::1185::TaskManager.Task::(prepare) Task=`974fb5a2-a0c4-445e-ae1b-513a034402ce`::finished: {'info': {'name': 'DC-REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2, 'domains': u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': 'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c': {'status': u'Active', 'diskfree': '1137495244800', 'isoprefix': '', 'alerts': [], 'disktotal': '1152393412608', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532385103872', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-1043::DEBUG::2014-07-10 08:13:37,872::task::595::TaskManager.Task::(_updateState) Task=`974fb5a2-a0c4-445e-ae1b-513a034402ce`::moving from state preparing -> state finished >Thread-1043::DEBUG::2014-07-10 08:13:37,872::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9': < ResourceRef 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9', isValid: 'True' obj: 'None'>} >Thread-1043::DEBUG::2014-07-10 08:13:37,872::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1043::DEBUG::2014-07-10 08:13:37,872::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' >Thread-1043::DEBUG::2014-07-10 08:13:37,873::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' (0 active users) >Thread-1043::DEBUG::2014-07-10 08:13:37,873::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' is free, finding out if anyone is waiting for it. >Thread-1043::DEBUG::2014-07-10 08:13:37,873::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9', Clearing records. >Thread-1043::DEBUG::2014-07-10 08:13:37,873::task::990::TaskManager.Task::(_decref) Task=`974fb5a2-a0c4-445e-ae1b-513a034402ce`::ref 0 aborting False >Dummy-36::DEBUG::2014-07-10 08:13:39,713::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-07-10 08:13:39,841::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0301677 s, 33.9 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 08:13:41,764::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lion.qa.lab.tlv.redhat.com:_export_yuri2_backup2/6a70504d-00df-4869-8695-0f442053f6b6/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-14::DEBUG::2014-07-10 08:13:41,826::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n369 bytes (369 B) copied, 0.000407966 s, 904 kB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-07-10 08:13:41,856::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-07-10 08:13:42,002::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0473013 s, 21.6 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-07-10 08:13:42,415::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/e01a3a36-d2ce-4153-bb57-d6e65b7ed08c/metadata bs=4096 count=1' (cwd None) >Thread-15::DEBUG::2014-07-10 08:13:42,519::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.0402499 s, 102 kB/s\n'; <rc> = 0 >Thread-1042::DEBUG::2014-07-10 08:13:43,772::task::595::TaskManager.Task::(_updateState) Task=`4765b084-2318-476a-b69b-f7f93b4ab62c`::moving from state init -> state preparing >Thread-1042::INFO::2014-07-10 08:13:43,773::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-1042::INFO::2014-07-10 08:13:43,773::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0402499', 'lastCheck': '1.2', 'valid': True}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000407966', 'lastCheck': '1.9', 'valid': True}} >Thread-1042::DEBUG::2014-07-10 08:13:43,773::task::1185::TaskManager.Task::(prepare) Task=`4765b084-2318-476a-b69b-f7f93b4ab62c`::finished: {u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0402499', 'lastCheck': '1.2', 'valid': True}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000407966', 'lastCheck': '1.9', 'valid': True}} >Thread-1042::DEBUG::2014-07-10 08:13:43,774::task::595::TaskManager.Task::(_updateState) Task=`4765b084-2318-476a-b69b-f7f93b4ab62c`::moving from state preparing -> state finished >Thread-1042::DEBUG::2014-07-10 08:13:43,774::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-1042::DEBUG::2014-07-10 08:13:43,774::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1042::DEBUG::2014-07-10 08:13:43,774::task::990::TaskManager.Task::(_decref) Task=`4765b084-2318-476a-b69b-f7f93b4ab62c`::ref 0 aborting False >Dummy-36::DEBUG::2014-07-10 08:13:44,017::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-07-10 08:13:44,152::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0380679 s, 26.9 MB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-07-10 08:13:46,162::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-07-10 08:13:46,667::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.405453 s, 2.5 MB/s\n'; <rc> = 0 >Thread-1042::DEBUG::2014-07-10 08:13:47,903::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-1042::DEBUG::2014-07-10 08:13:47,904::task::595::TaskManager.Task::(_updateState) Task=`e632c906-96c5-438a-892f-b6064e562295`::moving from state init -> state preparing >Thread-1042::INFO::2014-07-10 08:13:47,904::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='411039e4-4af2-4192-9de0-67dc1ed83ba9', options=None) >Thread-1042::INFO::2014-07-10 08:13:47,905::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2}} >Thread-1042::DEBUG::2014-07-10 08:13:47,905::task::1185::TaskManager.Task::(prepare) Task=`e632c906-96c5-438a-892f-b6064e562295`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2}} >Thread-1042::DEBUG::2014-07-10 08:13:47,905::task::595::TaskManager.Task::(_updateState) Task=`e632c906-96c5-438a-892f-b6064e562295`::moving from state preparing -> state finished >Thread-1042::DEBUG::2014-07-10 08:13:47,905::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-1042::DEBUG::2014-07-10 08:13:47,905::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1042::DEBUG::2014-07-10 08:13:47,906::task::990::TaskManager.Task::(_decref) Task=`e632c906-96c5-438a-892f-b6064e562295`::ref 0 aborting False >Thread-1043::DEBUG::2014-07-10 08:13:47,909::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-1043::DEBUG::2014-07-10 08:13:47,910::task::595::TaskManager.Task::(_updateState) Task=`56356ed6-6af8-469c-9440-57063e427319`::moving from state init -> state preparing >Thread-1043::INFO::2014-07-10 08:13:47,910::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='411039e4-4af2-4192-9de0-67dc1ed83ba9', options=None) >Thread-1043::DEBUG::2014-07-10 08:13:47,910::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9`ReqID=`09cc11f6-85b5-4fcc-a100-532608506aa3`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo' >Thread-1043::DEBUG::2014-07-10 08:13:47,911::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' for lock type 'shared' >Thread-1043::DEBUG::2014-07-10 08:13:47,911::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' is free. Now locking as 'shared' (1 active user) >Thread-1043::DEBUG::2014-07-10 08:13:47,911::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9`ReqID=`09cc11f6-85b5-4fcc-a100-532608506aa3`::Granted request >Thread-1043::DEBUG::2014-07-10 08:13:47,912::task::827::TaskManager.Task::(resourceAcquired) Task=`56356ed6-6af8-469c-9440-57063e427319`::_resourcesAcquired: Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9 (shared) >Thread-1043::DEBUG::2014-07-10 08:13:47,912::task::990::TaskManager.Task::(_decref) Task=`56356ed6-6af8-469c-9440-57063e427319`::ref 1 aborting False >Thread-1043::INFO::2014-07-10 08:13:47,913::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DC-REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2, 'domains': u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': 'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c': {'status': u'Active', 'diskfree': '1137495244800', 'isoprefix': '', 'alerts': [], 'disktotal': '1152393412608', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532370423808', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-1043::DEBUG::2014-07-10 08:13:47,913::task::1185::TaskManager.Task::(prepare) Task=`56356ed6-6af8-469c-9440-57063e427319`::finished: {'info': {'name': 'DC-REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2, 'domains': u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': 'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c': {'status': u'Active', 'diskfree': '1137495244800', 'isoprefix': '', 'alerts': [], 'disktotal': '1152393412608', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532370423808', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-1043::DEBUG::2014-07-10 08:13:47,913::task::595::TaskManager.Task::(_updateState) Task=`56356ed6-6af8-469c-9440-57063e427319`::moving from state preparing -> state finished >Thread-1043::DEBUG::2014-07-10 08:13:47,913::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9': < ResourceRef 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9', isValid: 'True' obj: 'None'>} >Thread-1043::DEBUG::2014-07-10 08:13:47,913::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1043::DEBUG::2014-07-10 08:13:47,914::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' >Thread-1043::DEBUG::2014-07-10 08:13:47,914::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' (0 active users) >Thread-1043::DEBUG::2014-07-10 08:13:47,915::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' is free, finding out if anyone is waiting for it. >Thread-1043::DEBUG::2014-07-10 08:13:47,915::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9', Clearing records. >Thread-1043::DEBUG::2014-07-10 08:13:47,915::task::990::TaskManager.Task::(_decref) Task=`56356ed6-6af8-469c-9440-57063e427319`::ref 0 aborting False >Dummy-36::DEBUG::2014-07-10 08:13:48,682::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-07-10 08:13:48,811::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0327728 s, 31.2 MB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-07-10 08:13:50,826::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-07-10 08:13:50,969::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0422832 s, 24.2 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 08:13:51,857::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lion.qa.lab.tlv.redhat.com:_export_yuri2_backup2/6a70504d-00df-4869-8695-0f442053f6b6/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-14::DEBUG::2014-07-10 08:13:51,921::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n369 bytes (369 B) copied, 0.00061301 s, 602 kB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-07-10 08:13:52,548::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/e01a3a36-d2ce-4153-bb57-d6e65b7ed08c/metadata bs=4096 count=1' (cwd None) >Thread-15::DEBUG::2014-07-10 08:13:52,606::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000878423 s, 4.7 MB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-07-10 08:13:52,988::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-07-10 08:13:53,129::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0382921 s, 26.7 MB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-07-10 08:13:55,143::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-07-10 08:13:55,275::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0325956 s, 31.4 MB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-07-10 08:13:57,290::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-07-10 08:13:57,423::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.033315 s, 30.7 MB/s\n'; <rc> = 0 >Thread-1042::DEBUG::2014-07-10 08:13:57,953::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-1042::DEBUG::2014-07-10 08:13:57,954::task::595::TaskManager.Task::(_updateState) Task=`646729da-6244-4cb7-8725-d1b8c137bbf7`::moving from state init -> state preparing >Thread-1042::INFO::2014-07-10 08:13:57,955::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='411039e4-4af2-4192-9de0-67dc1ed83ba9', options=None) >Thread-1042::INFO::2014-07-10 08:13:57,955::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2}} >Thread-1042::DEBUG::2014-07-10 08:13:57,956::task::1185::TaskManager.Task::(prepare) Task=`646729da-6244-4cb7-8725-d1b8c137bbf7`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2}} >Thread-1042::DEBUG::2014-07-10 08:13:57,956::task::595::TaskManager.Task::(_updateState) Task=`646729da-6244-4cb7-8725-d1b8c137bbf7`::moving from state preparing -> state finished >Thread-1042::DEBUG::2014-07-10 08:13:57,956::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-1042::DEBUG::2014-07-10 08:13:57,956::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1042::DEBUG::2014-07-10 08:13:57,956::task::990::TaskManager.Task::(_decref) Task=`646729da-6244-4cb7-8725-d1b8c137bbf7`::ref 0 aborting False >Thread-1043::DEBUG::2014-07-10 08:13:57,960::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-1043::DEBUG::2014-07-10 08:13:57,961::task::595::TaskManager.Task::(_updateState) Task=`17f6ac07-3471-41a7-9f7d-32a18c249b98`::moving from state init -> state preparing >Thread-1043::INFO::2014-07-10 08:13:57,961::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='411039e4-4af2-4192-9de0-67dc1ed83ba9', options=None) >Thread-1043::DEBUG::2014-07-10 08:13:57,962::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9`ReqID=`06b7a648-2ed3-4f84-8f14-182fcfdc97d3`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo' >Thread-1043::DEBUG::2014-07-10 08:13:57,962::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' for lock type 'shared' >Thread-1043::DEBUG::2014-07-10 08:13:57,962::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' is free. Now locking as 'shared' (1 active user) >Thread-1043::DEBUG::2014-07-10 08:13:57,963::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9`ReqID=`06b7a648-2ed3-4f84-8f14-182fcfdc97d3`::Granted request >Thread-1043::DEBUG::2014-07-10 08:13:57,963::task::827::TaskManager.Task::(resourceAcquired) Task=`17f6ac07-3471-41a7-9f7d-32a18c249b98`::_resourcesAcquired: Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9 (shared) >Thread-1043::DEBUG::2014-07-10 08:13:57,963::task::990::TaskManager.Task::(_decref) Task=`17f6ac07-3471-41a7-9f7d-32a18c249b98`::ref 1 aborting False >Thread-1043::INFO::2014-07-10 08:13:57,965::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DC-REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2, 'domains': u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': 'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c': {'status': u'Active', 'diskfree': '1137495244800', 'isoprefix': '', 'alerts': [], 'disktotal': '1152393412608', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532369375232', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-1043::DEBUG::2014-07-10 08:13:57,965::task::1185::TaskManager.Task::(prepare) Task=`17f6ac07-3471-41a7-9f7d-32a18c249b98`::finished: {'info': {'name': 'DC-REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2, 'domains': u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': 'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c': {'status': u'Active', 'diskfree': '1137495244800', 'isoprefix': '', 'alerts': [], 'disktotal': '1152393412608', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532369375232', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-1043::DEBUG::2014-07-10 08:13:57,965::task::595::TaskManager.Task::(_updateState) Task=`17f6ac07-3471-41a7-9f7d-32a18c249b98`::moving from state preparing -> state finished >Thread-1043::DEBUG::2014-07-10 08:13:57,965::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9': < ResourceRef 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9', isValid: 'True' obj: 'None'>} >Thread-1043::DEBUG::2014-07-10 08:13:57,965::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1043::DEBUG::2014-07-10 08:13:57,966::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' >Thread-1043::DEBUG::2014-07-10 08:13:57,966::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' (0 active users) >Thread-1043::DEBUG::2014-07-10 08:13:57,966::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' is free, finding out if anyone is waiting for it. >Thread-1043::DEBUG::2014-07-10 08:13:57,966::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9', Clearing records. >Thread-1043::DEBUG::2014-07-10 08:13:57,966::task::990::TaskManager.Task::(_decref) Task=`17f6ac07-3471-41a7-9f7d-32a18c249b98`::ref 0 aborting False >Thread-1042::DEBUG::2014-07-10 08:13:58,913::task::595::TaskManager.Task::(_updateState) Task=`795d1e32-cb70-460d-9815-4b5c90bc1fec`::moving from state init -> state preparing >Thread-1042::INFO::2014-07-10 08:13:58,913::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-1042::INFO::2014-07-10 08:13:58,914::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000878423', 'lastCheck': '6.3', 'valid': True}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00061301', 'lastCheck': '7.0', 'valid': True}} >Thread-1042::DEBUG::2014-07-10 08:13:58,914::task::1185::TaskManager.Task::(prepare) Task=`795d1e32-cb70-460d-9815-4b5c90bc1fec`::finished: {u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000878423', 'lastCheck': '6.3', 'valid': True}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00061301', 'lastCheck': '7.0', 'valid': True}} >Thread-1042::DEBUG::2014-07-10 08:13:58,914::task::595::TaskManager.Task::(_updateState) Task=`795d1e32-cb70-460d-9815-4b5c90bc1fec`::moving from state preparing -> state finished >Thread-1042::DEBUG::2014-07-10 08:13:58,914::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-1042::DEBUG::2014-07-10 08:13:58,914::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1042::DEBUG::2014-07-10 08:13:58,914::task::990::TaskManager.Task::(_decref) Task=`795d1e32-cb70-460d-9815-4b5c90bc1fec`::ref 0 aborting False >Dummy-36::DEBUG::2014-07-10 08:13:59,439::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-07-10 08:13:59,571::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.033275 s, 30.8 MB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-07-10 08:14:01,586::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-07-10 08:14:01,722::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0380001 s, 26.9 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 08:14:01,951::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lion.qa.lab.tlv.redhat.com:_export_yuri2_backup2/6a70504d-00df-4869-8695-0f442053f6b6/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-14::DEBUG::2014-07-10 08:14:02,027::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n369 bytes (369 B) copied, 0.000427285 s, 864 kB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-07-10 08:14:02,635::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/e01a3a36-d2ce-4153-bb57-d6e65b7ed08c/metadata bs=4096 count=1' (cwd None) >Thread-15::DEBUG::2014-07-10 08:14:02,693::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000796538 s, 5.1 MB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-07-10 08:14:03,737::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-07-10 08:14:03,879::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0359277 s, 28.5 MB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-07-10 08:14:05,894::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-07-10 08:14:06,024::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0370344 s, 27.6 MB/s\n'; <rc> = 0 >Thread-1042::DEBUG::2014-07-10 08:14:08,004::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-1042::DEBUG::2014-07-10 08:14:08,005::task::595::TaskManager.Task::(_updateState) Task=`e44bbace-a654-4b7d-aa3d-93a9823b69a8`::moving from state init -> state preparing >Thread-1042::INFO::2014-07-10 08:14:08,006::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='411039e4-4af2-4192-9de0-67dc1ed83ba9', options=None) >Thread-1042::INFO::2014-07-10 08:14:08,006::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2}} >Thread-1042::DEBUG::2014-07-10 08:14:08,007::task::1185::TaskManager.Task::(prepare) Task=`e44bbace-a654-4b7d-aa3d-93a9823b69a8`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2}} >Thread-1042::DEBUG::2014-07-10 08:14:08,007::task::595::TaskManager.Task::(_updateState) Task=`e44bbace-a654-4b7d-aa3d-93a9823b69a8`::moving from state preparing -> state finished >Thread-1042::DEBUG::2014-07-10 08:14:08,007::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-1042::DEBUG::2014-07-10 08:14:08,007::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1042::DEBUG::2014-07-10 08:14:08,007::task::990::TaskManager.Task::(_decref) Task=`e44bbace-a654-4b7d-aa3d-93a9823b69a8`::ref 0 aborting False >Thread-1043::DEBUG::2014-07-10 08:14:08,011::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-1043::DEBUG::2014-07-10 08:14:08,012::task::595::TaskManager.Task::(_updateState) Task=`b0047567-b7c8-4677-8236-3465827b3f1c`::moving from state init -> state preparing >Thread-1043::INFO::2014-07-10 08:14:08,012::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='411039e4-4af2-4192-9de0-67dc1ed83ba9', options=None) >Thread-1043::DEBUG::2014-07-10 08:14:08,013::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9`ReqID=`9855a2cb-7ec8-452c-856c-729ceed14c8a`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo' >Thread-1043::DEBUG::2014-07-10 08:14:08,013::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' for lock type 'shared' >Thread-1043::DEBUG::2014-07-10 08:14:08,013::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' is free. Now locking as 'shared' (1 active user) >Thread-1043::DEBUG::2014-07-10 08:14:08,014::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9`ReqID=`9855a2cb-7ec8-452c-856c-729ceed14c8a`::Granted request >Thread-1043::DEBUG::2014-07-10 08:14:08,014::task::827::TaskManager.Task::(resourceAcquired) Task=`b0047567-b7c8-4677-8236-3465827b3f1c`::_resourcesAcquired: Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9 (shared) >Thread-1043::DEBUG::2014-07-10 08:14:08,014::task::990::TaskManager.Task::(_decref) Task=`b0047567-b7c8-4677-8236-3465827b3f1c`::ref 1 aborting False >Thread-1043::INFO::2014-07-10 08:14:08,015::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DC-REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2, 'domains': u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': 'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c': {'status': u'Active', 'diskfree': '1137495244800', 'isoprefix': '', 'alerts': [], 'disktotal': '1152393412608', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532271857664', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-1043::DEBUG::2014-07-10 08:14:08,016::task::1185::TaskManager.Task::(prepare) Task=`b0047567-b7c8-4677-8236-3465827b3f1c`::finished: {'info': {'name': 'DC-REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2, 'domains': u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': 'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c': {'status': u'Active', 'diskfree': '1137495244800', 'isoprefix': '', 'alerts': [], 'disktotal': '1152393412608', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532271857664', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-1043::DEBUG::2014-07-10 08:14:08,016::task::595::TaskManager.Task::(_updateState) Task=`b0047567-b7c8-4677-8236-3465827b3f1c`::moving from state preparing -> state finished >Thread-1043::DEBUG::2014-07-10 08:14:08,016::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9': < ResourceRef 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9', isValid: 'True' obj: 'None'>} >Thread-1043::DEBUG::2014-07-10 08:14:08,016::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1043::DEBUG::2014-07-10 08:14:08,017::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' >Thread-1043::DEBUG::2014-07-10 08:14:08,017::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' (0 active users) >Thread-1043::DEBUG::2014-07-10 08:14:08,017::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' is free, finding out if anyone is waiting for it. >Thread-1043::DEBUG::2014-07-10 08:14:08,017::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9', Clearing records. >Thread-1043::DEBUG::2014-07-10 08:14:08,017::task::990::TaskManager.Task::(_decref) Task=`b0047567-b7c8-4677-8236-3465827b3f1c`::ref 0 aborting False >Dummy-36::DEBUG::2014-07-10 08:14:08,039::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-07-10 08:14:08,170::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0360218 s, 28.4 MB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-07-10 08:14:10,179::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-07-10 08:14:10,310::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0328387 s, 31.2 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 08:14:12,052::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lion.qa.lab.tlv.redhat.com:_export_yuri2_backup2/6a70504d-00df-4869-8695-0f442053f6b6/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-14::DEBUG::2014-07-10 08:14:12,115::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n369 bytes (369 B) copied, 0.000450064 s, 820 kB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-07-10 08:14:12,326::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-07-10 08:14:12,465::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0373381 s, 27.4 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-07-10 08:14:12,723::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/e01a3a36-d2ce-4153-bb57-d6e65b7ed08c/metadata bs=4096 count=1' (cwd None) >Thread-15::DEBUG::2014-07-10 08:14:12,788::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000615254 s, 6.7 MB/s\n'; <rc> = 0 >Thread-1042::DEBUG::2014-07-10 08:14:14,160::task::595::TaskManager.Task::(_updateState) Task=`a5120d43-3fb7-410f-bafd-642cbcfe8a37`::moving from state init -> state preparing >Thread-1042::INFO::2014-07-10 08:14:14,161::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-1042::INFO::2014-07-10 08:14:14,161::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000615254', 'lastCheck': '1.3', 'valid': True}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000450064', 'lastCheck': '2.0', 'valid': True}} >Thread-1042::DEBUG::2014-07-10 08:14:14,161::task::1185::TaskManager.Task::(prepare) Task=`a5120d43-3fb7-410f-bafd-642cbcfe8a37`::finished: {u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000615254', 'lastCheck': '1.3', 'valid': True}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000450064', 'lastCheck': '2.0', 'valid': True}} >Thread-1042::DEBUG::2014-07-10 08:14:14,162::task::595::TaskManager.Task::(_updateState) Task=`a5120d43-3fb7-410f-bafd-642cbcfe8a37`::moving from state preparing -> state finished >Thread-1042::DEBUG::2014-07-10 08:14:14,162::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-1042::DEBUG::2014-07-10 08:14:14,162::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1042::DEBUG::2014-07-10 08:14:14,162::task::990::TaskManager.Task::(_decref) Task=`a5120d43-3fb7-410f-bafd-642cbcfe8a37`::ref 0 aborting False >Dummy-36::DEBUG::2014-07-10 08:14:14,480::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-07-10 08:14:14,616::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0325116 s, 31.5 MB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-07-10 08:14:16,631::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-07-10 08:14:17,212::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.481971 s, 2.1 MB/s\n'; <rc> = 0 >Thread-1042::DEBUG::2014-07-10 08:14:18,094::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-1042::DEBUG::2014-07-10 08:14:18,095::task::595::TaskManager.Task::(_updateState) Task=`53253842-b5fd-4ae5-b363-6fb088c342a0`::moving from state init -> state preparing >Thread-1042::INFO::2014-07-10 08:14:18,095::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='411039e4-4af2-4192-9de0-67dc1ed83ba9', options=None) >Thread-1042::INFO::2014-07-10 08:14:18,096::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2}} >Thread-1042::DEBUG::2014-07-10 08:14:18,096::task::1185::TaskManager.Task::(prepare) Task=`53253842-b5fd-4ae5-b363-6fb088c342a0`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2}} >Thread-1042::DEBUG::2014-07-10 08:14:18,096::task::595::TaskManager.Task::(_updateState) Task=`53253842-b5fd-4ae5-b363-6fb088c342a0`::moving from state preparing -> state finished >Thread-1042::DEBUG::2014-07-10 08:14:18,096::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-1042::DEBUG::2014-07-10 08:14:18,097::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1042::DEBUG::2014-07-10 08:14:18,097::task::990::TaskManager.Task::(_decref) Task=`53253842-b5fd-4ae5-b363-6fb088c342a0`::ref 0 aborting False >Thread-1043::DEBUG::2014-07-10 08:14:18,100::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-1043::DEBUG::2014-07-10 08:14:18,101::task::595::TaskManager.Task::(_updateState) Task=`f1b7922d-2bcf-4733-8a62-2662c3539b2f`::moving from state init -> state preparing >Thread-1043::INFO::2014-07-10 08:14:18,101::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='411039e4-4af2-4192-9de0-67dc1ed83ba9', options=None) >Thread-1043::DEBUG::2014-07-10 08:14:18,102::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9`ReqID=`7876d9b8-faf1-4cc7-9fd1-bc91420686f8`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo' >Thread-1043::DEBUG::2014-07-10 08:14:18,102::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' for lock type 'shared' >Thread-1043::DEBUG::2014-07-10 08:14:18,102::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' is free. Now locking as 'shared' (1 active user) >Thread-1043::DEBUG::2014-07-10 08:14:18,103::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9`ReqID=`7876d9b8-faf1-4cc7-9fd1-bc91420686f8`::Granted request >Thread-1043::DEBUG::2014-07-10 08:14:18,103::task::827::TaskManager.Task::(resourceAcquired) Task=`f1b7922d-2bcf-4733-8a62-2662c3539b2f`::_resourcesAcquired: Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9 (shared) >Thread-1043::DEBUG::2014-07-10 08:14:18,103::task::990::TaskManager.Task::(_decref) Task=`f1b7922d-2bcf-4733-8a62-2662c3539b2f`::ref 1 aborting False >Thread-1043::INFO::2014-07-10 08:14:18,104::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DC-REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2, 'domains': u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': 'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c': {'status': u'Active', 'diskfree': '1137495244800', 'isoprefix': '', 'alerts': [], 'disktotal': '1152393412608', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532193214464', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-1043::DEBUG::2014-07-10 08:14:18,105::task::1185::TaskManager.Task::(prepare) Task=`f1b7922d-2bcf-4733-8a62-2662c3539b2f`::finished: {'info': {'name': 'DC-REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2, 'domains': u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': 'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c': {'status': u'Active', 'diskfree': '1137495244800', 'isoprefix': '', 'alerts': [], 'disktotal': '1152393412608', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532193214464', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-1043::DEBUG::2014-07-10 08:14:18,105::task::595::TaskManager.Task::(_updateState) Task=`f1b7922d-2bcf-4733-8a62-2662c3539b2f`::moving from state preparing -> state finished >Thread-1043::DEBUG::2014-07-10 08:14:18,105::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9': < ResourceRef 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9', isValid: 'True' obj: 'None'>} >Thread-1043::DEBUG::2014-07-10 08:14:18,105::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1043::DEBUG::2014-07-10 08:14:18,106::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' >Thread-1043::DEBUG::2014-07-10 08:14:18,106::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' (0 active users) >Thread-1043::DEBUG::2014-07-10 08:14:18,106::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' is free, finding out if anyone is waiting for it. >Thread-1043::DEBUG::2014-07-10 08:14:18,106::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9', Clearing records. >Thread-1043::DEBUG::2014-07-10 08:14:18,106::task::990::TaskManager.Task::(_decref) Task=`f1b7922d-2bcf-4733-8a62-2662c3539b2f`::ref 0 aborting False >Dummy-36::DEBUG::2014-07-10 08:14:19,227::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-07-10 08:14:19,363::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0361495 s, 28.3 MB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-07-10 08:14:21,378::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-07-10 08:14:21,514::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0373531 s, 27.4 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 08:14:22,145::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lion.qa.lab.tlv.redhat.com:_export_yuri2_backup2/6a70504d-00df-4869-8695-0f442053f6b6/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-14::DEBUG::2014-07-10 08:14:22,204::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n369 bytes (369 B) copied, 0.000462373 s, 798 kB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-07-10 08:14:22,817::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/e01a3a36-d2ce-4153-bb57-d6e65b7ed08c/metadata bs=4096 count=1' (cwd None) >Thread-15::DEBUG::2014-07-10 08:14:22,875::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000621903 s, 6.6 MB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-07-10 08:14:23,529::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-07-10 08:14:23,698::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0760733 s, 13.5 MB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-07-10 08:14:25,714::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-07-10 08:14:25,851::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0383513 s, 26.7 MB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-07-10 08:14:27,866::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-07-10 08:14:28,003::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0357555 s, 28.6 MB/s\n'; <rc> = 0 >Thread-1042::DEBUG::2014-07-10 08:14:28,137::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-1042::DEBUG::2014-07-10 08:14:28,138::task::595::TaskManager.Task::(_updateState) Task=`1f4014fb-3afd-4286-97bd-0e9465b05258`::moving from state init -> state preparing >Thread-1042::INFO::2014-07-10 08:14:28,139::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='411039e4-4af2-4192-9de0-67dc1ed83ba9', options=None) >Thread-1042::INFO::2014-07-10 08:14:28,139::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2}} >Thread-1042::DEBUG::2014-07-10 08:14:28,139::task::1185::TaskManager.Task::(prepare) Task=`1f4014fb-3afd-4286-97bd-0e9465b05258`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2}} >Thread-1042::DEBUG::2014-07-10 08:14:28,140::task::595::TaskManager.Task::(_updateState) Task=`1f4014fb-3afd-4286-97bd-0e9465b05258`::moving from state preparing -> state finished >Thread-1042::DEBUG::2014-07-10 08:14:28,140::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-1042::DEBUG::2014-07-10 08:14:28,140::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1042::DEBUG::2014-07-10 08:14:28,140::task::990::TaskManager.Task::(_decref) Task=`1f4014fb-3afd-4286-97bd-0e9465b05258`::ref 0 aborting False >Thread-1043::DEBUG::2014-07-10 08:14:28,144::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-1043::DEBUG::2014-07-10 08:14:28,145::task::595::TaskManager.Task::(_updateState) Task=`dab40716-1e0c-4aad-a41d-0355326cef48`::moving from state init -> state preparing >Thread-1043::INFO::2014-07-10 08:14:28,145::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='411039e4-4af2-4192-9de0-67dc1ed83ba9', options=None) >Thread-1043::DEBUG::2014-07-10 08:14:28,146::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9`ReqID=`37cdfe0a-096a-4855-99c8-1985d33c556a`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo' >Thread-1043::DEBUG::2014-07-10 08:14:28,146::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' for lock type 'shared' >Thread-1043::DEBUG::2014-07-10 08:14:28,146::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' is free. Now locking as 'shared' (1 active user) >Thread-1043::DEBUG::2014-07-10 08:14:28,147::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9`ReqID=`37cdfe0a-096a-4855-99c8-1985d33c556a`::Granted request >Thread-1043::DEBUG::2014-07-10 08:14:28,147::task::827::TaskManager.Task::(resourceAcquired) Task=`dab40716-1e0c-4aad-a41d-0355326cef48`::_resourcesAcquired: Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9 (shared) >Thread-1043::DEBUG::2014-07-10 08:14:28,147::task::990::TaskManager.Task::(_decref) Task=`dab40716-1e0c-4aad-a41d-0355326cef48`::ref 1 aborting False >Thread-1043::INFO::2014-07-10 08:14:28,149::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DC-REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2, 'domains': u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': 'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c': {'status': u'Active', 'diskfree': '1137495244800', 'isoprefix': '', 'alerts': [], 'disktotal': '1152393412608', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532193214464', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-1043::DEBUG::2014-07-10 08:14:28,149::task::1185::TaskManager.Task::(prepare) Task=`dab40716-1e0c-4aad-a41d-0355326cef48`::finished: {'info': {'name': 'DC-REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2, 'domains': u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': 'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c': {'status': u'Active', 'diskfree': '1137495244800', 'isoprefix': '', 'alerts': [], 'disktotal': '1152393412608', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532193214464', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-1043::DEBUG::2014-07-10 08:14:28,149::task::595::TaskManager.Task::(_updateState) Task=`dab40716-1e0c-4aad-a41d-0355326cef48`::moving from state preparing -> state finished >Thread-1043::DEBUG::2014-07-10 08:14:28,149::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9': < ResourceRef 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9', isValid: 'True' obj: 'None'>} >Thread-1043::DEBUG::2014-07-10 08:14:28,149::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1043::DEBUG::2014-07-10 08:14:28,150::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' >Thread-1043::DEBUG::2014-07-10 08:14:28,150::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' (0 active users) >Thread-1043::DEBUG::2014-07-10 08:14:28,150::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' is free, finding out if anyone is waiting for it. >Thread-1043::DEBUG::2014-07-10 08:14:28,150::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9', Clearing records. >Thread-1043::DEBUG::2014-07-10 08:14:28,150::task::990::TaskManager.Task::(_decref) Task=`dab40716-1e0c-4aad-a41d-0355326cef48`::ref 0 aborting False >Thread-1042::DEBUG::2014-07-10 08:14:29,320::task::595::TaskManager.Task::(_updateState) Task=`2a56cfa3-40bb-45b8-b756-cc089e38d43f`::moving from state init -> state preparing >Thread-1042::INFO::2014-07-10 08:14:29,320::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-1042::INFO::2014-07-10 08:14:29,320::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000621903', 'lastCheck': '6.4', 'valid': True}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000462373', 'lastCheck': '7.1', 'valid': True}} >Thread-1042::DEBUG::2014-07-10 08:14:29,320::task::1185::TaskManager.Task::(prepare) Task=`2a56cfa3-40bb-45b8-b756-cc089e38d43f`::finished: {u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000621903', 'lastCheck': '6.4', 'valid': True}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000462373', 'lastCheck': '7.1', 'valid': True}} >Thread-1042::DEBUG::2014-07-10 08:14:29,320::task::595::TaskManager.Task::(_updateState) Task=`2a56cfa3-40bb-45b8-b756-cc089e38d43f`::moving from state preparing -> state finished >Thread-1042::DEBUG::2014-07-10 08:14:29,321::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-1042::DEBUG::2014-07-10 08:14:29,321::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1042::DEBUG::2014-07-10 08:14:29,321::task::990::TaskManager.Task::(_decref) Task=`2a56cfa3-40bb-45b8-b756-cc089e38d43f`::ref 0 aborting False >Dummy-36::DEBUG::2014-07-10 08:14:30,018::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-07-10 08:14:30,148::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.033006 s, 31.0 MB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-07-10 08:14:32,163::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Thread-14::DEBUG::2014-07-10 08:14:32,266::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lion.qa.lab.tlv.redhat.com:_export_yuri2_backup2/6a70504d-00df-4869-8695-0f442053f6b6/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-14::DEBUG::2014-07-10 08:14:32,354::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n369 bytes (369 B) copied, 0.00042848 s, 861 kB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-07-10 08:14:32,443::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.16816 s, 6.1 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-07-10 08:14:32,904::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/e01a3a36-d2ce-4153-bb57-d6e65b7ed08c/metadata bs=4096 count=1' (cwd None) >Thread-15::DEBUG::2014-07-10 08:14:32,969::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000851228 s, 4.8 MB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-07-10 08:14:34,459::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-07-10 08:14:34,601::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0382862 s, 26.7 MB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-07-10 08:14:36,617::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-07-10 08:14:36,756::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0375845 s, 27.2 MB/s\n'; <rc> = 0 >Thread-1042::DEBUG::2014-07-10 08:14:38,229::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-1042::DEBUG::2014-07-10 08:14:38,230::task::595::TaskManager.Task::(_updateState) Task=`1659c2f3-62dd-4aec-8aec-3b1c6eaa72f6`::moving from state init -> state preparing >Thread-1042::INFO::2014-07-10 08:14:38,230::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='411039e4-4af2-4192-9de0-67dc1ed83ba9', options=None) >Thread-1042::INFO::2014-07-10 08:14:38,231::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2}} >Thread-1042::DEBUG::2014-07-10 08:14:38,231::task::1185::TaskManager.Task::(prepare) Task=`1659c2f3-62dd-4aec-8aec-3b1c6eaa72f6`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2}} >Thread-1042::DEBUG::2014-07-10 08:14:38,231::task::595::TaskManager.Task::(_updateState) Task=`1659c2f3-62dd-4aec-8aec-3b1c6eaa72f6`::moving from state preparing -> state finished >Thread-1042::DEBUG::2014-07-10 08:14:38,232::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-1042::DEBUG::2014-07-10 08:14:38,232::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1042::DEBUG::2014-07-10 08:14:38,232::task::990::TaskManager.Task::(_decref) Task=`1659c2f3-62dd-4aec-8aec-3b1c6eaa72f6`::ref 0 aborting False >Thread-1043::DEBUG::2014-07-10 08:14:38,236::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-1043::DEBUG::2014-07-10 08:14:38,236::task::595::TaskManager.Task::(_updateState) Task=`549e4dc2-ff9d-40f7-bcc8-c4a0685fd8d6`::moving from state init -> state preparing >Thread-1043::INFO::2014-07-10 08:14:38,236::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='411039e4-4af2-4192-9de0-67dc1ed83ba9', options=None) >Thread-1043::DEBUG::2014-07-10 08:14:38,237::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9`ReqID=`4c8c525a-a978-49e9-8332-1777fa71d8ad`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo' >Thread-1043::DEBUG::2014-07-10 08:14:38,237::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' for lock type 'shared' >Thread-1043::DEBUG::2014-07-10 08:14:38,238::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' is free. Now locking as 'shared' (1 active user) >Thread-1043::DEBUG::2014-07-10 08:14:38,238::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9`ReqID=`4c8c525a-a978-49e9-8332-1777fa71d8ad`::Granted request >Thread-1043::DEBUG::2014-07-10 08:14:38,238::task::827::TaskManager.Task::(resourceAcquired) Task=`549e4dc2-ff9d-40f7-bcc8-c4a0685fd8d6`::_resourcesAcquired: Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9 (shared) >Thread-1043::DEBUG::2014-07-10 08:14:38,238::task::990::TaskManager.Task::(_decref) Task=`549e4dc2-ff9d-40f7-bcc8-c4a0685fd8d6`::ref 1 aborting False >Thread-1043::INFO::2014-07-10 08:14:38,239::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DC-REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2, 'domains': u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': 'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c': {'status': u'Active', 'diskfree': '1137495244800', 'isoprefix': '', 'alerts': [], 'disktotal': '1152393412608', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532103036928', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-1043::DEBUG::2014-07-10 08:14:38,240::task::1185::TaskManager.Task::(prepare) Task=`549e4dc2-ff9d-40f7-bcc8-c4a0685fd8d6`::finished: {'info': {'name': 'DC-REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2, 'domains': u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': 'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c': {'status': u'Active', 'diskfree': '1137495244800', 'isoprefix': '', 'alerts': [], 'disktotal': '1152393412608', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532103036928', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-1043::DEBUG::2014-07-10 08:14:38,240::task::595::TaskManager.Task::(_updateState) Task=`549e4dc2-ff9d-40f7-bcc8-c4a0685fd8d6`::moving from state preparing -> state finished >Thread-1043::DEBUG::2014-07-10 08:14:38,240::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9': < ResourceRef 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9', isValid: 'True' obj: 'None'>} >Thread-1043::DEBUG::2014-07-10 08:14:38,240::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1043::DEBUG::2014-07-10 08:14:38,240::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' >Thread-1043::DEBUG::2014-07-10 08:14:38,241::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' (0 active users) >Thread-1043::DEBUG::2014-07-10 08:14:38,241::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' is free, finding out if anyone is waiting for it. >Thread-1043::DEBUG::2014-07-10 08:14:38,241::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9', Clearing records. >Thread-1043::DEBUG::2014-07-10 08:14:38,241::task::990::TaskManager.Task::(_decref) Task=`549e4dc2-ff9d-40f7-bcc8-c4a0685fd8d6`::ref 0 aborting False >Dummy-36::DEBUG::2014-07-10 08:14:38,771::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-07-10 08:14:38,898::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0295235 s, 34.7 MB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-07-10 08:14:40,913::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-07-10 08:14:41,048::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0380141 s, 26.9 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 08:14:42,396::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lion.qa.lab.tlv.redhat.com:_export_yuri2_backup2/6a70504d-00df-4869-8695-0f442053f6b6/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-14::DEBUG::2014-07-10 08:14:42,458::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n369 bytes (369 B) copied, 0.000402946 s, 916 kB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-07-10 08:14:43,000::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/e01a3a36-d2ce-4153-bb57-d6e65b7ed08c/metadata bs=4096 count=1' (cwd None) >Thread-15::DEBUG::2014-07-10 08:14:43,058::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000795394 s, 5.1 MB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-07-10 08:14:43,068::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-07-10 08:14:43,375::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.201625 s, 5.1 MB/s\n'; <rc> = 0 >Thread-1042::DEBUG::2014-07-10 08:14:44,455::task::595::TaskManager.Task::(_updateState) Task=`a0ac2851-4834-4067-8987-a801745a7c70`::moving from state init -> state preparing >Thread-1042::INFO::2014-07-10 08:14:44,456::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-1042::INFO::2014-07-10 08:14:44,456::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000795394', 'lastCheck': '1.1', 'valid': True}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000402946', 'lastCheck': '2.0', 'valid': True}} >Thread-1042::DEBUG::2014-07-10 08:14:44,456::task::1185::TaskManager.Task::(prepare) Task=`a0ac2851-4834-4067-8987-a801745a7c70`::finished: {u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000795394', 'lastCheck': '1.1', 'valid': True}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000402946', 'lastCheck': '2.0', 'valid': True}} >Thread-1042::DEBUG::2014-07-10 08:14:44,457::task::595::TaskManager.Task::(_updateState) Task=`a0ac2851-4834-4067-8987-a801745a7c70`::moving from state preparing -> state finished >Thread-1042::DEBUG::2014-07-10 08:14:44,457::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-1042::DEBUG::2014-07-10 08:14:44,457::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1042::DEBUG::2014-07-10 08:14:44,457::task::990::TaskManager.Task::(_decref) Task=`a0ac2851-4834-4067-8987-a801745a7c70`::ref 0 aborting False >Dummy-36::DEBUG::2014-07-10 08:14:45,390::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-07-10 08:14:45,527::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0329648 s, 31.1 MB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-07-10 08:14:47,542::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-07-10 08:14:47,673::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0322366 s, 31.8 MB/s\n'; <rc> = 0 >Thread-1042::DEBUG::2014-07-10 08:14:48,279::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-1042::DEBUG::2014-07-10 08:14:48,281::task::595::TaskManager.Task::(_updateState) Task=`b9e30c67-974f-4a0f-8fbd-69f2ae85098f`::moving from state init -> state preparing >Thread-1042::INFO::2014-07-10 08:14:48,281::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='411039e4-4af2-4192-9de0-67dc1ed83ba9', options=None) >Thread-1042::INFO::2014-07-10 08:14:48,282::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2}} >Thread-1042::DEBUG::2014-07-10 08:14:48,282::task::1185::TaskManager.Task::(prepare) Task=`b9e30c67-974f-4a0f-8fbd-69f2ae85098f`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2}} >Thread-1042::DEBUG::2014-07-10 08:14:48,282::task::595::TaskManager.Task::(_updateState) Task=`b9e30c67-974f-4a0f-8fbd-69f2ae85098f`::moving from state preparing -> state finished >Thread-1042::DEBUG::2014-07-10 08:14:48,282::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-1042::DEBUG::2014-07-10 08:14:48,282::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1042::DEBUG::2014-07-10 08:14:48,283::task::990::TaskManager.Task::(_decref) Task=`b9e30c67-974f-4a0f-8fbd-69f2ae85098f`::ref 0 aborting False >Thread-1043::DEBUG::2014-07-10 08:14:48,286::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-1043::DEBUG::2014-07-10 08:14:48,287::task::595::TaskManager.Task::(_updateState) Task=`4c5860ba-ba7c-4d22-8cde-1a5b77fff70b`::moving from state init -> state preparing >Thread-1043::INFO::2014-07-10 08:14:48,287::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='411039e4-4af2-4192-9de0-67dc1ed83ba9', options=None) >Thread-1043::DEBUG::2014-07-10 08:14:48,288::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9`ReqID=`32766b90-39a4-4dcf-9927-608e39d792ee`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo' >Thread-1043::DEBUG::2014-07-10 08:14:48,288::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' for lock type 'shared' >Thread-1043::DEBUG::2014-07-10 08:14:48,288::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' is free. Now locking as 'shared' (1 active user) >Thread-1043::DEBUG::2014-07-10 08:14:48,289::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9`ReqID=`32766b90-39a4-4dcf-9927-608e39d792ee`::Granted request >Thread-1043::DEBUG::2014-07-10 08:14:48,289::task::827::TaskManager.Task::(resourceAcquired) Task=`4c5860ba-ba7c-4d22-8cde-1a5b77fff70b`::_resourcesAcquired: Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9 (shared) >Thread-1043::DEBUG::2014-07-10 08:14:48,289::task::990::TaskManager.Task::(_decref) Task=`4c5860ba-ba7c-4d22-8cde-1a5b77fff70b`::ref 1 aborting False >Thread-1043::INFO::2014-07-10 08:14:48,291::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DC-REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2, 'domains': u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': 'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c': {'status': u'Active', 'diskfree': '1137495244800', 'isoprefix': '', 'alerts': [], 'disktotal': '1152393412608', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532057948160', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-1043::DEBUG::2014-07-10 08:14:48,291::task::1185::TaskManager.Task::(prepare) Task=`4c5860ba-ba7c-4d22-8cde-1a5b77fff70b`::finished: {'info': {'name': 'DC-REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2, 'domains': u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': 'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c': {'status': u'Active', 'diskfree': '1137495244800', 'isoprefix': '', 'alerts': [], 'disktotal': '1152393412608', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532057948160', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-1043::DEBUG::2014-07-10 08:14:48,291::task::595::TaskManager.Task::(_updateState) Task=`4c5860ba-ba7c-4d22-8cde-1a5b77fff70b`::moving from state preparing -> state finished >Thread-1043::DEBUG::2014-07-10 08:14:48,291::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9': < ResourceRef 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9', isValid: 'True' obj: 'None'>} >Thread-1043::DEBUG::2014-07-10 08:14:48,291::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1043::DEBUG::2014-07-10 08:14:48,292::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' >Thread-1043::DEBUG::2014-07-10 08:14:48,292::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' (0 active users) >Thread-1043::DEBUG::2014-07-10 08:14:48,292::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' is free, finding out if anyone is waiting for it. >Thread-1043::DEBUG::2014-07-10 08:14:48,292::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9', Clearing records. >Thread-1043::DEBUG::2014-07-10 08:14:48,293::task::990::TaskManager.Task::(_decref) Task=`4c5860ba-ba7c-4d22-8cde-1a5b77fff70b`::ref 0 aborting False >Dummy-36::DEBUG::2014-07-10 08:14:49,688::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-07-10 08:14:49,821::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.035848 s, 28.6 MB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-07-10 08:14:51,836::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-07-10 08:14:51,978::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0343929 s, 29.8 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 08:14:52,490::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lion.qa.lab.tlv.redhat.com:_export_yuri2_backup2/6a70504d-00df-4869-8695-0f442053f6b6/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-14::DEBUG::2014-07-10 08:14:52,551::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n369 bytes (369 B) copied, 0.000590026 s, 625 kB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-07-10 08:14:53,316::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/e01a3a36-d2ce-4153-bb57-d6e65b7ed08c/metadata bs=4096 count=1' (cwd None) >Thread-15::DEBUG::2014-07-10 08:14:53,376::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00350616 s, 1.2 MB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-07-10 08:14:53,993::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-07-10 08:14:54,127::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0381045 s, 26.9 MB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-07-10 08:14:56,142::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-07-10 08:14:56,269::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0371424 s, 27.6 MB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-07-10 08:14:58,279::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Thread-1042::DEBUG::2014-07-10 08:14:58,345::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-1042::DEBUG::2014-07-10 08:14:58,349::task::595::TaskManager.Task::(_updateState) Task=`1bcd4e12-c7c8-45e4-b8ef-d5456d1c5aa4`::moving from state init -> state preparing >Thread-1042::INFO::2014-07-10 08:14:58,352::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='411039e4-4af2-4192-9de0-67dc1ed83ba9', options=None) >Thread-1042::INFO::2014-07-10 08:14:58,357::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2}} >Thread-1042::DEBUG::2014-07-10 08:14:58,359::task::1185::TaskManager.Task::(prepare) Task=`1bcd4e12-c7c8-45e4-b8ef-d5456d1c5aa4`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2}} >Thread-1042::DEBUG::2014-07-10 08:14:58,362::task::595::TaskManager.Task::(_updateState) Task=`1bcd4e12-c7c8-45e4-b8ef-d5456d1c5aa4`::moving from state preparing -> state finished >Thread-1042::DEBUG::2014-07-10 08:14:58,364::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-1042::DEBUG::2014-07-10 08:14:58,367::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1042::DEBUG::2014-07-10 08:14:58,369::task::990::TaskManager.Task::(_decref) Task=`1bcd4e12-c7c8-45e4-b8ef-d5456d1c5aa4`::ref 0 aborting False >Thread-1043::DEBUG::2014-07-10 08:14:58,384::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-1043::DEBUG::2014-07-10 08:14:58,387::task::595::TaskManager.Task::(_updateState) Task=`282271c8-b4f8-4b32-9fca-e7d18ca7cacb`::moving from state init -> state preparing >Thread-1043::INFO::2014-07-10 08:14:58,390::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='411039e4-4af2-4192-9de0-67dc1ed83ba9', options=None) >Thread-1043::DEBUG::2014-07-10 08:14:58,397::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9`ReqID=`d7d174fe-f53c-4694-90b6-de7e21dd144b`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo' >Thread-1043::DEBUG::2014-07-10 08:14:58,399::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' for lock type 'shared' >Thread-1043::DEBUG::2014-07-10 08:14:58,403::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' is free. Now locking as 'shared' (1 active user) >Thread-1043::DEBUG::2014-07-10 08:14:58,406::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9`ReqID=`d7d174fe-f53c-4694-90b6-de7e21dd144b`::Granted request >Thread-1043::DEBUG::2014-07-10 08:14:58,413::task::827::TaskManager.Task::(resourceAcquired) Task=`282271c8-b4f8-4b32-9fca-e7d18ca7cacb`::_resourcesAcquired: Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9 (shared) >Thread-1043::DEBUG::2014-07-10 08:14:58,415::task::990::TaskManager.Task::(_decref) Task=`282271c8-b4f8-4b32-9fca-e7d18ca7cacb`::ref 1 aborting False >Thread-1043::INFO::2014-07-10 08:14:58,426::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DC-REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2, 'domains': u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': 'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c': {'status': u'Active', 'diskfree': '1137495244800', 'isoprefix': '', 'alerts': [], 'disktotal': '1152393412608', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532057948160', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-1043::DEBUG::2014-07-10 08:14:58,429::task::1185::TaskManager.Task::(prepare) Task=`282271c8-b4f8-4b32-9fca-e7d18ca7cacb`::finished: {'info': {'name': 'DC-REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2, 'domains': u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': 'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c': {'status': u'Active', 'diskfree': '1137495244800', 'isoprefix': '', 'alerts': [], 'disktotal': '1152393412608', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532057948160', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-1043::DEBUG::2014-07-10 08:14:58,432::task::595::TaskManager.Task::(_updateState) Task=`282271c8-b4f8-4b32-9fca-e7d18ca7cacb`::moving from state preparing -> state finished >Thread-1043::DEBUG::2014-07-10 08:14:58,434::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9': < ResourceRef 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9', isValid: 'True' obj: 'None'>} >Thread-1043::DEBUG::2014-07-10 08:14:58,437::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1043::DEBUG::2014-07-10 08:14:58,440::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' >Thread-1043::DEBUG::2014-07-10 08:14:58,443::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' (0 active users) >Thread-1043::DEBUG::2014-07-10 08:14:58,445::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' is free, finding out if anyone is waiting for it. >Thread-1043::DEBUG::2014-07-10 08:14:58,448::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9', Clearing records. >Thread-1043::DEBUG::2014-07-10 08:14:58,451::task::990::TaskManager.Task::(_decref) Task=`282271c8-b4f8-4b32-9fca-e7d18ca7cacb`::ref 0 aborting False >Dummy-36::DEBUG::2014-07-10 08:14:58,529::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.147036 s, 7.0 MB/s\n'; <rc> = 0 >Thread-1042::DEBUG::2014-07-10 08:14:59,637::task::595::TaskManager.Task::(_updateState) Task=`5771b1d2-c963-42fd-b68a-a4450f0b9910`::moving from state init -> state preparing >Thread-1042::INFO::2014-07-10 08:14:59,638::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-1042::INFO::2014-07-10 08:14:59,638::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00350616', 'lastCheck': '6.2', 'valid': True}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000590026', 'lastCheck': '7.1', 'valid': True}} >Thread-1042::DEBUG::2014-07-10 08:14:59,638::task::1185::TaskManager.Task::(prepare) Task=`5771b1d2-c963-42fd-b68a-a4450f0b9910`::finished: {u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00350616', 'lastCheck': '6.2', 'valid': True}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000590026', 'lastCheck': '7.1', 'valid': True}} >Thread-1042::DEBUG::2014-07-10 08:14:59,638::task::595::TaskManager.Task::(_updateState) Task=`5771b1d2-c963-42fd-b68a-a4450f0b9910`::moving from state preparing -> state finished >Thread-1042::DEBUG::2014-07-10 08:14:59,639::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-1042::DEBUG::2014-07-10 08:14:59,639::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1042::DEBUG::2014-07-10 08:14:59,639::task::990::TaskManager.Task::(_decref) Task=`5771b1d2-c963-42fd-b68a-a4450f0b9910`::ref 0 aborting False >Dummy-36::DEBUG::2014-07-10 08:15:00,544::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-07-10 08:15:00,669::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0297448 s, 34.4 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 08:15:02,576::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lion.qa.lab.tlv.redhat.com:_export_yuri2_backup2/6a70504d-00df-4869-8695-0f442053f6b6/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-14::DEBUG::2014-07-10 08:15:02,640::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n369 bytes (369 B) copied, 0.000484993 s, 761 kB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-07-10 08:15:02,685::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-07-10 08:15:02,830::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0409085 s, 25.0 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-07-10 08:15:03,405::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/e01a3a36-d2ce-4153-bb57-d6e65b7ed08c/metadata bs=4096 count=1' (cwd None) >Thread-15::DEBUG::2014-07-10 08:15:03,465::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000850926 s, 4.8 MB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-07-10 08:15:04,845::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-07-10 08:15:04,988::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0416067 s, 24.6 MB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-07-10 08:15:07,003::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-07-10 08:15:07,132::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0324221 s, 31.6 MB/s\n'; <rc> = 0 >Thread-1042::DEBUG::2014-07-10 08:15:08,496::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-1042::DEBUG::2014-07-10 08:15:08,497::task::595::TaskManager.Task::(_updateState) Task=`1006056e-8c08-4cee-8d65-48d3808f80bc`::moving from state init -> state preparing >Thread-1042::INFO::2014-07-10 08:15:08,498::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='411039e4-4af2-4192-9de0-67dc1ed83ba9', options=None) >Thread-1042::INFO::2014-07-10 08:15:08,498::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2}} >Thread-1042::DEBUG::2014-07-10 08:15:08,499::task::1185::TaskManager.Task::(prepare) Task=`1006056e-8c08-4cee-8d65-48d3808f80bc`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2}} >Thread-1042::DEBUG::2014-07-10 08:15:08,499::task::595::TaskManager.Task::(_updateState) Task=`1006056e-8c08-4cee-8d65-48d3808f80bc`::moving from state preparing -> state finished >Thread-1042::DEBUG::2014-07-10 08:15:08,499::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-1042::DEBUG::2014-07-10 08:15:08,499::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1042::DEBUG::2014-07-10 08:15:08,500::task::990::TaskManager.Task::(_decref) Task=`1006056e-8c08-4cee-8d65-48d3808f80bc`::ref 0 aborting False >Thread-1043::DEBUG::2014-07-10 08:15:08,504::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-1043::DEBUG::2014-07-10 08:15:08,504::task::595::TaskManager.Task::(_updateState) Task=`ed4359c3-354e-4575-92b1-02c217d49133`::moving from state init -> state preparing >Thread-1043::INFO::2014-07-10 08:15:08,504::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='411039e4-4af2-4192-9de0-67dc1ed83ba9', options=None) >Thread-1043::DEBUG::2014-07-10 08:15:08,505::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9`ReqID=`683b17d8-5376-4735-9588-a0cb4f8bf578`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo' >Thread-1043::DEBUG::2014-07-10 08:15:08,505::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' for lock type 'shared' >Thread-1043::DEBUG::2014-07-10 08:15:08,505::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' is free. Now locking as 'shared' (1 active user) >Thread-1043::DEBUG::2014-07-10 08:15:08,506::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9`ReqID=`683b17d8-5376-4735-9588-a0cb4f8bf578`::Granted request >Thread-1043::DEBUG::2014-07-10 08:15:08,506::task::827::TaskManager.Task::(resourceAcquired) Task=`ed4359c3-354e-4575-92b1-02c217d49133`::_resourcesAcquired: Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9 (shared) >Thread-1043::DEBUG::2014-07-10 08:15:08,506::task::990::TaskManager.Task::(_decref) Task=`ed4359c3-354e-4575-92b1-02c217d49133`::ref 1 aborting False >Thread-1043::INFO::2014-07-10 08:15:08,507::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DC-REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2, 'domains': u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': 'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c': {'status': u'Active', 'diskfree': '1137495244800', 'isoprefix': '', 'alerts': [], 'disktotal': '1152393412608', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532089405440', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-1043::DEBUG::2014-07-10 08:15:08,507::task::1185::TaskManager.Task::(prepare) Task=`ed4359c3-354e-4575-92b1-02c217d49133`::finished: {'info': {'name': 'DC-REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2, 'domains': u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': 'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c': {'status': u'Active', 'diskfree': '1137495244800', 'isoprefix': '', 'alerts': [], 'disktotal': '1152393412608', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532089405440', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-1043::DEBUG::2014-07-10 08:15:08,508::task::595::TaskManager.Task::(_updateState) Task=`ed4359c3-354e-4575-92b1-02c217d49133`::moving from state preparing -> state finished >Thread-1043::DEBUG::2014-07-10 08:15:08,508::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9': < ResourceRef 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9', isValid: 'True' obj: 'None'>} >Thread-1043::DEBUG::2014-07-10 08:15:08,508::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1043::DEBUG::2014-07-10 08:15:08,508::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' >Thread-1043::DEBUG::2014-07-10 08:15:08,508::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' (0 active users) >Thread-1043::DEBUG::2014-07-10 08:15:08,508::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' is free, finding out if anyone is waiting for it. >Thread-1043::DEBUG::2014-07-10 08:15:08,509::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9', Clearing records. >Thread-1043::DEBUG::2014-07-10 08:15:08,509::task::990::TaskManager.Task::(_decref) Task=`ed4359c3-354e-4575-92b1-02c217d49133`::ref 0 aborting False >Dummy-36::DEBUG::2014-07-10 08:15:09,147::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-07-10 08:15:09,278::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0312369 s, 32.8 MB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-07-10 08:15:11,293::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-07-10 08:15:11,422::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.032544 s, 31.5 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 08:15:12,671::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lion.qa.lab.tlv.redhat.com:_export_yuri2_backup2/6a70504d-00df-4869-8695-0f442053f6b6/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-14::DEBUG::2014-07-10 08:15:12,734::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n369 bytes (369 B) copied, 0.000430097 s, 858 kB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-07-10 08:15:13,437::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Thread-15::DEBUG::2014-07-10 08:15:13,496::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/e01a3a36-d2ce-4153-bb57-d6e65b7ed08c/metadata bs=4096 count=1' (cwd None) >Thread-15::DEBUG::2014-07-10 08:15:13,598::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00921052 s, 445 kB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-07-10 08:15:13,830::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.298109 s, 3.4 MB/s\n'; <rc> = 0 >Thread-1042::DEBUG::2014-07-10 08:15:14,792::task::595::TaskManager.Task::(_updateState) Task=`8dc0b319-4294-455a-baca-5ca492e16750`::moving from state init -> state preparing >Thread-1042::INFO::2014-07-10 08:15:14,792::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-1042::INFO::2014-07-10 08:15:14,792::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00921052', 'lastCheck': '1.0', 'valid': True}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000430097', 'lastCheck': '2.1', 'valid': True}} >Thread-1042::DEBUG::2014-07-10 08:15:14,792::task::1185::TaskManager.Task::(prepare) Task=`8dc0b319-4294-455a-baca-5ca492e16750`::finished: {u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00921052', 'lastCheck': '1.0', 'valid': True}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000430097', 'lastCheck': '2.1', 'valid': True}} >Thread-1042::DEBUG::2014-07-10 08:15:14,793::task::595::TaskManager.Task::(_updateState) Task=`8dc0b319-4294-455a-baca-5ca492e16750`::moving from state preparing -> state finished >Thread-1042::DEBUG::2014-07-10 08:15:14,793::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-1042::DEBUG::2014-07-10 08:15:14,793::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1042::DEBUG::2014-07-10 08:15:14,793::task::990::TaskManager.Task::(_decref) Task=`8dc0b319-4294-455a-baca-5ca492e16750`::ref 0 aborting False >Dummy-36::DEBUG::2014-07-10 08:15:15,845::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-07-10 08:15:15,975::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0324096 s, 31.6 MB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-07-10 08:15:17,991::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-07-10 08:15:18,125::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0374384 s, 27.4 MB/s\n'; <rc> = 0 >Thread-1042::DEBUG::2014-07-10 08:15:18,573::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-1042::DEBUG::2014-07-10 08:15:18,574::task::595::TaskManager.Task::(_updateState) Task=`1355117d-47db-4eef-94ba-22bc3f761a49`::moving from state init -> state preparing >Thread-1042::INFO::2014-07-10 08:15:18,575::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='411039e4-4af2-4192-9de0-67dc1ed83ba9', options=None) >Thread-1042::INFO::2014-07-10 08:15:18,575::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2}} >Thread-1042::DEBUG::2014-07-10 08:15:18,575::task::1185::TaskManager.Task::(prepare) Task=`1355117d-47db-4eef-94ba-22bc3f761a49`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2}} >Thread-1042::DEBUG::2014-07-10 08:15:18,576::task::595::TaskManager.Task::(_updateState) Task=`1355117d-47db-4eef-94ba-22bc3f761a49`::moving from state preparing -> state finished >Thread-1042::DEBUG::2014-07-10 08:15:18,576::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-1042::DEBUG::2014-07-10 08:15:18,576::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1042::DEBUG::2014-07-10 08:15:18,576::task::990::TaskManager.Task::(_decref) Task=`1355117d-47db-4eef-94ba-22bc3f761a49`::ref 0 aborting False >Thread-1043::DEBUG::2014-07-10 08:15:18,580::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-1043::DEBUG::2014-07-10 08:15:18,581::task::595::TaskManager.Task::(_updateState) Task=`f1874387-1646-44c1-96b5-ab64c8f49352`::moving from state init -> state preparing >Thread-1043::INFO::2014-07-10 08:15:18,581::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='411039e4-4af2-4192-9de0-67dc1ed83ba9', options=None) >Thread-1043::DEBUG::2014-07-10 08:15:18,582::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9`ReqID=`753e31a0-6e56-46a5-bef0-31ecab1e1efa`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo' >Thread-1043::DEBUG::2014-07-10 08:15:18,582::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' for lock type 'shared' >Thread-1043::DEBUG::2014-07-10 08:15:18,582::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' is free. Now locking as 'shared' (1 active user) >Thread-1043::DEBUG::2014-07-10 08:15:18,583::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9`ReqID=`753e31a0-6e56-46a5-bef0-31ecab1e1efa`::Granted request >Thread-1043::DEBUG::2014-07-10 08:15:18,583::task::827::TaskManager.Task::(resourceAcquired) Task=`f1874387-1646-44c1-96b5-ab64c8f49352`::_resourcesAcquired: Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9 (shared) >Thread-1043::DEBUG::2014-07-10 08:15:18,583::task::990::TaskManager.Task::(_decref) Task=`f1874387-1646-44c1-96b5-ab64c8f49352`::ref 1 aborting False >Thread-1043::INFO::2014-07-10 08:15:18,585::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DC-REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2, 'domains': u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': 'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c': {'status': u'Active', 'diskfree': '1137495244800', 'isoprefix': '', 'alerts': [], 'disktotal': '1152393412608', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532068433920', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-1043::DEBUG::2014-07-10 08:15:18,585::task::1185::TaskManager.Task::(prepare) Task=`f1874387-1646-44c1-96b5-ab64c8f49352`::finished: {'info': {'name': 'DC-REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2, 'domains': u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': 'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c': {'status': u'Active', 'diskfree': '1137495244800', 'isoprefix': '', 'alerts': [], 'disktotal': '1152393412608', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532068433920', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-1043::DEBUG::2014-07-10 08:15:18,585::task::595::TaskManager.Task::(_updateState) Task=`f1874387-1646-44c1-96b5-ab64c8f49352`::moving from state preparing -> state finished >Thread-1043::DEBUG::2014-07-10 08:15:18,585::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9': < ResourceRef 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9', isValid: 'True' obj: 'None'>} >Thread-1043::DEBUG::2014-07-10 08:15:18,585::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1043::DEBUG::2014-07-10 08:15:18,586::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' >Thread-1043::DEBUG::2014-07-10 08:15:18,586::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' (0 active users) >Thread-1043::DEBUG::2014-07-10 08:15:18,586::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' is free, finding out if anyone is waiting for it. >Thread-1043::DEBUG::2014-07-10 08:15:18,586::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9', Clearing records. >Thread-1043::DEBUG::2014-07-10 08:15:18,587::task::990::TaskManager.Task::(_decref) Task=`f1874387-1646-44c1-96b5-ab64c8f49352`::ref 0 aborting False >Dummy-36::DEBUG::2014-07-10 08:15:20,140::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-07-10 08:15:20,276::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0382473 s, 26.8 MB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-07-10 08:15:22,286::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-07-10 08:15:22,415::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0321691 s, 31.8 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 08:15:22,764::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lion.qa.lab.tlv.redhat.com:_export_yuri2_backup2/6a70504d-00df-4869-8695-0f442053f6b6/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-14::DEBUG::2014-07-10 08:15:22,826::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n369 bytes (369 B) copied, 0.000479875 s, 769 kB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-07-10 08:15:23,782::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/e01a3a36-d2ce-4153-bb57-d6e65b7ed08c/metadata bs=4096 count=1' (cwd None) >Thread-15::DEBUG::2014-07-10 08:15:23,839::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000920714 s, 4.4 MB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-07-10 08:15:24,431::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-07-10 08:15:24,567::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0359176 s, 28.5 MB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-07-10 08:15:26,583::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-07-10 08:15:26,713::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.032135 s, 31.9 MB/s\n'; <rc> = 0 >Thread-1042::DEBUG::2014-07-10 08:15:28,629::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-1042::DEBUG::2014-07-10 08:15:28,630::task::595::TaskManager.Task::(_updateState) Task=`c6bbfdc5-8395-4d8d-9cfb-1324f17e70e4`::moving from state init -> state preparing >Thread-1042::INFO::2014-07-10 08:15:28,630::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='411039e4-4af2-4192-9de0-67dc1ed83ba9', options=None) >Thread-1042::INFO::2014-07-10 08:15:28,631::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2}} >Thread-1042::DEBUG::2014-07-10 08:15:28,631::task::1185::TaskManager.Task::(prepare) Task=`c6bbfdc5-8395-4d8d-9cfb-1324f17e70e4`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2}} >Thread-1042::DEBUG::2014-07-10 08:15:28,631::task::595::TaskManager.Task::(_updateState) Task=`c6bbfdc5-8395-4d8d-9cfb-1324f17e70e4`::moving from state preparing -> state finished >Thread-1042::DEBUG::2014-07-10 08:15:28,632::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-1042::DEBUG::2014-07-10 08:15:28,632::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1042::DEBUG::2014-07-10 08:15:28,632::task::990::TaskManager.Task::(_decref) Task=`c6bbfdc5-8395-4d8d-9cfb-1324f17e70e4`::ref 0 aborting False >Thread-1043::DEBUG::2014-07-10 08:15:28,636::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-1043::DEBUG::2014-07-10 08:15:28,636::task::595::TaskManager.Task::(_updateState) Task=`f1f02dff-3ece-4ed9-9b0c-7181aa9d2970`::moving from state init -> state preparing >Thread-1043::INFO::2014-07-10 08:15:28,637::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='411039e4-4af2-4192-9de0-67dc1ed83ba9', options=None) >Thread-1043::DEBUG::2014-07-10 08:15:28,637::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9`ReqID=`3dc3558e-0aef-4e20-850c-42040ecede17`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo' >Thread-1043::DEBUG::2014-07-10 08:15:28,638::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' for lock type 'shared' >Thread-1043::DEBUG::2014-07-10 08:15:28,638::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' is free. Now locking as 'shared' (1 active user) >Thread-1043::DEBUG::2014-07-10 08:15:28,638::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9`ReqID=`3dc3558e-0aef-4e20-850c-42040ecede17`::Granted request >Thread-1043::DEBUG::2014-07-10 08:15:28,639::task::827::TaskManager.Task::(resourceAcquired) Task=`f1f02dff-3ece-4ed9-9b0c-7181aa9d2970`::_resourcesAcquired: Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9 (shared) >Thread-1043::DEBUG::2014-07-10 08:15:28,639::task::990::TaskManager.Task::(_decref) Task=`f1f02dff-3ece-4ed9-9b0c-7181aa9d2970`::ref 1 aborting False >Thread-1043::INFO::2014-07-10 08:15:28,640::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DC-REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2, 'domains': u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': 'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c': {'status': u'Active', 'diskfree': '1137495244800', 'isoprefix': '', 'alerts': [], 'disktotal': '1152393412608', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532068433920', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-1043::DEBUG::2014-07-10 08:15:28,640::task::1185::TaskManager.Task::(prepare) Task=`f1f02dff-3ece-4ed9-9b0c-7181aa9d2970`::finished: {'info': {'name': 'DC-REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2, 'domains': u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': 'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c': {'status': u'Active', 'diskfree': '1137495244800', 'isoprefix': '', 'alerts': [], 'disktotal': '1152393412608', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532068433920', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-1043::DEBUG::2014-07-10 08:15:28,640::task::595::TaskManager.Task::(_updateState) Task=`f1f02dff-3ece-4ed9-9b0c-7181aa9d2970`::moving from state preparing -> state finished >Thread-1043::DEBUG::2014-07-10 08:15:28,641::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9': < ResourceRef 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9', isValid: 'True' obj: 'None'>} >Thread-1043::DEBUG::2014-07-10 08:15:28,641::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1043::DEBUG::2014-07-10 08:15:28,641::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' >Thread-1043::DEBUG::2014-07-10 08:15:28,641::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' (0 active users) >Thread-1043::DEBUG::2014-07-10 08:15:28,642::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' is free, finding out if anyone is waiting for it. >Thread-1043::DEBUG::2014-07-10 08:15:28,642::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9', Clearing records. >Thread-1043::DEBUG::2014-07-10 08:15:28,642::task::990::TaskManager.Task::(_decref) Task=`f1f02dff-3ece-4ed9-9b0c-7181aa9d2970`::ref 0 aborting False >Dummy-36::DEBUG::2014-07-10 08:15:28,729::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-07-10 08:15:28,868::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0383337 s, 26.7 MB/s\n'; <rc> = 0 >Thread-1042::DEBUG::2014-07-10 08:15:29,924::task::595::TaskManager.Task::(_updateState) Task=`8135647d-10cb-410f-8889-3a055907261f`::moving from state init -> state preparing >Thread-1042::INFO::2014-07-10 08:15:29,925::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-1042::INFO::2014-07-10 08:15:29,925::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000920714', 'lastCheck': '6.1', 'valid': True}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000479875', 'lastCheck': '7.1', 'valid': True}} >Thread-1042::DEBUG::2014-07-10 08:15:29,925::task::1185::TaskManager.Task::(prepare) Task=`8135647d-10cb-410f-8889-3a055907261f`::finished: {u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000920714', 'lastCheck': '6.1', 'valid': True}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000479875', 'lastCheck': '7.1', 'valid': True}} >Thread-1042::DEBUG::2014-07-10 08:15:29,926::task::595::TaskManager.Task::(_updateState) Task=`8135647d-10cb-410f-8889-3a055907261f`::moving from state preparing -> state finished >Thread-1042::DEBUG::2014-07-10 08:15:29,926::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-1042::DEBUG::2014-07-10 08:15:29,926::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1042::DEBUG::2014-07-10 08:15:29,926::task::990::TaskManager.Task::(_decref) Task=`8135647d-10cb-410f-8889-3a055907261f`::ref 0 aborting False >Dummy-36::DEBUG::2014-07-10 08:15:30,883::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-07-10 08:15:31,014::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.032776 s, 31.2 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 08:15:32,888::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lion.qa.lab.tlv.redhat.com:_export_yuri2_backup2/6a70504d-00df-4869-8695-0f442053f6b6/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-14::DEBUG::2014-07-10 08:15:32,952::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n369 bytes (369 B) copied, 0.000446597 s, 826 kB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-07-10 08:15:33,030::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-07-10 08:15:33,164::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0387601 s, 26.4 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-07-10 08:15:33,869::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/e01a3a36-d2ce-4153-bb57-d6e65b7ed08c/metadata bs=4096 count=1' (cwd None) >Thread-15::DEBUG::2014-07-10 08:15:33,938::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00470445 s, 871 kB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-07-10 08:15:35,179::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-07-10 08:15:35,312::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0386249 s, 26.5 MB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-07-10 08:15:37,322::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-07-10 08:15:37,791::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0332124 s, 30.8 MB/s\n'; <rc> = 0 >Thread-1042::DEBUG::2014-07-10 08:15:38,679::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-1042::DEBUG::2014-07-10 08:15:38,681::task::595::TaskManager.Task::(_updateState) Task=`a7454396-9b58-4c1e-90dd-a1f7c8beb550`::moving from state init -> state preparing >Thread-1042::INFO::2014-07-10 08:15:38,681::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='411039e4-4af2-4192-9de0-67dc1ed83ba9', options=None) >Thread-1042::INFO::2014-07-10 08:15:38,682::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2}} >Thread-1042::DEBUG::2014-07-10 08:15:38,682::task::1185::TaskManager.Task::(prepare) Task=`a7454396-9b58-4c1e-90dd-a1f7c8beb550`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2}} >Thread-1042::DEBUG::2014-07-10 08:15:38,682::task::595::TaskManager.Task::(_updateState) Task=`a7454396-9b58-4c1e-90dd-a1f7c8beb550`::moving from state preparing -> state finished >Thread-1042::DEBUG::2014-07-10 08:15:38,682::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-1042::DEBUG::2014-07-10 08:15:38,682::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1042::DEBUG::2014-07-10 08:15:38,682::task::990::TaskManager.Task::(_decref) Task=`a7454396-9b58-4c1e-90dd-a1f7c8beb550`::ref 0 aborting False >Thread-1043::DEBUG::2014-07-10 08:15:38,687::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-1043::DEBUG::2014-07-10 08:15:38,687::task::595::TaskManager.Task::(_updateState) Task=`665e8128-565e-43a7-9393-42ae21e73b1c`::moving from state init -> state preparing >Thread-1043::INFO::2014-07-10 08:15:38,687::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='411039e4-4af2-4192-9de0-67dc1ed83ba9', options=None) >Thread-1043::DEBUG::2014-07-10 08:15:38,688::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9`ReqID=`0ff20f48-48f8-4392-968e-81811b2a21a1`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo' >Thread-1043::DEBUG::2014-07-10 08:15:38,688::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' for lock type 'shared' >Thread-1043::DEBUG::2014-07-10 08:15:38,688::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' is free. Now locking as 'shared' (1 active user) >Thread-1043::DEBUG::2014-07-10 08:15:38,689::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9`ReqID=`0ff20f48-48f8-4392-968e-81811b2a21a1`::Granted request >Thread-1043::DEBUG::2014-07-10 08:15:38,689::task::827::TaskManager.Task::(resourceAcquired) Task=`665e8128-565e-43a7-9393-42ae21e73b1c`::_resourcesAcquired: Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9 (shared) >Thread-1043::DEBUG::2014-07-10 08:15:38,689::task::990::TaskManager.Task::(_decref) Task=`665e8128-565e-43a7-9393-42ae21e73b1c`::ref 1 aborting False >Thread-1043::INFO::2014-07-10 08:15:38,690::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DC-REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2, 'domains': u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': 'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c': {'status': u'Active', 'diskfree': '1137495244800', 'isoprefix': '', 'alerts': [], 'disktotal': '1152393412608', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532068433920', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-1043::DEBUG::2014-07-10 08:15:38,691::task::1185::TaskManager.Task::(prepare) Task=`665e8128-565e-43a7-9393-42ae21e73b1c`::finished: {'info': {'name': 'DC-REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2, 'domains': u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': 'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c': {'status': u'Active', 'diskfree': '1137495244800', 'isoprefix': '', 'alerts': [], 'disktotal': '1152393412608', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532068433920', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-1043::DEBUG::2014-07-10 08:15:38,691::task::595::TaskManager.Task::(_updateState) Task=`665e8128-565e-43a7-9393-42ae21e73b1c`::moving from state preparing -> state finished >Thread-1043::DEBUG::2014-07-10 08:15:38,691::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9': < ResourceRef 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9', isValid: 'True' obj: 'None'>} >Thread-1043::DEBUG::2014-07-10 08:15:38,691::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1043::DEBUG::2014-07-10 08:15:38,691::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' >Thread-1043::DEBUG::2014-07-10 08:15:38,691::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' (0 active users) >Thread-1043::DEBUG::2014-07-10 08:15:38,692::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' is free, finding out if anyone is waiting for it. >Thread-1043::DEBUG::2014-07-10 08:15:38,692::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9', Clearing records. >Thread-1043::DEBUG::2014-07-10 08:15:38,692::task::990::TaskManager.Task::(_decref) Task=`665e8128-565e-43a7-9393-42ae21e73b1c`::ref 0 aborting False >Dummy-36::DEBUG::2014-07-10 08:15:39,876::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-07-10 08:15:40,008::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0327603 s, 31.3 MB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-07-10 08:15:42,022::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-07-10 08:15:42,154::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0329132 s, 31.1 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 08:15:42,982::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lion.qa.lab.tlv.redhat.com:_export_yuri2_backup2/6a70504d-00df-4869-8695-0f442053f6b6/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-14::DEBUG::2014-07-10 08:15:43,045::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n369 bytes (369 B) copied, 0.00049282 s, 749 kB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-07-10 08:15:43,967::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/e01a3a36-d2ce-4153-bb57-d6e65b7ed08c/metadata bs=4096 count=1' (cwd None) >Thread-15::DEBUG::2014-07-10 08:15:44,029::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000963812 s, 4.2 MB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-07-10 08:15:44,169::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-07-10 08:15:44,306::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0376714 s, 27.2 MB/s\n'; <rc> = 0 >Thread-1042::DEBUG::2014-07-10 08:15:45,091::task::595::TaskManager.Task::(_updateState) Task=`15f5dc48-13dc-40be-b066-e12ac43f723a`::moving from state init -> state preparing >Thread-1042::INFO::2014-07-10 08:15:45,092::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-1042::INFO::2014-07-10 08:15:45,092::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000963812', 'lastCheck': '1.0', 'valid': True}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00049282', 'lastCheck': '2.0', 'valid': True}} >Thread-1042::DEBUG::2014-07-10 08:15:45,092::task::1185::TaskManager.Task::(prepare) Task=`15f5dc48-13dc-40be-b066-e12ac43f723a`::finished: {u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000963812', 'lastCheck': '1.0', 'valid': True}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00049282', 'lastCheck': '2.0', 'valid': True}} >Thread-1042::DEBUG::2014-07-10 08:15:45,093::task::595::TaskManager.Task::(_updateState) Task=`15f5dc48-13dc-40be-b066-e12ac43f723a`::moving from state preparing -> state finished >Thread-1042::DEBUG::2014-07-10 08:15:45,093::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-1042::DEBUG::2014-07-10 08:15:45,093::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1042::DEBUG::2014-07-10 08:15:45,093::task::990::TaskManager.Task::(_decref) Task=`15f5dc48-13dc-40be-b066-e12ac43f723a`::ref 0 aborting False >Dummy-36::DEBUG::2014-07-10 08:15:46,316::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-07-10 08:15:46,448::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0327321 s, 31.3 MB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-07-10 08:15:48,463::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-07-10 08:15:48,605::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0404299 s, 25.3 MB/s\n'; <rc> = 0 >Thread-1042::DEBUG::2014-07-10 08:15:48,729::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-1042::DEBUG::2014-07-10 08:15:48,730::task::595::TaskManager.Task::(_updateState) Task=`905b213a-5e5f-4377-978c-4cefa71e0d81`::moving from state init -> state preparing >Thread-1042::INFO::2014-07-10 08:15:48,731::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='411039e4-4af2-4192-9de0-67dc1ed83ba9', options=None) >Thread-1042::INFO::2014-07-10 08:15:48,731::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2}} >Thread-1042::DEBUG::2014-07-10 08:15:48,731::task::1185::TaskManager.Task::(prepare) Task=`905b213a-5e5f-4377-978c-4cefa71e0d81`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2}} >Thread-1042::DEBUG::2014-07-10 08:15:48,732::task::595::TaskManager.Task::(_updateState) Task=`905b213a-5e5f-4377-978c-4cefa71e0d81`::moving from state preparing -> state finished >Thread-1042::DEBUG::2014-07-10 08:15:48,732::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-1042::DEBUG::2014-07-10 08:15:48,732::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1042::DEBUG::2014-07-10 08:15:48,732::task::990::TaskManager.Task::(_decref) Task=`905b213a-5e5f-4377-978c-4cefa71e0d81`::ref 0 aborting False >Thread-1043::DEBUG::2014-07-10 08:15:48,736::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-1043::DEBUG::2014-07-10 08:15:48,737::task::595::TaskManager.Task::(_updateState) Task=`14ad6620-5c7f-4007-be86-cd966bda451f`::moving from state init -> state preparing >Thread-1043::INFO::2014-07-10 08:15:48,737::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='411039e4-4af2-4192-9de0-67dc1ed83ba9', options=None) >Thread-1043::DEBUG::2014-07-10 08:15:48,738::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9`ReqID=`c857c33b-767f-4eef-811e-752208d3c359`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo' >Thread-1043::DEBUG::2014-07-10 08:15:48,738::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' for lock type 'shared' >Thread-1043::DEBUG::2014-07-10 08:15:48,738::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' is free. Now locking as 'shared' (1 active user) >Thread-1043::DEBUG::2014-07-10 08:15:48,739::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9`ReqID=`c857c33b-767f-4eef-811e-752208d3c359`::Granted request >Thread-1043::DEBUG::2014-07-10 08:15:48,739::task::827::TaskManager.Task::(resourceAcquired) Task=`14ad6620-5c7f-4007-be86-cd966bda451f`::_resourcesAcquired: Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9 (shared) >Thread-1043::DEBUG::2014-07-10 08:15:48,739::task::990::TaskManager.Task::(_decref) Task=`14ad6620-5c7f-4007-be86-cd966bda451f`::ref 1 aborting False >Thread-1043::INFO::2014-07-10 08:15:48,741::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DC-REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2, 'domains': u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': 'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c': {'status': u'Active', 'diskfree': '1137495244800', 'isoprefix': '', 'alerts': [], 'disktotal': '1152393412608', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532068433920', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-1043::DEBUG::2014-07-10 08:15:48,741::task::1185::TaskManager.Task::(prepare) Task=`14ad6620-5c7f-4007-be86-cd966bda451f`::finished: {'info': {'name': 'DC-REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2, 'domains': u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': 'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c': {'status': u'Active', 'diskfree': '1137495244800', 'isoprefix': '', 'alerts': [], 'disktotal': '1152393412608', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532068433920', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-1043::DEBUG::2014-07-10 08:15:48,741::task::595::TaskManager.Task::(_updateState) Task=`14ad6620-5c7f-4007-be86-cd966bda451f`::moving from state preparing -> state finished >Thread-1043::DEBUG::2014-07-10 08:15:48,742::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9': < ResourceRef 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9', isValid: 'True' obj: 'None'>} >Thread-1043::DEBUG::2014-07-10 08:15:48,742::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1043::DEBUG::2014-07-10 08:15:48,742::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' >Thread-1043::DEBUG::2014-07-10 08:15:48,742::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' (0 active users) >Thread-1043::DEBUG::2014-07-10 08:15:48,743::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' is free, finding out if anyone is waiting for it. >Thread-1043::DEBUG::2014-07-10 08:15:48,743::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9', Clearing records. >Thread-1043::DEBUG::2014-07-10 08:15:48,743::task::990::TaskManager.Task::(_decref) Task=`14ad6620-5c7f-4007-be86-cd966bda451f`::ref 0 aborting False >Dummy-36::DEBUG::2014-07-10 08:15:50,621::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-07-10 08:15:50,747::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0295408 s, 34.7 MB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-07-10 08:15:52,763::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-07-10 08:15:52,898::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0379266 s, 27.0 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 08:15:53,075::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lion.qa.lab.tlv.redhat.com:_export_yuri2_backup2/6a70504d-00df-4869-8695-0f442053f6b6/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-14::DEBUG::2014-07-10 08:15:53,137::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n369 bytes (369 B) copied, 0.000492727 s, 749 kB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-07-10 08:15:54,059::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/e01a3a36-d2ce-4153-bb57-d6e65b7ed08c/metadata bs=4096 count=1' (cwd None) >Thread-15::DEBUG::2014-07-10 08:15:54,127::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00698421 s, 586 kB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-07-10 08:15:54,913::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-07-10 08:15:55,049::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0353429 s, 29.0 MB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-07-10 08:15:57,064::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-07-10 08:15:57,194::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0322713 s, 31.7 MB/s\n'; <rc> = 0 >Thread-1042::DEBUG::2014-07-10 08:15:58,762::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-1042::DEBUG::2014-07-10 08:15:58,766::task::595::TaskManager.Task::(_updateState) Task=`7318d17d-bbe3-45c1-a507-09f8972ae795`::moving from state init -> state preparing >Thread-1042::INFO::2014-07-10 08:15:58,766::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='411039e4-4af2-4192-9de0-67dc1ed83ba9', options=None) >Thread-1042::INFO::2014-07-10 08:15:58,767::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2}} >Thread-1042::DEBUG::2014-07-10 08:15:58,767::task::1185::TaskManager.Task::(prepare) Task=`7318d17d-bbe3-45c1-a507-09f8972ae795`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2}} >Thread-1042::DEBUG::2014-07-10 08:15:58,767::task::595::TaskManager.Task::(_updateState) Task=`7318d17d-bbe3-45c1-a507-09f8972ae795`::moving from state preparing -> state finished >Thread-1042::DEBUG::2014-07-10 08:15:58,767::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-1042::DEBUG::2014-07-10 08:15:58,767::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1042::DEBUG::2014-07-10 08:15:58,768::task::990::TaskManager.Task::(_decref) Task=`7318d17d-bbe3-45c1-a507-09f8972ae795`::ref 0 aborting False >Thread-1043::DEBUG::2014-07-10 08:15:58,771::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-1043::DEBUG::2014-07-10 08:15:58,772::task::595::TaskManager.Task::(_updateState) Task=`a511e8fd-3ada-4b2b-8df9-f61c2eb30989`::moving from state init -> state preparing >Thread-1043::INFO::2014-07-10 08:15:58,772::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='411039e4-4af2-4192-9de0-67dc1ed83ba9', options=None) >Thread-1043::DEBUG::2014-07-10 08:15:58,773::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9`ReqID=`a2c831bb-9efb-4263-b285-10e627195824`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo' >Thread-1043::DEBUG::2014-07-10 08:15:58,773::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' for lock type 'shared' >Thread-1043::DEBUG::2014-07-10 08:15:58,773::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' is free. Now locking as 'shared' (1 active user) >Thread-1043::DEBUG::2014-07-10 08:15:58,774::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9`ReqID=`a2c831bb-9efb-4263-b285-10e627195824`::Granted request >Thread-1043::DEBUG::2014-07-10 08:15:58,774::task::827::TaskManager.Task::(resourceAcquired) Task=`a511e8fd-3ada-4b2b-8df9-f61c2eb30989`::_resourcesAcquired: Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9 (shared) >Thread-1043::DEBUG::2014-07-10 08:15:58,774::task::990::TaskManager.Task::(_decref) Task=`a511e8fd-3ada-4b2b-8df9-f61c2eb30989`::ref 1 aborting False >Thread-1043::INFO::2014-07-10 08:15:58,776::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DC-REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2, 'domains': u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': 'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c': {'status': u'Active', 'diskfree': '1137495244800', 'isoprefix': '', 'alerts': [], 'disktotal': '1152393412608', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532068433920', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-1043::DEBUG::2014-07-10 08:15:58,776::task::1185::TaskManager.Task::(prepare) Task=`a511e8fd-3ada-4b2b-8df9-f61c2eb30989`::finished: {'info': {'name': 'DC-REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2, 'domains': u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': 'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c': {'status': u'Active', 'diskfree': '1137495244800', 'isoprefix': '', 'alerts': [], 'disktotal': '1152393412608', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532068433920', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-1043::DEBUG::2014-07-10 08:15:58,776::task::595::TaskManager.Task::(_updateState) Task=`a511e8fd-3ada-4b2b-8df9-f61c2eb30989`::moving from state preparing -> state finished >Thread-1043::DEBUG::2014-07-10 08:15:58,776::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9': < ResourceRef 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9', isValid: 'True' obj: 'None'>} >Thread-1043::DEBUG::2014-07-10 08:15:58,776::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1043::DEBUG::2014-07-10 08:15:58,777::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' >Thread-1043::DEBUG::2014-07-10 08:15:58,777::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' (0 active users) >Thread-1043::DEBUG::2014-07-10 08:15:58,777::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' is free, finding out if anyone is waiting for it. >Thread-1043::DEBUG::2014-07-10 08:15:58,777::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9', Clearing records. >Thread-1043::DEBUG::2014-07-10 08:15:58,777::task::990::TaskManager.Task::(_decref) Task=`a511e8fd-3ada-4b2b-8df9-f61c2eb30989`::ref 0 aborting False >Dummy-36::DEBUG::2014-07-10 08:15:59,210::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-07-10 08:15:59,338::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0353137 s, 29.0 MB/s\n'; <rc> = 0 >Thread-1042::DEBUG::2014-07-10 08:16:00,285::task::595::TaskManager.Task::(_updateState) Task=`4e2d834d-705f-4785-93d4-07802f190156`::moving from state init -> state preparing >Thread-1042::INFO::2014-07-10 08:16:00,285::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-1042::INFO::2014-07-10 08:16:00,286::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00698421', 'lastCheck': '6.1', 'valid': True}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000492727', 'lastCheck': '7.1', 'valid': True}} >Thread-1042::DEBUG::2014-07-10 08:16:00,286::task::1185::TaskManager.Task::(prepare) Task=`4e2d834d-705f-4785-93d4-07802f190156`::finished: {u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00698421', 'lastCheck': '6.1', 'valid': True}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000492727', 'lastCheck': '7.1', 'valid': True}} >Thread-1042::DEBUG::2014-07-10 08:16:00,286::task::595::TaskManager.Task::(_updateState) Task=`4e2d834d-705f-4785-93d4-07802f190156`::moving from state preparing -> state finished >Thread-1042::DEBUG::2014-07-10 08:16:00,286::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-1042::DEBUG::2014-07-10 08:16:00,286::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1042::DEBUG::2014-07-10 08:16:00,287::task::990::TaskManager.Task::(_decref) Task=`4e2d834d-705f-4785-93d4-07802f190156`::ref 0 aborting False >Dummy-36::DEBUG::2014-07-10 08:16:01,348::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-07-10 08:16:01,478::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0329226 s, 31.1 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 08:16:03,163::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lion.qa.lab.tlv.redhat.com:_export_yuri2_backup2/6a70504d-00df-4869-8695-0f442053f6b6/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-14::DEBUG::2014-07-10 08:16:03,224::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n369 bytes (369 B) copied, 0.000472891 s, 780 kB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-07-10 08:16:03,492::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-07-10 08:16:03,674::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0476705 s, 21.5 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-07-10 08:16:04,157::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/e01a3a36-d2ce-4153-bb57-d6e65b7ed08c/metadata bs=4096 count=1' (cwd None) >Thread-15::DEBUG::2014-07-10 08:16:04,225::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00646997 s, 633 kB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-07-10 08:16:05,690::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-07-10 08:16:05,858::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0707593 s, 14.5 MB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-07-10 08:16:07,874::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-07-10 08:16:08,368::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.396824 s, 2.6 MB/s\n'; <rc> = 0 >Thread-1042::DEBUG::2014-07-10 08:16:08,822::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-1042::DEBUG::2014-07-10 08:16:08,823::task::595::TaskManager.Task::(_updateState) Task=`9b2176d0-09aa-4bc5-a5c8-d67c8b304f32`::moving from state init -> state preparing >Thread-1042::INFO::2014-07-10 08:16:08,823::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='411039e4-4af2-4192-9de0-67dc1ed83ba9', options=None) >Thread-1042::INFO::2014-07-10 08:16:08,824::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2}} >Thread-1042::DEBUG::2014-07-10 08:16:08,824::task::1185::TaskManager.Task::(prepare) Task=`9b2176d0-09aa-4bc5-a5c8-d67c8b304f32`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2}} >Thread-1042::DEBUG::2014-07-10 08:16:08,824::task::595::TaskManager.Task::(_updateState) Task=`9b2176d0-09aa-4bc5-a5c8-d67c8b304f32`::moving from state preparing -> state finished >Thread-1042::DEBUG::2014-07-10 08:16:08,824::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-1042::DEBUG::2014-07-10 08:16:08,824::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1042::DEBUG::2014-07-10 08:16:08,825::task::990::TaskManager.Task::(_decref) Task=`9b2176d0-09aa-4bc5-a5c8-d67c8b304f32`::ref 0 aborting False >Thread-1043::DEBUG::2014-07-10 08:16:08,828::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-1043::DEBUG::2014-07-10 08:16:08,829::task::595::TaskManager.Task::(_updateState) Task=`56227fb9-ec30-4aab-903a-3905cf9007ff`::moving from state init -> state preparing >Thread-1043::INFO::2014-07-10 08:16:08,829::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='411039e4-4af2-4192-9de0-67dc1ed83ba9', options=None) >Thread-1043::DEBUG::2014-07-10 08:16:08,830::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9`ReqID=`6042b148-9c42-4eea-b8ee-298770f71537`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo' >Thread-1043::DEBUG::2014-07-10 08:16:08,830::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' for lock type 'shared' >Thread-1043::DEBUG::2014-07-10 08:16:08,830::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' is free. Now locking as 'shared' (1 active user) >Thread-1043::DEBUG::2014-07-10 08:16:08,831::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9`ReqID=`6042b148-9c42-4eea-b8ee-298770f71537`::Granted request >Thread-1043::DEBUG::2014-07-10 08:16:08,831::task::827::TaskManager.Task::(resourceAcquired) Task=`56227fb9-ec30-4aab-903a-3905cf9007ff`::_resourcesAcquired: Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9 (shared) >Thread-1043::DEBUG::2014-07-10 08:16:08,831::task::990::TaskManager.Task::(_decref) Task=`56227fb9-ec30-4aab-903a-3905cf9007ff`::ref 1 aborting False >Thread-1043::INFO::2014-07-10 08:16:08,832::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DC-REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2, 'domains': u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': 'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c': {'status': u'Active', 'diskfree': '1137495244800', 'isoprefix': '', 'alerts': [], 'disktotal': '1152393412608', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532069482496', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-1043::DEBUG::2014-07-10 08:16:08,833::task::1185::TaskManager.Task::(prepare) Task=`56227fb9-ec30-4aab-903a-3905cf9007ff`::finished: {'info': {'name': 'DC-REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2, 'domains': u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': 'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c': {'status': u'Active', 'diskfree': '1137495244800', 'isoprefix': '', 'alerts': [], 'disktotal': '1152393412608', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532069482496', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-1043::DEBUG::2014-07-10 08:16:08,833::task::595::TaskManager.Task::(_updateState) Task=`56227fb9-ec30-4aab-903a-3905cf9007ff`::moving from state preparing -> state finished >Thread-1043::DEBUG::2014-07-10 08:16:08,833::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9': < ResourceRef 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9', isValid: 'True' obj: 'None'>} >Thread-1043::DEBUG::2014-07-10 08:16:08,833::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1043::DEBUG::2014-07-10 08:16:08,833::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' >Thread-1043::DEBUG::2014-07-10 08:16:08,834::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' (0 active users) >Thread-1043::DEBUG::2014-07-10 08:16:08,834::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' is free, finding out if anyone is waiting for it. >Thread-1043::DEBUG::2014-07-10 08:16:08,834::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9', Clearing records. >Thread-1043::DEBUG::2014-07-10 08:16:08,834::task::990::TaskManager.Task::(_decref) Task=`56227fb9-ec30-4aab-903a-3905cf9007ff`::ref 0 aborting False >Dummy-36::DEBUG::2014-07-10 08:16:10,383::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-07-10 08:16:10,540::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0565856 s, 18.1 MB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-07-10 08:16:12,555::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-07-10 08:16:12,687::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0329933 s, 31.0 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 08:16:13,255::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lion.qa.lab.tlv.redhat.com:_export_yuri2_backup2/6a70504d-00df-4869-8695-0f442053f6b6/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-14::DEBUG::2014-07-10 08:16:13,319::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n369 bytes (369 B) copied, 0.000478849 s, 771 kB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-07-10 08:16:14,255::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/e01a3a36-d2ce-4153-bb57-d6e65b7ed08c/metadata bs=4096 count=1' (cwd None) >Thread-15::DEBUG::2014-07-10 08:16:14,332::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.0159878 s, 256 kB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-07-10 08:16:14,702::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-07-10 08:16:14,847::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0400622 s, 25.6 MB/s\n'; <rc> = 0 >Thread-1042::DEBUG::2014-07-10 08:16:15,439::task::595::TaskManager.Task::(_updateState) Task=`6d2fbea4-ae81-4420-a6a8-e50ad2c7a006`::moving from state init -> state preparing >Thread-1042::INFO::2014-07-10 08:16:15,439::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-1042::INFO::2014-07-10 08:16:15,440::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0159878', 'lastCheck': '1.1', 'valid': True}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000478849', 'lastCheck': '2.1', 'valid': True}} >Thread-1042::DEBUG::2014-07-10 08:16:15,440::task::1185::TaskManager.Task::(prepare) Task=`6d2fbea4-ae81-4420-a6a8-e50ad2c7a006`::finished: {u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0159878', 'lastCheck': '1.1', 'valid': True}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000478849', 'lastCheck': '2.1', 'valid': True}} >Thread-1042::DEBUG::2014-07-10 08:16:15,440::task::595::TaskManager.Task::(_updateState) Task=`6d2fbea4-ae81-4420-a6a8-e50ad2c7a006`::moving from state preparing -> state finished >Thread-1042::DEBUG::2014-07-10 08:16:15,441::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-1042::DEBUG::2014-07-10 08:16:15,441::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1042::DEBUG::2014-07-10 08:16:15,441::task::990::TaskManager.Task::(_decref) Task=`6d2fbea4-ae81-4420-a6a8-e50ad2c7a006`::ref 0 aborting False >Dummy-36::DEBUG::2014-07-10 08:16:16,862::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-07-10 08:16:17,002::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.040965 s, 25.0 MB/s\n'; <rc> = 0 >Thread-1042::DEBUG::2014-07-10 08:16:18,863::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-1042::DEBUG::2014-07-10 08:16:18,864::task::595::TaskManager.Task::(_updateState) Task=`45689209-fab3-4ba3-a41e-0f8940c6b18e`::moving from state init -> state preparing >Thread-1042::INFO::2014-07-10 08:16:18,864::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='411039e4-4af2-4192-9de0-67dc1ed83ba9', options=None) >Thread-1042::INFO::2014-07-10 08:16:18,865::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2}} >Thread-1042::DEBUG::2014-07-10 08:16:18,865::task::1185::TaskManager.Task::(prepare) Task=`45689209-fab3-4ba3-a41e-0f8940c6b18e`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2}} >Thread-1042::DEBUG::2014-07-10 08:16:18,865::task::595::TaskManager.Task::(_updateState) Task=`45689209-fab3-4ba3-a41e-0f8940c6b18e`::moving from state preparing -> state finished >Thread-1042::DEBUG::2014-07-10 08:16:18,865::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-1042::DEBUG::2014-07-10 08:16:18,865::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1042::DEBUG::2014-07-10 08:16:18,865::task::990::TaskManager.Task::(_decref) Task=`45689209-fab3-4ba3-a41e-0f8940c6b18e`::ref 0 aborting False >Thread-1043::DEBUG::2014-07-10 08:16:18,869::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-1043::DEBUG::2014-07-10 08:16:18,869::task::595::TaskManager.Task::(_updateState) Task=`b31c23e2-a00c-4ab8-9019-6db521724970`::moving from state init -> state preparing >Thread-1043::INFO::2014-07-10 08:16:18,870::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='411039e4-4af2-4192-9de0-67dc1ed83ba9', options=None) >Thread-1043::DEBUG::2014-07-10 08:16:18,870::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9`ReqID=`a0f27bf5-50a5-44c4-99f3-d0dffba0959f`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo' >Thread-1043::DEBUG::2014-07-10 08:16:18,870::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' for lock type 'shared' >Thread-1043::DEBUG::2014-07-10 08:16:18,871::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' is free. Now locking as 'shared' (1 active user) >Thread-1043::DEBUG::2014-07-10 08:16:18,871::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9`ReqID=`a0f27bf5-50a5-44c4-99f3-d0dffba0959f`::Granted request >Thread-1043::DEBUG::2014-07-10 08:16:18,871::task::827::TaskManager.Task::(resourceAcquired) Task=`b31c23e2-a00c-4ab8-9019-6db521724970`::_resourcesAcquired: Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9 (shared) >Thread-1043::DEBUG::2014-07-10 08:16:18,872::task::990::TaskManager.Task::(_decref) Task=`b31c23e2-a00c-4ab8-9019-6db521724970`::ref 1 aborting False >Thread-1043::INFO::2014-07-10 08:16:18,873::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DC-REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2, 'domains': u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': 'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c': {'status': u'Active', 'diskfree': '1137495244800', 'isoprefix': '', 'alerts': [], 'disktotal': '1152393412608', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532069482496', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-1043::DEBUG::2014-07-10 08:16:18,873::task::1185::TaskManager.Task::(prepare) Task=`b31c23e2-a00c-4ab8-9019-6db521724970`::finished: {'info': {'name': 'DC-REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2, 'domains': u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': 'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c': {'status': u'Active', 'diskfree': '1137495244800', 'isoprefix': '', 'alerts': [], 'disktotal': '1152393412608', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532069482496', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-1043::DEBUG::2014-07-10 08:16:18,873::task::595::TaskManager.Task::(_updateState) Task=`b31c23e2-a00c-4ab8-9019-6db521724970`::moving from state preparing -> state finished >Thread-1043::DEBUG::2014-07-10 08:16:18,873::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9': < ResourceRef 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9', isValid: 'True' obj: 'None'>} >Thread-1043::DEBUG::2014-07-10 08:16:18,873::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1043::DEBUG::2014-07-10 08:16:18,874::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' >Thread-1043::DEBUG::2014-07-10 08:16:18,874::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' (0 active users) >Thread-1043::DEBUG::2014-07-10 08:16:18,874::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' is free, finding out if anyone is waiting for it. >Thread-1043::DEBUG::2014-07-10 08:16:18,874::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9', Clearing records. >Thread-1043::DEBUG::2014-07-10 08:16:18,874::task::990::TaskManager.Task::(_decref) Task=`b31c23e2-a00c-4ab8-9019-6db521724970`::ref 0 aborting False >Dummy-36::DEBUG::2014-07-10 08:16:19,029::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-07-10 08:16:19,167::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0335421 s, 30.5 MB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-07-10 08:16:21,182::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-07-10 08:16:21,312::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0320046 s, 32.0 MB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-07-10 08:16:23,331::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Thread-14::DEBUG::2014-07-10 08:16:23,439::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lion.qa.lab.tlv.redhat.com:_export_yuri2_backup2/6a70504d-00df-4869-8695-0f442053f6b6/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-14::DEBUG::2014-07-10 08:16:23,525::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n369 bytes (369 B) copied, 0.000371889 s, 992 kB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-07-10 08:16:23,602::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.16948 s, 6.0 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-07-10 08:16:24,362::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/e01a3a36-d2ce-4153-bb57-d6e65b7ed08c/metadata bs=4096 count=1' (cwd None) >Thread-15::DEBUG::2014-07-10 08:16:24,430::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00757595 s, 541 kB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-07-10 08:16:25,618::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-07-10 08:16:25,762::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0420794 s, 24.3 MB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-07-10 08:16:27,777::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-07-10 08:16:27,916::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0393177 s, 26.0 MB/s\n'; <rc> = 0 >Thread-1042::DEBUG::2014-07-10 08:16:28,913::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-1042::DEBUG::2014-07-10 08:16:28,915::task::595::TaskManager.Task::(_updateState) Task=`f836503f-8a48-4495-9777-4c7ec9d648c6`::moving from state init -> state preparing >Thread-1042::INFO::2014-07-10 08:16:28,915::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='411039e4-4af2-4192-9de0-67dc1ed83ba9', options=None) >Thread-1042::INFO::2014-07-10 08:16:28,916::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2}} >Thread-1042::DEBUG::2014-07-10 08:16:28,916::task::1185::TaskManager.Task::(prepare) Task=`f836503f-8a48-4495-9777-4c7ec9d648c6`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2}} >Thread-1042::DEBUG::2014-07-10 08:16:28,916::task::595::TaskManager.Task::(_updateState) Task=`f836503f-8a48-4495-9777-4c7ec9d648c6`::moving from state preparing -> state finished >Thread-1042::DEBUG::2014-07-10 08:16:28,916::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-1042::DEBUG::2014-07-10 08:16:28,916::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1042::DEBUG::2014-07-10 08:16:28,917::task::990::TaskManager.Task::(_decref) Task=`f836503f-8a48-4495-9777-4c7ec9d648c6`::ref 0 aborting False >Thread-1043::DEBUG::2014-07-10 08:16:28,921::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-1043::DEBUG::2014-07-10 08:16:28,921::task::595::TaskManager.Task::(_updateState) Task=`be3bd163-34a7-4e01-b742-0b639c86de47`::moving from state init -> state preparing >Thread-1043::INFO::2014-07-10 08:16:28,921::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='411039e4-4af2-4192-9de0-67dc1ed83ba9', options=None) >Thread-1043::DEBUG::2014-07-10 08:16:28,922::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9`ReqID=`e6d22928-b648-4960-8e8b-e070a384f98a`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo' >Thread-1043::DEBUG::2014-07-10 08:16:28,922::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' for lock type 'shared' >Thread-1043::DEBUG::2014-07-10 08:16:28,923::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' is free. Now locking as 'shared' (1 active user) >Thread-1043::DEBUG::2014-07-10 08:16:28,923::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9`ReqID=`e6d22928-b648-4960-8e8b-e070a384f98a`::Granted request >Thread-1043::DEBUG::2014-07-10 08:16:28,923::task::827::TaskManager.Task::(resourceAcquired) Task=`be3bd163-34a7-4e01-b742-0b639c86de47`::_resourcesAcquired: Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9 (shared) >Thread-1043::DEBUG::2014-07-10 08:16:28,924::task::990::TaskManager.Task::(_decref) Task=`be3bd163-34a7-4e01-b742-0b639c86de47`::ref 1 aborting False >Thread-1043::INFO::2014-07-10 08:16:28,925::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DC-REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2, 'domains': u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': 'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c': {'status': u'Active', 'diskfree': '1137495244800', 'isoprefix': '', 'alerts': [], 'disktotal': '1152393412608', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532069482496', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-1043::DEBUG::2014-07-10 08:16:28,925::task::1185::TaskManager.Task::(prepare) Task=`be3bd163-34a7-4e01-b742-0b639c86de47`::finished: {'info': {'name': 'DC-REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2, 'domains': u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': 'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c': {'status': u'Active', 'diskfree': '1137495244800', 'isoprefix': '', 'alerts': [], 'disktotal': '1152393412608', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532069482496', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-1043::DEBUG::2014-07-10 08:16:28,925::task::595::TaskManager.Task::(_updateState) Task=`be3bd163-34a7-4e01-b742-0b639c86de47`::moving from state preparing -> state finished >Thread-1043::DEBUG::2014-07-10 08:16:28,925::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9': < ResourceRef 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9', isValid: 'True' obj: 'None'>} >Thread-1043::DEBUG::2014-07-10 08:16:28,926::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1043::DEBUG::2014-07-10 08:16:28,926::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' >Thread-1043::DEBUG::2014-07-10 08:16:28,926::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' (0 active users) >Thread-1043::DEBUG::2014-07-10 08:16:28,926::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' is free, finding out if anyone is waiting for it. >Thread-1043::DEBUG::2014-07-10 08:16:28,926::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9', Clearing records. >Thread-1043::DEBUG::2014-07-10 08:16:28,927::task::990::TaskManager.Task::(_decref) Task=`be3bd163-34a7-4e01-b742-0b639c86de47`::ref 0 aborting False >Dummy-36::DEBUG::2014-07-10 08:16:29,931::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-07-10 08:16:30,064::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0326561 s, 31.4 MB/s\n'; <rc> = 0 >Thread-1042::DEBUG::2014-07-10 08:16:30,582::task::595::TaskManager.Task::(_updateState) Task=`48c8a4be-b7d6-4520-802f-d9d0b13fc75b`::moving from state init -> state preparing >Thread-1042::INFO::2014-07-10 08:16:30,584::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-1042::INFO::2014-07-10 08:16:30,585::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00757595', 'lastCheck': '6.1', 'valid': True}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000371889', 'lastCheck': '7.0', 'valid': True}} >Thread-1042::DEBUG::2014-07-10 08:16:30,585::task::1185::TaskManager.Task::(prepare) Task=`48c8a4be-b7d6-4520-802f-d9d0b13fc75b`::finished: {u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00757595', 'lastCheck': '6.1', 'valid': True}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000371889', 'lastCheck': '7.0', 'valid': True}} >Thread-1042::DEBUG::2014-07-10 08:16:30,585::task::595::TaskManager.Task::(_updateState) Task=`48c8a4be-b7d6-4520-802f-d9d0b13fc75b`::moving from state preparing -> state finished >Thread-1042::DEBUG::2014-07-10 08:16:30,585::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-1042::DEBUG::2014-07-10 08:16:30,585::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1042::DEBUG::2014-07-10 08:16:30,586::task::990::TaskManager.Task::(_decref) Task=`48c8a4be-b7d6-4520-802f-d9d0b13fc75b`::ref 0 aborting False >Dummy-36::DEBUG::2014-07-10 08:16:32,079::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-07-10 08:16:32,218::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.038751 s, 26.4 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 08:16:33,561::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lion.qa.lab.tlv.redhat.com:_export_yuri2_backup2/6a70504d-00df-4869-8695-0f442053f6b6/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-14::DEBUG::2014-07-10 08:16:33,625::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n369 bytes (369 B) copied, 0.000446992 s, 826 kB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-07-10 08:16:34,233::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-07-10 08:16:34,375::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.038408 s, 26.7 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-07-10 08:16:34,460::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/e01a3a36-d2ce-4153-bb57-d6e65b7ed08c/metadata bs=4096 count=1' (cwd None) >Thread-15::DEBUG::2014-07-10 08:16:34,527::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000829172 s, 4.9 MB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-07-10 08:16:36,421::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-07-10 08:16:36,558::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0325634 s, 31.4 MB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-07-10 08:16:38,572::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-07-10 08:16:38,709::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0324496 s, 31.6 MB/s\n'; <rc> = 0 >Thread-1042::DEBUG::2014-07-10 08:16:38,963::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-1042::DEBUG::2014-07-10 08:16:38,964::task::595::TaskManager.Task::(_updateState) Task=`f9d4af43-735d-4e18-96ba-b4b5881e3489`::moving from state init -> state preparing >Thread-1042::INFO::2014-07-10 08:16:38,965::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='411039e4-4af2-4192-9de0-67dc1ed83ba9', options=None) >Thread-1042::INFO::2014-07-10 08:16:38,965::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2}} >Thread-1042::DEBUG::2014-07-10 08:16:38,965::task::1185::TaskManager.Task::(prepare) Task=`f9d4af43-735d-4e18-96ba-b4b5881e3489`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2}} >Thread-1042::DEBUG::2014-07-10 08:16:38,966::task::595::TaskManager.Task::(_updateState) Task=`f9d4af43-735d-4e18-96ba-b4b5881e3489`::moving from state preparing -> state finished >Thread-1042::DEBUG::2014-07-10 08:16:38,966::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-1042::DEBUG::2014-07-10 08:16:38,966::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1042::DEBUG::2014-07-10 08:16:38,966::task::990::TaskManager.Task::(_decref) Task=`f9d4af43-735d-4e18-96ba-b4b5881e3489`::ref 0 aborting False >Thread-1043::DEBUG::2014-07-10 08:16:38,970::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-1043::DEBUG::2014-07-10 08:16:38,971::task::595::TaskManager.Task::(_updateState) Task=`4f14df75-9ef2-4ebb-b174-acac1eca536e`::moving from state init -> state preparing >Thread-1043::INFO::2014-07-10 08:16:38,971::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='411039e4-4af2-4192-9de0-67dc1ed83ba9', options=None) >Thread-1043::DEBUG::2014-07-10 08:16:38,972::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9`ReqID=`541fe896-39ac-470d-956b-d3c26950012c`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo' >Thread-1043::DEBUG::2014-07-10 08:16:38,972::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' for lock type 'shared' >Thread-1043::DEBUG::2014-07-10 08:16:38,972::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' is free. Now locking as 'shared' (1 active user) >Thread-1043::DEBUG::2014-07-10 08:16:38,972::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9`ReqID=`541fe896-39ac-470d-956b-d3c26950012c`::Granted request >Thread-1043::DEBUG::2014-07-10 08:16:38,973::task::827::TaskManager.Task::(resourceAcquired) Task=`4f14df75-9ef2-4ebb-b174-acac1eca536e`::_resourcesAcquired: Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9 (shared) >Thread-1043::DEBUG::2014-07-10 08:16:38,973::task::990::TaskManager.Task::(_decref) Task=`4f14df75-9ef2-4ebb-b174-acac1eca536e`::ref 1 aborting False >Thread-1043::INFO::2014-07-10 08:16:38,974::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DC-REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2, 'domains': u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': 'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c': {'status': u'Active', 'diskfree': '1137495244800', 'isoprefix': '', 'alerts': [], 'disktotal': '1152393412608', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532069482496', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-1043::DEBUG::2014-07-10 08:16:38,975::task::1185::TaskManager.Task::(prepare) Task=`4f14df75-9ef2-4ebb-b174-acac1eca536e`::finished: {'info': {'name': 'DC-REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2, 'domains': u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': 'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c': {'status': u'Active', 'diskfree': '1137495244800', 'isoprefix': '', 'alerts': [], 'disktotal': '1152393412608', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532069482496', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-1043::DEBUG::2014-07-10 08:16:38,975::task::595::TaskManager.Task::(_updateState) Task=`4f14df75-9ef2-4ebb-b174-acac1eca536e`::moving from state preparing -> state finished >Thread-1043::DEBUG::2014-07-10 08:16:38,975::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9': < ResourceRef 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9', isValid: 'True' obj: 'None'>} >Thread-1043::DEBUG::2014-07-10 08:16:38,975::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1043::DEBUG::2014-07-10 08:16:38,975::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' >Thread-1043::DEBUG::2014-07-10 08:16:38,976::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' (0 active users) >Thread-1043::DEBUG::2014-07-10 08:16:38,976::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' is free, finding out if anyone is waiting for it. >Thread-1043::DEBUG::2014-07-10 08:16:38,976::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9', Clearing records. >Thread-1043::DEBUG::2014-07-10 08:16:38,976::task::990::TaskManager.Task::(_decref) Task=`4f14df75-9ef2-4ebb-b174-acac1eca536e`::ref 0 aborting False >Dummy-36::DEBUG::2014-07-10 08:16:40,724::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-07-10 08:16:40,864::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0383719 s, 26.7 MB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-07-10 08:16:42,878::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-07-10 08:16:43,012::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0355915 s, 28.8 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 08:16:43,655::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lion.qa.lab.tlv.redhat.com:_export_yuri2_backup2/6a70504d-00df-4869-8695-0f442053f6b6/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-14::DEBUG::2014-07-10 08:16:43,722::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n369 bytes (369 B) copied, 0.000476035 s, 775 kB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-07-10 08:16:44,557::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/e01a3a36-d2ce-4153-bb57-d6e65b7ed08c/metadata bs=4096 count=1' (cwd None) >Thread-15::DEBUG::2014-07-10 08:16:44,614::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000750516 s, 5.5 MB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-07-10 08:16:45,027::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-07-10 08:16:45,165::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0383226 s, 26.7 MB/s\n'; <rc> = 0 >Thread-1042::DEBUG::2014-07-10 08:16:45,748::task::595::TaskManager.Task::(_updateState) Task=`e3412713-65e7-4a04-85b5-4399d7395bd4`::moving from state init -> state preparing >Thread-1042::INFO::2014-07-10 08:16:45,750::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-1042::INFO::2014-07-10 08:16:45,750::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000750516', 'lastCheck': '1.1', 'valid': True}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000476035', 'lastCheck': '2.0', 'valid': True}} >Thread-1042::DEBUG::2014-07-10 08:16:45,750::task::1185::TaskManager.Task::(prepare) Task=`e3412713-65e7-4a04-85b5-4399d7395bd4`::finished: {u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000750516', 'lastCheck': '1.1', 'valid': True}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000476035', 'lastCheck': '2.0', 'valid': True}} >Thread-1042::DEBUG::2014-07-10 08:16:45,751::task::595::TaskManager.Task::(_updateState) Task=`e3412713-65e7-4a04-85b5-4399d7395bd4`::moving from state preparing -> state finished >Thread-1042::DEBUG::2014-07-10 08:16:45,751::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-1042::DEBUG::2014-07-10 08:16:45,751::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1042::DEBUG::2014-07-10 08:16:45,751::task::990::TaskManager.Task::(_decref) Task=`e3412713-65e7-4a04-85b5-4399d7395bd4`::ref 0 aborting False >Dummy-36::DEBUG::2014-07-10 08:16:47,181::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-07-10 08:16:47,343::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0643483 s, 15.9 MB/s\n'; <rc> = 0 >Thread-1042::DEBUG::2014-07-10 08:16:49,013::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-1042::DEBUG::2014-07-10 08:16:49,013::task::595::TaskManager.Task::(_updateState) Task=`4c16234c-d58f-40e0-a8b2-373be0a33996`::moving from state init -> state preparing >Thread-1042::INFO::2014-07-10 08:16:49,014::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='411039e4-4af2-4192-9de0-67dc1ed83ba9', options=None) >Thread-1042::INFO::2014-07-10 08:16:49,014::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2}} >Thread-1042::DEBUG::2014-07-10 08:16:49,014::task::1185::TaskManager.Task::(prepare) Task=`4c16234c-d58f-40e0-a8b2-373be0a33996`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2}} >Thread-1042::DEBUG::2014-07-10 08:16:49,014::task::595::TaskManager.Task::(_updateState) Task=`4c16234c-d58f-40e0-a8b2-373be0a33996`::moving from state preparing -> state finished >Thread-1042::DEBUG::2014-07-10 08:16:49,015::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-1042::DEBUG::2014-07-10 08:16:49,015::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1042::DEBUG::2014-07-10 08:16:49,015::task::990::TaskManager.Task::(_decref) Task=`4c16234c-d58f-40e0-a8b2-373be0a33996`::ref 0 aborting False >Thread-1043::DEBUG::2014-07-10 08:16:49,018::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-1043::DEBUG::2014-07-10 08:16:49,019::task::595::TaskManager.Task::(_updateState) Task=`b9a9c6f7-e59d-47aa-aef1-a02db709db04`::moving from state init -> state preparing >Thread-1043::INFO::2014-07-10 08:16:49,019::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='411039e4-4af2-4192-9de0-67dc1ed83ba9', options=None) >Thread-1043::DEBUG::2014-07-10 08:16:49,020::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9`ReqID=`de9fa74e-ac3a-4a57-b028-f67ab484f4ba`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo' >Thread-1043::DEBUG::2014-07-10 08:16:49,020::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' for lock type 'shared' >Thread-1043::DEBUG::2014-07-10 08:16:49,020::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' is free. Now locking as 'shared' (1 active user) >Thread-1043::DEBUG::2014-07-10 08:16:49,020::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9`ReqID=`de9fa74e-ac3a-4a57-b028-f67ab484f4ba`::Granted request >Thread-1043::DEBUG::2014-07-10 08:16:49,021::task::827::TaskManager.Task::(resourceAcquired) Task=`b9a9c6f7-e59d-47aa-aef1-a02db709db04`::_resourcesAcquired: Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9 (shared) >Thread-1043::DEBUG::2014-07-10 08:16:49,021::task::990::TaskManager.Task::(_decref) Task=`b9a9c6f7-e59d-47aa-aef1-a02db709db04`::ref 1 aborting False >Thread-1043::INFO::2014-07-10 08:16:49,022::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DC-REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2, 'domains': u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': 'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c': {'status': u'Active', 'diskfree': '1137495244800', 'isoprefix': '', 'alerts': [], 'disktotal': '1152393412608', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532069482496', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-1043::DEBUG::2014-07-10 08:16:49,022::task::1185::TaskManager.Task::(prepare) Task=`b9a9c6f7-e59d-47aa-aef1-a02db709db04`::finished: {'info': {'name': 'DC-REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2, 'domains': u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': 'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c': {'status': u'Active', 'diskfree': '1137495244800', 'isoprefix': '', 'alerts': [], 'disktotal': '1152393412608', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532069482496', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-1043::DEBUG::2014-07-10 08:16:49,022::task::595::TaskManager.Task::(_updateState) Task=`b9a9c6f7-e59d-47aa-aef1-a02db709db04`::moving from state preparing -> state finished >Thread-1043::DEBUG::2014-07-10 08:16:49,022::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9': < ResourceRef 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9', isValid: 'True' obj: 'None'>} >Thread-1043::DEBUG::2014-07-10 08:16:49,023::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1043::DEBUG::2014-07-10 08:16:49,023::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' >Thread-1043::DEBUG::2014-07-10 08:16:49,023::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' (0 active users) >Thread-1043::DEBUG::2014-07-10 08:16:49,023::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' is free, finding out if anyone is waiting for it. >Thread-1043::DEBUG::2014-07-10 08:16:49,023::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9', Clearing records. >Thread-1043::DEBUG::2014-07-10 08:16:49,024::task::990::TaskManager.Task::(_decref) Task=`b9a9c6f7-e59d-47aa-aef1-a02db709db04`::ref 0 aborting False >Dummy-36::DEBUG::2014-07-10 08:16:49,358::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-07-10 08:16:49,491::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0336737 s, 30.4 MB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-07-10 08:16:51,506::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-07-10 08:16:51,638::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0328368 s, 31.2 MB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-07-10 08:16:53,653::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Thread-14::DEBUG::2014-07-10 08:16:53,726::domainMonitor::192::Storage.DomainMonitorThread::(_monitorDomain) Refreshing domain 6a70504d-00df-4869-8695-0f442053f6b6 >Thread-14::DEBUG::2014-07-10 08:16:53,794::fileSD::150::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/lion.qa.lab.tlv.redhat.com:_export_yuri2_backup2/6a70504d-00df-4869-8695-0f442053f6b6 >Thread-14::DEBUG::2014-07-10 08:16:53,797::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend >Thread-14::DEBUG::2014-07-10 08:16:53,800::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Backup', 'DESCRIPTION=test', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=0', 'POOL_UUID=411039e4-4af2-4192-9de0-67dc1ed83ba9', 'REMOTE_PATH=lion.qa.lab.tlv.redhat.com:/export/yuri2/backup2', 'ROLE=Regular', 'SDUUID=6a70504d-00df-4869-8695-0f442053f6b6', 'TYPE=NFS', 'VERSION=0', '_SHA_CKSUM=c52897a45cbc3ed0a0146ef350774e5cecebe6cf'] >Thread-14::DEBUG::2014-07-10 08:16:53,803::fileSD::609::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images [] >Thread-14::INFO::2014-07-10 08:16:53,804::sd::384::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 6a70504d-00df-4869-8695-0f442053f6b6_imageNS already registered >Thread-14::INFO::2014-07-10 08:16:53,804::sd::392::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 6a70504d-00df-4869-8695-0f442053f6b6_volumeNS already registered >Thread-14::DEBUG::2014-07-10 08:16:54,038::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lion.qa.lab.tlv.redhat.com:_export_yuri2_backup2/6a70504d-00df-4869-8695-0f442053f6b6/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-14::DEBUG::2014-07-10 08:16:54,129::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n369 bytes (369 B) copied, 0.00044228 s, 834 kB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-07-10 08:16:54,175::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.110898 s, 9.2 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-07-10 08:16:54,644::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/e01a3a36-d2ce-4153-bb57-d6e65b7ed08c/metadata bs=4096 count=1' (cwd None) >Thread-15::DEBUG::2014-07-10 08:16:54,706::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.0054133 s, 757 kB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-07-10 08:16:56,190::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-07-10 08:16:56,330::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0394525 s, 26.0 MB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-07-10 08:16:58,345::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-07-10 08:16:58,710::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0332123 s, 30.8 MB/s\n'; <rc> = 0 >Thread-1042::DEBUG::2014-07-10 08:16:59,054::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-1042::DEBUG::2014-07-10 08:16:59,055::task::595::TaskManager.Task::(_updateState) Task=`6a448e81-c8bd-4ca9-ad21-0b8870d8b655`::moving from state init -> state preparing >Thread-1042::INFO::2014-07-10 08:16:59,055::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='411039e4-4af2-4192-9de0-67dc1ed83ba9', options=None) >Thread-1042::INFO::2014-07-10 08:16:59,056::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2}} >Thread-1042::DEBUG::2014-07-10 08:16:59,056::task::1185::TaskManager.Task::(prepare) Task=`6a448e81-c8bd-4ca9-ad21-0b8870d8b655`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2}} >Thread-1042::DEBUG::2014-07-10 08:16:59,056::task::595::TaskManager.Task::(_updateState) Task=`6a448e81-c8bd-4ca9-ad21-0b8870d8b655`::moving from state preparing -> state finished >Thread-1042::DEBUG::2014-07-10 08:16:59,057::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-1042::DEBUG::2014-07-10 08:16:59,057::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1042::DEBUG::2014-07-10 08:16:59,057::task::990::TaskManager.Task::(_decref) Task=`6a448e81-c8bd-4ca9-ad21-0b8870d8b655`::ref 0 aborting False >Thread-1043::DEBUG::2014-07-10 08:16:59,061::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-1043::DEBUG::2014-07-10 08:16:59,061::task::595::TaskManager.Task::(_updateState) Task=`0f4b858b-abac-4f0a-b6c4-2a5cc2bd64b5`::moving from state init -> state preparing >Thread-1043::INFO::2014-07-10 08:16:59,062::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='411039e4-4af2-4192-9de0-67dc1ed83ba9', options=None) >Thread-1043::DEBUG::2014-07-10 08:16:59,062::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9`ReqID=`c58c14f1-ef19-41e8-910d-8defe5ff6034`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo' >Thread-1043::DEBUG::2014-07-10 08:16:59,063::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' for lock type 'shared' >Thread-1043::DEBUG::2014-07-10 08:16:59,063::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' is free. Now locking as 'shared' (1 active user) >Thread-1043::DEBUG::2014-07-10 08:16:59,063::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9`ReqID=`c58c14f1-ef19-41e8-910d-8defe5ff6034`::Granted request >Thread-1043::DEBUG::2014-07-10 08:16:59,064::task::827::TaskManager.Task::(resourceAcquired) Task=`0f4b858b-abac-4f0a-b6c4-2a5cc2bd64b5`::_resourcesAcquired: Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9 (shared) >Thread-1043::DEBUG::2014-07-10 08:16:59,064::task::990::TaskManager.Task::(_decref) Task=`0f4b858b-abac-4f0a-b6c4-2a5cc2bd64b5`::ref 1 aborting False >Thread-1043::INFO::2014-07-10 08:16:59,065::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DC-REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2, 'domains': u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': 'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c': {'status': u'Active', 'diskfree': '1137495244800', 'isoprefix': '', 'alerts': [], 'disktotal': '1152393412608', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532069482496', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-1043::DEBUG::2014-07-10 08:16:59,065::task::1185::TaskManager.Task::(prepare) Task=`0f4b858b-abac-4f0a-b6c4-2a5cc2bd64b5`::finished: {'info': {'name': 'DC-REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2, 'domains': u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': 'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c': {'status': u'Active', 'diskfree': '1137495244800', 'isoprefix': '', 'alerts': [], 'disktotal': '1152393412608', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532069482496', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-1043::DEBUG::2014-07-10 08:16:59,066::task::595::TaskManager.Task::(_updateState) Task=`0f4b858b-abac-4f0a-b6c4-2a5cc2bd64b5`::moving from state preparing -> state finished >Thread-1043::DEBUG::2014-07-10 08:16:59,066::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9': < ResourceRef 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9', isValid: 'True' obj: 'None'>} >Thread-1043::DEBUG::2014-07-10 08:16:59,066::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1043::DEBUG::2014-07-10 08:16:59,066::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' >Thread-1043::DEBUG::2014-07-10 08:16:59,066::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' (0 active users) >Thread-1043::DEBUG::2014-07-10 08:16:59,067::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' is free, finding out if anyone is waiting for it. >Thread-1043::DEBUG::2014-07-10 08:16:59,067::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9', Clearing records. >Thread-1043::DEBUG::2014-07-10 08:16:59,067::task::990::TaskManager.Task::(_decref) Task=`0f4b858b-abac-4f0a-b6c4-2a5cc2bd64b5`::ref 0 aborting False >Thread-1042::DEBUG::2014-07-10 08:17:00,890::task::595::TaskManager.Task::(_updateState) Task=`c5785b45-1562-4f77-9784-2da7b26de25e`::moving from state init -> state preparing >Thread-1042::INFO::2014-07-10 08:17:00,890::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-1042::INFO::2014-07-10 08:17:00,891::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0054133', 'lastCheck': '6.2', 'valid': True}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00044228', 'lastCheck': '6.7', 'valid': True}} >Thread-1042::DEBUG::2014-07-10 08:17:00,891::task::1185::TaskManager.Task::(prepare) Task=`c5785b45-1562-4f77-9784-2da7b26de25e`::finished: {u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0054133', 'lastCheck': '6.2', 'valid': True}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00044228', 'lastCheck': '6.7', 'valid': True}} >Thread-1042::DEBUG::2014-07-10 08:17:00,891::task::595::TaskManager.Task::(_updateState) Task=`c5785b45-1562-4f77-9784-2da7b26de25e`::moving from state preparing -> state finished >Thread-1042::DEBUG::2014-07-10 08:17:00,892::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-1042::DEBUG::2014-07-10 08:17:00,892::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1042::DEBUG::2014-07-10 08:17:00,892::task::990::TaskManager.Task::(_decref) Task=`c5785b45-1562-4f77-9784-2da7b26de25e`::ref 0 aborting False >Dummy-36::DEBUG::2014-07-10 08:17:00,907::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-07-10 08:17:01,055::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0482971 s, 21.2 MB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-07-10 08:17:03,070::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-07-10 08:17:03,202::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0328976 s, 31.1 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 08:17:04,171::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lion.qa.lab.tlv.redhat.com:_export_yuri2_backup2/6a70504d-00df-4869-8695-0f442053f6b6/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-14::DEBUG::2014-07-10 08:17:04,235::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n369 bytes (369 B) copied, 0.000442324 s, 834 kB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-07-10 08:17:04,736::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/e01a3a36-d2ce-4153-bb57-d6e65b7ed08c/metadata bs=4096 count=1' (cwd None) >Thread-15::DEBUG::2014-07-10 08:17:04,794::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000950474 s, 4.3 MB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-07-10 08:17:05,218::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-07-10 08:17:05,361::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0379355 s, 27.0 MB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-07-10 08:17:07,376::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-07-10 08:17:07,511::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0370086 s, 27.7 MB/s\n'; <rc> = 0 >Thread-1042::DEBUG::2014-07-10 08:17:09,104::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-1042::DEBUG::2014-07-10 08:17:09,105::task::595::TaskManager.Task::(_updateState) Task=`1f3062e9-f27e-4137-9fc7-c91771949e17`::moving from state init -> state preparing >Thread-1042::INFO::2014-07-10 08:17:09,106::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='411039e4-4af2-4192-9de0-67dc1ed83ba9', options=None) >Thread-1042::INFO::2014-07-10 08:17:09,106::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2}} >Thread-1042::DEBUG::2014-07-10 08:17:09,106::task::1185::TaskManager.Task::(prepare) Task=`1f3062e9-f27e-4137-9fc7-c91771949e17`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2}} >Thread-1042::DEBUG::2014-07-10 08:17:09,106::task::595::TaskManager.Task::(_updateState) Task=`1f3062e9-f27e-4137-9fc7-c91771949e17`::moving from state preparing -> state finished >Thread-1042::DEBUG::2014-07-10 08:17:09,107::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-1042::DEBUG::2014-07-10 08:17:09,107::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1042::DEBUG::2014-07-10 08:17:09,107::task::990::TaskManager.Task::(_decref) Task=`1f3062e9-f27e-4137-9fc7-c91771949e17`::ref 0 aborting False >Thread-1043::DEBUG::2014-07-10 08:17:09,111::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-1043::DEBUG::2014-07-10 08:17:09,111::task::595::TaskManager.Task::(_updateState) Task=`6ced6029-409c-4bc6-a751-692bfdd7fa19`::moving from state init -> state preparing >Thread-1043::INFO::2014-07-10 08:17:09,112::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='411039e4-4af2-4192-9de0-67dc1ed83ba9', options=None) >Thread-1043::DEBUG::2014-07-10 08:17:09,112::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9`ReqID=`008dea99-e589-4d29-9c92-8c8ee3c59ffb`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo' >Thread-1043::DEBUG::2014-07-10 08:17:09,112::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' for lock type 'shared' >Thread-1043::DEBUG::2014-07-10 08:17:09,113::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' is free. Now locking as 'shared' (1 active user) >Thread-1043::DEBUG::2014-07-10 08:17:09,113::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9`ReqID=`008dea99-e589-4d29-9c92-8c8ee3c59ffb`::Granted request >Thread-1043::DEBUG::2014-07-10 08:17:09,113::task::827::TaskManager.Task::(resourceAcquired) Task=`6ced6029-409c-4bc6-a751-692bfdd7fa19`::_resourcesAcquired: Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9 (shared) >Thread-1043::DEBUG::2014-07-10 08:17:09,114::task::990::TaskManager.Task::(_decref) Task=`6ced6029-409c-4bc6-a751-692bfdd7fa19`::ref 1 aborting False >Thread-1043::INFO::2014-07-10 08:17:09,115::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DC-REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2, 'domains': u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': 'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c': {'status': u'Active', 'diskfree': '1137495244800', 'isoprefix': '', 'alerts': [], 'disktotal': '1152393412608', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532069482496', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-1043::DEBUG::2014-07-10 08:17:09,115::task::1185::TaskManager.Task::(prepare) Task=`6ced6029-409c-4bc6-a751-692bfdd7fa19`::finished: {'info': {'name': 'DC-REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2, 'domains': u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': 'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c': {'status': u'Active', 'diskfree': '1137495244800', 'isoprefix': '', 'alerts': [], 'disktotal': '1152393412608', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532069482496', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-1043::DEBUG::2014-07-10 08:17:09,115::task::595::TaskManager.Task::(_updateState) Task=`6ced6029-409c-4bc6-a751-692bfdd7fa19`::moving from state preparing -> state finished >Thread-1043::DEBUG::2014-07-10 08:17:09,115::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9': < ResourceRef 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9', isValid: 'True' obj: 'None'>} >Thread-1043::DEBUG::2014-07-10 08:17:09,115::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1043::DEBUG::2014-07-10 08:17:09,116::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' >Thread-1043::DEBUG::2014-07-10 08:17:09,116::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' (0 active users) >Thread-1043::DEBUG::2014-07-10 08:17:09,116::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' is free, finding out if anyone is waiting for it. >Thread-1043::DEBUG::2014-07-10 08:17:09,116::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9', Clearing records. >Thread-1043::DEBUG::2014-07-10 08:17:09,116::task::990::TaskManager.Task::(_decref) Task=`6ced6029-409c-4bc6-a751-692bfdd7fa19`::ref 0 aborting False >Dummy-36::DEBUG::2014-07-10 08:17:09,525::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-07-10 08:17:09,652::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0297026 s, 34.5 MB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-07-10 08:17:11,667::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-07-10 08:17:11,798::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0321441 s, 31.9 MB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-07-10 08:17:13,814::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-07-10 08:17:13,949::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0361172 s, 28.4 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 08:17:14,265::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lion.qa.lab.tlv.redhat.com:_export_yuri2_backup2/6a70504d-00df-4869-8695-0f442053f6b6/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-14::DEBUG::2014-07-10 08:17:14,323::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n369 bytes (369 B) copied, 0.000450306 s, 819 kB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-07-10 08:17:14,823::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/e01a3a36-d2ce-4153-bb57-d6e65b7ed08c/metadata bs=4096 count=1' (cwd None) >Thread-15::DEBUG::2014-07-10 08:17:14,880::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000760504 s, 5.4 MB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-07-10 08:17:15,964::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Thread-1042::DEBUG::2014-07-10 08:17:16,133::task::595::TaskManager.Task::(_updateState) Task=`8fc0dcf2-dd8a-42e3-841d-c5d10ae041a3`::moving from state init -> state preparing >Thread-1042::INFO::2014-07-10 08:17:16,138::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-1042::INFO::2014-07-10 08:17:16,143::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000760504', 'lastCheck': '1.2', 'valid': True}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000450306', 'lastCheck': '1.8', 'valid': True}} >Thread-1042::DEBUG::2014-07-10 08:17:16,146::task::1185::TaskManager.Task::(prepare) Task=`8fc0dcf2-dd8a-42e3-841d-c5d10ae041a3`::finished: {u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000760504', 'lastCheck': '1.2', 'valid': True}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000450306', 'lastCheck': '1.8', 'valid': True}} >Thread-1042::DEBUG::2014-07-10 08:17:16,148::task::595::TaskManager.Task::(_updateState) Task=`8fc0dcf2-dd8a-42e3-841d-c5d10ae041a3`::moving from state preparing -> state finished >Thread-1042::DEBUG::2014-07-10 08:17:16,150::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-1042::DEBUG::2014-07-10 08:17:16,153::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1042::DEBUG::2014-07-10 08:17:16,156::task::990::TaskManager.Task::(_decref) Task=`8fc0dcf2-dd8a-42e3-841d-c5d10ae041a3`::ref 0 aborting False >Dummy-36::DEBUG::2014-07-10 08:17:16,195::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0379332 s, 27.0 MB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-07-10 08:17:18,322::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-07-10 08:17:18,448::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0296876 s, 34.5 MB/s\n'; <rc> = 0 >Thread-1042::DEBUG::2014-07-10 08:17:19,176::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-1042::DEBUG::2014-07-10 08:17:19,177::task::595::TaskManager.Task::(_updateState) Task=`4ba009fb-098a-4543-97e5-c17555951249`::moving from state init -> state preparing >Thread-1042::INFO::2014-07-10 08:17:19,177::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='411039e4-4af2-4192-9de0-67dc1ed83ba9', options=None) >Thread-1042::INFO::2014-07-10 08:17:19,178::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2}} >Thread-1042::DEBUG::2014-07-10 08:17:19,178::task::1185::TaskManager.Task::(prepare) Task=`4ba009fb-098a-4543-97e5-c17555951249`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2}} >Thread-1042::DEBUG::2014-07-10 08:17:19,178::task::595::TaskManager.Task::(_updateState) Task=`4ba009fb-098a-4543-97e5-c17555951249`::moving from state preparing -> state finished >Thread-1042::DEBUG::2014-07-10 08:17:19,178::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-1042::DEBUG::2014-07-10 08:17:19,179::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1042::DEBUG::2014-07-10 08:17:19,179::task::990::TaskManager.Task::(_decref) Task=`4ba009fb-098a-4543-97e5-c17555951249`::ref 0 aborting False >Thread-1043::DEBUG::2014-07-10 08:17:19,183::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-1043::DEBUG::2014-07-10 08:17:19,183::task::595::TaskManager.Task::(_updateState) Task=`2fbcaf36-3b18-41c8-9894-5b4c718b4d10`::moving from state init -> state preparing >Thread-1043::INFO::2014-07-10 08:17:19,183::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='411039e4-4af2-4192-9de0-67dc1ed83ba9', options=None) >Thread-1043::DEBUG::2014-07-10 08:17:19,184::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9`ReqID=`d5f3bb00-a910-43d3-9d61-083466fcf324`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo' >Thread-1043::DEBUG::2014-07-10 08:17:19,184::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' for lock type 'shared' >Thread-1043::DEBUG::2014-07-10 08:17:19,184::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' is free. Now locking as 'shared' (1 active user) >Thread-1043::DEBUG::2014-07-10 08:17:19,185::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9`ReqID=`d5f3bb00-a910-43d3-9d61-083466fcf324`::Granted request >Thread-1043::DEBUG::2014-07-10 08:17:19,185::task::827::TaskManager.Task::(resourceAcquired) Task=`2fbcaf36-3b18-41c8-9894-5b4c718b4d10`::_resourcesAcquired: Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9 (shared) >Thread-1043::DEBUG::2014-07-10 08:17:19,185::task::990::TaskManager.Task::(_decref) Task=`2fbcaf36-3b18-41c8-9894-5b4c718b4d10`::ref 1 aborting False >Thread-1043::INFO::2014-07-10 08:17:19,186::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DC-REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2, 'domains': u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': 'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c': {'status': u'Active', 'diskfree': '1137495244800', 'isoprefix': '', 'alerts': [], 'disktotal': '1152393412608', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532069482496', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-1043::DEBUG::2014-07-10 08:17:19,187::task::1185::TaskManager.Task::(prepare) Task=`2fbcaf36-3b18-41c8-9894-5b4c718b4d10`::finished: {'info': {'name': 'DC-REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2, 'domains': u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': 'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c': {'status': u'Active', 'diskfree': '1137495244800', 'isoprefix': '', 'alerts': [], 'disktotal': '1152393412608', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532069482496', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-1043::DEBUG::2014-07-10 08:17:19,187::task::595::TaskManager.Task::(_updateState) Task=`2fbcaf36-3b18-41c8-9894-5b4c718b4d10`::moving from state preparing -> state finished >Thread-1043::DEBUG::2014-07-10 08:17:19,187::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9': < ResourceRef 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9', isValid: 'True' obj: 'None'>} >Thread-1043::DEBUG::2014-07-10 08:17:19,187::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1043::DEBUG::2014-07-10 08:17:19,187::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' >Thread-1043::DEBUG::2014-07-10 08:17:19,188::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' (0 active users) >Thread-1043::DEBUG::2014-07-10 08:17:19,188::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' is free, finding out if anyone is waiting for it. >Thread-1043::DEBUG::2014-07-10 08:17:19,188::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9', Clearing records. >Thread-1043::DEBUG::2014-07-10 08:17:19,188::task::990::TaskManager.Task::(_decref) Task=`2fbcaf36-3b18-41c8-9894-5b4c718b4d10`::ref 0 aborting False >Dummy-36::DEBUG::2014-07-10 08:17:20,463::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-07-10 08:17:20,631::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0326263 s, 31.4 MB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-07-10 08:17:22,647::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-07-10 08:17:22,782::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0355539 s, 28.8 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 08:17:24,348::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lion.qa.lab.tlv.redhat.com:_export_yuri2_backup2/6a70504d-00df-4869-8695-0f442053f6b6/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-14::DEBUG::2014-07-10 08:17:24,408::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n369 bytes (369 B) copied, 0.000508885 s, 725 kB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-07-10 08:17:24,796::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Thread-15::DEBUG::2014-07-10 08:17:24,917::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/e01a3a36-d2ce-4153-bb57-d6e65b7ed08c/metadata bs=4096 count=1' (cwd None) >Thread-15::DEBUG::2014-07-10 08:17:25,044::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00066768 s, 6.1 MB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-07-10 08:17:25,362::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0373783 s, 27.4 MB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-07-10 08:17:27,377::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-07-10 08:17:27,514::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0350787 s, 29.2 MB/s\n'; <rc> = 0 >Thread-1042::DEBUG::2014-07-10 08:17:29,212::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-1042::DEBUG::2014-07-10 08:17:29,213::task::595::TaskManager.Task::(_updateState) Task=`d6a2c454-d057-4a7e-bec6-510c77b2d199`::moving from state init -> state preparing >Thread-1042::INFO::2014-07-10 08:17:29,213::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='411039e4-4af2-4192-9de0-67dc1ed83ba9', options=None) >Thread-1042::INFO::2014-07-10 08:17:29,214::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2}} >Thread-1042::DEBUG::2014-07-10 08:17:29,214::task::1185::TaskManager.Task::(prepare) Task=`d6a2c454-d057-4a7e-bec6-510c77b2d199`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2}} >Thread-1042::DEBUG::2014-07-10 08:17:29,214::task::595::TaskManager.Task::(_updateState) Task=`d6a2c454-d057-4a7e-bec6-510c77b2d199`::moving from state preparing -> state finished >Thread-1042::DEBUG::2014-07-10 08:17:29,215::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-1042::DEBUG::2014-07-10 08:17:29,215::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1042::DEBUG::2014-07-10 08:17:29,215::task::990::TaskManager.Task::(_decref) Task=`d6a2c454-d057-4a7e-bec6-510c77b2d199`::ref 0 aborting False >Thread-1043::DEBUG::2014-07-10 08:17:29,219::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-1043::DEBUG::2014-07-10 08:17:29,219::task::595::TaskManager.Task::(_updateState) Task=`878841b0-ec61-4e52-930d-a19580434a76`::moving from state init -> state preparing >Thread-1043::INFO::2014-07-10 08:17:29,219::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='411039e4-4af2-4192-9de0-67dc1ed83ba9', options=None) >Thread-1043::DEBUG::2014-07-10 08:17:29,220::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9`ReqID=`f4c85a6d-0f57-47b3-8143-9a8c50e9e652`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo' >Thread-1043::DEBUG::2014-07-10 08:17:29,220::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' for lock type 'shared' >Thread-1043::DEBUG::2014-07-10 08:17:29,221::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' is free. Now locking as 'shared' (1 active user) >Thread-1043::DEBUG::2014-07-10 08:17:29,221::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9`ReqID=`f4c85a6d-0f57-47b3-8143-9a8c50e9e652`::Granted request >Thread-1043::DEBUG::2014-07-10 08:17:29,222::task::827::TaskManager.Task::(resourceAcquired) Task=`878841b0-ec61-4e52-930d-a19580434a76`::_resourcesAcquired: Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9 (shared) >Thread-1043::DEBUG::2014-07-10 08:17:29,222::task::990::TaskManager.Task::(_decref) Task=`878841b0-ec61-4e52-930d-a19580434a76`::ref 1 aborting False >Thread-1043::INFO::2014-07-10 08:17:29,223::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DC-REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2, 'domains': u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': 'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c': {'status': u'Active', 'diskfree': '1137495244800', 'isoprefix': '', 'alerts': [], 'disktotal': '1152393412608', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532069482496', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-1043::DEBUG::2014-07-10 08:17:29,223::task::1185::TaskManager.Task::(prepare) Task=`878841b0-ec61-4e52-930d-a19580434a76`::finished: {'info': {'name': 'DC-REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2, 'domains': u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': 'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c': {'status': u'Active', 'diskfree': '1137495244800', 'isoprefix': '', 'alerts': [], 'disktotal': '1152393412608', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532069482496', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-1043::DEBUG::2014-07-10 08:17:29,223::task::595::TaskManager.Task::(_updateState) Task=`878841b0-ec61-4e52-930d-a19580434a76`::moving from state preparing -> state finished >Thread-1043::DEBUG::2014-07-10 08:17:29,224::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9': < ResourceRef 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9', isValid: 'True' obj: 'None'>} >Thread-1043::DEBUG::2014-07-10 08:17:29,224::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1043::DEBUG::2014-07-10 08:17:29,224::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' >Thread-1043::DEBUG::2014-07-10 08:17:29,224::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' (0 active users) >Thread-1043::DEBUG::2014-07-10 08:17:29,224::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' is free, finding out if anyone is waiting for it. >Thread-1043::DEBUG::2014-07-10 08:17:29,225::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9', Clearing records. >Thread-1043::DEBUG::2014-07-10 08:17:29,225::task::990::TaskManager.Task::(_decref) Task=`878841b0-ec61-4e52-930d-a19580434a76`::ref 0 aborting False >Dummy-36::DEBUG::2014-07-10 08:17:29,529::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-07-10 08:17:29,656::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0303885 s, 33.7 MB/s\n'; <rc> = 0 >Thread-1042::DEBUG::2014-07-10 08:17:31,432::task::595::TaskManager.Task::(_updateState) Task=`7d2a3259-16e0-437d-bec7-9f6102d5499d`::moving from state init -> state preparing >Thread-1042::INFO::2014-07-10 08:17:31,433::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-1042::INFO::2014-07-10 08:17:31,433::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00066768', 'lastCheck': '6.1', 'valid': True}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000508885', 'lastCheck': '7.0', 'valid': True}} >Thread-1042::DEBUG::2014-07-10 08:17:31,434::task::1185::TaskManager.Task::(prepare) Task=`7d2a3259-16e0-437d-bec7-9f6102d5499d`::finished: {u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00066768', 'lastCheck': '6.1', 'valid': True}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000508885', 'lastCheck': '7.0', 'valid': True}} >Thread-1042::DEBUG::2014-07-10 08:17:31,434::task::595::TaskManager.Task::(_updateState) Task=`7d2a3259-16e0-437d-bec7-9f6102d5499d`::moving from state preparing -> state finished >Thread-1042::DEBUG::2014-07-10 08:17:31,434::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-1042::DEBUG::2014-07-10 08:17:31,434::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1042::DEBUG::2014-07-10 08:17:31,434::task::990::TaskManager.Task::(_decref) Task=`7d2a3259-16e0-437d-bec7-9f6102d5499d`::ref 0 aborting False >Dummy-36::DEBUG::2014-07-10 08:17:31,671::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-07-10 08:17:31,812::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0382484 s, 26.8 MB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-07-10 08:17:33,827::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-07-10 08:17:33,969::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0439743 s, 23.3 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 08:17:34,439::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lion.qa.lab.tlv.redhat.com:_export_yuri2_backup2/6a70504d-00df-4869-8695-0f442053f6b6/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-14::DEBUG::2014-07-10 08:17:34,503::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n369 bytes (369 B) copied, 0.000468527 s, 788 kB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-07-10 08:17:35,353::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/e01a3a36-d2ce-4153-bb57-d6e65b7ed08c/metadata bs=4096 count=1' (cwd None) >Thread-15::DEBUG::2014-07-10 08:17:35,415::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00589105 s, 695 kB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-07-10 08:17:36,005::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-07-10 08:17:36,161::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0548957 s, 18.7 MB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-07-10 08:17:38,176::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-07-10 08:17:38,332::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0568374 s, 18.0 MB/s\n'; <rc> = 0 >Thread-1042::DEBUG::2014-07-10 08:17:39,263::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-1042::DEBUG::2014-07-10 08:17:39,264::task::595::TaskManager.Task::(_updateState) Task=`5e02d211-f246-4a54-9d0e-69d720734bd2`::moving from state init -> state preparing >Thread-1042::INFO::2014-07-10 08:17:39,264::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='411039e4-4af2-4192-9de0-67dc1ed83ba9', options=None) >Thread-1042::INFO::2014-07-10 08:17:39,265::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2}} >Thread-1042::DEBUG::2014-07-10 08:17:39,265::task::1185::TaskManager.Task::(prepare) Task=`5e02d211-f246-4a54-9d0e-69d720734bd2`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2}} >Thread-1042::DEBUG::2014-07-10 08:17:39,265::task::595::TaskManager.Task::(_updateState) Task=`5e02d211-f246-4a54-9d0e-69d720734bd2`::moving from state preparing -> state finished >Thread-1042::DEBUG::2014-07-10 08:17:39,265::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-1042::DEBUG::2014-07-10 08:17:39,266::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1042::DEBUG::2014-07-10 08:17:39,266::task::990::TaskManager.Task::(_decref) Task=`5e02d211-f246-4a54-9d0e-69d720734bd2`::ref 0 aborting False >Thread-1043::DEBUG::2014-07-10 08:17:39,270::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-1043::DEBUG::2014-07-10 08:17:39,270::task::595::TaskManager.Task::(_updateState) Task=`05bc04e8-1906-429e-a606-3ed7acea66c7`::moving from state init -> state preparing >Thread-1043::INFO::2014-07-10 08:17:39,270::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='411039e4-4af2-4192-9de0-67dc1ed83ba9', options=None) >Thread-1043::DEBUG::2014-07-10 08:17:39,271::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9`ReqID=`50339578-2050-4258-8c97-5fbf64a09bc9`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo' >Thread-1043::DEBUG::2014-07-10 08:17:39,271::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' for lock type 'shared' >Thread-1043::DEBUG::2014-07-10 08:17:39,272::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' is free. Now locking as 'shared' (1 active user) >Thread-1043::DEBUG::2014-07-10 08:17:39,272::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9`ReqID=`50339578-2050-4258-8c97-5fbf64a09bc9`::Granted request >Thread-1043::DEBUG::2014-07-10 08:17:39,272::task::827::TaskManager.Task::(resourceAcquired) Task=`05bc04e8-1906-429e-a606-3ed7acea66c7`::_resourcesAcquired: Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9 (shared) >Thread-1043::DEBUG::2014-07-10 08:17:39,273::task::990::TaskManager.Task::(_decref) Task=`05bc04e8-1906-429e-a606-3ed7acea66c7`::ref 1 aborting False >Thread-1043::INFO::2014-07-10 08:17:39,274::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DC-REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2, 'domains': u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': 'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c': {'status': u'Active', 'diskfree': '1137495244800', 'isoprefix': '', 'alerts': [], 'disktotal': '1152393412608', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532069482496', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-1043::DEBUG::2014-07-10 08:17:39,274::task::1185::TaskManager.Task::(prepare) Task=`05bc04e8-1906-429e-a606-3ed7acea66c7`::finished: {'info': {'name': 'DC-REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2, 'domains': u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': 'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c': {'status': u'Active', 'diskfree': '1137495244800', 'isoprefix': '', 'alerts': [], 'disktotal': '1152393412608', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532069482496', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-1043::DEBUG::2014-07-10 08:17:39,274::task::595::TaskManager.Task::(_updateState) Task=`05bc04e8-1906-429e-a606-3ed7acea66c7`::moving from state preparing -> state finished >Thread-1043::DEBUG::2014-07-10 08:17:39,274::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9': < ResourceRef 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9', isValid: 'True' obj: 'None'>} >Thread-1043::DEBUG::2014-07-10 08:17:39,274::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1043::DEBUG::2014-07-10 08:17:39,275::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' >Thread-1043::DEBUG::2014-07-10 08:17:39,275::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' (0 active users) >Thread-1043::DEBUG::2014-07-10 08:17:39,275::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' is free, finding out if anyone is waiting for it. >Thread-1043::DEBUG::2014-07-10 08:17:39,275::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9', Clearing records. >Thread-1043::DEBUG::2014-07-10 08:17:39,275::task::990::TaskManager.Task::(_decref) Task=`05bc04e8-1906-429e-a606-3ed7acea66c7`::ref 0 aborting False >Dummy-36::DEBUG::2014-07-10 08:17:40,347::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-07-10 08:17:40,493::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0483771 s, 21.2 MB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-07-10 08:17:42,509::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-07-10 08:17:42,644::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0352749 s, 29.0 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 08:17:44,529::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lion.qa.lab.tlv.redhat.com:_export_yuri2_backup2/6a70504d-00df-4869-8695-0f442053f6b6/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-14::DEBUG::2014-07-10 08:17:44,593::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n369 bytes (369 B) copied, 0.000450626 s, 819 kB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-07-10 08:17:44,659::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-07-10 08:17:44,808::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0436123 s, 23.5 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-07-10 08:17:45,445::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/e01a3a36-d2ce-4153-bb57-d6e65b7ed08c/metadata bs=4096 count=1' (cwd None) >Thread-15::DEBUG::2014-07-10 08:17:45,514::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00570391 s, 718 kB/s\n'; <rc> = 0 >Thread-1042::DEBUG::2014-07-10 08:17:46,578::task::595::TaskManager.Task::(_updateState) Task=`ff027533-09b6-46e0-8603-ab95abd9aed9`::moving from state init -> state preparing >Thread-1042::INFO::2014-07-10 08:17:46,578::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-1042::INFO::2014-07-10 08:17:46,579::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00570391', 'lastCheck': '1.0', 'valid': True}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000450626', 'lastCheck': '2.0', 'valid': True}} >Thread-1042::DEBUG::2014-07-10 08:17:46,579::task::1185::TaskManager.Task::(prepare) Task=`ff027533-09b6-46e0-8603-ab95abd9aed9`::finished: {u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00570391', 'lastCheck': '1.0', 'valid': True}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000450626', 'lastCheck': '2.0', 'valid': True}} >Thread-1042::DEBUG::2014-07-10 08:17:46,579::task::595::TaskManager.Task::(_updateState) Task=`ff027533-09b6-46e0-8603-ab95abd9aed9`::moving from state preparing -> state finished >Thread-1042::DEBUG::2014-07-10 08:17:46,579::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-1042::DEBUG::2014-07-10 08:17:46,579::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1042::DEBUG::2014-07-10 08:17:46,580::task::990::TaskManager.Task::(_decref) Task=`ff027533-09b6-46e0-8603-ab95abd9aed9`::ref 0 aborting False >Dummy-36::DEBUG::2014-07-10 08:17:46,823::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-07-10 08:17:46,999::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.074486 s, 13.7 MB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-07-10 08:17:49,014::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-07-10 08:17:49,234::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.12181 s, 8.4 MB/s\n'; <rc> = 0 >Thread-1042::DEBUG::2014-07-10 08:17:49,312::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-1042::DEBUG::2014-07-10 08:17:49,314::task::595::TaskManager.Task::(_updateState) Task=`25300355-84e4-448b-a37d-7a373776694f`::moving from state init -> state preparing >Thread-1042::INFO::2014-07-10 08:17:49,314::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='411039e4-4af2-4192-9de0-67dc1ed83ba9', options=None) >Thread-1042::INFO::2014-07-10 08:17:49,315::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2}} >Thread-1042::DEBUG::2014-07-10 08:17:49,315::task::1185::TaskManager.Task::(prepare) Task=`25300355-84e4-448b-a37d-7a373776694f`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2}} >Thread-1042::DEBUG::2014-07-10 08:17:49,315::task::595::TaskManager.Task::(_updateState) Task=`25300355-84e4-448b-a37d-7a373776694f`::moving from state preparing -> state finished >Thread-1042::DEBUG::2014-07-10 08:17:49,315::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-1042::DEBUG::2014-07-10 08:17:49,315::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1042::DEBUG::2014-07-10 08:17:49,316::task::990::TaskManager.Task::(_decref) Task=`25300355-84e4-448b-a37d-7a373776694f`::ref 0 aborting False >Thread-1043::DEBUG::2014-07-10 08:17:49,320::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-1043::DEBUG::2014-07-10 08:17:49,320::task::595::TaskManager.Task::(_updateState) Task=`02bab92c-da92-4c9e-b459-edb48a8cb885`::moving from state init -> state preparing >Thread-1043::INFO::2014-07-10 08:17:49,320::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='411039e4-4af2-4192-9de0-67dc1ed83ba9', options=None) >Thread-1043::DEBUG::2014-07-10 08:17:49,321::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9`ReqID=`650d19c2-e613-4d5d-8f88-5a70c739fc6f`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo' >Thread-1043::DEBUG::2014-07-10 08:17:49,321::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' for lock type 'shared' >Thread-1043::DEBUG::2014-07-10 08:17:49,322::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' is free. Now locking as 'shared' (1 active user) >Thread-1043::DEBUG::2014-07-10 08:17:49,322::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9`ReqID=`650d19c2-e613-4d5d-8f88-5a70c739fc6f`::Granted request >Thread-1043::DEBUG::2014-07-10 08:17:49,322::task::827::TaskManager.Task::(resourceAcquired) Task=`02bab92c-da92-4c9e-b459-edb48a8cb885`::_resourcesAcquired: Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9 (shared) >Thread-1043::DEBUG::2014-07-10 08:17:49,323::task::990::TaskManager.Task::(_decref) Task=`02bab92c-da92-4c9e-b459-edb48a8cb885`::ref 1 aborting False >Thread-1043::INFO::2014-07-10 08:17:49,324::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DC-REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2, 'domains': u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': 'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c': {'status': u'Active', 'diskfree': '1137495244800', 'isoprefix': '', 'alerts': [], 'disktotal': '1152393412608', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532069482496', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-1043::DEBUG::2014-07-10 08:17:49,324::task::1185::TaskManager.Task::(prepare) Task=`02bab92c-da92-4c9e-b459-edb48a8cb885`::finished: {'info': {'name': 'DC-REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2, 'domains': u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': 'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c': {'status': u'Active', 'diskfree': '1137495244800', 'isoprefix': '', 'alerts': [], 'disktotal': '1152393412608', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532069482496', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-1043::DEBUG::2014-07-10 08:17:49,324::task::595::TaskManager.Task::(_updateState) Task=`02bab92c-da92-4c9e-b459-edb48a8cb885`::moving from state preparing -> state finished >Thread-1043::DEBUG::2014-07-10 08:17:49,324::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9': < ResourceRef 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9', isValid: 'True' obj: 'None'>} >Thread-1043::DEBUG::2014-07-10 08:17:49,325::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1043::DEBUG::2014-07-10 08:17:49,325::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' >Thread-1043::DEBUG::2014-07-10 08:17:49,325::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' (0 active users) >Thread-1043::DEBUG::2014-07-10 08:17:49,325::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' is free, finding out if anyone is waiting for it. >Thread-1043::DEBUG::2014-07-10 08:17:49,325::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9', Clearing records. >Thread-1043::DEBUG::2014-07-10 08:17:49,326::task::990::TaskManager.Task::(_decref) Task=`02bab92c-da92-4c9e-b459-edb48a8cb885`::ref 0 aborting False >Dummy-36::DEBUG::2014-07-10 08:17:51,249::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-07-10 08:17:51,449::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.100826 s, 10.2 MB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-07-10 08:17:53,464::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-07-10 08:17:53,621::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0561639 s, 18.2 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 08:17:54,624::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lion.qa.lab.tlv.redhat.com:_export_yuri2_backup2/6a70504d-00df-4869-8695-0f442053f6b6/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-14::DEBUG::2014-07-10 08:17:54,687::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n369 bytes (369 B) copied, 0.000490992 s, 752 kB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-07-10 08:17:55,543::domainMonitor::192::Storage.DomainMonitorThread::(_monitorDomain) Refreshing domain e01a3a36-d2ce-4153-bb57-d6e65b7ed08c >Thread-15::ERROR::2014-07-10 08:17:55,544::sdc::137::Storage.StorageDomainCache::(_findDomain) looking for unfetched domain e01a3a36-d2ce-4153-bb57-d6e65b7ed08c >Thread-15::ERROR::2014-07-10 08:17:55,544::sdc::154::Storage.StorageDomainCache::(_findUnfetchedDomain) looking for domain e01a3a36-d2ce-4153-bb57-d6e65b7ed08c >Thread-15::DEBUG::2014-07-10 08:17:55,544::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with LvMetadataRW backend >Thread-15::DEBUG::2014-07-10 08:17:55,545::blockSD::336::Storage.Misc.excCmd::(readlines) '/bin/dd iflag=direct skip=0 bs=2048 if=/dev/e01a3a36-d2ce-4153-bb57-d6e65b7ed08c/metadata count=1' (cwd None) >Thread-15::DEBUG::2014-07-10 08:17:55,615::blockSD::336::Storage.Misc.excCmd::(readlines) SUCCESS: <err> = '1+0 records in\n1+0 records out\n2048 bytes (2.0 kB) copied, 0.0152812 s, 134 kB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-07-10 08:17:55,616::misc::282::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '2048 bytes (2.0 kB) copied, 0.0152812 s, 134 kB/s'], size: 2048 >Thread-15::DEBUG::2014-07-10 08:17:55,616::persistentDict::234::Storage.PersistentDict::(refresh) read lines (LvMetadataRW)=[] >Thread-15::WARNING::2014-07-10 08:17:55,616::persistentDict::256::Storage.PersistentDict::(refresh) data has no embedded checksum - trust it as it is >Thread-15::DEBUG::2014-07-10 08:17:55,616::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with VGTagMetadataRW backend >Thread-15::DEBUG::2014-07-10 08:17:55,617::lvm::503::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-15::DEBUG::2014-07-10 08:17:55,617::lvm::505::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-15::DEBUG::2014-07-10 08:17:55,618::lvm::513::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-15::DEBUG::2014-07-10 08:17:55,618::lvm::525::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-15::DEBUG::2014-07-10 08:17:55,618::lvm::373::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-15::DEBUG::2014-07-10 08:17:55,619::lvm::296::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/3600601601282300032826addbbdae311|/dev/mapper/360060160f4a030003840ec867ddee311|/dev/mapper/367cad74c2fcba00019e6afd20c781e67|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name e01a3a36-d2ce-4153-bb57-d6e65b7ed08c' (cwd None) >Dummy-36::DEBUG::2014-07-10 08:17:55,676::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-07-10 08:17:55,835::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0621947 s, 16.5 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-07-10 08:17:55,985::lvm::296::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-15::DEBUG::2014-07-10 08:17:55,987::lvm::415::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-15::DEBUG::2014-07-10 08:17:55,988::persistentDict::234::Storage.PersistentDict::(refresh) read lines (VGTagMetadataRW)=['LEASETIMESEC=60', 'CLASS=Data', 'VERSION=3', u'PV1=pv:360060160f4a030003840ec867ddee311,uuid:0eUwla-dsA3-g6ia-RU23-cual-0rt9-KzkxLj,pestart:0,pecount:397,mapoffset:8189', u'PV0=pv:3600601601282300032826addbbdae311,uuid:ZdReOp-Yf8A-beQm-ne4I-pN3J-rxgm-9Ew0S1,pestart:0,pecount:8189,mapoffset:0', 'LOGBLKSIZE=512', 'LEASERETRIES=3', 'IOOPTIMEOUTSEC=10', 'LOCKRENEWALINTERVALSEC=5', 'PHYBLKSIZE=512', 'SDUUID=e01a3a36-d2ce-4153-bb57-d6e65b7ed08c', 'DESCRIPTION=SD-REAL', 'LOCKPOLICY=', 'VGUUID=GJcVo5-Y0kU-CDub-zITS-zfoL-Z7hz-SeVeIe', 'TYPE=ISCSI', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=DC-REAL', 'ROLE=Master', 'POOL_UUID=411039e4-4af2-4192-9de0-67dc1ed83ba9', 'POOL_SPM_ID=1', u'POOL_DOMAINS=6a70504d-00df-4869-8695-0f442053f6b6:Active,e01a3a36-d2ce-4153-bb57-d6e65b7ed08c:Active', '_SHA_CKSUM=cefcf6543a5de3bd5b35901e3ca494c6a6185b63', 'POOL_SPM_LVER=2'] >Thread-15::INFO::2014-07-10 08:17:55,989::sd::384::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace e01a3a36-d2ce-4153-bb57-d6e65b7ed08c_imageNS already registered >Thread-15::INFO::2014-07-10 08:17:55,989::sd::392::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace e01a3a36-d2ce-4153-bb57-d6e65b7ed08c_volumeNS already registered >Thread-15::INFO::2014-07-10 08:17:55,990::blockSD::452::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace e01a3a36-d2ce-4153-bb57-d6e65b7ed08c_lvmActivationNS already registered >Thread-15::DEBUG::2014-07-10 08:17:55,990::lvm::296::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgck --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/3600601601282300032826addbbdae311|/dev/mapper/360060160f4a030003840ec867ddee311|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } " e01a3a36-d2ce-4153-bb57-d6e65b7ed08c' (cwd None) >Thread-15::DEBUG::2014-07-10 08:17:56,275::lvm::296::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-15::DEBUG::2014-07-10 08:17:56,276::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/e01a3a36-d2ce-4153-bb57-d6e65b7ed08c/metadata bs=4096 count=1' (cwd None) >Thread-15::DEBUG::2014-07-10 08:17:56,347::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.0107751 s, 380 kB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-07-10 08:17:57,851::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-07-10 08:17:57,988::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0360445 s, 28.4 MB/s\n'; <rc> = 0 >Thread-1042::DEBUG::2014-07-10 08:17:59,362::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-1042::DEBUG::2014-07-10 08:17:59,363::task::595::TaskManager.Task::(_updateState) Task=`30ba3651-1c50-4ebb-beb0-7c490740a838`::moving from state init -> state preparing >Thread-1042::INFO::2014-07-10 08:17:59,363::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='411039e4-4af2-4192-9de0-67dc1ed83ba9', options=None) >Thread-1042::INFO::2014-07-10 08:17:59,364::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2}} >Thread-1042::DEBUG::2014-07-10 08:17:59,364::task::1185::TaskManager.Task::(prepare) Task=`30ba3651-1c50-4ebb-beb0-7c490740a838`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2}} >Thread-1042::DEBUG::2014-07-10 08:17:59,364::task::595::TaskManager.Task::(_updateState) Task=`30ba3651-1c50-4ebb-beb0-7c490740a838`::moving from state preparing -> state finished >Thread-1042::DEBUG::2014-07-10 08:17:59,364::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-1042::DEBUG::2014-07-10 08:17:59,365::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1042::DEBUG::2014-07-10 08:17:59,365::task::990::TaskManager.Task::(_decref) Task=`30ba3651-1c50-4ebb-beb0-7c490740a838`::ref 0 aborting False >Thread-1043::DEBUG::2014-07-10 08:17:59,369::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-1043::DEBUG::2014-07-10 08:17:59,369::task::595::TaskManager.Task::(_updateState) Task=`5843c1d5-b119-4682-b9b9-f964bc5509b1`::moving from state init -> state preparing >Thread-1043::INFO::2014-07-10 08:17:59,369::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='411039e4-4af2-4192-9de0-67dc1ed83ba9', options=None) >Thread-1043::DEBUG::2014-07-10 08:17:59,370::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9`ReqID=`151eda1a-a62e-4f9b-9066-fb09cd393828`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo' >Thread-1043::DEBUG::2014-07-10 08:17:59,370::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' for lock type 'shared' >Thread-1043::DEBUG::2014-07-10 08:17:59,371::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' is free. Now locking as 'shared' (1 active user) >Thread-1043::DEBUG::2014-07-10 08:17:59,371::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9`ReqID=`151eda1a-a62e-4f9b-9066-fb09cd393828`::Granted request >Thread-1043::DEBUG::2014-07-10 08:17:59,371::task::827::TaskManager.Task::(resourceAcquired) Task=`5843c1d5-b119-4682-b9b9-f964bc5509b1`::_resourcesAcquired: Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9 (shared) >Thread-1043::DEBUG::2014-07-10 08:17:59,372::task::990::TaskManager.Task::(_decref) Task=`5843c1d5-b119-4682-b9b9-f964bc5509b1`::ref 1 aborting False >Thread-1043::INFO::2014-07-10 08:17:59,373::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DC-REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2, 'domains': u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': 'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c': {'status': u'Active', 'diskfree': '1137495244800', 'isoprefix': '', 'alerts': [], 'disktotal': '1152393412608', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532069482496', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-1043::DEBUG::2014-07-10 08:17:59,373::task::1185::TaskManager.Task::(prepare) Task=`5843c1d5-b119-4682-b9b9-f964bc5509b1`::finished: {'info': {'name': 'DC-REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2, 'domains': u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': 'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c': {'status': u'Active', 'diskfree': '1137495244800', 'isoprefix': '', 'alerts': [], 'disktotal': '1152393412608', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532069482496', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-1043::DEBUG::2014-07-10 08:17:59,373::task::595::TaskManager.Task::(_updateState) Task=`5843c1d5-b119-4682-b9b9-f964bc5509b1`::moving from state preparing -> state finished >Thread-1043::DEBUG::2014-07-10 08:17:59,373::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9': < ResourceRef 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9', isValid: 'True' obj: 'None'>} >Thread-1043::DEBUG::2014-07-10 08:17:59,374::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1043::DEBUG::2014-07-10 08:17:59,374::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' >Thread-1043::DEBUG::2014-07-10 08:17:59,374::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' (0 active users) >Thread-1043::DEBUG::2014-07-10 08:17:59,374::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' is free, finding out if anyone is waiting for it. >Thread-1043::DEBUG::2014-07-10 08:17:59,374::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9', Clearing records. >Thread-1043::DEBUG::2014-07-10 08:17:59,375::task::990::TaskManager.Task::(_decref) Task=`5843c1d5-b119-4682-b9b9-f964bc5509b1`::ref 0 aborting False >Dummy-36::DEBUG::2014-07-10 08:18:00,003::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-07-10 08:18:00,180::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.078694 s, 13.0 MB/s\n'; <rc> = 0 >Thread-1042::DEBUG::2014-07-10 08:18:01,761::task::595::TaskManager.Task::(_updateState) Task=`1ee5e4a8-97f7-4fa7-a698-f7f0413722aa`::moving from state init -> state preparing >Thread-1042::INFO::2014-07-10 08:18:01,762::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-1042::INFO::2014-07-10 08:18:01,763::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0107751', 'lastCheck': '5.4', 'valid': True}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000490992', 'lastCheck': '7.1', 'valid': True}} >Thread-1042::DEBUG::2014-07-10 08:18:01,763::task::1185::TaskManager.Task::(prepare) Task=`1ee5e4a8-97f7-4fa7-a698-f7f0413722aa`::finished: {u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0107751', 'lastCheck': '5.4', 'valid': True}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000490992', 'lastCheck': '7.1', 'valid': True}} >Thread-1042::DEBUG::2014-07-10 08:18:01,763::task::595::TaskManager.Task::(_updateState) Task=`1ee5e4a8-97f7-4fa7-a698-f7f0413722aa`::moving from state preparing -> state finished >Thread-1042::DEBUG::2014-07-10 08:18:01,763::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-1042::DEBUG::2014-07-10 08:18:01,764::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1042::DEBUG::2014-07-10 08:18:01,764::task::990::TaskManager.Task::(_decref) Task=`1ee5e4a8-97f7-4fa7-a698-f7f0413722aa`::ref 0 aborting False >Dummy-36::DEBUG::2014-07-10 08:18:02,194::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-07-10 08:18:02,335::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0386611 s, 26.5 MB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-07-10 08:18:04,350::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-07-10 08:18:04,481::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0336462 s, 30.4 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 08:18:04,718::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lion.qa.lab.tlv.redhat.com:_export_yuri2_backup2/6a70504d-00df-4869-8695-0f442053f6b6/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-14::DEBUG::2014-07-10 08:18:04,783::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n369 bytes (369 B) copied, 0.000447728 s, 824 kB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-07-10 08:18:06,376::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/e01a3a36-d2ce-4153-bb57-d6e65b7ed08c/metadata bs=4096 count=1' (cwd None) >Thread-15::DEBUG::2014-07-10 08:18:06,435::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000966036 s, 4.2 MB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-07-10 08:18:06,497::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-07-10 08:18:06,637::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.038252 s, 26.8 MB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-07-10 08:18:08,652::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-07-10 08:18:08,788::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0347699 s, 29.5 MB/s\n'; <rc> = 0 >Thread-1042::DEBUG::2014-07-10 08:18:09,412::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-1042::DEBUG::2014-07-10 08:18:09,413::task::595::TaskManager.Task::(_updateState) Task=`2a020a26-1682-46a4-b681-56751c2b5654`::moving from state init -> state preparing >Thread-1042::INFO::2014-07-10 08:18:09,414::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='411039e4-4af2-4192-9de0-67dc1ed83ba9', options=None) >Thread-1042::INFO::2014-07-10 08:18:09,414::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2}} >Thread-1042::DEBUG::2014-07-10 08:18:09,415::task::1185::TaskManager.Task::(prepare) Task=`2a020a26-1682-46a4-b681-56751c2b5654`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2}} >Thread-1042::DEBUG::2014-07-10 08:18:09,415::task::595::TaskManager.Task::(_updateState) Task=`2a020a26-1682-46a4-b681-56751c2b5654`::moving from state preparing -> state finished >Thread-1042::DEBUG::2014-07-10 08:18:09,415::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-1042::DEBUG::2014-07-10 08:18:09,415::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1042::DEBUG::2014-07-10 08:18:09,415::task::990::TaskManager.Task::(_decref) Task=`2a020a26-1682-46a4-b681-56751c2b5654`::ref 0 aborting False >Thread-1043::DEBUG::2014-07-10 08:18:09,419::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-1043::DEBUG::2014-07-10 08:18:09,420::task::595::TaskManager.Task::(_updateState) Task=`5031b62e-27d5-48f3-a145-85267efbfce0`::moving from state init -> state preparing >Thread-1043::INFO::2014-07-10 08:18:09,420::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='411039e4-4af2-4192-9de0-67dc1ed83ba9', options=None) >Thread-1043::DEBUG::2014-07-10 08:18:09,421::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9`ReqID=`5cbaf720-01e1-4db8-a9ae-460214023317`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo' >Thread-1043::DEBUG::2014-07-10 08:18:09,421::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' for lock type 'shared' >Thread-1043::DEBUG::2014-07-10 08:18:09,421::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' is free. Now locking as 'shared' (1 active user) >Thread-1043::DEBUG::2014-07-10 08:18:09,421::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9`ReqID=`5cbaf720-01e1-4db8-a9ae-460214023317`::Granted request >Thread-1043::DEBUG::2014-07-10 08:18:09,422::task::827::TaskManager.Task::(resourceAcquired) Task=`5031b62e-27d5-48f3-a145-85267efbfce0`::_resourcesAcquired: Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9 (shared) >Thread-1043::DEBUG::2014-07-10 08:18:09,422::task::990::TaskManager.Task::(_decref) Task=`5031b62e-27d5-48f3-a145-85267efbfce0`::ref 1 aborting False >Thread-1043::INFO::2014-07-10 08:18:09,423::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DC-REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2, 'domains': u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': 'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c': {'status': u'Active', 'diskfree': '1137495244800', 'isoprefix': '', 'alerts': [], 'disktotal': '1152393412608', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532069482496', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-1043::DEBUG::2014-07-10 08:18:09,424::task::1185::TaskManager.Task::(prepare) Task=`5031b62e-27d5-48f3-a145-85267efbfce0`::finished: {'info': {'name': 'DC-REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2, 'domains': u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': 'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c': {'status': u'Active', 'diskfree': '1137495244800', 'isoprefix': '', 'alerts': [], 'disktotal': '1152393412608', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532069482496', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-1043::DEBUG::2014-07-10 08:18:09,424::task::595::TaskManager.Task::(_updateState) Task=`5031b62e-27d5-48f3-a145-85267efbfce0`::moving from state preparing -> state finished >Thread-1043::DEBUG::2014-07-10 08:18:09,424::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9': < ResourceRef 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9', isValid: 'True' obj: 'None'>} >Thread-1043::DEBUG::2014-07-10 08:18:09,424::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1043::DEBUG::2014-07-10 08:18:09,424::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' >Thread-1043::DEBUG::2014-07-10 08:18:09,425::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' (0 active users) >Thread-1043::DEBUG::2014-07-10 08:18:09,425::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' is free, finding out if anyone is waiting for it. >Thread-1043::DEBUG::2014-07-10 08:18:09,425::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9', Clearing records. >Thread-1043::DEBUG::2014-07-10 08:18:09,425::task::990::TaskManager.Task::(_decref) Task=`5031b62e-27d5-48f3-a145-85267efbfce0`::ref 0 aborting False >Dummy-36::DEBUG::2014-07-10 08:18:10,803::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-07-10 08:18:10,952::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0494645 s, 20.7 MB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-07-10 08:18:12,969::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-07-10 08:18:13,110::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0386368 s, 26.5 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 08:18:14,808::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lion.qa.lab.tlv.redhat.com:_export_yuri2_backup2/6a70504d-00df-4869-8695-0f442053f6b6/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-14::DEBUG::2014-07-10 08:18:14,871::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n369 bytes (369 B) copied, 0.000505393 s, 730 kB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-07-10 08:18:15,125::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-07-10 08:18:15,268::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0398703 s, 25.7 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-07-10 08:18:16,464::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/e01a3a36-d2ce-4153-bb57-d6e65b7ed08c/metadata bs=4096 count=1' (cwd None) >Thread-15::DEBUG::2014-07-10 08:18:16,536::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00898254 s, 456 kB/s\n'; <rc> = 0 >Thread-1042::DEBUG::2014-07-10 08:18:16,912::task::595::TaskManager.Task::(_updateState) Task=`8e4ba913-619e-4c00-8e77-cef771817319`::moving from state init -> state preparing >Thread-1042::INFO::2014-07-10 08:18:16,912::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-1042::INFO::2014-07-10 08:18:16,913::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00898254', 'lastCheck': '0.3', 'valid': True}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000505393', 'lastCheck': '2.0', 'valid': True}} >Thread-1042::DEBUG::2014-07-10 08:18:16,913::task::1185::TaskManager.Task::(prepare) Task=`8e4ba913-619e-4c00-8e77-cef771817319`::finished: {u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00898254', 'lastCheck': '0.3', 'valid': True}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000505393', 'lastCheck': '2.0', 'valid': True}} >Thread-1042::DEBUG::2014-07-10 08:18:16,913::task::595::TaskManager.Task::(_updateState) Task=`8e4ba913-619e-4c00-8e77-cef771817319`::moving from state preparing -> state finished >Thread-1042::DEBUG::2014-07-10 08:18:16,913::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-1042::DEBUG::2014-07-10 08:18:16,913::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1042::DEBUG::2014-07-10 08:18:16,914::task::990::TaskManager.Task::(_decref) Task=`8e4ba913-619e-4c00-8e77-cef771817319`::ref 0 aborting False >Dummy-36::DEBUG::2014-07-10 08:18:17,283::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-07-10 08:18:17,424::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0382552 s, 26.8 MB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-07-10 08:18:19,439::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Thread-1042::DEBUG::2014-07-10 08:18:19,498::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-1042::DEBUG::2014-07-10 08:18:19,501::task::595::TaskManager.Task::(_updateState) Task=`e154a8cf-6d8b-4e20-a869-141930cd3924`::moving from state init -> state preparing >Thread-1042::INFO::2014-07-10 08:18:19,502::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='411039e4-4af2-4192-9de0-67dc1ed83ba9', options=None) >Thread-1042::INFO::2014-07-10 08:18:19,503::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2}} >Thread-1042::DEBUG::2014-07-10 08:18:19,503::task::1185::TaskManager.Task::(prepare) Task=`e154a8cf-6d8b-4e20-a869-141930cd3924`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2}} >Thread-1042::DEBUG::2014-07-10 08:18:19,504::task::595::TaskManager.Task::(_updateState) Task=`e154a8cf-6d8b-4e20-a869-141930cd3924`::moving from state preparing -> state finished >Thread-1042::DEBUG::2014-07-10 08:18:19,504::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-1042::DEBUG::2014-07-10 08:18:19,505::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1042::DEBUG::2014-07-10 08:18:19,505::task::990::TaskManager.Task::(_decref) Task=`e154a8cf-6d8b-4e20-a869-141930cd3924`::ref 0 aborting False >Thread-1043::DEBUG::2014-07-10 08:18:19,511::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-1043::DEBUG::2014-07-10 08:18:19,512::task::595::TaskManager.Task::(_updateState) Task=`5ad1b203-d180-4626-98b7-7443e6ae57d0`::moving from state init -> state preparing >Thread-1043::INFO::2014-07-10 08:18:19,513::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='411039e4-4af2-4192-9de0-67dc1ed83ba9', options=None) >Thread-1043::DEBUG::2014-07-10 08:18:19,514::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9`ReqID=`0fa9b401-0f01-4183-a7a9-96a1dc32b41b`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo' >Thread-1043::DEBUG::2014-07-10 08:18:19,515::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' for lock type 'shared' >Thread-1043::DEBUG::2014-07-10 08:18:19,516::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' is free. Now locking as 'shared' (1 active user) >Thread-1043::DEBUG::2014-07-10 08:18:19,517::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9`ReqID=`0fa9b401-0f01-4183-a7a9-96a1dc32b41b`::Granted request >Thread-1043::DEBUG::2014-07-10 08:18:19,518::task::827::TaskManager.Task::(resourceAcquired) Task=`5ad1b203-d180-4626-98b7-7443e6ae57d0`::_resourcesAcquired: Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9 (shared) >Thread-1043::DEBUG::2014-07-10 08:18:19,519::task::990::TaskManager.Task::(_decref) Task=`5ad1b203-d180-4626-98b7-7443e6ae57d0`::ref 1 aborting False >Thread-1043::INFO::2014-07-10 08:18:19,521::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DC-REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2, 'domains': u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': 'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c': {'status': u'Active', 'diskfree': '1137495244800', 'isoprefix': '', 'alerts': [], 'disktotal': '1152393412608', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532069482496', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-1043::DEBUG::2014-07-10 08:18:19,521::task::1185::TaskManager.Task::(prepare) Task=`5ad1b203-d180-4626-98b7-7443e6ae57d0`::finished: {'info': {'name': 'DC-REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2, 'domains': u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': 'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c': {'status': u'Active', 'diskfree': '1137495244800', 'isoprefix': '', 'alerts': [], 'disktotal': '1152393412608', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532069482496', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-1043::DEBUG::2014-07-10 08:18:19,522::task::595::TaskManager.Task::(_updateState) Task=`5ad1b203-d180-4626-98b7-7443e6ae57d0`::moving from state preparing -> state finished >Thread-1043::DEBUG::2014-07-10 08:18:19,523::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9': < ResourceRef 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9', isValid: 'True' obj: 'None'>} >Thread-1043::DEBUG::2014-07-10 08:18:19,523::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1043::DEBUG::2014-07-10 08:18:19,524::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' >Thread-1043::DEBUG::2014-07-10 08:18:19,525::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' (0 active users) >Thread-1043::DEBUG::2014-07-10 08:18:19,526::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' is free, finding out if anyone is waiting for it. >Thread-1043::DEBUG::2014-07-10 08:18:19,527::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9', Clearing records. >Thread-1043::DEBUG::2014-07-10 08:18:19,527::task::990::TaskManager.Task::(_decref) Task=`5ad1b203-d180-4626-98b7-7443e6ae57d0`::ref 0 aborting False >Dummy-36::DEBUG::2014-07-10 08:18:19,589::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0521539 s, 19.6 MB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-07-10 08:18:21,604::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-07-10 08:18:21,734::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0327226 s, 31.3 MB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-07-10 08:18:23,749::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-07-10 08:18:23,880::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0303853 s, 33.7 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 08:18:24,902::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lion.qa.lab.tlv.redhat.com:_export_yuri2_backup2/6a70504d-00df-4869-8695-0f442053f6b6/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-14::DEBUG::2014-07-10 08:18:24,966::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n369 bytes (369 B) copied, 0.000519133 s, 711 kB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-07-10 08:18:25,895::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-07-10 08:18:26,044::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0387851 s, 26.4 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-07-10 08:18:26,566::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/e01a3a36-d2ce-4153-bb57-d6e65b7ed08c/metadata bs=4096 count=1' (cwd None) >Thread-15::DEBUG::2014-07-10 08:18:26,643::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.0124769 s, 328 kB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-07-10 08:18:28,061::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-07-10 08:18:28,212::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0518416 s, 19.8 MB/s\n'; <rc> = 0 >Thread-1042::DEBUG::2014-07-10 08:18:29,554::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-1042::DEBUG::2014-07-10 08:18:29,555::task::595::TaskManager.Task::(_updateState) Task=`95a6d7ca-e656-4ef4-add5-7c52bf64ce93`::moving from state init -> state preparing >Thread-1042::INFO::2014-07-10 08:18:29,555::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='411039e4-4af2-4192-9de0-67dc1ed83ba9', options=None) >Thread-1042::INFO::2014-07-10 08:18:29,556::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2}} >Thread-1042::DEBUG::2014-07-10 08:18:29,556::task::1185::TaskManager.Task::(prepare) Task=`95a6d7ca-e656-4ef4-add5-7c52bf64ce93`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2}} >Thread-1042::DEBUG::2014-07-10 08:18:29,556::task::595::TaskManager.Task::(_updateState) Task=`95a6d7ca-e656-4ef4-add5-7c52bf64ce93`::moving from state preparing -> state finished >Thread-1042::DEBUG::2014-07-10 08:18:29,556::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-1042::DEBUG::2014-07-10 08:18:29,557::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1042::DEBUG::2014-07-10 08:18:29,557::task::990::TaskManager.Task::(_decref) Task=`95a6d7ca-e656-4ef4-add5-7c52bf64ce93`::ref 0 aborting False >Thread-1043::DEBUG::2014-07-10 08:18:29,560::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-1043::DEBUG::2014-07-10 08:18:29,561::task::595::TaskManager.Task::(_updateState) Task=`2391bc3c-a06b-45a5-86e4-1feea6838804`::moving from state init -> state preparing >Thread-1043::INFO::2014-07-10 08:18:29,561::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='411039e4-4af2-4192-9de0-67dc1ed83ba9', options=None) >Thread-1043::DEBUG::2014-07-10 08:18:29,562::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9`ReqID=`5970dd5a-2b12-45c8-bfae-983fbabd0907`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo' >Thread-1043::DEBUG::2014-07-10 08:18:29,562::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' for lock type 'shared' >Thread-1043::DEBUG::2014-07-10 08:18:29,563::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' is free. Now locking as 'shared' (1 active user) >Thread-1043::DEBUG::2014-07-10 08:18:29,563::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9`ReqID=`5970dd5a-2b12-45c8-bfae-983fbabd0907`::Granted request >Thread-1043::DEBUG::2014-07-10 08:18:29,563::task::827::TaskManager.Task::(resourceAcquired) Task=`2391bc3c-a06b-45a5-86e4-1feea6838804`::_resourcesAcquired: Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9 (shared) >Thread-1043::DEBUG::2014-07-10 08:18:29,563::task::990::TaskManager.Task::(_decref) Task=`2391bc3c-a06b-45a5-86e4-1feea6838804`::ref 1 aborting False >Thread-1043::INFO::2014-07-10 08:18:29,564::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DC-REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2, 'domains': u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': 'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c': {'status': u'Active', 'diskfree': '1137495244800', 'isoprefix': '', 'alerts': [], 'disktotal': '1152393412608', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532069482496', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-1043::DEBUG::2014-07-10 08:18:29,565::task::1185::TaskManager.Task::(prepare) Task=`2391bc3c-a06b-45a5-86e4-1feea6838804`::finished: {'info': {'name': 'DC-REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2, 'domains': u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': 'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c': {'status': u'Active', 'diskfree': '1137495244800', 'isoprefix': '', 'alerts': [], 'disktotal': '1152393412608', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532069482496', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-1043::DEBUG::2014-07-10 08:18:29,565::task::595::TaskManager.Task::(_updateState) Task=`2391bc3c-a06b-45a5-86e4-1feea6838804`::moving from state preparing -> state finished >Thread-1043::DEBUG::2014-07-10 08:18:29,565::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9': < ResourceRef 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9', isValid: 'True' obj: 'None'>} >Thread-1043::DEBUG::2014-07-10 08:18:29,565::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1043::DEBUG::2014-07-10 08:18:29,565::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' >Thread-1043::DEBUG::2014-07-10 08:18:29,566::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' (0 active users) >Thread-1043::DEBUG::2014-07-10 08:18:29,566::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' is free, finding out if anyone is waiting for it. >Thread-1043::DEBUG::2014-07-10 08:18:29,566::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9', Clearing records. >Thread-1043::DEBUG::2014-07-10 08:18:29,566::task::990::TaskManager.Task::(_decref) Task=`2391bc3c-a06b-45a5-86e4-1feea6838804`::ref 0 aborting False >Dummy-36::DEBUG::2014-07-10 08:18:30,227::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-07-10 08:18:30,398::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0692331 s, 14.8 MB/s\n'; <rc> = 0 >Thread-1042::DEBUG::2014-07-10 08:18:32,060::task::595::TaskManager.Task::(_updateState) Task=`2323a5f8-4b3d-4dee-a567-010f3ad20642`::moving from state init -> state preparing >Thread-1042::INFO::2014-07-10 08:18:32,061::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-1042::INFO::2014-07-10 08:18:32,061::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0124769', 'lastCheck': '5.4', 'valid': True}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000519133', 'lastCheck': '7.1', 'valid': True}} >Thread-1042::DEBUG::2014-07-10 08:18:32,061::task::1185::TaskManager.Task::(prepare) Task=`2323a5f8-4b3d-4dee-a567-010f3ad20642`::finished: {u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0124769', 'lastCheck': '5.4', 'valid': True}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000519133', 'lastCheck': '7.1', 'valid': True}} >Thread-1042::DEBUG::2014-07-10 08:18:32,061::task::595::TaskManager.Task::(_updateState) Task=`2323a5f8-4b3d-4dee-a567-010f3ad20642`::moving from state preparing -> state finished >Thread-1042::DEBUG::2014-07-10 08:18:32,062::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-1042::DEBUG::2014-07-10 08:18:32,062::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1042::DEBUG::2014-07-10 08:18:32,062::task::990::TaskManager.Task::(_decref) Task=`2323a5f8-4b3d-4dee-a567-010f3ad20642`::ref 0 aborting False >Dummy-36::DEBUG::2014-07-10 08:18:32,414::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-07-10 08:18:32,587::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0743664 s, 13.8 MB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-07-10 08:18:34,596::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-07-10 08:18:34,728::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0328011 s, 31.2 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 08:18:34,996::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lion.qa.lab.tlv.redhat.com:_export_yuri2_backup2/6a70504d-00df-4869-8695-0f442053f6b6/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-14::DEBUG::2014-07-10 08:18:35,060::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n369 bytes (369 B) copied, 0.000470078 s, 785 kB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-07-10 08:18:36,672::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/e01a3a36-d2ce-4153-bb57-d6e65b7ed08c/metadata bs=4096 count=1' (cwd None) >Dummy-36::DEBUG::2014-07-10 08:18:36,747::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Thread-15::DEBUG::2014-07-10 08:18:36,823::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.015935 s, 257 kB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-07-10 08:18:37,140::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.285956 s, 3.6 MB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-07-10 08:18:39,155::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Thread-1042::DEBUG::2014-07-10 08:18:39,613::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-1042::DEBUG::2014-07-10 08:18:39,626::task::595::TaskManager.Task::(_updateState) Task=`c7d90da1-c970-406c-98b4-4a11b12b205b`::moving from state init -> state preparing >Thread-1042::INFO::2014-07-10 08:18:39,635::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='411039e4-4af2-4192-9de0-67dc1ed83ba9', options=None) >Thread-1042::INFO::2014-07-10 08:18:39,646::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2}} >Thread-1042::DEBUG::2014-07-10 08:18:39,653::task::1185::TaskManager.Task::(prepare) Task=`c7d90da1-c970-406c-98b4-4a11b12b205b`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2}} >Thread-1042::DEBUG::2014-07-10 08:18:39,660::task::595::TaskManager.Task::(_updateState) Task=`c7d90da1-c970-406c-98b4-4a11b12b205b`::moving from state preparing -> state finished >Thread-1042::DEBUG::2014-07-10 08:18:39,666::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-1042::DEBUG::2014-07-10 08:18:39,673::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1042::DEBUG::2014-07-10 08:18:39,681::task::990::TaskManager.Task::(_decref) Task=`c7d90da1-c970-406c-98b4-4a11b12b205b`::ref 0 aborting False >Thread-1043::DEBUG::2014-07-10 08:18:39,714::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-1043::DEBUG::2014-07-10 08:18:39,725::task::595::TaskManager.Task::(_updateState) Task=`86d203c0-addc-48be-99fa-a78703a02542`::moving from state init -> state preparing >Thread-1043::INFO::2014-07-10 08:18:39,733::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='411039e4-4af2-4192-9de0-67dc1ed83ba9', options=None) >Thread-1043::DEBUG::2014-07-10 08:18:39,750::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9`ReqID=`a368737e-5002-4f2b-951a-75b8d8fd1baf`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo' >Thread-1043::DEBUG::2014-07-10 08:18:39,756::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' for lock type 'shared' >Thread-1043::DEBUG::2014-07-10 08:18:39,767::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' is free. Now locking as 'shared' (1 active user) >Thread-1043::DEBUG::2014-07-10 08:18:39,774::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9`ReqID=`a368737e-5002-4f2b-951a-75b8d8fd1baf`::Granted request >Thread-1043::DEBUG::2014-07-10 08:18:39,790::task::827::TaskManager.Task::(resourceAcquired) Task=`86d203c0-addc-48be-99fa-a78703a02542`::_resourcesAcquired: Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9 (shared) >Thread-1043::DEBUG::2014-07-10 08:18:39,797::task::990::TaskManager.Task::(_decref) Task=`86d203c0-addc-48be-99fa-a78703a02542`::ref 1 aborting False >Thread-1043::INFO::2014-07-10 08:18:39,832::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DC-REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2, 'domains': u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': 'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c': {'status': u'Active', 'diskfree': '1137495244800', 'isoprefix': '', 'alerts': [], 'disktotal': '1152393412608', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532069482496', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-1043::DEBUG::2014-07-10 08:18:39,834::task::1185::TaskManager.Task::(prepare) Task=`86d203c0-addc-48be-99fa-a78703a02542`::finished: {'info': {'name': 'DC-REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2, 'domains': u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': 'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c': {'status': u'Active', 'diskfree': '1137495244800', 'isoprefix': '', 'alerts': [], 'disktotal': '1152393412608', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532069482496', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-1043::DEBUG::2014-07-10 08:18:39,836::task::595::TaskManager.Task::(_updateState) Task=`86d203c0-addc-48be-99fa-a78703a02542`::moving from state preparing -> state finished >Thread-1043::DEBUG::2014-07-10 08:18:39,838::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9': < ResourceRef 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9', isValid: 'True' obj: 'None'>} >Thread-1043::DEBUG::2014-07-10 08:18:39,840::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1043::DEBUG::2014-07-10 08:18:39,843::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' >Thread-1043::DEBUG::2014-07-10 08:18:39,846::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' (0 active users) >Thread-1043::DEBUG::2014-07-10 08:18:39,848::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' is free, finding out if anyone is waiting for it. >Thread-1043::DEBUG::2014-07-10 08:18:39,850::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9', Clearing records. >Thread-1043::DEBUG::2014-07-10 08:18:39,854::task::990::TaskManager.Task::(_decref) Task=`86d203c0-addc-48be-99fa-a78703a02542`::ref 0 aborting False >Dummy-36::DEBUG::2014-07-10 08:18:39,877::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0324785 s, 31.5 MB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-07-10 08:18:41,891::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-07-10 08:18:42,021::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0311944 s, 32.8 MB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-07-10 08:18:44,037::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-07-10 08:18:44,178::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0394403 s, 26.0 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 08:18:45,089::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lion.qa.lab.tlv.redhat.com:_export_yuri2_backup2/6a70504d-00df-4869-8695-0f442053f6b6/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-14::DEBUG::2014-07-10 08:18:45,152::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n369 bytes (369 B) copied, 0.000398969 s, 925 kB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-07-10 08:18:46,201::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-07-10 08:18:46,336::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0387931 s, 26.4 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-07-10 08:18:47,084::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/e01a3a36-d2ce-4153-bb57-d6e65b7ed08c/metadata bs=4096 count=1' (cwd None) >Thread-15::DEBUG::2014-07-10 08:18:47,148::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00111344 s, 3.7 MB/s\n'; <rc> = 0 >Thread-1042::DEBUG::2014-07-10 08:18:47,205::task::595::TaskManager.Task::(_updateState) Task=`d9ef9afc-1f49-44e8-a6b9-35f874f267a6`::moving from state init -> state preparing >Thread-1042::INFO::2014-07-10 08:18:47,205::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-1042::INFO::2014-07-10 08:18:47,206::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00111344', 'lastCheck': '0.0', 'valid': True}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000398969', 'lastCheck': '2.0', 'valid': True}} >Thread-1042::DEBUG::2014-07-10 08:18:47,206::task::1185::TaskManager.Task::(prepare) Task=`d9ef9afc-1f49-44e8-a6b9-35f874f267a6`::finished: {u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00111344', 'lastCheck': '0.0', 'valid': True}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000398969', 'lastCheck': '2.0', 'valid': True}} >Thread-1042::DEBUG::2014-07-10 08:18:47,206::task::595::TaskManager.Task::(_updateState) Task=`d9ef9afc-1f49-44e8-a6b9-35f874f267a6`::moving from state preparing -> state finished >Thread-1042::DEBUG::2014-07-10 08:18:47,206::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-1042::DEBUG::2014-07-10 08:18:47,207::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1042::DEBUG::2014-07-10 08:18:47,207::task::990::TaskManager.Task::(_decref) Task=`d9ef9afc-1f49-44e8-a6b9-35f874f267a6`::ref 0 aborting False >Dummy-36::DEBUG::2014-07-10 08:18:48,351::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-07-10 08:18:48,489::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0382921 s, 26.7 MB/s\n'; <rc> = 0 >Thread-1042::DEBUG::2014-07-10 08:18:49,917::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-1042::DEBUG::2014-07-10 08:18:49,919::task::595::TaskManager.Task::(_updateState) Task=`b135c539-bd70-48b5-99f8-f39d2dc566b2`::moving from state init -> state preparing >Thread-1042::INFO::2014-07-10 08:18:49,919::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='411039e4-4af2-4192-9de0-67dc1ed83ba9', options=None) >Thread-1042::INFO::2014-07-10 08:18:49,920::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2}} >Thread-1042::DEBUG::2014-07-10 08:18:49,920::task::1185::TaskManager.Task::(prepare) Task=`b135c539-bd70-48b5-99f8-f39d2dc566b2`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2}} >Thread-1042::DEBUG::2014-07-10 08:18:49,920::task::595::TaskManager.Task::(_updateState) Task=`b135c539-bd70-48b5-99f8-f39d2dc566b2`::moving from state preparing -> state finished >Thread-1042::DEBUG::2014-07-10 08:18:49,920::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-1042::DEBUG::2014-07-10 08:18:49,920::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1042::DEBUG::2014-07-10 08:18:49,921::task::990::TaskManager.Task::(_decref) Task=`b135c539-bd70-48b5-99f8-f39d2dc566b2`::ref 0 aborting False >Thread-1043::DEBUG::2014-07-10 08:18:49,924::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-1043::DEBUG::2014-07-10 08:18:49,925::task::595::TaskManager.Task::(_updateState) Task=`9a8f7196-ffab-4670-803a-c5b789296b09`::moving from state init -> state preparing >Thread-1043::INFO::2014-07-10 08:18:49,925::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='411039e4-4af2-4192-9de0-67dc1ed83ba9', options=None) >Thread-1043::DEBUG::2014-07-10 08:18:49,926::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9`ReqID=`7ca03c2e-1abb-4f97-91a0-dfc4ed87f8e5`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo' >Thread-1043::DEBUG::2014-07-10 08:18:49,926::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' for lock type 'shared' >Thread-1043::DEBUG::2014-07-10 08:18:49,926::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' is free. Now locking as 'shared' (1 active user) >Thread-1043::DEBUG::2014-07-10 08:18:49,927::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9`ReqID=`7ca03c2e-1abb-4f97-91a0-dfc4ed87f8e5`::Granted request >Thread-1043::DEBUG::2014-07-10 08:18:49,929::task::827::TaskManager.Task::(resourceAcquired) Task=`9a8f7196-ffab-4670-803a-c5b789296b09`::_resourcesAcquired: Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9 (shared) >Thread-1043::DEBUG::2014-07-10 08:18:49,929::task::990::TaskManager.Task::(_decref) Task=`9a8f7196-ffab-4670-803a-c5b789296b09`::ref 1 aborting False >Thread-1043::INFO::2014-07-10 08:18:49,930::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DC-REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2, 'domains': u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': 'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c': {'status': u'Active', 'diskfree': '1137495244800', 'isoprefix': '', 'alerts': [], 'disktotal': '1152393412608', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532069482496', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-1043::DEBUG::2014-07-10 08:18:49,930::task::1185::TaskManager.Task::(prepare) Task=`9a8f7196-ffab-4670-803a-c5b789296b09`::finished: {'info': {'name': 'DC-REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2, 'domains': u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': 'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c': {'status': u'Active', 'diskfree': '1137495244800', 'isoprefix': '', 'alerts': [], 'disktotal': '1152393412608', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532069482496', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-1043::DEBUG::2014-07-10 08:18:49,930::task::595::TaskManager.Task::(_updateState) Task=`9a8f7196-ffab-4670-803a-c5b789296b09`::moving from state preparing -> state finished >Thread-1043::DEBUG::2014-07-10 08:18:49,931::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9': < ResourceRef 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9', isValid: 'True' obj: 'None'>} >Thread-1043::DEBUG::2014-07-10 08:18:49,931::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1043::DEBUG::2014-07-10 08:18:49,931::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' >Thread-1043::DEBUG::2014-07-10 08:18:49,931::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' (0 active users) >Thread-1043::DEBUG::2014-07-10 08:18:49,932::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' is free, finding out if anyone is waiting for it. >Thread-1043::DEBUG::2014-07-10 08:18:49,932::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9', Clearing records. >Thread-1043::DEBUG::2014-07-10 08:18:49,932::task::990::TaskManager.Task::(_decref) Task=`9a8f7196-ffab-4670-803a-c5b789296b09`::ref 0 aborting False >Dummy-36::DEBUG::2014-07-10 08:18:50,504::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-07-10 08:18:50,662::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.058682 s, 17.4 MB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-07-10 08:18:52,677::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-07-10 08:18:52,852::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0767363 s, 13.3 MB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-07-10 08:18:54,867::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-07-10 08:18:55,059::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.090729 s, 11.3 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 08:18:55,184::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lion.qa.lab.tlv.redhat.com:_export_yuri2_backup2/6a70504d-00df-4869-8695-0f442053f6b6/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-14::DEBUG::2014-07-10 08:18:55,247::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n369 bytes (369 B) copied, 0.000524974 s, 703 kB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-07-10 08:18:57,074::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Thread-15::DEBUG::2014-07-10 08:18:57,179::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/e01a3a36-d2ce-4153-bb57-d6e65b7ed08c/metadata bs=4096 count=1' (cwd None) >Thread-15::DEBUG::2014-07-10 08:18:57,289::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00370412 s, 1.1 MB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-07-10 08:18:57,578::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.220731 s, 4.6 MB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-07-10 08:18:59,593::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-07-10 08:18:59,797::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.101689 s, 10.1 MB/s\n'; <rc> = 0 >Thread-1042::DEBUG::2014-07-10 08:18:59,954::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-1042::DEBUG::2014-07-10 08:18:59,955::task::595::TaskManager.Task::(_updateState) Task=`6f971be2-6348-43c2-a77b-aecb10025035`::moving from state init -> state preparing >Thread-1042::INFO::2014-07-10 08:18:59,956::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='411039e4-4af2-4192-9de0-67dc1ed83ba9', options=None) >Thread-1042::INFO::2014-07-10 08:18:59,956::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2}} >Thread-1042::DEBUG::2014-07-10 08:18:59,957::task::1185::TaskManager.Task::(prepare) Task=`6f971be2-6348-43c2-a77b-aecb10025035`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2}} >Thread-1042::DEBUG::2014-07-10 08:18:59,957::task::595::TaskManager.Task::(_updateState) Task=`6f971be2-6348-43c2-a77b-aecb10025035`::moving from state preparing -> state finished >Thread-1042::DEBUG::2014-07-10 08:18:59,957::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-1042::DEBUG::2014-07-10 08:18:59,957::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1042::DEBUG::2014-07-10 08:18:59,957::task::990::TaskManager.Task::(_decref) Task=`6f971be2-6348-43c2-a77b-aecb10025035`::ref 0 aborting False >Thread-1043::DEBUG::2014-07-10 08:18:59,961::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-1043::DEBUG::2014-07-10 08:18:59,962::task::595::TaskManager.Task::(_updateState) Task=`6144f265-4372-4822-a6aa-16c6839f4688`::moving from state init -> state preparing >Thread-1043::INFO::2014-07-10 08:18:59,962::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='411039e4-4af2-4192-9de0-67dc1ed83ba9', options=None) >Thread-1043::DEBUG::2014-07-10 08:18:59,963::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9`ReqID=`e943f15a-d12b-4569-82f4-6cb6f3e14af4`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo' >Thread-1043::DEBUG::2014-07-10 08:18:59,963::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' for lock type 'shared' >Thread-1043::DEBUG::2014-07-10 08:18:59,963::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' is free. Now locking as 'shared' (1 active user) >Thread-1043::DEBUG::2014-07-10 08:18:59,964::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9`ReqID=`e943f15a-d12b-4569-82f4-6cb6f3e14af4`::Granted request >Thread-1043::DEBUG::2014-07-10 08:18:59,964::task::827::TaskManager.Task::(resourceAcquired) Task=`6144f265-4372-4822-a6aa-16c6839f4688`::_resourcesAcquired: Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9 (shared) >Thread-1043::DEBUG::2014-07-10 08:18:59,964::task::990::TaskManager.Task::(_decref) Task=`6144f265-4372-4822-a6aa-16c6839f4688`::ref 1 aborting False >Thread-1043::INFO::2014-07-10 08:18:59,965::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DC-REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2, 'domains': u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': 'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c': {'status': u'Active', 'diskfree': '1137495244800', 'isoprefix': '', 'alerts': [], 'disktotal': '1152393412608', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532069482496', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-1043::DEBUG::2014-07-10 08:18:59,966::task::1185::TaskManager.Task::(prepare) Task=`6144f265-4372-4822-a6aa-16c6839f4688`::finished: {'info': {'name': 'DC-REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2, 'domains': u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': 'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c': {'status': u'Active', 'diskfree': '1137495244800', 'isoprefix': '', 'alerts': [], 'disktotal': '1152393412608', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532069482496', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-1043::DEBUG::2014-07-10 08:18:59,966::task::595::TaskManager.Task::(_updateState) Task=`6144f265-4372-4822-a6aa-16c6839f4688`::moving from state preparing -> state finished >Thread-1043::DEBUG::2014-07-10 08:18:59,966::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9': < ResourceRef 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9', isValid: 'True' obj: 'None'>} >Thread-1043::DEBUG::2014-07-10 08:18:59,966::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1043::DEBUG::2014-07-10 08:18:59,967::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' >Thread-1043::DEBUG::2014-07-10 08:18:59,967::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' (0 active users) >Thread-1043::DEBUG::2014-07-10 08:18:59,967::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' is free, finding out if anyone is waiting for it. >Thread-1043::DEBUG::2014-07-10 08:18:59,967::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9', Clearing records. >Thread-1043::DEBUG::2014-07-10 08:18:59,967::task::990::TaskManager.Task::(_decref) Task=`6144f265-4372-4822-a6aa-16c6839f4688`::ref 0 aborting False >Dummy-36::DEBUG::2014-07-10 08:19:01,812::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-07-10 08:19:01,961::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0503186 s, 20.4 MB/s\n'; <rc> = 0 >Thread-1042::DEBUG::2014-07-10 08:19:02,347::task::595::TaskManager.Task::(_updateState) Task=`711a3466-f6cf-4683-822b-3781baf761fe`::moving from state init -> state preparing >Thread-1042::INFO::2014-07-10 08:19:02,348::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-1042::INFO::2014-07-10 08:19:02,348::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00370412', 'lastCheck': '4.8', 'valid': True}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000524974', 'lastCheck': '7.1', 'valid': True}} >Thread-1042::DEBUG::2014-07-10 08:19:02,349::task::1185::TaskManager.Task::(prepare) Task=`711a3466-f6cf-4683-822b-3781baf761fe`::finished: {u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00370412', 'lastCheck': '4.8', 'valid': True}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000524974', 'lastCheck': '7.1', 'valid': True}} >Thread-1042::DEBUG::2014-07-10 08:19:02,349::task::595::TaskManager.Task::(_updateState) Task=`711a3466-f6cf-4683-822b-3781baf761fe`::moving from state preparing -> state finished >Thread-1042::DEBUG::2014-07-10 08:19:02,349::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-1042::DEBUG::2014-07-10 08:19:02,349::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1042::DEBUG::2014-07-10 08:19:02,349::task::990::TaskManager.Task::(_decref) Task=`711a3466-f6cf-4683-822b-3781baf761fe`::ref 0 aborting False >Dummy-36::DEBUG::2014-07-10 08:19:03,980::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-07-10 08:19:04,140::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0603249 s, 17.0 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 08:19:05,277::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lion.qa.lab.tlv.redhat.com:_export_yuri2_backup2/6a70504d-00df-4869-8695-0f442053f6b6/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-14::DEBUG::2014-07-10 08:19:05,341::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n369 bytes (369 B) copied, 0.000435342 s, 848 kB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-07-10 08:19:06,155::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-07-10 08:19:06,308::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0493208 s, 20.8 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-07-10 08:19:07,549::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/e01a3a36-d2ce-4153-bb57-d6e65b7ed08c/metadata bs=4096 count=1' (cwd None) >Thread-15::DEBUG::2014-07-10 08:19:07,620::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00726448 s, 564 kB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-07-10 08:19:08,323::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-07-10 08:19:08,486::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0580563 s, 17.6 MB/s\n'; <rc> = 0 >Thread-1042::DEBUG::2014-07-10 08:19:10,004::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-1042::DEBUG::2014-07-10 08:19:10,005::task::595::TaskManager.Task::(_updateState) Task=`38f6204f-6541-44df-9cd2-4e16338a685c`::moving from state init -> state preparing >Thread-1042::INFO::2014-07-10 08:19:10,005::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='411039e4-4af2-4192-9de0-67dc1ed83ba9', options=None) >Thread-1042::INFO::2014-07-10 08:19:10,006::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2}} >Thread-1042::DEBUG::2014-07-10 08:19:10,006::task::1185::TaskManager.Task::(prepare) Task=`38f6204f-6541-44df-9cd2-4e16338a685c`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2}} >Thread-1042::DEBUG::2014-07-10 08:19:10,006::task::595::TaskManager.Task::(_updateState) Task=`38f6204f-6541-44df-9cd2-4e16338a685c`::moving from state preparing -> state finished >Thread-1042::DEBUG::2014-07-10 08:19:10,006::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-1042::DEBUG::2014-07-10 08:19:10,006::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1042::DEBUG::2014-07-10 08:19:10,007::task::990::TaskManager.Task::(_decref) Task=`38f6204f-6541-44df-9cd2-4e16338a685c`::ref 0 aborting False >Thread-1043::DEBUG::2014-07-10 08:19:10,010::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-1043::DEBUG::2014-07-10 08:19:10,011::task::595::TaskManager.Task::(_updateState) Task=`5b07ae34-aac1-4682-85cc-efa299b85152`::moving from state init -> state preparing >Thread-1043::INFO::2014-07-10 08:19:10,011::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='411039e4-4af2-4192-9de0-67dc1ed83ba9', options=None) >Thread-1043::DEBUG::2014-07-10 08:19:10,011::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9`ReqID=`7920b659-dab8-4593-8b3f-a129301b2371`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo' >Thread-1043::DEBUG::2014-07-10 08:19:10,012::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' for lock type 'shared' >Thread-1043::DEBUG::2014-07-10 08:19:10,012::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' is free. Now locking as 'shared' (1 active user) >Thread-1043::DEBUG::2014-07-10 08:19:10,012::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9`ReqID=`7920b659-dab8-4593-8b3f-a129301b2371`::Granted request >Thread-1043::DEBUG::2014-07-10 08:19:10,012::task::827::TaskManager.Task::(resourceAcquired) Task=`5b07ae34-aac1-4682-85cc-efa299b85152`::_resourcesAcquired: Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9 (shared) >Thread-1043::DEBUG::2014-07-10 08:19:10,013::task::990::TaskManager.Task::(_decref) Task=`5b07ae34-aac1-4682-85cc-efa299b85152`::ref 1 aborting False >Thread-1043::INFO::2014-07-10 08:19:10,014::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DC-REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2, 'domains': u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': 'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c': {'status': u'Active', 'diskfree': '1137495244800', 'isoprefix': '', 'alerts': [], 'disktotal': '1152393412608', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532069482496', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-1043::DEBUG::2014-07-10 08:19:10,014::task::1185::TaskManager.Task::(prepare) Task=`5b07ae34-aac1-4682-85cc-efa299b85152`::finished: {'info': {'name': 'DC-REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2, 'domains': u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': 'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c': {'status': u'Active', 'diskfree': '1137495244800', 'isoprefix': '', 'alerts': [], 'disktotal': '1152393412608', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532069482496', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-1043::DEBUG::2014-07-10 08:19:10,014::task::595::TaskManager.Task::(_updateState) Task=`5b07ae34-aac1-4682-85cc-efa299b85152`::moving from state preparing -> state finished >Thread-1043::DEBUG::2014-07-10 08:19:10,014::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9': < ResourceRef 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9', isValid: 'True' obj: 'None'>} >Thread-1043::DEBUG::2014-07-10 08:19:10,014::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1043::DEBUG::2014-07-10 08:19:10,015::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' >Thread-1043::DEBUG::2014-07-10 08:19:10,015::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' (0 active users) >Thread-1043::DEBUG::2014-07-10 08:19:10,015::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' is free, finding out if anyone is waiting for it. >Thread-1043::DEBUG::2014-07-10 08:19:10,015::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9', Clearing records. >Thread-1043::DEBUG::2014-07-10 08:19:10,015::task::990::TaskManager.Task::(_decref) Task=`5b07ae34-aac1-4682-85cc-efa299b85152`::ref 0 aborting False >Dummy-36::DEBUG::2014-07-10 08:19:10,501::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-07-10 08:19:10,647::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0477336 s, 21.5 MB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-07-10 08:19:12,662::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-07-10 08:19:12,803::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0449945 s, 22.8 MB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-07-10 08:19:14,818::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-07-10 08:19:14,952::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0330844 s, 31.0 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 08:19:15,371::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lion.qa.lab.tlv.redhat.com:_export_yuri2_backup2/6a70504d-00df-4869-8695-0f442053f6b6/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-14::DEBUG::2014-07-10 08:19:15,435::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n369 bytes (369 B) copied, 0.00045353 s, 814 kB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-07-10 08:19:16,967::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-07-10 08:19:17,096::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0354738 s, 28.9 MB/s\n'; <rc> = 0 >Thread-1042::DEBUG::2014-07-10 08:19:17,491::task::595::TaskManager.Task::(_updateState) Task=`ccf2137c-29fd-46f8-bd76-35d3f28e5322`::moving from state init -> state preparing >Thread-1042::INFO::2014-07-10 08:19:17,492::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-1042::INFO::2014-07-10 08:19:17,492::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00726448', 'lastCheck': '9.8', 'valid': True}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00045353', 'lastCheck': '2.1', 'valid': True}} >Thread-1042::DEBUG::2014-07-10 08:19:17,492::task::1185::TaskManager.Task::(prepare) Task=`ccf2137c-29fd-46f8-bd76-35d3f28e5322`::finished: {u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00726448', 'lastCheck': '9.8', 'valid': True}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00045353', 'lastCheck': '2.1', 'valid': True}} >Thread-1042::DEBUG::2014-07-10 08:19:17,493::task::595::TaskManager.Task::(_updateState) Task=`ccf2137c-29fd-46f8-bd76-35d3f28e5322`::moving from state preparing -> state finished >Thread-1042::DEBUG::2014-07-10 08:19:17,493::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-1042::DEBUG::2014-07-10 08:19:17,493::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1042::DEBUG::2014-07-10 08:19:17,493::task::990::TaskManager.Task::(_decref) Task=`ccf2137c-29fd-46f8-bd76-35d3f28e5322`::ref 0 aborting False >Thread-15::DEBUG::2014-07-10 08:19:17,649::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/e01a3a36-d2ce-4153-bb57-d6e65b7ed08c/metadata bs=4096 count=1' (cwd None) >Thread-15::DEBUG::2014-07-10 08:19:17,714::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00457128 s, 896 kB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-07-10 08:19:19,112::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-07-10 08:19:19,253::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0384475 s, 26.6 MB/s\n'; <rc> = 0 >Thread-1042::DEBUG::2014-07-10 08:19:20,054::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-1042::DEBUG::2014-07-10 08:19:20,056::task::595::TaskManager.Task::(_updateState) Task=`5e6456bb-aa9e-4079-8ad4-f6aacd02eef8`::moving from state init -> state preparing >Thread-1042::INFO::2014-07-10 08:19:20,056::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='411039e4-4af2-4192-9de0-67dc1ed83ba9', options=None) >Thread-1042::INFO::2014-07-10 08:19:20,057::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2}} >Thread-1042::DEBUG::2014-07-10 08:19:20,057::task::1185::TaskManager.Task::(prepare) Task=`5e6456bb-aa9e-4079-8ad4-f6aacd02eef8`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2}} >Thread-1042::DEBUG::2014-07-10 08:19:20,057::task::595::TaskManager.Task::(_updateState) Task=`5e6456bb-aa9e-4079-8ad4-f6aacd02eef8`::moving from state preparing -> state finished >Thread-1042::DEBUG::2014-07-10 08:19:20,057::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-1042::DEBUG::2014-07-10 08:19:20,057::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1042::DEBUG::2014-07-10 08:19:20,058::task::990::TaskManager.Task::(_decref) Task=`5e6456bb-aa9e-4079-8ad4-f6aacd02eef8`::ref 0 aborting False >Thread-1043::DEBUG::2014-07-10 08:19:20,061::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-1043::DEBUG::2014-07-10 08:19:20,062::task::595::TaskManager.Task::(_updateState) Task=`7a05adae-a731-4d25-80ec-e59a9fafd61a`::moving from state init -> state preparing >Thread-1043::INFO::2014-07-10 08:19:20,062::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='411039e4-4af2-4192-9de0-67dc1ed83ba9', options=None) >Thread-1043::DEBUG::2014-07-10 08:19:20,063::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9`ReqID=`4bfe5e1b-d283-4d74-adcb-f397c3ff9574`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo' >Thread-1043::DEBUG::2014-07-10 08:19:20,063::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' for lock type 'shared' >Thread-1043::DEBUG::2014-07-10 08:19:20,063::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' is free. Now locking as 'shared' (1 active user) >Thread-1043::DEBUG::2014-07-10 08:19:20,064::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9`ReqID=`4bfe5e1b-d283-4d74-adcb-f397c3ff9574`::Granted request >Thread-1043::DEBUG::2014-07-10 08:19:20,064::task::827::TaskManager.Task::(resourceAcquired) Task=`7a05adae-a731-4d25-80ec-e59a9fafd61a`::_resourcesAcquired: Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9 (shared) >Thread-1043::DEBUG::2014-07-10 08:19:20,064::task::990::TaskManager.Task::(_decref) Task=`7a05adae-a731-4d25-80ec-e59a9fafd61a`::ref 1 aborting False >Thread-1043::INFO::2014-07-10 08:19:20,066::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DC-REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2, 'domains': u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': 'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c': {'status': u'Active', 'diskfree': '1137495244800', 'isoprefix': '', 'alerts': [], 'disktotal': '1152393412608', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532069482496', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-1043::DEBUG::2014-07-10 08:19:20,066::task::1185::TaskManager.Task::(prepare) Task=`7a05adae-a731-4d25-80ec-e59a9fafd61a`::finished: {'info': {'name': 'DC-REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2, 'domains': u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': 'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c': {'status': u'Active', 'diskfree': '1137495244800', 'isoprefix': '', 'alerts': [], 'disktotal': '1152393412608', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532069482496', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-1043::DEBUG::2014-07-10 08:19:20,066::task::595::TaskManager.Task::(_updateState) Task=`7a05adae-a731-4d25-80ec-e59a9fafd61a`::moving from state preparing -> state finished >Thread-1043::DEBUG::2014-07-10 08:19:20,066::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9': < ResourceRef 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9', isValid: 'True' obj: 'None'>} >Thread-1043::DEBUG::2014-07-10 08:19:20,066::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1043::DEBUG::2014-07-10 08:19:20,067::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' >Thread-1043::DEBUG::2014-07-10 08:19:20,067::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' (0 active users) >Thread-1043::DEBUG::2014-07-10 08:19:20,067::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' is free, finding out if anyone is waiting for it. >Thread-1043::DEBUG::2014-07-10 08:19:20,067::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9', Clearing records. >Thread-1043::DEBUG::2014-07-10 08:19:20,067::task::990::TaskManager.Task::(_decref) Task=`7a05adae-a731-4d25-80ec-e59a9fafd61a`::ref 0 aborting False >Dummy-36::DEBUG::2014-07-10 08:19:21,268::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-07-10 08:19:21,395::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0301835 s, 33.9 MB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-07-10 08:19:23,411::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-07-10 08:19:23,545::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.03778 s, 27.1 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 08:19:25,467::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lion.qa.lab.tlv.redhat.com:_export_yuri2_backup2/6a70504d-00df-4869-8695-0f442053f6b6/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-14::DEBUG::2014-07-10 08:19:25,529::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n369 bytes (369 B) copied, 0.000449558 s, 821 kB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-07-10 08:19:25,561::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-07-10 08:19:25,690::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0352538 s, 29.0 MB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-07-10 08:19:27,705::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Thread-15::DEBUG::2014-07-10 08:19:27,762::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/e01a3a36-d2ce-4153-bb57-d6e65b7ed08c/metadata bs=4096 count=1' (cwd None) >Thread-15::DEBUG::2014-07-10 08:19:27,872::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000830232 s, 4.9 MB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-07-10 08:19:28,236::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.432879 s, 2.4 MB/s\n'; <rc> = 0 >Thread-1042::DEBUG::2014-07-10 08:19:30,112::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-1042::DEBUG::2014-07-10 08:19:30,113::task::595::TaskManager.Task::(_updateState) Task=`676aa22c-1303-473e-afe3-d6fda5417992`::moving from state init -> state preparing >Thread-1042::INFO::2014-07-10 08:19:30,113::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='411039e4-4af2-4192-9de0-67dc1ed83ba9', options=None) >Thread-1042::INFO::2014-07-10 08:19:30,114::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2}} >Thread-1042::DEBUG::2014-07-10 08:19:30,114::task::1185::TaskManager.Task::(prepare) Task=`676aa22c-1303-473e-afe3-d6fda5417992`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2}} >Thread-1042::DEBUG::2014-07-10 08:19:30,114::task::595::TaskManager.Task::(_updateState) Task=`676aa22c-1303-473e-afe3-d6fda5417992`::moving from state preparing -> state finished >Thread-1042::DEBUG::2014-07-10 08:19:30,114::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-1042::DEBUG::2014-07-10 08:19:30,114::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1042::DEBUG::2014-07-10 08:19:30,115::task::990::TaskManager.Task::(_decref) Task=`676aa22c-1303-473e-afe3-d6fda5417992`::ref 0 aborting False >Thread-1043::DEBUG::2014-07-10 08:19:30,118::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-1043::DEBUG::2014-07-10 08:19:30,118::task::595::TaskManager.Task::(_updateState) Task=`296d78a0-4d5b-4525-9c36-792f10b0f4ea`::moving from state init -> state preparing >Thread-1043::INFO::2014-07-10 08:19:30,119::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='411039e4-4af2-4192-9de0-67dc1ed83ba9', options=None) >Thread-1043::DEBUG::2014-07-10 08:19:30,119::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9`ReqID=`84881479-9592-4b50-8417-b34111cd1b72`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo' >Thread-1043::DEBUG::2014-07-10 08:19:30,119::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' for lock type 'shared' >Thread-1043::DEBUG::2014-07-10 08:19:30,120::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' is free. Now locking as 'shared' (1 active user) >Thread-1043::DEBUG::2014-07-10 08:19:30,120::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9`ReqID=`84881479-9592-4b50-8417-b34111cd1b72`::Granted request >Thread-1043::DEBUG::2014-07-10 08:19:30,120::task::827::TaskManager.Task::(resourceAcquired) Task=`296d78a0-4d5b-4525-9c36-792f10b0f4ea`::_resourcesAcquired: Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9 (shared) >Thread-1043::DEBUG::2014-07-10 08:19:30,121::task::990::TaskManager.Task::(_decref) Task=`296d78a0-4d5b-4525-9c36-792f10b0f4ea`::ref 1 aborting False >Thread-1043::INFO::2014-07-10 08:19:30,122::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DC-REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2, 'domains': u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': 'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c': {'status': u'Active', 'diskfree': '1137495244800', 'isoprefix': '', 'alerts': [], 'disktotal': '1152393412608', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532069482496', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-1043::DEBUG::2014-07-10 08:19:30,122::task::1185::TaskManager.Task::(prepare) Task=`296d78a0-4d5b-4525-9c36-792f10b0f4ea`::finished: {'info': {'name': 'DC-REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2, 'domains': u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': 'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c': {'status': u'Active', 'diskfree': '1137495244800', 'isoprefix': '', 'alerts': [], 'disktotal': '1152393412608', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532069482496', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-1043::DEBUG::2014-07-10 08:19:30,122::task::595::TaskManager.Task::(_updateState) Task=`296d78a0-4d5b-4525-9c36-792f10b0f4ea`::moving from state preparing -> state finished >Thread-1043::DEBUG::2014-07-10 08:19:30,122::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9': < ResourceRef 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9', isValid: 'True' obj: 'None'>} >Thread-1043::DEBUG::2014-07-10 08:19:30,122::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1043::DEBUG::2014-07-10 08:19:30,123::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' >Thread-1043::DEBUG::2014-07-10 08:19:30,123::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' (0 active users) >Thread-1043::DEBUG::2014-07-10 08:19:30,123::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' is free, finding out if anyone is waiting for it. >Thread-1043::DEBUG::2014-07-10 08:19:30,123::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9', Clearing records. >Thread-1043::DEBUG::2014-07-10 08:19:30,123::task::990::TaskManager.Task::(_decref) Task=`296d78a0-4d5b-4525-9c36-792f10b0f4ea`::ref 0 aborting False >Dummy-36::DEBUG::2014-07-10 08:19:30,252::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-07-10 08:19:30,382::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0302678 s, 33.8 MB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-07-10 08:19:32,397::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-07-10 08:19:32,534::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0394896 s, 25.9 MB/s\n'; <rc> = 0 >Thread-1042::DEBUG::2014-07-10 08:19:32,638::task::595::TaskManager.Task::(_updateState) Task=`64ffc6cc-a324-4c08-89d9-5a0aa3d9fac5`::moving from state init -> state preparing >Thread-1042::INFO::2014-07-10 08:19:32,639::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-1042::INFO::2014-07-10 08:19:32,639::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000830232', 'lastCheck': '4.5', 'valid': True}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000449558', 'lastCheck': '7.1', 'valid': True}} >Thread-1042::DEBUG::2014-07-10 08:19:32,639::task::1185::TaskManager.Task::(prepare) Task=`64ffc6cc-a324-4c08-89d9-5a0aa3d9fac5`::finished: {u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000830232', 'lastCheck': '4.5', 'valid': True}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000449558', 'lastCheck': '7.1', 'valid': True}} >Thread-1042::DEBUG::2014-07-10 08:19:32,640::task::595::TaskManager.Task::(_updateState) Task=`64ffc6cc-a324-4c08-89d9-5a0aa3d9fac5`::moving from state preparing -> state finished >Thread-1042::DEBUG::2014-07-10 08:19:32,640::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-1042::DEBUG::2014-07-10 08:19:32,640::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1042::DEBUG::2014-07-10 08:19:32,640::task::990::TaskManager.Task::(_decref) Task=`64ffc6cc-a324-4c08-89d9-5a0aa3d9fac5`::ref 0 aborting False >Dummy-36::DEBUG::2014-07-10 08:19:34,549::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-07-10 08:19:34,686::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0378084 s, 27.1 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 08:19:35,559::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lion.qa.lab.tlv.redhat.com:_export_yuri2_backup2/6a70504d-00df-4869-8695-0f442053f6b6/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-14::DEBUG::2014-07-10 08:19:35,622::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n369 bytes (369 B) copied, 0.000402704 s, 916 kB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-07-10 08:19:36,701::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-07-10 08:19:36,838::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.032749 s, 31.3 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-07-10 08:19:38,183::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/e01a3a36-d2ce-4153-bb57-d6e65b7ed08c/metadata bs=4096 count=1' (cwd None) >Thread-15::DEBUG::2014-07-10 08:19:38,251::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00382021 s, 1.1 MB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-07-10 08:19:38,854::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-07-10 08:19:38,990::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0328759 s, 31.1 MB/s\n'; <rc> = 0 >Thread-1042::DEBUG::2014-07-10 08:19:40,153::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-1042::DEBUG::2014-07-10 08:19:40,155::task::595::TaskManager.Task::(_updateState) Task=`3ab91246-cf52-4979-8fb3-8d8ad5502518`::moving from state init -> state preparing >Thread-1042::INFO::2014-07-10 08:19:40,155::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='411039e4-4af2-4192-9de0-67dc1ed83ba9', options=None) >Thread-1042::INFO::2014-07-10 08:19:40,156::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2}} >Thread-1042::DEBUG::2014-07-10 08:19:40,156::task::1185::TaskManager.Task::(prepare) Task=`3ab91246-cf52-4979-8fb3-8d8ad5502518`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2}} >Thread-1042::DEBUG::2014-07-10 08:19:40,156::task::595::TaskManager.Task::(_updateState) Task=`3ab91246-cf52-4979-8fb3-8d8ad5502518`::moving from state preparing -> state finished >Thread-1042::DEBUG::2014-07-10 08:19:40,156::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-1042::DEBUG::2014-07-10 08:19:40,156::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1042::DEBUG::2014-07-10 08:19:40,157::task::990::TaskManager.Task::(_decref) Task=`3ab91246-cf52-4979-8fb3-8d8ad5502518`::ref 0 aborting False >Thread-1043::DEBUG::2014-07-10 08:19:40,161::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-1043::DEBUG::2014-07-10 08:19:40,161::task::595::TaskManager.Task::(_updateState) Task=`ce0b3ff0-cae8-4cdf-a7c9-7baf011c5bfd`::moving from state init -> state preparing >Thread-1043::INFO::2014-07-10 08:19:40,161::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='411039e4-4af2-4192-9de0-67dc1ed83ba9', options=None) >Thread-1043::DEBUG::2014-07-10 08:19:40,162::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9`ReqID=`4d487116-47a7-4174-b920-38f6df0349da`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo' >Thread-1043::DEBUG::2014-07-10 08:19:40,162::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' for lock type 'shared' >Thread-1043::DEBUG::2014-07-10 08:19:40,163::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' is free. Now locking as 'shared' (1 active user) >Thread-1043::DEBUG::2014-07-10 08:19:40,163::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9`ReqID=`4d487116-47a7-4174-b920-38f6df0349da`::Granted request >Thread-1043::DEBUG::2014-07-10 08:19:40,163::task::827::TaskManager.Task::(resourceAcquired) Task=`ce0b3ff0-cae8-4cdf-a7c9-7baf011c5bfd`::_resourcesAcquired: Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9 (shared) >Thread-1043::DEBUG::2014-07-10 08:19:40,164::task::990::TaskManager.Task::(_decref) Task=`ce0b3ff0-cae8-4cdf-a7c9-7baf011c5bfd`::ref 1 aborting False >Thread-1043::INFO::2014-07-10 08:19:40,165::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DC-REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2, 'domains': u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': 'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c': {'status': u'Active', 'diskfree': '1137495244800', 'isoprefix': '', 'alerts': [], 'disktotal': '1152393412608', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532069482496', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-1043::DEBUG::2014-07-10 08:19:40,165::task::1185::TaskManager.Task::(prepare) Task=`ce0b3ff0-cae8-4cdf-a7c9-7baf011c5bfd`::finished: {'info': {'name': 'DC-REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2, 'domains': u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': 'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c': {'status': u'Active', 'diskfree': '1137495244800', 'isoprefix': '', 'alerts': [], 'disktotal': '1152393412608', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532069482496', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-1043::DEBUG::2014-07-10 08:19:40,165::task::595::TaskManager.Task::(_updateState) Task=`ce0b3ff0-cae8-4cdf-a7c9-7baf011c5bfd`::moving from state preparing -> state finished >Thread-1043::DEBUG::2014-07-10 08:19:40,165::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9': < ResourceRef 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9', isValid: 'True' obj: 'None'>} >Thread-1043::DEBUG::2014-07-10 08:19:40,166::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1043::DEBUG::2014-07-10 08:19:40,166::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' >Thread-1043::DEBUG::2014-07-10 08:19:40,166::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' (0 active users) >Thread-1043::DEBUG::2014-07-10 08:19:40,166::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' is free, finding out if anyone is waiting for it. >Thread-1043::DEBUG::2014-07-10 08:19:40,166::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9', Clearing records. >Thread-1043::DEBUG::2014-07-10 08:19:40,167::task::990::TaskManager.Task::(_decref) Task=`ce0b3ff0-cae8-4cdf-a7c9-7baf011c5bfd`::ref 0 aborting False >Dummy-36::DEBUG::2014-07-10 08:19:41,005::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-07-10 08:19:41,143::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0390865 s, 26.2 MB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-07-10 08:19:43,158::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-07-10 08:19:43,288::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.030217 s, 33.9 MB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-07-10 08:19:45,303::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-07-10 08:19:45,434::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0333127 s, 30.7 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 08:19:45,653::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lion.qa.lab.tlv.redhat.com:_export_yuri2_backup2/6a70504d-00df-4869-8695-0f442053f6b6/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-14::DEBUG::2014-07-10 08:19:45,718::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n369 bytes (369 B) copied, 0.000388629 s, 949 kB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-07-10 08:19:47,449::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-07-10 08:19:47,588::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.037603 s, 27.2 MB/s\n'; <rc> = 0 >Thread-1042::DEBUG::2014-07-10 08:19:47,802::task::595::TaskManager.Task::(_updateState) Task=`a8558e74-057a-486c-9728-3ceb8859d6f7`::moving from state init -> state preparing >Thread-1042::INFO::2014-07-10 08:19:47,803::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-1042::INFO::2014-07-10 08:19:47,803::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00382021', 'lastCheck': '9.5', 'valid': True}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000388629', 'lastCheck': '2.1', 'valid': True}} >Thread-1042::DEBUG::2014-07-10 08:19:47,803::task::1185::TaskManager.Task::(prepare) Task=`a8558e74-057a-486c-9728-3ceb8859d6f7`::finished: {u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00382021', 'lastCheck': '9.5', 'valid': True}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000388629', 'lastCheck': '2.1', 'valid': True}} >Thread-1042::DEBUG::2014-07-10 08:19:47,803::task::595::TaskManager.Task::(_updateState) Task=`a8558e74-057a-486c-9728-3ceb8859d6f7`::moving from state preparing -> state finished >Thread-1042::DEBUG::2014-07-10 08:19:47,804::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-1042::DEBUG::2014-07-10 08:19:47,804::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1042::DEBUG::2014-07-10 08:19:47,804::task::990::TaskManager.Task::(_decref) Task=`a8558e74-057a-486c-9728-3ceb8859d6f7`::ref 0 aborting False >Thread-15::DEBUG::2014-07-10 08:19:48,281::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/e01a3a36-d2ce-4153-bb57-d6e65b7ed08c/metadata bs=4096 count=1' (cwd None) >Thread-15::DEBUG::2014-07-10 08:19:48,345::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00537858 s, 762 kB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-07-10 08:19:49,604::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-07-10 08:19:49,757::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0487013 s, 21.0 MB/s\n'; <rc> = 0 >Thread-1042::DEBUG::2014-07-10 08:19:50,205::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-1042::DEBUG::2014-07-10 08:19:50,206::task::595::TaskManager.Task::(_updateState) Task=`6c5de083-8a87-40b1-93aa-4b148ef83a1b`::moving from state init -> state preparing >Thread-1042::INFO::2014-07-10 08:19:50,206::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='411039e4-4af2-4192-9de0-67dc1ed83ba9', options=None) >Thread-1042::INFO::2014-07-10 08:19:50,207::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2}} >Thread-1042::DEBUG::2014-07-10 08:19:50,207::task::1185::TaskManager.Task::(prepare) Task=`6c5de083-8a87-40b1-93aa-4b148ef83a1b`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2}} >Thread-1042::DEBUG::2014-07-10 08:19:50,207::task::595::TaskManager.Task::(_updateState) Task=`6c5de083-8a87-40b1-93aa-4b148ef83a1b`::moving from state preparing -> state finished >Thread-1042::DEBUG::2014-07-10 08:19:50,208::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-1042::DEBUG::2014-07-10 08:19:50,208::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1042::DEBUG::2014-07-10 08:19:50,208::task::990::TaskManager.Task::(_decref) Task=`6c5de083-8a87-40b1-93aa-4b148ef83a1b`::ref 0 aborting False >Thread-1043::DEBUG::2014-07-10 08:19:50,212::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-1043::DEBUG::2014-07-10 08:19:50,213::task::595::TaskManager.Task::(_updateState) Task=`67dbad87-ff19-4d9a-aacb-efc1c8d37f49`::moving from state init -> state preparing >Thread-1043::INFO::2014-07-10 08:19:50,213::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='411039e4-4af2-4192-9de0-67dc1ed83ba9', options=None) >Thread-1043::DEBUG::2014-07-10 08:19:50,213::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9`ReqID=`31bfcddf-d208-42e9-b9b4-8108af70534f`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo' >Thread-1043::DEBUG::2014-07-10 08:19:50,214::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' for lock type 'shared' >Thread-1043::DEBUG::2014-07-10 08:19:50,214::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' is free. Now locking as 'shared' (1 active user) >Thread-1043::DEBUG::2014-07-10 08:19:50,214::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9`ReqID=`31bfcddf-d208-42e9-b9b4-8108af70534f`::Granted request >Thread-1043::DEBUG::2014-07-10 08:19:50,215::task::827::TaskManager.Task::(resourceAcquired) Task=`67dbad87-ff19-4d9a-aacb-efc1c8d37f49`::_resourcesAcquired: Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9 (shared) >Thread-1043::DEBUG::2014-07-10 08:19:50,215::task::990::TaskManager.Task::(_decref) Task=`67dbad87-ff19-4d9a-aacb-efc1c8d37f49`::ref 1 aborting False >Thread-1043::INFO::2014-07-10 08:19:50,216::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DC-REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2, 'domains': u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': 'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c': {'status': u'Active', 'diskfree': '1137495244800', 'isoprefix': '', 'alerts': [], 'disktotal': '1152393412608', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532069482496', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-1043::DEBUG::2014-07-10 08:19:50,216::task::1185::TaskManager.Task::(prepare) Task=`67dbad87-ff19-4d9a-aacb-efc1c8d37f49`::finished: {'info': {'name': 'DC-REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2, 'domains': u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': 'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c': {'status': u'Active', 'diskfree': '1137495244800', 'isoprefix': '', 'alerts': [], 'disktotal': '1152393412608', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532069482496', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-1043::DEBUG::2014-07-10 08:19:50,217::task::595::TaskManager.Task::(_updateState) Task=`67dbad87-ff19-4d9a-aacb-efc1c8d37f49`::moving from state preparing -> state finished >Thread-1043::DEBUG::2014-07-10 08:19:50,217::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9': < ResourceRef 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9', isValid: 'True' obj: 'None'>} >Thread-1043::DEBUG::2014-07-10 08:19:50,217::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1043::DEBUG::2014-07-10 08:19:50,217::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' >Thread-1043::DEBUG::2014-07-10 08:19:50,218::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' (0 active users) >Thread-1043::DEBUG::2014-07-10 08:19:50,218::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' is free, finding out if anyone is waiting for it. >Thread-1043::DEBUG::2014-07-10 08:19:50,218::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9', Clearing records. >Thread-1043::DEBUG::2014-07-10 08:19:50,218::task::990::TaskManager.Task::(_decref) Task=`67dbad87-ff19-4d9a-aacb-efc1c8d37f49`::ref 0 aborting False >Dummy-36::DEBUG::2014-07-10 08:19:51,771::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-07-10 08:19:51,919::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0482332 s, 21.2 MB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-07-10 08:19:53,933::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-07-10 08:19:54,066::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0331046 s, 30.9 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 08:19:55,749::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lion.qa.lab.tlv.redhat.com:_export_yuri2_backup2/6a70504d-00df-4869-8695-0f442053f6b6/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-14::DEBUG::2014-07-10 08:19:55,809::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n369 bytes (369 B) copied, 0.00047134 s, 783 kB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-07-10 08:19:56,082::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-07-10 08:19:56,228::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0405941 s, 25.2 MB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-07-10 08:19:58,243::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Thread-15::DEBUG::2014-07-10 08:19:58,382::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/e01a3a36-d2ce-4153-bb57-d6e65b7ed08c/metadata bs=4096 count=1' (cwd None) >Dummy-36::DEBUG::2014-07-10 08:19:58,384::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0329622 s, 31.1 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-07-10 08:19:58,486::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00470273 s, 871 kB/s\n'; <rc> = 0 >Thread-1042::DEBUG::2014-07-10 08:20:00,253::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-1042::DEBUG::2014-07-10 08:20:00,255::task::595::TaskManager.Task::(_updateState) Task=`db854684-c814-40bf-be4f-d8ffe314ea23`::moving from state init -> state preparing >Thread-1042::INFO::2014-07-10 08:20:00,255::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='411039e4-4af2-4192-9de0-67dc1ed83ba9', options=None) >Thread-1042::INFO::2014-07-10 08:20:00,255::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2}} >Thread-1042::DEBUG::2014-07-10 08:20:00,256::task::1185::TaskManager.Task::(prepare) Task=`db854684-c814-40bf-be4f-d8ffe314ea23`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2}} >Thread-1042::DEBUG::2014-07-10 08:20:00,256::task::595::TaskManager.Task::(_updateState) Task=`db854684-c814-40bf-be4f-d8ffe314ea23`::moving from state preparing -> state finished >Thread-1042::DEBUG::2014-07-10 08:20:00,256::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-1042::DEBUG::2014-07-10 08:20:00,256::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1042::DEBUG::2014-07-10 08:20:00,256::task::990::TaskManager.Task::(_decref) Task=`db854684-c814-40bf-be4f-d8ffe314ea23`::ref 0 aborting False >Thread-1043::DEBUG::2014-07-10 08:20:00,260::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-1043::DEBUG::2014-07-10 08:20:00,260::task::595::TaskManager.Task::(_updateState) Task=`7dc566e7-4996-4c72-9357-fcbc9414f012`::moving from state init -> state preparing >Thread-1043::INFO::2014-07-10 08:20:00,260::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='411039e4-4af2-4192-9de0-67dc1ed83ba9', options=None) >Thread-1043::DEBUG::2014-07-10 08:20:00,261::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9`ReqID=`d4bdab5f-8641-4d5d-8e6b-0c6e6774e1fd`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo' >Thread-1043::DEBUG::2014-07-10 08:20:00,261::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' for lock type 'shared' >Thread-1043::DEBUG::2014-07-10 08:20:00,262::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' is free. Now locking as 'shared' (1 active user) >Thread-1043::DEBUG::2014-07-10 08:20:00,262::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9`ReqID=`d4bdab5f-8641-4d5d-8e6b-0c6e6774e1fd`::Granted request >Thread-1043::DEBUG::2014-07-10 08:20:00,262::task::827::TaskManager.Task::(resourceAcquired) Task=`7dc566e7-4996-4c72-9357-fcbc9414f012`::_resourcesAcquired: Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9 (shared) >Thread-1043::DEBUG::2014-07-10 08:20:00,262::task::990::TaskManager.Task::(_decref) Task=`7dc566e7-4996-4c72-9357-fcbc9414f012`::ref 1 aborting False >Thread-1043::INFO::2014-07-10 08:20:00,263::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DC-REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2, 'domains': u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': 'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c': {'status': u'Active', 'diskfree': '1137495244800', 'isoprefix': '', 'alerts': [], 'disktotal': '1152393412608', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532069482496', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-1043::DEBUG::2014-07-10 08:20:00,263::task::1185::TaskManager.Task::(prepare) Task=`7dc566e7-4996-4c72-9357-fcbc9414f012`::finished: {'info': {'name': 'DC-REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2, 'domains': u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': 'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c': {'status': u'Active', 'diskfree': '1137495244800', 'isoprefix': '', 'alerts': [], 'disktotal': '1152393412608', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532069482496', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-1043::DEBUG::2014-07-10 08:20:00,264::task::595::TaskManager.Task::(_updateState) Task=`7dc566e7-4996-4c72-9357-fcbc9414f012`::moving from state preparing -> state finished >Thread-1043::DEBUG::2014-07-10 08:20:00,264::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9': < ResourceRef 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9', isValid: 'True' obj: 'None'>} >Thread-1043::DEBUG::2014-07-10 08:20:00,264::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1043::DEBUG::2014-07-10 08:20:00,264::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' >Thread-1043::DEBUG::2014-07-10 08:20:00,264::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' (0 active users) >Thread-1043::DEBUG::2014-07-10 08:20:00,265::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' is free, finding out if anyone is waiting for it. >Thread-1043::DEBUG::2014-07-10 08:20:00,265::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9', Clearing records. >Thread-1043::DEBUG::2014-07-10 08:20:00,265::task::990::TaskManager.Task::(_decref) Task=`7dc566e7-4996-4c72-9357-fcbc9414f012`::ref 0 aborting False >Dummy-36::DEBUG::2014-07-10 08:20:00,666::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-07-10 08:20:00,800::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0326377 s, 31.4 MB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-07-10 08:20:02,815::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Thread-1042::DEBUG::2014-07-10 08:20:02,979::task::595::TaskManager.Task::(_updateState) Task=`90d3c1ea-76d8-44f7-aca8-4385d0714b64`::moving from state init -> state preparing >Thread-1042::INFO::2014-07-10 08:20:02,983::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-1042::INFO::2014-07-10 08:20:02,987::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00470273', 'lastCheck': '4.3', 'valid': True}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00047134', 'lastCheck': '7.2', 'valid': True}} >Thread-1042::DEBUG::2014-07-10 08:20:02,989::task::1185::TaskManager.Task::(prepare) Task=`90d3c1ea-76d8-44f7-aca8-4385d0714b64`::finished: {u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00470273', 'lastCheck': '4.3', 'valid': True}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00047134', 'lastCheck': '7.2', 'valid': True}} >Thread-1042::DEBUG::2014-07-10 08:20:02,991::task::595::TaskManager.Task::(_updateState) Task=`90d3c1ea-76d8-44f7-aca8-4385d0714b64`::moving from state preparing -> state finished >Thread-1042::DEBUG::2014-07-10 08:20:02,993::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-1042::DEBUG::2014-07-10 08:20:02,996::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1042::DEBUG::2014-07-10 08:20:02,998::task::990::TaskManager.Task::(_decref) Task=`90d3c1ea-76d8-44f7-aca8-4385d0714b64`::ref 0 aborting False >Dummy-36::DEBUG::2014-07-10 08:20:03,073::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0328065 s, 31.2 MB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-07-10 08:20:05,176::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-07-10 08:20:05,327::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0480152 s, 21.3 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 08:20:05,834::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lion.qa.lab.tlv.redhat.com:_export_yuri2_backup2/6a70504d-00df-4869-8695-0f442053f6b6/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-14::DEBUG::2014-07-10 08:20:05,897::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n369 bytes (369 B) copied, 0.000440995 s, 837 kB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-07-10 08:20:07,343::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-07-10 08:20:07,486::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0387375 s, 26.4 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-07-10 08:20:08,674::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/e01a3a36-d2ce-4153-bb57-d6e65b7ed08c/metadata bs=4096 count=1' (cwd None) >Thread-15::DEBUG::2014-07-10 08:20:08,738::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000834295 s, 4.9 MB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-07-10 08:20:09,501::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-07-10 08:20:09,637::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0327133 s, 31.3 MB/s\n'; <rc> = 0 >Thread-1042::DEBUG::2014-07-10 08:20:10,379::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-1042::DEBUG::2014-07-10 08:20:10,380::task::595::TaskManager.Task::(_updateState) Task=`ba2b2efb-b173-42fc-9117-9e81e38204ae`::moving from state init -> state preparing >Thread-1042::INFO::2014-07-10 08:20:10,380::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='411039e4-4af2-4192-9de0-67dc1ed83ba9', options=None) >Thread-1042::INFO::2014-07-10 08:20:10,381::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2}} >Thread-1042::DEBUG::2014-07-10 08:20:10,381::task::1185::TaskManager.Task::(prepare) Task=`ba2b2efb-b173-42fc-9117-9e81e38204ae`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2}} >Thread-1042::DEBUG::2014-07-10 08:20:10,381::task::595::TaskManager.Task::(_updateState) Task=`ba2b2efb-b173-42fc-9117-9e81e38204ae`::moving from state preparing -> state finished >Thread-1042::DEBUG::2014-07-10 08:20:10,382::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-1042::DEBUG::2014-07-10 08:20:10,382::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1042::DEBUG::2014-07-10 08:20:10,382::task::990::TaskManager.Task::(_decref) Task=`ba2b2efb-b173-42fc-9117-9e81e38204ae`::ref 0 aborting False >Thread-1043::DEBUG::2014-07-10 08:20:10,581::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-1043::DEBUG::2014-07-10 08:20:10,581::task::595::TaskManager.Task::(_updateState) Task=`1faf5ee5-c020-4cf9-8e72-665745a7c427`::moving from state init -> state preparing >Thread-1043::INFO::2014-07-10 08:20:10,582::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='411039e4-4af2-4192-9de0-67dc1ed83ba9', options=None) >Thread-1043::DEBUG::2014-07-10 08:20:10,582::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9`ReqID=`cc1885f5-edb8-4e56-a5f6-e368e3936bff`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo' >Thread-1043::DEBUG::2014-07-10 08:20:10,583::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' for lock type 'shared' >Thread-1043::DEBUG::2014-07-10 08:20:10,583::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' is free. Now locking as 'shared' (1 active user) >Thread-1043::DEBUG::2014-07-10 08:20:10,583::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9`ReqID=`cc1885f5-edb8-4e56-a5f6-e368e3936bff`::Granted request >Thread-1043::DEBUG::2014-07-10 08:20:10,584::task::827::TaskManager.Task::(resourceAcquired) Task=`1faf5ee5-c020-4cf9-8e72-665745a7c427`::_resourcesAcquired: Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9 (shared) >Thread-1043::DEBUG::2014-07-10 08:20:10,584::task::990::TaskManager.Task::(_decref) Task=`1faf5ee5-c020-4cf9-8e72-665745a7c427`::ref 1 aborting False >Thread-1043::INFO::2014-07-10 08:20:10,585::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DC-REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2, 'domains': u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': 'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c': {'status': u'Active', 'diskfree': '1137495244800', 'isoprefix': '', 'alerts': [], 'disktotal': '1152393412608', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532069482496', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-1043::DEBUG::2014-07-10 08:20:10,585::task::1185::TaskManager.Task::(prepare) Task=`1faf5ee5-c020-4cf9-8e72-665745a7c427`::finished: {'info': {'name': 'DC-REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2, 'domains': u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': 'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c': {'status': u'Active', 'diskfree': '1137495244800', 'isoprefix': '', 'alerts': [], 'disktotal': '1152393412608', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532069482496', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-1043::DEBUG::2014-07-10 08:20:10,585::task::595::TaskManager.Task::(_updateState) Task=`1faf5ee5-c020-4cf9-8e72-665745a7c427`::moving from state preparing -> state finished >Thread-1043::DEBUG::2014-07-10 08:20:10,586::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9': < ResourceRef 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9', isValid: 'True' obj: 'None'>} >Thread-1043::DEBUG::2014-07-10 08:20:10,586::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1043::DEBUG::2014-07-10 08:20:10,586::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' >Thread-1043::DEBUG::2014-07-10 08:20:10,586::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' (0 active users) >Thread-1043::DEBUG::2014-07-10 08:20:10,587::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' is free, finding out if anyone is waiting for it. >Thread-1043::DEBUG::2014-07-10 08:20:10,587::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9', Clearing records. >Thread-1043::DEBUG::2014-07-10 08:20:10,587::task::990::TaskManager.Task::(_decref) Task=`1faf5ee5-c020-4cf9-8e72-665745a7c427`::ref 0 aborting False >Dummy-36::DEBUG::2014-07-10 08:20:11,652::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-07-10 08:20:11,786::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.040268 s, 25.4 MB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-07-10 08:20:13,796::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-07-10 08:20:13,929::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0331862 s, 30.9 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 08:20:15,928::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lion.qa.lab.tlv.redhat.com:_export_yuri2_backup2/6a70504d-00df-4869-8695-0f442053f6b6/dom_md/metadata bs=4096 count=1' (cwd None) >Dummy-36::DEBUG::2014-07-10 08:20:15,992::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Thread-14::DEBUG::2014-07-10 08:20:16,063::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n369 bytes (369 B) copied, 0.000406532 s, 908 kB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-07-10 08:20:16,140::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0439079 s, 23.3 MB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-07-10 08:20:18,155::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Thread-1042::DEBUG::2014-07-10 08:20:18,317::task::595::TaskManager.Task::(_updateState) Task=`9605cf29-60b7-4129-b0b9-2ed0221a4550`::moving from state init -> state preparing >Thread-1042::INFO::2014-07-10 08:20:18,320::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-1042::INFO::2014-07-10 08:20:18,323::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000834295', 'lastCheck': '9.6', 'valid': True}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000406532', 'lastCheck': '2.2', 'valid': True}} >Thread-1042::DEBUG::2014-07-10 08:20:18,325::task::1185::TaskManager.Task::(prepare) Task=`9605cf29-60b7-4129-b0b9-2ed0221a4550`::finished: {u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000834295', 'lastCheck': '9.6', 'valid': True}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000406532', 'lastCheck': '2.2', 'valid': True}} >Thread-1042::DEBUG::2014-07-10 08:20:18,329::task::595::TaskManager.Task::(_updateState) Task=`9605cf29-60b7-4129-b0b9-2ed0221a4550`::moving from state preparing -> state finished >Thread-1042::DEBUG::2014-07-10 08:20:18,331::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-1042::DEBUG::2014-07-10 08:20:18,332::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1042::DEBUG::2014-07-10 08:20:18,335::task::990::TaskManager.Task::(_decref) Task=`9605cf29-60b7-4129-b0b9-2ed0221a4550`::ref 0 aborting False >Dummy-36::DEBUG::2014-07-10 08:20:18,353::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.035804 s, 28.6 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-07-10 08:20:18,767::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/e01a3a36-d2ce-4153-bb57-d6e65b7ed08c/metadata bs=4096 count=1' (cwd None) >Thread-15::DEBUG::2014-07-10 08:20:18,832::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000883859 s, 4.6 MB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-07-10 08:20:20,467::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-07-10 08:20:20,606::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0381171 s, 26.9 MB/s\n'; <rc> = 0 >Thread-1042::DEBUG::2014-07-10 08:20:20,659::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-1042::DEBUG::2014-07-10 08:20:20,660::task::595::TaskManager.Task::(_updateState) Task=`40f5d984-6ed5-4750-ae89-9ba001de38af`::moving from state init -> state preparing >Thread-1042::INFO::2014-07-10 08:20:20,661::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='411039e4-4af2-4192-9de0-67dc1ed83ba9', options=None) >Thread-1042::INFO::2014-07-10 08:20:20,661::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2}} >Thread-1042::DEBUG::2014-07-10 08:20:20,662::task::1185::TaskManager.Task::(prepare) Task=`40f5d984-6ed5-4750-ae89-9ba001de38af`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2}} >Thread-1042::DEBUG::2014-07-10 08:20:20,662::task::595::TaskManager.Task::(_updateState) Task=`40f5d984-6ed5-4750-ae89-9ba001de38af`::moving from state preparing -> state finished >Thread-1042::DEBUG::2014-07-10 08:20:20,662::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-1042::DEBUG::2014-07-10 08:20:20,662::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1042::DEBUG::2014-07-10 08:20:20,662::task::990::TaskManager.Task::(_decref) Task=`40f5d984-6ed5-4750-ae89-9ba001de38af`::ref 0 aborting False >Thread-1043::DEBUG::2014-07-10 08:20:20,666::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-1043::DEBUG::2014-07-10 08:20:20,667::task::595::TaskManager.Task::(_updateState) Task=`55cbe190-b798-4cbd-8d44-ea07ffbc531e`::moving from state init -> state preparing >Thread-1043::INFO::2014-07-10 08:20:20,667::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='411039e4-4af2-4192-9de0-67dc1ed83ba9', options=None) >Thread-1043::DEBUG::2014-07-10 08:20:20,668::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9`ReqID=`b4f1d8ac-7b27-4a87-9f8d-ce984f6db137`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo' >Thread-1043::DEBUG::2014-07-10 08:20:20,668::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' for lock type 'shared' >Thread-1043::DEBUG::2014-07-10 08:20:20,668::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' is free. Now locking as 'shared' (1 active user) >Thread-1043::DEBUG::2014-07-10 08:20:20,668::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9`ReqID=`b4f1d8ac-7b27-4a87-9f8d-ce984f6db137`::Granted request >Thread-1043::DEBUG::2014-07-10 08:20:20,669::task::827::TaskManager.Task::(resourceAcquired) Task=`55cbe190-b798-4cbd-8d44-ea07ffbc531e`::_resourcesAcquired: Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9 (shared) >Thread-1043::DEBUG::2014-07-10 08:20:20,669::task::990::TaskManager.Task::(_decref) Task=`55cbe190-b798-4cbd-8d44-ea07ffbc531e`::ref 1 aborting False >Thread-1043::INFO::2014-07-10 08:20:20,670::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DC-REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2, 'domains': u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': 'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c': {'status': u'Active', 'diskfree': '1137495244800', 'isoprefix': '', 'alerts': [], 'disktotal': '1152393412608', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532069482496', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-1043::DEBUG::2014-07-10 08:20:20,671::task::1185::TaskManager.Task::(prepare) Task=`55cbe190-b798-4cbd-8d44-ea07ffbc531e`::finished: {'info': {'name': 'DC-REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2, 'domains': u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': 'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c': {'status': u'Active', 'diskfree': '1137495244800', 'isoprefix': '', 'alerts': [], 'disktotal': '1152393412608', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532069482496', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-1043::DEBUG::2014-07-10 08:20:20,671::task::595::TaskManager.Task::(_updateState) Task=`55cbe190-b798-4cbd-8d44-ea07ffbc531e`::moving from state preparing -> state finished >Thread-1043::DEBUG::2014-07-10 08:20:20,671::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9': < ResourceRef 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9', isValid: 'True' obj: 'None'>} >Thread-1043::DEBUG::2014-07-10 08:20:20,671::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1043::DEBUG::2014-07-10 08:20:20,671::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' >Thread-1043::DEBUG::2014-07-10 08:20:20,672::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' (0 active users) >Thread-1043::DEBUG::2014-07-10 08:20:20,672::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' is free, finding out if anyone is waiting for it. >Thread-1043::DEBUG::2014-07-10 08:20:20,672::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9', Clearing records. >Thread-1043::DEBUG::2014-07-10 08:20:20,672::task::990::TaskManager.Task::(_decref) Task=`55cbe190-b798-4cbd-8d44-ea07ffbc531e`::ref 0 aborting False >Dummy-36::DEBUG::2014-07-10 08:20:22,620::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-07-10 08:20:22,752::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0329701 s, 31.1 MB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-07-10 08:20:24,767::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-07-10 08:20:24,899::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0335721 s, 30.5 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 08:20:26,102::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lion.qa.lab.tlv.redhat.com:_export_yuri2_backup2/6a70504d-00df-4869-8695-0f442053f6b6/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-14::DEBUG::2014-07-10 08:20:26,164::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n369 bytes (369 B) copied, 0.000411382 s, 897 kB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-07-10 08:20:26,914::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-07-10 08:20:27,051::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0325394 s, 31.5 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-07-10 08:20:28,863::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/e01a3a36-d2ce-4153-bb57-d6e65b7ed08c/metadata bs=4096 count=1' (cwd None) >Thread-15::DEBUG::2014-07-10 08:20:28,927::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000684637 s, 6.0 MB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-07-10 08:20:29,066::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-07-10 08:20:29,207::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0381746 s, 26.8 MB/s\n'; <rc> = 0 >Thread-1042::DEBUG::2014-07-10 08:20:30,695::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-1042::DEBUG::2014-07-10 08:20:30,696::task::595::TaskManager.Task::(_updateState) Task=`455561f3-d79e-4688-9d0f-df1ef87dc2a9`::moving from state init -> state preparing >Thread-1042::INFO::2014-07-10 08:20:30,696::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='411039e4-4af2-4192-9de0-67dc1ed83ba9', options=None) >Thread-1042::INFO::2014-07-10 08:20:30,697::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2}} >Thread-1042::DEBUG::2014-07-10 08:20:30,697::task::1185::TaskManager.Task::(prepare) Task=`455561f3-d79e-4688-9d0f-df1ef87dc2a9`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2}} >Thread-1042::DEBUG::2014-07-10 08:20:30,697::task::595::TaskManager.Task::(_updateState) Task=`455561f3-d79e-4688-9d0f-df1ef87dc2a9`::moving from state preparing -> state finished >Thread-1042::DEBUG::2014-07-10 08:20:30,698::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-1042::DEBUG::2014-07-10 08:20:30,698::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1042::DEBUG::2014-07-10 08:20:30,698::task::990::TaskManager.Task::(_decref) Task=`455561f3-d79e-4688-9d0f-df1ef87dc2a9`::ref 0 aborting False >Thread-1043::DEBUG::2014-07-10 08:20:30,702::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-1043::DEBUG::2014-07-10 08:20:30,702::task::595::TaskManager.Task::(_updateState) Task=`19dd769f-7f0b-4d26-8b52-995b138e9de9`::moving from state init -> state preparing >Thread-1043::INFO::2014-07-10 08:20:30,702::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='411039e4-4af2-4192-9de0-67dc1ed83ba9', options=None) >Thread-1043::DEBUG::2014-07-10 08:20:30,703::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9`ReqID=`87aeb77e-debc-4e4e-8b66-8f96e437cbb0`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo' >Thread-1043::DEBUG::2014-07-10 08:20:30,703::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' for lock type 'shared' >Thread-1043::DEBUG::2014-07-10 08:20:30,704::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' is free. Now locking as 'shared' (1 active user) >Thread-1043::DEBUG::2014-07-10 08:20:30,704::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9`ReqID=`87aeb77e-debc-4e4e-8b66-8f96e437cbb0`::Granted request >Thread-1043::DEBUG::2014-07-10 08:20:30,704::task::827::TaskManager.Task::(resourceAcquired) Task=`19dd769f-7f0b-4d26-8b52-995b138e9de9`::_resourcesAcquired: Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9 (shared) >Thread-1043::DEBUG::2014-07-10 08:20:30,705::task::990::TaskManager.Task::(_decref) Task=`19dd769f-7f0b-4d26-8b52-995b138e9de9`::ref 1 aborting False >Thread-1043::INFO::2014-07-10 08:20:30,706::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DC-REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2, 'domains': u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': 'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c': {'status': u'Active', 'diskfree': '1137495244800', 'isoprefix': '', 'alerts': [], 'disktotal': '1152393412608', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532069482496', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-1043::DEBUG::2014-07-10 08:20:30,706::task::1185::TaskManager.Task::(prepare) Task=`19dd769f-7f0b-4d26-8b52-995b138e9de9`::finished: {'info': {'name': 'DC-REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2, 'domains': u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': 'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c': {'status': u'Active', 'diskfree': '1137495244800', 'isoprefix': '', 'alerts': [], 'disktotal': '1152393412608', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532069482496', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-1043::DEBUG::2014-07-10 08:20:30,706::task::595::TaskManager.Task::(_updateState) Task=`19dd769f-7f0b-4d26-8b52-995b138e9de9`::moving from state preparing -> state finished >Thread-1043::DEBUG::2014-07-10 08:20:30,707::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9': < ResourceRef 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9', isValid: 'True' obj: 'None'>} >Thread-1043::DEBUG::2014-07-10 08:20:30,707::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1043::DEBUG::2014-07-10 08:20:30,707::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' >Thread-1043::DEBUG::2014-07-10 08:20:30,707::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' (0 active users) >Thread-1043::DEBUG::2014-07-10 08:20:30,707::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' is free, finding out if anyone is waiting for it. >Thread-1043::DEBUG::2014-07-10 08:20:30,708::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9', Clearing records. >Thread-1043::DEBUG::2014-07-10 08:20:30,708::task::990::TaskManager.Task::(_decref) Task=`19dd769f-7f0b-4d26-8b52-995b138e9de9`::ref 0 aborting False >Dummy-36::DEBUG::2014-07-10 08:20:31,222::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-07-10 08:20:31,362::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.038835 s, 26.4 MB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-07-10 08:20:33,377::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-07-10 08:20:33,509::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0332112 s, 30.8 MB/s\n'; <rc> = 0 >Thread-1042::DEBUG::2014-07-10 08:20:33,580::task::595::TaskManager.Task::(_updateState) Task=`e8c0d0a1-92b0-4e60-9932-c3ee6bd316fc`::moving from state init -> state preparing >Thread-1042::INFO::2014-07-10 08:20:33,581::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-1042::INFO::2014-07-10 08:20:33,581::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000684637', 'lastCheck': '4.6', 'valid': True}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000411382', 'lastCheck': '7.4', 'valid': True}} >Thread-1042::DEBUG::2014-07-10 08:20:33,581::task::1185::TaskManager.Task::(prepare) Task=`e8c0d0a1-92b0-4e60-9932-c3ee6bd316fc`::finished: {u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000684637', 'lastCheck': '4.6', 'valid': True}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000411382', 'lastCheck': '7.4', 'valid': True}} >Thread-1042::DEBUG::2014-07-10 08:20:33,581::task::595::TaskManager.Task::(_updateState) Task=`e8c0d0a1-92b0-4e60-9932-c3ee6bd316fc`::moving from state preparing -> state finished >Thread-1042::DEBUG::2014-07-10 08:20:33,582::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-1042::DEBUG::2014-07-10 08:20:33,582::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1042::DEBUG::2014-07-10 08:20:33,582::task::990::TaskManager.Task::(_decref) Task=`e8c0d0a1-92b0-4e60-9932-c3ee6bd316fc`::ref 0 aborting False >Dummy-36::DEBUG::2014-07-10 08:20:35,524::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-07-10 08:20:35,659::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0351385 s, 29.1 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 08:20:36,189::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lion.qa.lab.tlv.redhat.com:_export_yuri2_backup2/6a70504d-00df-4869-8695-0f442053f6b6/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-14::DEBUG::2014-07-10 08:20:36,254::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n369 bytes (369 B) copied, 0.000441717 s, 835 kB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-07-10 08:20:37,674::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-07-10 08:20:37,811::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0356729 s, 28.7 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-07-10 08:20:38,957::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/e01a3a36-d2ce-4153-bb57-d6e65b7ed08c/metadata bs=4096 count=1' (cwd None) >Thread-15::DEBUG::2014-07-10 08:20:39,017::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000721254 s, 5.7 MB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-07-10 08:20:39,826::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-07-10 08:20:39,963::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0351773 s, 29.1 MB/s\n'; <rc> = 0 >Thread-1042::DEBUG::2014-07-10 08:20:40,737::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-1042::DEBUG::2014-07-10 08:20:40,738::task::595::TaskManager.Task::(_updateState) Task=`8c42b3d9-f0d8-4ed3-9175-12096731a2b2`::moving from state init -> state preparing >Thread-1042::INFO::2014-07-10 08:20:40,739::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='411039e4-4af2-4192-9de0-67dc1ed83ba9', options=None) >Thread-1042::INFO::2014-07-10 08:20:40,739::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2}} >Thread-1042::DEBUG::2014-07-10 08:20:40,739::task::1185::TaskManager.Task::(prepare) Task=`8c42b3d9-f0d8-4ed3-9175-12096731a2b2`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2}} >Thread-1042::DEBUG::2014-07-10 08:20:40,740::task::595::TaskManager.Task::(_updateState) Task=`8c42b3d9-f0d8-4ed3-9175-12096731a2b2`::moving from state preparing -> state finished >Thread-1042::DEBUG::2014-07-10 08:20:40,740::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-1042::DEBUG::2014-07-10 08:20:40,740::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1042::DEBUG::2014-07-10 08:20:40,740::task::990::TaskManager.Task::(_decref) Task=`8c42b3d9-f0d8-4ed3-9175-12096731a2b2`::ref 0 aborting False >Thread-1043::DEBUG::2014-07-10 08:20:40,744::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-1043::DEBUG::2014-07-10 08:20:40,745::task::595::TaskManager.Task::(_updateState) Task=`c852ed68-4073-49e5-8ba9-6bc4307c9962`::moving from state init -> state preparing >Thread-1043::INFO::2014-07-10 08:20:40,745::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='411039e4-4af2-4192-9de0-67dc1ed83ba9', options=None) >Thread-1043::DEBUG::2014-07-10 08:20:40,746::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9`ReqID=`191ab3f4-ddf5-44f5-abfe-e291d13ae312`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo' >Thread-1043::DEBUG::2014-07-10 08:20:40,746::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' for lock type 'shared' >Thread-1043::DEBUG::2014-07-10 08:20:40,746::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' is free. Now locking as 'shared' (1 active user) >Thread-1043::DEBUG::2014-07-10 08:20:40,746::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9`ReqID=`191ab3f4-ddf5-44f5-abfe-e291d13ae312`::Granted request >Thread-1043::DEBUG::2014-07-10 08:20:40,747::task::827::TaskManager.Task::(resourceAcquired) Task=`c852ed68-4073-49e5-8ba9-6bc4307c9962`::_resourcesAcquired: Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9 (shared) >Thread-1043::DEBUG::2014-07-10 08:20:40,747::task::990::TaskManager.Task::(_decref) Task=`c852ed68-4073-49e5-8ba9-6bc4307c9962`::ref 1 aborting False >Thread-1043::INFO::2014-07-10 08:20:40,748::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DC-REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2, 'domains': u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': 'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c': {'status': u'Active', 'diskfree': '1137495244800', 'isoprefix': '', 'alerts': [], 'disktotal': '1152393412608', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532069482496', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-1043::DEBUG::2014-07-10 08:20:40,749::task::1185::TaskManager.Task::(prepare) Task=`c852ed68-4073-49e5-8ba9-6bc4307c9962`::finished: {'info': {'name': 'DC-REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2, 'domains': u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': 'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c': {'status': u'Active', 'diskfree': '1137495244800', 'isoprefix': '', 'alerts': [], 'disktotal': '1152393412608', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532069482496', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-1043::DEBUG::2014-07-10 08:20:40,749::task::595::TaskManager.Task::(_updateState) Task=`c852ed68-4073-49e5-8ba9-6bc4307c9962`::moving from state preparing -> state finished >Thread-1043::DEBUG::2014-07-10 08:20:40,749::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9': < ResourceRef 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9', isValid: 'True' obj: 'None'>} >Thread-1043::DEBUG::2014-07-10 08:20:40,749::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1043::DEBUG::2014-07-10 08:20:40,750::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' >Thread-1043::DEBUG::2014-07-10 08:20:40,750::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' (0 active users) >Thread-1043::DEBUG::2014-07-10 08:20:40,750::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' is free, finding out if anyone is waiting for it. >Thread-1043::DEBUG::2014-07-10 08:20:40,750::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9', Clearing records. >Thread-1043::DEBUG::2014-07-10 08:20:40,750::task::990::TaskManager.Task::(_decref) Task=`c852ed68-4073-49e5-8ba9-6bc4307c9962`::ref 0 aborting False >Dummy-36::DEBUG::2014-07-10 08:20:41,978::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-07-10 08:20:42,112::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0321543 s, 31.8 MB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-07-10 08:20:44,127::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-07-10 08:20:44,258::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0357213 s, 28.7 MB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-07-10 08:20:46,275::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Thread-14::DEBUG::2014-07-10 08:20:46,457::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lion.qa.lab.tlv.redhat.com:_export_yuri2_backup2/6a70504d-00df-4869-8695-0f442053f6b6/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-14::DEBUG::2014-07-10 08:20:46,552::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n369 bytes (369 B) copied, 0.000511913 s, 721 kB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-07-10 08:20:46,631::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.253334 s, 4.0 MB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-07-10 08:20:48,646::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Thread-1042::DEBUG::2014-07-10 08:20:48,724::task::595::TaskManager.Task::(_updateState) Task=`6d3a4e95-be76-4889-b5c8-28229300f7e8`::moving from state init -> state preparing >Thread-1042::INFO::2014-07-10 08:20:48,726::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-1042::INFO::2014-07-10 08:20:48,727::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000721254', 'lastCheck': '9.7', 'valid': True}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000511913', 'lastCheck': '2.2', 'valid': True}} >Thread-1042::DEBUG::2014-07-10 08:20:48,728::task::1185::TaskManager.Task::(prepare) Task=`6d3a4e95-be76-4889-b5c8-28229300f7e8`::finished: {u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000721254', 'lastCheck': '9.7', 'valid': True}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000511913', 'lastCheck': '2.2', 'valid': True}} >Thread-1042::DEBUG::2014-07-10 08:20:48,729::task::595::TaskManager.Task::(_updateState) Task=`6d3a4e95-be76-4889-b5c8-28229300f7e8`::moving from state preparing -> state finished >Thread-1042::DEBUG::2014-07-10 08:20:48,730::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-1042::DEBUG::2014-07-10 08:20:48,730::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1042::DEBUG::2014-07-10 08:20:48,731::task::990::TaskManager.Task::(_decref) Task=`6d3a4e95-be76-4889-b5c8-28229300f7e8`::ref 0 aborting False >Dummy-36::DEBUG::2014-07-10 08:20:48,811::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0639055 s, 16.0 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-07-10 08:20:49,046::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/e01a3a36-d2ce-4153-bb57-d6e65b7ed08c/metadata bs=4096 count=1' (cwd None) >Thread-15::DEBUG::2014-07-10 08:20:49,111::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000820727 s, 5.0 MB/s\n'; <rc> = 0 >Thread-1042::DEBUG::2014-07-10 08:20:50,812::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-1042::DEBUG::2014-07-10 08:20:50,813::task::595::TaskManager.Task::(_updateState) Task=`319acd3b-1073-4091-b4f7-21098e164aab`::moving from state init -> state preparing >Thread-1042::INFO::2014-07-10 08:20:50,814::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='411039e4-4af2-4192-9de0-67dc1ed83ba9', options=None) >Thread-1042::INFO::2014-07-10 08:20:50,814::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2}} >Thread-1042::DEBUG::2014-07-10 08:20:50,814::task::1185::TaskManager.Task::(prepare) Task=`319acd3b-1073-4091-b4f7-21098e164aab`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2}} >Thread-1042::DEBUG::2014-07-10 08:20:50,814::task::595::TaskManager.Task::(_updateState) Task=`319acd3b-1073-4091-b4f7-21098e164aab`::moving from state preparing -> state finished >Thread-1042::DEBUG::2014-07-10 08:20:50,814::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-1042::DEBUG::2014-07-10 08:20:50,815::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1042::DEBUG::2014-07-10 08:20:50,815::task::990::TaskManager.Task::(_decref) Task=`319acd3b-1073-4091-b4f7-21098e164aab`::ref 0 aborting False >Thread-1043::DEBUG::2014-07-10 08:20:50,818::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-1043::DEBUG::2014-07-10 08:20:50,819::task::595::TaskManager.Task::(_updateState) Task=`7ddce649-49ea-4944-a82b-d992ac11fbc2`::moving from state init -> state preparing >Thread-1043::INFO::2014-07-10 08:20:50,819::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='411039e4-4af2-4192-9de0-67dc1ed83ba9', options=None) >Thread-1043::DEBUG::2014-07-10 08:20:50,819::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9`ReqID=`667e3f92-c5fd-4b4a-aae9-d9b62073a234`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo' >Thread-1043::DEBUG::2014-07-10 08:20:50,820::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' for lock type 'shared' >Thread-1043::DEBUG::2014-07-10 08:20:50,820::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' is free. Now locking as 'shared' (1 active user) >Thread-1043::DEBUG::2014-07-10 08:20:50,820::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9`ReqID=`667e3f92-c5fd-4b4a-aae9-d9b62073a234`::Granted request >Thread-1043::DEBUG::2014-07-10 08:20:50,821::task::827::TaskManager.Task::(resourceAcquired) Task=`7ddce649-49ea-4944-a82b-d992ac11fbc2`::_resourcesAcquired: Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9 (shared) >Thread-1043::DEBUG::2014-07-10 08:20:50,821::task::990::TaskManager.Task::(_decref) Task=`7ddce649-49ea-4944-a82b-d992ac11fbc2`::ref 1 aborting False >Thread-1043::INFO::2014-07-10 08:20:50,822::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DC-REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2, 'domains': u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': 'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c': {'status': u'Active', 'diskfree': '1137495244800', 'isoprefix': '', 'alerts': [], 'disktotal': '1152393412608', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532069482496', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-1043::DEBUG::2014-07-10 08:20:50,822::task::1185::TaskManager.Task::(prepare) Task=`7ddce649-49ea-4944-a82b-d992ac11fbc2`::finished: {'info': {'name': 'DC-REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2, 'domains': u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': 'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c': {'status': u'Active', 'diskfree': '1137495244800', 'isoprefix': '', 'alerts': [], 'disktotal': '1152393412608', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532069482496', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-1043::DEBUG::2014-07-10 08:20:50,822::task::595::TaskManager.Task::(_updateState) Task=`7ddce649-49ea-4944-a82b-d992ac11fbc2`::moving from state preparing -> state finished >Thread-1043::DEBUG::2014-07-10 08:20:50,822::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9': < ResourceRef 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9', isValid: 'True' obj: 'None'>} >Thread-1043::DEBUG::2014-07-10 08:20:50,822::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1043::DEBUG::2014-07-10 08:20:50,823::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' >Thread-1043::DEBUG::2014-07-10 08:20:50,823::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' (0 active users) >Thread-1043::DEBUG::2014-07-10 08:20:50,823::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' is free, finding out if anyone is waiting for it. >Thread-1043::DEBUG::2014-07-10 08:20:50,823::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9', Clearing records. >Thread-1043::DEBUG::2014-07-10 08:20:50,823::task::990::TaskManager.Task::(_decref) Task=`7ddce649-49ea-4944-a82b-d992ac11fbc2`::ref 0 aborting False >Dummy-36::DEBUG::2014-07-10 08:20:50,826::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-07-10 08:20:50,983::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.052758 s, 19.4 MB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-07-10 08:20:52,998::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-07-10 08:20:53,135::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0381887 s, 26.8 MB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-07-10 08:20:55,151::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-07-10 08:20:55,281::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0326633 s, 31.4 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 08:20:56,594::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lion.qa.lab.tlv.redhat.com:_export_yuri2_backup2/6a70504d-00df-4869-8695-0f442053f6b6/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-14::DEBUG::2014-07-10 08:20:56,657::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n369 bytes (369 B) copied, 0.000439049 s, 840 kB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-07-10 08:20:57,297::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-07-10 08:20:57,432::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0332325 s, 30.8 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-07-10 08:20:59,140::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/e01a3a36-d2ce-4153-bb57-d6e65b7ed08c/metadata bs=4096 count=1' (cwd None) >Thread-15::DEBUG::2014-07-10 08:20:59,204::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00122595 s, 3.3 MB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-07-10 08:20:59,447::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-07-10 08:20:59,603::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0520489 s, 19.7 MB/s\n'; <rc> = 0 >Thread-1042::DEBUG::2014-07-10 08:21:00,845::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-1042::DEBUG::2014-07-10 08:21:00,846::task::595::TaskManager.Task::(_updateState) Task=`b3cabc51-0b17-4d89-8b82-34e5e2529536`::moving from state init -> state preparing >Thread-1042::INFO::2014-07-10 08:21:00,846::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='411039e4-4af2-4192-9de0-67dc1ed83ba9', options=None) >Thread-1042::INFO::2014-07-10 08:21:00,847::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2}} >Thread-1042::DEBUG::2014-07-10 08:21:00,847::task::1185::TaskManager.Task::(prepare) Task=`b3cabc51-0b17-4d89-8b82-34e5e2529536`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2}} >Thread-1042::DEBUG::2014-07-10 08:21:00,847::task::595::TaskManager.Task::(_updateState) Task=`b3cabc51-0b17-4d89-8b82-34e5e2529536`::moving from state preparing -> state finished >Thread-1042::DEBUG::2014-07-10 08:21:00,847::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-1042::DEBUG::2014-07-10 08:21:00,848::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1042::DEBUG::2014-07-10 08:21:00,848::task::990::TaskManager.Task::(_decref) Task=`b3cabc51-0b17-4d89-8b82-34e5e2529536`::ref 0 aborting False >Thread-1043::DEBUG::2014-07-10 08:21:00,852::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-1043::DEBUG::2014-07-10 08:21:00,852::task::595::TaskManager.Task::(_updateState) Task=`7f17ec09-205b-4848-95c8-942439196146`::moving from state init -> state preparing >Thread-1043::INFO::2014-07-10 08:21:00,852::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='411039e4-4af2-4192-9de0-67dc1ed83ba9', options=None) >Thread-1043::DEBUG::2014-07-10 08:21:00,853::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9`ReqID=`abe47b73-af62-4bf2-bfd7-84ca71ba5a23`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo' >Thread-1043::DEBUG::2014-07-10 08:21:00,853::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' for lock type 'shared' >Thread-1043::DEBUG::2014-07-10 08:21:00,853::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' is free. Now locking as 'shared' (1 active user) >Thread-1043::DEBUG::2014-07-10 08:21:00,854::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9`ReqID=`abe47b73-af62-4bf2-bfd7-84ca71ba5a23`::Granted request >Thread-1043::DEBUG::2014-07-10 08:21:00,854::task::827::TaskManager.Task::(resourceAcquired) Task=`7f17ec09-205b-4848-95c8-942439196146`::_resourcesAcquired: Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9 (shared) >Thread-1043::DEBUG::2014-07-10 08:21:00,854::task::990::TaskManager.Task::(_decref) Task=`7f17ec09-205b-4848-95c8-942439196146`::ref 1 aborting False >Thread-1043::INFO::2014-07-10 08:21:00,855::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DC-REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2, 'domains': u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': 'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c': {'status': u'Active', 'diskfree': '1137495244800', 'isoprefix': '', 'alerts': [], 'disktotal': '1152393412608', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532069482496', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-1043::DEBUG::2014-07-10 08:21:00,855::task::1185::TaskManager.Task::(prepare) Task=`7f17ec09-205b-4848-95c8-942439196146`::finished: {'info': {'name': 'DC-REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2, 'domains': u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': 'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c': {'status': u'Active', 'diskfree': '1137495244800', 'isoprefix': '', 'alerts': [], 'disktotal': '1152393412608', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532069482496', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-1043::DEBUG::2014-07-10 08:21:00,856::task::595::TaskManager.Task::(_updateState) Task=`7f17ec09-205b-4848-95c8-942439196146`::moving from state preparing -> state finished >Thread-1043::DEBUG::2014-07-10 08:21:00,856::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9': < ResourceRef 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9', isValid: 'True' obj: 'None'>} >Thread-1043::DEBUG::2014-07-10 08:21:00,856::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1043::DEBUG::2014-07-10 08:21:00,856::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' >Thread-1043::DEBUG::2014-07-10 08:21:00,856::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' (0 active users) >Thread-1043::DEBUG::2014-07-10 08:21:00,856::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' is free, finding out if anyone is waiting for it. >Thread-1043::DEBUG::2014-07-10 08:21:00,857::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9', Clearing records. >Thread-1043::DEBUG::2014-07-10 08:21:00,857::task::990::TaskManager.Task::(_decref) Task=`7f17ec09-205b-4848-95c8-942439196146`::ref 0 aborting False >Dummy-36::DEBUG::2014-07-10 08:21:01,619::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-07-10 08:21:01,759::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0381148 s, 26.9 MB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-07-10 08:21:03,774::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-07-10 08:21:03,904::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0327075 s, 31.3 MB/s\n'; <rc> = 0 >Thread-1042::DEBUG::2014-07-10 08:21:03,940::task::595::TaskManager.Task::(_updateState) Task=`590ac94d-b6cb-446a-9f11-9ba77c72a744`::moving from state init -> state preparing >Thread-1042::INFO::2014-07-10 08:21:03,943::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-1042::INFO::2014-07-10 08:21:03,945::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00122595', 'lastCheck': '4.7', 'valid': True}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000439049', 'lastCheck': '7.3', 'valid': True}} >Thread-1042::DEBUG::2014-07-10 08:21:03,946::task::1185::TaskManager.Task::(prepare) Task=`590ac94d-b6cb-446a-9f11-9ba77c72a744`::finished: {u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00122595', 'lastCheck': '4.7', 'valid': True}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000439049', 'lastCheck': '7.3', 'valid': True}} >Thread-1042::DEBUG::2014-07-10 08:21:03,948::task::595::TaskManager.Task::(_updateState) Task=`590ac94d-b6cb-446a-9f11-9ba77c72a744`::moving from state preparing -> state finished >Thread-1042::DEBUG::2014-07-10 08:21:03,949::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-1042::DEBUG::2014-07-10 08:21:03,950::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1042::DEBUG::2014-07-10 08:21:03,952::task::990::TaskManager.Task::(_decref) Task=`590ac94d-b6cb-446a-9f11-9ba77c72a744`::ref 0 aborting False >Dummy-36::DEBUG::2014-07-10 08:21:05,965::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-07-10 08:21:06,097::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0318847 s, 32.1 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 08:21:06,687::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lion.qa.lab.tlv.redhat.com:_export_yuri2_backup2/6a70504d-00df-4869-8695-0f442053f6b6/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-14::DEBUG::2014-07-10 08:21:06,750::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n369 bytes (369 B) copied, 0.000504751 s, 731 kB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-07-10 08:21:08,112::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-07-10 08:21:08,246::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0374883 s, 27.3 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-07-10 08:21:09,234::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/e01a3a36-d2ce-4153-bb57-d6e65b7ed08c/metadata bs=4096 count=1' (cwd None) >Thread-15::DEBUG::2014-07-10 08:21:09,313::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.0166355 s, 246 kB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-07-10 08:21:10,260::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-07-10 08:21:10,598::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.195398 s, 5.2 MB/s\n'; <rc> = 0 >Thread-1042::DEBUG::2014-07-10 08:21:10,887::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-1042::DEBUG::2014-07-10 08:21:10,888::task::595::TaskManager.Task::(_updateState) Task=`76c2c882-5e4e-425b-9ee4-478b74cedf47`::moving from state init -> state preparing >Thread-1042::INFO::2014-07-10 08:21:10,889::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='411039e4-4af2-4192-9de0-67dc1ed83ba9', options=None) >Thread-1042::INFO::2014-07-10 08:21:10,889::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2}} >Thread-1042::DEBUG::2014-07-10 08:21:10,889::task::1185::TaskManager.Task::(prepare) Task=`76c2c882-5e4e-425b-9ee4-478b74cedf47`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2}} >Thread-1042::DEBUG::2014-07-10 08:21:10,890::task::595::TaskManager.Task::(_updateState) Task=`76c2c882-5e4e-425b-9ee4-478b74cedf47`::moving from state preparing -> state finished >Thread-1042::DEBUG::2014-07-10 08:21:10,890::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-1042::DEBUG::2014-07-10 08:21:10,890::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1042::DEBUG::2014-07-10 08:21:10,890::task::990::TaskManager.Task::(_decref) Task=`76c2c882-5e4e-425b-9ee4-478b74cedf47`::ref 0 aborting False >Thread-1043::DEBUG::2014-07-10 08:21:10,894::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-1043::DEBUG::2014-07-10 08:21:10,895::task::595::TaskManager.Task::(_updateState) Task=`434c5277-50bd-441e-82ba-3cc474ef7d4e`::moving from state init -> state preparing >Thread-1043::INFO::2014-07-10 08:21:10,895::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='411039e4-4af2-4192-9de0-67dc1ed83ba9', options=None) >Thread-1043::DEBUG::2014-07-10 08:21:10,896::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9`ReqID=`c0c9b898-d1c1-48d1-b4d8-b72b49dab9e3`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo' >Thread-1043::DEBUG::2014-07-10 08:21:10,896::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' for lock type 'shared' >Thread-1043::DEBUG::2014-07-10 08:21:10,896::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' is free. Now locking as 'shared' (1 active user) >Thread-1043::DEBUG::2014-07-10 08:21:10,896::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9`ReqID=`c0c9b898-d1c1-48d1-b4d8-b72b49dab9e3`::Granted request >Thread-1043::DEBUG::2014-07-10 08:21:10,897::task::827::TaskManager.Task::(resourceAcquired) Task=`434c5277-50bd-441e-82ba-3cc474ef7d4e`::_resourcesAcquired: Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9 (shared) >Thread-1043::DEBUG::2014-07-10 08:21:10,897::task::990::TaskManager.Task::(_decref) Task=`434c5277-50bd-441e-82ba-3cc474ef7d4e`::ref 1 aborting False >Thread-1043::INFO::2014-07-10 08:21:10,898::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DC-REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2, 'domains': u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': 'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c': {'status': u'Active', 'diskfree': '1137495244800', 'isoprefix': '', 'alerts': [], 'disktotal': '1152393412608', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532069482496', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-1043::DEBUG::2014-07-10 08:21:10,898::task::1185::TaskManager.Task::(prepare) Task=`434c5277-50bd-441e-82ba-3cc474ef7d4e`::finished: {'info': {'name': 'DC-REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2, 'domains': u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': 'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c': {'status': u'Active', 'diskfree': '1137495244800', 'isoprefix': '', 'alerts': [], 'disktotal': '1152393412608', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532069482496', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-1043::DEBUG::2014-07-10 08:21:10,899::task::595::TaskManager.Task::(_updateState) Task=`434c5277-50bd-441e-82ba-3cc474ef7d4e`::moving from state preparing -> state finished >Thread-1043::DEBUG::2014-07-10 08:21:10,899::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9': < ResourceRef 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9', isValid: 'True' obj: 'None'>} >Thread-1043::DEBUG::2014-07-10 08:21:10,899::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1043::DEBUG::2014-07-10 08:21:10,899::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' >Thread-1043::DEBUG::2014-07-10 08:21:10,900::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' (0 active users) >Thread-1043::DEBUG::2014-07-10 08:21:10,900::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' is free, finding out if anyone is waiting for it. >Thread-1043::DEBUG::2014-07-10 08:21:10,900::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9', Clearing records. >Thread-1043::DEBUG::2014-07-10 08:21:10,900::task::990::TaskManager.Task::(_decref) Task=`434c5277-50bd-441e-82ba-3cc474ef7d4e`::ref 0 aborting False >Dummy-36::DEBUG::2014-07-10 08:21:12,613::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-07-10 08:21:12,743::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0295132 s, 34.7 MB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-07-10 08:21:14,758::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-07-10 08:21:14,897::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0420389 s, 24.4 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 08:21:16,780::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lion.qa.lab.tlv.redhat.com:_export_yuri2_backup2/6a70504d-00df-4869-8695-0f442053f6b6/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-14::DEBUG::2014-07-10 08:21:16,842::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n369 bytes (369 B) copied, 0.000400028 s, 922 kB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-07-10 08:21:16,912::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-07-10 08:21:17,053::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0378108 s, 27.1 MB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-07-10 08:21:19,069::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Thread-1042::DEBUG::2014-07-10 08:21:19,134::task::595::TaskManager.Task::(_updateState) Task=`04119475-cfb6-4c62-b962-2ae760b6e5ed`::moving from state init -> state preparing >Thread-1042::INFO::2014-07-10 08:21:19,136::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-1042::INFO::2014-07-10 08:21:19,137::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0166355', 'lastCheck': '9.8', 'valid': True}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000400028', 'lastCheck': '2.3', 'valid': True}} >Thread-1042::DEBUG::2014-07-10 08:21:19,137::task::1185::TaskManager.Task::(prepare) Task=`04119475-cfb6-4c62-b962-2ae760b6e5ed`::finished: {u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0166355', 'lastCheck': '9.8', 'valid': True}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000400028', 'lastCheck': '2.3', 'valid': True}} >Thread-1042::DEBUG::2014-07-10 08:21:19,138::task::595::TaskManager.Task::(_updateState) Task=`04119475-cfb6-4c62-b962-2ae760b6e5ed`::moving from state preparing -> state finished >Thread-1042::DEBUG::2014-07-10 08:21:19,139::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-1042::DEBUG::2014-07-10 08:21:19,140::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1042::DEBUG::2014-07-10 08:21:19,140::task::990::TaskManager.Task::(_decref) Task=`04119475-cfb6-4c62-b962-2ae760b6e5ed`::ref 0 aborting False >Dummy-36::DEBUG::2014-07-10 08:21:19,225::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0586275 s, 17.5 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-07-10 08:21:19,343::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/e01a3a36-d2ce-4153-bb57-d6e65b7ed08c/metadata bs=4096 count=1' (cwd None) >Thread-15::DEBUG::2014-07-10 08:21:19,412::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00478628 s, 856 kB/s\n'; <rc> = 0 >Thread-1042::DEBUG::2014-07-10 08:21:20,936::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-1042::DEBUG::2014-07-10 08:21:20,937::task::595::TaskManager.Task::(_updateState) Task=`5a8d948d-0dee-43e8-8774-527482714b04`::moving from state init -> state preparing >Thread-1042::INFO::2014-07-10 08:21:20,937::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='411039e4-4af2-4192-9de0-67dc1ed83ba9', options=None) >Thread-1042::INFO::2014-07-10 08:21:20,938::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2}} >Thread-1042::DEBUG::2014-07-10 08:21:20,938::task::1185::TaskManager.Task::(prepare) Task=`5a8d948d-0dee-43e8-8774-527482714b04`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2}} >Thread-1042::DEBUG::2014-07-10 08:21:20,938::task::595::TaskManager.Task::(_updateState) Task=`5a8d948d-0dee-43e8-8774-527482714b04`::moving from state preparing -> state finished >Thread-1042::DEBUG::2014-07-10 08:21:20,938::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-1042::DEBUG::2014-07-10 08:21:20,938::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1042::DEBUG::2014-07-10 08:21:20,938::task::990::TaskManager.Task::(_decref) Task=`5a8d948d-0dee-43e8-8774-527482714b04`::ref 0 aborting False >Thread-1043::DEBUG::2014-07-10 08:21:20,942::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-1043::DEBUG::2014-07-10 08:21:20,942::task::595::TaskManager.Task::(_updateState) Task=`24df925d-5a7e-4698-af48-b208d48e02ee`::moving from state init -> state preparing >Thread-1043::INFO::2014-07-10 08:21:20,943::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='411039e4-4af2-4192-9de0-67dc1ed83ba9', options=None) >Thread-1043::DEBUG::2014-07-10 08:21:20,943::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9`ReqID=`743e5454-a6b3-404c-98b9-def35e6a2775`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo' >Thread-1043::DEBUG::2014-07-10 08:21:20,943::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' for lock type 'shared' >Thread-1043::DEBUG::2014-07-10 08:21:20,944::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' is free. Now locking as 'shared' (1 active user) >Thread-1043::DEBUG::2014-07-10 08:21:20,944::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9`ReqID=`743e5454-a6b3-404c-98b9-def35e6a2775`::Granted request >Thread-1043::DEBUG::2014-07-10 08:21:20,944::task::827::TaskManager.Task::(resourceAcquired) Task=`24df925d-5a7e-4698-af48-b208d48e02ee`::_resourcesAcquired: Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9 (shared) >Thread-1043::DEBUG::2014-07-10 08:21:20,944::task::990::TaskManager.Task::(_decref) Task=`24df925d-5a7e-4698-af48-b208d48e02ee`::ref 1 aborting False >Thread-1043::INFO::2014-07-10 08:21:20,945::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DC-REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2, 'domains': u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': 'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c': {'status': u'Active', 'diskfree': '1137495244800', 'isoprefix': '', 'alerts': [], 'disktotal': '1152393412608', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532069482496', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-1043::DEBUG::2014-07-10 08:21:20,946::task::1185::TaskManager.Task::(prepare) Task=`24df925d-5a7e-4698-af48-b208d48e02ee`::finished: {'info': {'name': 'DC-REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2, 'domains': u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': 'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c': {'status': u'Active', 'diskfree': '1137495244800', 'isoprefix': '', 'alerts': [], 'disktotal': '1152393412608', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532069482496', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-1043::DEBUG::2014-07-10 08:21:20,946::task::595::TaskManager.Task::(_updateState) Task=`24df925d-5a7e-4698-af48-b208d48e02ee`::moving from state preparing -> state finished >Thread-1043::DEBUG::2014-07-10 08:21:20,946::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9': < ResourceRef 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9', isValid: 'True' obj: 'None'>} >Thread-1043::DEBUG::2014-07-10 08:21:20,946::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1043::DEBUG::2014-07-10 08:21:20,946::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' >Thread-1043::DEBUG::2014-07-10 08:21:20,946::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' (0 active users) >Thread-1043::DEBUG::2014-07-10 08:21:20,947::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' is free, finding out if anyone is waiting for it. >Thread-1043::DEBUG::2014-07-10 08:21:20,947::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9', Clearing records. >Thread-1043::DEBUG::2014-07-10 08:21:20,947::task::990::TaskManager.Task::(_decref) Task=`24df925d-5a7e-4698-af48-b208d48e02ee`::ref 0 aborting False >Dummy-36::DEBUG::2014-07-10 08:21:21,240::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-07-10 08:21:21,375::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0325908 s, 31.4 MB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-07-10 08:21:23,390::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-07-10 08:21:23,529::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0386673 s, 26.5 MB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-07-10 08:21:25,544::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-07-10 08:21:25,679::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0328641 s, 31.2 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 08:21:26,868::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lion.qa.lab.tlv.redhat.com:_export_yuri2_backup2/6a70504d-00df-4869-8695-0f442053f6b6/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-14::DEBUG::2014-07-10 08:21:26,934::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n369 bytes (369 B) copied, 0.00045028 s, 819 kB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-07-10 08:21:27,695::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-07-10 08:21:27,835::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0382062 s, 26.8 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-07-10 08:21:29,441::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/e01a3a36-d2ce-4153-bb57-d6e65b7ed08c/metadata bs=4096 count=1' (cwd None) >Thread-15::DEBUG::2014-07-10 08:21:29,514::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00849162 s, 482 kB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-07-10 08:21:29,850::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-07-10 08:21:29,988::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0325581 s, 31.5 MB/s\n'; <rc> = 0 >Thread-1042::DEBUG::2014-07-10 08:21:30,971::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-1042::DEBUG::2014-07-10 08:21:30,972::task::595::TaskManager.Task::(_updateState) Task=`a6a5c2be-09ea-4668-9e9b-ad1eca2fc72d`::moving from state init -> state preparing >Thread-1042::INFO::2014-07-10 08:21:30,973::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='411039e4-4af2-4192-9de0-67dc1ed83ba9', options=None) >Thread-1042::INFO::2014-07-10 08:21:30,973::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2}} >Thread-1042::DEBUG::2014-07-10 08:21:30,973::task::1185::TaskManager.Task::(prepare) Task=`a6a5c2be-09ea-4668-9e9b-ad1eca2fc72d`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2}} >Thread-1042::DEBUG::2014-07-10 08:21:30,973::task::595::TaskManager.Task::(_updateState) Task=`a6a5c2be-09ea-4668-9e9b-ad1eca2fc72d`::moving from state preparing -> state finished >Thread-1042::DEBUG::2014-07-10 08:21:30,974::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-1042::DEBUG::2014-07-10 08:21:30,974::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1042::DEBUG::2014-07-10 08:21:30,974::task::990::TaskManager.Task::(_decref) Task=`a6a5c2be-09ea-4668-9e9b-ad1eca2fc72d`::ref 0 aborting False >Thread-1043::DEBUG::2014-07-10 08:21:30,978::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-1043::DEBUG::2014-07-10 08:21:30,979::task::595::TaskManager.Task::(_updateState) Task=`d178010d-598e-4029-a18a-d48673a4f588`::moving from state init -> state preparing >Thread-1043::INFO::2014-07-10 08:21:30,979::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='411039e4-4af2-4192-9de0-67dc1ed83ba9', options=None) >Thread-1043::DEBUG::2014-07-10 08:21:30,980::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9`ReqID=`45cfb7e2-cc5c-4078-b77e-f73c9d166079`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo' >Thread-1043::DEBUG::2014-07-10 08:21:30,980::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' for lock type 'shared' >Thread-1043::DEBUG::2014-07-10 08:21:30,980::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' is free. Now locking as 'shared' (1 active user) >Thread-1043::DEBUG::2014-07-10 08:21:30,980::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9`ReqID=`45cfb7e2-cc5c-4078-b77e-f73c9d166079`::Granted request >Thread-1043::DEBUG::2014-07-10 08:21:30,981::task::827::TaskManager.Task::(resourceAcquired) Task=`d178010d-598e-4029-a18a-d48673a4f588`::_resourcesAcquired: Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9 (shared) >Thread-1043::DEBUG::2014-07-10 08:21:30,981::task::990::TaskManager.Task::(_decref) Task=`d178010d-598e-4029-a18a-d48673a4f588`::ref 1 aborting False >Thread-1043::INFO::2014-07-10 08:21:30,982::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DC-REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2, 'domains': u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': 'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c': {'status': u'Active', 'diskfree': '1137495244800', 'isoprefix': '', 'alerts': [], 'disktotal': '1152393412608', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532069482496', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-1043::DEBUG::2014-07-10 08:21:30,983::task::1185::TaskManager.Task::(prepare) Task=`d178010d-598e-4029-a18a-d48673a4f588`::finished: {'info': {'name': 'DC-REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2, 'domains': u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': 'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c': {'status': u'Active', 'diskfree': '1137495244800', 'isoprefix': '', 'alerts': [], 'disktotal': '1152393412608', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532069482496', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-1043::DEBUG::2014-07-10 08:21:30,983::task::595::TaskManager.Task::(_updateState) Task=`d178010d-598e-4029-a18a-d48673a4f588`::moving from state preparing -> state finished >Thread-1043::DEBUG::2014-07-10 08:21:30,983::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9': < ResourceRef 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9', isValid: 'True' obj: 'None'>} >Thread-1043::DEBUG::2014-07-10 08:21:30,983::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1043::DEBUG::2014-07-10 08:21:30,983::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' >Thread-1043::DEBUG::2014-07-10 08:21:30,984::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' (0 active users) >Thread-1043::DEBUG::2014-07-10 08:21:30,984::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' is free, finding out if anyone is waiting for it. >Thread-1043::DEBUG::2014-07-10 08:21:30,984::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9', Clearing records. >Thread-1043::DEBUG::2014-07-10 08:21:30,984::task::990::TaskManager.Task::(_decref) Task=`d178010d-598e-4029-a18a-d48673a4f588`::ref 0 aborting False >Dummy-36::DEBUG::2014-07-10 08:21:32,004::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-07-10 08:21:32,138::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0385481 s, 26.6 MB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-07-10 08:21:34,153::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Thread-1042::DEBUG::2014-07-10 08:21:34,321::task::595::TaskManager.Task::(_updateState) Task=`8e8d9a40-641c-4bfc-a409-7976b9574d50`::moving from state init -> state preparing >Thread-1042::INFO::2014-07-10 08:21:34,325::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-1042::INFO::2014-07-10 08:21:34,329::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00849162', 'lastCheck': '4.8', 'valid': True}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00045028', 'lastCheck': '7.4', 'valid': True}} >Thread-1042::DEBUG::2014-07-10 08:21:34,332::task::1185::TaskManager.Task::(prepare) Task=`8e8d9a40-641c-4bfc-a409-7976b9574d50`::finished: {u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00849162', 'lastCheck': '4.8', 'valid': True}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00045028', 'lastCheck': '7.4', 'valid': True}} >Thread-1042::DEBUG::2014-07-10 08:21:34,335::task::595::TaskManager.Task::(_updateState) Task=`8e8d9a40-641c-4bfc-a409-7976b9574d50`::moving from state preparing -> state finished >Thread-1042::DEBUG::2014-07-10 08:21:34,337::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-1042::DEBUG::2014-07-10 08:21:34,339::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1042::DEBUG::2014-07-10 08:21:34,341::task::990::TaskManager.Task::(_decref) Task=`8e8d9a40-641c-4bfc-a409-7976b9574d50`::ref 0 aborting False >Dummy-36::DEBUG::2014-07-10 08:21:34,380::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.037428 s, 27.4 MB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-07-10 08:21:36,491::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-07-10 08:21:36,622::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0327 s, 31.3 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 08:21:36,964::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lion.qa.lab.tlv.redhat.com:_export_yuri2_backup2/6a70504d-00df-4869-8695-0f442053f6b6/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-14::DEBUG::2014-07-10 08:21:37,028::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n369 bytes (369 B) copied, 0.000456528 s, 808 kB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-07-10 08:21:38,638::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-07-10 08:21:38,775::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.038495 s, 26.6 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-07-10 08:21:39,544::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/e01a3a36-d2ce-4153-bb57-d6e65b7ed08c/metadata bs=4096 count=1' (cwd None) >Thread-15::DEBUG::2014-07-10 08:21:39,613::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00629932 s, 650 kB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-07-10 08:21:40,790::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-07-10 08:21:40,942::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0379965 s, 26.9 MB/s\n'; <rc> = 0 >Thread-1042::DEBUG::2014-07-10 08:21:41,012::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [4ee1c32c] >Thread-1042::DEBUG::2014-07-10 08:21:41,013::task::595::TaskManager.Task::(_updateState) Task=`8043ceb3-0171-41ff-a2c7-670f12e04da0`::moving from state init -> state preparing >Thread-1042::INFO::2014-07-10 08:21:41,014::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='411039e4-4af2-4192-9de0-67dc1ed83ba9', options=None) >Thread-1042::INFO::2014-07-10 08:21:41,014::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2}} >Thread-1042::DEBUG::2014-07-10 08:21:41,014::task::1185::TaskManager.Task::(prepare) Task=`8043ceb3-0171-41ff-a2c7-670f12e04da0`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2}} >Thread-1042::DEBUG::2014-07-10 08:21:41,015::task::595::TaskManager.Task::(_updateState) Task=`8043ceb3-0171-41ff-a2c7-670f12e04da0`::moving from state preparing -> state finished >Thread-1042::DEBUG::2014-07-10 08:21:41,015::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-1042::DEBUG::2014-07-10 08:21:41,015::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1042::DEBUG::2014-07-10 08:21:41,015::task::990::TaskManager.Task::(_decref) Task=`8043ceb3-0171-41ff-a2c7-670f12e04da0`::ref 0 aborting False >Thread-1043::DEBUG::2014-07-10 08:21:41,019::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [4ee1c32c] >Thread-1043::DEBUG::2014-07-10 08:21:41,020::task::595::TaskManager.Task::(_updateState) Task=`e1316319-afdc-4421-bbdb-51bcad87cd1d`::moving from state init -> state preparing >Thread-1043::INFO::2014-07-10 08:21:41,020::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='411039e4-4af2-4192-9de0-67dc1ed83ba9', options=None) >Thread-1043::DEBUG::2014-07-10 08:21:41,021::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9`ReqID=`bf573342-bdb5-42de-91df-4fdf55605073`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo' >Thread-1043::DEBUG::2014-07-10 08:21:41,021::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' for lock type 'shared' >Thread-1043::DEBUG::2014-07-10 08:21:41,021::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' is free. Now locking as 'shared' (1 active user) >Thread-1043::DEBUG::2014-07-10 08:21:41,021::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9`ReqID=`bf573342-bdb5-42de-91df-4fdf55605073`::Granted request >Thread-1043::DEBUG::2014-07-10 08:21:41,022::task::827::TaskManager.Task::(resourceAcquired) Task=`e1316319-afdc-4421-bbdb-51bcad87cd1d`::_resourcesAcquired: Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9 (shared) >Thread-1043::DEBUG::2014-07-10 08:21:41,022::task::990::TaskManager.Task::(_decref) Task=`e1316319-afdc-4421-bbdb-51bcad87cd1d`::ref 1 aborting False >Thread-1043::INFO::2014-07-10 08:21:41,023::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DC-REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2, 'domains': u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': 'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c': {'status': u'Active', 'diskfree': '1137495244800', 'isoprefix': '', 'alerts': [], 'disktotal': '1152393412608', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532069482496', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-1043::DEBUG::2014-07-10 08:21:41,023::task::1185::TaskManager.Task::(prepare) Task=`e1316319-afdc-4421-bbdb-51bcad87cd1d`::finished: {'info': {'name': 'DC-REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2, 'domains': u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': 'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c': {'status': u'Active', 'diskfree': '1137495244800', 'isoprefix': '', 'alerts': [], 'disktotal': '1152393412608', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532069482496', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-1043::DEBUG::2014-07-10 08:21:41,024::task::595::TaskManager.Task::(_updateState) Task=`e1316319-afdc-4421-bbdb-51bcad87cd1d`::moving from state preparing -> state finished >Thread-1043::DEBUG::2014-07-10 08:21:41,024::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9': < ResourceRef 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9', isValid: 'True' obj: 'None'>} >Thread-1043::DEBUG::2014-07-10 08:21:41,024::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1043::DEBUG::2014-07-10 08:21:41,024::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' >Thread-1043::DEBUG::2014-07-10 08:21:41,025::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' (0 active users) >Thread-1043::DEBUG::2014-07-10 08:21:41,025::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' is free, finding out if anyone is waiting for it. >Thread-1043::DEBUG::2014-07-10 08:21:41,025::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9', Clearing records. >Thread-1043::DEBUG::2014-07-10 08:21:41,025::task::990::TaskManager.Task::(_decref) Task=`e1316319-afdc-4421-bbdb-51bcad87cd1d`::ref 0 aborting False >Dummy-36::DEBUG::2014-07-10 08:21:42,957::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-07-10 08:21:43,096::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0380471 s, 26.9 MB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-07-10 08:21:45,111::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-07-10 08:21:45,239::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.029974 s, 34.2 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 08:21:47,058::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lion.qa.lab.tlv.redhat.com:_export_yuri2_backup2/6a70504d-00df-4869-8695-0f442053f6b6/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-14::DEBUG::2014-07-10 08:21:47,123::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n369 bytes (369 B) copied, 0.000384422 s, 960 kB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-07-10 08:21:47,255::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-07-10 08:21:47,423::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0654613 s, 15.6 MB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-07-10 08:21:49,438::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-07-10 08:21:49,571::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0327752 s, 31.2 MB/s\n'; <rc> = 0 >Thread-1042::DEBUG::2014-07-10 08:21:49,600::task::595::TaskManager.Task::(_updateState) Task=`09304096-533a-4cbb-8de8-5bbf0bb87f87`::moving from state init -> state preparing >Thread-1042::INFO::2014-07-10 08:21:49,600::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-1042::INFO::2014-07-10 08:21:49,601::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00629932', 'lastCheck': '10.0', 'valid': True}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000384422', 'lastCheck': '2.5', 'valid': True}} >Thread-1042::DEBUG::2014-07-10 08:21:49,601::task::1185::TaskManager.Task::(prepare) Task=`09304096-533a-4cbb-8de8-5bbf0bb87f87`::finished: {u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00629932', 'lastCheck': '10.0', 'valid': True}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000384422', 'lastCheck': '2.5', 'valid': True}} >Thread-1042::DEBUG::2014-07-10 08:21:49,601::task::595::TaskManager.Task::(_updateState) Task=`09304096-533a-4cbb-8de8-5bbf0bb87f87`::moving from state preparing -> state finished >Thread-1042::DEBUG::2014-07-10 08:21:49,601::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-1042::DEBUG::2014-07-10 08:21:49,602::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1042::DEBUG::2014-07-10 08:21:49,602::task::990::TaskManager.Task::(_decref) Task=`09304096-533a-4cbb-8de8-5bbf0bb87f87`::ref 0 aborting False >Thread-15::DEBUG::2014-07-10 08:21:49,642::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/e01a3a36-d2ce-4153-bb57-d6e65b7ed08c/metadata bs=4096 count=1' (cwd None) >Thread-15::DEBUG::2014-07-10 08:21:49,715::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00788613 s, 519 kB/s\n'; <rc> = 0 >Thread-1042::DEBUG::2014-07-10 08:21:51,067::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-1042::DEBUG::2014-07-10 08:21:51,067::task::595::TaskManager.Task::(_updateState) Task=`20b1ec22-0ad0-4d51-822e-3cb653f20277`::moving from state init -> state preparing >Thread-1042::INFO::2014-07-10 08:21:51,068::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='411039e4-4af2-4192-9de0-67dc1ed83ba9', options=None) >Thread-1042::INFO::2014-07-10 08:21:51,068::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2}} >Thread-1042::DEBUG::2014-07-10 08:21:51,068::task::1185::TaskManager.Task::(prepare) Task=`20b1ec22-0ad0-4d51-822e-3cb653f20277`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2}} >Thread-1042::DEBUG::2014-07-10 08:21:51,068::task::595::TaskManager.Task::(_updateState) Task=`20b1ec22-0ad0-4d51-822e-3cb653f20277`::moving from state preparing -> state finished >Thread-1042::DEBUG::2014-07-10 08:21:51,069::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-1042::DEBUG::2014-07-10 08:21:51,069::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1042::DEBUG::2014-07-10 08:21:51,069::task::990::TaskManager.Task::(_decref) Task=`20b1ec22-0ad0-4d51-822e-3cb653f20277`::ref 0 aborting False >Thread-1043::DEBUG::2014-07-10 08:21:51,073::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-1043::DEBUG::2014-07-10 08:21:51,073::task::595::TaskManager.Task::(_updateState) Task=`9f73c800-7924-48a6-a901-36e78ebffa7f`::moving from state init -> state preparing >Thread-1043::INFO::2014-07-10 08:21:51,073::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='411039e4-4af2-4192-9de0-67dc1ed83ba9', options=None) >Thread-1043::DEBUG::2014-07-10 08:21:51,074::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9`ReqID=`617c3867-0de4-4c37-8579-96e8d58d50b6`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo' >Thread-1043::DEBUG::2014-07-10 08:21:51,074::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' for lock type 'shared' >Thread-1043::DEBUG::2014-07-10 08:21:51,074::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' is free. Now locking as 'shared' (1 active user) >Thread-1043::DEBUG::2014-07-10 08:21:51,074::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9`ReqID=`617c3867-0de4-4c37-8579-96e8d58d50b6`::Granted request >Thread-1043::DEBUG::2014-07-10 08:21:51,075::task::827::TaskManager.Task::(resourceAcquired) Task=`9f73c800-7924-48a6-a901-36e78ebffa7f`::_resourcesAcquired: Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9 (shared) >Thread-1043::DEBUG::2014-07-10 08:21:51,075::task::990::TaskManager.Task::(_decref) Task=`9f73c800-7924-48a6-a901-36e78ebffa7f`::ref 1 aborting False >Thread-1043::INFO::2014-07-10 08:21:51,076::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DC-REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2, 'domains': u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': 'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c': {'status': u'Active', 'diskfree': '1137495244800', 'isoprefix': '', 'alerts': [], 'disktotal': '1152393412608', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532069482496', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-1043::DEBUG::2014-07-10 08:21:51,076::task::1185::TaskManager.Task::(prepare) Task=`9f73c800-7924-48a6-a901-36e78ebffa7f`::finished: {'info': {'name': 'DC-REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2, 'domains': u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': 'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c': {'status': u'Active', 'diskfree': '1137495244800', 'isoprefix': '', 'alerts': [], 'disktotal': '1152393412608', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532069482496', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-1043::DEBUG::2014-07-10 08:21:51,076::task::595::TaskManager.Task::(_updateState) Task=`9f73c800-7924-48a6-a901-36e78ebffa7f`::moving from state preparing -> state finished >Thread-1043::DEBUG::2014-07-10 08:21:51,076::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9': < ResourceRef 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9', isValid: 'True' obj: 'None'>} >Thread-1043::DEBUG::2014-07-10 08:21:51,077::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1043::DEBUG::2014-07-10 08:21:51,077::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' >Thread-1043::DEBUG::2014-07-10 08:21:51,077::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' (0 active users) >Thread-1043::DEBUG::2014-07-10 08:21:51,077::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' is free, finding out if anyone is waiting for it. >Thread-1043::DEBUG::2014-07-10 08:21:51,077::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9', Clearing records. >Thread-1043::DEBUG::2014-07-10 08:21:51,078::task::990::TaskManager.Task::(_decref) Task=`9f73c800-7924-48a6-a901-36e78ebffa7f`::ref 0 aborting False >Dummy-36::DEBUG::2014-07-10 08:21:51,586::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-07-10 08:21:51,744::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0527805 s, 19.4 MB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-07-10 08:21:53,759::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-07-10 08:21:53,922::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0646846 s, 15.8 MB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-07-10 08:21:55,937::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-07-10 08:21:56,079::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0422603 s, 24.2 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 08:21:57,127::domainMonitor::192::Storage.DomainMonitorThread::(_monitorDomain) Refreshing domain 6a70504d-00df-4869-8695-0f442053f6b6 >Thread-14::DEBUG::2014-07-10 08:21:57,152::fileSD::150::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/lion.qa.lab.tlv.redhat.com:_export_yuri2_backup2/6a70504d-00df-4869-8695-0f442053f6b6 >Thread-14::DEBUG::2014-07-10 08:21:57,154::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend >Thread-14::DEBUG::2014-07-10 08:21:57,157::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Backup', 'DESCRIPTION=test', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=0', 'POOL_UUID=411039e4-4af2-4192-9de0-67dc1ed83ba9', 'REMOTE_PATH=lion.qa.lab.tlv.redhat.com:/export/yuri2/backup2', 'ROLE=Regular', 'SDUUID=6a70504d-00df-4869-8695-0f442053f6b6', 'TYPE=NFS', 'VERSION=0', '_SHA_CKSUM=c52897a45cbc3ed0a0146ef350774e5cecebe6cf'] >Thread-14::DEBUG::2014-07-10 08:21:57,158::fileSD::609::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images [] >Thread-14::INFO::2014-07-10 08:21:57,158::sd::384::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 6a70504d-00df-4869-8695-0f442053f6b6_imageNS already registered >Thread-14::INFO::2014-07-10 08:21:57,159::sd::392::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 6a70504d-00df-4869-8695-0f442053f6b6_volumeNS already registered >Thread-14::DEBUG::2014-07-10 08:21:57,178::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lion.qa.lab.tlv.redhat.com:_export_yuri2_backup2/6a70504d-00df-4869-8695-0f442053f6b6/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-14::DEBUG::2014-07-10 08:21:57,241::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n369 bytes (369 B) copied, 0.000510796 s, 722 kB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-07-10 08:21:58,095::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-07-10 08:21:58,235::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0381121 s, 26.9 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-07-10 08:21:59,745::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/e01a3a36-d2ce-4153-bb57-d6e65b7ed08c/metadata bs=4096 count=1' (cwd None) >Thread-15::DEBUG::2014-07-10 08:21:59,809::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000642622 s, 6.4 MB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-07-10 08:22:00,251::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-07-10 08:22:00,387::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0333749 s, 30.7 MB/s\n'; <rc> = 0 >Thread-1042::DEBUG::2014-07-10 08:22:01,104::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-1042::DEBUG::2014-07-10 08:22:01,105::task::595::TaskManager.Task::(_updateState) Task=`9edbbfb2-4086-47fe-9484-fa8d1ecccd03`::moving from state init -> state preparing >Thread-1042::INFO::2014-07-10 08:22:01,106::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='411039e4-4af2-4192-9de0-67dc1ed83ba9', options=None) >Thread-1042::INFO::2014-07-10 08:22:01,106::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2}} >Thread-1042::DEBUG::2014-07-10 08:22:01,107::task::1185::TaskManager.Task::(prepare) Task=`9edbbfb2-4086-47fe-9484-fa8d1ecccd03`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2}} >Thread-1042::DEBUG::2014-07-10 08:22:01,107::task::595::TaskManager.Task::(_updateState) Task=`9edbbfb2-4086-47fe-9484-fa8d1ecccd03`::moving from state preparing -> state finished >Thread-1042::DEBUG::2014-07-10 08:22:01,107::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-1042::DEBUG::2014-07-10 08:22:01,107::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1042::DEBUG::2014-07-10 08:22:01,107::task::990::TaskManager.Task::(_decref) Task=`9edbbfb2-4086-47fe-9484-fa8d1ecccd03`::ref 0 aborting False >Thread-1043::DEBUG::2014-07-10 08:22:01,111::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-1043::DEBUG::2014-07-10 08:22:01,112::task::595::TaskManager.Task::(_updateState) Task=`b6b67bf7-de67-47c8-93ff-113ad1fffa0d`::moving from state init -> state preparing >Thread-1043::INFO::2014-07-10 08:22:01,112::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='411039e4-4af2-4192-9de0-67dc1ed83ba9', options=None) >Thread-1043::DEBUG::2014-07-10 08:22:01,113::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9`ReqID=`300b67bf-8146-473a-81a7-919adaaba0ab`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo' >Thread-1043::DEBUG::2014-07-10 08:22:01,113::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' for lock type 'shared' >Thread-1043::DEBUG::2014-07-10 08:22:01,113::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' is free. Now locking as 'shared' (1 active user) >Thread-1043::DEBUG::2014-07-10 08:22:01,114::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9`ReqID=`300b67bf-8146-473a-81a7-919adaaba0ab`::Granted request >Thread-1043::DEBUG::2014-07-10 08:22:01,114::task::827::TaskManager.Task::(resourceAcquired) Task=`b6b67bf7-de67-47c8-93ff-113ad1fffa0d`::_resourcesAcquired: Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9 (shared) >Thread-1043::DEBUG::2014-07-10 08:22:01,114::task::990::TaskManager.Task::(_decref) Task=`b6b67bf7-de67-47c8-93ff-113ad1fffa0d`::ref 1 aborting False >Thread-1043::INFO::2014-07-10 08:22:01,116::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DC-REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2, 'domains': u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': 'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c': {'status': u'Active', 'diskfree': '1137495244800', 'isoprefix': '', 'alerts': [], 'disktotal': '1152393412608', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532069482496', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-1043::DEBUG::2014-07-10 08:22:01,116::task::1185::TaskManager.Task::(prepare) Task=`b6b67bf7-de67-47c8-93ff-113ad1fffa0d`::finished: {'info': {'name': 'DC-REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2, 'domains': u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': 'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c': {'status': u'Active', 'diskfree': '1137495244800', 'isoprefix': '', 'alerts': [], 'disktotal': '1152393412608', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532069482496', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-1043::DEBUG::2014-07-10 08:22:01,116::task::595::TaskManager.Task::(_updateState) Task=`b6b67bf7-de67-47c8-93ff-113ad1fffa0d`::moving from state preparing -> state finished >Thread-1043::DEBUG::2014-07-10 08:22:01,116::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9': < ResourceRef 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9', isValid: 'True' obj: 'None'>} >Thread-1043::DEBUG::2014-07-10 08:22:01,116::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1043::DEBUG::2014-07-10 08:22:01,117::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' >Thread-1043::DEBUG::2014-07-10 08:22:01,117::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' (0 active users) >Thread-1043::DEBUG::2014-07-10 08:22:01,117::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' is free, finding out if anyone is waiting for it. >Thread-1043::DEBUG::2014-07-10 08:22:01,117::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9', Clearing records. >Thread-1043::DEBUG::2014-07-10 08:22:01,118::task::990::TaskManager.Task::(_decref) Task=`b6b67bf7-de67-47c8-93ff-113ad1fffa0d`::ref 0 aborting False >Dummy-36::DEBUG::2014-07-10 08:22:02,402::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-07-10 08:22:02,539::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0381499 s, 26.8 MB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-07-10 08:22:04,554::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-07-10 08:22:04,688::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0329057 s, 31.1 MB/s\n'; <rc> = 0 >Thread-1042::DEBUG::2014-07-10 08:22:04,746::task::595::TaskManager.Task::(_updateState) Task=`c8f31d0a-1504-4d6d-84a9-2db403f5f5a5`::moving from state init -> state preparing >Thread-1042::INFO::2014-07-10 08:22:04,747::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-1042::INFO::2014-07-10 08:22:04,747::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000642622', 'lastCheck': '4.9', 'valid': True}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000510796', 'lastCheck': '7.5', 'valid': True}} >Thread-1042::DEBUG::2014-07-10 08:22:04,747::task::1185::TaskManager.Task::(prepare) Task=`c8f31d0a-1504-4d6d-84a9-2db403f5f5a5`::finished: {u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000642622', 'lastCheck': '4.9', 'valid': True}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000510796', 'lastCheck': '7.5', 'valid': True}} >Thread-1042::DEBUG::2014-07-10 08:22:04,748::task::595::TaskManager.Task::(_updateState) Task=`c8f31d0a-1504-4d6d-84a9-2db403f5f5a5`::moving from state preparing -> state finished >Thread-1042::DEBUG::2014-07-10 08:22:04,748::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-1042::DEBUG::2014-07-10 08:22:04,748::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1042::DEBUG::2014-07-10 08:22:04,748::task::990::TaskManager.Task::(_decref) Task=`c8f31d0a-1504-4d6d-84a9-2db403f5f5a5`::ref 0 aborting False >Dummy-36::DEBUG::2014-07-10 08:22:06,703::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-07-10 08:22:06,832::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0327555 s, 31.3 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 08:22:07,271::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lion.qa.lab.tlv.redhat.com:_export_yuri2_backup2/6a70504d-00df-4869-8695-0f442053f6b6/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-14::DEBUG::2014-07-10 08:22:07,335::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n369 bytes (369 B) copied, 0.000504837 s, 731 kB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-07-10 08:22:08,847::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-07-10 08:22:08,981::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0330263 s, 31.0 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-07-10 08:22:09,844::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/e01a3a36-d2ce-4153-bb57-d6e65b7ed08c/metadata bs=4096 count=1' (cwd None) >Thread-15::DEBUG::2014-07-10 08:22:09,912::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.0050919 s, 804 kB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-07-10 08:22:10,996::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-07-10 08:22:11,138::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0382574 s, 26.8 MB/s\n'; <rc> = 0 >Thread-1042::DEBUG::2014-07-10 08:22:11,147::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-1042::DEBUG::2014-07-10 08:22:11,151::task::595::TaskManager.Task::(_updateState) Task=`cdf06cf0-a16e-428f-a3ca-645b8b5f9247`::moving from state init -> state preparing >Thread-1042::INFO::2014-07-10 08:22:11,153::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='411039e4-4af2-4192-9de0-67dc1ed83ba9', options=None) >Thread-1042::INFO::2014-07-10 08:22:11,156::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2}} >Thread-1042::DEBUG::2014-07-10 08:22:11,158::task::1185::TaskManager.Task::(prepare) Task=`cdf06cf0-a16e-428f-a3ca-645b8b5f9247`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2}} >Thread-1042::DEBUG::2014-07-10 08:22:11,159::task::595::TaskManager.Task::(_updateState) Task=`cdf06cf0-a16e-428f-a3ca-645b8b5f9247`::moving from state preparing -> state finished >Thread-1042::DEBUG::2014-07-10 08:22:11,160::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-1042::DEBUG::2014-07-10 08:22:11,162::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1042::DEBUG::2014-07-10 08:22:11,163::task::990::TaskManager.Task::(_decref) Task=`cdf06cf0-a16e-428f-a3ca-645b8b5f9247`::ref 0 aborting False >Thread-1043::DEBUG::2014-07-10 08:22:11,173::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-1043::DEBUG::2014-07-10 08:22:11,176::task::595::TaskManager.Task::(_updateState) Task=`3b32e371-d29d-4968-986c-8eba2932453e`::moving from state init -> state preparing >Thread-1043::INFO::2014-07-10 08:22:11,177::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='411039e4-4af2-4192-9de0-67dc1ed83ba9', options=None) >Thread-1043::DEBUG::2014-07-10 08:22:11,181::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9`ReqID=`d9df3d5b-ffc0-4677-bd1b-1b77a2cb1c34`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo' >Thread-1043::DEBUG::2014-07-10 08:22:11,182::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' for lock type 'shared' >Thread-1043::DEBUG::2014-07-10 08:22:11,185::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' is free. Now locking as 'shared' (1 active user) >Thread-1043::DEBUG::2014-07-10 08:22:11,187::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9`ReqID=`d9df3d5b-ffc0-4677-bd1b-1b77a2cb1c34`::Granted request >Thread-1043::DEBUG::2014-07-10 08:22:11,190::task::827::TaskManager.Task::(resourceAcquired) Task=`3b32e371-d29d-4968-986c-8eba2932453e`::_resourcesAcquired: Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9 (shared) >Thread-1043::DEBUG::2014-07-10 08:22:11,192::task::990::TaskManager.Task::(_decref) Task=`3b32e371-d29d-4968-986c-8eba2932453e`::ref 1 aborting False >Thread-1043::INFO::2014-07-10 08:22:11,200::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DC-REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2, 'domains': u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': 'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c': {'status': u'Active', 'diskfree': '1137495244800', 'isoprefix': '', 'alerts': [], 'disktotal': '1152393412608', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532069482496', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-1043::DEBUG::2014-07-10 08:22:11,201::task::1185::TaskManager.Task::(prepare) Task=`3b32e371-d29d-4968-986c-8eba2932453e`::finished: {'info': {'name': 'DC-REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2, 'domains': u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': 'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c': {'status': u'Active', 'diskfree': '1137495244800', 'isoprefix': '', 'alerts': [], 'disktotal': '1152393412608', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532069482496', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-1043::DEBUG::2014-07-10 08:22:11,202::task::595::TaskManager.Task::(_updateState) Task=`3b32e371-d29d-4968-986c-8eba2932453e`::moving from state preparing -> state finished >Thread-1043::DEBUG::2014-07-10 08:22:11,204::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9': < ResourceRef 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9', isValid: 'True' obj: 'None'>} >Thread-1043::DEBUG::2014-07-10 08:22:11,205::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1043::DEBUG::2014-07-10 08:22:11,207::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' >Thread-1043::DEBUG::2014-07-10 08:22:11,209::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' (0 active users) >Thread-1043::DEBUG::2014-07-10 08:22:11,210::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' is free, finding out if anyone is waiting for it. >Thread-1043::DEBUG::2014-07-10 08:22:11,211::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9', Clearing records. >Thread-1043::DEBUG::2014-07-10 08:22:11,216::task::990::TaskManager.Task::(_decref) Task=`3b32e371-d29d-4968-986c-8eba2932453e`::ref 0 aborting False >Dummy-36::DEBUG::2014-07-10 08:22:13,229::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-07-10 08:22:13,370::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0385156 s, 26.6 MB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-07-10 08:22:15,385::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-07-10 08:22:15,516::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0339554 s, 30.2 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 08:22:17,365::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lion.qa.lab.tlv.redhat.com:_export_yuri2_backup2/6a70504d-00df-4869-8695-0f442053f6b6/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-14::DEBUG::2014-07-10 08:22:17,428::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n369 bytes (369 B) copied, 0.000407534 s, 905 kB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-07-10 08:22:17,531::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-07-10 08:22:17,673::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0389516 s, 26.3 MB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-07-10 08:22:19,689::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-07-10 08:22:19,828::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0382735 s, 26.8 MB/s\n'; <rc> = 0 >Thread-1042::DEBUG::2014-07-10 08:22:19,881::task::595::TaskManager.Task::(_updateState) Task=`e861f1fa-bcac-4b78-b841-884eb520257c`::moving from state init -> state preparing >Thread-1042::INFO::2014-07-10 08:22:19,882::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-1042::INFO::2014-07-10 08:22:19,882::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0050919', 'lastCheck': '9.9', 'valid': True}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000407534', 'lastCheck': '2.5', 'valid': True}} >Thread-1042::DEBUG::2014-07-10 08:22:19,882::task::1185::TaskManager.Task::(prepare) Task=`e861f1fa-bcac-4b78-b841-884eb520257c`::finished: {u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0050919', 'lastCheck': '9.9', 'valid': True}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000407534', 'lastCheck': '2.5', 'valid': True}} >Thread-1042::DEBUG::2014-07-10 08:22:19,882::task::595::TaskManager.Task::(_updateState) Task=`e861f1fa-bcac-4b78-b841-884eb520257c`::moving from state preparing -> state finished >Thread-1042::DEBUG::2014-07-10 08:22:19,883::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-1042::DEBUG::2014-07-10 08:22:19,883::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1042::DEBUG::2014-07-10 08:22:19,883::task::990::TaskManager.Task::(_decref) Task=`e861f1fa-bcac-4b78-b841-884eb520257c`::ref 0 aborting False >Thread-15::DEBUG::2014-07-10 08:22:19,942::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/e01a3a36-d2ce-4153-bb57-d6e65b7ed08c/metadata bs=4096 count=1' (cwd None) >Thread-15::DEBUG::2014-07-10 08:22:20,019::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.0121531 s, 337 kB/s\n'; <rc> = 0 >Thread-1042::DEBUG::2014-07-10 08:22:21,262::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-1042::DEBUG::2014-07-10 08:22:21,263::task::595::TaskManager.Task::(_updateState) Task=`9eb59c7a-e730-4b1f-b1f2-b9b437cfda05`::moving from state init -> state preparing >Thread-1042::INFO::2014-07-10 08:22:21,263::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='411039e4-4af2-4192-9de0-67dc1ed83ba9', options=None) >Thread-1042::INFO::2014-07-10 08:22:21,263::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2}} >Thread-1042::DEBUG::2014-07-10 08:22:21,263::task::1185::TaskManager.Task::(prepare) Task=`9eb59c7a-e730-4b1f-b1f2-b9b437cfda05`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2}} >Thread-1042::DEBUG::2014-07-10 08:22:21,264::task::595::TaskManager.Task::(_updateState) Task=`9eb59c7a-e730-4b1f-b1f2-b9b437cfda05`::moving from state preparing -> state finished >Thread-1042::DEBUG::2014-07-10 08:22:21,264::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-1042::DEBUG::2014-07-10 08:22:21,264::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1042::DEBUG::2014-07-10 08:22:21,264::task::990::TaskManager.Task::(_decref) Task=`9eb59c7a-e730-4b1f-b1f2-b9b437cfda05`::ref 0 aborting False >Thread-1043::DEBUG::2014-07-10 08:22:21,268::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-1043::DEBUG::2014-07-10 08:22:21,268::task::595::TaskManager.Task::(_updateState) Task=`c277e833-5bd7-487e-bcb0-48555df3fcec`::moving from state init -> state preparing >Thread-1043::INFO::2014-07-10 08:22:21,269::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='411039e4-4af2-4192-9de0-67dc1ed83ba9', options=None) >Thread-1043::DEBUG::2014-07-10 08:22:21,269::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9`ReqID=`d29f51ab-06d0-4bfb-8f2e-ad4d326bf672`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo' >Thread-1043::DEBUG::2014-07-10 08:22:21,269::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' for lock type 'shared' >Thread-1043::DEBUG::2014-07-10 08:22:21,270::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' is free. Now locking as 'shared' (1 active user) >Thread-1043::DEBUG::2014-07-10 08:22:21,270::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9`ReqID=`d29f51ab-06d0-4bfb-8f2e-ad4d326bf672`::Granted request >Thread-1043::DEBUG::2014-07-10 08:22:21,270::task::827::TaskManager.Task::(resourceAcquired) Task=`c277e833-5bd7-487e-bcb0-48555df3fcec`::_resourcesAcquired: Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9 (shared) >Thread-1043::DEBUG::2014-07-10 08:22:21,270::task::990::TaskManager.Task::(_decref) Task=`c277e833-5bd7-487e-bcb0-48555df3fcec`::ref 1 aborting False >Thread-1043::INFO::2014-07-10 08:22:21,271::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DC-REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2, 'domains': u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': 'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c': {'status': u'Active', 'diskfree': '1137495244800', 'isoprefix': '', 'alerts': [], 'disktotal': '1152393412608', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532069482496', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-1043::DEBUG::2014-07-10 08:22:21,271::task::1185::TaskManager.Task::(prepare) Task=`c277e833-5bd7-487e-bcb0-48555df3fcec`::finished: {'info': {'name': 'DC-REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2, 'domains': u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': 'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c': {'status': u'Active', 'diskfree': '1137495244800', 'isoprefix': '', 'alerts': [], 'disktotal': '1152393412608', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532069482496', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-1043::DEBUG::2014-07-10 08:22:21,272::task::595::TaskManager.Task::(_updateState) Task=`c277e833-5bd7-487e-bcb0-48555df3fcec`::moving from state preparing -> state finished >Thread-1043::DEBUG::2014-07-10 08:22:21,272::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9': < ResourceRef 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9', isValid: 'True' obj: 'None'>} >Thread-1043::DEBUG::2014-07-10 08:22:21,272::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1043::DEBUG::2014-07-10 08:22:21,272::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' >Thread-1043::DEBUG::2014-07-10 08:22:21,272::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' (0 active users) >Thread-1043::DEBUG::2014-07-10 08:22:21,273::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' is free, finding out if anyone is waiting for it. >Thread-1043::DEBUG::2014-07-10 08:22:21,273::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9', Clearing records. >Thread-1043::DEBUG::2014-07-10 08:22:21,273::task::990::TaskManager.Task::(_decref) Task=`c277e833-5bd7-487e-bcb0-48555df3fcec`::ref 0 aborting False >Dummy-36::DEBUG::2014-07-10 08:22:21,844::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-07-10 08:22:21,980::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0325239 s, 31.5 MB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-07-10 08:22:23,996::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-07-10 08:22:24,127::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0327887 s, 31.2 MB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-07-10 08:22:26,142::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-07-10 08:22:26,283::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0412862 s, 24.8 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 08:22:27,453::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lion.qa.lab.tlv.redhat.com:_export_yuri2_backup2/6a70504d-00df-4869-8695-0f442053f6b6/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-14::DEBUG::2014-07-10 08:22:27,517::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n369 bytes (369 B) copied, 0.000476083 s, 775 kB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-07-10 08:22:28,298::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-07-10 08:22:28,477::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0760329 s, 13.5 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-07-10 08:22:30,048::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/e01a3a36-d2ce-4153-bb57-d6e65b7ed08c/metadata bs=4096 count=1' (cwd None) >Thread-15::DEBUG::2014-07-10 08:22:30,117::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00644915 s, 635 kB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-07-10 08:22:30,493::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-07-10 08:22:30,634::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0383846 s, 26.7 MB/s\n'; <rc> = 0 >Thread-1042::DEBUG::2014-07-10 08:22:31,295::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [993c48c] >Thread-1042::DEBUG::2014-07-10 08:22:31,296::task::595::TaskManager.Task::(_updateState) Task=`abb1e252-1dad-4568-8cd3-712d6d6e9fe3`::moving from state init -> state preparing >Thread-1042::INFO::2014-07-10 08:22:31,297::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='411039e4-4af2-4192-9de0-67dc1ed83ba9', options=None) >Thread-1042::INFO::2014-07-10 08:22:31,297::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2}} >Thread-1042::DEBUG::2014-07-10 08:22:31,298::task::1185::TaskManager.Task::(prepare) Task=`abb1e252-1dad-4568-8cd3-712d6d6e9fe3`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2}} >Thread-1042::DEBUG::2014-07-10 08:22:31,298::task::595::TaskManager.Task::(_updateState) Task=`abb1e252-1dad-4568-8cd3-712d6d6e9fe3`::moving from state preparing -> state finished >Thread-1042::DEBUG::2014-07-10 08:22:31,298::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-1042::DEBUG::2014-07-10 08:22:31,298::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1042::DEBUG::2014-07-10 08:22:31,298::task::990::TaskManager.Task::(_decref) Task=`abb1e252-1dad-4568-8cd3-712d6d6e9fe3`::ref 0 aborting False >Thread-1043::DEBUG::2014-07-10 08:22:31,302::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [993c48c] >Thread-1043::DEBUG::2014-07-10 08:22:31,303::task::595::TaskManager.Task::(_updateState) Task=`3c547c5e-3d5d-4b74-b857-6672e08ed7dc`::moving from state init -> state preparing >Thread-1043::INFO::2014-07-10 08:22:31,303::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='411039e4-4af2-4192-9de0-67dc1ed83ba9', options=None) >Thread-1043::DEBUG::2014-07-10 08:22:31,304::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9`ReqID=`4808a49a-3000-41d9-8f44-3920349924bf`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo' >Thread-1043::DEBUG::2014-07-10 08:22:31,304::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' for lock type 'shared' >Thread-1043::DEBUG::2014-07-10 08:22:31,304::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' is free. Now locking as 'shared' (1 active user) >Thread-1043::DEBUG::2014-07-10 08:22:31,305::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9`ReqID=`4808a49a-3000-41d9-8f44-3920349924bf`::Granted request >Thread-1043::DEBUG::2014-07-10 08:22:31,305::task::827::TaskManager.Task::(resourceAcquired) Task=`3c547c5e-3d5d-4b74-b857-6672e08ed7dc`::_resourcesAcquired: Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9 (shared) >Thread-1043::DEBUG::2014-07-10 08:22:31,305::task::990::TaskManager.Task::(_decref) Task=`3c547c5e-3d5d-4b74-b857-6672e08ed7dc`::ref 1 aborting False >Thread-1043::INFO::2014-07-10 08:22:31,307::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DC-REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2, 'domains': u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': 'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c': {'status': u'Active', 'diskfree': '1137495244800', 'isoprefix': '', 'alerts': [], 'disktotal': '1152393412608', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532069482496', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-1043::DEBUG::2014-07-10 08:22:31,307::task::1185::TaskManager.Task::(prepare) Task=`3c547c5e-3d5d-4b74-b857-6672e08ed7dc`::finished: {'info': {'name': 'DC-REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2, 'domains': u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': 'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c': {'status': u'Active', 'diskfree': '1137495244800', 'isoprefix': '', 'alerts': [], 'disktotal': '1152393412608', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532069482496', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-1043::DEBUG::2014-07-10 08:22:31,307::task::595::TaskManager.Task::(_updateState) Task=`3c547c5e-3d5d-4b74-b857-6672e08ed7dc`::moving from state preparing -> state finished >Thread-1043::DEBUG::2014-07-10 08:22:31,307::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9': < ResourceRef 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9', isValid: 'True' obj: 'None'>} >Thread-1043::DEBUG::2014-07-10 08:22:31,307::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1043::DEBUG::2014-07-10 08:22:31,308::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' >Thread-1043::DEBUG::2014-07-10 08:22:31,308::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' (0 active users) >Thread-1043::DEBUG::2014-07-10 08:22:31,308::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' is free, finding out if anyone is waiting for it. >Thread-1043::DEBUG::2014-07-10 08:22:31,308::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9', Clearing records. >Thread-1043::DEBUG::2014-07-10 08:22:31,308::task::990::TaskManager.Task::(_decref) Task=`3c547c5e-3d5d-4b74-b857-6672e08ed7dc`::ref 0 aborting False >Dummy-36::DEBUG::2014-07-10 08:22:32,649::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-07-10 08:22:32,786::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0381177 s, 26.9 MB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-07-10 08:22:34,801::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-07-10 08:22:34,941::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0385735 s, 26.5 MB/s\n'; <rc> = 0 >Thread-1042::DEBUG::2014-07-10 08:22:35,025::task::595::TaskManager.Task::(_updateState) Task=`a3d66d18-05b6-4d72-ade9-e4d01ac0ac4b`::moving from state init -> state preparing >Thread-1042::INFO::2014-07-10 08:22:35,026::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-1042::INFO::2014-07-10 08:22:35,026::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00644915', 'lastCheck': '4.9', 'valid': True}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000476083', 'lastCheck': '7.5', 'valid': True}} >Thread-1042::DEBUG::2014-07-10 08:22:35,026::task::1185::TaskManager.Task::(prepare) Task=`a3d66d18-05b6-4d72-ade9-e4d01ac0ac4b`::finished: {u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00644915', 'lastCheck': '4.9', 'valid': True}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000476083', 'lastCheck': '7.5', 'valid': True}} >Thread-1042::DEBUG::2014-07-10 08:22:35,027::task::595::TaskManager.Task::(_updateState) Task=`a3d66d18-05b6-4d72-ade9-e4d01ac0ac4b`::moving from state preparing -> state finished >Thread-1042::DEBUG::2014-07-10 08:22:35,027::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-1042::DEBUG::2014-07-10 08:22:35,027::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1042::DEBUG::2014-07-10 08:22:35,027::task::990::TaskManager.Task::(_decref) Task=`a3d66d18-05b6-4d72-ade9-e4d01ac0ac4b`::ref 0 aborting False >Dummy-36::DEBUG::2014-07-10 08:22:36,956::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-07-10 08:22:37,089::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0353288 s, 29.0 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 08:22:37,547::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lion.qa.lab.tlv.redhat.com:_export_yuri2_backup2/6a70504d-00df-4869-8695-0f442053f6b6/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-14::DEBUG::2014-07-10 08:22:37,611::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n369 bytes (369 B) copied, 0.000408525 s, 903 kB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-07-10 08:22:39,104::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-07-10 08:22:39,236::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0327167 s, 31.3 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-07-10 08:22:40,147::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/e01a3a36-d2ce-4153-bb57-d6e65b7ed08c/metadata bs=4096 count=1' (cwd None) >Thread-15::DEBUG::2014-07-10 08:22:40,228::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.0171854 s, 238 kB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-07-10 08:22:41,251::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Thread-1042::DEBUG::2014-07-10 08:22:41,338::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-1042::DEBUG::2014-07-10 08:22:41,344::task::595::TaskManager.Task::(_updateState) Task=`d5033203-b737-421b-b6d8-a2f0d94d133b`::moving from state init -> state preparing >Thread-1042::INFO::2014-07-10 08:22:41,347::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='411039e4-4af2-4192-9de0-67dc1ed83ba9', options=None) >Thread-1042::INFO::2014-07-10 08:22:41,351::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2}} >Thread-1042::DEBUG::2014-07-10 08:22:41,353::task::1185::TaskManager.Task::(prepare) Task=`d5033203-b737-421b-b6d8-a2f0d94d133b`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2}} >Thread-1042::DEBUG::2014-07-10 08:22:41,355::task::595::TaskManager.Task::(_updateState) Task=`d5033203-b737-421b-b6d8-a2f0d94d133b`::moving from state preparing -> state finished >Thread-1042::DEBUG::2014-07-10 08:22:41,357::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-1042::DEBUG::2014-07-10 08:22:41,359::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1042::DEBUG::2014-07-10 08:22:41,362::task::990::TaskManager.Task::(_decref) Task=`d5033203-b737-421b-b6d8-a2f0d94d133b`::ref 0 aborting False >Thread-1043::DEBUG::2014-07-10 08:22:41,374::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-1043::DEBUG::2014-07-10 08:22:41,378::task::595::TaskManager.Task::(_updateState) Task=`7f59597b-b2ef-44b6-a25a-1fab85439d5c`::moving from state init -> state preparing >Thread-1043::INFO::2014-07-10 08:22:41,381::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='411039e4-4af2-4192-9de0-67dc1ed83ba9', options=None) >Thread-1043::DEBUG::2014-07-10 08:22:41,387::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9`ReqID=`7a51f083-a5f9-4c19-9a40-3b0e6b5e4f64`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo' >Thread-1043::DEBUG::2014-07-10 08:22:41,390::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' for lock type 'shared' >Thread-1043::DEBUG::2014-07-10 08:22:41,394::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' is free. Now locking as 'shared' (1 active user) >Thread-1043::DEBUG::2014-07-10 08:22:41,396::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9`ReqID=`7a51f083-a5f9-4c19-9a40-3b0e6b5e4f64`::Granted request >Thread-1043::DEBUG::2014-07-10 08:22:41,401::task::827::TaskManager.Task::(resourceAcquired) Task=`7f59597b-b2ef-44b6-a25a-1fab85439d5c`::_resourcesAcquired: Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9 (shared) >Thread-1043::DEBUG::2014-07-10 08:22:41,404::task::990::TaskManager.Task::(_decref) Task=`7f59597b-b2ef-44b6-a25a-1fab85439d5c`::ref 1 aborting False >Thread-1043::INFO::2014-07-10 08:22:41,415::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DC-REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2, 'domains': u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': 'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c': {'status': u'Active', 'diskfree': '1137495244800', 'isoprefix': '', 'alerts': [], 'disktotal': '1152393412608', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532069482496', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-1043::DEBUG::2014-07-10 08:22:41,417::task::1185::TaskManager.Task::(prepare) Task=`7f59597b-b2ef-44b6-a25a-1fab85439d5c`::finished: {'info': {'name': 'DC-REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2, 'domains': u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': 'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c': {'status': u'Active', 'diskfree': '1137495244800', 'isoprefix': '', 'alerts': [], 'disktotal': '1152393412608', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532069482496', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-1043::DEBUG::2014-07-10 08:22:41,419::task::595::TaskManager.Task::(_updateState) Task=`7f59597b-b2ef-44b6-a25a-1fab85439d5c`::moving from state preparing -> state finished >Thread-1043::DEBUG::2014-07-10 08:22:41,421::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9': < ResourceRef 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9', isValid: 'True' obj: 'None'>} >Thread-1043::DEBUG::2014-07-10 08:22:41,423::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1043::DEBUG::2014-07-10 08:22:41,427::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' >Thread-1043::DEBUG::2014-07-10 08:22:41,430::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' (0 active users) >Thread-1043::DEBUG::2014-07-10 08:22:41,431::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' is free, finding out if anyone is waiting for it. >Thread-1043::DEBUG::2014-07-10 08:22:41,433::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9', Clearing records. >Thread-1043::DEBUG::2014-07-10 08:22:41,437::task::990::TaskManager.Task::(_decref) Task=`7f59597b-b2ef-44b6-a25a-1fab85439d5c`::ref 0 aborting False >Dummy-36::DEBUG::2014-07-10 08:22:41,514::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.15898 s, 6.4 MB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-07-10 08:22:43,529::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-07-10 08:22:43,831::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.203593 s, 5.0 MB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-07-10 08:22:45,846::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-07-10 08:22:45,997::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0500013 s, 20.5 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 08:22:47,641::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lion.qa.lab.tlv.redhat.com:_export_yuri2_backup2/6a70504d-00df-4869-8695-0f442053f6b6/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-14::DEBUG::2014-07-10 08:22:47,705::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n369 bytes (369 B) copied, 0.00058028 s, 636 kB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-07-10 08:22:48,012::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-07-10 08:22:48,165::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0484115 s, 21.2 MB/s\n'; <rc> = 0 >Thread-1042::DEBUG::2014-07-10 08:22:50,170::task::595::TaskManager.Task::(_updateState) Task=`9af8ac9b-5e03-4d8f-ba2e-3c93b827b9c0`::moving from state init -> state preparing >Thread-1042::INFO::2014-07-10 08:22:50,171::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-1042::INFO::2014-07-10 08:22:50,171::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0171854', 'lastCheck': '9.9', 'valid': True}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00058028', 'lastCheck': '2.5', 'valid': True}} >Thread-1042::DEBUG::2014-07-10 08:22:50,171::task::1185::TaskManager.Task::(prepare) Task=`9af8ac9b-5e03-4d8f-ba2e-3c93b827b9c0`::finished: {u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0171854', 'lastCheck': '9.9', 'valid': True}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00058028', 'lastCheck': '2.5', 'valid': True}} >Thread-1042::DEBUG::2014-07-10 08:22:50,172::task::595::TaskManager.Task::(_updateState) Task=`9af8ac9b-5e03-4d8f-ba2e-3c93b827b9c0`::moving from state preparing -> state finished >Thread-1042::DEBUG::2014-07-10 08:22:50,172::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-1042::DEBUG::2014-07-10 08:22:50,172::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1042::DEBUG::2014-07-10 08:22:50,172::task::990::TaskManager.Task::(_decref) Task=`9af8ac9b-5e03-4d8f-ba2e-3c93b827b9c0`::ref 0 aborting False >Dummy-36::DEBUG::2014-07-10 08:22:50,184::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Thread-15::DEBUG::2014-07-10 08:22:50,273::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/e01a3a36-d2ce-4153-bb57-d6e65b7ed08c/metadata bs=4096 count=1' (cwd None) >Thread-15::DEBUG::2014-07-10 08:22:50,455::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00949213 s, 432 kB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-07-10 08:22:50,882::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.593019 s, 1.7 MB/s\n'; <rc> = 0 >Thread-1042::DEBUG::2014-07-10 08:22:51,486::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-1042::DEBUG::2014-07-10 08:22:51,487::task::595::TaskManager.Task::(_updateState) Task=`a392e775-d030-46c7-9066-a0526a055e35`::moving from state init -> state preparing >Thread-1042::INFO::2014-07-10 08:22:51,487::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='411039e4-4af2-4192-9de0-67dc1ed83ba9', options=None) >Thread-1042::INFO::2014-07-10 08:22:51,488::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2}} >Thread-1042::DEBUG::2014-07-10 08:22:51,488::task::1185::TaskManager.Task::(prepare) Task=`a392e775-d030-46c7-9066-a0526a055e35`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2}} >Thread-1042::DEBUG::2014-07-10 08:22:51,488::task::595::TaskManager.Task::(_updateState) Task=`a392e775-d030-46c7-9066-a0526a055e35`::moving from state preparing -> state finished >Thread-1042::DEBUG::2014-07-10 08:22:51,488::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-1042::DEBUG::2014-07-10 08:22:51,488::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1042::DEBUG::2014-07-10 08:22:51,489::task::990::TaskManager.Task::(_decref) Task=`a392e775-d030-46c7-9066-a0526a055e35`::ref 0 aborting False >Thread-1043::DEBUG::2014-07-10 08:22:51,492::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-1043::DEBUG::2014-07-10 08:22:51,492::task::595::TaskManager.Task::(_updateState) Task=`2856e68c-f96a-4ab4-a9fc-458890e3cf35`::moving from state init -> state preparing >Thread-1043::INFO::2014-07-10 08:22:51,493::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='411039e4-4af2-4192-9de0-67dc1ed83ba9', options=None) >Thread-1043::DEBUG::2014-07-10 08:22:51,493::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9`ReqID=`6c4ea1e0-8a14-486d-a740-3092652efc7d`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo' >Thread-1043::DEBUG::2014-07-10 08:22:51,493::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' for lock type 'shared' >Thread-1043::DEBUG::2014-07-10 08:22:51,494::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' is free. Now locking as 'shared' (1 active user) >Thread-1043::DEBUG::2014-07-10 08:22:51,494::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9`ReqID=`6c4ea1e0-8a14-486d-a740-3092652efc7d`::Granted request >Thread-1043::DEBUG::2014-07-10 08:22:51,494::task::827::TaskManager.Task::(resourceAcquired) Task=`2856e68c-f96a-4ab4-a9fc-458890e3cf35`::_resourcesAcquired: Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9 (shared) >Thread-1043::DEBUG::2014-07-10 08:22:51,494::task::990::TaskManager.Task::(_decref) Task=`2856e68c-f96a-4ab4-a9fc-458890e3cf35`::ref 1 aborting False >Thread-1043::INFO::2014-07-10 08:22:51,495::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DC-REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2, 'domains': u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': 'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c': {'status': u'Active', 'diskfree': '1137495244800', 'isoprefix': '', 'alerts': [], 'disktotal': '1152393412608', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532069482496', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-1043::DEBUG::2014-07-10 08:22:51,495::task::1185::TaskManager.Task::(prepare) Task=`2856e68c-f96a-4ab4-a9fc-458890e3cf35`::finished: {'info': {'name': 'DC-REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2, 'domains': u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': 'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c': {'status': u'Active', 'diskfree': '1137495244800', 'isoprefix': '', 'alerts': [], 'disktotal': '1152393412608', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532069482496', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-1043::DEBUG::2014-07-10 08:22:51,496::task::595::TaskManager.Task::(_updateState) Task=`2856e68c-f96a-4ab4-a9fc-458890e3cf35`::moving from state preparing -> state finished >Thread-1043::DEBUG::2014-07-10 08:22:51,496::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9': < ResourceRef 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9', isValid: 'True' obj: 'None'>} >Thread-1043::DEBUG::2014-07-10 08:22:51,496::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1043::DEBUG::2014-07-10 08:22:51,496::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' >Thread-1043::DEBUG::2014-07-10 08:22:51,496::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' (0 active users) >Thread-1043::DEBUG::2014-07-10 08:22:51,497::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' is free, finding out if anyone is waiting for it. >Thread-1043::DEBUG::2014-07-10 08:22:51,497::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9', Clearing records. >Thread-1043::DEBUG::2014-07-10 08:22:51,497::task::990::TaskManager.Task::(_decref) Task=`2856e68c-f96a-4ab4-a9fc-458890e3cf35`::ref 0 aborting False >Dummy-36::DEBUG::2014-07-10 08:22:52,897::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-07-10 08:22:53,134::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.13386 s, 7.6 MB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-07-10 08:22:55,149::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-07-10 08:22:55,288::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.037952 s, 27.0 MB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-07-10 08:22:57,303::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-07-10 08:22:57,449::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0466435 s, 22.0 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 08:22:57,736::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lion.qa.lab.tlv.redhat.com:_export_yuri2_backup2/6a70504d-00df-4869-8695-0f442053f6b6/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-14::DEBUG::2014-07-10 08:22:57,800::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n369 bytes (369 B) copied, 0.000509008 s, 725 kB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-07-10 08:22:59,465::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-07-10 08:22:59,642::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0642387 s, 15.9 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-07-10 08:23:00,828::domainMonitor::192::Storage.DomainMonitorThread::(_monitorDomain) Refreshing domain e01a3a36-d2ce-4153-bb57-d6e65b7ed08c >Thread-15::ERROR::2014-07-10 08:23:00,829::sdc::137::Storage.StorageDomainCache::(_findDomain) looking for unfetched domain e01a3a36-d2ce-4153-bb57-d6e65b7ed08c >Thread-15::ERROR::2014-07-10 08:23:00,829::sdc::154::Storage.StorageDomainCache::(_findUnfetchedDomain) looking for domain e01a3a36-d2ce-4153-bb57-d6e65b7ed08c >Thread-15::DEBUG::2014-07-10 08:23:00,829::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with LvMetadataRW backend >Thread-15::DEBUG::2014-07-10 08:23:00,830::blockSD::336::Storage.Misc.excCmd::(readlines) '/bin/dd iflag=direct skip=0 bs=2048 if=/dev/e01a3a36-d2ce-4153-bb57-d6e65b7ed08c/metadata count=1' (cwd None) >Thread-15::DEBUG::2014-07-10 08:23:00,898::blockSD::336::Storage.Misc.excCmd::(readlines) SUCCESS: <err> = '1+0 records in\n1+0 records out\n2048 bytes (2.0 kB) copied, 0.00651705 s, 314 kB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-07-10 08:23:00,899::misc::282::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '2048 bytes (2.0 kB) copied, 0.00651705 s, 314 kB/s'], size: 2048 >Thread-15::DEBUG::2014-07-10 08:23:00,899::persistentDict::234::Storage.PersistentDict::(refresh) read lines (LvMetadataRW)=[] >Thread-15::WARNING::2014-07-10 08:23:00,899::persistentDict::256::Storage.PersistentDict::(refresh) data has no embedded checksum - trust it as it is >Thread-15::DEBUG::2014-07-10 08:23:00,900::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with VGTagMetadataRW backend >Thread-15::DEBUG::2014-07-10 08:23:00,900::lvm::503::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-15::DEBUG::2014-07-10 08:23:00,900::lvm::505::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-15::DEBUG::2014-07-10 08:23:00,901::lvm::513::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-15::DEBUG::2014-07-10 08:23:00,901::lvm::525::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-15::DEBUG::2014-07-10 08:23:00,901::lvm::373::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-15::DEBUG::2014-07-10 08:23:00,902::lvm::296::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/3600601601282300032826addbbdae311|/dev/mapper/360060160f4a030003840ec867ddee311|/dev/mapper/367cad74c2fcba00019e6afd20c781e67|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name e01a3a36-d2ce-4153-bb57-d6e65b7ed08c' (cwd None) >Thread-15::DEBUG::2014-07-10 08:23:01,224::lvm::296::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-15::DEBUG::2014-07-10 08:23:01,226::lvm::415::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-15::DEBUG::2014-07-10 08:23:01,227::persistentDict::234::Storage.PersistentDict::(refresh) read lines (VGTagMetadataRW)=['LEASETIMESEC=60', 'CLASS=Data', 'VERSION=3', u'PV1=pv:360060160f4a030003840ec867ddee311,uuid:0eUwla-dsA3-g6ia-RU23-cual-0rt9-KzkxLj,pestart:0,pecount:397,mapoffset:8189', u'PV0=pv:3600601601282300032826addbbdae311,uuid:ZdReOp-Yf8A-beQm-ne4I-pN3J-rxgm-9Ew0S1,pestart:0,pecount:8189,mapoffset:0', 'LOGBLKSIZE=512', 'LEASERETRIES=3', 'IOOPTIMEOUTSEC=10', 'LOCKRENEWALINTERVALSEC=5', 'PHYBLKSIZE=512', 'SDUUID=e01a3a36-d2ce-4153-bb57-d6e65b7ed08c', 'DESCRIPTION=SD-REAL', 'LOCKPOLICY=', 'VGUUID=GJcVo5-Y0kU-CDub-zITS-zfoL-Z7hz-SeVeIe', 'TYPE=ISCSI', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=DC-REAL', 'ROLE=Master', 'POOL_UUID=411039e4-4af2-4192-9de0-67dc1ed83ba9', 'POOL_SPM_ID=1', u'POOL_DOMAINS=6a70504d-00df-4869-8695-0f442053f6b6:Active,e01a3a36-d2ce-4153-bb57-d6e65b7ed08c:Active', '_SHA_CKSUM=cefcf6543a5de3bd5b35901e3ca494c6a6185b63', 'POOL_SPM_LVER=2'] >Thread-15::INFO::2014-07-10 08:23:01,228::sd::384::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace e01a3a36-d2ce-4153-bb57-d6e65b7ed08c_imageNS already registered >Thread-15::INFO::2014-07-10 08:23:01,228::sd::392::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace e01a3a36-d2ce-4153-bb57-d6e65b7ed08c_volumeNS already registered >Thread-15::INFO::2014-07-10 08:23:01,229::blockSD::452::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace e01a3a36-d2ce-4153-bb57-d6e65b7ed08c_lvmActivationNS already registered >Thread-15::DEBUG::2014-07-10 08:23:01,229::lvm::296::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgck --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/3600601601282300032826addbbdae311|/dev/mapper/360060160f4a030003840ec867ddee311|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } " e01a3a36-d2ce-4153-bb57-d6e65b7ed08c' (cwd None) >Thread-15::DEBUG::2014-07-10 08:23:01,470::lvm::296::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-15::DEBUG::2014-07-10 08:23:01,471::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/e01a3a36-d2ce-4153-bb57-d6e65b7ed08c/metadata bs=4096 count=1' (cwd None) >Thread-1042::DEBUG::2014-07-10 08:23:01,533::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-1042::DEBUG::2014-07-10 08:23:01,539::task::595::TaskManager.Task::(_updateState) Task=`5a078655-ce56-49ba-93d3-7fb9fe505f83`::moving from state init -> state preparing >Thread-1042::INFO::2014-07-10 08:23:01,543::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='411039e4-4af2-4192-9de0-67dc1ed83ba9', options=None) >Thread-1042::INFO::2014-07-10 08:23:01,548::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2}} >Thread-1042::DEBUG::2014-07-10 08:23:01,549::task::1185::TaskManager.Task::(prepare) Task=`5a078655-ce56-49ba-93d3-7fb9fe505f83`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2}} >Thread-1042::DEBUG::2014-07-10 08:23:01,552::task::595::TaskManager.Task::(_updateState) Task=`5a078655-ce56-49ba-93d3-7fb9fe505f83`::moving from state preparing -> state finished >Thread-1042::DEBUG::2014-07-10 08:23:01,554::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-1042::DEBUG::2014-07-10 08:23:01,556::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1042::DEBUG::2014-07-10 08:23:01,559::task::990::TaskManager.Task::(_decref) Task=`5a078655-ce56-49ba-93d3-7fb9fe505f83`::ref 0 aborting False >Thread-15::DEBUG::2014-07-10 08:23:01,568::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00090986 s, 4.5 MB/s\n'; <rc> = 0 >Thread-1043::DEBUG::2014-07-10 08:23:01,573::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-1043::DEBUG::2014-07-10 08:23:01,575::task::595::TaskManager.Task::(_updateState) Task=`7ab66075-855f-4ad0-b4e4-4248788d4b0a`::moving from state init -> state preparing >Thread-1043::INFO::2014-07-10 08:23:01,577::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='411039e4-4af2-4192-9de0-67dc1ed83ba9', options=None) >Thread-1043::DEBUG::2014-07-10 08:23:01,583::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9`ReqID=`d8182a06-fb5a-4088-b53c-da21e2c64415`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo' >Thread-1043::DEBUG::2014-07-10 08:23:01,586::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' for lock type 'shared' >Thread-1043::DEBUG::2014-07-10 08:23:01,589::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' is free. Now locking as 'shared' (1 active user) >Thread-1043::DEBUG::2014-07-10 08:23:01,592::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9`ReqID=`d8182a06-fb5a-4088-b53c-da21e2c64415`::Granted request >Thread-1043::DEBUG::2014-07-10 08:23:01,598::task::827::TaskManager.Task::(resourceAcquired) Task=`7ab66075-855f-4ad0-b4e4-4248788d4b0a`::_resourcesAcquired: Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9 (shared) >Thread-1043::DEBUG::2014-07-10 08:23:01,600::task::990::TaskManager.Task::(_decref) Task=`7ab66075-855f-4ad0-b4e4-4248788d4b0a`::ref 1 aborting False >Thread-1043::INFO::2014-07-10 08:23:01,611::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DC-REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2, 'domains': u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': 'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c': {'status': u'Active', 'diskfree': '1137495244800', 'isoprefix': '', 'alerts': [], 'disktotal': '1152393412608', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532069482496', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-1043::DEBUG::2014-07-10 08:23:01,613::task::1185::TaskManager.Task::(prepare) Task=`7ab66075-855f-4ad0-b4e4-4248788d4b0a`::finished: {'info': {'name': 'DC-REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2, 'domains': u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': 'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c': {'status': u'Active', 'diskfree': '1137495244800', 'isoprefix': '', 'alerts': [], 'disktotal': '1152393412608', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532069482496', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-1043::DEBUG::2014-07-10 08:23:01,615::task::595::TaskManager.Task::(_updateState) Task=`7ab66075-855f-4ad0-b4e4-4248788d4b0a`::moving from state preparing -> state finished >Thread-1043::DEBUG::2014-07-10 08:23:01,618::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9': < ResourceRef 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9', isValid: 'True' obj: 'None'>} >Thread-1043::DEBUG::2014-07-10 08:23:01,620::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1043::DEBUG::2014-07-10 08:23:01,623::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' >Thread-1043::DEBUG::2014-07-10 08:23:01,626::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' (0 active users) >Thread-1043::DEBUG::2014-07-10 08:23:01,628::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' is free, finding out if anyone is waiting for it. >Thread-1043::DEBUG::2014-07-10 08:23:01,630::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9', Clearing records. >Thread-1043::DEBUG::2014-07-10 08:23:01,633::task::990::TaskManager.Task::(_decref) Task=`7ab66075-855f-4ad0-b4e4-4248788d4b0a`::ref 0 aborting False >Dummy-36::DEBUG::2014-07-10 08:23:01,661::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-07-10 08:23:01,830::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0627211 s, 16.3 MB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-07-10 08:23:03,845::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-07-10 08:23:04,023::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0788575 s, 13.0 MB/s\n'; <rc> = 0 >Thread-1042::DEBUG::2014-07-10 08:23:05,661::task::595::TaskManager.Task::(_updateState) Task=`ad6f3cbb-1623-4e3c-bb19-1a908ca7ba2e`::moving from state init -> state preparing >Thread-1042::INFO::2014-07-10 08:23:05,662::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-1042::INFO::2014-07-10 08:23:05,662::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00090986', 'lastCheck': '3.9', 'valid': True}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000509008', 'lastCheck': '7.9', 'valid': True}} >Thread-1042::DEBUG::2014-07-10 08:23:05,663::task::1185::TaskManager.Task::(prepare) Task=`ad6f3cbb-1623-4e3c-bb19-1a908ca7ba2e`::finished: {u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00090986', 'lastCheck': '3.9', 'valid': True}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000509008', 'lastCheck': '7.9', 'valid': True}} >Thread-1042::DEBUG::2014-07-10 08:23:05,663::task::595::TaskManager.Task::(_updateState) Task=`ad6f3cbb-1623-4e3c-bb19-1a908ca7ba2e`::moving from state preparing -> state finished >Thread-1042::DEBUG::2014-07-10 08:23:05,663::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-1042::DEBUG::2014-07-10 08:23:05,663::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1042::DEBUG::2014-07-10 08:23:05,663::task::990::TaskManager.Task::(_decref) Task=`ad6f3cbb-1623-4e3c-bb19-1a908ca7ba2e`::ref 0 aborting False >Dummy-36::DEBUG::2014-07-10 08:23:06,038::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-07-10 08:23:06,194::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.056305 s, 18.2 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 08:23:07,832::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lion.qa.lab.tlv.redhat.com:_export_yuri2_backup2/6a70504d-00df-4869-8695-0f442053f6b6/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-14::DEBUG::2014-07-10 08:23:07,895::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n369 bytes (369 B) copied, 0.000562853 s, 656 kB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-07-10 08:23:08,209::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-07-10 08:23:08,353::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0390249 s, 26.2 MB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-07-10 08:23:10,368::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-07-10 08:23:10,508::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0383815 s, 26.7 MB/s\n'; <rc> = 0 >Thread-1042::DEBUG::2014-07-10 08:23:11,679::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-1042::DEBUG::2014-07-10 08:23:11,680::task::595::TaskManager.Task::(_updateState) Task=`8fe2fd9c-6774-493d-a942-3327a57ee6cb`::moving from state init -> state preparing >Thread-1042::INFO::2014-07-10 08:23:11,681::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='411039e4-4af2-4192-9de0-67dc1ed83ba9', options=None) >Thread-1042::INFO::2014-07-10 08:23:11,681::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2}} >Thread-1042::DEBUG::2014-07-10 08:23:11,682::task::1185::TaskManager.Task::(prepare) Task=`8fe2fd9c-6774-493d-a942-3327a57ee6cb`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2}} >Thread-1042::DEBUG::2014-07-10 08:23:11,682::task::595::TaskManager.Task::(_updateState) Task=`8fe2fd9c-6774-493d-a942-3327a57ee6cb`::moving from state preparing -> state finished >Thread-1042::DEBUG::2014-07-10 08:23:11,682::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-1042::DEBUG::2014-07-10 08:23:11,682::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1042::DEBUG::2014-07-10 08:23:11,682::task::990::TaskManager.Task::(_decref) Task=`8fe2fd9c-6774-493d-a942-3327a57ee6cb`::ref 0 aborting False >Thread-1043::DEBUG::2014-07-10 08:23:11,686::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-1043::DEBUG::2014-07-10 08:23:11,687::task::595::TaskManager.Task::(_updateState) Task=`5be8b73f-d08b-4a33-a769-afb943f2afca`::moving from state init -> state preparing >Thread-1043::INFO::2014-07-10 08:23:11,687::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='411039e4-4af2-4192-9de0-67dc1ed83ba9', options=None) >Thread-1043::DEBUG::2014-07-10 08:23:11,688::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9`ReqID=`fcac8649-a2ef-4403-82f7-3cff988ee0fd`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo' >Thread-1043::DEBUG::2014-07-10 08:23:11,688::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' for lock type 'shared' >Thread-1043::DEBUG::2014-07-10 08:23:11,688::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' is free. Now locking as 'shared' (1 active user) >Thread-1043::DEBUG::2014-07-10 08:23:11,689::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9`ReqID=`fcac8649-a2ef-4403-82f7-3cff988ee0fd`::Granted request >Thread-1043::DEBUG::2014-07-10 08:23:11,689::task::827::TaskManager.Task::(resourceAcquired) Task=`5be8b73f-d08b-4a33-a769-afb943f2afca`::_resourcesAcquired: Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9 (shared) >Thread-1043::DEBUG::2014-07-10 08:23:11,689::task::990::TaskManager.Task::(_decref) Task=`5be8b73f-d08b-4a33-a769-afb943f2afca`::ref 1 aborting False >Thread-1043::INFO::2014-07-10 08:23:11,691::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DC-REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2, 'domains': u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': 'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c': {'status': u'Active', 'diskfree': '1137495244800', 'isoprefix': '', 'alerts': [], 'disktotal': '1152393412608', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532069482496', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-1043::DEBUG::2014-07-10 08:23:11,691::task::1185::TaskManager.Task::(prepare) Task=`5be8b73f-d08b-4a33-a769-afb943f2afca`::finished: {'info': {'name': 'DC-REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2, 'domains': u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': 'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c': {'status': u'Active', 'diskfree': '1137495244800', 'isoprefix': '', 'alerts': [], 'disktotal': '1152393412608', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532069482496', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-1043::DEBUG::2014-07-10 08:23:11,691::task::595::TaskManager.Task::(_updateState) Task=`5be8b73f-d08b-4a33-a769-afb943f2afca`::moving from state preparing -> state finished >Thread-1043::DEBUG::2014-07-10 08:23:11,691::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9': < ResourceRef 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9', isValid: 'True' obj: 'None'>} >Thread-1043::DEBUG::2014-07-10 08:23:11,691::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1043::DEBUG::2014-07-10 08:23:11,692::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' >Thread-1043::DEBUG::2014-07-10 08:23:11,692::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' (0 active users) >Thread-1043::DEBUG::2014-07-10 08:23:11,692::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' is free, finding out if anyone is waiting for it. >Thread-1043::DEBUG::2014-07-10 08:23:11,692::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9', Clearing records. >Thread-1043::DEBUG::2014-07-10 08:23:11,693::task::990::TaskManager.Task::(_decref) Task=`5be8b73f-d08b-4a33-a769-afb943f2afca`::ref 0 aborting False >Thread-15::DEBUG::2014-07-10 08:23:11,742::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/e01a3a36-d2ce-4153-bb57-d6e65b7ed08c/metadata bs=4096 count=1' (cwd None) >Thread-15::DEBUG::2014-07-10 08:23:11,841::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.0347186 s, 118 kB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-07-10 08:23:12,523::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-07-10 08:23:12,657::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0332349 s, 30.8 MB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-07-10 08:23:14,672::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-07-10 08:23:14,811::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0384979 s, 26.6 MB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-07-10 08:23:16,838::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-07-10 08:23:16,984::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0473509 s, 21.6 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 08:23:17,925::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lion.qa.lab.tlv.redhat.com:_export_yuri2_backup2/6a70504d-00df-4869-8695-0f442053f6b6/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-14::DEBUG::2014-07-10 08:23:17,988::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n369 bytes (369 B) copied, 0.000447526 s, 825 kB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-07-10 08:23:19,000::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-07-10 08:23:19,140::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0382241 s, 26.8 MB/s\n'; <rc> = 0 >Thread-1042::DEBUG::2014-07-10 08:23:20,843::task::595::TaskManager.Task::(_updateState) Task=`6ca77d58-c9b9-4b82-805a-2530f65ca5cd`::moving from state init -> state preparing >Thread-1042::INFO::2014-07-10 08:23:20,844::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-1042::INFO::2014-07-10 08:23:20,845::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0347186', 'lastCheck': '9.0', 'valid': True}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000447526', 'lastCheck': '2.9', 'valid': True}} >Thread-1042::DEBUG::2014-07-10 08:23:20,845::task::1185::TaskManager.Task::(prepare) Task=`6ca77d58-c9b9-4b82-805a-2530f65ca5cd`::finished: {u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0347186', 'lastCheck': '9.0', 'valid': True}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000447526', 'lastCheck': '2.9', 'valid': True}} >Thread-1042::DEBUG::2014-07-10 08:23:20,845::task::595::TaskManager.Task::(_updateState) Task=`6ca77d58-c9b9-4b82-805a-2530f65ca5cd`::moving from state preparing -> state finished >Thread-1042::DEBUG::2014-07-10 08:23:20,845::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-1042::DEBUG::2014-07-10 08:23:20,845::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1042::DEBUG::2014-07-10 08:23:20,846::task::990::TaskManager.Task::(_decref) Task=`6ca77d58-c9b9-4b82-805a-2530f65ca5cd`::ref 0 aborting False >Dummy-36::DEBUG::2014-07-10 08:23:21,155::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-07-10 08:23:21,313::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.058005 s, 17.7 MB/s\n'; <rc> = 0 >Thread-1042::DEBUG::2014-07-10 08:23:21,726::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-1042::DEBUG::2014-07-10 08:23:21,726::task::595::TaskManager.Task::(_updateState) Task=`198ca66e-cb92-4d43-8ea5-696b802fe5fe`::moving from state init -> state preparing >Thread-1042::INFO::2014-07-10 08:23:21,727::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='411039e4-4af2-4192-9de0-67dc1ed83ba9', options=None) >Thread-1042::INFO::2014-07-10 08:23:21,727::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2}} >Thread-1042::DEBUG::2014-07-10 08:23:21,727::task::1185::TaskManager.Task::(prepare) Task=`198ca66e-cb92-4d43-8ea5-696b802fe5fe`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2}} >Thread-1042::DEBUG::2014-07-10 08:23:21,728::task::595::TaskManager.Task::(_updateState) Task=`198ca66e-cb92-4d43-8ea5-696b802fe5fe`::moving from state preparing -> state finished >Thread-1042::DEBUG::2014-07-10 08:23:21,728::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-1042::DEBUG::2014-07-10 08:23:21,728::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1042::DEBUG::2014-07-10 08:23:21,728::task::990::TaskManager.Task::(_decref) Task=`198ca66e-cb92-4d43-8ea5-696b802fe5fe`::ref 0 aborting False >Thread-1043::DEBUG::2014-07-10 08:23:21,732::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-1043::DEBUG::2014-07-10 08:23:21,733::task::595::TaskManager.Task::(_updateState) Task=`baf47834-e33f-4dcd-b4af-84f1a2f67253`::moving from state init -> state preparing >Thread-1043::INFO::2014-07-10 08:23:21,733::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='411039e4-4af2-4192-9de0-67dc1ed83ba9', options=None) >Thread-1043::DEBUG::2014-07-10 08:23:21,733::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9`ReqID=`578c3248-11a4-4921-bb6b-ff67f7f9efa4`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo' >Thread-1043::DEBUG::2014-07-10 08:23:21,734::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' for lock type 'shared' >Thread-1043::DEBUG::2014-07-10 08:23:21,734::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' is free. Now locking as 'shared' (1 active user) >Thread-1043::DEBUG::2014-07-10 08:23:21,734::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9`ReqID=`578c3248-11a4-4921-bb6b-ff67f7f9efa4`::Granted request >Thread-1043::DEBUG::2014-07-10 08:23:21,735::task::827::TaskManager.Task::(resourceAcquired) Task=`baf47834-e33f-4dcd-b4af-84f1a2f67253`::_resourcesAcquired: Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9 (shared) >Thread-1043::DEBUG::2014-07-10 08:23:21,735::task::990::TaskManager.Task::(_decref) Task=`baf47834-e33f-4dcd-b4af-84f1a2f67253`::ref 1 aborting False >Thread-1043::INFO::2014-07-10 08:23:21,736::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DC-REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2, 'domains': u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': 'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c': {'status': u'Active', 'diskfree': '1137495244800', 'isoprefix': '', 'alerts': [], 'disktotal': '1152393412608', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532069482496', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-1043::DEBUG::2014-07-10 08:23:21,736::task::1185::TaskManager.Task::(prepare) Task=`baf47834-e33f-4dcd-b4af-84f1a2f67253`::finished: {'info': {'name': 'DC-REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2, 'domains': u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': 'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c': {'status': u'Active', 'diskfree': '1137495244800', 'isoprefix': '', 'alerts': [], 'disktotal': '1152393412608', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532069482496', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-1043::DEBUG::2014-07-10 08:23:21,736::task::595::TaskManager.Task::(_updateState) Task=`baf47834-e33f-4dcd-b4af-84f1a2f67253`::moving from state preparing -> state finished >Thread-1043::DEBUG::2014-07-10 08:23:21,737::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9': < ResourceRef 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9', isValid: 'True' obj: 'None'>} >Thread-1043::DEBUG::2014-07-10 08:23:21,737::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1043::DEBUG::2014-07-10 08:23:21,737::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' >Thread-1043::DEBUG::2014-07-10 08:23:21,737::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' (0 active users) >Thread-1043::DEBUG::2014-07-10 08:23:21,738::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' is free, finding out if anyone is waiting for it. >Thread-1043::DEBUG::2014-07-10 08:23:21,738::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9', Clearing records. >Thread-1043::DEBUG::2014-07-10 08:23:21,738::task::990::TaskManager.Task::(_decref) Task=`baf47834-e33f-4dcd-b4af-84f1a2f67253`::ref 0 aborting False >Thread-15::DEBUG::2014-07-10 08:23:21,874::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/e01a3a36-d2ce-4153-bb57-d6e65b7ed08c/metadata bs=4096 count=1' (cwd None) >Thread-15::DEBUG::2014-07-10 08:23:21,943::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00451393 s, 907 kB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-07-10 08:23:23,328::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-07-10 08:23:23,466::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0357192 s, 28.7 MB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-07-10 08:23:25,482::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-07-10 08:23:25,621::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0380552 s, 26.9 MB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-07-10 08:23:27,635::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-07-10 08:23:27,767::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.032887 s, 31.1 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 08:23:28,019::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lion.qa.lab.tlv.redhat.com:_export_yuri2_backup2/6a70504d-00df-4869-8695-0f442053f6b6/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-14::DEBUG::2014-07-10 08:23:28,082::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n369 bytes (369 B) copied, 0.000459644 s, 803 kB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-07-10 08:23:29,782::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-07-10 08:23:29,961::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0426655 s, 24.0 MB/s\n'; <rc> = 0 >Thread-1042::DEBUG::2014-07-10 08:23:31,761::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-1042::DEBUG::2014-07-10 08:23:31,762::task::595::TaskManager.Task::(_updateState) Task=`e128176d-3d38-4a97-9ec3-94384197745f`::moving from state init -> state preparing >Thread-1042::INFO::2014-07-10 08:23:31,763::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='411039e4-4af2-4192-9de0-67dc1ed83ba9', options=None) >Thread-1042::INFO::2014-07-10 08:23:31,763::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2}} >Thread-1042::DEBUG::2014-07-10 08:23:31,763::task::1185::TaskManager.Task::(prepare) Task=`e128176d-3d38-4a97-9ec3-94384197745f`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2}} >Thread-1042::DEBUG::2014-07-10 08:23:31,764::task::595::TaskManager.Task::(_updateState) Task=`e128176d-3d38-4a97-9ec3-94384197745f`::moving from state preparing -> state finished >Thread-1042::DEBUG::2014-07-10 08:23:31,764::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-1042::DEBUG::2014-07-10 08:23:31,764::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1042::DEBUG::2014-07-10 08:23:31,764::task::990::TaskManager.Task::(_decref) Task=`e128176d-3d38-4a97-9ec3-94384197745f`::ref 0 aborting False >Thread-1043::DEBUG::2014-07-10 08:23:31,768::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-1043::DEBUG::2014-07-10 08:23:31,768::task::595::TaskManager.Task::(_updateState) Task=`bd2e5fbc-3aeb-4150-aa47-6a32fa9343e7`::moving from state init -> state preparing >Thread-1043::INFO::2014-07-10 08:23:31,769::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='411039e4-4af2-4192-9de0-67dc1ed83ba9', options=None) >Thread-1043::DEBUG::2014-07-10 08:23:31,769::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9`ReqID=`fd985a79-b75c-4e00-ab6c-35648b480bf1`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo' >Thread-1043::DEBUG::2014-07-10 08:23:31,770::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' for lock type 'shared' >Thread-1043::DEBUG::2014-07-10 08:23:31,770::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' is free. Now locking as 'shared' (1 active user) >Thread-1043::DEBUG::2014-07-10 08:23:31,770::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9`ReqID=`fd985a79-b75c-4e00-ab6c-35648b480bf1`::Granted request >Thread-1043::DEBUG::2014-07-10 08:23:31,771::task::827::TaskManager.Task::(resourceAcquired) Task=`bd2e5fbc-3aeb-4150-aa47-6a32fa9343e7`::_resourcesAcquired: Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9 (shared) >Thread-1043::DEBUG::2014-07-10 08:23:31,771::task::990::TaskManager.Task::(_decref) Task=`bd2e5fbc-3aeb-4150-aa47-6a32fa9343e7`::ref 1 aborting False >Thread-1043::INFO::2014-07-10 08:23:31,772::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DC-REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2, 'domains': u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': 'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c': {'status': u'Active', 'diskfree': '1137495244800', 'isoprefix': '', 'alerts': [], 'disktotal': '1152393412608', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532069482496', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-1043::DEBUG::2014-07-10 08:23:31,772::task::1185::TaskManager.Task::(prepare) Task=`bd2e5fbc-3aeb-4150-aa47-6a32fa9343e7`::finished: {'info': {'name': 'DC-REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2, 'domains': u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': 'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c': {'status': u'Active', 'diskfree': '1137495244800', 'isoprefix': '', 'alerts': [], 'disktotal': '1152393412608', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532069482496', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-1043::DEBUG::2014-07-10 08:23:31,772::task::595::TaskManager.Task::(_updateState) Task=`bd2e5fbc-3aeb-4150-aa47-6a32fa9343e7`::moving from state preparing -> state finished >Thread-1043::DEBUG::2014-07-10 08:23:31,773::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9': < ResourceRef 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9', isValid: 'True' obj: 'None'>} >Thread-1043::DEBUG::2014-07-10 08:23:31,773::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1043::DEBUG::2014-07-10 08:23:31,773::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' >Thread-1043::DEBUG::2014-07-10 08:23:31,773::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' (0 active users) >Thread-1043::DEBUG::2014-07-10 08:23:31,774::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' is free, finding out if anyone is waiting for it. >Thread-1043::DEBUG::2014-07-10 08:23:31,774::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9', Clearing records. >Thread-1043::DEBUG::2014-07-10 08:23:31,774::task::990::TaskManager.Task::(_decref) Task=`bd2e5fbc-3aeb-4150-aa47-6a32fa9343e7`::ref 0 aborting False >Thread-15::DEBUG::2014-07-10 08:23:31,973::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/e01a3a36-d2ce-4153-bb57-d6e65b7ed08c/metadata bs=4096 count=1' (cwd None) >Dummy-36::DEBUG::2014-07-10 08:23:32,035::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Thread-15::DEBUG::2014-07-10 08:23:32,136::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.0197187 s, 208 kB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-07-10 08:23:32,416::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.243831 s, 4.2 MB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-07-10 08:23:34,431::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-07-10 08:23:34,598::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0676043 s, 15.1 MB/s\n'; <rc> = 0 >Thread-1042::DEBUG::2014-07-10 08:23:35,999::task::595::TaskManager.Task::(_updateState) Task=`942fa31e-f45b-493f-870f-84d50147b35a`::moving from state init -> state preparing >Thread-1042::INFO::2014-07-10 08:23:36,000::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-1042::INFO::2014-07-10 08:23:36,000::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0197187', 'lastCheck': '3.6', 'valid': True}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000459644', 'lastCheck': '7.9', 'valid': True}} >Thread-1042::DEBUG::2014-07-10 08:23:36,000::task::1185::TaskManager.Task::(prepare) Task=`942fa31e-f45b-493f-870f-84d50147b35a`::finished: {u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0197187', 'lastCheck': '3.6', 'valid': True}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000459644', 'lastCheck': '7.9', 'valid': True}} >Thread-1042::DEBUG::2014-07-10 08:23:36,001::task::595::TaskManager.Task::(_updateState) Task=`942fa31e-f45b-493f-870f-84d50147b35a`::moving from state preparing -> state finished >Thread-1042::DEBUG::2014-07-10 08:23:36,001::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-1042::DEBUG::2014-07-10 08:23:36,001::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1042::DEBUG::2014-07-10 08:23:36,001::task::990::TaskManager.Task::(_decref) Task=`942fa31e-f45b-493f-870f-84d50147b35a`::ref 0 aborting False >Dummy-36::DEBUG::2014-07-10 08:23:36,613::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-07-10 08:23:36,756::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0444719 s, 23.0 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 08:23:38,113::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lion.qa.lab.tlv.redhat.com:_export_yuri2_backup2/6a70504d-00df-4869-8695-0f442053f6b6/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-14::DEBUG::2014-07-10 08:23:38,177::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n369 bytes (369 B) copied, 0.000469554 s, 786 kB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-07-10 08:23:38,772::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-07-10 08:23:38,934::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0567779 s, 18.0 MB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-07-10 08:23:40,949::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-07-10 08:23:41,088::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0379599 s, 27.0 MB/s\n'; <rc> = 0 >Thread-1042::DEBUG::2014-07-10 08:23:41,812::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-1042::DEBUG::2014-07-10 08:23:41,814::task::595::TaskManager.Task::(_updateState) Task=`778500b6-2760-4e45-be13-9f37c55ca115`::moving from state init -> state preparing >Thread-1042::INFO::2014-07-10 08:23:41,814::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='411039e4-4af2-4192-9de0-67dc1ed83ba9', options=None) >Thread-1042::INFO::2014-07-10 08:23:41,815::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2}} >Thread-1042::DEBUG::2014-07-10 08:23:41,815::task::1185::TaskManager.Task::(prepare) Task=`778500b6-2760-4e45-be13-9f37c55ca115`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2}} >Thread-1042::DEBUG::2014-07-10 08:23:41,815::task::595::TaskManager.Task::(_updateState) Task=`778500b6-2760-4e45-be13-9f37c55ca115`::moving from state preparing -> state finished >Thread-1042::DEBUG::2014-07-10 08:23:41,815::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-1042::DEBUG::2014-07-10 08:23:41,816::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1042::DEBUG::2014-07-10 08:23:41,816::task::990::TaskManager.Task::(_decref) Task=`778500b6-2760-4e45-be13-9f37c55ca115`::ref 0 aborting False >Thread-1043::DEBUG::2014-07-10 08:23:41,820::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-1043::DEBUG::2014-07-10 08:23:41,820::task::595::TaskManager.Task::(_updateState) Task=`83eff637-e4b5-4294-9e9a-47c809f21835`::moving from state init -> state preparing >Thread-1043::INFO::2014-07-10 08:23:41,820::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='411039e4-4af2-4192-9de0-67dc1ed83ba9', options=None) >Thread-1043::DEBUG::2014-07-10 08:23:41,821::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9`ReqID=`d75b1adc-774f-4b57-b1a1-0bb745a0cc7c`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo' >Thread-1043::DEBUG::2014-07-10 08:23:41,821::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' for lock type 'shared' >Thread-1043::DEBUG::2014-07-10 08:23:41,822::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' is free. Now locking as 'shared' (1 active user) >Thread-1043::DEBUG::2014-07-10 08:23:41,822::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9`ReqID=`d75b1adc-774f-4b57-b1a1-0bb745a0cc7c`::Granted request >Thread-1043::DEBUG::2014-07-10 08:23:41,822::task::827::TaskManager.Task::(resourceAcquired) Task=`83eff637-e4b5-4294-9e9a-47c809f21835`::_resourcesAcquired: Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9 (shared) >Thread-1043::DEBUG::2014-07-10 08:23:41,823::task::990::TaskManager.Task::(_decref) Task=`83eff637-e4b5-4294-9e9a-47c809f21835`::ref 1 aborting False >Thread-1043::INFO::2014-07-10 08:23:41,824::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DC-REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2, 'domains': u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': 'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c': {'status': u'Active', 'diskfree': '1137495244800', 'isoprefix': '', 'alerts': [], 'disktotal': '1152393412608', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532069482496', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-1043::DEBUG::2014-07-10 08:23:41,824::task::1185::TaskManager.Task::(prepare) Task=`83eff637-e4b5-4294-9e9a-47c809f21835`::finished: {'info': {'name': 'DC-REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2, 'domains': u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': 'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c': {'status': u'Active', 'diskfree': '1137495244800', 'isoprefix': '', 'alerts': [], 'disktotal': '1152393412608', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532069482496', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-1043::DEBUG::2014-07-10 08:23:41,824::task::595::TaskManager.Task::(_updateState) Task=`83eff637-e4b5-4294-9e9a-47c809f21835`::moving from state preparing -> state finished >Thread-1043::DEBUG::2014-07-10 08:23:41,824::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9': < ResourceRef 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9', isValid: 'True' obj: 'None'>} >Thread-1043::DEBUG::2014-07-10 08:23:41,825::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1043::DEBUG::2014-07-10 08:23:41,825::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' >Thread-1043::DEBUG::2014-07-10 08:23:41,825::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' (0 active users) >Thread-1043::DEBUG::2014-07-10 08:23:41,825::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' is free, finding out if anyone is waiting for it. >Thread-1043::DEBUG::2014-07-10 08:23:41,826::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9', Clearing records. >Thread-1043::DEBUG::2014-07-10 08:23:41,826::task::990::TaskManager.Task::(_decref) Task=`83eff637-e4b5-4294-9e9a-47c809f21835`::ref 0 aborting False >Thread-15::DEBUG::2014-07-10 08:23:42,361::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/e01a3a36-d2ce-4153-bb57-d6e65b7ed08c/metadata bs=4096 count=1' (cwd None) >Thread-15::DEBUG::2014-07-10 08:23:42,432::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.0073928 s, 554 kB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-07-10 08:23:43,103::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-07-10 08:23:43,252::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0535023 s, 19.1 MB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-07-10 08:23:45,267::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-07-10 08:23:45,416::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.051318 s, 20.0 MB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-07-10 08:23:47,438::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-07-10 08:23:47,576::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0389504 s, 26.3 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 08:23:48,203::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lion.qa.lab.tlv.redhat.com:_export_yuri2_backup2/6a70504d-00df-4869-8695-0f442053f6b6/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-14::DEBUG::2014-07-10 08:23:48,266::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n369 bytes (369 B) copied, 0.000382523 s, 965 kB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-07-10 08:23:49,591::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-07-10 08:23:49,727::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0383835 s, 26.7 MB/s\n'; <rc> = 0 >Thread-1042::DEBUG::2014-07-10 08:23:51,139::task::595::TaskManager.Task::(_updateState) Task=`e4163d3d-a54b-445d-9568-e5e9d1d178ae`::moving from state init -> state preparing >Thread-1042::INFO::2014-07-10 08:23:51,140::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-1042::INFO::2014-07-10 08:23:51,140::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0073928', 'lastCheck': '8.7', 'valid': True}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000382523', 'lastCheck': '2.9', 'valid': True}} >Thread-1042::DEBUG::2014-07-10 08:23:51,141::task::1185::TaskManager.Task::(prepare) Task=`e4163d3d-a54b-445d-9568-e5e9d1d178ae`::finished: {u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0073928', 'lastCheck': '8.7', 'valid': True}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000382523', 'lastCheck': '2.9', 'valid': True}} >Thread-1042::DEBUG::2014-07-10 08:23:51,141::task::595::TaskManager.Task::(_updateState) Task=`e4163d3d-a54b-445d-9568-e5e9d1d178ae`::moving from state preparing -> state finished >Thread-1042::DEBUG::2014-07-10 08:23:51,141::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-1042::DEBUG::2014-07-10 08:23:51,141::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1042::DEBUG::2014-07-10 08:23:51,141::task::990::TaskManager.Task::(_decref) Task=`e4163d3d-a54b-445d-9568-e5e9d1d178ae`::ref 0 aborting False >Dummy-36::DEBUG::2014-07-10 08:23:51,743::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Thread-1042::DEBUG::2014-07-10 08:23:51,858::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-1042::DEBUG::2014-07-10 08:23:51,865::task::595::TaskManager.Task::(_updateState) Task=`1337d451-9423-4f37-81f5-0d02edc3d5df`::moving from state init -> state preparing >Thread-1042::INFO::2014-07-10 08:23:51,868::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='411039e4-4af2-4192-9de0-67dc1ed83ba9', options=None) >Thread-1042::INFO::2014-07-10 08:23:51,872::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2}} >Thread-1042::DEBUG::2014-07-10 08:23:51,874::task::1185::TaskManager.Task::(prepare) Task=`1337d451-9423-4f37-81f5-0d02edc3d5df`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2}} >Thread-1042::DEBUG::2014-07-10 08:23:51,879::task::595::TaskManager.Task::(_updateState) Task=`1337d451-9423-4f37-81f5-0d02edc3d5df`::moving from state preparing -> state finished >Thread-1042::DEBUG::2014-07-10 08:23:51,881::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-1042::DEBUG::2014-07-10 08:23:51,883::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1042::DEBUG::2014-07-10 08:23:51,886::task::990::TaskManager.Task::(_decref) Task=`1337d451-9423-4f37-81f5-0d02edc3d5df`::ref 0 aborting False >Thread-1043::DEBUG::2014-07-10 08:23:51,900::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-1043::DEBUG::2014-07-10 08:23:51,904::task::595::TaskManager.Task::(_updateState) Task=`848da51e-bcee-4b78-a131-b664a516d67d`::moving from state init -> state preparing >Thread-1043::INFO::2014-07-10 08:23:51,907::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='411039e4-4af2-4192-9de0-67dc1ed83ba9', options=None) >Thread-1043::DEBUG::2014-07-10 08:23:51,913::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9`ReqID=`0c79ca71-00a0-4043-8f8a-02da2cdfac68`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo' >Thread-1043::DEBUG::2014-07-10 08:23:51,915::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' for lock type 'shared' >Thread-1043::DEBUG::2014-07-10 08:23:51,920::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' is free. Now locking as 'shared' (1 active user) >Thread-1043::DEBUG::2014-07-10 08:23:51,922::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9`ReqID=`0c79ca71-00a0-4043-8f8a-02da2cdfac68`::Granted request >Thread-1043::DEBUG::2014-07-10 08:23:51,928::task::827::TaskManager.Task::(resourceAcquired) Task=`848da51e-bcee-4b78-a131-b664a516d67d`::_resourcesAcquired: Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9 (shared) >Thread-1043::DEBUG::2014-07-10 08:23:51,931::task::990::TaskManager.Task::(_decref) Task=`848da51e-bcee-4b78-a131-b664a516d67d`::ref 1 aborting False >Thread-1043::INFO::2014-07-10 08:23:51,945::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DC-REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2, 'domains': u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': 'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c': {'status': u'Active', 'diskfree': '1137495244800', 'isoprefix': '', 'alerts': [], 'disktotal': '1152393412608', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532069482496', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-1043::DEBUG::2014-07-10 08:23:51,947::task::1185::TaskManager.Task::(prepare) Task=`848da51e-bcee-4b78-a131-b664a516d67d`::finished: {'info': {'name': 'DC-REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2, 'domains': u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': 'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c': {'status': u'Active', 'diskfree': '1137495244800', 'isoprefix': '', 'alerts': [], 'disktotal': '1152393412608', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532069482496', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-1043::DEBUG::2014-07-10 08:23:51,949::task::595::TaskManager.Task::(_updateState) Task=`848da51e-bcee-4b78-a131-b664a516d67d`::moving from state preparing -> state finished >Thread-1043::DEBUG::2014-07-10 08:23:51,951::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9': < ResourceRef 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9', isValid: 'True' obj: 'None'>} >Thread-1043::DEBUG::2014-07-10 08:23:51,954::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1043::DEBUG::2014-07-10 08:23:51,958::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' >Thread-1043::DEBUG::2014-07-10 08:23:51,962::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' (0 active users) >Thread-1043::DEBUG::2014-07-10 08:23:51,964::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' is free, finding out if anyone is waiting for it. >Thread-1043::DEBUG::2014-07-10 08:23:51,966::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9', Clearing records. >Thread-1043::DEBUG::2014-07-10 08:23:51,971::task::990::TaskManager.Task::(_decref) Task=`848da51e-bcee-4b78-a131-b664a516d67d`::ref 0 aborting False >Dummy-36::DEBUG::2014-07-10 08:23:51,995::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0330253 s, 31.0 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-07-10 08:23:52,462::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/e01a3a36-d2ce-4153-bb57-d6e65b7ed08c/metadata bs=4096 count=1' (cwd None) >Thread-15::DEBUG::2014-07-10 08:23:52,562::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.037992 s, 108 kB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-07-10 08:23:54,010::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-07-10 08:23:54,148::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0326019 s, 31.4 MB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-07-10 08:23:56,163::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-07-10 08:23:56,305::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0381158 s, 26.9 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 08:23:58,291::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lion.qa.lab.tlv.redhat.com:_export_yuri2_backup2/6a70504d-00df-4869-8695-0f442053f6b6/dom_md/metadata bs=4096 count=1' (cwd None) >Dummy-36::DEBUG::2014-07-10 08:23:58,350::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Thread-14::DEBUG::2014-07-10 08:23:58,413::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n369 bytes (369 B) copied, 0.000509351 s, 724 kB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-07-10 08:23:58,490::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.040758 s, 25.1 MB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-07-10 08:24:00,505::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-07-10 08:24:00,636::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.032631 s, 31.4 MB/s\n'; <rc> = 0 >Thread-1042::DEBUG::2014-07-10 08:24:02,012::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-1042::DEBUG::2014-07-10 08:24:02,013::task::595::TaskManager.Task::(_updateState) Task=`e87d8283-3f44-4a7a-96db-382aca91f35d`::moving from state init -> state preparing >Thread-1042::INFO::2014-07-10 08:24:02,014::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='411039e4-4af2-4192-9de0-67dc1ed83ba9', options=None) >Thread-1042::INFO::2014-07-10 08:24:02,014::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2}} >Thread-1042::DEBUG::2014-07-10 08:24:02,015::task::1185::TaskManager.Task::(prepare) Task=`e87d8283-3f44-4a7a-96db-382aca91f35d`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2}} >Thread-1042::DEBUG::2014-07-10 08:24:02,015::task::595::TaskManager.Task::(_updateState) Task=`e87d8283-3f44-4a7a-96db-382aca91f35d`::moving from state preparing -> state finished >Thread-1042::DEBUG::2014-07-10 08:24:02,015::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-1042::DEBUG::2014-07-10 08:24:02,015::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1042::DEBUG::2014-07-10 08:24:02,016::task::990::TaskManager.Task::(_decref) Task=`e87d8283-3f44-4a7a-96db-382aca91f35d`::ref 0 aborting False >Thread-1043::DEBUG::2014-07-10 08:24:02,019::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-1043::DEBUG::2014-07-10 08:24:02,020::task::595::TaskManager.Task::(_updateState) Task=`c55f5fd5-3fef-4e92-8ddd-8353a968a764`::moving from state init -> state preparing >Thread-1043::INFO::2014-07-10 08:24:02,020::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='411039e4-4af2-4192-9de0-67dc1ed83ba9', options=None) >Thread-1043::DEBUG::2014-07-10 08:24:02,021::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9`ReqID=`7fff3f54-3df2-48cf-99f7-2b1fef009b39`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo' >Thread-1043::DEBUG::2014-07-10 08:24:02,021::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' for lock type 'shared' >Thread-1043::DEBUG::2014-07-10 08:24:02,021::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' is free. Now locking as 'shared' (1 active user) >Thread-1043::DEBUG::2014-07-10 08:24:02,022::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9`ReqID=`7fff3f54-3df2-48cf-99f7-2b1fef009b39`::Granted request >Thread-1043::DEBUG::2014-07-10 08:24:02,022::task::827::TaskManager.Task::(resourceAcquired) Task=`c55f5fd5-3fef-4e92-8ddd-8353a968a764`::_resourcesAcquired: Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9 (shared) >Thread-1043::DEBUG::2014-07-10 08:24:02,022::task::990::TaskManager.Task::(_decref) Task=`c55f5fd5-3fef-4e92-8ddd-8353a968a764`::ref 1 aborting False >Thread-1043::INFO::2014-07-10 08:24:02,023::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DC-REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2, 'domains': u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': 'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c': {'status': u'Active', 'diskfree': '1137495244800', 'isoprefix': '', 'alerts': [], 'disktotal': '1152393412608', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532069482496', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-1043::DEBUG::2014-07-10 08:24:02,024::task::1185::TaskManager.Task::(prepare) Task=`c55f5fd5-3fef-4e92-8ddd-8353a968a764`::finished: {'info': {'name': 'DC-REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2, 'domains': u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': 'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c': {'status': u'Active', 'diskfree': '1137495244800', 'isoprefix': '', 'alerts': [], 'disktotal': '1152393412608', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532069482496', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-1043::DEBUG::2014-07-10 08:24:02,024::task::595::TaskManager.Task::(_updateState) Task=`c55f5fd5-3fef-4e92-8ddd-8353a968a764`::moving from state preparing -> state finished >Thread-1043::DEBUG::2014-07-10 08:24:02,024::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9': < ResourceRef 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9', isValid: 'True' obj: 'None'>} >Thread-1043::DEBUG::2014-07-10 08:24:02,024::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1043::DEBUG::2014-07-10 08:24:02,025::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' >Thread-1043::DEBUG::2014-07-10 08:24:02,025::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' (0 active users) >Thread-1043::DEBUG::2014-07-10 08:24:02,025::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' is free, finding out if anyone is waiting for it. >Thread-1043::DEBUG::2014-07-10 08:24:02,025::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9', Clearing records. >Thread-1043::DEBUG::2014-07-10 08:24:02,025::task::990::TaskManager.Task::(_decref) Task=`c55f5fd5-3fef-4e92-8ddd-8353a968a764`::ref 0 aborting False >Thread-15::DEBUG::2014-07-10 08:24:02,592::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/e01a3a36-d2ce-4153-bb57-d6e65b7ed08c/metadata bs=4096 count=1' (cwd None) >Dummy-36::DEBUG::2014-07-10 08:24:02,656::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Thread-15::DEBUG::2014-07-10 08:24:02,733::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00080146 s, 5.1 MB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-07-10 08:24:03,084::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.320734 s, 3.2 MB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-07-10 08:24:05,094::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-07-10 08:24:05,222::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0299223 s, 34.2 MB/s\n'; <rc> = 0 >Thread-1043::DEBUG::2014-07-10 08:24:05,927::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [2ed0a112] >Thread-1043::DEBUG::2014-07-10 08:24:05,928::task::595::TaskManager.Task::(_updateState) Task=`29e88bf1-56b9-4e0c-b694-88d17016a83d`::moving from state init -> state preparing >Thread-1043::INFO::2014-07-10 08:24:05,928::logUtils::44::dispatcher::(wrapper) Run and protect: deactivateStorageDomain(sdUUID='6a70504d-00df-4869-8695-0f442053f6b6', spUUID='411039e4-4af2-4192-9de0-67dc1ed83ba9', msdUUID='00000000-0000-0000-0000-000000000000', masterVersion=1, options=None) >Thread-1043::DEBUG::2014-07-10 08:24:05,929::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9`ReqID=`c4d5285d-d97b-4f2a-a7f8-fe04423ef4e3`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '1234' at 'deactivateStorageDomain' >Thread-1043::DEBUG::2014-07-10 08:24:05,929::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' for lock type 'exclusive' >Thread-1043::DEBUG::2014-07-10 08:24:05,930::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' is free. Now locking as 'exclusive' (1 active user) >Thread-1043::DEBUG::2014-07-10 08:24:05,930::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9`ReqID=`c4d5285d-d97b-4f2a-a7f8-fe04423ef4e3`::Granted request >Thread-1043::DEBUG::2014-07-10 08:24:05,930::task::827::TaskManager.Task::(resourceAcquired) Task=`29e88bf1-56b9-4e0c-b694-88d17016a83d`::_resourcesAcquired: Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9 (exclusive) >Thread-1043::DEBUG::2014-07-10 08:24:05,931::task::990::TaskManager.Task::(_decref) Task=`29e88bf1-56b9-4e0c-b694-88d17016a83d`::ref 1 aborting False >Thread-1043::DEBUG::2014-07-10 08:24:05,931::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.6a70504d-00df-4869-8695-0f442053f6b6`ReqID=`19fecb87-234c-4799-9d7a-0815fa4163dc`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '1235' at 'deactivateStorageDomain' >Thread-1043::DEBUG::2014-07-10 08:24:05,931::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.6a70504d-00df-4869-8695-0f442053f6b6' for lock type 'exclusive' >Thread-1043::DEBUG::2014-07-10 08:24:05,931::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.6a70504d-00df-4869-8695-0f442053f6b6' is free. Now locking as 'exclusive' (1 active user) >Thread-1043::DEBUG::2014-07-10 08:24:05,932::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.6a70504d-00df-4869-8695-0f442053f6b6`ReqID=`19fecb87-234c-4799-9d7a-0815fa4163dc`::Granted request >Thread-1043::DEBUG::2014-07-10 08:24:05,932::task::827::TaskManager.Task::(resourceAcquired) Task=`29e88bf1-56b9-4e0c-b694-88d17016a83d`::_resourcesAcquired: Storage.6a70504d-00df-4869-8695-0f442053f6b6 (exclusive) >Thread-1043::DEBUG::2014-07-10 08:24:05,932::task::990::TaskManager.Task::(_decref) Task=`29e88bf1-56b9-4e0c-b694-88d17016a83d`::ref 1 aborting False >Thread-1043::INFO::2014-07-10 08:24:05,933::sp::1063::Storage.StoragePool::(deactivateSD) sdUUID=6a70504d-00df-4869-8695-0f442053f6b6 spUUID=411039e4-4af2-4192-9de0-67dc1ed83ba9 newMsdUUID=00000000-0000-0000-0000-000000000000 >Thread-1043::DEBUG::2014-07-10 08:24:05,961::persistentDict::167::Storage.PersistentDict::(transaction) Starting transaction >Thread-1043::DEBUG::2014-07-10 08:24:05,961::persistentDict::173::Storage.PersistentDict::(transaction) Flushing changes >Thread-1043::DEBUG::2014-07-10 08:24:05,961::persistentDict::299::Storage.PersistentDict::(flush) about to write lines (VGTagMetadataRW)=['CLASS=Data', 'DESCRIPTION=SD-REAL', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'LOGBLKSIZE=512', 'MASTER_VERSION=1', 'PHYBLKSIZE=512', 'POOL_DESCRIPTION=DC-REAL', u'POOL_DOMAINS=6a70504d-00df-4869-8695-0f442053f6b6:Attached,e01a3a36-d2ce-4153-bb57-d6e65b7ed08c:Active', 'POOL_SPM_ID=1', 'POOL_SPM_LVER=2', 'POOL_UUID=411039e4-4af2-4192-9de0-67dc1ed83ba9', u'PV0=pv:3600601601282300032826addbbdae311,uuid:ZdReOp-Yf8A-beQm-ne4I-pN3J-rxgm-9Ew0S1,pestart:0,pecount:8189,mapoffset:0', u'PV1=pv:360060160f4a030003840ec867ddee311,uuid:0eUwla-dsA3-g6ia-RU23-cual-0rt9-KzkxLj,pestart:0,pecount:397,mapoffset:8189', 'ROLE=Master', 'SDUUID=e01a3a36-d2ce-4153-bb57-d6e65b7ed08c', 'TYPE=ISCSI', 'VERSION=3', 'VGUUID=GJcVo5-Y0kU-CDub-zITS-zfoL-Z7hz-SeVeIe', '_SHA_CKSUM=b8ab8f69e4ce521efe60d540821bb40a90656f83'] >Thread-1043::DEBUG::2014-07-10 08:24:05,962::lvm::503::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-1043::DEBUG::2014-07-10 08:24:05,962::lvm::505::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-1043::DEBUG::2014-07-10 08:24:05,962::lvm::513::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-1043::DEBUG::2014-07-10 08:24:05,963::lvm::525::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-1043::DEBUG::2014-07-10 08:24:05,963::lvm::373::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-1043::DEBUG::2014-07-10 08:24:05,964::lvm::296::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/3600601601282300032826addbbdae311|/dev/mapper/360060160f4a030003840ec867ddee311|/dev/mapper/367cad74c2fcba00019e6afd20c781e67|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name e01a3a36-d2ce-4153-bb57-d6e65b7ed08c' (cwd None) >Thread-1042::DEBUG::2014-07-10 08:24:06,283::task::595::TaskManager.Task::(_updateState) Task=`f27ccab4-f656-4798-8b3b-5499b32fc1f4`::moving from state init -> state preparing >Thread-1042::INFO::2014-07-10 08:24:06,284::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-1042::INFO::2014-07-10 08:24:06,284::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00080146', 'lastCheck': '3.3', 'valid': True}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000509351', 'lastCheck': '7.9', 'valid': True}} >Thread-1042::DEBUG::2014-07-10 08:24:06,284::task::1185::TaskManager.Task::(prepare) Task=`f27ccab4-f656-4798-8b3b-5499b32fc1f4`::finished: {u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00080146', 'lastCheck': '3.3', 'valid': True}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000509351', 'lastCheck': '7.9', 'valid': True}} >Thread-1042::DEBUG::2014-07-10 08:24:06,285::task::595::TaskManager.Task::(_updateState) Task=`f27ccab4-f656-4798-8b3b-5499b32fc1f4`::moving from state preparing -> state finished >Thread-1042::DEBUG::2014-07-10 08:24:06,285::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-1042::DEBUG::2014-07-10 08:24:06,285::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1042::DEBUG::2014-07-10 08:24:06,285::task::990::TaskManager.Task::(_decref) Task=`f27ccab4-f656-4798-8b3b-5499b32fc1f4`::ref 0 aborting False >Thread-1043::DEBUG::2014-07-10 08:24:06,325::lvm::296::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-1043::DEBUG::2014-07-10 08:24:06,327::lvm::415::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-1043::DEBUG::2014-07-10 08:24:06,328::blockSD::315::storage.Metadata.VGTagMetadataRW::(writelines) Updating metadata adding=MDT__SHA_CKSUM=b8ab8f69e4ce521efe60d540821bb40a90656f83, MDT_POOL_DOMAINS=6a70504d-00df-4869-8695-0f442053f6b6:Attached&44&e01a3a36-d2ce-4153-bb57-d6e65b7ed08c:Active removing=MDT_POOL_DOMAINS=6a70504d-00df-4869-8695-0f442053f6b6:Active&44&e01a3a36-d2ce-4153-bb57-d6e65b7ed08c:Active, MDT__SHA_CKSUM=cefcf6543a5de3bd5b35901e3ca494c6a6185b63 >Thread-1043::DEBUG::2014-07-10 08:24:06,329::lvm::296::Storage.Misc.excCmd::(cmd) u'/usr/bin/sudo -n /sbin/lvm vgchange --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/3600601601282300032826addbbdae311|/dev/mapper/360060160f4a030003840ec867ddee311|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } " --deltag MDT__SHA_CKSUM=cefcf6543a5de3bd5b35901e3ca494c6a6185b63 --deltag MDT_POOL_DOMAINS=6a70504d-00df-4869-8695-0f442053f6b6:Active&44&e01a3a36-d2ce-4153-bb57-d6e65b7ed08c:Active --addtag MDT__SHA_CKSUM=b8ab8f69e4ce521efe60d540821bb40a90656f83 --addtag MDT_POOL_DOMAINS=6a70504d-00df-4869-8695-0f442053f6b6:Attached&44&e01a3a36-d2ce-4153-bb57-d6e65b7ed08c:Active e01a3a36-d2ce-4153-bb57-d6e65b7ed08c' (cwd None) >Thread-1043::DEBUG::2014-07-10 08:24:06,606::lvm::296::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-1043::DEBUG::2014-07-10 08:24:06,607::lvm::503::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-1043::DEBUG::2014-07-10 08:24:06,607::lvm::505::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-1043::DEBUG::2014-07-10 08:24:06,607::persistentDict::175::Storage.PersistentDict::(transaction) Finished transaction >Thread-1043::DEBUG::2014-07-10 08:24:06,608::misc::756::SamplingMethod::(__call__) Trying to enter sampling method (storage.sp.updateMonitoringThreads) >Thread-1043::DEBUG::2014-07-10 08:24:06,608::misc::758::SamplingMethod::(__call__) Got in to sampling method >Thread-1043::INFO::2014-07-10 08:24:06,608::domainMonitor::113::Storage.DomainMonitor::(stopMonitoring) Stop monitoring 6a70504d-00df-4869-8695-0f442053f6b6 >Thread-14::DEBUG::2014-07-10 08:24:06,609::domainMonitor::175::Storage.DomainMonitorThread::(_monitorLoop) Stopping domain monitor for 6a70504d-00df-4869-8695-0f442053f6b6 >Thread-14::DEBUG::2014-07-10 08:24:06,609::clusterlock::90::SafeLease::(releaseHostId) Host id for domain 6a70504d-00df-4869-8695-0f442053f6b6 released successfully (id: 1) >Thread-1043::DEBUG::2014-07-10 08:24:06,610::sp::1393::Storage.StoragePool::(updateMonitoringThreads) Storage Pool `411039e4-4af2-4192-9de0-67dc1ed83ba9` stopped monitoring domain `6a70504d-00df-4869-8695-0f442053f6b6` >Thread-1043::DEBUG::2014-07-10 08:24:06,610::misc::766::SamplingMethod::(__call__) Returning last result >Thread-1043::INFO::2014-07-10 08:24:06,610::logUtils::47::dispatcher::(wrapper) Run and protect: deactivateStorageDomain, Return response: None >Thread-1043::DEBUG::2014-07-10 08:24:06,610::task::1185::TaskManager.Task::(prepare) Task=`29e88bf1-56b9-4e0c-b694-88d17016a83d`::finished: None >Thread-1043::DEBUG::2014-07-10 08:24:06,610::task::595::TaskManager.Task::(_updateState) Task=`29e88bf1-56b9-4e0c-b694-88d17016a83d`::moving from state preparing -> state finished >Thread-1043::DEBUG::2014-07-10 08:24:06,611::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9': < ResourceRef 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9', isValid: 'True' obj: 'None'>, 'Storage.6a70504d-00df-4869-8695-0f442053f6b6': < ResourceRef 'Storage.6a70504d-00df-4869-8695-0f442053f6b6', isValid: 'True' obj: 'None'>} >Thread-1043::DEBUG::2014-07-10 08:24:06,611::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1043::DEBUG::2014-07-10 08:24:06,611::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' >Thread-1043::DEBUG::2014-07-10 08:24:06,612::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' (0 active users) >Thread-1043::DEBUG::2014-07-10 08:24:06,612::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' is free, finding out if anyone is waiting for it. >Thread-1043::DEBUG::2014-07-10 08:24:06,612::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9', Clearing records. >Thread-1043::DEBUG::2014-07-10 08:24:06,612::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.6a70504d-00df-4869-8695-0f442053f6b6' >Thread-1043::DEBUG::2014-07-10 08:24:06,613::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.6a70504d-00df-4869-8695-0f442053f6b6' (0 active users) >Thread-1043::DEBUG::2014-07-10 08:24:06,613::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.6a70504d-00df-4869-8695-0f442053f6b6' is free, finding out if anyone is waiting for it. >Thread-1043::DEBUG::2014-07-10 08:24:06,613::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.6a70504d-00df-4869-8695-0f442053f6b6', Clearing records. >Thread-1043::DEBUG::2014-07-10 08:24:06,613::task::990::TaskManager.Task::(_decref) Task=`29e88bf1-56b9-4e0c-b694-88d17016a83d`::ref 0 aborting False >Thread-1042::DEBUG::2014-07-10 08:24:06,629::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [2ed0a112] >Thread-1042::DEBUG::2014-07-10 08:24:06,630::task::595::TaskManager.Task::(_updateState) Task=`e8a03126-9444-48ee-a2d8-24a6fb91f37c`::moving from state init -> state preparing >Thread-1042::INFO::2014-07-10 08:24:06,630::logUtils::44::dispatcher::(wrapper) Run and protect: refreshStoragePool(spUUID='411039e4-4af2-4192-9de0-67dc1ed83ba9', msdUUID='e01a3a36-d2ce-4153-bb57-d6e65b7ed08c', masterVersion=1, options=None) >Thread-1042::DEBUG::2014-07-10 08:24:06,631::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9`ReqID=`5eaf2770-25fa-4fff-8aa7-2fb3feb9f7d5`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '870' at 'refreshStoragePool' >Thread-1042::DEBUG::2014-07-10 08:24:06,631::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' for lock type 'shared' >Thread-1042::DEBUG::2014-07-10 08:24:06,631::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' is free. Now locking as 'shared' (1 active user) >Thread-1042::DEBUG::2014-07-10 08:24:06,632::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9`ReqID=`5eaf2770-25fa-4fff-8aa7-2fb3feb9f7d5`::Granted request >Thread-1042::DEBUG::2014-07-10 08:24:06,632::task::827::TaskManager.Task::(resourceAcquired) Task=`e8a03126-9444-48ee-a2d8-24a6fb91f37c`::_resourcesAcquired: Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9 (shared) >Thread-1042::DEBUG::2014-07-10 08:24:06,632::task::990::TaskManager.Task::(_decref) Task=`e8a03126-9444-48ee-a2d8-24a6fb91f37c`::ref 1 aborting False >Thread-1042::INFO::2014-07-10 08:24:06,632::hsm::879::Storage.HSM::(refreshStoragePool) Ignoring the refreshStoragePool request (the host is the SPM) >Thread-1042::INFO::2014-07-10 08:24:06,633::logUtils::47::dispatcher::(wrapper) Run and protect: refreshStoragePool, Return response: None >Thread-1042::DEBUG::2014-07-10 08:24:06,633::task::1185::TaskManager.Task::(prepare) Task=`e8a03126-9444-48ee-a2d8-24a6fb91f37c`::finished: None >Thread-1042::DEBUG::2014-07-10 08:24:06,633::task::595::TaskManager.Task::(_updateState) Task=`e8a03126-9444-48ee-a2d8-24a6fb91f37c`::moving from state preparing -> state finished >Thread-1042::DEBUG::2014-07-10 08:24:06,633::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9': < ResourceRef 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9', isValid: 'True' obj: 'None'>} >Thread-1042::DEBUG::2014-07-10 08:24:06,633::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1042::DEBUG::2014-07-10 08:24:06,633::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' >Thread-1042::DEBUG::2014-07-10 08:24:06,634::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' (0 active users) >Thread-1042::DEBUG::2014-07-10 08:24:06,634::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' is free, finding out if anyone is waiting for it. >Thread-1042::DEBUG::2014-07-10 08:24:06,634::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9', Clearing records. >Thread-1042::DEBUG::2014-07-10 08:24:06,634::task::990::TaskManager.Task::(_decref) Task=`e8a03126-9444-48ee-a2d8-24a6fb91f37c`::ref 0 aborting False >Thread-1042::DEBUG::2014-07-10 08:24:06,648::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [1a173404] >Thread-1042::DEBUG::2014-07-10 08:24:06,648::task::595::TaskManager.Task::(_updateState) Task=`68676179-a4af-4450-9c00-cbc294a9b647`::moving from state init -> state preparing >Thread-1042::INFO::2014-07-10 08:24:06,648::logUtils::44::dispatcher::(wrapper) Run and protect: disconnectStorageServer(domType=1, spUUID='00000000-0000-0000-0000-000000000000', conList=[{'connection': 'lion.qa.lab.tlv.redhat.com:/export/yuri2/backup2', 'iqn': '', 'user': '', 'tpgt': '1', 'password': '******', 'id': '22d965b8-f5e8-427d-8af6-dc707e6b84b5', 'port': ''}], options=None) >Thread-1042::DEBUG::2014-07-10 08:24:06,649::mount::202::Storage.Misc.excCmd::(_runcmd) '/usr/bin/sudo -n /bin/umount -f -l /rhev/data-center/mnt/lion.qa.lab.tlv.redhat.com:_export_yuri2_backup2' (cwd None) >Thread-1042::DEBUG::2014-07-10 08:24:06,783::misc::756::SamplingMethod::(__call__) Trying to enter sampling method (storage.sdc.refreshStorage) >Thread-1042::DEBUG::2014-07-10 08:24:06,794::misc::758::SamplingMethod::(__call__) Got in to sampling method >Thread-1042::DEBUG::2014-07-10 08:24:06,794::misc::756::SamplingMethod::(__call__) Trying to enter sampling method (storage.iscsi.rescan) >Thread-1042::DEBUG::2014-07-10 08:24:06,794::misc::758::SamplingMethod::(__call__) Got in to sampling method >Thread-1042::DEBUG::2014-07-10 08:24:06,795::iscsi::407::Storage.ISCSI::(rescan) Performing SCSI scan, this will take up to 30 seconds >Thread-1042::DEBUG::2014-07-10 08:24:06,795::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) '/usr/bin/sudo -n /sbin/iscsiadm -m session -R' (cwd None) >Thread-1042::DEBUG::2014-07-10 08:24:06,882::misc::766::SamplingMethod::(__call__) Returning last result >Thread-1042::DEBUG::2014-07-10 08:24:06,882::multipath::110::Storage.Misc.excCmd::(rescan) '/usr/bin/sudo -n /sbin/multipath -r' (cwd None) >Dummy-36::DEBUG::2014-07-10 08:24:07,237::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Thread-1042::DEBUG::2014-07-10 08:24:07,303::multipath::110::Storage.Misc.excCmd::(rescan) SUCCESS: <err> = ''; <rc> = 0 >Thread-1042::DEBUG::2014-07-10 08:24:07,305::lvm::497::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-1042::DEBUG::2014-07-10 08:24:07,305::lvm::499::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-1042::DEBUG::2014-07-10 08:24:07,305::lvm::508::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-1042::DEBUG::2014-07-10 08:24:07,305::lvm::510::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-1042::DEBUG::2014-07-10 08:24:07,306::lvm::528::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-1042::DEBUG::2014-07-10 08:24:07,306::lvm::530::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-1042::DEBUG::2014-07-10 08:24:07,308::misc::766::SamplingMethod::(__call__) Returning last result >Thread-1042::INFO::2014-07-10 08:24:07,311::logUtils::47::dispatcher::(wrapper) Run and protect: disconnectStorageServer, Return response: {'statuslist': [{'status': 0, 'id': '22d965b8-f5e8-427d-8af6-dc707e6b84b5'}]} >Thread-1042::DEBUG::2014-07-10 08:24:07,314::task::1185::TaskManager.Task::(prepare) Task=`68676179-a4af-4450-9c00-cbc294a9b647`::finished: {'statuslist': [{'status': 0, 'id': '22d965b8-f5e8-427d-8af6-dc707e6b84b5'}]} >Thread-1042::DEBUG::2014-07-10 08:24:07,316::task::595::TaskManager.Task::(_updateState) Task=`68676179-a4af-4450-9c00-cbc294a9b647`::moving from state preparing -> state finished >Thread-1042::DEBUG::2014-07-10 08:24:07,319::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-1042::DEBUG::2014-07-10 08:24:07,321::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1042::DEBUG::2014-07-10 08:24:07,325::task::990::TaskManager.Task::(_decref) Task=`68676179-a4af-4450-9c00-cbc294a9b647`::ref 0 aborting False >Dummy-36::DEBUG::2014-07-10 08:24:07,401::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0626062 s, 16.4 MB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-07-10 08:24:09,416::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-07-10 08:24:09,539::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0298071 s, 34.4 MB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-07-10 08:24:11,555::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-07-10 08:24:11,692::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0374605 s, 27.3 MB/s\n'; <rc> = 0 >Thread-1042::DEBUG::2014-07-10 08:24:12,063::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-1042::DEBUG::2014-07-10 08:24:12,064::task::595::TaskManager.Task::(_updateState) Task=`6ff117f2-95f5-4e3c-b446-d699c71c73bb`::moving from state init -> state preparing >Thread-1042::INFO::2014-07-10 08:24:12,064::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='411039e4-4af2-4192-9de0-67dc1ed83ba9', options=None) >Thread-1042::INFO::2014-07-10 08:24:12,065::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2}} >Thread-1042::DEBUG::2014-07-10 08:24:12,065::task::1185::TaskManager.Task::(prepare) Task=`6ff117f2-95f5-4e3c-b446-d699c71c73bb`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2}} >Thread-1042::DEBUG::2014-07-10 08:24:12,065::task::595::TaskManager.Task::(_updateState) Task=`6ff117f2-95f5-4e3c-b446-d699c71c73bb`::moving from state preparing -> state finished >Thread-1042::DEBUG::2014-07-10 08:24:12,066::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-1042::DEBUG::2014-07-10 08:24:12,066::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1042::DEBUG::2014-07-10 08:24:12,066::task::990::TaskManager.Task::(_decref) Task=`6ff117f2-95f5-4e3c-b446-d699c71c73bb`::ref 0 aborting False >Thread-1043::DEBUG::2014-07-10 08:24:12,070::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-1043::DEBUG::2014-07-10 08:24:12,071::task::595::TaskManager.Task::(_updateState) Task=`09d70fe0-2dd3-4ce9-ae0c-4285e7b0f2b8`::moving from state init -> state preparing >Thread-1043::INFO::2014-07-10 08:24:12,071::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='411039e4-4af2-4192-9de0-67dc1ed83ba9', options=None) >Thread-1043::DEBUG::2014-07-10 08:24:12,071::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9`ReqID=`c2553f5f-7a1b-4fe1-863a-c551cca60890`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo' >Thread-1043::DEBUG::2014-07-10 08:24:12,072::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' for lock type 'shared' >Thread-1043::DEBUG::2014-07-10 08:24:12,072::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' is free. Now locking as 'shared' (1 active user) >Thread-1043::DEBUG::2014-07-10 08:24:12,072::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9`ReqID=`c2553f5f-7a1b-4fe1-863a-c551cca60890`::Granted request >Thread-1043::DEBUG::2014-07-10 08:24:12,073::task::827::TaskManager.Task::(resourceAcquired) Task=`09d70fe0-2dd3-4ce9-ae0c-4285e7b0f2b8`::_resourcesAcquired: Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9 (shared) >Thread-1043::DEBUG::2014-07-10 08:24:12,073::task::990::TaskManager.Task::(_decref) Task=`09d70fe0-2dd3-4ce9-ae0c-4285e7b0f2b8`::ref 1 aborting False >Thread-1043::DEBUG::2014-07-10 08:24:12,074::lvm::373::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-1043::DEBUG::2014-07-10 08:24:12,077::lvm::296::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/3600601601282300032826addbbdae311|/dev/mapper/360060160f4a030003840ec867ddee311|/dev/mapper/367cad74c2fcba00019e6afd20c781e67|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name e01a3a36-d2ce-4153-bb57-d6e65b7ed08c' (cwd None) >Thread-1043::DEBUG::2014-07-10 08:24:12,384::lvm::296::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-1043::DEBUG::2014-07-10 08:24:12,386::lvm::415::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-1043::INFO::2014-07-10 08:24:12,388::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DC-REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2, 'domains': u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c:Active,6a70504d-00df-4869-8695-0f442053f6b6:Attached', 'master_uuid': 'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c': {'status': u'Active', 'diskfree': '1137495244800', 'isoprefix': '', 'alerts': [], 'disktotal': '1152393412608', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Attached', 'isoprefix': '', 'alerts': []}}} >Thread-1043::DEBUG::2014-07-10 08:24:12,390::task::1185::TaskManager.Task::(prepare) Task=`09d70fe0-2dd3-4ce9-ae0c-4285e7b0f2b8`::finished: {'info': {'name': 'DC-REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2, 'domains': u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c:Active,6a70504d-00df-4869-8695-0f442053f6b6:Attached', 'master_uuid': 'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c': {'status': u'Active', 'diskfree': '1137495244800', 'isoprefix': '', 'alerts': [], 'disktotal': '1152393412608', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Attached', 'isoprefix': '', 'alerts': []}}} >Thread-1043::DEBUG::2014-07-10 08:24:12,395::task::595::TaskManager.Task::(_updateState) Task=`09d70fe0-2dd3-4ce9-ae0c-4285e7b0f2b8`::moving from state preparing -> state finished >Thread-1043::DEBUG::2014-07-10 08:24:12,397::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9': < ResourceRef 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9', isValid: 'True' obj: 'None'>} >Thread-1043::DEBUG::2014-07-10 08:24:12,397::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1043::DEBUG::2014-07-10 08:24:12,402::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' >Thread-1043::DEBUG::2014-07-10 08:24:12,403::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' (0 active users) >Thread-1043::DEBUG::2014-07-10 08:24:12,403::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' is free, finding out if anyone is waiting for it. >Thread-1043::DEBUG::2014-07-10 08:24:12,403::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9', Clearing records. >Thread-1043::DEBUG::2014-07-10 08:24:12,403::task::990::TaskManager.Task::(_decref) Task=`09d70fe0-2dd3-4ce9-ae0c-4285e7b0f2b8`::ref 0 aborting False >Thread-15::DEBUG::2014-07-10 08:24:13,027::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/e01a3a36-d2ce-4153-bb57-d6e65b7ed08c/metadata bs=4096 count=1' (cwd None) >Thread-15::DEBUG::2014-07-10 08:24:13,086::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000734458 s, 5.6 MB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-07-10 08:24:13,707::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-07-10 08:24:13,852::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0397888 s, 25.7 MB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-07-10 08:24:15,868::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-07-10 08:24:16,000::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0332977 s, 30.8 MB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-07-10 08:24:18,016::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-07-10 08:24:18,152::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0382674 s, 26.8 MB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-07-10 08:24:20,161::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-07-10 08:24:20,295::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0323543 s, 31.6 MB/s\n'; <rc> = 0 >Thread-1042::DEBUG::2014-07-10 08:24:21,429::task::595::TaskManager.Task::(_updateState) Task=`994340ca-7b06-467e-80ce-8e07d2028048`::moving from state init -> state preparing >Thread-1042::INFO::2014-07-10 08:24:21,430::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-1042::INFO::2014-07-10 08:24:21,431::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000734458', 'lastCheck': '8.3', 'valid': True}} >Thread-1042::DEBUG::2014-07-10 08:24:21,431::task::1185::TaskManager.Task::(prepare) Task=`994340ca-7b06-467e-80ce-8e07d2028048`::finished: {u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000734458', 'lastCheck': '8.3', 'valid': True}} >Thread-1042::DEBUG::2014-07-10 08:24:21,431::task::595::TaskManager.Task::(_updateState) Task=`994340ca-7b06-467e-80ce-8e07d2028048`::moving from state preparing -> state finished >Thread-1042::DEBUG::2014-07-10 08:24:21,431::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-1042::DEBUG::2014-07-10 08:24:21,431::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1042::DEBUG::2014-07-10 08:24:21,432::task::990::TaskManager.Task::(_decref) Task=`994340ca-7b06-467e-80ce-8e07d2028048`::ref 0 aborting False >Dummy-36::DEBUG::2014-07-10 08:24:22,310::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Thread-1042::DEBUG::2014-07-10 08:24:22,426::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-1042::DEBUG::2014-07-10 08:24:22,433::task::595::TaskManager.Task::(_updateState) Task=`e36f2f9e-2ccd-4eda-ac82-61617dde61c4`::moving from state init -> state preparing >Thread-1042::INFO::2014-07-10 08:24:22,437::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='411039e4-4af2-4192-9de0-67dc1ed83ba9', options=None) >Thread-1042::INFO::2014-07-10 08:24:22,441::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2}} >Thread-1042::DEBUG::2014-07-10 08:24:22,444::task::1185::TaskManager.Task::(prepare) Task=`e36f2f9e-2ccd-4eda-ac82-61617dde61c4`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2}} >Thread-1042::DEBUG::2014-07-10 08:24:22,447::task::595::TaskManager.Task::(_updateState) Task=`e36f2f9e-2ccd-4eda-ac82-61617dde61c4`::moving from state preparing -> state finished >Thread-1042::DEBUG::2014-07-10 08:24:22,449::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-1042::DEBUG::2014-07-10 08:24:22,452::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1042::DEBUG::2014-07-10 08:24:22,455::task::990::TaskManager.Task::(_decref) Task=`e36f2f9e-2ccd-4eda-ac82-61617dde61c4`::ref 0 aborting False >Thread-1043::DEBUG::2014-07-10 08:24:22,470::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-1043::DEBUG::2014-07-10 08:24:22,475::task::595::TaskManager.Task::(_updateState) Task=`76e8f22c-eda3-432f-9c9a-133087926d1b`::moving from state init -> state preparing >Thread-1043::INFO::2014-07-10 08:24:22,478::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='411039e4-4af2-4192-9de0-67dc1ed83ba9', options=None) >Thread-1043::DEBUG::2014-07-10 08:24:22,485::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9`ReqID=`66afdfa5-9bfe-4218-a4d7-e0870b2a5504`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo' >Thread-1043::DEBUG::2014-07-10 08:24:22,488::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' for lock type 'shared' >Thread-1043::DEBUG::2014-07-10 08:24:22,492::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' is free. Now locking as 'shared' (1 active user) >Thread-1043::DEBUG::2014-07-10 08:24:22,495::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9`ReqID=`66afdfa5-9bfe-4218-a4d7-e0870b2a5504`::Granted request >Thread-1043::DEBUG::2014-07-10 08:24:22,501::task::827::TaskManager.Task::(resourceAcquired) Task=`76e8f22c-eda3-432f-9c9a-133087926d1b`::_resourcesAcquired: Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9 (shared) >Thread-1043::DEBUG::2014-07-10 08:24:22,504::task::990::TaskManager.Task::(_decref) Task=`76e8f22c-eda3-432f-9c9a-133087926d1b`::ref 1 aborting False >Thread-1043::INFO::2014-07-10 08:24:22,517::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DC-REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2, 'domains': u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c:Active,6a70504d-00df-4869-8695-0f442053f6b6:Attached', 'master_uuid': 'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c': {'status': u'Active', 'diskfree': '1137495244800', 'isoprefix': '', 'alerts': [], 'disktotal': '1152393412608', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Attached', 'isoprefix': '', 'alerts': []}}} >Thread-1043::DEBUG::2014-07-10 08:24:22,519::task::1185::TaskManager.Task::(prepare) Task=`76e8f22c-eda3-432f-9c9a-133087926d1b`::finished: {'info': {'name': 'DC-REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2, 'domains': u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c:Active,6a70504d-00df-4869-8695-0f442053f6b6:Attached', 'master_uuid': 'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c': {'status': u'Active', 'diskfree': '1137495244800', 'isoprefix': '', 'alerts': [], 'disktotal': '1152393412608', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Attached', 'isoprefix': '', 'alerts': []}}} >Thread-1043::DEBUG::2014-07-10 08:24:22,522::task::595::TaskManager.Task::(_updateState) Task=`76e8f22c-eda3-432f-9c9a-133087926d1b`::moving from state preparing -> state finished >Thread-1043::DEBUG::2014-07-10 08:24:22,524::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9': < ResourceRef 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9', isValid: 'True' obj: 'None'>} >Thread-1043::DEBUG::2014-07-10 08:24:22,527::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1043::DEBUG::2014-07-10 08:24:22,531::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' >Thread-1043::DEBUG::2014-07-10 08:24:22,534::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' (0 active users) >Thread-1043::DEBUG::2014-07-10 08:24:22,537::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' is free, finding out if anyone is waiting for it. >Thread-1043::DEBUG::2014-07-10 08:24:22,539::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9', Clearing records. >Thread-1043::DEBUG::2014-07-10 08:24:22,543::task::990::TaskManager.Task::(_decref) Task=`76e8f22c-eda3-432f-9c9a-133087926d1b`::ref 0 aborting False >Dummy-36::DEBUG::2014-07-10 08:24:22,575::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.038438 s, 26.6 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-07-10 08:24:23,116::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/e01a3a36-d2ce-4153-bb57-d6e65b7ed08c/metadata bs=4096 count=1' (cwd None) >Thread-15::DEBUG::2014-07-10 08:24:23,179::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000718229 s, 5.7 MB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-07-10 08:24:24,590::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-07-10 08:24:24,727::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.032321 s, 31.7 MB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-07-10 08:24:26,742::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-07-10 08:24:26,883::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0384307 s, 26.6 MB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-07-10 08:24:28,898::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-07-10 08:24:29,029::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0333777 s, 30.7 MB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-07-10 08:24:31,044::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-07-10 08:24:31,176::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0328142 s, 31.2 MB/s\n'; <rc> = 0 >Thread-1042::DEBUG::2014-07-10 08:24:32,571::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-1042::DEBUG::2014-07-10 08:24:32,573::task::595::TaskManager.Task::(_updateState) Task=`da6f3f95-015e-4032-9451-a845d8903cc3`::moving from state init -> state preparing >Thread-1042::INFO::2014-07-10 08:24:32,573::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='411039e4-4af2-4192-9de0-67dc1ed83ba9', options=None) >Thread-1042::INFO::2014-07-10 08:24:32,574::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2}} >Thread-1042::DEBUG::2014-07-10 08:24:32,574::task::1185::TaskManager.Task::(prepare) Task=`da6f3f95-015e-4032-9451-a845d8903cc3`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2}} >Thread-1042::DEBUG::2014-07-10 08:24:32,574::task::595::TaskManager.Task::(_updateState) Task=`da6f3f95-015e-4032-9451-a845d8903cc3`::moving from state preparing -> state finished >Thread-1042::DEBUG::2014-07-10 08:24:32,574::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-1042::DEBUG::2014-07-10 08:24:32,574::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1042::DEBUG::2014-07-10 08:24:32,575::task::990::TaskManager.Task::(_decref) Task=`da6f3f95-015e-4032-9451-a845d8903cc3`::ref 0 aborting False >Thread-1043::DEBUG::2014-07-10 08:24:32,579::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-1043::DEBUG::2014-07-10 08:24:32,579::task::595::TaskManager.Task::(_updateState) Task=`ae781ea8-3ba3-495a-87c3-353db8dfeef0`::moving from state init -> state preparing >Thread-1043::INFO::2014-07-10 08:24:32,579::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='411039e4-4af2-4192-9de0-67dc1ed83ba9', options=None) >Thread-1043::DEBUG::2014-07-10 08:24:32,582::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9`ReqID=`295c95fc-5b9e-4e34-aa01-be31cf1d23af`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo' >Thread-1043::DEBUG::2014-07-10 08:24:32,582::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' for lock type 'shared' >Thread-1043::DEBUG::2014-07-10 08:24:32,582::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' is free. Now locking as 'shared' (1 active user) >Thread-1043::DEBUG::2014-07-10 08:24:32,582::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9`ReqID=`295c95fc-5b9e-4e34-aa01-be31cf1d23af`::Granted request >Thread-1043::DEBUG::2014-07-10 08:24:32,583::task::827::TaskManager.Task::(resourceAcquired) Task=`ae781ea8-3ba3-495a-87c3-353db8dfeef0`::_resourcesAcquired: Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9 (shared) >Thread-1043::DEBUG::2014-07-10 08:24:32,583::task::990::TaskManager.Task::(_decref) Task=`ae781ea8-3ba3-495a-87c3-353db8dfeef0`::ref 1 aborting False >Thread-1043::INFO::2014-07-10 08:24:32,584::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DC-REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2, 'domains': u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c:Active,6a70504d-00df-4869-8695-0f442053f6b6:Attached', 'master_uuid': 'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c': {'status': u'Active', 'diskfree': '1137495244800', 'isoprefix': '', 'alerts': [], 'disktotal': '1152393412608', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Attached', 'isoprefix': '', 'alerts': []}}} >Thread-1043::DEBUG::2014-07-10 08:24:32,584::task::1185::TaskManager.Task::(prepare) Task=`ae781ea8-3ba3-495a-87c3-353db8dfeef0`::finished: {'info': {'name': 'DC-REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2, 'domains': u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c:Active,6a70504d-00df-4869-8695-0f442053f6b6:Attached', 'master_uuid': 'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c': {'status': u'Active', 'diskfree': '1137495244800', 'isoprefix': '', 'alerts': [], 'disktotal': '1152393412608', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Attached', 'isoprefix': '', 'alerts': []}}} >Thread-1043::DEBUG::2014-07-10 08:24:32,585::task::595::TaskManager.Task::(_updateState) Task=`ae781ea8-3ba3-495a-87c3-353db8dfeef0`::moving from state preparing -> state finished >Thread-1043::DEBUG::2014-07-10 08:24:32,585::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9': < ResourceRef 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9', isValid: 'True' obj: 'None'>} >Thread-1043::DEBUG::2014-07-10 08:24:32,585::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1043::DEBUG::2014-07-10 08:24:32,585::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' >Thread-1043::DEBUG::2014-07-10 08:24:32,586::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' (0 active users) >Thread-1043::DEBUG::2014-07-10 08:24:32,586::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' is free, finding out if anyone is waiting for it. >Thread-1043::DEBUG::2014-07-10 08:24:32,586::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9', Clearing records. >Thread-1043::DEBUG::2014-07-10 08:24:32,586::task::990::TaskManager.Task::(_decref) Task=`ae781ea8-3ba3-495a-87c3-353db8dfeef0`::ref 0 aborting False >Dummy-36::DEBUG::2014-07-10 08:24:33,191::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Thread-15::DEBUG::2014-07-10 08:24:33,249::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/e01a3a36-d2ce-4153-bb57-d6e65b7ed08c/metadata bs=4096 count=1' (cwd None) >Thread-15::DEBUG::2014-07-10 08:24:33,344::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00741447 s, 552 kB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-07-10 08:24:33,528::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.238396 s, 4.3 MB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-07-10 08:24:35,542::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-07-10 08:24:35,679::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.037628 s, 27.2 MB/s\n'; <rc> = 0 >Thread-1042::DEBUG::2014-07-10 08:24:36,699::task::595::TaskManager.Task::(_updateState) Task=`cdf9fa04-58b3-4341-926e-7457c1f26489`::moving from state init -> state preparing >Thread-1042::INFO::2014-07-10 08:24:36,700::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-1042::INFO::2014-07-10 08:24:36,701::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00741447', 'lastCheck': '3.2', 'valid': True}} >Thread-1042::DEBUG::2014-07-10 08:24:36,701::task::1185::TaskManager.Task::(prepare) Task=`cdf9fa04-58b3-4341-926e-7457c1f26489`::finished: {u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00741447', 'lastCheck': '3.2', 'valid': True}} >Thread-1042::DEBUG::2014-07-10 08:24:36,701::task::595::TaskManager.Task::(_updateState) Task=`cdf9fa04-58b3-4341-926e-7457c1f26489`::moving from state preparing -> state finished >Thread-1042::DEBUG::2014-07-10 08:24:36,701::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-1042::DEBUG::2014-07-10 08:24:36,701::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1042::DEBUG::2014-07-10 08:24:36,701::task::990::TaskManager.Task::(_decref) Task=`cdf9fa04-58b3-4341-926e-7457c1f26489`::ref 0 aborting False >Dummy-36::DEBUG::2014-07-10 08:24:37,695::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-07-10 08:24:37,832::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0346221 s, 29.6 MB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-07-10 08:24:39,847::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-07-10 08:24:39,983::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0379265 s, 27.0 MB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-07-10 08:24:42,000::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-07-10 08:24:42,135::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0351724 s, 29.1 MB/s\n'; <rc> = 0 >Thread-1042::DEBUG::2014-07-10 08:24:42,655::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-1042::DEBUG::2014-07-10 08:24:42,656::task::595::TaskManager.Task::(_updateState) Task=`6730553b-c3db-4b4d-ac3c-2f3b81094c7a`::moving from state init -> state preparing >Thread-1042::INFO::2014-07-10 08:24:42,656::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='411039e4-4af2-4192-9de0-67dc1ed83ba9', options=None) >Thread-1042::INFO::2014-07-10 08:24:42,656::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2}} >Thread-1042::DEBUG::2014-07-10 08:24:42,657::task::1185::TaskManager.Task::(prepare) Task=`6730553b-c3db-4b4d-ac3c-2f3b81094c7a`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2}} >Thread-1042::DEBUG::2014-07-10 08:24:42,657::task::595::TaskManager.Task::(_updateState) Task=`6730553b-c3db-4b4d-ac3c-2f3b81094c7a`::moving from state preparing -> state finished >Thread-1042::DEBUG::2014-07-10 08:24:42,657::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-1042::DEBUG::2014-07-10 08:24:42,657::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1042::DEBUG::2014-07-10 08:24:42,657::task::990::TaskManager.Task::(_decref) Task=`6730553b-c3db-4b4d-ac3c-2f3b81094c7a`::ref 0 aborting False >Thread-1043::DEBUG::2014-07-10 08:24:42,661::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-1043::DEBUG::2014-07-10 08:24:42,662::task::595::TaskManager.Task::(_updateState) Task=`b836da9c-213d-456a-abd7-8c26cb47d13a`::moving from state init -> state preparing >Thread-1043::INFO::2014-07-10 08:24:42,662::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='411039e4-4af2-4192-9de0-67dc1ed83ba9', options=None) >Thread-1043::DEBUG::2014-07-10 08:24:42,662::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9`ReqID=`e66072a9-73c2-4d4e-9794-ed65aeca51a3`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo' >Thread-1043::DEBUG::2014-07-10 08:24:42,663::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' for lock type 'shared' >Thread-1043::DEBUG::2014-07-10 08:24:42,663::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' is free. Now locking as 'shared' (1 active user) >Thread-1043::DEBUG::2014-07-10 08:24:42,663::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9`ReqID=`e66072a9-73c2-4d4e-9794-ed65aeca51a3`::Granted request >Thread-1043::DEBUG::2014-07-10 08:24:42,664::task::827::TaskManager.Task::(resourceAcquired) Task=`b836da9c-213d-456a-abd7-8c26cb47d13a`::_resourcesAcquired: Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9 (shared) >Thread-1043::DEBUG::2014-07-10 08:24:42,664::task::990::TaskManager.Task::(_decref) Task=`b836da9c-213d-456a-abd7-8c26cb47d13a`::ref 1 aborting False >Thread-1043::INFO::2014-07-10 08:24:42,665::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DC-REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2, 'domains': u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c:Active,6a70504d-00df-4869-8695-0f442053f6b6:Attached', 'master_uuid': 'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c': {'status': u'Active', 'diskfree': '1137495244800', 'isoprefix': '', 'alerts': [], 'disktotal': '1152393412608', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Attached', 'isoprefix': '', 'alerts': []}}} >Thread-1043::DEBUG::2014-07-10 08:24:42,665::task::1185::TaskManager.Task::(prepare) Task=`b836da9c-213d-456a-abd7-8c26cb47d13a`::finished: {'info': {'name': 'DC-REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2, 'domains': u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c:Active,6a70504d-00df-4869-8695-0f442053f6b6:Attached', 'master_uuid': 'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c': {'status': u'Active', 'diskfree': '1137495244800', 'isoprefix': '', 'alerts': [], 'disktotal': '1152393412608', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Attached', 'isoprefix': '', 'alerts': []}}} >Thread-1043::DEBUG::2014-07-10 08:24:42,665::task::595::TaskManager.Task::(_updateState) Task=`b836da9c-213d-456a-abd7-8c26cb47d13a`::moving from state preparing -> state finished >Thread-1043::DEBUG::2014-07-10 08:24:42,665::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9': < ResourceRef 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9', isValid: 'True' obj: 'None'>} >Thread-1043::DEBUG::2014-07-10 08:24:42,665::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1043::DEBUG::2014-07-10 08:24:42,666::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' >Thread-1043::DEBUG::2014-07-10 08:24:42,666::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' (0 active users) >Thread-1043::DEBUG::2014-07-10 08:24:42,666::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' is free, finding out if anyone is waiting for it. >Thread-1043::DEBUG::2014-07-10 08:24:42,666::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9', Clearing records. >Thread-1043::DEBUG::2014-07-10 08:24:42,666::task::990::TaskManager.Task::(_decref) Task=`b836da9c-213d-456a-abd7-8c26cb47d13a`::ref 0 aborting False >Thread-15::DEBUG::2014-07-10 08:24:43,475::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/e01a3a36-d2ce-4153-bb57-d6e65b7ed08c/metadata bs=4096 count=1' (cwd None) >Thread-15::DEBUG::2014-07-10 08:24:43,537::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000772868 s, 5.3 MB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-07-10 08:24:44,150::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-07-10 08:24:44,294::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0452691 s, 22.6 MB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-07-10 08:24:46,309::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-07-10 08:24:46,436::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0297159 s, 34.5 MB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-07-10 08:24:48,451::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-07-10 08:24:48,575::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0284792 s, 36.0 MB/s\n'; <rc> = 0 >Thread-1042::DEBUG::2014-07-10 08:24:50,432::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [5e7cc2dc] >Thread-1042::DEBUG::2014-07-10 08:24:50,433::task::595::TaskManager.Task::(_updateState) Task=`d87e79e6-7833-48ab-afbf-c524bc04f43b`::moving from state init -> state preparing >Thread-1042::INFO::2014-07-10 08:24:50,433::logUtils::44::dispatcher::(wrapper) Run and protect: connectStorageServer(domType=1, spUUID='00000000-0000-0000-0000-000000000000', conList=[{'connection': 'lion.qa.lab.tlv.redhat.com:/export/yuri2/backup2', 'iqn': '', 'user': '', 'tpgt': '1', 'password': '******', 'id': '22d965b8-f5e8-427d-8af6-dc707e6b84b5', 'port': ''}], options=None) >Thread-1042::DEBUG::2014-07-10 08:24:50,457::mount::202::Storage.Misc.excCmd::(_runcmd) '/usr/bin/sudo -n /bin/mount -t nfs -o soft,nosharecache,timeo=600,retrans=6,nfsvers=3 lion.qa.lab.tlv.redhat.com:/export/yuri2/backup2 /rhev/data-center/mnt/lion.qa.lab.tlv.redhat.com:_export_yuri2_backup2' (cwd None) >Dummy-36::DEBUG::2014-07-10 08:24:50,591::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Thread-1042::DEBUG::2014-07-10 08:24:50,870::hsm::2329::Storage.HSM::(__prefetchDomains) nfs local path: /rhev/data-center/mnt/lion.qa.lab.tlv.redhat.com:_export_yuri2_backup2 >Thread-1042::DEBUG::2014-07-10 08:24:50,882::hsm::2353::Storage.HSM::(__prefetchDomains) Found SD uuids: ('f34d0693-3747-467e-9a7c-8d73e8fb1171', 'cb15e53b-995b-47d6-b132-0ad9d148269e', '41530dea-409a-4a3d-ad8a-6f714a9b5986', '6a70504d-00df-4869-8695-0f442053f6b6', '33100657-451b-45f5-9a71-9fed8490e696') >Thread-1042::DEBUG::2014-07-10 08:24:50,885::hsm::2409::Storage.HSM::(connectStorageServer) knownSDs: {f34d0693-3747-467e-9a7c-8d73e8fb1171: storage.nfsSD.findDomain, 33100657-451b-45f5-9a71-9fed8490e696: storage.nfsSD.findDomain, 41530dea-409a-4a3d-ad8a-6f714a9b5986: storage.nfsSD.findDomain, 6a70504d-00df-4869-8695-0f442053f6b6: storage.nfsSD.findDomain, cb15e53b-995b-47d6-b132-0ad9d148269e: storage.nfsSD.findDomain} >Thread-1042::INFO::2014-07-10 08:24:50,887::logUtils::47::dispatcher::(wrapper) Run and protect: connectStorageServer, Return response: {'statuslist': [{'status': 0, 'id': '22d965b8-f5e8-427d-8af6-dc707e6b84b5'}]} >Thread-1042::DEBUG::2014-07-10 08:24:50,889::task::1185::TaskManager.Task::(prepare) Task=`d87e79e6-7833-48ab-afbf-c524bc04f43b`::finished: {'statuslist': [{'status': 0, 'id': '22d965b8-f5e8-427d-8af6-dc707e6b84b5'}]} >Thread-1042::DEBUG::2014-07-10 08:24:50,891::task::595::TaskManager.Task::(_updateState) Task=`d87e79e6-7833-48ab-afbf-c524bc04f43b`::moving from state preparing -> state finished >Thread-1042::DEBUG::2014-07-10 08:24:50,893::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-1042::DEBUG::2014-07-10 08:24:50,895::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1042::DEBUG::2014-07-10 08:24:50,898::task::990::TaskManager.Task::(_decref) Task=`d87e79e6-7833-48ab-afbf-c524bc04f43b`::ref 0 aborting False >Thread-1043::DEBUG::2014-07-10 08:24:50,914::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [1dce38d1] >Thread-1043::DEBUG::2014-07-10 08:24:50,918::task::595::TaskManager.Task::(_updateState) Task=`adfce83e-d6de-4652-bc6f-bb77ebd91ca7`::moving from state init -> state preparing >Thread-1043::INFO::2014-07-10 08:24:50,921::logUtils::44::dispatcher::(wrapper) Run and protect: detachStorageDomain(sdUUID='6a70504d-00df-4869-8695-0f442053f6b6', spUUID='411039e4-4af2-4192-9de0-67dc1ed83ba9', msdUUID='00000000-0000-0000-0000-000000000000', masterVersion=1, options=None) >Thread-1043::DEBUG::2014-07-10 08:24:50,926::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9`ReqID=`da532d3b-f7e2-4c12-8504-f4895082cc4b`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '806' at 'detachStorageDomain' >Thread-1043::DEBUG::2014-07-10 08:24:50,928::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' for lock type 'exclusive' >Thread-1043::DEBUG::2014-07-10 08:24:50,931::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' is free. Now locking as 'exclusive' (1 active user) >Thread-1043::DEBUG::2014-07-10 08:24:50,933::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9`ReqID=`da532d3b-f7e2-4c12-8504-f4895082cc4b`::Granted request >Thread-1043::DEBUG::2014-07-10 08:24:50,938::task::827::TaskManager.Task::(resourceAcquired) Task=`adfce83e-d6de-4652-bc6f-bb77ebd91ca7`::_resourcesAcquired: Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9 (exclusive) >Thread-1043::DEBUG::2014-07-10 08:24:50,940::task::990::TaskManager.Task::(_decref) Task=`adfce83e-d6de-4652-bc6f-bb77ebd91ca7`::ref 1 aborting False >Thread-1043::DEBUG::2014-07-10 08:24:50,945::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.6a70504d-00df-4869-8695-0f442053f6b6`ReqID=`2d89bff7-f8ec-46ab-aa00-25029f95f439`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '807' at 'detachStorageDomain' >Thread-1043::DEBUG::2014-07-10 08:24:50,946::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.6a70504d-00df-4869-8695-0f442053f6b6' for lock type 'exclusive' >Thread-1043::DEBUG::2014-07-10 08:24:50,949::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.6a70504d-00df-4869-8695-0f442053f6b6' is free. Now locking as 'exclusive' (1 active user) >Thread-1043::DEBUG::2014-07-10 08:24:50,951::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.6a70504d-00df-4869-8695-0f442053f6b6`ReqID=`2d89bff7-f8ec-46ab-aa00-25029f95f439`::Granted request >Thread-1043::DEBUG::2014-07-10 08:24:50,955::task::827::TaskManager.Task::(resourceAcquired) Task=`adfce83e-d6de-4652-bc6f-bb77ebd91ca7`::_resourcesAcquired: Storage.6a70504d-00df-4869-8695-0f442053f6b6 (exclusive) >Thread-1043::DEBUG::2014-07-10 08:24:50,957::task::990::TaskManager.Task::(_decref) Task=`adfce83e-d6de-4652-bc6f-bb77ebd91ca7`::ref 1 aborting False >Thread-1043::INFO::2014-07-10 08:24:50,959::sp::947::Storage.StoragePool::(detachSD) sdUUID=6a70504d-00df-4869-8695-0f442053f6b6 spUUID=411039e4-4af2-4192-9de0-67dc1ed83ba9 >Thread-1043::DEBUG::2014-07-10 08:24:50,961::misc::756::SamplingMethod::(__call__) Trying to enter sampling method (storage.sdc.refreshStorage) >Thread-1043::DEBUG::2014-07-10 08:24:50,963::misc::758::SamplingMethod::(__call__) Got in to sampling method >Thread-1043::DEBUG::2014-07-10 08:24:50,967::misc::756::SamplingMethod::(__call__) Trying to enter sampling method (storage.iscsi.rescan) >Thread-1043::DEBUG::2014-07-10 08:24:50,969::misc::758::SamplingMethod::(__call__) Got in to sampling method >Thread-1043::DEBUG::2014-07-10 08:24:50,971::iscsi::407::Storage.ISCSI::(rescan) Performing SCSI scan, this will take up to 30 seconds >Thread-1043::DEBUG::2014-07-10 08:24:50,974::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) '/usr/bin/sudo -n /sbin/iscsiadm -m session -R' (cwd None) >Thread-1043::DEBUG::2014-07-10 08:24:51,061::misc::766::SamplingMethod::(__call__) Returning last result >Thread-1043::DEBUG::2014-07-10 08:24:51,068::multipath::110::Storage.Misc.excCmd::(rescan) '/usr/bin/sudo -n /sbin/multipath -r' (cwd None) >Dummy-36::DEBUG::2014-07-10 08:24:51,134::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.210582 s, 4.9 MB/s\n'; <rc> = 0 >Thread-1043::DEBUG::2014-07-10 08:24:51,313::multipath::110::Storage.Misc.excCmd::(rescan) SUCCESS: <err> = ''; <rc> = 0 >Thread-1043::DEBUG::2014-07-10 08:24:51,314::lvm::497::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-1043::DEBUG::2014-07-10 08:24:51,314::lvm::499::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-1043::DEBUG::2014-07-10 08:24:51,314::lvm::508::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-1043::DEBUG::2014-07-10 08:24:51,314::lvm::510::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-1043::DEBUG::2014-07-10 08:24:51,315::lvm::528::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-1043::DEBUG::2014-07-10 08:24:51,315::lvm::530::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-1043::DEBUG::2014-07-10 08:24:51,315::misc::766::SamplingMethod::(__call__) Returning last result >Thread-1043::DEBUG::2014-07-10 08:24:51,350::fileSD::150::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/lion.qa.lab.tlv.redhat.com:_export_yuri2_backup2/6a70504d-00df-4869-8695-0f442053f6b6 >Thread-1043::DEBUG::2014-07-10 08:24:51,352::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend >Thread-1043::DEBUG::2014-07-10 08:24:51,356::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Backup', 'DESCRIPTION=test', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=0', 'POOL_UUID=411039e4-4af2-4192-9de0-67dc1ed83ba9', 'REMOTE_PATH=lion.qa.lab.tlv.redhat.com:/export/yuri2/backup2', 'ROLE=Regular', 'SDUUID=6a70504d-00df-4869-8695-0f442053f6b6', 'TYPE=NFS', 'VERSION=0', '_SHA_CKSUM=c52897a45cbc3ed0a0146ef350774e5cecebe6cf'] >Thread-1043::DEBUG::2014-07-10 08:24:51,358::fileSD::609::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images [] >Thread-1043::INFO::2014-07-10 08:24:51,359::sd::384::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 6a70504d-00df-4869-8695-0f442053f6b6_imageNS already registered >Thread-1043::INFO::2014-07-10 08:24:51,359::sd::392::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 6a70504d-00df-4869-8695-0f442053f6b6_volumeNS already registered >Thread-1043::DEBUG::2014-07-10 08:24:51,362::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Backup', 'DESCRIPTION=test', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=0', 'POOL_UUID=411039e4-4af2-4192-9de0-67dc1ed83ba9', 'REMOTE_PATH=lion.qa.lab.tlv.redhat.com:/export/yuri2/backup2', 'ROLE=Regular', 'SDUUID=6a70504d-00df-4869-8695-0f442053f6b6', 'TYPE=NFS', 'VERSION=0', '_SHA_CKSUM=c52897a45cbc3ed0a0146ef350774e5cecebe6cf'] >Thread-1043::DEBUG::2014-07-10 08:24:51,362::persistentDict::167::Storage.PersistentDict::(transaction) Starting transaction >Thread-1043::DEBUG::2014-07-10 08:24:51,362::persistentDict::160::Storage.PersistentDict::(transaction) Reusing active transaction >Thread-1043::DEBUG::2014-07-10 08:24:51,362::persistentDict::160::Storage.PersistentDict::(transaction) Reusing active transaction >Thread-1043::DEBUG::2014-07-10 08:24:51,363::persistentDict::173::Storage.PersistentDict::(transaction) Flushing changes >Thread-1043::DEBUG::2014-07-10 08:24:51,363::persistentDict::299::Storage.PersistentDict::(flush) about to write lines (FileMetadataRW)=['CLASS=Backup', 'DESCRIPTION=test', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=0', 'POOL_UUID=', 'REMOTE_PATH=lion.qa.lab.tlv.redhat.com:/export/yuri2/backup2', 'ROLE=Regular', 'SDUUID=6a70504d-00df-4869-8695-0f442053f6b6', 'TYPE=NFS', 'VERSION=0', '_SHA_CKSUM=25fcf6f5195d1012468ec6c2844cb2ea77f111c8'] >Thread-1043::DEBUG::2014-07-10 08:24:51,365::persistentDict::175::Storage.PersistentDict::(transaction) Finished transaction >Thread-1043::WARNING::2014-07-10 08:24:51,366::sp::920::Storage.StoragePool::(forcedDetachSD) Force detaching domain `6a70504d-00df-4869-8695-0f442053f6b6` >Thread-1043::DEBUG::2014-07-10 08:24:51,366::persistentDict::167::Storage.PersistentDict::(transaction) Starting transaction >Thread-1043::DEBUG::2014-07-10 08:24:51,366::persistentDict::173::Storage.PersistentDict::(transaction) Flushing changes >Thread-1043::DEBUG::2014-07-10 08:24:51,367::persistentDict::299::Storage.PersistentDict::(flush) about to write lines (VGTagMetadataRW)=['CLASS=Data', 'DESCRIPTION=SD-REAL', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'LOGBLKSIZE=512', 'MASTER_VERSION=1', 'PHYBLKSIZE=512', 'POOL_DESCRIPTION=DC-REAL', u'POOL_DOMAINS=e01a3a36-d2ce-4153-bb57-d6e65b7ed08c:Active', 'POOL_SPM_ID=1', 'POOL_SPM_LVER=2', 'POOL_UUID=411039e4-4af2-4192-9de0-67dc1ed83ba9', u'PV0=pv:3600601601282300032826addbbdae311,uuid:ZdReOp-Yf8A-beQm-ne4I-pN3J-rxgm-9Ew0S1,pestart:0,pecount:8189,mapoffset:0', u'PV1=pv:360060160f4a030003840ec867ddee311,uuid:0eUwla-dsA3-g6ia-RU23-cual-0rt9-KzkxLj,pestart:0,pecount:397,mapoffset:8189', 'ROLE=Master', 'SDUUID=e01a3a36-d2ce-4153-bb57-d6e65b7ed08c', 'TYPE=ISCSI', 'VERSION=3', 'VGUUID=GJcVo5-Y0kU-CDub-zITS-zfoL-Z7hz-SeVeIe', '_SHA_CKSUM=bd2f6e0ca6c4678becab320fc25aa34fafae4056'] >Thread-1043::DEBUG::2014-07-10 08:24:51,367::lvm::503::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-1043::DEBUG::2014-07-10 08:24:51,367::lvm::505::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-1043::DEBUG::2014-07-10 08:24:51,368::lvm::513::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-1043::DEBUG::2014-07-10 08:24:51,368::lvm::525::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-1043::DEBUG::2014-07-10 08:24:51,368::lvm::373::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-1043::DEBUG::2014-07-10 08:24:51,372::lvm::296::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/3600601601282300032826addbbdae311|/dev/mapper/360060160f4a030003840ec867ddee311|/dev/mapper/367cad74c2fcba00019e6afd20c781e67|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name e01a3a36-d2ce-4153-bb57-d6e65b7ed08c' (cwd None) >Thread-1043::DEBUG::2014-07-10 08:24:51,653::lvm::296::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-1043::DEBUG::2014-07-10 08:24:51,655::lvm::415::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-1043::DEBUG::2014-07-10 08:24:51,656::blockSD::315::storage.Metadata.VGTagMetadataRW::(writelines) Updating metadata adding=MDT__SHA_CKSUM=bd2f6e0ca6c4678becab320fc25aa34fafae4056, MDT_POOL_DOMAINS=e01a3a36-d2ce-4153-bb57-d6e65b7ed08c:Active removing=MDT__SHA_CKSUM=b8ab8f69e4ce521efe60d540821bb40a90656f83, MDT_POOL_DOMAINS=6a70504d-00df-4869-8695-0f442053f6b6:Attached&44&e01a3a36-d2ce-4153-bb57-d6e65b7ed08c:Active >Thread-1043::DEBUG::2014-07-10 08:24:51,657::lvm::296::Storage.Misc.excCmd::(cmd) u'/usr/bin/sudo -n /sbin/lvm vgchange --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/3600601601282300032826addbbdae311|/dev/mapper/360060160f4a030003840ec867ddee311|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } " --deltag MDT__SHA_CKSUM=b8ab8f69e4ce521efe60d540821bb40a90656f83 --deltag MDT_POOL_DOMAINS=6a70504d-00df-4869-8695-0f442053f6b6:Attached&44&e01a3a36-d2ce-4153-bb57-d6e65b7ed08c:Active --addtag MDT_POOL_DOMAINS=e01a3a36-d2ce-4153-bb57-d6e65b7ed08c:Active --addtag MDT__SHA_CKSUM=bd2f6e0ca6c4678becab320fc25aa34fafae4056 e01a3a36-d2ce-4153-bb57-d6e65b7ed08c' (cwd None) >Thread-1042::DEBUG::2014-07-10 08:24:51,841::task::595::TaskManager.Task::(_updateState) Task=`7fb3fa02-68d2-4f6f-b117-ecd7f4749910`::moving from state init -> state preparing >Thread-1042::INFO::2014-07-10 08:24:51,842::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-1042::INFO::2014-07-10 08:24:51,842::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000772868', 'lastCheck': '8.3', 'valid': True}} >Thread-1042::DEBUG::2014-07-10 08:24:51,843::task::1185::TaskManager.Task::(prepare) Task=`7fb3fa02-68d2-4f6f-b117-ecd7f4749910`::finished: {u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000772868', 'lastCheck': '8.3', 'valid': True}} >Thread-1042::DEBUG::2014-07-10 08:24:51,843::task::595::TaskManager.Task::(_updateState) Task=`7fb3fa02-68d2-4f6f-b117-ecd7f4749910`::moving from state preparing -> state finished >Thread-1042::DEBUG::2014-07-10 08:24:51,843::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-1042::DEBUG::2014-07-10 08:24:51,844::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1042::DEBUG::2014-07-10 08:24:51,844::task::990::TaskManager.Task::(_decref) Task=`7fb3fa02-68d2-4f6f-b117-ecd7f4749910`::ref 0 aborting False >Thread-1043::DEBUG::2014-07-10 08:24:51,942::lvm::296::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-1043::DEBUG::2014-07-10 08:24:51,943::lvm::503::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-1043::DEBUG::2014-07-10 08:24:51,943::lvm::505::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-1043::DEBUG::2014-07-10 08:24:51,943::persistentDict::175::Storage.PersistentDict::(transaction) Finished transaction >Thread-1043::DEBUG::2014-07-10 08:24:51,944::misc::756::SamplingMethod::(__call__) Trying to enter sampling method (storage.sp.updateMonitoringThreads) >Thread-1043::DEBUG::2014-07-10 08:24:51,944::misc::758::SamplingMethod::(__call__) Got in to sampling method >Thread-1043::DEBUG::2014-07-10 08:24:51,944::misc::766::SamplingMethod::(__call__) Returning last result >Thread-1043::DEBUG::2014-07-10 08:24:51,945::sp::937::Storage.StoragePool::(forcedDetachSD) Force detach for domain `6a70504d-00df-4869-8695-0f442053f6b6` is done >Thread-1043::INFO::2014-07-10 08:24:51,945::logUtils::47::dispatcher::(wrapper) Run and protect: detachStorageDomain, Return response: None >Thread-1043::DEBUG::2014-07-10 08:24:51,945::task::1185::TaskManager.Task::(prepare) Task=`adfce83e-d6de-4652-bc6f-bb77ebd91ca7`::finished: None >Thread-1043::DEBUG::2014-07-10 08:24:51,945::task::595::TaskManager.Task::(_updateState) Task=`adfce83e-d6de-4652-bc6f-bb77ebd91ca7`::moving from state preparing -> state finished >Thread-1043::DEBUG::2014-07-10 08:24:51,945::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9': < ResourceRef 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9', isValid: 'True' obj: 'None'>, 'Storage.6a70504d-00df-4869-8695-0f442053f6b6': < ResourceRef 'Storage.6a70504d-00df-4869-8695-0f442053f6b6', isValid: 'True' obj: 'None'>} >Thread-1043::DEBUG::2014-07-10 08:24:51,946::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1043::DEBUG::2014-07-10 08:24:51,946::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' >Thread-1043::DEBUG::2014-07-10 08:24:51,946::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' (0 active users) >Thread-1043::DEBUG::2014-07-10 08:24:51,947::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' is free, finding out if anyone is waiting for it. >Thread-1043::DEBUG::2014-07-10 08:24:51,947::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9', Clearing records. >Thread-1043::DEBUG::2014-07-10 08:24:51,947::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.6a70504d-00df-4869-8695-0f442053f6b6' >Thread-1043::DEBUG::2014-07-10 08:24:51,947::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.6a70504d-00df-4869-8695-0f442053f6b6' (0 active users) >Thread-1043::DEBUG::2014-07-10 08:24:51,947::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.6a70504d-00df-4869-8695-0f442053f6b6' is free, finding out if anyone is waiting for it. >Thread-1043::DEBUG::2014-07-10 08:24:51,948::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.6a70504d-00df-4869-8695-0f442053f6b6', Clearing records. >Thread-1043::DEBUG::2014-07-10 08:24:51,948::task::990::TaskManager.Task::(_decref) Task=`adfce83e-d6de-4652-bc6f-bb77ebd91ca7`::ref 0 aborting False >Thread-1042::DEBUG::2014-07-10 08:24:51,964::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [1dce38d1] >Thread-1042::DEBUG::2014-07-10 08:24:51,964::task::595::TaskManager.Task::(_updateState) Task=`d68ace7d-6cdf-41a0-99c7-972baaa09e2c`::moving from state init -> state preparing >Thread-1042::INFO::2014-07-10 08:24:51,965::logUtils::44::dispatcher::(wrapper) Run and protect: refreshStoragePool(spUUID='411039e4-4af2-4192-9de0-67dc1ed83ba9', msdUUID='e01a3a36-d2ce-4153-bb57-d6e65b7ed08c', masterVersion=1, options=None) >Thread-1042::DEBUG::2014-07-10 08:24:51,965::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9`ReqID=`ad65cff9-eaea-4997-af49-9b871db004e8`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '870' at 'refreshStoragePool' >Thread-1042::DEBUG::2014-07-10 08:24:51,966::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' for lock type 'shared' >Thread-1042::DEBUG::2014-07-10 08:24:51,966::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' is free. Now locking as 'shared' (1 active user) >Thread-1042::DEBUG::2014-07-10 08:24:51,966::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9`ReqID=`ad65cff9-eaea-4997-af49-9b871db004e8`::Granted request >Thread-1042::DEBUG::2014-07-10 08:24:51,967::task::827::TaskManager.Task::(resourceAcquired) Task=`d68ace7d-6cdf-41a0-99c7-972baaa09e2c`::_resourcesAcquired: Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9 (shared) >Thread-1042::DEBUG::2014-07-10 08:24:51,967::task::990::TaskManager.Task::(_decref) Task=`d68ace7d-6cdf-41a0-99c7-972baaa09e2c`::ref 1 aborting False >Thread-1042::INFO::2014-07-10 08:24:51,967::hsm::879::Storage.HSM::(refreshStoragePool) Ignoring the refreshStoragePool request (the host is the SPM) >Thread-1042::INFO::2014-07-10 08:24:51,967::logUtils::47::dispatcher::(wrapper) Run and protect: refreshStoragePool, Return response: None >Thread-1042::DEBUG::2014-07-10 08:24:51,968::task::1185::TaskManager.Task::(prepare) Task=`d68ace7d-6cdf-41a0-99c7-972baaa09e2c`::finished: None >Thread-1042::DEBUG::2014-07-10 08:24:51,968::task::595::TaskManager.Task::(_updateState) Task=`d68ace7d-6cdf-41a0-99c7-972baaa09e2c`::moving from state preparing -> state finished >Thread-1042::DEBUG::2014-07-10 08:24:51,968::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9': < ResourceRef 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9', isValid: 'True' obj: 'None'>} >Thread-1042::DEBUG::2014-07-10 08:24:51,968::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1042::DEBUG::2014-07-10 08:24:51,968::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' >Thread-1042::DEBUG::2014-07-10 08:24:51,969::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' (0 active users) >Thread-1042::DEBUG::2014-07-10 08:24:51,969::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' is free, finding out if anyone is waiting for it. >Thread-1042::DEBUG::2014-07-10 08:24:51,969::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9', Clearing records. >Thread-1042::DEBUG::2014-07-10 08:24:51,969::task::990::TaskManager.Task::(_decref) Task=`d68ace7d-6cdf-41a0-99c7-972baaa09e2c`::ref 0 aborting False >Thread-1042::DEBUG::2014-07-10 08:24:51,975::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [599ac598] >Thread-1042::DEBUG::2014-07-10 08:24:51,976::task::595::TaskManager.Task::(_updateState) Task=`bf454341-14e1-4c12-b6af-f289eac700cd`::moving from state init -> state preparing >Thread-1042::INFO::2014-07-10 08:24:51,976::logUtils::44::dispatcher::(wrapper) Run and protect: disconnectStorageServer(domType=1, spUUID='00000000-0000-0000-0000-000000000000', conList=[{'connection': 'lion.qa.lab.tlv.redhat.com:/export/yuri2/backup2', 'iqn': '', 'user': '', 'tpgt': '1', 'password': '******', 'id': '22d965b8-f5e8-427d-8af6-dc707e6b84b5', 'port': ''}], options=None) >Thread-1042::DEBUG::2014-07-10 08:24:51,977::mount::202::Storage.Misc.excCmd::(_runcmd) '/usr/bin/sudo -n /bin/umount -f -l /rhev/data-center/mnt/lion.qa.lab.tlv.redhat.com:_export_yuri2_backup2' (cwd None) >Thread-1042::DEBUG::2014-07-10 08:24:52,128::misc::756::SamplingMethod::(__call__) Trying to enter sampling method (storage.sdc.refreshStorage) >Thread-1042::DEBUG::2014-07-10 08:24:52,129::misc::758::SamplingMethod::(__call__) Got in to sampling method >Thread-1042::DEBUG::2014-07-10 08:24:52,129::misc::756::SamplingMethod::(__call__) Trying to enter sampling method (storage.iscsi.rescan) >Thread-1042::DEBUG::2014-07-10 08:24:52,129::misc::758::SamplingMethod::(__call__) Got in to sampling method >Thread-1042::DEBUG::2014-07-10 08:24:52,130::iscsi::407::Storage.ISCSI::(rescan) Performing SCSI scan, this will take up to 30 seconds >Thread-1042::DEBUG::2014-07-10 08:24:52,130::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) '/usr/bin/sudo -n /sbin/iscsiadm -m session -R' (cwd None) >Thread-1042::DEBUG::2014-07-10 08:24:52,211::misc::766::SamplingMethod::(__call__) Returning last result >Thread-1042::DEBUG::2014-07-10 08:24:52,212::multipath::110::Storage.Misc.excCmd::(rescan) '/usr/bin/sudo -n /sbin/multipath -r' (cwd None) >Thread-1042::DEBUG::2014-07-10 08:24:52,409::multipath::110::Storage.Misc.excCmd::(rescan) SUCCESS: <err> = ''; <rc> = 0 >Thread-1042::DEBUG::2014-07-10 08:24:52,410::lvm::497::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-1042::DEBUG::2014-07-10 08:24:52,410::lvm::499::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-1042::DEBUG::2014-07-10 08:24:52,411::lvm::508::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-1042::DEBUG::2014-07-10 08:24:52,411::lvm::510::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-1042::DEBUG::2014-07-10 08:24:52,411::lvm::528::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-1042::DEBUG::2014-07-10 08:24:52,411::lvm::530::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-1042::DEBUG::2014-07-10 08:24:52,412::misc::766::SamplingMethod::(__call__) Returning last result >Thread-1042::INFO::2014-07-10 08:24:52,412::logUtils::47::dispatcher::(wrapper) Run and protect: disconnectStorageServer, Return response: {'statuslist': [{'status': 0, 'id': '22d965b8-f5e8-427d-8af6-dc707e6b84b5'}]} >Thread-1042::DEBUG::2014-07-10 08:24:52,412::task::1185::TaskManager.Task::(prepare) Task=`bf454341-14e1-4c12-b6af-f289eac700cd`::finished: {'statuslist': [{'status': 0, 'id': '22d965b8-f5e8-427d-8af6-dc707e6b84b5'}]} >Thread-1042::DEBUG::2014-07-10 08:24:52,412::task::595::TaskManager.Task::(_updateState) Task=`bf454341-14e1-4c12-b6af-f289eac700cd`::moving from state preparing -> state finished >Thread-1042::DEBUG::2014-07-10 08:24:52,413::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-1042::DEBUG::2014-07-10 08:24:52,413::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1042::DEBUG::2014-07-10 08:24:52,413::task::990::TaskManager.Task::(_decref) Task=`bf454341-14e1-4c12-b6af-f289eac700cd`::ref 0 aborting False >Thread-1042::DEBUG::2014-07-10 08:24:52,697::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-1042::DEBUG::2014-07-10 08:24:52,698::task::595::TaskManager.Task::(_updateState) Task=`c76af528-92eb-4ff1-9025-b0a6555671b4`::moving from state init -> state preparing >Thread-1042::INFO::2014-07-10 08:24:52,698::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='411039e4-4af2-4192-9de0-67dc1ed83ba9', options=None) >Thread-1042::INFO::2014-07-10 08:24:52,699::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2}} >Thread-1042::DEBUG::2014-07-10 08:24:52,699::task::1185::TaskManager.Task::(prepare) Task=`c76af528-92eb-4ff1-9025-b0a6555671b4`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2}} >Thread-1042::DEBUG::2014-07-10 08:24:52,699::task::595::TaskManager.Task::(_updateState) Task=`c76af528-92eb-4ff1-9025-b0a6555671b4`::moving from state preparing -> state finished >Thread-1042::DEBUG::2014-07-10 08:24:52,700::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-1042::DEBUG::2014-07-10 08:24:52,700::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1042::DEBUG::2014-07-10 08:24:52,700::task::990::TaskManager.Task::(_decref) Task=`c76af528-92eb-4ff1-9025-b0a6555671b4`::ref 0 aborting False >Thread-1043::DEBUG::2014-07-10 08:24:52,704::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-1043::DEBUG::2014-07-10 08:24:52,704::task::595::TaskManager.Task::(_updateState) Task=`ec0dcad6-c19f-47cc-be11-c7afa7868688`::moving from state init -> state preparing >Thread-1043::INFO::2014-07-10 08:24:52,705::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='411039e4-4af2-4192-9de0-67dc1ed83ba9', options=None) >Thread-1043::DEBUG::2014-07-10 08:24:52,705::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9`ReqID=`3e08223d-6eae-4c10-8a3c-e3bcc1bc7d50`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo' >Thread-1043::DEBUG::2014-07-10 08:24:52,705::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' for lock type 'shared' >Thread-1043::DEBUG::2014-07-10 08:24:52,706::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' is free. Now locking as 'shared' (1 active user) >Thread-1043::DEBUG::2014-07-10 08:24:52,706::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9`ReqID=`3e08223d-6eae-4c10-8a3c-e3bcc1bc7d50`::Granted request >Thread-1043::DEBUG::2014-07-10 08:24:52,707::task::827::TaskManager.Task::(resourceAcquired) Task=`ec0dcad6-c19f-47cc-be11-c7afa7868688`::_resourcesAcquired: Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9 (shared) >Thread-1043::DEBUG::2014-07-10 08:24:52,707::task::990::TaskManager.Task::(_decref) Task=`ec0dcad6-c19f-47cc-be11-c7afa7868688`::ref 1 aborting False >Thread-1043::DEBUG::2014-07-10 08:24:52,707::lvm::373::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-1043::DEBUG::2014-07-10 08:24:52,711::lvm::296::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/3600601601282300032826addbbdae311|/dev/mapper/360060160f4a030003840ec867ddee311|/dev/mapper/367cad74c2fcba00019e6afd20c781e67|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name e01a3a36-d2ce-4153-bb57-d6e65b7ed08c' (cwd None) >Thread-1043::DEBUG::2014-07-10 08:24:52,977::lvm::296::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-1043::DEBUG::2014-07-10 08:24:52,980::lvm::415::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-1043::INFO::2014-07-10 08:24:52,981::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DC-REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2, 'domains': u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c:Active', 'master_uuid': 'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c': {'status': u'Active', 'diskfree': '1137495244800', 'isoprefix': '', 'alerts': [], 'disktotal': '1152393412608', 'version': 3}}} >Thread-1043::DEBUG::2014-07-10 08:24:52,981::task::1185::TaskManager.Task::(prepare) Task=`ec0dcad6-c19f-47cc-be11-c7afa7868688`::finished: {'info': {'name': 'DC-REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2, 'domains': u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c:Active', 'master_uuid': 'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c': {'status': u'Active', 'diskfree': '1137495244800', 'isoprefix': '', 'alerts': [], 'disktotal': '1152393412608', 'version': 3}}} >Thread-1043::DEBUG::2014-07-10 08:24:52,981::task::595::TaskManager.Task::(_updateState) Task=`ec0dcad6-c19f-47cc-be11-c7afa7868688`::moving from state preparing -> state finished >Thread-1043::DEBUG::2014-07-10 08:24:52,982::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9': < ResourceRef 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9', isValid: 'True' obj: 'None'>} >Thread-1043::DEBUG::2014-07-10 08:24:52,982::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1043::DEBUG::2014-07-10 08:24:52,982::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' >Thread-1043::DEBUG::2014-07-10 08:24:52,983::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' (0 active users) >Thread-1043::DEBUG::2014-07-10 08:24:52,983::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' is free, finding out if anyone is waiting for it. >Thread-1043::DEBUG::2014-07-10 08:24:52,983::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9', Clearing records. >Thread-1043::DEBUG::2014-07-10 08:24:52,983::task::990::TaskManager.Task::(_decref) Task=`ec0dcad6-c19f-47cc-be11-c7afa7868688`::ref 0 aborting False >Dummy-36::DEBUG::2014-07-10 08:24:53,149::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-07-10 08:24:53,284::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0370459 s, 27.6 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-07-10 08:24:53,565::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/e01a3a36-d2ce-4153-bb57-d6e65b7ed08c/metadata bs=4096 count=1' (cwd None) >Thread-15::DEBUG::2014-07-10 08:24:53,656::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.029388 s, 139 kB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-07-10 08:24:55,300::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-07-10 08:24:55,428::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0325036 s, 31.5 MB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-07-10 08:24:57,444::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-07-10 08:24:57,587::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0434973 s, 23.5 MB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-07-10 08:24:59,602::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-07-10 08:24:59,740::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.039464 s, 25.9 MB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-07-10 08:25:01,762::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-07-10 08:25:01,927::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0442092 s, 23.2 MB/s\n'; <rc> = 0 >Thread-1042::DEBUG::2014-07-10 08:25:03,001::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-1042::DEBUG::2014-07-10 08:25:03,002::task::595::TaskManager.Task::(_updateState) Task=`9299625b-984e-4bae-bef8-89d3023ef3e9`::moving from state init -> state preparing >Thread-1042::INFO::2014-07-10 08:25:03,003::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='411039e4-4af2-4192-9de0-67dc1ed83ba9', options=None) >Thread-1042::INFO::2014-07-10 08:25:03,003::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2}} >Thread-1042::DEBUG::2014-07-10 08:25:03,004::task::1185::TaskManager.Task::(prepare) Task=`9299625b-984e-4bae-bef8-89d3023ef3e9`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2}} >Thread-1042::DEBUG::2014-07-10 08:25:03,004::task::595::TaskManager.Task::(_updateState) Task=`9299625b-984e-4bae-bef8-89d3023ef3e9`::moving from state preparing -> state finished >Thread-1042::DEBUG::2014-07-10 08:25:03,004::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-1042::DEBUG::2014-07-10 08:25:03,004::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1042::DEBUG::2014-07-10 08:25:03,004::task::990::TaskManager.Task::(_decref) Task=`9299625b-984e-4bae-bef8-89d3023ef3e9`::ref 0 aborting False >Thread-1043::DEBUG::2014-07-10 08:25:03,008::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-1043::DEBUG::2014-07-10 08:25:03,009::task::595::TaskManager.Task::(_updateState) Task=`578b9eb5-5afa-4940-af35-5947ae94b7a0`::moving from state init -> state preparing >Thread-1043::INFO::2014-07-10 08:25:03,009::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='411039e4-4af2-4192-9de0-67dc1ed83ba9', options=None) >Thread-1043::DEBUG::2014-07-10 08:25:03,012::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9`ReqID=`c77384c4-67c9-4ad1-a43f-8bf5c21e454e`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo' >Thread-1043::DEBUG::2014-07-10 08:25:03,012::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' for lock type 'shared' >Thread-1043::DEBUG::2014-07-10 08:25:03,012::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' is free. Now locking as 'shared' (1 active user) >Thread-1043::DEBUG::2014-07-10 08:25:03,013::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9`ReqID=`c77384c4-67c9-4ad1-a43f-8bf5c21e454e`::Granted request >Thread-1043::DEBUG::2014-07-10 08:25:03,013::task::827::TaskManager.Task::(resourceAcquired) Task=`578b9eb5-5afa-4940-af35-5947ae94b7a0`::_resourcesAcquired: Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9 (shared) >Thread-1043::DEBUG::2014-07-10 08:25:03,013::task::990::TaskManager.Task::(_decref) Task=`578b9eb5-5afa-4940-af35-5947ae94b7a0`::ref 1 aborting False >Thread-1043::INFO::2014-07-10 08:25:03,014::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DC-REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2, 'domains': u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c:Active', 'master_uuid': 'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c': {'status': u'Active', 'diskfree': '1137495244800', 'isoprefix': '', 'alerts': [], 'disktotal': '1152393412608', 'version': 3}}} >Thread-1043::DEBUG::2014-07-10 08:25:03,015::task::1185::TaskManager.Task::(prepare) Task=`578b9eb5-5afa-4940-af35-5947ae94b7a0`::finished: {'info': {'name': 'DC-REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2, 'domains': u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c:Active', 'master_uuid': 'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c': {'status': u'Active', 'diskfree': '1137495244800', 'isoprefix': '', 'alerts': [], 'disktotal': '1152393412608', 'version': 3}}} >Thread-1043::DEBUG::2014-07-10 08:25:03,015::task::595::TaskManager.Task::(_updateState) Task=`578b9eb5-5afa-4940-af35-5947ae94b7a0`::moving from state preparing -> state finished >Thread-1043::DEBUG::2014-07-10 08:25:03,015::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9': < ResourceRef 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9', isValid: 'True' obj: 'None'>} >Thread-1043::DEBUG::2014-07-10 08:25:03,015::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1043::DEBUG::2014-07-10 08:25:03,015::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' >Thread-1043::DEBUG::2014-07-10 08:25:03,016::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' (0 active users) >Thread-1043::DEBUG::2014-07-10 08:25:03,016::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' is free, finding out if anyone is waiting for it. >Thread-1043::DEBUG::2014-07-10 08:25:03,016::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9', Clearing records. >Thread-1043::DEBUG::2014-07-10 08:25:03,016::task::990::TaskManager.Task::(_decref) Task=`578b9eb5-5afa-4940-af35-5947ae94b7a0`::ref 0 aborting False >Thread-15::DEBUG::2014-07-10 08:25:03,687::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/e01a3a36-d2ce-4153-bb57-d6e65b7ed08c/metadata bs=4096 count=1' (cwd None) >Thread-15::DEBUG::2014-07-10 08:25:03,750::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00060557 s, 6.8 MB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-07-10 08:25:03,942::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-07-10 08:25:04,086::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0396004 s, 25.9 MB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-07-10 08:25:06,101::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-07-10 08:25:06,229::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0385753 s, 26.5 MB/s\n'; <rc> = 0 >Thread-1042::DEBUG::2014-07-10 08:25:07,026::task::595::TaskManager.Task::(_updateState) Task=`474d48c1-2cee-4681-b273-70b88d3b6590`::moving from state init -> state preparing >Thread-1042::INFO::2014-07-10 08:25:07,027::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-1042::INFO::2014-07-10 08:25:07,027::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00060557', 'lastCheck': '3.2', 'valid': True}} >Thread-1042::DEBUG::2014-07-10 08:25:07,028::task::1185::TaskManager.Task::(prepare) Task=`474d48c1-2cee-4681-b273-70b88d3b6590`::finished: {u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00060557', 'lastCheck': '3.2', 'valid': True}} >Thread-1042::DEBUG::2014-07-10 08:25:07,028::task::595::TaskManager.Task::(_updateState) Task=`474d48c1-2cee-4681-b273-70b88d3b6590`::moving from state preparing -> state finished >Thread-1042::DEBUG::2014-07-10 08:25:07,028::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-1042::DEBUG::2014-07-10 08:25:07,028::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1042::DEBUG::2014-07-10 08:25:07,028::task::990::TaskManager.Task::(_decref) Task=`474d48c1-2cee-4681-b273-70b88d3b6590`::ref 0 aborting False >Dummy-36::DEBUG::2014-07-10 08:25:08,239::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-07-10 08:25:08,376::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0380931 s, 26.9 MB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-07-10 08:25:10,391::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-07-10 08:25:10,523::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0328707 s, 31.2 MB/s\n'; <rc> = 0 >Thread-1043::DEBUG::2014-07-10 08:25:12,429::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [449b4bff] >Thread-1043::DEBUG::2014-07-10 08:25:12,431::task::595::TaskManager.Task::(_updateState) Task=`d2514b13-767d-435d-a4d4-c489ae9b9af7`::moving from state init -> state preparing >Thread-1043::INFO::2014-07-10 08:25:12,431::logUtils::44::dispatcher::(wrapper) Run and protect: deactivateStorageDomain(sdUUID='e01a3a36-d2ce-4153-bb57-d6e65b7ed08c', spUUID='411039e4-4af2-4192-9de0-67dc1ed83ba9', msdUUID='00000000-0000-0000-0000-000000000000', masterVersion=1, options=None) >Thread-1043::DEBUG::2014-07-10 08:25:12,432::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9`ReqID=`72bd45dc-4577-49f7-a24f-151110102728`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '1234' at 'deactivateStorageDomain' >Thread-1043::DEBUG::2014-07-10 08:25:12,432::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' for lock type 'exclusive' >Thread-1043::DEBUG::2014-07-10 08:25:12,432::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' is free. Now locking as 'exclusive' (1 active user) >Thread-1043::DEBUG::2014-07-10 08:25:12,432::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9`ReqID=`72bd45dc-4577-49f7-a24f-151110102728`::Granted request >Thread-1043::DEBUG::2014-07-10 08:25:12,433::task::827::TaskManager.Task::(resourceAcquired) Task=`d2514b13-767d-435d-a4d4-c489ae9b9af7`::_resourcesAcquired: Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9 (exclusive) >Thread-1043::DEBUG::2014-07-10 08:25:12,433::task::990::TaskManager.Task::(_decref) Task=`d2514b13-767d-435d-a4d4-c489ae9b9af7`::ref 1 aborting False >Thread-1043::DEBUG::2014-07-10 08:25:12,434::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.e01a3a36-d2ce-4153-bb57-d6e65b7ed08c`ReqID=`3cbf9731-db8a-41fb-9c8b-5e8930fb298c`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '1235' at 'deactivateStorageDomain' >Thread-1043::DEBUG::2014-07-10 08:25:12,434::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.e01a3a36-d2ce-4153-bb57-d6e65b7ed08c' for lock type 'exclusive' >Thread-1043::DEBUG::2014-07-10 08:25:12,434::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.e01a3a36-d2ce-4153-bb57-d6e65b7ed08c' is free. Now locking as 'exclusive' (1 active user) >Thread-1043::DEBUG::2014-07-10 08:25:12,434::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.e01a3a36-d2ce-4153-bb57-d6e65b7ed08c`ReqID=`3cbf9731-db8a-41fb-9c8b-5e8930fb298c`::Granted request >Thread-1043::DEBUG::2014-07-10 08:25:12,434::task::827::TaskManager.Task::(resourceAcquired) Task=`d2514b13-767d-435d-a4d4-c489ae9b9af7`::_resourcesAcquired: Storage.e01a3a36-d2ce-4153-bb57-d6e65b7ed08c (exclusive) >Thread-1043::DEBUG::2014-07-10 08:25:12,434::task::990::TaskManager.Task::(_decref) Task=`d2514b13-767d-435d-a4d4-c489ae9b9af7`::ref 1 aborting False >Thread-1043::INFO::2014-07-10 08:25:12,435::sp::1063::Storage.StoragePool::(deactivateSD) sdUUID=e01a3a36-d2ce-4153-bb57-d6e65b7ed08c spUUID=411039e4-4af2-4192-9de0-67dc1ed83ba9 newMsdUUID=00000000-0000-0000-0000-000000000000 >Thread-1043::INFO::2014-07-10 08:25:12,435::sp::1087::Storage.StoragePool::(deactivateSD) Silently ignoring the deactivation request for the master domain e01a3a36-d2ce-4153-bb57-d6e65b7ed08c >Thread-1043::INFO::2014-07-10 08:25:12,435::logUtils::47::dispatcher::(wrapper) Run and protect: deactivateStorageDomain, Return response: None >Thread-1043::DEBUG::2014-07-10 08:25:12,436::task::1185::TaskManager.Task::(prepare) Task=`d2514b13-767d-435d-a4d4-c489ae9b9af7`::finished: None >Thread-1043::DEBUG::2014-07-10 08:25:12,436::task::595::TaskManager.Task::(_updateState) Task=`d2514b13-767d-435d-a4d4-c489ae9b9af7`::moving from state preparing -> state finished >Thread-1043::DEBUG::2014-07-10 08:25:12,436::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9': < ResourceRef 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9', isValid: 'True' obj: 'None'>, 'Storage.e01a3a36-d2ce-4153-bb57-d6e65b7ed08c': < ResourceRef 'Storage.e01a3a36-d2ce-4153-bb57-d6e65b7ed08c', isValid: 'True' obj: 'None'>} >Thread-1043::DEBUG::2014-07-10 08:25:12,436::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1043::DEBUG::2014-07-10 08:25:12,436::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' >Thread-1043::DEBUG::2014-07-10 08:25:12,436::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' (0 active users) >Thread-1043::DEBUG::2014-07-10 08:25:12,437::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' is free, finding out if anyone is waiting for it. >Thread-1043::DEBUG::2014-07-10 08:25:12,437::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9', Clearing records. >Thread-1043::DEBUG::2014-07-10 08:25:12,437::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.e01a3a36-d2ce-4153-bb57-d6e65b7ed08c' >Thread-1043::DEBUG::2014-07-10 08:25:12,437::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.e01a3a36-d2ce-4153-bb57-d6e65b7ed08c' (0 active users) >Thread-1043::DEBUG::2014-07-10 08:25:12,437::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.e01a3a36-d2ce-4153-bb57-d6e65b7ed08c' is free, finding out if anyone is waiting for it. >Thread-1043::DEBUG::2014-07-10 08:25:12,437::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.e01a3a36-d2ce-4153-bb57-d6e65b7ed08c', Clearing records. >Thread-1043::DEBUG::2014-07-10 08:25:12,438::task::990::TaskManager.Task::(_decref) Task=`d2514b13-767d-435d-a4d4-c489ae9b9af7`::ref 0 aborting False >Thread-1042::DEBUG::2014-07-10 08:25:12,444::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [449b4bff] >Thread-1042::DEBUG::2014-07-10 08:25:12,444::task::595::TaskManager.Task::(_updateState) Task=`50775260-1c60-4e13-82e7-de28942744d2`::moving from state init -> state preparing >Thread-1042::INFO::2014-07-10 08:25:12,444::logUtils::44::dispatcher::(wrapper) Run and protect: getAllTasksStatuses(spUUID=None, options=None) >Thread-1042::DEBUG::2014-07-10 08:25:12,445::taskManager::102::TaskManager::(getAllTasksStatuses) Entry. >Thread-1042::DEBUG::2014-07-10 08:25:12,445::taskManager::113::TaskManager::(getAllTasksStatuses) Return: {} >Thread-1042::INFO::2014-07-10 08:25:12,445::logUtils::47::dispatcher::(wrapper) Run and protect: getAllTasksStatuses, Return response: {'allTasksStatus': {}} >Thread-1042::DEBUG::2014-07-10 08:25:12,445::task::1185::TaskManager.Task::(prepare) Task=`50775260-1c60-4e13-82e7-de28942744d2`::finished: {'allTasksStatus': {}} >Thread-1042::DEBUG::2014-07-10 08:25:12,445::task::595::TaskManager.Task::(_updateState) Task=`50775260-1c60-4e13-82e7-de28942744d2`::moving from state preparing -> state finished >Thread-1042::DEBUG::2014-07-10 08:25:12,445::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-1042::DEBUG::2014-07-10 08:25:12,446::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1042::DEBUG::2014-07-10 08:25:12,446::task::990::TaskManager.Task::(_decref) Task=`50775260-1c60-4e13-82e7-de28942744d2`::ref 0 aborting False >Thread-1042::DEBUG::2014-07-10 08:25:12,449::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [449b4bff] >Thread-1042::DEBUG::2014-07-10 08:25:12,449::task::595::TaskManager.Task::(_updateState) Task=`e37010f7-d68b-4621-9bf9-84a3b5baddcb`::moving from state init -> state preparing >Thread-1042::INFO::2014-07-10 08:25:12,450::logUtils::44::dispatcher::(wrapper) Run and protect: spmStop(spUUID='411039e4-4af2-4192-9de0-67dc1ed83ba9', options=None) >Thread-1042::DEBUG::2014-07-10 08:25:12,450::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9`ReqID=`cdade00a-f175-428f-88e9-b557692cc243`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '616' at 'spmStop' >Thread-1042::DEBUG::2014-07-10 08:25:12,450::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' for lock type 'exclusive' >Thread-1042::DEBUG::2014-07-10 08:25:12,450::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' is free. Now locking as 'exclusive' (1 active user) >Thread-1042::DEBUG::2014-07-10 08:25:12,451::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9`ReqID=`cdade00a-f175-428f-88e9-b557692cc243`::Granted request >Thread-1042::DEBUG::2014-07-10 08:25:12,451::task::827::TaskManager.Task::(resourceAcquired) Task=`e37010f7-d68b-4621-9bf9-84a3b5baddcb`::_resourcesAcquired: Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9 (exclusive) >Thread-1042::DEBUG::2014-07-10 08:25:12,451::task::990::TaskManager.Task::(_decref) Task=`e37010f7-d68b-4621-9bf9-84a3b5baddcb`::ref 1 aborting False >Thread-1042::DEBUG::2014-07-10 08:25:12,451::sp::340::Storage.StoragePool::(_shutDownUpgrade) Shutting down upgrade process >Thread-1042::DEBUG::2014-07-10 08:25:12,452::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.upgrade_411039e4-4af2-4192-9de0-67dc1ed83ba9`ReqID=`f1de9aa8-d668-41b0-8312-01fbee44e431`::Request was made in '/usr/share/vdsm/storage/sp.py' line '342' at '_shutDownUpgrade' >Thread-1042::DEBUG::2014-07-10 08:25:12,452::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.upgrade_411039e4-4af2-4192-9de0-67dc1ed83ba9' for lock type 'exclusive' >Thread-1042::DEBUG::2014-07-10 08:25:12,452::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.upgrade_411039e4-4af2-4192-9de0-67dc1ed83ba9' is free. Now locking as 'exclusive' (1 active user) >Thread-1042::DEBUG::2014-07-10 08:25:12,452::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.upgrade_411039e4-4af2-4192-9de0-67dc1ed83ba9`ReqID=`f1de9aa8-d668-41b0-8312-01fbee44e431`::Granted request >Thread-1042::DEBUG::2014-07-10 08:25:12,452::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.upgrade_411039e4-4af2-4192-9de0-67dc1ed83ba9' >Thread-1042::DEBUG::2014-07-10 08:25:12,453::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.upgrade_411039e4-4af2-4192-9de0-67dc1ed83ba9' (0 active users) >Thread-1042::DEBUG::2014-07-10 08:25:12,453::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.upgrade_411039e4-4af2-4192-9de0-67dc1ed83ba9' is free, finding out if anyone is waiting for it. >Thread-1042::DEBUG::2014-07-10 08:25:12,453::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.upgrade_411039e4-4af2-4192-9de0-67dc1ed83ba9', Clearing records. >Thread-1042::DEBUG::2014-07-10 08:25:12,471::sp::378::Storage.StoragePool::(cleanupMasterMount) unmounting /rhev/data-center/mnt/blockSD/e01a3a36-d2ce-4153-bb57-d6e65b7ed08c/master >Dummy-36::DEBUG::2014-07-10 08:25:12,540::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Thread-15::DEBUG::2014-07-10 08:25:13,795::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/e01a3a36-d2ce-4153-bb57-d6e65b7ed08c/metadata bs=4096 count=1' (cwd None) >Thread-15::DEBUG::2014-07-10 08:25:13,970::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000913518 s, 4.5 MB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-07-10 08:25:14,723::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.681128 s, 1.5 MB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-07-10 08:25:17,090::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-07-10 08:25:18,411::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.721707 s, 1.4 MB/s\n'; <rc> = 0 >Thread-1042::DEBUG::2014-07-10 08:25:18,874::mount::202::Storage.Misc.excCmd::(_runcmd) '/usr/bin/sudo -n /bin/umount /rhev/data-center/mnt/blockSD/e01a3a36-d2ce-4153-bb57-d6e65b7ed08c/master' (cwd None) >Thread-1042::DEBUG::2014-07-10 08:25:18,983::persistentDict::167::Storage.PersistentDict::(transaction) Starting transaction >Thread-1042::DEBUG::2014-07-10 08:25:18,984::persistentDict::173::Storage.PersistentDict::(transaction) Flushing changes >Thread-1042::DEBUG::2014-07-10 08:25:18,985::persistentDict::299::Storage.PersistentDict::(flush) about to write lines (VGTagMetadataRW)=['CLASS=Data', 'DESCRIPTION=SD-REAL', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'LOGBLKSIZE=512', 'MASTER_VERSION=1', 'PHYBLKSIZE=512', 'POOL_DESCRIPTION=DC-REAL', u'POOL_DOMAINS=e01a3a36-d2ce-4153-bb57-d6e65b7ed08c:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=2', 'POOL_UUID=411039e4-4af2-4192-9de0-67dc1ed83ba9', u'PV0=pv:3600601601282300032826addbbdae311,uuid:ZdReOp-Yf8A-beQm-ne4I-pN3J-rxgm-9Ew0S1,pestart:0,pecount:8189,mapoffset:0', u'PV1=pv:360060160f4a030003840ec867ddee311,uuid:0eUwla-dsA3-g6ia-RU23-cual-0rt9-KzkxLj,pestart:0,pecount:397,mapoffset:8189', 'ROLE=Master', 'SDUUID=e01a3a36-d2ce-4153-bb57-d6e65b7ed08c', 'TYPE=ISCSI', 'VERSION=3', 'VGUUID=GJcVo5-Y0kU-CDub-zITS-zfoL-Z7hz-SeVeIe', '_SHA_CKSUM=0862f206224f948dbd549e5f29740569287a60bc'] >Thread-1042::DEBUG::2014-07-10 08:25:18,985::lvm::503::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-1042::DEBUG::2014-07-10 08:25:18,985::lvm::505::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-1042::DEBUG::2014-07-10 08:25:18,986::lvm::513::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-1042::DEBUG::2014-07-10 08:25:18,986::lvm::525::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-1042::DEBUG::2014-07-10 08:25:18,986::lvm::373::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-1042::DEBUG::2014-07-10 08:25:18,987::lvm::296::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/3600601601282300032826addbbdae311|/dev/mapper/360060160f4a030003840ec867ddee311|/dev/mapper/367cad74c2fcba00019e6afd20c781e67|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name e01a3a36-d2ce-4153-bb57-d6e65b7ed08c' (cwd None) >Thread-1042::DEBUG::2014-07-10 08:25:19,323::lvm::296::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-1042::DEBUG::2014-07-10 08:25:19,325::lvm::415::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-1042::DEBUG::2014-07-10 08:25:19,326::blockSD::315::storage.Metadata.VGTagMetadataRW::(writelines) Updating metadata adding=MDT_POOL_SPM_ID=-1, MDT__SHA_CKSUM=0862f206224f948dbd549e5f29740569287a60bc removing=MDT__SHA_CKSUM=bd2f6e0ca6c4678becab320fc25aa34fafae4056, MDT_POOL_SPM_ID=1 >Thread-1042::DEBUG::2014-07-10 08:25:19,327::lvm::296::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgchange --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/3600601601282300032826addbbdae311|/dev/mapper/360060160f4a030003840ec867ddee311|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } " --deltag MDT_POOL_SPM_ID=1 --deltag MDT__SHA_CKSUM=bd2f6e0ca6c4678becab320fc25aa34fafae4056 --addtag MDT__SHA_CKSUM=0862f206224f948dbd549e5f29740569287a60bc --addtag MDT_POOL_SPM_ID=-1 e01a3a36-d2ce-4153-bb57-d6e65b7ed08c' (cwd None) >Thread-1042::DEBUG::2014-07-10 08:25:19,604::lvm::296::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-1042::DEBUG::2014-07-10 08:25:19,605::lvm::503::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-1042::DEBUG::2014-07-10 08:25:19,605::lvm::505::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-1042::DEBUG::2014-07-10 08:25:19,606::persistentDict::175::Storage.PersistentDict::(transaction) Finished transaction >Thread-1042::INFO::2014-07-10 08:25:19,606::clusterlock::279::SANLock::(release) Releasing cluster lock for domain e01a3a36-d2ce-4153-bb57-d6e65b7ed08c >Thread-1042::DEBUG::2014-07-10 08:25:19,653::clusterlock::289::SANLock::(release) Cluster lock for domain e01a3a36-d2ce-4153-bb57-d6e65b7ed08c successfully released >Thread-1042::INFO::2014-07-10 08:25:19,654::logUtils::47::dispatcher::(wrapper) Run and protect: spmStop, Return response: None >Thread-1042::DEBUG::2014-07-10 08:25:19,654::task::1185::TaskManager.Task::(prepare) Task=`e37010f7-d68b-4621-9bf9-84a3b5baddcb`::finished: None >Thread-1042::DEBUG::2014-07-10 08:25:19,654::task::595::TaskManager.Task::(_updateState) Task=`e37010f7-d68b-4621-9bf9-84a3b5baddcb`::moving from state preparing -> state finished >Thread-1042::DEBUG::2014-07-10 08:25:19,655::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9': < ResourceRef 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9', isValid: 'True' obj: 'None'>} >Thread-1042::DEBUG::2014-07-10 08:25:19,655::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1042::DEBUG::2014-07-10 08:25:19,655::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' >Thread-1042::DEBUG::2014-07-10 08:25:19,656::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' (0 active users) >Thread-1042::DEBUG::2014-07-10 08:25:19,656::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' is free, finding out if anyone is waiting for it. >Thread-1042::DEBUG::2014-07-10 08:25:19,656::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9', Clearing records. >Thread-1042::DEBUG::2014-07-10 08:25:19,656::task::990::TaskManager.Task::(_decref) Task=`e37010f7-d68b-4621-9bf9-84a3b5baddcb`::ref 0 aborting False >Thread-1042::DEBUG::2014-07-10 08:25:19,714::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [449b4bff] >Thread-1042::DEBUG::2014-07-10 08:25:19,715::task::595::TaskManager.Task::(_updateState) Task=`79245cfc-9c19-487f-8d98-eac7fddd22e3`::moving from state init -> state preparing >Thread-1042::INFO::2014-07-10 08:25:19,715::logUtils::44::dispatcher::(wrapper) Run and protect: disconnectStoragePool(spUUID='411039e4-4af2-4192-9de0-67dc1ed83ba9', hostID=1, remove=False, options=None) >Thread-1042::DEBUG::2014-07-10 08:25:19,716::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9`ReqID=`4a6e3ce9-ae25-4187-8216-4b775ec3fc88`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '1131' at 'disconnectStoragePool' >Thread-1042::DEBUG::2014-07-10 08:25:19,716::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' for lock type 'exclusive' >Thread-1042::DEBUG::2014-07-10 08:25:19,717::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' is free. Now locking as 'exclusive' (1 active user) >Thread-1042::DEBUG::2014-07-10 08:25:19,717::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9`ReqID=`4a6e3ce9-ae25-4187-8216-4b775ec3fc88`::Granted request >Thread-1042::DEBUG::2014-07-10 08:25:19,717::task::827::TaskManager.Task::(resourceAcquired) Task=`79245cfc-9c19-487f-8d98-eac7fddd22e3`::_resourcesAcquired: Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9 (exclusive) >Thread-1042::DEBUG::2014-07-10 08:25:19,717::task::990::TaskManager.Task::(_decref) Task=`79245cfc-9c19-487f-8d98-eac7fddd22e3`::ref 1 aborting False >Thread-1042::DEBUG::2014-07-10 08:25:19,718::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.HsmDomainMonitorLock`ReqID=`093c9785-53f1-4a52-9dc3-f226df405768`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '1139' at '_disconnectPool' >Thread-1042::DEBUG::2014-07-10 08:25:19,718::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.HsmDomainMonitorLock' for lock type 'exclusive' >Thread-1042::DEBUG::2014-07-10 08:25:19,718::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.HsmDomainMonitorLock' is free. Now locking as 'exclusive' (1 active user) >Thread-1042::DEBUG::2014-07-10 08:25:19,719::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.HsmDomainMonitorLock`ReqID=`093c9785-53f1-4a52-9dc3-f226df405768`::Granted request >Thread-1042::INFO::2014-07-10 08:25:19,719::sp::649::Storage.StoragePool::(disconnect) Disconnect from the storage pool 411039e4-4af2-4192-9de0-67dc1ed83ba9 >Thread-29::INFO::2014-07-10 08:25:20,453::storage_mailbox::509::Storage.MailBox.HsmMailMonitor::(run) HSM_MailboxMonitor - Incoming mail monitoring thread stopped, clearing outgoing mail >Thread-29::INFO::2014-07-10 08:25:20,453::storage_mailbox::385::Storage.MailBox.HsmMailMonitor::(_sendMail) HSM_MailMonitor sending mail to SPM - ['/bin/dd', 'of=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox', 'iflag=fullblock', 'oflag=direct', 'conv=notrunc', 'bs=512', 'seek=8'] >Thread-29::DEBUG::2014-07-10 08:25:20,454::storage_mailbox::84::Storage.Misc.excCmd::(_mboxExecCmd) '/bin/dd of=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=fullblock oflag=direct conv=notrunc bs=512 seek=8' (cwd None) >Thread-29::DEBUG::2014-07-10 08:25:21,517::storage_mailbox::84::Storage.Misc.excCmd::(_mboxExecCmd) SUCCESS: <err> = '8+0 records in\n8+0 records out\n4096 bytes (4.1 kB) copied, 1.00178 s, 4.1 kB/s\n'; <rc> = 0 >Thread-1042::INFO::2014-07-10 08:25:21,525::domainMonitor::113::Storage.DomainMonitor::(stopMonitoring) Stop monitoring e01a3a36-d2ce-4153-bb57-d6e65b7ed08c >Thread-15::DEBUG::2014-07-10 08:25:21,525::domainMonitor::175::Storage.DomainMonitorThread::(_monitorLoop) Stopping domain monitor for e01a3a36-d2ce-4153-bb57-d6e65b7ed08c >Thread-15::INFO::2014-07-10 08:25:21,526::clusterlock::207::SANLock::(releaseHostId) Releasing host id for domain e01a3a36-d2ce-4153-bb57-d6e65b7ed08c (id: 1) >Dummy-36::INFO::2014-07-10 08:25:21,533::storage_mailbox::794::Storage.MailBox.SpmMailMonitor::(run) SPM_MailMonitor - Incoming mail monitoring thread stopped >Thread-1044::DEBUG::2014-07-10 08:25:22,187::task::595::TaskManager.Task::(_updateState) Task=`608e2c5e-740d-41c7-a84b-e3b15a042208`::moving from state init -> state preparing >Thread-1044::INFO::2014-07-10 08:25:22,188::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-1044::INFO::2014-07-10 08:25:22,188::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000913518', 'lastCheck': '7.6', 'valid': True}} >Thread-1044::DEBUG::2014-07-10 08:25:22,188::task::1185::TaskManager.Task::(prepare) Task=`608e2c5e-740d-41c7-a84b-e3b15a042208`::finished: {u'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000913518', 'lastCheck': '7.6', 'valid': True}} >Thread-1044::DEBUG::2014-07-10 08:25:22,189::task::595::TaskManager.Task::(_updateState) Task=`608e2c5e-740d-41c7-a84b-e3b15a042208`::moving from state preparing -> state finished >Thread-1044::DEBUG::2014-07-10 08:25:22,189::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-1044::DEBUG::2014-07-10 08:25:22,189::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1044::DEBUG::2014-07-10 08:25:22,189::task::990::TaskManager.Task::(_decref) Task=`608e2c5e-740d-41c7-a84b-e3b15a042208`::ref 0 aborting False >Thread-15::DEBUG::2014-07-10 08:25:23,528::clusterlock::217::SANLock::(releaseHostId) Host id for domain e01a3a36-d2ce-4153-bb57-d6e65b7ed08c released successfully (id: 1) >Thread-1042::DEBUG::2014-07-10 08:25:23,530::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.HsmDomainMonitorLock' >Thread-1042::DEBUG::2014-07-10 08:25:23,531::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.HsmDomainMonitorLock' (0 active users) >Thread-1042::DEBUG::2014-07-10 08:25:23,531::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.HsmDomainMonitorLock' is free, finding out if anyone is waiting for it. >Thread-1042::DEBUG::2014-07-10 08:25:23,531::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.HsmDomainMonitorLock', Clearing records. >Thread-1042::INFO::2014-07-10 08:25:23,531::logUtils::47::dispatcher::(wrapper) Run and protect: disconnectStoragePool, Return response: True >Thread-1042::DEBUG::2014-07-10 08:25:23,532::task::1185::TaskManager.Task::(prepare) Task=`79245cfc-9c19-487f-8d98-eac7fddd22e3`::finished: True >Thread-1042::DEBUG::2014-07-10 08:25:23,532::task::595::TaskManager.Task::(_updateState) Task=`79245cfc-9c19-487f-8d98-eac7fddd22e3`::moving from state preparing -> state finished >Thread-1042::DEBUG::2014-07-10 08:25:23,532::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9': < ResourceRef 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9', isValid: 'True' obj: 'None'>} >Thread-1042::DEBUG::2014-07-10 08:25:23,532::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1042::DEBUG::2014-07-10 08:25:23,533::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' >Thread-1042::DEBUG::2014-07-10 08:25:23,533::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' (0 active users) >Thread-1042::DEBUG::2014-07-10 08:25:23,533::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' is free, finding out if anyone is waiting for it. >Thread-1042::DEBUG::2014-07-10 08:25:23,533::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9', Clearing records. >Thread-1042::DEBUG::2014-07-10 08:25:23,534::task::990::TaskManager.Task::(_decref) Task=`79245cfc-9c19-487f-8d98-eac7fddd22e3`::ref 0 aborting False >Thread-1042::DEBUG::2014-07-10 08:25:23,581::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [449b4bff] >Thread-1042::DEBUG::2014-07-10 08:25:23,581::task::595::TaskManager.Task::(_updateState) Task=`c0442152-c267-42da-93d2-373bd597279e`::moving from state init -> state preparing >Thread-1042::INFO::2014-07-10 08:25:23,581::logUtils::44::dispatcher::(wrapper) Run and protect: disconnectStoragePool(spUUID='411039e4-4af2-4192-9de0-67dc1ed83ba9', hostID=1, remove=False, options=None) >Thread-1042::WARNING::2014-07-10 08:25:23,582::hsm::1126::Storage.HSM::(disconnectStoragePool) disconnect sp: 411039e4-4af2-4192-9de0-67dc1ed83ba9 failed. Known pools {} >Thread-1042::INFO::2014-07-10 08:25:23,582::logUtils::47::dispatcher::(wrapper) Run and protect: disconnectStoragePool, Return response: None >Thread-1042::DEBUG::2014-07-10 08:25:23,582::task::1185::TaskManager.Task::(prepare) Task=`c0442152-c267-42da-93d2-373bd597279e`::finished: None >Thread-1042::DEBUG::2014-07-10 08:25:23,582::task::595::TaskManager.Task::(_updateState) Task=`c0442152-c267-42da-93d2-373bd597279e`::moving from state preparing -> state finished >Thread-1042::DEBUG::2014-07-10 08:25:23,582::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-1042::DEBUG::2014-07-10 08:25:23,583::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1042::DEBUG::2014-07-10 08:25:23,583::task::990::TaskManager.Task::(_decref) Task=`c0442152-c267-42da-93d2-373bd597279e`::ref 0 aborting False >Thread-1042::DEBUG::2014-07-10 08:25:23,721::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [449b4bff] >Thread-1042::DEBUG::2014-07-10 08:25:23,722::task::595::TaskManager.Task::(_updateState) Task=`b3908587-048c-4333-bcb3-2a6aed8630fb`::moving from state init -> state preparing >Thread-1042::INFO::2014-07-10 08:25:23,722::logUtils::44::dispatcher::(wrapper) Run and protect: disconnectStorageServer(domType=3, spUUID='411039e4-4af2-4192-9de0-67dc1ed83ba9', conList=[{'connection': '10.35.160.107', 'iqn': 'iqn.1992-04.com.emc:cx.ckm00121000438.b7', 'user': '', 'tpgt': '4', 'password': '******', 'id': '21af9f33-77f4-44ce-afd8-ac2b9d767d2d', 'port': '3260'}, {'connection': '10.35.160.106', 'iqn': 'iqn.1992-04.com.emc:cx.ckm00121000438.b6', 'user': '', 'tpgt': '3', 'password': '******', 'id': 'bf1f6c61-9095-46fa-ae99-483613a91747', 'port': '3260'}, {'connection': '10.35.160.104', 'iqn': 'iqn.1992-04.com.emc:cx.ckm00121000438.a6', 'user': '', 'tpgt': '1', 'password': '******', 'id': 'e2ffc61c-fdb9-46ce-b87b-7235401ebf49', 'port': '3260'}, {'connection': '10.35.160.105', 'iqn': 'iqn.1992-04.com.emc:cx.ckm00121000438.a7', 'user': '', 'tpgt': '2', 'password': '******', 'id': 'fa5dd339-edaa-44d5-9807-e488406bb839', 'port': '3260'}, {'connection': '10.35.160.107', 'iqn': 'iqn.1992-04.com.emc:cx.ckm00121000438.b7', 'user': '', 'tpgt': '4', 'password': '******', 'id': '21af9f33-77f4-44ce-afd8-ac2b9d767d2d', 'port': '3260'}, {'connection': '10.35.160.106', 'iqn': 'iqn.1992-04.com.emc:cx.ckm00121000438.b6', 'user': '', 'tpgt': '3', 'password': '******', 'id': 'bf1f6c61-9095-46fa-ae99-483613a91747', 'port': '3260'}, {'connection': '10.35.160.104', 'iqn': 'iqn.1992-04.com.emc:cx.ckm00121000438.a6', 'user': '', 'tpgt': '1', 'password': '******', 'id': 'e2ffc61c-fdb9-46ce-b87b-7235401ebf49', 'port': '3260'}, {'connection': '10.35.160.105', 'iqn': 'iqn.1992-04.com.emc:cx.ckm00121000438.a7', 'user': '', 'tpgt': '2', 'password': '******', 'id': 'fa5dd339-edaa-44d5-9807-e488406bb839', 'port': '3260'}], options=None) >Thread-1042::DEBUG::2014-07-10 08:25:23,742::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) '/usr/bin/sudo -n /sbin/iscsiadm -m session -r 1 -u' (cwd None) >Thread-1042::DEBUG::2014-07-10 08:25:24,337::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-1042::DEBUG::2014-07-10 08:25:24,350::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) '/usr/bin/sudo -n /sbin/iscsiadm -m session -r 2 -u' (cwd None) >Thread-1042::DEBUG::2014-07-10 08:25:24,937::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-1042::DEBUG::2014-07-10 08:25:24,941::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) '/usr/bin/sudo -n /sbin/iscsiadm -m session -r 3 -u' (cwd None) >Thread-1042::DEBUG::2014-07-10 08:25:25,520::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-1042::DEBUG::2014-07-10 08:25:25,524::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) '/usr/bin/sudo -n /sbin/iscsiadm -m session -r 4 -u' (cwd None) >Thread-1042::DEBUG::2014-07-10 08:25:26,103::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-1042::DEBUG::2014-07-10 08:25:26,108::misc::756::SamplingMethod::(__call__) Trying to enter sampling method (storage.sdc.refreshStorage) >Thread-1042::DEBUG::2014-07-10 08:25:26,108::misc::758::SamplingMethod::(__call__) Got in to sampling method >Thread-1042::DEBUG::2014-07-10 08:25:26,109::misc::756::SamplingMethod::(__call__) Trying to enter sampling method (storage.iscsi.rescan) >Thread-1042::DEBUG::2014-07-10 08:25:26,109::misc::758::SamplingMethod::(__call__) Got in to sampling method >Thread-1042::DEBUG::2014-07-10 08:25:26,109::iscsi::407::Storage.ISCSI::(rescan) Performing SCSI scan, this will take up to 30 seconds >Thread-1042::DEBUG::2014-07-10 08:25:26,109::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) '/usr/bin/sudo -n /sbin/iscsiadm -m session -R' (cwd None) >Thread-1042::DEBUG::2014-07-10 08:25:26,179::misc::766::SamplingMethod::(__call__) Returning last result >Thread-1042::DEBUG::2014-07-10 08:25:26,180::multipath::110::Storage.Misc.excCmd::(rescan) '/usr/bin/sudo -n /sbin/multipath -r' (cwd None) >Thread-1042::DEBUG::2014-07-10 08:25:26,286::multipath::110::Storage.Misc.excCmd::(rescan) SUCCESS: <err> = ''; <rc> = 0 >Thread-1042::DEBUG::2014-07-10 08:25:26,287::lvm::497::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-1042::DEBUG::2014-07-10 08:25:26,287::lvm::499::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-1042::DEBUG::2014-07-10 08:25:26,287::lvm::508::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-1042::DEBUG::2014-07-10 08:25:26,287::lvm::510::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-1042::DEBUG::2014-07-10 08:25:26,288::lvm::528::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-1042::DEBUG::2014-07-10 08:25:26,288::lvm::530::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-1042::DEBUG::2014-07-10 08:25:26,288::misc::766::SamplingMethod::(__call__) Returning last result >Thread-1042::INFO::2014-07-10 08:25:26,289::logUtils::47::dispatcher::(wrapper) Run and protect: disconnectStorageServer, Return response: {'statuslist': [{'status': 0, 'id': '21af9f33-77f4-44ce-afd8-ac2b9d767d2d'}, {'status': 0, 'id': 'bf1f6c61-9095-46fa-ae99-483613a91747'}, {'status': 0, 'id': 'e2ffc61c-fdb9-46ce-b87b-7235401ebf49'}, {'status': 0, 'id': 'fa5dd339-edaa-44d5-9807-e488406bb839'}, {'status': 0, 'id': '21af9f33-77f4-44ce-afd8-ac2b9d767d2d'}, {'status': 0, 'id': 'bf1f6c61-9095-46fa-ae99-483613a91747'}, {'status': 0, 'id': 'e2ffc61c-fdb9-46ce-b87b-7235401ebf49'}, {'status': 0, 'id': 'fa5dd339-edaa-44d5-9807-e488406bb839'}]} >Thread-1042::DEBUG::2014-07-10 08:25:26,289::task::1185::TaskManager.Task::(prepare) Task=`b3908587-048c-4333-bcb3-2a6aed8630fb`::finished: {'statuslist': [{'status': 0, 'id': '21af9f33-77f4-44ce-afd8-ac2b9d767d2d'}, {'status': 0, 'id': 'bf1f6c61-9095-46fa-ae99-483613a91747'}, {'status': 0, 'id': 'e2ffc61c-fdb9-46ce-b87b-7235401ebf49'}, {'status': 0, 'id': 'fa5dd339-edaa-44d5-9807-e488406bb839'}, {'status': 0, 'id': '21af9f33-77f4-44ce-afd8-ac2b9d767d2d'}, {'status': 0, 'id': 'bf1f6c61-9095-46fa-ae99-483613a91747'}, {'status': 0, 'id': 'e2ffc61c-fdb9-46ce-b87b-7235401ebf49'}, {'status': 0, 'id': 'fa5dd339-edaa-44d5-9807-e488406bb839'}]} >Thread-1042::DEBUG::2014-07-10 08:25:26,289::task::595::TaskManager.Task::(_updateState) Task=`b3908587-048c-4333-bcb3-2a6aed8630fb`::moving from state preparing -> state finished >Thread-1042::DEBUG::2014-07-10 08:25:26,290::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-1042::DEBUG::2014-07-10 08:25:26,290::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1042::DEBUG::2014-07-10 08:25:26,290::task::990::TaskManager.Task::(_decref) Task=`b3908587-048c-4333-bcb3-2a6aed8630fb`::ref 0 aborting False >Thread-1042::DEBUG::2014-07-10 08:25:26,365::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [449b4bff] >Thread-1042::DEBUG::2014-07-10 08:25:26,366::task::595::TaskManager.Task::(_updateState) Task=`87b3699f-675a-4063-a68b-811a548a226d`::moving from state init -> state preparing >Thread-1042::INFO::2014-07-10 08:25:26,367::logUtils::44::dispatcher::(wrapper) Run and protect: disconnectStorageServer(domType=3, spUUID='411039e4-4af2-4192-9de0-67dc1ed83ba9', conList=[{'connection': '10.35.160.107', 'iqn': 'iqn.1992-04.com.emc:cx.ckm00121000438.b7', 'user': '', 'tpgt': '4', 'password': '******', 'id': '21af9f33-77f4-44ce-afd8-ac2b9d767d2d', 'port': '3260'}, {'connection': '10.35.160.106', 'iqn': 'iqn.1992-04.com.emc:cx.ckm00121000438.b6', 'user': '', 'tpgt': '3', 'password': '******', 'id': 'bf1f6c61-9095-46fa-ae99-483613a91747', 'port': '3260'}, {'connection': '10.35.160.104', 'iqn': 'iqn.1992-04.com.emc:cx.ckm00121000438.a6', 'user': '', 'tpgt': '1', 'password': '******', 'id': 'e2ffc61c-fdb9-46ce-b87b-7235401ebf49', 'port': '3260'}, {'connection': '10.35.160.105', 'iqn': 'iqn.1992-04.com.emc:cx.ckm00121000438.a7', 'user': '', 'tpgt': '2', 'password': '******', 'id': 'fa5dd339-edaa-44d5-9807-e488406bb839', 'port': '3260'}, {'connection': '10.35.160.107', 'iqn': 'iqn.1992-04.com.emc:cx.ckm00121000438.b7', 'user': '', 'tpgt': '4', 'password': '******', 'id': '21af9f33-77f4-44ce-afd8-ac2b9d767d2d', 'port': '3260'}, {'connection': '10.35.160.106', 'iqn': 'iqn.1992-04.com.emc:cx.ckm00121000438.b6', 'user': '', 'tpgt': '3', 'password': '******', 'id': 'bf1f6c61-9095-46fa-ae99-483613a91747', 'port': '3260'}, {'connection': '10.35.160.104', 'iqn': 'iqn.1992-04.com.emc:cx.ckm00121000438.a6', 'user': '', 'tpgt': '1', 'password': '******', 'id': 'e2ffc61c-fdb9-46ce-b87b-7235401ebf49', 'port': '3260'}, {'connection': '10.35.160.105', 'iqn': 'iqn.1992-04.com.emc:cx.ckm00121000438.a7', 'user': '', 'tpgt': '2', 'password': '******', 'id': 'fa5dd339-edaa-44d5-9807-e488406bb839', 'port': '3260'}], options=None) >Thread-1042::DEBUG::2014-07-10 08:25:26,376::misc::756::SamplingMethod::(__call__) Trying to enter sampling method (storage.sdc.refreshStorage) >Thread-1042::DEBUG::2014-07-10 08:25:26,376::misc::758::SamplingMethod::(__call__) Got in to sampling method >Thread-1042::DEBUG::2014-07-10 08:25:26,376::misc::756::SamplingMethod::(__call__) Trying to enter sampling method (storage.iscsi.rescan) >Thread-1042::DEBUG::2014-07-10 08:25:26,376::misc::758::SamplingMethod::(__call__) Got in to sampling method >Thread-1042::DEBUG::2014-07-10 08:25:26,377::iscsi::407::Storage.ISCSI::(rescan) Performing SCSI scan, this will take up to 30 seconds >Thread-1042::DEBUG::2014-07-10 08:25:26,377::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) '/usr/bin/sudo -n /sbin/iscsiadm -m session -R' (cwd None) >Thread-1042::DEBUG::2014-07-10 08:25:26,446::misc::766::SamplingMethod::(__call__) Returning last result >Thread-1042::DEBUG::2014-07-10 08:25:26,447::multipath::110::Storage.Misc.excCmd::(rescan) '/usr/bin/sudo -n /sbin/multipath -r' (cwd None) >Thread-1042::DEBUG::2014-07-10 08:25:26,540::multipath::110::Storage.Misc.excCmd::(rescan) SUCCESS: <err> = ''; <rc> = 0 >Thread-1042::DEBUG::2014-07-10 08:25:26,541::lvm::497::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-1042::DEBUG::2014-07-10 08:25:26,541::lvm::499::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-1042::DEBUG::2014-07-10 08:25:26,541::lvm::508::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-1042::DEBUG::2014-07-10 08:25:26,541::lvm::510::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-1042::DEBUG::2014-07-10 08:25:26,542::lvm::528::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-1042::DEBUG::2014-07-10 08:25:26,542::lvm::530::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-1042::DEBUG::2014-07-10 08:25:26,542::misc::766::SamplingMethod::(__call__) Returning last result >Thread-1042::INFO::2014-07-10 08:25:26,543::logUtils::47::dispatcher::(wrapper) Run and protect: disconnectStorageServer, Return response: {'statuslist': [{'status': 0, 'id': '21af9f33-77f4-44ce-afd8-ac2b9d767d2d'}, {'status': 0, 'id': 'bf1f6c61-9095-46fa-ae99-483613a91747'}, {'status': 0, 'id': 'e2ffc61c-fdb9-46ce-b87b-7235401ebf49'}, {'status': 0, 'id': 'fa5dd339-edaa-44d5-9807-e488406bb839'}, {'status': 0, 'id': '21af9f33-77f4-44ce-afd8-ac2b9d767d2d'}, {'status': 0, 'id': 'bf1f6c61-9095-46fa-ae99-483613a91747'}, {'status': 0, 'id': 'e2ffc61c-fdb9-46ce-b87b-7235401ebf49'}, {'status': 0, 'id': 'fa5dd339-edaa-44d5-9807-e488406bb839'}]} >Thread-1042::DEBUG::2014-07-10 08:25:26,543::task::1185::TaskManager.Task::(prepare) Task=`87b3699f-675a-4063-a68b-811a548a226d`::finished: {'statuslist': [{'status': 0, 'id': '21af9f33-77f4-44ce-afd8-ac2b9d767d2d'}, {'status': 0, 'id': 'bf1f6c61-9095-46fa-ae99-483613a91747'}, {'status': 0, 'id': 'e2ffc61c-fdb9-46ce-b87b-7235401ebf49'}, {'status': 0, 'id': 'fa5dd339-edaa-44d5-9807-e488406bb839'}, {'status': 0, 'id': '21af9f33-77f4-44ce-afd8-ac2b9d767d2d'}, {'status': 0, 'id': 'bf1f6c61-9095-46fa-ae99-483613a91747'}, {'status': 0, 'id': 'e2ffc61c-fdb9-46ce-b87b-7235401ebf49'}, {'status': 0, 'id': 'fa5dd339-edaa-44d5-9807-e488406bb839'}]} >Thread-1042::DEBUG::2014-07-10 08:25:26,543::task::595::TaskManager.Task::(_updateState) Task=`87b3699f-675a-4063-a68b-811a548a226d`::moving from state preparing -> state finished >Thread-1042::DEBUG::2014-07-10 08:25:26,544::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-1042::DEBUG::2014-07-10 08:25:26,544::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1042::DEBUG::2014-07-10 08:25:26,544::task::990::TaskManager.Task::(_decref) Task=`87b3699f-675a-4063-a68b-811a548a226d`::ref 0 aborting False >Thread-1042::DEBUG::2014-07-10 08:25:37,347::task::595::TaskManager.Task::(_updateState) Task=`520dbe84-76e8-4bce-b122-1126e16a9e98`::moving from state init -> state preparing >Thread-1042::INFO::2014-07-10 08:25:37,349::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-1042::INFO::2014-07-10 08:25:37,349::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-1042::DEBUG::2014-07-10 08:25:37,350::task::1185::TaskManager.Task::(prepare) Task=`520dbe84-76e8-4bce-b122-1126e16a9e98`::finished: {} >Thread-1042::DEBUG::2014-07-10 08:25:37,350::task::595::TaskManager.Task::(_updateState) Task=`520dbe84-76e8-4bce-b122-1126e16a9e98`::moving from state preparing -> state finished >Thread-1042::DEBUG::2014-07-10 08:25:37,350::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-1042::DEBUG::2014-07-10 08:25:37,350::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1042::DEBUG::2014-07-10 08:25:37,350::task::990::TaskManager.Task::(_decref) Task=`520dbe84-76e8-4bce-b122-1126e16a9e98`::ref 0 aborting False >Thread-1042::DEBUG::2014-07-10 08:25:49,685::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [7d3120db] >Thread-1042::DEBUG::2014-07-10 08:25:49,687::task::595::TaskManager.Task::(_updateState) Task=`de1eb6cc-cf70-4539-913e-f066d4914ea9`::moving from state init -> state preparing >Thread-1042::INFO::2014-07-10 08:25:49,687::logUtils::44::dispatcher::(wrapper) Run and protect: connectStorageServer(domType=3, spUUID='411039e4-4af2-4192-9de0-67dc1ed83ba9', conList=[{'connection': '10.35.160.107', 'iqn': 'iqn.1992-04.com.emc:cx.ckm00121000438.b7', 'user': '', 'tpgt': '4', 'password': '******', 'id': '21af9f33-77f4-44ce-afd8-ac2b9d767d2d', 'port': '3260'}, {'connection': '10.35.160.106', 'iqn': 'iqn.1992-04.com.emc:cx.ckm00121000438.b6', 'user': '', 'tpgt': '3', 'password': '******', 'id': 'bf1f6c61-9095-46fa-ae99-483613a91747', 'port': '3260'}, {'connection': '10.35.160.104', 'iqn': 'iqn.1992-04.com.emc:cx.ckm00121000438.a6', 'user': '', 'tpgt': '1', 'password': '******', 'id': 'e2ffc61c-fdb9-46ce-b87b-7235401ebf49', 'port': '3260'}, {'connection': '10.35.160.105', 'iqn': 'iqn.1992-04.com.emc:cx.ckm00121000438.a7', 'user': '', 'tpgt': '2', 'password': '******', 'id': 'fa5dd339-edaa-44d5-9807-e488406bb839', 'port': '3260'}, {'connection': '10.35.160.107', 'iqn': 'iqn.1992-04.com.emc:cx.ckm00121000438.b7', 'user': '', 'tpgt': '4', 'password': '******', 'id': '21af9f33-77f4-44ce-afd8-ac2b9d767d2d', 'port': '3260'}, {'connection': '10.35.160.106', 'iqn': 'iqn.1992-04.com.emc:cx.ckm00121000438.b6', 'user': '', 'tpgt': '3', 'password': '******', 'id': 'bf1f6c61-9095-46fa-ae99-483613a91747', 'port': '3260'}, {'connection': '10.35.160.104', 'iqn': 'iqn.1992-04.com.emc:cx.ckm00121000438.a6', 'user': '', 'tpgt': '1', 'password': '******', 'id': 'e2ffc61c-fdb9-46ce-b87b-7235401ebf49', 'port': '3260'}, {'connection': '10.35.160.105', 'iqn': 'iqn.1992-04.com.emc:cx.ckm00121000438.a7', 'user': '', 'tpgt': '2', 'password': '******', 'id': 'fa5dd339-edaa-44d5-9807-e488406bb839', 'port': '3260'}], options=None) >Thread-1042::DEBUG::2014-07-10 08:25:49,688::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) '/usr/bin/sudo -n /sbin/iscsiadm -m node -T iqn.1992-04.com.emc:cx.ckm00121000438.b7 -I default -p 10.35.160.107:3260,4 --op=new' (cwd None) >Thread-1042::DEBUG::2014-07-10 08:25:49,766::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-1042::DEBUG::2014-07-10 08:25:49,767::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) '/usr/bin/sudo -n /sbin/iscsiadm -m node -T iqn.1992-04.com.emc:cx.ckm00121000438.b7 -I default -p 10.35.160.107:3260,4 -l' (cwd None) >Thread-1042::DEBUG::2014-07-10 08:25:50,387::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-1042::DEBUG::2014-07-10 08:25:50,388::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) '/usr/bin/sudo -n /sbin/iscsiadm -m node -T iqn.1992-04.com.emc:cx.ckm00121000438.b7 -I default -p 10.35.160.107:3260,4 -n node.startup -v manual --op=update' (cwd None) >Thread-1042::DEBUG::2014-07-10 08:25:50,474::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-1042::DEBUG::2014-07-10 08:25:50,475::lvm::373::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-1042::DEBUG::2014-07-10 08:25:50,479::lvm::296::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/3600601601282300032826addbbdae311|/dev/mapper/360060160f4a030003840ec867ddee311|/dev/mapper/367cad74c2fcba00019e6afd20c781e67|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name' (cwd None) >Thread-1042::DEBUG::2014-07-10 08:25:50,978::lvm::296::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-1042::DEBUG::2014-07-10 08:25:50,983::lvm::415::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-1042::DEBUG::2014-07-10 08:25:50,983::hsm::2353::Storage.HSM::(__prefetchDomains) Found SD uuids: ('e01a3a36-d2ce-4153-bb57-d6e65b7ed08c',) >Thread-1042::DEBUG::2014-07-10 08:25:50,983::hsm::2409::Storage.HSM::(connectStorageServer) knownSDs: {f34d0693-3747-467e-9a7c-8d73e8fb1171: storage.nfsSD.findDomain, 33100657-451b-45f5-9a71-9fed8490e696: storage.nfsSD.findDomain, 41530dea-409a-4a3d-ad8a-6f714a9b5986: storage.nfsSD.findDomain, 6a70504d-00df-4869-8695-0f442053f6b6: storage.nfsSD.findDomain, e01a3a36-d2ce-4153-bb57-d6e65b7ed08c: storage.blockSD.findDomain, cb15e53b-995b-47d6-b132-0ad9d148269e: storage.nfsSD.findDomain} >Thread-1042::DEBUG::2014-07-10 08:25:50,984::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) '/usr/bin/sudo -n /sbin/iscsiadm -m node -T iqn.1992-04.com.emc:cx.ckm00121000438.b6 -I default -p 10.35.160.106:3260,3 --op=new' (cwd None) >Thread-1042::DEBUG::2014-07-10 08:25:51,069::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-1042::DEBUG::2014-07-10 08:25:51,070::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) '/usr/bin/sudo -n /sbin/iscsiadm -m node -T iqn.1992-04.com.emc:cx.ckm00121000438.b6 -I default -p 10.35.160.106:3260,3 -l' (cwd None) >Thread-1042::DEBUG::2014-07-10 08:25:51,688::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-1042::DEBUG::2014-07-10 08:25:51,689::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) '/usr/bin/sudo -n /sbin/iscsiadm -m node -T iqn.1992-04.com.emc:cx.ckm00121000438.b6 -I default -p 10.35.160.106:3260,3 -n node.startup -v manual --op=update' (cwd None) >Thread-1042::DEBUG::2014-07-10 08:25:51,758::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-1042::DEBUG::2014-07-10 08:25:51,759::hsm::2353::Storage.HSM::(__prefetchDomains) Found SD uuids: ('e01a3a36-d2ce-4153-bb57-d6e65b7ed08c',) >Thread-1042::DEBUG::2014-07-10 08:25:51,759::hsm::2409::Storage.HSM::(connectStorageServer) knownSDs: {f34d0693-3747-467e-9a7c-8d73e8fb1171: storage.nfsSD.findDomain, 33100657-451b-45f5-9a71-9fed8490e696: storage.nfsSD.findDomain, 41530dea-409a-4a3d-ad8a-6f714a9b5986: storage.nfsSD.findDomain, 6a70504d-00df-4869-8695-0f442053f6b6: storage.nfsSD.findDomain, e01a3a36-d2ce-4153-bb57-d6e65b7ed08c: storage.blockSD.findDomain, cb15e53b-995b-47d6-b132-0ad9d148269e: storage.nfsSD.findDomain} >Thread-1042::DEBUG::2014-07-10 08:25:51,760::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) '/usr/bin/sudo -n /sbin/iscsiadm -m node -T iqn.1992-04.com.emc:cx.ckm00121000438.a6 -I default -p 10.35.160.104:3260,1 --op=new' (cwd None) >Thread-1042::DEBUG::2014-07-10 08:25:51,820::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-1042::DEBUG::2014-07-10 08:25:51,821::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) '/usr/bin/sudo -n /sbin/iscsiadm -m node -T iqn.1992-04.com.emc:cx.ckm00121000438.a6 -I default -p 10.35.160.104:3260,1 -l' (cwd None) >Thread-1042::DEBUG::2014-07-10 08:25:52,399::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-1042::DEBUG::2014-07-10 08:25:52,400::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) '/usr/bin/sudo -n /sbin/iscsiadm -m node -T iqn.1992-04.com.emc:cx.ckm00121000438.a6 -I default -p 10.35.160.104:3260,1 -n node.startup -v manual --op=update' (cwd None) >Thread-1042::DEBUG::2014-07-10 08:25:52,475::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-1042::DEBUG::2014-07-10 08:25:52,476::hsm::2353::Storage.HSM::(__prefetchDomains) Found SD uuids: ('e01a3a36-d2ce-4153-bb57-d6e65b7ed08c',) >Thread-1042::DEBUG::2014-07-10 08:25:52,476::hsm::2409::Storage.HSM::(connectStorageServer) knownSDs: {f34d0693-3747-467e-9a7c-8d73e8fb1171: storage.nfsSD.findDomain, 33100657-451b-45f5-9a71-9fed8490e696: storage.nfsSD.findDomain, 41530dea-409a-4a3d-ad8a-6f714a9b5986: storage.nfsSD.findDomain, 6a70504d-00df-4869-8695-0f442053f6b6: storage.nfsSD.findDomain, e01a3a36-d2ce-4153-bb57-d6e65b7ed08c: storage.blockSD.findDomain, cb15e53b-995b-47d6-b132-0ad9d148269e: storage.nfsSD.findDomain} >Thread-1042::DEBUG::2014-07-10 08:25:52,477::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) '/usr/bin/sudo -n /sbin/iscsiadm -m node -T iqn.1992-04.com.emc:cx.ckm00121000438.a7 -I default -p 10.35.160.105:3260,2 --op=new' (cwd None) >Thread-1044::DEBUG::2014-07-10 08:25:52,540::task::595::TaskManager.Task::(_updateState) Task=`5bb0786c-51c8-40d2-8076-1cbfdca676fe`::moving from state init -> state preparing >Thread-1044::INFO::2014-07-10 08:25:52,541::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-1044::INFO::2014-07-10 08:25:52,541::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-1044::DEBUG::2014-07-10 08:25:52,541::task::1185::TaskManager.Task::(prepare) Task=`5bb0786c-51c8-40d2-8076-1cbfdca676fe`::finished: {} >Thread-1044::DEBUG::2014-07-10 08:25:52,541::task::595::TaskManager.Task::(_updateState) Task=`5bb0786c-51c8-40d2-8076-1cbfdca676fe`::moving from state preparing -> state finished >Thread-1044::DEBUG::2014-07-10 08:25:52,541::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-1044::DEBUG::2014-07-10 08:25:52,542::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1044::DEBUG::2014-07-10 08:25:52,542::task::990::TaskManager.Task::(_decref) Task=`5bb0786c-51c8-40d2-8076-1cbfdca676fe`::ref 0 aborting False >Thread-1042::DEBUG::2014-07-10 08:25:52,552::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-1042::DEBUG::2014-07-10 08:25:52,559::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) '/usr/bin/sudo -n /sbin/iscsiadm -m node -T iqn.1992-04.com.emc:cx.ckm00121000438.a7 -I default -p 10.35.160.105:3260,2 -l' (cwd None) >Thread-1042::DEBUG::2014-07-10 08:25:53,149::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-1042::DEBUG::2014-07-10 08:25:53,150::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) '/usr/bin/sudo -n /sbin/iscsiadm -m node -T iqn.1992-04.com.emc:cx.ckm00121000438.a7 -I default -p 10.35.160.105:3260,2 -n node.startup -v manual --op=update' (cwd None) >Thread-1042::DEBUG::2014-07-10 08:25:53,221::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-1042::DEBUG::2014-07-10 08:25:53,222::hsm::2353::Storage.HSM::(__prefetchDomains) Found SD uuids: ('e01a3a36-d2ce-4153-bb57-d6e65b7ed08c',) >Thread-1042::DEBUG::2014-07-10 08:25:53,223::hsm::2409::Storage.HSM::(connectStorageServer) knownSDs: {f34d0693-3747-467e-9a7c-8d73e8fb1171: storage.nfsSD.findDomain, 33100657-451b-45f5-9a71-9fed8490e696: storage.nfsSD.findDomain, 41530dea-409a-4a3d-ad8a-6f714a9b5986: storage.nfsSD.findDomain, 6a70504d-00df-4869-8695-0f442053f6b6: storage.nfsSD.findDomain, e01a3a36-d2ce-4153-bb57-d6e65b7ed08c: storage.blockSD.findDomain, cb15e53b-995b-47d6-b132-0ad9d148269e: storage.nfsSD.findDomain} >Thread-1042::DEBUG::2014-07-10 08:25:53,223::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) '/usr/bin/sudo -n /sbin/iscsiadm -m node -T iqn.1992-04.com.emc:cx.ckm00121000438.b7 -I default -p 10.35.160.107:3260,4 --op=new' (cwd None) >Thread-1042::DEBUG::2014-07-10 08:25:53,290::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-1042::DEBUG::2014-07-10 08:25:53,291::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) '/usr/bin/sudo -n /sbin/iscsiadm -m node -T iqn.1992-04.com.emc:cx.ckm00121000438.b7 -I default -p 10.35.160.107:3260,4 -l' (cwd None) >Thread-1042::DEBUG::2014-07-10 08:25:53,353::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-1042::DEBUG::2014-07-10 08:25:53,354::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) '/usr/bin/sudo -n /sbin/iscsiadm -m node -T iqn.1992-04.com.emc:cx.ckm00121000438.b7 -I default -p 10.35.160.107:3260,4 -n node.startup -v manual --op=update' (cwd None) >Thread-1042::DEBUG::2014-07-10 08:25:53,418::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-1042::DEBUG::2014-07-10 08:25:53,419::hsm::2353::Storage.HSM::(__prefetchDomains) Found SD uuids: ('e01a3a36-d2ce-4153-bb57-d6e65b7ed08c',) >Thread-1042::DEBUG::2014-07-10 08:25:53,419::hsm::2409::Storage.HSM::(connectStorageServer) knownSDs: {f34d0693-3747-467e-9a7c-8d73e8fb1171: storage.nfsSD.findDomain, 33100657-451b-45f5-9a71-9fed8490e696: storage.nfsSD.findDomain, 41530dea-409a-4a3d-ad8a-6f714a9b5986: storage.nfsSD.findDomain, 6a70504d-00df-4869-8695-0f442053f6b6: storage.nfsSD.findDomain, e01a3a36-d2ce-4153-bb57-d6e65b7ed08c: storage.blockSD.findDomain, cb15e53b-995b-47d6-b132-0ad9d148269e: storage.nfsSD.findDomain} >Thread-1042::DEBUG::2014-07-10 08:25:53,420::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) '/usr/bin/sudo -n /sbin/iscsiadm -m node -T iqn.1992-04.com.emc:cx.ckm00121000438.b6 -I default -p 10.35.160.106:3260,3 --op=new' (cwd None) >Thread-1042::DEBUG::2014-07-10 08:25:53,489::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-1042::DEBUG::2014-07-10 08:25:53,490::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) '/usr/bin/sudo -n /sbin/iscsiadm -m node -T iqn.1992-04.com.emc:cx.ckm00121000438.b6 -I default -p 10.35.160.106:3260,3 -l' (cwd None) >Thread-1042::DEBUG::2014-07-10 08:25:53,563::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-1042::DEBUG::2014-07-10 08:25:53,564::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) '/usr/bin/sudo -n /sbin/iscsiadm -m node -T iqn.1992-04.com.emc:cx.ckm00121000438.b6 -I default -p 10.35.160.106:3260,3 -n node.startup -v manual --op=update' (cwd None) >Thread-1042::DEBUG::2014-07-10 08:25:53,632::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-1042::DEBUG::2014-07-10 08:25:53,633::hsm::2353::Storage.HSM::(__prefetchDomains) Found SD uuids: ('e01a3a36-d2ce-4153-bb57-d6e65b7ed08c',) >Thread-1042::DEBUG::2014-07-10 08:25:53,634::hsm::2409::Storage.HSM::(connectStorageServer) knownSDs: {f34d0693-3747-467e-9a7c-8d73e8fb1171: storage.nfsSD.findDomain, 33100657-451b-45f5-9a71-9fed8490e696: storage.nfsSD.findDomain, 41530dea-409a-4a3d-ad8a-6f714a9b5986: storage.nfsSD.findDomain, 6a70504d-00df-4869-8695-0f442053f6b6: storage.nfsSD.findDomain, e01a3a36-d2ce-4153-bb57-d6e65b7ed08c: storage.blockSD.findDomain, cb15e53b-995b-47d6-b132-0ad9d148269e: storage.nfsSD.findDomain} >Thread-1042::DEBUG::2014-07-10 08:25:53,635::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) '/usr/bin/sudo -n /sbin/iscsiadm -m node -T iqn.1992-04.com.emc:cx.ckm00121000438.a6 -I default -p 10.35.160.104:3260,1 --op=new' (cwd None) >Thread-1042::DEBUG::2014-07-10 08:25:53,765::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-1042::DEBUG::2014-07-10 08:25:53,766::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) '/usr/bin/sudo -n /sbin/iscsiadm -m node -T iqn.1992-04.com.emc:cx.ckm00121000438.a6 -I default -p 10.35.160.104:3260,1 -l' (cwd None) >Thread-1042::DEBUG::2014-07-10 08:25:53,848::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-1042::DEBUG::2014-07-10 08:25:53,849::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) '/usr/bin/sudo -n /sbin/iscsiadm -m node -T iqn.1992-04.com.emc:cx.ckm00121000438.a6 -I default -p 10.35.160.104:3260,1 -n node.startup -v manual --op=update' (cwd None) >Thread-1042::DEBUG::2014-07-10 08:25:53,918::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-1042::DEBUG::2014-07-10 08:25:53,919::hsm::2353::Storage.HSM::(__prefetchDomains) Found SD uuids: ('e01a3a36-d2ce-4153-bb57-d6e65b7ed08c',) >Thread-1042::DEBUG::2014-07-10 08:25:53,920::hsm::2409::Storage.HSM::(connectStorageServer) knownSDs: {f34d0693-3747-467e-9a7c-8d73e8fb1171: storage.nfsSD.findDomain, 33100657-451b-45f5-9a71-9fed8490e696: storage.nfsSD.findDomain, 41530dea-409a-4a3d-ad8a-6f714a9b5986: storage.nfsSD.findDomain, 6a70504d-00df-4869-8695-0f442053f6b6: storage.nfsSD.findDomain, e01a3a36-d2ce-4153-bb57-d6e65b7ed08c: storage.blockSD.findDomain, cb15e53b-995b-47d6-b132-0ad9d148269e: storage.nfsSD.findDomain} >Thread-1042::DEBUG::2014-07-10 08:25:53,921::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) '/usr/bin/sudo -n /sbin/iscsiadm -m node -T iqn.1992-04.com.emc:cx.ckm00121000438.a7 -I default -p 10.35.160.105:3260,2 --op=new' (cwd None) >Thread-1042::DEBUG::2014-07-10 08:25:53,992::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-1042::DEBUG::2014-07-10 08:25:53,993::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) '/usr/bin/sudo -n /sbin/iscsiadm -m node -T iqn.1992-04.com.emc:cx.ckm00121000438.a7 -I default -p 10.35.160.105:3260,2 -l' (cwd None) >Thread-1042::DEBUG::2014-07-10 08:25:54,069::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-1042::DEBUG::2014-07-10 08:25:54,070::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) '/usr/bin/sudo -n /sbin/iscsiadm -m node -T iqn.1992-04.com.emc:cx.ckm00121000438.a7 -I default -p 10.35.160.105:3260,2 -n node.startup -v manual --op=update' (cwd None) >Thread-1042::DEBUG::2014-07-10 08:25:54,140::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-1042::DEBUG::2014-07-10 08:25:54,140::hsm::2353::Storage.HSM::(__prefetchDomains) Found SD uuids: ('e01a3a36-d2ce-4153-bb57-d6e65b7ed08c',) >Thread-1042::DEBUG::2014-07-10 08:25:54,141::hsm::2409::Storage.HSM::(connectStorageServer) knownSDs: {f34d0693-3747-467e-9a7c-8d73e8fb1171: storage.nfsSD.findDomain, 33100657-451b-45f5-9a71-9fed8490e696: storage.nfsSD.findDomain, 41530dea-409a-4a3d-ad8a-6f714a9b5986: storage.nfsSD.findDomain, 6a70504d-00df-4869-8695-0f442053f6b6: storage.nfsSD.findDomain, e01a3a36-d2ce-4153-bb57-d6e65b7ed08c: storage.blockSD.findDomain, cb15e53b-995b-47d6-b132-0ad9d148269e: storage.nfsSD.findDomain} >Thread-1042::INFO::2014-07-10 08:25:54,141::logUtils::47::dispatcher::(wrapper) Run and protect: connectStorageServer, Return response: {'statuslist': [{'status': 0, 'id': '21af9f33-77f4-44ce-afd8-ac2b9d767d2d'}, {'status': 0, 'id': 'bf1f6c61-9095-46fa-ae99-483613a91747'}, {'status': 0, 'id': 'e2ffc61c-fdb9-46ce-b87b-7235401ebf49'}, {'status': 0, 'id': 'fa5dd339-edaa-44d5-9807-e488406bb839'}, {'status': 0, 'id': '21af9f33-77f4-44ce-afd8-ac2b9d767d2d'}, {'status': 0, 'id': 'bf1f6c61-9095-46fa-ae99-483613a91747'}, {'status': 0, 'id': 'e2ffc61c-fdb9-46ce-b87b-7235401ebf49'}, {'status': 0, 'id': 'fa5dd339-edaa-44d5-9807-e488406bb839'}]} >Thread-1042::DEBUG::2014-07-10 08:25:54,142::task::1185::TaskManager.Task::(prepare) Task=`de1eb6cc-cf70-4539-913e-f066d4914ea9`::finished: {'statuslist': [{'status': 0, 'id': '21af9f33-77f4-44ce-afd8-ac2b9d767d2d'}, {'status': 0, 'id': 'bf1f6c61-9095-46fa-ae99-483613a91747'}, {'status': 0, 'id': 'e2ffc61c-fdb9-46ce-b87b-7235401ebf49'}, {'status': 0, 'id': 'fa5dd339-edaa-44d5-9807-e488406bb839'}, {'status': 0, 'id': '21af9f33-77f4-44ce-afd8-ac2b9d767d2d'}, {'status': 0, 'id': 'bf1f6c61-9095-46fa-ae99-483613a91747'}, {'status': 0, 'id': 'e2ffc61c-fdb9-46ce-b87b-7235401ebf49'}, {'status': 0, 'id': 'fa5dd339-edaa-44d5-9807-e488406bb839'}]} >Thread-1042::DEBUG::2014-07-10 08:25:54,142::task::595::TaskManager.Task::(_updateState) Task=`de1eb6cc-cf70-4539-913e-f066d4914ea9`::moving from state preparing -> state finished >Thread-1042::DEBUG::2014-07-10 08:25:54,142::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-1042::DEBUG::2014-07-10 08:25:54,142::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1042::DEBUG::2014-07-10 08:25:54,142::task::990::TaskManager.Task::(_decref) Task=`de1eb6cc-cf70-4539-913e-f066d4914ea9`::ref 0 aborting False >Thread-1042::DEBUG::2014-07-10 08:25:54,156::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [743e0868] >Thread-1042::DEBUG::2014-07-10 08:25:54,158::task::595::TaskManager.Task::(_updateState) Task=`e286bc07-0ee3-4aed-a1a3-82b4e98c50db`::moving from state init -> state preparing >Thread-1042::INFO::2014-07-10 08:25:54,158::logUtils::44::dispatcher::(wrapper) Run and protect: getVGInfo(vgUUID='GJcVo5-Y0kU-CDub-zITS-zfoL-Z7hz-SeVeIe', options=None) >Thread-1042::DEBUG::2014-07-10 08:25:54,269::lvm::325::OperationMutex::(_reloadpvs) Operation 'lvm reload operation' got the operation mutex >Thread-1042::DEBUG::2014-07-10 08:25:54,271::lvm::296::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm pvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/3600601601282300032826addbbdae311|/dev/mapper/360060160f4a030003840ec867ddee311|/dev/mapper/367cad74c2fcba00019e6afd20c781e67|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,size,vg_name,vg_uuid,pe_start,pe_count,pe_alloc_count,mda_count,dev_size /dev/mapper/3600601601282300032826addbbdae311' (cwd None) >Thread-1042::DEBUG::2014-07-10 08:25:54,686::lvm::296::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-1042::DEBUG::2014-07-10 08:25:54,687::lvm::350::OperationMutex::(_reloadpvs) Operation 'lvm reload operation' released the operation mutex >Thread-1042::DEBUG::2014-07-10 08:25:54,688::lvm::325::OperationMutex::(_reloadpvs) Operation 'lvm reload operation' got the operation mutex >Thread-1042::DEBUG::2014-07-10 08:25:54,689::lvm::296::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm pvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/3600601601282300032826addbbdae311|/dev/mapper/360060160f4a030003840ec867ddee311|/dev/mapper/367cad74c2fcba00019e6afd20c781e67|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,size,vg_name,vg_uuid,pe_start,pe_count,pe_alloc_count,mda_count,dev_size /dev/mapper/360060160f4a030003840ec867ddee311' (cwd None) >Thread-1042::DEBUG::2014-07-10 08:25:54,965::lvm::296::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-1042::DEBUG::2014-07-10 08:25:54,966::lvm::350::OperationMutex::(_reloadpvs) Operation 'lvm reload operation' released the operation mutex >Thread-1042::INFO::2014-07-10 08:25:54,967::logUtils::47::dispatcher::(wrapper) Run and protect: getVGInfo, Return response: {'info': {'state': 'OK', 'vgsize': '1152393412608', 'name': 'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c', 'vgfree': '1137495244800', 'vgUUID': 'GJcVo5-Y0kU-CDub-zITS-zfoL-Z7hz-SeVeIe', 'pvlist': [{'vendorID': 'DGC', 'capacity': '1099108974592', 'fwrev': '0000', 'vgUUID': 'GJcVo5-Y0kU-CDub-zITS-zfoL-Z7hz-SeVeIe', 'pathlist': [{'connection': '10.35.160.107', 'iqn': 'iqn.1992-04.com.emc:cx.ckm00121000438.b7', 'portal': '4', 'port': '3260', 'initiatorname': 'default'}, {'connection': '10.35.160.106', 'iqn': 'iqn.1992-04.com.emc:cx.ckm00121000438.b6', 'portal': '3', 'port': '3260', 'initiatorname': 'default'}, {'connection': '10.35.160.104', 'iqn': 'iqn.1992-04.com.emc:cx.ckm00121000438.a6', 'portal': '1', 'port': '3260', 'initiatorname': 'default'}, {'connection': '10.35.160.105', 'iqn': 'iqn.1992-04.com.emc:cx.ckm00121000438.a7', 'portal': '2', 'port': '3260', 'initiatorname': 'default'}], 'pathstatus': [{'physdev': 'sdb', 'type': 'iSCSI', 'state': 'active', 'lun': '0'}, {'physdev': 'sdd', 'type': 'iSCSI', 'state': 'active', 'lun': '0'}, {'physdev': 'sdf', 'type': 'iSCSI', 'state': 'active', 'lun': '0'}, {'physdev': 'sdh', 'type': 'iSCSI', 'state': 'active', 'lun': '0'}], 'devtype': 'iSCSI', 'pvUUID': 'ZdReOp-Yf8A-beQm-ne4I-pN3J-rxgm-9Ew0S1', 'serial': 'SDGC_VRAID_CKM00121000438', 'GUID': '3600601601282300032826addbbdae311', 'devcapacity': '1099511627776', 'productID': 'VRAID'}, {'vendorID': 'DGC', 'capacity': '53284438016', 'fwrev': '0000', 'vgUUID': 'GJcVo5-Y0kU-CDub-zITS-zfoL-Z7hz-SeVeIe', 'pathlist': [{'connection': '10.35.160.107', 'iqn': 'iqn.1992-04.com.emc:cx.ckm00121000438.b7', 'portal': '4', 'port': '3260', 'initiatorname': 'default'}, {'connection': '10.35.160.106', 'iqn': 'iqn.1992-04.com.emc:cx.ckm00121000438.b6', 'portal': '3', 'port': '3260', 'initiatorname': 'default'}, {'connection': '10.35.160.104', 'iqn': 'iqn.1992-04.com.emc:cx.ckm00121000438.a6', 'portal': '1', 'port': '3260', 'initiatorname': 'default'}, {'connection': '10.35.160.105', 'iqn': 'iqn.1992-04.com.emc:cx.ckm00121000438.a7', 'portal': '2', 'port': '3260', 'initiatorname': 'default'}], 'pathstatus': [{'physdev': 'sdc', 'type': 'iSCSI', 'state': 'active', 'lun': '1'}, {'physdev': 'sde', 'type': 'iSCSI', 'state': 'active', 'lun': '1'}, {'physdev': 'sdg', 'type': 'iSCSI', 'state': 'active', 'lun': '1'}, {'physdev': 'sdi', 'type': 'iSCSI', 'state': 'active', 'lun': '1'}], 'devtype': 'iSCSI', 'pvUUID': '0eUwla-dsA3-g6ia-RU23-cual-0rt9-KzkxLj', 'serial': 'SDGC_VRAID_CKM00121000438', 'GUID': '360060160f4a030003840ec867ddee311', 'devcapacity': '53687091200', 'productID': 'VRAID'}], 'type': 3, 'attr': {'allocation': 'n', 'partial': '-', 'exported': '-', 'permission': 'w', 'clustered': '-', 'resizeable': 'z'}}} >Thread-1042::DEBUG::2014-07-10 08:25:54,967::task::1185::TaskManager.Task::(prepare) Task=`e286bc07-0ee3-4aed-a1a3-82b4e98c50db`::finished: {'info': {'state': 'OK', 'vgsize': '1152393412608', 'name': 'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c', 'vgfree': '1137495244800', 'vgUUID': 'GJcVo5-Y0kU-CDub-zITS-zfoL-Z7hz-SeVeIe', 'pvlist': [{'vendorID': 'DGC', 'capacity': '1099108974592', 'fwrev': '0000', 'vgUUID': 'GJcVo5-Y0kU-CDub-zITS-zfoL-Z7hz-SeVeIe', 'pathlist': [{'connection': '10.35.160.107', 'iqn': 'iqn.1992-04.com.emc:cx.ckm00121000438.b7', 'portal': '4', 'port': '3260', 'initiatorname': 'default'}, {'connection': '10.35.160.106', 'iqn': 'iqn.1992-04.com.emc:cx.ckm00121000438.b6', 'portal': '3', 'port': '3260', 'initiatorname': 'default'}, {'connection': '10.35.160.104', 'iqn': 'iqn.1992-04.com.emc:cx.ckm00121000438.a6', 'portal': '1', 'port': '3260', 'initiatorname': 'default'}, {'connection': '10.35.160.105', 'iqn': 'iqn.1992-04.com.emc:cx.ckm00121000438.a7', 'portal': '2', 'port': '3260', 'initiatorname': 'default'}], 'pathstatus': [{'physdev': 'sdb', 'type': 'iSCSI', 'state': 'active', 'lun': '0'}, {'physdev': 'sdd', 'type': 'iSCSI', 'state': 'active', 'lun': '0'}, {'physdev': 'sdf', 'type': 'iSCSI', 'state': 'active', 'lun': '0'}, {'physdev': 'sdh', 'type': 'iSCSI', 'state': 'active', 'lun': '0'}], 'devtype': 'iSCSI', 'pvUUID': 'ZdReOp-Yf8A-beQm-ne4I-pN3J-rxgm-9Ew0S1', 'serial': 'SDGC_VRAID_CKM00121000438', 'GUID': '3600601601282300032826addbbdae311', 'devcapacity': '1099511627776', 'productID': 'VRAID'}, {'vendorID': 'DGC', 'capacity': '53284438016', 'fwrev': '0000', 'vgUUID': 'GJcVo5-Y0kU-CDub-zITS-zfoL-Z7hz-SeVeIe', 'pathlist': [{'connection': '10.35.160.107', 'iqn': 'iqn.1992-04.com.emc:cx.ckm00121000438.b7', 'portal': '4', 'port': '3260', 'initiatorname': 'default'}, {'connection': '10.35.160.106', 'iqn': 'iqn.1992-04.com.emc:cx.ckm00121000438.b6', 'portal': '3', 'port': '3260', 'initiatorname': 'default'}, {'connection': '10.35.160.104', 'iqn': 'iqn.1992-04.com.emc:cx.ckm00121000438.a6', 'portal': '1', 'port': '3260', 'initiatorname': 'default'}, {'connection': '10.35.160.105', 'iqn': 'iqn.1992-04.com.emc:cx.ckm00121000438.a7', 'portal': '2', 'port': '3260', 'initiatorname': 'default'}], 'pathstatus': [{'physdev': 'sdc', 'type': 'iSCSI', 'state': 'active', 'lun': '1'}, {'physdev': 'sde', 'type': 'iSCSI', 'state': 'active', 'lun': '1'}, {'physdev': 'sdg', 'type': 'iSCSI', 'state': 'active', 'lun': '1'}, {'physdev': 'sdi', 'type': 'iSCSI', 'state': 'active', 'lun': '1'}], 'devtype': 'iSCSI', 'pvUUID': '0eUwla-dsA3-g6ia-RU23-cual-0rt9-KzkxLj', 'serial': 'SDGC_VRAID_CKM00121000438', 'GUID': '360060160f4a030003840ec867ddee311', 'devcapacity': '53687091200', 'productID': 'VRAID'}], 'type': 3, 'attr': {'allocation': 'n', 'partial': '-', 'exported': '-', 'permission': 'w', 'clustered': '-', 'resizeable': 'z'}}} >Thread-1042::DEBUG::2014-07-10 08:25:54,967::task::595::TaskManager.Task::(_updateState) Task=`e286bc07-0ee3-4aed-a1a3-82b4e98c50db`::moving from state preparing -> state finished >Thread-1042::DEBUG::2014-07-10 08:25:54,968::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-1042::DEBUG::2014-07-10 08:25:54,968::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1042::DEBUG::2014-07-10 08:25:54,968::task::990::TaskManager.Task::(_decref) Task=`e286bc07-0ee3-4aed-a1a3-82b4e98c50db`::ref 0 aborting False >Thread-1042::DEBUG::2014-07-10 08:25:55,009::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [64ccce3e] >Thread-1042::DEBUG::2014-07-10 08:25:55,010::task::595::TaskManager.Task::(_updateState) Task=`3599200d-f505-405c-82c4-432034ee9f46`::moving from state init -> state preparing >Thread-1042::INFO::2014-07-10 08:25:55,011::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='411039e4-4af2-4192-9de0-67dc1ed83ba9', options=None) >Thread-1042::ERROR::2014-07-10 08:25:55,011::task::866::TaskManager.Task::(_setError) Task=`3599200d-f505-405c-82c4-432034ee9f46`::Unexpected error >Traceback (most recent call last): > File "/usr/share/vdsm/storage/task.py", line 873, in _run > File "/usr/share/vdsm/logUtils.py", line 45, in wrapper > File "/usr/share/vdsm/storage/hsm.py", line 629, in getSpmStatus > File "/usr/share/vdsm/storage/hsm.py", line 326, in getPool >StoragePoolUnknown: Unknown pool id, pool not connected: ('411039e4-4af2-4192-9de0-67dc1ed83ba9',) >Thread-1042::DEBUG::2014-07-10 08:25:55,013::task::885::TaskManager.Task::(_run) Task=`3599200d-f505-405c-82c4-432034ee9f46`::Task._run: 3599200d-f505-405c-82c4-432034ee9f46 ('411039e4-4af2-4192-9de0-67dc1ed83ba9',) {} failed - stopping task >Thread-1042::DEBUG::2014-07-10 08:25:55,014::task::1211::TaskManager.Task::(stop) Task=`3599200d-f505-405c-82c4-432034ee9f46`::stopping in state preparing (force False) >Thread-1042::DEBUG::2014-07-10 08:25:55,014::task::990::TaskManager.Task::(_decref) Task=`3599200d-f505-405c-82c4-432034ee9f46`::ref 1 aborting True >Thread-1042::INFO::2014-07-10 08:25:55,014::task::1168::TaskManager.Task::(prepare) Task=`3599200d-f505-405c-82c4-432034ee9f46`::aborting: Task is aborted: 'Unknown pool id, pool not connected' - code 309 >Thread-1042::DEBUG::2014-07-10 08:25:55,014::task::1173::TaskManager.Task::(prepare) Task=`3599200d-f505-405c-82c4-432034ee9f46`::Prepare: aborted: Unknown pool id, pool not connected >Thread-1042::DEBUG::2014-07-10 08:25:55,015::task::990::TaskManager.Task::(_decref) Task=`3599200d-f505-405c-82c4-432034ee9f46`::ref 0 aborting True >Thread-1042::DEBUG::2014-07-10 08:25:55,015::task::925::TaskManager.Task::(_doAbort) Task=`3599200d-f505-405c-82c4-432034ee9f46`::Task._doAbort: force False >Thread-1042::DEBUG::2014-07-10 08:25:55,015::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1042::DEBUG::2014-07-10 08:25:55,015::task::595::TaskManager.Task::(_updateState) Task=`3599200d-f505-405c-82c4-432034ee9f46`::moving from state preparing -> state aborting >Thread-1042::DEBUG::2014-07-10 08:25:55,015::task::550::TaskManager.Task::(__state_aborting) Task=`3599200d-f505-405c-82c4-432034ee9f46`::_aborting: recover policy none >Thread-1042::DEBUG::2014-07-10 08:25:55,015::task::595::TaskManager.Task::(_updateState) Task=`3599200d-f505-405c-82c4-432034ee9f46`::moving from state aborting -> state failed >Thread-1042::DEBUG::2014-07-10 08:25:55,016::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-1042::DEBUG::2014-07-10 08:25:55,016::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1042::ERROR::2014-07-10 08:25:55,016::dispatcher::65::Storage.Dispatcher.Protect::(run) {'status': {'message': "Unknown pool id, pool not connected: ('411039e4-4af2-4192-9de0-67dc1ed83ba9',)", 'code': 309}} >Thread-1042::DEBUG::2014-07-10 08:25:55,062::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [64ccce3e] >Thread-1042::DEBUG::2014-07-10 08:25:55,063::task::595::TaskManager.Task::(_updateState) Task=`176b67a8-580d-4881-8194-9cf081ca9efa`::moving from state init -> state preparing >Thread-1042::INFO::2014-07-10 08:25:55,063::logUtils::44::dispatcher::(wrapper) Run and protect: connectStoragePool(spUUID='411039e4-4af2-4192-9de0-67dc1ed83ba9', hostID=1, msdUUID='e01a3a36-d2ce-4153-bb57-d6e65b7ed08c', masterVersion=1, domainsMap=None, options=None) >Thread-1042::DEBUG::2014-07-10 08:25:55,064::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.HsmDomainMonitorLock`ReqID=`dba66eea-37f6-4a54-957f-ce692d2340d9`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '1018' at 'connectStoragePool' >Thread-1042::DEBUG::2014-07-10 08:25:55,064::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.HsmDomainMonitorLock' for lock type 'exclusive' >Thread-1042::DEBUG::2014-07-10 08:25:55,064::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.HsmDomainMonitorLock' is free. Now locking as 'exclusive' (1 active user) >Thread-1042::DEBUG::2014-07-10 08:25:55,065::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.HsmDomainMonitorLock`ReqID=`dba66eea-37f6-4a54-957f-ce692d2340d9`::Granted request >Thread-1042::DEBUG::2014-07-10 08:25:55,065::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9`ReqID=`d46386c4-682c-4d92-817a-93af24f35b66`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '1066' at '_connectStoragePool' >Thread-1042::DEBUG::2014-07-10 08:25:55,066::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' for lock type 'exclusive' >Thread-1042::DEBUG::2014-07-10 08:25:55,066::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' is free. Now locking as 'exclusive' (1 active user) >Thread-1042::DEBUG::2014-07-10 08:25:55,066::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9`ReqID=`d46386c4-682c-4d92-817a-93af24f35b66`::Granted request >Thread-1042::INFO::2014-07-10 08:25:55,067::sp::133::Storage.StoragePool::(setBackend) updating pool 411039e4-4af2-4192-9de0-67dc1ed83ba9 backend from type NoneType instance 0x7f732209c210 to type StoragePoolDiskBackend instance 0x7f72c80ab170 >Thread-1042::INFO::2014-07-10 08:25:55,067::sp::623::Storage.StoragePool::(connect) Connect host #1 to the storage pool 411039e4-4af2-4192-9de0-67dc1ed83ba9 with master domain: e01a3a36-d2ce-4153-bb57-d6e65b7ed08c (ver = 1) >Thread-1042::DEBUG::2014-07-10 08:25:55,067::lvm::497::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-1042::DEBUG::2014-07-10 08:25:55,067::lvm::499::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-1042::DEBUG::2014-07-10 08:25:55,068::lvm::508::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-1042::DEBUG::2014-07-10 08:25:55,068::lvm::510::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-1042::DEBUG::2014-07-10 08:25:55,068::lvm::528::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-1042::DEBUG::2014-07-10 08:25:55,068::lvm::530::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-1042::DEBUG::2014-07-10 08:25:55,069::misc::756::SamplingMethod::(__call__) Trying to enter sampling method (storage.sdc.refreshStorage) >Thread-1042::DEBUG::2014-07-10 08:25:55,069::misc::758::SamplingMethod::(__call__) Got in to sampling method >Thread-1042::DEBUG::2014-07-10 08:25:55,069::misc::756::SamplingMethod::(__call__) Trying to enter sampling method (storage.iscsi.rescan) >Thread-1042::DEBUG::2014-07-10 08:25:55,069::misc::758::SamplingMethod::(__call__) Got in to sampling method >Thread-1042::DEBUG::2014-07-10 08:25:55,070::iscsi::407::Storage.ISCSI::(rescan) Performing SCSI scan, this will take up to 30 seconds >Thread-1042::DEBUG::2014-07-10 08:25:55,070::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) '/usr/bin/sudo -n /sbin/iscsiadm -m session -R' (cwd None) >Thread-1042::DEBUG::2014-07-10 08:25:55,151::misc::766::SamplingMethod::(__call__) Returning last result >Thread-1042::DEBUG::2014-07-10 08:25:55,152::multipath::110::Storage.Misc.excCmd::(rescan) '/usr/bin/sudo -n /sbin/multipath -r' (cwd None) >Thread-1042::DEBUG::2014-07-10 08:25:55,371::multipath::110::Storage.Misc.excCmd::(rescan) SUCCESS: <err> = ''; <rc> = 0 >Thread-1042::DEBUG::2014-07-10 08:25:55,371::lvm::497::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-1042::DEBUG::2014-07-10 08:25:55,372::lvm::499::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-1042::DEBUG::2014-07-10 08:25:55,372::lvm::508::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-1042::DEBUG::2014-07-10 08:25:55,372::lvm::510::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-1042::DEBUG::2014-07-10 08:25:55,373::lvm::528::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-1042::DEBUG::2014-07-10 08:25:55,373::lvm::530::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-1042::DEBUG::2014-07-10 08:25:55,373::misc::766::SamplingMethod::(__call__) Returning last result >Thread-1042::DEBUG::2014-07-10 08:25:55,373::lvm::373::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-1042::DEBUG::2014-07-10 08:25:55,377::lvm::296::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/3600601601282300032826addbbdae311|/dev/mapper/360060160f4a030003840ec867ddee311|/dev/mapper/367cad74c2fcba00019e6afd20c781e67|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name e01a3a36-d2ce-4153-bb57-d6e65b7ed08c' (cwd None) >Thread-1042::DEBUG::2014-07-10 08:25:55,660::lvm::296::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-1042::DEBUG::2014-07-10 08:25:55,663::lvm::415::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-1042::DEBUG::2014-07-10 08:25:55,663::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with LvMetadataRW backend >Thread-1042::DEBUG::2014-07-10 08:25:55,664::blockSD::336::Storage.Misc.excCmd::(readlines) '/bin/dd iflag=direct skip=0 bs=2048 if=/dev/e01a3a36-d2ce-4153-bb57-d6e65b7ed08c/metadata count=1' (cwd None) >Thread-1042::DEBUG::2014-07-10 08:25:55,739::blockSD::336::Storage.Misc.excCmd::(readlines) SUCCESS: <err> = '1+0 records in\n1+0 records out\n2048 bytes (2.0 kB) copied, 0.0175202 s, 117 kB/s\n'; <rc> = 0 >Thread-1042::DEBUG::2014-07-10 08:25:55,739::misc::282::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '2048 bytes (2.0 kB) copied, 0.0175202 s, 117 kB/s'], size: 2048 >Thread-1042::DEBUG::2014-07-10 08:25:55,740::persistentDict::234::Storage.PersistentDict::(refresh) read lines (LvMetadataRW)=[] >Thread-1042::WARNING::2014-07-10 08:25:55,740::persistentDict::256::Storage.PersistentDict::(refresh) data has no embedded checksum - trust it as it is >Thread-1042::DEBUG::2014-07-10 08:25:55,740::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with VGTagMetadataRW backend >Thread-1042::DEBUG::2014-07-10 08:25:55,741::lvm::503::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-1042::DEBUG::2014-07-10 08:25:55,741::lvm::505::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-1042::DEBUG::2014-07-10 08:25:55,741::lvm::513::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-1042::DEBUG::2014-07-10 08:25:55,742::lvm::525::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-1042::DEBUG::2014-07-10 08:25:55,742::lvm::373::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-1042::DEBUG::2014-07-10 08:25:55,743::lvm::296::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/3600601601282300032826addbbdae311|/dev/mapper/360060160f4a030003840ec867ddee311|/dev/mapper/367cad74c2fcba00019e6afd20c781e67|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name e01a3a36-d2ce-4153-bb57-d6e65b7ed08c' (cwd None) >Thread-1042::DEBUG::2014-07-10 08:25:56,031::lvm::296::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-1042::DEBUG::2014-07-10 08:25:56,034::lvm::415::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-1042::DEBUG::2014-07-10 08:25:56,034::persistentDict::234::Storage.PersistentDict::(refresh) read lines (VGTagMetadataRW)=['LEASETIMESEC=60', 'CLASS=Data', 'VERSION=3', u'PV1=pv:360060160f4a030003840ec867ddee311,uuid:0eUwla-dsA3-g6ia-RU23-cual-0rt9-KzkxLj,pestart:0,pecount:397,mapoffset:8189', u'PV0=pv:3600601601282300032826addbbdae311,uuid:ZdReOp-Yf8A-beQm-ne4I-pN3J-rxgm-9Ew0S1,pestart:0,pecount:8189,mapoffset:0', 'LOGBLKSIZE=512', 'LEASERETRIES=3', 'IOOPTIMEOUTSEC=10', 'LOCKRENEWALINTERVALSEC=5', 'PHYBLKSIZE=512', 'SDUUID=e01a3a36-d2ce-4153-bb57-d6e65b7ed08c', 'DESCRIPTION=SD-REAL', 'LOCKPOLICY=', 'VGUUID=GJcVo5-Y0kU-CDub-zITS-zfoL-Z7hz-SeVeIe', 'TYPE=ISCSI', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=DC-REAL', 'ROLE=Master', 'POOL_UUID=411039e4-4af2-4192-9de0-67dc1ed83ba9', 'POOL_SPM_LVER=2', 'POOL_DOMAINS=e01a3a36-d2ce-4153-bb57-d6e65b7ed08c:Active', '_SHA_CKSUM=0862f206224f948dbd549e5f29740569287a60bc', 'POOL_SPM_ID=-1'] >Thread-1042::INFO::2014-07-10 08:25:56,036::sd::384::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace e01a3a36-d2ce-4153-bb57-d6e65b7ed08c_imageNS already registered >Thread-1042::INFO::2014-07-10 08:25:56,036::sd::392::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace e01a3a36-d2ce-4153-bb57-d6e65b7ed08c_volumeNS already registered >Thread-1042::INFO::2014-07-10 08:25:56,036::blockSD::452::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace e01a3a36-d2ce-4153-bb57-d6e65b7ed08c_lvmActivationNS already registered >Thread-1042::DEBUG::2014-07-10 08:25:56,037::sp::1375::Storage.StoragePool::(setMasterDomain) Master domain e01a3a36-d2ce-4153-bb57-d6e65b7ed08c verified, version 1 >Thread-1042::DEBUG::2014-07-10 08:25:56,037::misc::756::SamplingMethod::(__call__) Trying to enter sampling method (storage.sp.updateMonitoringThreads) >Thread-1042::DEBUG::2014-07-10 08:25:56,037::misc::758::SamplingMethod::(__call__) Got in to sampling method >Thread-1042::DEBUG::2014-07-10 08:25:56,037::lvm::503::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-1042::DEBUG::2014-07-10 08:25:56,038::lvm::505::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-1042::DEBUG::2014-07-10 08:25:56,038::lvm::513::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-1042::DEBUG::2014-07-10 08:25:56,038::lvm::525::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-1042::DEBUG::2014-07-10 08:25:56,038::lvm::373::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-1042::DEBUG::2014-07-10 08:25:56,039::lvm::296::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/3600601601282300032826addbbdae311|/dev/mapper/360060160f4a030003840ec867ddee311|/dev/mapper/367cad74c2fcba00019e6afd20c781e67|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name e01a3a36-d2ce-4153-bb57-d6e65b7ed08c' (cwd None) >Thread-1042::DEBUG::2014-07-10 08:25:56,325::lvm::296::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-1042::DEBUG::2014-07-10 08:25:56,327::lvm::415::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-1042::DEBUG::2014-07-10 08:25:56,328::persistentDict::234::Storage.PersistentDict::(refresh) read lines (VGTagMetadataRW)=['LEASETIMESEC=60', 'CLASS=Data', 'VERSION=3', u'PV1=pv:360060160f4a030003840ec867ddee311,uuid:0eUwla-dsA3-g6ia-RU23-cual-0rt9-KzkxLj,pestart:0,pecount:397,mapoffset:8189', u'PV0=pv:3600601601282300032826addbbdae311,uuid:ZdReOp-Yf8A-beQm-ne4I-pN3J-rxgm-9Ew0S1,pestart:0,pecount:8189,mapoffset:0', 'LOGBLKSIZE=512', 'LEASERETRIES=3', 'IOOPTIMEOUTSEC=10', 'LOCKRENEWALINTERVALSEC=5', 'PHYBLKSIZE=512', 'SDUUID=e01a3a36-d2ce-4153-bb57-d6e65b7ed08c', 'DESCRIPTION=SD-REAL', 'LOCKPOLICY=', 'VGUUID=GJcVo5-Y0kU-CDub-zITS-zfoL-Z7hz-SeVeIe', 'TYPE=ISCSI', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=DC-REAL', 'ROLE=Master', 'POOL_UUID=411039e4-4af2-4192-9de0-67dc1ed83ba9', 'POOL_SPM_LVER=2', 'POOL_DOMAINS=e01a3a36-d2ce-4153-bb57-d6e65b7ed08c:Active', '_SHA_CKSUM=0862f206224f948dbd549e5f29740569287a60bc', 'POOL_SPM_ID=-1'] >Thread-1042::INFO::2014-07-10 08:25:56,328::domainMonitor::99::Storage.DomainMonitor::(startMonitoring) Start monitoring e01a3a36-d2ce-4153-bb57-d6e65b7ed08c >Thread-1624::DEBUG::2014-07-10 08:25:56,330::domainMonitor::165::Storage.DomainMonitorThread::(_monitorLoop) Starting domain monitor for e01a3a36-d2ce-4153-bb57-d6e65b7ed08c >Thread-1042::DEBUG::2014-07-10 08:25:56,330::sp::1404::Storage.StoragePool::(updateMonitoringThreads) Storage Pool `411039e4-4af2-4192-9de0-67dc1ed83ba9` started monitoring domain `e01a3a36-d2ce-4153-bb57-d6e65b7ed08c` >Thread-1042::DEBUG::2014-07-10 08:25:56,335::misc::766::SamplingMethod::(__call__) Returning last result >Thread-1624::DEBUG::2014-07-10 08:25:56,341::lvm::296::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgck --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/3600601601282300032826addbbdae311|/dev/mapper/360060160f4a030003840ec867ddee311|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } " e01a3a36-d2ce-4153-bb57-d6e65b7ed08c' (cwd None) >Thread-1042::DEBUG::2014-07-10 08:25:56,407::lvm::503::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-1042::DEBUG::2014-07-10 08:25:56,408::lvm::505::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-1042::DEBUG::2014-07-10 08:25:56,408::lvm::513::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-1042::DEBUG::2014-07-10 08:25:56,408::lvm::525::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-1042::DEBUG::2014-07-10 08:25:56,409::lvm::373::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-1042::DEBUG::2014-07-10 08:25:56,409::lvm::296::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/3600601601282300032826addbbdae311|/dev/mapper/360060160f4a030003840ec867ddee311|/dev/mapper/367cad74c2fcba00019e6afd20c781e67|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name e01a3a36-d2ce-4153-bb57-d6e65b7ed08c' (cwd None) >Thread-1624::DEBUG::2014-07-10 08:25:56,584::lvm::296::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-1624::DEBUG::2014-07-10 08:25:56,585::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/e01a3a36-d2ce-4153-bb57-d6e65b7ed08c/metadata bs=4096 count=1' (cwd None) >Thread-1624::DEBUG::2014-07-10 08:25:56,650::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.0095458 s, 429 kB/s\n'; <rc> = 0 >Thread-1624::DEBUG::2014-07-10 08:25:56,652::lvm::373::OperationMutex::(_reloadvgs) Got the operational mutex >Thread-1624::DEBUG::2014-07-10 08:25:56,652::lvm::296::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/3600601601282300032826addbbdae311|/dev/mapper/360060160f4a030003840ec867ddee311|/dev/mapper/367cad74c2fcba00019e6afd20c781e67|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name e01a3a36-d2ce-4153-bb57-d6e65b7ed08c' (cwd None) >Thread-1042::DEBUG::2014-07-10 08:25:56,742::lvm::296::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-1042::DEBUG::2014-07-10 08:25:56,745::persistentDict::234::Storage.PersistentDict::(refresh) read lines (VGTagMetadataRW)=['LEASETIMESEC=60', 'CLASS=Data', 'VERSION=3', u'PV1=pv:360060160f4a030003840ec867ddee311,uuid:0eUwla-dsA3-g6ia-RU23-cual-0rt9-KzkxLj,pestart:0,pecount:397,mapoffset:8189', u'PV0=pv:3600601601282300032826addbbdae311,uuid:ZdReOp-Yf8A-beQm-ne4I-pN3J-rxgm-9Ew0S1,pestart:0,pecount:8189,mapoffset:0', 'LOGBLKSIZE=512', 'LEASERETRIES=3', 'IOOPTIMEOUTSEC=10', 'LOCKRENEWALINTERVALSEC=5', 'PHYBLKSIZE=512', 'SDUUID=e01a3a36-d2ce-4153-bb57-d6e65b7ed08c', 'DESCRIPTION=SD-REAL', 'LOCKPOLICY=', 'VGUUID=GJcVo5-Y0kU-CDub-zITS-zfoL-Z7hz-SeVeIe', 'TYPE=ISCSI', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=DC-REAL', 'ROLE=Master', 'POOL_UUID=411039e4-4af2-4192-9de0-67dc1ed83ba9', 'POOL_SPM_LVER=2', 'POOL_DOMAINS=e01a3a36-d2ce-4153-bb57-d6e65b7ed08c:Active', '_SHA_CKSUM=0862f206224f948dbd549e5f29740569287a60bc', 'POOL_SPM_ID=-1'] >Thread-1042::DEBUG::2014-07-10 08:25:56,746::lvm::373::OperationMutex::(_reloadvgs) Got the operational mutex >Thread-1042::DEBUG::2014-07-10 08:25:56,747::lvm::296::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/3600601601282300032826addbbdae311|/dev/mapper/360060160f4a030003840ec867ddee311|/dev/mapper/367cad74c2fcba00019e6afd20c781e67|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name' (cwd None) >Thread-1624::DEBUG::2014-07-10 08:25:56,901::lvm::296::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-1624::DEBUG::2014-07-10 08:25:56,930::domainMonitor::247::Storage.DomainMonitorThread::(_monitorDomain) Domain e01a3a36-d2ce-4153-bb57-d6e65b7ed08c changed its status to Valid >Thread-1625::DEBUG::2014-07-10 08:25:56,932::misc::878::Event.Storage.DomainMonitor.onDomainStateChange::(_emit) Emitting event >Thread-1624::INFO::2014-07-10 08:25:56,932::clusterlock::184::SANLock::(acquireHostId) Acquiring host id for domain e01a3a36-d2ce-4153-bb57-d6e65b7ed08c (id: 1) >Thread-1625::DEBUG::2014-07-10 08:25:56,935::misc::888::Event.Storage.DomainMonitor.onDomainStateChange::(_emit) Calling registered method `_onDomainStateChange` >Thread-1624::DEBUG::2014-07-10 08:25:56,936::clusterlock::202::SANLock::(acquireHostId) Host id for domain e01a3a36-d2ce-4153-bb57-d6e65b7ed08c successfully acquired (id: 1) >Thread-1625::DEBUG::2014-07-10 08:25:56,937::misc::888::Event.Storage.DomainMonitor.onDomainStateChange::(_emit) Calling registered method `contEIOVms` >Thread-1625::DEBUG::2014-07-10 08:25:56,941::misc::898::Event.Storage.DomainMonitor.onDomainStateChange::(_emit) Event emitted >Thread-1627::INFO::2014-07-10 08:25:56,943::clientIF::126::vds::(contEIOVms) vmContainerLock acquired >Thread-1042::DEBUG::2014-07-10 08:25:57,017::lvm::296::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-1042::DEBUG::2014-07-10 08:25:57,022::lvm::415::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-1042::WARNING::2014-07-10 08:25:57,022::fileUtils::167::Storage.fileUtils::(createdir) Dir /rhev/data-center/mnt/blockSD/e01a3a36-d2ce-4153-bb57-d6e65b7ed08c/images already exists >Thread-1042::WARNING::2014-07-10 08:25:57,023::fileUtils::167::Storage.fileUtils::(createdir) Dir /rhev/data-center/mnt/blockSD/e01a3a36-d2ce-4153-bb57-d6e65b7ed08c/dom_md already exists >Thread-1042::INFO::2014-07-10 08:25:57,023::sp::1113::Storage.StoragePool::(_linkStorageDomain) Linking /rhev/data-center/mnt/blockSD/e01a3a36-d2ce-4153-bb57-d6e65b7ed08c to /rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/e01a3a36-d2ce-4153-bb57-d6e65b7ed08c >Thread-1042::INFO::2014-07-10 08:25:57,024::sp::1113::Storage.StoragePool::(_linkStorageDomain) Linking /rhev/data-center/mnt/blockSD/e01a3a36-d2ce-4153-bb57-d6e65b7ed08c to /rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd >Thread-1042::DEBUG::2014-07-10 08:25:57,025::threadPool::35::Misc.ThreadPool::(__init__) Enter - numThreads: 5.0, waitTimeout: 3, maxTasks: 500.0 >Thread-1042::DEBUG::2014-07-10 08:25:57,030::storage_mailbox::84::Storage.Misc.excCmd::(_mboxExecCmd) '/bin/dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/outbox iflag=direct,fullblock bs=512 count=8 skip=8' (cwd None) >Thread-1042::DEBUG::2014-07-10 08:25:57,299::storage_mailbox::84::Storage.Misc.excCmd::(_mboxExecCmd) SUCCESS: <err> = '8+0 records in\n8+0 records out\n4096 bytes (4.1 kB) copied, 0.20826 s, 19.7 kB/s\n'; <rc> = 0 >Thread-1042::INFO::2014-07-10 08:25:57,300::storage_mailbox::385::Storage.MailBox.HsmMailMonitor::(_sendMail) HSM_MailMonitor sending mail to SPM - ['/bin/dd', 'of=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox', 'iflag=fullblock', 'oflag=direct', 'conv=notrunc', 'bs=512', 'seek=8'] >Thread-1042::DEBUG::2014-07-10 08:25:57,300::storage_mailbox::84::Storage.Misc.excCmd::(_mboxExecCmd) '/bin/dd of=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=fullblock oflag=direct conv=notrunc bs=512 seek=8' (cwd None) >Thread-1042::DEBUG::2014-07-10 08:25:58,359::storage_mailbox::84::Storage.Misc.excCmd::(_mboxExecCmd) SUCCESS: <err> = '8+0 records in\n8+0 records out\n4096 bytes (4.1 kB) copied, 1.00365 s, 4.1 kB/s\n'; <rc> = 0 >Thread-1042::DEBUG::2014-07-10 08:25:58,361::storage_mailbox::207::Storage.Mailbox.HSM::(__init__) HSM_MailboxMonitor created for pool 411039e4-4af2-4192-9de0-67dc1ed83ba9 >Thread-1042::DEBUG::2014-07-10 08:25:58,362::sp::465::Storage.StoragePool::(__createMailboxMonitor) HSM mailbox ready for pool 411039e4-4af2-4192-9de0-67dc1ed83ba9 on master domain e01a3a36-d2ce-4153-bb57-d6e65b7ed08c >Thread-1042::DEBUG::2014-07-10 08:25:58,362::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' >Thread-1042::DEBUG::2014-07-10 08:25:58,363::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' (0 active users) >Thread-1042::DEBUG::2014-07-10 08:25:58,363::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' is free, finding out if anyone is waiting for it. >Thread-1042::DEBUG::2014-07-10 08:25:58,363::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9', Clearing records. >Thread-1042::DEBUG::2014-07-10 08:25:58,363::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.HsmDomainMonitorLock' >Thread-1042::DEBUG::2014-07-10 08:25:58,364::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.HsmDomainMonitorLock' (0 active users) >Thread-1042::DEBUG::2014-07-10 08:25:58,364::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.HsmDomainMonitorLock' is free, finding out if anyone is waiting for it. >Thread-1042::DEBUG::2014-07-10 08:25:58,364::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.HsmDomainMonitorLock', Clearing records. >Thread-1042::INFO::2014-07-10 08:25:58,364::logUtils::47::dispatcher::(wrapper) Run and protect: connectStoragePool, Return response: True >Thread-1042::DEBUG::2014-07-10 08:25:58,365::task::1185::TaskManager.Task::(prepare) Task=`176b67a8-580d-4881-8194-9cf081ca9efa`::finished: True >Thread-1042::DEBUG::2014-07-10 08:25:58,365::task::595::TaskManager.Task::(_updateState) Task=`176b67a8-580d-4881-8194-9cf081ca9efa`::moving from state preparing -> state finished >Thread-1042::DEBUG::2014-07-10 08:25:58,365::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-1042::DEBUG::2014-07-10 08:25:58,365::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1042::DEBUG::2014-07-10 08:25:58,365::task::990::TaskManager.Task::(_decref) Task=`176b67a8-580d-4881-8194-9cf081ca9efa`::ref 0 aborting False >Thread-1042::DEBUG::2014-07-10 08:25:58,411::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [64ccce3e] >Thread-1042::DEBUG::2014-07-10 08:25:58,412::task::595::TaskManager.Task::(_updateState) Task=`51d9a259-aedf-4fd8-b2ba-5f38b6ec3ee9`::moving from state init -> state preparing >Thread-1042::INFO::2014-07-10 08:25:58,413::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='411039e4-4af2-4192-9de0-67dc1ed83ba9', options=None) >Thread-1042::INFO::2014-07-10 08:25:58,414::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': -1, 'spmStatus': 'Free', 'spmLver': 2}} >Thread-1042::DEBUG::2014-07-10 08:25:58,414::task::1185::TaskManager.Task::(prepare) Task=`51d9a259-aedf-4fd8-b2ba-5f38b6ec3ee9`::finished: {'spm_st': {'spmId': -1, 'spmStatus': 'Free', 'spmLver': 2}} >Thread-1042::DEBUG::2014-07-10 08:25:58,414::task::595::TaskManager.Task::(_updateState) Task=`51d9a259-aedf-4fd8-b2ba-5f38b6ec3ee9`::moving from state preparing -> state finished >Thread-1042::DEBUG::2014-07-10 08:25:58,414::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-1042::DEBUG::2014-07-10 08:25:58,415::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1042::DEBUG::2014-07-10 08:25:58,415::task::990::TaskManager.Task::(_decref) Task=`51d9a259-aedf-4fd8-b2ba-5f38b6ec3ee9`::ref 0 aborting False >Thread-1042::DEBUG::2014-07-10 08:25:58,483::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [64ccce3e] >Thread-1042::DEBUG::2014-07-10 08:25:58,483::task::595::TaskManager.Task::(_updateState) Task=`aa977a1d-e5ee-4a27-84c7-bcc58f7e8696`::moving from state init -> state preparing >Thread-1042::INFO::2014-07-10 08:25:58,483::logUtils::44::dispatcher::(wrapper) Run and protect: spmStart(spUUID='411039e4-4af2-4192-9de0-67dc1ed83ba9', prevID=-1, prevLVER='2', maxHostID=250, domVersion='3', options=None) >Thread-1042::DEBUG::2014-07-10 08:25:58,484::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9`ReqID=`14ca34fd-9898-4d89-9463-6f54ee400008`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '588' at 'spmStart' >Thread-1042::DEBUG::2014-07-10 08:25:58,484::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' for lock type 'exclusive' >Thread-1042::DEBUG::2014-07-10 08:25:58,485::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' is free. Now locking as 'exclusive' (1 active user) >Thread-1042::DEBUG::2014-07-10 08:25:58,485::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9`ReqID=`14ca34fd-9898-4d89-9463-6f54ee400008`::Granted request >Thread-1042::DEBUG::2014-07-10 08:25:58,485::task::827::TaskManager.Task::(resourceAcquired) Task=`aa977a1d-e5ee-4a27-84c7-bcc58f7e8696`::_resourcesAcquired: Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9 (exclusive) >Thread-1042::DEBUG::2014-07-10 08:25:58,486::task::990::TaskManager.Task::(_decref) Task=`aa977a1d-e5ee-4a27-84c7-bcc58f7e8696`::ref 1 aborting False >Thread-1042::INFO::2014-07-10 08:25:58,486::logUtils::47::dispatcher::(wrapper) Run and protect: spmStart, Return response: None >Thread-1042::DEBUG::2014-07-10 08:25:58,486::task::1180::TaskManager.Task::(prepare) Task=`aa977a1d-e5ee-4a27-84c7-bcc58f7e8696`::Prepare: 1 jobs exist, move to acquiring >Thread-1042::DEBUG::2014-07-10 08:25:58,486::task::595::TaskManager.Task::(_updateState) Task=`aa977a1d-e5ee-4a27-84c7-bcc58f7e8696`::moving from state preparing -> state acquiring >Thread-1042::DEBUG::2014-07-10 08:25:58,487::task::595::TaskManager.Task::(_updateState) Task=`aa977a1d-e5ee-4a27-84c7-bcc58f7e8696`::moving from state acquiring -> state queued >Thread-1042::DEBUG::2014-07-10 08:25:58,487::taskManager::50::TaskManager::(_queueTask) queuing task: aa977a1d-e5ee-4a27-84c7-bcc58f7e8696 >Thread-1042::DEBUG::2014-07-10 08:25:58,487::taskManager::56::TaskManager::(_queueTask) task queued: aa977a1d-e5ee-4a27-84c7-bcc58f7e8696 >Thread-1042::DEBUG::2014-07-10 08:25:58,489::task::1182::TaskManager.Task::(prepare) Task=`aa977a1d-e5ee-4a27-84c7-bcc58f7e8696`::returning >367e56a9-bd55-424b-bc7e-3d3fdd3fa718::DEBUG::2014-07-10 08:25:58,488::threadPool::57::Misc.ThreadPool::(setRunningTask) Number of running tasks: 1 >Thread-1042::DEBUG::2014-07-10 08:25:58,491::task::990::TaskManager.Task::(_decref) Task=`aa977a1d-e5ee-4a27-84c7-bcc58f7e8696`::ref 0 aborting False >aa977a1d-e5ee-4a27-84c7-bcc58f7e8696::DEBUG::2014-07-10 08:25:58,493::threadPool::200::Misc.ThreadPool.WorkerThread::(_processNextTask) Task: aa977a1d-e5ee-4a27-84c7-bcc58f7e8696 running: <bound method Task.commit of <storage.task.Task instance at 0x7f72c811fa28>> with: None >aa977a1d-e5ee-4a27-84c7-bcc58f7e8696::DEBUG::2014-07-10 08:25:58,495::task::1194::TaskManager.Task::(commit) Task=`aa977a1d-e5ee-4a27-84c7-bcc58f7e8696`::committing task: aa977a1d-e5ee-4a27-84c7-bcc58f7e8696 >aa977a1d-e5ee-4a27-84c7-bcc58f7e8696::DEBUG::2014-07-10 08:25:58,497::task::595::TaskManager.Task::(_updateState) Task=`aa977a1d-e5ee-4a27-84c7-bcc58f7e8696`::moving from state queued -> state running >aa977a1d-e5ee-4a27-84c7-bcc58f7e8696::DEBUG::2014-07-10 08:25:58,498::task::905::TaskManager.Task::(_runJobs) Task=`aa977a1d-e5ee-4a27-84c7-bcc58f7e8696`::Task.run: running job 0: spmStart: <bound method StoragePool.startSpm of <storage.sp.StoragePool object at 0x7f7270560350>> (args: (-1, '2', 250, 3) kwargs: {}) >aa977a1d-e5ee-4a27-84c7-bcc58f7e8696::DEBUG::2014-07-10 08:25:58,498::task::331::TaskManager.Task::(run) Task=`aa977a1d-e5ee-4a27-84c7-bcc58f7e8696`::Job.run: running spmStart: <bound method StoragePool.startSpm of <storage.sp.StoragePool object at 0x7f7270560350>> (args: (-1, '2', 250, 3) kwargs: {}) callback None >aa977a1d-e5ee-4a27-84c7-bcc58f7e8696::DEBUG::2014-07-10 08:25:58,498::misc::756::SamplingMethod::(__call__) Trying to enter sampling method (storage.sp.updateMonitoringThreads) >aa977a1d-e5ee-4a27-84c7-bcc58f7e8696::DEBUG::2014-07-10 08:25:58,499::misc::758::SamplingMethod::(__call__) Got in to sampling method >aa977a1d-e5ee-4a27-84c7-bcc58f7e8696::DEBUG::2014-07-10 08:25:58,499::lvm::503::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >aa977a1d-e5ee-4a27-84c7-bcc58f7e8696::DEBUG::2014-07-10 08:25:58,499::lvm::505::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >aa977a1d-e5ee-4a27-84c7-bcc58f7e8696::DEBUG::2014-07-10 08:25:58,500::lvm::513::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >aa977a1d-e5ee-4a27-84c7-bcc58f7e8696::DEBUG::2014-07-10 08:25:58,500::lvm::525::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >aa977a1d-e5ee-4a27-84c7-bcc58f7e8696::DEBUG::2014-07-10 08:25:58,500::lvm::373::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >aa977a1d-e5ee-4a27-84c7-bcc58f7e8696::DEBUG::2014-07-10 08:25:58,501::lvm::296::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/3600601601282300032826addbbdae311|/dev/mapper/360060160f4a030003840ec867ddee311|/dev/mapper/367cad74c2fcba00019e6afd20c781e67|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name e01a3a36-d2ce-4153-bb57-d6e65b7ed08c' (cwd None) >aa977a1d-e5ee-4a27-84c7-bcc58f7e8696::DEBUG::2014-07-10 08:25:58,837::lvm::296::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >aa977a1d-e5ee-4a27-84c7-bcc58f7e8696::DEBUG::2014-07-10 08:25:58,839::lvm::415::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >aa977a1d-e5ee-4a27-84c7-bcc58f7e8696::DEBUG::2014-07-10 08:25:58,840::persistentDict::234::Storage.PersistentDict::(refresh) read lines (VGTagMetadataRW)=['LEASETIMESEC=60', 'CLASS=Data', 'VERSION=3', u'PV1=pv:360060160f4a030003840ec867ddee311,uuid:0eUwla-dsA3-g6ia-RU23-cual-0rt9-KzkxLj,pestart:0,pecount:397,mapoffset:8189', u'PV0=pv:3600601601282300032826addbbdae311,uuid:ZdReOp-Yf8A-beQm-ne4I-pN3J-rxgm-9Ew0S1,pestart:0,pecount:8189,mapoffset:0', 'LOGBLKSIZE=512', 'LEASERETRIES=3', 'IOOPTIMEOUTSEC=10', 'LOCKRENEWALINTERVALSEC=5', 'PHYBLKSIZE=512', 'SDUUID=e01a3a36-d2ce-4153-bb57-d6e65b7ed08c', 'DESCRIPTION=SD-REAL', 'LOCKPOLICY=', 'VGUUID=GJcVo5-Y0kU-CDub-zITS-zfoL-Z7hz-SeVeIe', 'TYPE=ISCSI', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=DC-REAL', 'ROLE=Master', 'POOL_UUID=411039e4-4af2-4192-9de0-67dc1ed83ba9', 'POOL_SPM_LVER=2', 'POOL_DOMAINS=e01a3a36-d2ce-4153-bb57-d6e65b7ed08c:Active', '_SHA_CKSUM=0862f206224f948dbd549e5f29740569287a60bc', 'POOL_SPM_ID=-1'] >aa977a1d-e5ee-4a27-84c7-bcc58f7e8696::DEBUG::2014-07-10 08:25:58,841::misc::766::SamplingMethod::(__call__) Returning last result >aa977a1d-e5ee-4a27-84c7-bcc58f7e8696::INFO::2014-07-10 08:25:58,841::clusterlock::184::SANLock::(acquireHostId) Acquiring host id for domain e01a3a36-d2ce-4153-bb57-d6e65b7ed08c (id: 1) >Thread-1042::DEBUG::2014-07-10 08:25:59,540::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [64ccce3e] >Thread-1042::DEBUG::2014-07-10 08:25:59,541::task::595::TaskManager.Task::(_updateState) Task=`8a172c98-fefb-4bdb-9d76-f92c76ce97ce`::moving from state init -> state preparing >Thread-1042::INFO::2014-07-10 08:25:59,541::logUtils::44::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='aa977a1d-e5ee-4a27-84c7-bcc58f7e8696', spUUID=None, options=None) >Thread-1042::DEBUG::2014-07-10 08:25:59,541::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: aa977a1d-e5ee-4a27-84c7-bcc58f7e8696 >Thread-1042::DEBUG::2014-07-10 08:25:59,542::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'aa977a1d-e5ee-4a27-84c7-bcc58f7e8696'} >Thread-1042::INFO::2014-07-10 08:25:59,542::logUtils::47::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'aa977a1d-e5ee-4a27-84c7-bcc58f7e8696'}} >Thread-1042::DEBUG::2014-07-10 08:25:59,542::task::1185::TaskManager.Task::(prepare) Task=`8a172c98-fefb-4bdb-9d76-f92c76ce97ce`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'aa977a1d-e5ee-4a27-84c7-bcc58f7e8696'}} >Thread-1042::DEBUG::2014-07-10 08:25:59,542::task::595::TaskManager.Task::(_updateState) Task=`8a172c98-fefb-4bdb-9d76-f92c76ce97ce`::moving from state preparing -> state finished >Thread-1042::DEBUG::2014-07-10 08:25:59,542::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-1042::DEBUG::2014-07-10 08:25:59,543::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1042::DEBUG::2014-07-10 08:25:59,543::task::990::TaskManager.Task::(_decref) Task=`8a172c98-fefb-4bdb-9d76-f92c76ce97ce`::ref 0 aborting False >Thread-1042::DEBUG::2014-07-10 08:26:00,547::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [64ccce3e] >Thread-1042::DEBUG::2014-07-10 08:26:00,548::task::595::TaskManager.Task::(_updateState) Task=`55a6bfac-f17f-402a-9116-d592cc3a34c0`::moving from state init -> state preparing >Thread-1042::INFO::2014-07-10 08:26:00,548::logUtils::44::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='aa977a1d-e5ee-4a27-84c7-bcc58f7e8696', spUUID=None, options=None) >Thread-1042::DEBUG::2014-07-10 08:26:00,548::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: aa977a1d-e5ee-4a27-84c7-bcc58f7e8696 >Thread-1042::DEBUG::2014-07-10 08:26:00,548::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'aa977a1d-e5ee-4a27-84c7-bcc58f7e8696'} >Thread-1042::INFO::2014-07-10 08:26:00,549::logUtils::47::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'aa977a1d-e5ee-4a27-84c7-bcc58f7e8696'}} >Thread-1042::DEBUG::2014-07-10 08:26:00,549::task::1185::TaskManager.Task::(prepare) Task=`55a6bfac-f17f-402a-9116-d592cc3a34c0`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'aa977a1d-e5ee-4a27-84c7-bcc58f7e8696'}} >Thread-1042::DEBUG::2014-07-10 08:26:00,549::task::595::TaskManager.Task::(_updateState) Task=`55a6bfac-f17f-402a-9116-d592cc3a34c0`::moving from state preparing -> state finished >Thread-1042::DEBUG::2014-07-10 08:26:00,549::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-1042::DEBUG::2014-07-10 08:26:00,549::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1042::DEBUG::2014-07-10 08:26:00,549::task::990::TaskManager.Task::(_decref) Task=`55a6bfac-f17f-402a-9116-d592cc3a34c0`::ref 0 aborting False >Thread-1042::DEBUG::2014-07-10 08:26:01,553::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [64ccce3e] >Thread-1042::DEBUG::2014-07-10 08:26:01,553::task::595::TaskManager.Task::(_updateState) Task=`dedc2cca-87a5-425e-a9de-ccda13b5d9b2`::moving from state init -> state preparing >Thread-1042::INFO::2014-07-10 08:26:01,553::logUtils::44::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='aa977a1d-e5ee-4a27-84c7-bcc58f7e8696', spUUID=None, options=None) >Thread-1042::DEBUG::2014-07-10 08:26:01,553::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: aa977a1d-e5ee-4a27-84c7-bcc58f7e8696 >Thread-1042::DEBUG::2014-07-10 08:26:01,554::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'aa977a1d-e5ee-4a27-84c7-bcc58f7e8696'} >Thread-1042::INFO::2014-07-10 08:26:01,554::logUtils::47::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'aa977a1d-e5ee-4a27-84c7-bcc58f7e8696'}} >Thread-1042::DEBUG::2014-07-10 08:26:01,554::task::1185::TaskManager.Task::(prepare) Task=`dedc2cca-87a5-425e-a9de-ccda13b5d9b2`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'aa977a1d-e5ee-4a27-84c7-bcc58f7e8696'}} >Thread-1042::DEBUG::2014-07-10 08:26:01,554::task::595::TaskManager.Task::(_updateState) Task=`dedc2cca-87a5-425e-a9de-ccda13b5d9b2`::moving from state preparing -> state finished >Thread-1042::DEBUG::2014-07-10 08:26:01,554::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-1042::DEBUG::2014-07-10 08:26:01,554::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1042::DEBUG::2014-07-10 08:26:01,555::task::990::TaskManager.Task::(_decref) Task=`dedc2cca-87a5-425e-a9de-ccda13b5d9b2`::ref 0 aborting False >Thread-1042::DEBUG::2014-07-10 08:26:02,558::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [64ccce3e] >Thread-1042::DEBUG::2014-07-10 08:26:02,559::task::595::TaskManager.Task::(_updateState) Task=`e00049db-c328-4099-a5f1-cd51a502d5a6`::moving from state init -> state preparing >Thread-1042::INFO::2014-07-10 08:26:02,559::logUtils::44::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='aa977a1d-e5ee-4a27-84c7-bcc58f7e8696', spUUID=None, options=None) >Thread-1042::DEBUG::2014-07-10 08:26:02,559::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: aa977a1d-e5ee-4a27-84c7-bcc58f7e8696 >Thread-1042::DEBUG::2014-07-10 08:26:02,560::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'aa977a1d-e5ee-4a27-84c7-bcc58f7e8696'} >Thread-1042::INFO::2014-07-10 08:26:02,560::logUtils::47::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'aa977a1d-e5ee-4a27-84c7-bcc58f7e8696'}} >Thread-1042::DEBUG::2014-07-10 08:26:02,560::task::1185::TaskManager.Task::(prepare) Task=`e00049db-c328-4099-a5f1-cd51a502d5a6`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'aa977a1d-e5ee-4a27-84c7-bcc58f7e8696'}} >Thread-1042::DEBUG::2014-07-10 08:26:02,560::task::595::TaskManager.Task::(_updateState) Task=`e00049db-c328-4099-a5f1-cd51a502d5a6`::moving from state preparing -> state finished >Thread-1042::DEBUG::2014-07-10 08:26:02,560::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-1042::DEBUG::2014-07-10 08:26:02,560::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1042::DEBUG::2014-07-10 08:26:02,560::task::990::TaskManager.Task::(_decref) Task=`e00049db-c328-4099-a5f1-cd51a502d5a6`::ref 0 aborting False >Thread-1042::DEBUG::2014-07-10 08:26:03,565::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [64ccce3e] >Thread-1042::DEBUG::2014-07-10 08:26:03,565::task::595::TaskManager.Task::(_updateState) Task=`a2efd6e3-2303-49d0-8c04-a3a4f67445a5`::moving from state init -> state preparing >Thread-1042::INFO::2014-07-10 08:26:03,566::logUtils::44::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='aa977a1d-e5ee-4a27-84c7-bcc58f7e8696', spUUID=None, options=None) >Thread-1042::DEBUG::2014-07-10 08:26:03,566::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: aa977a1d-e5ee-4a27-84c7-bcc58f7e8696 >Thread-1042::DEBUG::2014-07-10 08:26:03,566::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'aa977a1d-e5ee-4a27-84c7-bcc58f7e8696'} >Thread-1042::INFO::2014-07-10 08:26:03,566::logUtils::47::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'aa977a1d-e5ee-4a27-84c7-bcc58f7e8696'}} >Thread-1042::DEBUG::2014-07-10 08:26:03,566::task::1185::TaskManager.Task::(prepare) Task=`a2efd6e3-2303-49d0-8c04-a3a4f67445a5`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'aa977a1d-e5ee-4a27-84c7-bcc58f7e8696'}} >Thread-1042::DEBUG::2014-07-10 08:26:03,566::task::595::TaskManager.Task::(_updateState) Task=`a2efd6e3-2303-49d0-8c04-a3a4f67445a5`::moving from state preparing -> state finished >Thread-1042::DEBUG::2014-07-10 08:26:03,567::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-1042::DEBUG::2014-07-10 08:26:03,567::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1042::DEBUG::2014-07-10 08:26:03,567::task::990::TaskManager.Task::(_decref) Task=`a2efd6e3-2303-49d0-8c04-a3a4f67445a5`::ref 0 aborting False >Thread-1042::DEBUG::2014-07-10 08:26:04,572::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [64ccce3e] >Thread-1042::DEBUG::2014-07-10 08:26:04,573::task::595::TaskManager.Task::(_updateState) Task=`70f886c8-799e-4f5b-abc0-ba0ea9571678`::moving from state init -> state preparing >Thread-1042::INFO::2014-07-10 08:26:04,574::logUtils::44::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='aa977a1d-e5ee-4a27-84c7-bcc58f7e8696', spUUID=None, options=None) >Thread-1042::DEBUG::2014-07-10 08:26:04,574::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: aa977a1d-e5ee-4a27-84c7-bcc58f7e8696 >Thread-1042::DEBUG::2014-07-10 08:26:04,574::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'aa977a1d-e5ee-4a27-84c7-bcc58f7e8696'} >Thread-1042::INFO::2014-07-10 08:26:04,574::logUtils::47::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'aa977a1d-e5ee-4a27-84c7-bcc58f7e8696'}} >Thread-1042::DEBUG::2014-07-10 08:26:04,575::task::1185::TaskManager.Task::(prepare) Task=`70f886c8-799e-4f5b-abc0-ba0ea9571678`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'aa977a1d-e5ee-4a27-84c7-bcc58f7e8696'}} >Thread-1042::DEBUG::2014-07-10 08:26:04,575::task::595::TaskManager.Task::(_updateState) Task=`70f886c8-799e-4f5b-abc0-ba0ea9571678`::moving from state preparing -> state finished >Thread-1042::DEBUG::2014-07-10 08:26:04,575::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-1042::DEBUG::2014-07-10 08:26:04,575::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1042::DEBUG::2014-07-10 08:26:04,575::task::990::TaskManager.Task::(_decref) Task=`70f886c8-799e-4f5b-abc0-ba0ea9571678`::ref 0 aborting False >Thread-1042::DEBUG::2014-07-10 08:26:05,580::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [64ccce3e] >Thread-1042::DEBUG::2014-07-10 08:26:05,580::task::595::TaskManager.Task::(_updateState) Task=`f49b5f36-d69d-4d05-9b6e-423048d851ca`::moving from state init -> state preparing >Thread-1042::INFO::2014-07-10 08:26:05,580::logUtils::44::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='aa977a1d-e5ee-4a27-84c7-bcc58f7e8696', spUUID=None, options=None) >Thread-1042::DEBUG::2014-07-10 08:26:05,580::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: aa977a1d-e5ee-4a27-84c7-bcc58f7e8696 >Thread-1042::DEBUG::2014-07-10 08:26:05,581::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'aa977a1d-e5ee-4a27-84c7-bcc58f7e8696'} >Thread-1042::INFO::2014-07-10 08:26:05,581::logUtils::47::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'aa977a1d-e5ee-4a27-84c7-bcc58f7e8696'}} >Thread-1042::DEBUG::2014-07-10 08:26:05,581::task::1185::TaskManager.Task::(prepare) Task=`f49b5f36-d69d-4d05-9b6e-423048d851ca`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'aa977a1d-e5ee-4a27-84c7-bcc58f7e8696'}} >Thread-1042::DEBUG::2014-07-10 08:26:05,581::task::595::TaskManager.Task::(_updateState) Task=`f49b5f36-d69d-4d05-9b6e-423048d851ca`::moving from state preparing -> state finished >Thread-1042::DEBUG::2014-07-10 08:26:05,581::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-1042::DEBUG::2014-07-10 08:26:05,581::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1042::DEBUG::2014-07-10 08:26:05,582::task::990::TaskManager.Task::(_decref) Task=`f49b5f36-d69d-4d05-9b6e-423048d851ca`::ref 0 aborting False >Thread-1042::DEBUG::2014-07-10 08:26:06,585::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [64ccce3e] >Thread-1042::DEBUG::2014-07-10 08:26:06,586::task::595::TaskManager.Task::(_updateState) Task=`db244b0d-92f5-4af4-ae6b-fb1daac59d25`::moving from state init -> state preparing >Thread-1042::INFO::2014-07-10 08:26:06,586::logUtils::44::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='aa977a1d-e5ee-4a27-84c7-bcc58f7e8696', spUUID=None, options=None) >Thread-1042::DEBUG::2014-07-10 08:26:06,586::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: aa977a1d-e5ee-4a27-84c7-bcc58f7e8696 >Thread-1042::DEBUG::2014-07-10 08:26:06,586::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'aa977a1d-e5ee-4a27-84c7-bcc58f7e8696'} >Thread-1042::INFO::2014-07-10 08:26:06,586::logUtils::47::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'aa977a1d-e5ee-4a27-84c7-bcc58f7e8696'}} >Thread-1042::DEBUG::2014-07-10 08:26:06,586::task::1185::TaskManager.Task::(prepare) Task=`db244b0d-92f5-4af4-ae6b-fb1daac59d25`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'aa977a1d-e5ee-4a27-84c7-bcc58f7e8696'}} >Thread-1042::DEBUG::2014-07-10 08:26:06,587::task::595::TaskManager.Task::(_updateState) Task=`db244b0d-92f5-4af4-ae6b-fb1daac59d25`::moving from state preparing -> state finished >Thread-1042::DEBUG::2014-07-10 08:26:06,587::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-1042::DEBUG::2014-07-10 08:26:06,587::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1042::DEBUG::2014-07-10 08:26:06,587::task::990::TaskManager.Task::(_decref) Task=`db244b0d-92f5-4af4-ae6b-fb1daac59d25`::ref 0 aborting False >Thread-1624::DEBUG::2014-07-10 08:26:06,941::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/e01a3a36-d2ce-4153-bb57-d6e65b7ed08c/metadata bs=4096 count=1' (cwd None) >Thread-1624::DEBUG::2014-07-10 08:26:07,001::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00072368 s, 5.7 MB/s\n'; <rc> = 0 >Thread-1042::DEBUG::2014-07-10 08:26:07,592::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [64ccce3e] >Thread-1042::DEBUG::2014-07-10 08:26:07,592::task::595::TaskManager.Task::(_updateState) Task=`2e18e3f1-50d1-4e2e-88ca-8811be3461d7`::moving from state init -> state preparing >Thread-1042::INFO::2014-07-10 08:26:07,593::logUtils::44::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='aa977a1d-e5ee-4a27-84c7-bcc58f7e8696', spUUID=None, options=None) >Thread-1042::DEBUG::2014-07-10 08:26:07,593::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: aa977a1d-e5ee-4a27-84c7-bcc58f7e8696 >Thread-1042::DEBUG::2014-07-10 08:26:07,593::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'aa977a1d-e5ee-4a27-84c7-bcc58f7e8696'} >Thread-1042::INFO::2014-07-10 08:26:07,593::logUtils::47::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'aa977a1d-e5ee-4a27-84c7-bcc58f7e8696'}} >Thread-1042::DEBUG::2014-07-10 08:26:07,593::task::1185::TaskManager.Task::(prepare) Task=`2e18e3f1-50d1-4e2e-88ca-8811be3461d7`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'aa977a1d-e5ee-4a27-84c7-bcc58f7e8696'}} >Thread-1042::DEBUG::2014-07-10 08:26:07,594::task::595::TaskManager.Task::(_updateState) Task=`2e18e3f1-50d1-4e2e-88ca-8811be3461d7`::moving from state preparing -> state finished >Thread-1042::DEBUG::2014-07-10 08:26:07,594::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-1042::DEBUG::2014-07-10 08:26:07,594::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1042::DEBUG::2014-07-10 08:26:07,594::task::990::TaskManager.Task::(_decref) Task=`2e18e3f1-50d1-4e2e-88ca-8811be3461d7`::ref 0 aborting False >Thread-1042::DEBUG::2014-07-10 08:26:07,760::task::595::TaskManager.Task::(_updateState) Task=`ce5bb5ff-2020-48e5-ae3c-a3b452a5c121`::moving from state init -> state preparing >Thread-1042::INFO::2014-07-10 08:26:07,760::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-1042::INFO::2014-07-10 08:26:07,761::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c': {'code': 0, 'version': 3, 'acquired': False, 'delay': '0.0095458', 'lastCheck': '10.8', 'valid': True}} >Thread-1042::DEBUG::2014-07-10 08:26:07,761::task::1185::TaskManager.Task::(prepare) Task=`ce5bb5ff-2020-48e5-ae3c-a3b452a5c121`::finished: {'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c': {'code': 0, 'version': 3, 'acquired': False, 'delay': '0.0095458', 'lastCheck': '10.8', 'valid': True}} >Thread-1042::DEBUG::2014-07-10 08:26:07,761::task::595::TaskManager.Task::(_updateState) Task=`ce5bb5ff-2020-48e5-ae3c-a3b452a5c121`::moving from state preparing -> state finished >Thread-1042::DEBUG::2014-07-10 08:26:07,761::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-1042::DEBUG::2014-07-10 08:26:07,762::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1042::DEBUG::2014-07-10 08:26:07,762::task::990::TaskManager.Task::(_decref) Task=`ce5bb5ff-2020-48e5-ae3c-a3b452a5c121`::ref 0 aborting False >Thread-1042::DEBUG::2014-07-10 08:26:08,598::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [64ccce3e] >Thread-1042::DEBUG::2014-07-10 08:26:08,599::task::595::TaskManager.Task::(_updateState) Task=`3584bc4d-923a-4587-96e2-67913e4a9403`::moving from state init -> state preparing >Thread-1042::INFO::2014-07-10 08:26:08,599::logUtils::44::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='aa977a1d-e5ee-4a27-84c7-bcc58f7e8696', spUUID=None, options=None) >Thread-1042::DEBUG::2014-07-10 08:26:08,599::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: aa977a1d-e5ee-4a27-84c7-bcc58f7e8696 >Thread-1042::DEBUG::2014-07-10 08:26:08,599::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'aa977a1d-e5ee-4a27-84c7-bcc58f7e8696'} >Thread-1042::INFO::2014-07-10 08:26:08,599::logUtils::47::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'aa977a1d-e5ee-4a27-84c7-bcc58f7e8696'}} >Thread-1042::DEBUG::2014-07-10 08:26:08,600::task::1185::TaskManager.Task::(prepare) Task=`3584bc4d-923a-4587-96e2-67913e4a9403`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'aa977a1d-e5ee-4a27-84c7-bcc58f7e8696'}} >Thread-1042::DEBUG::2014-07-10 08:26:08,600::task::595::TaskManager.Task::(_updateState) Task=`3584bc4d-923a-4587-96e2-67913e4a9403`::moving from state preparing -> state finished >Thread-1042::DEBUG::2014-07-10 08:26:08,600::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-1042::DEBUG::2014-07-10 08:26:08,600::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1042::DEBUG::2014-07-10 08:26:08,600::task::990::TaskManager.Task::(_decref) Task=`3584bc4d-923a-4587-96e2-67913e4a9403`::ref 0 aborting False >Thread-1042::DEBUG::2014-07-10 08:26:09,605::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [64ccce3e] >Thread-1042::DEBUG::2014-07-10 08:26:09,606::task::595::TaskManager.Task::(_updateState) Task=`90942918-694e-4ded-b18e-a585771f7e30`::moving from state init -> state preparing >Thread-1042::INFO::2014-07-10 08:26:09,607::logUtils::44::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='aa977a1d-e5ee-4a27-84c7-bcc58f7e8696', spUUID=None, options=None) >Thread-1042::DEBUG::2014-07-10 08:26:09,607::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: aa977a1d-e5ee-4a27-84c7-bcc58f7e8696 >Thread-1042::DEBUG::2014-07-10 08:26:09,607::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'aa977a1d-e5ee-4a27-84c7-bcc58f7e8696'} >Thread-1042::INFO::2014-07-10 08:26:09,607::logUtils::47::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'aa977a1d-e5ee-4a27-84c7-bcc58f7e8696'}} >Thread-1042::DEBUG::2014-07-10 08:26:09,608::task::1185::TaskManager.Task::(prepare) Task=`90942918-694e-4ded-b18e-a585771f7e30`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'aa977a1d-e5ee-4a27-84c7-bcc58f7e8696'}} >Thread-1042::DEBUG::2014-07-10 08:26:09,608::task::595::TaskManager.Task::(_updateState) Task=`90942918-694e-4ded-b18e-a585771f7e30`::moving from state preparing -> state finished >Thread-1042::DEBUG::2014-07-10 08:26:09,608::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-1042::DEBUG::2014-07-10 08:26:09,608::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1042::DEBUG::2014-07-10 08:26:09,608::task::990::TaskManager.Task::(_decref) Task=`90942918-694e-4ded-b18e-a585771f7e30`::ref 0 aborting False >Thread-1042::DEBUG::2014-07-10 08:26:10,612::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [64ccce3e] >Thread-1042::DEBUG::2014-07-10 08:26:10,613::task::595::TaskManager.Task::(_updateState) Task=`eb1f00c4-2d50-4765-a32b-5fa0bd923a39`::moving from state init -> state preparing >Thread-1042::INFO::2014-07-10 08:26:10,613::logUtils::44::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='aa977a1d-e5ee-4a27-84c7-bcc58f7e8696', spUUID=None, options=None) >Thread-1042::DEBUG::2014-07-10 08:26:10,613::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: aa977a1d-e5ee-4a27-84c7-bcc58f7e8696 >Thread-1042::DEBUG::2014-07-10 08:26:10,613::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'aa977a1d-e5ee-4a27-84c7-bcc58f7e8696'} >Thread-1042::INFO::2014-07-10 08:26:10,614::logUtils::47::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'aa977a1d-e5ee-4a27-84c7-bcc58f7e8696'}} >Thread-1042::DEBUG::2014-07-10 08:26:10,614::task::1185::TaskManager.Task::(prepare) Task=`eb1f00c4-2d50-4765-a32b-5fa0bd923a39`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'aa977a1d-e5ee-4a27-84c7-bcc58f7e8696'}} >Thread-1042::DEBUG::2014-07-10 08:26:10,614::task::595::TaskManager.Task::(_updateState) Task=`eb1f00c4-2d50-4765-a32b-5fa0bd923a39`::moving from state preparing -> state finished >Thread-1042::DEBUG::2014-07-10 08:26:10,614::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-1042::DEBUG::2014-07-10 08:26:10,614::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1042::DEBUG::2014-07-10 08:26:10,615::task::990::TaskManager.Task::(_decref) Task=`eb1f00c4-2d50-4765-a32b-5fa0bd923a39`::ref 0 aborting False >Thread-1042::DEBUG::2014-07-10 08:26:11,618::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [64ccce3e] >Thread-1042::DEBUG::2014-07-10 08:26:11,619::task::595::TaskManager.Task::(_updateState) Task=`b16e5cbf-545f-4f33-a536-2030103eccd0`::moving from state init -> state preparing >Thread-1042::INFO::2014-07-10 08:26:11,619::logUtils::44::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='aa977a1d-e5ee-4a27-84c7-bcc58f7e8696', spUUID=None, options=None) >Thread-1042::DEBUG::2014-07-10 08:26:11,619::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: aa977a1d-e5ee-4a27-84c7-bcc58f7e8696 >Thread-1042::DEBUG::2014-07-10 08:26:11,619::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'aa977a1d-e5ee-4a27-84c7-bcc58f7e8696'} >Thread-1042::INFO::2014-07-10 08:26:11,619::logUtils::47::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'aa977a1d-e5ee-4a27-84c7-bcc58f7e8696'}} >Thread-1042::DEBUG::2014-07-10 08:26:11,620::task::1185::TaskManager.Task::(prepare) Task=`b16e5cbf-545f-4f33-a536-2030103eccd0`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'aa977a1d-e5ee-4a27-84c7-bcc58f7e8696'}} >Thread-1042::DEBUG::2014-07-10 08:26:11,620::task::595::TaskManager.Task::(_updateState) Task=`b16e5cbf-545f-4f33-a536-2030103eccd0`::moving from state preparing -> state finished >Thread-1042::DEBUG::2014-07-10 08:26:11,620::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-1042::DEBUG::2014-07-10 08:26:11,620::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1042::DEBUG::2014-07-10 08:26:11,620::task::990::TaskManager.Task::(_decref) Task=`b16e5cbf-545f-4f33-a536-2030103eccd0`::ref 0 aborting False >Thread-1042::DEBUG::2014-07-10 08:26:12,624::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [64ccce3e] >Thread-1042::DEBUG::2014-07-10 08:26:12,625::task::595::TaskManager.Task::(_updateState) Task=`d7c5feb5-93a9-413d-92be-307348a94044`::moving from state init -> state preparing >Thread-1042::INFO::2014-07-10 08:26:12,625::logUtils::44::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='aa977a1d-e5ee-4a27-84c7-bcc58f7e8696', spUUID=None, options=None) >Thread-1042::DEBUG::2014-07-10 08:26:12,625::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: aa977a1d-e5ee-4a27-84c7-bcc58f7e8696 >Thread-1042::DEBUG::2014-07-10 08:26:12,625::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'aa977a1d-e5ee-4a27-84c7-bcc58f7e8696'} >Thread-1042::INFO::2014-07-10 08:26:12,625::logUtils::47::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'aa977a1d-e5ee-4a27-84c7-bcc58f7e8696'}} >Thread-1042::DEBUG::2014-07-10 08:26:12,626::task::1185::TaskManager.Task::(prepare) Task=`d7c5feb5-93a9-413d-92be-307348a94044`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'aa977a1d-e5ee-4a27-84c7-bcc58f7e8696'}} >Thread-1042::DEBUG::2014-07-10 08:26:12,626::task::595::TaskManager.Task::(_updateState) Task=`d7c5feb5-93a9-413d-92be-307348a94044`::moving from state preparing -> state finished >Thread-1042::DEBUG::2014-07-10 08:26:12,626::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-1042::DEBUG::2014-07-10 08:26:12,626::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1042::DEBUG::2014-07-10 08:26:12,626::task::990::TaskManager.Task::(_decref) Task=`d7c5feb5-93a9-413d-92be-307348a94044`::ref 0 aborting False >Thread-1042::DEBUG::2014-07-10 08:26:13,640::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [64ccce3e] >Thread-1042::DEBUG::2014-07-10 08:26:13,640::task::595::TaskManager.Task::(_updateState) Task=`6ea61cc7-7cbe-4b31-adaf-15ddaa237da2`::moving from state init -> state preparing >Thread-1042::INFO::2014-07-10 08:26:13,641::logUtils::44::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='aa977a1d-e5ee-4a27-84c7-bcc58f7e8696', spUUID=None, options=None) >Thread-1042::DEBUG::2014-07-10 08:26:13,641::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: aa977a1d-e5ee-4a27-84c7-bcc58f7e8696 >Thread-1042::DEBUG::2014-07-10 08:26:13,641::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'aa977a1d-e5ee-4a27-84c7-bcc58f7e8696'} >Thread-1042::INFO::2014-07-10 08:26:13,641::logUtils::47::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'aa977a1d-e5ee-4a27-84c7-bcc58f7e8696'}} >Thread-1042::DEBUG::2014-07-10 08:26:13,641::task::1185::TaskManager.Task::(prepare) Task=`6ea61cc7-7cbe-4b31-adaf-15ddaa237da2`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'aa977a1d-e5ee-4a27-84c7-bcc58f7e8696'}} >Thread-1042::DEBUG::2014-07-10 08:26:13,641::task::595::TaskManager.Task::(_updateState) Task=`6ea61cc7-7cbe-4b31-adaf-15ddaa237da2`::moving from state preparing -> state finished >Thread-1042::DEBUG::2014-07-10 08:26:13,642::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-1042::DEBUG::2014-07-10 08:26:13,642::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1042::DEBUG::2014-07-10 08:26:13,642::task::990::TaskManager.Task::(_decref) Task=`6ea61cc7-7cbe-4b31-adaf-15ddaa237da2`::ref 0 aborting False >Thread-1042::DEBUG::2014-07-10 08:26:14,647::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [64ccce3e] >Thread-1042::DEBUG::2014-07-10 08:26:14,648::task::595::TaskManager.Task::(_updateState) Task=`9587ab51-497b-4c39-ac6d-08a9c034db13`::moving from state init -> state preparing >Thread-1042::INFO::2014-07-10 08:26:14,649::logUtils::44::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='aa977a1d-e5ee-4a27-84c7-bcc58f7e8696', spUUID=None, options=None) >Thread-1042::DEBUG::2014-07-10 08:26:14,649::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: aa977a1d-e5ee-4a27-84c7-bcc58f7e8696 >Thread-1042::DEBUG::2014-07-10 08:26:14,649::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'aa977a1d-e5ee-4a27-84c7-bcc58f7e8696'} >Thread-1042::INFO::2014-07-10 08:26:14,650::logUtils::47::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'aa977a1d-e5ee-4a27-84c7-bcc58f7e8696'}} >Thread-1042::DEBUG::2014-07-10 08:26:14,650::task::1185::TaskManager.Task::(prepare) Task=`9587ab51-497b-4c39-ac6d-08a9c034db13`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'aa977a1d-e5ee-4a27-84c7-bcc58f7e8696'}} >Thread-1042::DEBUG::2014-07-10 08:26:14,650::task::595::TaskManager.Task::(_updateState) Task=`9587ab51-497b-4c39-ac6d-08a9c034db13`::moving from state preparing -> state finished >Thread-1042::DEBUG::2014-07-10 08:26:14,650::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-1042::DEBUG::2014-07-10 08:26:14,650::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1042::DEBUG::2014-07-10 08:26:14,651::task::990::TaskManager.Task::(_decref) Task=`9587ab51-497b-4c39-ac6d-08a9c034db13`::ref 0 aborting False >Thread-1042::DEBUG::2014-07-10 08:26:15,655::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [64ccce3e] >Thread-1042::DEBUG::2014-07-10 08:26:15,655::task::595::TaskManager.Task::(_updateState) Task=`1a1901ff-b7ff-4cbf-843c-478c05f75d2b`::moving from state init -> state preparing >Thread-1042::INFO::2014-07-10 08:26:15,655::logUtils::44::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='aa977a1d-e5ee-4a27-84c7-bcc58f7e8696', spUUID=None, options=None) >Thread-1042::DEBUG::2014-07-10 08:26:15,656::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: aa977a1d-e5ee-4a27-84c7-bcc58f7e8696 >Thread-1042::DEBUG::2014-07-10 08:26:15,656::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'aa977a1d-e5ee-4a27-84c7-bcc58f7e8696'} >Thread-1042::INFO::2014-07-10 08:26:15,656::logUtils::47::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'aa977a1d-e5ee-4a27-84c7-bcc58f7e8696'}} >Thread-1042::DEBUG::2014-07-10 08:26:15,656::task::1185::TaskManager.Task::(prepare) Task=`1a1901ff-b7ff-4cbf-843c-478c05f75d2b`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'aa977a1d-e5ee-4a27-84c7-bcc58f7e8696'}} >Thread-1042::DEBUG::2014-07-10 08:26:15,656::task::595::TaskManager.Task::(_updateState) Task=`1a1901ff-b7ff-4cbf-843c-478c05f75d2b`::moving from state preparing -> state finished >Thread-1042::DEBUG::2014-07-10 08:26:15,656::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-1042::DEBUG::2014-07-10 08:26:15,656::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1042::DEBUG::2014-07-10 08:26:15,657::task::990::TaskManager.Task::(_decref) Task=`1a1901ff-b7ff-4cbf-843c-478c05f75d2b`::ref 0 aborting False >Thread-1042::DEBUG::2014-07-10 08:26:16,660::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [64ccce3e] >Thread-1042::DEBUG::2014-07-10 08:26:16,660::task::595::TaskManager.Task::(_updateState) Task=`af979de2-c197-4cf7-8643-c67ff4f5e168`::moving from state init -> state preparing >Thread-1042::INFO::2014-07-10 08:26:16,661::logUtils::44::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='aa977a1d-e5ee-4a27-84c7-bcc58f7e8696', spUUID=None, options=None) >Thread-1042::DEBUG::2014-07-10 08:26:16,661::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: aa977a1d-e5ee-4a27-84c7-bcc58f7e8696 >Thread-1042::DEBUG::2014-07-10 08:26:16,661::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'aa977a1d-e5ee-4a27-84c7-bcc58f7e8696'} >Thread-1042::INFO::2014-07-10 08:26:16,661::logUtils::47::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'aa977a1d-e5ee-4a27-84c7-bcc58f7e8696'}} >Thread-1042::DEBUG::2014-07-10 08:26:16,661::task::1185::TaskManager.Task::(prepare) Task=`af979de2-c197-4cf7-8643-c67ff4f5e168`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'aa977a1d-e5ee-4a27-84c7-bcc58f7e8696'}} >Thread-1042::DEBUG::2014-07-10 08:26:16,661::task::595::TaskManager.Task::(_updateState) Task=`af979de2-c197-4cf7-8643-c67ff4f5e168`::moving from state preparing -> state finished >Thread-1042::DEBUG::2014-07-10 08:26:16,662::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-1042::DEBUG::2014-07-10 08:26:16,662::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1042::DEBUG::2014-07-10 08:26:16,662::task::990::TaskManager.Task::(_decref) Task=`af979de2-c197-4cf7-8643-c67ff4f5e168`::ref 0 aborting False >Thread-1042::DEBUG::2014-07-10 08:26:17,666::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [64ccce3e] >Thread-1042::DEBUG::2014-07-10 08:26:17,666::task::595::TaskManager.Task::(_updateState) Task=`a3b5b6c4-b308-401d-ad3c-4fee1adbb918`::moving from state init -> state preparing >Thread-1042::INFO::2014-07-10 08:26:17,666::logUtils::44::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='aa977a1d-e5ee-4a27-84c7-bcc58f7e8696', spUUID=None, options=None) >Thread-1042::DEBUG::2014-07-10 08:26:17,666::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: aa977a1d-e5ee-4a27-84c7-bcc58f7e8696 >Thread-1042::DEBUG::2014-07-10 08:26:17,667::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'aa977a1d-e5ee-4a27-84c7-bcc58f7e8696'} >Thread-1042::INFO::2014-07-10 08:26:17,667::logUtils::47::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'aa977a1d-e5ee-4a27-84c7-bcc58f7e8696'}} >Thread-1042::DEBUG::2014-07-10 08:26:17,667::task::1185::TaskManager.Task::(prepare) Task=`a3b5b6c4-b308-401d-ad3c-4fee1adbb918`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'aa977a1d-e5ee-4a27-84c7-bcc58f7e8696'}} >Thread-1042::DEBUG::2014-07-10 08:26:17,667::task::595::TaskManager.Task::(_updateState) Task=`a3b5b6c4-b308-401d-ad3c-4fee1adbb918`::moving from state preparing -> state finished >Thread-1042::DEBUG::2014-07-10 08:26:17,667::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-1042::DEBUG::2014-07-10 08:26:17,667::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1042::DEBUG::2014-07-10 08:26:17,667::task::990::TaskManager.Task::(_decref) Task=`a3b5b6c4-b308-401d-ad3c-4fee1adbb918`::ref 0 aborting False >Thread-1042::DEBUG::2014-07-10 08:26:18,671::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [64ccce3e] >Thread-1042::DEBUG::2014-07-10 08:26:18,671::task::595::TaskManager.Task::(_updateState) Task=`e2f53ead-204f-4491-98f4-6ec246f399e0`::moving from state init -> state preparing >Thread-1042::INFO::2014-07-10 08:26:18,672::logUtils::44::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='aa977a1d-e5ee-4a27-84c7-bcc58f7e8696', spUUID=None, options=None) >Thread-1042::DEBUG::2014-07-10 08:26:18,672::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: aa977a1d-e5ee-4a27-84c7-bcc58f7e8696 >Thread-1042::DEBUG::2014-07-10 08:26:18,672::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'aa977a1d-e5ee-4a27-84c7-bcc58f7e8696'} >Thread-1042::INFO::2014-07-10 08:26:18,672::logUtils::47::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'aa977a1d-e5ee-4a27-84c7-bcc58f7e8696'}} >Thread-1042::DEBUG::2014-07-10 08:26:18,672::task::1185::TaskManager.Task::(prepare) Task=`e2f53ead-204f-4491-98f4-6ec246f399e0`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'aa977a1d-e5ee-4a27-84c7-bcc58f7e8696'}} >Thread-1042::DEBUG::2014-07-10 08:26:18,672::task::595::TaskManager.Task::(_updateState) Task=`e2f53ead-204f-4491-98f4-6ec246f399e0`::moving from state preparing -> state finished >Thread-1042::DEBUG::2014-07-10 08:26:18,672::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-1042::DEBUG::2014-07-10 08:26:18,673::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1042::DEBUG::2014-07-10 08:26:18,673::task::990::TaskManager.Task::(_decref) Task=`e2f53ead-204f-4491-98f4-6ec246f399e0`::ref 0 aborting False >aa977a1d-e5ee-4a27-84c7-bcc58f7e8696::DEBUG::2014-07-10 08:26:18,846::clusterlock::202::SANLock::(acquireHostId) Host id for domain e01a3a36-d2ce-4153-bb57-d6e65b7ed08c successfully acquired (id: 1) >aa977a1d-e5ee-4a27-84c7-bcc58f7e8696::WARNING::2014-07-10 08:26:18,847::fileUtils::167::Storage.fileUtils::(createdir) Dir /rhev/data-center/mnt/blockSD/e01a3a36-d2ce-4153-bb57-d6e65b7ed08c/images already exists >aa977a1d-e5ee-4a27-84c7-bcc58f7e8696::WARNING::2014-07-10 08:26:18,848::fileUtils::167::Storage.fileUtils::(createdir) Dir /rhev/data-center/mnt/blockSD/e01a3a36-d2ce-4153-bb57-d6e65b7ed08c/dom_md already exists >aa977a1d-e5ee-4a27-84c7-bcc58f7e8696::DEBUG::2014-07-10 08:26:18,848::lvm::503::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >aa977a1d-e5ee-4a27-84c7-bcc58f7e8696::DEBUG::2014-07-10 08:26:18,849::lvm::505::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >aa977a1d-e5ee-4a27-84c7-bcc58f7e8696::DEBUG::2014-07-10 08:26:18,849::lvm::513::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >aa977a1d-e5ee-4a27-84c7-bcc58f7e8696::DEBUG::2014-07-10 08:26:18,849::lvm::525::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >aa977a1d-e5ee-4a27-84c7-bcc58f7e8696::DEBUG::2014-07-10 08:26:18,850::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with LvMetadataRW backend >aa977a1d-e5ee-4a27-84c7-bcc58f7e8696::DEBUG::2014-07-10 08:26:18,850::blockSD::336::Storage.Misc.excCmd::(readlines) '/bin/dd iflag=direct skip=0 bs=2048 if=/dev/e01a3a36-d2ce-4153-bb57-d6e65b7ed08c/metadata count=1' (cwd None) >aa977a1d-e5ee-4a27-84c7-bcc58f7e8696::DEBUG::2014-07-10 08:26:18,908::blockSD::336::Storage.Misc.excCmd::(readlines) SUCCESS: <err> = '1+0 records in\n1+0 records out\n2048 bytes (2.0 kB) copied, 0.000861664 s, 2.4 MB/s\n'; <rc> = 0 >aa977a1d-e5ee-4a27-84c7-bcc58f7e8696::DEBUG::2014-07-10 08:26:18,908::misc::282::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '2048 bytes (2.0 kB) copied, 0.000861664 s, 2.4 MB/s'], size: 2048 >aa977a1d-e5ee-4a27-84c7-bcc58f7e8696::DEBUG::2014-07-10 08:26:18,909::persistentDict::234::Storage.PersistentDict::(refresh) read lines (LvMetadataRW)=[] >aa977a1d-e5ee-4a27-84c7-bcc58f7e8696::WARNING::2014-07-10 08:26:18,909::persistentDict::256::Storage.PersistentDict::(refresh) data has no embedded checksum - trust it as it is >aa977a1d-e5ee-4a27-84c7-bcc58f7e8696::DEBUG::2014-07-10 08:26:18,909::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with VGTagMetadataRW backend >aa977a1d-e5ee-4a27-84c7-bcc58f7e8696::DEBUG::2014-07-10 08:26:18,910::lvm::503::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >aa977a1d-e5ee-4a27-84c7-bcc58f7e8696::DEBUG::2014-07-10 08:26:18,910::lvm::505::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >aa977a1d-e5ee-4a27-84c7-bcc58f7e8696::DEBUG::2014-07-10 08:26:18,910::lvm::513::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >aa977a1d-e5ee-4a27-84c7-bcc58f7e8696::DEBUG::2014-07-10 08:26:18,910::lvm::525::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >aa977a1d-e5ee-4a27-84c7-bcc58f7e8696::DEBUG::2014-07-10 08:26:18,911::lvm::373::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >aa977a1d-e5ee-4a27-84c7-bcc58f7e8696::DEBUG::2014-07-10 08:26:18,912::lvm::296::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/3600601601282300032826addbbdae311|/dev/mapper/360060160f4a030003840ec867ddee311|/dev/mapper/367cad74c2fcba00019e6afd20c781e67|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name e01a3a36-d2ce-4153-bb57-d6e65b7ed08c' (cwd None) >aa977a1d-e5ee-4a27-84c7-bcc58f7e8696::DEBUG::2014-07-10 08:26:19,282::lvm::296::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >aa977a1d-e5ee-4a27-84c7-bcc58f7e8696::DEBUG::2014-07-10 08:26:19,284::lvm::415::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >aa977a1d-e5ee-4a27-84c7-bcc58f7e8696::DEBUG::2014-07-10 08:26:19,285::persistentDict::234::Storage.PersistentDict::(refresh) read lines (VGTagMetadataRW)=['LEASETIMESEC=60', 'CLASS=Data', 'VERSION=3', u'PV1=pv:360060160f4a030003840ec867ddee311,uuid:0eUwla-dsA3-g6ia-RU23-cual-0rt9-KzkxLj,pestart:0,pecount:397,mapoffset:8189', u'PV0=pv:3600601601282300032826addbbdae311,uuid:ZdReOp-Yf8A-beQm-ne4I-pN3J-rxgm-9Ew0S1,pestart:0,pecount:8189,mapoffset:0', 'LOGBLKSIZE=512', 'LEASERETRIES=3', 'IOOPTIMEOUTSEC=10', 'LOCKRENEWALINTERVALSEC=5', 'PHYBLKSIZE=512', 'SDUUID=e01a3a36-d2ce-4153-bb57-d6e65b7ed08c', 'DESCRIPTION=SD-REAL', 'LOCKPOLICY=', 'VGUUID=GJcVo5-Y0kU-CDub-zITS-zfoL-Z7hz-SeVeIe', 'TYPE=ISCSI', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=DC-REAL', 'ROLE=Master', 'POOL_UUID=411039e4-4af2-4192-9de0-67dc1ed83ba9', 'POOL_SPM_LVER=2', 'POOL_DOMAINS=e01a3a36-d2ce-4153-bb57-d6e65b7ed08c:Active', '_SHA_CKSUM=0862f206224f948dbd549e5f29740569287a60bc', 'POOL_SPM_ID=-1'] >aa977a1d-e5ee-4a27-84c7-bcc58f7e8696::INFO::2014-07-10 08:26:19,285::clusterlock::235::SANLock::(acquire) Acquiring cluster lock for domain e01a3a36-d2ce-4153-bb57-d6e65b7ed08c (id: 1) >aa977a1d-e5ee-4a27-84c7-bcc58f7e8696::DEBUG::2014-07-10 08:26:19,350::clusterlock::261::SANLock::(acquire) Cluster lock for domain e01a3a36-d2ce-4153-bb57-d6e65b7ed08c successfully acquired (id: 1) >aa977a1d-e5ee-4a27-84c7-bcc58f7e8696::DEBUG::2014-07-10 08:26:19,350::sp::275::Storage.StoragePool::(startSpm) spm lock acquired successfully >aa977a1d-e5ee-4a27-84c7-bcc58f7e8696::DEBUG::2014-07-10 08:26:19,350::lvm::503::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >aa977a1d-e5ee-4a27-84c7-bcc58f7e8696::DEBUG::2014-07-10 08:26:19,351::lvm::505::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >aa977a1d-e5ee-4a27-84c7-bcc58f7e8696::DEBUG::2014-07-10 08:26:19,351::lvm::513::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >aa977a1d-e5ee-4a27-84c7-bcc58f7e8696::DEBUG::2014-07-10 08:26:19,351::lvm::525::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >aa977a1d-e5ee-4a27-84c7-bcc58f7e8696::DEBUG::2014-07-10 08:26:19,351::lvm::373::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >aa977a1d-e5ee-4a27-84c7-bcc58f7e8696::DEBUG::2014-07-10 08:26:19,352::lvm::296::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/3600601601282300032826addbbdae311|/dev/mapper/360060160f4a030003840ec867ddee311|/dev/mapper/367cad74c2fcba00019e6afd20c781e67|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name e01a3a36-d2ce-4153-bb57-d6e65b7ed08c' (cwd None) >aa977a1d-e5ee-4a27-84c7-bcc58f7e8696::DEBUG::2014-07-10 08:26:19,673::lvm::296::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-1042::DEBUG::2014-07-10 08:26:19,683::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [64ccce3e] >aa977a1d-e5ee-4a27-84c7-bcc58f7e8696::DEBUG::2014-07-10 08:26:19,683::lvm::415::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-1042::DEBUG::2014-07-10 08:26:19,686::task::595::TaskManager.Task::(_updateState) Task=`3468207c-f917-4954-ac6e-07c9cb239282`::moving from state init -> state preparing >aa977a1d-e5ee-4a27-84c7-bcc58f7e8696::DEBUG::2014-07-10 08:26:19,687::persistentDict::234::Storage.PersistentDict::(refresh) read lines (VGTagMetadataRW)=['LEASETIMESEC=60', 'CLASS=Data', 'VERSION=3', u'PV1=pv:360060160f4a030003840ec867ddee311,uuid:0eUwla-dsA3-g6ia-RU23-cual-0rt9-KzkxLj,pestart:0,pecount:397,mapoffset:8189', u'PV0=pv:3600601601282300032826addbbdae311,uuid:ZdReOp-Yf8A-beQm-ne4I-pN3J-rxgm-9Ew0S1,pestart:0,pecount:8189,mapoffset:0', 'LOGBLKSIZE=512', 'LEASERETRIES=3', 'IOOPTIMEOUTSEC=10', 'LOCKRENEWALINTERVALSEC=5', 'PHYBLKSIZE=512', 'SDUUID=e01a3a36-d2ce-4153-bb57-d6e65b7ed08c', 'DESCRIPTION=SD-REAL', 'LOCKPOLICY=', 'VGUUID=GJcVo5-Y0kU-CDub-zITS-zfoL-Z7hz-SeVeIe', 'TYPE=ISCSI', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=DC-REAL', 'ROLE=Master', 'POOL_UUID=411039e4-4af2-4192-9de0-67dc1ed83ba9', 'POOL_SPM_LVER=2', 'POOL_DOMAINS=e01a3a36-d2ce-4153-bb57-d6e65b7ed08c:Active', '_SHA_CKSUM=0862f206224f948dbd549e5f29740569287a60bc', 'POOL_SPM_ID=-1'] >Thread-1042::INFO::2014-07-10 08:26:19,688::logUtils::44::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='aa977a1d-e5ee-4a27-84c7-bcc58f7e8696', spUUID=None, options=None) >aa977a1d-e5ee-4a27-84c7-bcc58f7e8696::DEBUG::2014-07-10 08:26:19,689::persistentDict::167::Storage.PersistentDict::(transaction) Starting transaction >Thread-1042::DEBUG::2014-07-10 08:26:19,690::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: aa977a1d-e5ee-4a27-84c7-bcc58f7e8696 >Thread-1042::DEBUG::2014-07-10 08:26:19,691::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'aa977a1d-e5ee-4a27-84c7-bcc58f7e8696'} >Thread-1042::INFO::2014-07-10 08:26:19,692::logUtils::47::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'aa977a1d-e5ee-4a27-84c7-bcc58f7e8696'}} >aa977a1d-e5ee-4a27-84c7-bcc58f7e8696::DEBUG::2014-07-10 08:26:19,693::persistentDict::173::Storage.PersistentDict::(transaction) Flushing changes >Thread-1042::DEBUG::2014-07-10 08:26:19,693::task::1185::TaskManager.Task::(prepare) Task=`3468207c-f917-4954-ac6e-07c9cb239282`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'aa977a1d-e5ee-4a27-84c7-bcc58f7e8696'}} >aa977a1d-e5ee-4a27-84c7-bcc58f7e8696::DEBUG::2014-07-10 08:26:19,695::persistentDict::299::Storage.PersistentDict::(flush) about to write lines (VGTagMetadataRW)=['CLASS=Data', 'DESCRIPTION=SD-REAL', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'LOGBLKSIZE=512', 'MASTER_VERSION=1', 'PHYBLKSIZE=512', 'POOL_DESCRIPTION=DC-REAL', 'POOL_DOMAINS=e01a3a36-d2ce-4153-bb57-d6e65b7ed08c:Active', 'POOL_SPM_ID=1', 'POOL_SPM_LVER=3', 'POOL_UUID=411039e4-4af2-4192-9de0-67dc1ed83ba9', u'PV0=pv:3600601601282300032826addbbdae311,uuid:ZdReOp-Yf8A-beQm-ne4I-pN3J-rxgm-9Ew0S1,pestart:0,pecount:8189,mapoffset:0', u'PV1=pv:360060160f4a030003840ec867ddee311,uuid:0eUwla-dsA3-g6ia-RU23-cual-0rt9-KzkxLj,pestart:0,pecount:397,mapoffset:8189', 'ROLE=Master', 'SDUUID=e01a3a36-d2ce-4153-bb57-d6e65b7ed08c', 'TYPE=ISCSI', 'VERSION=3', 'VGUUID=GJcVo5-Y0kU-CDub-zITS-zfoL-Z7hz-SeVeIe', '_SHA_CKSUM=fff80dfbf867146f89a6fadc25468cad12a2316f'] >Thread-1042::DEBUG::2014-07-10 08:26:19,695::task::595::TaskManager.Task::(_updateState) Task=`3468207c-f917-4954-ac6e-07c9cb239282`::moving from state preparing -> state finished >aa977a1d-e5ee-4a27-84c7-bcc58f7e8696::DEBUG::2014-07-10 08:26:19,696::lvm::503::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-1042::DEBUG::2014-07-10 08:26:19,696::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-1042::DEBUG::2014-07-10 08:26:19,698::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >aa977a1d-e5ee-4a27-84c7-bcc58f7e8696::DEBUG::2014-07-10 08:26:19,698::lvm::505::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-1042::DEBUG::2014-07-10 08:26:19,699::task::990::TaskManager.Task::(_decref) Task=`3468207c-f917-4954-ac6e-07c9cb239282`::ref 0 aborting False >aa977a1d-e5ee-4a27-84c7-bcc58f7e8696::DEBUG::2014-07-10 08:26:19,700::lvm::513::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >aa977a1d-e5ee-4a27-84c7-bcc58f7e8696::DEBUG::2014-07-10 08:26:19,701::lvm::525::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >aa977a1d-e5ee-4a27-84c7-bcc58f7e8696::DEBUG::2014-07-10 08:26:19,702::lvm::373::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >aa977a1d-e5ee-4a27-84c7-bcc58f7e8696::DEBUG::2014-07-10 08:26:19,704::lvm::296::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/3600601601282300032826addbbdae311|/dev/mapper/360060160f4a030003840ec867ddee311|/dev/mapper/367cad74c2fcba00019e6afd20c781e67|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name e01a3a36-d2ce-4153-bb57-d6e65b7ed08c' (cwd None) >aa977a1d-e5ee-4a27-84c7-bcc58f7e8696::DEBUG::2014-07-10 08:26:19,956::lvm::296::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >aa977a1d-e5ee-4a27-84c7-bcc58f7e8696::DEBUG::2014-07-10 08:26:19,958::lvm::415::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >aa977a1d-e5ee-4a27-84c7-bcc58f7e8696::DEBUG::2014-07-10 08:26:19,959::blockSD::315::storage.Metadata.VGTagMetadataRW::(writelines) Updating metadata adding=MDT_POOL_SPM_LVER=3, MDT_POOL_SPM_ID=1, MDT__SHA_CKSUM=fff80dfbf867146f89a6fadc25468cad12a2316f removing=MDT_POOL_SPM_ID=-1, MDT_POOL_SPM_LVER=2, MDT__SHA_CKSUM=0862f206224f948dbd549e5f29740569287a60bc >aa977a1d-e5ee-4a27-84c7-bcc58f7e8696::DEBUG::2014-07-10 08:26:19,960::lvm::296::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgchange --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/3600601601282300032826addbbdae311|/dev/mapper/360060160f4a030003840ec867ddee311|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } " --deltag MDT__SHA_CKSUM=0862f206224f948dbd549e5f29740569287a60bc --deltag MDT_POOL_SPM_ID=-1 --deltag MDT_POOL_SPM_LVER=2 --addtag MDT_POOL_SPM_ID=1 --addtag MDT__SHA_CKSUM=fff80dfbf867146f89a6fadc25468cad12a2316f --addtag MDT_POOL_SPM_LVER=3 e01a3a36-d2ce-4153-bb57-d6e65b7ed08c' (cwd None) >aa977a1d-e5ee-4a27-84c7-bcc58f7e8696::DEBUG::2014-07-10 08:26:20,320::lvm::296::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >aa977a1d-e5ee-4a27-84c7-bcc58f7e8696::DEBUG::2014-07-10 08:26:20,321::lvm::503::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >aa977a1d-e5ee-4a27-84c7-bcc58f7e8696::DEBUG::2014-07-10 08:26:20,321::lvm::505::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >aa977a1d-e5ee-4a27-84c7-bcc58f7e8696::DEBUG::2014-07-10 08:26:20,321::persistentDict::175::Storage.PersistentDict::(transaction) Finished transaction >aa977a1d-e5ee-4a27-84c7-bcc58f7e8696::DEBUG::2014-07-10 08:26:20,322::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.upgrade_411039e4-4af2-4192-9de0-67dc1ed83ba9`ReqID=`ee8fc297-93aa-4e3a-989d-6a489eb7c3de`::Request was made in '/usr/share/vdsm/storage/sp.py' line '429' at '_upgradePool' >aa977a1d-e5ee-4a27-84c7-bcc58f7e8696::DEBUG::2014-07-10 08:26:20,323::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.upgrade_411039e4-4af2-4192-9de0-67dc1ed83ba9' for lock type 'exclusive' >aa977a1d-e5ee-4a27-84c7-bcc58f7e8696::DEBUG::2014-07-10 08:26:20,323::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.upgrade_411039e4-4af2-4192-9de0-67dc1ed83ba9' is free. Now locking as 'exclusive' (1 active user) >aa977a1d-e5ee-4a27-84c7-bcc58f7e8696::DEBUG::2014-07-10 08:26:20,323::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.upgrade_411039e4-4af2-4192-9de0-67dc1ed83ba9`ReqID=`ee8fc297-93aa-4e3a-989d-6a489eb7c3de`::Granted request >aa977a1d-e5ee-4a27-84c7-bcc58f7e8696::INFO::2014-07-10 08:26:20,324::sp::435::Storage.StoragePool::(_upgradePool) Trying to upgrade master domain `e01a3a36-d2ce-4153-bb57-d6e65b7ed08c` >aa977a1d-e5ee-4a27-84c7-bcc58f7e8696::DEBUG::2014-07-10 08:26:20,324::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.e01a3a36-d2ce-4153-bb57-d6e65b7ed08c`ReqID=`bd79b370-5104-430d-9119-36528ec2145c`::Request was made in '/usr/share/vdsm/storage/sp.py' line '437' at '_upgradePool' >aa977a1d-e5ee-4a27-84c7-bcc58f7e8696::DEBUG::2014-07-10 08:26:20,324::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.e01a3a36-d2ce-4153-bb57-d6e65b7ed08c' for lock type 'exclusive' >aa977a1d-e5ee-4a27-84c7-bcc58f7e8696::DEBUG::2014-07-10 08:26:20,325::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.e01a3a36-d2ce-4153-bb57-d6e65b7ed08c' is free. Now locking as 'exclusive' (1 active user) >aa977a1d-e5ee-4a27-84c7-bcc58f7e8696::DEBUG::2014-07-10 08:26:20,325::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.e01a3a36-d2ce-4153-bb57-d6e65b7ed08c`ReqID=`bd79b370-5104-430d-9119-36528ec2145c`::Granted request >aa977a1d-e5ee-4a27-84c7-bcc58f7e8696::DEBUG::2014-07-10 08:26:20,326::lvm::373::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >aa977a1d-e5ee-4a27-84c7-bcc58f7e8696::DEBUG::2014-07-10 08:26:20,326::lvm::296::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/3600601601282300032826addbbdae311|/dev/mapper/360060160f4a030003840ec867ddee311|/dev/mapper/367cad74c2fcba00019e6afd20c781e67|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name e01a3a36-d2ce-4153-bb57-d6e65b7ed08c' (cwd None) >aa977a1d-e5ee-4a27-84c7-bcc58f7e8696::DEBUG::2014-07-10 08:26:20,662::lvm::296::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >aa977a1d-e5ee-4a27-84c7-bcc58f7e8696::DEBUG::2014-07-10 08:26:20,664::lvm::415::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >aa977a1d-e5ee-4a27-84c7-bcc58f7e8696::DEBUG::2014-07-10 08:26:20,665::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with LvMetadataRW backend >aa977a1d-e5ee-4a27-84c7-bcc58f7e8696::DEBUG::2014-07-10 08:26:20,665::blockSD::336::Storage.Misc.excCmd::(readlines) '/bin/dd iflag=direct skip=0 bs=2048 if=/dev/e01a3a36-d2ce-4153-bb57-d6e65b7ed08c/metadata count=1' (cwd None) >Thread-1042::DEBUG::2014-07-10 08:26:20,724::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [64ccce3e] >Thread-1042::DEBUG::2014-07-10 08:26:20,727::task::595::TaskManager.Task::(_updateState) Task=`0ea15c6f-fd98-4a4d-9e8f-3956fe1e29d7`::moving from state init -> state preparing >Thread-1042::INFO::2014-07-10 08:26:20,729::logUtils::44::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='aa977a1d-e5ee-4a27-84c7-bcc58f7e8696', spUUID=None, options=None) >Thread-1042::DEBUG::2014-07-10 08:26:20,730::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: aa977a1d-e5ee-4a27-84c7-bcc58f7e8696 >aa977a1d-e5ee-4a27-84c7-bcc58f7e8696::DEBUG::2014-07-10 08:26:20,731::blockSD::336::Storage.Misc.excCmd::(readlines) SUCCESS: <err> = '1+0 records in\n1+0 records out\n2048 bytes (2.0 kB) copied, 0.00102199 s, 2.0 MB/s\n'; <rc> = 0 >Thread-1042::DEBUG::2014-07-10 08:26:20,732::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'aa977a1d-e5ee-4a27-84c7-bcc58f7e8696'} >aa977a1d-e5ee-4a27-84c7-bcc58f7e8696::DEBUG::2014-07-10 08:26:20,732::misc::282::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '2048 bytes (2.0 kB) copied, 0.00102199 s, 2.0 MB/s'], size: 2048 >Thread-1042::INFO::2014-07-10 08:26:20,733::logUtils::47::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'aa977a1d-e5ee-4a27-84c7-bcc58f7e8696'}} >aa977a1d-e5ee-4a27-84c7-bcc58f7e8696::DEBUG::2014-07-10 08:26:20,733::persistentDict::234::Storage.PersistentDict::(refresh) read lines (LvMetadataRW)=[] >aa977a1d-e5ee-4a27-84c7-bcc58f7e8696::WARNING::2014-07-10 08:26:20,734::persistentDict::256::Storage.PersistentDict::(refresh) data has no embedded checksum - trust it as it is >Thread-1042::DEBUG::2014-07-10 08:26:20,734::task::1185::TaskManager.Task::(prepare) Task=`0ea15c6f-fd98-4a4d-9e8f-3956fe1e29d7`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'aa977a1d-e5ee-4a27-84c7-bcc58f7e8696'}} >aa977a1d-e5ee-4a27-84c7-bcc58f7e8696::DEBUG::2014-07-10 08:26:20,735::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with VGTagMetadataRW backend >Thread-1042::DEBUG::2014-07-10 08:26:20,736::task::595::TaskManager.Task::(_updateState) Task=`0ea15c6f-fd98-4a4d-9e8f-3956fe1e29d7`::moving from state preparing -> state finished >aa977a1d-e5ee-4a27-84c7-bcc58f7e8696::DEBUG::2014-07-10 08:26:20,737::lvm::503::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-1042::DEBUG::2014-07-10 08:26:20,738::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >aa977a1d-e5ee-4a27-84c7-bcc58f7e8696::DEBUG::2014-07-10 08:26:20,739::lvm::505::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-1042::DEBUG::2014-07-10 08:26:20,739::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >aa977a1d-e5ee-4a27-84c7-bcc58f7e8696::DEBUG::2014-07-10 08:26:20,741::lvm::513::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-1042::DEBUG::2014-07-10 08:26:20,741::task::990::TaskManager.Task::(_decref) Task=`0ea15c6f-fd98-4a4d-9e8f-3956fe1e29d7`::ref 0 aborting False >aa977a1d-e5ee-4a27-84c7-bcc58f7e8696::DEBUG::2014-07-10 08:26:20,742::lvm::525::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >aa977a1d-e5ee-4a27-84c7-bcc58f7e8696::DEBUG::2014-07-10 08:26:20,743::lvm::373::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >aa977a1d-e5ee-4a27-84c7-bcc58f7e8696::DEBUG::2014-07-10 08:26:20,746::lvm::296::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/3600601601282300032826addbbdae311|/dev/mapper/360060160f4a030003840ec867ddee311|/dev/mapper/367cad74c2fcba00019e6afd20c781e67|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name e01a3a36-d2ce-4153-bb57-d6e65b7ed08c' (cwd None) >aa977a1d-e5ee-4a27-84c7-bcc58f7e8696::DEBUG::2014-07-10 08:26:20,990::lvm::296::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >aa977a1d-e5ee-4a27-84c7-bcc58f7e8696::DEBUG::2014-07-10 08:26:20,993::lvm::415::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >aa977a1d-e5ee-4a27-84c7-bcc58f7e8696::DEBUG::2014-07-10 08:26:20,993::persistentDict::234::Storage.PersistentDict::(refresh) read lines (VGTagMetadataRW)=['LEASETIMESEC=60', 'CLASS=Data', 'VERSION=3', u'PV1=pv:360060160f4a030003840ec867ddee311,uuid:0eUwla-dsA3-g6ia-RU23-cual-0rt9-KzkxLj,pestart:0,pecount:397,mapoffset:8189', u'PV0=pv:3600601601282300032826addbbdae311,uuid:ZdReOp-Yf8A-beQm-ne4I-pN3J-rxgm-9Ew0S1,pestart:0,pecount:8189,mapoffset:0', 'LOGBLKSIZE=512', 'LEASERETRIES=3', 'IOOPTIMEOUTSEC=10', 'LOCKRENEWALINTERVALSEC=5', 'PHYBLKSIZE=512', 'SDUUID=e01a3a36-d2ce-4153-bb57-d6e65b7ed08c', 'DESCRIPTION=SD-REAL', 'LOCKPOLICY=', 'VGUUID=GJcVo5-Y0kU-CDub-zITS-zfoL-Z7hz-SeVeIe', 'TYPE=ISCSI', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=DC-REAL', 'ROLE=Master', 'POOL_UUID=411039e4-4af2-4192-9de0-67dc1ed83ba9', 'POOL_DOMAINS=e01a3a36-d2ce-4153-bb57-d6e65b7ed08c:Active', 'POOL_SPM_ID=1', '_SHA_CKSUM=fff80dfbf867146f89a6fadc25468cad12a2316f', 'POOL_SPM_LVER=3'] >aa977a1d-e5ee-4a27-84c7-bcc58f7e8696::INFO::2014-07-10 08:26:20,995::sd::384::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace e01a3a36-d2ce-4153-bb57-d6e65b7ed08c_imageNS already registered >aa977a1d-e5ee-4a27-84c7-bcc58f7e8696::INFO::2014-07-10 08:26:20,995::sd::392::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace e01a3a36-d2ce-4153-bb57-d6e65b7ed08c_volumeNS already registered >aa977a1d-e5ee-4a27-84c7-bcc58f7e8696::INFO::2014-07-10 08:26:20,995::blockSD::452::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace e01a3a36-d2ce-4153-bb57-d6e65b7ed08c_lvmActivationNS already registered >aa977a1d-e5ee-4a27-84c7-bcc58f7e8696::DEBUG::2014-07-10 08:26:20,996::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.e01a3a36-d2ce-4153-bb57-d6e65b7ed08c' >aa977a1d-e5ee-4a27-84c7-bcc58f7e8696::DEBUG::2014-07-10 08:26:20,996::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.e01a3a36-d2ce-4153-bb57-d6e65b7ed08c' (0 active users) >aa977a1d-e5ee-4a27-84c7-bcc58f7e8696::DEBUG::2014-07-10 08:26:20,996::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.e01a3a36-d2ce-4153-bb57-d6e65b7ed08c' is free, finding out if anyone is waiting for it. >aa977a1d-e5ee-4a27-84c7-bcc58f7e8696::DEBUG::2014-07-10 08:26:20,996::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.e01a3a36-d2ce-4153-bb57-d6e65b7ed08c', Clearing records. >aa977a1d-e5ee-4a27-84c7-bcc58f7e8696::DEBUG::2014-07-10 08:26:20,997::sp::440::Storage.StoragePool::(_upgradePool) Marking all domains for upgrade >aa977a1d-e5ee-4a27-84c7-bcc58f7e8696::DEBUG::2014-07-10 08:26:20,997::lvm::503::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >aa977a1d-e5ee-4a27-84c7-bcc58f7e8696::DEBUG::2014-07-10 08:26:20,997::lvm::505::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >aa977a1d-e5ee-4a27-84c7-bcc58f7e8696::DEBUG::2014-07-10 08:26:20,997::lvm::513::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >aa977a1d-e5ee-4a27-84c7-bcc58f7e8696::DEBUG::2014-07-10 08:26:20,998::lvm::525::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >aa977a1d-e5ee-4a27-84c7-bcc58f7e8696::DEBUG::2014-07-10 08:26:20,998::lvm::373::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >aa977a1d-e5ee-4a27-84c7-bcc58f7e8696::DEBUG::2014-07-10 08:26:20,999::lvm::296::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/3600601601282300032826addbbdae311|/dev/mapper/360060160f4a030003840ec867ddee311|/dev/mapper/367cad74c2fcba00019e6afd20c781e67|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name e01a3a36-d2ce-4153-bb57-d6e65b7ed08c' (cwd None) >aa977a1d-e5ee-4a27-84c7-bcc58f7e8696::DEBUG::2014-07-10 08:26:21,248::lvm::296::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >aa977a1d-e5ee-4a27-84c7-bcc58f7e8696::DEBUG::2014-07-10 08:26:21,251::lvm::415::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >aa977a1d-e5ee-4a27-84c7-bcc58f7e8696::DEBUG::2014-07-10 08:26:21,251::persistentDict::234::Storage.PersistentDict::(refresh) read lines (VGTagMetadataRW)=['LEASETIMESEC=60', 'CLASS=Data', 'VERSION=3', u'PV1=pv:360060160f4a030003840ec867ddee311,uuid:0eUwla-dsA3-g6ia-RU23-cual-0rt9-KzkxLj,pestart:0,pecount:397,mapoffset:8189', u'PV0=pv:3600601601282300032826addbbdae311,uuid:ZdReOp-Yf8A-beQm-ne4I-pN3J-rxgm-9Ew0S1,pestart:0,pecount:8189,mapoffset:0', 'LOGBLKSIZE=512', 'LEASERETRIES=3', 'IOOPTIMEOUTSEC=10', 'LOCKRENEWALINTERVALSEC=5', 'PHYBLKSIZE=512', 'SDUUID=e01a3a36-d2ce-4153-bb57-d6e65b7ed08c', 'DESCRIPTION=SD-REAL', 'LOCKPOLICY=', 'VGUUID=GJcVo5-Y0kU-CDub-zITS-zfoL-Z7hz-SeVeIe', 'TYPE=ISCSI', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=DC-REAL', 'ROLE=Master', 'POOL_UUID=411039e4-4af2-4192-9de0-67dc1ed83ba9', 'POOL_DOMAINS=e01a3a36-d2ce-4153-bb57-d6e65b7ed08c:Active', 'POOL_SPM_ID=1', '_SHA_CKSUM=fff80dfbf867146f89a6fadc25468cad12a2316f', 'POOL_SPM_LVER=3'] >aa977a1d-e5ee-4a27-84c7-bcc58f7e8696::DEBUG::2014-07-10 08:26:21,252::sp::447::Storage.StoragePool::(_upgradePool) Registering with state change event >aa977a1d-e5ee-4a27-84c7-bcc58f7e8696::DEBUG::2014-07-10 08:26:21,252::sp::450::Storage.StoragePool::(_upgradePool) Running initial domain upgrade threads >aa977a1d-e5ee-4a27-84c7-bcc58f7e8696::DEBUG::2014-07-10 08:26:21,252::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.upgrade_411039e4-4af2-4192-9de0-67dc1ed83ba9' >aa977a1d-e5ee-4a27-84c7-bcc58f7e8696::DEBUG::2014-07-10 08:26:21,253::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.upgrade_411039e4-4af2-4192-9de0-67dc1ed83ba9' (0 active users) >aa977a1d-e5ee-4a27-84c7-bcc58f7e8696::DEBUG::2014-07-10 08:26:21,253::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.upgrade_411039e4-4af2-4192-9de0-67dc1ed83ba9' is free, finding out if anyone is waiting for it. >aa977a1d-e5ee-4a27-84c7-bcc58f7e8696::DEBUG::2014-07-10 08:26:21,253::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.upgrade_411039e4-4af2-4192-9de0-67dc1ed83ba9', Clearing records. >aa977a1d-e5ee-4a27-84c7-bcc58f7e8696::WARNING::2014-07-10 08:26:21,254::fileUtils::167::Storage.fileUtils::(createdir) Dir /rhev/data-center/mnt/blockSD/e01a3a36-d2ce-4153-bb57-d6e65b7ed08c/master already exists >aa977a1d-e5ee-4a27-84c7-bcc58f7e8696::DEBUG::2014-07-10 08:26:21,254::blockSD::1131::Storage.Misc.excCmd::(mountMaster) '/usr/bin/sudo -n /sbin/fsck -p /dev/e01a3a36-d2ce-4153-bb57-d6e65b7ed08c/master' (cwd None) >aa977a1d-e5ee-4a27-84c7-bcc58f7e8696::DEBUG::2014-07-10 08:26:21,514::blockSD::1131::Storage.Misc.excCmd::(mountMaster) SUCCESS: <err> = ''; <rc> = 0 >aa977a1d-e5ee-4a27-84c7-bcc58f7e8696::DEBUG::2014-07-10 08:26:21,515::blockSD::1156::Storage.Misc.excCmd::(mountMaster) '/usr/bin/sudo -n /sbin/tune2fs -j /dev/e01a3a36-d2ce-4153-bb57-d6e65b7ed08c/master' (cwd None) >aa977a1d-e5ee-4a27-84c7-bcc58f7e8696::DEBUG::2014-07-10 08:26:21,588::blockSD::1156::Storage.Misc.excCmd::(mountMaster) FAILED: <err> = 'The filesystem already has a journal.\n'; <rc> = 1 >aa977a1d-e5ee-4a27-84c7-bcc58f7e8696::DEBUG::2014-07-10 08:26:21,589::mount::202::Storage.Misc.excCmd::(_runcmd) '/usr/bin/sudo -n /bin/mount -t ext3 /dev/e01a3a36-d2ce-4153-bb57-d6e65b7ed08c/master /rhev/data-center/mnt/blockSD/e01a3a36-d2ce-4153-bb57-d6e65b7ed08c/master' (cwd None) >aa977a1d-e5ee-4a27-84c7-bcc58f7e8696::DEBUG::2014-07-10 08:26:21,742::blockSD::1168::Storage.Misc.excCmd::(mountMaster) '/usr/bin/sudo -n /bin/chown vdsm:kvm /rhev/data-center/mnt/blockSD/e01a3a36-d2ce-4153-bb57-d6e65b7ed08c/master' (cwd None) >Thread-1042::DEBUG::2014-07-10 08:26:21,802::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [64ccce3e] >Thread-1042::DEBUG::2014-07-10 08:26:21,803::task::595::TaskManager.Task::(_updateState) Task=`b47076b3-3009-40c8-bff9-2c1c1d44aff4`::moving from state init -> state preparing >Thread-1042::INFO::2014-07-10 08:26:21,804::logUtils::44::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='aa977a1d-e5ee-4a27-84c7-bcc58f7e8696', spUUID=None, options=None) >Thread-1042::DEBUG::2014-07-10 08:26:21,804::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: aa977a1d-e5ee-4a27-84c7-bcc58f7e8696 >Thread-1042::DEBUG::2014-07-10 08:26:21,804::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'aa977a1d-e5ee-4a27-84c7-bcc58f7e8696'} >Thread-1042::INFO::2014-07-10 08:26:21,804::logUtils::47::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'aa977a1d-e5ee-4a27-84c7-bcc58f7e8696'}} >Thread-1042::DEBUG::2014-07-10 08:26:21,804::task::1185::TaskManager.Task::(prepare) Task=`b47076b3-3009-40c8-bff9-2c1c1d44aff4`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'aa977a1d-e5ee-4a27-84c7-bcc58f7e8696'}} >Thread-1042::DEBUG::2014-07-10 08:26:21,805::task::595::TaskManager.Task::(_updateState) Task=`b47076b3-3009-40c8-bff9-2c1c1d44aff4`::moving from state preparing -> state finished >Thread-1042::DEBUG::2014-07-10 08:26:21,805::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-1042::DEBUG::2014-07-10 08:26:21,805::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1042::DEBUG::2014-07-10 08:26:21,805::task::990::TaskManager.Task::(_decref) Task=`b47076b3-3009-40c8-bff9-2c1c1d44aff4`::ref 0 aborting False >aa977a1d-e5ee-4a27-84c7-bcc58f7e8696::DEBUG::2014-07-10 08:26:21,811::blockSD::1168::Storage.Misc.excCmd::(mountMaster) SUCCESS: <err> = ''; <rc> = 0 >aa977a1d-e5ee-4a27-84c7-bcc58f7e8696::DEBUG::2014-07-10 08:26:21,812::sd::633::Storage.StorageDomain::(createMasterTree) creating vms dir: /rhev/data-center/mnt/blockSD/e01a3a36-d2ce-4153-bb57-d6e65b7ed08c/master/vms >aa977a1d-e5ee-4a27-84c7-bcc58f7e8696::DEBUG::2014-07-10 08:26:21,824::sd::636::Storage.StorageDomain::(createMasterTree) creating task dir: /rhev/data-center/mnt/blockSD/e01a3a36-d2ce-4153-bb57-d6e65b7ed08c/master/tasks >aa977a1d-e5ee-4a27-84c7-bcc58f7e8696::DEBUG::2014-07-10 08:26:21,854::lvm::503::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >aa977a1d-e5ee-4a27-84c7-bcc58f7e8696::DEBUG::2014-07-10 08:26:21,854::lvm::505::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >aa977a1d-e5ee-4a27-84c7-bcc58f7e8696::DEBUG::2014-07-10 08:26:21,854::lvm::513::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >aa977a1d-e5ee-4a27-84c7-bcc58f7e8696::DEBUG::2014-07-10 08:26:21,854::lvm::525::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >aa977a1d-e5ee-4a27-84c7-bcc58f7e8696::DEBUG::2014-07-10 08:26:21,855::lvm::373::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >aa977a1d-e5ee-4a27-84c7-bcc58f7e8696::DEBUG::2014-07-10 08:26:21,856::lvm::296::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/3600601601282300032826addbbdae311|/dev/mapper/360060160f4a030003840ec867ddee311|/dev/mapper/367cad74c2fcba00019e6afd20c781e67|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name e01a3a36-d2ce-4153-bb57-d6e65b7ed08c' (cwd None) >aa977a1d-e5ee-4a27-84c7-bcc58f7e8696::DEBUG::2014-07-10 08:26:22,116::lvm::296::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >aa977a1d-e5ee-4a27-84c7-bcc58f7e8696::DEBUG::2014-07-10 08:26:22,125::lvm::415::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >aa977a1d-e5ee-4a27-84c7-bcc58f7e8696::DEBUG::2014-07-10 08:26:22,129::persistentDict::234::Storage.PersistentDict::(refresh) read lines (VGTagMetadataRW)=['LEASETIMESEC=60', 'CLASS=Data', 'VERSION=3', u'PV1=pv:360060160f4a030003840ec867ddee311,uuid:0eUwla-dsA3-g6ia-RU23-cual-0rt9-KzkxLj,pestart:0,pecount:397,mapoffset:8189', u'PV0=pv:3600601601282300032826addbbdae311,uuid:ZdReOp-Yf8A-beQm-ne4I-pN3J-rxgm-9Ew0S1,pestart:0,pecount:8189,mapoffset:0', 'LOGBLKSIZE=512', 'LEASERETRIES=3', 'IOOPTIMEOUTSEC=10', 'LOCKRENEWALINTERVALSEC=5', 'PHYBLKSIZE=512', 'SDUUID=e01a3a36-d2ce-4153-bb57-d6e65b7ed08c', 'DESCRIPTION=SD-REAL', 'LOCKPOLICY=', 'VGUUID=GJcVo5-Y0kU-CDub-zITS-zfoL-Z7hz-SeVeIe', 'TYPE=ISCSI', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=DC-REAL', 'ROLE=Master', 'POOL_UUID=411039e4-4af2-4192-9de0-67dc1ed83ba9', 'POOL_DOMAINS=e01a3a36-d2ce-4153-bb57-d6e65b7ed08c:Active', 'POOL_SPM_ID=1', '_SHA_CKSUM=fff80dfbf867146f89a6fadc25468cad12a2316f', 'POOL_SPM_LVER=3'] >aa977a1d-e5ee-4a27-84c7-bcc58f7e8696::DEBUG::2014-07-10 08:26:22,166::threadPool::35::Misc.ThreadPool::(__init__) Enter - numThreads: 5.0, waitTimeout: 3, maxTasks: 500.0 >aa977a1d-e5ee-4a27-84c7-bcc58f7e8696::DEBUG::2014-07-10 08:26:22,175::storage_mailbox::574::Storage.MailBox.SpmMailMonitor::(__init__) SPM_MailMonitor - clearing outgoing mail, command is: ['dd', 'of=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/outbox', 'oflag=direct', 'iflag=fullblock', 'conv=notrunc', 'count=1'] >aa977a1d-e5ee-4a27-84c7-bcc58f7e8696::DEBUG::2014-07-10 08:26:22,176::storage_mailbox::84::Storage.Misc.excCmd::(_mboxExecCmd) 'dd of=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/outbox oflag=direct iflag=fullblock conv=notrunc count=1 bs=1024000' (cwd None) >aa977a1d-e5ee-4a27-84c7-bcc58f7e8696::DEBUG::2014-07-10 08:26:22,278::storage_mailbox::84::Storage.Misc.excCmd::(_mboxExecCmd) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0452875 s, 22.6 MB/s\n'; <rc> = 0 >aa977a1d-e5ee-4a27-84c7-bcc58f7e8696::DEBUG::2014-07-10 08:26:22,278::storage_mailbox::582::Storage.MailBox.SpmMailMonitor::(__init__) SPM_MailMonitor created for pool 411039e4-4af2-4192-9de0-67dc1ed83ba9 >aa977a1d-e5ee-4a27-84c7-bcc58f7e8696::DEBUG::2014-07-10 08:26:22,280::sp::322::Storage.StoragePool::(startSpm) SPM mailbox ready for pool 411039e4-4af2-4192-9de0-67dc1ed83ba9 on master domain e01a3a36-d2ce-4153-bb57-d6e65b7ed08c >aa977a1d-e5ee-4a27-84c7-bcc58f7e8696::DEBUG::2014-07-10 08:26:22,281::sp::330::Storage.StoragePool::(startSpm) ended. >aa977a1d-e5ee-4a27-84c7-bcc58f7e8696::DEBUG::2014-07-10 08:26:22,283::task::595::TaskManager.Task::(_updateState) Task=`aa977a1d-e5ee-4a27-84c7-bcc58f7e8696`::moving from state running -> state finished >Dummy-1639::DEBUG::2014-07-10 08:26:22,283::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >aa977a1d-e5ee-4a27-84c7-bcc58f7e8696::DEBUG::2014-07-10 08:26:22,286::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9': < ResourceRef 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9', isValid: 'True' obj: 'None'>} >aa977a1d-e5ee-4a27-84c7-bcc58f7e8696::DEBUG::2014-07-10 08:26:22,355::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >aa977a1d-e5ee-4a27-84c7-bcc58f7e8696::DEBUG::2014-07-10 08:26:22,358::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' >aa977a1d-e5ee-4a27-84c7-bcc58f7e8696::DEBUG::2014-07-10 08:26:22,358::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' (0 active users) >aa977a1d-e5ee-4a27-84c7-bcc58f7e8696::DEBUG::2014-07-10 08:26:22,359::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' is free, finding out if anyone is waiting for it. >aa977a1d-e5ee-4a27-84c7-bcc58f7e8696::DEBUG::2014-07-10 08:26:22,359::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9', Clearing records. >aa977a1d-e5ee-4a27-84c7-bcc58f7e8696::DEBUG::2014-07-10 08:26:22,359::task::913::TaskManager.Task::(_runJobs) Task=`aa977a1d-e5ee-4a27-84c7-bcc58f7e8696`::Task.run: exit - success: result >aa977a1d-e5ee-4a27-84c7-bcc58f7e8696::DEBUG::2014-07-10 08:26:22,359::task::990::TaskManager.Task::(_decref) Task=`aa977a1d-e5ee-4a27-84c7-bcc58f7e8696`::ref 0 aborting False >aa977a1d-e5ee-4a27-84c7-bcc58f7e8696::DEBUG::2014-07-10 08:26:22,360::threadPool::57::Misc.ThreadPool::(setRunningTask) Number of running tasks: 0 >Thread-1042::DEBUG::2014-07-10 08:26:22,810::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [64ccce3e] >Thread-1042::DEBUG::2014-07-10 08:26:22,811::task::595::TaskManager.Task::(_updateState) Task=`dd1f2d7e-8d32-4a68-9dd1-d89d66e0f469`::moving from state init -> state preparing >Thread-1042::INFO::2014-07-10 08:26:22,812::logUtils::44::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='aa977a1d-e5ee-4a27-84c7-bcc58f7e8696', spUUID=None, options=None) >Thread-1042::DEBUG::2014-07-10 08:26:22,812::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: aa977a1d-e5ee-4a27-84c7-bcc58f7e8696 >Thread-1042::DEBUG::2014-07-10 08:26:22,812::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': '1 jobs completed successfully', 'taskState': 'finished', 'taskResult': 'success', 'taskID': 'aa977a1d-e5ee-4a27-84c7-bcc58f7e8696'} >Thread-1042::INFO::2014-07-10 08:26:22,812::logUtils::47::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': '1 jobs completed successfully', 'taskState': 'finished', 'taskResult': 'success', 'taskID': 'aa977a1d-e5ee-4a27-84c7-bcc58f7e8696'}} >Thread-1042::DEBUG::2014-07-10 08:26:22,812::task::1185::TaskManager.Task::(prepare) Task=`dd1f2d7e-8d32-4a68-9dd1-d89d66e0f469`::finished: {'taskStatus': {'code': 0, 'message': '1 jobs completed successfully', 'taskState': 'finished', 'taskResult': 'success', 'taskID': 'aa977a1d-e5ee-4a27-84c7-bcc58f7e8696'}} >Thread-1042::DEBUG::2014-07-10 08:26:22,813::task::595::TaskManager.Task::(_updateState) Task=`dd1f2d7e-8d32-4a68-9dd1-d89d66e0f469`::moving from state preparing -> state finished >Thread-1042::DEBUG::2014-07-10 08:26:22,813::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-1042::DEBUG::2014-07-10 08:26:22,813::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1042::DEBUG::2014-07-10 08:26:22,813::task::990::TaskManager.Task::(_decref) Task=`dd1f2d7e-8d32-4a68-9dd1-d89d66e0f469`::ref 0 aborting False >Thread-1042::DEBUG::2014-07-10 08:26:22,817::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [64ccce3e] >Thread-1042::DEBUG::2014-07-10 08:26:22,818::task::595::TaskManager.Task::(_updateState) Task=`e0c2cf0d-af17-4faf-8264-1b1ddd776abe`::moving from state init -> state preparing >Thread-1042::INFO::2014-07-10 08:26:22,818::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='411039e4-4af2-4192-9de0-67dc1ed83ba9', options=None) >Thread-1042::INFO::2014-07-10 08:26:22,818::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 3}} >Thread-1042::DEBUG::2014-07-10 08:26:22,819::task::1185::TaskManager.Task::(prepare) Task=`e0c2cf0d-af17-4faf-8264-1b1ddd776abe`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 3}} >Thread-1042::DEBUG::2014-07-10 08:26:22,819::task::595::TaskManager.Task::(_updateState) Task=`e0c2cf0d-af17-4faf-8264-1b1ddd776abe`::moving from state preparing -> state finished >Thread-1042::DEBUG::2014-07-10 08:26:22,819::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-1042::DEBUG::2014-07-10 08:26:22,819::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1042::DEBUG::2014-07-10 08:26:22,819::task::990::TaskManager.Task::(_decref) Task=`e0c2cf0d-af17-4faf-8264-1b1ddd776abe`::ref 0 aborting False >Thread-1042::DEBUG::2014-07-10 08:26:22,863::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [64ccce3e] >Thread-1042::DEBUG::2014-07-10 08:26:22,864::task::595::TaskManager.Task::(_updateState) Task=`e65b6d69-8cff-4ffd-bade-99b5d7c2e735`::moving from state init -> state preparing >Thread-1042::INFO::2014-07-10 08:26:22,864::logUtils::44::dispatcher::(wrapper) Run and protect: clearTask(taskID='aa977a1d-e5ee-4a27-84c7-bcc58f7e8696', spUUID=None, options=None) >Thread-1042::DEBUG::2014-07-10 08:26:22,864::taskManager::161::TaskManager::(clearTask) Entry. taskID: aa977a1d-e5ee-4a27-84c7-bcc58f7e8696 >Thread-1042::DEBUG::2014-07-10 08:26:22,864::taskManager::166::TaskManager::(clearTask) Return. >Thread-1042::INFO::2014-07-10 08:26:22,864::logUtils::47::dispatcher::(wrapper) Run and protect: clearTask, Return response: None >Thread-1042::DEBUG::2014-07-10 08:26:22,865::task::1185::TaskManager.Task::(prepare) Task=`e65b6d69-8cff-4ffd-bade-99b5d7c2e735`::finished: None >Thread-1042::DEBUG::2014-07-10 08:26:22,865::task::595::TaskManager.Task::(_updateState) Task=`e65b6d69-8cff-4ffd-bade-99b5d7c2e735`::moving from state preparing -> state finished >Thread-1042::DEBUG::2014-07-10 08:26:22,865::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-1042::DEBUG::2014-07-10 08:26:22,865::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1042::DEBUG::2014-07-10 08:26:22,865::task::990::TaskManager.Task::(_decref) Task=`e65b6d69-8cff-4ffd-bade-99b5d7c2e735`::ref 0 aborting False >Thread-1044::DEBUG::2014-07-10 08:26:22,910::task::595::TaskManager.Task::(_updateState) Task=`6983b355-fa2e-4869-888a-6fd36ef0982a`::moving from state init -> state preparing >Thread-1044::INFO::2014-07-10 08:26:22,911::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-1044::INFO::2014-07-10 08:26:22,911::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00072368', 'lastCheck': '4.1', 'valid': True}} >Thread-1044::DEBUG::2014-07-10 08:26:22,911::task::1185::TaskManager.Task::(prepare) Task=`6983b355-fa2e-4869-888a-6fd36ef0982a`::finished: {'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00072368', 'lastCheck': '4.1', 'valid': True}} >Thread-1044::DEBUG::2014-07-10 08:26:22,911::task::595::TaskManager.Task::(_updateState) Task=`6983b355-fa2e-4869-888a-6fd36ef0982a`::moving from state preparing -> state finished >Thread-1044::DEBUG::2014-07-10 08:26:22,912::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-1044::DEBUG::2014-07-10 08:26:22,912::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1044::DEBUG::2014-07-10 08:26:22,912::task::990::TaskManager.Task::(_decref) Task=`6983b355-fa2e-4869-888a-6fd36ef0982a`::ref 0 aborting False >Dummy-1639::DEBUG::2014-07-10 08:26:23,118::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.7261 s, 1.4 MB/s\n'; <rc> = 0 >Thread-1640::DEBUG::2014-07-10 08:26:23,230::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [64ccce3e] >Thread-1640::DEBUG::2014-07-10 08:26:23,231::task::595::TaskManager.Task::(_updateState) Task=`766445a2-66f8-41ad-8873-a20199008e18`::moving from state init -> state preparing >Thread-1640::INFO::2014-07-10 08:26:23,231::logUtils::44::dispatcher::(wrapper) Run and protect: activateStorageDomain(sdUUID='e01a3a36-d2ce-4153-bb57-d6e65b7ed08c', spUUID='411039e4-4af2-4192-9de0-67dc1ed83ba9', options=None) >Thread-1640::DEBUG::2014-07-10 08:26:23,232::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9`ReqID=`77cac491-2e15-4f3e-9d53-a64662edd937`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '1256' at 'activateStorageDomain' >Thread-1640::DEBUG::2014-07-10 08:26:23,232::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' for lock type 'exclusive' >Thread-1640::DEBUG::2014-07-10 08:26:23,232::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' is free. Now locking as 'exclusive' (1 active user) >Thread-1640::DEBUG::2014-07-10 08:26:23,233::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9`ReqID=`77cac491-2e15-4f3e-9d53-a64662edd937`::Granted request >Thread-1640::DEBUG::2014-07-10 08:26:23,233::task::827::TaskManager.Task::(resourceAcquired) Task=`766445a2-66f8-41ad-8873-a20199008e18`::_resourcesAcquired: Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9 (exclusive) >Thread-1640::DEBUG::2014-07-10 08:26:23,233::task::990::TaskManager.Task::(_decref) Task=`766445a2-66f8-41ad-8873-a20199008e18`::ref 1 aborting False >Thread-1640::DEBUG::2014-07-10 08:26:23,234::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.e01a3a36-d2ce-4153-bb57-d6e65b7ed08c`ReqID=`9cb44f69-e362-4f90-a178-451b1087ae56`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '1257' at 'activateStorageDomain' >Thread-1640::DEBUG::2014-07-10 08:26:23,234::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.e01a3a36-d2ce-4153-bb57-d6e65b7ed08c' for lock type 'exclusive' >Thread-1640::DEBUG::2014-07-10 08:26:23,234::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.e01a3a36-d2ce-4153-bb57-d6e65b7ed08c' is free. Now locking as 'exclusive' (1 active user) >Thread-1640::DEBUG::2014-07-10 08:26:23,234::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.e01a3a36-d2ce-4153-bb57-d6e65b7ed08c`ReqID=`9cb44f69-e362-4f90-a178-451b1087ae56`::Granted request >Thread-1640::DEBUG::2014-07-10 08:26:23,235::task::827::TaskManager.Task::(resourceAcquired) Task=`766445a2-66f8-41ad-8873-a20199008e18`::_resourcesAcquired: Storage.e01a3a36-d2ce-4153-bb57-d6e65b7ed08c (exclusive) >Thread-1640::DEBUG::2014-07-10 08:26:23,235::task::990::TaskManager.Task::(_decref) Task=`766445a2-66f8-41ad-8873-a20199008e18`::ref 1 aborting False >Thread-1640::INFO::2014-07-10 08:26:23,235::sp::1024::Storage.StoragePool::(activateSD) sdUUID=e01a3a36-d2ce-4153-bb57-d6e65b7ed08c spUUID=411039e4-4af2-4192-9de0-67dc1ed83ba9 >Thread-1640::INFO::2014-07-10 08:26:23,236::logUtils::47::dispatcher::(wrapper) Run and protect: activateStorageDomain, Return response: None >Thread-1640::DEBUG::2014-07-10 08:26:23,236::task::1185::TaskManager.Task::(prepare) Task=`766445a2-66f8-41ad-8873-a20199008e18`::finished: None >Thread-1640::DEBUG::2014-07-10 08:26:23,236::task::595::TaskManager.Task::(_updateState) Task=`766445a2-66f8-41ad-8873-a20199008e18`::moving from state preparing -> state finished >Thread-1640::DEBUG::2014-07-10 08:26:23,236::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9': < ResourceRef 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9', isValid: 'True' obj: 'None'>, 'Storage.e01a3a36-d2ce-4153-bb57-d6e65b7ed08c': < ResourceRef 'Storage.e01a3a36-d2ce-4153-bb57-d6e65b7ed08c', isValid: 'True' obj: 'None'>} >Thread-1640::DEBUG::2014-07-10 08:26:23,236::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1640::DEBUG::2014-07-10 08:26:23,237::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' >Thread-1640::DEBUG::2014-07-10 08:26:23,237::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' (0 active users) >Thread-1640::DEBUG::2014-07-10 08:26:23,237::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' is free, finding out if anyone is waiting for it. >Thread-1640::DEBUG::2014-07-10 08:26:23,237::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9', Clearing records. >Thread-1640::DEBUG::2014-07-10 08:26:23,237::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.e01a3a36-d2ce-4153-bb57-d6e65b7ed08c' >Thread-1640::DEBUG::2014-07-10 08:26:23,238::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.e01a3a36-d2ce-4153-bb57-d6e65b7ed08c' (0 active users) >Thread-1640::DEBUG::2014-07-10 08:26:23,238::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.e01a3a36-d2ce-4153-bb57-d6e65b7ed08c' is free, finding out if anyone is waiting for it. >Thread-1640::DEBUG::2014-07-10 08:26:23,238::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.e01a3a36-d2ce-4153-bb57-d6e65b7ed08c', Clearing records. >Thread-1640::DEBUG::2014-07-10 08:26:23,238::task::990::TaskManager.Task::(_decref) Task=`766445a2-66f8-41ad-8873-a20199008e18`::ref 0 aborting False >Thread-1044::DEBUG::2014-07-10 08:26:23,293::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [64ccce3e] >Thread-1044::DEBUG::2014-07-10 08:26:23,294::task::595::TaskManager.Task::(_updateState) Task=`eda9bfe1-449b-440c-9cc2-10588aae7df6`::moving from state init -> state preparing >Thread-1044::INFO::2014-07-10 08:26:23,294::logUtils::44::dispatcher::(wrapper) Run and protect: connectStoragePool(spUUID='411039e4-4af2-4192-9de0-67dc1ed83ba9', hostID=1, msdUUID='e01a3a36-d2ce-4153-bb57-d6e65b7ed08c', masterVersion=1, domainsMap=None, options=None) >Thread-1044::DEBUG::2014-07-10 08:26:23,295::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.HsmDomainMonitorLock`ReqID=`0a782f7e-6022-4b74-9c78-a1f59110fb57`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '1018' at 'connectStoragePool' >Thread-1044::DEBUG::2014-07-10 08:26:23,295::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.HsmDomainMonitorLock' for lock type 'exclusive' >Thread-1044::DEBUG::2014-07-10 08:26:23,295::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.HsmDomainMonitorLock' is free. Now locking as 'exclusive' (1 active user) >Thread-1044::DEBUG::2014-07-10 08:26:23,295::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.HsmDomainMonitorLock`ReqID=`0a782f7e-6022-4b74-9c78-a1f59110fb57`::Granted request >Thread-1044::DEBUG::2014-07-10 08:26:23,296::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9`ReqID=`0e911993-1041-458d-b8d5-5b39cd42c0d6`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '1056' at '_connectStoragePool' >Thread-1044::DEBUG::2014-07-10 08:26:23,296::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' for lock type 'shared' >Thread-1044::DEBUG::2014-07-10 08:26:23,297::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' is free. Now locking as 'shared' (1 active user) >Thread-1044::DEBUG::2014-07-10 08:26:23,297::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9`ReqID=`0e911993-1041-458d-b8d5-5b39cd42c0d6`::Granted request >Thread-1044::DEBUG::2014-07-10 08:26:23,297::lvm::497::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-1044::DEBUG::2014-07-10 08:26:23,298::lvm::499::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-1044::DEBUG::2014-07-10 08:26:23,298::lvm::508::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-1044::DEBUG::2014-07-10 08:26:23,298::lvm::510::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-1044::DEBUG::2014-07-10 08:26:23,298::lvm::528::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-1044::DEBUG::2014-07-10 08:26:23,299::lvm::530::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-1044::DEBUG::2014-07-10 08:26:23,299::misc::756::SamplingMethod::(__call__) Trying to enter sampling method (storage.sdc.refreshStorage) >Thread-1044::DEBUG::2014-07-10 08:26:23,299::misc::758::SamplingMethod::(__call__) Got in to sampling method >Thread-1044::DEBUG::2014-07-10 08:26:23,299::misc::756::SamplingMethod::(__call__) Trying to enter sampling method (storage.iscsi.rescan) >Thread-1044::DEBUG::2014-07-10 08:26:23,299::misc::758::SamplingMethod::(__call__) Got in to sampling method >Thread-1044::DEBUG::2014-07-10 08:26:23,300::iscsi::407::Storage.ISCSI::(rescan) Performing SCSI scan, this will take up to 30 seconds >Thread-1044::DEBUG::2014-07-10 08:26:23,300::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) '/usr/bin/sudo -n /sbin/iscsiadm -m session -R' (cwd None) >Thread-1044::DEBUG::2014-07-10 08:26:23,388::misc::766::SamplingMethod::(__call__) Returning last result >Thread-1044::DEBUG::2014-07-10 08:26:23,389::multipath::110::Storage.Misc.excCmd::(rescan) '/usr/bin/sudo -n /sbin/multipath -r' (cwd None) >Thread-1044::DEBUG::2014-07-10 08:26:23,627::multipath::110::Storage.Misc.excCmd::(rescan) SUCCESS: <err> = ''; <rc> = 0 >Thread-1044::DEBUG::2014-07-10 08:26:23,628::lvm::497::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-1044::DEBUG::2014-07-10 08:26:23,629::lvm::499::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-1044::DEBUG::2014-07-10 08:26:23,629::lvm::508::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-1044::DEBUG::2014-07-10 08:26:23,629::lvm::510::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-1044::DEBUG::2014-07-10 08:26:23,629::lvm::528::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-1044::DEBUG::2014-07-10 08:26:23,630::lvm::530::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-1044::DEBUG::2014-07-10 08:26:23,630::misc::766::SamplingMethod::(__call__) Returning last result >Thread-1044::DEBUG::2014-07-10 08:26:23,630::lvm::373::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-1044::DEBUG::2014-07-10 08:26:23,634::lvm::296::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/3600601601282300032826addbbdae311|/dev/mapper/360060160f4a030003840ec867ddee311|/dev/mapper/367cad74c2fcba00019e6afd20c781e67|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name e01a3a36-d2ce-4153-bb57-d6e65b7ed08c' (cwd None) >Thread-1044::DEBUG::2014-07-10 08:26:23,962::lvm::296::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-1044::DEBUG::2014-07-10 08:26:23,964::lvm::415::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-1044::DEBUG::2014-07-10 08:26:23,965::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with LvMetadataRW backend >Thread-1044::DEBUG::2014-07-10 08:26:23,965::blockSD::336::Storage.Misc.excCmd::(readlines) '/bin/dd iflag=direct skip=0 bs=2048 if=/dev/e01a3a36-d2ce-4153-bb57-d6e65b7ed08c/metadata count=1' (cwd None) >Thread-1044::DEBUG::2014-07-10 08:26:24,026::blockSD::336::Storage.Misc.excCmd::(readlines) SUCCESS: <err> = '1+0 records in\n1+0 records out\n2048 bytes (2.0 kB) copied, 0.000825234 s, 2.5 MB/s\n'; <rc> = 0 >Thread-1044::DEBUG::2014-07-10 08:26:24,027::misc::282::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '2048 bytes (2.0 kB) copied, 0.000825234 s, 2.5 MB/s'], size: 2048 >Thread-1044::DEBUG::2014-07-10 08:26:24,027::persistentDict::234::Storage.PersistentDict::(refresh) read lines (LvMetadataRW)=[] >Thread-1044::WARNING::2014-07-10 08:26:24,027::persistentDict::256::Storage.PersistentDict::(refresh) data has no embedded checksum - trust it as it is >Thread-1044::DEBUG::2014-07-10 08:26:24,027::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with VGTagMetadataRW backend >Thread-1044::DEBUG::2014-07-10 08:26:24,028::lvm::503::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-1044::DEBUG::2014-07-10 08:26:24,028::lvm::505::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-1044::DEBUG::2014-07-10 08:26:24,029::lvm::513::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-1044::DEBUG::2014-07-10 08:26:24,029::lvm::525::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-1044::DEBUG::2014-07-10 08:26:24,029::lvm::373::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-1044::DEBUG::2014-07-10 08:26:24,030::lvm::296::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/3600601601282300032826addbbdae311|/dev/mapper/360060160f4a030003840ec867ddee311|/dev/mapper/367cad74c2fcba00019e6afd20c781e67|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name e01a3a36-d2ce-4153-bb57-d6e65b7ed08c' (cwd None) >Thread-1044::DEBUG::2014-07-10 08:26:24,323::lvm::296::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-1044::DEBUG::2014-07-10 08:26:24,325::lvm::415::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-1044::DEBUG::2014-07-10 08:26:24,326::persistentDict::234::Storage.PersistentDict::(refresh) read lines (VGTagMetadataRW)=['LEASETIMESEC=60', 'CLASS=Data', 'VERSION=3', u'PV1=pv:360060160f4a030003840ec867ddee311,uuid:0eUwla-dsA3-g6ia-RU23-cual-0rt9-KzkxLj,pestart:0,pecount:397,mapoffset:8189', u'PV0=pv:3600601601282300032826addbbdae311,uuid:ZdReOp-Yf8A-beQm-ne4I-pN3J-rxgm-9Ew0S1,pestart:0,pecount:8189,mapoffset:0', 'LOGBLKSIZE=512', 'LEASERETRIES=3', 'IOOPTIMEOUTSEC=10', 'LOCKRENEWALINTERVALSEC=5', 'PHYBLKSIZE=512', 'SDUUID=e01a3a36-d2ce-4153-bb57-d6e65b7ed08c', 'DESCRIPTION=SD-REAL', 'LOCKPOLICY=', 'VGUUID=GJcVo5-Y0kU-CDub-zITS-zfoL-Z7hz-SeVeIe', 'TYPE=ISCSI', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=DC-REAL', 'ROLE=Master', 'POOL_UUID=411039e4-4af2-4192-9de0-67dc1ed83ba9', 'POOL_DOMAINS=e01a3a36-d2ce-4153-bb57-d6e65b7ed08c:Active', 'POOL_SPM_ID=1', '_SHA_CKSUM=fff80dfbf867146f89a6fadc25468cad12a2316f', 'POOL_SPM_LVER=3'] >Thread-1044::INFO::2014-07-10 08:26:24,329::sd::384::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace e01a3a36-d2ce-4153-bb57-d6e65b7ed08c_imageNS already registered >Thread-1044::INFO::2014-07-10 08:26:24,329::sd::392::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace e01a3a36-d2ce-4153-bb57-d6e65b7ed08c_volumeNS already registered >Thread-1044::INFO::2014-07-10 08:26:24,329::blockSD::452::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace e01a3a36-d2ce-4153-bb57-d6e65b7ed08c_lvmActivationNS already registered >Thread-1044::DEBUG::2014-07-10 08:26:24,330::sp::1375::Storage.StoragePool::(setMasterDomain) Master domain e01a3a36-d2ce-4153-bb57-d6e65b7ed08c verified, version 1 >Thread-1044::DEBUG::2014-07-10 08:26:24,330::misc::756::SamplingMethod::(__call__) Trying to enter sampling method (storage.sp.updateMonitoringThreads) >Thread-1044::DEBUG::2014-07-10 08:26:24,330::misc::758::SamplingMethod::(__call__) Got in to sampling method >Thread-1044::DEBUG::2014-07-10 08:26:24,330::misc::766::SamplingMethod::(__call__) Returning last result >Thread-1044::WARNING::2014-07-10 08:26:24,331::fileUtils::167::Storage.fileUtils::(createdir) Dir /rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9 already exists >Thread-1044::DEBUG::2014-07-10 08:26:24,331::lvm::373::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-1044::DEBUG::2014-07-10 08:26:24,332::lvm::296::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/3600601601282300032826addbbdae311|/dev/mapper/360060160f4a030003840ec867ddee311|/dev/mapper/367cad74c2fcba00019e6afd20c781e67|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name' (cwd None) >Thread-1044::DEBUG::2014-07-10 08:26:24,684::lvm::296::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-1044::DEBUG::2014-07-10 08:26:24,688::lvm::415::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-1044::WARNING::2014-07-10 08:26:24,695::fileUtils::167::Storage.fileUtils::(createdir) Dir /rhev/data-center/mnt/blockSD/e01a3a36-d2ce-4153-bb57-d6e65b7ed08c/images already exists >Thread-1044::WARNING::2014-07-10 08:26:24,695::fileUtils::167::Storage.fileUtils::(createdir) Dir /rhev/data-center/mnt/blockSD/e01a3a36-d2ce-4153-bb57-d6e65b7ed08c/dom_md already exists >Thread-1044::INFO::2014-07-10 08:26:24,695::sp::1113::Storage.StoragePool::(_linkStorageDomain) Linking /rhev/data-center/mnt/blockSD/e01a3a36-d2ce-4153-bb57-d6e65b7ed08c to /rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/e01a3a36-d2ce-4153-bb57-d6e65b7ed08c >Thread-1044::INFO::2014-07-10 08:26:24,697::sp::1113::Storage.StoragePool::(_linkStorageDomain) Linking /rhev/data-center/mnt/blockSD/e01a3a36-d2ce-4153-bb57-d6e65b7ed08c to /rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd >Thread-1044::DEBUG::2014-07-10 08:26:24,697::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' >Thread-1044::DEBUG::2014-07-10 08:26:24,698::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' (0 active users) >Thread-1044::DEBUG::2014-07-10 08:26:24,698::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' is free, finding out if anyone is waiting for it. >Thread-1044::DEBUG::2014-07-10 08:26:24,698::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9', Clearing records. >Thread-1044::DEBUG::2014-07-10 08:26:24,698::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.HsmDomainMonitorLock' >Thread-1044::DEBUG::2014-07-10 08:26:24,699::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.HsmDomainMonitorLock' (0 active users) >Thread-1044::DEBUG::2014-07-10 08:26:24,699::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.HsmDomainMonitorLock' is free, finding out if anyone is waiting for it. >Thread-1044::DEBUG::2014-07-10 08:26:24,699::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.HsmDomainMonitorLock', Clearing records. >Thread-1044::INFO::2014-07-10 08:26:24,699::logUtils::47::dispatcher::(wrapper) Run and protect: connectStoragePool, Return response: True >Thread-1044::DEBUG::2014-07-10 08:26:24,699::task::1185::TaskManager.Task::(prepare) Task=`eda9bfe1-449b-440c-9cc2-10588aae7df6`::finished: True >Thread-1044::DEBUG::2014-07-10 08:26:24,700::task::595::TaskManager.Task::(_updateState) Task=`eda9bfe1-449b-440c-9cc2-10588aae7df6`::moving from state preparing -> state finished >Thread-1044::DEBUG::2014-07-10 08:26:24,700::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-1044::DEBUG::2014-07-10 08:26:24,700::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1044::DEBUG::2014-07-10 08:26:24,700::task::990::TaskManager.Task::(_decref) Task=`eda9bfe1-449b-440c-9cc2-10588aae7df6`::ref 0 aborting False >Dummy-1639::DEBUG::2014-07-10 08:26:25,133::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-1639::DEBUG::2014-07-10 08:26:25,274::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0421643 s, 24.3 MB/s\n'; <rc> = 0 >Dummy-1639::DEBUG::2014-07-10 08:26:27,289::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-1639::DEBUG::2014-07-10 08:26:27,420::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0339663 s, 30.1 MB/s\n'; <rc> = 0 >Thread-1624::DEBUG::2014-07-10 08:26:28,850::lvm::296::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgck --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/3600601601282300032826addbbdae311|/dev/mapper/360060160f4a030003840ec867ddee311|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } " e01a3a36-d2ce-4153-bb57-d6e65b7ed08c' (cwd None) >Thread-1624::DEBUG::2014-07-10 08:26:29,134::lvm::296::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-1624::DEBUG::2014-07-10 08:26:29,135::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/e01a3a36-d2ce-4153-bb57-d6e65b7ed08c/metadata bs=4096 count=1' (cwd None) >Thread-1624::DEBUG::2014-07-10 08:26:29,222::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.0258061 s, 159 kB/s\n'; <rc> = 0 >Dummy-1639::DEBUG::2014-07-10 08:26:29,437::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-1639::DEBUG::2014-07-10 08:26:29,578::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0414771 s, 24.7 MB/s\n'; <rc> = 0 >Dummy-1639::DEBUG::2014-07-10 08:26:31,593::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-1639::DEBUG::2014-07-10 08:26:31,723::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0332187 s, 30.8 MB/s\n'; <rc> = 0 >Thread-1044::DEBUG::2014-07-10 08:26:33,288::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-1044::DEBUG::2014-07-10 08:26:33,289::task::595::TaskManager.Task::(_updateState) Task=`2d91db4b-e8d3-40a3-bacd-9060a445dbd8`::moving from state init -> state preparing >Thread-1044::INFO::2014-07-10 08:26:33,290::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='411039e4-4af2-4192-9de0-67dc1ed83ba9', options=None) >Thread-1044::INFO::2014-07-10 08:26:33,290::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 3}} >Thread-1044::DEBUG::2014-07-10 08:26:33,290::task::1185::TaskManager.Task::(prepare) Task=`2d91db4b-e8d3-40a3-bacd-9060a445dbd8`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 3}} >Thread-1044::DEBUG::2014-07-10 08:26:33,291::task::595::TaskManager.Task::(_updateState) Task=`2d91db4b-e8d3-40a3-bacd-9060a445dbd8`::moving from state preparing -> state finished >Thread-1044::DEBUG::2014-07-10 08:26:33,291::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-1044::DEBUG::2014-07-10 08:26:33,291::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1044::DEBUG::2014-07-10 08:26:33,291::task::990::TaskManager.Task::(_decref) Task=`2d91db4b-e8d3-40a3-bacd-9060a445dbd8`::ref 0 aborting False >Thread-1640::DEBUG::2014-07-10 08:26:33,296::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-1640::DEBUG::2014-07-10 08:26:33,296::task::595::TaskManager.Task::(_updateState) Task=`11398fec-027f-42e8-ae92-aab6d5619806`::moving from state init -> state preparing >Thread-1640::INFO::2014-07-10 08:26:33,297::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='411039e4-4af2-4192-9de0-67dc1ed83ba9', options=None) >Thread-1640::DEBUG::2014-07-10 08:26:33,297::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9`ReqID=`663679c2-5185-43cf-a73e-b9f03c9e46e0`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo' >Thread-1640::DEBUG::2014-07-10 08:26:33,297::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' for lock type 'shared' >Thread-1640::DEBUG::2014-07-10 08:26:33,298::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' is free. Now locking as 'shared' (1 active user) >Thread-1640::DEBUG::2014-07-10 08:26:33,298::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9`ReqID=`663679c2-5185-43cf-a73e-b9f03c9e46e0`::Granted request >Thread-1640::DEBUG::2014-07-10 08:26:33,298::task::827::TaskManager.Task::(resourceAcquired) Task=`11398fec-027f-42e8-ae92-aab6d5619806`::_resourcesAcquired: Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9 (shared) >Thread-1640::DEBUG::2014-07-10 08:26:33,299::task::990::TaskManager.Task::(_decref) Task=`11398fec-027f-42e8-ae92-aab6d5619806`::ref 1 aborting False >Thread-1640::INFO::2014-07-10 08:26:33,300::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DC-REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 3, 'domains': 'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c:Active', 'master_uuid': 'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c': {'status': 'Active', 'diskfree': '1137495244800', 'isoprefix': '', 'alerts': [], 'disktotal': '1152393412608', 'version': 3}}} >Thread-1640::DEBUG::2014-07-10 08:26:33,300::task::1185::TaskManager.Task::(prepare) Task=`11398fec-027f-42e8-ae92-aab6d5619806`::finished: {'info': {'name': 'DC-REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 3, 'domains': 'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c:Active', 'master_uuid': 'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c': {'status': 'Active', 'diskfree': '1137495244800', 'isoprefix': '', 'alerts': [], 'disktotal': '1152393412608', 'version': 3}}} >Thread-1640::DEBUG::2014-07-10 08:26:33,300::task::595::TaskManager.Task::(_updateState) Task=`11398fec-027f-42e8-ae92-aab6d5619806`::moving from state preparing -> state finished >Thread-1640::DEBUG::2014-07-10 08:26:33,300::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9': < ResourceRef 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9', isValid: 'True' obj: 'None'>} >Thread-1640::DEBUG::2014-07-10 08:26:33,300::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1640::DEBUG::2014-07-10 08:26:33,301::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' >Thread-1640::DEBUG::2014-07-10 08:26:33,301::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' (0 active users) >Thread-1640::DEBUG::2014-07-10 08:26:33,301::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' is free, finding out if anyone is waiting for it. >Thread-1640::DEBUG::2014-07-10 08:26:33,301::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9', Clearing records. >Thread-1640::DEBUG::2014-07-10 08:26:33,302::task::990::TaskManager.Task::(_decref) Task=`11398fec-027f-42e8-ae92-aab6d5619806`::ref 0 aborting False >Dummy-1639::DEBUG::2014-07-10 08:26:33,739::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-1639::DEBUG::2014-07-10 08:26:33,872::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0361209 s, 28.3 MB/s\n'; <rc> = 0 >Dummy-1639::DEBUG::2014-07-10 08:26:35,888::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-1639::DEBUG::2014-07-10 08:26:36,023::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.038937 s, 26.3 MB/s\n'; <rc> = 0 >Thread-1640::DEBUG::2014-07-10 08:26:37,483::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [79d0dfee] >Thread-1640::DEBUG::2014-07-10 08:26:37,484::task::595::TaskManager.Task::(_updateState) Task=`837cf99a-a568-4d24-93d7-1aed254e7a65`::moving from state init -> state preparing >Thread-1640::INFO::2014-07-10 08:26:37,484::logUtils::44::dispatcher::(wrapper) Run and protect: deleteImage(sdUUID='e01a3a36-d2ce-4153-bb57-d6e65b7ed08c', spUUID='411039e4-4af2-4192-9de0-67dc1ed83ba9', imgUUID='613d30f8-bee3-4d6f-8df0-e73ce775bf3b', postZero='false', force='false') >Thread-1640::DEBUG::2014-07-10 08:26:37,485::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.613d30f8-bee3-4d6f-8df0-e73ce775bf3b`ReqID=`c0f72314-40f1-41cf-86d9-e8c729e200c7`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '1507' at 'deleteImage' >Thread-1640::DEBUG::2014-07-10 08:26:37,485::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.613d30f8-bee3-4d6f-8df0-e73ce775bf3b' for lock type 'exclusive' >Thread-1640::DEBUG::2014-07-10 08:26:37,486::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.613d30f8-bee3-4d6f-8df0-e73ce775bf3b' is free. Now locking as 'exclusive' (1 active user) >Thread-1640::DEBUG::2014-07-10 08:26:37,486::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.613d30f8-bee3-4d6f-8df0-e73ce775bf3b`ReqID=`c0f72314-40f1-41cf-86d9-e8c729e200c7`::Granted request >Thread-1640::DEBUG::2014-07-10 08:26:37,486::task::827::TaskManager.Task::(resourceAcquired) Task=`837cf99a-a568-4d24-93d7-1aed254e7a65`::_resourcesAcquired: Storage.613d30f8-bee3-4d6f-8df0-e73ce775bf3b (exclusive) >Thread-1640::DEBUG::2014-07-10 08:26:37,486::task::990::TaskManager.Task::(_decref) Task=`837cf99a-a568-4d24-93d7-1aed254e7a65`::ref 1 aborting False >Thread-1640::DEBUG::2014-07-10 08:26:37,487::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.e01a3a36-d2ce-4153-bb57-d6e65b7ed08c`ReqID=`13859690-fc0a-4337-a0cb-b60a1f532380`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '1508' at 'deleteImage' >Thread-1640::DEBUG::2014-07-10 08:26:37,487::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.e01a3a36-d2ce-4153-bb57-d6e65b7ed08c' for lock type 'shared' >Thread-1640::DEBUG::2014-07-10 08:26:37,487::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.e01a3a36-d2ce-4153-bb57-d6e65b7ed08c' is free. Now locking as 'shared' (1 active user) >Thread-1640::DEBUG::2014-07-10 08:26:37,487::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.e01a3a36-d2ce-4153-bb57-d6e65b7ed08c`ReqID=`13859690-fc0a-4337-a0cb-b60a1f532380`::Granted request >Thread-1640::DEBUG::2014-07-10 08:26:37,488::task::827::TaskManager.Task::(resourceAcquired) Task=`837cf99a-a568-4d24-93d7-1aed254e7a65`::_resourcesAcquired: Storage.e01a3a36-d2ce-4153-bb57-d6e65b7ed08c (shared) >Thread-1640::DEBUG::2014-07-10 08:26:37,488::task::990::TaskManager.Task::(_decref) Task=`837cf99a-a568-4d24-93d7-1aed254e7a65`::ref 1 aborting False >Thread-1640::DEBUG::2014-07-10 08:26:37,488::lvm::427::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' got the operation mutex >Thread-1640::DEBUG::2014-07-10 08:26:37,489::lvm::296::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm lvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/3600601601282300032826addbbdae311|/dev/mapper/360060160f4a030003840ec867ddee311|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,vg_name,attr,size,seg_start_pe,devices,tags e01a3a36-d2ce-4153-bb57-d6e65b7ed08c' (cwd None) >Thread-1640::DEBUG::2014-07-10 08:26:37,784::lvm::296::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-1640::DEBUG::2014-07-10 08:26:37,793::lvm::462::Storage.LVM::(_reloadlvs) lvs reloaded >Thread-1640::DEBUG::2014-07-10 08:26:37,793::lvm::462::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' released the operation mutex >Thread-1640::DEBUG::2014-07-10 08:26:37,794::lvm::296::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm lvchange --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/3600601601282300032826addbbdae311|/dev/mapper/360060160f4a030003840ec867ddee311|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } " --autobackup n -a y --deltag IU_613d30f8-bee3-4d6f-8df0-e73ce775bf3b --addtag IU__remove_me_613d30f8-bee3-4d6f-8df0-e73ce775bf3b e01a3a36-d2ce-4153-bb57-d6e65b7ed08c/d6c69b79-3d10-4656-a279-fe0a4c879393' (cwd None) >Dummy-1639::DEBUG::2014-07-10 08:26:38,040::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Thread-1640::DEBUG::2014-07-10 08:26:38,104::lvm::296::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ' WARNING: This metadata update is NOT backed up\n WARNING: This metadata update is NOT backed up\n'; <rc> = 0 >Thread-1640::DEBUG::2014-07-10 08:26:38,105::lvm::513::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-1640::DEBUG::2014-07-10 08:26:38,106::lvm::525::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-1640::WARNING::2014-07-10 08:26:38,110::lvm::1095::Storage.LVM::(removeLVs) Removing active volume e01a3a36-d2ce-4153-bb57-d6e65b7ed08c/d6c69b79-3d10-4656-a279-fe0a4c879393 >Thread-1640::DEBUG::2014-07-10 08:26:38,118::lvm::296::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm lvremove --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/3600601601282300032826addbbdae311|/dev/mapper/360060160f4a030003840ec867ddee311|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } " -f --autobackup n e01a3a36-d2ce-4153-bb57-d6e65b7ed08c/d6c69b79-3d10-4656-a279-fe0a4c879393' (cwd None) >Thread-1044::DEBUG::2014-07-10 08:26:38,220::task::595::TaskManager.Task::(_updateState) Task=`31442f7e-4112-400f-943b-c54e4c338da5`::moving from state init -> state preparing >Thread-1044::INFO::2014-07-10 08:26:38,223::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-1044::INFO::2014-07-10 08:26:38,226::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0258061', 'lastCheck': '9.0', 'valid': True}} >Thread-1044::DEBUG::2014-07-10 08:26:38,228::task::1185::TaskManager.Task::(prepare) Task=`31442f7e-4112-400f-943b-c54e4c338da5`::finished: {'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0258061', 'lastCheck': '9.0', 'valid': True}} >Thread-1044::DEBUG::2014-07-10 08:26:38,230::task::595::TaskManager.Task::(_updateState) Task=`31442f7e-4112-400f-943b-c54e4c338da5`::moving from state preparing -> state finished >Thread-1044::DEBUG::2014-07-10 08:26:38,232::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-1044::DEBUG::2014-07-10 08:26:38,233::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1044::DEBUG::2014-07-10 08:26:38,235::task::990::TaskManager.Task::(_decref) Task=`31442f7e-4112-400f-943b-c54e4c338da5`::ref 0 aborting False >Dummy-1639::DEBUG::2014-07-10 08:26:38,466::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.327171 s, 3.1 MB/s\n'; <rc> = 0 >Thread-1640::DEBUG::2014-07-10 08:26:38,483::lvm::296::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ' WARNING: This metadata update is NOT backed up\n'; <rc> = 0 >Thread-1640::DEBUG::2014-07-10 08:26:38,483::lvm::503::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-1640::DEBUG::2014-07-10 08:26:38,484::lvm::505::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-1640::DEBUG::2014-07-10 08:26:38,484::blockSD::953::Storage.StorageDomain::(rmDCVolLinks) removed: ['/rhev/data-center/mnt/blockSD/e01a3a36-d2ce-4153-bb57-d6e65b7ed08c/images/613d30f8-bee3-4d6f-8df0-e73ce775bf3b/d6c69b79-3d10-4656-a279-fe0a4c879393'] >Thread-1640::DEBUG::2014-07-10 08:26:38,484::blockSD::964::Storage.StorageDomain::(rmDCImgDir) removed image dir: /rhev/data-center/mnt/blockSD/e01a3a36-d2ce-4153-bb57-d6e65b7ed08c/images/613d30f8-bee3-4d6f-8df0-e73ce775bf3b >Thread-1640::DEBUG::2014-07-10 08:26:38,496::task::752::TaskManager.Task::(_save) Task=`837cf99a-a568-4d24-93d7-1aed254e7a65`::_save: orig /rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/master/tasks/837cf99a-a568-4d24-93d7-1aed254e7a65 temp /rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/master/tasks/837cf99a-a568-4d24-93d7-1aed254e7a65.temp >Thread-1640::DEBUG::2014-07-10 08:26:38,509::taskManager::68::TaskManager::(scheduleJob) scheduled job deleteImage_613d30f8-bee3-4d6f-8df0-e73ce775bf3b for task 837cf99a-a568-4d24-93d7-1aed254e7a65 >Thread-1640::INFO::2014-07-10 08:26:38,509::logUtils::47::dispatcher::(wrapper) Run and protect: deleteImage, Return response: None >Thread-1640::DEBUG::2014-07-10 08:26:38,509::task::1180::TaskManager.Task::(prepare) Task=`837cf99a-a568-4d24-93d7-1aed254e7a65`::Prepare: 1 jobs exist, move to acquiring >Thread-1640::DEBUG::2014-07-10 08:26:38,509::task::595::TaskManager.Task::(_updateState) Task=`837cf99a-a568-4d24-93d7-1aed254e7a65`::moving from state preparing -> state acquiring >Thread-1640::DEBUG::2014-07-10 08:26:38,510::task::752::TaskManager.Task::(_save) Task=`837cf99a-a568-4d24-93d7-1aed254e7a65`::_save: orig /rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/master/tasks/837cf99a-a568-4d24-93d7-1aed254e7a65 temp /rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/master/tasks/837cf99a-a568-4d24-93d7-1aed254e7a65.temp >Thread-1640::DEBUG::2014-07-10 08:26:38,517::task::595::TaskManager.Task::(_updateState) Task=`837cf99a-a568-4d24-93d7-1aed254e7a65`::moving from state acquiring -> state queued >Thread-1640::DEBUG::2014-07-10 08:26:38,517::task::752::TaskManager.Task::(_save) Task=`837cf99a-a568-4d24-93d7-1aed254e7a65`::_save: orig /rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/master/tasks/837cf99a-a568-4d24-93d7-1aed254e7a65 temp /rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/master/tasks/837cf99a-a568-4d24-93d7-1aed254e7a65.temp >Thread-1640::DEBUG::2014-07-10 08:26:38,524::taskManager::50::TaskManager::(_queueTask) queuing task: 837cf99a-a568-4d24-93d7-1aed254e7a65 >Thread-1640::DEBUG::2014-07-10 08:26:38,524::taskManager::56::TaskManager::(_queueTask) task queued: 837cf99a-a568-4d24-93d7-1aed254e7a65 >5183fdde-15bf-4550-a46c-80e242a4d5ee::DEBUG::2014-07-10 08:26:38,526::threadPool::57::Misc.ThreadPool::(setRunningTask) Number of running tasks: 1 >Thread-1640::DEBUG::2014-07-10 08:26:38,527::task::1182::TaskManager.Task::(prepare) Task=`837cf99a-a568-4d24-93d7-1aed254e7a65`::returning >837cf99a-a568-4d24-93d7-1aed254e7a65::DEBUG::2014-07-10 08:26:38,529::threadPool::200::Misc.ThreadPool.WorkerThread::(_processNextTask) Task: 837cf99a-a568-4d24-93d7-1aed254e7a65 running: <bound method Task.commit of <storage.task.Task instance at 0x7f72f811ebd8>> with: None >Thread-1640::DEBUG::2014-07-10 08:26:38,531::task::990::TaskManager.Task::(_decref) Task=`837cf99a-a568-4d24-93d7-1aed254e7a65`::ref 0 aborting False >837cf99a-a568-4d24-93d7-1aed254e7a65::DEBUG::2014-07-10 08:26:38,533::task::1194::TaskManager.Task::(commit) Task=`837cf99a-a568-4d24-93d7-1aed254e7a65`::committing task: 837cf99a-a568-4d24-93d7-1aed254e7a65 >837cf99a-a568-4d24-93d7-1aed254e7a65::DEBUG::2014-07-10 08:26:38,536::task::595::TaskManager.Task::(_updateState) Task=`837cf99a-a568-4d24-93d7-1aed254e7a65`::moving from state queued -> state running >837cf99a-a568-4d24-93d7-1aed254e7a65::DEBUG::2014-07-10 08:26:38,538::task::752::TaskManager.Task::(_save) Task=`837cf99a-a568-4d24-93d7-1aed254e7a65`::_save: orig /rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/master/tasks/837cf99a-a568-4d24-93d7-1aed254e7a65 temp /rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/master/tasks/837cf99a-a568-4d24-93d7-1aed254e7a65.temp >837cf99a-a568-4d24-93d7-1aed254e7a65::DEBUG::2014-07-10 08:26:38,545::task::905::TaskManager.Task::(_runJobs) Task=`837cf99a-a568-4d24-93d7-1aed254e7a65`::Task.run: running job 0: deleteImage_613d30f8-bee3-4d6f-8df0-e73ce775bf3b: <function <lambda> at 0x7f7271343500> (args: () kwargs: {}) >837cf99a-a568-4d24-93d7-1aed254e7a65::DEBUG::2014-07-10 08:26:38,546::task::331::TaskManager.Task::(run) Task=`837cf99a-a568-4d24-93d7-1aed254e7a65`::Job.run: running deleteImage_613d30f8-bee3-4d6f-8df0-e73ce775bf3b: <function <lambda> at 0x7f7271343500> (args: () kwargs: {}) callback None >837cf99a-a568-4d24-93d7-1aed254e7a65::DEBUG::2014-07-10 08:26:38,546::task::595::TaskManager.Task::(_updateState) Task=`837cf99a-a568-4d24-93d7-1aed254e7a65`::moving from state running -> state finished >837cf99a-a568-4d24-93d7-1aed254e7a65::DEBUG::2014-07-10 08:26:38,546::task::752::TaskManager.Task::(_save) Task=`837cf99a-a568-4d24-93d7-1aed254e7a65`::_save: orig /rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/master/tasks/837cf99a-a568-4d24-93d7-1aed254e7a65 temp /rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/master/tasks/837cf99a-a568-4d24-93d7-1aed254e7a65.temp >837cf99a-a568-4d24-93d7-1aed254e7a65::DEBUG::2014-07-10 08:26:38,554::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.613d30f8-bee3-4d6f-8df0-e73ce775bf3b': < ResourceRef 'Storage.613d30f8-bee3-4d6f-8df0-e73ce775bf3b', isValid: 'True' obj: 'None'>, 'Storage.e01a3a36-d2ce-4153-bb57-d6e65b7ed08c': < ResourceRef 'Storage.e01a3a36-d2ce-4153-bb57-d6e65b7ed08c', isValid: 'True' obj: 'None'>} >837cf99a-a568-4d24-93d7-1aed254e7a65::DEBUG::2014-07-10 08:26:38,554::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >837cf99a-a568-4d24-93d7-1aed254e7a65::DEBUG::2014-07-10 08:26:38,554::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.613d30f8-bee3-4d6f-8df0-e73ce775bf3b' >837cf99a-a568-4d24-93d7-1aed254e7a65::DEBUG::2014-07-10 08:26:38,555::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.613d30f8-bee3-4d6f-8df0-e73ce775bf3b' (0 active users) >837cf99a-a568-4d24-93d7-1aed254e7a65::DEBUG::2014-07-10 08:26:38,555::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.613d30f8-bee3-4d6f-8df0-e73ce775bf3b' is free, finding out if anyone is waiting for it. >837cf99a-a568-4d24-93d7-1aed254e7a65::DEBUG::2014-07-10 08:26:38,555::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.613d30f8-bee3-4d6f-8df0-e73ce775bf3b', Clearing records. >837cf99a-a568-4d24-93d7-1aed254e7a65::DEBUG::2014-07-10 08:26:38,556::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.e01a3a36-d2ce-4153-bb57-d6e65b7ed08c' >837cf99a-a568-4d24-93d7-1aed254e7a65::DEBUG::2014-07-10 08:26:38,556::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.e01a3a36-d2ce-4153-bb57-d6e65b7ed08c' (0 active users) >837cf99a-a568-4d24-93d7-1aed254e7a65::DEBUG::2014-07-10 08:26:38,556::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.e01a3a36-d2ce-4153-bb57-d6e65b7ed08c' is free, finding out if anyone is waiting for it. >837cf99a-a568-4d24-93d7-1aed254e7a65::DEBUG::2014-07-10 08:26:38,556::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.e01a3a36-d2ce-4153-bb57-d6e65b7ed08c', Clearing records. >837cf99a-a568-4d24-93d7-1aed254e7a65::DEBUG::2014-07-10 08:26:38,556::task::913::TaskManager.Task::(_runJobs) Task=`837cf99a-a568-4d24-93d7-1aed254e7a65`::Task.run: exit - success: result True >837cf99a-a568-4d24-93d7-1aed254e7a65::DEBUG::2014-07-10 08:26:38,557::task::990::TaskManager.Task::(_decref) Task=`837cf99a-a568-4d24-93d7-1aed254e7a65`::ref 0 aborting False >837cf99a-a568-4d24-93d7-1aed254e7a65::DEBUG::2014-07-10 08:26:38,557::threadPool::57::Misc.ThreadPool::(setRunningTask) Number of running tasks: 0 >Thread-1624::DEBUG::2014-07-10 08:26:39,253::lvm::373::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-1624::DEBUG::2014-07-10 08:26:39,254::lvm::296::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/3600601601282300032826addbbdae311|/dev/mapper/360060160f4a030003840ec867ddee311|/dev/mapper/367cad74c2fcba00019e6afd20c781e67|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name e01a3a36-d2ce-4153-bb57-d6e65b7ed08c' (cwd None) >Thread-1624::DEBUG::2014-07-10 08:26:39,546::lvm::296::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-1624::DEBUG::2014-07-10 08:26:39,549::lvm::415::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-1624::DEBUG::2014-07-10 08:26:39,549::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/e01a3a36-d2ce-4153-bb57-d6e65b7ed08c/metadata bs=4096 count=1' (cwd None) >Thread-1624::DEBUG::2014-07-10 08:26:39,613::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00115702 s, 3.5 MB/s\n'; <rc> = 0 >Dummy-1639::DEBUG::2014-07-10 08:26:40,481::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-1639::DEBUG::2014-07-10 08:26:40,617::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0390915 s, 26.2 MB/s\n'; <rc> = 0 >Dummy-1639::DEBUG::2014-07-10 08:26:42,632::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-1639::DEBUG::2014-07-10 08:26:42,767::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0369774 s, 27.7 MB/s\n'; <rc> = 0 >Thread-1044::DEBUG::2014-07-10 08:26:43,355::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-1044::DEBUG::2014-07-10 08:26:43,356::task::595::TaskManager.Task::(_updateState) Task=`c53b63c9-28be-48fc-bc8a-6f4f74d0ec1c`::moving from state init -> state preparing >Thread-1044::INFO::2014-07-10 08:26:43,356::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='411039e4-4af2-4192-9de0-67dc1ed83ba9', options=None) >Thread-1044::INFO::2014-07-10 08:26:43,357::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 3}} >Thread-1044::DEBUG::2014-07-10 08:26:43,357::task::1185::TaskManager.Task::(prepare) Task=`c53b63c9-28be-48fc-bc8a-6f4f74d0ec1c`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 3}} >Thread-1044::DEBUG::2014-07-10 08:26:43,357::task::595::TaskManager.Task::(_updateState) Task=`c53b63c9-28be-48fc-bc8a-6f4f74d0ec1c`::moving from state preparing -> state finished >Thread-1044::DEBUG::2014-07-10 08:26:43,358::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-1044::DEBUG::2014-07-10 08:26:43,358::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1044::DEBUG::2014-07-10 08:26:43,358::task::990::TaskManager.Task::(_decref) Task=`c53b63c9-28be-48fc-bc8a-6f4f74d0ec1c`::ref 0 aborting False >Thread-1640::DEBUG::2014-07-10 08:26:43,363::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-1640::DEBUG::2014-07-10 08:26:43,364::task::595::TaskManager.Task::(_updateState) Task=`edaebd48-c1dc-427a-a26d-f34ca9e135a6`::moving from state init -> state preparing >Thread-1640::INFO::2014-07-10 08:26:43,364::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='411039e4-4af2-4192-9de0-67dc1ed83ba9', options=None) >Thread-1640::DEBUG::2014-07-10 08:26:43,365::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9`ReqID=`b88ce03c-ee01-40f8-b83c-ba7d8cd5f9bc`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo' >Thread-1640::DEBUG::2014-07-10 08:26:43,365::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' for lock type 'shared' >Thread-1640::DEBUG::2014-07-10 08:26:43,366::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' is free. Now locking as 'shared' (1 active user) >Thread-1640::DEBUG::2014-07-10 08:26:43,366::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9`ReqID=`b88ce03c-ee01-40f8-b83c-ba7d8cd5f9bc`::Granted request >Thread-1640::DEBUG::2014-07-10 08:26:43,367::task::827::TaskManager.Task::(resourceAcquired) Task=`edaebd48-c1dc-427a-a26d-f34ca9e135a6`::_resourcesAcquired: Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9 (shared) >Thread-1640::DEBUG::2014-07-10 08:26:43,367::task::990::TaskManager.Task::(_decref) Task=`edaebd48-c1dc-427a-a26d-f34ca9e135a6`::ref 1 aborting False >Thread-1640::INFO::2014-07-10 08:26:43,368::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DC-REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 3, 'domains': 'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c:Active', 'master_uuid': 'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c': {'status': 'Active', 'diskfree': '1148232663040', 'isoprefix': '', 'alerts': [], 'disktotal': '1152393412608', 'version': 3}}} >Thread-1640::DEBUG::2014-07-10 08:26:43,368::task::1185::TaskManager.Task::(prepare) Task=`edaebd48-c1dc-427a-a26d-f34ca9e135a6`::finished: {'info': {'name': 'DC-REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 3, 'domains': 'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c:Active', 'master_uuid': 'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c': {'status': 'Active', 'diskfree': '1148232663040', 'isoprefix': '', 'alerts': [], 'disktotal': '1152393412608', 'version': 3}}} >Thread-1640::DEBUG::2014-07-10 08:26:43,368::task::595::TaskManager.Task::(_updateState) Task=`edaebd48-c1dc-427a-a26d-f34ca9e135a6`::moving from state preparing -> state finished >Thread-1640::DEBUG::2014-07-10 08:26:43,369::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9': < ResourceRef 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9', isValid: 'True' obj: 'None'>} >Thread-1640::DEBUG::2014-07-10 08:26:43,369::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1640::DEBUG::2014-07-10 08:26:43,369::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' >Thread-1640::DEBUG::2014-07-10 08:26:43,369::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' (0 active users) >Thread-1640::DEBUG::2014-07-10 08:26:43,369::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' is free, finding out if anyone is waiting for it. >Thread-1640::DEBUG::2014-07-10 08:26:43,370::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9', Clearing records. >Thread-1640::DEBUG::2014-07-10 08:26:43,370::task::990::TaskManager.Task::(_decref) Task=`edaebd48-c1dc-427a-a26d-f34ca9e135a6`::ref 0 aborting False >Thread-1044::DEBUG::2014-07-10 08:26:44,038::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-1044::DEBUG::2014-07-10 08:26:44,039::task::595::TaskManager.Task::(_updateState) Task=`c7e0698d-4099-48ca-8ccb-835fdf15682f`::moving from state init -> state preparing >Thread-1044::INFO::2014-07-10 08:26:44,039::logUtils::44::dispatcher::(wrapper) Run and protect: getAllTasksStatuses(spUUID=None, options=None) >Thread-1044::DEBUG::2014-07-10 08:26:44,039::taskManager::102::TaskManager::(getAllTasksStatuses) Entry. >Thread-1044::DEBUG::2014-07-10 08:26:44,039::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 837cf99a-a568-4d24-93d7-1aed254e7a65 >Thread-1044::DEBUG::2014-07-10 08:26:44,039::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': '1 jobs completed successfully', 'taskState': 'finished', 'taskResult': 'success', 'taskID': '837cf99a-a568-4d24-93d7-1aed254e7a65'} >Thread-1044::DEBUG::2014-07-10 08:26:44,040::taskManager::113::TaskManager::(getAllTasksStatuses) Return: {'837cf99a-a568-4d24-93d7-1aed254e7a65': {'code': 0, 'message': '1 jobs completed successfully', 'taskState': 'finished', 'taskResult': 'success', 'taskID': '837cf99a-a568-4d24-93d7-1aed254e7a65'}} >Thread-1044::INFO::2014-07-10 08:26:44,040::logUtils::47::dispatcher::(wrapper) Run and protect: getAllTasksStatuses, Return response: {'allTasksStatus': {'837cf99a-a568-4d24-93d7-1aed254e7a65': {'code': 0, 'message': '1 jobs completed successfully', 'taskState': 'finished', 'taskResult': 'success', 'taskID': '837cf99a-a568-4d24-93d7-1aed254e7a65'}}} >Thread-1044::DEBUG::2014-07-10 08:26:44,040::task::1185::TaskManager.Task::(prepare) Task=`c7e0698d-4099-48ca-8ccb-835fdf15682f`::finished: {'allTasksStatus': {'837cf99a-a568-4d24-93d7-1aed254e7a65': {'code': 0, 'message': '1 jobs completed successfully', 'taskState': 'finished', 'taskResult': 'success', 'taskID': '837cf99a-a568-4d24-93d7-1aed254e7a65'}}} >Thread-1044::DEBUG::2014-07-10 08:26:44,040::task::595::TaskManager.Task::(_updateState) Task=`c7e0698d-4099-48ca-8ccb-835fdf15682f`::moving from state preparing -> state finished >Thread-1044::DEBUG::2014-07-10 08:26:44,040::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-1044::DEBUG::2014-07-10 08:26:44,041::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1044::DEBUG::2014-07-10 08:26:44,041::task::990::TaskManager.Task::(_decref) Task=`c7e0698d-4099-48ca-8ccb-835fdf15682f`::ref 0 aborting False >Thread-1044::DEBUG::2014-07-10 08:26:44,100::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-1044::DEBUG::2014-07-10 08:26:44,100::task::595::TaskManager.Task::(_updateState) Task=`a3ff74e7-4f37-487a-a7da-084a7782308c`::moving from state init -> state preparing >Thread-1044::INFO::2014-07-10 08:26:44,101::logUtils::44::dispatcher::(wrapper) Run and protect: clearTask(taskID='837cf99a-a568-4d24-93d7-1aed254e7a65', spUUID=None, options=None) >Thread-1044::DEBUG::2014-07-10 08:26:44,101::taskManager::161::TaskManager::(clearTask) Entry. taskID: 837cf99a-a568-4d24-93d7-1aed254e7a65 >Thread-1044::DEBUG::2014-07-10 08:26:44,102::taskManager::166::TaskManager::(clearTask) Return. >Thread-1044::INFO::2014-07-10 08:26:44,103::logUtils::47::dispatcher::(wrapper) Run and protect: clearTask, Return response: None >Thread-1044::DEBUG::2014-07-10 08:26:44,103::task::1185::TaskManager.Task::(prepare) Task=`a3ff74e7-4f37-487a-a7da-084a7782308c`::finished: None >Thread-1044::DEBUG::2014-07-10 08:26:44,103::task::595::TaskManager.Task::(_updateState) Task=`a3ff74e7-4f37-487a-a7da-084a7782308c`::moving from state preparing -> state finished >Thread-1044::DEBUG::2014-07-10 08:26:44,103::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-1044::DEBUG::2014-07-10 08:26:44,103::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1044::DEBUG::2014-07-10 08:26:44,104::task::990::TaskManager.Task::(_decref) Task=`a3ff74e7-4f37-487a-a7da-084a7782308c`::ref 0 aborting False >Dummy-1639::DEBUG::2014-07-10 08:26:44,782::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-1639::DEBUG::2014-07-10 08:26:44,917::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.039231 s, 26.1 MB/s\n'; <rc> = 0 >Dummy-1639::DEBUG::2014-07-10 08:26:46,932::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-1639::DEBUG::2014-07-10 08:26:47,067::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0370142 s, 27.7 MB/s\n'; <rc> = 0 >Dummy-1639::DEBUG::2014-07-10 08:26:49,083::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-1639::DEBUG::2014-07-10 08:26:49,218::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0366556 s, 27.9 MB/s\n'; <rc> = 0 >Thread-1624::DEBUG::2014-07-10 08:26:49,640::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/e01a3a36-d2ce-4153-bb57-d6e65b7ed08c/metadata bs=4096 count=1' (cwd None) >Thread-1624::DEBUG::2014-07-10 08:26:49,704::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000796514 s, 5.1 MB/s\n'; <rc> = 0 >Dummy-1639::DEBUG::2014-07-10 08:26:51,233::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-1639::DEBUG::2014-07-10 08:26:51,376::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0419976 s, 24.4 MB/s\n'; <rc> = 0 >Dummy-1639::DEBUG::2014-07-10 08:26:53,386::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Thread-1044::DEBUG::2014-07-10 08:26:53,445::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-1044::DEBUG::2014-07-10 08:26:53,447::task::595::TaskManager.Task::(_updateState) Task=`2538c4d1-bc6c-412c-865a-ec017428832d`::moving from state init -> state preparing >Thread-1044::INFO::2014-07-10 08:26:53,447::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='411039e4-4af2-4192-9de0-67dc1ed83ba9', options=None) >Thread-1044::INFO::2014-07-10 08:26:53,448::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 3}} >Thread-1044::DEBUG::2014-07-10 08:26:53,448::task::1185::TaskManager.Task::(prepare) Task=`2538c4d1-bc6c-412c-865a-ec017428832d`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 3}} >Thread-1044::DEBUG::2014-07-10 08:26:53,448::task::595::TaskManager.Task::(_updateState) Task=`2538c4d1-bc6c-412c-865a-ec017428832d`::moving from state preparing -> state finished >Thread-1044::DEBUG::2014-07-10 08:26:53,449::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-1044::DEBUG::2014-07-10 08:26:53,449::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1044::DEBUG::2014-07-10 08:26:53,449::task::990::TaskManager.Task::(_decref) Task=`2538c4d1-bc6c-412c-865a-ec017428832d`::ref 0 aborting False >Thread-1640::DEBUG::2014-07-10 08:26:53,454::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-1640::DEBUG::2014-07-10 08:26:53,455::task::595::TaskManager.Task::(_updateState) Task=`f1b070c4-a645-4abd-b1af-5b1088edbf71`::moving from state init -> state preparing >Thread-1640::INFO::2014-07-10 08:26:53,455::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='411039e4-4af2-4192-9de0-67dc1ed83ba9', options=None) >Thread-1640::DEBUG::2014-07-10 08:26:53,457::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9`ReqID=`8897cdf3-3d3b-4d66-94a2-2286b0c3c688`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo' >Thread-1640::DEBUG::2014-07-10 08:26:53,458::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' for lock type 'shared' >Thread-1640::DEBUG::2014-07-10 08:26:53,459::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' is free. Now locking as 'shared' (1 active user) >Thread-1640::DEBUG::2014-07-10 08:26:53,460::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9`ReqID=`8897cdf3-3d3b-4d66-94a2-2286b0c3c688`::Granted request >Thread-1640::DEBUG::2014-07-10 08:26:53,461::task::827::TaskManager.Task::(resourceAcquired) Task=`f1b070c4-a645-4abd-b1af-5b1088edbf71`::_resourcesAcquired: Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9 (shared) >Thread-1640::DEBUG::2014-07-10 08:26:53,462::task::990::TaskManager.Task::(_decref) Task=`f1b070c4-a645-4abd-b1af-5b1088edbf71`::ref 1 aborting False >Thread-1640::INFO::2014-07-10 08:26:53,464::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DC-REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 3, 'domains': 'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c:Active', 'master_uuid': 'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c': {'status': 'Active', 'diskfree': '1148232663040', 'isoprefix': '', 'alerts': [], 'disktotal': '1152393412608', 'version': 3}}} >Thread-1640::DEBUG::2014-07-10 08:26:53,465::task::1185::TaskManager.Task::(prepare) Task=`f1b070c4-a645-4abd-b1af-5b1088edbf71`::finished: {'info': {'name': 'DC-REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 3, 'domains': 'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c:Active', 'master_uuid': 'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c': {'status': 'Active', 'diskfree': '1148232663040', 'isoprefix': '', 'alerts': [], 'disktotal': '1152393412608', 'version': 3}}} >Thread-1640::DEBUG::2014-07-10 08:26:53,465::task::595::TaskManager.Task::(_updateState) Task=`f1b070c4-a645-4abd-b1af-5b1088edbf71`::moving from state preparing -> state finished >Thread-1640::DEBUG::2014-07-10 08:26:53,466::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9': < ResourceRef 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9', isValid: 'True' obj: 'None'>} >Thread-1640::DEBUG::2014-07-10 08:26:53,466::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1640::DEBUG::2014-07-10 08:26:53,468::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' >Thread-1640::DEBUG::2014-07-10 08:26:53,468::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' (0 active users) >Thread-1640::DEBUG::2014-07-10 08:26:53,469::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' is free, finding out if anyone is waiting for it. >Thread-1640::DEBUG::2014-07-10 08:26:53,470::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9', Clearing records. >Thread-1640::DEBUG::2014-07-10 08:26:53,470::task::990::TaskManager.Task::(_decref) Task=`f1b070c4-a645-4abd-b1af-5b1088edbf71`::ref 0 aborting False >Dummy-1639::DEBUG::2014-07-10 08:26:53,535::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0541711 s, 18.9 MB/s\n'; <rc> = 0 >Thread-1044::DEBUG::2014-07-10 08:26:53,591::task::595::TaskManager.Task::(_updateState) Task=`6ab9a10c-4c79-422f-86b8-c329fb87150c`::moving from state init -> state preparing >Thread-1044::INFO::2014-07-10 08:26:53,592::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-1044::INFO::2014-07-10 08:26:53,592::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000796514', 'lastCheck': '3.9', 'valid': True}} >Thread-1044::DEBUG::2014-07-10 08:26:53,592::task::1185::TaskManager.Task::(prepare) Task=`6ab9a10c-4c79-422f-86b8-c329fb87150c`::finished: {'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000796514', 'lastCheck': '3.9', 'valid': True}} >Thread-1044::DEBUG::2014-07-10 08:26:53,592::task::595::TaskManager.Task::(_updateState) Task=`6ab9a10c-4c79-422f-86b8-c329fb87150c`::moving from state preparing -> state finished >Thread-1044::DEBUG::2014-07-10 08:26:53,592::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-1044::DEBUG::2014-07-10 08:26:53,593::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1044::DEBUG::2014-07-10 08:26:53,593::task::990::TaskManager.Task::(_decref) Task=`6ab9a10c-4c79-422f-86b8-c329fb87150c`::ref 0 aborting False >Dummy-1639::DEBUG::2014-07-10 08:26:55,550::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-1639::DEBUG::2014-07-10 08:26:55,693::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0422176 s, 24.3 MB/s\n'; <rc> = 0 >Dummy-1639::DEBUG::2014-07-10 08:26:57,708::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-1639::DEBUG::2014-07-10 08:26:57,854::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0482947 s, 21.2 MB/s\n'; <rc> = 0 >Thread-1624::DEBUG::2014-07-10 08:26:59,732::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/e01a3a36-d2ce-4153-bb57-d6e65b7ed08c/metadata bs=4096 count=1' (cwd None) >Thread-1624::DEBUG::2014-07-10 08:26:59,802::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000785193 s, 5.2 MB/s\n'; <rc> = 0 >Dummy-1639::DEBUG::2014-07-10 08:26:59,869::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-1639::DEBUG::2014-07-10 08:27:00,014::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0429218 s, 23.9 MB/s\n'; <rc> = 0 >Dummy-1639::DEBUG::2014-07-10 08:27:02,030::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-1639::DEBUG::2014-07-10 08:27:02,174::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0421144 s, 24.3 MB/s\n'; <rc> = 0 >Thread-1044::DEBUG::2014-07-10 08:27:03,527::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-1044::DEBUG::2014-07-10 08:27:03,528::task::595::TaskManager.Task::(_updateState) Task=`62b269ef-abef-4d37-b05f-4128a313663e`::moving from state init -> state preparing >Thread-1044::INFO::2014-07-10 08:27:03,529::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='411039e4-4af2-4192-9de0-67dc1ed83ba9', options=None) >Thread-1044::INFO::2014-07-10 08:27:03,529::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 3}} >Thread-1044::DEBUG::2014-07-10 08:27:03,529::task::1185::TaskManager.Task::(prepare) Task=`62b269ef-abef-4d37-b05f-4128a313663e`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 3}} >Thread-1044::DEBUG::2014-07-10 08:27:03,530::task::595::TaskManager.Task::(_updateState) Task=`62b269ef-abef-4d37-b05f-4128a313663e`::moving from state preparing -> state finished >Thread-1044::DEBUG::2014-07-10 08:27:03,530::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-1044::DEBUG::2014-07-10 08:27:03,530::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1044::DEBUG::2014-07-10 08:27:03,530::task::990::TaskManager.Task::(_decref) Task=`62b269ef-abef-4d37-b05f-4128a313663e`::ref 0 aborting False >Thread-1640::DEBUG::2014-07-10 08:27:03,533::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-1640::DEBUG::2014-07-10 08:27:03,534::task::595::TaskManager.Task::(_updateState) Task=`4d0f5501-79b0-4462-a4b1-49ea0ebcbb6f`::moving from state init -> state preparing >Thread-1640::INFO::2014-07-10 08:27:03,534::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='411039e4-4af2-4192-9de0-67dc1ed83ba9', options=None) >Thread-1640::DEBUG::2014-07-10 08:27:03,535::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9`ReqID=`f16ba201-3a4e-444c-97b6-c1d099294610`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo' >Thread-1640::DEBUG::2014-07-10 08:27:03,535::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' for lock type 'shared' >Thread-1640::DEBUG::2014-07-10 08:27:03,535::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' is free. Now locking as 'shared' (1 active user) >Thread-1640::DEBUG::2014-07-10 08:27:03,535::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9`ReqID=`f16ba201-3a4e-444c-97b6-c1d099294610`::Granted request >Thread-1640::DEBUG::2014-07-10 08:27:03,536::task::827::TaskManager.Task::(resourceAcquired) Task=`4d0f5501-79b0-4462-a4b1-49ea0ebcbb6f`::_resourcesAcquired: Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9 (shared) >Thread-1640::DEBUG::2014-07-10 08:27:03,536::task::990::TaskManager.Task::(_decref) Task=`4d0f5501-79b0-4462-a4b1-49ea0ebcbb6f`::ref 1 aborting False >Thread-1640::INFO::2014-07-10 08:27:03,537::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DC-REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 3, 'domains': 'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c:Active', 'master_uuid': 'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c': {'status': 'Active', 'diskfree': '1148232663040', 'isoprefix': '', 'alerts': [], 'disktotal': '1152393412608', 'version': 3}}} >Thread-1640::DEBUG::2014-07-10 08:27:03,537::task::1185::TaskManager.Task::(prepare) Task=`4d0f5501-79b0-4462-a4b1-49ea0ebcbb6f`::finished: {'info': {'name': 'DC-REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 3, 'domains': 'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c:Active', 'master_uuid': 'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c': {'status': 'Active', 'diskfree': '1148232663040', 'isoprefix': '', 'alerts': [], 'disktotal': '1152393412608', 'version': 3}}} >Thread-1640::DEBUG::2014-07-10 08:27:03,537::task::595::TaskManager.Task::(_updateState) Task=`4d0f5501-79b0-4462-a4b1-49ea0ebcbb6f`::moving from state preparing -> state finished >Thread-1640::DEBUG::2014-07-10 08:27:03,537::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9': < ResourceRef 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9', isValid: 'True' obj: 'None'>} >Thread-1640::DEBUG::2014-07-10 08:27:03,538::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1640::DEBUG::2014-07-10 08:27:03,538::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' >Thread-1640::DEBUG::2014-07-10 08:27:03,538::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' (0 active users) >Thread-1640::DEBUG::2014-07-10 08:27:03,538::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' is free, finding out if anyone is waiting for it. >Thread-1640::DEBUG::2014-07-10 08:27:03,538::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9', Clearing records. >Thread-1640::DEBUG::2014-07-10 08:27:03,539::task::990::TaskManager.Task::(_decref) Task=`4d0f5501-79b0-4462-a4b1-49ea0ebcbb6f`::ref 0 aborting False >Dummy-1639::DEBUG::2014-07-10 08:27:04,189::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-1639::DEBUG::2014-07-10 08:27:04,324::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0372302 s, 27.5 MB/s\n'; <rc> = 0 >Dummy-1639::DEBUG::2014-07-10 08:27:06,339::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-1639::DEBUG::2014-07-10 08:27:06,471::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0334806 s, 30.6 MB/s\n'; <rc> = 0 >Dummy-1639::DEBUG::2014-07-10 08:27:08,486::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-1639::DEBUG::2014-07-10 08:27:08,627::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0440655 s, 23.2 MB/s\n'; <rc> = 0 >Thread-1044::DEBUG::2014-07-10 08:27:08,871::task::595::TaskManager.Task::(_updateState) Task=`ec4bad97-88b2-4740-a53d-86057379d0e9`::moving from state init -> state preparing >Thread-1044::INFO::2014-07-10 08:27:08,872::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-1044::INFO::2014-07-10 08:27:08,872::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000785193', 'lastCheck': '9.0', 'valid': True}} >Thread-1044::DEBUG::2014-07-10 08:27:08,873::task::1185::TaskManager.Task::(prepare) Task=`ec4bad97-88b2-4740-a53d-86057379d0e9`::finished: {'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000785193', 'lastCheck': '9.0', 'valid': True}} >Thread-1044::DEBUG::2014-07-10 08:27:08,873::task::595::TaskManager.Task::(_updateState) Task=`ec4bad97-88b2-4740-a53d-86057379d0e9`::moving from state preparing -> state finished >Thread-1044::DEBUG::2014-07-10 08:27:08,873::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-1044::DEBUG::2014-07-10 08:27:08,873::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1044::DEBUG::2014-07-10 08:27:08,873::task::990::TaskManager.Task::(_decref) Task=`ec4bad97-88b2-4740-a53d-86057379d0e9`::ref 0 aborting False >Thread-1624::DEBUG::2014-07-10 08:27:09,829::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/e01a3a36-d2ce-4153-bb57-d6e65b7ed08c/metadata bs=4096 count=1' (cwd None) >Thread-1624::DEBUG::2014-07-10 08:27:09,890::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000977818 s, 4.2 MB/s\n'; <rc> = 0 >Dummy-1639::DEBUG::2014-07-10 08:27:10,643::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-1639::DEBUG::2014-07-10 08:27:10,782::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0391024 s, 26.2 MB/s\n'; <rc> = 0 >Dummy-1639::DEBUG::2014-07-10 08:27:12,798::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-1639::DEBUG::2014-07-10 08:27:12,932::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0369252 s, 27.7 MB/s\n'; <rc> = 0 >Thread-1044::DEBUG::2014-07-10 08:27:13,597::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-1044::DEBUG::2014-07-10 08:27:13,599::task::595::TaskManager.Task::(_updateState) Task=`c0d3f12e-8775-4579-9b6b-389dc9fb194d`::moving from state init -> state preparing >Thread-1044::INFO::2014-07-10 08:27:13,599::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='411039e4-4af2-4192-9de0-67dc1ed83ba9', options=None) >Thread-1044::INFO::2014-07-10 08:27:13,600::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 3}} >Thread-1044::DEBUG::2014-07-10 08:27:13,600::task::1185::TaskManager.Task::(prepare) Task=`c0d3f12e-8775-4579-9b6b-389dc9fb194d`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 3}} >Thread-1044::DEBUG::2014-07-10 08:27:13,600::task::595::TaskManager.Task::(_updateState) Task=`c0d3f12e-8775-4579-9b6b-389dc9fb194d`::moving from state preparing -> state finished >Thread-1044::DEBUG::2014-07-10 08:27:13,600::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-1044::DEBUG::2014-07-10 08:27:13,601::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1044::DEBUG::2014-07-10 08:27:13,601::task::990::TaskManager.Task::(_decref) Task=`c0d3f12e-8775-4579-9b6b-389dc9fb194d`::ref 0 aborting False >Thread-1640::DEBUG::2014-07-10 08:27:13,605::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-1640::DEBUG::2014-07-10 08:27:13,605::task::595::TaskManager.Task::(_updateState) Task=`03b37c48-b1dd-4b34-9c48-37f28b709ed1`::moving from state init -> state preparing >Thread-1640::INFO::2014-07-10 08:27:13,605::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='411039e4-4af2-4192-9de0-67dc1ed83ba9', options=None) >Thread-1640::DEBUG::2014-07-10 08:27:13,606::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9`ReqID=`fe0708c9-de0a-41c3-bfd0-b1ef8c91c697`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2573' at 'getStoragePoolInfo' >Thread-1640::DEBUG::2014-07-10 08:27:13,606::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' for lock type 'shared' >Thread-1640::DEBUG::2014-07-10 08:27:13,607::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' is free. Now locking as 'shared' (1 active user) >Thread-1640::DEBUG::2014-07-10 08:27:13,607::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9`ReqID=`fe0708c9-de0a-41c3-bfd0-b1ef8c91c697`::Granted request >Thread-1640::DEBUG::2014-07-10 08:27:13,607::task::827::TaskManager.Task::(resourceAcquired) Task=`03b37c48-b1dd-4b34-9c48-37f28b709ed1`::_resourcesAcquired: Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9 (shared) >Thread-1640::DEBUG::2014-07-10 08:27:13,608::task::990::TaskManager.Task::(_decref) Task=`03b37c48-b1dd-4b34-9c48-37f28b709ed1`::ref 1 aborting False >Thread-1640::INFO::2014-07-10 08:27:13,609::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DC-REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 3, 'domains': 'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c:Active', 'master_uuid': 'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c': {'status': 'Active', 'diskfree': '1148232663040', 'isoprefix': '', 'alerts': [], 'disktotal': '1152393412608', 'version': 3}}} >Thread-1640::DEBUG::2014-07-10 08:27:13,609::task::1185::TaskManager.Task::(prepare) Task=`03b37c48-b1dd-4b34-9c48-37f28b709ed1`::finished: {'info': {'name': 'DC-REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 3, 'domains': 'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c:Active', 'master_uuid': 'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c': {'status': 'Active', 'diskfree': '1148232663040', 'isoprefix': '', 'alerts': [], 'disktotal': '1152393412608', 'version': 3}}} >Thread-1640::DEBUG::2014-07-10 08:27:13,609::task::595::TaskManager.Task::(_updateState) Task=`03b37c48-b1dd-4b34-9c48-37f28b709ed1`::moving from state preparing -> state finished >Thread-1640::DEBUG::2014-07-10 08:27:13,609::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9': < ResourceRef 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9', isValid: 'True' obj: 'None'>} >Thread-1640::DEBUG::2014-07-10 08:27:13,610::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1640::DEBUG::2014-07-10 08:27:13,610::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' >Thread-1640::DEBUG::2014-07-10 08:27:13,610::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' (0 active users) >Thread-1640::DEBUG::2014-07-10 08:27:13,610::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' is free, finding out if anyone is waiting for it. >Thread-1640::DEBUG::2014-07-10 08:27:13,610::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9', Clearing records. >Thread-1640::DEBUG::2014-07-10 08:27:13,611::task::990::TaskManager.Task::(_decref) Task=`03b37c48-b1dd-4b34-9c48-37f28b709ed1`::ref 0 aborting False >Dummy-1639::DEBUG::2014-07-10 08:27:14,947::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-1639::DEBUG::2014-07-10 08:27:15,088::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0445972 s, 23.0 MB/s\n'; <rc> = 0 >Dummy-1639::DEBUG::2014-07-10 08:27:17,105::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-1639::DEBUG::2014-07-10 08:27:17,258::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0553634 s, 18.5 MB/s\n'; <rc> = 0 >Dummy-1639::DEBUG::2014-07-10 08:27:19,274::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Thread-1624::DEBUG::2014-07-10 08:27:19,918::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/e01a3a36-d2ce-4153-bb57-d6e65b7ed08c/metadata bs=4096 count=1' (cwd None) >Thread-1624::DEBUG::2014-07-10 08:27:19,983::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000795936 s, 5.1 MB/s\n'; <rc> = 0 >Dummy-1639::DEBUG::2014-07-10 08:27:20,113::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.742427 s, 1.4 MB/s\n'; <rc> = 0 >Thread-1640::DEBUG::2014-07-10 08:27:21,959::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [45524d8c] >Thread-1640::DEBUG::2014-07-10 08:27:21,960::task::595::TaskManager.Task::(_updateState) Task=`e1c722bf-b98b-4b4b-a64d-65c3aa9ea685`::moving from state init -> state preparing >Thread-1640::INFO::2014-07-10 08:27:21,960::logUtils::44::dispatcher::(wrapper) Run and protect: deactivateStorageDomain(sdUUID='e01a3a36-d2ce-4153-bb57-d6e65b7ed08c', spUUID='411039e4-4af2-4192-9de0-67dc1ed83ba9', msdUUID='00000000-0000-0000-0000-000000000000', masterVersion=1, options=None) >Thread-1640::DEBUG::2014-07-10 08:27:21,961::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9`ReqID=`81e8a05c-b8bf-4793-9477-baf214d2a575`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '1234' at 'deactivateStorageDomain' >Thread-1640::DEBUG::2014-07-10 08:27:21,961::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' for lock type 'exclusive' >Thread-1640::DEBUG::2014-07-10 08:27:21,961::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' is free. Now locking as 'exclusive' (1 active user) >Thread-1640::DEBUG::2014-07-10 08:27:21,961::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9`ReqID=`81e8a05c-b8bf-4793-9477-baf214d2a575`::Granted request >Thread-1640::DEBUG::2014-07-10 08:27:21,962::task::827::TaskManager.Task::(resourceAcquired) Task=`e1c722bf-b98b-4b4b-a64d-65c3aa9ea685`::_resourcesAcquired: Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9 (exclusive) >Thread-1640::DEBUG::2014-07-10 08:27:21,962::task::990::TaskManager.Task::(_decref) Task=`e1c722bf-b98b-4b4b-a64d-65c3aa9ea685`::ref 1 aborting False >Thread-1640::DEBUG::2014-07-10 08:27:21,962::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.e01a3a36-d2ce-4153-bb57-d6e65b7ed08c`ReqID=`192bc08c-b44a-4f0e-b338-ca271a5789ee`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '1235' at 'deactivateStorageDomain' >Thread-1640::DEBUG::2014-07-10 08:27:21,963::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.e01a3a36-d2ce-4153-bb57-d6e65b7ed08c' for lock type 'exclusive' >Thread-1640::DEBUG::2014-07-10 08:27:21,963::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.e01a3a36-d2ce-4153-bb57-d6e65b7ed08c' is free. Now locking as 'exclusive' (1 active user) >Thread-1640::DEBUG::2014-07-10 08:27:21,963::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.e01a3a36-d2ce-4153-bb57-d6e65b7ed08c`ReqID=`192bc08c-b44a-4f0e-b338-ca271a5789ee`::Granted request >Thread-1640::DEBUG::2014-07-10 08:27:21,963::task::827::TaskManager.Task::(resourceAcquired) Task=`e1c722bf-b98b-4b4b-a64d-65c3aa9ea685`::_resourcesAcquired: Storage.e01a3a36-d2ce-4153-bb57-d6e65b7ed08c (exclusive) >Thread-1640::DEBUG::2014-07-10 08:27:21,963::task::990::TaskManager.Task::(_decref) Task=`e1c722bf-b98b-4b4b-a64d-65c3aa9ea685`::ref 1 aborting False >Thread-1640::INFO::2014-07-10 08:27:21,964::sp::1063::Storage.StoragePool::(deactivateSD) sdUUID=e01a3a36-d2ce-4153-bb57-d6e65b7ed08c spUUID=411039e4-4af2-4192-9de0-67dc1ed83ba9 newMsdUUID=00000000-0000-0000-0000-000000000000 >Thread-1640::INFO::2014-07-10 08:27:21,964::sp::1087::Storage.StoragePool::(deactivateSD) Silently ignoring the deactivation request for the master domain e01a3a36-d2ce-4153-bb57-d6e65b7ed08c >Thread-1640::INFO::2014-07-10 08:27:21,964::logUtils::47::dispatcher::(wrapper) Run and protect: deactivateStorageDomain, Return response: None >Thread-1640::DEBUG::2014-07-10 08:27:21,964::task::1185::TaskManager.Task::(prepare) Task=`e1c722bf-b98b-4b4b-a64d-65c3aa9ea685`::finished: None >Thread-1640::DEBUG::2014-07-10 08:27:21,965::task::595::TaskManager.Task::(_updateState) Task=`e1c722bf-b98b-4b4b-a64d-65c3aa9ea685`::moving from state preparing -> state finished >Thread-1640::DEBUG::2014-07-10 08:27:21,965::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9': < ResourceRef 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9', isValid: 'True' obj: 'None'>, 'Storage.e01a3a36-d2ce-4153-bb57-d6e65b7ed08c': < ResourceRef 'Storage.e01a3a36-d2ce-4153-bb57-d6e65b7ed08c', isValid: 'True' obj: 'None'>} >Thread-1640::DEBUG::2014-07-10 08:27:21,965::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1640::DEBUG::2014-07-10 08:27:21,965::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' >Thread-1640::DEBUG::2014-07-10 08:27:21,965::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' (0 active users) >Thread-1640::DEBUG::2014-07-10 08:27:21,966::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' is free, finding out if anyone is waiting for it. >Thread-1640::DEBUG::2014-07-10 08:27:21,966::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9', Clearing records. >Thread-1640::DEBUG::2014-07-10 08:27:21,966::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.e01a3a36-d2ce-4153-bb57-d6e65b7ed08c' >Thread-1640::DEBUG::2014-07-10 08:27:21,966::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.e01a3a36-d2ce-4153-bb57-d6e65b7ed08c' (0 active users) >Thread-1640::DEBUG::2014-07-10 08:27:21,966::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.e01a3a36-d2ce-4153-bb57-d6e65b7ed08c' is free, finding out if anyone is waiting for it. >Thread-1640::DEBUG::2014-07-10 08:27:21,966::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.e01a3a36-d2ce-4153-bb57-d6e65b7ed08c', Clearing records. >Thread-1640::DEBUG::2014-07-10 08:27:21,967::task::990::TaskManager.Task::(_decref) Task=`e1c722bf-b98b-4b4b-a64d-65c3aa9ea685`::ref 0 aborting False >Thread-1044::DEBUG::2014-07-10 08:27:21,971::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [45524d8c] >Thread-1044::DEBUG::2014-07-10 08:27:21,972::task::595::TaskManager.Task::(_updateState) Task=`d4f3101d-38c4-439a-a070-ad63283a74e5`::moving from state init -> state preparing >Thread-1044::INFO::2014-07-10 08:27:21,972::logUtils::44::dispatcher::(wrapper) Run and protect: getAllTasksStatuses(spUUID=None, options=None) >Thread-1044::DEBUG::2014-07-10 08:27:21,972::taskManager::102::TaskManager::(getAllTasksStatuses) Entry. >Thread-1044::DEBUG::2014-07-10 08:27:21,972::taskManager::113::TaskManager::(getAllTasksStatuses) Return: {} >Thread-1044::INFO::2014-07-10 08:27:21,972::logUtils::47::dispatcher::(wrapper) Run and protect: getAllTasksStatuses, Return response: {'allTasksStatus': {}} >Thread-1044::DEBUG::2014-07-10 08:27:21,973::task::1185::TaskManager.Task::(prepare) Task=`d4f3101d-38c4-439a-a070-ad63283a74e5`::finished: {'allTasksStatus': {}} >Thread-1044::DEBUG::2014-07-10 08:27:21,973::task::595::TaskManager.Task::(_updateState) Task=`d4f3101d-38c4-439a-a070-ad63283a74e5`::moving from state preparing -> state finished >Thread-1044::DEBUG::2014-07-10 08:27:21,973::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-1044::DEBUG::2014-07-10 08:27:21,973::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1044::DEBUG::2014-07-10 08:27:21,973::task::990::TaskManager.Task::(_decref) Task=`d4f3101d-38c4-439a-a070-ad63283a74e5`::ref 0 aborting False >Thread-1044::DEBUG::2014-07-10 08:27:21,977::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [45524d8c] >Thread-1044::DEBUG::2014-07-10 08:27:21,977::task::595::TaskManager.Task::(_updateState) Task=`58487efe-199b-4aeb-936d-da6bad71fde7`::moving from state init -> state preparing >Thread-1044::INFO::2014-07-10 08:27:21,978::logUtils::44::dispatcher::(wrapper) Run and protect: spmStop(spUUID='411039e4-4af2-4192-9de0-67dc1ed83ba9', options=None) >Thread-1044::DEBUG::2014-07-10 08:27:21,978::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9`ReqID=`9c8ed79e-7818-4355-9d9c-790418bdc581`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '616' at 'spmStop' >Thread-1044::DEBUG::2014-07-10 08:27:21,978::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' for lock type 'exclusive' >Thread-1044::DEBUG::2014-07-10 08:27:21,978::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' is free. Now locking as 'exclusive' (1 active user) >Thread-1044::DEBUG::2014-07-10 08:27:21,979::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9`ReqID=`9c8ed79e-7818-4355-9d9c-790418bdc581`::Granted request >Thread-1044::DEBUG::2014-07-10 08:27:21,979::task::827::TaskManager.Task::(resourceAcquired) Task=`58487efe-199b-4aeb-936d-da6bad71fde7`::_resourcesAcquired: Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9 (exclusive) >Thread-1044::DEBUG::2014-07-10 08:27:21,979::task::990::TaskManager.Task::(_decref) Task=`58487efe-199b-4aeb-936d-da6bad71fde7`::ref 1 aborting False >Thread-1044::DEBUG::2014-07-10 08:27:21,979::sp::340::Storage.StoragePool::(_shutDownUpgrade) Shutting down upgrade process >Thread-1044::DEBUG::2014-07-10 08:27:21,980::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.upgrade_411039e4-4af2-4192-9de0-67dc1ed83ba9`ReqID=`01b9f47c-3256-49df-9d48-81f62ff19b80`::Request was made in '/usr/share/vdsm/storage/sp.py' line '342' at '_shutDownUpgrade' >Thread-1044::DEBUG::2014-07-10 08:27:21,980::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.upgrade_411039e4-4af2-4192-9de0-67dc1ed83ba9' for lock type 'exclusive' >Thread-1044::DEBUG::2014-07-10 08:27:21,980::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.upgrade_411039e4-4af2-4192-9de0-67dc1ed83ba9' is free. Now locking as 'exclusive' (1 active user) >Thread-1044::DEBUG::2014-07-10 08:27:21,980::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.upgrade_411039e4-4af2-4192-9de0-67dc1ed83ba9`ReqID=`01b9f47c-3256-49df-9d48-81f62ff19b80`::Granted request >Thread-1044::DEBUG::2014-07-10 08:27:21,981::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.upgrade_411039e4-4af2-4192-9de0-67dc1ed83ba9' >Thread-1044::DEBUG::2014-07-10 08:27:21,981::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.upgrade_411039e4-4af2-4192-9de0-67dc1ed83ba9' (0 active users) >Thread-1044::DEBUG::2014-07-10 08:27:21,981::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.upgrade_411039e4-4af2-4192-9de0-67dc1ed83ba9' is free, finding out if anyone is waiting for it. >Thread-1044::DEBUG::2014-07-10 08:27:21,981::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.upgrade_411039e4-4af2-4192-9de0-67dc1ed83ba9', Clearing records. >Thread-1044::DEBUG::2014-07-10 08:27:21,999::sp::378::Storage.StoragePool::(cleanupMasterMount) unmounting /rhev/data-center/mnt/blockSD/e01a3a36-d2ce-4153-bb57-d6e65b7ed08c/master >Dummy-1639::DEBUG::2014-07-10 08:27:22,129::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Thread-1042::DEBUG::2014-07-10 08:27:24,176::task::595::TaskManager.Task::(_updateState) Task=`bc7bfe33-191e-4201-8fa6-7edee24faeea`::moving from state init -> state preparing >Thread-1042::INFO::2014-07-10 08:27:24,181::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-1042::INFO::2014-07-10 08:27:24,187::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000795936', 'lastCheck': '4.2', 'valid': True}} >Thread-1042::DEBUG::2014-07-10 08:27:24,190::task::1185::TaskManager.Task::(prepare) Task=`bc7bfe33-191e-4201-8fa6-7edee24faeea`::finished: {'e01a3a36-d2ce-4153-bb57-d6e65b7ed08c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000795936', 'lastCheck': '4.2', 'valid': True}} >Thread-1042::DEBUG::2014-07-10 08:27:24,196::task::595::TaskManager.Task::(_updateState) Task=`bc7bfe33-191e-4201-8fa6-7edee24faeea`::moving from state preparing -> state finished >Thread-1042::DEBUG::2014-07-10 08:27:24,201::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-1042::DEBUG::2014-07-10 08:27:24,205::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1042::DEBUG::2014-07-10 08:27:24,209::task::990::TaskManager.Task::(_decref) Task=`bc7bfe33-191e-4201-8fa6-7edee24faeea`::ref 0 aborting False >Dummy-1639::DEBUG::2014-07-10 08:27:24,474::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.930133 s, 1.1 MB/s\n'; <rc> = 0 >Dummy-1639::DEBUG::2014-07-10 08:27:26,516::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-1639::DEBUG::2014-07-10 08:27:27,900::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.757052 s, 1.4 MB/s\n'; <rc> = 0 >Thread-1044::DEBUG::2014-07-10 08:27:27,974::mount::202::Storage.Misc.excCmd::(_runcmd) '/usr/bin/sudo -n /bin/umount /rhev/data-center/mnt/blockSD/e01a3a36-d2ce-4153-bb57-d6e65b7ed08c/master' (cwd None) >Thread-1044::DEBUG::2014-07-10 08:27:28,073::persistentDict::167::Storage.PersistentDict::(transaction) Starting transaction >Thread-1044::DEBUG::2014-07-10 08:27:28,074::persistentDict::173::Storage.PersistentDict::(transaction) Flushing changes >Thread-1044::DEBUG::2014-07-10 08:27:28,075::persistentDict::299::Storage.PersistentDict::(flush) about to write lines (VGTagMetadataRW)=['CLASS=Data', 'DESCRIPTION=SD-REAL', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'LOGBLKSIZE=512', 'MASTER_VERSION=1', 'PHYBLKSIZE=512', 'POOL_DESCRIPTION=DC-REAL', 'POOL_DOMAINS=e01a3a36-d2ce-4153-bb57-d6e65b7ed08c:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=3', 'POOL_UUID=411039e4-4af2-4192-9de0-67dc1ed83ba9', u'PV0=pv:3600601601282300032826addbbdae311,uuid:ZdReOp-Yf8A-beQm-ne4I-pN3J-rxgm-9Ew0S1,pestart:0,pecount:8189,mapoffset:0', u'PV1=pv:360060160f4a030003840ec867ddee311,uuid:0eUwla-dsA3-g6ia-RU23-cual-0rt9-KzkxLj,pestart:0,pecount:397,mapoffset:8189', 'ROLE=Master', 'SDUUID=e01a3a36-d2ce-4153-bb57-d6e65b7ed08c', 'TYPE=ISCSI', 'VERSION=3', 'VGUUID=GJcVo5-Y0kU-CDub-zITS-zfoL-Z7hz-SeVeIe', '_SHA_CKSUM=9c219a14ef871a45bbdc2f9f3c84ddb22d05fc30'] >Thread-1044::DEBUG::2014-07-10 08:27:28,075::lvm::503::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-1044::DEBUG::2014-07-10 08:27:28,076::lvm::505::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-1044::DEBUG::2014-07-10 08:27:28,076::lvm::513::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-1044::DEBUG::2014-07-10 08:27:28,076::lvm::525::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-1044::DEBUG::2014-07-10 08:27:28,077::lvm::373::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-1044::DEBUG::2014-07-10 08:27:28,077::lvm::296::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/3600601601282300032826addbbdae311|/dev/mapper/360060160f4a030003840ec867ddee311|/dev/mapper/367cad74c2fcba00019e6afd20c781e67|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name e01a3a36-d2ce-4153-bb57-d6e65b7ed08c' (cwd None) >Thread-1044::DEBUG::2014-07-10 08:27:28,700::lvm::296::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-1044::DEBUG::2014-07-10 08:27:28,703::lvm::415::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-1044::DEBUG::2014-07-10 08:27:28,703::blockSD::315::storage.Metadata.VGTagMetadataRW::(writelines) Updating metadata adding=MDT_POOL_SPM_ID=-1, MDT__SHA_CKSUM=9c219a14ef871a45bbdc2f9f3c84ddb22d05fc30 removing=MDT_POOL_SPM_ID=1, MDT__SHA_CKSUM=fff80dfbf867146f89a6fadc25468cad12a2316f >Thread-1044::DEBUG::2014-07-10 08:27:28,704::lvm::296::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgchange --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/3600601601282300032826addbbdae311|/dev/mapper/360060160f4a030003840ec867ddee311|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } " --deltag MDT_POOL_SPM_ID=1 --deltag MDT__SHA_CKSUM=fff80dfbf867146f89a6fadc25468cad12a2316f --addtag MDT_POOL_SPM_ID=-1 --addtag MDT__SHA_CKSUM=9c219a14ef871a45bbdc2f9f3c84ddb22d05fc30 e01a3a36-d2ce-4153-bb57-d6e65b7ed08c' (cwd None) >Thread-1044::DEBUG::2014-07-10 08:27:28,971::lvm::296::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-1044::DEBUG::2014-07-10 08:27:28,972::lvm::503::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-1044::DEBUG::2014-07-10 08:27:28,972::lvm::505::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-1044::DEBUG::2014-07-10 08:27:28,972::persistentDict::175::Storage.PersistentDict::(transaction) Finished transaction >Thread-1044::INFO::2014-07-10 08:27:28,973::clusterlock::279::SANLock::(release) Releasing cluster lock for domain e01a3a36-d2ce-4153-bb57-d6e65b7ed08c >Thread-1044::DEBUG::2014-07-10 08:27:29,038::clusterlock::289::SANLock::(release) Cluster lock for domain e01a3a36-d2ce-4153-bb57-d6e65b7ed08c successfully released >Thread-1044::INFO::2014-07-10 08:27:29,039::logUtils::47::dispatcher::(wrapper) Run and protect: spmStop, Return response: None >Thread-1044::DEBUG::2014-07-10 08:27:29,039::task::1185::TaskManager.Task::(prepare) Task=`58487efe-199b-4aeb-936d-da6bad71fde7`::finished: None >Thread-1044::DEBUG::2014-07-10 08:27:29,039::task::595::TaskManager.Task::(_updateState) Task=`58487efe-199b-4aeb-936d-da6bad71fde7`::moving from state preparing -> state finished >Thread-1044::DEBUG::2014-07-10 08:27:29,040::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9': < ResourceRef 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9', isValid: 'True' obj: 'None'>} >Thread-1044::DEBUG::2014-07-10 08:27:29,040::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1044::DEBUG::2014-07-10 08:27:29,040::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' >Thread-1044::DEBUG::2014-07-10 08:27:29,041::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' (0 active users) >Thread-1044::DEBUG::2014-07-10 08:27:29,041::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' is free, finding out if anyone is waiting for it. >Thread-1044::DEBUG::2014-07-10 08:27:29,041::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9', Clearing records. >Thread-1044::DEBUG::2014-07-10 08:27:29,041::task::990::TaskManager.Task::(_decref) Task=`58487efe-199b-4aeb-936d-da6bad71fde7`::ref 0 aborting False >Thread-1044::DEBUG::2014-07-10 08:27:29,113::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [45524d8c] >Thread-1044::DEBUG::2014-07-10 08:27:29,114::task::595::TaskManager.Task::(_updateState) Task=`3ee486d5-213f-4922-9c5a-4e08f41f2a06`::moving from state init -> state preparing >Thread-1044::INFO::2014-07-10 08:27:29,114::logUtils::44::dispatcher::(wrapper) Run and protect: disconnectStoragePool(spUUID='411039e4-4af2-4192-9de0-67dc1ed83ba9', hostID=1, remove=False, options=None) >Thread-1044::DEBUG::2014-07-10 08:27:29,115::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9`ReqID=`593bec68-8134-4e73-8b57-d92c5d907d4e`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '1131' at 'disconnectStoragePool' >Thread-1044::DEBUG::2014-07-10 08:27:29,115::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' for lock type 'exclusive' >Thread-1044::DEBUG::2014-07-10 08:27:29,116::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' is free. Now locking as 'exclusive' (1 active user) >Thread-1044::DEBUG::2014-07-10 08:27:29,116::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9`ReqID=`593bec68-8134-4e73-8b57-d92c5d907d4e`::Granted request >Thread-1044::DEBUG::2014-07-10 08:27:29,116::task::827::TaskManager.Task::(resourceAcquired) Task=`3ee486d5-213f-4922-9c5a-4e08f41f2a06`::_resourcesAcquired: Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9 (exclusive) >Thread-1044::DEBUG::2014-07-10 08:27:29,117::task::990::TaskManager.Task::(_decref) Task=`3ee486d5-213f-4922-9c5a-4e08f41f2a06`::ref 1 aborting False >Thread-1044::DEBUG::2014-07-10 08:27:29,117::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.HsmDomainMonitorLock`ReqID=`1ab8e869-d6b2-4e76-abbe-6b0e47088d39`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '1139' at '_disconnectPool' >Thread-1044::DEBUG::2014-07-10 08:27:29,117::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.HsmDomainMonitorLock' for lock type 'exclusive' >Thread-1044::DEBUG::2014-07-10 08:27:29,117::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.HsmDomainMonitorLock' is free. Now locking as 'exclusive' (1 active user) >Thread-1044::DEBUG::2014-07-10 08:27:29,118::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.HsmDomainMonitorLock`ReqID=`1ab8e869-d6b2-4e76-abbe-6b0e47088d39`::Granted request >Thread-1044::INFO::2014-07-10 08:27:29,118::sp::649::Storage.StoragePool::(disconnect) Disconnect from the storage pool 411039e4-4af2-4192-9de0-67dc1ed83ba9 >Thread-1624::DEBUG::2014-07-10 08:27:30,010::lvm::373::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-1624::DEBUG::2014-07-10 08:27:30,011::lvm::296::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/3600601601282300032826addbbdae311|/dev/mapper/360060160f4a030003840ec867ddee311|/dev/mapper/367cad74c2fcba00019e6afd20c781e67|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name e01a3a36-d2ce-4153-bb57-d6e65b7ed08c' (cwd None) >Thread-1044::INFO::2014-07-10 08:27:30,105::domainMonitor::113::Storage.DomainMonitor::(stopMonitoring) Stop monitoring e01a3a36-d2ce-4153-bb57-d6e65b7ed08c >Thread-1624::DEBUG::2014-07-10 08:27:30,308::lvm::296::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-1624::DEBUG::2014-07-10 08:27:30,310::lvm::415::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-1624::DEBUG::2014-07-10 08:27:30,311::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/e01a3a36-d2ce-4153-bb57-d6e65b7ed08c/metadata bs=4096 count=1' (cwd None) >Thread-1624::DEBUG::2014-07-10 08:27:30,380::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00868471 s, 472 kB/s\n'; <rc> = 0 >Thread-1624::DEBUG::2014-07-10 08:27:30,402::domainMonitor::175::Storage.DomainMonitorThread::(_monitorLoop) Stopping domain monitor for e01a3a36-d2ce-4153-bb57-d6e65b7ed08c >Thread-1624::INFO::2014-07-10 08:27:30,402::clusterlock::207::SANLock::(releaseHostId) Releasing host id for domain e01a3a36-d2ce-4153-bb57-d6e65b7ed08c (id: 1) >Thread-1633::INFO::2014-07-10 08:27:30,406::storage_mailbox::509::Storage.MailBox.HsmMailMonitor::(run) HSM_MailboxMonitor - Incoming mail monitoring thread stopped, clearing outgoing mail >Thread-1633::INFO::2014-07-10 08:27:30,406::storage_mailbox::385::Storage.MailBox.HsmMailMonitor::(_sendMail) HSM_MailMonitor sending mail to SPM - ['/bin/dd', 'of=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox', 'iflag=fullblock', 'oflag=direct', 'conv=notrunc', 'bs=512', 'seek=8'] >Thread-1633::DEBUG::2014-07-10 08:27:30,407::storage_mailbox::84::Storage.Misc.excCmd::(_mboxExecCmd) '/bin/dd of=/rhev/data-center/411039e4-4af2-4192-9de0-67dc1ed83ba9/mastersd/dom_md/inbox iflag=fullblock oflag=direct conv=notrunc bs=512 seek=8' (cwd None) >Dummy-1639::INFO::2014-07-10 08:27:31,388::storage_mailbox::794::Storage.MailBox.SpmMailMonitor::(run) SPM_MailMonitor - Incoming mail monitoring thread stopped >Thread-1624::DEBUG::2014-07-10 08:27:33,404::clusterlock::217::SANLock::(releaseHostId) Host id for domain e01a3a36-d2ce-4153-bb57-d6e65b7ed08c released successfully (id: 1) >Thread-1044::DEBUG::2014-07-10 08:27:33,407::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.HsmDomainMonitorLock' >Thread-1044::DEBUG::2014-07-10 08:27:33,408::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.HsmDomainMonitorLock' (0 active users) >Thread-1044::DEBUG::2014-07-10 08:27:33,408::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.HsmDomainMonitorLock' is free, finding out if anyone is waiting for it. >Thread-1044::DEBUG::2014-07-10 08:27:33,408::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.HsmDomainMonitorLock', Clearing records. >Thread-1044::INFO::2014-07-10 08:27:33,408::logUtils::47::dispatcher::(wrapper) Run and protect: disconnectStoragePool, Return response: True >Thread-1044::DEBUG::2014-07-10 08:27:33,409::task::1185::TaskManager.Task::(prepare) Task=`3ee486d5-213f-4922-9c5a-4e08f41f2a06`::finished: True >Thread-1044::DEBUG::2014-07-10 08:27:33,409::task::595::TaskManager.Task::(_updateState) Task=`3ee486d5-213f-4922-9c5a-4e08f41f2a06`::moving from state preparing -> state finished >Thread-1044::DEBUG::2014-07-10 08:27:33,409::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9': < ResourceRef 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9', isValid: 'True' obj: 'None'>} >Thread-1044::DEBUG::2014-07-10 08:27:33,409::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1044::DEBUG::2014-07-10 08:27:33,410::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' >Thread-1044::DEBUG::2014-07-10 08:27:33,410::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' (0 active users) >Thread-1044::DEBUG::2014-07-10 08:27:33,410::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9' is free, finding out if anyone is waiting for it. >Thread-1044::DEBUG::2014-07-10 08:27:33,410::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.411039e4-4af2-4192-9de0-67dc1ed83ba9', Clearing records. >Thread-1044::DEBUG::2014-07-10 08:27:33,410::task::990::TaskManager.Task::(_decref) Task=`3ee486d5-213f-4922-9c5a-4e08f41f2a06`::ref 0 aborting False >Thread-1044::DEBUG::2014-07-10 08:27:33,457::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [45524d8c] >Thread-1044::DEBUG::2014-07-10 08:27:33,458::task::595::TaskManager.Task::(_updateState) Task=`e70683de-a1d0-4e39-a7ff-811217ec046d`::moving from state init -> state preparing >Thread-1044::INFO::2014-07-10 08:27:33,458::logUtils::44::dispatcher::(wrapper) Run and protect: disconnectStoragePool(spUUID='411039e4-4af2-4192-9de0-67dc1ed83ba9', hostID=1, remove=False, options=None) >Thread-1044::WARNING::2014-07-10 08:27:33,458::hsm::1126::Storage.HSM::(disconnectStoragePool) disconnect sp: 411039e4-4af2-4192-9de0-67dc1ed83ba9 failed. Known pools {} >Thread-1044::INFO::2014-07-10 08:27:33,458::logUtils::47::dispatcher::(wrapper) Run and protect: disconnectStoragePool, Return response: None >Thread-1044::DEBUG::2014-07-10 08:27:33,459::task::1185::TaskManager.Task::(prepare) Task=`e70683de-a1d0-4e39-a7ff-811217ec046d`::finished: None >Thread-1044::DEBUG::2014-07-10 08:27:33,459::task::595::TaskManager.Task::(_updateState) Task=`e70683de-a1d0-4e39-a7ff-811217ec046d`::moving from state preparing -> state finished >Thread-1044::DEBUG::2014-07-10 08:27:33,459::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-1044::DEBUG::2014-07-10 08:27:33,459::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1044::DEBUG::2014-07-10 08:27:33,459::task::990::TaskManager.Task::(_decref) Task=`e70683de-a1d0-4e39-a7ff-811217ec046d`::ref 0 aborting False >Thread-1044::DEBUG::2014-07-10 08:27:33,566::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [45524d8c] >Thread-1044::DEBUG::2014-07-10 08:27:33,567::task::595::TaskManager.Task::(_updateState) Task=`3c25d5c5-c86f-495c-a3b2-a5ce0baf2a8e`::moving from state init -> state preparing >Thread-1044::INFO::2014-07-10 08:27:33,567::logUtils::44::dispatcher::(wrapper) Run and protect: disconnectStorageServer(domType=3, spUUID='411039e4-4af2-4192-9de0-67dc1ed83ba9', conList=[{'connection': '10.35.160.107', 'iqn': 'iqn.1992-04.com.emc:cx.ckm00121000438.b7', 'user': '', 'tpgt': '4', 'password': '******', 'id': '21af9f33-77f4-44ce-afd8-ac2b9d767d2d', 'port': '3260'}, {'connection': '10.35.160.106', 'iqn': 'iqn.1992-04.com.emc:cx.ckm00121000438.b6', 'user': '', 'tpgt': '3', 'password': '******', 'id': 'bf1f6c61-9095-46fa-ae99-483613a91747', 'port': '3260'}, {'connection': '10.35.160.104', 'iqn': 'iqn.1992-04.com.emc:cx.ckm00121000438.a6', 'user': '', 'tpgt': '1', 'password': '******', 'id': 'e2ffc61c-fdb9-46ce-b87b-7235401ebf49', 'port': '3260'}, {'connection': '10.35.160.105', 'iqn': 'iqn.1992-04.com.emc:cx.ckm00121000438.a7', 'user': '', 'tpgt': '2', 'password': '******', 'id': 'fa5dd339-edaa-44d5-9807-e488406bb839', 'port': '3260'}, {'connection': '10.35.160.107', 'iqn': 'iqn.1992-04.com.emc:cx.ckm00121000438.b7', 'user': '', 'tpgt': '4', 'password': '******', 'id': '21af9f33-77f4-44ce-afd8-ac2b9d767d2d', 'port': '3260'}, {'connection': '10.35.160.106', 'iqn': 'iqn.1992-04.com.emc:cx.ckm00121000438.b6', 'user': '', 'tpgt': '3', 'password': '******', 'id': 'bf1f6c61-9095-46fa-ae99-483613a91747', 'port': '3260'}, {'connection': '10.35.160.104', 'iqn': 'iqn.1992-04.com.emc:cx.ckm00121000438.a6', 'user': '', 'tpgt': '1', 'password': '******', 'id': 'e2ffc61c-fdb9-46ce-b87b-7235401ebf49', 'port': '3260'}, {'connection': '10.35.160.105', 'iqn': 'iqn.1992-04.com.emc:cx.ckm00121000438.a7', 'user': '', 'tpgt': '2', 'password': '******', 'id': 'fa5dd339-edaa-44d5-9807-e488406bb839', 'port': '3260'}], options=None) >Thread-1044::DEBUG::2014-07-10 08:27:33,576::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) '/usr/bin/sudo -n /sbin/iscsiadm -m session -r 5 -u' (cwd None) >Thread-1044::DEBUG::2014-07-10 08:27:34,173::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-1044::DEBUG::2014-07-10 08:27:34,178::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) '/usr/bin/sudo -n /sbin/iscsiadm -m session -r 6 -u' (cwd None) >Thread-1044::DEBUG::2014-07-10 08:27:34,764::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-1044::DEBUG::2014-07-10 08:27:34,768::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) '/usr/bin/sudo -n /sbin/iscsiadm -m session -r 7 -u' (cwd None) >Thread-1044::DEBUG::2014-07-10 08:27:35,350::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-1044::DEBUG::2014-07-10 08:27:35,355::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) '/usr/bin/sudo -n /sbin/iscsiadm -m session -r 8 -u' (cwd None) >Thread-1044::DEBUG::2014-07-10 08:27:35,935::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-1044::DEBUG::2014-07-10 08:27:35,940::misc::756::SamplingMethod::(__call__) Trying to enter sampling method (storage.sdc.refreshStorage) >Thread-1044::DEBUG::2014-07-10 08:27:35,940::misc::758::SamplingMethod::(__call__) Got in to sampling method >Thread-1044::DEBUG::2014-07-10 08:27:35,941::misc::756::SamplingMethod::(__call__) Trying to enter sampling method (storage.iscsi.rescan) >Thread-1044::DEBUG::2014-07-10 08:27:35,941::misc::758::SamplingMethod::(__call__) Got in to sampling method >Thread-1044::DEBUG::2014-07-10 08:27:35,941::iscsi::407::Storage.ISCSI::(rescan) Performing SCSI scan, this will take up to 30 seconds >Thread-1044::DEBUG::2014-07-10 08:27:35,941::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) '/usr/bin/sudo -n /sbin/iscsiadm -m session -R' (cwd None) >Thread-1044::DEBUG::2014-07-10 08:27:36,012::misc::766::SamplingMethod::(__call__) Returning last result >Thread-1044::DEBUG::2014-07-10 08:27:36,013::multipath::110::Storage.Misc.excCmd::(rescan) '/usr/bin/sudo -n /sbin/multipath -r' (cwd None) >Thread-1044::DEBUG::2014-07-10 08:27:36,103::multipath::110::Storage.Misc.excCmd::(rescan) SUCCESS: <err> = ''; <rc> = 0 >Thread-1044::DEBUG::2014-07-10 08:27:36,104::lvm::497::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-1044::DEBUG::2014-07-10 08:27:36,104::lvm::499::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-1044::DEBUG::2014-07-10 08:27:36,104::lvm::508::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-1044::DEBUG::2014-07-10 08:27:36,104::lvm::510::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-1044::DEBUG::2014-07-10 08:27:36,105::lvm::528::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-1044::DEBUG::2014-07-10 08:27:36,105::lvm::530::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-1044::DEBUG::2014-07-10 08:27:36,105::misc::766::SamplingMethod::(__call__) Returning last result >Thread-1044::INFO::2014-07-10 08:27:36,106::logUtils::47::dispatcher::(wrapper) Run and protect: disconnectStorageServer, Return response: {'statuslist': [{'status': 0, 'id': '21af9f33-77f4-44ce-afd8-ac2b9d767d2d'}, {'status': 0, 'id': 'bf1f6c61-9095-46fa-ae99-483613a91747'}, {'status': 0, 'id': 'e2ffc61c-fdb9-46ce-b87b-7235401ebf49'}, {'status': 0, 'id': 'fa5dd339-edaa-44d5-9807-e488406bb839'}, {'status': 0, 'id': '21af9f33-77f4-44ce-afd8-ac2b9d767d2d'}, {'status': 0, 'id': 'bf1f6c61-9095-46fa-ae99-483613a91747'}, {'status': 0, 'id': 'e2ffc61c-fdb9-46ce-b87b-7235401ebf49'}, {'status': 0, 'id': 'fa5dd339-edaa-44d5-9807-e488406bb839'}]} >Thread-1044::DEBUG::2014-07-10 08:27:36,106::task::1185::TaskManager.Task::(prepare) Task=`3c25d5c5-c86f-495c-a3b2-a5ce0baf2a8e`::finished: {'statuslist': [{'status': 0, 'id': '21af9f33-77f4-44ce-afd8-ac2b9d767d2d'}, {'status': 0, 'id': 'bf1f6c61-9095-46fa-ae99-483613a91747'}, {'status': 0, 'id': 'e2ffc61c-fdb9-46ce-b87b-7235401ebf49'}, {'status': 0, 'id': 'fa5dd339-edaa-44d5-9807-e488406bb839'}, {'status': 0, 'id': '21af9f33-77f4-44ce-afd8-ac2b9d767d2d'}, {'status': 0, 'id': 'bf1f6c61-9095-46fa-ae99-483613a91747'}, {'status': 0, 'id': 'e2ffc61c-fdb9-46ce-b87b-7235401ebf49'}, {'status': 0, 'id': 'fa5dd339-edaa-44d5-9807-e488406bb839'}]} >Thread-1044::DEBUG::2014-07-10 08:27:36,106::task::595::TaskManager.Task::(_updateState) Task=`3c25d5c5-c86f-495c-a3b2-a5ce0baf2a8e`::moving from state preparing -> state finished >Thread-1044::DEBUG::2014-07-10 08:27:36,106::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-1044::DEBUG::2014-07-10 08:27:36,107::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1044::DEBUG::2014-07-10 08:27:36,107::task::990::TaskManager.Task::(_decref) Task=`3c25d5c5-c86f-495c-a3b2-a5ce0baf2a8e`::ref 0 aborting False >Thread-1044::DEBUG::2014-07-10 08:27:36,164::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [45524d8c] >Thread-1044::DEBUG::2014-07-10 08:27:36,165::task::595::TaskManager.Task::(_updateState) Task=`52ce8525-8b90-46f4-a845-fc363f66420c`::moving from state init -> state preparing >Thread-1044::INFO::2014-07-10 08:27:36,165::logUtils::44::dispatcher::(wrapper) Run and protect: disconnectStorageServer(domType=3, spUUID='411039e4-4af2-4192-9de0-67dc1ed83ba9', conList=[{'connection': '10.35.160.107', 'iqn': 'iqn.1992-04.com.emc:cx.ckm00121000438.b7', 'user': '', 'tpgt': '4', 'password': '******', 'id': '21af9f33-77f4-44ce-afd8-ac2b9d767d2d', 'port': '3260'}, {'connection': '10.35.160.106', 'iqn': 'iqn.1992-04.com.emc:cx.ckm00121000438.b6', 'user': '', 'tpgt': '3', 'password': '******', 'id': 'bf1f6c61-9095-46fa-ae99-483613a91747', 'port': '3260'}, {'connection': '10.35.160.104', 'iqn': 'iqn.1992-04.com.emc:cx.ckm00121000438.a6', 'user': '', 'tpgt': '1', 'password': '******', 'id': 'e2ffc61c-fdb9-46ce-b87b-7235401ebf49', 'port': '3260'}, {'connection': '10.35.160.105', 'iqn': 'iqn.1992-04.com.emc:cx.ckm00121000438.a7', 'user': '', 'tpgt': '2', 'password': '******', 'id': 'fa5dd339-edaa-44d5-9807-e488406bb839', 'port': '3260'}, {'connection': '10.35.160.107', 'iqn': 'iqn.1992-04.com.emc:cx.ckm00121000438.b7', 'user': '', 'tpgt': '4', 'password': '******', 'id': '21af9f33-77f4-44ce-afd8-ac2b9d767d2d', 'port': '3260'}, {'connection': '10.35.160.106', 'iqn': 'iqn.1992-04.com.emc:cx.ckm00121000438.b6', 'user': '', 'tpgt': '3', 'password': '******', 'id': 'bf1f6c61-9095-46fa-ae99-483613a91747', 'port': '3260'}, {'connection': '10.35.160.104', 'iqn': 'iqn.1992-04.com.emc:cx.ckm00121000438.a6', 'user': '', 'tpgt': '1', 'password': '******', 'id': 'e2ffc61c-fdb9-46ce-b87b-7235401ebf49', 'port': '3260'}, {'connection': '10.35.160.105', 'iqn': 'iqn.1992-04.com.emc:cx.ckm00121000438.a7', 'user': '', 'tpgt': '2', 'password': '******', 'id': 'fa5dd339-edaa-44d5-9807-e488406bb839', 'port': '3260'}], options=None) >Thread-1044::DEBUG::2014-07-10 08:27:36,172::misc::756::SamplingMethod::(__call__) Trying to enter sampling method (storage.sdc.refreshStorage) >Thread-1044::DEBUG::2014-07-10 08:27:36,172::misc::758::SamplingMethod::(__call__) Got in to sampling method >Thread-1044::DEBUG::2014-07-10 08:27:36,172::misc::756::SamplingMethod::(__call__) Trying to enter sampling method (storage.iscsi.rescan) >Thread-1044::DEBUG::2014-07-10 08:27:36,173::misc::758::SamplingMethod::(__call__) Got in to sampling method >Thread-1044::DEBUG::2014-07-10 08:27:36,173::iscsi::407::Storage.ISCSI::(rescan) Performing SCSI scan, this will take up to 30 seconds >Thread-1044::DEBUG::2014-07-10 08:27:36,173::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) '/usr/bin/sudo -n /sbin/iscsiadm -m session -R' (cwd None) >Thread-1044::DEBUG::2014-07-10 08:27:36,242::misc::766::SamplingMethod::(__call__) Returning last result >Thread-1044::DEBUG::2014-07-10 08:27:36,243::multipath::110::Storage.Misc.excCmd::(rescan) '/usr/bin/sudo -n /sbin/multipath -r' (cwd None) >Thread-1044::DEBUG::2014-07-10 08:27:36,334::multipath::110::Storage.Misc.excCmd::(rescan) SUCCESS: <err> = ''; <rc> = 0 >Thread-1044::DEBUG::2014-07-10 08:27:36,335::lvm::497::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-1044::DEBUG::2014-07-10 08:27:36,335::lvm::499::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-1044::DEBUG::2014-07-10 08:27:36,336::lvm::508::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-1044::DEBUG::2014-07-10 08:27:36,336::lvm::510::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-1044::DEBUG::2014-07-10 08:27:36,336::lvm::528::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-1044::DEBUG::2014-07-10 08:27:36,336::lvm::530::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-1044::DEBUG::2014-07-10 08:27:36,337::misc::766::SamplingMethod::(__call__) Returning last result >Thread-1044::INFO::2014-07-10 08:27:36,337::logUtils::47::dispatcher::(wrapper) Run and protect: disconnectStorageServer, Return response: {'statuslist': [{'status': 0, 'id': '21af9f33-77f4-44ce-afd8-ac2b9d767d2d'}, {'status': 0, 'id': 'bf1f6c61-9095-46fa-ae99-483613a91747'}, {'status': 0, 'id': 'e2ffc61c-fdb9-46ce-b87b-7235401ebf49'}, {'status': 0, 'id': 'fa5dd339-edaa-44d5-9807-e488406bb839'}, {'status': 0, 'id': '21af9f33-77f4-44ce-afd8-ac2b9d767d2d'}, {'status': 0, 'id': 'bf1f6c61-9095-46fa-ae99-483613a91747'}, {'status': 0, 'id': 'e2ffc61c-fdb9-46ce-b87b-7235401ebf49'}, {'status': 0, 'id': 'fa5dd339-edaa-44d5-9807-e488406bb839'}]} >Thread-1044::DEBUG::2014-07-10 08:27:36,337::task::1185::TaskManager.Task::(prepare) Task=`52ce8525-8b90-46f4-a845-fc363f66420c`::finished: {'statuslist': [{'status': 0, 'id': '21af9f33-77f4-44ce-afd8-ac2b9d767d2d'}, {'status': 0, 'id': 'bf1f6c61-9095-46fa-ae99-483613a91747'}, {'status': 0, 'id': 'e2ffc61c-fdb9-46ce-b87b-7235401ebf49'}, {'status': 0, 'id': 'fa5dd339-edaa-44d5-9807-e488406bb839'}, {'status': 0, 'id': '21af9f33-77f4-44ce-afd8-ac2b9d767d2d'}, {'status': 0, 'id': 'bf1f6c61-9095-46fa-ae99-483613a91747'}, {'status': 0, 'id': 'e2ffc61c-fdb9-46ce-b87b-7235401ebf49'}, {'status': 0, 'id': 'fa5dd339-edaa-44d5-9807-e488406bb839'}]} >Thread-1044::DEBUG::2014-07-10 08:27:36,337::task::595::TaskManager.Task::(_updateState) Task=`52ce8525-8b90-46f4-a845-fc363f66420c`::moving from state preparing -> state finished >Thread-1044::DEBUG::2014-07-10 08:27:36,338::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-1044::DEBUG::2014-07-10 08:27:36,338::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1044::DEBUG::2014-07-10 08:27:36,338::task::990::TaskManager.Task::(_decref) Task=`52ce8525-8b90-46f4-a845-fc363f66420c`::ref 0 aborting False >Thread-1044::DEBUG::2014-07-10 08:27:39,605::task::595::TaskManager.Task::(_updateState) Task=`7db48d5d-0d88-4fc0-9c78-13817d0c4342`::moving from state init -> state preparing >Thread-1044::INFO::2014-07-10 08:27:39,606::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-1044::INFO::2014-07-10 08:27:39,606::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-1044::DEBUG::2014-07-10 08:27:39,606::task::1185::TaskManager.Task::(prepare) Task=`7db48d5d-0d88-4fc0-9c78-13817d0c4342`::finished: {} >Thread-1044::DEBUG::2014-07-10 08:27:39,606::task::595::TaskManager.Task::(_updateState) Task=`7db48d5d-0d88-4fc0-9c78-13817d0c4342`::moving from state preparing -> state finished >Thread-1044::DEBUG::2014-07-10 08:27:39,607::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-1044::DEBUG::2014-07-10 08:27:39,607::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1044::DEBUG::2014-07-10 08:27:39,607::task::990::TaskManager.Task::(_decref) Task=`7db48d5d-0d88-4fc0-9c78-13817d0c4342`::ref 0 aborting False >Thread-1044::DEBUG::2014-07-10 08:27:54,741::task::595::TaskManager.Task::(_updateState) Task=`94ef6c07-61d9-4817-b62c-268abbd53267`::moving from state init -> state preparing >Thread-1044::INFO::2014-07-10 08:27:54,742::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-1044::INFO::2014-07-10 08:27:54,742::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-1044::DEBUG::2014-07-10 08:27:54,742::task::1185::TaskManager.Task::(prepare) Task=`94ef6c07-61d9-4817-b62c-268abbd53267`::finished: {} >Thread-1044::DEBUG::2014-07-10 08:27:54,742::task::595::TaskManager.Task::(_updateState) Task=`94ef6c07-61d9-4817-b62c-268abbd53267`::moving from state preparing -> state finished >Thread-1044::DEBUG::2014-07-10 08:27:54,743::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-1044::DEBUG::2014-07-10 08:27:54,743::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1044::DEBUG::2014-07-10 08:27:54,743::task::990::TaskManager.Task::(_decref) Task=`94ef6c07-61d9-4817-b62c-268abbd53267`::ref 0 aborting False >Thread-1044::DEBUG::2014-07-10 08:28:03,879::task::595::TaskManager.Task::(_updateState) Task=`553c8b26-d8fe-46f0-b756-331f228a7d57`::moving from state init -> state preparing >Thread-1044::INFO::2014-07-10 08:28:03,879::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-1044::INFO::2014-07-10 08:28:03,880::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-1044::DEBUG::2014-07-10 08:28:03,880::task::1185::TaskManager.Task::(prepare) Task=`553c8b26-d8fe-46f0-b756-331f228a7d57`::finished: {} >Thread-1044::DEBUG::2014-07-10 08:28:03,880::task::595::TaskManager.Task::(_updateState) Task=`553c8b26-d8fe-46f0-b756-331f228a7d57`::moving from state preparing -> state finished >Thread-1044::DEBUG::2014-07-10 08:28:03,880::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-1044::DEBUG::2014-07-10 08:28:03,880::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1044::DEBUG::2014-07-10 08:28:03,880::task::990::TaskManager.Task::(_decref) Task=`553c8b26-d8fe-46f0-b756-331f228a7d57`::ref 0 aborting False >Thread-1044::DEBUG::2014-07-10 08:28:03,979::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-1044::DEBUG::2014-07-10 08:28:03,979::task::595::TaskManager.Task::(_updateState) Task=`afb980db-6070-48d0-b861-547a4b3236ac`::moving from state init -> state preparing >Thread-1044::INFO::2014-07-10 08:28:03,979::logUtils::44::dispatcher::(wrapper) Run and protect: disconnectStoragePool(spUUID='411039e4-4af2-4192-9de0-67dc1ed83ba9', hostID=1, remove=False, options=None) >Thread-1044::WARNING::2014-07-10 08:28:03,980::hsm::1126::Storage.HSM::(disconnectStoragePool) disconnect sp: 411039e4-4af2-4192-9de0-67dc1ed83ba9 failed. Known pools {} >Thread-1044::INFO::2014-07-10 08:28:03,980::logUtils::47::dispatcher::(wrapper) Run and protect: disconnectStoragePool, Return response: None >Thread-1044::DEBUG::2014-07-10 08:28:03,980::task::1185::TaskManager.Task::(prepare) Task=`afb980db-6070-48d0-b861-547a4b3236ac`::finished: None >Thread-1044::DEBUG::2014-07-10 08:28:03,980::task::595::TaskManager.Task::(_updateState) Task=`afb980db-6070-48d0-b861-547a4b3236ac`::moving from state preparing -> state finished >Thread-1044::DEBUG::2014-07-10 08:28:03,980::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-1044::DEBUG::2014-07-10 08:28:03,980::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1044::DEBUG::2014-07-10 08:28:03,981::task::990::TaskManager.Task::(_decref) Task=`afb980db-6070-48d0-b861-547a4b3236ac`::ref 0 aborting False >MainThread::DEBUG::2014-07-10 08:39:02,381::vdsm::55::vds::(sigtermHandler) Received signal 15 >MainThread::INFO::2014-07-10 08:39:03,381::vmChannels::183::vds::(stop) VM channels listener was stopped. >MainThread::INFO::2014-07-10 08:39:03,382::momIF::84::MOM::(stop) Shutting down MOM >MainThread::DEBUG::2014-07-10 08:39:03,383::task::595::TaskManager.Task::(_updateState) Task=`45b1a149-25df-43fb-84c5-9beca7fd7c69`::moving from state init -> state preparing >MainThread::INFO::2014-07-10 08:39:03,383::logUtils::44::dispatcher::(wrapper) Run and protect: prepareForShutdown(options=None) >Thread-11::DEBUG::2014-07-10 08:39:03,384::storageServer::698::ConnectionMonitor::(_monitorConnections) Monitoring stopped >MainThread::DEBUG::2014-07-10 08:39:03,409::sp::384::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/e01a3a36-d2ce-4153-bb57-d6e65b7ed08c/master` is not mounted, skipping >VM Channels Listener::INFO::2014-07-10 08:39:03,472::vmChannels::178::vds::(run) VM channels listener thread has ended. >MainThread::INFO::2014-07-10 08:39:31,894::vdsm::119::vds::(run) (PID: 20255) I am the actual vdsm 4.14.7-3.el6ev ucs1-b420-2.eng.lab.tlv.redhat.com (2.6.32-431.20.3.el6.x86_64) >MainThread::DEBUG::2014-07-10 08:39:31,895::resourceManager::421::ResourceManager::(registerNamespace) Registering namespace 'Storage' >MainThread::DEBUG::2014-07-10 08:39:31,895::threadPool::35::Misc.ThreadPool::(__init__) Enter - numThreads: 10.0, waitTimeout: 3, maxTasks: 500.0 >MainThread::WARNING::2014-07-10 08:39:31,901::fileUtils::167::Storage.fileUtils::(createdir) Dir /rhev/data-center/mnt already exists >MainThread::DEBUG::2014-07-10 08:39:31,921::sp::384::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/e01a3a36-d2ce-4153-bb57-d6e65b7ed08c/master` is not mounted, skipping >MainThread::DEBUG::2014-07-10 08:39:35,436::supervdsm::77::SuperVdsmProxy::(_connect) Trying to connect to Super Vdsm >MainThread::DEBUG::2014-07-10 08:39:35,466::multipath::142::Storage.Multipath::(isEnabled) Current revision of multipath.conf detected, preserving >MainThread::DEBUG::2014-07-10 08:39:35,467::hsm::434::Storage.Misc.excCmd::(__validateLvmLockingType) '/usr/bin/sudo -n /sbin/lvm dumpconfig global/locking_type' (cwd None) >MainThread::DEBUG::2014-07-10 08:39:35,669::hsm::434::Storage.Misc.excCmd::(__validateLvmLockingType) SUCCESS: <err> = ''; <rc> = 0 >MainThread::DEBUG::2014-07-10 08:39:35,670::hsm::458::Storage.HSM::(__cleanStorageRepository) Started cleaning storage repository at '/rhev/data-center' >MainThread::DEBUG::2014-07-10 08:39:35,687::hsm::490::Storage.HSM::(__cleanStorageRepository) White list: ['/rhev/data-center/hsm-tasks', '/rhev/data-center/hsm-tasks/*', '/rhev/data-center/mnt'] >MainThread::DEBUG::2014-07-10 08:39:35,688::hsm::491::Storage.HSM::(__cleanStorageRepository) Mount list: ['/rhev/data-center'] >MainThread::DEBUG::2014-07-10 08:39:35,688::hsm::493::Storage.HSM::(__cleanStorageRepository) Cleaning leftovers >MainThread::DEBUG::2014-07-10 08:39:35,691::hsm::536::Storage.HSM::(__cleanStorageRepository) Finished cleaning storage repository at '/rhev/data-center' >storageRefresh::DEBUG::2014-07-10 08:39:35,692::misc::756::SamplingMethod::(__call__) Trying to enter sampling method (storage.sdc.refreshStorage) >MainThread::INFO::2014-07-10 08:39:35,694::dispatcher::97::Storage.Dispatcher::(__init__) Starting StorageDispatcher... >storageRefresh::DEBUG::2014-07-10 08:39:35,714::misc::758::SamplingMethod::(__call__) Got in to sampling method >storageRefresh::DEBUG::2014-07-10 08:39:35,727::misc::756::SamplingMethod::(__call__) Trying to enter sampling method (storage.iscsi.rescan) >storageRefresh::DEBUG::2014-07-10 08:39:35,729::misc::758::SamplingMethod::(__call__) Got in to sampling method >storageRefresh::DEBUG::2014-07-10 08:39:35,733::iscsi::407::Storage.ISCSI::(rescan) Performing SCSI scan, this will take up to 30 seconds >storageRefresh::DEBUG::2014-07-10 08:39:35,733::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) '/usr/bin/sudo -n /sbin/iscsiadm -m session -R' (cwd None) >storageRefresh::DEBUG::2014-07-10 08:39:35,770::misc::766::SamplingMethod::(__call__) Returning last result >storageRefresh::DEBUG::2014-07-10 08:39:35,770::multipath::110::Storage.Misc.excCmd::(rescan) '/usr/bin/sudo -n /sbin/multipath -r' (cwd None) >MainThread::DEBUG::2014-07-10 08:39:35,793::task::595::TaskManager.Task::(_updateState) Task=`499b79d3-eec2-433f-9475-c3f8c11e8d76`::moving from state init -> state preparing >MainThread::INFO::2014-07-10 08:39:35,794::logUtils::44::dispatcher::(wrapper) Run and protect: registerDomainStateChangeCallback(callbackFunc=<bound method clientIF.contEIOVms of <clientIF.clientIF instance at 0x1d1a518>>) >MainThread::INFO::2014-07-10 08:39:35,794::logUtils::47::dispatcher::(wrapper) Run and protect: registerDomainStateChangeCallback, Return response: None >MainThread::DEBUG::2014-07-10 08:39:35,794::task::1185::TaskManager.Task::(prepare) Task=`499b79d3-eec2-433f-9475-c3f8c11e8d76`::finished: None >MainThread::DEBUG::2014-07-10 08:39:35,794::task::595::TaskManager.Task::(_updateState) Task=`499b79d3-eec2-433f-9475-c3f8c11e8d76`::moving from state preparing -> state finished >MainThread::DEBUG::2014-07-10 08:39:35,794::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >MainThread::DEBUG::2014-07-10 08:39:35,795::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >MainThread::DEBUG::2014-07-10 08:39:35,795::task::990::TaskManager.Task::(_decref) Task=`499b79d3-eec2-433f-9475-c3f8c11e8d76`::ref 0 aborting False >MainThread::INFO::2014-07-10 08:39:35,811::momIF::47::MOM::(__init__) Starting up MOM >MainThread::INFO::2014-07-10 08:39:35,817::vmChannels::187::vds::(settimeout) Setting channels' timeout to 30 seconds. >VM Channels Listener::INFO::2014-07-10 08:39:35,834::vmChannels::170::vds::(run) Starting VM channels listener thread. >clientIFinit::DEBUG::2014-07-10 08:39:35,835::libvirtconnection::145::root::(get) trying to connect libvirt >storageRefresh::DEBUG::2014-07-10 08:39:35,906::multipath::110::Storage.Misc.excCmd::(rescan) SUCCESS: <err> = ''; <rc> = 0 >storageRefresh::DEBUG::2014-07-10 08:39:35,910::lvm::497::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex >storageRefresh::DEBUG::2014-07-10 08:39:35,910::lvm::499::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex >storageRefresh::DEBUG::2014-07-10 08:39:35,910::lvm::508::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex >storageRefresh::DEBUG::2014-07-10 08:39:35,911::lvm::510::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex >storageRefresh::DEBUG::2014-07-10 08:39:35,911::lvm::528::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex >storageRefresh::DEBUG::2014-07-10 08:39:35,911::lvm::530::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex >storageRefresh::DEBUG::2014-07-10 08:39:35,911::misc::766::SamplingMethod::(__call__) Returning last result >storageRefresh::DEBUG::2014-07-10 08:39:35,912::lvm::325::OperationMutex::(_reloadpvs) Operation 'lvm reload operation' got the operation mutex >storageRefresh::DEBUG::2014-07-10 08:39:35,915::lvm::296::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm pvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/3600601601282300032826addbbdae311|/dev/mapper/367cad74c2fcba00019e6afd20c781e67|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,size,vg_name,vg_uuid,pe_start,pe_count,pe_alloc_count,mda_count,dev_size' (cwd None) >Thread-13::DEBUG::2014-07-10 08:39:35,947::BindingXMLRPC::1067::vds::(wrapper) client [10.35.3.13]::call ping with () {} flowID [2abb8506] >Thread-13::DEBUG::2014-07-10 08:39:35,952::BindingXMLRPC::1074::vds::(wrapper) return ping with {'status': {'message': 'Recovering from crash or Initializing', 'code': 99}} >storageRefresh::DEBUG::2014-07-10 08:39:36,141::lvm::296::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ' /dev/mapper/3600601601282300032826addbbdae311: read failed after 0 of 4096 at 1099511562240: Input/output error\n /dev/mapper/3600601601282300032826addbbdae311: read failed after 0 of 4096 at 1099511619584: Input/output error\n /dev/mapper/3600601601282300032826addbbdae311: read failed after 0 of 4096 at 0: Input/output error\n WARNING: Error counts reached a limit of 3. Device /dev/mapper/3600601601282300032826addbbdae311 was disabled\n'; <rc> = 0 >storageRefresh::DEBUG::2014-07-10 08:39:36,146::lvm::350::OperationMutex::(_reloadpvs) Operation 'lvm reload operation' released the operation mutex >storageRefresh::DEBUG::2014-07-10 08:39:36,150::lvm::373::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >storageRefresh::DEBUG::2014-07-10 08:39:36,160::lvm::296::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/3600601601282300032826addbbdae311|/dev/mapper/367cad74c2fcba00019e6afd20c781e67|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name' (cwd None) >storageRefresh::DEBUG::2014-07-10 08:39:36,359::lvm::296::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ' /dev/mapper/3600601601282300032826addbbdae311: read failed after 0 of 4096 at 1099511562240: Input/output error\n /dev/mapper/3600601601282300032826addbbdae311: read failed after 0 of 4096 at 1099511619584: Input/output error\n /dev/mapper/3600601601282300032826addbbdae311: read failed after 0 of 4096 at 0: Input/output error\n WARNING: Error counts reached a limit of 3. Device /dev/mapper/3600601601282300032826addbbdae311 was disabled\n'; <rc> = 0 >storageRefresh::DEBUG::2014-07-10 08:39:36,361::lvm::415::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >storageRefresh::DEBUG::2014-07-10 08:39:36,361::lvm::296::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm lvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/3600601601282300032826addbbdae311|/dev/mapper/367cad74c2fcba00019e6afd20c781e67|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,vg_name,attr,size,seg_start_pe,devices,tags' (cwd None) >Thread-13::DEBUG::2014-07-10 08:39:36,523::BindingXMLRPC::1067::vds::(wrapper) client [10.35.3.13]::call ping with () {} flowID [2abb8506] >Thread-13::DEBUG::2014-07-10 08:39:36,523::BindingXMLRPC::1074::vds::(wrapper) return ping with {'status': {'message': 'Recovering from crash or Initializing', 'code': 99}} >storageRefresh::DEBUG::2014-07-10 08:39:36,544::lvm::296::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ' /dev/mapper/3600601601282300032826addbbdae311: read failed after 0 of 4096 at 1099511562240: Input/output error\n /dev/mapper/3600601601282300032826addbbdae311: read failed after 0 of 4096 at 1099511619584: Input/output error\n /dev/mapper/3600601601282300032826addbbdae311: read failed after 0 of 4096 at 0: Input/output error\n WARNING: Error counts reached a limit of 3. Device /dev/mapper/3600601601282300032826addbbdae311 was disabled\n'; <rc> = 0 >storageRefresh::DEBUG::2014-07-10 08:39:36,549::lvm::661::Storage.LVM::(bootstrap) Skipping open lv: vg=HostVG lv=Data >storageRefresh::DEBUG::2014-07-10 08:39:36,549::lvm::661::Storage.LVM::(bootstrap) Skipping open lv: vg=HostVG lv=Logging >storageRefresh::DEBUG::2014-07-10 08:39:36,549::lvm::661::Storage.LVM::(bootstrap) Skipping open lv: vg=HostVG lv=Config >storageRefresh::DEBUG::2014-07-10 08:39:36,549::lvm::661::Storage.LVM::(bootstrap) Skipping open lv: vg=HostVG lv=Swap >storageRefresh::WARNING::2014-07-10 08:39:36,551::fileUtils::167::Storage.fileUtils::(createdir) Dir /rhev/data-center/hsm-tasks already exists >storageRefresh::DEBUG::2014-07-10 08:39:36,552::hsm::393::Storage.HSM::(storageRefresh) HSM is ready >Thread-13::DEBUG::2014-07-10 08:39:37,030::BindingXMLRPC::1067::vds::(wrapper) client [10.35.3.13]::call ping with () {} flowID [2abb8506] >Thread-13::DEBUG::2014-07-10 08:39:37,031::BindingXMLRPC::1074::vds::(wrapper) return ping with {'status': {'message': 'Done', 'code': 0}} >Thread-13::DEBUG::2014-07-10 08:39:37,039::BindingXMLRPC::1067::vds::(wrapper) client [10.35.3.13]::call getCapabilities with () {} flowID [2abb8506] >Thread-13::DEBUG::2014-07-10 08:39:37,129::utils::642::root::(execCmd) '/sbin/ip route show to 0.0.0.0/0 table all' (cwd None) >Thread-13::DEBUG::2014-07-10 08:39:37,150::utils::662::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-13::DEBUG::2014-07-10 08:39:37,245::BindingXMLRPC::1074::vds::(wrapper) return getCapabilities with {'status': {'message': 'Done', 'code': 0}, 'info': {'HBAInventory': {'iSCSI': [{'InitiatorName': 'iqn.1994-05.com.redhat:6e278f1bf57'}], 'FC': [{'wwpn': '20000025b50a0004', 'wwnn': '20000025b5ff0004', 'model': 'Unknown - Unknown'}, {'wwpn': '20000025b50b0004', 'wwnn': '20000025b5ff0004', 'model': 'Unknown - Unknown'}]}, 'packages2': {'kernel': {'release': '431.20.3.el6.x86_64', 'buildtime': 1402079454.0, 'version': '2.6.32'}, 'spice-server': {'release': '6.el6_5.2', 'buildtime': 1401730350L, 'version': '0.12.4'}, 'vdsm': {'release': '3.el6ev', 'buildtime': 1400591891L, 'version': '4.14.7'}, 'qemu-kvm': {'release': '2.415.el6_5.10', 'buildtime': 1401300739L, 'version': '0.12.1.2'}, 'libvirt': {'release': '29.el6_5.9', 'buildtime': 1401355377L, 'version': '0.10.2'}, 'qemu-img': {'release': '2.415.el6_5.10', 'buildtime': 1401300739L, 'version': '0.12.1.2'}, 'mom': {'release': '1.el6ev', 'buildtime': 1392224015L, 'version': '0.4.0'}}, 'cpuModel': 'Intel(R) Xeon(R) CPU E5-4620 0 @ 2.20GHz', 'hooks': {'before_vm_start': {'50_vhostmd': {'md5': 'f3ee6dbf6fbd01333bd3e32afec4fbba'}}, 'after_vm_destroy': {'50_vhostmd': {'md5': '92498ed80c0219749829ecce2813fc7c'}}, 'before_vm_dehibernate': {'50_vhostmd': {'md5': 'f3ee6dbf6fbd01333bd3e32afec4fbba'}}, 'before_vm_migrate_destination': {'50_vhostmd': {'md5': 'f3ee6dbf6fbd01333bd3e32afec4fbba'}}}, 'cpuSockets': '4', 'vmTypes': ['kvm'], 'supportedProtocols': ['2.2', '2.3'], 'networks': {'rhevm': {'iface': 'rhevm', 'addr': '10.35.19.153', 'cfg': {'IPADDR': '10.35.19.153', 'PEERDNS': 'no', 'GATEWAY': '10.35.19.254', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'NETMASK': '255.255.252.0', 'BOOTPROTO': 'none', 'STP': 'no', 'DEVICE': 'rhevm', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'ipv6addrs': ['fe80::225:b5ff:fe0a:c/64'], 'gateway': '10.35.19.254', 'netmask': '255.255.252.0', 'stp': 'off', 'bridged': True, 'mtu': '1500', 'ipv6gateway': '::', 'ports': ['bond0']}}, 'bridges': {'rhevm': {'addr': '10.35.19.153', 'cfg': {'IPADDR': '10.35.19.153', 'PEERDNS': 'no', 'GATEWAY': '10.35.19.254', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'NETMASK': '255.255.252.0', 'BOOTPROTO': 'none', 'STP': 'no', 'DEVICE': 'rhevm', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'ipv6addrs': ['fe80::225:b5ff:fe0a:c/64'], 'mtu': '1500', 'netmask': '255.255.252.0', 'stp': 'off', 'ipv6gateway': '::', 'gateway': '10.35.19.254', 'ports': ['bond0']}, ';vdsmdummy;': {'addr': '', 'cfg': {}, 'ipv6addrs': [], 'mtu': '1500', 'netmask': '', 'stp': 'off', 'ipv6gateway': '::', 'gateway': '', 'ports': []}}, 'uuid': '52BAF97B-FF2F-E311-0000-100000000005', 'lastClientIface': 'rhevm', 'nics': {'eth1': {'netmask': '', 'addr': '', 'hwaddr': '00:25:b5:0a:00:0c', 'cfg': {'SLAVE': 'yes', 'NM_CONTROLLED': 'no', 'PEERDNS': 'no', 'HWADDR': '00:25:b5:0b:00:0c', 'MASTER': 'bond0', 'DEVICE': 'eth1', 'STP': 'no', 'ONBOOT': 'yes'}, 'ipv6addrs': [], 'permhwaddr': '00:25:B5:0B:00:0C', 'speed': 10240, 'mtu': '1500'}, 'eth0': {'netmask': '', 'addr': '', 'hwaddr': '00:25:b5:0a:00:0c', 'cfg': {'SLAVE': 'yes', 'NM_CONTROLLED': 'no', 'PEERDNS': 'no', 'HWADDR': '00:25:b5:0a:00:0c', 'MASTER': 'bond0', 'DEVICE': 'eth0', 'STP': 'no', 'ONBOOT': 'yes'}, 'ipv6addrs': [], 'permhwaddr': '00:25:B5:0A:00:0C', 'speed': 10240, 'mtu': '1500'}}, 'software_revision': '3', 'management_ip': '0.0.0.0', 'clusterLevels': ['3.0', '3.1', '3.2', '3.3', '3.4'], 'cpuFlags': u'fpu,vme,de,pse,tsc,msr,pae,mce,cx8,apic,sep,mtrr,pge,mca,cmov,pat,pse36,clflush,dts,acpi,mmx,fxsr,sse,sse2,ss,ht,tm,pbe,syscall,nx,pdpe1gb,rdtscp,lm,constant_tsc,arch_perfmon,pebs,bts,rep_good,xtopology,nonstop_tsc,aperfmperf,pni,pclmulqdq,dtes64,monitor,ds_cpl,vmx,smx,est,tm2,ssse3,cx16,xtpr,pdcm,pcid,dca,sse4_1,sse4_2,x2apic,popcnt,tsc_deadline_timer,aes,xsave,avx,lahf_lm,ida,arat,epb,xsaveopt,pln,pts,dts,tpr_shadow,vnmi,flexpriority,ept,vpid,model_Nehalem,model_Conroe,model_coreduo,model_core2duo,model_Penryn,model_Westmere,model_n270,model_SandyBridge', 'ISCSIInitiatorName': 'iqn.1994-05.com.redhat:6e278f1bf57', 'netConfigDirty': 'False', 'supportedENGINEs': ['3.0', '3.1', '3.2', '3.3', '3.4'], 'reservedMem': '321', 'bondings': {'bond4': {'netmask': '', 'addr': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00', 'cfg': {}, 'ipv6addrs': [], 'mtu': '1500'}, 'bond0': {'netmask': '', 'addr': '', 'slaves': ['eth0', 'eth1'], 'hwaddr': '00:25:b5:0a:00:0c', 'cfg': {'BRIDGE': 'rhevm', 'PEERDNS': 'no', 'NM_CONTROLLED': 'no', 'STP': 'no', 'BONDING_OPTS': 'mode=4', 'DEVICE': 'bond0', 'ONBOOT': 'yes'}, 'ipv6addrs': ['fe80::225:b5ff:fe0a:c/64'], 'mtu': '1500'}, 'bond1': {'netmask': '', 'addr': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00', 'cfg': {}, 'ipv6addrs': [], 'mtu': '1500'}, 'bond2': {'netmask': '', 'addr': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00', 'cfg': {}, 'ipv6addrs': [], 'mtu': '1500'}, 'bond3': {'netmask': '', 'addr': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00', 'cfg': {}, 'ipv6addrs': [], 'mtu': '1500'}}, 'software_version': '4.14', 'memSize': '387598', 'cpuSpeed': '2199.885', 'version_name': 'Snow Man', 'vlans': {}, 'cpuCores': '32', 'kvmEnabled': 'true', 'guestOverhead': '65', 'supportedRHEVMs': ['3.0'], 'cpuThreads': '64', 'emulatedMachines': [u'rhel6.5.0', u'pc', u'rhel6.4.0', u'rhel6.3.0', u'rhel6.2.0', u'rhel6.1.0', u'rhel6.0.0', u'rhel5.5.0', u'rhel5.4.4', u'rhel5.4.0'], 'rngSources': ['random'], 'operatingSystem': {'release': '20140624.0.el6ev', 'version': '6.5', 'name': 'RHEV Hypervisor'}, 'lastClient': '10.35.3.13'}} >Thread-13::DEBUG::2014-07-10 08:39:39,177::BindingXMLRPC::1067::vds::(wrapper) client [10.35.3.13]::call getCapabilities with () {} >Thread-13::DEBUG::2014-07-10 08:39:39,183::utils::642::root::(execCmd) '/sbin/ip route show to 0.0.0.0/0 table all' (cwd None) >Thread-13::DEBUG::2014-07-10 08:39:39,196::utils::662::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-13::DEBUG::2014-07-10 08:39:39,266::BindingXMLRPC::1074::vds::(wrapper) return getCapabilities with {'status': {'message': 'Done', 'code': 0}, 'info': {'HBAInventory': {'iSCSI': [{'InitiatorName': 'iqn.1994-05.com.redhat:6e278f1bf57'}], 'FC': [{'wwpn': '20000025b50a0004', 'wwnn': '20000025b5ff0004', 'model': 'Unknown - Unknown'}, {'wwpn': '20000025b50b0004', 'wwnn': '20000025b5ff0004', 'model': 'Unknown - Unknown'}]}, 'packages2': {'kernel': {'release': '431.20.3.el6.x86_64', 'buildtime': 1402079454.0, 'version': '2.6.32'}, 'spice-server': {'release': '6.el6_5.2', 'buildtime': 1401730350L, 'version': '0.12.4'}, 'vdsm': {'release': '3.el6ev', 'buildtime': 1400591891L, 'version': '4.14.7'}, 'qemu-kvm': {'release': '2.415.el6_5.10', 'buildtime': 1401300739L, 'version': '0.12.1.2'}, 'libvirt': {'release': '29.el6_5.9', 'buildtime': 1401355377L, 'version': '0.10.2'}, 'qemu-img': {'release': '2.415.el6_5.10', 'buildtime': 1401300739L, 'version': '0.12.1.2'}, 'mom': {'release': '1.el6ev', 'buildtime': 1392224015L, 'version': '0.4.0'}}, 'cpuModel': 'Intel(R) Xeon(R) CPU E5-4620 0 @ 2.20GHz', 'hooks': {'before_vm_start': {'50_vhostmd': {'md5': 'f3ee6dbf6fbd01333bd3e32afec4fbba'}}, 'after_vm_destroy': {'50_vhostmd': {'md5': '92498ed80c0219749829ecce2813fc7c'}}, 'before_vm_dehibernate': {'50_vhostmd': {'md5': 'f3ee6dbf6fbd01333bd3e32afec4fbba'}}, 'before_vm_migrate_destination': {'50_vhostmd': {'md5': 'f3ee6dbf6fbd01333bd3e32afec4fbba'}}}, 'cpuSockets': '4', 'vmTypes': ['kvm'], 'supportedProtocols': ['2.2', '2.3'], 'networks': {'rhevm': {'iface': 'rhevm', 'addr': '10.35.19.153', 'cfg': {'IPADDR': '10.35.19.153', 'PEERDNS': 'no', 'GATEWAY': '10.35.19.254', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'NETMASK': '255.255.252.0', 'BOOTPROTO': 'none', 'STP': 'no', 'DEVICE': 'rhevm', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'ipv6addrs': ['fe80::225:b5ff:fe0a:c/64'], 'gateway': '10.35.19.254', 'netmask': '255.255.252.0', 'stp': 'off', 'bridged': True, 'mtu': '1500', 'ipv6gateway': '::', 'ports': ['bond0']}}, 'bridges': {'rhevm': {'addr': '10.35.19.153', 'cfg': {'IPADDR': '10.35.19.153', 'PEERDNS': 'no', 'GATEWAY': '10.35.19.254', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'NETMASK': '255.255.252.0', 'BOOTPROTO': 'none', 'STP': 'no', 'DEVICE': 'rhevm', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'ipv6addrs': ['fe80::225:b5ff:fe0a:c/64'], 'mtu': '1500', 'netmask': '255.255.252.0', 'stp': 'off', 'ipv6gateway': '::', 'gateway': '10.35.19.254', 'ports': ['bond0']}, ';vdsmdummy;': {'addr': '', 'cfg': {}, 'ipv6addrs': [], 'mtu': '1500', 'netmask': '', 'stp': 'off', 'ipv6gateway': '::', 'gateway': '', 'ports': []}}, 'uuid': '52BAF97B-FF2F-E311-0000-100000000005', 'lastClientIface': 'rhevm', 'nics': {'eth1': {'netmask': '', 'addr': '', 'hwaddr': '00:25:b5:0a:00:0c', 'cfg': {'SLAVE': 'yes', 'NM_CONTROLLED': 'no', 'PEERDNS': 'no', 'HWADDR': '00:25:b5:0b:00:0c', 'MASTER': 'bond0', 'DEVICE': 'eth1', 'STP': 'no', 'ONBOOT': 'yes'}, 'ipv6addrs': [], 'permhwaddr': '00:25:B5:0B:00:0C', 'speed': 10240, 'mtu': '1500'}, 'eth0': {'netmask': '', 'addr': '', 'hwaddr': '00:25:b5:0a:00:0c', 'cfg': {'SLAVE': 'yes', 'NM_CONTROLLED': 'no', 'PEERDNS': 'no', 'HWADDR': '00:25:b5:0a:00:0c', 'MASTER': 'bond0', 'DEVICE': 'eth0', 'STP': 'no', 'ONBOOT': 'yes'}, 'ipv6addrs': [], 'permhwaddr': '00:25:B5:0A:00:0C', 'speed': 10240, 'mtu': '1500'}}, 'software_revision': '3', 'management_ip': '0.0.0.0', 'clusterLevels': ['3.0', '3.1', '3.2', '3.3', '3.4'], 'cpuFlags': u'fpu,vme,de,pse,tsc,msr,pae,mce,cx8,apic,sep,mtrr,pge,mca,cmov,pat,pse36,clflush,dts,acpi,mmx,fxsr,sse,sse2,ss,ht,tm,pbe,syscall,nx,pdpe1gb,rdtscp,lm,constant_tsc,arch_perfmon,pebs,bts,rep_good,xtopology,nonstop_tsc,aperfmperf,pni,pclmulqdq,dtes64,monitor,ds_cpl,vmx,smx,est,tm2,ssse3,cx16,xtpr,pdcm,pcid,dca,sse4_1,sse4_2,x2apic,popcnt,tsc_deadline_timer,aes,xsave,avx,lahf_lm,ida,arat,epb,xsaveopt,pln,pts,dts,tpr_shadow,vnmi,flexpriority,ept,vpid,model_Nehalem,model_Conroe,model_coreduo,model_core2duo,model_Penryn,model_Westmere,model_n270,model_SandyBridge', 'ISCSIInitiatorName': 'iqn.1994-05.com.redhat:6e278f1bf57', 'netConfigDirty': 'False', 'supportedENGINEs': ['3.0', '3.1', '3.2', '3.3', '3.4'], 'reservedMem': '321', 'bondings': {'bond4': {'netmask': '', 'addr': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00', 'cfg': {}, 'ipv6addrs': [], 'mtu': '1500'}, 'bond0': {'netmask': '', 'addr': '', 'slaves': ['eth0', 'eth1'], 'hwaddr': '00:25:b5:0a:00:0c', 'cfg': {'BRIDGE': 'rhevm', 'PEERDNS': 'no', 'NM_CONTROLLED': 'no', 'STP': 'no', 'BONDING_OPTS': 'mode=4', 'DEVICE': 'bond0', 'ONBOOT': 'yes'}, 'ipv6addrs': ['fe80::225:b5ff:fe0a:c/64'], 'mtu': '1500'}, 'bond1': {'netmask': '', 'addr': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00', 'cfg': {}, 'ipv6addrs': [], 'mtu': '1500'}, 'bond2': {'netmask': '', 'addr': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00', 'cfg': {}, 'ipv6addrs': [], 'mtu': '1500'}, 'bond3': {'netmask': '', 'addr': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00', 'cfg': {}, 'ipv6addrs': [], 'mtu': '1500'}}, 'software_version': '4.14', 'memSize': '387598', 'cpuSpeed': '2199.885', 'version_name': 'Snow Man', 'vlans': {}, 'cpuCores': '32', 'kvmEnabled': 'true', 'guestOverhead': '65', 'supportedRHEVMs': ['3.0'], 'cpuThreads': '64', 'emulatedMachines': [u'rhel6.5.0', u'pc', u'rhel6.4.0', u'rhel6.3.0', u'rhel6.2.0', u'rhel6.1.0', u'rhel6.0.0', u'rhel5.5.0', u'rhel5.4.4', u'rhel5.4.0'], 'rngSources': ['random'], 'operatingSystem': {'release': '20140624.0.el6ev', 'version': '6.5', 'name': 'RHEV Hypervisor'}, 'lastClient': '10.35.3.13'}} >Thread-13::DEBUG::2014-07-10 08:39:39,295::BindingXMLRPC::1067::vds::(wrapper) client [10.35.3.13]::call getHardwareInfo with () {} >Thread-13::DEBUG::2014-07-10 08:39:39,416::BindingXMLRPC::1074::vds::(wrapper) return getHardwareInfo with {'status': {'message': 'Done', 'code': 0}, 'info': {'systemProductName': 'UCSB-B420-M3', 'systemSerialNumber': 'FCH1710J7E7', 'systemFamily': '', 'systemVersion': '1', 'systemUUID': '52BAF97B-FF2F-E311-0000-100000000005', 'systemManufacturer': 'Cisco Systems Inc'}} >Thread-13::DEBUG::2014-07-10 08:39:39,522::BindingXMLRPC::1067::vds::(wrapper) client [10.35.3.13]::call getCapabilities with () {} flowID [f3fa4ac] >Thread-13::DEBUG::2014-07-10 08:39:39,529::utils::642::root::(execCmd) '/sbin/ip route show to 0.0.0.0/0 table all' (cwd None) >Thread-13::DEBUG::2014-07-10 08:39:39,555::utils::662::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-13::DEBUG::2014-07-10 08:39:39,629::BindingXMLRPC::1074::vds::(wrapper) return getCapabilities with {'status': {'message': 'Done', 'code': 0}, 'info': {'HBAInventory': {'iSCSI': [{'InitiatorName': 'iqn.1994-05.com.redhat:6e278f1bf57'}], 'FC': [{'wwpn': '20000025b50a0004', 'wwnn': '20000025b5ff0004', 'model': 'Unknown - Unknown'}, {'wwpn': '20000025b50b0004', 'wwnn': '20000025b5ff0004', 'model': 'Unknown - Unknown'}]}, 'packages2': {'kernel': {'release': '431.20.3.el6.x86_64', 'buildtime': 1402079454.0, 'version': '2.6.32'}, 'spice-server': {'release': '6.el6_5.2', 'buildtime': 1401730350L, 'version': '0.12.4'}, 'vdsm': {'release': '3.el6ev', 'buildtime': 1400591891L, 'version': '4.14.7'}, 'qemu-kvm': {'release': '2.415.el6_5.10', 'buildtime': 1401300739L, 'version': '0.12.1.2'}, 'libvirt': {'release': '29.el6_5.9', 'buildtime': 1401355377L, 'version': '0.10.2'}, 'qemu-img': {'release': '2.415.el6_5.10', 'buildtime': 1401300739L, 'version': '0.12.1.2'}, 'mom': {'release': '1.el6ev', 'buildtime': 1392224015L, 'version': '0.4.0'}}, 'cpuModel': 'Intel(R) Xeon(R) CPU E5-4620 0 @ 2.20GHz', 'hooks': {'before_vm_start': {'50_vhostmd': {'md5': 'f3ee6dbf6fbd01333bd3e32afec4fbba'}}, 'after_vm_destroy': {'50_vhostmd': {'md5': '92498ed80c0219749829ecce2813fc7c'}}, 'before_vm_dehibernate': {'50_vhostmd': {'md5': 'f3ee6dbf6fbd01333bd3e32afec4fbba'}}, 'before_vm_migrate_destination': {'50_vhostmd': {'md5': 'f3ee6dbf6fbd01333bd3e32afec4fbba'}}}, 'cpuSockets': '4', 'vmTypes': ['kvm'], 'supportedProtocols': ['2.2', '2.3'], 'networks': {'rhevm': {'iface': 'rhevm', 'addr': '10.35.19.153', 'cfg': {'IPADDR': '10.35.19.153', 'PEERDNS': 'no', 'GATEWAY': '10.35.19.254', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'NETMASK': '255.255.252.0', 'BOOTPROTO': 'none', 'STP': 'no', 'DEVICE': 'rhevm', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'ipv6addrs': ['fe80::225:b5ff:fe0a:c/64'], 'gateway': '10.35.19.254', 'netmask': '255.255.252.0', 'stp': 'off', 'bridged': True, 'mtu': '1500', 'ipv6gateway': '::', 'ports': ['bond0']}}, 'bridges': {'rhevm': {'addr': '10.35.19.153', 'cfg': {'IPADDR': '10.35.19.153', 'PEERDNS': 'no', 'GATEWAY': '10.35.19.254', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'NETMASK': '255.255.252.0', 'BOOTPROTO': 'none', 'STP': 'no', 'DEVICE': 'rhevm', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'ipv6addrs': ['fe80::225:b5ff:fe0a:c/64'], 'mtu': '1500', 'netmask': '255.255.252.0', 'stp': 'off', 'ipv6gateway': '::', 'gateway': '10.35.19.254', 'ports': ['bond0']}, ';vdsmdummy;': {'addr': '', 'cfg': {}, 'ipv6addrs': [], 'mtu': '1500', 'netmask': '', 'stp': 'off', 'ipv6gateway': '::', 'gateway': '', 'ports': []}}, 'uuid': '52BAF97B-FF2F-E311-0000-100000000005', 'lastClientIface': 'rhevm', 'nics': {'eth1': {'netmask': '', 'addr': '', 'hwaddr': '00:25:b5:0a:00:0c', 'cfg': {'SLAVE': 'yes', 'NM_CONTROLLED': 'no', 'PEERDNS': 'no', 'HWADDR': '00:25:b5:0b:00:0c', 'MASTER': 'bond0', 'DEVICE': 'eth1', 'STP': 'no', 'ONBOOT': 'yes'}, 'ipv6addrs': [], 'permhwaddr': '00:25:B5:0B:00:0C', 'speed': 10240, 'mtu': '1500'}, 'eth0': {'netmask': '', 'addr': '', 'hwaddr': '00:25:b5:0a:00:0c', 'cfg': {'SLAVE': 'yes', 'NM_CONTROLLED': 'no', 'PEERDNS': 'no', 'HWADDR': '00:25:b5:0a:00:0c', 'MASTER': 'bond0', 'DEVICE': 'eth0', 'STP': 'no', 'ONBOOT': 'yes'}, 'ipv6addrs': [], 'permhwaddr': '00:25:B5:0A:00:0C', 'speed': 10240, 'mtu': '1500'}}, 'software_revision': '3', 'management_ip': '0.0.0.0', 'clusterLevels': ['3.0', '3.1', '3.2', '3.3', '3.4'], 'cpuFlags': u'fpu,vme,de,pse,tsc,msr,pae,mce,cx8,apic,sep,mtrr,pge,mca,cmov,pat,pse36,clflush,dts,acpi,mmx,fxsr,sse,sse2,ss,ht,tm,pbe,syscall,nx,pdpe1gb,rdtscp,lm,constant_tsc,arch_perfmon,pebs,bts,rep_good,xtopology,nonstop_tsc,aperfmperf,pni,pclmulqdq,dtes64,monitor,ds_cpl,vmx,smx,est,tm2,ssse3,cx16,xtpr,pdcm,pcid,dca,sse4_1,sse4_2,x2apic,popcnt,tsc_deadline_timer,aes,xsave,avx,lahf_lm,ida,arat,epb,xsaveopt,pln,pts,dts,tpr_shadow,vnmi,flexpriority,ept,vpid,model_Nehalem,model_Conroe,model_coreduo,model_core2duo,model_Penryn,model_Westmere,model_n270,model_SandyBridge', 'ISCSIInitiatorName': 'iqn.1994-05.com.redhat:6e278f1bf57', 'netConfigDirty': 'False', 'supportedENGINEs': ['3.0', '3.1', '3.2', '3.3', '3.4'], 'reservedMem': '321', 'bondings': {'bond4': {'netmask': '', 'addr': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00', 'cfg': {}, 'ipv6addrs': [], 'mtu': '1500'}, 'bond0': {'netmask': '', 'addr': '', 'slaves': ['eth0', 'eth1'], 'hwaddr': '00:25:b5:0a:00:0c', 'cfg': {'BRIDGE': 'rhevm', 'PEERDNS': 'no', 'NM_CONTROLLED': 'no', 'STP': 'no', 'BONDING_OPTS': 'mode=4', 'DEVICE': 'bond0', 'ONBOOT': 'yes'}, 'ipv6addrs': ['fe80::225:b5ff:fe0a:c/64'], 'mtu': '1500'}, 'bond1': {'netmask': '', 'addr': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00', 'cfg': {}, 'ipv6addrs': [], 'mtu': '1500'}, 'bond2': {'netmask': '', 'addr': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00', 'cfg': {}, 'ipv6addrs': [], 'mtu': '1500'}, 'bond3': {'netmask': '', 'addr': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00', 'cfg': {}, 'ipv6addrs': [], 'mtu': '1500'}}, 'software_version': '4.14', 'memSize': '387598', 'cpuSpeed': '2199.885', 'version_name': 'Snow Man', 'vlans': {}, 'cpuCores': '32', 'kvmEnabled': 'true', 'guestOverhead': '65', 'supportedRHEVMs': ['3.0'], 'cpuThreads': '64', 'emulatedMachines': [u'rhel6.5.0', u'pc', u'rhel6.4.0', u'rhel6.3.0', u'rhel6.2.0', u'rhel6.1.0', u'rhel6.0.0', u'rhel5.5.0', u'rhel5.4.4', u'rhel5.4.0'], 'rngSources': ['random'], 'operatingSystem': {'release': '20140624.0.el6ev', 'version': '6.5', 'name': 'RHEV Hypervisor'}, 'lastClient': '10.35.3.13'}} >Thread-13::DEBUG::2014-07-10 08:39:39,645::BindingXMLRPC::1067::vds::(wrapper) client [10.35.3.13]::call getHardwareInfo with () {} flowID [f3fa4ac] >Thread-13::DEBUG::2014-07-10 08:39:39,646::BindingXMLRPC::1074::vds::(wrapper) return getHardwareInfo with {'status': {'message': 'Done', 'code': 0}, 'info': {'systemProductName': 'UCSB-B420-M3', 'systemSerialNumber': 'FCH1710J7E7', 'systemFamily': '', 'systemVersion': '1', 'systemUUID': '52BAF97B-FF2F-E311-0000-100000000005', 'systemManufacturer': 'Cisco Systems Inc'}} >Thread-13::DEBUG::2014-07-10 08:39:39,777::BindingXMLRPC::1067::vds::(wrapper) client [10.35.3.13]::call setMOMPolicyParameters with ({'balloonEnabled': False, 'ksmEnabled': False},) {} flowID [3df14f92] >Thread-13::DEBUG::2014-07-10 08:39:39,894::BindingXMLRPC::1074::vds::(wrapper) return setMOMPolicyParameters with {'status': {'message': 'Done', 'code': 0}} >Thread-13::DEBUG::2014-07-10 08:39:49,034::task::595::TaskManager.Task::(_updateState) Task=`8b5f1a28-00a9-4ddf-a1e2-bab00cc21550`::moving from state init -> state preparing >Thread-13::INFO::2014-07-10 08:39:49,035::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-13::INFO::2014-07-10 08:39:49,035::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-13::DEBUG::2014-07-10 08:39:49,035::task::1185::TaskManager.Task::(prepare) Task=`8b5f1a28-00a9-4ddf-a1e2-bab00cc21550`::finished: {} >Thread-13::DEBUG::2014-07-10 08:39:49,035::task::595::TaskManager.Task::(_updateState) Task=`8b5f1a28-00a9-4ddf-a1e2-bab00cc21550`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-07-10 08:39:49,035::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-07-10 08:39:49,035::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-07-10 08:39:49,036::task::990::TaskManager.Task::(_decref) Task=`8b5f1a28-00a9-4ddf-a1e2-bab00cc21550`::ref 0 aborting False >Thread-13::DEBUG::2014-07-10 08:40:04,188::task::595::TaskManager.Task::(_updateState) Task=`837ee157-9b31-4173-bda8-ee208163f88a`::moving from state init -> state preparing >Thread-13::INFO::2014-07-10 08:40:04,188::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-13::INFO::2014-07-10 08:40:04,189::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-13::DEBUG::2014-07-10 08:40:04,189::task::1185::TaskManager.Task::(prepare) Task=`837ee157-9b31-4173-bda8-ee208163f88a`::finished: {} >Thread-13::DEBUG::2014-07-10 08:40:04,189::task::595::TaskManager.Task::(_updateState) Task=`837ee157-9b31-4173-bda8-ee208163f88a`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-07-10 08:40:04,189::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-07-10 08:40:04,189::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-07-10 08:40:04,189::task::990::TaskManager.Task::(_decref) Task=`837ee157-9b31-4173-bda8-ee208163f88a`::ref 0 aborting False >Thread-13::DEBUG::2014-07-10 08:40:19,341::task::595::TaskManager.Task::(_updateState) Task=`e8966c0c-941e-400d-b79d-f2c3d9988caf`::moving from state init -> state preparing >Thread-13::INFO::2014-07-10 08:40:19,342::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-13::INFO::2014-07-10 08:40:19,342::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-13::DEBUG::2014-07-10 08:40:19,342::task::1185::TaskManager.Task::(prepare) Task=`e8966c0c-941e-400d-b79d-f2c3d9988caf`::finished: {} >Thread-13::DEBUG::2014-07-10 08:40:19,342::task::595::TaskManager.Task::(_updateState) Task=`e8966c0c-941e-400d-b79d-f2c3d9988caf`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-07-10 08:40:19,343::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-07-10 08:40:19,343::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-07-10 08:40:19,343::task::990::TaskManager.Task::(_decref) Task=`e8966c0c-941e-400d-b79d-f2c3d9988caf`::ref 0 aborting False >Thread-13::DEBUG::2014-07-10 08:40:34,492::task::595::TaskManager.Task::(_updateState) Task=`82b44969-36d7-46d1-be45-845959230573`::moving from state init -> state preparing >Thread-13::INFO::2014-07-10 08:40:34,492::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-13::INFO::2014-07-10 08:40:34,493::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-13::DEBUG::2014-07-10 08:40:34,493::task::1185::TaskManager.Task::(prepare) Task=`82b44969-36d7-46d1-be45-845959230573`::finished: {} >Thread-13::DEBUG::2014-07-10 08:40:34,493::task::595::TaskManager.Task::(_updateState) Task=`82b44969-36d7-46d1-be45-845959230573`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-07-10 08:40:34,493::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-07-10 08:40:34,493::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-07-10 08:40:34,493::task::990::TaskManager.Task::(_decref) Task=`82b44969-36d7-46d1-be45-845959230573`::ref 0 aborting False >Thread-13::DEBUG::2014-07-10 08:40:49,630::task::595::TaskManager.Task::(_updateState) Task=`6fda5e79-b8d9-4995-968c-6dd3fb348769`::moving from state init -> state preparing >Thread-13::INFO::2014-07-10 08:40:49,630::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-13::INFO::2014-07-10 08:40:49,630::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-13::DEBUG::2014-07-10 08:40:49,631::task::1185::TaskManager.Task::(prepare) Task=`6fda5e79-b8d9-4995-968c-6dd3fb348769`::finished: {} >Thread-13::DEBUG::2014-07-10 08:40:49,631::task::595::TaskManager.Task::(_updateState) Task=`6fda5e79-b8d9-4995-968c-6dd3fb348769`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-07-10 08:40:49,631::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-07-10 08:40:49,631::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-07-10 08:40:49,631::task::990::TaskManager.Task::(_decref) Task=`6fda5e79-b8d9-4995-968c-6dd3fb348769`::ref 0 aborting False >Thread-13::DEBUG::2014-07-10 08:41:04,780::task::595::TaskManager.Task::(_updateState) Task=`3d5f1369-2127-4a7b-80f8-86e5d9670b88`::moving from state init -> state preparing >Thread-13::INFO::2014-07-10 08:41:04,781::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-13::INFO::2014-07-10 08:41:04,781::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-13::DEBUG::2014-07-10 08:41:04,781::task::1185::TaskManager.Task::(prepare) Task=`3d5f1369-2127-4a7b-80f8-86e5d9670b88`::finished: {} >Thread-13::DEBUG::2014-07-10 08:41:04,781::task::595::TaskManager.Task::(_updateState) Task=`3d5f1369-2127-4a7b-80f8-86e5d9670b88`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-07-10 08:41:04,781::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-07-10 08:41:04,782::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-07-10 08:41:04,782::task::990::TaskManager.Task::(_decref) Task=`3d5f1369-2127-4a7b-80f8-86e5d9670b88`::ref 0 aborting False >MainThread::DEBUG::2014-07-10 08:41:31,781::vdsm::55::vds::(sigtermHandler) Received signal 15 >MainThread::INFO::2014-07-10 08:41:32,092::vmChannels::183::vds::(stop) VM channels listener was stopped. >MainThread::INFO::2014-07-10 08:41:32,092::momIF::84::MOM::(stop) Shutting down MOM >MainThread::DEBUG::2014-07-10 08:41:32,093::task::595::TaskManager.Task::(_updateState) Task=`28ff0d0d-42a8-4efa-837d-44f08844e01b`::moving from state init -> state preparing >MainThread::INFO::2014-07-10 08:41:32,093::logUtils::44::dispatcher::(wrapper) Run and protect: prepareForShutdown(options=None) >Thread-11::DEBUG::2014-07-10 08:41:32,095::storageServer::698::ConnectionMonitor::(_monitorConnections) Monitoring stopped >VM Channels Listener::INFO::2014-07-10 08:41:32,985::vmChannels::178::vds::(run) VM channels listener thread has ended. >MainThread::INFO::2014-07-10 08:45:27,806::vdsm::119::vds::(run) (PID: 8130) I am the actual vdsm 4.14.7-5.el6ev ucs1-b420-2.eng.lab.tlv.redhat.com (2.6.32-431.20.3.el6.x86_64) >MainThread::DEBUG::2014-07-10 08:45:27,812::resourceManager::421::ResourceManager::(registerNamespace) Registering namespace 'Storage' >MainThread::DEBUG::2014-07-10 08:45:27,813::threadPool::35::Misc.ThreadPool::(__init__) Enter - numThreads: 10.0, waitTimeout: 3, maxTasks: 500.0 >MainThread::DEBUG::2014-07-10 08:45:31,275::supervdsm::77::SuperVdsmProxy::(_connect) Trying to connect to Super Vdsm >MainThread::DEBUG::2014-07-10 08:45:31,305::multipath::141::Storage.Multipath::(isEnabled) Current revision of multipath.conf detected, preserving >MainThread::DEBUG::2014-07-10 08:45:31,306::hsm::434::Storage.Misc.excCmd::(__validateLvmLockingType) '/usr/bin/sudo -n /sbin/lvm dumpconfig global/locking_type' (cwd None) >MainThread::DEBUG::2014-07-10 08:45:31,497::hsm::434::Storage.Misc.excCmd::(__validateLvmLockingType) SUCCESS: <err> = ''; <rc> = 0 >MainThread::DEBUG::2014-07-10 08:45:31,498::hsm::458::Storage.HSM::(__cleanStorageRepository) Started cleaning storage repository at '/rhev/data-center' >MainThread::DEBUG::2014-07-10 08:45:31,518::hsm::490::Storage.HSM::(__cleanStorageRepository) White list: ['/rhev/data-center/hsm-tasks', '/rhev/data-center/hsm-tasks/*', '/rhev/data-center/mnt'] >MainThread::DEBUG::2014-07-10 08:45:31,518::hsm::491::Storage.HSM::(__cleanStorageRepository) Mount list: ['/rhev/data-center'] >MainThread::DEBUG::2014-07-10 08:45:31,518::hsm::493::Storage.HSM::(__cleanStorageRepository) Cleaning leftovers >MainThread::DEBUG::2014-07-10 08:45:31,520::hsm::536::Storage.HSM::(__cleanStorageRepository) Finished cleaning storage repository at '/rhev/data-center' >storageRefresh::DEBUG::2014-07-10 08:45:31,521::misc::756::SamplingMethod::(__call__) Trying to enter sampling method (storage.sdc.refreshStorage) >MainThread::INFO::2014-07-10 08:45:31,523::dispatcher::97::Storage.Dispatcher::(__init__) Starting StorageDispatcher... >storageRefresh::DEBUG::2014-07-10 08:45:31,524::misc::758::SamplingMethod::(__call__) Got in to sampling method >storageRefresh::DEBUG::2014-07-10 08:45:31,550::misc::756::SamplingMethod::(__call__) Trying to enter sampling method (storage.iscsi.rescan) >storageRefresh::DEBUG::2014-07-10 08:45:31,551::misc::758::SamplingMethod::(__call__) Got in to sampling method >storageRefresh::DEBUG::2014-07-10 08:45:31,554::iscsi::407::Storage.ISCSI::(rescan) Performing SCSI scan, this will take up to 30 seconds >storageRefresh::DEBUG::2014-07-10 08:45:31,561::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) '/usr/bin/sudo -n /sbin/iscsiadm -m session -R' (cwd None) >MainThread::DEBUG::2014-07-10 08:45:31,582::task::595::TaskManager.Task::(_updateState) Task=`610ba454-3e9d-4f76-a78e-7432bf3d0fe2`::moving from state init -> state preparing >MainThread::INFO::2014-07-10 08:45:31,582::logUtils::44::dispatcher::(wrapper) Run and protect: registerDomainStateChangeCallback(callbackFunc=<bound method clientIF.contEIOVms of <clientIF.clientIF instance at 0x2474638>>) >MainThread::INFO::2014-07-10 08:45:31,582::logUtils::47::dispatcher::(wrapper) Run and protect: registerDomainStateChangeCallback, Return response: None >MainThread::DEBUG::2014-07-10 08:45:31,582::task::1185::TaskManager.Task::(prepare) Task=`610ba454-3e9d-4f76-a78e-7432bf3d0fe2`::finished: None >MainThread::DEBUG::2014-07-10 08:45:31,582::task::595::TaskManager.Task::(_updateState) Task=`610ba454-3e9d-4f76-a78e-7432bf3d0fe2`::moving from state preparing -> state finished >MainThread::DEBUG::2014-07-10 08:45:31,583::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >MainThread::DEBUG::2014-07-10 08:45:31,583::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >MainThread::DEBUG::2014-07-10 08:45:31,583::task::990::TaskManager.Task::(_decref) Task=`610ba454-3e9d-4f76-a78e-7432bf3d0fe2`::ref 0 aborting False >storageRefresh::DEBUG::2014-07-10 08:45:31,591::misc::766::SamplingMethod::(__call__) Returning last result >MainThread::INFO::2014-07-10 08:45:31,599::momIF::49::MOM::(__init__) Starting up MOM >storageRefresh::DEBUG::2014-07-10 08:45:31,605::multipath::109::Storage.Misc.excCmd::(rescan) '/usr/bin/sudo -n /sbin/multipath' (cwd None) >MainThread::INFO::2014-07-10 08:45:31,619::vmChannels::191::vds::(settimeout) Setting channels' timeout to 30 seconds. >VM Channels Listener::INFO::2014-07-10 08:45:31,621::vmChannels::174::vds::(run) Starting VM channels listener thread. >clientIFinit::DEBUG::2014-07-10 08:45:31,637::libvirtconnection::145::root::(get) trying to connect libvirt >storageRefresh::DEBUG::2014-07-10 08:45:31,645::multipath::109::Storage.Misc.excCmd::(rescan) SUCCESS: <err> = ''; <rc> = 0 >storageRefresh::DEBUG::2014-07-10 08:45:31,647::lvm::497::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex >storageRefresh::DEBUG::2014-07-10 08:45:31,647::lvm::499::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex >storageRefresh::DEBUG::2014-07-10 08:45:31,652::lvm::508::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex >storageRefresh::DEBUG::2014-07-10 08:45:31,653::lvm::510::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex >storageRefresh::DEBUG::2014-07-10 08:45:31,654::lvm::528::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex >storageRefresh::DEBUG::2014-07-10 08:45:31,654::lvm::530::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex >storageRefresh::DEBUG::2014-07-10 08:45:31,654::misc::766::SamplingMethod::(__call__) Returning last result >storageRefresh::DEBUG::2014-07-10 08:45:31,655::lvm::325::OperationMutex::(_reloadpvs) Operation 'lvm reload operation' got the operation mutex >storageRefresh::DEBUG::2014-07-10 08:45:31,662::lvm::296::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm pvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/367cad74c2fcba00019e6afd20c781e67|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,size,vg_name,vg_uuid,pe_start,pe_count,pe_alloc_count,mda_count,dev_size' (cwd None) >storageRefresh::DEBUG::2014-07-10 08:45:31,899::lvm::296::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >storageRefresh::DEBUG::2014-07-10 08:45:31,905::lvm::350::OperationMutex::(_reloadpvs) Operation 'lvm reload operation' released the operation mutex >storageRefresh::DEBUG::2014-07-10 08:45:31,908::lvm::373::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >storageRefresh::DEBUG::2014-07-10 08:45:31,917::lvm::296::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/367cad74c2fcba00019e6afd20c781e67|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name' (cwd None) >storageRefresh::DEBUG::2014-07-10 08:45:32,103::lvm::296::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >storageRefresh::DEBUG::2014-07-10 08:45:32,105::lvm::415::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >storageRefresh::DEBUG::2014-07-10 08:45:32,105::lvm::296::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm lvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/367cad74c2fcba00019e6afd20c781e67|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,vg_name,attr,size,seg_start_pe,devices,tags' (cwd None) >storageRefresh::DEBUG::2014-07-10 08:45:32,285::lvm::296::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >storageRefresh::DEBUG::2014-07-10 08:45:32,290::lvm::661::Storage.LVM::(bootstrap) Skipping open lv: vg=HostVG lv=Data >storageRefresh::DEBUG::2014-07-10 08:45:32,290::lvm::661::Storage.LVM::(bootstrap) Skipping open lv: vg=HostVG lv=Logging >storageRefresh::DEBUG::2014-07-10 08:45:32,290::lvm::661::Storage.LVM::(bootstrap) Skipping open lv: vg=HostVG lv=Config >storageRefresh::DEBUG::2014-07-10 08:45:32,290::lvm::661::Storage.LVM::(bootstrap) Skipping open lv: vg=HostVG lv=Swap >storageRefresh::DEBUG::2014-07-10 08:45:32,291::hsm::393::Storage.HSM::(storageRefresh) HSM is ready >Thread-13::DEBUG::2014-07-10 08:47:38,426::BindingXMLRPC::1067::vds::(wrapper) client [10.35.3.13]::call getCapabilities with () {} >Thread-13::DEBUG::2014-07-10 08:47:38,496::utils::642::root::(execCmd) '/sbin/ip route show to 0.0.0.0/0 table all' (cwd None) >Thread-13::DEBUG::2014-07-10 08:47:38,514::utils::662::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-13::DEBUG::2014-07-10 08:47:38,677::BindingXMLRPC::1074::vds::(wrapper) return getCapabilities with {'status': {'message': 'Done', 'code': 0}, 'info': {'HBAInventory': {'iSCSI': [{'InitiatorName': 'iqn.1994-05.com.redhat:6e278f1bf57'}], 'FC': [{'wwpn': '20000025b50a0004', 'wwnn': '20000025b5ff0004', 'model': 'Unknown - Unknown'}, {'wwpn': '20000025b50b0004', 'wwnn': '20000025b5ff0004', 'model': 'Unknown - Unknown'}]}, 'packages2': {'kernel': {'release': '431.20.3.el6.x86_64', 'buildtime': 1402079454.0, 'version': '2.6.32'}, 'spice-server': {'release': '6.el6_5.2', 'buildtime': 1401730350L, 'version': '0.12.4'}, 'vdsm': {'release': '5.el6ev', 'buildtime': 1404742802L, 'version': '4.14.7'}, 'qemu-kvm': {'release': '2.415.el6_5.10', 'buildtime': 1401300739L, 'version': '0.12.1.2'}, 'libvirt': {'release': '29.el6_5.9', 'buildtime': 1401355377L, 'version': '0.10.2'}, 'qemu-img': {'release': '2.415.el6_5.10', 'buildtime': 1401300739L, 'version': '0.12.1.2'}, 'mom': {'release': '1.el6ev', 'buildtime': 1392224015L, 'version': '0.4.0'}}, 'cpuModel': 'Intel(R) Xeon(R) CPU E5-4620 0 @ 2.20GHz', 'hooks': {'before_vm_start': {'50_vhostmd': {'md5': 'f3ee6dbf6fbd01333bd3e32afec4fbba'}}, 'after_vm_destroy': {'50_vhostmd': {'md5': '92498ed80c0219749829ecce2813fc7c'}}, 'before_vm_dehibernate': {'50_vhostmd': {'md5': 'f3ee6dbf6fbd01333bd3e32afec4fbba'}}, 'before_vm_migrate_destination': {'50_vhostmd': {'md5': 'f3ee6dbf6fbd01333bd3e32afec4fbba'}}}, 'cpuSockets': '4', 'vmTypes': ['kvm'], 'supportedProtocols': ['2.2', '2.3'], 'networks': {'rhevm': {'iface': 'rhevm', 'addr': '10.35.19.153', 'cfg': {'IPADDR': '10.35.19.153', 'PEERDNS': 'no', 'GATEWAY': '10.35.19.254', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'NETMASK': '255.255.252.0', 'BOOTPROTO': 'none', 'STP': 'no', 'DEVICE': 'rhevm', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'ipv6addrs': ['fe80::225:b5ff:fe0a:c/64'], 'gateway': '10.35.19.254', 'netmask': '255.255.252.0', 'stp': 'off', 'bridged': True, 'mtu': '1500', 'ipv6gateway': '::', 'ports': ['bond0']}}, 'bridges': {'rhevm': {'addr': '10.35.19.153', 'cfg': {'IPADDR': '10.35.19.153', 'PEERDNS': 'no', 'GATEWAY': '10.35.19.254', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'NETMASK': '255.255.252.0', 'BOOTPROTO': 'none', 'STP': 'no', 'DEVICE': 'rhevm', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'ipv6addrs': ['fe80::225:b5ff:fe0a:c/64'], 'mtu': '1500', 'netmask': '255.255.252.0', 'stp': 'off', 'ipv6gateway': '::', 'gateway': '10.35.19.254', 'ports': ['bond0']}, ';vdsmdummy;': {'addr': '', 'cfg': {}, 'ipv6addrs': [], 'mtu': '1500', 'netmask': '', 'stp': 'off', 'ipv6gateway': '::', 'gateway': '', 'ports': []}}, 'uuid': '52BAF97B-FF2F-E311-0000-100000000005', 'lastClientIface': 'rhevm', 'nics': {'eth1': {'netmask': '', 'addr': '', 'hwaddr': '00:25:b5:0a:00:0c', 'cfg': {'SLAVE': 'yes', 'NM_CONTROLLED': 'no', 'PEERDNS': 'no', 'HWADDR': '00:25:b5:0b:00:0c', 'MASTER': 'bond0', 'DEVICE': 'eth1', 'STP': 'no', 'ONBOOT': 'yes'}, 'ipv6addrs': [], 'permhwaddr': '00:25:B5:0B:00:0C', 'speed': 10240, 'mtu': '1500'}, 'eth0': {'netmask': '', 'addr': '', 'hwaddr': '00:25:b5:0a:00:0c', 'cfg': {'SLAVE': 'yes', 'NM_CONTROLLED': 'no', 'PEERDNS': 'no', 'HWADDR': '00:25:b5:0a:00:0c', 'MASTER': 'bond0', 'DEVICE': 'eth0', 'STP': 'no', 'ONBOOT': 'yes'}, 'ipv6addrs': [], 'permhwaddr': '00:25:B5:0A:00:0C', 'speed': 10240, 'mtu': '1500'}}, 'software_revision': '5', 'management_ip': '0.0.0.0', 'clusterLevels': ['3.0', '3.1', '3.2', '3.3', '3.4'], 'cpuFlags': u'fpu,vme,de,pse,tsc,msr,pae,mce,cx8,apic,sep,mtrr,pge,mca,cmov,pat,pse36,clflush,dts,acpi,mmx,fxsr,sse,sse2,ss,ht,tm,pbe,syscall,nx,pdpe1gb,rdtscp,lm,constant_tsc,arch_perfmon,pebs,bts,rep_good,xtopology,nonstop_tsc,aperfmperf,pni,pclmulqdq,dtes64,monitor,ds_cpl,vmx,smx,est,tm2,ssse3,cx16,xtpr,pdcm,pcid,dca,sse4_1,sse4_2,x2apic,popcnt,tsc_deadline_timer,aes,xsave,avx,lahf_lm,ida,arat,epb,xsaveopt,pln,pts,dts,tpr_shadow,vnmi,flexpriority,ept,vpid,model_Nehalem,model_Conroe,model_coreduo,model_core2duo,model_Penryn,model_Westmere,model_n270,model_SandyBridge', 'ISCSIInitiatorName': 'iqn.1994-05.com.redhat:6e278f1bf57', 'netConfigDirty': 'False', 'supportedENGINEs': ['3.0', '3.1', '3.2', '3.3', '3.4'], 'reservedMem': '321', 'bondings': {'bond4': {'netmask': '', 'addr': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00', 'cfg': {}, 'ipv6addrs': [], 'mtu': '1500'}, 'bond0': {'netmask': '', 'addr': '', 'slaves': ['eth0', 'eth1'], 'hwaddr': '00:25:b5:0a:00:0c', 'cfg': {'BRIDGE': 'rhevm', 'PEERDNS': 'no', 'NM_CONTROLLED': 'no', 'STP': 'no', 'BONDING_OPTS': 'mode=4', 'DEVICE': 'bond0', 'ONBOOT': 'yes'}, 'ipv6addrs': ['fe80::225:b5ff:fe0a:c/64'], 'mtu': '1500'}, 'bond1': {'netmask': '', 'addr': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00', 'cfg': {}, 'ipv6addrs': [], 'mtu': '1500'}, 'bond2': {'netmask': '', 'addr': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00', 'cfg': {}, 'ipv6addrs': [], 'mtu': '1500'}, 'bond3': {'netmask': '', 'addr': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00', 'cfg': {}, 'ipv6addrs': [], 'mtu': '1500'}}, 'software_version': '4.14', 'memSize': '387598', 'cpuSpeed': '2199.856', 'version_name': 'Snow Man', 'vlans': {}, 'cpuCores': '32', 'kvmEnabled': 'true', 'guestOverhead': '65', 'supportedRHEVMs': ['3.0'], 'cpuThreads': '64', 'emulatedMachines': [u'rhel6.5.0', u'pc', u'rhel6.4.0', u'rhel6.3.0', u'rhel6.2.0', u'rhel6.1.0', u'rhel6.0.0', u'rhel5.5.0', u'rhel5.4.4', u'rhel5.4.0'], 'rngSources': ['random'], 'operatingSystem': {'release': '20140707.0.el6ev', 'version': '6.5', 'name': 'RHEV Hypervisor'}, 'lastClient': '10.35.3.13'}} >Thread-13::DEBUG::2014-07-10 08:47:38,723::BindingXMLRPC::1067::vds::(wrapper) client [10.35.3.13]::call getHardwareInfo with () {} >Thread-13::DEBUG::2014-07-10 08:47:38,830::BindingXMLRPC::1074::vds::(wrapper) return getHardwareInfo with {'status': {'message': 'Done', 'code': 0}, 'info': {'systemProductName': 'UCSB-B420-M3', 'systemSerialNumber': 'FCH1710J7E7', 'systemFamily': '', 'systemVersion': '1', 'systemUUID': '52BAF97B-FF2F-E311-0000-100000000005', 'systemManufacturer': 'Cisco Systems Inc'}} >Thread-13::DEBUG::2014-07-10 08:47:38,962::BindingXMLRPC::1067::vds::(wrapper) client [10.35.3.13]::call setMOMPolicyParameters with ({'balloonEnabled': False, 'ksmEnabled': False},) {} flowID [499c1982] >Thread-13::DEBUG::2014-07-10 08:47:39,047::BindingXMLRPC::1074::vds::(wrapper) return setMOMPolicyParameters with {'status': {'message': 'Done', 'code': 0}} >Thread-13::DEBUG::2014-07-10 08:47:51,133::task::595::TaskManager.Task::(_updateState) Task=`1c91e03b-a384-4dcf-aebf-9a64b538b408`::moving from state init -> state preparing >Thread-13::INFO::2014-07-10 08:47:51,134::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-13::INFO::2014-07-10 08:47:51,134::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-13::DEBUG::2014-07-10 08:47:51,134::task::1185::TaskManager.Task::(prepare) Task=`1c91e03b-a384-4dcf-aebf-9a64b538b408`::finished: {} >Thread-13::DEBUG::2014-07-10 08:47:51,134::task::595::TaskManager.Task::(_updateState) Task=`1c91e03b-a384-4dcf-aebf-9a64b538b408`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-07-10 08:47:51,135::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-07-10 08:47:51,135::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-07-10 08:47:51,135::task::990::TaskManager.Task::(_decref) Task=`1c91e03b-a384-4dcf-aebf-9a64b538b408`::ref 0 aborting False >Thread-13::DEBUG::2014-07-10 08:48:06,263::task::595::TaskManager.Task::(_updateState) Task=`b310892d-8b37-41e2-a658-7f08bd4b323f`::moving from state init -> state preparing >Thread-13::INFO::2014-07-10 08:48:06,263::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-13::INFO::2014-07-10 08:48:06,263::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-13::DEBUG::2014-07-10 08:48:06,264::task::1185::TaskManager.Task::(prepare) Task=`b310892d-8b37-41e2-a658-7f08bd4b323f`::finished: {} >Thread-13::DEBUG::2014-07-10 08:48:06,264::task::595::TaskManager.Task::(_updateState) Task=`b310892d-8b37-41e2-a658-7f08bd4b323f`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-07-10 08:48:06,264::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-07-10 08:48:06,264::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-07-10 08:48:06,264::task::990::TaskManager.Task::(_decref) Task=`b310892d-8b37-41e2-a658-7f08bd4b323f`::ref 0 aborting False >Thread-13::DEBUG::2014-07-10 08:48:21,405::task::595::TaskManager.Task::(_updateState) Task=`25410d8d-b836-450d-867e-32ef9e7b6659`::moving from state init -> state preparing >Thread-13::INFO::2014-07-10 08:48:21,406::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-13::INFO::2014-07-10 08:48:21,406::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-13::DEBUG::2014-07-10 08:48:21,406::task::1185::TaskManager.Task::(prepare) Task=`25410d8d-b836-450d-867e-32ef9e7b6659`::finished: {} >Thread-13::DEBUG::2014-07-10 08:48:21,406::task::595::TaskManager.Task::(_updateState) Task=`25410d8d-b836-450d-867e-32ef9e7b6659`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-07-10 08:48:21,406::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-07-10 08:48:21,407::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-07-10 08:48:21,407::task::990::TaskManager.Task::(_decref) Task=`25410d8d-b836-450d-867e-32ef9e7b6659`::ref 0 aborting False >Thread-13::DEBUG::2014-07-10 08:48:24,602::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-13::DEBUG::2014-07-10 08:48:24,603::task::595::TaskManager.Task::(_updateState) Task=`632a6db2-5365-45d8-b2f1-eb770a69d0a9`::moving from state init -> state preparing >Thread-13::INFO::2014-07-10 08:48:24,604::logUtils::44::dispatcher::(wrapper) Run and protect: getDeviceList(storageType=3, options={}) >Thread-13::DEBUG::2014-07-10 08:48:24,604::misc::756::SamplingMethod::(__call__) Trying to enter sampling method (storage.sdc.refreshStorage) >Thread-13::DEBUG::2014-07-10 08:48:24,604::misc::758::SamplingMethod::(__call__) Got in to sampling method >Thread-13::DEBUG::2014-07-10 08:48:24,604::misc::756::SamplingMethod::(__call__) Trying to enter sampling method (storage.iscsi.rescan) >Thread-13::DEBUG::2014-07-10 08:48:24,604::misc::758::SamplingMethod::(__call__) Got in to sampling method >Thread-13::DEBUG::2014-07-10 08:48:24,605::iscsi::407::Storage.ISCSI::(rescan) Performing SCSI scan, this will take up to 30 seconds >Thread-13::DEBUG::2014-07-10 08:48:24,605::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) '/usr/bin/sudo -n /sbin/iscsiadm -m session -R' (cwd None) >Thread-13::DEBUG::2014-07-10 08:48:24,634::misc::766::SamplingMethod::(__call__) Returning last result >Thread-13::DEBUG::2014-07-10 08:48:24,635::multipath::109::Storage.Misc.excCmd::(rescan) '/usr/bin/sudo -n /sbin/multipath' (cwd None) >Thread-13::DEBUG::2014-07-10 08:48:24,664::multipath::109::Storage.Misc.excCmd::(rescan) SUCCESS: <err> = ''; <rc> = 0 >Thread-13::DEBUG::2014-07-10 08:48:24,665::lvm::497::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-13::DEBUG::2014-07-10 08:48:24,665::lvm::499::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-13::DEBUG::2014-07-10 08:48:24,665::lvm::508::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-13::DEBUG::2014-07-10 08:48:24,665::lvm::510::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-13::DEBUG::2014-07-10 08:48:24,666::lvm::528::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-13::DEBUG::2014-07-10 08:48:24,666::lvm::530::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-13::DEBUG::2014-07-10 08:48:24,666::misc::766::SamplingMethod::(__call__) Returning last result >Thread-13::DEBUG::2014-07-10 08:48:24,667::lvm::325::OperationMutex::(_reloadpvs) Operation 'lvm reload operation' got the operation mutex >Thread-13::DEBUG::2014-07-10 08:48:24,669::lvm::296::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm pvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/367cad74c2fcba00019e6afd20c781e67|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,size,vg_name,vg_uuid,pe_start,pe_count,pe_alloc_count,mda_count,dev_size' (cwd None) >Thread-13::DEBUG::2014-07-10 08:48:24,923::lvm::296::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-13::DEBUG::2014-07-10 08:48:24,924::lvm::350::OperationMutex::(_reloadpvs) Operation 'lvm reload operation' released the operation mutex >Thread-13::DEBUG::2014-07-10 08:48:24,994::lvm::296::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm pvcreate --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/367cad74c2fcba00019e6afd20c781e67|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } " --test --metadatasize 128m --metadatacopies 2 --metadataignore y' (cwd None) >Thread-13::DEBUG::2014-07-10 08:48:25,152::lvm::296::Storage.Misc.excCmd::(cmd) FAILED: <err> = " TEST MODE: Metadata will NOT be updated and volumes will not be (de)activated.\n Please enter a physical volume path\n Run `pvcreate --help' for more information.\n"; <rc> = 3 >Thread-13::DEBUG::2014-07-10 08:48:25,154::lvm::860::Storage.LVM::(testPVCreate) rc: 3, out: [], err: [' TEST MODE: Metadata will NOT be updated and volumes will not be (de)activated.', ' Please enter a physical volume path', " Run `pvcreate --help' for more information."], unusedDevs: set([]), usedDevs: set([]) >Thread-13::INFO::2014-07-10 08:48:25,155::logUtils::47::dispatcher::(wrapper) Run and protect: getDeviceList, Return response: {'devList': []} >Thread-13::DEBUG::2014-07-10 08:48:25,155::task::1185::TaskManager.Task::(prepare) Task=`632a6db2-5365-45d8-b2f1-eb770a69d0a9`::finished: {'devList': []} >Thread-13::DEBUG::2014-07-10 08:48:25,155::task::595::TaskManager.Task::(_updateState) Task=`632a6db2-5365-45d8-b2f1-eb770a69d0a9`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-07-10 08:48:25,155::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-07-10 08:48:25,156::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-07-10 08:48:25,156::task::990::TaskManager.Task::(_decref) Task=`632a6db2-5365-45d8-b2f1-eb770a69d0a9`::ref 0 aborting False >Thread-13::DEBUG::2014-07-10 08:48:36,572::task::595::TaskManager.Task::(_updateState) Task=`fbb7e231-cd03-4ff7-b903-50ba54571a31`::moving from state init -> state preparing >Thread-13::INFO::2014-07-10 08:48:36,573::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-13::INFO::2014-07-10 08:48:36,573::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-13::DEBUG::2014-07-10 08:48:36,573::task::1185::TaskManager.Task::(prepare) Task=`fbb7e231-cd03-4ff7-b903-50ba54571a31`::finished: {} >Thread-13::DEBUG::2014-07-10 08:48:36,573::task::595::TaskManager.Task::(_updateState) Task=`fbb7e231-cd03-4ff7-b903-50ba54571a31`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-07-10 08:48:36,573::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-07-10 08:48:36,574::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-07-10 08:48:36,574::task::990::TaskManager.Task::(_decref) Task=`fbb7e231-cd03-4ff7-b903-50ba54571a31`::ref 0 aborting False >Thread-13::DEBUG::2014-07-10 08:48:51,711::task::595::TaskManager.Task::(_updateState) Task=`31b85586-bca3-42bf-8a53-f8c03d1d7200`::moving from state init -> state preparing >Thread-13::INFO::2014-07-10 08:48:51,711::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-13::INFO::2014-07-10 08:48:51,712::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-13::DEBUG::2014-07-10 08:48:51,712::task::1185::TaskManager.Task::(prepare) Task=`31b85586-bca3-42bf-8a53-f8c03d1d7200`::finished: {} >Thread-13::DEBUG::2014-07-10 08:48:51,712::task::595::TaskManager.Task::(_updateState) Task=`31b85586-bca3-42bf-8a53-f8c03d1d7200`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-07-10 08:48:51,712::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-07-10 08:48:51,712::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-07-10 08:48:51,712::task::990::TaskManager.Task::(_decref) Task=`31b85586-bca3-42bf-8a53-f8c03d1d7200`::ref 0 aborting False >Thread-14::DEBUG::2014-07-10 08:48:54,817::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-14::DEBUG::2014-07-10 08:48:54,818::task::595::TaskManager.Task::(_updateState) Task=`cb8ccc22-6ff6-480b-96d1-c93992a03e91`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 08:48:54,818::logUtils::44::dispatcher::(wrapper) Run and protect: discoverSendTargets(con={'connection': '10.35.160.104', 'password': '******', 'port': '3260', 'user': ''}, options=None) >Thread-14::DEBUG::2014-07-10 08:48:54,819::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) '/usr/bin/sudo -n /sbin/iscsiadm -m discoverydb -t sendtargets -I default -p 10.35.160.104:3260 --op=new' (cwd None) >Thread-14::DEBUG::2014-07-10 08:48:54,845::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-14::DEBUG::2014-07-10 08:48:54,846::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) '/usr/bin/sudo -n /sbin/iscsiadm -m discoverydb -t sendtargets -I default -p 10.35.160.104:3260 --discover' (cwd None) >Thread-14::DEBUG::2014-07-10 08:48:54,872::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-14::DEBUG::2014-07-10 08:48:54,873::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) '/usr/bin/sudo -n /sbin/iscsiadm -m discoverydb -t sendtargets -I default -p 10.35.160.104:3260 --op=delete' (cwd None) >Thread-14::DEBUG::2014-07-10 08:48:54,891::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-14::INFO::2014-07-10 08:48:54,891::logUtils::47::dispatcher::(wrapper) Run and protect: discoverSendTargets, Return response: {'fullTargets': ['10.35.160.104:3260,1 iqn.1992-04.com.emc:cx.ckm00121000438.a6', '10.35.160.105:3260,2 iqn.1992-04.com.emc:cx.ckm00121000438.a7', '10.35.160.106:3260,3 iqn.1992-04.com.emc:cx.ckm00121000438.b6', '10.35.160.107:3260,4 iqn.1992-04.com.emc:cx.ckm00121000438.b7'], 'targets': ['iqn.1992-04.com.emc:cx.ckm00121000438.a6', 'iqn.1992-04.com.emc:cx.ckm00121000438.a7', 'iqn.1992-04.com.emc:cx.ckm00121000438.b6', 'iqn.1992-04.com.emc:cx.ckm00121000438.b7']} >Thread-14::DEBUG::2014-07-10 08:48:54,892::task::1185::TaskManager.Task::(prepare) Task=`cb8ccc22-6ff6-480b-96d1-c93992a03e91`::finished: {'fullTargets': ['10.35.160.104:3260,1 iqn.1992-04.com.emc:cx.ckm00121000438.a6', '10.35.160.105:3260,2 iqn.1992-04.com.emc:cx.ckm00121000438.a7', '10.35.160.106:3260,3 iqn.1992-04.com.emc:cx.ckm00121000438.b6', '10.35.160.107:3260,4 iqn.1992-04.com.emc:cx.ckm00121000438.b7'], 'targets': ['iqn.1992-04.com.emc:cx.ckm00121000438.a6', 'iqn.1992-04.com.emc:cx.ckm00121000438.a7', 'iqn.1992-04.com.emc:cx.ckm00121000438.b6', 'iqn.1992-04.com.emc:cx.ckm00121000438.b7']} >Thread-14::DEBUG::2014-07-10 08:48:54,892::task::595::TaskManager.Task::(_updateState) Task=`cb8ccc22-6ff6-480b-96d1-c93992a03e91`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 08:48:54,892::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 08:48:54,892::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 08:48:54,893::task::990::TaskManager.Task::(_decref) Task=`cb8ccc22-6ff6-480b-96d1-c93992a03e91`::ref 0 aborting False >Thread-14::DEBUG::2014-07-10 08:48:57,241::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [2087e9fc] >Thread-14::DEBUG::2014-07-10 08:48:57,242::task::595::TaskManager.Task::(_updateState) Task=`31a46858-7a36-4654-b43d-e353d34ff754`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 08:48:57,242::logUtils::44::dispatcher::(wrapper) Run and protect: connectStorageServer(domType=3, spUUID='00000000-0000-0000-0000-000000000000', conList=[{'connection': '10.35.160.104', 'iqn': 'iqn.1992-04.com.emc:cx.ckm00121000438.a6', 'user': '', 'tpgt': '1', 'password': '******', 'id': '00000000-0000-0000-0000-000000000000', 'port': '3260'}], options=None) >Thread-14::DEBUG::2014-07-10 08:48:57,243::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) '/usr/bin/sudo -n /sbin/iscsiadm -m node -T iqn.1992-04.com.emc:cx.ckm00121000438.a6 -I default -p 10.35.160.104:3260,1 --op=new' (cwd None) >Thread-14::DEBUG::2014-07-10 08:48:57,260::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-14::DEBUG::2014-07-10 08:48:57,261::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) '/usr/bin/sudo -n /sbin/iscsiadm -m node -T iqn.1992-04.com.emc:cx.ckm00121000438.a6 -I default -p 10.35.160.104:3260,1 -l' (cwd None) >Thread-14::DEBUG::2014-07-10 08:48:57,823::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-14::DEBUG::2014-07-10 08:48:57,824::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) '/usr/bin/sudo -n /sbin/iscsiadm -m node -T iqn.1992-04.com.emc:cx.ckm00121000438.a6 -I default -p 10.35.160.104:3260,1 -n node.startup -v manual --op=update' (cwd None) >Thread-14::DEBUG::2014-07-10 08:48:57,847::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-14::DEBUG::2014-07-10 08:48:57,848::lvm::373::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-14::DEBUG::2014-07-10 08:48:57,849::lvm::296::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/367cad74c2fcba00019e6afd20c781e67|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name' (cwd None) >Thread-14::DEBUG::2014-07-10 08:48:58,087::lvm::296::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-14::DEBUG::2014-07-10 08:48:58,090::lvm::415::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-14::DEBUG::2014-07-10 08:48:58,090::hsm::2352::Storage.HSM::(__prefetchDomains) Found SD uuids: () >Thread-14::DEBUG::2014-07-10 08:48:58,091::hsm::2408::Storage.HSM::(connectStorageServer) knownSDs: {} >Thread-14::INFO::2014-07-10 08:48:58,091::logUtils::47::dispatcher::(wrapper) Run and protect: connectStorageServer, Return response: {'statuslist': [{'status': 0, 'id': '00000000-0000-0000-0000-000000000000'}]} >Thread-14::DEBUG::2014-07-10 08:48:58,091::task::1185::TaskManager.Task::(prepare) Task=`31a46858-7a36-4654-b43d-e353d34ff754`::finished: {'statuslist': [{'status': 0, 'id': '00000000-0000-0000-0000-000000000000'}]} >Thread-14::DEBUG::2014-07-10 08:48:58,091::task::595::TaskManager.Task::(_updateState) Task=`31a46858-7a36-4654-b43d-e353d34ff754`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 08:48:58,091::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 08:48:58,092::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 08:48:58,092::task::990::TaskManager.Task::(_decref) Task=`31a46858-7a36-4654-b43d-e353d34ff754`::ref 0 aborting False >Thread-14::DEBUG::2014-07-10 08:48:58,211::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [6d9f5b88] >Thread-14::DEBUG::2014-07-10 08:48:58,212::task::595::TaskManager.Task::(_updateState) Task=`0904fc3d-d0eb-4407-9a3f-b90da15756d2`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 08:48:58,212::logUtils::44::dispatcher::(wrapper) Run and protect: connectStorageServer(domType=3, spUUID='00000000-0000-0000-0000-000000000000', conList=[{'connection': '10.35.160.105', 'iqn': 'iqn.1992-04.com.emc:cx.ckm00121000438.a7', 'user': '', 'tpgt': '1', 'password': '******', 'id': '00000000-0000-0000-0000-000000000000', 'port': '3260'}], options=None) >Thread-14::DEBUG::2014-07-10 08:48:58,213::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) '/usr/bin/sudo -n /sbin/iscsiadm -m node -T iqn.1992-04.com.emc:cx.ckm00121000438.a7 -I default -p 10.35.160.105:3260,1 --op=new' (cwd None) >Thread-14::DEBUG::2014-07-10 08:48:58,244::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-14::DEBUG::2014-07-10 08:48:58,245::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) '/usr/bin/sudo -n /sbin/iscsiadm -m node -T iqn.1992-04.com.emc:cx.ckm00121000438.a7 -I default -p 10.35.160.105:3260,1 -l' (cwd None) >Thread-14::DEBUG::2014-07-10 08:48:58,799::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-14::DEBUG::2014-07-10 08:48:58,800::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) '/usr/bin/sudo -n /sbin/iscsiadm -m node -T iqn.1992-04.com.emc:cx.ckm00121000438.a7 -I default -p 10.35.160.105:3260,1 -n node.startup -v manual --op=update' (cwd None) >Thread-14::DEBUG::2014-07-10 08:48:58,819::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-14::DEBUG::2014-07-10 08:48:58,821::hsm::2352::Storage.HSM::(__prefetchDomains) Found SD uuids: () >Thread-14::DEBUG::2014-07-10 08:48:58,821::hsm::2408::Storage.HSM::(connectStorageServer) knownSDs: {} >Thread-14::INFO::2014-07-10 08:48:58,821::logUtils::47::dispatcher::(wrapper) Run and protect: connectStorageServer, Return response: {'statuslist': [{'status': 0, 'id': '00000000-0000-0000-0000-000000000000'}]} >Thread-14::DEBUG::2014-07-10 08:48:58,822::task::1185::TaskManager.Task::(prepare) Task=`0904fc3d-d0eb-4407-9a3f-b90da15756d2`::finished: {'statuslist': [{'status': 0, 'id': '00000000-0000-0000-0000-000000000000'}]} >Thread-14::DEBUG::2014-07-10 08:48:58,822::task::595::TaskManager.Task::(_updateState) Task=`0904fc3d-d0eb-4407-9a3f-b90da15756d2`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 08:48:58,822::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 08:48:58,822::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 08:48:58,823::task::990::TaskManager.Task::(_decref) Task=`0904fc3d-d0eb-4407-9a3f-b90da15756d2`::ref 0 aborting False >Thread-14::DEBUG::2014-07-10 08:48:58,933::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [187c26d7] >Thread-14::DEBUG::2014-07-10 08:48:58,934::task::595::TaskManager.Task::(_updateState) Task=`ecdbb3da-e9f7-49e5-9f36-f36331f031fd`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 08:48:58,935::logUtils::44::dispatcher::(wrapper) Run and protect: connectStorageServer(domType=3, spUUID='00000000-0000-0000-0000-000000000000', conList=[{'connection': '10.35.160.106', 'iqn': 'iqn.1992-04.com.emc:cx.ckm00121000438.b6', 'user': '', 'tpgt': '1', 'password': '******', 'id': '00000000-0000-0000-0000-000000000000', 'port': '3260'}], options=None) >Thread-14::DEBUG::2014-07-10 08:48:58,936::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) '/usr/bin/sudo -n /sbin/iscsiadm -m node -T iqn.1992-04.com.emc:cx.ckm00121000438.b6 -I default -p 10.35.160.106:3260,1 --op=new' (cwd None) >Thread-14::DEBUG::2014-07-10 08:48:58,953::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-14::DEBUG::2014-07-10 08:48:58,954::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) '/usr/bin/sudo -n /sbin/iscsiadm -m node -T iqn.1992-04.com.emc:cx.ckm00121000438.b6 -I default -p 10.35.160.106:3260,1 -l' (cwd None) >Thread-14::DEBUG::2014-07-10 08:48:59,503::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-14::DEBUG::2014-07-10 08:48:59,504::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) '/usr/bin/sudo -n /sbin/iscsiadm -m node -T iqn.1992-04.com.emc:cx.ckm00121000438.b6 -I default -p 10.35.160.106:3260,1 -n node.startup -v manual --op=update' (cwd None) >Thread-14::DEBUG::2014-07-10 08:48:59,523::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-14::DEBUG::2014-07-10 08:48:59,524::hsm::2352::Storage.HSM::(__prefetchDomains) Found SD uuids: () >Thread-14::DEBUG::2014-07-10 08:48:59,524::hsm::2408::Storage.HSM::(connectStorageServer) knownSDs: {} >Thread-14::INFO::2014-07-10 08:48:59,525::logUtils::47::dispatcher::(wrapper) Run and protect: connectStorageServer, Return response: {'statuslist': [{'status': 0, 'id': '00000000-0000-0000-0000-000000000000'}]} >Thread-14::DEBUG::2014-07-10 08:48:59,525::task::1185::TaskManager.Task::(prepare) Task=`ecdbb3da-e9f7-49e5-9f36-f36331f031fd`::finished: {'statuslist': [{'status': 0, 'id': '00000000-0000-0000-0000-000000000000'}]} >Thread-14::DEBUG::2014-07-10 08:48:59,525::task::595::TaskManager.Task::(_updateState) Task=`ecdbb3da-e9f7-49e5-9f36-f36331f031fd`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 08:48:59,525::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 08:48:59,526::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 08:48:59,526::task::990::TaskManager.Task::(_decref) Task=`ecdbb3da-e9f7-49e5-9f36-f36331f031fd`::ref 0 aborting False >Thread-14::DEBUG::2014-07-10 08:48:59,639::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [7b7a9183] >Thread-14::DEBUG::2014-07-10 08:48:59,641::task::595::TaskManager.Task::(_updateState) Task=`d53ec54e-9e0a-428a-bfe8-7d11c5235d3d`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 08:48:59,641::logUtils::44::dispatcher::(wrapper) Run and protect: connectStorageServer(domType=3, spUUID='00000000-0000-0000-0000-000000000000', conList=[{'connection': '10.35.160.107', 'iqn': 'iqn.1992-04.com.emc:cx.ckm00121000438.b7', 'user': '', 'tpgt': '1', 'password': '******', 'id': '00000000-0000-0000-0000-000000000000', 'port': '3260'}], options=None) >Thread-14::DEBUG::2014-07-10 08:48:59,642::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) '/usr/bin/sudo -n /sbin/iscsiadm -m node -T iqn.1992-04.com.emc:cx.ckm00121000438.b7 -I default -p 10.35.160.107:3260,1 --op=new' (cwd None) >Thread-14::DEBUG::2014-07-10 08:48:59,661::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-14::DEBUG::2014-07-10 08:48:59,662::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) '/usr/bin/sudo -n /sbin/iscsiadm -m node -T iqn.1992-04.com.emc:cx.ckm00121000438.b7 -I default -p 10.35.160.107:3260,1 -l' (cwd None) >Thread-14::DEBUG::2014-07-10 08:49:00,201::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-14::DEBUG::2014-07-10 08:49:00,202::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) '/usr/bin/sudo -n /sbin/iscsiadm -m node -T iqn.1992-04.com.emc:cx.ckm00121000438.b7 -I default -p 10.35.160.107:3260,1 -n node.startup -v manual --op=update' (cwd None) >Thread-14::DEBUG::2014-07-10 08:49:00,222::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-14::DEBUG::2014-07-10 08:49:00,223::hsm::2352::Storage.HSM::(__prefetchDomains) Found SD uuids: () >Thread-14::DEBUG::2014-07-10 08:49:00,223::hsm::2408::Storage.HSM::(connectStorageServer) knownSDs: {} >Thread-14::INFO::2014-07-10 08:49:00,224::logUtils::47::dispatcher::(wrapper) Run and protect: connectStorageServer, Return response: {'statuslist': [{'status': 0, 'id': '00000000-0000-0000-0000-000000000000'}]} >Thread-14::DEBUG::2014-07-10 08:49:00,224::task::1185::TaskManager.Task::(prepare) Task=`d53ec54e-9e0a-428a-bfe8-7d11c5235d3d`::finished: {'statuslist': [{'status': 0, 'id': '00000000-0000-0000-0000-000000000000'}]} >Thread-14::DEBUG::2014-07-10 08:49:00,224::task::595::TaskManager.Task::(_updateState) Task=`d53ec54e-9e0a-428a-bfe8-7d11c5235d3d`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 08:49:00,224::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 08:49:00,225::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 08:49:00,225::task::990::TaskManager.Task::(_decref) Task=`d53ec54e-9e0a-428a-bfe8-7d11c5235d3d`::ref 0 aborting False >Thread-14::DEBUG::2014-07-10 08:49:00,306::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-14::DEBUG::2014-07-10 08:49:00,307::task::595::TaskManager.Task::(_updateState) Task=`fc56e880-5299-4abb-ac6c-f470c65675a3`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 08:49:00,308::logUtils::44::dispatcher::(wrapper) Run and protect: getDeviceList(storageType=3, options={}) >Thread-14::DEBUG::2014-07-10 08:49:00,308::misc::756::SamplingMethod::(__call__) Trying to enter sampling method (storage.sdc.refreshStorage) >Thread-14::DEBUG::2014-07-10 08:49:00,308::misc::758::SamplingMethod::(__call__) Got in to sampling method >Thread-14::DEBUG::2014-07-10 08:49:00,308::misc::756::SamplingMethod::(__call__) Trying to enter sampling method (storage.iscsi.rescan) >Thread-14::DEBUG::2014-07-10 08:49:00,308::misc::758::SamplingMethod::(__call__) Got in to sampling method >Thread-14::DEBUG::2014-07-10 08:49:00,309::iscsi::407::Storage.ISCSI::(rescan) Performing SCSI scan, this will take up to 30 seconds >Thread-14::DEBUG::2014-07-10 08:49:00,309::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) '/usr/bin/sudo -n /sbin/iscsiadm -m session -R' (cwd None) >Thread-14::DEBUG::2014-07-10 08:49:00,334::misc::766::SamplingMethod::(__call__) Returning last result >Thread-14::DEBUG::2014-07-10 08:49:00,335::multipath::109::Storage.Misc.excCmd::(rescan) '/usr/bin/sudo -n /sbin/multipath' (cwd None) >Thread-14::DEBUG::2014-07-10 08:49:00,384::multipath::109::Storage.Misc.excCmd::(rescan) SUCCESS: <err> = ''; <rc> = 0 >Thread-14::DEBUG::2014-07-10 08:49:00,384::lvm::497::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-14::DEBUG::2014-07-10 08:49:00,385::lvm::499::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-14::DEBUG::2014-07-10 08:49:00,385::lvm::508::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-14::DEBUG::2014-07-10 08:49:00,385::lvm::510::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-14::DEBUG::2014-07-10 08:49:00,385::lvm::528::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-14::DEBUG::2014-07-10 08:49:00,386::lvm::530::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-14::DEBUG::2014-07-10 08:49:00,386::misc::766::SamplingMethod::(__call__) Returning last result >Thread-14::DEBUG::2014-07-10 08:49:00,386::lvm::325::OperationMutex::(_reloadpvs) Operation 'lvm reload operation' got the operation mutex >Thread-14::DEBUG::2014-07-10 08:49:00,389::lvm::296::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm pvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/3600601601282300032826addbbdae311|/dev/mapper/360060160f4a030003840ec867ddee311|/dev/mapper/367cad74c2fcba00019e6afd20c781e67|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,size,vg_name,vg_uuid,pe_start,pe_count,pe_alloc_count,mda_count,dev_size' (cwd None) >Thread-14::DEBUG::2014-07-10 08:49:00,621::lvm::296::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-14::DEBUG::2014-07-10 08:49:00,622::lvm::350::OperationMutex::(_reloadpvs) Operation 'lvm reload operation' released the operation mutex >Thread-14::DEBUG::2014-07-10 08:49:00,742::lvm::296::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm pvcreate --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/3600601601282300032826addbbdae311|/dev/mapper/360060160f4a030003840ec867ddee311|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } " --test --metadatasize 128m --metadatacopies 2 --metadataignore y /dev/mapper/360060160f4a030003840ec867ddee311 /dev/mapper/3600601601282300032826addbbdae311' (cwd None) >Thread-14::DEBUG::2014-07-10 08:49:00,951::lvm::296::Storage.Misc.excCmd::(cmd) FAILED: <err> = ' TEST MODE: Metadata will NOT be updated and volumes will not be (de)activated.\n Can\'t initialize physical volume "/dev/mapper/360060160f4a030003840ec867ddee311" of volume group "e01a3a36-d2ce-4153-bb57-d6e65b7ed08c" without -ff\n Can\'t initialize physical volume "/dev/mapper/3600601601282300032826addbbdae311" of volume group "e01a3a36-d2ce-4153-bb57-d6e65b7ed08c" without -ff\n'; <rc> = 5 >Thread-14::DEBUG::2014-07-10 08:49:00,954::lvm::306::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm pvcreate --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/3600601601282300032826addbbdae311|/dev/mapper/360060160f4a030003840ec867ddee311|/dev/mapper/367cad74c2fcba00019e6afd20c781e67|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } " --test --metadatasize 128m --metadatacopies 2 --metadataignore y /dev/mapper/360060160f4a030003840ec867ddee311 /dev/mapper/3600601601282300032826addbbdae311' (cwd None) >Thread-14::DEBUG::2014-07-10 08:49:01,163::lvm::306::Storage.Misc.excCmd::(cmd) FAILED: <err> = ' TEST MODE: Metadata will NOT be updated and volumes will not be (de)activated.\n Can\'t initialize physical volume "/dev/mapper/360060160f4a030003840ec867ddee311" of volume group "e01a3a36-d2ce-4153-bb57-d6e65b7ed08c" without -ff\n Can\'t initialize physical volume "/dev/mapper/3600601601282300032826addbbdae311" of volume group "e01a3a36-d2ce-4153-bb57-d6e65b7ed08c" without -ff\n'; <rc> = 5 >Thread-14::DEBUG::2014-07-10 08:49:01,164::lvm::860::Storage.LVM::(testPVCreate) rc: 5, out: [], err: [' TEST MODE: Metadata will NOT be updated and volumes will not be (de)activated.', ' Can\'t initialize physical volume "/dev/mapper/360060160f4a030003840ec867ddee311" of volume group "e01a3a36-d2ce-4153-bb57-d6e65b7ed08c" without -ff', ' Can\'t initialize physical volume "/dev/mapper/3600601601282300032826addbbdae311" of volume group "e01a3a36-d2ce-4153-bb57-d6e65b7ed08c" without -ff'], unusedDevs: set([]), usedDevs: set(['/dev/mapper/360060160f4a030003840ec867ddee311', '/dev/mapper/3600601601282300032826addbbdae311']) >Thread-14::INFO::2014-07-10 08:49:01,165::logUtils::47::dispatcher::(wrapper) Run and protect: getDeviceList, Return response: {'devList': [{'status': 'used', 'vendorID': 'DGC', 'capacity': '53687091200', 'fwrev': '0531', 'vgUUID': 'GJcVo5-Y0kU-CDub-zITS-zfoL-Z7hz-SeVeIe', 'pathlist': [{'initiatorname': 'default', 'connection': '10.35.160.104', 'iqn': 'iqn.1992-04.com.emc:cx.ckm00121000438.a6', 'portal': '1', 'password': '******', 'port': '3260'}, {'initiatorname': 'default', 'connection': '10.35.160.105', 'iqn': 'iqn.1992-04.com.emc:cx.ckm00121000438.a7', 'portal': '2', 'password': '******', 'port': '3260'}, {'initiatorname': 'default', 'connection': '10.35.160.106', 'iqn': 'iqn.1992-04.com.emc:cx.ckm00121000438.b6', 'portal': '3', 'password': '******', 'port': '3260'}, {'initiatorname': 'default', 'connection': '10.35.160.107', 'iqn': 'iqn.1992-04.com.emc:cx.ckm00121000438.b7', 'portal': '4', 'password': '******', 'port': '3260'}], 'logicalblocksize': '512', 'pathstatus': [{'physdev': 'sdc', 'type': 'iSCSI', 'state': 'active', 'lun': '1'}, {'physdev': 'sde', 'type': 'iSCSI', 'state': 'active', 'lun': '1'}, {'physdev': 'sdg', 'type': 'iSCSI', 'state': 'active', 'lun': '1'}, {'physdev': 'sdi', 'type': 'iSCSI', 'state': 'active', 'lun': '1'}], 'devtype': 'iSCSI', 'physicalblocksize': '512', 'pvUUID': '0eUwla-dsA3-g6ia-RU23-cual-0rt9-KzkxLj', 'serial': 'SDGC_VRAID_CKM00121000438', 'GUID': '360060160f4a030003840ec867ddee311', 'productID': 'VRAID'}, {'status': 'used', 'vendorID': 'DGC', 'capacity': '1099511627776', 'fwrev': '0531', 'vgUUID': 'GJcVo5-Y0kU-CDub-zITS-zfoL-Z7hz-SeVeIe', 'pathlist': [{'initiatorname': 'default', 'connection': '10.35.160.104', 'iqn': 'iqn.1992-04.com.emc:cx.ckm00121000438.a6', 'portal': '1', 'password': '******', 'port': '3260'}, {'initiatorname': 'default', 'connection': '10.35.160.105', 'iqn': 'iqn.1992-04.com.emc:cx.ckm00121000438.a7', 'portal': '2', 'password': '******', 'port': '3260'}, {'initiatorname': 'default', 'connection': '10.35.160.106', 'iqn': 'iqn.1992-04.com.emc:cx.ckm00121000438.b6', 'portal': '3', 'password': '******', 'port': '3260'}, {'initiatorname': 'default', 'connection': '10.35.160.107', 'iqn': 'iqn.1992-04.com.emc:cx.ckm00121000438.b7', 'portal': '4', 'password': '******', 'port': '3260'}], 'logicalblocksize': '512', 'pathstatus': [{'physdev': 'sdb', 'type': 'iSCSI', 'state': 'active', 'lun': '0'}, {'physdev': 'sdd', 'type': 'iSCSI', 'state': 'active', 'lun': '0'}, {'physdev': 'sdf', 'type': 'iSCSI', 'state': 'active', 'lun': '0'}, {'physdev': 'sdh', 'type': 'iSCSI', 'state': 'active', 'lun': '0'}], 'devtype': 'iSCSI', 'physicalblocksize': '512', 'pvUUID': 'ZdReOp-Yf8A-beQm-ne4I-pN3J-rxgm-9Ew0S1', 'serial': 'SDGC_VRAID_CKM00121000438', 'GUID': '3600601601282300032826addbbdae311', 'productID': 'VRAID'}]} >Thread-14::DEBUG::2014-07-10 08:49:01,165::task::1185::TaskManager.Task::(prepare) Task=`fc56e880-5299-4abb-ac6c-f470c65675a3`::finished: {'devList': [{'status': 'used', 'fwrev': '0531', 'vgUUID': 'GJcVo5-Y0kU-CDub-zITS-zfoL-Z7hz-SeVeIe', 'pathlist': [{'connection': '10.35.160.104', 'iqn': 'iqn.1992-04.com.emc:cx.ckm00121000438.a6', 'portal': '1', 'port': '3260', 'initiatorname': 'default'}, {'connection': '10.35.160.105', 'iqn': 'iqn.1992-04.com.emc:cx.ckm00121000438.a7', 'portal': '2', 'port': '3260', 'initiatorname': 'default'}, {'connection': '10.35.160.106', 'iqn': 'iqn.1992-04.com.emc:cx.ckm00121000438.b6', 'portal': '3', 'port': '3260', 'initiatorname': 'default'}, {'connection': '10.35.160.107', 'iqn': 'iqn.1992-04.com.emc:cx.ckm00121000438.b7', 'portal': '4', 'port': '3260', 'initiatorname': 'default'}], 'logicalblocksize': '512', 'devtype': 'iSCSI', 'physicalblocksize': '512', 'serial': 'SDGC_VRAID_CKM00121000438', 'GUID': '360060160f4a030003840ec867ddee311', 'productID': 'VRAID', 'vendorID': 'DGC', 'capacity': '53687091200', 'pathstatus': [{'physdev': 'sdc', 'type': 'iSCSI', 'state': 'active', 'lun': '1'}, {'physdev': 'sde', 'type': 'iSCSI', 'state': 'active', 'lun': '1'}, {'physdev': 'sdg', 'type': 'iSCSI', 'state': 'active', 'lun': '1'}, {'physdev': 'sdi', 'type': 'iSCSI', 'state': 'active', 'lun': '1'}], 'pvUUID': '0eUwla-dsA3-g6ia-RU23-cual-0rt9-KzkxLj'}, {'status': 'used', 'fwrev': '0531', 'vgUUID': 'GJcVo5-Y0kU-CDub-zITS-zfoL-Z7hz-SeVeIe', 'pathlist': [{'connection': '10.35.160.104', 'iqn': 'iqn.1992-04.com.emc:cx.ckm00121000438.a6', 'portal': '1', 'port': '3260', 'initiatorname': 'default'}, {'connection': '10.35.160.105', 'iqn': 'iqn.1992-04.com.emc:cx.ckm00121000438.a7', 'portal': '2', 'port': '3260', 'initiatorname': 'default'}, {'connection': '10.35.160.106', 'iqn': 'iqn.1992-04.com.emc:cx.ckm00121000438.b6', 'portal': '3', 'port': '3260', 'initiatorname': 'default'}, {'connection': '10.35.160.107', 'iqn': 'iqn.1992-04.com.emc:cx.ckm00121000438.b7', 'portal': '4', 'port': '3260', 'initiatorname': 'default'}], 'logicalblocksize': '512', 'devtype': 'iSCSI', 'physicalblocksize': '512', 'serial': 'SDGC_VRAID_CKM00121000438', 'GUID': '3600601601282300032826addbbdae311', 'productID': 'VRAID', 'vendorID': 'DGC', 'capacity': '1099511627776', 'pathstatus': [{'physdev': 'sdb', 'type': 'iSCSI', 'state': 'active', 'lun': '0'}, {'physdev': 'sdd', 'type': 'iSCSI', 'state': 'active', 'lun': '0'}, {'physdev': 'sdf', 'type': 'iSCSI', 'state': 'active', 'lun': '0'}, {'physdev': 'sdh', 'type': 'iSCSI', 'state': 'active', 'lun': '0'}], 'pvUUID': 'ZdReOp-Yf8A-beQm-ne4I-pN3J-rxgm-9Ew0S1'}]} >Thread-14::DEBUG::2014-07-10 08:49:01,166::task::595::TaskManager.Task::(_updateState) Task=`fc56e880-5299-4abb-ac6c-f470c65675a3`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 08:49:01,166::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 08:49:01,166::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 08:49:01,166::task::990::TaskManager.Task::(_decref) Task=`fc56e880-5299-4abb-ac6c-f470c65675a3`::ref 0 aborting False >Thread-14::DEBUG::2014-07-10 08:49:06,869::task::595::TaskManager.Task::(_updateState) Task=`0718c642-8d58-4618-8457-b7fceaf07aec`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 08:49:06,869::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::INFO::2014-07-10 08:49:06,869::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-14::DEBUG::2014-07-10 08:49:06,869::task::1185::TaskManager.Task::(prepare) Task=`0718c642-8d58-4618-8457-b7fceaf07aec`::finished: {} >Thread-14::DEBUG::2014-07-10 08:49:06,870::task::595::TaskManager.Task::(_updateState) Task=`0718c642-8d58-4618-8457-b7fceaf07aec`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 08:49:06,870::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 08:49:06,870::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 08:49:06,870::task::990::TaskManager.Task::(_decref) Task=`0718c642-8d58-4618-8457-b7fceaf07aec`::ref 0 aborting False >Thread-14::DEBUG::2014-07-10 08:49:13,859::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [3cf8ccfe] >Thread-14::DEBUG::2014-07-10 08:49:13,860::task::595::TaskManager.Task::(_updateState) Task=`1c72302e-7123-409b-87fb-6fdf8fe7d86c`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 08:49:13,860::logUtils::44::dispatcher::(wrapper) Run and protect: createVG(vgname='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', devlist=['3600601601282300032826addbbdae311'], force=True, options=None) >Thread-14::DEBUG::2014-07-10 08:49:13,863::lvm::296::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm pvcreate --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/3600601601282300032826addbbdae311|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } " -y -ff --metadatasize 128m --metadatacopies 2 --metadataignore y /dev/mapper/3600601601282300032826addbbdae311' (cwd None) >Thread-14::DEBUG::2014-07-10 08:49:14,127::lvm::296::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ' Couldn\'t find device with uuid 0eUwla-dsA3-g6ia-RU23-cual-0rt9-KzkxLj.\n WARNING: Forcing physical volume creation on /dev/mapper/3600601601282300032826addbbdae311 of volume group "e01a3a36-d2ce-4153-bb57-d6e65b7ed08c"\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 08:49:14,129::lvm::491::OperationMutex::(_invalidatepvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-14::DEBUG::2014-07-10 08:49:14,129::lvm::494::OperationMutex::(_invalidatepvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-14::DEBUG::2014-07-10 08:49:14,130::lvm::296::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm pvchange --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/3600601601282300032826addbbdae311|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } " --metadataignore n /dev/mapper/3600601601282300032826addbbdae311' (cwd None) >Thread-14::DEBUG::2014-07-10 08:49:14,360::lvm::296::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-14::DEBUG::2014-07-10 08:49:14,361::lvm::296::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgcreate --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/3600601601282300032826addbbdae311|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } " --physicalextentsize 128m --addtag RHAT_storage_domain_UNREADY 9e1aa540-1f4e-4ee3-a152-be381ef6c3bd /dev/mapper/3600601601282300032826addbbdae311' (cwd None) >Thread-14::DEBUG::2014-07-10 08:49:14,586::lvm::296::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-14::DEBUG::2014-07-10 08:49:14,587::lvm::491::OperationMutex::(_invalidatepvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-14::DEBUG::2014-07-10 08:49:14,587::lvm::494::OperationMutex::(_invalidatepvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-14::DEBUG::2014-07-10 08:49:14,587::lvm::503::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-14::DEBUG::2014-07-10 08:49:14,588::lvm::505::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-14::DEBUG::2014-07-10 08:49:14,588::lvm::931::Storage.LVM::(createVG) Cache after createvg {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': Stub(name='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', stale=True)} >Thread-14::DEBUG::2014-07-10 08:49:14,588::lvm::373::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-14::DEBUG::2014-07-10 08:49:14,589::lvm::296::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/3600601601282300032826addbbdae311|/dev/mapper/360060160f4a030003840ec867ddee311|/dev/mapper/367cad74c2fcba00019e6afd20c781e67|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name 9e1aa540-1f4e-4ee3-a152-be381ef6c3bd' (cwd None) >Thread-14::DEBUG::2014-07-10 08:49:14,802::lvm::296::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-14::DEBUG::2014-07-10 08:49:14,805::lvm::415::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-14::INFO::2014-07-10 08:49:14,805::logUtils::47::dispatcher::(wrapper) Run and protect: createVG, Return response: {'uuid': '9CsMxb-YbRc-yRG7-cQKD-xY3G-GLi5-YxUyPC'} >Thread-14::DEBUG::2014-07-10 08:49:14,805::task::1185::TaskManager.Task::(prepare) Task=`1c72302e-7123-409b-87fb-6fdf8fe7d86c`::finished: {'uuid': '9CsMxb-YbRc-yRG7-cQKD-xY3G-GLi5-YxUyPC'} >Thread-14::DEBUG::2014-07-10 08:49:14,805::task::595::TaskManager.Task::(_updateState) Task=`1c72302e-7123-409b-87fb-6fdf8fe7d86c`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 08:49:14,806::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 08:49:14,806::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 08:49:14,806::task::990::TaskManager.Task::(_decref) Task=`1c72302e-7123-409b-87fb-6fdf8fe7d86c`::ref 0 aborting False >Thread-14::DEBUG::2014-07-10 08:49:14,813::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [3cf8ccfe] >Thread-14::DEBUG::2014-07-10 08:49:14,814::task::595::TaskManager.Task::(_updateState) Task=`ccb8deb9-4217-4039-9e9e-69ce53b712ce`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 08:49:14,815::logUtils::44::dispatcher::(wrapper) Run and protect: createStorageDomain(storageType=3, sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', domainName='SD_REAL', typeSpecificArg='9CsMxb-YbRc-yRG7-cQKD-xY3G-GLi5-YxUyPC', domClass=1, domVersion='3', options=None) >Thread-14::ERROR::2014-07-10 08:49:14,815::sdc::137::Storage.StorageDomainCache::(_findDomain) looking for unfetched domain 9e1aa540-1f4e-4ee3-a152-be381ef6c3bd >Thread-14::ERROR::2014-07-10 08:49:14,815::sdc::154::Storage.StorageDomainCache::(_findUnfetchedDomain) looking for domain 9e1aa540-1f4e-4ee3-a152-be381ef6c3bd >Thread-14::ERROR::2014-07-10 08:49:14,818::sdc::143::Storage.StorageDomainCache::(_findDomain) domain 9e1aa540-1f4e-4ee3-a152-be381ef6c3bd not found >Traceback (most recent call last): > File "/usr/share/vdsm/storage/sdc.py", line 141, in _findDomain > File "/usr/share/vdsm/storage/sdc.py", line 171, in _findUnfetchedDomain >StorageDomainDoesNotExist: Storage domain does not exist: ('9e1aa540-1f4e-4ee3-a152-be381ef6c3bd',) >Thread-14::INFO::2014-07-10 08:49:14,819::blockSD::488::Storage.StorageDomain::(create) sdUUID=9e1aa540-1f4e-4ee3-a152-be381ef6c3bd domainName=SD_REAL domClass=1 vgUUID=9CsMxb-YbRc-yRG7-cQKD-xY3G-GLi5-YxUyPC storageType=3 version=3 >Thread-14::DEBUG::2014-07-10 08:49:14,819::lvm::373::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-14::DEBUG::2014-07-10 08:49:14,820::lvm::296::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/3600601601282300032826addbbdae311|/dev/mapper/360060160f4a030003840ec867ddee311|/dev/mapper/367cad74c2fcba00019e6afd20c781e67|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name' (cwd None) >Thread-14::DEBUG::2014-07-10 08:49:15,015::lvm::296::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-14::DEBUG::2014-07-10 08:49:15,018::lvm::415::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-14::DEBUG::2014-07-10 08:49:15,018::lvm::427::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' got the operation mutex >Thread-14::DEBUG::2014-07-10 08:49:15,019::lvm::296::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm lvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/3600601601282300032826addbbdae311|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,vg_name,attr,size,seg_start_pe,devices,tags 9e1aa540-1f4e-4ee3-a152-be381ef6c3bd' (cwd None) >Thread-14::DEBUG::2014-07-10 08:49:15,199::lvm::296::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-14::DEBUG::2014-07-10 08:49:15,200::lvm::462::Storage.LVM::(_reloadlvs) lvs reloaded >Thread-14::DEBUG::2014-07-10 08:49:15,200::lvm::462::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' released the operation mutex >Thread-14::INFO::2014-07-10 08:49:15,201::blockSD::472::Storage.StorageDomain::(metaSize) size 512 MB (metaratio 262144) >Thread-14::DEBUG::2014-07-10 08:49:15,201::lvm::296::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm lvcreate --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/3600601601282300032826addbbdae311|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } " --autobackup n --contiguous n --size 512m --name metadata 9e1aa540-1f4e-4ee3-a152-be381ef6c3bd' (cwd None) >Thread-14::DEBUG::2014-07-10 08:49:15,451::lvm::296::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ' WARNING: This metadata update is NOT backed up\n WARNING: This metadata update is NOT backed up\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 08:49:15,452::lvm::503::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-14::DEBUG::2014-07-10 08:49:15,453::lvm::505::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-14::DEBUG::2014-07-10 08:49:15,453::lvm::513::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-14::DEBUG::2014-07-10 08:49:15,453::lvm::525::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-14::DEBUG::2014-07-10 08:49:15,454::lvm::427::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' got the operation mutex >Thread-14::DEBUG::2014-07-10 08:49:15,454::lvm::296::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm lvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/3600601601282300032826addbbdae311|/dev/mapper/360060160f4a030003840ec867ddee311|/dev/mapper/367cad74c2fcba00019e6afd20c781e67|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,vg_name,attr,size,seg_start_pe,devices,tags 9e1aa540-1f4e-4ee3-a152-be381ef6c3bd' (cwd None) >Thread-14::DEBUG::2014-07-10 08:49:15,648::lvm::296::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-14::DEBUG::2014-07-10 08:49:15,650::lvm::462::Storage.LVM::(_reloadlvs) lvs reloaded >Thread-14::DEBUG::2014-07-10 08:49:15,650::lvm::462::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' released the operation mutex >Thread-14::DEBUG::2014-07-10 08:49:15,651::lvm::373::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-14::DEBUG::2014-07-10 08:49:15,651::lvm::296::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/3600601601282300032826addbbdae311|/dev/mapper/360060160f4a030003840ec867ddee311|/dev/mapper/367cad74c2fcba00019e6afd20c781e67|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name 9e1aa540-1f4e-4ee3-a152-be381ef6c3bd' (cwd None) >Thread-14::DEBUG::2014-07-10 08:49:15,837::lvm::296::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-14::DEBUG::2014-07-10 08:49:15,839::lvm::415::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-14::INFO::2014-07-10 08:49:15,839::blockSD::660::Storage.StorageDomain::(getMetaDataMapping) Create: SORT MAPPING: ['/dev/mapper/3600601601282300032826addbbdae311'] >Thread-14::DEBUG::2014-07-10 08:49:15,839::lvm::325::OperationMutex::(_reloadpvs) Operation 'lvm reload operation' got the operation mutex >Thread-14::DEBUG::2014-07-10 08:49:15,841::lvm::296::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm pvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/3600601601282300032826addbbdae311|/dev/mapper/360060160f4a030003840ec867ddee311|/dev/mapper/367cad74c2fcba00019e6afd20c781e67|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,size,vg_name,vg_uuid,pe_start,pe_count,pe_alloc_count,mda_count,dev_size /dev/mapper/3600601601282300032826addbbdae311' (cwd None) >Thread-14::DEBUG::2014-07-10 08:49:16,034::lvm::296::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-14::DEBUG::2014-07-10 08:49:16,035::lvm::350::OperationMutex::(_reloadpvs) Operation 'lvm reload operation' released the operation mutex >Thread-14::DEBUG::2014-07-10 08:49:16,036::lvm::296::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm lvcreate --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/3600601601282300032826addbbdae311|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } " --autobackup n --contiguous n --size 16m --name outbox 9e1aa540-1f4e-4ee3-a152-be381ef6c3bd' (cwd None) >Thread-14::DEBUG::2014-07-10 08:49:16,278::lvm::296::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ' WARNING: This metadata update is NOT backed up\n WARNING: This metadata update is NOT backed up\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 08:49:16,279::lvm::503::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-14::DEBUG::2014-07-10 08:49:16,279::lvm::505::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-14::DEBUG::2014-07-10 08:49:16,280::lvm::513::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-14::DEBUG::2014-07-10 08:49:16,280::lvm::525::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-14::DEBUG::2014-07-10 08:49:16,281::lvm::296::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm lvcreate --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/3600601601282300032826addbbdae311|/dev/mapper/360060160f4a030003840ec867ddee311|/dev/mapper/367cad74c2fcba00019e6afd20c781e67|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } " --autobackup n --contiguous n --size 2048m --name leases 9e1aa540-1f4e-4ee3-a152-be381ef6c3bd' (cwd None) >Thread-14::DEBUG::2014-07-10 08:49:16,525::lvm::296::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ' WARNING: This metadata update is NOT backed up\n WARNING: This metadata update is NOT backed up\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 08:49:16,526::lvm::503::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-14::DEBUG::2014-07-10 08:49:16,527::lvm::505::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-14::DEBUG::2014-07-10 08:49:16,527::lvm::513::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-14::DEBUG::2014-07-10 08:49:16,527::lvm::525::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-14::DEBUG::2014-07-10 08:49:16,528::lvm::1080::Storage.Misc.excCmd::(createLV) '/usr/bin/sudo -n /bin/chown vdsm:qemu /dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/leases' (cwd None) >Thread-14::DEBUG::2014-07-10 08:49:16,547::lvm::1080::Storage.Misc.excCmd::(createLV) SUCCESS: <err> = ''; <rc> = 0 >Thread-14::DEBUG::2014-07-10 08:49:16,549::lvm::296::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm lvcreate --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/3600601601282300032826addbbdae311|/dev/mapper/360060160f4a030003840ec867ddee311|/dev/mapper/367cad74c2fcba00019e6afd20c781e67|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } " --autobackup n --contiguous n --size 8m --name ids 9e1aa540-1f4e-4ee3-a152-be381ef6c3bd' (cwd None) >Thread-14::DEBUG::2014-07-10 08:49:16,787::lvm::296::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ' WARNING: This metadata update is NOT backed up\n WARNING: This metadata update is NOT backed up\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 08:49:16,787::lvm::503::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-14::DEBUG::2014-07-10 08:49:16,788::lvm::505::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-14::DEBUG::2014-07-10 08:49:16,788::lvm::513::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-14::DEBUG::2014-07-10 08:49:16,788::lvm::525::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-14::DEBUG::2014-07-10 08:49:16,789::lvm::1080::Storage.Misc.excCmd::(createLV) '/usr/bin/sudo -n /bin/chown vdsm:qemu /dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/ids' (cwd None) >Thread-14::DEBUG::2014-07-10 08:49:16,809::lvm::1080::Storage.Misc.excCmd::(createLV) SUCCESS: <err> = ''; <rc> = 0 >Thread-14::DEBUG::2014-07-10 08:49:16,811::lvm::296::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm lvcreate --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/3600601601282300032826addbbdae311|/dev/mapper/360060160f4a030003840ec867ddee311|/dev/mapper/367cad74c2fcba00019e6afd20c781e67|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } " --autobackup n --contiguous n --size 16m --name inbox 9e1aa540-1f4e-4ee3-a152-be381ef6c3bd' (cwd None) >Thread-14::DEBUG::2014-07-10 08:49:17,049::lvm::296::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ' WARNING: This metadata update is NOT backed up\n WARNING: This metadata update is NOT backed up\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 08:49:17,050::lvm::503::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-14::DEBUG::2014-07-10 08:49:17,050::lvm::505::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-14::DEBUG::2014-07-10 08:49:17,050::lvm::513::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-14::DEBUG::2014-07-10 08:49:17,051::lvm::525::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-14::DEBUG::2014-07-10 08:49:17,052::lvm::296::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm lvcreate --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/3600601601282300032826addbbdae311|/dev/mapper/360060160f4a030003840ec867ddee311|/dev/mapper/367cad74c2fcba00019e6afd20c781e67|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } " --autobackup n --contiguous n --size 1024m --name master 9e1aa540-1f4e-4ee3-a152-be381ef6c3bd' (cwd None) >Thread-14::DEBUG::2014-07-10 08:49:17,291::lvm::296::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ' WARNING: This metadata update is NOT backed up\n WARNING: This metadata update is NOT backed up\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 08:49:17,291::lvm::503::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-14::DEBUG::2014-07-10 08:49:17,292::lvm::505::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-14::DEBUG::2014-07-10 08:49:17,292::lvm::513::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-14::DEBUG::2014-07-10 08:49:17,292::lvm::525::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-14::DEBUG::2014-07-10 08:49:17,293::lvm::1080::Storage.Misc.excCmd::(createLV) '/usr/bin/sudo -n /bin/chown vdsm:qemu /dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/master' (cwd None) >Thread-14::DEBUG::2014-07-10 08:49:17,314::lvm::1080::Storage.Misc.excCmd::(createLV) SUCCESS: <err> = ''; <rc> = 0 >Thread-14::DEBUG::2014-07-10 08:49:17,315::blockSD::1346::Storage.Misc.excCmd::(_createVMSfs) '/usr/bin/sudo -n /sbin/mkfs -q -j -E nodiscard /dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/master' (cwd None) >Thread-14::DEBUG::2014-07-10 08:49:17,529::blockSD::1346::Storage.Misc.excCmd::(_createVMSfs) SUCCESS: <err> = ''; <rc> = 0 >Thread-14::DEBUG::2014-07-10 08:49:17,531::lvm::296::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm lvchange --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/3600601601282300032826addbbdae311|/dev/mapper/360060160f4a030003840ec867ddee311|/dev/mapper/367cad74c2fcba00019e6afd20c781e67|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } " --autobackup n --available n 9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/master' (cwd None) >Thread-14::DEBUG::2014-07-10 08:49:17,750::lvm::296::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-14::DEBUG::2014-07-10 08:49:17,751::lvm::513::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-14::DEBUG::2014-07-10 08:49:17,751::lvm::525::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-14::DEBUG::2014-07-10 08:49:17,752::blockSD::539::Storage.Misc.excCmd::(create) '/bin/nice -n 19 /usr/bin/ionice -c 3 /bin/dd if=/dev/zero of=/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/metadata bs=1048576 seek=0 skip=0 conv=notrunc count=40 oflag=direct' (cwd None) >Thread-14::DEBUG::2014-07-10 08:49:17,925::blockSD::539::Storage.Misc.excCmd::(create) SUCCESS: <err> = '40+0 records in\n40+0 records out\n41943040 bytes (42 MB) copied, 0.160207 s, 262 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 08:49:17,925::misc::282::Storage.Misc::(validateDDBytes) err: ['40+0 records in', '40+0 records out', '41943040 bytes (42 MB) copied, 0.160207 s, 262 MB/s'], size: 41943040 >Thread-14::DEBUG::2014-07-10 08:49:17,926::blockSD::541::Storage.Misc.excCmd::(create) '/bin/nice -n 19 /usr/bin/ionice -c 3 /bin/dd if=/dev/zero of=/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/inbox bs=1024000 seek=0 skip=0 conv=notrunc count=1 oflag=direct' (cwd None) >Thread-14::DEBUG::2014-07-10 08:49:17,943::blockSD::541::Storage.Misc.excCmd::(create) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.00665763 s, 154 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 08:49:17,943::misc::282::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '1024000 bytes (1.0 MB) copied, 0.00665763 s, 154 MB/s'], size: 1024000 >Thread-14::DEBUG::2014-07-10 08:49:17,944::blockSD::543::Storage.Misc.excCmd::(create) '/bin/nice -n 19 /usr/bin/ionice -c 3 /bin/dd if=/dev/zero of=/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/outbox bs=1024000 seek=0 skip=0 conv=notrunc count=1 oflag=direct' (cwd None) >Thread-14::DEBUG::2014-07-10 08:49:17,959::blockSD::543::Storage.Misc.excCmd::(create) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.00563812 s, 182 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 08:49:17,960::misc::282::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '1024000 bytes (1.0 MB) copied, 0.00563812 s, 182 MB/s'], size: 1024000 >Thread-14::DEBUG::2014-07-10 08:49:17,960::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with VGTagMetadataRW backend >Thread-14::DEBUG::2014-07-10 08:49:17,961::lvm::373::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-14::DEBUG::2014-07-10 08:49:17,962::lvm::296::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/3600601601282300032826addbbdae311|/dev/mapper/360060160f4a030003840ec867ddee311|/dev/mapper/367cad74c2fcba00019e6afd20c781e67|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name 9e1aa540-1f4e-4ee3-a152-be381ef6c3bd' (cwd None) >Thread-14::DEBUG::2014-07-10 08:49:18,148::lvm::296::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-14::DEBUG::2014-07-10 08:49:18,150::lvm::415::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-14::DEBUG::2014-07-10 08:49:18,151::lvm::503::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-14::DEBUG::2014-07-10 08:49:18,151::lvm::505::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-14::DEBUG::2014-07-10 08:49:18,152::lvm::513::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-14::DEBUG::2014-07-10 08:49:18,152::lvm::525::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-14::DEBUG::2014-07-10 08:49:18,152::lvm::373::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-14::DEBUG::2014-07-10 08:49:18,153::lvm::296::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/3600601601282300032826addbbdae311|/dev/mapper/360060160f4a030003840ec867ddee311|/dev/mapper/367cad74c2fcba00019e6afd20c781e67|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name 9e1aa540-1f4e-4ee3-a152-be381ef6c3bd' (cwd None) >Thread-14::DEBUG::2014-07-10 08:49:18,342::lvm::296::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-14::DEBUG::2014-07-10 08:49:18,344::lvm::415::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-14::DEBUG::2014-07-10 08:49:18,344::persistentDict::234::Storage.PersistentDict::(refresh) read lines (VGTagMetadataRW)=[] >Thread-14::WARNING::2014-07-10 08:49:18,344::persistentDict::256::Storage.PersistentDict::(refresh) data has no embedded checksum - trust it as it is >Thread-14::DEBUG::2014-07-10 08:49:18,344::persistentDict::167::Storage.PersistentDict::(transaction) Starting transaction >Thread-14::DEBUG::2014-07-10 08:49:18,345::persistentDict::173::Storage.PersistentDict::(transaction) Flushing changes >Thread-14::DEBUG::2014-07-10 08:49:18,345::persistentDict::299::Storage.PersistentDict::(flush) about to write lines (VGTagMetadataRW)=['CLASS=Data', 'DESCRIPTION=SD_REAL', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'LOGBLKSIZE=512', 'PHYBLKSIZE=512', 'POOL_UUID=', 'PV0=pv:3600601601282300032826addbbdae311,uuid:7qEb8v-jk2X-3CPk-k4XB-eIBk-onYD-807hcV,pestart:0,pecount:8189,mapoffset:0', 'ROLE=Regular', 'SDUUID=9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'TYPE=ISCSI', 'VERSION=3', 'VGUUID=9CsMxb-YbRc-yRG7-cQKD-xY3G-GLi5-YxUyPC', '_SHA_CKSUM=16fc11442b001d65809e853cb5a0ca94c2f95c99'] >Thread-14::DEBUG::2014-07-10 08:49:18,345::lvm::503::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-14::DEBUG::2014-07-10 08:49:18,346::lvm::505::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-14::DEBUG::2014-07-10 08:49:18,346::lvm::513::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-14::DEBUG::2014-07-10 08:49:18,346::lvm::525::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-14::DEBUG::2014-07-10 08:49:18,346::lvm::373::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-14::DEBUG::2014-07-10 08:49:18,347::lvm::296::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/3600601601282300032826addbbdae311|/dev/mapper/360060160f4a030003840ec867ddee311|/dev/mapper/367cad74c2fcba00019e6afd20c781e67|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name 9e1aa540-1f4e-4ee3-a152-be381ef6c3bd' (cwd None) >Thread-14::DEBUG::2014-07-10 08:49:18,534::lvm::296::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-14::DEBUG::2014-07-10 08:49:18,536::lvm::415::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-14::DEBUG::2014-07-10 08:49:18,537::blockSD::315::storage.Metadata.VGTagMetadataRW::(writelines) Updating metadata adding=MDT_PHYBLKSIZE=512, MDT_VGUUID=9CsMxb-YbRc-yRG7-cQKD-xY3G-GLi5-YxUyPC, MDT_PV0=pv:3600601601282300032826addbbdae311&44&uuid:7qEb8v-jk2X-3CPk-k4XB-eIBk-onYD-807hcV&44&pestart:0&44&pecount:8189&44&mapoffset:0, MDT_CLASS=Data, MDT_LEASERETRIES=3, MDT_POOL_UUID=, MDT_IOOPTIMEOUTSEC=10, MDT_LOCKRENEWALINTERVALSEC=5, MDT_LOGBLKSIZE=512, MDT_DESCRIPTION=SD_REAL, MDT__SHA_CKSUM=16fc11442b001d65809e853cb5a0ca94c2f95c99, MDT_SDUUID=9e1aa540-1f4e-4ee3-a152-be381ef6c3bd, MDT_VERSION=3, MDT_LEASETIMESEC=60, MDT_TYPE=ISCSI, MDT_ROLE=Regular, MDT_LOCKPOLICY= removing= >Thread-14::DEBUG::2014-07-10 08:49:18,538::lvm::296::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgchange --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/3600601601282300032826addbbdae311|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } " --addtag MDT_LEASETIMESEC=60 --addtag MDT_POOL_UUID= --addtag MDT_VGUUID=9CsMxb-YbRc-yRG7-cQKD-xY3G-GLi5-YxUyPC --addtag MDT_VERSION=3 --addtag MDT_TYPE=ISCSI --addtag MDT_LOGBLKSIZE=512 --addtag MDT_PV0=pv:3600601601282300032826addbbdae311&44&uuid:7qEb8v-jk2X-3CPk-k4XB-eIBk-onYD-807hcV&44&pestart:0&44&pecount:8189&44&mapoffset:0 --addtag MDT_LEASERETRIES=3 --addtag MDT_IOOPTIMEOUTSEC=10 --addtag MDT_LOCKRENEWALINTERVALSEC=5 --addtag MDT_ROLE=Regular --addtag MDT_PHYBLKSIZE=512 --addtag MDT_SDUUID=9e1aa540-1f4e-4ee3-a152-be381ef6c3bd --addtag MDT_CLASS=Data --addtag MDT_LOCKPOLICY= --addtag MDT_DESCRIPTION=SD_REAL --addtag MDT__SHA_CKSUM=16fc11442b001d65809e853cb5a0ca94c2f95c99 9e1aa540-1f4e-4ee3-a152-be381ef6c3bd' (cwd None) >Thread-14::DEBUG::2014-07-10 08:49:18,746::lvm::296::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-14::DEBUG::2014-07-10 08:49:18,747::lvm::503::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-14::DEBUG::2014-07-10 08:49:18,748::lvm::505::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-14::DEBUG::2014-07-10 08:49:18,748::persistentDict::175::Storage.PersistentDict::(transaction) Finished transaction >Thread-14::DEBUG::2014-07-10 08:49:18,749::lvm::296::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgchange --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/3600601601282300032826addbbdae311|/dev/mapper/360060160f4a030003840ec867ddee311|/dev/mapper/367cad74c2fcba00019e6afd20c781e67|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } " --deltag RHAT_storage_domain_UNREADY --addtag RHAT_storage_domain 9e1aa540-1f4e-4ee3-a152-be381ef6c3bd' (cwd None) >Thread-14::DEBUG::2014-07-10 08:49:18,952::lvm::296::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-14::DEBUG::2014-07-10 08:49:18,953::lvm::503::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-14::DEBUG::2014-07-10 08:49:18,953::lvm::505::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-14::DEBUG::2014-07-10 08:49:18,953::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with LvMetadataRW backend >Thread-14::DEBUG::2014-07-10 08:49:18,954::blockSD::336::Storage.Misc.excCmd::(readlines) '/bin/dd iflag=direct skip=0 bs=2048 if=/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/metadata count=1' (cwd None) >Thread-14::DEBUG::2014-07-10 08:49:18,963::blockSD::336::Storage.Misc.excCmd::(readlines) SUCCESS: <err> = '1+0 records in\n1+0 records out\n2048 bytes (2.0 kB) copied, 0.000646054 s, 3.2 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 08:49:18,964::misc::282::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '2048 bytes (2.0 kB) copied, 0.000646054 s, 3.2 MB/s'], size: 2048 >Thread-14::DEBUG::2014-07-10 08:49:18,964::persistentDict::234::Storage.PersistentDict::(refresh) read lines (LvMetadataRW)=[] >Thread-14::WARNING::2014-07-10 08:49:18,964::persistentDict::256::Storage.PersistentDict::(refresh) data has no embedded checksum - trust it as it is >Thread-14::DEBUG::2014-07-10 08:49:18,965::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with VGTagMetadataRW backend >Thread-14::DEBUG::2014-07-10 08:49:18,965::lvm::503::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-14::DEBUG::2014-07-10 08:49:18,965::lvm::505::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-14::DEBUG::2014-07-10 08:49:18,966::lvm::513::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-14::DEBUG::2014-07-10 08:49:18,966::lvm::525::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-14::DEBUG::2014-07-10 08:49:18,966::lvm::373::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-14::DEBUG::2014-07-10 08:49:18,967::lvm::296::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/3600601601282300032826addbbdae311|/dev/mapper/360060160f4a030003840ec867ddee311|/dev/mapper/367cad74c2fcba00019e6afd20c781e67|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name 9e1aa540-1f4e-4ee3-a152-be381ef6c3bd' (cwd None) >Thread-14::DEBUG::2014-07-10 08:49:19,151::lvm::296::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-14::DEBUG::2014-07-10 08:49:19,153::lvm::415::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-14::DEBUG::2014-07-10 08:49:19,154::persistentDict::234::Storage.PersistentDict::(refresh) read lines (VGTagMetadataRW)=['LEASETIMESEC=60', 'POOL_UUID=', 'VGUUID=9CsMxb-YbRc-yRG7-cQKD-xY3G-GLi5-YxUyPC', 'VERSION=3', 'TYPE=ISCSI', 'LOGBLKSIZE=512', u'PV0=pv:3600601601282300032826addbbdae311,uuid:7qEb8v-jk2X-3CPk-k4XB-eIBk-onYD-807hcV,pestart:0,pecount:8189,mapoffset:0', 'LEASERETRIES=3', 'IOOPTIMEOUTSEC=10', 'LOCKRENEWALINTERVALSEC=5', 'ROLE=Regular', 'PHYBLKSIZE=512', 'SDUUID=9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'CLASS=Data', 'LOCKPOLICY=', 'DESCRIPTION=SD_REAL', '_SHA_CKSUM=16fc11442b001d65809e853cb5a0ca94c2f95c99'] >Thread-14::DEBUG::2014-07-10 08:49:19,155::lvm::296::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm lvchange --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/3600601601282300032826addbbdae311|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } " --autobackup n --available y 9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/master' (cwd None) >Thread-14::DEBUG::2014-07-10 08:49:19,405::lvm::296::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-14::DEBUG::2014-07-10 08:49:19,406::lvm::513::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-14::DEBUG::2014-07-10 08:49:19,407::lvm::525::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-14::DEBUG::2014-07-10 08:49:19,408::resourceManager::421::ResourceManager::(registerNamespace) Registering namespace '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd_imageNS' >Thread-14::DEBUG::2014-07-10 08:49:19,408::resourceManager::421::ResourceManager::(registerNamespace) Registering namespace '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd_volumeNS' >Thread-14::DEBUG::2014-07-10 08:49:19,408::resourceManager::421::ResourceManager::(registerNamespace) Registering namespace '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd_lvmActivationNS' >Thread-14::DEBUG::2014-07-10 08:49:19,408::clusterlock::144::initSANLock::(initSANLock) Initializing SANLock for domain 9e1aa540-1f4e-4ee3-a152-be381ef6c3bd >Thread-14::DEBUG::2014-07-10 08:49:19,420::sd::434::Storage.StorageDomain::(initSPMlease) lease initialized successfully >Thread-14::DEBUG::2014-07-10 08:49:19,421::hsm::2647::Storage.HSM::(createStorageDomain) knownSDs: {9e1aa540-1f4e-4ee3-a152-be381ef6c3bd: storage.blockSD.findDomain} >Thread-14::INFO::2014-07-10 08:49:19,421::logUtils::47::dispatcher::(wrapper) Run and protect: createStorageDomain, Return response: None >Thread-14::DEBUG::2014-07-10 08:49:19,421::task::1185::TaskManager.Task::(prepare) Task=`ccb8deb9-4217-4039-9e9e-69ce53b712ce`::finished: None >Thread-14::DEBUG::2014-07-10 08:49:19,421::task::595::TaskManager.Task::(_updateState) Task=`ccb8deb9-4217-4039-9e9e-69ce53b712ce`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 08:49:19,422::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 08:49:19,422::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 08:49:19,422::task::990::TaskManager.Task::(_decref) Task=`ccb8deb9-4217-4039-9e9e-69ce53b712ce`::ref 0 aborting False >Thread-14::DEBUG::2014-07-10 08:49:19,470::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [3cf8ccfe] >Thread-14::DEBUG::2014-07-10 08:49:19,471::task::595::TaskManager.Task::(_updateState) Task=`12d479ad-150e-4afc-9303-926961fbdbb9`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 08:49:19,472::logUtils::44::dispatcher::(wrapper) Run and protect: getStorageDomainStats(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', options=None) >Thread-14::DEBUG::2014-07-10 08:49:19,472::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.9e1aa540-1f4e-4ee3-a152-be381ef6c3bd`ReqID=`e5b75c61-59e2-4051-a54d-4c65a48f820e`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2786' at 'getStorageDomainStats' >Thread-14::DEBUG::2014-07-10 08:49:19,473::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.9e1aa540-1f4e-4ee3-a152-be381ef6c3bd' for lock type 'shared' >Thread-14::DEBUG::2014-07-10 08:49:19,473::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.9e1aa540-1f4e-4ee3-a152-be381ef6c3bd' is free. Now locking as 'shared' (1 active user) >Thread-14::DEBUG::2014-07-10 08:49:19,473::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.9e1aa540-1f4e-4ee3-a152-be381ef6c3bd`ReqID=`e5b75c61-59e2-4051-a54d-4c65a48f820e`::Granted request >Thread-14::DEBUG::2014-07-10 08:49:19,474::task::827::TaskManager.Task::(resourceAcquired) Task=`12d479ad-150e-4afc-9303-926961fbdbb9`::_resourcesAcquired: Storage.9e1aa540-1f4e-4ee3-a152-be381ef6c3bd (shared) >Thread-14::DEBUG::2014-07-10 08:49:19,474::task::990::TaskManager.Task::(_decref) Task=`12d479ad-150e-4afc-9303-926961fbdbb9`::ref 1 aborting False >Thread-14::DEBUG::2014-07-10 08:49:19,476::lvm::503::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-14::DEBUG::2014-07-10 08:49:19,476::lvm::505::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-14::DEBUG::2014-07-10 08:49:19,476::lvm::513::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-14::DEBUG::2014-07-10 08:49:19,477::lvm::525::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-14::DEBUG::2014-07-10 08:49:19,477::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with LvMetadataRW backend >Thread-14::DEBUG::2014-07-10 08:49:19,477::blockSD::336::Storage.Misc.excCmd::(readlines) '/bin/dd iflag=direct skip=0 bs=2048 if=/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/metadata count=1' (cwd None) >Thread-14::DEBUG::2014-07-10 08:49:19,488::blockSD::336::Storage.Misc.excCmd::(readlines) SUCCESS: <err> = '1+0 records in\n1+0 records out\n2048 bytes (2.0 kB) copied, 0.000530727 s, 3.9 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 08:49:19,489::misc::282::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '2048 bytes (2.0 kB) copied, 0.000530727 s, 3.9 MB/s'], size: 2048 >Thread-14::DEBUG::2014-07-10 08:49:19,489::persistentDict::234::Storage.PersistentDict::(refresh) read lines (LvMetadataRW)=[] >Thread-14::WARNING::2014-07-10 08:49:19,489::persistentDict::256::Storage.PersistentDict::(refresh) data has no embedded checksum - trust it as it is >Thread-14::DEBUG::2014-07-10 08:49:19,490::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with VGTagMetadataRW backend >Thread-14::DEBUG::2014-07-10 08:49:19,490::lvm::373::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-14::DEBUG::2014-07-10 08:49:19,491::lvm::296::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/3600601601282300032826addbbdae311|/dev/mapper/360060160f4a030003840ec867ddee311|/dev/mapper/367cad74c2fcba00019e6afd20c781e67|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name 9e1aa540-1f4e-4ee3-a152-be381ef6c3bd' (cwd None) >Thread-14::DEBUG::2014-07-10 08:49:19,681::lvm::296::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-14::DEBUG::2014-07-10 08:49:19,683::lvm::415::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-14::INFO::2014-07-10 08:49:19,684::logUtils::47::dispatcher::(wrapper) Run and protect: getStorageDomainStats, Return response: {'stats': {'mdasize': '134217728', 'mdathreshold': True, 'mdavalid': True, 'diskfree': '1094948225024', 'disktotal': '1099108974592', 'mdafree': '67104768'}} >Thread-14::DEBUG::2014-07-10 08:49:19,684::task::1185::TaskManager.Task::(prepare) Task=`12d479ad-150e-4afc-9303-926961fbdbb9`::finished: {'stats': {'mdasize': '134217728', 'mdathreshold': True, 'mdavalid': True, 'diskfree': '1094948225024', 'disktotal': '1099108974592', 'mdafree': '67104768'}} >Thread-14::DEBUG::2014-07-10 08:49:19,684::task::595::TaskManager.Task::(_updateState) Task=`12d479ad-150e-4afc-9303-926961fbdbb9`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 08:49:19,684::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': < ResourceRef 'Storage.9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', isValid: 'True' obj: 'None'>} >Thread-14::DEBUG::2014-07-10 08:49:19,685::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 08:49:19,685::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.9e1aa540-1f4e-4ee3-a152-be381ef6c3bd' >Thread-14::DEBUG::2014-07-10 08:49:19,685::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.9e1aa540-1f4e-4ee3-a152-be381ef6c3bd' (0 active users) >Thread-14::DEBUG::2014-07-10 08:49:19,685::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.9e1aa540-1f4e-4ee3-a152-be381ef6c3bd' is free, finding out if anyone is waiting for it. >Thread-14::DEBUG::2014-07-10 08:49:19,686::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', Clearing records. >Thread-14::DEBUG::2014-07-10 08:49:19,686::task::990::TaskManager.Task::(_decref) Task=`12d479ad-150e-4afc-9303-926961fbdbb9`::ref 0 aborting False >Thread-14::DEBUG::2014-07-10 08:49:19,749::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [3cf8ccfe] >Thread-14::DEBUG::2014-07-10 08:49:19,750::task::595::TaskManager.Task::(_updateState) Task=`15432946-5055-4354-a0ad-33ba0e7a4a90`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 08:49:19,750::logUtils::44::dispatcher::(wrapper) Run and protect: getVGInfo(vgUUID='9CsMxb-YbRc-yRG7-cQKD-xY3G-GLi5-YxUyPC', options=None) >Thread-14::INFO::2014-07-10 08:49:19,812::logUtils::47::dispatcher::(wrapper) Run and protect: getVGInfo, Return response: {'info': {'state': 'OK', 'vgsize': '1099108974592', 'name': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'vgfree': '1094948225024', 'vgUUID': '9CsMxb-YbRc-yRG7-cQKD-xY3G-GLi5-YxUyPC', 'pvlist': [{'vendorID': 'DGC', 'capacity': '1099108974592', 'fwrev': '0000', 'vgUUID': '9CsMxb-YbRc-yRG7-cQKD-xY3G-GLi5-YxUyPC', 'pathlist': [{'connection': '10.35.160.104', 'iqn': 'iqn.1992-04.com.emc:cx.ckm00121000438.a6', 'portal': '1', 'port': '3260', 'initiatorname': 'default'}, {'connection': '10.35.160.105', 'iqn': 'iqn.1992-04.com.emc:cx.ckm00121000438.a7', 'portal': '2', 'port': '3260', 'initiatorname': 'default'}, {'connection': '10.35.160.106', 'iqn': 'iqn.1992-04.com.emc:cx.ckm00121000438.b6', 'portal': '3', 'port': '3260', 'initiatorname': 'default'}, {'connection': '10.35.160.107', 'iqn': 'iqn.1992-04.com.emc:cx.ckm00121000438.b7', 'portal': '4', 'port': '3260', 'initiatorname': 'default'}], 'pathstatus': [{'physdev': 'sdb', 'type': 'iSCSI', 'state': 'active', 'lun': '0'}, {'physdev': 'sdd', 'type': 'iSCSI', 'state': 'active', 'lun': '0'}, {'physdev': 'sdf', 'type': 'iSCSI', 'state': 'active', 'lun': '0'}, {'physdev': 'sdh', 'type': 'iSCSI', 'state': 'active', 'lun': '0'}], 'devtype': 'iSCSI', 'pvUUID': '7qEb8v-jk2X-3CPk-k4XB-eIBk-onYD-807hcV', 'serial': 'SDGC_VRAID_CKM00121000438', 'GUID': '3600601601282300032826addbbdae311', 'devcapacity': '1099511627776', 'productID': 'VRAID'}], 'type': 3, 'attr': {'allocation': 'n', 'partial': '-', 'exported': '-', 'permission': 'w', 'clustered': '-', 'resizeable': 'z'}}} >Thread-14::DEBUG::2014-07-10 08:49:19,812::task::1185::TaskManager.Task::(prepare) Task=`15432946-5055-4354-a0ad-33ba0e7a4a90`::finished: {'info': {'state': 'OK', 'vgsize': '1099108974592', 'name': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'vgfree': '1094948225024', 'vgUUID': '9CsMxb-YbRc-yRG7-cQKD-xY3G-GLi5-YxUyPC', 'pvlist': [{'vendorID': 'DGC', 'capacity': '1099108974592', 'fwrev': '0000', 'vgUUID': '9CsMxb-YbRc-yRG7-cQKD-xY3G-GLi5-YxUyPC', 'pathlist': [{'connection': '10.35.160.104', 'iqn': 'iqn.1992-04.com.emc:cx.ckm00121000438.a6', 'portal': '1', 'port': '3260', 'initiatorname': 'default'}, {'connection': '10.35.160.105', 'iqn': 'iqn.1992-04.com.emc:cx.ckm00121000438.a7', 'portal': '2', 'port': '3260', 'initiatorname': 'default'}, {'connection': '10.35.160.106', 'iqn': 'iqn.1992-04.com.emc:cx.ckm00121000438.b6', 'portal': '3', 'port': '3260', 'initiatorname': 'default'}, {'connection': '10.35.160.107', 'iqn': 'iqn.1992-04.com.emc:cx.ckm00121000438.b7', 'portal': '4', 'port': '3260', 'initiatorname': 'default'}], 'pathstatus': [{'physdev': 'sdb', 'type': 'iSCSI', 'state': 'active', 'lun': '0'}, {'physdev': 'sdd', 'type': 'iSCSI', 'state': 'active', 'lun': '0'}, {'physdev': 'sdf', 'type': 'iSCSI', 'state': 'active', 'lun': '0'}, {'physdev': 'sdh', 'type': 'iSCSI', 'state': 'active', 'lun': '0'}], 'devtype': 'iSCSI', 'pvUUID': '7qEb8v-jk2X-3CPk-k4XB-eIBk-onYD-807hcV', 'serial': 'SDGC_VRAID_CKM00121000438', 'GUID': '3600601601282300032826addbbdae311', 'devcapacity': '1099511627776', 'productID': 'VRAID'}], 'type': 3, 'attr': {'allocation': 'n', 'partial': '-', 'exported': '-', 'permission': 'w', 'clustered': '-', 'resizeable': 'z'}}} >Thread-14::DEBUG::2014-07-10 08:49:19,812::task::595::TaskManager.Task::(_updateState) Task=`15432946-5055-4354-a0ad-33ba0e7a4a90`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 08:49:19,812::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 08:49:19,813::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 08:49:19,813::task::990::TaskManager.Task::(_decref) Task=`15432946-5055-4354-a0ad-33ba0e7a4a90`::ref 0 aborting False >Thread-14::DEBUG::2014-07-10 08:49:20,085::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [3173344c] >Thread-14::DEBUG::2014-07-10 08:49:20,086::task::595::TaskManager.Task::(_updateState) Task=`49d07e0f-eb9e-4c3f-a554-c8c720bdaafa`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 08:49:20,086::logUtils::44::dispatcher::(wrapper) Run and protect: connectStorageServer(domType=3, spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', conList=[{'connection': '10.35.160.106', 'iqn': 'iqn.1992-04.com.emc:cx.ckm00121000438.b6', 'user': '', 'tpgt': '3', 'password': '******', 'id': '4ccb966d-3b62-4db5-b3ea-c1f4b239b3a0', 'port': '3260'}, {'connection': '10.35.160.105', 'iqn': 'iqn.1992-04.com.emc:cx.ckm00121000438.a7', 'user': '', 'tpgt': '2', 'password': '******', 'id': '5fc5041b-6706-4798-a77a-b89fb29d0d03', 'port': '3260'}, {'connection': '10.35.160.107', 'iqn': 'iqn.1992-04.com.emc:cx.ckm00121000438.b7', 'user': '', 'tpgt': '4', 'password': '******', 'id': '6536c50e-b301-4a70-b649-f9aa1160ba28', 'port': '3260'}, {'connection': '10.35.160.104', 'iqn': 'iqn.1992-04.com.emc:cx.ckm00121000438.a6', 'user': '', 'tpgt': '1', 'password': '******', 'id': '9115a344-d532-4fec-8a25-370baba91fab', 'port': '3260'}], options=None) >Thread-14::DEBUG::2014-07-10 08:49:20,087::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) '/usr/bin/sudo -n /sbin/iscsiadm -m node -T iqn.1992-04.com.emc:cx.ckm00121000438.b6 -I default -p 10.35.160.106:3260,3 --op=new' (cwd None) >Thread-14::DEBUG::2014-07-10 08:49:20,113::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-14::DEBUG::2014-07-10 08:49:20,113::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) '/usr/bin/sudo -n /sbin/iscsiadm -m node -T iqn.1992-04.com.emc:cx.ckm00121000438.b6 -I default -p 10.35.160.106:3260,3 -l' (cwd None) >Thread-14::DEBUG::2014-07-10 08:49:20,140::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-14::DEBUG::2014-07-10 08:49:20,140::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) '/usr/bin/sudo -n /sbin/iscsiadm -m node -T iqn.1992-04.com.emc:cx.ckm00121000438.b6 -I default -p 10.35.160.106:3260,3 -n node.startup -v manual --op=update' (cwd None) >Thread-14::DEBUG::2014-07-10 08:49:20,159::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-14::DEBUG::2014-07-10 08:49:20,160::hsm::2352::Storage.HSM::(__prefetchDomains) Found SD uuids: ('9e1aa540-1f4e-4ee3-a152-be381ef6c3bd',) >Thread-14::DEBUG::2014-07-10 08:49:20,160::hsm::2408::Storage.HSM::(connectStorageServer) knownSDs: {9e1aa540-1f4e-4ee3-a152-be381ef6c3bd: storage.blockSD.findDomain} >Thread-14::DEBUG::2014-07-10 08:49:20,161::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) '/usr/bin/sudo -n /sbin/iscsiadm -m node -T iqn.1992-04.com.emc:cx.ckm00121000438.a7 -I default -p 10.35.160.105:3260,2 --op=new' (cwd None) >Thread-14::DEBUG::2014-07-10 08:49:20,179::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-14::DEBUG::2014-07-10 08:49:20,180::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) '/usr/bin/sudo -n /sbin/iscsiadm -m node -T iqn.1992-04.com.emc:cx.ckm00121000438.a7 -I default -p 10.35.160.105:3260,2 -l' (cwd None) >Thread-14::DEBUG::2014-07-10 08:49:20,203::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-14::DEBUG::2014-07-10 08:49:20,204::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) '/usr/bin/sudo -n /sbin/iscsiadm -m node -T iqn.1992-04.com.emc:cx.ckm00121000438.a7 -I default -p 10.35.160.105:3260,2 -n node.startup -v manual --op=update' (cwd None) >Thread-14::DEBUG::2014-07-10 08:49:20,221::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-14::DEBUG::2014-07-10 08:49:20,222::hsm::2352::Storage.HSM::(__prefetchDomains) Found SD uuids: ('9e1aa540-1f4e-4ee3-a152-be381ef6c3bd',) >Thread-14::DEBUG::2014-07-10 08:49:20,222::hsm::2408::Storage.HSM::(connectStorageServer) knownSDs: {9e1aa540-1f4e-4ee3-a152-be381ef6c3bd: storage.blockSD.findDomain} >Thread-14::DEBUG::2014-07-10 08:49:20,226::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) '/usr/bin/sudo -n /sbin/iscsiadm -m node -T iqn.1992-04.com.emc:cx.ckm00121000438.b7 -I default -p 10.35.160.107:3260,4 --op=new' (cwd None) >Thread-14::DEBUG::2014-07-10 08:49:20,249::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-14::DEBUG::2014-07-10 08:49:20,250::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) '/usr/bin/sudo -n /sbin/iscsiadm -m node -T iqn.1992-04.com.emc:cx.ckm00121000438.b7 -I default -p 10.35.160.107:3260,4 -l' (cwd None) >Thread-14::DEBUG::2014-07-10 08:49:20,277::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-14::DEBUG::2014-07-10 08:49:20,278::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) '/usr/bin/sudo -n /sbin/iscsiadm -m node -T iqn.1992-04.com.emc:cx.ckm00121000438.b7 -I default -p 10.35.160.107:3260,4 -n node.startup -v manual --op=update' (cwd None) >Thread-14::DEBUG::2014-07-10 08:49:20,297::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-14::DEBUG::2014-07-10 08:49:20,298::hsm::2352::Storage.HSM::(__prefetchDomains) Found SD uuids: ('9e1aa540-1f4e-4ee3-a152-be381ef6c3bd',) >Thread-14::DEBUG::2014-07-10 08:49:20,298::hsm::2408::Storage.HSM::(connectStorageServer) knownSDs: {9e1aa540-1f4e-4ee3-a152-be381ef6c3bd: storage.blockSD.findDomain} >Thread-14::DEBUG::2014-07-10 08:49:20,299::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) '/usr/bin/sudo -n /sbin/iscsiadm -m node -T iqn.1992-04.com.emc:cx.ckm00121000438.a6 -I default -p 10.35.160.104:3260,1 --op=new' (cwd None) >Thread-14::DEBUG::2014-07-10 08:49:20,318::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-14::DEBUG::2014-07-10 08:49:20,319::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) '/usr/bin/sudo -n /sbin/iscsiadm -m node -T iqn.1992-04.com.emc:cx.ckm00121000438.a6 -I default -p 10.35.160.104:3260,1 -l' (cwd None) >Thread-14::DEBUG::2014-07-10 08:49:20,342::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-14::DEBUG::2014-07-10 08:49:20,343::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) '/usr/bin/sudo -n /sbin/iscsiadm -m node -T iqn.1992-04.com.emc:cx.ckm00121000438.a6 -I default -p 10.35.160.104:3260,1 -n node.startup -v manual --op=update' (cwd None) >Thread-14::DEBUG::2014-07-10 08:49:20,362::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-14::DEBUG::2014-07-10 08:49:20,363::hsm::2352::Storage.HSM::(__prefetchDomains) Found SD uuids: ('9e1aa540-1f4e-4ee3-a152-be381ef6c3bd',) >Thread-14::DEBUG::2014-07-10 08:49:20,363::hsm::2408::Storage.HSM::(connectStorageServer) knownSDs: {9e1aa540-1f4e-4ee3-a152-be381ef6c3bd: storage.blockSD.findDomain} >Thread-14::INFO::2014-07-10 08:49:20,363::logUtils::47::dispatcher::(wrapper) Run and protect: connectStorageServer, Return response: {'statuslist': [{'status': 0, 'id': '4ccb966d-3b62-4db5-b3ea-c1f4b239b3a0'}, {'status': 0, 'id': '5fc5041b-6706-4798-a77a-b89fb29d0d03'}, {'status': 0, 'id': '6536c50e-b301-4a70-b649-f9aa1160ba28'}, {'status': 0, 'id': '9115a344-d532-4fec-8a25-370baba91fab'}]} >Thread-14::DEBUG::2014-07-10 08:49:20,363::task::1185::TaskManager.Task::(prepare) Task=`49d07e0f-eb9e-4c3f-a554-c8c720bdaafa`::finished: {'statuslist': [{'status': 0, 'id': '4ccb966d-3b62-4db5-b3ea-c1f4b239b3a0'}, {'status': 0, 'id': '5fc5041b-6706-4798-a77a-b89fb29d0d03'}, {'status': 0, 'id': '6536c50e-b301-4a70-b649-f9aa1160ba28'}, {'status': 0, 'id': '9115a344-d532-4fec-8a25-370baba91fab'}]} >Thread-14::DEBUG::2014-07-10 08:49:20,364::task::595::TaskManager.Task::(_updateState) Task=`49d07e0f-eb9e-4c3f-a554-c8c720bdaafa`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 08:49:20,364::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 08:49:20,364::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 08:49:20,364::task::990::TaskManager.Task::(_decref) Task=`49d07e0f-eb9e-4c3f-a554-c8c720bdaafa`::ref 0 aborting False >Thread-14::DEBUG::2014-07-10 08:49:20,375::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [5098b091] >Thread-14::DEBUG::2014-07-10 08:49:20,376::task::595::TaskManager.Task::(_updateState) Task=`584c2d73-1cf1-436b-9fc9-0647cfaf62ab`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 08:49:20,376::logUtils::44::dispatcher::(wrapper) Run and protect: getVGInfo(vgUUID='9CsMxb-YbRc-yRG7-cQKD-xY3G-GLi5-YxUyPC', options=None) >Thread-14::INFO::2014-07-10 08:49:20,410::logUtils::47::dispatcher::(wrapper) Run and protect: getVGInfo, Return response: {'info': {'state': 'OK', 'vgsize': '1099108974592', 'name': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'vgfree': '1094948225024', 'vgUUID': '9CsMxb-YbRc-yRG7-cQKD-xY3G-GLi5-YxUyPC', 'pvlist': [{'vendorID': 'DGC', 'capacity': '1099108974592', 'fwrev': '0000', 'vgUUID': '9CsMxb-YbRc-yRG7-cQKD-xY3G-GLi5-YxUyPC', 'pathlist': [{'connection': '10.35.160.104', 'iqn': 'iqn.1992-04.com.emc:cx.ckm00121000438.a6', 'portal': '1', 'port': '3260', 'initiatorname': 'default'}, {'connection': '10.35.160.105', 'iqn': 'iqn.1992-04.com.emc:cx.ckm00121000438.a7', 'portal': '2', 'port': '3260', 'initiatorname': 'default'}, {'connection': '10.35.160.106', 'iqn': 'iqn.1992-04.com.emc:cx.ckm00121000438.b6', 'portal': '3', 'port': '3260', 'initiatorname': 'default'}, {'connection': '10.35.160.107', 'iqn': 'iqn.1992-04.com.emc:cx.ckm00121000438.b7', 'portal': '4', 'port': '3260', 'initiatorname': 'default'}], 'pathstatus': [{'physdev': 'sdb', 'type': 'iSCSI', 'state': 'active', 'lun': '0'}, {'physdev': 'sdd', 'type': 'iSCSI', 'state': 'active', 'lun': '0'}, {'physdev': 'sdf', 'type': 'iSCSI', 'state': 'active', 'lun': '0'}, {'physdev': 'sdh', 'type': 'iSCSI', 'state': 'active', 'lun': '0'}], 'devtype': 'iSCSI', 'pvUUID': '7qEb8v-jk2X-3CPk-k4XB-eIBk-onYD-807hcV', 'serial': 'SDGC_VRAID_CKM00121000438', 'GUID': '3600601601282300032826addbbdae311', 'devcapacity': '1099511627776', 'productID': 'VRAID'}], 'type': 3, 'attr': {'allocation': 'n', 'partial': '-', 'exported': '-', 'permission': 'w', 'clustered': '-', 'resizeable': 'z'}}} >Thread-14::DEBUG::2014-07-10 08:49:20,410::task::1185::TaskManager.Task::(prepare) Task=`584c2d73-1cf1-436b-9fc9-0647cfaf62ab`::finished: {'info': {'state': 'OK', 'vgsize': '1099108974592', 'name': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'vgfree': '1094948225024', 'vgUUID': '9CsMxb-YbRc-yRG7-cQKD-xY3G-GLi5-YxUyPC', 'pvlist': [{'vendorID': 'DGC', 'capacity': '1099108974592', 'fwrev': '0000', 'vgUUID': '9CsMxb-YbRc-yRG7-cQKD-xY3G-GLi5-YxUyPC', 'pathlist': [{'connection': '10.35.160.104', 'iqn': 'iqn.1992-04.com.emc:cx.ckm00121000438.a6', 'portal': '1', 'port': '3260', 'initiatorname': 'default'}, {'connection': '10.35.160.105', 'iqn': 'iqn.1992-04.com.emc:cx.ckm00121000438.a7', 'portal': '2', 'port': '3260', 'initiatorname': 'default'}, {'connection': '10.35.160.106', 'iqn': 'iqn.1992-04.com.emc:cx.ckm00121000438.b6', 'portal': '3', 'port': '3260', 'initiatorname': 'default'}, {'connection': '10.35.160.107', 'iqn': 'iqn.1992-04.com.emc:cx.ckm00121000438.b7', 'portal': '4', 'port': '3260', 'initiatorname': 'default'}], 'pathstatus': [{'physdev': 'sdb', 'type': 'iSCSI', 'state': 'active', 'lun': '0'}, {'physdev': 'sdd', 'type': 'iSCSI', 'state': 'active', 'lun': '0'}, {'physdev': 'sdf', 'type': 'iSCSI', 'state': 'active', 'lun': '0'}, {'physdev': 'sdh', 'type': 'iSCSI', 'state': 'active', 'lun': '0'}], 'devtype': 'iSCSI', 'pvUUID': '7qEb8v-jk2X-3CPk-k4XB-eIBk-onYD-807hcV', 'serial': 'SDGC_VRAID_CKM00121000438', 'GUID': '3600601601282300032826addbbdae311', 'devcapacity': '1099511627776', 'productID': 'VRAID'}], 'type': 3, 'attr': {'allocation': 'n', 'partial': '-', 'exported': '-', 'permission': 'w', 'clustered': '-', 'resizeable': 'z'}}} >Thread-14::DEBUG::2014-07-10 08:49:20,411::task::595::TaskManager.Task::(_updateState) Task=`584c2d73-1cf1-436b-9fc9-0647cfaf62ab`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 08:49:20,411::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 08:49:20,411::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 08:49:20,411::task::990::TaskManager.Task::(_decref) Task=`584c2d73-1cf1-436b-9fc9-0647cfaf62ab`::ref 0 aborting False >Thread-14::DEBUG::2014-07-10 08:49:20,426::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [5098b091] >Thread-14::DEBUG::2014-07-10 08:49:20,426::task::595::TaskManager.Task::(_updateState) Task=`b6a3d1ff-fb07-4817-b47a-80ba5156091a`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 08:49:20,427::logUtils::44::dispatcher::(wrapper) Run and protect: createStoragePool(poolType=None, spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', poolName='DC_REAL', masterDom='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', domList=['9e1aa540-1f4e-4ee3-a152-be381ef6c3bd'], masterVersion=1, lockPolicy=None, lockRenewalIntervalSec=5, leaseTimeSec=60, ioOpTimeoutSec=10, leaseRetries=3, options=None) >Thread-14::DEBUG::2014-07-10 08:49:20,427::misc::756::SamplingMethod::(__call__) Trying to enter sampling method (storage.sdc.refreshStorage) >Thread-14::DEBUG::2014-07-10 08:49:20,427::misc::758::SamplingMethod::(__call__) Got in to sampling method >Thread-14::DEBUG::2014-07-10 08:49:20,427::misc::756::SamplingMethod::(__call__) Trying to enter sampling method (storage.iscsi.rescan) >Thread-14::DEBUG::2014-07-10 08:49:20,428::misc::758::SamplingMethod::(__call__) Got in to sampling method >Thread-14::DEBUG::2014-07-10 08:49:20,428::iscsi::407::Storage.ISCSI::(rescan) Performing SCSI scan, this will take up to 30 seconds >Thread-14::DEBUG::2014-07-10 08:49:20,428::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) '/usr/bin/sudo -n /sbin/iscsiadm -m session -R' (cwd None) >Thread-14::DEBUG::2014-07-10 08:49:20,457::misc::766::SamplingMethod::(__call__) Returning last result >Thread-14::DEBUG::2014-07-10 08:49:20,458::multipath::109::Storage.Misc.excCmd::(rescan) '/usr/bin/sudo -n /sbin/multipath' (cwd None) >Thread-14::DEBUG::2014-07-10 08:49:20,526::multipath::109::Storage.Misc.excCmd::(rescan) SUCCESS: <err> = ''; <rc> = 0 >Thread-14::DEBUG::2014-07-10 08:49:20,526::lvm::497::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-14::DEBUG::2014-07-10 08:49:20,527::lvm::499::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-14::DEBUG::2014-07-10 08:49:20,527::lvm::508::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-14::DEBUG::2014-07-10 08:49:20,527::lvm::510::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-14::DEBUG::2014-07-10 08:49:20,527::lvm::528::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-14::DEBUG::2014-07-10 08:49:20,528::lvm::530::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-14::DEBUG::2014-07-10 08:49:20,528::misc::766::SamplingMethod::(__call__) Returning last result >Thread-14::DEBUG::2014-07-10 08:49:20,528::lvm::373::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-14::DEBUG::2014-07-10 08:49:20,531::lvm::296::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/3600601601282300032826addbbdae311|/dev/mapper/360060160f4a030003840ec867ddee311|/dev/mapper/367cad74c2fcba00019e6afd20c781e67|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name 9e1aa540-1f4e-4ee3-a152-be381ef6c3bd' (cwd None) >Thread-14::DEBUG::2014-07-10 08:49:20,717::lvm::296::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-14::DEBUG::2014-07-10 08:49:20,720::lvm::415::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-14::DEBUG::2014-07-10 08:49:20,720::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with LvMetadataRW backend >Thread-14::DEBUG::2014-07-10 08:49:20,721::blockSD::336::Storage.Misc.excCmd::(readlines) '/bin/dd iflag=direct skip=0 bs=2048 if=/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/metadata count=1' (cwd None) >Thread-14::DEBUG::2014-07-10 08:49:20,730::blockSD::336::Storage.Misc.excCmd::(readlines) SUCCESS: <err> = '1+0 records in\n1+0 records out\n2048 bytes (2.0 kB) copied, 0.00058455 s, 3.5 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 08:49:20,731::misc::282::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '2048 bytes (2.0 kB) copied, 0.00058455 s, 3.5 MB/s'], size: 2048 >Thread-14::DEBUG::2014-07-10 08:49:20,731::persistentDict::234::Storage.PersistentDict::(refresh) read lines (LvMetadataRW)=[] >Thread-14::WARNING::2014-07-10 08:49:20,731::persistentDict::256::Storage.PersistentDict::(refresh) data has no embedded checksum - trust it as it is >Thread-14::DEBUG::2014-07-10 08:49:20,731::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with VGTagMetadataRW backend >Thread-14::DEBUG::2014-07-10 08:49:20,732::lvm::503::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-14::DEBUG::2014-07-10 08:49:20,732::lvm::505::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-14::DEBUG::2014-07-10 08:49:20,732::lvm::513::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-14::DEBUG::2014-07-10 08:49:20,733::lvm::525::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-14::DEBUG::2014-07-10 08:49:20,733::lvm::373::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-14::DEBUG::2014-07-10 08:49:20,734::lvm::296::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/3600601601282300032826addbbdae311|/dev/mapper/360060160f4a030003840ec867ddee311|/dev/mapper/367cad74c2fcba00019e6afd20c781e67|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name 9e1aa540-1f4e-4ee3-a152-be381ef6c3bd' (cwd None) >Thread-14::DEBUG::2014-07-10 08:49:20,917::lvm::296::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-14::DEBUG::2014-07-10 08:49:20,918::lvm::415::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-14::DEBUG::2014-07-10 08:49:20,919::persistentDict::234::Storage.PersistentDict::(refresh) read lines (VGTagMetadataRW)=['LEASETIMESEC=60', 'POOL_UUID=', 'VGUUID=9CsMxb-YbRc-yRG7-cQKD-xY3G-GLi5-YxUyPC', 'VERSION=3', 'TYPE=ISCSI', 'LOGBLKSIZE=512', u'PV0=pv:3600601601282300032826addbbdae311,uuid:7qEb8v-jk2X-3CPk-k4XB-eIBk-onYD-807hcV,pestart:0,pecount:8189,mapoffset:0', 'LEASERETRIES=3', 'IOOPTIMEOUTSEC=10', 'LOCKRENEWALINTERVALSEC=5', 'ROLE=Regular', 'PHYBLKSIZE=512', 'SDUUID=9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'CLASS=Data', 'LOCKPOLICY=', 'DESCRIPTION=SD_REAL', '_SHA_CKSUM=16fc11442b001d65809e853cb5a0ca94c2f95c99'] >Thread-14::INFO::2014-07-10 08:49:20,920::sd::384::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 9e1aa540-1f4e-4ee3-a152-be381ef6c3bd_imageNS already registered >Thread-14::INFO::2014-07-10 08:49:20,920::sd::392::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 9e1aa540-1f4e-4ee3-a152-be381ef6c3bd_volumeNS already registered >Thread-14::INFO::2014-07-10 08:49:20,920::blockSD::452::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 9e1aa540-1f4e-4ee3-a152-be381ef6c3bd_lvmActivationNS already registered >Thread-14::INFO::2014-07-10 08:49:20,921::blockSD::846::Storage.StorageDomain::(validate) sdUUID=9e1aa540-1f4e-4ee3-a152-be381ef6c3bd >Thread-14::DEBUG::2014-07-10 08:49:20,921::lvm::296::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgck --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/3600601601282300032826addbbdae311|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } " 9e1aa540-1f4e-4ee3-a152-be381ef6c3bd' (cwd None) >Thread-14::DEBUG::2014-07-10 08:49:21,104::lvm::296::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-14::DEBUG::2014-07-10 08:49:21,105::lvm::503::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-14::DEBUG::2014-07-10 08:49:21,105::lvm::505::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-14::DEBUG::2014-07-10 08:49:21,105::lvm::513::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-14::DEBUG::2014-07-10 08:49:21,106::lvm::525::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-14::DEBUG::2014-07-10 08:49:21,106::lvm::373::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-14::DEBUG::2014-07-10 08:49:21,107::lvm::296::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/3600601601282300032826addbbdae311|/dev/mapper/360060160f4a030003840ec867ddee311|/dev/mapper/367cad74c2fcba00019e6afd20c781e67|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name 9e1aa540-1f4e-4ee3-a152-be381ef6c3bd' (cwd None) >Thread-14::DEBUG::2014-07-10 08:49:21,293::lvm::296::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-14::DEBUG::2014-07-10 08:49:21,296::lvm::415::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-14::DEBUG::2014-07-10 08:49:21,296::persistentDict::234::Storage.PersistentDict::(refresh) read lines (VGTagMetadataRW)=['LEASETIMESEC=60', 'POOL_UUID=', 'VGUUID=9CsMxb-YbRc-yRG7-cQKD-xY3G-GLi5-YxUyPC', 'VERSION=3', 'TYPE=ISCSI', 'LOGBLKSIZE=512', u'PV0=pv:3600601601282300032826addbbdae311,uuid:7qEb8v-jk2X-3CPk-k4XB-eIBk-onYD-807hcV,pestart:0,pecount:8189,mapoffset:0', 'LEASERETRIES=3', 'IOOPTIMEOUTSEC=10', 'LOCKRENEWALINTERVALSEC=5', 'ROLE=Regular', 'PHYBLKSIZE=512', 'SDUUID=9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'CLASS=Data', 'LOCKPOLICY=', 'DESCRIPTION=SD_REAL', '_SHA_CKSUM=16fc11442b001d65809e853cb5a0ca94c2f95c99'] >Thread-14::DEBUG::2014-07-10 08:49:21,298::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`e5239518-3b2b-492a-8ce3-cd8eddbc7692`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '980' at 'createStoragePool' >Thread-14::DEBUG::2014-07-10 08:49:21,298::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' for lock type 'exclusive' >Thread-14::DEBUG::2014-07-10 08:49:21,298::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free. Now locking as 'exclusive' (1 active user) >Thread-14::DEBUG::2014-07-10 08:49:21,299::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`e5239518-3b2b-492a-8ce3-cd8eddbc7692`::Granted request >Thread-14::DEBUG::2014-07-10 08:49:21,299::task::827::TaskManager.Task::(resourceAcquired) Task=`b6a3d1ff-fb07-4817-b47a-80ba5156091a`::_resourcesAcquired: Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee (exclusive) >Thread-14::DEBUG::2014-07-10 08:49:21,299::task::990::TaskManager.Task::(_decref) Task=`b6a3d1ff-fb07-4817-b47a-80ba5156091a`::ref 1 aborting False >Thread-14::DEBUG::2014-07-10 08:49:21,300::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.9e1aa540-1f4e-4ee3-a152-be381ef6c3bd`ReqID=`7e516cc6-e24b-4e3d-a657-1df115bb38ed`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '982' at 'createStoragePool' >Thread-14::DEBUG::2014-07-10 08:49:21,300::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.9e1aa540-1f4e-4ee3-a152-be381ef6c3bd' for lock type 'exclusive' >Thread-14::DEBUG::2014-07-10 08:49:21,300::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.9e1aa540-1f4e-4ee3-a152-be381ef6c3bd' is free. Now locking as 'exclusive' (1 active user) >Thread-14::DEBUG::2014-07-10 08:49:21,300::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.9e1aa540-1f4e-4ee3-a152-be381ef6c3bd`ReqID=`7e516cc6-e24b-4e3d-a657-1df115bb38ed`::Granted request >Thread-14::DEBUG::2014-07-10 08:49:21,301::task::827::TaskManager.Task::(resourceAcquired) Task=`b6a3d1ff-fb07-4817-b47a-80ba5156091a`::_resourcesAcquired: Storage.9e1aa540-1f4e-4ee3-a152-be381ef6c3bd (exclusive) >Thread-14::DEBUG::2014-07-10 08:49:21,301::task::990::TaskManager.Task::(_decref) Task=`b6a3d1ff-fb07-4817-b47a-80ba5156091a`::ref 1 aborting False >Thread-14::INFO::2014-07-10 08:49:21,301::sp::133::Storage.StoragePool::(setBackend) updating pool 4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee backend from type NoneType instance 0x7f626c0f7210 to type StoragePoolDiskBackend instance 0x7f620c0526c8 >Thread-14::INFO::2014-07-10 08:49:21,301::sp::548::Storage.StoragePool::(create) spUUID=4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee poolName=DC_REAL master_sd=9e1aa540-1f4e-4ee3-a152-be381ef6c3bd domList=['9e1aa540-1f4e-4ee3-a152-be381ef6c3bd'] masterVersion=1 {'LEASETIMESEC': 60, 'IOOPTIMEOUTSEC': 10, 'LEASERETRIES': 3, 'LOCKRENEWALINTERVALSEC': 5} >Thread-14::INFO::2014-07-10 08:49:21,302::blockSD::846::Storage.StorageDomain::(validate) sdUUID=9e1aa540-1f4e-4ee3-a152-be381ef6c3bd >Thread-14::DEBUG::2014-07-10 08:49:21,302::lvm::296::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgck --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/3600601601282300032826addbbdae311|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } " 9e1aa540-1f4e-4ee3-a152-be381ef6c3bd' (cwd None) >Thread-14::DEBUG::2014-07-10 08:49:21,484::lvm::296::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-14::DEBUG::2014-07-10 08:49:21,485::lvm::503::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-14::DEBUG::2014-07-10 08:49:21,485::lvm::505::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-14::DEBUG::2014-07-10 08:49:21,485::lvm::513::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-14::DEBUG::2014-07-10 08:49:21,486::lvm::525::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-14::DEBUG::2014-07-10 08:49:21,486::lvm::373::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-14::DEBUG::2014-07-10 08:49:21,487::lvm::296::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/3600601601282300032826addbbdae311|/dev/mapper/360060160f4a030003840ec867ddee311|/dev/mapper/367cad74c2fcba00019e6afd20c781e67|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name 9e1aa540-1f4e-4ee3-a152-be381ef6c3bd' (cwd None) >Thread-14::DEBUG::2014-07-10 08:49:21,673::lvm::296::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-14::DEBUG::2014-07-10 08:49:21,675::lvm::415::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-14::DEBUG::2014-07-10 08:49:21,675::persistentDict::234::Storage.PersistentDict::(refresh) read lines (VGTagMetadataRW)=['LEASETIMESEC=60', 'POOL_UUID=', 'VGUUID=9CsMxb-YbRc-yRG7-cQKD-xY3G-GLi5-YxUyPC', 'VERSION=3', 'TYPE=ISCSI', 'LOGBLKSIZE=512', u'PV0=pv:3600601601282300032826addbbdae311,uuid:7qEb8v-jk2X-3CPk-k4XB-eIBk-onYD-807hcV,pestart:0,pecount:8189,mapoffset:0', 'LEASERETRIES=3', 'IOOPTIMEOUTSEC=10', 'LOCKRENEWALINTERVALSEC=5', 'ROLE=Regular', 'PHYBLKSIZE=512', 'SDUUID=9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'CLASS=Data', 'LOCKPOLICY=', 'DESCRIPTION=SD_REAL', '_SHA_CKSUM=16fc11442b001d65809e853cb5a0ca94c2f95c99'] >Thread-14::DEBUG::2014-07-10 08:49:21,676::lvm::503::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-14::DEBUG::2014-07-10 08:49:21,676::lvm::505::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-14::DEBUG::2014-07-10 08:49:21,677::lvm::513::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-14::DEBUG::2014-07-10 08:49:21,677::lvm::525::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-14::DEBUG::2014-07-10 08:49:21,677::lvm::373::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-14::DEBUG::2014-07-10 08:49:21,678::lvm::296::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/3600601601282300032826addbbdae311|/dev/mapper/360060160f4a030003840ec867ddee311|/dev/mapper/367cad74c2fcba00019e6afd20c781e67|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name 9e1aa540-1f4e-4ee3-a152-be381ef6c3bd' (cwd None) >Thread-14::DEBUG::2014-07-10 08:49:21,868::lvm::296::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-14::DEBUG::2014-07-10 08:49:21,870::lvm::415::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-14::DEBUG::2014-07-10 08:49:21,870::persistentDict::234::Storage.PersistentDict::(refresh) read lines (VGTagMetadataRW)=['LEASETIMESEC=60', 'POOL_UUID=', 'VGUUID=9CsMxb-YbRc-yRG7-cQKD-xY3G-GLi5-YxUyPC', 'VERSION=3', 'TYPE=ISCSI', 'LOGBLKSIZE=512', u'PV0=pv:3600601601282300032826addbbdae311,uuid:7qEb8v-jk2X-3CPk-k4XB-eIBk-onYD-807hcV,pestart:0,pecount:8189,mapoffset:0', 'LEASERETRIES=3', 'IOOPTIMEOUTSEC=10', 'LOCKRENEWALINTERVALSEC=5', 'ROLE=Regular', 'PHYBLKSIZE=512', 'SDUUID=9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'CLASS=Data', 'LOCKPOLICY=', 'DESCRIPTION=SD_REAL', '_SHA_CKSUM=16fc11442b001d65809e853cb5a0ca94c2f95c99'] >Thread-14::DEBUG::2014-07-10 08:49:21,871::persistentDict::167::Storage.PersistentDict::(transaction) Starting transaction >Thread-14::DEBUG::2014-07-10 08:49:21,871::persistentDict::175::Storage.PersistentDict::(transaction) Finished transaction >Thread-14::INFO::2014-07-10 08:49:21,872::clusterlock::184::SANLock::(acquireHostId) Acquiring host id for domain 9e1aa540-1f4e-4ee3-a152-be381ef6c3bd (id: 250) >Thread-13::DEBUG::2014-07-10 08:49:22,011::task::595::TaskManager.Task::(_updateState) Task=`8a9359ce-4d3c-4a54-8eb5-7a89a06f2a8f`::moving from state init -> state preparing >Thread-13::INFO::2014-07-10 08:49:22,011::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-13::INFO::2014-07-10 08:49:22,012::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-13::DEBUG::2014-07-10 08:49:22,012::task::1185::TaskManager.Task::(prepare) Task=`8a9359ce-4d3c-4a54-8eb5-7a89a06f2a8f`::finished: {} >Thread-13::DEBUG::2014-07-10 08:49:22,012::task::595::TaskManager.Task::(_updateState) Task=`8a9359ce-4d3c-4a54-8eb5-7a89a06f2a8f`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-07-10 08:49:22,012::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-07-10 08:49:22,013::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-07-10 08:49:22,013::task::990::TaskManager.Task::(_decref) Task=`8a9359ce-4d3c-4a54-8eb5-7a89a06f2a8f`::ref 0 aborting False >Thread-13::DEBUG::2014-07-10 08:49:37,149::task::595::TaskManager.Task::(_updateState) Task=`8bdb7f3f-e403-4746-a23a-c0e4cf9f3dea`::moving from state init -> state preparing >Thread-13::INFO::2014-07-10 08:49:37,150::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-13::INFO::2014-07-10 08:49:37,150::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-13::DEBUG::2014-07-10 08:49:37,150::task::1185::TaskManager.Task::(prepare) Task=`8bdb7f3f-e403-4746-a23a-c0e4cf9f3dea`::finished: {} >Thread-13::DEBUG::2014-07-10 08:49:37,150::task::595::TaskManager.Task::(_updateState) Task=`8bdb7f3f-e403-4746-a23a-c0e4cf9f3dea`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-07-10 08:49:37,151::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-07-10 08:49:37,151::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-07-10 08:49:37,151::task::990::TaskManager.Task::(_decref) Task=`8bdb7f3f-e403-4746-a23a-c0e4cf9f3dea`::ref 0 aborting False >Thread-14::DEBUG::2014-07-10 08:49:42,879::clusterlock::202::SANLock::(acquireHostId) Host id for domain 9e1aa540-1f4e-4ee3-a152-be381ef6c3bd successfully acquired (id: 250) >Thread-14::WARNING::2014-07-10 08:49:42,880::fileUtils::167::Storage.fileUtils::(createdir) Dir /rhev/data-center/mnt/blockSD/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/images already exists >Thread-14::WARNING::2014-07-10 08:49:42,880::fileUtils::167::Storage.fileUtils::(createdir) Dir /rhev/data-center/mnt/blockSD/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/dom_md already exists >Thread-14::DEBUG::2014-07-10 08:49:42,881::lvm::503::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-14::DEBUG::2014-07-10 08:49:42,881::lvm::505::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-14::DEBUG::2014-07-10 08:49:42,881::lvm::513::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-14::DEBUG::2014-07-10 08:49:42,881::lvm::525::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-14::DEBUG::2014-07-10 08:49:42,882::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with LvMetadataRW backend >Thread-14::DEBUG::2014-07-10 08:49:42,882::blockSD::336::Storage.Misc.excCmd::(readlines) '/bin/dd iflag=direct skip=0 bs=2048 if=/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/metadata count=1' (cwd None) >Thread-14::DEBUG::2014-07-10 08:49:42,897::blockSD::336::Storage.Misc.excCmd::(readlines) SUCCESS: <err> = '1+0 records in\n1+0 records out\n2048 bytes (2.0 kB) copied, 0.000711036 s, 2.9 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 08:49:42,897::misc::282::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '2048 bytes (2.0 kB) copied, 0.000711036 s, 2.9 MB/s'], size: 2048 >Thread-14::DEBUG::2014-07-10 08:49:42,898::persistentDict::234::Storage.PersistentDict::(refresh) read lines (LvMetadataRW)=[] >Thread-14::WARNING::2014-07-10 08:49:42,898::persistentDict::256::Storage.PersistentDict::(refresh) data has no embedded checksum - trust it as it is >Thread-14::DEBUG::2014-07-10 08:49:42,898::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with VGTagMetadataRW backend >Thread-14::DEBUG::2014-07-10 08:49:42,899::lvm::503::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-14::DEBUG::2014-07-10 08:49:42,899::lvm::505::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-14::DEBUG::2014-07-10 08:49:42,899::lvm::513::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-14::DEBUG::2014-07-10 08:49:42,899::lvm::525::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-14::DEBUG::2014-07-10 08:49:42,900::lvm::373::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-14::DEBUG::2014-07-10 08:49:42,901::lvm::296::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/3600601601282300032826addbbdae311|/dev/mapper/360060160f4a030003840ec867ddee311|/dev/mapper/367cad74c2fcba00019e6afd20c781e67|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name 9e1aa540-1f4e-4ee3-a152-be381ef6c3bd' (cwd None) >Thread-14::DEBUG::2014-07-10 08:49:43,161::lvm::296::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-14::DEBUG::2014-07-10 08:49:43,163::lvm::415::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-14::DEBUG::2014-07-10 08:49:43,164::persistentDict::234::Storage.PersistentDict::(refresh) read lines (VGTagMetadataRW)=['LEASETIMESEC=60', 'POOL_UUID=', 'VGUUID=9CsMxb-YbRc-yRG7-cQKD-xY3G-GLi5-YxUyPC', 'VERSION=3', 'TYPE=ISCSI', 'LOGBLKSIZE=512', u'PV0=pv:3600601601282300032826addbbdae311,uuid:7qEb8v-jk2X-3CPk-k4XB-eIBk-onYD-807hcV,pestart:0,pecount:8189,mapoffset:0', 'LEASERETRIES=3', 'IOOPTIMEOUTSEC=10', 'LOCKRENEWALINTERVALSEC=5', 'ROLE=Regular', 'PHYBLKSIZE=512', 'SDUUID=9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'CLASS=Data', 'LOCKPOLICY=', 'DESCRIPTION=SD_REAL', '_SHA_CKSUM=16fc11442b001d65809e853cb5a0ca94c2f95c99'] >Thread-14::INFO::2014-07-10 08:49:43,164::clusterlock::235::SANLock::(acquire) Acquiring cluster lock for domain 9e1aa540-1f4e-4ee3-a152-be381ef6c3bd (id: 250) >Thread-14::DEBUG::2014-07-10 08:49:43,177::clusterlock::261::SANLock::(acquire) Cluster lock for domain 9e1aa540-1f4e-4ee3-a152-be381ef6c3bd successfully acquired (id: 250) >Thread-14::INFO::2014-07-10 08:49:43,177::sp::671::Storage.StoragePool::(createMaster) setting master domain for spUUID 4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee on sdUUID=9e1aa540-1f4e-4ee3-a152-be381ef6c3bd >Thread-14::DEBUG::2014-07-10 08:49:43,178::persistentDict::167::Storage.PersistentDict::(transaction) Starting transaction >Thread-14::DEBUG::2014-07-10 08:49:43,178::persistentDict::173::Storage.PersistentDict::(transaction) Flushing changes >Thread-14::DEBUG::2014-07-10 08:49:43,178::persistentDict::299::Storage.PersistentDict::(flush) about to write lines (VGTagMetadataRW)=['CLASS=Data', 'DESCRIPTION=SD_REAL', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'LOGBLKSIZE=512', 'MASTER_VERSION=1', 'PHYBLKSIZE=512', 'POOL_DESCRIPTION=DC_REAL', 'POOL_DOMAINS=9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=-1', 'POOL_UUID=', u'PV0=pv:3600601601282300032826addbbdae311,uuid:7qEb8v-jk2X-3CPk-k4XB-eIBk-onYD-807hcV,pestart:0,pecount:8189,mapoffset:0', 'ROLE=Regular', 'SDUUID=9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'TYPE=ISCSI', 'VERSION=3', 'VGUUID=9CsMxb-YbRc-yRG7-cQKD-xY3G-GLi5-YxUyPC', '_SHA_CKSUM=258dd064e304c8ffa3fbfa9b4a570682a0e5d6b1'] >Thread-14::DEBUG::2014-07-10 08:49:43,179::lvm::503::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-14::DEBUG::2014-07-10 08:49:43,179::lvm::505::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-14::DEBUG::2014-07-10 08:49:43,179::lvm::513::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-14::DEBUG::2014-07-10 08:49:43,179::lvm::525::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-14::DEBUG::2014-07-10 08:49:43,180::lvm::373::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-14::DEBUG::2014-07-10 08:49:43,180::lvm::296::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/3600601601282300032826addbbdae311|/dev/mapper/360060160f4a030003840ec867ddee311|/dev/mapper/367cad74c2fcba00019e6afd20c781e67|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name 9e1aa540-1f4e-4ee3-a152-be381ef6c3bd' (cwd None) >Thread-14::DEBUG::2014-07-10 08:49:43,387::lvm::296::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-14::DEBUG::2014-07-10 08:49:43,389::lvm::415::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-14::DEBUG::2014-07-10 08:49:43,389::blockSD::315::storage.Metadata.VGTagMetadataRW::(writelines) Updating metadata adding=MDT_POOL_SPM_ID=-1, MDT_POOL_SPM_LVER=-1, MDT_POOL_DESCRIPTION=DC_REAL, MDT_MASTER_VERSION=1, MDT__SHA_CKSUM=258dd064e304c8ffa3fbfa9b4a570682a0e5d6b1, MDT_POOL_DOMAINS=9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active removing=MDT__SHA_CKSUM=16fc11442b001d65809e853cb5a0ca94c2f95c99 >Thread-14::DEBUG::2014-07-10 08:49:43,390::lvm::296::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgchange --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/3600601601282300032826addbbdae311|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } " --deltag MDT__SHA_CKSUM=16fc11442b001d65809e853cb5a0ca94c2f95c99 --addtag MDT_POOL_DOMAINS=9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active --addtag MDT_POOL_SPM_ID=-1 --addtag MDT_MASTER_VERSION=1 --addtag MDT_POOL_SPM_LVER=-1 --addtag MDT__SHA_CKSUM=258dd064e304c8ffa3fbfa9b4a570682a0e5d6b1 --addtag MDT_POOL_DESCRIPTION=DC_REAL 9e1aa540-1f4e-4ee3-a152-be381ef6c3bd' (cwd None) >Thread-14::DEBUG::2014-07-10 08:49:43,589::lvm::296::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-14::DEBUG::2014-07-10 08:49:43,590::lvm::503::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-14::DEBUG::2014-07-10 08:49:43,590::lvm::505::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-14::DEBUG::2014-07-10 08:49:43,590::persistentDict::175::Storage.PersistentDict::(transaction) Finished transaction >Thread-14::DEBUG::2014-07-10 08:49:43,591::lvm::503::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-14::DEBUG::2014-07-10 08:49:43,591::lvm::505::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-14::DEBUG::2014-07-10 08:49:43,591::lvm::513::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-14::DEBUG::2014-07-10 08:49:43,592::lvm::525::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-14::DEBUG::2014-07-10 08:49:43,592::lvm::373::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-14::DEBUG::2014-07-10 08:49:43,593::lvm::296::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/3600601601282300032826addbbdae311|/dev/mapper/360060160f4a030003840ec867ddee311|/dev/mapper/367cad74c2fcba00019e6afd20c781e67|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name 9e1aa540-1f4e-4ee3-a152-be381ef6c3bd' (cwd None) >Thread-14::DEBUG::2014-07-10 08:49:43,779::lvm::296::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-14::DEBUG::2014-07-10 08:49:43,781::lvm::415::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-14::DEBUG::2014-07-10 08:49:43,781::persistentDict::234::Storage.PersistentDict::(refresh) read lines (VGTagMetadataRW)=['LEASETIMESEC=60', 'POOL_UUID=', 'VGUUID=9CsMxb-YbRc-yRG7-cQKD-xY3G-GLi5-YxUyPC', 'VERSION=3', 'TYPE=ISCSI', 'LOGBLKSIZE=512', u'PV0=pv:3600601601282300032826addbbdae311,uuid:7qEb8v-jk2X-3CPk-k4XB-eIBk-onYD-807hcV,pestart:0,pecount:8189,mapoffset:0', 'LEASERETRIES=3', 'IOOPTIMEOUTSEC=10', 'LOCKRENEWALINTERVALSEC=5', 'ROLE=Regular', 'PHYBLKSIZE=512', 'SDUUID=9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'CLASS=Data', 'LOCKPOLICY=', 'DESCRIPTION=SD_REAL', 'POOL_DOMAINS=9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active', 'POOL_SPM_ID=-1', 'MASTER_VERSION=1', 'POOL_SPM_LVER=-1', '_SHA_CKSUM=258dd064e304c8ffa3fbfa9b4a570682a0e5d6b1', 'POOL_DESCRIPTION=DC_REAL'] >Thread-14::DEBUG::2014-07-10 08:49:43,782::persistentDict::167::Storage.PersistentDict::(transaction) Starting transaction >Thread-14::DEBUG::2014-07-10 08:49:43,782::persistentDict::160::Storage.PersistentDict::(transaction) Reusing active transaction >Thread-14::DEBUG::2014-07-10 08:49:43,782::persistentDict::160::Storage.PersistentDict::(transaction) Reusing active transaction >Thread-14::DEBUG::2014-07-10 08:49:43,783::persistentDict::160::Storage.PersistentDict::(transaction) Reusing active transaction >Thread-14::DEBUG::2014-07-10 08:49:43,783::persistentDict::173::Storage.PersistentDict::(transaction) Flushing changes >Thread-14::DEBUG::2014-07-10 08:49:43,783::persistentDict::299::Storage.PersistentDict::(flush) about to write lines (VGTagMetadataRW)=['CLASS=Data', 'DESCRIPTION=SD_REAL', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'LOGBLKSIZE=512', 'MASTER_VERSION=1', 'PHYBLKSIZE=512', 'POOL_DESCRIPTION=DC_REAL', 'POOL_DOMAINS=9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=-1', 'POOL_UUID=4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', u'PV0=pv:3600601601282300032826addbbdae311,uuid:7qEb8v-jk2X-3CPk-k4XB-eIBk-onYD-807hcV,pestart:0,pecount:8189,mapoffset:0', 'ROLE=Master', 'SDUUID=9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'TYPE=ISCSI', 'VERSION=3', 'VGUUID=9CsMxb-YbRc-yRG7-cQKD-xY3G-GLi5-YxUyPC', '_SHA_CKSUM=c4c32b0569b49805fb7350a6bafd03535a50ade1'] >Thread-14::DEBUG::2014-07-10 08:49:43,783::lvm::503::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-14::DEBUG::2014-07-10 08:49:43,784::lvm::505::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-14::DEBUG::2014-07-10 08:49:43,784::lvm::513::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-14::DEBUG::2014-07-10 08:49:43,784::lvm::525::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-14::DEBUG::2014-07-10 08:49:43,784::lvm::373::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-14::DEBUG::2014-07-10 08:49:43,785::lvm::296::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/3600601601282300032826addbbdae311|/dev/mapper/360060160f4a030003840ec867ddee311|/dev/mapper/367cad74c2fcba00019e6afd20c781e67|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name 9e1aa540-1f4e-4ee3-a152-be381ef6c3bd' (cwd None) >Thread-14::DEBUG::2014-07-10 08:49:43,973::lvm::296::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-14::DEBUG::2014-07-10 08:49:43,976::lvm::415::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-14::DEBUG::2014-07-10 08:49:43,976::blockSD::315::storage.Metadata.VGTagMetadataRW::(writelines) Updating metadata adding=MDT_POOL_UUID=4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee, MDT_ROLE=Master, MDT__SHA_CKSUM=c4c32b0569b49805fb7350a6bafd03535a50ade1 removing=MDT__SHA_CKSUM=258dd064e304c8ffa3fbfa9b4a570682a0e5d6b1, MDT_ROLE=Regular, MDT_POOL_UUID= >Thread-14::DEBUG::2014-07-10 08:49:43,977::lvm::296::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgchange --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/3600601601282300032826addbbdae311|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } " --deltag MDT_ROLE=Regular --deltag MDT_POOL_UUID= --deltag MDT__SHA_CKSUM=258dd064e304c8ffa3fbfa9b4a570682a0e5d6b1 --addtag MDT_ROLE=Master --addtag MDT__SHA_CKSUM=c4c32b0569b49805fb7350a6bafd03535a50ade1 --addtag MDT_POOL_UUID=4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee 9e1aa540-1f4e-4ee3-a152-be381ef6c3bd' (cwd None) >Thread-14::DEBUG::2014-07-10 08:49:44,175::lvm::296::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-14::DEBUG::2014-07-10 08:49:44,176::lvm::503::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-14::DEBUG::2014-07-10 08:49:44,176::lvm::505::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-14::DEBUG::2014-07-10 08:49:44,176::persistentDict::175::Storage.PersistentDict::(transaction) Finished transaction >Thread-14::DEBUG::2014-07-10 08:49:44,177::sp::1375::Storage.StoragePool::(setMasterDomain) Master domain 9e1aa540-1f4e-4ee3-a152-be381ef6c3bd verified, version 1 >Thread-14::DEBUG::2014-07-10 08:49:44,177::misc::756::SamplingMethod::(__call__) Trying to enter sampling method (storage.sp.updateMonitoringThreads) >Thread-14::DEBUG::2014-07-10 08:49:44,177::misc::758::SamplingMethod::(__call__) Got in to sampling method >Thread-14::DEBUG::2014-07-10 08:49:44,178::lvm::503::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-14::DEBUG::2014-07-10 08:49:44,178::lvm::505::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-14::DEBUG::2014-07-10 08:49:44,178::lvm::513::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-14::DEBUG::2014-07-10 08:49:44,179::lvm::525::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-14::DEBUG::2014-07-10 08:49:44,179::lvm::373::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-14::DEBUG::2014-07-10 08:49:44,180::lvm::296::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/3600601601282300032826addbbdae311|/dev/mapper/360060160f4a030003840ec867ddee311|/dev/mapper/367cad74c2fcba00019e6afd20c781e67|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name 9e1aa540-1f4e-4ee3-a152-be381ef6c3bd' (cwd None) >Thread-14::DEBUG::2014-07-10 08:49:44,368::lvm::296::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-14::DEBUG::2014-07-10 08:49:44,370::lvm::415::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-14::DEBUG::2014-07-10 08:49:44,370::persistentDict::234::Storage.PersistentDict::(refresh) read lines (VGTagMetadataRW)=['LEASETIMESEC=60', 'VGUUID=9CsMxb-YbRc-yRG7-cQKD-xY3G-GLi5-YxUyPC', 'VERSION=3', 'TYPE=ISCSI', 'LOGBLKSIZE=512', u'PV0=pv:3600601601282300032826addbbdae311,uuid:7qEb8v-jk2X-3CPk-k4XB-eIBk-onYD-807hcV,pestart:0,pecount:8189,mapoffset:0', 'LEASERETRIES=3', 'IOOPTIMEOUTSEC=10', 'LOCKRENEWALINTERVALSEC=5', 'PHYBLKSIZE=512', 'SDUUID=9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'CLASS=Data', 'LOCKPOLICY=', 'DESCRIPTION=SD_REAL', 'POOL_DOMAINS=9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active', 'POOL_SPM_ID=-1', 'MASTER_VERSION=1', 'POOL_SPM_LVER=-1', 'POOL_DESCRIPTION=DC_REAL', 'ROLE=Master', '_SHA_CKSUM=c4c32b0569b49805fb7350a6bafd03535a50ade1', 'POOL_UUID=4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee'] >Thread-14::INFO::2014-07-10 08:49:44,371::domainMonitor::99::Storage.DomainMonitor::(startMonitoring) Start monitoring 9e1aa540-1f4e-4ee3-a152-be381ef6c3bd >Thread-14::DEBUG::2014-07-10 08:49:44,372::sp::1404::Storage.StoragePool::(updateMonitoringThreads) Storage Pool `4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee` started monitoring domain `9e1aa540-1f4e-4ee3-a152-be381ef6c3bd` >Thread-15::DEBUG::2014-07-10 08:49:44,375::domainMonitor::165::Storage.DomainMonitorThread::(_monitorLoop) Starting domain monitor for 9e1aa540-1f4e-4ee3-a152-be381ef6c3bd >Thread-14::DEBUG::2014-07-10 08:49:44,377::misc::766::SamplingMethod::(__call__) Returning last result >Thread-15::DEBUG::2014-07-10 08:49:44,381::lvm::296::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgck --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/3600601601282300032826addbbdae311|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } " 9e1aa540-1f4e-4ee3-a152-be381ef6c3bd' (cwd None) >Thread-14::WARNING::2014-07-10 08:49:44,390::fileUtils::167::Storage.fileUtils::(createdir) Dir /rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee already exists >Thread-14::DEBUG::2014-07-10 08:49:44,395::lvm::503::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-14::DEBUG::2014-07-10 08:49:44,395::lvm::505::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-14::DEBUG::2014-07-10 08:49:44,395::lvm::513::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-14::DEBUG::2014-07-10 08:49:44,395::lvm::525::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-14::DEBUG::2014-07-10 08:49:44,396::lvm::373::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-14::DEBUG::2014-07-10 08:49:44,396::lvm::296::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/3600601601282300032826addbbdae311|/dev/mapper/360060160f4a030003840ec867ddee311|/dev/mapper/367cad74c2fcba00019e6afd20c781e67|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name 9e1aa540-1f4e-4ee3-a152-be381ef6c3bd' (cwd None) >Thread-15::DEBUG::2014-07-10 08:49:44,562::lvm::296::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-15::DEBUG::2014-07-10 08:49:44,563::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/metadata bs=4096 count=1' (cwd None) >Thread-15::DEBUG::2014-07-10 08:49:44,574::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000504837 s, 8.1 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-07-10 08:49:44,575::lvm::373::OperationMutex::(_reloadvgs) Got the operational mutex >Thread-15::DEBUG::2014-07-10 08:49:44,575::lvm::296::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/3600601601282300032826addbbdae311|/dev/mapper/360060160f4a030003840ec867ddee311|/dev/mapper/367cad74c2fcba00019e6afd20c781e67|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name 9e1aa540-1f4e-4ee3-a152-be381ef6c3bd' (cwd None) >Thread-14::DEBUG::2014-07-10 08:49:44,586::lvm::296::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-14::DEBUG::2014-07-10 08:49:44,589::persistentDict::234::Storage.PersistentDict::(refresh) read lines (VGTagMetadataRW)=['LEASETIMESEC=60', 'VGUUID=9CsMxb-YbRc-yRG7-cQKD-xY3G-GLi5-YxUyPC', 'VERSION=3', 'TYPE=ISCSI', 'LOGBLKSIZE=512', u'PV0=pv:3600601601282300032826addbbdae311,uuid:7qEb8v-jk2X-3CPk-k4XB-eIBk-onYD-807hcV,pestart:0,pecount:8189,mapoffset:0', 'LEASERETRIES=3', 'IOOPTIMEOUTSEC=10', 'LOCKRENEWALINTERVALSEC=5', 'PHYBLKSIZE=512', 'SDUUID=9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'CLASS=Data', 'LOCKPOLICY=', 'DESCRIPTION=SD_REAL', 'POOL_DOMAINS=9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active', 'POOL_SPM_ID=-1', 'MASTER_VERSION=1', 'POOL_SPM_LVER=-1', 'POOL_DESCRIPTION=DC_REAL', 'ROLE=Master', '_SHA_CKSUM=c4c32b0569b49805fb7350a6bafd03535a50ade1', 'POOL_UUID=4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee'] >Thread-14::DEBUG::2014-07-10 08:49:44,590::lvm::373::OperationMutex::(_reloadvgs) Got the operational mutex >Thread-14::DEBUG::2014-07-10 08:49:44,591::lvm::296::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/3600601601282300032826addbbdae311|/dev/mapper/360060160f4a030003840ec867ddee311|/dev/mapper/367cad74c2fcba00019e6afd20c781e67|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name' (cwd None) >Thread-15::DEBUG::2014-07-10 08:49:44,761::lvm::296::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-14::DEBUG::2014-07-10 08:49:44,793::lvm::296::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-15::DEBUG::2014-07-10 08:49:44,797::domainMonitor::247::Storage.DomainMonitorThread::(_monitorDomain) Domain 9e1aa540-1f4e-4ee3-a152-be381ef6c3bd changed its status to Valid >Thread-16::DEBUG::2014-07-10 08:49:44,803::misc::878::Event.Storage.DomainMonitor.onDomainStateChange::(_emit) Emitting event >Thread-14::DEBUG::2014-07-10 08:49:44,805::lvm::415::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-16::DEBUG::2014-07-10 08:49:44,806::misc::888::Event.Storage.DomainMonitor.onDomainStateChange::(_emit) Calling registered method `_onDomainStateChange` >Thread-14::WARNING::2014-07-10 08:49:44,810::fileUtils::167::Storage.fileUtils::(createdir) Dir /rhev/data-center/mnt/blockSD/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/images already exists >Thread-16::DEBUG::2014-07-10 08:49:44,810::misc::898::Event.Storage.DomainMonitor.onDomainStateChange::(_emit) Event emitted >Thread-14::WARNING::2014-07-10 08:49:44,811::fileUtils::167::Storage.fileUtils::(createdir) Dir /rhev/data-center/mnt/blockSD/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/dom_md already exists >Thread-14::INFO::2014-07-10 08:49:44,812::sp::1113::Storage.StoragePool::(_linkStorageDomain) Linking /rhev/data-center/mnt/blockSD/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd to /rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd >Thread-14::INFO::2014-07-10 08:49:44,813::sp::1113::Storage.StoragePool::(_linkStorageDomain) Linking /rhev/data-center/mnt/blockSD/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd to /rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd >Thread-14::INFO::2014-07-10 08:49:44,813::clusterlock::279::SANLock::(release) Releasing cluster lock for domain 9e1aa540-1f4e-4ee3-a152-be381ef6c3bd >Thread-14::DEBUG::2014-07-10 08:49:44,854::clusterlock::289::SANLock::(release) Cluster lock for domain 9e1aa540-1f4e-4ee3-a152-be381ef6c3bd successfully released >Thread-14::INFO::2014-07-10 08:49:44,854::clusterlock::207::SANLock::(releaseHostId) Releasing host id for domain 9e1aa540-1f4e-4ee3-a152-be381ef6c3bd (id: 250) >Thread-14::DEBUG::2014-07-10 08:49:46,855::clusterlock::217::SANLock::(releaseHostId) Host id for domain 9e1aa540-1f4e-4ee3-a152-be381ef6c3bd released successfully (id: 250) >Thread-14::INFO::2014-07-10 08:49:46,855::domainMonitor::113::Storage.DomainMonitor::(stopMonitoring) Stop monitoring 9e1aa540-1f4e-4ee3-a152-be381ef6c3bd >Thread-15::DEBUG::2014-07-10 08:49:46,856::domainMonitor::175::Storage.DomainMonitorThread::(_monitorLoop) Stopping domain monitor for 9e1aa540-1f4e-4ee3-a152-be381ef6c3bd >Thread-15::INFO::2014-07-10 08:49:46,856::clusterlock::207::SANLock::(releaseHostId) Releasing host id for domain 9e1aa540-1f4e-4ee3-a152-be381ef6c3bd (id: 250) >Thread-15::DEBUG::2014-07-10 08:49:46,857::clusterlock::217::SANLock::(releaseHostId) Host id for domain 9e1aa540-1f4e-4ee3-a152-be381ef6c3bd released successfully (id: 250) >Thread-14::INFO::2014-07-10 08:49:46,857::logUtils::47::dispatcher::(wrapper) Run and protect: createStoragePool, Return response: True >Thread-14::DEBUG::2014-07-10 08:49:46,857::task::1185::TaskManager.Task::(prepare) Task=`b6a3d1ff-fb07-4817-b47a-80ba5156091a`::finished: True >Thread-14::DEBUG::2014-07-10 08:49:46,858::task::595::TaskManager.Task::(_updateState) Task=`b6a3d1ff-fb07-4817-b47a-80ba5156091a`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 08:49:46,858::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': < ResourceRef 'Storage.9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', isValid: 'True' obj: 'None'>, 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee': < ResourceRef 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', isValid: 'True' obj: 'None'>} >Thread-14::DEBUG::2014-07-10 08:49:46,858::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 08:49:46,858::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.9e1aa540-1f4e-4ee3-a152-be381ef6c3bd' >Thread-14::DEBUG::2014-07-10 08:49:46,859::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.9e1aa540-1f4e-4ee3-a152-be381ef6c3bd' (0 active users) >Thread-14::DEBUG::2014-07-10 08:49:46,859::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.9e1aa540-1f4e-4ee3-a152-be381ef6c3bd' is free, finding out if anyone is waiting for it. >Thread-14::DEBUG::2014-07-10 08:49:46,859::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', Clearing records. >Thread-14::DEBUG::2014-07-10 08:49:46,860::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' >Thread-14::DEBUG::2014-07-10 08:49:46,860::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' (0 active users) >Thread-14::DEBUG::2014-07-10 08:49:46,860::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free, finding out if anyone is waiting for it. >Thread-14::DEBUG::2014-07-10 08:49:46,860::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', Clearing records. >Thread-14::DEBUG::2014-07-10 08:49:46,860::task::990::TaskManager.Task::(_decref) Task=`b6a3d1ff-fb07-4817-b47a-80ba5156091a`::ref 0 aborting False >Thread-14::DEBUG::2014-07-10 08:49:46,941::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [47cdd565] >Thread-14::DEBUG::2014-07-10 08:49:46,941::task::595::TaskManager.Task::(_updateState) Task=`ac9d7fdf-f9c7-4bb7-bc4f-cb8a3e69486c`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 08:49:46,942::logUtils::44::dispatcher::(wrapper) Run and protect: connectStorageServer(domType=3, spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', conList=[{'connection': '10.35.160.106', 'iqn': 'iqn.1992-04.com.emc:cx.ckm00121000438.b6', 'user': '', 'tpgt': '3', 'password': '******', 'id': '4ccb966d-3b62-4db5-b3ea-c1f4b239b3a0', 'port': '3260'}, {'connection': '10.35.160.105', 'iqn': 'iqn.1992-04.com.emc:cx.ckm00121000438.a7', 'user': '', 'tpgt': '2', 'password': '******', 'id': '5fc5041b-6706-4798-a77a-b89fb29d0d03', 'port': '3260'}, {'connection': '10.35.160.107', 'iqn': 'iqn.1992-04.com.emc:cx.ckm00121000438.b7', 'user': '', 'tpgt': '4', 'password': '******', 'id': '6536c50e-b301-4a70-b649-f9aa1160ba28', 'port': '3260'}, {'connection': '10.35.160.104', 'iqn': 'iqn.1992-04.com.emc:cx.ckm00121000438.a6', 'user': '', 'tpgt': '1', 'password': '******', 'id': '9115a344-d532-4fec-8a25-370baba91fab', 'port': '3260'}], options=None) >Thread-14::DEBUG::2014-07-10 08:49:46,942::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) '/usr/bin/sudo -n /sbin/iscsiadm -m node -T iqn.1992-04.com.emc:cx.ckm00121000438.b6 -I default -p 10.35.160.106:3260,3 --op=new' (cwd None) >Thread-14::DEBUG::2014-07-10 08:49:46,965::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-14::DEBUG::2014-07-10 08:49:46,966::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) '/usr/bin/sudo -n /sbin/iscsiadm -m node -T iqn.1992-04.com.emc:cx.ckm00121000438.b6 -I default -p 10.35.160.106:3260,3 -l' (cwd None) >Thread-14::DEBUG::2014-07-10 08:49:46,992::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-14::DEBUG::2014-07-10 08:49:46,993::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) '/usr/bin/sudo -n /sbin/iscsiadm -m node -T iqn.1992-04.com.emc:cx.ckm00121000438.b6 -I default -p 10.35.160.106:3260,3 -n node.startup -v manual --op=update' (cwd None) >Thread-14::DEBUG::2014-07-10 08:49:47,012::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-14::DEBUG::2014-07-10 08:49:47,013::hsm::2352::Storage.HSM::(__prefetchDomains) Found SD uuids: ('9e1aa540-1f4e-4ee3-a152-be381ef6c3bd',) >Thread-14::DEBUG::2014-07-10 08:49:47,013::hsm::2408::Storage.HSM::(connectStorageServer) knownSDs: {9e1aa540-1f4e-4ee3-a152-be381ef6c3bd: storage.blockSD.findDomain} >Thread-14::DEBUG::2014-07-10 08:49:47,014::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) '/usr/bin/sudo -n /sbin/iscsiadm -m node -T iqn.1992-04.com.emc:cx.ckm00121000438.a7 -I default -p 10.35.160.105:3260,2 --op=new' (cwd None) >Thread-14::DEBUG::2014-07-10 08:49:47,032::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-14::DEBUG::2014-07-10 08:49:47,033::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) '/usr/bin/sudo -n /sbin/iscsiadm -m node -T iqn.1992-04.com.emc:cx.ckm00121000438.a7 -I default -p 10.35.160.105:3260,2 -l' (cwd None) >Thread-14::DEBUG::2014-07-10 08:49:47,057::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-14::DEBUG::2014-07-10 08:49:47,058::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) '/usr/bin/sudo -n /sbin/iscsiadm -m node -T iqn.1992-04.com.emc:cx.ckm00121000438.a7 -I default -p 10.35.160.105:3260,2 -n node.startup -v manual --op=update' (cwd None) >Thread-14::DEBUG::2014-07-10 08:49:47,076::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-14::DEBUG::2014-07-10 08:49:47,077::hsm::2352::Storage.HSM::(__prefetchDomains) Found SD uuids: ('9e1aa540-1f4e-4ee3-a152-be381ef6c3bd',) >Thread-14::DEBUG::2014-07-10 08:49:47,077::hsm::2408::Storage.HSM::(connectStorageServer) knownSDs: {9e1aa540-1f4e-4ee3-a152-be381ef6c3bd: storage.blockSD.findDomain} >Thread-14::DEBUG::2014-07-10 08:49:47,078::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) '/usr/bin/sudo -n /sbin/iscsiadm -m node -T iqn.1992-04.com.emc:cx.ckm00121000438.b7 -I default -p 10.35.160.107:3260,4 --op=new' (cwd None) >Thread-14::DEBUG::2014-07-10 08:49:47,096::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-14::DEBUG::2014-07-10 08:49:47,096::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) '/usr/bin/sudo -n /sbin/iscsiadm -m node -T iqn.1992-04.com.emc:cx.ckm00121000438.b7 -I default -p 10.35.160.107:3260,4 -l' (cwd None) >Thread-14::DEBUG::2014-07-10 08:49:47,119::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-14::DEBUG::2014-07-10 08:49:47,120::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) '/usr/bin/sudo -n /sbin/iscsiadm -m node -T iqn.1992-04.com.emc:cx.ckm00121000438.b7 -I default -p 10.35.160.107:3260,4 -n node.startup -v manual --op=update' (cwd None) >Thread-14::DEBUG::2014-07-10 08:49:47,138::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-14::DEBUG::2014-07-10 08:49:47,138::hsm::2352::Storage.HSM::(__prefetchDomains) Found SD uuids: ('9e1aa540-1f4e-4ee3-a152-be381ef6c3bd',) >Thread-14::DEBUG::2014-07-10 08:49:47,139::hsm::2408::Storage.HSM::(connectStorageServer) knownSDs: {9e1aa540-1f4e-4ee3-a152-be381ef6c3bd: storage.blockSD.findDomain} >Thread-14::DEBUG::2014-07-10 08:49:47,139::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) '/usr/bin/sudo -n /sbin/iscsiadm -m node -T iqn.1992-04.com.emc:cx.ckm00121000438.a6 -I default -p 10.35.160.104:3260,1 --op=new' (cwd None) >Thread-14::DEBUG::2014-07-10 08:49:47,157::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-14::DEBUG::2014-07-10 08:49:47,158::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) '/usr/bin/sudo -n /sbin/iscsiadm -m node -T iqn.1992-04.com.emc:cx.ckm00121000438.a6 -I default -p 10.35.160.104:3260,1 -l' (cwd None) >Thread-14::DEBUG::2014-07-10 08:49:47,179::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-14::DEBUG::2014-07-10 08:49:47,179::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) '/usr/bin/sudo -n /sbin/iscsiadm -m node -T iqn.1992-04.com.emc:cx.ckm00121000438.a6 -I default -p 10.35.160.104:3260,1 -n node.startup -v manual --op=update' (cwd None) >Thread-14::DEBUG::2014-07-10 08:49:47,197::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-14::DEBUG::2014-07-10 08:49:47,198::hsm::2352::Storage.HSM::(__prefetchDomains) Found SD uuids: ('9e1aa540-1f4e-4ee3-a152-be381ef6c3bd',) >Thread-14::DEBUG::2014-07-10 08:49:47,198::hsm::2408::Storage.HSM::(connectStorageServer) knownSDs: {9e1aa540-1f4e-4ee3-a152-be381ef6c3bd: storage.blockSD.findDomain} >Thread-14::INFO::2014-07-10 08:49:47,198::logUtils::47::dispatcher::(wrapper) Run and protect: connectStorageServer, Return response: {'statuslist': [{'status': 0, 'id': '4ccb966d-3b62-4db5-b3ea-c1f4b239b3a0'}, {'status': 0, 'id': '5fc5041b-6706-4798-a77a-b89fb29d0d03'}, {'status': 0, 'id': '6536c50e-b301-4a70-b649-f9aa1160ba28'}, {'status': 0, 'id': '9115a344-d532-4fec-8a25-370baba91fab'}]} >Thread-14::DEBUG::2014-07-10 08:49:47,199::task::1185::TaskManager.Task::(prepare) Task=`ac9d7fdf-f9c7-4bb7-bc4f-cb8a3e69486c`::finished: {'statuslist': [{'status': 0, 'id': '4ccb966d-3b62-4db5-b3ea-c1f4b239b3a0'}, {'status': 0, 'id': '5fc5041b-6706-4798-a77a-b89fb29d0d03'}, {'status': 0, 'id': '6536c50e-b301-4a70-b649-f9aa1160ba28'}, {'status': 0, 'id': '9115a344-d532-4fec-8a25-370baba91fab'}]} >Thread-14::DEBUG::2014-07-10 08:49:47,199::task::595::TaskManager.Task::(_updateState) Task=`ac9d7fdf-f9c7-4bb7-bc4f-cb8a3e69486c`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 08:49:47,199::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 08:49:47,199::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 08:49:47,200::task::990::TaskManager.Task::(_decref) Task=`ac9d7fdf-f9c7-4bb7-bc4f-cb8a3e69486c`::ref 0 aborting False >Thread-14::DEBUG::2014-07-10 08:49:47,209::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [470c8eae] >Thread-14::DEBUG::2014-07-10 08:49:47,209::task::595::TaskManager.Task::(_updateState) Task=`5af0d029-0b65-42bc-ac73-a9ba6eb94676`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 08:49:47,210::logUtils::44::dispatcher::(wrapper) Run and protect: getVGInfo(vgUUID='9CsMxb-YbRc-yRG7-cQKD-xY3G-GLi5-YxUyPC', options=None) >Thread-14::DEBUG::2014-07-10 08:49:47,275::lvm::325::OperationMutex::(_reloadpvs) Operation 'lvm reload operation' got the operation mutex >Thread-14::DEBUG::2014-07-10 08:49:47,275::lvm::296::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm pvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/3600601601282300032826addbbdae311|/dev/mapper/360060160f4a030003840ec867ddee311|/dev/mapper/367cad74c2fcba00019e6afd20c781e67|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,size,vg_name,vg_uuid,pe_start,pe_count,pe_alloc_count,mda_count,dev_size /dev/mapper/3600601601282300032826addbbdae311' (cwd None) >Thread-14::DEBUG::2014-07-10 08:49:47,467::lvm::296::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-14::DEBUG::2014-07-10 08:49:47,468::lvm::350::OperationMutex::(_reloadpvs) Operation 'lvm reload operation' released the operation mutex >Thread-14::INFO::2014-07-10 08:49:47,469::logUtils::47::dispatcher::(wrapper) Run and protect: getVGInfo, Return response: {'info': {'state': 'OK', 'vgsize': '1099108974592', 'name': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'vgfree': '1094948225024', 'vgUUID': '9CsMxb-YbRc-yRG7-cQKD-xY3G-GLi5-YxUyPC', 'pvlist': [{'vendorID': 'DGC', 'capacity': '1099108974592', 'fwrev': '0000', 'vgUUID': '9CsMxb-YbRc-yRG7-cQKD-xY3G-GLi5-YxUyPC', 'pathlist': [{'connection': '10.35.160.104', 'iqn': 'iqn.1992-04.com.emc:cx.ckm00121000438.a6', 'portal': '1', 'port': '3260', 'initiatorname': 'default'}, {'connection': '10.35.160.105', 'iqn': 'iqn.1992-04.com.emc:cx.ckm00121000438.a7', 'portal': '2', 'port': '3260', 'initiatorname': 'default'}, {'connection': '10.35.160.106', 'iqn': 'iqn.1992-04.com.emc:cx.ckm00121000438.b6', 'portal': '3', 'port': '3260', 'initiatorname': 'default'}, {'connection': '10.35.160.107', 'iqn': 'iqn.1992-04.com.emc:cx.ckm00121000438.b7', 'portal': '4', 'port': '3260', 'initiatorname': 'default'}], 'pathstatus': [{'physdev': 'sdb', 'type': 'iSCSI', 'state': 'active', 'lun': '0'}, {'physdev': 'sdd', 'type': 'iSCSI', 'state': 'active', 'lun': '0'}, {'physdev': 'sdf', 'type': 'iSCSI', 'state': 'active', 'lun': '0'}, {'physdev': 'sdh', 'type': 'iSCSI', 'state': 'active', 'lun': '0'}], 'devtype': 'iSCSI', 'pvUUID': '7qEb8v-jk2X-3CPk-k4XB-eIBk-onYD-807hcV', 'serial': 'SDGC_VRAID_CKM00121000438', 'GUID': '3600601601282300032826addbbdae311', 'devcapacity': '1099511627776', 'productID': 'VRAID'}], 'type': 3, 'attr': {'allocation': 'n', 'partial': '-', 'exported': '-', 'permission': 'w', 'clustered': '-', 'resizeable': 'z'}}} >Thread-14::DEBUG::2014-07-10 08:49:47,469::task::1185::TaskManager.Task::(prepare) Task=`5af0d029-0b65-42bc-ac73-a9ba6eb94676`::finished: {'info': {'state': 'OK', 'vgsize': '1099108974592', 'name': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'vgfree': '1094948225024', 'vgUUID': '9CsMxb-YbRc-yRG7-cQKD-xY3G-GLi5-YxUyPC', 'pvlist': [{'vendorID': 'DGC', 'capacity': '1099108974592', 'fwrev': '0000', 'vgUUID': '9CsMxb-YbRc-yRG7-cQKD-xY3G-GLi5-YxUyPC', 'pathlist': [{'connection': '10.35.160.104', 'iqn': 'iqn.1992-04.com.emc:cx.ckm00121000438.a6', 'portal': '1', 'port': '3260', 'initiatorname': 'default'}, {'connection': '10.35.160.105', 'iqn': 'iqn.1992-04.com.emc:cx.ckm00121000438.a7', 'portal': '2', 'port': '3260', 'initiatorname': 'default'}, {'connection': '10.35.160.106', 'iqn': 'iqn.1992-04.com.emc:cx.ckm00121000438.b6', 'portal': '3', 'port': '3260', 'initiatorname': 'default'}, {'connection': '10.35.160.107', 'iqn': 'iqn.1992-04.com.emc:cx.ckm00121000438.b7', 'portal': '4', 'port': '3260', 'initiatorname': 'default'}], 'pathstatus': [{'physdev': 'sdb', 'type': 'iSCSI', 'state': 'active', 'lun': '0'}, {'physdev': 'sdd', 'type': 'iSCSI', 'state': 'active', 'lun': '0'}, {'physdev': 'sdf', 'type': 'iSCSI', 'state': 'active', 'lun': '0'}, {'physdev': 'sdh', 'type': 'iSCSI', 'state': 'active', 'lun': '0'}], 'devtype': 'iSCSI', 'pvUUID': '7qEb8v-jk2X-3CPk-k4XB-eIBk-onYD-807hcV', 'serial': 'SDGC_VRAID_CKM00121000438', 'GUID': '3600601601282300032826addbbdae311', 'devcapacity': '1099511627776', 'productID': 'VRAID'}], 'type': 3, 'attr': {'allocation': 'n', 'partial': '-', 'exported': '-', 'permission': 'w', 'clustered': '-', 'resizeable': 'z'}}} >Thread-14::DEBUG::2014-07-10 08:49:47,469::task::595::TaskManager.Task::(_updateState) Task=`5af0d029-0b65-42bc-ac73-a9ba6eb94676`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 08:49:47,470::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 08:49:47,470::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 08:49:47,470::task::990::TaskManager.Task::(_decref) Task=`5af0d029-0b65-42bc-ac73-a9ba6eb94676`::ref 0 aborting False >Thread-14::DEBUG::2014-07-10 08:49:47,513::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [83a37e9] >Thread-14::DEBUG::2014-07-10 08:49:47,514::task::595::TaskManager.Task::(_updateState) Task=`e3f3fab3-8944-45b3-b2c4-c838ff7ceac7`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 08:49:47,514::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-14::ERROR::2014-07-10 08:49:47,515::task::866::TaskManager.Task::(_setError) Task=`e3f3fab3-8944-45b3-b2c4-c838ff7ceac7`::Unexpected error >Traceback (most recent call last): > File "/usr/share/vdsm/storage/task.py", line 873, in _run > File "/usr/share/vdsm/logUtils.py", line 45, in wrapper > File "/usr/share/vdsm/storage/hsm.py", line 629, in getSpmStatus > File "/usr/share/vdsm/storage/hsm.py", line 326, in getPool >StoragePoolUnknown: Unknown pool id, pool not connected: ('4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee',) >Thread-14::DEBUG::2014-07-10 08:49:47,517::task::885::TaskManager.Task::(_run) Task=`e3f3fab3-8944-45b3-b2c4-c838ff7ceac7`::Task._run: e3f3fab3-8944-45b3-b2c4-c838ff7ceac7 ('4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee',) {} failed - stopping task >Thread-14::DEBUG::2014-07-10 08:49:47,517::task::1211::TaskManager.Task::(stop) Task=`e3f3fab3-8944-45b3-b2c4-c838ff7ceac7`::stopping in state preparing (force False) >Thread-14::DEBUG::2014-07-10 08:49:47,518::task::990::TaskManager.Task::(_decref) Task=`e3f3fab3-8944-45b3-b2c4-c838ff7ceac7`::ref 1 aborting True >Thread-14::INFO::2014-07-10 08:49:47,518::task::1168::TaskManager.Task::(prepare) Task=`e3f3fab3-8944-45b3-b2c4-c838ff7ceac7`::aborting: Task is aborted: 'Unknown pool id, pool not connected' - code 309 >Thread-14::DEBUG::2014-07-10 08:49:47,518::task::1173::TaskManager.Task::(prepare) Task=`e3f3fab3-8944-45b3-b2c4-c838ff7ceac7`::Prepare: aborted: Unknown pool id, pool not connected >Thread-14::DEBUG::2014-07-10 08:49:47,518::task::990::TaskManager.Task::(_decref) Task=`e3f3fab3-8944-45b3-b2c4-c838ff7ceac7`::ref 0 aborting True >Thread-14::DEBUG::2014-07-10 08:49:47,518::task::925::TaskManager.Task::(_doAbort) Task=`e3f3fab3-8944-45b3-b2c4-c838ff7ceac7`::Task._doAbort: force False >Thread-14::DEBUG::2014-07-10 08:49:47,518::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 08:49:47,519::task::595::TaskManager.Task::(_updateState) Task=`e3f3fab3-8944-45b3-b2c4-c838ff7ceac7`::moving from state preparing -> state aborting >Thread-14::DEBUG::2014-07-10 08:49:47,519::task::550::TaskManager.Task::(__state_aborting) Task=`e3f3fab3-8944-45b3-b2c4-c838ff7ceac7`::_aborting: recover policy none >Thread-14::DEBUG::2014-07-10 08:49:47,519::task::595::TaskManager.Task::(_updateState) Task=`e3f3fab3-8944-45b3-b2c4-c838ff7ceac7`::moving from state aborting -> state failed >Thread-14::DEBUG::2014-07-10 08:49:47,519::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 08:49:47,519::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::ERROR::2014-07-10 08:49:47,520::dispatcher::65::Storage.Dispatcher.Protect::(run) {'status': {'message': "Unknown pool id, pool not connected: ('4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee',)", 'code': 309}} >Thread-14::DEBUG::2014-07-10 08:49:47,568::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [83a37e9] >Thread-14::DEBUG::2014-07-10 08:49:47,568::task::595::TaskManager.Task::(_updateState) Task=`d5bd7991-e5a1-47de-9dd9-c31f761c5802`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 08:49:47,569::logUtils::44::dispatcher::(wrapper) Run and protect: connectStoragePool(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', hostID=1, msdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', masterVersion=1, domainsMap=None, options=None) >Thread-14::DEBUG::2014-07-10 08:49:47,569::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.HsmDomainMonitorLock`ReqID=`43cc138e-2649-405e-ae20-ebc95dcbeb4b`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '1018' at 'connectStoragePool' >Thread-14::DEBUG::2014-07-10 08:49:47,570::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.HsmDomainMonitorLock' for lock type 'exclusive' >Thread-14::DEBUG::2014-07-10 08:49:47,570::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.HsmDomainMonitorLock' is free. Now locking as 'exclusive' (1 active user) >Thread-14::DEBUG::2014-07-10 08:49:47,570::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.HsmDomainMonitorLock`ReqID=`43cc138e-2649-405e-ae20-ebc95dcbeb4b`::Granted request >Thread-14::DEBUG::2014-07-10 08:49:47,571::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`361edd86-c658-4a73-a63b-578a8ac44df1`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '1066' at '_connectStoragePool' >Thread-14::DEBUG::2014-07-10 08:49:47,571::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' for lock type 'exclusive' >Thread-14::DEBUG::2014-07-10 08:49:47,571::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free. Now locking as 'exclusive' (1 active user) >Thread-14::DEBUG::2014-07-10 08:49:47,572::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`361edd86-c658-4a73-a63b-578a8ac44df1`::Granted request >Thread-14::INFO::2014-07-10 08:49:47,572::sp::133::Storage.StoragePool::(setBackend) updating pool 4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee backend from type NoneType instance 0x7f626c0f7210 to type StoragePoolDiskBackend instance 0x7f6218131098 >Thread-14::INFO::2014-07-10 08:49:47,572::sp::623::Storage.StoragePool::(connect) Connect host #1 to the storage pool 4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee with master domain: 9e1aa540-1f4e-4ee3-a152-be381ef6c3bd (ver = 1) >Thread-14::DEBUG::2014-07-10 08:49:47,573::lvm::497::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-14::DEBUG::2014-07-10 08:49:47,573::lvm::499::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-14::DEBUG::2014-07-10 08:49:47,573::lvm::508::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-14::DEBUG::2014-07-10 08:49:47,573::lvm::510::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-14::DEBUG::2014-07-10 08:49:47,574::lvm::528::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-14::DEBUG::2014-07-10 08:49:47,574::lvm::530::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-14::DEBUG::2014-07-10 08:49:47,574::misc::756::SamplingMethod::(__call__) Trying to enter sampling method (storage.sdc.refreshStorage) >Thread-14::DEBUG::2014-07-10 08:49:47,574::misc::758::SamplingMethod::(__call__) Got in to sampling method >Thread-14::DEBUG::2014-07-10 08:49:47,575::misc::756::SamplingMethod::(__call__) Trying to enter sampling method (storage.iscsi.rescan) >Thread-14::DEBUG::2014-07-10 08:49:47,575::misc::758::SamplingMethod::(__call__) Got in to sampling method >Thread-14::DEBUG::2014-07-10 08:49:47,575::iscsi::407::Storage.ISCSI::(rescan) Performing SCSI scan, this will take up to 30 seconds >Thread-14::DEBUG::2014-07-10 08:49:47,575::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) '/usr/bin/sudo -n /sbin/iscsiadm -m session -R' (cwd None) >Thread-14::DEBUG::2014-07-10 08:49:47,602::misc::766::SamplingMethod::(__call__) Returning last result >Thread-14::DEBUG::2014-07-10 08:49:47,603::multipath::109::Storage.Misc.excCmd::(rescan) '/usr/bin/sudo -n /sbin/multipath' (cwd None) >Thread-14::DEBUG::2014-07-10 08:49:47,665::multipath::109::Storage.Misc.excCmd::(rescan) SUCCESS: <err> = ''; <rc> = 0 >Thread-14::DEBUG::2014-07-10 08:49:47,666::lvm::497::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-14::DEBUG::2014-07-10 08:49:47,667::lvm::499::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-14::DEBUG::2014-07-10 08:49:47,667::lvm::508::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-14::DEBUG::2014-07-10 08:49:47,667::lvm::510::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-14::DEBUG::2014-07-10 08:49:47,667::lvm::528::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-14::DEBUG::2014-07-10 08:49:47,668::lvm::530::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-14::DEBUG::2014-07-10 08:49:47,668::misc::766::SamplingMethod::(__call__) Returning last result >Thread-14::DEBUG::2014-07-10 08:49:47,668::lvm::373::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-14::DEBUG::2014-07-10 08:49:47,671::lvm::296::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/3600601601282300032826addbbdae311|/dev/mapper/360060160f4a030003840ec867ddee311|/dev/mapper/367cad74c2fcba00019e6afd20c781e67|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name 9e1aa540-1f4e-4ee3-a152-be381ef6c3bd' (cwd None) >Thread-14::DEBUG::2014-07-10 08:49:47,898::lvm::296::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-14::DEBUG::2014-07-10 08:49:47,900::lvm::415::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-14::DEBUG::2014-07-10 08:49:47,900::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with LvMetadataRW backend >Thread-14::DEBUG::2014-07-10 08:49:47,901::blockSD::336::Storage.Misc.excCmd::(readlines) '/bin/dd iflag=direct skip=0 bs=2048 if=/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/metadata count=1' (cwd None) >Thread-14::DEBUG::2014-07-10 08:49:47,913::blockSD::336::Storage.Misc.excCmd::(readlines) SUCCESS: <err> = '1+0 records in\n1+0 records out\n2048 bytes (2.0 kB) copied, 0.00474173 s, 432 kB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 08:49:47,914::misc::282::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '2048 bytes (2.0 kB) copied, 0.00474173 s, 432 kB/s'], size: 2048 >Thread-14::DEBUG::2014-07-10 08:49:47,914::persistentDict::234::Storage.PersistentDict::(refresh) read lines (LvMetadataRW)=[] >Thread-14::WARNING::2014-07-10 08:49:47,914::persistentDict::256::Storage.PersistentDict::(refresh) data has no embedded checksum - trust it as it is >Thread-14::DEBUG::2014-07-10 08:49:47,915::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with VGTagMetadataRW backend >Thread-14::DEBUG::2014-07-10 08:49:47,915::lvm::503::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-14::DEBUG::2014-07-10 08:49:47,916::lvm::505::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-14::DEBUG::2014-07-10 08:49:47,916::lvm::513::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-14::DEBUG::2014-07-10 08:49:47,916::lvm::525::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-14::DEBUG::2014-07-10 08:49:47,916::lvm::373::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-14::DEBUG::2014-07-10 08:49:47,917::lvm::296::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/3600601601282300032826addbbdae311|/dev/mapper/360060160f4a030003840ec867ddee311|/dev/mapper/367cad74c2fcba00019e6afd20c781e67|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name 9e1aa540-1f4e-4ee3-a152-be381ef6c3bd' (cwd None) >Thread-14::DEBUG::2014-07-10 08:49:48,111::lvm::296::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-14::DEBUG::2014-07-10 08:49:48,113::lvm::415::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-14::DEBUG::2014-07-10 08:49:48,114::persistentDict::234::Storage.PersistentDict::(refresh) read lines (VGTagMetadataRW)=['LEASETIMESEC=60', 'VGUUID=9CsMxb-YbRc-yRG7-cQKD-xY3G-GLi5-YxUyPC', 'VERSION=3', 'TYPE=ISCSI', 'LOGBLKSIZE=512', u'PV0=pv:3600601601282300032826addbbdae311,uuid:7qEb8v-jk2X-3CPk-k4XB-eIBk-onYD-807hcV,pestart:0,pecount:8189,mapoffset:0', 'LEASERETRIES=3', 'IOOPTIMEOUTSEC=10', 'LOCKRENEWALINTERVALSEC=5', 'PHYBLKSIZE=512', 'SDUUID=9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'CLASS=Data', 'LOCKPOLICY=', 'DESCRIPTION=SD_REAL', 'POOL_DOMAINS=9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active', 'POOL_SPM_ID=-1', 'MASTER_VERSION=1', 'POOL_SPM_LVER=-1', 'POOL_DESCRIPTION=DC_REAL', 'ROLE=Master', '_SHA_CKSUM=c4c32b0569b49805fb7350a6bafd03535a50ade1', 'POOL_UUID=4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee'] >Thread-14::INFO::2014-07-10 08:49:48,115::sd::384::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 9e1aa540-1f4e-4ee3-a152-be381ef6c3bd_imageNS already registered >Thread-14::INFO::2014-07-10 08:49:48,115::sd::392::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 9e1aa540-1f4e-4ee3-a152-be381ef6c3bd_volumeNS already registered >Thread-14::INFO::2014-07-10 08:49:48,115::blockSD::452::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 9e1aa540-1f4e-4ee3-a152-be381ef6c3bd_lvmActivationNS already registered >Thread-14::DEBUG::2014-07-10 08:49:48,116::sp::1375::Storage.StoragePool::(setMasterDomain) Master domain 9e1aa540-1f4e-4ee3-a152-be381ef6c3bd verified, version 1 >Thread-14::DEBUG::2014-07-10 08:49:48,116::misc::756::SamplingMethod::(__call__) Trying to enter sampling method (storage.sp.updateMonitoringThreads) >Thread-14::DEBUG::2014-07-10 08:49:48,116::misc::758::SamplingMethod::(__call__) Got in to sampling method >Thread-14::DEBUG::2014-07-10 08:49:48,117::lvm::503::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-14::DEBUG::2014-07-10 08:49:48,117::lvm::505::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-14::DEBUG::2014-07-10 08:49:48,117::lvm::513::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-14::DEBUG::2014-07-10 08:49:48,117::lvm::525::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-14::DEBUG::2014-07-10 08:49:48,118::lvm::373::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-14::DEBUG::2014-07-10 08:49:48,118::lvm::296::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/3600601601282300032826addbbdae311|/dev/mapper/360060160f4a030003840ec867ddee311|/dev/mapper/367cad74c2fcba00019e6afd20c781e67|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name 9e1aa540-1f4e-4ee3-a152-be381ef6c3bd' (cwd None) >Thread-14::DEBUG::2014-07-10 08:49:48,311::lvm::296::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-14::DEBUG::2014-07-10 08:49:48,313::lvm::415::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-14::DEBUG::2014-07-10 08:49:48,313::persistentDict::234::Storage.PersistentDict::(refresh) read lines (VGTagMetadataRW)=['LEASETIMESEC=60', 'VGUUID=9CsMxb-YbRc-yRG7-cQKD-xY3G-GLi5-YxUyPC', 'VERSION=3', 'TYPE=ISCSI', 'LOGBLKSIZE=512', u'PV0=pv:3600601601282300032826addbbdae311,uuid:7qEb8v-jk2X-3CPk-k4XB-eIBk-onYD-807hcV,pestart:0,pecount:8189,mapoffset:0', 'LEASERETRIES=3', 'IOOPTIMEOUTSEC=10', 'LOCKRENEWALINTERVALSEC=5', 'PHYBLKSIZE=512', 'SDUUID=9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'CLASS=Data', 'LOCKPOLICY=', 'DESCRIPTION=SD_REAL', 'POOL_DOMAINS=9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active', 'POOL_SPM_ID=-1', 'MASTER_VERSION=1', 'POOL_SPM_LVER=-1', 'POOL_DESCRIPTION=DC_REAL', 'ROLE=Master', '_SHA_CKSUM=c4c32b0569b49805fb7350a6bafd03535a50ade1', 'POOL_UUID=4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee'] >Thread-14::INFO::2014-07-10 08:49:48,314::domainMonitor::99::Storage.DomainMonitor::(startMonitoring) Start monitoring 9e1aa540-1f4e-4ee3-a152-be381ef6c3bd >Thread-14::DEBUG::2014-07-10 08:49:48,316::sp::1404::Storage.StoragePool::(updateMonitoringThreads) Storage Pool `4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee` started monitoring domain `9e1aa540-1f4e-4ee3-a152-be381ef6c3bd` >Thread-18::DEBUG::2014-07-10 08:49:48,316::domainMonitor::165::Storage.DomainMonitorThread::(_monitorLoop) Starting domain monitor for 9e1aa540-1f4e-4ee3-a152-be381ef6c3bd >Thread-14::DEBUG::2014-07-10 08:49:48,318::misc::766::SamplingMethod::(__call__) Returning last result >Thread-14::WARNING::2014-07-10 08:49:48,321::fileUtils::167::Storage.fileUtils::(createdir) Dir /rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee already exists >Thread-14::DEBUG::2014-07-10 08:49:48,327::lvm::503::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-14::DEBUG::2014-07-10 08:49:48,330::lvm::505::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-18::DEBUG::2014-07-10 08:49:48,331::lvm::296::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgck --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/3600601601282300032826addbbdae311|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } " 9e1aa540-1f4e-4ee3-a152-be381ef6c3bd' (cwd None) >Thread-14::DEBUG::2014-07-10 08:49:48,345::lvm::513::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-14::DEBUG::2014-07-10 08:49:48,346::lvm::525::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-14::DEBUG::2014-07-10 08:49:48,346::lvm::373::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-14::DEBUG::2014-07-10 08:49:48,347::lvm::296::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/3600601601282300032826addbbdae311|/dev/mapper/360060160f4a030003840ec867ddee311|/dev/mapper/367cad74c2fcba00019e6afd20c781e67|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name 9e1aa540-1f4e-4ee3-a152-be381ef6c3bd' (cwd None) >Thread-18::DEBUG::2014-07-10 08:49:48,517::lvm::296::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-18::DEBUG::2014-07-10 08:49:48,518::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/metadata bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-10 08:49:48,531::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000412833 s, 9.9 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-10 08:49:48,532::lvm::373::OperationMutex::(_reloadvgs) Got the operational mutex >Thread-18::DEBUG::2014-07-10 08:49:48,533::lvm::296::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/3600601601282300032826addbbdae311|/dev/mapper/360060160f4a030003840ec867ddee311|/dev/mapper/367cad74c2fcba00019e6afd20c781e67|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name 9e1aa540-1f4e-4ee3-a152-be381ef6c3bd' (cwd None) >Thread-14::DEBUG::2014-07-10 08:49:48,543::lvm::296::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-14::DEBUG::2014-07-10 08:49:48,545::persistentDict::234::Storage.PersistentDict::(refresh) read lines (VGTagMetadataRW)=['LEASETIMESEC=60', 'VGUUID=9CsMxb-YbRc-yRG7-cQKD-xY3G-GLi5-YxUyPC', 'VERSION=3', 'TYPE=ISCSI', 'LOGBLKSIZE=512', u'PV0=pv:3600601601282300032826addbbdae311,uuid:7qEb8v-jk2X-3CPk-k4XB-eIBk-onYD-807hcV,pestart:0,pecount:8189,mapoffset:0', 'LEASERETRIES=3', 'IOOPTIMEOUTSEC=10', 'LOCKRENEWALINTERVALSEC=5', 'PHYBLKSIZE=512', 'SDUUID=9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'CLASS=Data', 'LOCKPOLICY=', 'DESCRIPTION=SD_REAL', 'POOL_DOMAINS=9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active', 'POOL_SPM_ID=-1', 'MASTER_VERSION=1', 'POOL_SPM_LVER=-1', 'POOL_DESCRIPTION=DC_REAL', 'ROLE=Master', '_SHA_CKSUM=c4c32b0569b49805fb7350a6bafd03535a50ade1', 'POOL_UUID=4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee'] >Thread-14::DEBUG::2014-07-10 08:49:48,546::lvm::373::OperationMutex::(_reloadvgs) Got the operational mutex >Thread-14::DEBUG::2014-07-10 08:49:48,547::lvm::296::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/3600601601282300032826addbbdae311|/dev/mapper/360060160f4a030003840ec867ddee311|/dev/mapper/367cad74c2fcba00019e6afd20c781e67|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name' (cwd None) >Thread-18::DEBUG::2014-07-10 08:49:48,720::lvm::296::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-18::DEBUG::2014-07-10 08:49:48,742::domainMonitor::247::Storage.DomainMonitorThread::(_monitorDomain) Domain 9e1aa540-1f4e-4ee3-a152-be381ef6c3bd changed its status to Valid >Thread-19::DEBUG::2014-07-10 08:49:48,744::misc::878::Event.Storage.DomainMonitor.onDomainStateChange::(_emit) Emitting event >Thread-18::INFO::2014-07-10 08:49:48,745::clusterlock::184::SANLock::(acquireHostId) Acquiring host id for domain 9e1aa540-1f4e-4ee3-a152-be381ef6c3bd (id: 1) >Thread-19::DEBUG::2014-07-10 08:49:48,747::misc::888::Event.Storage.DomainMonitor.onDomainStateChange::(_emit) Calling registered method `_onDomainStateChange` >Thread-18::DEBUG::2014-07-10 08:49:48,748::clusterlock::202::SANLock::(acquireHostId) Host id for domain 9e1aa540-1f4e-4ee3-a152-be381ef6c3bd successfully acquired (id: 1) >Thread-19::DEBUG::2014-07-10 08:49:48,752::misc::888::Event.Storage.DomainMonitor.onDomainStateChange::(_emit) Calling registered method `contEIOVms` >Thread-19::DEBUG::2014-07-10 08:49:48,756::misc::898::Event.Storage.DomainMonitor.onDomainStateChange::(_emit) Event emitted >Thread-21::INFO::2014-07-10 08:49:48,757::clientIF::126::vds::(contEIOVms) vmContainerLock acquired >Thread-14::DEBUG::2014-07-10 08:49:48,759::lvm::296::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-14::DEBUG::2014-07-10 08:49:48,762::lvm::415::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-14::WARNING::2014-07-10 08:49:48,763::fileUtils::167::Storage.fileUtils::(createdir) Dir /rhev/data-center/mnt/blockSD/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/images already exists >Thread-14::WARNING::2014-07-10 08:49:48,763::fileUtils::167::Storage.fileUtils::(createdir) Dir /rhev/data-center/mnt/blockSD/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/dom_md already exists >Thread-14::INFO::2014-07-10 08:49:48,764::sp::1113::Storage.StoragePool::(_linkStorageDomain) Linking /rhev/data-center/mnt/blockSD/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd to /rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd >Thread-14::INFO::2014-07-10 08:49:48,764::sp::1113::Storage.StoragePool::(_linkStorageDomain) Linking /rhev/data-center/mnt/blockSD/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd to /rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd >Thread-14::DEBUG::2014-07-10 08:49:48,765::threadPool::35::Misc.ThreadPool::(__init__) Enter - numThreads: 5.0, waitTimeout: 3, maxTasks: 500.0 >Thread-14::DEBUG::2014-07-10 08:49:48,769::storage_mailbox::84::Storage.Misc.excCmd::(_mboxExecCmd) '/bin/dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/outbox iflag=direct,fullblock bs=512 count=8 skip=8' (cwd None) >Thread-14::DEBUG::2014-07-10 08:49:49,059::storage_mailbox::84::Storage.Misc.excCmd::(_mboxExecCmd) SUCCESS: <err> = '8+0 records in\n8+0 records out\n4096 bytes (4.1 kB) copied, 0.280887 s, 14.6 kB/s\n'; <rc> = 0 >Thread-14::INFO::2014-07-10 08:49:49,060::storage_mailbox::385::Storage.MailBox.HsmMailMonitor::(_sendMail) HSM_MailMonitor sending mail to SPM - ['/bin/dd', 'of=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox', 'iflag=fullblock', 'oflag=direct', 'conv=notrunc', 'bs=512', 'seek=8'] >Thread-14::DEBUG::2014-07-10 08:49:49,061::storage_mailbox::84::Storage.Misc.excCmd::(_mboxExecCmd) '/bin/dd of=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=fullblock oflag=direct conv=notrunc bs=512 seek=8' (cwd None) >Thread-14::DEBUG::2014-07-10 08:49:50,071::storage_mailbox::84::Storage.Misc.excCmd::(_mboxExecCmd) SUCCESS: <err> = '8+0 records in\n8+0 records out\n4096 bytes (4.1 kB) copied, 1.00154 s, 4.1 kB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 08:49:50,072::storage_mailbox::207::Storage.Mailbox.HSM::(__init__) HSM_MailboxMonitor created for pool 4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee >Thread-14::DEBUG::2014-07-10 08:49:50,072::sp::465::Storage.StoragePool::(__createMailboxMonitor) HSM mailbox ready for pool 4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee on master domain 9e1aa540-1f4e-4ee3-a152-be381ef6c3bd >Thread-14::DEBUG::2014-07-10 08:49:50,073::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' >Thread-14::DEBUG::2014-07-10 08:49:50,073::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' (0 active users) >Thread-14::DEBUG::2014-07-10 08:49:50,073::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free, finding out if anyone is waiting for it. >Thread-14::DEBUG::2014-07-10 08:49:50,074::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', Clearing records. >Thread-14::DEBUG::2014-07-10 08:49:50,074::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.HsmDomainMonitorLock' >Thread-14::DEBUG::2014-07-10 08:49:50,074::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.HsmDomainMonitorLock' (0 active users) >Thread-14::DEBUG::2014-07-10 08:49:50,074::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.HsmDomainMonitorLock' is free, finding out if anyone is waiting for it. >Thread-14::DEBUG::2014-07-10 08:49:50,075::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.HsmDomainMonitorLock', Clearing records. >Thread-14::INFO::2014-07-10 08:49:50,075::logUtils::47::dispatcher::(wrapper) Run and protect: connectStoragePool, Return response: True >Thread-14::DEBUG::2014-07-10 08:49:50,075::task::1185::TaskManager.Task::(prepare) Task=`d5bd7991-e5a1-47de-9dd9-c31f761c5802`::finished: True >Thread-14::DEBUG::2014-07-10 08:49:50,075::task::595::TaskManager.Task::(_updateState) Task=`d5bd7991-e5a1-47de-9dd9-c31f761c5802`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 08:49:50,076::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 08:49:50,076::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 08:49:50,076::task::990::TaskManager.Task::(_decref) Task=`d5bd7991-e5a1-47de-9dd9-c31f761c5802`::ref 0 aborting False >Thread-14::DEBUG::2014-07-10 08:49:50,121::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [83a37e9] >Thread-14::DEBUG::2014-07-10 08:49:50,122::task::595::TaskManager.Task::(_updateState) Task=`6499a28e-d4f2-4fc9-8647-c6d1ec57d6db`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 08:49:50,122::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-14::INFO::2014-07-10 08:49:50,123::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': -1, 'spmStatus': 'Free', 'spmLver': -1}} >Thread-14::DEBUG::2014-07-10 08:49:50,123::task::1185::TaskManager.Task::(prepare) Task=`6499a28e-d4f2-4fc9-8647-c6d1ec57d6db`::finished: {'spm_st': {'spmId': -1, 'spmStatus': 'Free', 'spmLver': -1}} >Thread-14::DEBUG::2014-07-10 08:49:50,123::task::595::TaskManager.Task::(_updateState) Task=`6499a28e-d4f2-4fc9-8647-c6d1ec57d6db`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 08:49:50,123::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 08:49:50,123::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 08:49:50,124::task::990::TaskManager.Task::(_decref) Task=`6499a28e-d4f2-4fc9-8647-c6d1ec57d6db`::ref 0 aborting False >Thread-14::DEBUG::2014-07-10 08:49:50,187::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [83a37e9] >Thread-14::DEBUG::2014-07-10 08:49:50,188::task::595::TaskManager.Task::(_updateState) Task=`a87169e0-a176-4c59-b6eb-eec414640692`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 08:49:50,188::logUtils::44::dispatcher::(wrapper) Run and protect: spmStart(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', prevID=-1, prevLVER='-1', maxHostID=250, domVersion='3', options=None) >Thread-14::DEBUG::2014-07-10 08:49:50,189::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`893930ad-b5d7-495d-98f2-9ae03d26f215`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '588' at 'spmStart' >Thread-14::DEBUG::2014-07-10 08:49:50,189::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' for lock type 'exclusive' >Thread-14::DEBUG::2014-07-10 08:49:50,189::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free. Now locking as 'exclusive' (1 active user) >Thread-14::DEBUG::2014-07-10 08:49:50,189::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`893930ad-b5d7-495d-98f2-9ae03d26f215`::Granted request >Thread-14::DEBUG::2014-07-10 08:49:50,190::task::827::TaskManager.Task::(resourceAcquired) Task=`a87169e0-a176-4c59-b6eb-eec414640692`::_resourcesAcquired: Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee (exclusive) >Thread-14::DEBUG::2014-07-10 08:49:50,190::task::990::TaskManager.Task::(_decref) Task=`a87169e0-a176-4c59-b6eb-eec414640692`::ref 1 aborting False >Thread-14::INFO::2014-07-10 08:49:50,190::logUtils::47::dispatcher::(wrapper) Run and protect: spmStart, Return response: None >Thread-14::DEBUG::2014-07-10 08:49:50,191::task::1180::TaskManager.Task::(prepare) Task=`a87169e0-a176-4c59-b6eb-eec414640692`::Prepare: 1 jobs exist, move to acquiring >Thread-14::DEBUG::2014-07-10 08:49:50,191::task::595::TaskManager.Task::(_updateState) Task=`a87169e0-a176-4c59-b6eb-eec414640692`::moving from state preparing -> state acquiring >Thread-14::DEBUG::2014-07-10 08:49:50,191::task::595::TaskManager.Task::(_updateState) Task=`a87169e0-a176-4c59-b6eb-eec414640692`::moving from state acquiring -> state queued >Thread-14::DEBUG::2014-07-10 08:49:50,191::taskManager::50::TaskManager::(_queueTask) queuing task: a87169e0-a176-4c59-b6eb-eec414640692 >Thread-14::DEBUG::2014-07-10 08:49:50,192::taskManager::56::TaskManager::(_queueTask) task queued: a87169e0-a176-4c59-b6eb-eec414640692 >Thread-4::DEBUG::2014-07-10 08:49:50,192::threadPool::57::Misc.ThreadPool::(setRunningTask) Number of running tasks: 1 >Thread-14::DEBUG::2014-07-10 08:49:50,193::task::1182::TaskManager.Task::(prepare) Task=`a87169e0-a176-4c59-b6eb-eec414640692`::returning >a87169e0-a176-4c59-b6eb-eec414640692::DEBUG::2014-07-10 08:49:50,193::threadPool::200::Misc.ThreadPool.WorkerThread::(_processNextTask) Task: a87169e0-a176-4c59-b6eb-eec414640692 running: <bound method Task.commit of <storage.task.Task instance at 0x7f620c06e368>> with: None >Thread-14::DEBUG::2014-07-10 08:49:50,195::task::990::TaskManager.Task::(_decref) Task=`a87169e0-a176-4c59-b6eb-eec414640692`::ref 0 aborting False >a87169e0-a176-4c59-b6eb-eec414640692::DEBUG::2014-07-10 08:49:50,195::task::1194::TaskManager.Task::(commit) Task=`a87169e0-a176-4c59-b6eb-eec414640692`::committing task: a87169e0-a176-4c59-b6eb-eec414640692 >a87169e0-a176-4c59-b6eb-eec414640692::DEBUG::2014-07-10 08:49:50,196::task::595::TaskManager.Task::(_updateState) Task=`a87169e0-a176-4c59-b6eb-eec414640692`::moving from state queued -> state running >a87169e0-a176-4c59-b6eb-eec414640692::DEBUG::2014-07-10 08:49:50,197::task::905::TaskManager.Task::(_runJobs) Task=`a87169e0-a176-4c59-b6eb-eec414640692`::Task.run: running job 0: spmStart: <bound method StoragePool.startSpm of <storage.sp.StoragePool object at 0x7f62180b9dd0>> (args: (-1, '-1', 250, 3) kwargs: {}) >a87169e0-a176-4c59-b6eb-eec414640692::DEBUG::2014-07-10 08:49:50,197::task::331::TaskManager.Task::(run) Task=`a87169e0-a176-4c59-b6eb-eec414640692`::Job.run: running spmStart: <bound method StoragePool.startSpm of <storage.sp.StoragePool object at 0x7f62180b9dd0>> (args: (-1, '-1', 250, 3) kwargs: {}) callback None >a87169e0-a176-4c59-b6eb-eec414640692::DEBUG::2014-07-10 08:49:50,198::misc::756::SamplingMethod::(__call__) Trying to enter sampling method (storage.sp.updateMonitoringThreads) >a87169e0-a176-4c59-b6eb-eec414640692::DEBUG::2014-07-10 08:49:50,199::misc::758::SamplingMethod::(__call__) Got in to sampling method >a87169e0-a176-4c59-b6eb-eec414640692::DEBUG::2014-07-10 08:49:50,199::lvm::503::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >a87169e0-a176-4c59-b6eb-eec414640692::DEBUG::2014-07-10 08:49:50,200::lvm::505::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >a87169e0-a176-4c59-b6eb-eec414640692::DEBUG::2014-07-10 08:49:50,200::lvm::513::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >a87169e0-a176-4c59-b6eb-eec414640692::DEBUG::2014-07-10 08:49:50,200::lvm::525::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >a87169e0-a176-4c59-b6eb-eec414640692::DEBUG::2014-07-10 08:49:50,201::lvm::373::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >a87169e0-a176-4c59-b6eb-eec414640692::DEBUG::2014-07-10 08:49:50,201::lvm::296::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/3600601601282300032826addbbdae311|/dev/mapper/360060160f4a030003840ec867ddee311|/dev/mapper/367cad74c2fcba00019e6afd20c781e67|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name 9e1aa540-1f4e-4ee3-a152-be381ef6c3bd' (cwd None) >a87169e0-a176-4c59-b6eb-eec414640692::DEBUG::2014-07-10 08:49:50,389::lvm::296::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >a87169e0-a176-4c59-b6eb-eec414640692::DEBUG::2014-07-10 08:49:50,391::lvm::415::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >a87169e0-a176-4c59-b6eb-eec414640692::DEBUG::2014-07-10 08:49:50,391::persistentDict::234::Storage.PersistentDict::(refresh) read lines (VGTagMetadataRW)=['LEASETIMESEC=60', 'VGUUID=9CsMxb-YbRc-yRG7-cQKD-xY3G-GLi5-YxUyPC', 'VERSION=3', 'TYPE=ISCSI', 'LOGBLKSIZE=512', u'PV0=pv:3600601601282300032826addbbdae311,uuid:7qEb8v-jk2X-3CPk-k4XB-eIBk-onYD-807hcV,pestart:0,pecount:8189,mapoffset:0', 'LEASERETRIES=3', 'IOOPTIMEOUTSEC=10', 'LOCKRENEWALINTERVALSEC=5', 'PHYBLKSIZE=512', 'SDUUID=9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'CLASS=Data', 'LOCKPOLICY=', 'DESCRIPTION=SD_REAL', 'POOL_DOMAINS=9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active', 'POOL_SPM_ID=-1', 'MASTER_VERSION=1', 'POOL_SPM_LVER=-1', 'POOL_DESCRIPTION=DC_REAL', 'ROLE=Master', '_SHA_CKSUM=c4c32b0569b49805fb7350a6bafd03535a50ade1', 'POOL_UUID=4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee'] >a87169e0-a176-4c59-b6eb-eec414640692::DEBUG::2014-07-10 08:49:50,392::misc::766::SamplingMethod::(__call__) Returning last result >a87169e0-a176-4c59-b6eb-eec414640692::INFO::2014-07-10 08:49:50,393::clusterlock::184::SANLock::(acquireHostId) Acquiring host id for domain 9e1aa540-1f4e-4ee3-a152-be381ef6c3bd (id: 1) >Thread-14::DEBUG::2014-07-10 08:49:51,241::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [83a37e9] >Thread-14::DEBUG::2014-07-10 08:49:51,243::task::595::TaskManager.Task::(_updateState) Task=`54b9610f-3be7-4703-bb6a-326afebf0fdc`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 08:49:51,243::logUtils::44::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='a87169e0-a176-4c59-b6eb-eec414640692', spUUID=None, options=None) >Thread-14::DEBUG::2014-07-10 08:49:51,243::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: a87169e0-a176-4c59-b6eb-eec414640692 >Thread-14::DEBUG::2014-07-10 08:49:51,245::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'a87169e0-a176-4c59-b6eb-eec414640692'} >Thread-14::INFO::2014-07-10 08:49:51,245::logUtils::47::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'a87169e0-a176-4c59-b6eb-eec414640692'}} >Thread-14::DEBUG::2014-07-10 08:49:51,245::task::1185::TaskManager.Task::(prepare) Task=`54b9610f-3be7-4703-bb6a-326afebf0fdc`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'a87169e0-a176-4c59-b6eb-eec414640692'}} >Thread-14::DEBUG::2014-07-10 08:49:51,245::task::595::TaskManager.Task::(_updateState) Task=`54b9610f-3be7-4703-bb6a-326afebf0fdc`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 08:49:51,246::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 08:49:51,246::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 08:49:51,246::task::990::TaskManager.Task::(_decref) Task=`54b9610f-3be7-4703-bb6a-326afebf0fdc`::ref 0 aborting False >Thread-14::DEBUG::2014-07-10 08:49:52,251::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [83a37e9] >Thread-14::DEBUG::2014-07-10 08:49:52,252::task::595::TaskManager.Task::(_updateState) Task=`9998f6cd-52ce-46d2-98fa-b435807ec883`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 08:49:52,252::logUtils::44::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='a87169e0-a176-4c59-b6eb-eec414640692', spUUID=None, options=None) >Thread-14::DEBUG::2014-07-10 08:49:52,252::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: a87169e0-a176-4c59-b6eb-eec414640692 >Thread-14::DEBUG::2014-07-10 08:49:52,253::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'a87169e0-a176-4c59-b6eb-eec414640692'} >Thread-14::INFO::2014-07-10 08:49:52,253::logUtils::47::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'a87169e0-a176-4c59-b6eb-eec414640692'}} >Thread-14::DEBUG::2014-07-10 08:49:52,253::task::1185::TaskManager.Task::(prepare) Task=`9998f6cd-52ce-46d2-98fa-b435807ec883`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'a87169e0-a176-4c59-b6eb-eec414640692'}} >Thread-14::DEBUG::2014-07-10 08:49:52,253::task::595::TaskManager.Task::(_updateState) Task=`9998f6cd-52ce-46d2-98fa-b435807ec883`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 08:49:52,253::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 08:49:52,253::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 08:49:52,254::task::990::TaskManager.Task::(_decref) Task=`9998f6cd-52ce-46d2-98fa-b435807ec883`::ref 0 aborting False >Thread-14::DEBUG::2014-07-10 08:49:52,366::task::595::TaskManager.Task::(_updateState) Task=`5b78e73d-aecb-440d-ab42-953ddf9ac234`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 08:49:52,366::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::INFO::2014-07-10 08:49:52,366::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'code': 0, 'version': 3, 'acquired': False, 'delay': '0.000412833', 'lastCheck': '3.6', 'valid': True}} >Thread-14::DEBUG::2014-07-10 08:49:52,367::task::1185::TaskManager.Task::(prepare) Task=`5b78e73d-aecb-440d-ab42-953ddf9ac234`::finished: {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'code': 0, 'version': 3, 'acquired': False, 'delay': '0.000412833', 'lastCheck': '3.6', 'valid': True}} >Thread-14::DEBUG::2014-07-10 08:49:52,367::task::595::TaskManager.Task::(_updateState) Task=`5b78e73d-aecb-440d-ab42-953ddf9ac234`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 08:49:52,367::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 08:49:52,367::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 08:49:52,367::task::990::TaskManager.Task::(_decref) Task=`5b78e73d-aecb-440d-ab42-953ddf9ac234`::ref 0 aborting False >Thread-14::DEBUG::2014-07-10 08:49:53,258::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [83a37e9] >Thread-14::DEBUG::2014-07-10 08:49:53,258::task::595::TaskManager.Task::(_updateState) Task=`5900b9db-efb2-42fb-876e-b3d866755ecb`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 08:49:53,259::logUtils::44::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='a87169e0-a176-4c59-b6eb-eec414640692', spUUID=None, options=None) >Thread-14::DEBUG::2014-07-10 08:49:53,259::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: a87169e0-a176-4c59-b6eb-eec414640692 >Thread-14::DEBUG::2014-07-10 08:49:53,259::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'a87169e0-a176-4c59-b6eb-eec414640692'} >Thread-14::INFO::2014-07-10 08:49:53,259::logUtils::47::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'a87169e0-a176-4c59-b6eb-eec414640692'}} >Thread-14::DEBUG::2014-07-10 08:49:53,259::task::1185::TaskManager.Task::(prepare) Task=`5900b9db-efb2-42fb-876e-b3d866755ecb`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'a87169e0-a176-4c59-b6eb-eec414640692'}} >Thread-14::DEBUG::2014-07-10 08:49:53,259::task::595::TaskManager.Task::(_updateState) Task=`5900b9db-efb2-42fb-876e-b3d866755ecb`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 08:49:53,259::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 08:49:53,260::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 08:49:53,260::task::990::TaskManager.Task::(_decref) Task=`5900b9db-efb2-42fb-876e-b3d866755ecb`::ref 0 aborting False >Thread-14::DEBUG::2014-07-10 08:49:54,264::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [83a37e9] >Thread-14::DEBUG::2014-07-10 08:49:54,264::task::595::TaskManager.Task::(_updateState) Task=`9dce3b8f-b8fb-42ed-9aa3-ae8dd2dd5f60`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 08:49:54,265::logUtils::44::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='a87169e0-a176-4c59-b6eb-eec414640692', spUUID=None, options=None) >Thread-14::DEBUG::2014-07-10 08:49:54,265::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: a87169e0-a176-4c59-b6eb-eec414640692 >Thread-14::DEBUG::2014-07-10 08:49:54,265::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'a87169e0-a176-4c59-b6eb-eec414640692'} >Thread-14::INFO::2014-07-10 08:49:54,265::logUtils::47::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'a87169e0-a176-4c59-b6eb-eec414640692'}} >Thread-14::DEBUG::2014-07-10 08:49:54,265::task::1185::TaskManager.Task::(prepare) Task=`9dce3b8f-b8fb-42ed-9aa3-ae8dd2dd5f60`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'a87169e0-a176-4c59-b6eb-eec414640692'}} >Thread-14::DEBUG::2014-07-10 08:49:54,265::task::595::TaskManager.Task::(_updateState) Task=`9dce3b8f-b8fb-42ed-9aa3-ae8dd2dd5f60`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 08:49:54,266::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 08:49:54,266::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 08:49:54,266::task::990::TaskManager.Task::(_decref) Task=`9dce3b8f-b8fb-42ed-9aa3-ae8dd2dd5f60`::ref 0 aborting False >Thread-14::DEBUG::2014-07-10 08:49:55,270::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [83a37e9] >Thread-14::DEBUG::2014-07-10 08:49:55,270::task::595::TaskManager.Task::(_updateState) Task=`4101d9ce-45b3-4a7f-bb7c-f423b263218d`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 08:49:55,270::logUtils::44::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='a87169e0-a176-4c59-b6eb-eec414640692', spUUID=None, options=None) >Thread-14::DEBUG::2014-07-10 08:49:55,270::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: a87169e0-a176-4c59-b6eb-eec414640692 >Thread-14::DEBUG::2014-07-10 08:49:55,271::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'a87169e0-a176-4c59-b6eb-eec414640692'} >Thread-14::INFO::2014-07-10 08:49:55,271::logUtils::47::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'a87169e0-a176-4c59-b6eb-eec414640692'}} >Thread-14::DEBUG::2014-07-10 08:49:55,271::task::1185::TaskManager.Task::(prepare) Task=`4101d9ce-45b3-4a7f-bb7c-f423b263218d`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'a87169e0-a176-4c59-b6eb-eec414640692'}} >Thread-14::DEBUG::2014-07-10 08:49:55,271::task::595::TaskManager.Task::(_updateState) Task=`4101d9ce-45b3-4a7f-bb7c-f423b263218d`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 08:49:55,271::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 08:49:55,271::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 08:49:55,272::task::990::TaskManager.Task::(_decref) Task=`4101d9ce-45b3-4a7f-bb7c-f423b263218d`::ref 0 aborting False >Thread-14::DEBUG::2014-07-10 08:49:56,276::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [83a37e9] >Thread-14::DEBUG::2014-07-10 08:49:56,277::task::595::TaskManager.Task::(_updateState) Task=`dc1c9f02-fc0b-4979-97b3-d75d050fd40e`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 08:49:56,277::logUtils::44::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='a87169e0-a176-4c59-b6eb-eec414640692', spUUID=None, options=None) >Thread-14::DEBUG::2014-07-10 08:49:56,277::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: a87169e0-a176-4c59-b6eb-eec414640692 >Thread-14::DEBUG::2014-07-10 08:49:56,277::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'a87169e0-a176-4c59-b6eb-eec414640692'} >Thread-14::INFO::2014-07-10 08:49:56,277::logUtils::47::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'a87169e0-a176-4c59-b6eb-eec414640692'}} >Thread-14::DEBUG::2014-07-10 08:49:56,278::task::1185::TaskManager.Task::(prepare) Task=`dc1c9f02-fc0b-4979-97b3-d75d050fd40e`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'a87169e0-a176-4c59-b6eb-eec414640692'}} >Thread-14::DEBUG::2014-07-10 08:49:56,278::task::595::TaskManager.Task::(_updateState) Task=`dc1c9f02-fc0b-4979-97b3-d75d050fd40e`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 08:49:56,278::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 08:49:56,278::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 08:49:56,278::task::990::TaskManager.Task::(_decref) Task=`dc1c9f02-fc0b-4979-97b3-d75d050fd40e`::ref 0 aborting False >Thread-14::DEBUG::2014-07-10 08:49:57,283::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [83a37e9] >Thread-14::DEBUG::2014-07-10 08:49:57,283::task::595::TaskManager.Task::(_updateState) Task=`895bf6a8-7196-4ec3-ba59-096a6ed0b5b2`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 08:49:57,283::logUtils::44::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='a87169e0-a176-4c59-b6eb-eec414640692', spUUID=None, options=None) >Thread-14::DEBUG::2014-07-10 08:49:57,283::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: a87169e0-a176-4c59-b6eb-eec414640692 >Thread-14::DEBUG::2014-07-10 08:49:57,284::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'a87169e0-a176-4c59-b6eb-eec414640692'} >Thread-14::INFO::2014-07-10 08:49:57,284::logUtils::47::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'a87169e0-a176-4c59-b6eb-eec414640692'}} >Thread-14::DEBUG::2014-07-10 08:49:57,284::task::1185::TaskManager.Task::(prepare) Task=`895bf6a8-7196-4ec3-ba59-096a6ed0b5b2`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'a87169e0-a176-4c59-b6eb-eec414640692'}} >Thread-14::DEBUG::2014-07-10 08:49:57,284::task::595::TaskManager.Task::(_updateState) Task=`895bf6a8-7196-4ec3-ba59-096a6ed0b5b2`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 08:49:57,284::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 08:49:57,284::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 08:49:57,285::task::990::TaskManager.Task::(_decref) Task=`895bf6a8-7196-4ec3-ba59-096a6ed0b5b2`::ref 0 aborting False >Thread-14::DEBUG::2014-07-10 08:49:58,288::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [83a37e9] >Thread-14::DEBUG::2014-07-10 08:49:58,289::task::595::TaskManager.Task::(_updateState) Task=`884fa51d-d4c4-492a-8e3d-5977e47125d1`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 08:49:58,289::logUtils::44::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='a87169e0-a176-4c59-b6eb-eec414640692', spUUID=None, options=None) >Thread-14::DEBUG::2014-07-10 08:49:58,289::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: a87169e0-a176-4c59-b6eb-eec414640692 >Thread-14::DEBUG::2014-07-10 08:49:58,289::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'a87169e0-a176-4c59-b6eb-eec414640692'} >Thread-14::INFO::2014-07-10 08:49:58,290::logUtils::47::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'a87169e0-a176-4c59-b6eb-eec414640692'}} >Thread-14::DEBUG::2014-07-10 08:49:58,290::task::1185::TaskManager.Task::(prepare) Task=`884fa51d-d4c4-492a-8e3d-5977e47125d1`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'a87169e0-a176-4c59-b6eb-eec414640692'}} >Thread-14::DEBUG::2014-07-10 08:49:58,290::task::595::TaskManager.Task::(_updateState) Task=`884fa51d-d4c4-492a-8e3d-5977e47125d1`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 08:49:58,290::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 08:49:58,290::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 08:49:58,290::task::990::TaskManager.Task::(_decref) Task=`884fa51d-d4c4-492a-8e3d-5977e47125d1`::ref 0 aborting False >Thread-18::DEBUG::2014-07-10 08:49:58,755::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/metadata bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-10 08:49:58,765::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00070608 s, 5.8 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 08:49:59,294::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [83a37e9] >Thread-14::DEBUG::2014-07-10 08:49:59,295::task::595::TaskManager.Task::(_updateState) Task=`33290e08-cb49-4fad-8498-fd07056725eb`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 08:49:59,295::logUtils::44::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='a87169e0-a176-4c59-b6eb-eec414640692', spUUID=None, options=None) >Thread-14::DEBUG::2014-07-10 08:49:59,296::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: a87169e0-a176-4c59-b6eb-eec414640692 >Thread-14::DEBUG::2014-07-10 08:49:59,296::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'a87169e0-a176-4c59-b6eb-eec414640692'} >Thread-14::INFO::2014-07-10 08:49:59,296::logUtils::47::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'a87169e0-a176-4c59-b6eb-eec414640692'}} >Thread-14::DEBUG::2014-07-10 08:49:59,296::task::1185::TaskManager.Task::(prepare) Task=`33290e08-cb49-4fad-8498-fd07056725eb`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'a87169e0-a176-4c59-b6eb-eec414640692'}} >Thread-14::DEBUG::2014-07-10 08:49:59,296::task::595::TaskManager.Task::(_updateState) Task=`33290e08-cb49-4fad-8498-fd07056725eb`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 08:49:59,296::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 08:49:59,297::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 08:49:59,297::task::990::TaskManager.Task::(_decref) Task=`33290e08-cb49-4fad-8498-fd07056725eb`::ref 0 aborting False >Thread-14::DEBUG::2014-07-10 08:50:00,301::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [83a37e9] >Thread-14::DEBUG::2014-07-10 08:50:00,301::task::595::TaskManager.Task::(_updateState) Task=`072135f0-7a7e-40be-a824-6ef3bd49f972`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 08:50:00,302::logUtils::44::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='a87169e0-a176-4c59-b6eb-eec414640692', spUUID=None, options=None) >Thread-14::DEBUG::2014-07-10 08:50:00,302::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: a87169e0-a176-4c59-b6eb-eec414640692 >Thread-14::DEBUG::2014-07-10 08:50:00,302::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'a87169e0-a176-4c59-b6eb-eec414640692'} >Thread-14::INFO::2014-07-10 08:50:00,302::logUtils::47::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'a87169e0-a176-4c59-b6eb-eec414640692'}} >Thread-14::DEBUG::2014-07-10 08:50:00,302::task::1185::TaskManager.Task::(prepare) Task=`072135f0-7a7e-40be-a824-6ef3bd49f972`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'a87169e0-a176-4c59-b6eb-eec414640692'}} >Thread-14::DEBUG::2014-07-10 08:50:00,302::task::595::TaskManager.Task::(_updateState) Task=`072135f0-7a7e-40be-a824-6ef3bd49f972`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 08:50:00,303::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 08:50:00,303::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 08:50:00,303::task::990::TaskManager.Task::(_decref) Task=`072135f0-7a7e-40be-a824-6ef3bd49f972`::ref 0 aborting False >Thread-14::DEBUG::2014-07-10 08:50:01,308::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [83a37e9] >Thread-14::DEBUG::2014-07-10 08:50:01,309::task::595::TaskManager.Task::(_updateState) Task=`d16f1fe4-8264-4a92-a8f5-949fd8521102`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 08:50:01,309::logUtils::44::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='a87169e0-a176-4c59-b6eb-eec414640692', spUUID=None, options=None) >Thread-14::DEBUG::2014-07-10 08:50:01,309::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: a87169e0-a176-4c59-b6eb-eec414640692 >Thread-14::DEBUG::2014-07-10 08:50:01,310::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'a87169e0-a176-4c59-b6eb-eec414640692'} >Thread-14::INFO::2014-07-10 08:50:01,310::logUtils::47::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'a87169e0-a176-4c59-b6eb-eec414640692'}} >Thread-14::DEBUG::2014-07-10 08:50:01,310::task::1185::TaskManager.Task::(prepare) Task=`d16f1fe4-8264-4a92-a8f5-949fd8521102`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'a87169e0-a176-4c59-b6eb-eec414640692'}} >Thread-14::DEBUG::2014-07-10 08:50:01,310::task::595::TaskManager.Task::(_updateState) Task=`d16f1fe4-8264-4a92-a8f5-949fd8521102`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 08:50:01,311::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 08:50:01,311::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 08:50:01,311::task::990::TaskManager.Task::(_decref) Task=`d16f1fe4-8264-4a92-a8f5-949fd8521102`::ref 0 aborting False >Thread-14::DEBUG::2014-07-10 08:50:02,316::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [83a37e9] >Thread-14::DEBUG::2014-07-10 08:50:02,317::task::595::TaskManager.Task::(_updateState) Task=`870186f8-5323-4671-a8eb-7f56ad66b92a`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 08:50:02,317::logUtils::44::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='a87169e0-a176-4c59-b6eb-eec414640692', spUUID=None, options=None) >Thread-14::DEBUG::2014-07-10 08:50:02,317::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: a87169e0-a176-4c59-b6eb-eec414640692 >Thread-14::DEBUG::2014-07-10 08:50:02,317::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'a87169e0-a176-4c59-b6eb-eec414640692'} >Thread-14::INFO::2014-07-10 08:50:02,317::logUtils::47::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'a87169e0-a176-4c59-b6eb-eec414640692'}} >Thread-14::DEBUG::2014-07-10 08:50:02,318::task::1185::TaskManager.Task::(prepare) Task=`870186f8-5323-4671-a8eb-7f56ad66b92a`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'a87169e0-a176-4c59-b6eb-eec414640692'}} >Thread-14::DEBUG::2014-07-10 08:50:02,318::task::595::TaskManager.Task::(_updateState) Task=`870186f8-5323-4671-a8eb-7f56ad66b92a`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 08:50:02,318::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 08:50:02,318::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 08:50:02,318::task::990::TaskManager.Task::(_decref) Task=`870186f8-5323-4671-a8eb-7f56ad66b92a`::ref 0 aborting False >Thread-14::DEBUG::2014-07-10 08:50:03,323::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [83a37e9] >Thread-14::DEBUG::2014-07-10 08:50:03,324::task::595::TaskManager.Task::(_updateState) Task=`edaf5669-9827-4750-a471-1a62d103a5ad`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 08:50:03,324::logUtils::44::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='a87169e0-a176-4c59-b6eb-eec414640692', spUUID=None, options=None) >Thread-14::DEBUG::2014-07-10 08:50:03,324::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: a87169e0-a176-4c59-b6eb-eec414640692 >Thread-14::DEBUG::2014-07-10 08:50:03,324::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'a87169e0-a176-4c59-b6eb-eec414640692'} >Thread-14::INFO::2014-07-10 08:50:03,325::logUtils::47::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'a87169e0-a176-4c59-b6eb-eec414640692'}} >Thread-14::DEBUG::2014-07-10 08:50:03,325::task::1185::TaskManager.Task::(prepare) Task=`edaf5669-9827-4750-a471-1a62d103a5ad`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'a87169e0-a176-4c59-b6eb-eec414640692'}} >Thread-14::DEBUG::2014-07-10 08:50:03,325::task::595::TaskManager.Task::(_updateState) Task=`edaf5669-9827-4750-a471-1a62d103a5ad`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 08:50:03,325::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 08:50:03,325::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 08:50:03,325::task::990::TaskManager.Task::(_decref) Task=`edaf5669-9827-4750-a471-1a62d103a5ad`::ref 0 aborting False >Thread-14::DEBUG::2014-07-10 08:50:04,329::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [83a37e9] >Thread-14::DEBUG::2014-07-10 08:50:04,330::task::595::TaskManager.Task::(_updateState) Task=`323934e4-a978-4939-b7d4-1212cc37b64c`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 08:50:04,330::logUtils::44::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='a87169e0-a176-4c59-b6eb-eec414640692', spUUID=None, options=None) >Thread-14::DEBUG::2014-07-10 08:50:04,330::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: a87169e0-a176-4c59-b6eb-eec414640692 >Thread-14::DEBUG::2014-07-10 08:50:04,330::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'a87169e0-a176-4c59-b6eb-eec414640692'} >Thread-14::INFO::2014-07-10 08:50:04,330::logUtils::47::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'a87169e0-a176-4c59-b6eb-eec414640692'}} >Thread-14::DEBUG::2014-07-10 08:50:04,331::task::1185::TaskManager.Task::(prepare) Task=`323934e4-a978-4939-b7d4-1212cc37b64c`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'a87169e0-a176-4c59-b6eb-eec414640692'}} >Thread-14::DEBUG::2014-07-10 08:50:04,331::task::595::TaskManager.Task::(_updateState) Task=`323934e4-a978-4939-b7d4-1212cc37b64c`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 08:50:04,331::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 08:50:04,331::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 08:50:04,331::task::990::TaskManager.Task::(_decref) Task=`323934e4-a978-4939-b7d4-1212cc37b64c`::ref 0 aborting False >Thread-14::DEBUG::2014-07-10 08:50:05,335::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [83a37e9] >Thread-14::DEBUG::2014-07-10 08:50:05,335::task::595::TaskManager.Task::(_updateState) Task=`4a347bc6-c143-47e8-9ad8-76ad52c92b31`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 08:50:05,335::logUtils::44::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='a87169e0-a176-4c59-b6eb-eec414640692', spUUID=None, options=None) >Thread-14::DEBUG::2014-07-10 08:50:05,336::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: a87169e0-a176-4c59-b6eb-eec414640692 >Thread-14::DEBUG::2014-07-10 08:50:05,336::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'a87169e0-a176-4c59-b6eb-eec414640692'} >Thread-14::INFO::2014-07-10 08:50:05,336::logUtils::47::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'a87169e0-a176-4c59-b6eb-eec414640692'}} >Thread-14::DEBUG::2014-07-10 08:50:05,336::task::1185::TaskManager.Task::(prepare) Task=`4a347bc6-c143-47e8-9ad8-76ad52c92b31`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'a87169e0-a176-4c59-b6eb-eec414640692'}} >Thread-14::DEBUG::2014-07-10 08:50:05,336::task::595::TaskManager.Task::(_updateState) Task=`4a347bc6-c143-47e8-9ad8-76ad52c92b31`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 08:50:05,336::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 08:50:05,336::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 08:50:05,337::task::990::TaskManager.Task::(_decref) Task=`4a347bc6-c143-47e8-9ad8-76ad52c92b31`::ref 0 aborting False >Thread-14::DEBUG::2014-07-10 08:50:06,342::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [83a37e9] >Thread-14::DEBUG::2014-07-10 08:50:06,342::task::595::TaskManager.Task::(_updateState) Task=`d7085133-6607-4c5e-9d34-f754c9628107`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 08:50:06,343::logUtils::44::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='a87169e0-a176-4c59-b6eb-eec414640692', spUUID=None, options=None) >Thread-14::DEBUG::2014-07-10 08:50:06,343::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: a87169e0-a176-4c59-b6eb-eec414640692 >Thread-14::DEBUG::2014-07-10 08:50:06,343::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'a87169e0-a176-4c59-b6eb-eec414640692'} >Thread-14::INFO::2014-07-10 08:50:06,343::logUtils::47::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'a87169e0-a176-4c59-b6eb-eec414640692'}} >Thread-14::DEBUG::2014-07-10 08:50:06,344::task::1185::TaskManager.Task::(prepare) Task=`d7085133-6607-4c5e-9d34-f754c9628107`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'a87169e0-a176-4c59-b6eb-eec414640692'}} >Thread-14::DEBUG::2014-07-10 08:50:06,344::task::595::TaskManager.Task::(_updateState) Task=`d7085133-6607-4c5e-9d34-f754c9628107`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 08:50:06,344::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 08:50:06,344::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 08:50:06,344::task::990::TaskManager.Task::(_decref) Task=`d7085133-6607-4c5e-9d34-f754c9628107`::ref 0 aborting False >Thread-14::DEBUG::2014-07-10 08:50:07,349::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [83a37e9] >Thread-14::DEBUG::2014-07-10 08:50:07,349::task::595::TaskManager.Task::(_updateState) Task=`5a6e488d-7a13-4d86-b369-4e8c0cb0c563`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 08:50:07,349::logUtils::44::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='a87169e0-a176-4c59-b6eb-eec414640692', spUUID=None, options=None) >Thread-14::DEBUG::2014-07-10 08:50:07,349::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: a87169e0-a176-4c59-b6eb-eec414640692 >Thread-14::DEBUG::2014-07-10 08:50:07,350::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'a87169e0-a176-4c59-b6eb-eec414640692'} >Thread-14::INFO::2014-07-10 08:50:07,350::logUtils::47::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'a87169e0-a176-4c59-b6eb-eec414640692'}} >Thread-14::DEBUG::2014-07-10 08:50:07,350::task::1185::TaskManager.Task::(prepare) Task=`5a6e488d-7a13-4d86-b369-4e8c0cb0c563`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'a87169e0-a176-4c59-b6eb-eec414640692'}} >Thread-14::DEBUG::2014-07-10 08:50:07,350::task::595::TaskManager.Task::(_updateState) Task=`5a6e488d-7a13-4d86-b369-4e8c0cb0c563`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 08:50:07,350::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 08:50:07,350::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 08:50:07,351::task::990::TaskManager.Task::(_decref) Task=`5a6e488d-7a13-4d86-b369-4e8c0cb0c563`::ref 0 aborting False >Thread-14::DEBUG::2014-07-10 08:50:07,493::task::595::TaskManager.Task::(_updateState) Task=`3889ce61-1050-47c1-aeda-d2471fa047ca`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 08:50:07,494::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::INFO::2014-07-10 08:50:07,494::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'code': 0, 'version': 3, 'acquired': False, 'delay': '0.000412833', 'lastCheck': '18.8', 'valid': True}} >Thread-14::DEBUG::2014-07-10 08:50:07,494::task::1185::TaskManager.Task::(prepare) Task=`3889ce61-1050-47c1-aeda-d2471fa047ca`::finished: {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'code': 0, 'version': 3, 'acquired': False, 'delay': '0.000412833', 'lastCheck': '18.8', 'valid': True}} >Thread-14::DEBUG::2014-07-10 08:50:07,494::task::595::TaskManager.Task::(_updateState) Task=`3889ce61-1050-47c1-aeda-d2471fa047ca`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 08:50:07,495::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 08:50:07,495::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 08:50:07,495::task::990::TaskManager.Task::(_decref) Task=`3889ce61-1050-47c1-aeda-d2471fa047ca`::ref 0 aborting False >Thread-14::DEBUG::2014-07-10 08:50:08,355::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [83a37e9] >Thread-14::DEBUG::2014-07-10 08:50:08,355::task::595::TaskManager.Task::(_updateState) Task=`e4eeb155-418f-4a66-b3f5-0d57890b19f8`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 08:50:08,355::logUtils::44::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='a87169e0-a176-4c59-b6eb-eec414640692', spUUID=None, options=None) >Thread-14::DEBUG::2014-07-10 08:50:08,356::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: a87169e0-a176-4c59-b6eb-eec414640692 >Thread-14::DEBUG::2014-07-10 08:50:08,356::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'a87169e0-a176-4c59-b6eb-eec414640692'} >Thread-14::INFO::2014-07-10 08:50:08,356::logUtils::47::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'a87169e0-a176-4c59-b6eb-eec414640692'}} >Thread-14::DEBUG::2014-07-10 08:50:08,356::task::1185::TaskManager.Task::(prepare) Task=`e4eeb155-418f-4a66-b3f5-0d57890b19f8`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'a87169e0-a176-4c59-b6eb-eec414640692'}} >Thread-14::DEBUG::2014-07-10 08:50:08,356::task::595::TaskManager.Task::(_updateState) Task=`e4eeb155-418f-4a66-b3f5-0d57890b19f8`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 08:50:08,356::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 08:50:08,357::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 08:50:08,357::task::990::TaskManager.Task::(_decref) Task=`e4eeb155-418f-4a66-b3f5-0d57890b19f8`::ref 0 aborting False >Thread-14::DEBUG::2014-07-10 08:50:09,360::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [83a37e9] >Thread-14::DEBUG::2014-07-10 08:50:09,361::task::595::TaskManager.Task::(_updateState) Task=`bfedcc35-3aec-409a-9135-e8ea10c73c42`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 08:50:09,361::logUtils::44::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='a87169e0-a176-4c59-b6eb-eec414640692', spUUID=None, options=None) >Thread-14::DEBUG::2014-07-10 08:50:09,361::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: a87169e0-a176-4c59-b6eb-eec414640692 >Thread-14::DEBUG::2014-07-10 08:50:09,361::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'a87169e0-a176-4c59-b6eb-eec414640692'} >Thread-14::INFO::2014-07-10 08:50:09,361::logUtils::47::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'a87169e0-a176-4c59-b6eb-eec414640692'}} >Thread-14::DEBUG::2014-07-10 08:50:09,361::task::1185::TaskManager.Task::(prepare) Task=`bfedcc35-3aec-409a-9135-e8ea10c73c42`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'a87169e0-a176-4c59-b6eb-eec414640692'}} >Thread-14::DEBUG::2014-07-10 08:50:09,362::task::595::TaskManager.Task::(_updateState) Task=`bfedcc35-3aec-409a-9135-e8ea10c73c42`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 08:50:09,362::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 08:50:09,362::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 08:50:09,362::task::990::TaskManager.Task::(_decref) Task=`bfedcc35-3aec-409a-9135-e8ea10c73c42`::ref 0 aborting False >Thread-14::DEBUG::2014-07-10 08:50:10,366::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [83a37e9] >Thread-14::DEBUG::2014-07-10 08:50:10,366::task::595::TaskManager.Task::(_updateState) Task=`879a872c-0d66-4825-b77c-309ba9eb2f00`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 08:50:10,366::logUtils::44::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='a87169e0-a176-4c59-b6eb-eec414640692', spUUID=None, options=None) >Thread-14::DEBUG::2014-07-10 08:50:10,367::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: a87169e0-a176-4c59-b6eb-eec414640692 >Thread-14::DEBUG::2014-07-10 08:50:10,367::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'a87169e0-a176-4c59-b6eb-eec414640692'} >Thread-14::INFO::2014-07-10 08:50:10,367::logUtils::47::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'a87169e0-a176-4c59-b6eb-eec414640692'}} >Thread-14::DEBUG::2014-07-10 08:50:10,367::task::1185::TaskManager.Task::(prepare) Task=`879a872c-0d66-4825-b77c-309ba9eb2f00`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'a87169e0-a176-4c59-b6eb-eec414640692'}} >Thread-14::DEBUG::2014-07-10 08:50:10,367::task::595::TaskManager.Task::(_updateState) Task=`879a872c-0d66-4825-b77c-309ba9eb2f00`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 08:50:10,367::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 08:50:10,367::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 08:50:10,368::task::990::TaskManager.Task::(_decref) Task=`879a872c-0d66-4825-b77c-309ba9eb2f00`::ref 0 aborting False >a87169e0-a176-4c59-b6eb-eec414640692::DEBUG::2014-07-10 08:50:10,395::clusterlock::202::SANLock::(acquireHostId) Host id for domain 9e1aa540-1f4e-4ee3-a152-be381ef6c3bd successfully acquired (id: 1) >a87169e0-a176-4c59-b6eb-eec414640692::WARNING::2014-07-10 08:50:10,396::fileUtils::167::Storage.fileUtils::(createdir) Dir /rhev/data-center/mnt/blockSD/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/images already exists >a87169e0-a176-4c59-b6eb-eec414640692::WARNING::2014-07-10 08:50:10,396::fileUtils::167::Storage.fileUtils::(createdir) Dir /rhev/data-center/mnt/blockSD/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/dom_md already exists >a87169e0-a176-4c59-b6eb-eec414640692::DEBUG::2014-07-10 08:50:10,397::lvm::503::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >a87169e0-a176-4c59-b6eb-eec414640692::DEBUG::2014-07-10 08:50:10,397::lvm::505::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >a87169e0-a176-4c59-b6eb-eec414640692::DEBUG::2014-07-10 08:50:10,398::lvm::513::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >a87169e0-a176-4c59-b6eb-eec414640692::DEBUG::2014-07-10 08:50:10,398::lvm::525::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >a87169e0-a176-4c59-b6eb-eec414640692::DEBUG::2014-07-10 08:50:10,398::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with LvMetadataRW backend >a87169e0-a176-4c59-b6eb-eec414640692::DEBUG::2014-07-10 08:50:10,398::blockSD::336::Storage.Misc.excCmd::(readlines) '/bin/dd iflag=direct skip=0 bs=2048 if=/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/metadata count=1' (cwd None) >a87169e0-a176-4c59-b6eb-eec414640692::DEBUG::2014-07-10 08:50:10,408::blockSD::336::Storage.Misc.excCmd::(readlines) SUCCESS: <err> = '1+0 records in\n1+0 records out\n2048 bytes (2.0 kB) copied, 0.00054061 s, 3.8 MB/s\n'; <rc> = 0 >a87169e0-a176-4c59-b6eb-eec414640692::DEBUG::2014-07-10 08:50:10,408::misc::282::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '2048 bytes (2.0 kB) copied, 0.00054061 s, 3.8 MB/s'], size: 2048 >a87169e0-a176-4c59-b6eb-eec414640692::DEBUG::2014-07-10 08:50:10,409::persistentDict::234::Storage.PersistentDict::(refresh) read lines (LvMetadataRW)=[] >a87169e0-a176-4c59-b6eb-eec414640692::WARNING::2014-07-10 08:50:10,409::persistentDict::256::Storage.PersistentDict::(refresh) data has no embedded checksum - trust it as it is >a87169e0-a176-4c59-b6eb-eec414640692::DEBUG::2014-07-10 08:50:10,409::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with VGTagMetadataRW backend >a87169e0-a176-4c59-b6eb-eec414640692::DEBUG::2014-07-10 08:50:10,410::lvm::503::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >a87169e0-a176-4c59-b6eb-eec414640692::DEBUG::2014-07-10 08:50:10,410::lvm::505::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >a87169e0-a176-4c59-b6eb-eec414640692::DEBUG::2014-07-10 08:50:10,410::lvm::513::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >a87169e0-a176-4c59-b6eb-eec414640692::DEBUG::2014-07-10 08:50:10,411::lvm::525::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >a87169e0-a176-4c59-b6eb-eec414640692::DEBUG::2014-07-10 08:50:10,411::lvm::373::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >a87169e0-a176-4c59-b6eb-eec414640692::DEBUG::2014-07-10 08:50:10,412::lvm::296::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/3600601601282300032826addbbdae311|/dev/mapper/360060160f4a030003840ec867ddee311|/dev/mapper/367cad74c2fcba00019e6afd20c781e67|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name 9e1aa540-1f4e-4ee3-a152-be381ef6c3bd' (cwd None) >a87169e0-a176-4c59-b6eb-eec414640692::DEBUG::2014-07-10 08:50:10,713::lvm::296::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >a87169e0-a176-4c59-b6eb-eec414640692::DEBUG::2014-07-10 08:50:10,715::lvm::415::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >a87169e0-a176-4c59-b6eb-eec414640692::DEBUG::2014-07-10 08:50:10,716::persistentDict::234::Storage.PersistentDict::(refresh) read lines (VGTagMetadataRW)=['LEASETIMESEC=60', 'VGUUID=9CsMxb-YbRc-yRG7-cQKD-xY3G-GLi5-YxUyPC', 'VERSION=3', 'TYPE=ISCSI', 'LOGBLKSIZE=512', u'PV0=pv:3600601601282300032826addbbdae311,uuid:7qEb8v-jk2X-3CPk-k4XB-eIBk-onYD-807hcV,pestart:0,pecount:8189,mapoffset:0', 'LEASERETRIES=3', 'IOOPTIMEOUTSEC=10', 'LOCKRENEWALINTERVALSEC=5', 'PHYBLKSIZE=512', 'SDUUID=9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'CLASS=Data', 'LOCKPOLICY=', 'DESCRIPTION=SD_REAL', 'POOL_DOMAINS=9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active', 'POOL_SPM_ID=-1', 'MASTER_VERSION=1', 'POOL_SPM_LVER=-1', 'POOL_DESCRIPTION=DC_REAL', 'ROLE=Master', '_SHA_CKSUM=c4c32b0569b49805fb7350a6bafd03535a50ade1', 'POOL_UUID=4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee'] >a87169e0-a176-4c59-b6eb-eec414640692::INFO::2014-07-10 08:50:10,716::clusterlock::235::SANLock::(acquire) Acquiring cluster lock for domain 9e1aa540-1f4e-4ee3-a152-be381ef6c3bd (id: 1) >a87169e0-a176-4c59-b6eb-eec414640692::DEBUG::2014-07-10 08:50:10,728::clusterlock::261::SANLock::(acquire) Cluster lock for domain 9e1aa540-1f4e-4ee3-a152-be381ef6c3bd successfully acquired (id: 1) >a87169e0-a176-4c59-b6eb-eec414640692::DEBUG::2014-07-10 08:50:10,729::sp::275::Storage.StoragePool::(startSpm) spm lock acquired successfully >a87169e0-a176-4c59-b6eb-eec414640692::DEBUG::2014-07-10 08:50:10,729::lvm::503::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >a87169e0-a176-4c59-b6eb-eec414640692::DEBUG::2014-07-10 08:50:10,730::lvm::505::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >a87169e0-a176-4c59-b6eb-eec414640692::DEBUG::2014-07-10 08:50:10,730::lvm::513::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >a87169e0-a176-4c59-b6eb-eec414640692::DEBUG::2014-07-10 08:50:10,731::lvm::525::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >a87169e0-a176-4c59-b6eb-eec414640692::DEBUG::2014-07-10 08:50:10,731::lvm::373::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >a87169e0-a176-4c59-b6eb-eec414640692::DEBUG::2014-07-10 08:50:10,732::lvm::296::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/3600601601282300032826addbbdae311|/dev/mapper/360060160f4a030003840ec867ddee311|/dev/mapper/367cad74c2fcba00019e6afd20c781e67|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name 9e1aa540-1f4e-4ee3-a152-be381ef6c3bd' (cwd None) >a87169e0-a176-4c59-b6eb-eec414640692::DEBUG::2014-07-10 08:50:10,933::lvm::296::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >a87169e0-a176-4c59-b6eb-eec414640692::DEBUG::2014-07-10 08:50:10,936::lvm::415::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >a87169e0-a176-4c59-b6eb-eec414640692::DEBUG::2014-07-10 08:50:10,936::persistentDict::234::Storage.PersistentDict::(refresh) read lines (VGTagMetadataRW)=['LEASETIMESEC=60', 'VGUUID=9CsMxb-YbRc-yRG7-cQKD-xY3G-GLi5-YxUyPC', 'VERSION=3', 'TYPE=ISCSI', 'LOGBLKSIZE=512', u'PV0=pv:3600601601282300032826addbbdae311,uuid:7qEb8v-jk2X-3CPk-k4XB-eIBk-onYD-807hcV,pestart:0,pecount:8189,mapoffset:0', 'LEASERETRIES=3', 'IOOPTIMEOUTSEC=10', 'LOCKRENEWALINTERVALSEC=5', 'PHYBLKSIZE=512', 'SDUUID=9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'CLASS=Data', 'LOCKPOLICY=', 'DESCRIPTION=SD_REAL', 'POOL_DOMAINS=9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active', 'POOL_SPM_ID=-1', 'MASTER_VERSION=1', 'POOL_SPM_LVER=-1', 'POOL_DESCRIPTION=DC_REAL', 'ROLE=Master', '_SHA_CKSUM=c4c32b0569b49805fb7350a6bafd03535a50ade1', 'POOL_UUID=4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee'] >a87169e0-a176-4c59-b6eb-eec414640692::DEBUG::2014-07-10 08:50:10,937::persistentDict::167::Storage.PersistentDict::(transaction) Starting transaction >a87169e0-a176-4c59-b6eb-eec414640692::DEBUG::2014-07-10 08:50:10,937::persistentDict::173::Storage.PersistentDict::(transaction) Flushing changes >a87169e0-a176-4c59-b6eb-eec414640692::DEBUG::2014-07-10 08:50:10,938::persistentDict::299::Storage.PersistentDict::(flush) about to write lines (VGTagMetadataRW)=['CLASS=Data', 'DESCRIPTION=SD_REAL', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'LOGBLKSIZE=512', 'MASTER_VERSION=1', 'PHYBLKSIZE=512', 'POOL_DESCRIPTION=DC_REAL', 'POOL_DOMAINS=9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active', 'POOL_SPM_ID=1', 'POOL_SPM_LVER=0', 'POOL_UUID=4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', u'PV0=pv:3600601601282300032826addbbdae311,uuid:7qEb8v-jk2X-3CPk-k4XB-eIBk-onYD-807hcV,pestart:0,pecount:8189,mapoffset:0', 'ROLE=Master', 'SDUUID=9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'TYPE=ISCSI', 'VERSION=3', 'VGUUID=9CsMxb-YbRc-yRG7-cQKD-xY3G-GLi5-YxUyPC', '_SHA_CKSUM=9900f699e87d637c24122a843274e33fe5b7e52b'] >a87169e0-a176-4c59-b6eb-eec414640692::DEBUG::2014-07-10 08:50:10,938::lvm::503::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >a87169e0-a176-4c59-b6eb-eec414640692::DEBUG::2014-07-10 08:50:10,938::lvm::505::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >a87169e0-a176-4c59-b6eb-eec414640692::DEBUG::2014-07-10 08:50:10,939::lvm::513::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >a87169e0-a176-4c59-b6eb-eec414640692::DEBUG::2014-07-10 08:50:10,939::lvm::525::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >a87169e0-a176-4c59-b6eb-eec414640692::DEBUG::2014-07-10 08:50:10,939::lvm::373::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >a87169e0-a176-4c59-b6eb-eec414640692::DEBUG::2014-07-10 08:50:10,940::lvm::296::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/3600601601282300032826addbbdae311|/dev/mapper/360060160f4a030003840ec867ddee311|/dev/mapper/367cad74c2fcba00019e6afd20c781e67|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name 9e1aa540-1f4e-4ee3-a152-be381ef6c3bd' (cwd None) >a87169e0-a176-4c59-b6eb-eec414640692::DEBUG::2014-07-10 08:50:11,137::lvm::296::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >a87169e0-a176-4c59-b6eb-eec414640692::DEBUG::2014-07-10 08:50:11,141::lvm::415::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >a87169e0-a176-4c59-b6eb-eec414640692::DEBUG::2014-07-10 08:50:11,142::blockSD::315::storage.Metadata.VGTagMetadataRW::(writelines) Updating metadata adding=MDT_POOL_SPM_ID=1, MDT_POOL_SPM_LVER=0, MDT__SHA_CKSUM=9900f699e87d637c24122a843274e33fe5b7e52b removing=MDT_POOL_SPM_ID=-1, MDT__SHA_CKSUM=c4c32b0569b49805fb7350a6bafd03535a50ade1, MDT_POOL_SPM_LVER=-1 >a87169e0-a176-4c59-b6eb-eec414640692::DEBUG::2014-07-10 08:50:11,142::lvm::296::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgchange --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/3600601601282300032826addbbdae311|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } " --deltag MDT_POOL_SPM_ID=-1 --deltag MDT_POOL_SPM_LVER=-1 --deltag MDT__SHA_CKSUM=c4c32b0569b49805fb7350a6bafd03535a50ade1 --addtag MDT_POOL_SPM_ID=1 --addtag MDT__SHA_CKSUM=9900f699e87d637c24122a843274e33fe5b7e52b --addtag MDT_POOL_SPM_LVER=0 9e1aa540-1f4e-4ee3-a152-be381ef6c3bd' (cwd None) >a87169e0-a176-4c59-b6eb-eec414640692::DEBUG::2014-07-10 08:50:11,350::lvm::296::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >a87169e0-a176-4c59-b6eb-eec414640692::DEBUG::2014-07-10 08:50:11,351::lvm::503::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >a87169e0-a176-4c59-b6eb-eec414640692::DEBUG::2014-07-10 08:50:11,351::lvm::505::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >a87169e0-a176-4c59-b6eb-eec414640692::DEBUG::2014-07-10 08:50:11,352::persistentDict::175::Storage.PersistentDict::(transaction) Finished transaction >a87169e0-a176-4c59-b6eb-eec414640692::DEBUG::2014-07-10 08:50:11,353::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.upgrade_4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`782169f9-041a-4ad7-94b5-56a99ebd57eb`::Request was made in '/usr/share/vdsm/storage/sp.py' line '429' at '_upgradePool' >a87169e0-a176-4c59-b6eb-eec414640692::DEBUG::2014-07-10 08:50:11,353::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.upgrade_4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' for lock type 'exclusive' >a87169e0-a176-4c59-b6eb-eec414640692::DEBUG::2014-07-10 08:50:11,353::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.upgrade_4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free. Now locking as 'exclusive' (1 active user) >a87169e0-a176-4c59-b6eb-eec414640692::DEBUG::2014-07-10 08:50:11,353::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.upgrade_4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`782169f9-041a-4ad7-94b5-56a99ebd57eb`::Granted request >a87169e0-a176-4c59-b6eb-eec414640692::INFO::2014-07-10 08:50:11,354::sp::435::Storage.StoragePool::(_upgradePool) Trying to upgrade master domain `9e1aa540-1f4e-4ee3-a152-be381ef6c3bd` >a87169e0-a176-4c59-b6eb-eec414640692::DEBUG::2014-07-10 08:50:11,354::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.9e1aa540-1f4e-4ee3-a152-be381ef6c3bd`ReqID=`7be97e9e-5068-40ee-9ddd-23d6d22e2cc1`::Request was made in '/usr/share/vdsm/storage/sp.py' line '437' at '_upgradePool' >a87169e0-a176-4c59-b6eb-eec414640692::DEBUG::2014-07-10 08:50:11,354::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.9e1aa540-1f4e-4ee3-a152-be381ef6c3bd' for lock type 'exclusive' >a87169e0-a176-4c59-b6eb-eec414640692::DEBUG::2014-07-10 08:50:11,355::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.9e1aa540-1f4e-4ee3-a152-be381ef6c3bd' is free. Now locking as 'exclusive' (1 active user) >a87169e0-a176-4c59-b6eb-eec414640692::DEBUG::2014-07-10 08:50:11,355::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.9e1aa540-1f4e-4ee3-a152-be381ef6c3bd`ReqID=`7be97e9e-5068-40ee-9ddd-23d6d22e2cc1`::Granted request >a87169e0-a176-4c59-b6eb-eec414640692::DEBUG::2014-07-10 08:50:11,356::lvm::373::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >a87169e0-a176-4c59-b6eb-eec414640692::DEBUG::2014-07-10 08:50:11,356::lvm::296::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/3600601601282300032826addbbdae311|/dev/mapper/360060160f4a030003840ec867ddee311|/dev/mapper/367cad74c2fcba00019e6afd20c781e67|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name 9e1aa540-1f4e-4ee3-a152-be381ef6c3bd' (cwd None) >Thread-14::DEBUG::2014-07-10 08:50:11,384::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [83a37e9] >Thread-14::DEBUG::2014-07-10 08:50:11,385::task::595::TaskManager.Task::(_updateState) Task=`3621b474-b073-40ba-a3bf-468e77136036`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 08:50:11,385::logUtils::44::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='a87169e0-a176-4c59-b6eb-eec414640692', spUUID=None, options=None) >Thread-14::DEBUG::2014-07-10 08:50:11,386::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: a87169e0-a176-4c59-b6eb-eec414640692 >Thread-14::DEBUG::2014-07-10 08:50:11,386::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'a87169e0-a176-4c59-b6eb-eec414640692'} >Thread-14::INFO::2014-07-10 08:50:11,386::logUtils::47::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'a87169e0-a176-4c59-b6eb-eec414640692'}} >Thread-14::DEBUG::2014-07-10 08:50:11,386::task::1185::TaskManager.Task::(prepare) Task=`3621b474-b073-40ba-a3bf-468e77136036`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'a87169e0-a176-4c59-b6eb-eec414640692'}} >Thread-14::DEBUG::2014-07-10 08:50:11,386::task::595::TaskManager.Task::(_updateState) Task=`3621b474-b073-40ba-a3bf-468e77136036`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 08:50:11,387::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 08:50:11,387::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 08:50:11,387::task::990::TaskManager.Task::(_decref) Task=`3621b474-b073-40ba-a3bf-468e77136036`::ref 0 aborting False >a87169e0-a176-4c59-b6eb-eec414640692::DEBUG::2014-07-10 08:50:11,552::lvm::296::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >a87169e0-a176-4c59-b6eb-eec414640692::DEBUG::2014-07-10 08:50:11,554::lvm::415::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >a87169e0-a176-4c59-b6eb-eec414640692::DEBUG::2014-07-10 08:50:11,554::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with LvMetadataRW backend >a87169e0-a176-4c59-b6eb-eec414640692::DEBUG::2014-07-10 08:50:11,555::blockSD::336::Storage.Misc.excCmd::(readlines) '/bin/dd iflag=direct skip=0 bs=2048 if=/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/metadata count=1' (cwd None) >a87169e0-a176-4c59-b6eb-eec414640692::DEBUG::2014-07-10 08:50:11,564::blockSD::336::Storage.Misc.excCmd::(readlines) SUCCESS: <err> = '1+0 records in\n1+0 records out\n2048 bytes (2.0 kB) copied, 0.000609263 s, 3.4 MB/s\n'; <rc> = 0 >a87169e0-a176-4c59-b6eb-eec414640692::DEBUG::2014-07-10 08:50:11,565::misc::282::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '2048 bytes (2.0 kB) copied, 0.000609263 s, 3.4 MB/s'], size: 2048 >a87169e0-a176-4c59-b6eb-eec414640692::DEBUG::2014-07-10 08:50:11,565::persistentDict::234::Storage.PersistentDict::(refresh) read lines (LvMetadataRW)=[] >a87169e0-a176-4c59-b6eb-eec414640692::WARNING::2014-07-10 08:50:11,566::persistentDict::256::Storage.PersistentDict::(refresh) data has no embedded checksum - trust it as it is >a87169e0-a176-4c59-b6eb-eec414640692::DEBUG::2014-07-10 08:50:11,566::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with VGTagMetadataRW backend >a87169e0-a176-4c59-b6eb-eec414640692::DEBUG::2014-07-10 08:50:11,566::lvm::503::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >a87169e0-a176-4c59-b6eb-eec414640692::DEBUG::2014-07-10 08:50:11,567::lvm::505::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >a87169e0-a176-4c59-b6eb-eec414640692::DEBUG::2014-07-10 08:50:11,567::lvm::513::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >a87169e0-a176-4c59-b6eb-eec414640692::DEBUG::2014-07-10 08:50:11,567::lvm::525::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >a87169e0-a176-4c59-b6eb-eec414640692::DEBUG::2014-07-10 08:50:11,568::lvm::373::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >a87169e0-a176-4c59-b6eb-eec414640692::DEBUG::2014-07-10 08:50:11,568::lvm::296::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/3600601601282300032826addbbdae311|/dev/mapper/360060160f4a030003840ec867ddee311|/dev/mapper/367cad74c2fcba00019e6afd20c781e67|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name 9e1aa540-1f4e-4ee3-a152-be381ef6c3bd' (cwd None) >a87169e0-a176-4c59-b6eb-eec414640692::DEBUG::2014-07-10 08:50:11,761::lvm::296::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >a87169e0-a176-4c59-b6eb-eec414640692::DEBUG::2014-07-10 08:50:11,763::lvm::415::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >a87169e0-a176-4c59-b6eb-eec414640692::DEBUG::2014-07-10 08:50:11,763::persistentDict::234::Storage.PersistentDict::(refresh) read lines (VGTagMetadataRW)=['LEASETIMESEC=60', 'VGUUID=9CsMxb-YbRc-yRG7-cQKD-xY3G-GLi5-YxUyPC', 'VERSION=3', 'TYPE=ISCSI', 'LOGBLKSIZE=512', u'PV0=pv:3600601601282300032826addbbdae311,uuid:7qEb8v-jk2X-3CPk-k4XB-eIBk-onYD-807hcV,pestart:0,pecount:8189,mapoffset:0', 'LEASERETRIES=3', 'IOOPTIMEOUTSEC=10', 'LOCKRENEWALINTERVALSEC=5', 'PHYBLKSIZE=512', 'SDUUID=9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'CLASS=Data', 'LOCKPOLICY=', 'DESCRIPTION=SD_REAL', 'POOL_DOMAINS=9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=DC_REAL', 'ROLE=Master', 'POOL_UUID=4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', 'POOL_SPM_ID=1', '_SHA_CKSUM=9900f699e87d637c24122a843274e33fe5b7e52b', 'POOL_SPM_LVER=0'] >a87169e0-a176-4c59-b6eb-eec414640692::INFO::2014-07-10 08:50:11,765::sd::384::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 9e1aa540-1f4e-4ee3-a152-be381ef6c3bd_imageNS already registered >a87169e0-a176-4c59-b6eb-eec414640692::INFO::2014-07-10 08:50:11,765::sd::392::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 9e1aa540-1f4e-4ee3-a152-be381ef6c3bd_volumeNS already registered >a87169e0-a176-4c59-b6eb-eec414640692::INFO::2014-07-10 08:50:11,765::blockSD::452::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 9e1aa540-1f4e-4ee3-a152-be381ef6c3bd_lvmActivationNS already registered >a87169e0-a176-4c59-b6eb-eec414640692::DEBUG::2014-07-10 08:50:11,765::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.9e1aa540-1f4e-4ee3-a152-be381ef6c3bd' >a87169e0-a176-4c59-b6eb-eec414640692::DEBUG::2014-07-10 08:50:11,766::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.9e1aa540-1f4e-4ee3-a152-be381ef6c3bd' (0 active users) >a87169e0-a176-4c59-b6eb-eec414640692::DEBUG::2014-07-10 08:50:11,766::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.9e1aa540-1f4e-4ee3-a152-be381ef6c3bd' is free, finding out if anyone is waiting for it. >a87169e0-a176-4c59-b6eb-eec414640692::DEBUG::2014-07-10 08:50:11,766::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', Clearing records. >a87169e0-a176-4c59-b6eb-eec414640692::DEBUG::2014-07-10 08:50:11,766::sp::440::Storage.StoragePool::(_upgradePool) Marking all domains for upgrade >a87169e0-a176-4c59-b6eb-eec414640692::DEBUG::2014-07-10 08:50:11,767::lvm::503::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >a87169e0-a176-4c59-b6eb-eec414640692::DEBUG::2014-07-10 08:50:11,767::lvm::505::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >a87169e0-a176-4c59-b6eb-eec414640692::DEBUG::2014-07-10 08:50:11,767::lvm::513::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >a87169e0-a176-4c59-b6eb-eec414640692::DEBUG::2014-07-10 08:50:11,767::lvm::525::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >a87169e0-a176-4c59-b6eb-eec414640692::DEBUG::2014-07-10 08:50:11,768::lvm::373::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >a87169e0-a176-4c59-b6eb-eec414640692::DEBUG::2014-07-10 08:50:11,768::lvm::296::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/3600601601282300032826addbbdae311|/dev/mapper/360060160f4a030003840ec867ddee311|/dev/mapper/367cad74c2fcba00019e6afd20c781e67|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name 9e1aa540-1f4e-4ee3-a152-be381ef6c3bd' (cwd None) >a87169e0-a176-4c59-b6eb-eec414640692::DEBUG::2014-07-10 08:50:11,959::lvm::296::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >a87169e0-a176-4c59-b6eb-eec414640692::DEBUG::2014-07-10 08:50:11,966::lvm::415::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >a87169e0-a176-4c59-b6eb-eec414640692::DEBUG::2014-07-10 08:50:11,971::persistentDict::234::Storage.PersistentDict::(refresh) read lines (VGTagMetadataRW)=['LEASETIMESEC=60', 'VGUUID=9CsMxb-YbRc-yRG7-cQKD-xY3G-GLi5-YxUyPC', 'VERSION=3', 'TYPE=ISCSI', 'LOGBLKSIZE=512', u'PV0=pv:3600601601282300032826addbbdae311,uuid:7qEb8v-jk2X-3CPk-k4XB-eIBk-onYD-807hcV,pestart:0,pecount:8189,mapoffset:0', 'LEASERETRIES=3', 'IOOPTIMEOUTSEC=10', 'LOCKRENEWALINTERVALSEC=5', 'PHYBLKSIZE=512', 'SDUUID=9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'CLASS=Data', 'LOCKPOLICY=', 'DESCRIPTION=SD_REAL', 'POOL_DOMAINS=9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=DC_REAL', 'ROLE=Master', 'POOL_UUID=4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', 'POOL_SPM_ID=1', '_SHA_CKSUM=9900f699e87d637c24122a843274e33fe5b7e52b', 'POOL_SPM_LVER=0'] >a87169e0-a176-4c59-b6eb-eec414640692::DEBUG::2014-07-10 08:50:11,978::sp::447::Storage.StoragePool::(_upgradePool) Registering with state change event >a87169e0-a176-4c59-b6eb-eec414640692::DEBUG::2014-07-10 08:50:11,980::sp::450::Storage.StoragePool::(_upgradePool) Running initial domain upgrade threads >a87169e0-a176-4c59-b6eb-eec414640692::DEBUG::2014-07-10 08:50:11,984::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.upgrade_4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' >a87169e0-a176-4c59-b6eb-eec414640692::DEBUG::2014-07-10 08:50:11,987::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.upgrade_4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' (0 active users) >a87169e0-a176-4c59-b6eb-eec414640692::DEBUG::2014-07-10 08:50:11,990::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.upgrade_4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free, finding out if anyone is waiting for it. >a87169e0-a176-4c59-b6eb-eec414640692::DEBUG::2014-07-10 08:50:11,992::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.upgrade_4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', Clearing records. >a87169e0-a176-4c59-b6eb-eec414640692::DEBUG::2014-07-10 08:50:11,994::blockSD::1131::Storage.Misc.excCmd::(mountMaster) '/usr/bin/sudo -n /sbin/fsck -p /dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/master' (cwd None) >a87169e0-a176-4c59-b6eb-eec414640692::DEBUG::2014-07-10 08:50:12,061::blockSD::1131::Storage.Misc.excCmd::(mountMaster) SUCCESS: <err> = ''; <rc> = 0 >a87169e0-a176-4c59-b6eb-eec414640692::DEBUG::2014-07-10 08:50:12,062::blockSD::1156::Storage.Misc.excCmd::(mountMaster) '/usr/bin/sudo -n /sbin/tune2fs -j /dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/master' (cwd None) >a87169e0-a176-4c59-b6eb-eec414640692::DEBUG::2014-07-10 08:50:12,086::blockSD::1156::Storage.Misc.excCmd::(mountMaster) FAILED: <err> = 'The filesystem already has a journal.\n'; <rc> = 1 >a87169e0-a176-4c59-b6eb-eec414640692::DEBUG::2014-07-10 08:50:12,087::mount::202::Storage.Misc.excCmd::(_runcmd) '/usr/bin/sudo -n /bin/mount -t ext3 /dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/master /rhev/data-center/mnt/blockSD/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/master' (cwd None) >a87169e0-a176-4c59-b6eb-eec414640692::DEBUG::2014-07-10 08:50:12,270::blockSD::1168::Storage.Misc.excCmd::(mountMaster) '/usr/bin/sudo -n /bin/chown vdsm:kvm /rhev/data-center/mnt/blockSD/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/master' (cwd None) >a87169e0-a176-4c59-b6eb-eec414640692::DEBUG::2014-07-10 08:50:12,290::blockSD::1168::Storage.Misc.excCmd::(mountMaster) SUCCESS: <err> = ''; <rc> = 0 >a87169e0-a176-4c59-b6eb-eec414640692::DEBUG::2014-07-10 08:50:12,291::sd::633::Storage.StorageDomain::(createMasterTree) creating vms dir: /rhev/data-center/mnt/blockSD/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/master/vms >Thread-14::DEBUG::2014-07-10 08:50:12,392::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [83a37e9] >Thread-14::DEBUG::2014-07-10 08:50:12,393::task::595::TaskManager.Task::(_updateState) Task=`32816e8d-a9d3-44ed-a08c-cd8518e2a084`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 08:50:12,394::logUtils::44::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='a87169e0-a176-4c59-b6eb-eec414640692', spUUID=None, options=None) >Thread-14::DEBUG::2014-07-10 08:50:12,394::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: a87169e0-a176-4c59-b6eb-eec414640692 >Thread-14::DEBUG::2014-07-10 08:50:12,394::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'a87169e0-a176-4c59-b6eb-eec414640692'} >Thread-14::INFO::2014-07-10 08:50:12,394::logUtils::47::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'a87169e0-a176-4c59-b6eb-eec414640692'}} >Thread-14::DEBUG::2014-07-10 08:50:12,395::task::1185::TaskManager.Task::(prepare) Task=`32816e8d-a9d3-44ed-a08c-cd8518e2a084`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'a87169e0-a176-4c59-b6eb-eec414640692'}} >Thread-14::DEBUG::2014-07-10 08:50:12,395::task::595::TaskManager.Task::(_updateState) Task=`32816e8d-a9d3-44ed-a08c-cd8518e2a084`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 08:50:12,395::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 08:50:12,395::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 08:50:12,395::task::990::TaskManager.Task::(_decref) Task=`32816e8d-a9d3-44ed-a08c-cd8518e2a084`::ref 0 aborting False >a87169e0-a176-4c59-b6eb-eec414640692::DEBUG::2014-07-10 08:50:12,487::sd::636::Storage.StorageDomain::(createMasterTree) creating task dir: /rhev/data-center/mnt/blockSD/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/master/tasks >a87169e0-a176-4c59-b6eb-eec414640692::DEBUG::2014-07-10 08:50:12,490::lvm::503::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >a87169e0-a176-4c59-b6eb-eec414640692::DEBUG::2014-07-10 08:50:12,490::lvm::505::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >a87169e0-a176-4c59-b6eb-eec414640692::DEBUG::2014-07-10 08:50:12,490::lvm::513::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >a87169e0-a176-4c59-b6eb-eec414640692::DEBUG::2014-07-10 08:50:12,491::lvm::525::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >a87169e0-a176-4c59-b6eb-eec414640692::DEBUG::2014-07-10 08:50:12,491::lvm::373::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >a87169e0-a176-4c59-b6eb-eec414640692::DEBUG::2014-07-10 08:50:12,492::lvm::296::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/3600601601282300032826addbbdae311|/dev/mapper/360060160f4a030003840ec867ddee311|/dev/mapper/367cad74c2fcba00019e6afd20c781e67|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name 9e1aa540-1f4e-4ee3-a152-be381ef6c3bd' (cwd None) >a87169e0-a176-4c59-b6eb-eec414640692::DEBUG::2014-07-10 08:50:12,681::lvm::296::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >a87169e0-a176-4c59-b6eb-eec414640692::DEBUG::2014-07-10 08:50:12,683::lvm::415::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >a87169e0-a176-4c59-b6eb-eec414640692::DEBUG::2014-07-10 08:50:12,684::persistentDict::234::Storage.PersistentDict::(refresh) read lines (VGTagMetadataRW)=['LEASETIMESEC=60', 'VGUUID=9CsMxb-YbRc-yRG7-cQKD-xY3G-GLi5-YxUyPC', 'VERSION=3', 'TYPE=ISCSI', 'LOGBLKSIZE=512', u'PV0=pv:3600601601282300032826addbbdae311,uuid:7qEb8v-jk2X-3CPk-k4XB-eIBk-onYD-807hcV,pestart:0,pecount:8189,mapoffset:0', 'LEASERETRIES=3', 'IOOPTIMEOUTSEC=10', 'LOCKRENEWALINTERVALSEC=5', 'PHYBLKSIZE=512', 'SDUUID=9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'CLASS=Data', 'LOCKPOLICY=', 'DESCRIPTION=SD_REAL', 'POOL_DOMAINS=9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=DC_REAL', 'ROLE=Master', 'POOL_UUID=4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', 'POOL_SPM_ID=1', '_SHA_CKSUM=9900f699e87d637c24122a843274e33fe5b7e52b', 'POOL_SPM_LVER=0'] >a87169e0-a176-4c59-b6eb-eec414640692::DEBUG::2014-07-10 08:50:12,685::threadPool::35::Misc.ThreadPool::(__init__) Enter - numThreads: 5.0, waitTimeout: 3, maxTasks: 500.0 >a87169e0-a176-4c59-b6eb-eec414640692::DEBUG::2014-07-10 08:50:12,694::storage_mailbox::574::Storage.MailBox.SpmMailMonitor::(__init__) SPM_MailMonitor - clearing outgoing mail, command is: ['dd', 'of=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/outbox', 'oflag=direct', 'iflag=fullblock', 'conv=notrunc', 'count=1'] >a87169e0-a176-4c59-b6eb-eec414640692::DEBUG::2014-07-10 08:50:12,695::storage_mailbox::84::Storage.Misc.excCmd::(_mboxExecCmd) 'dd of=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/outbox oflag=direct iflag=fullblock conv=notrunc count=1 bs=1024000' (cwd None) >a87169e0-a176-4c59-b6eb-eec414640692::DEBUG::2014-07-10 08:50:12,739::storage_mailbox::84::Storage.Misc.excCmd::(_mboxExecCmd) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.033757 s, 30.3 MB/s\n'; <rc> = 0 >a87169e0-a176-4c59-b6eb-eec414640692::DEBUG::2014-07-10 08:50:12,740::storage_mailbox::582::Storage.MailBox.SpmMailMonitor::(__init__) SPM_MailMonitor created for pool 4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee >a87169e0-a176-4c59-b6eb-eec414640692::DEBUG::2014-07-10 08:50:12,741::sp::322::Storage.StoragePool::(startSpm) SPM mailbox ready for pool 4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee on master domain 9e1aa540-1f4e-4ee3-a152-be381ef6c3bd >a87169e0-a176-4c59-b6eb-eec414640692::DEBUG::2014-07-10 08:50:12,743::sp::330::Storage.StoragePool::(startSpm) ended. >a87169e0-a176-4c59-b6eb-eec414640692::DEBUG::2014-07-10 08:50:12,745::task::595::TaskManager.Task::(_updateState) Task=`a87169e0-a176-4c59-b6eb-eec414640692`::moving from state running -> state finished >Dummy-33::DEBUG::2014-07-10 08:50:12,746::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >a87169e0-a176-4c59-b6eb-eec414640692::DEBUG::2014-07-10 08:50:12,748::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee': < ResourceRef 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', isValid: 'True' obj: 'None'>} >a87169e0-a176-4c59-b6eb-eec414640692::DEBUG::2014-07-10 08:50:12,763::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >a87169e0-a176-4c59-b6eb-eec414640692::DEBUG::2014-07-10 08:50:12,775::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' >a87169e0-a176-4c59-b6eb-eec414640692::DEBUG::2014-07-10 08:50:12,781::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' (0 active users) >a87169e0-a176-4c59-b6eb-eec414640692::DEBUG::2014-07-10 08:50:12,784::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free, finding out if anyone is waiting for it. >a87169e0-a176-4c59-b6eb-eec414640692::DEBUG::2014-07-10 08:50:12,786::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', Clearing records. >a87169e0-a176-4c59-b6eb-eec414640692::DEBUG::2014-07-10 08:50:12,790::task::913::TaskManager.Task::(_runJobs) Task=`a87169e0-a176-4c59-b6eb-eec414640692`::Task.run: exit - success: result >a87169e0-a176-4c59-b6eb-eec414640692::DEBUG::2014-07-10 08:50:12,793::task::990::TaskManager.Task::(_decref) Task=`a87169e0-a176-4c59-b6eb-eec414640692`::ref 0 aborting False >a87169e0-a176-4c59-b6eb-eec414640692::DEBUG::2014-07-10 08:50:12,796::threadPool::57::Misc.ThreadPool::(setRunningTask) Number of running tasks: 0 >Dummy-33::DEBUG::2014-07-10 08:50:13,019::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0666272 s, 15.4 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 08:50:13,403::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [83a37e9] >Thread-14::DEBUG::2014-07-10 08:50:13,404::task::595::TaskManager.Task::(_updateState) Task=`19e67bdf-9833-4eee-9cc1-b96a396cd260`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 08:50:13,405::logUtils::44::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='a87169e0-a176-4c59-b6eb-eec414640692', spUUID=None, options=None) >Thread-14::DEBUG::2014-07-10 08:50:13,405::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: a87169e0-a176-4c59-b6eb-eec414640692 >Thread-14::DEBUG::2014-07-10 08:50:13,405::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': '1 jobs completed successfully', 'taskState': 'finished', 'taskResult': 'success', 'taskID': 'a87169e0-a176-4c59-b6eb-eec414640692'} >Thread-14::INFO::2014-07-10 08:50:13,405::logUtils::47::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': '1 jobs completed successfully', 'taskState': 'finished', 'taskResult': 'success', 'taskID': 'a87169e0-a176-4c59-b6eb-eec414640692'}} >Thread-14::DEBUG::2014-07-10 08:50:13,405::task::1185::TaskManager.Task::(prepare) Task=`19e67bdf-9833-4eee-9cc1-b96a396cd260`::finished: {'taskStatus': {'code': 0, 'message': '1 jobs completed successfully', 'taskState': 'finished', 'taskResult': 'success', 'taskID': 'a87169e0-a176-4c59-b6eb-eec414640692'}} >Thread-14::DEBUG::2014-07-10 08:50:13,406::task::595::TaskManager.Task::(_updateState) Task=`19e67bdf-9833-4eee-9cc1-b96a396cd260`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 08:50:13,406::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 08:50:13,406::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 08:50:13,406::task::990::TaskManager.Task::(_decref) Task=`19e67bdf-9833-4eee-9cc1-b96a396cd260`::ref 0 aborting False >Thread-14::DEBUG::2014-07-10 08:50:13,411::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [83a37e9] >Thread-14::DEBUG::2014-07-10 08:50:13,411::task::595::TaskManager.Task::(_updateState) Task=`25d69d1d-db09-4fad-82df-a3be0bb15347`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 08:50:13,411::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-14::INFO::2014-07-10 08:50:13,412::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 08:50:13,412::task::1185::TaskManager.Task::(prepare) Task=`25d69d1d-db09-4fad-82df-a3be0bb15347`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 08:50:13,412::task::595::TaskManager.Task::(_updateState) Task=`25d69d1d-db09-4fad-82df-a3be0bb15347`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 08:50:13,412::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 08:50:13,412::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 08:50:13,413::task::990::TaskManager.Task::(_decref) Task=`25d69d1d-db09-4fad-82df-a3be0bb15347`::ref 0 aborting False >Thread-14::DEBUG::2014-07-10 08:50:13,457::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [83a37e9] >Thread-14::DEBUG::2014-07-10 08:50:13,458::task::595::TaskManager.Task::(_updateState) Task=`57ff141e-d785-4556-9f46-9a10cc6161e9`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 08:50:13,458::logUtils::44::dispatcher::(wrapper) Run and protect: clearTask(taskID='a87169e0-a176-4c59-b6eb-eec414640692', spUUID=None, options=None) >Thread-14::DEBUG::2014-07-10 08:50:13,458::taskManager::161::TaskManager::(clearTask) Entry. taskID: a87169e0-a176-4c59-b6eb-eec414640692 >Thread-14::DEBUG::2014-07-10 08:50:13,458::taskManager::166::TaskManager::(clearTask) Return. >Thread-14::INFO::2014-07-10 08:50:13,459::logUtils::47::dispatcher::(wrapper) Run and protect: clearTask, Return response: None >Thread-14::DEBUG::2014-07-10 08:50:13,459::task::1185::TaskManager.Task::(prepare) Task=`57ff141e-d785-4556-9f46-9a10cc6161e9`::finished: None >Thread-14::DEBUG::2014-07-10 08:50:13,459::task::595::TaskManager.Task::(_updateState) Task=`57ff141e-d785-4556-9f46-9a10cc6161e9`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 08:50:13,459::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 08:50:13,459::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 08:50:13,459::task::990::TaskManager.Task::(_decref) Task=`57ff141e-d785-4556-9f46-9a10cc6161e9`::ref 0 aborting False >Thread-34::DEBUG::2014-07-10 08:50:13,539::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [83a37e9] >Thread-34::DEBUG::2014-07-10 08:50:13,540::task::595::TaskManager.Task::(_updateState) Task=`2378c1f9-d428-4394-b403-6a40985a0cad`::moving from state init -> state preparing >Thread-34::INFO::2014-07-10 08:50:13,540::logUtils::44::dispatcher::(wrapper) Run and protect: activateStorageDomain(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-34::DEBUG::2014-07-10 08:50:13,541::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`8384237a-7212-4676-88af-fd459aba17e6`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '1256' at 'activateStorageDomain' >Thread-34::DEBUG::2014-07-10 08:50:13,541::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' for lock type 'exclusive' >Thread-34::DEBUG::2014-07-10 08:50:13,541::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free. Now locking as 'exclusive' (1 active user) >Thread-34::DEBUG::2014-07-10 08:50:13,542::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`8384237a-7212-4676-88af-fd459aba17e6`::Granted request >Thread-34::DEBUG::2014-07-10 08:50:13,542::task::827::TaskManager.Task::(resourceAcquired) Task=`2378c1f9-d428-4394-b403-6a40985a0cad`::_resourcesAcquired: Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee (exclusive) >Thread-34::DEBUG::2014-07-10 08:50:13,542::task::990::TaskManager.Task::(_decref) Task=`2378c1f9-d428-4394-b403-6a40985a0cad`::ref 1 aborting False >Thread-34::DEBUG::2014-07-10 08:50:13,543::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.9e1aa540-1f4e-4ee3-a152-be381ef6c3bd`ReqID=`d434518a-7423-46f9-b626-173c83d0cafc`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '1257' at 'activateStorageDomain' >Thread-34::DEBUG::2014-07-10 08:50:13,543::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.9e1aa540-1f4e-4ee3-a152-be381ef6c3bd' for lock type 'exclusive' >Thread-34::DEBUG::2014-07-10 08:50:13,543::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.9e1aa540-1f4e-4ee3-a152-be381ef6c3bd' is free. Now locking as 'exclusive' (1 active user) >Thread-34::DEBUG::2014-07-10 08:50:13,543::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.9e1aa540-1f4e-4ee3-a152-be381ef6c3bd`ReqID=`d434518a-7423-46f9-b626-173c83d0cafc`::Granted request >Thread-34::DEBUG::2014-07-10 08:50:13,544::task::827::TaskManager.Task::(resourceAcquired) Task=`2378c1f9-d428-4394-b403-6a40985a0cad`::_resourcesAcquired: Storage.9e1aa540-1f4e-4ee3-a152-be381ef6c3bd (exclusive) >Thread-34::DEBUG::2014-07-10 08:50:13,544::task::990::TaskManager.Task::(_decref) Task=`2378c1f9-d428-4394-b403-6a40985a0cad`::ref 1 aborting False >Thread-34::INFO::2014-07-10 08:50:13,544::sp::1024::Storage.StoragePool::(activateSD) sdUUID=9e1aa540-1f4e-4ee3-a152-be381ef6c3bd spUUID=4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee >Thread-34::INFO::2014-07-10 08:50:13,545::logUtils::47::dispatcher::(wrapper) Run and protect: activateStorageDomain, Return response: None >Thread-34::DEBUG::2014-07-10 08:50:13,545::task::1185::TaskManager.Task::(prepare) Task=`2378c1f9-d428-4394-b403-6a40985a0cad`::finished: None >Thread-34::DEBUG::2014-07-10 08:50:13,545::task::595::TaskManager.Task::(_updateState) Task=`2378c1f9-d428-4394-b403-6a40985a0cad`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-10 08:50:13,545::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': < ResourceRef 'Storage.9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', isValid: 'True' obj: 'None'>, 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee': < ResourceRef 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-10 08:50:13,545::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-10 08:50:13,546::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.9e1aa540-1f4e-4ee3-a152-be381ef6c3bd' >Thread-34::DEBUG::2014-07-10 08:50:13,546::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.9e1aa540-1f4e-4ee3-a152-be381ef6c3bd' (0 active users) >Thread-34::DEBUG::2014-07-10 08:50:13,546::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.9e1aa540-1f4e-4ee3-a152-be381ef6c3bd' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-10 08:50:13,546::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', Clearing records. >Thread-34::DEBUG::2014-07-10 08:50:13,547::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' >Thread-34::DEBUG::2014-07-10 08:50:13,547::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' (0 active users) >Thread-34::DEBUG::2014-07-10 08:50:13,547::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-10 08:50:13,547::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', Clearing records. >Thread-34::DEBUG::2014-07-10 08:50:13,547::task::990::TaskManager.Task::(_decref) Task=`2378c1f9-d428-4394-b403-6a40985a0cad`::ref 0 aborting False >Thread-14::DEBUG::2014-07-10 08:50:13,596::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [83a37e9] >Thread-14::DEBUG::2014-07-10 08:50:13,597::task::595::TaskManager.Task::(_updateState) Task=`3b421cfc-1a18-402a-bcd4-373447f9ac5f`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 08:50:13,597::logUtils::44::dispatcher::(wrapper) Run and protect: connectStoragePool(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', hostID=1, msdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', masterVersion=1, domainsMap=None, options=None) >Thread-14::DEBUG::2014-07-10 08:50:13,597::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.HsmDomainMonitorLock`ReqID=`b627a89c-df92-49b0-becf-9f83c76da224`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '1018' at 'connectStoragePool' >Thread-14::DEBUG::2014-07-10 08:50:13,598::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.HsmDomainMonitorLock' for lock type 'exclusive' >Thread-14::DEBUG::2014-07-10 08:50:13,598::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.HsmDomainMonitorLock' is free. Now locking as 'exclusive' (1 active user) >Thread-14::DEBUG::2014-07-10 08:50:13,598::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.HsmDomainMonitorLock`ReqID=`b627a89c-df92-49b0-becf-9f83c76da224`::Granted request >Thread-14::DEBUG::2014-07-10 08:50:13,599::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`04f25ac5-f438-4db3-9cf5-4b35470fa818`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '1056' at '_connectStoragePool' >Thread-14::DEBUG::2014-07-10 08:50:13,599::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' for lock type 'shared' >Thread-14::DEBUG::2014-07-10 08:50:13,599::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free. Now locking as 'shared' (1 active user) >Thread-14::DEBUG::2014-07-10 08:50:13,599::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`04f25ac5-f438-4db3-9cf5-4b35470fa818`::Granted request >Thread-14::DEBUG::2014-07-10 08:50:13,600::lvm::497::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-14::DEBUG::2014-07-10 08:50:13,600::lvm::499::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-14::DEBUG::2014-07-10 08:50:13,601::lvm::508::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-14::DEBUG::2014-07-10 08:50:13,601::lvm::510::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-14::DEBUG::2014-07-10 08:50:13,601::lvm::528::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-14::DEBUG::2014-07-10 08:50:13,601::lvm::530::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-14::DEBUG::2014-07-10 08:50:13,602::misc::756::SamplingMethod::(__call__) Trying to enter sampling method (storage.sdc.refreshStorage) >Thread-14::DEBUG::2014-07-10 08:50:13,602::misc::758::SamplingMethod::(__call__) Got in to sampling method >Thread-14::DEBUG::2014-07-10 08:50:13,602::misc::756::SamplingMethod::(__call__) Trying to enter sampling method (storage.iscsi.rescan) >Thread-14::DEBUG::2014-07-10 08:50:13,602::misc::758::SamplingMethod::(__call__) Got in to sampling method >Thread-14::DEBUG::2014-07-10 08:50:13,602::iscsi::407::Storage.ISCSI::(rescan) Performing SCSI scan, this will take up to 30 seconds >Thread-14::DEBUG::2014-07-10 08:50:13,603::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) '/usr/bin/sudo -n /sbin/iscsiadm -m session -R' (cwd None) >Thread-14::DEBUG::2014-07-10 08:50:13,634::misc::766::SamplingMethod::(__call__) Returning last result >Thread-14::DEBUG::2014-07-10 08:50:13,635::multipath::109::Storage.Misc.excCmd::(rescan) '/usr/bin/sudo -n /sbin/multipath' (cwd None) >Thread-14::DEBUG::2014-07-10 08:50:13,703::multipath::109::Storage.Misc.excCmd::(rescan) SUCCESS: <err> = ''; <rc> = 0 >Thread-14::DEBUG::2014-07-10 08:50:13,705::lvm::497::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-14::DEBUG::2014-07-10 08:50:13,705::lvm::499::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-14::DEBUG::2014-07-10 08:50:13,706::lvm::508::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-14::DEBUG::2014-07-10 08:50:13,706::lvm::510::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-14::DEBUG::2014-07-10 08:50:13,706::lvm::528::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-14::DEBUG::2014-07-10 08:50:13,706::lvm::530::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-14::DEBUG::2014-07-10 08:50:13,707::misc::766::SamplingMethod::(__call__) Returning last result >Thread-14::DEBUG::2014-07-10 08:50:13,707::lvm::373::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-14::DEBUG::2014-07-10 08:50:13,710::lvm::296::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/3600601601282300032826addbbdae311|/dev/mapper/360060160f4a030003840ec867ddee311|/dev/mapper/367cad74c2fcba00019e6afd20c781e67|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name 9e1aa540-1f4e-4ee3-a152-be381ef6c3bd' (cwd None) >Thread-14::DEBUG::2014-07-10 08:50:13,909::lvm::296::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-14::DEBUG::2014-07-10 08:50:13,911::lvm::415::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-14::DEBUG::2014-07-10 08:50:13,911::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with LvMetadataRW backend >Thread-14::DEBUG::2014-07-10 08:50:13,912::blockSD::336::Storage.Misc.excCmd::(readlines) '/bin/dd iflag=direct skip=0 bs=2048 if=/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/metadata count=1' (cwd None) >Thread-14::DEBUG::2014-07-10 08:50:13,922::blockSD::336::Storage.Misc.excCmd::(readlines) SUCCESS: <err> = '1+0 records in\n1+0 records out\n2048 bytes (2.0 kB) copied, 0.000682189 s, 3.0 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 08:50:13,923::misc::282::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '2048 bytes (2.0 kB) copied, 0.000682189 s, 3.0 MB/s'], size: 2048 >Thread-14::DEBUG::2014-07-10 08:50:13,923::persistentDict::234::Storage.PersistentDict::(refresh) read lines (LvMetadataRW)=[] >Thread-14::WARNING::2014-07-10 08:50:13,924::persistentDict::256::Storage.PersistentDict::(refresh) data has no embedded checksum - trust it as it is >Thread-14::DEBUG::2014-07-10 08:50:13,924::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with VGTagMetadataRW backend >Thread-14::DEBUG::2014-07-10 08:50:13,924::lvm::503::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-14::DEBUG::2014-07-10 08:50:13,925::lvm::505::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-14::DEBUG::2014-07-10 08:50:13,925::lvm::513::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-14::DEBUG::2014-07-10 08:50:13,925::lvm::525::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-14::DEBUG::2014-07-10 08:50:13,926::lvm::373::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-14::DEBUG::2014-07-10 08:50:13,926::lvm::296::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/3600601601282300032826addbbdae311|/dev/mapper/360060160f4a030003840ec867ddee311|/dev/mapper/367cad74c2fcba00019e6afd20c781e67|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name 9e1aa540-1f4e-4ee3-a152-be381ef6c3bd' (cwd None) >Thread-14::DEBUG::2014-07-10 08:50:14,117::lvm::296::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-14::DEBUG::2014-07-10 08:50:14,119::lvm::415::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-14::DEBUG::2014-07-10 08:50:14,119::persistentDict::234::Storage.PersistentDict::(refresh) read lines (VGTagMetadataRW)=['LEASETIMESEC=60', 'VGUUID=9CsMxb-YbRc-yRG7-cQKD-xY3G-GLi5-YxUyPC', 'VERSION=3', 'TYPE=ISCSI', 'LOGBLKSIZE=512', u'PV0=pv:3600601601282300032826addbbdae311,uuid:7qEb8v-jk2X-3CPk-k4XB-eIBk-onYD-807hcV,pestart:0,pecount:8189,mapoffset:0', 'LEASERETRIES=3', 'IOOPTIMEOUTSEC=10', 'LOCKRENEWALINTERVALSEC=5', 'PHYBLKSIZE=512', 'SDUUID=9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'CLASS=Data', 'LOCKPOLICY=', 'DESCRIPTION=SD_REAL', 'POOL_DOMAINS=9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=DC_REAL', 'ROLE=Master', 'POOL_UUID=4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', 'POOL_SPM_ID=1', '_SHA_CKSUM=9900f699e87d637c24122a843274e33fe5b7e52b', 'POOL_SPM_LVER=0'] >Thread-14::INFO::2014-07-10 08:50:14,121::sd::384::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 9e1aa540-1f4e-4ee3-a152-be381ef6c3bd_imageNS already registered >Thread-14::INFO::2014-07-10 08:50:14,121::sd::392::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 9e1aa540-1f4e-4ee3-a152-be381ef6c3bd_volumeNS already registered >Thread-14::INFO::2014-07-10 08:50:14,121::blockSD::452::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 9e1aa540-1f4e-4ee3-a152-be381ef6c3bd_lvmActivationNS already registered >Thread-14::DEBUG::2014-07-10 08:50:14,121::sp::1375::Storage.StoragePool::(setMasterDomain) Master domain 9e1aa540-1f4e-4ee3-a152-be381ef6c3bd verified, version 1 >Thread-14::DEBUG::2014-07-10 08:50:14,122::misc::756::SamplingMethod::(__call__) Trying to enter sampling method (storage.sp.updateMonitoringThreads) >Thread-14::DEBUG::2014-07-10 08:50:14,122::misc::758::SamplingMethod::(__call__) Got in to sampling method >Thread-14::DEBUG::2014-07-10 08:50:14,122::misc::766::SamplingMethod::(__call__) Returning last result >Thread-14::WARNING::2014-07-10 08:50:14,122::fileUtils::167::Storage.fileUtils::(createdir) Dir /rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee already exists >Thread-14::DEBUG::2014-07-10 08:50:14,123::lvm::373::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-14::DEBUG::2014-07-10 08:50:14,123::lvm::296::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/3600601601282300032826addbbdae311|/dev/mapper/360060160f4a030003840ec867ddee311|/dev/mapper/367cad74c2fcba00019e6afd20c781e67|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name' (cwd None) >Thread-14::DEBUG::2014-07-10 08:50:14,324::lvm::296::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-14::DEBUG::2014-07-10 08:50:14,327::lvm::415::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-14::WARNING::2014-07-10 08:50:14,328::fileUtils::167::Storage.fileUtils::(createdir) Dir /rhev/data-center/mnt/blockSD/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/images already exists >Thread-14::WARNING::2014-07-10 08:50:14,328::fileUtils::167::Storage.fileUtils::(createdir) Dir /rhev/data-center/mnt/blockSD/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/dom_md already exists >Thread-14::INFO::2014-07-10 08:50:14,328::sp::1113::Storage.StoragePool::(_linkStorageDomain) Linking /rhev/data-center/mnt/blockSD/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd to /rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd >Thread-14::INFO::2014-07-10 08:50:14,329::sp::1113::Storage.StoragePool::(_linkStorageDomain) Linking /rhev/data-center/mnt/blockSD/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd to /rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd >Thread-14::DEBUG::2014-07-10 08:50:14,330::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' >Thread-14::DEBUG::2014-07-10 08:50:14,330::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' (0 active users) >Thread-14::DEBUG::2014-07-10 08:50:14,330::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free, finding out if anyone is waiting for it. >Thread-14::DEBUG::2014-07-10 08:50:14,330::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', Clearing records. >Thread-14::DEBUG::2014-07-10 08:50:14,331::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.HsmDomainMonitorLock' >Thread-14::DEBUG::2014-07-10 08:50:14,331::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.HsmDomainMonitorLock' (0 active users) >Thread-14::DEBUG::2014-07-10 08:50:14,331::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.HsmDomainMonitorLock' is free, finding out if anyone is waiting for it. >Thread-14::DEBUG::2014-07-10 08:50:14,331::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.HsmDomainMonitorLock', Clearing records. >Thread-14::INFO::2014-07-10 08:50:14,331::logUtils::47::dispatcher::(wrapper) Run and protect: connectStoragePool, Return response: True >Thread-14::DEBUG::2014-07-10 08:50:14,332::task::1185::TaskManager.Task::(prepare) Task=`3b421cfc-1a18-402a-bcd4-373447f9ac5f`::finished: True >Thread-14::DEBUG::2014-07-10 08:50:14,332::task::595::TaskManager.Task::(_updateState) Task=`3b421cfc-1a18-402a-bcd4-373447f9ac5f`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 08:50:14,332::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 08:50:14,332::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 08:50:14,332::task::990::TaskManager.Task::(_decref) Task=`3b421cfc-1a18-402a-bcd4-373447f9ac5f`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 08:50:15,065::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 08:50:15,153::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0359597 s, 28.5 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 08:50:17,168::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 08:50:17,249::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0294051 s, 34.8 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 08:50:19,264::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 08:50:19,343::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0312795 s, 32.7 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-10 08:50:20,397::lvm::296::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgck --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/3600601601282300032826addbbdae311|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } " 9e1aa540-1f4e-4ee3-a152-be381ef6c3bd' (cwd None) >Thread-18::DEBUG::2014-07-10 08:50:20,594::lvm::296::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-18::DEBUG::2014-07-10 08:50:20,595::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/metadata bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-10 08:50:20,607::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000618429 s, 6.6 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 08:50:21,359::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 08:50:21,446::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0361079 s, 28.4 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 08:50:22,642::task::595::TaskManager.Task::(_updateState) Task=`dcb33833-fedd-4044-90ba-dcf1fa8a72e8`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 08:50:22,644::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::INFO::2014-07-10 08:50:22,644::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000618429', 'lastCheck': '2.0', 'valid': True}} >Thread-14::DEBUG::2014-07-10 08:50:22,644::task::1185::TaskManager.Task::(prepare) Task=`dcb33833-fedd-4044-90ba-dcf1fa8a72e8`::finished: {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000618429', 'lastCheck': '2.0', 'valid': True}} >Thread-14::DEBUG::2014-07-10 08:50:22,644::task::595::TaskManager.Task::(_updateState) Task=`dcb33833-fedd-4044-90ba-dcf1fa8a72e8`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 08:50:22,645::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 08:50:22,645::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 08:50:22,645::task::990::TaskManager.Task::(_decref) Task=`dcb33833-fedd-4044-90ba-dcf1fa8a72e8`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 08:50:23,462::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 08:50:23,542::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0284272 s, 36.0 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 08:50:23,597::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-14::DEBUG::2014-07-10 08:50:23,598::task::595::TaskManager.Task::(_updateState) Task=`5d81c47a-ca8f-4acc-966e-a28086909a61`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 08:50:23,599::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-14::INFO::2014-07-10 08:50:23,599::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 08:50:23,599::task::1185::TaskManager.Task::(prepare) Task=`5d81c47a-ca8f-4acc-966e-a28086909a61`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 08:50:23,600::task::595::TaskManager.Task::(_updateState) Task=`5d81c47a-ca8f-4acc-966e-a28086909a61`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 08:50:23,600::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 08:50:23,600::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 08:50:23,600::task::990::TaskManager.Task::(_decref) Task=`5d81c47a-ca8f-4acc-966e-a28086909a61`::ref 0 aborting False >Thread-34::DEBUG::2014-07-10 08:50:23,606::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-34::DEBUG::2014-07-10 08:50:23,607::task::595::TaskManager.Task::(_updateState) Task=`9f2623cd-599e-44f3-8b64-11efe0a83a40`::moving from state init -> state preparing >Thread-34::INFO::2014-07-10 08:50:23,607::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-34::DEBUG::2014-07-10 08:50:23,609::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`a1d46f3a-b68d-4b25-a211-b1ac5e2f6c33`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-10 08:50:23,610::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' for lock type 'shared' >Thread-34::DEBUG::2014-07-10 08:50:23,610::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-10 08:50:23,610::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`a1d46f3a-b68d-4b25-a211-b1ac5e2f6c33`::Granted request >Thread-34::DEBUG::2014-07-10 08:50:23,611::task::827::TaskManager.Task::(resourceAcquired) Task=`9f2623cd-599e-44f3-8b64-11efe0a83a40`::_resourcesAcquired: Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee (shared) >Thread-34::DEBUG::2014-07-10 08:50:23,611::task::990::TaskManager.Task::(_decref) Task=`9f2623cd-599e-44f3-8b64-11efe0a83a40`::ref 1 aborting False >Thread-34::INFO::2014-07-10 08:50:23,612::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': 'Active', 'diskfree': '1094948225024', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}}} >Thread-34::DEBUG::2014-07-10 08:50:23,612::task::1185::TaskManager.Task::(prepare) Task=`9f2623cd-599e-44f3-8b64-11efe0a83a40`::finished: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': 'Active', 'diskfree': '1094948225024', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}}} >Thread-34::DEBUG::2014-07-10 08:50:23,612::task::595::TaskManager.Task::(_updateState) Task=`9f2623cd-599e-44f3-8b64-11efe0a83a40`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-10 08:50:23,613::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee': < ResourceRef 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-10 08:50:23,613::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-10 08:50:23,613::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' >Thread-34::DEBUG::2014-07-10 08:50:23,613::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' (0 active users) >Thread-34::DEBUG::2014-07-10 08:50:23,613::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-10 08:50:23,614::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', Clearing records. >Thread-34::DEBUG::2014-07-10 08:50:23,614::task::990::TaskManager.Task::(_decref) Task=`9f2623cd-599e-44f3-8b64-11efe0a83a40`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 08:50:25,558::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 08:50:25,639::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0331825 s, 30.9 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 08:50:27,654::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 08:50:27,748::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0425683 s, 24.1 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 08:50:29,762::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 08:50:29,841::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.029437 s, 34.8 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-10 08:50:30,638::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/metadata bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-10 08:50:30,650::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000870156 s, 4.7 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 08:50:31,857::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 08:50:31,941::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0342807 s, 29.9 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 08:50:33,632::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-14::DEBUG::2014-07-10 08:50:33,633::task::595::TaskManager.Task::(_updateState) Task=`2e77b8e2-2d83-462e-8b0f-1bac8be90962`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 08:50:33,633::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-14::INFO::2014-07-10 08:50:33,633::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 08:50:33,634::task::1185::TaskManager.Task::(prepare) Task=`2e77b8e2-2d83-462e-8b0f-1bac8be90962`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 08:50:33,634::task::595::TaskManager.Task::(_updateState) Task=`2e77b8e2-2d83-462e-8b0f-1bac8be90962`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 08:50:33,634::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 08:50:33,634::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 08:50:33,634::task::990::TaskManager.Task::(_decref) Task=`2e77b8e2-2d83-462e-8b0f-1bac8be90962`::ref 0 aborting False >Thread-34::DEBUG::2014-07-10 08:50:33,640::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-34::DEBUG::2014-07-10 08:50:33,640::task::595::TaskManager.Task::(_updateState) Task=`3714fb88-494d-465a-b505-75cbb83833f9`::moving from state init -> state preparing >Thread-34::INFO::2014-07-10 08:50:33,640::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-34::DEBUG::2014-07-10 08:50:33,641::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`d72fcce5-d73f-4021-9488-67f7961ced68`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-10 08:50:33,641::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' for lock type 'shared' >Thread-34::DEBUG::2014-07-10 08:50:33,641::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-10 08:50:33,642::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`d72fcce5-d73f-4021-9488-67f7961ced68`::Granted request >Thread-34::DEBUG::2014-07-10 08:50:33,642::task::827::TaskManager.Task::(resourceAcquired) Task=`3714fb88-494d-465a-b505-75cbb83833f9`::_resourcesAcquired: Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee (shared) >Thread-34::DEBUG::2014-07-10 08:50:33,642::task::990::TaskManager.Task::(_decref) Task=`3714fb88-494d-465a-b505-75cbb83833f9`::ref 1 aborting False >Thread-34::INFO::2014-07-10 08:50:33,643::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': 'Active', 'diskfree': '1094948225024', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}}} >Thread-34::DEBUG::2014-07-10 08:50:33,643::task::1185::TaskManager.Task::(prepare) Task=`3714fb88-494d-465a-b505-75cbb83833f9`::finished: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': 'Active', 'diskfree': '1094948225024', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}}} >Thread-34::DEBUG::2014-07-10 08:50:33,643::task::595::TaskManager.Task::(_updateState) Task=`3714fb88-494d-465a-b505-75cbb83833f9`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-10 08:50:33,644::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee': < ResourceRef 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-10 08:50:33,644::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-10 08:50:33,644::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' >Thread-34::DEBUG::2014-07-10 08:50:33,644::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' (0 active users) >Thread-34::DEBUG::2014-07-10 08:50:33,644::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-10 08:50:33,644::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', Clearing records. >Thread-34::DEBUG::2014-07-10 08:50:33,645::task::990::TaskManager.Task::(_decref) Task=`3714fb88-494d-465a-b505-75cbb83833f9`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 08:50:33,956::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 08:50:34,034::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0289833 s, 35.3 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 08:50:36,049::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 08:50:36,126::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0285595 s, 35.9 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 08:50:37,822::task::595::TaskManager.Task::(_updateState) Task=`9230660c-9c02-467e-8c82-ba5b48fc9419`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 08:50:37,823::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::INFO::2014-07-10 08:50:37,823::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000870156', 'lastCheck': '7.1', 'valid': True}} >Thread-14::DEBUG::2014-07-10 08:50:37,823::task::1185::TaskManager.Task::(prepare) Task=`9230660c-9c02-467e-8c82-ba5b48fc9419`::finished: {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000870156', 'lastCheck': '7.1', 'valid': True}} >Thread-14::DEBUG::2014-07-10 08:50:37,823::task::595::TaskManager.Task::(_updateState) Task=`9230660c-9c02-467e-8c82-ba5b48fc9419`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 08:50:37,824::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 08:50:37,824::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 08:50:37,824::task::990::TaskManager.Task::(_decref) Task=`9230660c-9c02-467e-8c82-ba5b48fc9419`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 08:50:38,141::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 08:50:38,222::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0291687 s, 35.1 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 08:50:40,265::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 08:50:40,358::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0443506 s, 23.1 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-10 08:50:40,677::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/metadata bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-10 08:50:40,689::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000784491 s, 5.2 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 08:50:42,374::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 08:50:42,459::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.035404 s, 28.9 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 08:50:43,672::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-14::DEBUG::2014-07-10 08:50:43,673::task::595::TaskManager.Task::(_updateState) Task=`40bb5fc1-5378-4407-8396-8c237db3d65f`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 08:50:43,673::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-14::INFO::2014-07-10 08:50:43,674::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 08:50:43,674::task::1185::TaskManager.Task::(prepare) Task=`40bb5fc1-5378-4407-8396-8c237db3d65f`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 08:50:43,674::task::595::TaskManager.Task::(_updateState) Task=`40bb5fc1-5378-4407-8396-8c237db3d65f`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 08:50:43,674::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 08:50:43,674::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 08:50:43,675::task::990::TaskManager.Task::(_decref) Task=`40bb5fc1-5378-4407-8396-8c237db3d65f`::ref 0 aborting False >Thread-34::DEBUG::2014-07-10 08:50:43,679::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-34::DEBUG::2014-07-10 08:50:43,679::task::595::TaskManager.Task::(_updateState) Task=`fa9c8379-845d-4c43-8b71-a5bec5b79074`::moving from state init -> state preparing >Thread-34::INFO::2014-07-10 08:50:43,679::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-34::DEBUG::2014-07-10 08:50:43,680::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`da3bdc7a-0b0c-4592-ada1-311dc853ba58`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-10 08:50:43,680::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' for lock type 'shared' >Thread-34::DEBUG::2014-07-10 08:50:43,681::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-10 08:50:43,681::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`da3bdc7a-0b0c-4592-ada1-311dc853ba58`::Granted request >Thread-34::DEBUG::2014-07-10 08:50:43,681::task::827::TaskManager.Task::(resourceAcquired) Task=`fa9c8379-845d-4c43-8b71-a5bec5b79074`::_resourcesAcquired: Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee (shared) >Thread-34::DEBUG::2014-07-10 08:50:43,681::task::990::TaskManager.Task::(_decref) Task=`fa9c8379-845d-4c43-8b71-a5bec5b79074`::ref 1 aborting False >Thread-34::INFO::2014-07-10 08:50:43,682::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': 'Active', 'diskfree': '1094948225024', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}}} >Thread-34::DEBUG::2014-07-10 08:50:43,683::task::1185::TaskManager.Task::(prepare) Task=`fa9c8379-845d-4c43-8b71-a5bec5b79074`::finished: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': 'Active', 'diskfree': '1094948225024', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}}} >Thread-34::DEBUG::2014-07-10 08:50:43,683::task::595::TaskManager.Task::(_updateState) Task=`fa9c8379-845d-4c43-8b71-a5bec5b79074`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-10 08:50:43,683::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee': < ResourceRef 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-10 08:50:43,683::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-10 08:50:43,683::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' >Thread-34::DEBUG::2014-07-10 08:50:43,684::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' (0 active users) >Thread-34::DEBUG::2014-07-10 08:50:43,684::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-10 08:50:43,684::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', Clearing records. >Thread-34::DEBUG::2014-07-10 08:50:43,684::task::990::TaskManager.Task::(_decref) Task=`fa9c8379-845d-4c43-8b71-a5bec5b79074`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 08:50:44,474::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 08:50:44,552::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0289911 s, 35.3 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 08:50:46,568::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 08:50:46,661::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0345999 s, 29.6 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 08:50:48,676::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 08:50:48,756::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.030069 s, 34.1 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-10 08:50:50,716::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/metadata bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-10 08:50:50,767::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.0394951 s, 104 kB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 08:50:50,775::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 08:50:50,893::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0647735 s, 15.8 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 08:50:52,908::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Thread-14::DEBUG::2014-07-10 08:50:52,959::task::595::TaskManager.Task::(_updateState) Task=`68a50efd-0a8f-4eda-9a18-3a69518576ee`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 08:50:52,963::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::INFO::2014-07-10 08:50:52,966::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0394951', 'lastCheck': '2.2', 'valid': True}} >Thread-14::DEBUG::2014-07-10 08:50:52,968::task::1185::TaskManager.Task::(prepare) Task=`68a50efd-0a8f-4eda-9a18-3a69518576ee`::finished: {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0394951', 'lastCheck': '2.2', 'valid': True}} >Thread-14::DEBUG::2014-07-10 08:50:52,971::task::595::TaskManager.Task::(_updateState) Task=`68a50efd-0a8f-4eda-9a18-3a69518576ee`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 08:50:52,973::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 08:50:52,975::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 08:50:52,977::task::990::TaskManager.Task::(_decref) Task=`68a50efd-0a8f-4eda-9a18-3a69518576ee`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 08:50:53,052::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.085833 s, 11.9 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 08:50:53,703::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-14::DEBUG::2014-07-10 08:50:53,704::task::595::TaskManager.Task::(_updateState) Task=`5b07b404-34c6-4a09-8123-179286f94dea`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 08:50:53,704::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-14::INFO::2014-07-10 08:50:53,705::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 08:50:53,705::task::1185::TaskManager.Task::(prepare) Task=`5b07b404-34c6-4a09-8123-179286f94dea`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 08:50:53,705::task::595::TaskManager.Task::(_updateState) Task=`5b07b404-34c6-4a09-8123-179286f94dea`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 08:50:53,705::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 08:50:53,705::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 08:50:53,705::task::990::TaskManager.Task::(_decref) Task=`5b07b404-34c6-4a09-8123-179286f94dea`::ref 0 aborting False >Thread-34::DEBUG::2014-07-10 08:50:53,709::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-34::DEBUG::2014-07-10 08:50:53,710::task::595::TaskManager.Task::(_updateState) Task=`34ac91b9-a12d-45ab-99ae-23db3552cd69`::moving from state init -> state preparing >Thread-34::INFO::2014-07-10 08:50:53,710::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-34::DEBUG::2014-07-10 08:50:53,711::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`7c17fbaf-3a5f-4745-8653-451e9303e8a8`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-10 08:50:53,711::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' for lock type 'shared' >Thread-34::DEBUG::2014-07-10 08:50:53,711::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-10 08:50:53,712::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`7c17fbaf-3a5f-4745-8653-451e9303e8a8`::Granted request >Thread-34::DEBUG::2014-07-10 08:50:53,712::task::827::TaskManager.Task::(resourceAcquired) Task=`34ac91b9-a12d-45ab-99ae-23db3552cd69`::_resourcesAcquired: Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee (shared) >Thread-34::DEBUG::2014-07-10 08:50:53,712::task::990::TaskManager.Task::(_decref) Task=`34ac91b9-a12d-45ab-99ae-23db3552cd69`::ref 1 aborting False >Thread-34::INFO::2014-07-10 08:50:53,713::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': 'Active', 'diskfree': '1094948225024', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}}} >Thread-34::DEBUG::2014-07-10 08:50:53,713::task::1185::TaskManager.Task::(prepare) Task=`34ac91b9-a12d-45ab-99ae-23db3552cd69`::finished: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': 'Active', 'diskfree': '1094948225024', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}}} >Thread-34::DEBUG::2014-07-10 08:50:53,714::task::595::TaskManager.Task::(_updateState) Task=`34ac91b9-a12d-45ab-99ae-23db3552cd69`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-10 08:50:53,714::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee': < ResourceRef 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-10 08:50:53,714::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-10 08:50:53,714::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' >Thread-34::DEBUG::2014-07-10 08:50:53,715::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' (0 active users) >Thread-34::DEBUG::2014-07-10 08:50:53,715::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-10 08:50:53,715::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', Clearing records. >Thread-34::DEBUG::2014-07-10 08:50:53,715::task::990::TaskManager.Task::(_decref) Task=`34ac91b9-a12d-45ab-99ae-23db3552cd69`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 08:50:55,068::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 08:50:55,153::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0353335 s, 29.0 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 08:50:57,168::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 08:50:57,251::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0327202 s, 31.3 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 08:50:59,266::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 08:50:59,348::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0337225 s, 30.4 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-10 08:51:00,815::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/metadata bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-10 08:51:00,844::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.0170707 s, 240 kB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 08:51:01,362::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 08:51:01,441::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0312273 s, 32.8 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 08:51:03,457::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 08:51:03,531::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0265974 s, 38.5 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 08:51:03,727::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-14::DEBUG::2014-07-10 08:51:03,728::task::595::TaskManager.Task::(_updateState) Task=`2ebb43bc-8f8d-4174-9ad9-6ae84fda5788`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 08:51:03,728::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-14::INFO::2014-07-10 08:51:03,729::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 08:51:03,729::task::1185::TaskManager.Task::(prepare) Task=`2ebb43bc-8f8d-4174-9ad9-6ae84fda5788`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 08:51:03,729::task::595::TaskManager.Task::(_updateState) Task=`2ebb43bc-8f8d-4174-9ad9-6ae84fda5788`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 08:51:03,729::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 08:51:03,730::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 08:51:03,730::task::990::TaskManager.Task::(_decref) Task=`2ebb43bc-8f8d-4174-9ad9-6ae84fda5788`::ref 0 aborting False >Thread-34::DEBUG::2014-07-10 08:51:03,736::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-34::DEBUG::2014-07-10 08:51:03,736::task::595::TaskManager.Task::(_updateState) Task=`487aedb7-2e37-4b0d-9ad6-3d0cdfb86fa7`::moving from state init -> state preparing >Thread-34::INFO::2014-07-10 08:51:03,736::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-34::DEBUG::2014-07-10 08:51:03,737::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`5497c41d-b18a-44c9-bed3-c119d2bbe856`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-10 08:51:03,737::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' for lock type 'shared' >Thread-34::DEBUG::2014-07-10 08:51:03,738::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-10 08:51:03,738::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`5497c41d-b18a-44c9-bed3-c119d2bbe856`::Granted request >Thread-34::DEBUG::2014-07-10 08:51:03,738::task::827::TaskManager.Task::(resourceAcquired) Task=`487aedb7-2e37-4b0d-9ad6-3d0cdfb86fa7`::_resourcesAcquired: Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee (shared) >Thread-34::DEBUG::2014-07-10 08:51:03,738::task::990::TaskManager.Task::(_decref) Task=`487aedb7-2e37-4b0d-9ad6-3d0cdfb86fa7`::ref 1 aborting False >Thread-34::INFO::2014-07-10 08:51:03,740::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': 'Active', 'diskfree': '1094948225024', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}}} >Thread-34::DEBUG::2014-07-10 08:51:03,740::task::1185::TaskManager.Task::(prepare) Task=`487aedb7-2e37-4b0d-9ad6-3d0cdfb86fa7`::finished: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': 'Active', 'diskfree': '1094948225024', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}}} >Thread-34::DEBUG::2014-07-10 08:51:03,740::task::595::TaskManager.Task::(_updateState) Task=`487aedb7-2e37-4b0d-9ad6-3d0cdfb86fa7`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-10 08:51:03,740::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee': < ResourceRef 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-10 08:51:03,740::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-10 08:51:03,741::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' >Thread-34::DEBUG::2014-07-10 08:51:03,741::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' (0 active users) >Thread-34::DEBUG::2014-07-10 08:51:03,741::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-10 08:51:03,741::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', Clearing records. >Thread-34::DEBUG::2014-07-10 08:51:03,741::task::990::TaskManager.Task::(_decref) Task=`487aedb7-2e37-4b0d-9ad6-3d0cdfb86fa7`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 08:51:05,547::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 08:51:05,622::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0261301 s, 39.2 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 08:51:07,637::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 08:51:07,722::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0359058 s, 28.5 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 08:51:08,128::task::595::TaskManager.Task::(_updateState) Task=`6866a23a-5901-4e23-9b2f-1acab9a3cd48`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 08:51:08,129::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::INFO::2014-07-10 08:51:08,129::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0170707', 'lastCheck': '7.3', 'valid': True}} >Thread-14::DEBUG::2014-07-10 08:51:08,129::task::1185::TaskManager.Task::(prepare) Task=`6866a23a-5901-4e23-9b2f-1acab9a3cd48`::finished: {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0170707', 'lastCheck': '7.3', 'valid': True}} >Thread-14::DEBUG::2014-07-10 08:51:08,129::task::595::TaskManager.Task::(_updateState) Task=`6866a23a-5901-4e23-9b2f-1acab9a3cd48`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 08:51:08,130::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 08:51:08,130::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 08:51:08,130::task::990::TaskManager.Task::(_decref) Task=`6866a23a-5901-4e23-9b2f-1acab9a3cd48`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 08:51:09,737::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 08:51:09,821::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0296451 s, 34.5 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-10 08:51:10,879::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/metadata bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-10 08:51:10,892::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000684358 s, 6.0 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 08:51:11,837::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 08:51:11,920::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0325067 s, 31.5 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 08:51:13,766::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-14::DEBUG::2014-07-10 08:51:13,767::task::595::TaskManager.Task::(_updateState) Task=`2e0d68d7-9edc-4a09-b992-9ac4fe0b8468`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 08:51:13,767::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-14::INFO::2014-07-10 08:51:13,767::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 08:51:13,768::task::1185::TaskManager.Task::(prepare) Task=`2e0d68d7-9edc-4a09-b992-9ac4fe0b8468`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 08:51:13,768::task::595::TaskManager.Task::(_updateState) Task=`2e0d68d7-9edc-4a09-b992-9ac4fe0b8468`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 08:51:13,768::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 08:51:13,768::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 08:51:13,769::task::990::TaskManager.Task::(_decref) Task=`2e0d68d7-9edc-4a09-b992-9ac4fe0b8468`::ref 0 aborting False >Thread-34::DEBUG::2014-07-10 08:51:13,773::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-34::DEBUG::2014-07-10 08:51:13,773::task::595::TaskManager.Task::(_updateState) Task=`9e2bc0f9-23d6-4e6b-b2cb-fd01a3c60d97`::moving from state init -> state preparing >Thread-34::INFO::2014-07-10 08:51:13,774::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-34::DEBUG::2014-07-10 08:51:13,774::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`92a7bd60-a083-4f1b-aae0-30d127686957`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-10 08:51:13,774::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' for lock type 'shared' >Thread-34::DEBUG::2014-07-10 08:51:13,775::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-10 08:51:13,775::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`92a7bd60-a083-4f1b-aae0-30d127686957`::Granted request >Thread-34::DEBUG::2014-07-10 08:51:13,776::task::827::TaskManager.Task::(resourceAcquired) Task=`9e2bc0f9-23d6-4e6b-b2cb-fd01a3c60d97`::_resourcesAcquired: Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee (shared) >Thread-34::DEBUG::2014-07-10 08:51:13,776::task::990::TaskManager.Task::(_decref) Task=`9e2bc0f9-23d6-4e6b-b2cb-fd01a3c60d97`::ref 1 aborting False >Thread-34::INFO::2014-07-10 08:51:13,777::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': 'Active', 'diskfree': '1094948225024', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}}} >Thread-34::DEBUG::2014-07-10 08:51:13,777::task::1185::TaskManager.Task::(prepare) Task=`9e2bc0f9-23d6-4e6b-b2cb-fd01a3c60d97`::finished: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': 'Active', 'diskfree': '1094948225024', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}}} >Thread-34::DEBUG::2014-07-10 08:51:13,777::task::595::TaskManager.Task::(_updateState) Task=`9e2bc0f9-23d6-4e6b-b2cb-fd01a3c60d97`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-10 08:51:13,777::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee': < ResourceRef 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-10 08:51:13,778::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-10 08:51:13,778::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' >Thread-34::DEBUG::2014-07-10 08:51:13,778::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' (0 active users) >Thread-34::DEBUG::2014-07-10 08:51:13,778::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-10 08:51:13,778::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', Clearing records. >Thread-34::DEBUG::2014-07-10 08:51:13,779::task::990::TaskManager.Task::(_decref) Task=`9e2bc0f9-23d6-4e6b-b2cb-fd01a3c60d97`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 08:51:13,936::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 08:51:14,018::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0332533 s, 30.8 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 08:51:16,029::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 08:51:16,107::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0282729 s, 36.2 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 08:51:18,122::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 08:51:18,209::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0348 s, 29.4 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 08:51:20,224::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 08:51:20,307::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0337009 s, 30.4 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-10 08:51:20,918::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/metadata bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-10 08:51:20,938::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.0079558 s, 515 kB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 08:51:22,322::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 08:51:22,407::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0346297 s, 29.6 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 08:51:23,258::task::595::TaskManager.Task::(_updateState) Task=`61e09436-1bb5-412a-92b2-3c082c78578f`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 08:51:23,259::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::INFO::2014-07-10 08:51:23,259::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0079558', 'lastCheck': '2.3', 'valid': True}} >Thread-14::DEBUG::2014-07-10 08:51:23,259::task::1185::TaskManager.Task::(prepare) Task=`61e09436-1bb5-412a-92b2-3c082c78578f`::finished: {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0079558', 'lastCheck': '2.3', 'valid': True}} >Thread-14::DEBUG::2014-07-10 08:51:23,259::task::595::TaskManager.Task::(_updateState) Task=`61e09436-1bb5-412a-92b2-3c082c78578f`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 08:51:23,259::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 08:51:23,260::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 08:51:23,260::task::990::TaskManager.Task::(_decref) Task=`61e09436-1bb5-412a-92b2-3c082c78578f`::ref 0 aborting False >Thread-14::DEBUG::2014-07-10 08:51:23,805::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-14::DEBUG::2014-07-10 08:51:23,806::task::595::TaskManager.Task::(_updateState) Task=`f5345719-032d-464b-94b2-ea74bfc4ecf7`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 08:51:23,806::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-14::INFO::2014-07-10 08:51:23,806::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 08:51:23,807::task::1185::TaskManager.Task::(prepare) Task=`f5345719-032d-464b-94b2-ea74bfc4ecf7`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 08:51:23,807::task::595::TaskManager.Task::(_updateState) Task=`f5345719-032d-464b-94b2-ea74bfc4ecf7`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 08:51:23,807::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 08:51:23,807::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 08:51:23,807::task::990::TaskManager.Task::(_decref) Task=`f5345719-032d-464b-94b2-ea74bfc4ecf7`::ref 0 aborting False >Thread-34::DEBUG::2014-07-10 08:51:23,811::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-34::DEBUG::2014-07-10 08:51:23,811::task::595::TaskManager.Task::(_updateState) Task=`3e1598b8-d088-4cc9-99de-608676972904`::moving from state init -> state preparing >Thread-34::INFO::2014-07-10 08:51:23,812::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-34::DEBUG::2014-07-10 08:51:23,812::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`c930009e-fd00-4c4c-828e-b113aede0258`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-10 08:51:23,812::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' for lock type 'shared' >Thread-34::DEBUG::2014-07-10 08:51:23,813::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-10 08:51:23,813::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`c930009e-fd00-4c4c-828e-b113aede0258`::Granted request >Thread-34::DEBUG::2014-07-10 08:51:23,814::task::827::TaskManager.Task::(resourceAcquired) Task=`3e1598b8-d088-4cc9-99de-608676972904`::_resourcesAcquired: Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee (shared) >Thread-34::DEBUG::2014-07-10 08:51:23,814::task::990::TaskManager.Task::(_decref) Task=`3e1598b8-d088-4cc9-99de-608676972904`::ref 1 aborting False >Thread-34::INFO::2014-07-10 08:51:23,815::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': 'Active', 'diskfree': '1094948225024', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}}} >Thread-34::DEBUG::2014-07-10 08:51:23,815::task::1185::TaskManager.Task::(prepare) Task=`3e1598b8-d088-4cc9-99de-608676972904`::finished: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': 'Active', 'diskfree': '1094948225024', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}}} >Thread-34::DEBUG::2014-07-10 08:51:23,816::task::595::TaskManager.Task::(_updateState) Task=`3e1598b8-d088-4cc9-99de-608676972904`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-10 08:51:23,816::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee': < ResourceRef 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-10 08:51:23,816::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-10 08:51:23,816::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' >Thread-34::DEBUG::2014-07-10 08:51:23,816::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' (0 active users) >Thread-34::DEBUG::2014-07-10 08:51:23,817::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-10 08:51:23,817::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', Clearing records. >Thread-34::DEBUG::2014-07-10 08:51:23,817::task::990::TaskManager.Task::(_decref) Task=`3e1598b8-d088-4cc9-99de-608676972904`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 08:51:24,422::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 08:51:24,502::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0292966 s, 35.0 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 08:51:26,517::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 08:51:26,599::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0312015 s, 32.8 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 08:51:28,614::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 08:51:28,737::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0358404 s, 28.6 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 08:51:30,752::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 08:51:30,834::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0312997 s, 32.7 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-10 08:51:30,964::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/metadata bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-10 08:51:30,983::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00691573 s, 592 kB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 08:51:32,849::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 08:51:32,942::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0419242 s, 24.4 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 08:51:33,829::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-14::DEBUG::2014-07-10 08:51:33,830::task::595::TaskManager.Task::(_updateState) Task=`3f6e8f40-25ee-4c5a-9a76-e9b2c352a8e1`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 08:51:33,831::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-14::INFO::2014-07-10 08:51:33,831::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 08:51:33,832::task::1185::TaskManager.Task::(prepare) Task=`3f6e8f40-25ee-4c5a-9a76-e9b2c352a8e1`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 08:51:33,832::task::595::TaskManager.Task::(_updateState) Task=`3f6e8f40-25ee-4c5a-9a76-e9b2c352a8e1`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 08:51:33,832::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 08:51:33,832::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 08:51:33,832::task::990::TaskManager.Task::(_decref) Task=`3f6e8f40-25ee-4c5a-9a76-e9b2c352a8e1`::ref 0 aborting False >Thread-34::DEBUG::2014-07-10 08:51:33,836::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-34::DEBUG::2014-07-10 08:51:33,837::task::595::TaskManager.Task::(_updateState) Task=`b5826100-fbba-4226-b4f7-b0dc213a5500`::moving from state init -> state preparing >Thread-34::INFO::2014-07-10 08:51:33,837::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-34::DEBUG::2014-07-10 08:51:33,838::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`e5b7b1a4-c9fb-408f-9570-e7c28029067a`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-10 08:51:33,838::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' for lock type 'shared' >Thread-34::DEBUG::2014-07-10 08:51:33,838::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-10 08:51:33,839::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`e5b7b1a4-c9fb-408f-9570-e7c28029067a`::Granted request >Thread-34::DEBUG::2014-07-10 08:51:33,839::task::827::TaskManager.Task::(resourceAcquired) Task=`b5826100-fbba-4226-b4f7-b0dc213a5500`::_resourcesAcquired: Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee (shared) >Thread-34::DEBUG::2014-07-10 08:51:33,839::task::990::TaskManager.Task::(_decref) Task=`b5826100-fbba-4226-b4f7-b0dc213a5500`::ref 1 aborting False >Thread-34::INFO::2014-07-10 08:51:33,840::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': 'Active', 'diskfree': '1094948225024', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}}} >Thread-34::DEBUG::2014-07-10 08:51:33,840::task::1185::TaskManager.Task::(prepare) Task=`b5826100-fbba-4226-b4f7-b0dc213a5500`::finished: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': 'Active', 'diskfree': '1094948225024', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}}} >Thread-34::DEBUG::2014-07-10 08:51:33,841::task::595::TaskManager.Task::(_updateState) Task=`b5826100-fbba-4226-b4f7-b0dc213a5500`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-10 08:51:33,841::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee': < ResourceRef 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-10 08:51:33,841::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-10 08:51:33,841::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' >Thread-34::DEBUG::2014-07-10 08:51:33,842::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' (0 active users) >Thread-34::DEBUG::2014-07-10 08:51:33,842::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-10 08:51:33,842::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', Clearing records. >Thread-34::DEBUG::2014-07-10 08:51:33,842::task::990::TaskManager.Task::(_decref) Task=`b5826100-fbba-4226-b4f7-b0dc213a5500`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 08:51:34,957::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 08:51:35,044::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.035265 s, 29.0 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 08:51:37,053::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 08:51:37,135::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0294943 s, 34.7 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 08:51:38,394::task::595::TaskManager.Task::(_updateState) Task=`182954c0-8e13-4d3b-ba9d-e6d77cd450ac`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 08:51:38,394::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::INFO::2014-07-10 08:51:38,395::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00691573', 'lastCheck': '7.4', 'valid': True}} >Thread-14::DEBUG::2014-07-10 08:51:38,395::task::1185::TaskManager.Task::(prepare) Task=`182954c0-8e13-4d3b-ba9d-e6d77cd450ac`::finished: {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00691573', 'lastCheck': '7.4', 'valid': True}} >Thread-14::DEBUG::2014-07-10 08:51:38,395::task::595::TaskManager.Task::(_updateState) Task=`182954c0-8e13-4d3b-ba9d-e6d77cd450ac`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 08:51:38,395::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 08:51:38,395::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 08:51:38,395::task::990::TaskManager.Task::(_decref) Task=`182954c0-8e13-4d3b-ba9d-e6d77cd450ac`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 08:51:39,150::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 08:51:39,232::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.029969 s, 34.2 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-10 08:51:41,009::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/metadata bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-10 08:51:41,036::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.015283 s, 268 kB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 08:51:41,247::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 08:51:41,324::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0279346 s, 36.7 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 08:51:43,339::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 08:51:43,566::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.178051 s, 5.8 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 08:51:43,862::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-14::DEBUG::2014-07-10 08:51:43,863::task::595::TaskManager.Task::(_updateState) Task=`b876a872-f61b-47be-9bb2-48848f56e8bd`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 08:51:43,863::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-14::INFO::2014-07-10 08:51:43,864::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 08:51:43,864::task::1185::TaskManager.Task::(prepare) Task=`b876a872-f61b-47be-9bb2-48848f56e8bd`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 08:51:43,864::task::595::TaskManager.Task::(_updateState) Task=`b876a872-f61b-47be-9bb2-48848f56e8bd`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 08:51:43,865::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 08:51:43,865::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 08:51:43,865::task::990::TaskManager.Task::(_decref) Task=`b876a872-f61b-47be-9bb2-48848f56e8bd`::ref 0 aborting False >Thread-34::DEBUG::2014-07-10 08:51:43,869::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-34::DEBUG::2014-07-10 08:51:43,870::task::595::TaskManager.Task::(_updateState) Task=`24ae9e22-bcf0-4a87-bb55-8012fc0027e1`::moving from state init -> state preparing >Thread-34::INFO::2014-07-10 08:51:43,870::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-34::DEBUG::2014-07-10 08:51:43,871::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`0e372e82-96b9-4900-876b-dfca677c843c`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-10 08:51:43,871::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' for lock type 'shared' >Thread-34::DEBUG::2014-07-10 08:51:43,871::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-10 08:51:43,872::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`0e372e82-96b9-4900-876b-dfca677c843c`::Granted request >Thread-34::DEBUG::2014-07-10 08:51:43,872::task::827::TaskManager.Task::(resourceAcquired) Task=`24ae9e22-bcf0-4a87-bb55-8012fc0027e1`::_resourcesAcquired: Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee (shared) >Thread-34::DEBUG::2014-07-10 08:51:43,872::task::990::TaskManager.Task::(_decref) Task=`24ae9e22-bcf0-4a87-bb55-8012fc0027e1`::ref 1 aborting False >Thread-34::INFO::2014-07-10 08:51:43,873::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': 'Active', 'diskfree': '1094948225024', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}}} >Thread-34::DEBUG::2014-07-10 08:51:43,873::task::1185::TaskManager.Task::(prepare) Task=`24ae9e22-bcf0-4a87-bb55-8012fc0027e1`::finished: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': 'Active', 'diskfree': '1094948225024', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}}} >Thread-34::DEBUG::2014-07-10 08:51:43,874::task::595::TaskManager.Task::(_updateState) Task=`24ae9e22-bcf0-4a87-bb55-8012fc0027e1`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-10 08:51:43,874::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee': < ResourceRef 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-10 08:51:43,874::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-10 08:51:43,874::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' >Thread-34::DEBUG::2014-07-10 08:51:43,875::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' (0 active users) >Thread-34::DEBUG::2014-07-10 08:51:43,875::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-10 08:51:43,875::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', Clearing records. >Thread-34::DEBUG::2014-07-10 08:51:43,875::task::990::TaskManager.Task::(_decref) Task=`24ae9e22-bcf0-4a87-bb55-8012fc0027e1`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 08:51:45,581::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 08:51:45,659::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0281339 s, 36.4 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 08:51:47,674::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 08:51:47,759::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0354918 s, 28.9 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 08:51:49,774::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 08:51:49,859::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0353913 s, 28.9 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-10 08:51:51,060::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/metadata bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-10 08:51:51,073::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00095202 s, 4.3 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 08:51:51,874::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 08:51:51,966::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0403988 s, 25.3 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 08:51:53,522::task::595::TaskManager.Task::(_updateState) Task=`29a9688f-6504-4552-bd46-25ce105d0483`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 08:51:53,522::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::INFO::2014-07-10 08:51:53,522::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00095202', 'lastCheck': '2.4', 'valid': True}} >Thread-14::DEBUG::2014-07-10 08:51:53,523::task::1185::TaskManager.Task::(prepare) Task=`29a9688f-6504-4552-bd46-25ce105d0483`::finished: {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00095202', 'lastCheck': '2.4', 'valid': True}} >Thread-14::DEBUG::2014-07-10 08:51:53,523::task::595::TaskManager.Task::(_updateState) Task=`29a9688f-6504-4552-bd46-25ce105d0483`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 08:51:53,523::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 08:51:53,523::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 08:51:53,523::task::990::TaskManager.Task::(_decref) Task=`29a9688f-6504-4552-bd46-25ce105d0483`::ref 0 aborting False >Thread-14::DEBUG::2014-07-10 08:51:53,897::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-14::DEBUG::2014-07-10 08:51:53,898::task::595::TaskManager.Task::(_updateState) Task=`ce9de855-600e-4c07-8963-ebc3d7c8dfaf`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 08:51:53,898::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-14::INFO::2014-07-10 08:51:53,898::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 08:51:53,898::task::1185::TaskManager.Task::(prepare) Task=`ce9de855-600e-4c07-8963-ebc3d7c8dfaf`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 08:51:53,899::task::595::TaskManager.Task::(_updateState) Task=`ce9de855-600e-4c07-8963-ebc3d7c8dfaf`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 08:51:53,899::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 08:51:53,899::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 08:51:53,899::task::990::TaskManager.Task::(_decref) Task=`ce9de855-600e-4c07-8963-ebc3d7c8dfaf`::ref 0 aborting False >Thread-34::DEBUG::2014-07-10 08:51:53,903::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-34::DEBUG::2014-07-10 08:51:53,903::task::595::TaskManager.Task::(_updateState) Task=`efacaea6-f2d3-4804-8891-66f86399ef40`::moving from state init -> state preparing >Thread-34::INFO::2014-07-10 08:51:53,903::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-34::DEBUG::2014-07-10 08:51:53,905::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`a3290ca0-4c5c-48bd-beb1-9d316535f6e3`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-10 08:51:53,905::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' for lock type 'shared' >Thread-34::DEBUG::2014-07-10 08:51:53,906::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-10 08:51:53,906::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`a3290ca0-4c5c-48bd-beb1-9d316535f6e3`::Granted request >Thread-34::DEBUG::2014-07-10 08:51:53,906::task::827::TaskManager.Task::(resourceAcquired) Task=`efacaea6-f2d3-4804-8891-66f86399ef40`::_resourcesAcquired: Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee (shared) >Thread-34::DEBUG::2014-07-10 08:51:53,906::task::990::TaskManager.Task::(_decref) Task=`efacaea6-f2d3-4804-8891-66f86399ef40`::ref 1 aborting False >Thread-34::INFO::2014-07-10 08:51:53,907::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': 'Active', 'diskfree': '1094948225024', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}}} >Thread-34::DEBUG::2014-07-10 08:51:53,907::task::1185::TaskManager.Task::(prepare) Task=`efacaea6-f2d3-4804-8891-66f86399ef40`::finished: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': 'Active', 'diskfree': '1094948225024', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}}} >Thread-34::DEBUG::2014-07-10 08:51:53,907::task::595::TaskManager.Task::(_updateState) Task=`efacaea6-f2d3-4804-8891-66f86399ef40`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-10 08:51:53,908::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee': < ResourceRef 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-10 08:51:53,908::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-10 08:51:53,908::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' >Thread-34::DEBUG::2014-07-10 08:51:53,908::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' (0 active users) >Thread-34::DEBUG::2014-07-10 08:51:53,908::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-10 08:51:53,908::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', Clearing records. >Thread-34::DEBUG::2014-07-10 08:51:53,909::task::990::TaskManager.Task::(_decref) Task=`efacaea6-f2d3-4804-8891-66f86399ef40`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 08:51:53,980::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 08:51:54,058::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0281977 s, 36.3 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 08:51:56,072::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 08:51:56,149::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0286724 s, 35.7 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 08:51:58,165::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 08:51:58,249::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0344725 s, 29.7 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 08:52:00,264::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 08:52:00,343::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.029977 s, 34.2 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-10 08:52:01,099::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/metadata bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-10 08:52:01,118::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00640614 s, 639 kB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 08:52:02,358::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 08:52:02,437::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0292754 s, 35.0 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 08:52:03,926::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-14::DEBUG::2014-07-10 08:52:03,927::task::595::TaskManager.Task::(_updateState) Task=`2eddad77-a40c-46d3-9ddd-0b786cfad4a0`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 08:52:03,927::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-14::INFO::2014-07-10 08:52:03,928::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 08:52:03,928::task::1185::TaskManager.Task::(prepare) Task=`2eddad77-a40c-46d3-9ddd-0b786cfad4a0`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 08:52:03,928::task::595::TaskManager.Task::(_updateState) Task=`2eddad77-a40c-46d3-9ddd-0b786cfad4a0`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 08:52:03,928::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 08:52:03,928::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 08:52:03,929::task::990::TaskManager.Task::(_decref) Task=`2eddad77-a40c-46d3-9ddd-0b786cfad4a0`::ref 0 aborting False >Thread-34::DEBUG::2014-07-10 08:52:03,933::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-34::DEBUG::2014-07-10 08:52:03,933::task::595::TaskManager.Task::(_updateState) Task=`22b9f65f-c90f-4914-b45f-2f64d24f5b74`::moving from state init -> state preparing >Thread-34::INFO::2014-07-10 08:52:03,934::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-34::DEBUG::2014-07-10 08:52:03,934::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`7764ab25-0d58-4f3b-bab8-5645813205e3`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-10 08:52:03,935::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' for lock type 'shared' >Thread-34::DEBUG::2014-07-10 08:52:03,935::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-10 08:52:03,935::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`7764ab25-0d58-4f3b-bab8-5645813205e3`::Granted request >Thread-34::DEBUG::2014-07-10 08:52:03,936::task::827::TaskManager.Task::(resourceAcquired) Task=`22b9f65f-c90f-4914-b45f-2f64d24f5b74`::_resourcesAcquired: Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee (shared) >Thread-34::DEBUG::2014-07-10 08:52:03,936::task::990::TaskManager.Task::(_decref) Task=`22b9f65f-c90f-4914-b45f-2f64d24f5b74`::ref 1 aborting False >Thread-34::INFO::2014-07-10 08:52:03,937::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': 'Active', 'diskfree': '1094948225024', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}}} >Thread-34::DEBUG::2014-07-10 08:52:03,937::task::1185::TaskManager.Task::(prepare) Task=`22b9f65f-c90f-4914-b45f-2f64d24f5b74`::finished: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': 'Active', 'diskfree': '1094948225024', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}}} >Thread-34::DEBUG::2014-07-10 08:52:03,937::task::595::TaskManager.Task::(_updateState) Task=`22b9f65f-c90f-4914-b45f-2f64d24f5b74`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-10 08:52:03,937::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee': < ResourceRef 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-10 08:52:03,938::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-10 08:52:03,938::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' >Thread-34::DEBUG::2014-07-10 08:52:03,938::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' (0 active users) >Thread-34::DEBUG::2014-07-10 08:52:03,938::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-10 08:52:03,938::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', Clearing records. >Thread-34::DEBUG::2014-07-10 08:52:03,939::task::990::TaskManager.Task::(_decref) Task=`22b9f65f-c90f-4914-b45f-2f64d24f5b74`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 08:52:04,453::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 08:52:04,568::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0659923 s, 15.5 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 08:52:06,583::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 08:52:06,683::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0501009 s, 20.4 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 08:52:08,655::task::595::TaskManager.Task::(_updateState) Task=`e81e2964-8289-4b99-aa59-b076ac35cc7c`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 08:52:08,655::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::INFO::2014-07-10 08:52:08,656::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00640614', 'lastCheck': '7.5', 'valid': True}} >Thread-14::DEBUG::2014-07-10 08:52:08,656::task::1185::TaskManager.Task::(prepare) Task=`e81e2964-8289-4b99-aa59-b076ac35cc7c`::finished: {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00640614', 'lastCheck': '7.5', 'valid': True}} >Thread-14::DEBUG::2014-07-10 08:52:08,656::task::595::TaskManager.Task::(_updateState) Task=`e81e2964-8289-4b99-aa59-b076ac35cc7c`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 08:52:08,656::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 08:52:08,656::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 08:52:08,656::task::990::TaskManager.Task::(_decref) Task=`e81e2964-8289-4b99-aa59-b076ac35cc7c`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 08:52:08,698::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 08:52:08,778::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0295697 s, 34.6 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 08:52:10,793::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 08:52:10,890::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0480673 s, 21.3 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-10 08:52:11,146::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/metadata bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-10 08:52:11,164::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00645943 s, 634 kB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 08:52:12,404::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [6f7047c9] >Thread-14::DEBUG::2014-07-10 08:52:12,405::task::595::TaskManager.Task::(_updateState) Task=`84a6c007-50bd-4206-b37e-240831b30b09`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 08:52:12,406::logUtils::44::dispatcher::(wrapper) Run and protect: connectStorageServer(domType=1, spUUID='00000000-0000-0000-0000-000000000000', conList=[{'connection': 'lion.qa.lab.tlv.redhat.com:/export/yuri2/backup2', 'iqn': '', 'user': '', 'tpgt': '1', 'password': '******', 'id': '00000000-0000-0000-0000-000000000000', 'port': ''}], options=None) >Thread-14::DEBUG::2014-07-10 08:52:12,429::mount::202::Storage.Misc.excCmd::(_runcmd) '/usr/bin/sudo -n /bin/mount -t nfs -o soft,nosharecache,timeo=600,retrans=6,nfsvers=3 lion.qa.lab.tlv.redhat.com:/export/yuri2/backup2 /rhev/data-center/mnt/lion.qa.lab.tlv.redhat.com:_export_yuri2_backup2' (cwd None) >Thread-14::DEBUG::2014-07-10 08:52:12,870::hsm::2328::Storage.HSM::(__prefetchDomains) nfs local path: /rhev/data-center/mnt/lion.qa.lab.tlv.redhat.com:_export_yuri2_backup2 >Thread-14::DEBUG::2014-07-10 08:52:12,873::hsm::2352::Storage.HSM::(__prefetchDomains) Found SD uuids: ('f34d0693-3747-467e-9a7c-8d73e8fb1171', 'cb15e53b-995b-47d6-b132-0ad9d148269e', '41530dea-409a-4a3d-ad8a-6f714a9b5986', '6a70504d-00df-4869-8695-0f442053f6b6', '33100657-451b-45f5-9a71-9fed8490e696') >Thread-14::DEBUG::2014-07-10 08:52:12,873::hsm::2408::Storage.HSM::(connectStorageServer) knownSDs: {f34d0693-3747-467e-9a7c-8d73e8fb1171: storage.nfsSD.findDomain, 9e1aa540-1f4e-4ee3-a152-be381ef6c3bd: storage.blockSD.findDomain, 41530dea-409a-4a3d-ad8a-6f714a9b5986: storage.nfsSD.findDomain, 6a70504d-00df-4869-8695-0f442053f6b6: storage.nfsSD.findDomain, 33100657-451b-45f5-9a71-9fed8490e696: storage.nfsSD.findDomain, cb15e53b-995b-47d6-b132-0ad9d148269e: storage.nfsSD.findDomain} >Thread-14::INFO::2014-07-10 08:52:12,873::logUtils::47::dispatcher::(wrapper) Run and protect: connectStorageServer, Return response: {'statuslist': [{'status': 0, 'id': '00000000-0000-0000-0000-000000000000'}]} >Thread-14::DEBUG::2014-07-10 08:52:12,874::task::1185::TaskManager.Task::(prepare) Task=`84a6c007-50bd-4206-b37e-240831b30b09`::finished: {'statuslist': [{'status': 0, 'id': '00000000-0000-0000-0000-000000000000'}]} >Thread-14::DEBUG::2014-07-10 08:52:12,874::task::595::TaskManager.Task::(_updateState) Task=`84a6c007-50bd-4206-b37e-240831b30b09`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 08:52:12,874::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 08:52:12,874::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 08:52:12,875::task::990::TaskManager.Task::(_decref) Task=`84a6c007-50bd-4206-b37e-240831b30b09`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 08:52:12,904::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 08:52:13,022::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0677931 s, 15.1 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 08:52:13,124::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-14::DEBUG::2014-07-10 08:52:13,125::task::595::TaskManager.Task::(_updateState) Task=`1633ea66-354c-4dc3-ac6f-29fcd484a020`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 08:52:13,125::logUtils::44::dispatcher::(wrapper) Run and protect: getStorageDomainsList(spUUID='00000000-0000-0000-0000-000000000000', domainClass=3, storageType=1, remotePath='lion.qa.lab.tlv.redhat.com:/export/yuri2/backup2', options=None) >Thread-14::DEBUG::2014-07-10 08:52:13,125::misc::756::SamplingMethod::(__call__) Trying to enter sampling method (storage.sdc.refreshStorage) >Thread-14::DEBUG::2014-07-10 08:52:13,126::misc::758::SamplingMethod::(__call__) Got in to sampling method >Thread-14::DEBUG::2014-07-10 08:52:13,126::misc::756::SamplingMethod::(__call__) Trying to enter sampling method (storage.iscsi.rescan) >Thread-14::DEBUG::2014-07-10 08:52:13,126::misc::758::SamplingMethod::(__call__) Got in to sampling method >Thread-14::DEBUG::2014-07-10 08:52:13,126::iscsi::407::Storage.ISCSI::(rescan) Performing SCSI scan, this will take up to 30 seconds >Thread-14::DEBUG::2014-07-10 08:52:13,127::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) '/usr/bin/sudo -n /sbin/iscsiadm -m session -R' (cwd None) >Thread-14::DEBUG::2014-07-10 08:52:13,166::misc::766::SamplingMethod::(__call__) Returning last result >Thread-14::DEBUG::2014-07-10 08:52:13,167::multipath::109::Storage.Misc.excCmd::(rescan) '/usr/bin/sudo -n /sbin/multipath' (cwd None) >Thread-14::DEBUG::2014-07-10 08:52:13,231::multipath::109::Storage.Misc.excCmd::(rescan) SUCCESS: <err> = ''; <rc> = 0 >Thread-14::DEBUG::2014-07-10 08:52:13,232::lvm::497::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-14::DEBUG::2014-07-10 08:52:13,233::lvm::499::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-14::DEBUG::2014-07-10 08:52:13,233::lvm::508::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-14::DEBUG::2014-07-10 08:52:13,233::lvm::510::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-14::DEBUG::2014-07-10 08:52:13,233::lvm::528::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-14::DEBUG::2014-07-10 08:52:13,234::lvm::530::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-14::DEBUG::2014-07-10 08:52:13,234::misc::766::SamplingMethod::(__call__) Returning last result >Thread-14::DEBUG::2014-07-10 08:52:13,234::lvm::373::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-14::DEBUG::2014-07-10 08:52:13,238::lvm::296::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/3600601601282300032826addbbdae311|/dev/mapper/360060160f4a030003840ec867ddee311|/dev/mapper/367cad74c2fcba00019e6afd20c781e67|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name' (cwd None) >Thread-14::DEBUG::2014-07-10 08:52:13,533::lvm::296::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-14::DEBUG::2014-07-10 08:52:13,536::lvm::415::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-14::DEBUG::2014-07-10 08:52:13,762::fileSD::150::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/lion.qa.lab.tlv.redhat.com:_export_yuri2_backup2/6a70504d-00df-4869-8695-0f442053f6b6 >Thread-14::DEBUG::2014-07-10 08:52:13,953::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend >Thread-13::DEBUG::2014-07-10 08:52:13,957::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-13::DEBUG::2014-07-10 08:52:13,958::task::595::TaskManager.Task::(_updateState) Task=`9fdef945-9eb0-4ea0-b672-6b4e2dce9165`::moving from state init -> state preparing >Thread-13::INFO::2014-07-10 08:52:13,958::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-13::INFO::2014-07-10 08:52:13,958::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-13::DEBUG::2014-07-10 08:52:13,959::task::1185::TaskManager.Task::(prepare) Task=`9fdef945-9eb0-4ea0-b672-6b4e2dce9165`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-13::DEBUG::2014-07-10 08:52:13,959::task::595::TaskManager.Task::(_updateState) Task=`9fdef945-9eb0-4ea0-b672-6b4e2dce9165`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-07-10 08:52:13,959::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-07-10 08:52:13,959::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-07-10 08:52:13,959::task::990::TaskManager.Task::(_decref) Task=`9fdef945-9eb0-4ea0-b672-6b4e2dce9165`::ref 0 aborting False >Thread-14::DEBUG::2014-07-10 08:52:13,962::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Backup', 'DESCRIPTION=test', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=0', 'POOL_UUID=', 'REMOTE_PATH=lion.qa.lab.tlv.redhat.com:/export/yuri2/backup2', 'ROLE=Regular', 'SDUUID=6a70504d-00df-4869-8695-0f442053f6b6', 'TYPE=NFS', 'VERSION=0', '_SHA_CKSUM=25fcf6f5195d1012468ec6c2844cb2ea77f111c8'] >Thread-34::DEBUG::2014-07-10 08:52:13,964::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-34::DEBUG::2014-07-10 08:52:13,964::task::595::TaskManager.Task::(_updateState) Task=`f8d9cc8c-99d2-453a-979a-dd961a46bc12`::moving from state init -> state preparing >Thread-14::DEBUG::2014-07-10 08:52:13,965::fileSD::609::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images [] >Thread-34::INFO::2014-07-10 08:52:13,966::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-14::DEBUG::2014-07-10 08:52:13,967::resourceManager::421::ResourceManager::(registerNamespace) Registering namespace '6a70504d-00df-4869-8695-0f442053f6b6_imageNS' >Thread-34::DEBUG::2014-07-10 08:52:13,969::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`4696d616-8eba-4a77-93ad-716c60048fb9`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-14::DEBUG::2014-07-10 08:52:13,969::resourceManager::421::ResourceManager::(registerNamespace) Registering namespace '6a70504d-00df-4869-8695-0f442053f6b6_volumeNS' >Thread-34::DEBUG::2014-07-10 08:52:13,970::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' for lock type 'shared' >Thread-34::DEBUG::2014-07-10 08:52:13,972::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free. Now locking as 'shared' (1 active user) >Thread-14::INFO::2014-07-10 08:52:13,972::logUtils::47::dispatcher::(wrapper) Run and protect: getStorageDomainsList, Return response: {'domlist': ['6a70504d-00df-4869-8695-0f442053f6b6']} >Thread-34::DEBUG::2014-07-10 08:52:13,973::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`4696d616-8eba-4a77-93ad-716c60048fb9`::Granted request >Thread-14::DEBUG::2014-07-10 08:52:13,973::task::1185::TaskManager.Task::(prepare) Task=`1633ea66-354c-4dc3-ac6f-29fcd484a020`::finished: {'domlist': ['6a70504d-00df-4869-8695-0f442053f6b6']} >Thread-14::DEBUG::2014-07-10 08:52:13,974::task::595::TaskManager.Task::(_updateState) Task=`1633ea66-354c-4dc3-ac6f-29fcd484a020`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-10 08:52:13,976::task::827::TaskManager.Task::(resourceAcquired) Task=`f8d9cc8c-99d2-453a-979a-dd961a46bc12`::_resourcesAcquired: Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee (shared) >Thread-14::DEBUG::2014-07-10 08:52:13,976::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-34::DEBUG::2014-07-10 08:52:13,977::task::990::TaskManager.Task::(_decref) Task=`f8d9cc8c-99d2-453a-979a-dd961a46bc12`::ref 1 aborting False >Thread-14::DEBUG::2014-07-10 08:52:13,977::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 08:52:13,978::task::990::TaskManager.Task::(_decref) Task=`1633ea66-354c-4dc3-ac6f-29fcd484a020`::ref 0 aborting False >Thread-34::INFO::2014-07-10 08:52:13,981::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': 'Active', 'diskfree': '1094948225024', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}}} >Thread-34::DEBUG::2014-07-10 08:52:13,981::task::1185::TaskManager.Task::(prepare) Task=`f8d9cc8c-99d2-453a-979a-dd961a46bc12`::finished: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': 'Active', 'diskfree': '1094948225024', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}}} >Thread-34::DEBUG::2014-07-10 08:52:13,982::task::595::TaskManager.Task::(_updateState) Task=`f8d9cc8c-99d2-453a-979a-dd961a46bc12`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-10 08:52:13,983::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee': < ResourceRef 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-10 08:52:13,983::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-10 08:52:13,983::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' >Thread-34::DEBUG::2014-07-10 08:52:13,983::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' (0 active users) >Thread-34::DEBUG::2014-07-10 08:52:13,984::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-10 08:52:13,984::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', Clearing records. >Thread-34::DEBUG::2014-07-10 08:52:13,984::task::990::TaskManager.Task::(_decref) Task=`f8d9cc8c-99d2-453a-979a-dd961a46bc12`::ref 0 aborting False >Thread-14::DEBUG::2014-07-10 08:52:14,021::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-14::DEBUG::2014-07-10 08:52:14,021::task::595::TaskManager.Task::(_updateState) Task=`a224017c-e99a-43da-87cb-30e4987b15d9`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 08:52:14,021::logUtils::44::dispatcher::(wrapper) Run and protect: getStorageDomainInfo(sdUUID='6a70504d-00df-4869-8695-0f442053f6b6', options=None) >Thread-14::INFO::2014-07-10 08:52:14,021::fileSD::350::Storage.StorageDomain::(validate) sdUUID=6a70504d-00df-4869-8695-0f442053f6b6 >Thread-14::DEBUG::2014-07-10 08:52:14,024::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Backup', 'DESCRIPTION=test', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=0', 'POOL_UUID=', 'REMOTE_PATH=lion.qa.lab.tlv.redhat.com:/export/yuri2/backup2', 'ROLE=Regular', 'SDUUID=6a70504d-00df-4869-8695-0f442053f6b6', 'TYPE=NFS', 'VERSION=0', '_SHA_CKSUM=25fcf6f5195d1012468ec6c2844cb2ea77f111c8'] >Thread-14::DEBUG::2014-07-10 08:52:14,024::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.6a70504d-00df-4869-8695-0f442053f6b6`ReqID=`23cc6f75-c529-4cc9-944d-1e7d37b8eb85`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2768' at 'getStorageDomainInfo' >Thread-14::DEBUG::2014-07-10 08:52:14,025::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.6a70504d-00df-4869-8695-0f442053f6b6' for lock type 'shared' >Thread-14::DEBUG::2014-07-10 08:52:14,025::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.6a70504d-00df-4869-8695-0f442053f6b6' is free. Now locking as 'shared' (1 active user) >Thread-14::DEBUG::2014-07-10 08:52:14,025::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.6a70504d-00df-4869-8695-0f442053f6b6`ReqID=`23cc6f75-c529-4cc9-944d-1e7d37b8eb85`::Granted request >Thread-14::DEBUG::2014-07-10 08:52:14,025::task::827::TaskManager.Task::(resourceAcquired) Task=`a224017c-e99a-43da-87cb-30e4987b15d9`::_resourcesAcquired: Storage.6a70504d-00df-4869-8695-0f442053f6b6 (shared) >Thread-14::DEBUG::2014-07-10 08:52:14,026::task::990::TaskManager.Task::(_decref) Task=`a224017c-e99a-43da-87cb-30e4987b15d9`::ref 1 aborting False >Thread-14::INFO::2014-07-10 08:52:14,050::logUtils::47::dispatcher::(wrapper) Run and protect: getStorageDomainInfo, Return response: {'info': {'uuid': '6a70504d-00df-4869-8695-0f442053f6b6', 'version': '0', 'role': 'Regular', 'remotePath': 'lion.qa.lab.tlv.redhat.com:/export/yuri2/backup2', 'type': 'NFS', 'class': 'Backup', 'pool': [], 'name': 'test'}} >Thread-14::DEBUG::2014-07-10 08:52:14,050::task::1185::TaskManager.Task::(prepare) Task=`a224017c-e99a-43da-87cb-30e4987b15d9`::finished: {'info': {'uuid': '6a70504d-00df-4869-8695-0f442053f6b6', 'version': '0', 'role': 'Regular', 'remotePath': 'lion.qa.lab.tlv.redhat.com:/export/yuri2/backup2', 'type': 'NFS', 'class': 'Backup', 'pool': [], 'name': 'test'}} >Thread-14::DEBUG::2014-07-10 08:52:14,050::task::595::TaskManager.Task::(_updateState) Task=`a224017c-e99a-43da-87cb-30e4987b15d9`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 08:52:14,050::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.6a70504d-00df-4869-8695-0f442053f6b6': < ResourceRef 'Storage.6a70504d-00df-4869-8695-0f442053f6b6', isValid: 'True' obj: 'None'>} >Thread-14::DEBUG::2014-07-10 08:52:14,051::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 08:52:14,051::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.6a70504d-00df-4869-8695-0f442053f6b6' >Thread-14::DEBUG::2014-07-10 08:52:14,051::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.6a70504d-00df-4869-8695-0f442053f6b6' (0 active users) >Thread-14::DEBUG::2014-07-10 08:52:14,051::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.6a70504d-00df-4869-8695-0f442053f6b6' is free, finding out if anyone is waiting for it. >Thread-14::DEBUG::2014-07-10 08:52:14,051::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.6a70504d-00df-4869-8695-0f442053f6b6', Clearing records. >Thread-14::DEBUG::2014-07-10 08:52:14,052::task::990::TaskManager.Task::(_decref) Task=`a224017c-e99a-43da-87cb-30e4987b15d9`::ref 0 aborting False >Thread-14::DEBUG::2014-07-10 08:52:14,291::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [563b5108] >Thread-14::DEBUG::2014-07-10 08:52:14,291::task::595::TaskManager.Task::(_updateState) Task=`2228299f-1f32-4ee7-a69e-b70f0bbb297b`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 08:52:14,292::logUtils::44::dispatcher::(wrapper) Run and protect: getStorageDomainsList(spUUID='00000000-0000-0000-0000-000000000000', domainClass=3, storageType=1, remotePath='', options=None) >Thread-14::DEBUG::2014-07-10 08:52:14,292::misc::756::SamplingMethod::(__call__) Trying to enter sampling method (storage.sdc.refreshStorage) >Thread-14::DEBUG::2014-07-10 08:52:14,292::misc::758::SamplingMethod::(__call__) Got in to sampling method >Thread-14::DEBUG::2014-07-10 08:52:14,292::misc::756::SamplingMethod::(__call__) Trying to enter sampling method (storage.iscsi.rescan) >Thread-14::DEBUG::2014-07-10 08:52:14,292::misc::758::SamplingMethod::(__call__) Got in to sampling method >Thread-14::DEBUG::2014-07-10 08:52:14,292::iscsi::407::Storage.ISCSI::(rescan) Performing SCSI scan, this will take up to 30 seconds >Thread-14::DEBUG::2014-07-10 08:52:14,293::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) '/usr/bin/sudo -n /sbin/iscsiadm -m session -R' (cwd None) >Thread-14::DEBUG::2014-07-10 08:52:14,323::misc::766::SamplingMethod::(__call__) Returning last result >Thread-14::DEBUG::2014-07-10 08:52:14,324::multipath::109::Storage.Misc.excCmd::(rescan) '/usr/bin/sudo -n /sbin/multipath' (cwd None) >Thread-14::DEBUG::2014-07-10 08:52:14,391::multipath::109::Storage.Misc.excCmd::(rescan) SUCCESS: <err> = ''; <rc> = 0 >Thread-14::DEBUG::2014-07-10 08:52:14,391::lvm::497::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-14::DEBUG::2014-07-10 08:52:14,392::lvm::499::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-14::DEBUG::2014-07-10 08:52:14,392::lvm::508::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-14::DEBUG::2014-07-10 08:52:14,392::lvm::510::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-14::DEBUG::2014-07-10 08:52:14,392::lvm::528::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-14::DEBUG::2014-07-10 08:52:14,393::lvm::530::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-14::DEBUG::2014-07-10 08:52:14,393::misc::766::SamplingMethod::(__call__) Returning last result >Thread-14::DEBUG::2014-07-10 08:52:14,393::lvm::373::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-14::DEBUG::2014-07-10 08:52:14,396::lvm::296::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/3600601601282300032826addbbdae311|/dev/mapper/360060160f4a030003840ec867ddee311|/dev/mapper/367cad74c2fcba00019e6afd20c781e67|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name' (cwd None) >Thread-14::DEBUG::2014-07-10 08:52:14,608::lvm::296::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-14::DEBUG::2014-07-10 08:52:14,611::lvm::415::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-14::INFO::2014-07-10 08:52:14,619::logUtils::47::dispatcher::(wrapper) Run and protect: getStorageDomainsList, Return response: {'domlist': ['6a70504d-00df-4869-8695-0f442053f6b6']} >Thread-14::DEBUG::2014-07-10 08:52:14,619::task::1185::TaskManager.Task::(prepare) Task=`2228299f-1f32-4ee7-a69e-b70f0bbb297b`::finished: {'domlist': ['6a70504d-00df-4869-8695-0f442053f6b6']} >Thread-14::DEBUG::2014-07-10 08:52:14,620::task::595::TaskManager.Task::(_updateState) Task=`2228299f-1f32-4ee7-a69e-b70f0bbb297b`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 08:52:14,620::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 08:52:14,620::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 08:52:14,620::task::990::TaskManager.Task::(_decref) Task=`2228299f-1f32-4ee7-a69e-b70f0bbb297b`::ref 0 aborting False >Thread-14::DEBUG::2014-07-10 08:52:14,627::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [563b5108] >Thread-14::DEBUG::2014-07-10 08:52:14,628::task::595::TaskManager.Task::(_updateState) Task=`01bfe776-d74d-42d6-8cfb-44d7a07d97a2`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 08:52:14,628::logUtils::44::dispatcher::(wrapper) Run and protect: getStorageDomainInfo(sdUUID='6a70504d-00df-4869-8695-0f442053f6b6', options=None) >Thread-14::INFO::2014-07-10 08:52:14,629::fileSD::350::Storage.StorageDomain::(validate) sdUUID=6a70504d-00df-4869-8695-0f442053f6b6 >Thread-14::DEBUG::2014-07-10 08:52:14,632::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Backup', 'DESCRIPTION=test', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=0', 'POOL_UUID=', 'REMOTE_PATH=lion.qa.lab.tlv.redhat.com:/export/yuri2/backup2', 'ROLE=Regular', 'SDUUID=6a70504d-00df-4869-8695-0f442053f6b6', 'TYPE=NFS', 'VERSION=0', '_SHA_CKSUM=25fcf6f5195d1012468ec6c2844cb2ea77f111c8'] >Thread-14::DEBUG::2014-07-10 08:52:14,633::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.6a70504d-00df-4869-8695-0f442053f6b6`ReqID=`43b10e76-1ef1-4192-b2e4-744fe93945fe`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2768' at 'getStorageDomainInfo' >Thread-14::DEBUG::2014-07-10 08:52:14,633::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.6a70504d-00df-4869-8695-0f442053f6b6' for lock type 'shared' >Thread-14::DEBUG::2014-07-10 08:52:14,634::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.6a70504d-00df-4869-8695-0f442053f6b6' is free. Now locking as 'shared' (1 active user) >Thread-14::DEBUG::2014-07-10 08:52:14,634::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.6a70504d-00df-4869-8695-0f442053f6b6`ReqID=`43b10e76-1ef1-4192-b2e4-744fe93945fe`::Granted request >Thread-14::DEBUG::2014-07-10 08:52:14,634::task::827::TaskManager.Task::(resourceAcquired) Task=`01bfe776-d74d-42d6-8cfb-44d7a07d97a2`::_resourcesAcquired: Storage.6a70504d-00df-4869-8695-0f442053f6b6 (shared) >Thread-14::DEBUG::2014-07-10 08:52:14,635::task::990::TaskManager.Task::(_decref) Task=`01bfe776-d74d-42d6-8cfb-44d7a07d97a2`::ref 1 aborting False >Thread-14::INFO::2014-07-10 08:52:14,659::logUtils::47::dispatcher::(wrapper) Run and protect: getStorageDomainInfo, Return response: {'info': {'uuid': '6a70504d-00df-4869-8695-0f442053f6b6', 'version': '0', 'role': 'Regular', 'remotePath': 'lion.qa.lab.tlv.redhat.com:/export/yuri2/backup2', 'type': 'NFS', 'class': 'Backup', 'pool': [], 'name': 'test'}} >Thread-14::DEBUG::2014-07-10 08:52:14,659::task::1185::TaskManager.Task::(prepare) Task=`01bfe776-d74d-42d6-8cfb-44d7a07d97a2`::finished: {'info': {'uuid': '6a70504d-00df-4869-8695-0f442053f6b6', 'version': '0', 'role': 'Regular', 'remotePath': 'lion.qa.lab.tlv.redhat.com:/export/yuri2/backup2', 'type': 'NFS', 'class': 'Backup', 'pool': [], 'name': 'test'}} >Thread-14::DEBUG::2014-07-10 08:52:14,660::task::595::TaskManager.Task::(_updateState) Task=`01bfe776-d74d-42d6-8cfb-44d7a07d97a2`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 08:52:14,660::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.6a70504d-00df-4869-8695-0f442053f6b6': < ResourceRef 'Storage.6a70504d-00df-4869-8695-0f442053f6b6', isValid: 'True' obj: 'None'>} >Thread-14::DEBUG::2014-07-10 08:52:14,660::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 08:52:14,660::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.6a70504d-00df-4869-8695-0f442053f6b6' >Thread-14::DEBUG::2014-07-10 08:52:14,661::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.6a70504d-00df-4869-8695-0f442053f6b6' (0 active users) >Thread-14::DEBUG::2014-07-10 08:52:14,661::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.6a70504d-00df-4869-8695-0f442053f6b6' is free, finding out if anyone is waiting for it. >Thread-14::DEBUG::2014-07-10 08:52:14,661::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.6a70504d-00df-4869-8695-0f442053f6b6', Clearing records. >Thread-14::DEBUG::2014-07-10 08:52:14,661::task::990::TaskManager.Task::(_decref) Task=`01bfe776-d74d-42d6-8cfb-44d7a07d97a2`::ref 0 aborting False >Thread-14::DEBUG::2014-07-10 08:52:14,729::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [563b5108] >Thread-14::DEBUG::2014-07-10 08:52:14,729::task::595::TaskManager.Task::(_updateState) Task=`872737db-39e3-40b4-b23a-1a95af7adead`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 08:52:14,729::logUtils::44::dispatcher::(wrapper) Run and protect: getStorageDomainStats(sdUUID='6a70504d-00df-4869-8695-0f442053f6b6', options=None) >Thread-14::DEBUG::2014-07-10 08:52:14,730::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.6a70504d-00df-4869-8695-0f442053f6b6`ReqID=`67be509e-6093-40e0-92da-4f1a5c132266`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2786' at 'getStorageDomainStats' >Thread-14::DEBUG::2014-07-10 08:52:14,730::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.6a70504d-00df-4869-8695-0f442053f6b6' for lock type 'shared' >Thread-14::DEBUG::2014-07-10 08:52:14,730::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.6a70504d-00df-4869-8695-0f442053f6b6' is free. Now locking as 'shared' (1 active user) >Thread-14::DEBUG::2014-07-10 08:52:14,731::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.6a70504d-00df-4869-8695-0f442053f6b6`ReqID=`67be509e-6093-40e0-92da-4f1a5c132266`::Granted request >Thread-14::DEBUG::2014-07-10 08:52:14,731::task::827::TaskManager.Task::(resourceAcquired) Task=`872737db-39e3-40b4-b23a-1a95af7adead`::_resourcesAcquired: Storage.6a70504d-00df-4869-8695-0f442053f6b6 (shared) >Thread-14::DEBUG::2014-07-10 08:52:14,731::task::990::TaskManager.Task::(_decref) Task=`872737db-39e3-40b4-b23a-1a95af7adead`::ref 1 aborting False >Thread-14::INFO::2014-07-10 08:52:14,732::logUtils::47::dispatcher::(wrapper) Run and protect: getStorageDomainStats, Return response: {'stats': {'mdasize': 0, 'mdathreshold': True, 'mdavalid': True, 'diskfree': '532069482496', 'disktotal': '1056894353408', 'mdafree': 0}} >Thread-14::DEBUG::2014-07-10 08:52:14,732::task::1185::TaskManager.Task::(prepare) Task=`872737db-39e3-40b4-b23a-1a95af7adead`::finished: {'stats': {'mdasize': 0, 'mdathreshold': True, 'mdavalid': True, 'diskfree': '532069482496', 'disktotal': '1056894353408', 'mdafree': 0}} >Thread-14::DEBUG::2014-07-10 08:52:14,733::task::595::TaskManager.Task::(_updateState) Task=`872737db-39e3-40b4-b23a-1a95af7adead`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 08:52:14,733::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.6a70504d-00df-4869-8695-0f442053f6b6': < ResourceRef 'Storage.6a70504d-00df-4869-8695-0f442053f6b6', isValid: 'True' obj: 'None'>} >Thread-14::DEBUG::2014-07-10 08:52:14,733::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 08:52:14,733::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.6a70504d-00df-4869-8695-0f442053f6b6' >Thread-14::DEBUG::2014-07-10 08:52:14,734::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.6a70504d-00df-4869-8695-0f442053f6b6' (0 active users) >Thread-14::DEBUG::2014-07-10 08:52:14,734::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.6a70504d-00df-4869-8695-0f442053f6b6' is free, finding out if anyone is waiting for it. >Thread-14::DEBUG::2014-07-10 08:52:14,734::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.6a70504d-00df-4869-8695-0f442053f6b6', Clearing records. >Thread-14::DEBUG::2014-07-10 08:52:14,734::task::990::TaskManager.Task::(_decref) Task=`872737db-39e3-40b4-b23a-1a95af7adead`::ref 0 aborting False >Thread-14::DEBUG::2014-07-10 08:52:14,974::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [3751b29f] >Thread-14::DEBUG::2014-07-10 08:52:14,975::task::595::TaskManager.Task::(_updateState) Task=`f337254a-998d-4fc6-b51b-c06164046d80`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 08:52:14,975::logUtils::44::dispatcher::(wrapper) Run and protect: connectStorageServer(domType=1, spUUID='00000000-0000-0000-0000-000000000000', conList=[{'connection': 'lion.qa.lab.tlv.redhat.com:/export/yuri2/backup2', 'iqn': '', 'user': '', 'tpgt': '1', 'password': '******', 'id': '5da3014e-7fe6-4801-9d78-fc9de864301c', 'port': ''}], options=None) >Thread-14::DEBUG::2014-07-10 08:52:14,999::hsm::2328::Storage.HSM::(__prefetchDomains) nfs local path: /rhev/data-center/mnt/lion.qa.lab.tlv.redhat.com:_export_yuri2_backup2 >Thread-14::DEBUG::2014-07-10 08:52:15,000::hsm::2352::Storage.HSM::(__prefetchDomains) Found SD uuids: ('f34d0693-3747-467e-9a7c-8d73e8fb1171', 'cb15e53b-995b-47d6-b132-0ad9d148269e', '41530dea-409a-4a3d-ad8a-6f714a9b5986', '6a70504d-00df-4869-8695-0f442053f6b6', '33100657-451b-45f5-9a71-9fed8490e696') >Thread-14::DEBUG::2014-07-10 08:52:15,001::hsm::2408::Storage.HSM::(connectStorageServer) knownSDs: {f34d0693-3747-467e-9a7c-8d73e8fb1171: storage.nfsSD.findDomain, 33100657-451b-45f5-9a71-9fed8490e696: storage.nfsSD.findDomain, 41530dea-409a-4a3d-ad8a-6f714a9b5986: storage.nfsSD.findDomain, 9e1aa540-1f4e-4ee3-a152-be381ef6c3bd: storage.blockSD.findDomain, 6a70504d-00df-4869-8695-0f442053f6b6: storage.nfsSD.findDomain, cb15e53b-995b-47d6-b132-0ad9d148269e: storage.nfsSD.findDomain} >Thread-14::INFO::2014-07-10 08:52:15,001::logUtils::47::dispatcher::(wrapper) Run and protect: connectStorageServer, Return response: {'statuslist': [{'status': 0, 'id': '5da3014e-7fe6-4801-9d78-fc9de864301c'}]} >Thread-14::DEBUG::2014-07-10 08:52:15,001::task::1185::TaskManager.Task::(prepare) Task=`f337254a-998d-4fc6-b51b-c06164046d80`::finished: {'statuslist': [{'status': 0, 'id': '5da3014e-7fe6-4801-9d78-fc9de864301c'}]} >Thread-14::DEBUG::2014-07-10 08:52:15,001::task::595::TaskManager.Task::(_updateState) Task=`f337254a-998d-4fc6-b51b-c06164046d80`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 08:52:15,001::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 08:52:15,002::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 08:52:15,002::task::990::TaskManager.Task::(_decref) Task=`f337254a-998d-4fc6-b51b-c06164046d80`::ref 0 aborting False >Thread-34::DEBUG::2014-07-10 08:52:15,007::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [5943a7e3] >Thread-34::DEBUG::2014-07-10 08:52:15,007::task::595::TaskManager.Task::(_updateState) Task=`602a98e1-6b2b-4133-8e56-22d4a2c31ecc`::moving from state init -> state preparing >Thread-34::INFO::2014-07-10 08:52:15,007::logUtils::44::dispatcher::(wrapper) Run and protect: attachStorageDomain(sdUUID='6a70504d-00df-4869-8695-0f442053f6b6', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-34::DEBUG::2014-07-10 08:52:15,008::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`c2aca746-c591-4755-b439-720ea6289751`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '1197' at 'attachStorageDomain' >Thread-34::DEBUG::2014-07-10 08:52:15,008::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' for lock type 'exclusive' >Thread-34::DEBUG::2014-07-10 08:52:15,008::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free. Now locking as 'exclusive' (1 active user) >Thread-34::DEBUG::2014-07-10 08:52:15,008::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`c2aca746-c591-4755-b439-720ea6289751`::Granted request >Thread-34::DEBUG::2014-07-10 08:52:15,009::task::827::TaskManager.Task::(resourceAcquired) Task=`602a98e1-6b2b-4133-8e56-22d4a2c31ecc`::_resourcesAcquired: Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee (exclusive) >Thread-34::DEBUG::2014-07-10 08:52:15,009::task::990::TaskManager.Task::(_decref) Task=`602a98e1-6b2b-4133-8e56-22d4a2c31ecc`::ref 1 aborting False >Thread-34::DEBUG::2014-07-10 08:52:15,010::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.6a70504d-00df-4869-8695-0f442053f6b6`ReqID=`828c0a6e-cc12-4410-810e-5548fabaddcd`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '1198' at 'attachStorageDomain' >Thread-34::DEBUG::2014-07-10 08:52:15,010::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.6a70504d-00df-4869-8695-0f442053f6b6' for lock type 'exclusive' >Thread-34::DEBUG::2014-07-10 08:52:15,010::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.6a70504d-00df-4869-8695-0f442053f6b6' is free. Now locking as 'exclusive' (1 active user) >Thread-34::DEBUG::2014-07-10 08:52:15,010::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.6a70504d-00df-4869-8695-0f442053f6b6`ReqID=`828c0a6e-cc12-4410-810e-5548fabaddcd`::Granted request >Thread-34::DEBUG::2014-07-10 08:52:15,010::task::827::TaskManager.Task::(resourceAcquired) Task=`602a98e1-6b2b-4133-8e56-22d4a2c31ecc`::_resourcesAcquired: Storage.6a70504d-00df-4869-8695-0f442053f6b6 (exclusive) >Thread-34::DEBUG::2014-07-10 08:52:15,011::task::990::TaskManager.Task::(_decref) Task=`602a98e1-6b2b-4133-8e56-22d4a2c31ecc`::ref 1 aborting False >Thread-34::INFO::2014-07-10 08:52:15,011::sp::869::Storage.StoragePool::(attachSD) sdUUID=6a70504d-00df-4869-8695-0f442053f6b6 spUUID=4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee >Thread-34::DEBUG::2014-07-10 08:52:15,012::misc::756::SamplingMethod::(__call__) Trying to enter sampling method (storage.sdc.refreshStorage) >Thread-34::DEBUG::2014-07-10 08:52:15,012::misc::758::SamplingMethod::(__call__) Got in to sampling method >Thread-34::DEBUG::2014-07-10 08:52:15,012::misc::756::SamplingMethod::(__call__) Trying to enter sampling method (storage.iscsi.rescan) >Thread-34::DEBUG::2014-07-10 08:52:15,012::misc::758::SamplingMethod::(__call__) Got in to sampling method >Thread-34::DEBUG::2014-07-10 08:52:15,012::iscsi::407::Storage.ISCSI::(rescan) Performing SCSI scan, this will take up to 30 seconds >Thread-34::DEBUG::2014-07-10 08:52:15,013::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) '/usr/bin/sudo -n /sbin/iscsiadm -m session -R' (cwd None) >Dummy-33::DEBUG::2014-07-10 08:52:15,038::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Thread-34::DEBUG::2014-07-10 08:52:15,055::misc::766::SamplingMethod::(__call__) Returning last result >Thread-34::DEBUG::2014-07-10 08:52:15,058::multipath::109::Storage.Misc.excCmd::(rescan) '/usr/bin/sudo -n /sbin/multipath' (cwd None) >Thread-34::DEBUG::2014-07-10 08:52:15,140::multipath::109::Storage.Misc.excCmd::(rescan) SUCCESS: <err> = ''; <rc> = 0 >Thread-34::DEBUG::2014-07-10 08:52:15,148::lvm::497::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-34::DEBUG::2014-07-10 08:52:15,153::lvm::499::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-34::DEBUG::2014-07-10 08:52:15,168::lvm::508::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-34::DEBUG::2014-07-10 08:52:15,180::lvm::510::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-34::DEBUG::2014-07-10 08:52:15,184::lvm::528::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-34::DEBUG::2014-07-10 08:52:15,188::lvm::530::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-34::DEBUG::2014-07-10 08:52:15,191::misc::766::SamplingMethod::(__call__) Returning last result >Thread-34::DEBUG::2014-07-10 08:52:15,494::fileSD::150::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/lion.qa.lab.tlv.redhat.com:_export_yuri2_backup2/6a70504d-00df-4869-8695-0f442053f6b6 >Thread-34::DEBUG::2014-07-10 08:52:15,501::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend >Thread-34::DEBUG::2014-07-10 08:52:15,511::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Backup', 'DESCRIPTION=test', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=0', 'POOL_UUID=', 'REMOTE_PATH=lion.qa.lab.tlv.redhat.com:/export/yuri2/backup2', 'ROLE=Regular', 'SDUUID=6a70504d-00df-4869-8695-0f442053f6b6', 'TYPE=NFS', 'VERSION=0', '_SHA_CKSUM=25fcf6f5195d1012468ec6c2844cb2ea77f111c8'] >Thread-34::DEBUG::2014-07-10 08:52:15,523::fileSD::609::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images [] >Thread-34::INFO::2014-07-10 08:52:15,524::sd::384::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 6a70504d-00df-4869-8695-0f442053f6b6_imageNS already registered >Thread-34::INFO::2014-07-10 08:52:15,526::sd::392::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 6a70504d-00df-4869-8695-0f442053f6b6_volumeNS already registered >Thread-34::DEBUG::2014-07-10 08:52:15,530::clusterlock::86::SafeLease::(acquireHostId) Host id for domain 6a70504d-00df-4869-8695-0f442053f6b6 successfully acquired (id: 1) >Thread-34::DEBUG::2014-07-10 08:52:15,534::clusterlock::100::SafeLease::(acquire) Acquiring cluster lock for domain 6a70504d-00df-4869-8695-0f442053f6b6 >Thread-34::DEBUG::2014-07-10 08:52:15,543::clusterlock::114::Storage.Misc.excCmd::(acquire) '/usr/bin/sudo -n /usr/bin/setsid /usr/bin/ionice -c 1 -n 0 /bin/su vdsm -s /bin/sh -c "/usr/libexec/vdsm/spmprotect.sh start 6a70504d-00df-4869-8695-0f442053f6b6 1 5 /rhev/data-center/mnt/lion.qa.lab.tlv.redhat.com:_export_yuri2_backup2/6a70504d-00df-4869-8695-0f442053f6b6/dom_md/leases 60000 10000 3"' (cwd /usr/libexec/vdsm) >Dummy-33::DEBUG::2014-07-10 08:52:15,582::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.148776 s, 6.9 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 08:52:17,597::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 08:52:17,672::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0258935 s, 39.5 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 08:52:19,687::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 08:52:19,773::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0361017 s, 28.4 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-10 08:52:21,190::lvm::373::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-18::DEBUG::2014-07-10 08:52:21,193::lvm::296::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/3600601601282300032826addbbdae311|/dev/mapper/360060160f4a030003840ec867ddee311|/dev/mapper/367cad74c2fcba00019e6afd20c781e67|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name 9e1aa540-1f4e-4ee3-a152-be381ef6c3bd' (cwd None) >Thread-18::DEBUG::2014-07-10 08:52:21,435::lvm::296::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-18::DEBUG::2014-07-10 08:52:21,437::lvm::415::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-18::DEBUG::2014-07-10 08:52:21,438::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/metadata bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-10 08:52:21,450::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000569419 s, 7.2 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 08:52:21,788::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 08:52:21,879::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0352739 s, 29.0 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 08:52:23,784::task::595::TaskManager.Task::(_updateState) Task=`38b89126-c532-4f2a-918d-06a48605dcb7`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 08:52:23,785::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::INFO::2014-07-10 08:52:23,785::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000569419', 'lastCheck': '2.3', 'valid': True}} >Thread-14::DEBUG::2014-07-10 08:52:23,785::task::1185::TaskManager.Task::(prepare) Task=`38b89126-c532-4f2a-918d-06a48605dcb7`::finished: {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000569419', 'lastCheck': '2.3', 'valid': True}} >Thread-14::DEBUG::2014-07-10 08:52:23,785::task::595::TaskManager.Task::(_updateState) Task=`38b89126-c532-4f2a-918d-06a48605dcb7`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 08:52:23,786::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 08:52:23,786::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 08:52:23,786::task::990::TaskManager.Task::(_decref) Task=`38b89126-c532-4f2a-918d-06a48605dcb7`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 08:52:23,895::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 08:52:23,977::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0329027 s, 31.1 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 08:52:25,992::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 08:52:26,072::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0315042 s, 32.5 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 08:52:28,087::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 08:52:28,167::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0305065 s, 33.6 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 08:52:30,182::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 08:52:30,262::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0301958 s, 33.9 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-10 08:52:31,478::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/metadata bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-10 08:52:31,491::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000640281 s, 6.4 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 08:52:32,277::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 08:52:32,358::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0300474 s, 34.1 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 08:52:34,373::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 08:52:34,459::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0357289 s, 28.7 MB/s\n'; <rc> = 0 >Thread-34::DEBUG::2014-07-10 08:52:35,624::clusterlock::114::Storage.Misc.excCmd::(acquire) SUCCESS: <err> = ''; <rc> = 0 >Thread-34::DEBUG::2014-07-10 08:52:35,625::clusterlock::117::SafeLease::(acquire) Clustered lock acquired successfully >Thread-34::DEBUG::2014-07-10 08:52:35,632::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Backup', 'DESCRIPTION=test', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=0', 'POOL_UUID=', 'REMOTE_PATH=lion.qa.lab.tlv.redhat.com:/export/yuri2/backup2', 'ROLE=Regular', 'SDUUID=6a70504d-00df-4869-8695-0f442053f6b6', 'TYPE=NFS', 'VERSION=0', '_SHA_CKSUM=25fcf6f5195d1012468ec6c2844cb2ea77f111c8'] >Thread-34::DEBUG::2014-07-10 08:52:35,633::persistentDict::167::Storage.PersistentDict::(transaction) Starting transaction >Thread-34::DEBUG::2014-07-10 08:52:35,634::persistentDict::173::Storage.PersistentDict::(transaction) Flushing changes >Thread-34::DEBUG::2014-07-10 08:52:35,634::persistentDict::299::Storage.PersistentDict::(flush) about to write lines (FileMetadataRW)=['CLASS=Backup', 'DESCRIPTION=test', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=0', 'POOL_UUID=4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', 'REMOTE_PATH=lion.qa.lab.tlv.redhat.com:/export/yuri2/backup2', 'ROLE=Regular', 'SDUUID=6a70504d-00df-4869-8695-0f442053f6b6', 'TYPE=NFS', 'VERSION=0', '_SHA_CKSUM=aab6b8e901ec435cd5f9de3c9e3f8b45dca569e0'] >Thread-34::DEBUG::2014-07-10 08:52:35,637::persistentDict::175::Storage.PersistentDict::(transaction) Finished transaction >Thread-34::DEBUG::2014-07-10 08:52:35,638::persistentDict::167::Storage.PersistentDict::(transaction) Starting transaction >Thread-34::DEBUG::2014-07-10 08:52:35,638::persistentDict::173::Storage.PersistentDict::(transaction) Flushing changes >Thread-34::DEBUG::2014-07-10 08:52:35,638::persistentDict::299::Storage.PersistentDict::(flush) about to write lines (VGTagMetadataRW)=['CLASS=Data', 'DESCRIPTION=SD_REAL', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'LOGBLKSIZE=512', 'MASTER_VERSION=1', 'PHYBLKSIZE=512', 'POOL_DESCRIPTION=DC_REAL', 'POOL_DOMAINS=9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Attached', 'POOL_SPM_ID=1', 'POOL_SPM_LVER=0', 'POOL_UUID=4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', u'PV0=pv:3600601601282300032826addbbdae311,uuid:7qEb8v-jk2X-3CPk-k4XB-eIBk-onYD-807hcV,pestart:0,pecount:8189,mapoffset:0', 'ROLE=Master', 'SDUUID=9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'TYPE=ISCSI', 'VERSION=3', 'VGUUID=9CsMxb-YbRc-yRG7-cQKD-xY3G-GLi5-YxUyPC', '_SHA_CKSUM=93948d8c722ad3f834746df1d58a0c2dcd331e54'] >Thread-34::DEBUG::2014-07-10 08:52:35,639::lvm::503::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-34::DEBUG::2014-07-10 08:52:35,639::lvm::505::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-34::DEBUG::2014-07-10 08:52:35,639::lvm::513::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-34::DEBUG::2014-07-10 08:52:35,640::lvm::525::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-34::DEBUG::2014-07-10 08:52:35,640::lvm::373::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-34::DEBUG::2014-07-10 08:52:35,641::lvm::296::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/3600601601282300032826addbbdae311|/dev/mapper/360060160f4a030003840ec867ddee311|/dev/mapper/367cad74c2fcba00019e6afd20c781e67|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name 9e1aa540-1f4e-4ee3-a152-be381ef6c3bd' (cwd None) >Thread-34::DEBUG::2014-07-10 08:52:35,885::lvm::296::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-34::DEBUG::2014-07-10 08:52:35,887::lvm::415::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-34::DEBUG::2014-07-10 08:52:35,887::blockSD::315::storage.Metadata.VGTagMetadataRW::(writelines) Updating metadata adding=MDT__SHA_CKSUM=93948d8c722ad3f834746df1d58a0c2dcd331e54, MDT_POOL_DOMAINS=9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active&44&6a70504d-00df-4869-8695-0f442053f6b6:Attached removing=MDT__SHA_CKSUM=9900f699e87d637c24122a843274e33fe5b7e52b, MDT_POOL_DOMAINS=9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active >Thread-34::DEBUG::2014-07-10 08:52:35,888::lvm::296::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgchange --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/3600601601282300032826addbbdae311|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } " --deltag MDT__SHA_CKSUM=9900f699e87d637c24122a843274e33fe5b7e52b --deltag MDT_POOL_DOMAINS=9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active --addtag MDT_POOL_DOMAINS=9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active&44&6a70504d-00df-4869-8695-0f442053f6b6:Attached --addtag MDT__SHA_CKSUM=93948d8c722ad3f834746df1d58a0c2dcd331e54 9e1aa540-1f4e-4ee3-a152-be381ef6c3bd' (cwd None) >Thread-34::DEBUG::2014-07-10 08:52:36,093::lvm::296::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-34::DEBUG::2014-07-10 08:52:36,094::lvm::503::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-34::DEBUG::2014-07-10 08:52:36,094::lvm::505::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-34::DEBUG::2014-07-10 08:52:36,095::persistentDict::175::Storage.PersistentDict::(transaction) Finished transaction >Thread-34::INFO::2014-07-10 08:52:36,095::sp::1113::Storage.StoragePool::(_linkStorageDomain) Linking /rhev/data-center/mnt/lion.qa.lab.tlv.redhat.com:_export_yuri2_backup2/6a70504d-00df-4869-8695-0f442053f6b6 to /rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/6a70504d-00df-4869-8695-0f442053f6b6 >Thread-34::INFO::2014-07-10 08:52:36,096::clusterlock::130::SafeLease::(release) Releasing cluster lock for domain 6a70504d-00df-4869-8695-0f442053f6b6 >Thread-34::DEBUG::2014-07-10 08:52:36,096::clusterlock::132::Storage.Misc.excCmd::(release) '/usr/libexec/vdsm/spmstop.sh 6a70504d-00df-4869-8695-0f442053f6b6' (cwd /usr/libexec/vdsm) >Dummy-33::DEBUG::2014-07-10 08:52:36,474::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 08:52:36,562::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0360723 s, 28.4 MB/s\n'; <rc> = 0 >Thread-34::DEBUG::2014-07-10 08:52:37,239::clusterlock::132::Storage.Misc.excCmd::(release) SUCCESS: <err> = ''; <rc> = 0 >Thread-34::DEBUG::2014-07-10 08:52:37,240::clusterlock::137::SafeLease::(release) Cluster lock released successfully >Thread-34::DEBUG::2014-07-10 08:52:37,251::clusterlock::90::SafeLease::(releaseHostId) Host id for domain 6a70504d-00df-4869-8695-0f442053f6b6 released successfully (id: 1) >Thread-34::DEBUG::2014-07-10 08:52:37,251::misc::756::SamplingMethod::(__call__) Trying to enter sampling method (storage.sp.updateMonitoringThreads) >Thread-34::DEBUG::2014-07-10 08:52:37,251::misc::758::SamplingMethod::(__call__) Got in to sampling method >Thread-34::DEBUG::2014-07-10 08:52:37,252::misc::766::SamplingMethod::(__call__) Returning last result >Thread-34::INFO::2014-07-10 08:52:37,252::logUtils::47::dispatcher::(wrapper) Run and protect: attachStorageDomain, Return response: None >Thread-34::DEBUG::2014-07-10 08:52:37,252::task::1185::TaskManager.Task::(prepare) Task=`602a98e1-6b2b-4133-8e56-22d4a2c31ecc`::finished: None >Thread-34::DEBUG::2014-07-10 08:52:37,253::task::595::TaskManager.Task::(_updateState) Task=`602a98e1-6b2b-4133-8e56-22d4a2c31ecc`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-10 08:52:37,253::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.6a70504d-00df-4869-8695-0f442053f6b6': < ResourceRef 'Storage.6a70504d-00df-4869-8695-0f442053f6b6', isValid: 'True' obj: 'None'>, 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee': < ResourceRef 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-10 08:52:37,253::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-10 08:52:37,254::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.6a70504d-00df-4869-8695-0f442053f6b6' >Thread-34::DEBUG::2014-07-10 08:52:37,254::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.6a70504d-00df-4869-8695-0f442053f6b6' (0 active users) >Thread-34::DEBUG::2014-07-10 08:52:37,254::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.6a70504d-00df-4869-8695-0f442053f6b6' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-10 08:52:37,254::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.6a70504d-00df-4869-8695-0f442053f6b6', Clearing records. >Thread-34::DEBUG::2014-07-10 08:52:37,255::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' >Thread-34::DEBUG::2014-07-10 08:52:37,255::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' (0 active users) >Thread-34::DEBUG::2014-07-10 08:52:37,255::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-10 08:52:37,255::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', Clearing records. >Thread-34::DEBUG::2014-07-10 08:52:37,255::task::990::TaskManager.Task::(_decref) Task=`602a98e1-6b2b-4133-8e56-22d4a2c31ecc`::ref 0 aborting False >Thread-14::DEBUG::2014-07-10 08:52:37,262::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-14::DEBUG::2014-07-10 08:52:37,263::task::595::TaskManager.Task::(_updateState) Task=`1f61a4bf-9235-4364-9549-f45a7736d265`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 08:52:37,263::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-14::INFO::2014-07-10 08:52:37,263::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 08:52:37,264::task::1185::TaskManager.Task::(prepare) Task=`1f61a4bf-9235-4364-9549-f45a7736d265`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 08:52:37,264::task::595::TaskManager.Task::(_updateState) Task=`1f61a4bf-9235-4364-9549-f45a7736d265`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 08:52:37,264::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 08:52:37,264::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 08:52:37,264::task::990::TaskManager.Task::(_decref) Task=`1f61a4bf-9235-4364-9549-f45a7736d265`::ref 0 aborting False >Thread-34::DEBUG::2014-07-10 08:52:37,269::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-34::DEBUG::2014-07-10 08:52:37,269::task::595::TaskManager.Task::(_updateState) Task=`73255833-07fb-4d0c-8496-18131ca39230`::moving from state init -> state preparing >Thread-34::INFO::2014-07-10 08:52:37,269::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-34::DEBUG::2014-07-10 08:52:37,270::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`ca7218a8-8d00-4a4c-b8e3-0b63c19ca19c`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-10 08:52:37,270::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' for lock type 'shared' >Thread-34::DEBUG::2014-07-10 08:52:37,270::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-10 08:52:37,270::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`ca7218a8-8d00-4a4c-b8e3-0b63c19ca19c`::Granted request >Thread-34::DEBUG::2014-07-10 08:52:37,271::task::827::TaskManager.Task::(resourceAcquired) Task=`73255833-07fb-4d0c-8496-18131ca39230`::_resourcesAcquired: Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee (shared) >Thread-34::DEBUG::2014-07-10 08:52:37,271::task::990::TaskManager.Task::(_decref) Task=`73255833-07fb-4d0c-8496-18131ca39230`::ref 1 aborting False >Thread-34::DEBUG::2014-07-10 08:52:37,272::lvm::373::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-34::DEBUG::2014-07-10 08:52:37,272::lvm::296::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/3600601601282300032826addbbdae311|/dev/mapper/360060160f4a030003840ec867ddee311|/dev/mapper/367cad74c2fcba00019e6afd20c781e67|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name 9e1aa540-1f4e-4ee3-a152-be381ef6c3bd' (cwd None) >Thread-14::DEBUG::2014-07-10 08:52:37,312::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [254d58b3] >Thread-14::DEBUG::2014-07-10 08:52:37,314::task::595::TaskManager.Task::(_updateState) Task=`b517e5d6-782e-47b7-9f45-a59f3e692eeb`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 08:52:37,314::logUtils::44::dispatcher::(wrapper) Run and protect: connectStorageServer(domType=1, spUUID='00000000-0000-0000-0000-000000000000', conList=[{'connection': 'lion.qa.lab.tlv.redhat.com:/export/yuri2/backup2', 'iqn': '', 'user': '', 'tpgt': '1', 'password': '******', 'id': '5da3014e-7fe6-4801-9d78-fc9de864301c', 'port': ''}], options=None) >Thread-14::DEBUG::2014-07-10 08:52:37,396::hsm::2328::Storage.HSM::(__prefetchDomains) nfs local path: /rhev/data-center/mnt/lion.qa.lab.tlv.redhat.com:_export_yuri2_backup2 >Thread-14::DEBUG::2014-07-10 08:52:37,398::hsm::2352::Storage.HSM::(__prefetchDomains) Found SD uuids: ('f34d0693-3747-467e-9a7c-8d73e8fb1171', 'cb15e53b-995b-47d6-b132-0ad9d148269e', '41530dea-409a-4a3d-ad8a-6f714a9b5986', '6a70504d-00df-4869-8695-0f442053f6b6', '33100657-451b-45f5-9a71-9fed8490e696') >Thread-14::DEBUG::2014-07-10 08:52:37,398::hsm::2408::Storage.HSM::(connectStorageServer) knownSDs: {f34d0693-3747-467e-9a7c-8d73e8fb1171: storage.nfsSD.findDomain, 33100657-451b-45f5-9a71-9fed8490e696: storage.nfsSD.findDomain, 41530dea-409a-4a3d-ad8a-6f714a9b5986: storage.nfsSD.findDomain, 9e1aa540-1f4e-4ee3-a152-be381ef6c3bd: storage.blockSD.findDomain, 6a70504d-00df-4869-8695-0f442053f6b6: storage.nfsSD.findDomain, cb15e53b-995b-47d6-b132-0ad9d148269e: storage.nfsSD.findDomain} >Thread-14::INFO::2014-07-10 08:52:37,399::logUtils::47::dispatcher::(wrapper) Run and protect: connectStorageServer, Return response: {'statuslist': [{'status': 0, 'id': '5da3014e-7fe6-4801-9d78-fc9de864301c'}]} >Thread-14::DEBUG::2014-07-10 08:52:37,399::task::1185::TaskManager.Task::(prepare) Task=`b517e5d6-782e-47b7-9f45-a59f3e692eeb`::finished: {'statuslist': [{'status': 0, 'id': '5da3014e-7fe6-4801-9d78-fc9de864301c'}]} >Thread-14::DEBUG::2014-07-10 08:52:37,401::task::595::TaskManager.Task::(_updateState) Task=`b517e5d6-782e-47b7-9f45-a59f3e692eeb`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 08:52:37,403::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 08:52:37,406::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 08:52:37,407::task::990::TaskManager.Task::(_decref) Task=`b517e5d6-782e-47b7-9f45-a59f3e692eeb`::ref 0 aborting False >Thread-34::DEBUG::2014-07-10 08:52:37,527::lvm::296::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-34::DEBUG::2014-07-10 08:52:37,529::lvm::415::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-34::INFO::2014-07-10 08:52:37,530::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Attached', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': 'Active', 'diskfree': '1094948225024', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, '6a70504d-00df-4869-8695-0f442053f6b6': {'status': 'Attached', 'isoprefix': '', 'alerts': []}}} >Thread-34::DEBUG::2014-07-10 08:52:37,530::task::1185::TaskManager.Task::(prepare) Task=`73255833-07fb-4d0c-8496-18131ca39230`::finished: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Attached', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': 'Active', 'diskfree': '1094948225024', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, '6a70504d-00df-4869-8695-0f442053f6b6': {'status': 'Attached', 'isoprefix': '', 'alerts': []}}} >Thread-34::DEBUG::2014-07-10 08:52:37,530::task::595::TaskManager.Task::(_updateState) Task=`73255833-07fb-4d0c-8496-18131ca39230`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-10 08:52:37,531::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee': < ResourceRef 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-10 08:52:37,531::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-10 08:52:37,531::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' >Thread-34::DEBUG::2014-07-10 08:52:37,532::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' (0 active users) >Thread-34::DEBUG::2014-07-10 08:52:37,532::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-10 08:52:37,532::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', Clearing records. >Thread-34::DEBUG::2014-07-10 08:52:37,532::task::990::TaskManager.Task::(_decref) Task=`73255833-07fb-4d0c-8496-18131ca39230`::ref 0 aborting False >Thread-34::DEBUG::2014-07-10 08:52:37,544::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [30baeeea] >Thread-34::DEBUG::2014-07-10 08:52:37,544::task::595::TaskManager.Task::(_updateState) Task=`ffa36e9c-3fe6-442a-be1d-5c94a5d3bd1a`::moving from state init -> state preparing >Thread-34::INFO::2014-07-10 08:52:37,545::logUtils::44::dispatcher::(wrapper) Run and protect: activateStorageDomain(sdUUID='6a70504d-00df-4869-8695-0f442053f6b6', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-34::DEBUG::2014-07-10 08:52:37,545::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`779af886-5be0-41aa-8748-f9e0dd19aabd`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '1256' at 'activateStorageDomain' >Thread-34::DEBUG::2014-07-10 08:52:37,545::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' for lock type 'exclusive' >Thread-34::DEBUG::2014-07-10 08:52:37,546::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free. Now locking as 'exclusive' (1 active user) >Thread-34::DEBUG::2014-07-10 08:52:37,546::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`779af886-5be0-41aa-8748-f9e0dd19aabd`::Granted request >Thread-34::DEBUG::2014-07-10 08:52:37,546::task::827::TaskManager.Task::(resourceAcquired) Task=`ffa36e9c-3fe6-442a-be1d-5c94a5d3bd1a`::_resourcesAcquired: Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee (exclusive) >Thread-34::DEBUG::2014-07-10 08:52:37,547::task::990::TaskManager.Task::(_decref) Task=`ffa36e9c-3fe6-442a-be1d-5c94a5d3bd1a`::ref 1 aborting False >Thread-34::DEBUG::2014-07-10 08:52:37,547::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.6a70504d-00df-4869-8695-0f442053f6b6`ReqID=`ff498bfb-656f-4b7a-8cee-d1d6c6e24d4c`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '1257' at 'activateStorageDomain' >Thread-34::DEBUG::2014-07-10 08:52:37,547::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.6a70504d-00df-4869-8695-0f442053f6b6' for lock type 'exclusive' >Thread-34::DEBUG::2014-07-10 08:52:37,547::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.6a70504d-00df-4869-8695-0f442053f6b6' is free. Now locking as 'exclusive' (1 active user) >Thread-34::DEBUG::2014-07-10 08:52:37,548::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.6a70504d-00df-4869-8695-0f442053f6b6`ReqID=`ff498bfb-656f-4b7a-8cee-d1d6c6e24d4c`::Granted request >Thread-34::DEBUG::2014-07-10 08:52:37,548::task::827::TaskManager.Task::(resourceAcquired) Task=`ffa36e9c-3fe6-442a-be1d-5c94a5d3bd1a`::_resourcesAcquired: Storage.6a70504d-00df-4869-8695-0f442053f6b6 (exclusive) >Thread-34::DEBUG::2014-07-10 08:52:37,548::task::990::TaskManager.Task::(_decref) Task=`ffa36e9c-3fe6-442a-be1d-5c94a5d3bd1a`::ref 1 aborting False >Thread-34::INFO::2014-07-10 08:52:37,548::sp::1024::Storage.StoragePool::(activateSD) sdUUID=6a70504d-00df-4869-8695-0f442053f6b6 spUUID=4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee >Thread-34::DEBUG::2014-07-10 08:52:37,549::misc::756::SamplingMethod::(__call__) Trying to enter sampling method (storage.sdc.refreshStorage) >Thread-34::DEBUG::2014-07-10 08:52:37,549::misc::758::SamplingMethod::(__call__) Got in to sampling method >Thread-34::DEBUG::2014-07-10 08:52:37,549::misc::756::SamplingMethod::(__call__) Trying to enter sampling method (storage.iscsi.rescan) >Thread-34::DEBUG::2014-07-10 08:52:37,549::misc::758::SamplingMethod::(__call__) Got in to sampling method >Thread-34::DEBUG::2014-07-10 08:52:37,549::iscsi::407::Storage.ISCSI::(rescan) Performing SCSI scan, this will take up to 30 seconds >Thread-34::DEBUG::2014-07-10 08:52:37,550::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) '/usr/bin/sudo -n /sbin/iscsiadm -m session -R' (cwd None) >Thread-34::DEBUG::2014-07-10 08:52:37,581::misc::766::SamplingMethod::(__call__) Returning last result >Thread-34::DEBUG::2014-07-10 08:52:37,582::multipath::109::Storage.Misc.excCmd::(rescan) '/usr/bin/sudo -n /sbin/multipath' (cwd None) >Thread-34::DEBUG::2014-07-10 08:52:37,656::multipath::109::Storage.Misc.excCmd::(rescan) SUCCESS: <err> = ''; <rc> = 0 >Thread-34::DEBUG::2014-07-10 08:52:37,657::lvm::497::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-34::DEBUG::2014-07-10 08:52:37,657::lvm::499::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-34::DEBUG::2014-07-10 08:52:37,657::lvm::508::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-34::DEBUG::2014-07-10 08:52:37,657::lvm::510::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-34::DEBUG::2014-07-10 08:52:37,658::lvm::528::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-34::DEBUG::2014-07-10 08:52:37,658::lvm::530::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-34::DEBUG::2014-07-10 08:52:37,658::misc::766::SamplingMethod::(__call__) Returning last result >Thread-34::DEBUG::2014-07-10 08:52:37,687::fileSD::150::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/lion.qa.lab.tlv.redhat.com:_export_yuri2_backup2/6a70504d-00df-4869-8695-0f442053f6b6 >Thread-34::DEBUG::2014-07-10 08:52:37,689::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend >Thread-34::DEBUG::2014-07-10 08:52:37,691::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Backup', 'DESCRIPTION=test', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=0', 'POOL_UUID=4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', 'REMOTE_PATH=lion.qa.lab.tlv.redhat.com:/export/yuri2/backup2', 'ROLE=Regular', 'SDUUID=6a70504d-00df-4869-8695-0f442053f6b6', 'TYPE=NFS', 'VERSION=0', '_SHA_CKSUM=aab6b8e901ec435cd5f9de3c9e3f8b45dca569e0'] >Thread-34::DEBUG::2014-07-10 08:52:37,693::fileSD::609::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images [] >Thread-34::INFO::2014-07-10 08:52:37,693::sd::384::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 6a70504d-00df-4869-8695-0f442053f6b6_imageNS already registered >Thread-34::INFO::2014-07-10 08:52:37,694::sd::392::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 6a70504d-00df-4869-8695-0f442053f6b6_volumeNS already registered >Thread-34::INFO::2014-07-10 08:52:37,694::sp::1113::Storage.StoragePool::(_linkStorageDomain) Linking /rhev/data-center/mnt/lion.qa.lab.tlv.redhat.com:_export_yuri2_backup2/6a70504d-00df-4869-8695-0f442053f6b6 to /rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/6a70504d-00df-4869-8695-0f442053f6b6 >Thread-34::DEBUG::2014-07-10 08:52:37,695::persistentDict::167::Storage.PersistentDict::(transaction) Starting transaction >Thread-34::DEBUG::2014-07-10 08:52:37,695::persistentDict::160::Storage.PersistentDict::(transaction) Reusing active transaction >Thread-34::DEBUG::2014-07-10 08:52:37,695::persistentDict::160::Storage.PersistentDict::(transaction) Reusing active transaction >Thread-34::DEBUG::2014-07-10 08:52:37,695::persistentDict::175::Storage.PersistentDict::(transaction) Finished transaction >Thread-34::DEBUG::2014-07-10 08:52:37,697::sd::633::Storage.StorageDomain::(createMasterTree) creating vms dir: /rhev/data-center/mnt/lion.qa.lab.tlv.redhat.com:_export_yuri2_backup2/6a70504d-00df-4869-8695-0f442053f6b6/master/vms >Thread-34::DEBUG::2014-07-10 08:52:37,698::sd::636::Storage.StorageDomain::(createMasterTree) creating task dir: /rhev/data-center/mnt/lion.qa.lab.tlv.redhat.com:_export_yuri2_backup2/6a70504d-00df-4869-8695-0f442053f6b6/master/tasks >Thread-34::DEBUG::2014-07-10 08:52:37,698::persistentDict::167::Storage.PersistentDict::(transaction) Starting transaction >Thread-34::DEBUG::2014-07-10 08:52:37,699::persistentDict::173::Storage.PersistentDict::(transaction) Flushing changes >Thread-34::DEBUG::2014-07-10 08:52:37,699::persistentDict::299::Storage.PersistentDict::(flush) about to write lines (VGTagMetadataRW)=['CLASS=Data', 'DESCRIPTION=SD_REAL', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'LOGBLKSIZE=512', 'MASTER_VERSION=1', 'PHYBLKSIZE=512', 'POOL_DESCRIPTION=DC_REAL', 'POOL_DOMAINS=9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'POOL_SPM_ID=1', 'POOL_SPM_LVER=0', 'POOL_UUID=4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', u'PV0=pv:3600601601282300032826addbbdae311,uuid:7qEb8v-jk2X-3CPk-k4XB-eIBk-onYD-807hcV,pestart:0,pecount:8189,mapoffset:0', 'ROLE=Master', 'SDUUID=9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'TYPE=ISCSI', 'VERSION=3', 'VGUUID=9CsMxb-YbRc-yRG7-cQKD-xY3G-GLi5-YxUyPC', '_SHA_CKSUM=013b5a7910962201c4cceab31b9c6d9c79f7316f'] >Thread-34::DEBUG::2014-07-10 08:52:37,699::lvm::503::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-34::DEBUG::2014-07-10 08:52:37,700::lvm::505::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-34::DEBUG::2014-07-10 08:52:37,700::lvm::513::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-34::DEBUG::2014-07-10 08:52:37,700::lvm::525::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-34::DEBUG::2014-07-10 08:52:37,700::lvm::373::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-34::DEBUG::2014-07-10 08:52:37,703::lvm::296::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/3600601601282300032826addbbdae311|/dev/mapper/360060160f4a030003840ec867ddee311|/dev/mapper/367cad74c2fcba00019e6afd20c781e67|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name 9e1aa540-1f4e-4ee3-a152-be381ef6c3bd' (cwd None) >Thread-34::DEBUG::2014-07-10 08:52:37,904::lvm::296::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-34::DEBUG::2014-07-10 08:52:37,906::lvm::415::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-34::DEBUG::2014-07-10 08:52:37,906::blockSD::315::storage.Metadata.VGTagMetadataRW::(writelines) Updating metadata adding=MDT__SHA_CKSUM=013b5a7910962201c4cceab31b9c6d9c79f7316f, MDT_POOL_DOMAINS=9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active&44&6a70504d-00df-4869-8695-0f442053f6b6:Active removing=MDT__SHA_CKSUM=93948d8c722ad3f834746df1d58a0c2dcd331e54, MDT_POOL_DOMAINS=9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active&44&6a70504d-00df-4869-8695-0f442053f6b6:Attached >Thread-34::DEBUG::2014-07-10 08:52:37,908::lvm::296::Storage.Misc.excCmd::(cmd) u'/usr/bin/sudo -n /sbin/lvm vgchange --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/3600601601282300032826addbbdae311|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } " --deltag MDT_POOL_DOMAINS=9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active&44&6a70504d-00df-4869-8695-0f442053f6b6:Attached --deltag MDT__SHA_CKSUM=93948d8c722ad3f834746df1d58a0c2dcd331e54 --addtag MDT__SHA_CKSUM=013b5a7910962201c4cceab31b9c6d9c79f7316f --addtag MDT_POOL_DOMAINS=9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active&44&6a70504d-00df-4869-8695-0f442053f6b6:Active 9e1aa540-1f4e-4ee3-a152-be381ef6c3bd' (cwd None) >Thread-34::DEBUG::2014-07-10 08:52:38,103::lvm::296::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-34::DEBUG::2014-07-10 08:52:38,105::lvm::503::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-34::DEBUG::2014-07-10 08:52:38,105::lvm::505::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-34::DEBUG::2014-07-10 08:52:38,106::persistentDict::175::Storage.PersistentDict::(transaction) Finished transaction >Thread-34::DEBUG::2014-07-10 08:52:38,106::misc::756::SamplingMethod::(__call__) Trying to enter sampling method (storage.sp.updateMonitoringThreads) >Thread-34::DEBUG::2014-07-10 08:52:38,106::misc::758::SamplingMethod::(__call__) Got in to sampling method >Thread-34::INFO::2014-07-10 08:52:38,107::domainMonitor::99::Storage.DomainMonitor::(startMonitoring) Start monitoring 6a70504d-00df-4869-8695-0f442053f6b6 >Thread-34::DEBUG::2014-07-10 08:52:38,108::sp::1404::Storage.StoragePool::(updateMonitoringThreads) Storage Pool `4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee` started monitoring domain `6a70504d-00df-4869-8695-0f442053f6b6` >Thread-40::DEBUG::2014-07-10 08:52:38,108::domainMonitor::165::Storage.DomainMonitorThread::(_monitorLoop) Starting domain monitor for 6a70504d-00df-4869-8695-0f442053f6b6 >Thread-34::DEBUG::2014-07-10 08:52:38,109::misc::766::SamplingMethod::(__call__) Returning last result >Thread-34::INFO::2014-07-10 08:52:38,111::logUtils::47::dispatcher::(wrapper) Run and protect: activateStorageDomain, Return response: None >Thread-34::DEBUG::2014-07-10 08:52:38,111::task::1185::TaskManager.Task::(prepare) Task=`ffa36e9c-3fe6-442a-be1d-5c94a5d3bd1a`::finished: None >Thread-34::DEBUG::2014-07-10 08:52:38,113::task::595::TaskManager.Task::(_updateState) Task=`ffa36e9c-3fe6-442a-be1d-5c94a5d3bd1a`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-10 08:52:38,114::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.6a70504d-00df-4869-8695-0f442053f6b6': < ResourceRef 'Storage.6a70504d-00df-4869-8695-0f442053f6b6', isValid: 'True' obj: 'None'>, 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee': < ResourceRef 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-10 08:52:38,116::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-10 08:52:38,118::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.6a70504d-00df-4869-8695-0f442053f6b6' >Thread-34::DEBUG::2014-07-10 08:52:38,119::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.6a70504d-00df-4869-8695-0f442053f6b6' (0 active users) >Thread-34::DEBUG::2014-07-10 08:52:38,120::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.6a70504d-00df-4869-8695-0f442053f6b6' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-10 08:52:38,123::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.6a70504d-00df-4869-8695-0f442053f6b6', Clearing records. >Thread-34::DEBUG::2014-07-10 08:52:38,124::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' >Thread-34::DEBUG::2014-07-10 08:52:38,125::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' (0 active users) >Thread-34::DEBUG::2014-07-10 08:52:38,125::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-10 08:52:38,126::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', Clearing records. >Thread-34::DEBUG::2014-07-10 08:52:38,127::task::990::TaskManager.Task::(_decref) Task=`ffa36e9c-3fe6-442a-be1d-5c94a5d3bd1a`::ref 0 aborting False >Thread-40::DEBUG::2014-07-10 08:52:38,147::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lion.qa.lab.tlv.redhat.com:_export_yuri2_backup2/6a70504d-00df-4869-8695-0f442053f6b6/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-40::DEBUG::2014-07-10 08:52:38,159::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n369 bytes (369 B) copied, 0.000441305 s, 836 kB/s\n'; <rc> = 0 >Thread-40::DEBUG::2014-07-10 08:52:38,162::domainMonitor::247::Storage.DomainMonitorThread::(_monitorDomain) Domain 6a70504d-00df-4869-8695-0f442053f6b6 changed its status to Valid >Thread-41::DEBUG::2014-07-10 08:52:38,164::misc::878::Event.Storage.DomainMonitor.onDomainStateChange::(_emit) Emitting event >Thread-41::DEBUG::2014-07-10 08:52:38,165::misc::888::Event.Storage.DomainMonitor.onDomainStateChange::(_emit) Calling registered method `_onDomainStateChange` >Thread-41::DEBUG::2014-07-10 08:52:38,167::misc::888::Event.Storage.DomainMonitor.onDomainStateChange::(_emit) Calling registered method `contEIOVms` >Thread-42::INFO::2014-07-10 08:52:38,170::sp::1113::Storage.StoragePool::(_linkStorageDomain) Linking /rhev/data-center/mnt/lion.qa.lab.tlv.redhat.com:_export_yuri2_backup2/6a70504d-00df-4869-8695-0f442053f6b6 to /rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/6a70504d-00df-4869-8695-0f442053f6b6 >Thread-41::DEBUG::2014-07-10 08:52:38,172::misc::888::Event.Storage.DomainMonitor.onDomainStateChange::(_emit) Calling registered method `_upgradePoolDomain` >Thread-43::INFO::2014-07-10 08:52:38,175::clientIF::126::vds::(contEIOVms) vmContainerLock acquired >Thread-41::DEBUG::2014-07-10 08:52:38,180::misc::898::Event.Storage.DomainMonitor.onDomainStateChange::(_emit) Event emitted >Thread-14::DEBUG::2014-07-10 08:52:38,188::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [30baeeea] >Thread-14::DEBUG::2014-07-10 08:52:38,189::task::595::TaskManager.Task::(_updateState) Task=`f792849e-33f3-43f5-b8d1-f244074f6a99`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 08:52:38,189::logUtils::44::dispatcher::(wrapper) Run and protect: refreshStoragePool(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', msdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', masterVersion=1, options=None) >Thread-14::DEBUG::2014-07-10 08:52:38,190::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`723f237f-2a7a-4003-99e5-967858b71eff`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '870' at 'refreshStoragePool' >Thread-14::DEBUG::2014-07-10 08:52:38,190::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' for lock type 'shared' >Thread-14::DEBUG::2014-07-10 08:52:38,191::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free. Now locking as 'shared' (1 active user) >Thread-14::DEBUG::2014-07-10 08:52:38,191::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`723f237f-2a7a-4003-99e5-967858b71eff`::Granted request >Thread-14::DEBUG::2014-07-10 08:52:38,191::task::827::TaskManager.Task::(resourceAcquired) Task=`f792849e-33f3-43f5-b8d1-f244074f6a99`::_resourcesAcquired: Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee (shared) >Thread-14::DEBUG::2014-07-10 08:52:38,192::task::990::TaskManager.Task::(_decref) Task=`f792849e-33f3-43f5-b8d1-f244074f6a99`::ref 1 aborting False >Thread-14::INFO::2014-07-10 08:52:38,193::hsm::879::Storage.HSM::(refreshStoragePool) Ignoring the refreshStoragePool request (the host is the SPM) >Thread-14::INFO::2014-07-10 08:52:38,193::logUtils::47::dispatcher::(wrapper) Run and protect: refreshStoragePool, Return response: None >Thread-14::DEBUG::2014-07-10 08:52:38,193::task::1185::TaskManager.Task::(prepare) Task=`f792849e-33f3-43f5-b8d1-f244074f6a99`::finished: None >Thread-14::DEBUG::2014-07-10 08:52:38,193::task::595::TaskManager.Task::(_updateState) Task=`f792849e-33f3-43f5-b8d1-f244074f6a99`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 08:52:38,193::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee': < ResourceRef 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', isValid: 'True' obj: 'None'>} >Thread-14::DEBUG::2014-07-10 08:52:38,194::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 08:52:38,194::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' >Thread-14::DEBUG::2014-07-10 08:52:38,194::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' (0 active users) >Thread-14::DEBUG::2014-07-10 08:52:38,194::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free, finding out if anyone is waiting for it. >Thread-14::DEBUG::2014-07-10 08:52:38,194::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', Clearing records. >Thread-14::DEBUG::2014-07-10 08:52:38,195::task::990::TaskManager.Task::(_decref) Task=`f792849e-33f3-43f5-b8d1-f244074f6a99`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 08:52:38,578::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 08:52:38,665::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0366299 s, 28.0 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 08:52:38,925::task::595::TaskManager.Task::(_updateState) Task=`76dd8d63-1bd2-4d8f-af2d-d1734e99d3bc`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 08:52:38,926::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::INFO::2014-07-10 08:52:38,926::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000640281', 'lastCheck': '7.4', 'valid': True}, '6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000441305', 'lastCheck': '0.8', 'valid': True}} >Thread-14::DEBUG::2014-07-10 08:52:38,926::task::1185::TaskManager.Task::(prepare) Task=`76dd8d63-1bd2-4d8f-af2d-d1734e99d3bc`::finished: {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000640281', 'lastCheck': '7.4', 'valid': True}, '6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000441305', 'lastCheck': '0.8', 'valid': True}} >Thread-14::DEBUG::2014-07-10 08:52:38,927::task::595::TaskManager.Task::(_updateState) Task=`76dd8d63-1bd2-4d8f-af2d-d1734e99d3bc`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 08:52:38,927::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 08:52:38,927::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 08:52:38,927::task::990::TaskManager.Task::(_decref) Task=`76dd8d63-1bd2-4d8f-af2d-d1734e99d3bc`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 08:52:40,680::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 08:52:40,768::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0364473 s, 28.1 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-10 08:52:41,531::lvm::373::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-18::DEBUG::2014-07-10 08:52:41,532::lvm::296::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/3600601601282300032826addbbdae311|/dev/mapper/360060160f4a030003840ec867ddee311|/dev/mapper/367cad74c2fcba00019e6afd20c781e67|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name 9e1aa540-1f4e-4ee3-a152-be381ef6c3bd' (cwd None) >Thread-18::DEBUG::2014-07-10 08:52:41,725::lvm::296::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-18::DEBUG::2014-07-10 08:52:41,728::lvm::415::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-18::DEBUG::2014-07-10 08:52:41,729::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/metadata bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-10 08:52:41,741::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00048944 s, 8.4 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 08:52:42,783::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 08:52:42,875::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0408557 s, 25.1 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 08:52:44,891::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 08:52:44,971::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.030196 s, 33.9 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 08:52:46,986::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 08:52:47,070::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0354482 s, 28.9 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 08:52:47,544::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-14::DEBUG::2014-07-10 08:52:47,545::task::595::TaskManager.Task::(_updateState) Task=`21b7081e-7e78-4a78-bc32-659ce15c64ae`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 08:52:47,546::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-14::INFO::2014-07-10 08:52:47,546::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 08:52:47,546::task::1185::TaskManager.Task::(prepare) Task=`21b7081e-7e78-4a78-bc32-659ce15c64ae`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 08:52:47,546::task::595::TaskManager.Task::(_updateState) Task=`21b7081e-7e78-4a78-bc32-659ce15c64ae`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 08:52:47,547::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 08:52:47,547::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 08:52:47,547::task::990::TaskManager.Task::(_decref) Task=`21b7081e-7e78-4a78-bc32-659ce15c64ae`::ref 0 aborting False >Thread-34::DEBUG::2014-07-10 08:52:47,552::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-34::DEBUG::2014-07-10 08:52:47,553::task::595::TaskManager.Task::(_updateState) Task=`00acf424-ca3a-4ce1-a582-394725b5bba9`::moving from state init -> state preparing >Thread-34::INFO::2014-07-10 08:52:47,553::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-34::DEBUG::2014-07-10 08:52:47,553::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`63f76833-36ed-4ccb-a490-2c995730f4fc`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-10 08:52:47,554::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' for lock type 'shared' >Thread-34::DEBUG::2014-07-10 08:52:47,554::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-10 08:52:47,554::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`63f76833-36ed-4ccb-a490-2c995730f4fc`::Granted request >Thread-34::DEBUG::2014-07-10 08:52:47,555::task::827::TaskManager.Task::(resourceAcquired) Task=`00acf424-ca3a-4ce1-a582-394725b5bba9`::_resourcesAcquired: Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee (shared) >Thread-34::DEBUG::2014-07-10 08:52:47,555::task::990::TaskManager.Task::(_decref) Task=`00acf424-ca3a-4ce1-a582-394725b5bba9`::ref 1 aborting False >Thread-34::INFO::2014-07-10 08:52:47,556::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': 'Active', 'diskfree': '1094948225024', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, '6a70504d-00df-4869-8695-0f442053f6b6': {'status': 'Active', 'diskfree': '532069482496', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 08:52:47,556::task::1185::TaskManager.Task::(prepare) Task=`00acf424-ca3a-4ce1-a582-394725b5bba9`::finished: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': 'Active', 'diskfree': '1094948225024', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, '6a70504d-00df-4869-8695-0f442053f6b6': {'status': 'Active', 'diskfree': '532069482496', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 08:52:47,556::task::595::TaskManager.Task::(_updateState) Task=`00acf424-ca3a-4ce1-a582-394725b5bba9`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-10 08:52:47,556::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee': < ResourceRef 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-10 08:52:47,556::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-10 08:52:47,557::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' >Thread-34::DEBUG::2014-07-10 08:52:47,557::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' (0 active users) >Thread-34::DEBUG::2014-07-10 08:52:47,557::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-10 08:52:47,557::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', Clearing records. >Thread-34::DEBUG::2014-07-10 08:52:47,557::task::990::TaskManager.Task::(_decref) Task=`00acf424-ca3a-4ce1-a582-394725b5bba9`::ref 0 aborting False >Thread-40::DEBUG::2014-07-10 08:52:48,186::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lion.qa.lab.tlv.redhat.com:_export_yuri2_backup2/6a70504d-00df-4869-8695-0f442053f6b6/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-40::DEBUG::2014-07-10 08:52:48,200::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n369 bytes (369 B) copied, 0.000460464 s, 801 kB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 08:52:49,085::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 08:52:49,170::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0354117 s, 28.9 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 08:52:51,185::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 08:52:51,259::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0257845 s, 39.7 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-10 08:52:51,772::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/metadata bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-10 08:52:51,785::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000643732 s, 6.4 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 08:52:53,274::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 08:52:53,348::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0255938 s, 40.0 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 08:52:54,052::task::595::TaskManager.Task::(_updateState) Task=`3096a996-30a5-4544-88cb-9019b5755ad1`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 08:52:54,052::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::INFO::2014-07-10 08:52:54,053::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000643732', 'lastCheck': '2.2', 'valid': True}, '6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000460464', 'lastCheck': '5.8', 'valid': True}} >Thread-14::DEBUG::2014-07-10 08:52:54,053::task::1185::TaskManager.Task::(prepare) Task=`3096a996-30a5-4544-88cb-9019b5755ad1`::finished: {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000643732', 'lastCheck': '2.2', 'valid': True}, '6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000460464', 'lastCheck': '5.8', 'valid': True}} >Thread-14::DEBUG::2014-07-10 08:52:54,053::task::595::TaskManager.Task::(_updateState) Task=`3096a996-30a5-4544-88cb-9019b5755ad1`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 08:52:54,053::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 08:52:54,054::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 08:52:54,054::task::990::TaskManager.Task::(_decref) Task=`3096a996-30a5-4544-88cb-9019b5755ad1`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 08:52:55,363::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 08:52:55,446::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0331319 s, 30.9 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 08:52:57,462::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 08:52:57,536::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0258398 s, 39.6 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 08:52:57,589::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-14::DEBUG::2014-07-10 08:52:57,590::task::595::TaskManager.Task::(_updateState) Task=`4483c6ec-7190-4436-a3d5-96a4734df85f`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 08:52:57,590::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-14::INFO::2014-07-10 08:52:57,591::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 08:52:57,591::task::1185::TaskManager.Task::(prepare) Task=`4483c6ec-7190-4436-a3d5-96a4734df85f`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 08:52:57,591::task::595::TaskManager.Task::(_updateState) Task=`4483c6ec-7190-4436-a3d5-96a4734df85f`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 08:52:57,591::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 08:52:57,592::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 08:52:57,592::task::990::TaskManager.Task::(_decref) Task=`4483c6ec-7190-4436-a3d5-96a4734df85f`::ref 0 aborting False >Thread-34::DEBUG::2014-07-10 08:52:57,596::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-34::DEBUG::2014-07-10 08:52:57,597::task::595::TaskManager.Task::(_updateState) Task=`6f323780-facb-4e7d-87ff-944bd5471c35`::moving from state init -> state preparing >Thread-34::INFO::2014-07-10 08:52:57,597::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-34::DEBUG::2014-07-10 08:52:57,598::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`e79cf816-103b-46e2-97a0-9e93f0fa92b6`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-10 08:52:57,598::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' for lock type 'shared' >Thread-34::DEBUG::2014-07-10 08:52:57,598::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-10 08:52:57,598::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`e79cf816-103b-46e2-97a0-9e93f0fa92b6`::Granted request >Thread-34::DEBUG::2014-07-10 08:52:57,599::task::827::TaskManager.Task::(resourceAcquired) Task=`6f323780-facb-4e7d-87ff-944bd5471c35`::_resourcesAcquired: Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee (shared) >Thread-34::DEBUG::2014-07-10 08:52:57,599::task::990::TaskManager.Task::(_decref) Task=`6f323780-facb-4e7d-87ff-944bd5471c35`::ref 1 aborting False >Thread-34::INFO::2014-07-10 08:52:57,600::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': 'Active', 'diskfree': '1094948225024', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, '6a70504d-00df-4869-8695-0f442053f6b6': {'status': 'Active', 'diskfree': '532069482496', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 08:52:57,601::task::1185::TaskManager.Task::(prepare) Task=`6f323780-facb-4e7d-87ff-944bd5471c35`::finished: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': 'Active', 'diskfree': '1094948225024', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, '6a70504d-00df-4869-8695-0f442053f6b6': {'status': 'Active', 'diskfree': '532069482496', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 08:52:57,601::task::595::TaskManager.Task::(_updateState) Task=`6f323780-facb-4e7d-87ff-944bd5471c35`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-10 08:52:57,601::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee': < ResourceRef 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-10 08:52:57,601::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-10 08:52:57,602::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' >Thread-34::DEBUG::2014-07-10 08:52:57,602::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' (0 active users) >Thread-34::DEBUG::2014-07-10 08:52:57,602::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-10 08:52:57,602::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', Clearing records. >Thread-34::DEBUG::2014-07-10 08:52:57,602::task::990::TaskManager.Task::(_decref) Task=`6f323780-facb-4e7d-87ff-944bd5471c35`::ref 0 aborting False >Thread-40::DEBUG::2014-07-10 08:52:58,230::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lion.qa.lab.tlv.redhat.com:_export_yuri2_backup2/6a70504d-00df-4869-8695-0f442053f6b6/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-40::DEBUG::2014-07-10 08:52:58,243::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n369 bytes (369 B) copied, 0.000543487 s, 679 kB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 08:52:59,551::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 08:52:59,675::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0259607 s, 39.4 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 08:53:01,690::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 08:53:01,770::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.031378 s, 32.6 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-10 08:53:01,817::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/metadata bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-10 08:53:01,830::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000638876 s, 6.4 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 08:53:03,786::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 08:53:03,867::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.031025 s, 33.0 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 08:53:05,882::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 08:53:05,959::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0283627 s, 36.1 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 08:53:07,633::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-14::DEBUG::2014-07-10 08:53:07,634::task::595::TaskManager.Task::(_updateState) Task=`8d9da1f7-28da-4d1d-ae33-da5ad54286fd`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 08:53:07,634::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-14::INFO::2014-07-10 08:53:07,635::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 08:53:07,635::task::1185::TaskManager.Task::(prepare) Task=`8d9da1f7-28da-4d1d-ae33-da5ad54286fd`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 08:53:07,635::task::595::TaskManager.Task::(_updateState) Task=`8d9da1f7-28da-4d1d-ae33-da5ad54286fd`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 08:53:07,635::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 08:53:07,636::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 08:53:07,636::task::990::TaskManager.Task::(_decref) Task=`8d9da1f7-28da-4d1d-ae33-da5ad54286fd`::ref 0 aborting False >Thread-34::DEBUG::2014-07-10 08:53:07,640::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-34::DEBUG::2014-07-10 08:53:07,641::task::595::TaskManager.Task::(_updateState) Task=`dd06d339-a005-4a66-aaba-4fe46df0971d`::moving from state init -> state preparing >Thread-34::INFO::2014-07-10 08:53:07,641::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-34::DEBUG::2014-07-10 08:53:07,642::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`f72dd7d3-e9c0-4b12-b2f2-2bfd1431b179`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-10 08:53:07,642::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' for lock type 'shared' >Thread-34::DEBUG::2014-07-10 08:53:07,642::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-10 08:53:07,643::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`f72dd7d3-e9c0-4b12-b2f2-2bfd1431b179`::Granted request >Thread-34::DEBUG::2014-07-10 08:53:07,645::task::827::TaskManager.Task::(resourceAcquired) Task=`dd06d339-a005-4a66-aaba-4fe46df0971d`::_resourcesAcquired: Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee (shared) >Thread-34::DEBUG::2014-07-10 08:53:07,645::task::990::TaskManager.Task::(_decref) Task=`dd06d339-a005-4a66-aaba-4fe46df0971d`::ref 1 aborting False >Thread-34::INFO::2014-07-10 08:53:07,646::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': 'Active', 'diskfree': '1094948225024', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, '6a70504d-00df-4869-8695-0f442053f6b6': {'status': 'Active', 'diskfree': '532069482496', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 08:53:07,646::task::1185::TaskManager.Task::(prepare) Task=`dd06d339-a005-4a66-aaba-4fe46df0971d`::finished: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': 'Active', 'diskfree': '1094948225024', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, '6a70504d-00df-4869-8695-0f442053f6b6': {'status': 'Active', 'diskfree': '532069482496', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 08:53:07,647::task::595::TaskManager.Task::(_updateState) Task=`dd06d339-a005-4a66-aaba-4fe46df0971d`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-10 08:53:07,647::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee': < ResourceRef 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-10 08:53:07,647::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-10 08:53:07,647::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' >Thread-34::DEBUG::2014-07-10 08:53:07,647::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' (0 active users) >Thread-34::DEBUG::2014-07-10 08:53:07,648::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-10 08:53:07,648::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', Clearing records. >Thread-34::DEBUG::2014-07-10 08:53:07,648::task::990::TaskManager.Task::(_decref) Task=`dd06d339-a005-4a66-aaba-4fe46df0971d`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 08:53:07,974::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 08:53:08,053::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0312442 s, 32.8 MB/s\n'; <rc> = 0 >Thread-40::DEBUG::2014-07-10 08:53:08,269::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lion.qa.lab.tlv.redhat.com:_export_yuri2_backup2/6a70504d-00df-4869-8695-0f442053f6b6/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-40::DEBUG::2014-07-10 08:53:08,284::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n369 bytes (369 B) copied, 0.000557083 s, 662 kB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 08:53:09,179::task::595::TaskManager.Task::(_updateState) Task=`4c46fc7b-9344-48d5-893c-ff36599591b9`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 08:53:09,179::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::INFO::2014-07-10 08:53:09,180::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000638876', 'lastCheck': '7.3', 'valid': True}, '6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000557083', 'lastCheck': '0.9', 'valid': True}} >Thread-14::DEBUG::2014-07-10 08:53:09,180::task::1185::TaskManager.Task::(prepare) Task=`4c46fc7b-9344-48d5-893c-ff36599591b9`::finished: {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000638876', 'lastCheck': '7.3', 'valid': True}, '6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000557083', 'lastCheck': '0.9', 'valid': True}} >Thread-14::DEBUG::2014-07-10 08:53:09,180::task::595::TaskManager.Task::(_updateState) Task=`4c46fc7b-9344-48d5-893c-ff36599591b9`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 08:53:09,180::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 08:53:09,181::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 08:53:09,181::task::990::TaskManager.Task::(_decref) Task=`4c46fc7b-9344-48d5-893c-ff36599591b9`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 08:53:10,069::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 08:53:10,155::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0361969 s, 28.3 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-10 08:53:11,858::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/metadata bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-10 08:53:11,871::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000577069 s, 7.1 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 08:53:12,171::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 08:53:12,260::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0369839 s, 27.7 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 08:53:14,275::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 08:53:14,355::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.029954 s, 34.2 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 08:53:16,370::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 08:53:16,455::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0353678 s, 29.0 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 08:53:17,674::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-14::DEBUG::2014-07-10 08:53:17,675::task::595::TaskManager.Task::(_updateState) Task=`906067c6-b29d-4a6c-90ed-99c1754ea5e0`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 08:53:17,675::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-14::INFO::2014-07-10 08:53:17,676::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 08:53:17,676::task::1185::TaskManager.Task::(prepare) Task=`906067c6-b29d-4a6c-90ed-99c1754ea5e0`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 08:53:17,676::task::595::TaskManager.Task::(_updateState) Task=`906067c6-b29d-4a6c-90ed-99c1754ea5e0`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 08:53:17,676::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 08:53:17,677::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 08:53:17,677::task::990::TaskManager.Task::(_decref) Task=`906067c6-b29d-4a6c-90ed-99c1754ea5e0`::ref 0 aborting False >Thread-34::DEBUG::2014-07-10 08:53:17,681::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-34::DEBUG::2014-07-10 08:53:17,681::task::595::TaskManager.Task::(_updateState) Task=`365076ef-90df-4761-9705-71a39726efe8`::moving from state init -> state preparing >Thread-34::INFO::2014-07-10 08:53:17,682::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-34::DEBUG::2014-07-10 08:53:17,682::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`be6dbca7-1fa5-4ecf-a395-0bdbc09a00e1`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-10 08:53:17,682::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' for lock type 'shared' >Thread-34::DEBUG::2014-07-10 08:53:17,683::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-10 08:53:17,683::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`be6dbca7-1fa5-4ecf-a395-0bdbc09a00e1`::Granted request >Thread-34::DEBUG::2014-07-10 08:53:17,683::task::827::TaskManager.Task::(resourceAcquired) Task=`365076ef-90df-4761-9705-71a39726efe8`::_resourcesAcquired: Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee (shared) >Thread-34::DEBUG::2014-07-10 08:53:17,683::task::990::TaskManager.Task::(_decref) Task=`365076ef-90df-4761-9705-71a39726efe8`::ref 1 aborting False >Thread-34::INFO::2014-07-10 08:53:17,684::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': 'Active', 'diskfree': '1094948225024', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, '6a70504d-00df-4869-8695-0f442053f6b6': {'status': 'Active', 'diskfree': '532069482496', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 08:53:17,685::task::1185::TaskManager.Task::(prepare) Task=`365076ef-90df-4761-9705-71a39726efe8`::finished: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': 'Active', 'diskfree': '1094948225024', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, '6a70504d-00df-4869-8695-0f442053f6b6': {'status': 'Active', 'diskfree': '532069482496', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 08:53:17,685::task::595::TaskManager.Task::(_updateState) Task=`365076ef-90df-4761-9705-71a39726efe8`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-10 08:53:17,685::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee': < ResourceRef 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-10 08:53:17,685::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-10 08:53:17,685::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' >Thread-34::DEBUG::2014-07-10 08:53:17,686::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' (0 active users) >Thread-34::DEBUG::2014-07-10 08:53:17,686::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-10 08:53:17,686::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', Clearing records. >Thread-34::DEBUG::2014-07-10 08:53:17,686::task::990::TaskManager.Task::(_decref) Task=`365076ef-90df-4761-9705-71a39726efe8`::ref 0 aborting False >Thread-40::DEBUG::2014-07-10 08:53:18,309::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lion.qa.lab.tlv.redhat.com:_export_yuri2_backup2/6a70504d-00df-4869-8695-0f442053f6b6/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-40::DEBUG::2014-07-10 08:53:18,322::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n369 bytes (369 B) copied, 0.000544751 s, 677 kB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 08:53:18,470::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 08:53:18,556::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0353915 s, 28.9 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 08:53:20,571::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 08:53:20,653::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.030611 s, 33.5 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-10 08:53:21,899::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/metadata bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-10 08:53:21,918::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000493412 s, 8.3 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 08:53:22,668::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 08:53:22,752::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0328859 s, 31.1 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 08:53:24,311::task::595::TaskManager.Task::(_updateState) Task=`855989f0-139a-4641-9ec6-799892e4777f`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 08:53:24,311::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::INFO::2014-07-10 08:53:24,312::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000493412', 'lastCheck': '2.4', 'valid': True}, '6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000544751', 'lastCheck': '6.0', 'valid': True}} >Thread-14::DEBUG::2014-07-10 08:53:24,312::task::1185::TaskManager.Task::(prepare) Task=`855989f0-139a-4641-9ec6-799892e4777f`::finished: {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000493412', 'lastCheck': '2.4', 'valid': True}, '6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000544751', 'lastCheck': '6.0', 'valid': True}} >Thread-14::DEBUG::2014-07-10 08:53:24,312::task::595::TaskManager.Task::(_updateState) Task=`855989f0-139a-4641-9ec6-799892e4777f`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 08:53:24,313::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 08:53:24,313::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 08:53:24,313::task::990::TaskManager.Task::(_decref) Task=`855989f0-139a-4641-9ec6-799892e4777f`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 08:53:24,767::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 08:53:24,860::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0409436 s, 25.0 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 08:53:26,875::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 08:53:26,953::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0275656 s, 37.1 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 08:53:27,738::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-14::DEBUG::2014-07-10 08:53:27,739::task::595::TaskManager.Task::(_updateState) Task=`46dfaf84-3dc2-4c7f-8c77-dffe4e2d8973`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 08:53:27,739::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-14::INFO::2014-07-10 08:53:27,740::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 08:53:27,740::task::1185::TaskManager.Task::(prepare) Task=`46dfaf84-3dc2-4c7f-8c77-dffe4e2d8973`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 08:53:27,740::task::595::TaskManager.Task::(_updateState) Task=`46dfaf84-3dc2-4c7f-8c77-dffe4e2d8973`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 08:53:27,740::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 08:53:27,740::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 08:53:27,740::task::990::TaskManager.Task::(_decref) Task=`46dfaf84-3dc2-4c7f-8c77-dffe4e2d8973`::ref 0 aborting False >Thread-34::DEBUG::2014-07-10 08:53:27,744::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-34::DEBUG::2014-07-10 08:53:27,745::task::595::TaskManager.Task::(_updateState) Task=`3bd36462-f3c5-4097-b7db-f3b479635ad9`::moving from state init -> state preparing >Thread-34::INFO::2014-07-10 08:53:27,745::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-34::DEBUG::2014-07-10 08:53:27,746::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`82bdf5db-43b0-4bbe-b4d9-7f24b2d2599c`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-10 08:53:27,746::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' for lock type 'shared' >Thread-34::DEBUG::2014-07-10 08:53:27,746::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-10 08:53:27,746::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`82bdf5db-43b0-4bbe-b4d9-7f24b2d2599c`::Granted request >Thread-34::DEBUG::2014-07-10 08:53:27,747::task::827::TaskManager.Task::(resourceAcquired) Task=`3bd36462-f3c5-4097-b7db-f3b479635ad9`::_resourcesAcquired: Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee (shared) >Thread-34::DEBUG::2014-07-10 08:53:27,747::task::990::TaskManager.Task::(_decref) Task=`3bd36462-f3c5-4097-b7db-f3b479635ad9`::ref 1 aborting False >Thread-34::INFO::2014-07-10 08:53:27,748::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': 'Active', 'diskfree': '1094948225024', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, '6a70504d-00df-4869-8695-0f442053f6b6': {'status': 'Active', 'diskfree': '532069482496', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 08:53:27,748::task::1185::TaskManager.Task::(prepare) Task=`3bd36462-f3c5-4097-b7db-f3b479635ad9`::finished: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': 'Active', 'diskfree': '1094948225024', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, '6a70504d-00df-4869-8695-0f442053f6b6': {'status': 'Active', 'diskfree': '532069482496', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 08:53:27,749::task::595::TaskManager.Task::(_updateState) Task=`3bd36462-f3c5-4097-b7db-f3b479635ad9`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-10 08:53:27,749::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee': < ResourceRef 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-10 08:53:27,749::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-10 08:53:27,749::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' >Thread-34::DEBUG::2014-07-10 08:53:27,749::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' (0 active users) >Thread-34::DEBUG::2014-07-10 08:53:27,750::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-10 08:53:27,750::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', Clearing records. >Thread-34::DEBUG::2014-07-10 08:53:27,750::task::990::TaskManager.Task::(_decref) Task=`3bd36462-f3c5-4097-b7db-f3b479635ad9`::ref 0 aborting False >Thread-40::DEBUG::2014-07-10 08:53:28,352::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lion.qa.lab.tlv.redhat.com:_export_yuri2_backup2/6a70504d-00df-4869-8695-0f442053f6b6/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-40::DEBUG::2014-07-10 08:53:28,364::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n369 bytes (369 B) copied, 0.000524416 s, 704 kB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 08:53:28,967::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 08:53:29,053::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0362156 s, 28.3 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 08:53:31,069::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 08:53:31,152::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0327518 s, 31.3 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-10 08:53:31,946::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/metadata bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-10 08:53:31,958::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000623179 s, 6.6 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 08:53:33,167::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 08:53:33,247::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0300788 s, 34.0 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 08:53:35,263::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 08:53:35,340::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0284884 s, 35.9 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 08:53:37,355::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 08:53:37,438::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0336743 s, 30.4 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 08:53:37,772::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-14::DEBUG::2014-07-10 08:53:37,773::task::595::TaskManager.Task::(_updateState) Task=`1d5b616c-6c17-4d70-8ce2-9039b21e9fbe`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 08:53:37,773::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-14::INFO::2014-07-10 08:53:37,774::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 08:53:37,774::task::1185::TaskManager.Task::(prepare) Task=`1d5b616c-6c17-4d70-8ce2-9039b21e9fbe`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 08:53:37,774::task::595::TaskManager.Task::(_updateState) Task=`1d5b616c-6c17-4d70-8ce2-9039b21e9fbe`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 08:53:37,775::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 08:53:37,775::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 08:53:37,775::task::990::TaskManager.Task::(_decref) Task=`1d5b616c-6c17-4d70-8ce2-9039b21e9fbe`::ref 0 aborting False >Thread-34::DEBUG::2014-07-10 08:53:37,779::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-34::DEBUG::2014-07-10 08:53:37,780::task::595::TaskManager.Task::(_updateState) Task=`10d26fd2-ab48-4576-a724-e10b65d47946`::moving from state init -> state preparing >Thread-34::INFO::2014-07-10 08:53:37,780::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-34::DEBUG::2014-07-10 08:53:37,781::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`e31f29a2-947f-488f-98d1-956380cbae3f`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-10 08:53:37,781::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' for lock type 'shared' >Thread-34::DEBUG::2014-07-10 08:53:37,781::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-10 08:53:37,782::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`e31f29a2-947f-488f-98d1-956380cbae3f`::Granted request >Thread-34::DEBUG::2014-07-10 08:53:37,782::task::827::TaskManager.Task::(resourceAcquired) Task=`10d26fd2-ab48-4576-a724-e10b65d47946`::_resourcesAcquired: Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee (shared) >Thread-34::DEBUG::2014-07-10 08:53:37,782::task::990::TaskManager.Task::(_decref) Task=`10d26fd2-ab48-4576-a724-e10b65d47946`::ref 1 aborting False >Thread-34::INFO::2014-07-10 08:53:37,783::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': 'Active', 'diskfree': '1094948225024', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, '6a70504d-00df-4869-8695-0f442053f6b6': {'status': 'Active', 'diskfree': '532069482496', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 08:53:37,784::task::1185::TaskManager.Task::(prepare) Task=`10d26fd2-ab48-4576-a724-e10b65d47946`::finished: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': 'Active', 'diskfree': '1094948225024', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, '6a70504d-00df-4869-8695-0f442053f6b6': {'status': 'Active', 'diskfree': '532069482496', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 08:53:37,784::task::595::TaskManager.Task::(_updateState) Task=`10d26fd2-ab48-4576-a724-e10b65d47946`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-10 08:53:37,784::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee': < ResourceRef 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-10 08:53:37,784::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-10 08:53:37,785::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' >Thread-34::DEBUG::2014-07-10 08:53:37,785::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' (0 active users) >Thread-34::DEBUG::2014-07-10 08:53:37,785::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-10 08:53:37,785::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', Clearing records. >Thread-34::DEBUG::2014-07-10 08:53:37,785::task::990::TaskManager.Task::(_decref) Task=`10d26fd2-ab48-4576-a724-e10b65d47946`::ref 0 aborting False >Thread-40::DEBUG::2014-07-10 08:53:38,388::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lion.qa.lab.tlv.redhat.com:_export_yuri2_backup2/6a70504d-00df-4869-8695-0f442053f6b6/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-40::DEBUG::2014-07-10 08:53:38,401::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n369 bytes (369 B) copied, 0.000454128 s, 813 kB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 08:53:39,447::task::595::TaskManager.Task::(_updateState) Task=`2c3c80d2-ac41-497c-917c-affdb043e1bb`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 08:53:39,448::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::INFO::2014-07-10 08:53:39,448::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000623179', 'lastCheck': '7.5', 'valid': True}, '6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000454128', 'lastCheck': '1.0', 'valid': True}} >Thread-14::DEBUG::2014-07-10 08:53:39,449::task::1185::TaskManager.Task::(prepare) Task=`2c3c80d2-ac41-497c-917c-affdb043e1bb`::finished: {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000623179', 'lastCheck': '7.5', 'valid': True}, '6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000454128', 'lastCheck': '1.0', 'valid': True}} >Thread-14::DEBUG::2014-07-10 08:53:39,449::task::595::TaskManager.Task::(_updateState) Task=`2c3c80d2-ac41-497c-917c-affdb043e1bb`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 08:53:39,449::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 08:53:39,449::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 08:53:39,449::task::990::TaskManager.Task::(_decref) Task=`2c3c80d2-ac41-497c-917c-affdb043e1bb`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 08:53:39,457::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 08:53:39,546::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0369096 s, 27.7 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 08:53:41,561::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 08:53:41,643::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0306976 s, 33.4 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-10 08:53:41,989::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/metadata bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-10 08:53:42,008::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00710344 s, 577 kB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 08:53:43,658::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 08:53:43,758::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0510755 s, 20.0 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 08:53:45,773::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 08:53:45,859::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0313598 s, 32.7 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 08:53:47,821::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-14::DEBUG::2014-07-10 08:53:47,822::task::595::TaskManager.Task::(_updateState) Task=`fb65618e-ddd6-411e-a0cb-831542e56865`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 08:53:47,822::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-14::INFO::2014-07-10 08:53:47,823::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 08:53:47,823::task::1185::TaskManager.Task::(prepare) Task=`fb65618e-ddd6-411e-a0cb-831542e56865`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 08:53:47,823::task::595::TaskManager.Task::(_updateState) Task=`fb65618e-ddd6-411e-a0cb-831542e56865`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 08:53:47,823::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 08:53:47,823::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 08:53:47,824::task::990::TaskManager.Task::(_decref) Task=`fb65618e-ddd6-411e-a0cb-831542e56865`::ref 0 aborting False >Thread-34::DEBUG::2014-07-10 08:53:47,828::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-34::DEBUG::2014-07-10 08:53:47,828::task::595::TaskManager.Task::(_updateState) Task=`7a40245f-eae2-4d31-a70e-43fef234e206`::moving from state init -> state preparing >Thread-34::INFO::2014-07-10 08:53:47,828::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-34::DEBUG::2014-07-10 08:53:47,829::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`c557f440-4c67-4b3b-848c-238b3a444c9f`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-10 08:53:47,829::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' for lock type 'shared' >Thread-34::DEBUG::2014-07-10 08:53:47,829::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-10 08:53:47,830::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`c557f440-4c67-4b3b-848c-238b3a444c9f`::Granted request >Thread-34::DEBUG::2014-07-10 08:53:47,830::task::827::TaskManager.Task::(resourceAcquired) Task=`7a40245f-eae2-4d31-a70e-43fef234e206`::_resourcesAcquired: Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee (shared) >Thread-34::DEBUG::2014-07-10 08:53:47,830::task::990::TaskManager.Task::(_decref) Task=`7a40245f-eae2-4d31-a70e-43fef234e206`::ref 1 aborting False >Thread-34::INFO::2014-07-10 08:53:47,831::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': 'Active', 'diskfree': '1094948225024', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, '6a70504d-00df-4869-8695-0f442053f6b6': {'status': 'Active', 'diskfree': '532069482496', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 08:53:47,831::task::1185::TaskManager.Task::(prepare) Task=`7a40245f-eae2-4d31-a70e-43fef234e206`::finished: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': 'Active', 'diskfree': '1094948225024', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, '6a70504d-00df-4869-8695-0f442053f6b6': {'status': 'Active', 'diskfree': '532069482496', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 08:53:47,831::task::595::TaskManager.Task::(_updateState) Task=`7a40245f-eae2-4d31-a70e-43fef234e206`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-10 08:53:47,832::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee': < ResourceRef 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-10 08:53:47,832::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-10 08:53:47,832::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' >Thread-34::DEBUG::2014-07-10 08:53:47,832::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' (0 active users) >Thread-34::DEBUG::2014-07-10 08:53:47,832::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-10 08:53:47,833::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', Clearing records. >Thread-34::DEBUG::2014-07-10 08:53:47,833::task::990::TaskManager.Task::(_decref) Task=`7a40245f-eae2-4d31-a70e-43fef234e206`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 08:53:47,874::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 08:53:47,951::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0277363 s, 36.9 MB/s\n'; <rc> = 0 >Thread-40::DEBUG::2014-07-10 08:53:48,431::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lion.qa.lab.tlv.redhat.com:_export_yuri2_backup2/6a70504d-00df-4869-8695-0f442053f6b6/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-40::DEBUG::2014-07-10 08:53:48,444::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n369 bytes (369 B) copied, 0.000495004 s, 745 kB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 08:53:49,966::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 08:53:50,054::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.036417 s, 28.1 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-10 08:53:52,041::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/metadata bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-10 08:53:52,052::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000544723 s, 7.5 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 08:53:52,072::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 08:53:52,308::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.183132 s, 5.6 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 08:53:54,323::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 08:53:54,403::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0307058 s, 33.3 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 08:53:54,600::task::595::TaskManager.Task::(_updateState) Task=`e8cc00db-75ef-43b7-be82-706bc192bfe8`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 08:53:54,601::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::INFO::2014-07-10 08:53:54,601::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000544723', 'lastCheck': '2.4', 'valid': True}, '6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000495004', 'lastCheck': '6.2', 'valid': True}} >Thread-14::DEBUG::2014-07-10 08:53:54,602::task::1185::TaskManager.Task::(prepare) Task=`e8cc00db-75ef-43b7-be82-706bc192bfe8`::finished: {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000544723', 'lastCheck': '2.4', 'valid': True}, '6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000495004', 'lastCheck': '6.2', 'valid': True}} >Thread-14::DEBUG::2014-07-10 08:53:54,602::task::595::TaskManager.Task::(_updateState) Task=`e8cc00db-75ef-43b7-be82-706bc192bfe8`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 08:53:54,602::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 08:53:54,602::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 08:53:54,602::task::990::TaskManager.Task::(_decref) Task=`e8cc00db-75ef-43b7-be82-706bc192bfe8`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 08:53:56,418::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 08:53:56,498::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0303434 s, 33.7 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 08:53:57,860::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [20826f36] >Thread-14::DEBUG::2014-07-10 08:53:57,861::task::595::TaskManager.Task::(_updateState) Task=`14576182-8b70-48d6-9475-40d1b1cd288f`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 08:53:57,861::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-14::INFO::2014-07-10 08:53:57,862::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 08:53:57,862::task::1185::TaskManager.Task::(prepare) Task=`14576182-8b70-48d6-9475-40d1b1cd288f`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 08:53:57,862::task::595::TaskManager.Task::(_updateState) Task=`14576182-8b70-48d6-9475-40d1b1cd288f`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 08:53:57,862::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 08:53:57,863::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 08:53:57,863::task::990::TaskManager.Task::(_decref) Task=`14576182-8b70-48d6-9475-40d1b1cd288f`::ref 0 aborting False >Thread-34::DEBUG::2014-07-10 08:53:57,867::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [20826f36] >Thread-34::DEBUG::2014-07-10 08:53:57,867::task::595::TaskManager.Task::(_updateState) Task=`0a9590c8-1c34-4842-bc15-be43d86465b8`::moving from state init -> state preparing >Thread-34::INFO::2014-07-10 08:53:57,867::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-34::DEBUG::2014-07-10 08:53:57,868::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`e579e189-3def-434d-8f57-1ac81ef78ec8`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-10 08:53:57,868::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' for lock type 'shared' >Thread-34::DEBUG::2014-07-10 08:53:57,869::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-10 08:53:57,869::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`e579e189-3def-434d-8f57-1ac81ef78ec8`::Granted request >Thread-34::DEBUG::2014-07-10 08:53:57,869::task::827::TaskManager.Task::(resourceAcquired) Task=`0a9590c8-1c34-4842-bc15-be43d86465b8`::_resourcesAcquired: Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee (shared) >Thread-34::DEBUG::2014-07-10 08:53:57,869::task::990::TaskManager.Task::(_decref) Task=`0a9590c8-1c34-4842-bc15-be43d86465b8`::ref 1 aborting False >Thread-34::INFO::2014-07-10 08:53:57,871::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': 'Active', 'diskfree': '1094948225024', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, '6a70504d-00df-4869-8695-0f442053f6b6': {'status': 'Active', 'diskfree': '532069482496', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 08:53:57,871::task::1185::TaskManager.Task::(prepare) Task=`0a9590c8-1c34-4842-bc15-be43d86465b8`::finished: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': 'Active', 'diskfree': '1094948225024', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, '6a70504d-00df-4869-8695-0f442053f6b6': {'status': 'Active', 'diskfree': '532069482496', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 08:53:57,871::task::595::TaskManager.Task::(_updateState) Task=`0a9590c8-1c34-4842-bc15-be43d86465b8`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-10 08:53:57,871::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee': < ResourceRef 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-10 08:53:57,871::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-10 08:53:57,872::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' >Thread-34::DEBUG::2014-07-10 08:53:57,872::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' (0 active users) >Thread-34::DEBUG::2014-07-10 08:53:57,872::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-10 08:53:57,872::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', Clearing records. >Thread-34::DEBUG::2014-07-10 08:53:57,872::task::990::TaskManager.Task::(_decref) Task=`0a9590c8-1c34-4842-bc15-be43d86465b8`::ref 0 aborting False >Thread-40::DEBUG::2014-07-10 08:53:58,473::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lion.qa.lab.tlv.redhat.com:_export_yuri2_backup2/6a70504d-00df-4869-8695-0f442053f6b6/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-40::DEBUG::2014-07-10 08:53:58,486::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n369 bytes (369 B) copied, 0.000473862 s, 779 kB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 08:53:58,513::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 08:53:58,598::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0358657 s, 28.6 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 08:54:00,613::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 08:54:00,697::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.032894 s, 31.1 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-10 08:54:02,238::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/metadata bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-10 08:54:02,252::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000582761 s, 7.0 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 08:54:02,712::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 08:54:02,797::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0359477 s, 28.5 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 08:54:04,813::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 08:54:04,898::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0342368 s, 29.9 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 08:54:06,913::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 08:54:06,998::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0342245 s, 29.9 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 08:54:07,902::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-14::DEBUG::2014-07-10 08:54:07,903::task::595::TaskManager.Task::(_updateState) Task=`ad3f0041-309d-433c-bd97-829309368ef7`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 08:54:07,904::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-14::INFO::2014-07-10 08:54:07,904::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 08:54:07,904::task::1185::TaskManager.Task::(prepare) Task=`ad3f0041-309d-433c-bd97-829309368ef7`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 08:54:07,905::task::595::TaskManager.Task::(_updateState) Task=`ad3f0041-309d-433c-bd97-829309368ef7`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 08:54:07,905::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 08:54:07,905::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 08:54:07,905::task::990::TaskManager.Task::(_decref) Task=`ad3f0041-309d-433c-bd97-829309368ef7`::ref 0 aborting False >Thread-34::DEBUG::2014-07-10 08:54:07,909::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-34::DEBUG::2014-07-10 08:54:07,909::task::595::TaskManager.Task::(_updateState) Task=`a5cbaf5e-5107-4dd4-a047-023961b16fc9`::moving from state init -> state preparing >Thread-34::INFO::2014-07-10 08:54:07,910::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-34::DEBUG::2014-07-10 08:54:07,910::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`fe0c0f9c-2060-41c1-8867-c163688a692a`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-10 08:54:07,911::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' for lock type 'shared' >Thread-34::DEBUG::2014-07-10 08:54:07,911::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-10 08:54:07,911::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`fe0c0f9c-2060-41c1-8867-c163688a692a`::Granted request >Thread-34::DEBUG::2014-07-10 08:54:07,912::task::827::TaskManager.Task::(resourceAcquired) Task=`a5cbaf5e-5107-4dd4-a047-023961b16fc9`::_resourcesAcquired: Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee (shared) >Thread-34::DEBUG::2014-07-10 08:54:07,912::task::990::TaskManager.Task::(_decref) Task=`a5cbaf5e-5107-4dd4-a047-023961b16fc9`::ref 1 aborting False >Thread-34::INFO::2014-07-10 08:54:07,913::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': 'Active', 'diskfree': '1094948225024', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, '6a70504d-00df-4869-8695-0f442053f6b6': {'status': 'Active', 'diskfree': '532069482496', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 08:54:07,913::task::1185::TaskManager.Task::(prepare) Task=`a5cbaf5e-5107-4dd4-a047-023961b16fc9`::finished: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': 'Active', 'diskfree': '1094948225024', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, '6a70504d-00df-4869-8695-0f442053f6b6': {'status': 'Active', 'diskfree': '532069482496', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 08:54:07,914::task::595::TaskManager.Task::(_updateState) Task=`a5cbaf5e-5107-4dd4-a047-023961b16fc9`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-10 08:54:07,914::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee': < ResourceRef 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-10 08:54:07,914::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-10 08:54:07,914::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' >Thread-34::DEBUG::2014-07-10 08:54:07,914::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' (0 active users) >Thread-34::DEBUG::2014-07-10 08:54:07,915::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-10 08:54:07,915::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', Clearing records. >Thread-34::DEBUG::2014-07-10 08:54:07,915::task::990::TaskManager.Task::(_decref) Task=`a5cbaf5e-5107-4dd4-a047-023961b16fc9`::ref 0 aborting False >Thread-40::DEBUG::2014-07-10 08:54:08,510::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lion.qa.lab.tlv.redhat.com:_export_yuri2_backup2/6a70504d-00df-4869-8695-0f442053f6b6/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-40::DEBUG::2014-07-10 08:54:08,522::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n369 bytes (369 B) copied, 0.000430898 s, 856 kB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 08:54:09,013::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 08:54:09,099::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0364128 s, 28.1 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 08:54:09,946::task::595::TaskManager.Task::(_updateState) Task=`345bf9bd-70f8-4a1b-9cec-1138bd8a87c4`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 08:54:09,947::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::INFO::2014-07-10 08:54:09,947::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000582761', 'lastCheck': '7.7', 'valid': True}, '6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000430898', 'lastCheck': '1.4', 'valid': True}} >Thread-14::DEBUG::2014-07-10 08:54:09,947::task::1185::TaskManager.Task::(prepare) Task=`345bf9bd-70f8-4a1b-9cec-1138bd8a87c4`::finished: {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000582761', 'lastCheck': '7.7', 'valid': True}, '6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000430898', 'lastCheck': '1.4', 'valid': True}} >Thread-14::DEBUG::2014-07-10 08:54:09,948::task::595::TaskManager.Task::(_updateState) Task=`345bf9bd-70f8-4a1b-9cec-1138bd8a87c4`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 08:54:09,948::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 08:54:09,948::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 08:54:09,948::task::990::TaskManager.Task::(_decref) Task=`345bf9bd-70f8-4a1b-9cec-1138bd8a87c4`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 08:54:11,114::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 08:54:11,201::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0364594 s, 28.1 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-10 08:54:12,292::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/metadata bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-10 08:54:12,303::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000592817 s, 6.9 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 08:54:13,216::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 08:54:13,298::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0326735 s, 31.3 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 08:54:15,313::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 08:54:15,397::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0335934 s, 30.5 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 08:54:17,412::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 08:54:17,489::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.029195 s, 35.1 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 08:54:17,942::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-14::DEBUG::2014-07-10 08:54:17,943::task::595::TaskManager.Task::(_updateState) Task=`fbff2df3-6232-4b52-b1a7-9c626272f82c`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 08:54:17,944::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-14::INFO::2014-07-10 08:54:17,944::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 08:54:17,944::task::1185::TaskManager.Task::(prepare) Task=`fbff2df3-6232-4b52-b1a7-9c626272f82c`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 08:54:17,945::task::595::TaskManager.Task::(_updateState) Task=`fbff2df3-6232-4b52-b1a7-9c626272f82c`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 08:54:17,945::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 08:54:17,945::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 08:54:17,945::task::990::TaskManager.Task::(_decref) Task=`fbff2df3-6232-4b52-b1a7-9c626272f82c`::ref 0 aborting False >Thread-34::DEBUG::2014-07-10 08:54:17,949::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-34::DEBUG::2014-07-10 08:54:17,950::task::595::TaskManager.Task::(_updateState) Task=`d536233f-efdc-4e8b-b7d7-e5e0c69352c0`::moving from state init -> state preparing >Thread-34::INFO::2014-07-10 08:54:17,950::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-34::DEBUG::2014-07-10 08:54:17,952::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`19f5ccfb-2582-41cd-b8f4-525f43ff020b`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-10 08:54:17,953::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' for lock type 'shared' >Thread-34::DEBUG::2014-07-10 08:54:17,953::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-10 08:54:17,953::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`19f5ccfb-2582-41cd-b8f4-525f43ff020b`::Granted request >Thread-34::DEBUG::2014-07-10 08:54:17,954::task::827::TaskManager.Task::(resourceAcquired) Task=`d536233f-efdc-4e8b-b7d7-e5e0c69352c0`::_resourcesAcquired: Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee (shared) >Thread-34::DEBUG::2014-07-10 08:54:17,954::task::990::TaskManager.Task::(_decref) Task=`d536233f-efdc-4e8b-b7d7-e5e0c69352c0`::ref 1 aborting False >Thread-34::INFO::2014-07-10 08:54:17,955::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': 'Active', 'diskfree': '1094948225024', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, '6a70504d-00df-4869-8695-0f442053f6b6': {'status': 'Active', 'diskfree': '532069482496', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 08:54:17,955::task::1185::TaskManager.Task::(prepare) Task=`d536233f-efdc-4e8b-b7d7-e5e0c69352c0`::finished: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': 'Active', 'diskfree': '1094948225024', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, '6a70504d-00df-4869-8695-0f442053f6b6': {'status': 'Active', 'diskfree': '532069482496', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 08:54:17,955::task::595::TaskManager.Task::(_updateState) Task=`d536233f-efdc-4e8b-b7d7-e5e0c69352c0`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-10 08:54:17,956::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee': < ResourceRef 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-10 08:54:17,956::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-10 08:54:17,956::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' >Thread-34::DEBUG::2014-07-10 08:54:17,956::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' (0 active users) >Thread-34::DEBUG::2014-07-10 08:54:17,956::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-10 08:54:17,957::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', Clearing records. >Thread-34::DEBUG::2014-07-10 08:54:17,957::task::990::TaskManager.Task::(_decref) Task=`d536233f-efdc-4e8b-b7d7-e5e0c69352c0`::ref 0 aborting False >Thread-34::DEBUG::2014-07-10 08:54:18,074::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-34::DEBUG::2014-07-10 08:54:18,074::task::595::TaskManager.Task::(_updateState) Task=`cfaf54b3-ec1e-4add-8471-a4d797f3c4cb`::moving from state init -> state preparing >Thread-34::INFO::2014-07-10 08:54:18,075::logUtils::44::dispatcher::(wrapper) Run and protect: getVmsInfo(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', sdUUID='6a70504d-00df-4869-8695-0f442053f6b6', vmList=[], options=None) >Thread-34::DEBUG::2014-07-10 08:54:18,075::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.6a70504d-00df-4869-8695-0f442053f6b6`ReqID=`1c0148b5-692b-4156-b159-9c308d111bbf`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '1423' at 'getVmsInfo' >Thread-34::DEBUG::2014-07-10 08:54:18,075::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.6a70504d-00df-4869-8695-0f442053f6b6' for lock type 'shared' >Thread-34::DEBUG::2014-07-10 08:54:18,076::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.6a70504d-00df-4869-8695-0f442053f6b6' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-10 08:54:18,076::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.6a70504d-00df-4869-8695-0f442053f6b6`ReqID=`1c0148b5-692b-4156-b159-9c308d111bbf`::Granted request >Thread-34::DEBUG::2014-07-10 08:54:18,076::task::827::TaskManager.Task::(resourceAcquired) Task=`cfaf54b3-ec1e-4add-8471-a4d797f3c4cb`::_resourcesAcquired: Storage.6a70504d-00df-4869-8695-0f442053f6b6 (shared) >Thread-34::DEBUG::2014-07-10 08:54:18,076::task::990::TaskManager.Task::(_decref) Task=`cfaf54b3-ec1e-4add-8471-a4d797f3c4cb`::ref 1 aborting False >Thread-34::INFO::2014-07-10 08:54:18,079::sd::595::Storage.StorageDomain::(getVMsList) vmList=['28c62278-4914-46da-aefa-4c8b65ef8bef'] >Thread-34::INFO::2014-07-10 08:54:18,079::sd::612::Storage.StorageDomain::(getVMsInfo) vmList=['28c62278-4914-46da-aefa-4c8b65ef8bef'] >Thread-34::INFO::2014-07-10 08:54:18,092::logUtils::47::dispatcher::(wrapper) Run and protect: getVmsInfo, Return response: {'vmlist': {'28c62278-4914-46da-aefa-4c8b65ef8bef': u'<?xml version=\'1.0\' encoding=\'UTF-8\'?><ovf:Envelope xmlns:ovf="http://schemas.dmtf.org/ovf/envelope/1/" xmlns:rasd="http://schemas.dmtf.org/wbem/wscim/1/cim-schema/2/CIM_ResourceAllocationSettingData" xmlns:vssd="http://schemas.dmtf.org/wbem/wscim/1/cim-schema/2/CIM_VirtualSystemSettingData" xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance" ovf:version="3.4.0.0"><References><File ovf:href="b8c3a0af-85ef-42d5-abd5-42a2c2371498/022d12c7-cf77-4c96-b939-4dd8d42a2127" ovf:id="022d12c7-cf77-4c96-b939-4dd8d42a2127" ovf:size="10737418240" ovf:description=""/><Nic ovf:id="ce6a114b-c8ec-4cdf-ab8b-b149cdcfffdd"/></References><Section xsi:type="ovf:NetworkSection_Type"><Info>List of networks</Info><Network ovf:name="Network 1"/></Section><Section xsi:type="ovf:DiskSection_Type"><Info>List of Virtual Disks</Info><Disk ovf:diskId="022d12c7-cf77-4c96-b939-4dd8d42a2127" ovf:size="10" ovf:actual_size="10" ovf:vm_snapshot_id="7db9d144-4112-4a71-bf2d-60de22d5c3c0" ovf:parentRef="" ovf:fileRef="b8c3a0af-85ef-42d5-abd5-42a2c2371498/022d12c7-cf77-4c96-b939-4dd8d42a2127" ovf:format="http://www.vmware.com/specifications/vmdk.html#sparse" ovf:volume-format="RAW" ovf:volume-type="Preallocated" ovf:disk-interface="VirtIO" ovf:boot="true" ovf:disk-alias="vm_4_fake_Disk1" ovf:wipe-after-delete="false"/></Section><Content ovf:id="out" xsi:type="ovf:VirtualSystem_Type"><Description></Description><CreationDate>2014/05/15 09:52:35</CreationDate><ExportDate>2014/06/23 10:43:07</ExportDate><DeleteProtected>false</DeleteProtected><SsoMethod>guest_agent</SsoMethod><IsSmartcardEnabled>false</IsSmartcardEnabled><TimeZone></TimeZone><default_boot_sequence>0</default_boot_sequence><Generation>1</Generation><VmType>1</VmType><MinAllocatedMem>2048</MinAllocatedMem><IsStateless>false</IsStateless><IsRunAndPause>false</IsRunAndPause><AutoStartup>false</AutoStartup><Priority>1</Priority><CreatedByUserId>fdfc627c-d875-11e0-90f0-83df133b58cc</CreatedByUserId><VmInit ovf:regenerateKeys="false" ovf:networks="[ ]"/><Name>templ_4_fake</Name><TemplateId>28c62278-4914-46da-aefa-4c8b65ef8bef</TemplateId><Origin>3</Origin><default_display_type>1</default_display_type><IsDisabled>false</IsDisabled><TrustedService>false</TrustedService><TemplateType>TEMPLATE</TemplateType><BaseTemplateId>28c62278-4914-46da-aefa-4c8b65ef8bef</BaseTemplateId><TemplateVersionNumber>1</TemplateVersionNumber><TemplateVersionName>base version</TemplateVersionName><Section ovf:id="28c62278-4914-46da-aefa-4c8b65ef8bef" ovf:required="false" xsi:type="ovf:OperatingSystemSection_Type"><Info>Guest Operating System</Info><Description>rhel_7x64</Description></Section><Section xsi:type="ovf:VirtualHardwareSection_Type"><Info>2 CPU, 2048 Memeory</Info><System><vssd:VirtualSystemType>ENGINE 3.4.0.0</vssd:VirtualSystemType></System><Item><rasd:Caption>2 virtual cpu</rasd:Caption><rasd:Description>Number of virtual CPU</rasd:Description><rasd:InstanceId>1</rasd:InstanceId><rasd:ResourceType>3</rasd:ResourceType><rasd:num_of_sockets>1</rasd:num_of_sockets><rasd:cpu_per_socket>2</rasd:cpu_per_socket></Item><Item><rasd:Caption>2048 MB of memory</rasd:Caption><rasd:Description>Memory Size</rasd:Description><rasd:InstanceId>2</rasd:InstanceId><rasd:ResourceType>4</rasd:ResourceType><rasd:AllocationUnits>MegaBytes</rasd:AllocationUnits><rasd:VirtualQuantity>2048</rasd:VirtualQuantity></Item><Item><rasd:Caption>vm_4_fake_Disk1</rasd:Caption><rasd:InstanceId>022d12c7-cf77-4c96-b939-4dd8d42a2127</rasd:InstanceId><rasd:ResourceType>17</rasd:ResourceType><rasd:HostResource>b8c3a0af-85ef-42d5-abd5-42a2c2371498/022d12c7-cf77-4c96-b939-4dd8d42a2127</rasd:HostResource><rasd:Parent>00000000-0000-0000-0000-000000000000</rasd:Parent><rasd:Template>00000000-0000-0000-0000-000000000000</rasd:Template><rasd:ApplicationList></rasd:ApplicationList><rasd:StorageId>5cb61565-ecf8-42a5-b9d7-57d6429feecc</rasd:StorageId><rasd:StoragePoolId>df949554-d4a9-43b0-9b0c-e9daaea2dac2</rasd:StoragePoolId><rasd:CreationDate>2014/05/27 06:42:35</rasd:CreationDate><rasd:LastModified>2014/05/27 06:42:37</rasd:LastModified><Type>disk</Type><Device>disk</Device><rasd:Address>{bus=0x00, domain=0x0000, type=pci, slot=0x06, function=0x0}</rasd:Address><BootOrder>0</BootOrder><IsPlugged>true</IsPlugged><IsReadOnly>false</IsReadOnly><Alias></Alias></Item><Item><rasd:Caption>Ethernet adapter on rhevm</rasd:Caption><rasd:InstanceId>ce6a114b-c8ec-4cdf-ab8b-b149cdcfffdd</rasd:InstanceId><rasd:ResourceType>10</rasd:ResourceType><rasd:OtherResourceType>rhevm</rasd:OtherResourceType><rasd:ResourceSubType>3</rasd:ResourceSubType><rasd:Connection>rhevm</rasd:Connection><rasd:Linked>true</rasd:Linked><rasd:Name>nic1</rasd:Name><rasd:speed>1000</rasd:speed><Type>interface</Type><Device>bridge</Device><rasd:Address></rasd:Address><BootOrder>0</BootOrder><IsPlugged>true</IsPlugged><IsReadOnly>false</IsReadOnly><Alias></Alias></Item><Item><rasd:Caption>USB Controller</rasd:Caption><rasd:InstanceId>3</rasd:InstanceId><rasd:ResourceType>23</rasd:ResourceType><rasd:UsbPolicy>DISABLED</rasd:UsbPolicy></Item><Item><rasd:Caption>Graphical Controller</rasd:Caption><rasd:InstanceId>3d61b1a1-0e4e-4888-bd75-f603c08b159a</rasd:InstanceId><rasd:ResourceType>20</rasd:ResourceType><rasd:VirtualQuantity>1</rasd:VirtualQuantity><rasd:SinglePciQxl>true</rasd:SinglePciQxl><Type>video</Type><Device>qxl</Device><rasd:Address>{bus=0x00, domain=0x0000, type=pci, slot=0x02, function=0x0}</rasd:Address><BootOrder>0</BootOrder><IsPlugged>true</IsPlugged><IsReadOnly>true</IsReadOnly><Alias>video0</Alias><SpecParams><ram>65536</ram><vram>32768</vram><heads>1</heads></SpecParams></Item><Item><rasd:Caption>CDROM</rasd:Caption><rasd:InstanceId>0984c4e9-afd6-4ea9-9fd2-ca6d653a6ab1</rasd:InstanceId><rasd:ResourceType>15</rasd:ResourceType><Type>disk</Type><Device>cdrom</Device><rasd:Address></rasd:Address><BootOrder>0</BootOrder><IsPlugged>true</IsPlugged><IsReadOnly>true</IsReadOnly><Alias></Alias></Item><Item><rasd:ResourceType>0</rasd:ResourceType><rasd:InstanceId>39c6518f-f6da-45ac-bf8b-55cc78472257</rasd:InstanceId><Type>channel</Type><Device>spicevmc</Device><rasd:Address>{port=3, bus=0, controller=0, type=virtio-serial}</rasd:Address><BootOrder>0</BootOrder><IsPlugged>true</IsPlugged><IsReadOnly>false</IsReadOnly><Alias>channel2</Alias></Item><Item><rasd:ResourceType>0</rasd:ResourceType><rasd:InstanceId>558be496-a5ae-4e6a-9fcf-409004b48e6f</rasd:InstanceId><Type>channel</Type><Device>unix</Device><rasd:Address>{port=2, bus=0, controller=0, type=virtio-serial}</rasd:Address><BootOrder>0</BootOrder><IsPlugged>true</IsPlugged><IsReadOnly>false</IsReadOnly><Alias>channel1</Alias></Item><Item><rasd:ResourceType>0</rasd:ResourceType><rasd:InstanceId>fabf5a03-c413-4ce1-8274-8980a0cdfc87</rasd:InstanceId><Type>controller</Type><Device>ide</Device><rasd:Address>{bus=0x00, domain=0x0000, type=pci, slot=0x01, function=0x1}</rasd:Address><BootOrder>0</BootOrder><IsPlugged>true</IsPlugged><IsReadOnly>false</IsReadOnly><Alias>ide0</Alias></Item><Item><rasd:ResourceType>0</rasd:ResourceType><rasd:InstanceId>054fc109-f3a5-4346-a389-a2a5729ca992</rasd:InstanceId><Type>channel</Type><Device>unix</Device><rasd:Address>{port=1, bus=0, controller=0, type=virtio-serial}</rasd:Address><BootOrder>0</BootOrder><IsPlugged>true</IsPlugged><IsReadOnly>false</IsReadOnly><Alias>channel0</Alias></Item><Item><rasd:ResourceType>0</rasd:ResourceType><rasd:InstanceId>6e6081e6-28e2-4fb7-b140-e0e65f00088b</rasd:InstanceId><Type>controller</Type><Device>virtio-serial</Device><rasd:Address>{bus=0x00, domain=0x0000, type=pci, slot=0x05, function=0x0}</rasd:Address><BootOrder>0</BootOrder><IsPlugged>true</IsPlugged><IsReadOnly>false</IsReadOnly><Alias>virtio-serial0</Alias></Item><Item><rasd:ResourceType>0</rasd:ResourceType><rasd:InstanceId>10c726a9-4c1d-4071-bc13-7b449d3ac3d9</rasd:InstanceId><Type>balloon</Type><Device>memballoon</Device><rasd:Address>{bus=0x00, domain=0x0000, type=pci, slot=0x07, function=0x0}</rasd:Address><BootOrder>0</BootOrder><IsPlugged>true</IsPlugged><IsReadOnly>true</IsReadOnly><Alias>balloon0</Alias><SpecParams><model>virtio</model></SpecParams></Item><Item><rasd:ResourceType>0</rasd:ResourceType><rasd:InstanceId>475d3bf8-cc8b-464b-81bf-f0163b133eed</rasd:InstanceId><Type>controller</Type><Device>usb</Device><rasd:Address>{bus=0x00, domain=0x0000, type=pci, slot=0x01, function=0x2}</rasd:Address><BootOrder>0</BootOrder><IsPlugged>true</IsPlugged><IsReadOnly>false</IsReadOnly><Alias>usb0</Alias></Item><Item><rasd:ResourceType>0</rasd:ResourceType><rasd:InstanceId>501b5f3e-edd9-43cf-9c73-c70d76bba636</rasd:InstanceId><Type>controller</Type><Device>virtio-scsi</Device><rasd:Address>{bus=0x00, domain=0x0000, type=pci, slot=0x04, function=0x0}</rasd:Address><BootOrder>0</BootOrder><IsPlugged>true</IsPlugged><IsReadOnly>false</IsReadOnly><Alias>scsi0</Alias></Item></Section></Content></ovf:Envelope>'}} >Thread-34::DEBUG::2014-07-10 08:54:18,093::task::1185::TaskManager.Task::(prepare) Task=`cfaf54b3-ec1e-4add-8471-a4d797f3c4cb`::finished: {'vmlist': {'28c62278-4914-46da-aefa-4c8b65ef8bef': u'<?xml version=\'1.0\' encoding=\'UTF-8\'?><ovf:Envelope xmlns:ovf="http://schemas.dmtf.org/ovf/envelope/1/" xmlns:rasd="http://schemas.dmtf.org/wbem/wscim/1/cim-schema/2/CIM_ResourceAllocationSettingData" xmlns:vssd="http://schemas.dmtf.org/wbem/wscim/1/cim-schema/2/CIM_VirtualSystemSettingData" xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance" ovf:version="3.4.0.0"><References><File ovf:href="b8c3a0af-85ef-42d5-abd5-42a2c2371498/022d12c7-cf77-4c96-b939-4dd8d42a2127" ovf:id="022d12c7-cf77-4c96-b939-4dd8d42a2127" ovf:size="10737418240" ovf:description=""/><Nic ovf:id="ce6a114b-c8ec-4cdf-ab8b-b149cdcfffdd"/></References><Section xsi:type="ovf:NetworkSection_Type"><Info>List of networks</Info><Network ovf:name="Network 1"/></Section><Section xsi:type="ovf:DiskSection_Type"><Info>List of Virtual Disks</Info><Disk ovf:diskId="022d12c7-cf77-4c96-b939-4dd8d42a2127" ovf:size="10" ovf:actual_size="10" ovf:vm_snapshot_id="7db9d144-4112-4a71-bf2d-60de22d5c3c0" ovf:parentRef="" ovf:fileRef="b8c3a0af-85ef-42d5-abd5-42a2c2371498/022d12c7-cf77-4c96-b939-4dd8d42a2127" ovf:format="http://www.vmware.com/specifications/vmdk.html#sparse" ovf:volume-format="RAW" ovf:volume-type="Preallocated" ovf:disk-interface="VirtIO" ovf:boot="true" ovf:disk-alias="vm_4_fake_Disk1" ovf:wipe-after-delete="false"/></Section><Content ovf:id="out" xsi:type="ovf:VirtualSystem_Type"><Description></Description><CreationDate>2014/05/15 09:52:35</CreationDate><ExportDate>2014/06/23 10:43:07</ExportDate><DeleteProtected>false</DeleteProtected><SsoMethod>guest_agent</SsoMethod><IsSmartcardEnabled>false</IsSmartcardEnabled><TimeZone></TimeZone><default_boot_sequence>0</default_boot_sequence><Generation>1</Generation><VmType>1</VmType><MinAllocatedMem>2048</MinAllocatedMem><IsStateless>false</IsStateless><IsRunAndPause>false</IsRunAndPause><AutoStartup>false</AutoStartup><Priority>1</Priority><CreatedByUserId>fdfc627c-d875-11e0-90f0-83df133b58cc</CreatedByUserId><VmInit ovf:regenerateKeys="false" ovf:networks="[ ]"/><Name>templ_4_fake</Name><TemplateId>28c62278-4914-46da-aefa-4c8b65ef8bef</TemplateId><Origin>3</Origin><default_display_type>1</default_display_type><IsDisabled>false</IsDisabled><TrustedService>false</TrustedService><TemplateType>TEMPLATE</TemplateType><BaseTemplateId>28c62278-4914-46da-aefa-4c8b65ef8bef</BaseTemplateId><TemplateVersionNumber>1</TemplateVersionNumber><TemplateVersionName>base version</TemplateVersionName><Section ovf:id="28c62278-4914-46da-aefa-4c8b65ef8bef" ovf:required="false" xsi:type="ovf:OperatingSystemSection_Type"><Info>Guest Operating System</Info><Description>rhel_7x64</Description></Section><Section xsi:type="ovf:VirtualHardwareSection_Type"><Info>2 CPU, 2048 Memeory</Info><System><vssd:VirtualSystemType>ENGINE 3.4.0.0</vssd:VirtualSystemType></System><Item><rasd:Caption>2 virtual cpu</rasd:Caption><rasd:Description>Number of virtual CPU</rasd:Description><rasd:InstanceId>1</rasd:InstanceId><rasd:ResourceType>3</rasd:ResourceType><rasd:num_of_sockets>1</rasd:num_of_sockets><rasd:cpu_per_socket>2</rasd:cpu_per_socket></Item><Item><rasd:Caption>2048 MB of memory</rasd:Caption><rasd:Description>Memory Size</rasd:Description><rasd:InstanceId>2</rasd:InstanceId><rasd:ResourceType>4</rasd:ResourceType><rasd:AllocationUnits>MegaBytes</rasd:AllocationUnits><rasd:VirtualQuantity>2048</rasd:VirtualQuantity></Item><Item><rasd:Caption>vm_4_fake_Disk1</rasd:Caption><rasd:InstanceId>022d12c7-cf77-4c96-b939-4dd8d42a2127</rasd:InstanceId><rasd:ResourceType>17</rasd:ResourceType><rasd:HostResource>b8c3a0af-85ef-42d5-abd5-42a2c2371498/022d12c7-cf77-4c96-b939-4dd8d42a2127</rasd:HostResource><rasd:Parent>00000000-0000-0000-0000-000000000000</rasd:Parent><rasd:Template>00000000-0000-0000-0000-000000000000</rasd:Template><rasd:ApplicationList></rasd:ApplicationList><rasd:StorageId>5cb61565-ecf8-42a5-b9d7-57d6429feecc</rasd:StorageId><rasd:StoragePoolId>df949554-d4a9-43b0-9b0c-e9daaea2dac2</rasd:StoragePoolId><rasd:CreationDate>2014/05/27 06:42:35</rasd:CreationDate><rasd:LastModified>2014/05/27 06:42:37</rasd:LastModified><Type>disk</Type><Device>disk</Device><rasd:Address>{bus=0x00, domain=0x0000, type=pci, slot=0x06, function=0x0}</rasd:Address><BootOrder>0</BootOrder><IsPlugged>true</IsPlugged><IsReadOnly>false</IsReadOnly><Alias></Alias></Item><Item><rasd:Caption>Ethernet adapter on rhevm</rasd:Caption><rasd:InstanceId>ce6a114b-c8ec-4cdf-ab8b-b149cdcfffdd</rasd:InstanceId><rasd:ResourceType>10</rasd:ResourceType><rasd:OtherResourceType>rhevm</rasd:OtherResourceType><rasd:ResourceSubType>3</rasd:ResourceSubType><rasd:Connection>rhevm</rasd:Connection><rasd:Linked>true</rasd:Linked><rasd:Name>nic1</rasd:Name><rasd:speed>1000</rasd:speed><Type>interface</Type><Device>bridge</Device><rasd:Address></rasd:Address><BootOrder>0</BootOrder><IsPlugged>true</IsPlugged><IsReadOnly>false</IsReadOnly><Alias></Alias></Item><Item><rasd:Caption>USB Controller</rasd:Caption><rasd:InstanceId>3</rasd:InstanceId><rasd:ResourceType>23</rasd:ResourceType><rasd:UsbPolicy>DISABLED</rasd:UsbPolicy></Item><Item><rasd:Caption>Graphical Controller</rasd:Caption><rasd:InstanceId>3d61b1a1-0e4e-4888-bd75-f603c08b159a</rasd:InstanceId><rasd:ResourceType>20</rasd:ResourceType><rasd:VirtualQuantity>1</rasd:VirtualQuantity><rasd:SinglePciQxl>true</rasd:SinglePciQxl><Type>video</Type><Device>qxl</Device><rasd:Address>{bus=0x00, domain=0x0000, type=pci, slot=0x02, function=0x0}</rasd:Address><BootOrder>0</BootOrder><IsPlugged>true</IsPlugged><IsReadOnly>true</IsReadOnly><Alias>video0</Alias><SpecParams><ram>65536</ram><vram>32768</vram><heads>1</heads></SpecParams></Item><Item><rasd:Caption>CDROM</rasd:Caption><rasd:InstanceId>0984c4e9-afd6-4ea9-9fd2-ca6d653a6ab1</rasd:InstanceId><rasd:ResourceType>15</rasd:ResourceType><Type>disk</Type><Device>cdrom</Device><rasd:Address></rasd:Address><BootOrder>0</BootOrder><IsPlugged>true</IsPlugged><IsReadOnly>true</IsReadOnly><Alias></Alias></Item><Item><rasd:ResourceType>0</rasd:ResourceType><rasd:InstanceId>39c6518f-f6da-45ac-bf8b-55cc78472257</rasd:InstanceId><Type>channel</Type><Device>spicevmc</Device><rasd:Address>{port=3, bus=0, controller=0, type=virtio-serial}</rasd:Address><BootOrder>0</BootOrder><IsPlugged>true</IsPlugged><IsReadOnly>false</IsReadOnly><Alias>channel2</Alias></Item><Item><rasd:ResourceType>0</rasd:ResourceType><rasd:InstanceId>558be496-a5ae-4e6a-9fcf-409004b48e6f</rasd:InstanceId><Type>channel</Type><Device>unix</Device><rasd:Address>{port=2, bus=0, controller=0, type=virtio-serial}</rasd:Address><BootOrder>0</BootOrder><IsPlugged>true</IsPlugged><IsReadOnly>false</IsReadOnly><Alias>channel1</Alias></Item><Item><rasd:ResourceType>0</rasd:ResourceType><rasd:InstanceId>fabf5a03-c413-4ce1-8274-8980a0cdfc87</rasd:InstanceId><Type>controller</Type><Device>ide</Device><rasd:Address>{bus=0x00, domain=0x0000, type=pci, slot=0x01, function=0x1}</rasd:Address><BootOrder>0</BootOrder><IsPlugged>true</IsPlugged><IsReadOnly>false</IsReadOnly><Alias>ide0</Alias></Item><Item><rasd:ResourceType>0</rasd:ResourceType><rasd:InstanceId>054fc109-f3a5-4346-a389-a2a5729ca992</rasd:InstanceId><Type>channel</Type><Device>unix</Device><rasd:Address>{port=1, bus=0, controller=0, type=virtio-serial}</rasd:Address><BootOrder>0</BootOrder><IsPlugged>true</IsPlugged><IsReadOnly>false</IsReadOnly><Alias>channel0</Alias></Item><Item><rasd:ResourceType>0</rasd:ResourceType><rasd:InstanceId>6e6081e6-28e2-4fb7-b140-e0e65f00088b</rasd:InstanceId><Type>controller</Type><Device>virtio-serial</Device><rasd:Address>{bus=0x00, domain=0x0000, type=pci, slot=0x05, function=0x0}</rasd:Address><BootOrder>0</BootOrder><IsPlugged>true</IsPlugged><IsReadOnly>false</IsReadOnly><Alias>virtio-serial0</Alias></Item><Item><rasd:ResourceType>0</rasd:ResourceType><rasd:InstanceId>10c726a9-4c1d-4071-bc13-7b449d3ac3d9</rasd:InstanceId><Type>balloon</Type><Device>memballoon</Device><rasd:Address>{bus=0x00, domain=0x0000, type=pci, slot=0x07, function=0x0}</rasd:Address><BootOrder>0</BootOrder><IsPlugged>true</IsPlugged><IsReadOnly>true</IsReadOnly><Alias>balloon0</Alias><SpecParams><model>virtio</model></SpecParams></Item><Item><rasd:ResourceType>0</rasd:ResourceType><rasd:InstanceId>475d3bf8-cc8b-464b-81bf-f0163b133eed</rasd:InstanceId><Type>controller</Type><Device>usb</Device><rasd:Address>{bus=0x00, domain=0x0000, type=pci, slot=0x01, function=0x2}</rasd:Address><BootOrder>0</BootOrder><IsPlugged>true</IsPlugged><IsReadOnly>false</IsReadOnly><Alias>usb0</Alias></Item><Item><rasd:ResourceType>0</rasd:ResourceType><rasd:InstanceId>501b5f3e-edd9-43cf-9c73-c70d76bba636</rasd:InstanceId><Type>controller</Type><Device>virtio-scsi</Device><rasd:Address>{bus=0x00, domain=0x0000, type=pci, slot=0x04, function=0x0}</rasd:Address><BootOrder>0</BootOrder><IsPlugged>true</IsPlugged><IsReadOnly>false</IsReadOnly><Alias>scsi0</Alias></Item></Section></Content></ovf:Envelope>'}} >Thread-34::DEBUG::2014-07-10 08:54:18,093::task::595::TaskManager.Task::(_updateState) Task=`cfaf54b3-ec1e-4add-8471-a4d797f3c4cb`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-10 08:54:18,093::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.6a70504d-00df-4869-8695-0f442053f6b6': < ResourceRef 'Storage.6a70504d-00df-4869-8695-0f442053f6b6', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-10 08:54:18,093::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-10 08:54:18,094::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.6a70504d-00df-4869-8695-0f442053f6b6' >Thread-34::DEBUG::2014-07-10 08:54:18,094::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.6a70504d-00df-4869-8695-0f442053f6b6' (0 active users) >Thread-34::DEBUG::2014-07-10 08:54:18,094::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.6a70504d-00df-4869-8695-0f442053f6b6' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-10 08:54:18,094::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.6a70504d-00df-4869-8695-0f442053f6b6', Clearing records. >Thread-34::DEBUG::2014-07-10 08:54:18,094::task::990::TaskManager.Task::(_decref) Task=`cfaf54b3-ec1e-4add-8471-a4d797f3c4cb`::ref 0 aborting False >Thread-40::DEBUG::2014-07-10 08:54:18,550::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lion.qa.lab.tlv.redhat.com:_export_yuri2_backup2/6a70504d-00df-4869-8695-0f442053f6b6/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-40::DEBUG::2014-07-10 08:54:18,562::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n369 bytes (369 B) copied, 0.000381284 s, 968 kB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 08:54:19,504::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 08:54:19,587::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0332091 s, 30.8 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 08:54:21,603::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 08:54:21,685::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0312056 s, 32.8 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-10 08:54:22,332::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/metadata bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-10 08:54:22,344::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000652485 s, 6.3 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 08:54:23,700::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 08:54:23,776::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0271524 s, 37.7 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 08:54:25,120::task::595::TaskManager.Task::(_updateState) Task=`2b748713-b5af-4478-b44e-2a27e204dfbe`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 08:54:25,120::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::INFO::2014-07-10 08:54:25,121::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000652485', 'lastCheck': '2.7', 'valid': True}, '6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000381284', 'lastCheck': '6.6', 'valid': True}} >Thread-14::DEBUG::2014-07-10 08:54:25,121::task::1185::TaskManager.Task::(prepare) Task=`2b748713-b5af-4478-b44e-2a27e204dfbe`::finished: {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000652485', 'lastCheck': '2.7', 'valid': True}, '6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000381284', 'lastCheck': '6.6', 'valid': True}} >Thread-14::DEBUG::2014-07-10 08:54:25,121::task::595::TaskManager.Task::(_updateState) Task=`2b748713-b5af-4478-b44e-2a27e204dfbe`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 08:54:25,121::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 08:54:25,121::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 08:54:25,122::task::990::TaskManager.Task::(_decref) Task=`2b748713-b5af-4478-b44e-2a27e204dfbe`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 08:54:25,792::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 08:54:25,900::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0580871 s, 17.6 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 08:54:27,915::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Thread-14::DEBUG::2014-07-10 08:54:27,988::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-14::DEBUG::2014-07-10 08:54:27,994::task::595::TaskManager.Task::(_updateState) Task=`7be7867b-a3f5-4413-b31f-583e0d00827b`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 08:54:27,997::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-14::INFO::2014-07-10 08:54:28,002::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 08:54:28,004::task::1185::TaskManager.Task::(prepare) Task=`7be7867b-a3f5-4413-b31f-583e0d00827b`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 08:54:28,007::task::595::TaskManager.Task::(_updateState) Task=`7be7867b-a3f5-4413-b31f-583e0d00827b`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 08:54:28,009::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 08:54:28,012::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 08:54:28,015::task::990::TaskManager.Task::(_decref) Task=`7be7867b-a3f5-4413-b31f-583e0d00827b`::ref 0 aborting False >Thread-34::DEBUG::2014-07-10 08:54:28,030::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-34::DEBUG::2014-07-10 08:54:28,034::task::595::TaskManager.Task::(_updateState) Task=`9ea54c59-db15-4829-9687-e5956bf70b33`::moving from state init -> state preparing >Thread-34::INFO::2014-07-10 08:54:28,038::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-34::DEBUG::2014-07-10 08:54:28,045::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`15eb0205-4773-464c-a67f-f95c1b13edf4`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-10 08:54:28,047::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' for lock type 'shared' >Thread-34::DEBUG::2014-07-10 08:54:28,051::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-10 08:54:28,054::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`15eb0205-4773-464c-a67f-f95c1b13edf4`::Granted request >Thread-34::DEBUG::2014-07-10 08:54:28,060::task::827::TaskManager.Task::(resourceAcquired) Task=`9ea54c59-db15-4829-9687-e5956bf70b33`::_resourcesAcquired: Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee (shared) >Thread-34::DEBUG::2014-07-10 08:54:28,062::task::990::TaskManager.Task::(_decref) Task=`9ea54c59-db15-4829-9687-e5956bf70b33`::ref 1 aborting False >Thread-34::INFO::2014-07-10 08:54:28,076::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': 'Active', 'diskfree': '1094948225024', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, '6a70504d-00df-4869-8695-0f442053f6b6': {'status': 'Active', 'diskfree': '532069482496', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 08:54:28,079::task::1185::TaskManager.Task::(prepare) Task=`9ea54c59-db15-4829-9687-e5956bf70b33`::finished: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': 'Active', 'diskfree': '1094948225024', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, '6a70504d-00df-4869-8695-0f442053f6b6': {'status': 'Active', 'diskfree': '532069482496', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Dummy-33::DEBUG::2014-07-10 08:54:28,080::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0267592 s, 38.3 MB/s\n'; <rc> = 0 >Thread-34::DEBUG::2014-07-10 08:54:28,083::task::595::TaskManager.Task::(_updateState) Task=`9ea54c59-db15-4829-9687-e5956bf70b33`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-10 08:54:28,085::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee': < ResourceRef 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-10 08:54:28,086::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-10 08:54:28,089::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' >Thread-34::DEBUG::2014-07-10 08:54:28,091::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' (0 active users) >Thread-34::DEBUG::2014-07-10 08:54:28,092::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-10 08:54:28,093::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', Clearing records. >Thread-34::DEBUG::2014-07-10 08:54:28,096::task::990::TaskManager.Task::(_decref) Task=`9ea54c59-db15-4829-9687-e5956bf70b33`::ref 0 aborting False >Thread-40::DEBUG::2014-07-10 08:54:28,592::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lion.qa.lab.tlv.redhat.com:_export_yuri2_backup2/6a70504d-00df-4869-8695-0f442053f6b6/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-40::DEBUG::2014-07-10 08:54:28,604::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n369 bytes (369 B) copied, 0.000469787 s, 785 kB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 08:54:30,117::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 08:54:30,202::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0339963 s, 30.1 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 08:54:32,217::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 08:54:32,298::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0301539 s, 34.0 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-10 08:54:32,377::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/metadata bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-10 08:54:32,388::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000640652 s, 6.4 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 08:54:34,314::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 08:54:34,397::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0318492 s, 32.2 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 08:54:36,413::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 08:54:36,500::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0359568 s, 28.5 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 08:54:38,132::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-14::DEBUG::2014-07-10 08:54:38,133::task::595::TaskManager.Task::(_updateState) Task=`f3b6c68f-38b4-45ca-be03-35b9c18cadf3`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 08:54:38,133::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-14::INFO::2014-07-10 08:54:38,134::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 08:54:38,134::task::1185::TaskManager.Task::(prepare) Task=`f3b6c68f-38b4-45ca-be03-35b9c18cadf3`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 08:54:38,134::task::595::TaskManager.Task::(_updateState) Task=`f3b6c68f-38b4-45ca-be03-35b9c18cadf3`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 08:54:38,135::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 08:54:38,135::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 08:54:38,135::task::990::TaskManager.Task::(_decref) Task=`f3b6c68f-38b4-45ca-be03-35b9c18cadf3`::ref 0 aborting False >Thread-34::DEBUG::2014-07-10 08:54:38,139::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-34::DEBUG::2014-07-10 08:54:38,139::task::595::TaskManager.Task::(_updateState) Task=`642ee149-5907-4bb7-b5db-72fa5cfee344`::moving from state init -> state preparing >Thread-34::INFO::2014-07-10 08:54:38,139::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-34::DEBUG::2014-07-10 08:54:38,140::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`69f95fee-c46e-4a50-8327-dab5f15e33f9`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-10 08:54:38,140::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' for lock type 'shared' >Thread-34::DEBUG::2014-07-10 08:54:38,141::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-10 08:54:38,141::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`69f95fee-c46e-4a50-8327-dab5f15e33f9`::Granted request >Thread-34::DEBUG::2014-07-10 08:54:38,141::task::827::TaskManager.Task::(resourceAcquired) Task=`642ee149-5907-4bb7-b5db-72fa5cfee344`::_resourcesAcquired: Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee (shared) >Thread-34::DEBUG::2014-07-10 08:54:38,142::task::990::TaskManager.Task::(_decref) Task=`642ee149-5907-4bb7-b5db-72fa5cfee344`::ref 1 aborting False >Thread-34::INFO::2014-07-10 08:54:38,143::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': 'Active', 'diskfree': '1094948225024', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, '6a70504d-00df-4869-8695-0f442053f6b6': {'status': 'Active', 'diskfree': '532069482496', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 08:54:38,143::task::1185::TaskManager.Task::(prepare) Task=`642ee149-5907-4bb7-b5db-72fa5cfee344`::finished: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': 'Active', 'diskfree': '1094948225024', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, '6a70504d-00df-4869-8695-0f442053f6b6': {'status': 'Active', 'diskfree': '532069482496', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 08:54:38,143::task::595::TaskManager.Task::(_updateState) Task=`642ee149-5907-4bb7-b5db-72fa5cfee344`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-10 08:54:38,143::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee': < ResourceRef 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-10 08:54:38,144::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-10 08:54:38,144::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' >Thread-34::DEBUG::2014-07-10 08:54:38,144::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' (0 active users) >Thread-34::DEBUG::2014-07-10 08:54:38,144::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-10 08:54:38,145::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', Clearing records. >Thread-34::DEBUG::2014-07-10 08:54:38,145::task::990::TaskManager.Task::(_decref) Task=`642ee149-5907-4bb7-b5db-72fa5cfee344`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 08:54:38,515::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Thread-40::DEBUG::2014-07-10 08:54:38,751::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lion.qa.lab.tlv.redhat.com:_export_yuri2_backup2/6a70504d-00df-4869-8695-0f442053f6b6/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-40::DEBUG::2014-07-10 08:54:38,784::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n369 bytes (369 B) copied, 0.000349557 s, 1.1 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 08:54:38,812::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0724149 s, 14.1 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 08:54:40,234::task::595::TaskManager.Task::(_updateState) Task=`58091cb8-e45f-49bb-b31e-852a1d534960`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 08:54:40,234::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::INFO::2014-07-10 08:54:40,235::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000640652', 'lastCheck': '7.8', 'valid': True}, '6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000349557', 'lastCheck': '1.4', 'valid': True}} >Thread-14::DEBUG::2014-07-10 08:54:40,235::task::1185::TaskManager.Task::(prepare) Task=`58091cb8-e45f-49bb-b31e-852a1d534960`::finished: {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000640652', 'lastCheck': '7.8', 'valid': True}, '6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000349557', 'lastCheck': '1.4', 'valid': True}} >Thread-14::DEBUG::2014-07-10 08:54:40,235::task::595::TaskManager.Task::(_updateState) Task=`58091cb8-e45f-49bb-b31e-852a1d534960`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 08:54:40,235::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 08:54:40,235::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 08:54:40,236::task::990::TaskManager.Task::(_decref) Task=`58091cb8-e45f-49bb-b31e-852a1d534960`::ref 0 aborting False >Thread-34::DEBUG::2014-07-10 08:54:40,673::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [62aff6f0] >Thread-34::DEBUG::2014-07-10 08:54:40,674::task::595::TaskManager.Task::(_updateState) Task=`e1eb8ae6-2938-4489-b30e-7bdee118bee3`::moving from state init -> state preparing >Thread-34::INFO::2014-07-10 08:54:40,675::logUtils::44::dispatcher::(wrapper) Run and protect: getVmsInfo(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', sdUUID='6a70504d-00df-4869-8695-0f442053f6b6', vmList=[], options=None) >Thread-34::DEBUG::2014-07-10 08:54:40,676::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.6a70504d-00df-4869-8695-0f442053f6b6`ReqID=`3098ae05-9a64-43da-a248-ebd11c70c470`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '1423' at 'getVmsInfo' >Thread-34::DEBUG::2014-07-10 08:54:40,676::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.6a70504d-00df-4869-8695-0f442053f6b6' for lock type 'shared' >Thread-34::DEBUG::2014-07-10 08:54:40,676::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.6a70504d-00df-4869-8695-0f442053f6b6' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-10 08:54:40,677::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.6a70504d-00df-4869-8695-0f442053f6b6`ReqID=`3098ae05-9a64-43da-a248-ebd11c70c470`::Granted request >Thread-34::DEBUG::2014-07-10 08:54:40,677::task::827::TaskManager.Task::(resourceAcquired) Task=`e1eb8ae6-2938-4489-b30e-7bdee118bee3`::_resourcesAcquired: Storage.6a70504d-00df-4869-8695-0f442053f6b6 (shared) >Thread-34::DEBUG::2014-07-10 08:54:40,677::task::990::TaskManager.Task::(_decref) Task=`e1eb8ae6-2938-4489-b30e-7bdee118bee3`::ref 1 aborting False >Thread-34::INFO::2014-07-10 08:54:40,679::sd::595::Storage.StorageDomain::(getVMsList) vmList=['28c62278-4914-46da-aefa-4c8b65ef8bef'] >Thread-34::INFO::2014-07-10 08:54:40,679::sd::612::Storage.StorageDomain::(getVMsInfo) vmList=['28c62278-4914-46da-aefa-4c8b65ef8bef'] >Thread-34::INFO::2014-07-10 08:54:40,681::logUtils::47::dispatcher::(wrapper) Run and protect: getVmsInfo, Return response: {'vmlist': {'28c62278-4914-46da-aefa-4c8b65ef8bef': u'<?xml version=\'1.0\' encoding=\'UTF-8\'?><ovf:Envelope xmlns:ovf="http://schemas.dmtf.org/ovf/envelope/1/" xmlns:rasd="http://schemas.dmtf.org/wbem/wscim/1/cim-schema/2/CIM_ResourceAllocationSettingData" xmlns:vssd="http://schemas.dmtf.org/wbem/wscim/1/cim-schema/2/CIM_VirtualSystemSettingData" xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance" ovf:version="3.4.0.0"><References><File ovf:href="b8c3a0af-85ef-42d5-abd5-42a2c2371498/022d12c7-cf77-4c96-b939-4dd8d42a2127" ovf:id="022d12c7-cf77-4c96-b939-4dd8d42a2127" ovf:size="10737418240" ovf:description=""/><Nic ovf:id="ce6a114b-c8ec-4cdf-ab8b-b149cdcfffdd"/></References><Section xsi:type="ovf:NetworkSection_Type"><Info>List of networks</Info><Network ovf:name="Network 1"/></Section><Section xsi:type="ovf:DiskSection_Type"><Info>List of Virtual Disks</Info><Disk ovf:diskId="022d12c7-cf77-4c96-b939-4dd8d42a2127" ovf:size="10" ovf:actual_size="10" ovf:vm_snapshot_id="7db9d144-4112-4a71-bf2d-60de22d5c3c0" ovf:parentRef="" ovf:fileRef="b8c3a0af-85ef-42d5-abd5-42a2c2371498/022d12c7-cf77-4c96-b939-4dd8d42a2127" ovf:format="http://www.vmware.com/specifications/vmdk.html#sparse" ovf:volume-format="RAW" ovf:volume-type="Preallocated" ovf:disk-interface="VirtIO" ovf:boot="true" ovf:disk-alias="vm_4_fake_Disk1" ovf:wipe-after-delete="false"/></Section><Content ovf:id="out" xsi:type="ovf:VirtualSystem_Type"><Description></Description><CreationDate>2014/05/15 09:52:35</CreationDate><ExportDate>2014/06/23 10:43:07</ExportDate><DeleteProtected>false</DeleteProtected><SsoMethod>guest_agent</SsoMethod><IsSmartcardEnabled>false</IsSmartcardEnabled><TimeZone></TimeZone><default_boot_sequence>0</default_boot_sequence><Generation>1</Generation><VmType>1</VmType><MinAllocatedMem>2048</MinAllocatedMem><IsStateless>false</IsStateless><IsRunAndPause>false</IsRunAndPause><AutoStartup>false</AutoStartup><Priority>1</Priority><CreatedByUserId>fdfc627c-d875-11e0-90f0-83df133b58cc</CreatedByUserId><VmInit ovf:regenerateKeys="false" ovf:networks="[ ]"/><Name>templ_4_fake</Name><TemplateId>28c62278-4914-46da-aefa-4c8b65ef8bef</TemplateId><Origin>3</Origin><default_display_type>1</default_display_type><IsDisabled>false</IsDisabled><TrustedService>false</TrustedService><TemplateType>TEMPLATE</TemplateType><BaseTemplateId>28c62278-4914-46da-aefa-4c8b65ef8bef</BaseTemplateId><TemplateVersionNumber>1</TemplateVersionNumber><TemplateVersionName>base version</TemplateVersionName><Section ovf:id="28c62278-4914-46da-aefa-4c8b65ef8bef" ovf:required="false" xsi:type="ovf:OperatingSystemSection_Type"><Info>Guest Operating System</Info><Description>rhel_7x64</Description></Section><Section xsi:type="ovf:VirtualHardwareSection_Type"><Info>2 CPU, 2048 Memeory</Info><System><vssd:VirtualSystemType>ENGINE 3.4.0.0</vssd:VirtualSystemType></System><Item><rasd:Caption>2 virtual cpu</rasd:Caption><rasd:Description>Number of virtual CPU</rasd:Description><rasd:InstanceId>1</rasd:InstanceId><rasd:ResourceType>3</rasd:ResourceType><rasd:num_of_sockets>1</rasd:num_of_sockets><rasd:cpu_per_socket>2</rasd:cpu_per_socket></Item><Item><rasd:Caption>2048 MB of memory</rasd:Caption><rasd:Description>Memory Size</rasd:Description><rasd:InstanceId>2</rasd:InstanceId><rasd:ResourceType>4</rasd:ResourceType><rasd:AllocationUnits>MegaBytes</rasd:AllocationUnits><rasd:VirtualQuantity>2048</rasd:VirtualQuantity></Item><Item><rasd:Caption>vm_4_fake_Disk1</rasd:Caption><rasd:InstanceId>022d12c7-cf77-4c96-b939-4dd8d42a2127</rasd:InstanceId><rasd:ResourceType>17</rasd:ResourceType><rasd:HostResource>b8c3a0af-85ef-42d5-abd5-42a2c2371498/022d12c7-cf77-4c96-b939-4dd8d42a2127</rasd:HostResource><rasd:Parent>00000000-0000-0000-0000-000000000000</rasd:Parent><rasd:Template>00000000-0000-0000-0000-000000000000</rasd:Template><rasd:ApplicationList></rasd:ApplicationList><rasd:StorageId>5cb61565-ecf8-42a5-b9d7-57d6429feecc</rasd:StorageId><rasd:StoragePoolId>df949554-d4a9-43b0-9b0c-e9daaea2dac2</rasd:StoragePoolId><rasd:CreationDate>2014/05/27 06:42:35</rasd:CreationDate><rasd:LastModified>2014/05/27 06:42:37</rasd:LastModified><Type>disk</Type><Device>disk</Device><rasd:Address>{bus=0x00, domain=0x0000, type=pci, slot=0x06, function=0x0}</rasd:Address><BootOrder>0</BootOrder><IsPlugged>true</IsPlugged><IsReadOnly>false</IsReadOnly><Alias></Alias></Item><Item><rasd:Caption>Ethernet adapter on rhevm</rasd:Caption><rasd:InstanceId>ce6a114b-c8ec-4cdf-ab8b-b149cdcfffdd</rasd:InstanceId><rasd:ResourceType>10</rasd:ResourceType><rasd:OtherResourceType>rhevm</rasd:OtherResourceType><rasd:ResourceSubType>3</rasd:ResourceSubType><rasd:Connection>rhevm</rasd:Connection><rasd:Linked>true</rasd:Linked><rasd:Name>nic1</rasd:Name><rasd:speed>1000</rasd:speed><Type>interface</Type><Device>bridge</Device><rasd:Address></rasd:Address><BootOrder>0</BootOrder><IsPlugged>true</IsPlugged><IsReadOnly>false</IsReadOnly><Alias></Alias></Item><Item><rasd:Caption>USB Controller</rasd:Caption><rasd:InstanceId>3</rasd:InstanceId><rasd:ResourceType>23</rasd:ResourceType><rasd:UsbPolicy>DISABLED</rasd:UsbPolicy></Item><Item><rasd:Caption>Graphical Controller</rasd:Caption><rasd:InstanceId>3d61b1a1-0e4e-4888-bd75-f603c08b159a</rasd:InstanceId><rasd:ResourceType>20</rasd:ResourceType><rasd:VirtualQuantity>1</rasd:VirtualQuantity><rasd:SinglePciQxl>true</rasd:SinglePciQxl><Type>video</Type><Device>qxl</Device><rasd:Address>{bus=0x00, domain=0x0000, type=pci, slot=0x02, function=0x0}</rasd:Address><BootOrder>0</BootOrder><IsPlugged>true</IsPlugged><IsReadOnly>true</IsReadOnly><Alias>video0</Alias><SpecParams><ram>65536</ram><vram>32768</vram><heads>1</heads></SpecParams></Item><Item><rasd:Caption>CDROM</rasd:Caption><rasd:InstanceId>0984c4e9-afd6-4ea9-9fd2-ca6d653a6ab1</rasd:InstanceId><rasd:ResourceType>15</rasd:ResourceType><Type>disk</Type><Device>cdrom</Device><rasd:Address></rasd:Address><BootOrder>0</BootOrder><IsPlugged>true</IsPlugged><IsReadOnly>true</IsReadOnly><Alias></Alias></Item><Item><rasd:ResourceType>0</rasd:ResourceType><rasd:InstanceId>39c6518f-f6da-45ac-bf8b-55cc78472257</rasd:InstanceId><Type>channel</Type><Device>spicevmc</Device><rasd:Address>{port=3, bus=0, controller=0, type=virtio-serial}</rasd:Address><BootOrder>0</BootOrder><IsPlugged>true</IsPlugged><IsReadOnly>false</IsReadOnly><Alias>channel2</Alias></Item><Item><rasd:ResourceType>0</rasd:ResourceType><rasd:InstanceId>558be496-a5ae-4e6a-9fcf-409004b48e6f</rasd:InstanceId><Type>channel</Type><Device>unix</Device><rasd:Address>{port=2, bus=0, controller=0, type=virtio-serial}</rasd:Address><BootOrder>0</BootOrder><IsPlugged>true</IsPlugged><IsReadOnly>false</IsReadOnly><Alias>channel1</Alias></Item><Item><rasd:ResourceType>0</rasd:ResourceType><rasd:InstanceId>fabf5a03-c413-4ce1-8274-8980a0cdfc87</rasd:InstanceId><Type>controller</Type><Device>ide</Device><rasd:Address>{bus=0x00, domain=0x0000, type=pci, slot=0x01, function=0x1}</rasd:Address><BootOrder>0</BootOrder><IsPlugged>true</IsPlugged><IsReadOnly>false</IsReadOnly><Alias>ide0</Alias></Item><Item><rasd:ResourceType>0</rasd:ResourceType><rasd:InstanceId>054fc109-f3a5-4346-a389-a2a5729ca992</rasd:InstanceId><Type>channel</Type><Device>unix</Device><rasd:Address>{port=1, bus=0, controller=0, type=virtio-serial}</rasd:Address><BootOrder>0</BootOrder><IsPlugged>true</IsPlugged><IsReadOnly>false</IsReadOnly><Alias>channel0</Alias></Item><Item><rasd:ResourceType>0</rasd:ResourceType><rasd:InstanceId>6e6081e6-28e2-4fb7-b140-e0e65f00088b</rasd:InstanceId><Type>controller</Type><Device>virtio-serial</Device><rasd:Address>{bus=0x00, domain=0x0000, type=pci, slot=0x05, function=0x0}</rasd:Address><BootOrder>0</BootOrder><IsPlugged>true</IsPlugged><IsReadOnly>false</IsReadOnly><Alias>virtio-serial0</Alias></Item><Item><rasd:ResourceType>0</rasd:ResourceType><rasd:InstanceId>10c726a9-4c1d-4071-bc13-7b449d3ac3d9</rasd:InstanceId><Type>balloon</Type><Device>memballoon</Device><rasd:Address>{bus=0x00, domain=0x0000, type=pci, slot=0x07, function=0x0}</rasd:Address><BootOrder>0</BootOrder><IsPlugged>true</IsPlugged><IsReadOnly>true</IsReadOnly><Alias>balloon0</Alias><SpecParams><model>virtio</model></SpecParams></Item><Item><rasd:ResourceType>0</rasd:ResourceType><rasd:InstanceId>475d3bf8-cc8b-464b-81bf-f0163b133eed</rasd:InstanceId><Type>controller</Type><Device>usb</Device><rasd:Address>{bus=0x00, domain=0x0000, type=pci, slot=0x01, function=0x2}</rasd:Address><BootOrder>0</BootOrder><IsPlugged>true</IsPlugged><IsReadOnly>false</IsReadOnly><Alias>usb0</Alias></Item><Item><rasd:ResourceType>0</rasd:ResourceType><rasd:InstanceId>501b5f3e-edd9-43cf-9c73-c70d76bba636</rasd:InstanceId><Type>controller</Type><Device>virtio-scsi</Device><rasd:Address>{bus=0x00, domain=0x0000, type=pci, slot=0x04, function=0x0}</rasd:Address><BootOrder>0</BootOrder><IsPlugged>true</IsPlugged><IsReadOnly>false</IsReadOnly><Alias>scsi0</Alias></Item></Section></Content></ovf:Envelope>'}} >Thread-34::DEBUG::2014-07-10 08:54:40,681::task::1185::TaskManager.Task::(prepare) Task=`e1eb8ae6-2938-4489-b30e-7bdee118bee3`::finished: {'vmlist': {'28c62278-4914-46da-aefa-4c8b65ef8bef': u'<?xml version=\'1.0\' encoding=\'UTF-8\'?><ovf:Envelope xmlns:ovf="http://schemas.dmtf.org/ovf/envelope/1/" xmlns:rasd="http://schemas.dmtf.org/wbem/wscim/1/cim-schema/2/CIM_ResourceAllocationSettingData" xmlns:vssd="http://schemas.dmtf.org/wbem/wscim/1/cim-schema/2/CIM_VirtualSystemSettingData" xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance" ovf:version="3.4.0.0"><References><File ovf:href="b8c3a0af-85ef-42d5-abd5-42a2c2371498/022d12c7-cf77-4c96-b939-4dd8d42a2127" ovf:id="022d12c7-cf77-4c96-b939-4dd8d42a2127" ovf:size="10737418240" ovf:description=""/><Nic ovf:id="ce6a114b-c8ec-4cdf-ab8b-b149cdcfffdd"/></References><Section xsi:type="ovf:NetworkSection_Type"><Info>List of networks</Info><Network ovf:name="Network 1"/></Section><Section xsi:type="ovf:DiskSection_Type"><Info>List of Virtual Disks</Info><Disk ovf:diskId="022d12c7-cf77-4c96-b939-4dd8d42a2127" ovf:size="10" ovf:actual_size="10" ovf:vm_snapshot_id="7db9d144-4112-4a71-bf2d-60de22d5c3c0" ovf:parentRef="" ovf:fileRef="b8c3a0af-85ef-42d5-abd5-42a2c2371498/022d12c7-cf77-4c96-b939-4dd8d42a2127" ovf:format="http://www.vmware.com/specifications/vmdk.html#sparse" ovf:volume-format="RAW" ovf:volume-type="Preallocated" ovf:disk-interface="VirtIO" ovf:boot="true" ovf:disk-alias="vm_4_fake_Disk1" ovf:wipe-after-delete="false"/></Section><Content ovf:id="out" xsi:type="ovf:VirtualSystem_Type"><Description></Description><CreationDate>2014/05/15 09:52:35</CreationDate><ExportDate>2014/06/23 10:43:07</ExportDate><DeleteProtected>false</DeleteProtected><SsoMethod>guest_agent</SsoMethod><IsSmartcardEnabled>false</IsSmartcardEnabled><TimeZone></TimeZone><default_boot_sequence>0</default_boot_sequence><Generation>1</Generation><VmType>1</VmType><MinAllocatedMem>2048</MinAllocatedMem><IsStateless>false</IsStateless><IsRunAndPause>false</IsRunAndPause><AutoStartup>false</AutoStartup><Priority>1</Priority><CreatedByUserId>fdfc627c-d875-11e0-90f0-83df133b58cc</CreatedByUserId><VmInit ovf:regenerateKeys="false" ovf:networks="[ ]"/><Name>templ_4_fake</Name><TemplateId>28c62278-4914-46da-aefa-4c8b65ef8bef</TemplateId><Origin>3</Origin><default_display_type>1</default_display_type><IsDisabled>false</IsDisabled><TrustedService>false</TrustedService><TemplateType>TEMPLATE</TemplateType><BaseTemplateId>28c62278-4914-46da-aefa-4c8b65ef8bef</BaseTemplateId><TemplateVersionNumber>1</TemplateVersionNumber><TemplateVersionName>base version</TemplateVersionName><Section ovf:id="28c62278-4914-46da-aefa-4c8b65ef8bef" ovf:required="false" xsi:type="ovf:OperatingSystemSection_Type"><Info>Guest Operating System</Info><Description>rhel_7x64</Description></Section><Section xsi:type="ovf:VirtualHardwareSection_Type"><Info>2 CPU, 2048 Memeory</Info><System><vssd:VirtualSystemType>ENGINE 3.4.0.0</vssd:VirtualSystemType></System><Item><rasd:Caption>2 virtual cpu</rasd:Caption><rasd:Description>Number of virtual CPU</rasd:Description><rasd:InstanceId>1</rasd:InstanceId><rasd:ResourceType>3</rasd:ResourceType><rasd:num_of_sockets>1</rasd:num_of_sockets><rasd:cpu_per_socket>2</rasd:cpu_per_socket></Item><Item><rasd:Caption>2048 MB of memory</rasd:Caption><rasd:Description>Memory Size</rasd:Description><rasd:InstanceId>2</rasd:InstanceId><rasd:ResourceType>4</rasd:ResourceType><rasd:AllocationUnits>MegaBytes</rasd:AllocationUnits><rasd:VirtualQuantity>2048</rasd:VirtualQuantity></Item><Item><rasd:Caption>vm_4_fake_Disk1</rasd:Caption><rasd:InstanceId>022d12c7-cf77-4c96-b939-4dd8d42a2127</rasd:InstanceId><rasd:ResourceType>17</rasd:ResourceType><rasd:HostResource>b8c3a0af-85ef-42d5-abd5-42a2c2371498/022d12c7-cf77-4c96-b939-4dd8d42a2127</rasd:HostResource><rasd:Parent>00000000-0000-0000-0000-000000000000</rasd:Parent><rasd:Template>00000000-0000-0000-0000-000000000000</rasd:Template><rasd:ApplicationList></rasd:ApplicationList><rasd:StorageId>5cb61565-ecf8-42a5-b9d7-57d6429feecc</rasd:StorageId><rasd:StoragePoolId>df949554-d4a9-43b0-9b0c-e9daaea2dac2</rasd:StoragePoolId><rasd:CreationDate>2014/05/27 06:42:35</rasd:CreationDate><rasd:LastModified>2014/05/27 06:42:37</rasd:LastModified><Type>disk</Type><Device>disk</Device><rasd:Address>{bus=0x00, domain=0x0000, type=pci, slot=0x06, function=0x0}</rasd:Address><BootOrder>0</BootOrder><IsPlugged>true</IsPlugged><IsReadOnly>false</IsReadOnly><Alias></Alias></Item><Item><rasd:Caption>Ethernet adapter on rhevm</rasd:Caption><rasd:InstanceId>ce6a114b-c8ec-4cdf-ab8b-b149cdcfffdd</rasd:InstanceId><rasd:ResourceType>10</rasd:ResourceType><rasd:OtherResourceType>rhevm</rasd:OtherResourceType><rasd:ResourceSubType>3</rasd:ResourceSubType><rasd:Connection>rhevm</rasd:Connection><rasd:Linked>true</rasd:Linked><rasd:Name>nic1</rasd:Name><rasd:speed>1000</rasd:speed><Type>interface</Type><Device>bridge</Device><rasd:Address></rasd:Address><BootOrder>0</BootOrder><IsPlugged>true</IsPlugged><IsReadOnly>false</IsReadOnly><Alias></Alias></Item><Item><rasd:Caption>USB Controller</rasd:Caption><rasd:InstanceId>3</rasd:InstanceId><rasd:ResourceType>23</rasd:ResourceType><rasd:UsbPolicy>DISABLED</rasd:UsbPolicy></Item><Item><rasd:Caption>Graphical Controller</rasd:Caption><rasd:InstanceId>3d61b1a1-0e4e-4888-bd75-f603c08b159a</rasd:InstanceId><rasd:ResourceType>20</rasd:ResourceType><rasd:VirtualQuantity>1</rasd:VirtualQuantity><rasd:SinglePciQxl>true</rasd:SinglePciQxl><Type>video</Type><Device>qxl</Device><rasd:Address>{bus=0x00, domain=0x0000, type=pci, slot=0x02, function=0x0}</rasd:Address><BootOrder>0</BootOrder><IsPlugged>true</IsPlugged><IsReadOnly>true</IsReadOnly><Alias>video0</Alias><SpecParams><ram>65536</ram><vram>32768</vram><heads>1</heads></SpecParams></Item><Item><rasd:Caption>CDROM</rasd:Caption><rasd:InstanceId>0984c4e9-afd6-4ea9-9fd2-ca6d653a6ab1</rasd:InstanceId><rasd:ResourceType>15</rasd:ResourceType><Type>disk</Type><Device>cdrom</Device><rasd:Address></rasd:Address><BootOrder>0</BootOrder><IsPlugged>true</IsPlugged><IsReadOnly>true</IsReadOnly><Alias></Alias></Item><Item><rasd:ResourceType>0</rasd:ResourceType><rasd:InstanceId>39c6518f-f6da-45ac-bf8b-55cc78472257</rasd:InstanceId><Type>channel</Type><Device>spicevmc</Device><rasd:Address>{port=3, bus=0, controller=0, type=virtio-serial}</rasd:Address><BootOrder>0</BootOrder><IsPlugged>true</IsPlugged><IsReadOnly>false</IsReadOnly><Alias>channel2</Alias></Item><Item><rasd:ResourceType>0</rasd:ResourceType><rasd:InstanceId>558be496-a5ae-4e6a-9fcf-409004b48e6f</rasd:InstanceId><Type>channel</Type><Device>unix</Device><rasd:Address>{port=2, bus=0, controller=0, type=virtio-serial}</rasd:Address><BootOrder>0</BootOrder><IsPlugged>true</IsPlugged><IsReadOnly>false</IsReadOnly><Alias>channel1</Alias></Item><Item><rasd:ResourceType>0</rasd:ResourceType><rasd:InstanceId>fabf5a03-c413-4ce1-8274-8980a0cdfc87</rasd:InstanceId><Type>controller</Type><Device>ide</Device><rasd:Address>{bus=0x00, domain=0x0000, type=pci, slot=0x01, function=0x1}</rasd:Address><BootOrder>0</BootOrder><IsPlugged>true</IsPlugged><IsReadOnly>false</IsReadOnly><Alias>ide0</Alias></Item><Item><rasd:ResourceType>0</rasd:ResourceType><rasd:InstanceId>054fc109-f3a5-4346-a389-a2a5729ca992</rasd:InstanceId><Type>channel</Type><Device>unix</Device><rasd:Address>{port=1, bus=0, controller=0, type=virtio-serial}</rasd:Address><BootOrder>0</BootOrder><IsPlugged>true</IsPlugged><IsReadOnly>false</IsReadOnly><Alias>channel0</Alias></Item><Item><rasd:ResourceType>0</rasd:ResourceType><rasd:InstanceId>6e6081e6-28e2-4fb7-b140-e0e65f00088b</rasd:InstanceId><Type>controller</Type><Device>virtio-serial</Device><rasd:Address>{bus=0x00, domain=0x0000, type=pci, slot=0x05, function=0x0}</rasd:Address><BootOrder>0</BootOrder><IsPlugged>true</IsPlugged><IsReadOnly>false</IsReadOnly><Alias>virtio-serial0</Alias></Item><Item><rasd:ResourceType>0</rasd:ResourceType><rasd:InstanceId>10c726a9-4c1d-4071-bc13-7b449d3ac3d9</rasd:InstanceId><Type>balloon</Type><Device>memballoon</Device><rasd:Address>{bus=0x00, domain=0x0000, type=pci, slot=0x07, function=0x0}</rasd:Address><BootOrder>0</BootOrder><IsPlugged>true</IsPlugged><IsReadOnly>true</IsReadOnly><Alias>balloon0</Alias><SpecParams><model>virtio</model></SpecParams></Item><Item><rasd:ResourceType>0</rasd:ResourceType><rasd:InstanceId>475d3bf8-cc8b-464b-81bf-f0163b133eed</rasd:InstanceId><Type>controller</Type><Device>usb</Device><rasd:Address>{bus=0x00, domain=0x0000, type=pci, slot=0x01, function=0x2}</rasd:Address><BootOrder>0</BootOrder><IsPlugged>true</IsPlugged><IsReadOnly>false</IsReadOnly><Alias>usb0</Alias></Item><Item><rasd:ResourceType>0</rasd:ResourceType><rasd:InstanceId>501b5f3e-edd9-43cf-9c73-c70d76bba636</rasd:InstanceId><Type>controller</Type><Device>virtio-scsi</Device><rasd:Address>{bus=0x00, domain=0x0000, type=pci, slot=0x04, function=0x0}</rasd:Address><BootOrder>0</BootOrder><IsPlugged>true</IsPlugged><IsReadOnly>false</IsReadOnly><Alias>scsi0</Alias></Item></Section></Content></ovf:Envelope>'}} >Thread-34::DEBUG::2014-07-10 08:54:40,681::task::595::TaskManager.Task::(_updateState) Task=`e1eb8ae6-2938-4489-b30e-7bdee118bee3`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-10 08:54:40,682::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.6a70504d-00df-4869-8695-0f442053f6b6': < ResourceRef 'Storage.6a70504d-00df-4869-8695-0f442053f6b6', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-10 08:54:40,682::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-10 08:54:40,682::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.6a70504d-00df-4869-8695-0f442053f6b6' >Thread-34::DEBUG::2014-07-10 08:54:40,682::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.6a70504d-00df-4869-8695-0f442053f6b6' (0 active users) >Thread-34::DEBUG::2014-07-10 08:54:40,682::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.6a70504d-00df-4869-8695-0f442053f6b6' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-10 08:54:40,683::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.6a70504d-00df-4869-8695-0f442053f6b6', Clearing records. >Thread-34::DEBUG::2014-07-10 08:54:40,683::task::990::TaskManager.Task::(_decref) Task=`e1eb8ae6-2938-4489-b30e-7bdee118bee3`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 08:54:40,826::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 08:54:40,948::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0716672 s, 14.3 MB/s\n'; <rc> = 0 >Thread-34::DEBUG::2014-07-10 08:54:41,016::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [155db6e] >Thread-34::DEBUG::2014-07-10 08:54:41,017::task::595::TaskManager.Task::(_updateState) Task=`9a3a6f4f-bc9b-484a-8a3e-851d8fdafecf`::moving from state init -> state preparing >Thread-34::INFO::2014-07-10 08:54:41,018::logUtils::44::dispatcher::(wrapper) Run and protect: copyImage(sdUUID='6a70504d-00df-4869-8695-0f442053f6b6', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', vmUUID='', srcImgUUID='b8c3a0af-85ef-42d5-abd5-42a2c2371498', srcVolUUID='022d12c7-cf77-4c96-b939-4dd8d42a2127', dstImgUUID='9cf413b7-7f14-4a61-8c71-913e5b0ea9c0', dstVolUUID='47592965-e853-4e59-9728-d11cca6a7a8a', description='', dstSdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', volType=6, volFormat=5, preallocate=1, postZero='false', force='false') >Thread-34::DEBUG::2014-07-10 08:54:41,021::fileVolume::529::Storage.Volume::(validateVolumePath) validate path for 022d12c7-cf77-4c96-b939-4dd8d42a2127 >Thread-34::INFO::2014-07-10 08:54:41,046::image::285::Storage.Image::(isLegal) image b8c3a0af-85ef-42d5-abd5-42a2c2371498 in domain 6a70504d-00df-4869-8695-0f442053f6b6 has vollist ['022d12c7-cf77-4c96-b939-4dd8d42a2127'] >Thread-34::DEBUG::2014-07-10 08:54:41,047::fileVolume::529::Storage.Volume::(validateVolumePath) validate path for 022d12c7-cf77-4c96-b939-4dd8d42a2127 >Thread-34::DEBUG::2014-07-10 08:54:41,053::fileVolume::529::Storage.Volume::(validateVolumePath) validate path for 022d12c7-cf77-4c96-b939-4dd8d42a2127 >Thread-34::DEBUG::2014-07-10 08:54:41,057::fileVolume::529::Storage.Volume::(validateVolumePath) validate path for 022d12c7-cf77-4c96-b939-4dd8d42a2127 >Thread-34::DEBUG::2014-07-10 08:54:41,062::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.6a70504d-00df-4869-8695-0f442053f6b6`ReqID=`a9443b89-6e53-4c22-abeb-486d1769d648`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '1792' at 'copyImage' >Thread-34::DEBUG::2014-07-10 08:54:41,062::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.6a70504d-00df-4869-8695-0f442053f6b6' for lock type 'shared' >Thread-34::DEBUG::2014-07-10 08:54:41,063::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.6a70504d-00df-4869-8695-0f442053f6b6' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-10 08:54:41,063::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.6a70504d-00df-4869-8695-0f442053f6b6`ReqID=`a9443b89-6e53-4c22-abeb-486d1769d648`::Granted request >Thread-34::DEBUG::2014-07-10 08:54:41,063::task::827::TaskManager.Task::(resourceAcquired) Task=`9a3a6f4f-bc9b-484a-8a3e-851d8fdafecf`::_resourcesAcquired: Storage.6a70504d-00df-4869-8695-0f442053f6b6 (shared) >Thread-34::DEBUG::2014-07-10 08:54:41,064::task::990::TaskManager.Task::(_decref) Task=`9a3a6f4f-bc9b-484a-8a3e-851d8fdafecf`::ref 1 aborting False >Thread-34::DEBUG::2014-07-10 08:54:41,064::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.9e1aa540-1f4e-4ee3-a152-be381ef6c3bd`ReqID=`d8c8f7bc-50d5-471d-9844-860f6cdafb6a`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '1792' at 'copyImage' >Thread-34::DEBUG::2014-07-10 08:54:41,064::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.9e1aa540-1f4e-4ee3-a152-be381ef6c3bd' for lock type 'shared' >Thread-34::DEBUG::2014-07-10 08:54:41,064::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.9e1aa540-1f4e-4ee3-a152-be381ef6c3bd' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-10 08:54:41,065::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.9e1aa540-1f4e-4ee3-a152-be381ef6c3bd`ReqID=`d8c8f7bc-50d5-471d-9844-860f6cdafb6a`::Granted request >Thread-34::DEBUG::2014-07-10 08:54:41,065::task::827::TaskManager.Task::(resourceAcquired) Task=`9a3a6f4f-bc9b-484a-8a3e-851d8fdafecf`::_resourcesAcquired: Storage.9e1aa540-1f4e-4ee3-a152-be381ef6c3bd (shared) >Thread-34::DEBUG::2014-07-10 08:54:41,065::task::990::TaskManager.Task::(_decref) Task=`9a3a6f4f-bc9b-484a-8a3e-851d8fdafecf`::ref 1 aborting False >Thread-34::DEBUG::2014-07-10 08:54:41,067::task::752::TaskManager.Task::(_save) Task=`9a3a6f4f-bc9b-484a-8a3e-851d8fdafecf`::_save: orig /rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/master/tasks/9a3a6f4f-bc9b-484a-8a3e-851d8fdafecf temp /rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/master/tasks/9a3a6f4f-bc9b-484a-8a3e-851d8fdafecf.temp >Thread-34::DEBUG::2014-07-10 08:54:41,086::taskManager::68::TaskManager::(scheduleJob) scheduled job copyImage_9cf413b7-7f14-4a61-8c71-913e5b0ea9c0 for task 9a3a6f4f-bc9b-484a-8a3e-851d8fdafecf >Thread-34::INFO::2014-07-10 08:54:41,086::logUtils::47::dispatcher::(wrapper) Run and protect: copyImage, Return response: None >Thread-34::DEBUG::2014-07-10 08:54:41,086::task::1180::TaskManager.Task::(prepare) Task=`9a3a6f4f-bc9b-484a-8a3e-851d8fdafecf`::Prepare: 1 jobs exist, move to acquiring >Thread-34::DEBUG::2014-07-10 08:54:41,087::task::595::TaskManager.Task::(_updateState) Task=`9a3a6f4f-bc9b-484a-8a3e-851d8fdafecf`::moving from state preparing -> state acquiring >Thread-34::DEBUG::2014-07-10 08:54:41,087::task::752::TaskManager.Task::(_save) Task=`9a3a6f4f-bc9b-484a-8a3e-851d8fdafecf`::_save: orig /rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/master/tasks/9a3a6f4f-bc9b-484a-8a3e-851d8fdafecf temp /rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/master/tasks/9a3a6f4f-bc9b-484a-8a3e-851d8fdafecf.temp >Thread-34::DEBUG::2014-07-10 08:54:41,095::task::595::TaskManager.Task::(_updateState) Task=`9a3a6f4f-bc9b-484a-8a3e-851d8fdafecf`::moving from state acquiring -> state queued >Thread-34::DEBUG::2014-07-10 08:54:41,096::task::752::TaskManager.Task::(_save) Task=`9a3a6f4f-bc9b-484a-8a3e-851d8fdafecf`::_save: orig /rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/master/tasks/9a3a6f4f-bc9b-484a-8a3e-851d8fdafecf temp /rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/master/tasks/9a3a6f4f-bc9b-484a-8a3e-851d8fdafecf.temp >Thread-34::DEBUG::2014-07-10 08:54:41,103::taskManager::50::TaskManager::(_queueTask) queuing task: 9a3a6f4f-bc9b-484a-8a3e-851d8fdafecf >Thread-34::DEBUG::2014-07-10 08:54:41,103::taskManager::56::TaskManager::(_queueTask) task queued: 9a3a6f4f-bc9b-484a-8a3e-851d8fdafecf >a87169e0-a176-4c59-b6eb-eec414640692::DEBUG::2014-07-10 08:54:41,104::threadPool::57::Misc.ThreadPool::(setRunningTask) Number of running tasks: 1 >Thread-34::DEBUG::2014-07-10 08:54:41,107::task::1182::TaskManager.Task::(prepare) Task=`9a3a6f4f-bc9b-484a-8a3e-851d8fdafecf`::returning >9a3a6f4f-bc9b-484a-8a3e-851d8fdafecf::DEBUG::2014-07-10 08:54:41,107::threadPool::200::Misc.ThreadPool.WorkerThread::(_processNextTask) Task: 9a3a6f4f-bc9b-484a-8a3e-851d8fdafecf running: <bound method Task.commit of <storage.task.Task instance at 0x7f62180b80e0>> with: None >Thread-34::DEBUG::2014-07-10 08:54:41,110::task::990::TaskManager.Task::(_decref) Task=`9a3a6f4f-bc9b-484a-8a3e-851d8fdafecf`::ref 0 aborting False >9a3a6f4f-bc9b-484a-8a3e-851d8fdafecf::DEBUG::2014-07-10 08:54:41,111::task::1194::TaskManager.Task::(commit) Task=`9a3a6f4f-bc9b-484a-8a3e-851d8fdafecf`::committing task: 9a3a6f4f-bc9b-484a-8a3e-851d8fdafecf >9a3a6f4f-bc9b-484a-8a3e-851d8fdafecf::DEBUG::2014-07-10 08:54:41,114::task::595::TaskManager.Task::(_updateState) Task=`9a3a6f4f-bc9b-484a-8a3e-851d8fdafecf`::moving from state queued -> state running >9a3a6f4f-bc9b-484a-8a3e-851d8fdafecf::DEBUG::2014-07-10 08:54:41,117::task::752::TaskManager.Task::(_save) Task=`9a3a6f4f-bc9b-484a-8a3e-851d8fdafecf`::_save: orig /rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/master/tasks/9a3a6f4f-bc9b-484a-8a3e-851d8fdafecf temp /rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/master/tasks/9a3a6f4f-bc9b-484a-8a3e-851d8fdafecf.temp >9a3a6f4f-bc9b-484a-8a3e-851d8fdafecf::DEBUG::2014-07-10 08:54:41,125::task::905::TaskManager.Task::(_runJobs) Task=`9a3a6f4f-bc9b-484a-8a3e-851d8fdafecf`::Task.run: running job 0: copyImage_9cf413b7-7f14-4a61-8c71-913e5b0ea9c0: <bound method StoragePool.copyImage of <storage.sp.StoragePool object at 0x7f62180b9dd0>> (args: ('6a70504d-00df-4869-8695-0f442053f6b6', '', 'b8c3a0af-85ef-42d5-abd5-42a2c2371498', '022d12c7-cf77-4c96-b939-4dd8d42a2127', '9cf413b7-7f14-4a61-8c71-913e5b0ea9c0', '47592965-e853-4e59-9728-d11cca6a7a8a', '', '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 6, 5, 1, False, False) kwargs: {}) >9a3a6f4f-bc9b-484a-8a3e-851d8fdafecf::DEBUG::2014-07-10 08:54:41,126::task::331::TaskManager.Task::(run) Task=`9a3a6f4f-bc9b-484a-8a3e-851d8fdafecf`::Job.run: running copyImage_9cf413b7-7f14-4a61-8c71-913e5b0ea9c0: <bound method StoragePool.copyImage of <storage.sp.StoragePool object at 0x7f62180b9dd0>> (args: ('6a70504d-00df-4869-8695-0f442053f6b6', '', 'b8c3a0af-85ef-42d5-abd5-42a2c2371498', '022d12c7-cf77-4c96-b939-4dd8d42a2127', '9cf413b7-7f14-4a61-8c71-913e5b0ea9c0', '47592965-e853-4e59-9728-d11cca6a7a8a', '', '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 6, 5, 1, False, False) kwargs: {}) callback None >9a3a6f4f-bc9b-484a-8a3e-851d8fdafecf::DEBUG::2014-07-10 08:54:41,126::resourceManager::198::ResourceManager.Request::(__init__) ResName=`6a70504d-00df-4869-8695-0f442053f6b6_imageNS.b8c3a0af-85ef-42d5-abd5-42a2c2371498`ReqID=`c6494755-b65b-4308-9e4e-6f91fcdf30cc`::Request was made in '/usr/share/vdsm/storage/sp.py' line '1495' at 'copyImage' >9a3a6f4f-bc9b-484a-8a3e-851d8fdafecf::DEBUG::2014-07-10 08:54:41,127::resourceManager::542::ResourceManager::(registerResource) Trying to register resource '6a70504d-00df-4869-8695-0f442053f6b6_imageNS.b8c3a0af-85ef-42d5-abd5-42a2c2371498' for lock type 'shared' >9a3a6f4f-bc9b-484a-8a3e-851d8fdafecf::DEBUG::2014-07-10 08:54:41,129::fileVolume::529::Storage.Volume::(validateVolumePath) validate path for 022d12c7-cf77-4c96-b939-4dd8d42a2127 >9a3a6f4f-bc9b-484a-8a3e-851d8fdafecf::DEBUG::2014-07-10 08:54:41,133::fileVolume::529::Storage.Volume::(validateVolumePath) validate path for 022d12c7-cf77-4c96-b939-4dd8d42a2127 >9a3a6f4f-bc9b-484a-8a3e-851d8fdafecf::DEBUG::2014-07-10 08:54:41,138::resourceManager::198::ResourceManager.Request::(__init__) ResName=`6a70504d-00df-4869-8695-0f442053f6b6_volumeNS.022d12c7-cf77-4c96-b939-4dd8d42a2127`ReqID=`66ee3aaf-e95b-40ae-8b37-cce05e5eec89`::Request was made in '/usr/share/vdsm/storage/resourceFactories.py' line '164' at '__getResourceCandidatesList' >9a3a6f4f-bc9b-484a-8a3e-851d8fdafecf::DEBUG::2014-07-10 08:54:41,139::resourceManager::542::ResourceManager::(registerResource) Trying to register resource '6a70504d-00df-4869-8695-0f442053f6b6_volumeNS.022d12c7-cf77-4c96-b939-4dd8d42a2127' for lock type 'shared' >9a3a6f4f-bc9b-484a-8a3e-851d8fdafecf::DEBUG::2014-07-10 08:54:41,139::resourceManager::601::ResourceManager::(registerResource) Resource '6a70504d-00df-4869-8695-0f442053f6b6_volumeNS.022d12c7-cf77-4c96-b939-4dd8d42a2127' is free. Now locking as 'shared' (1 active user) >9a3a6f4f-bc9b-484a-8a3e-851d8fdafecf::DEBUG::2014-07-10 08:54:41,139::resourceManager::238::ResourceManager.Request::(grant) ResName=`6a70504d-00df-4869-8695-0f442053f6b6_volumeNS.022d12c7-cf77-4c96-b939-4dd8d42a2127`ReqID=`66ee3aaf-e95b-40ae-8b37-cce05e5eec89`::Granted request >9a3a6f4f-bc9b-484a-8a3e-851d8fdafecf::DEBUG::2014-07-10 08:54:41,140::resourceManager::601::ResourceManager::(registerResource) Resource '6a70504d-00df-4869-8695-0f442053f6b6_imageNS.b8c3a0af-85ef-42d5-abd5-42a2c2371498' is free. Now locking as 'shared' (1 active user) >9a3a6f4f-bc9b-484a-8a3e-851d8fdafecf::DEBUG::2014-07-10 08:54:41,140::resourceManager::238::ResourceManager.Request::(grant) ResName=`6a70504d-00df-4869-8695-0f442053f6b6_imageNS.b8c3a0af-85ef-42d5-abd5-42a2c2371498`ReqID=`c6494755-b65b-4308-9e4e-6f91fcdf30cc`::Granted request >9a3a6f4f-bc9b-484a-8a3e-851d8fdafecf::DEBUG::2014-07-10 08:54:41,141::resourceManager::198::ResourceManager.Request::(__init__) ResName=`9e1aa540-1f4e-4ee3-a152-be381ef6c3bd_imageNS.9cf413b7-7f14-4a61-8c71-913e5b0ea9c0`ReqID=`678b8aaf-b94f-4391-a74d-403bf7d2f97b`::Request was made in '/usr/share/vdsm/storage/sp.py' line '1497' at 'copyImage' >9a3a6f4f-bc9b-484a-8a3e-851d8fdafecf::DEBUG::2014-07-10 08:54:41,141::resourceManager::542::ResourceManager::(registerResource) Trying to register resource '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd_imageNS.9cf413b7-7f14-4a61-8c71-913e5b0ea9c0' for lock type 'exclusive' >9a3a6f4f-bc9b-484a-8a3e-851d8fdafecf::DEBUG::2014-07-10 08:54:41,141::lvm::427::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' got the operation mutex >9a3a6f4f-bc9b-484a-8a3e-851d8fdafecf::DEBUG::2014-07-10 08:54:41,142::lvm::296::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm lvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/3600601601282300032826addbbdae311|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,vg_name,attr,size,seg_start_pe,devices,tags 9e1aa540-1f4e-4ee3-a152-be381ef6c3bd' (cwd None) >9a3a6f4f-bc9b-484a-8a3e-851d8fdafecf::DEBUG::2014-07-10 08:54:41,377::lvm::296::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >9a3a6f4f-bc9b-484a-8a3e-851d8fdafecf::DEBUG::2014-07-10 08:54:41,386::lvm::462::Storage.LVM::(_reloadlvs) lvs reloaded >9a3a6f4f-bc9b-484a-8a3e-851d8fdafecf::DEBUG::2014-07-10 08:54:41,386::lvm::462::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' released the operation mutex >9a3a6f4f-bc9b-484a-8a3e-851d8fdafecf::DEBUG::2014-07-10 08:54:41,386::resourceFactories::125::Storage.ResourcesFactories::(__getResourceCandidatesList) Image 9cf413b7-7f14-4a61-8c71-913e5b0ea9c0 does not exist in domain 9e1aa540-1f4e-4ee3-a152-be381ef6c3bd >9a3a6f4f-bc9b-484a-8a3e-851d8fdafecf::DEBUG::2014-07-10 08:54:41,386::resourceManager::601::ResourceManager::(registerResource) Resource '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd_imageNS.9cf413b7-7f14-4a61-8c71-913e5b0ea9c0' is free. Now locking as 'exclusive' (1 active user) >9a3a6f4f-bc9b-484a-8a3e-851d8fdafecf::DEBUG::2014-07-10 08:54:41,387::resourceManager::238::ResourceManager.Request::(grant) ResName=`9e1aa540-1f4e-4ee3-a152-be381ef6c3bd_imageNS.9cf413b7-7f14-4a61-8c71-913e5b0ea9c0`ReqID=`678b8aaf-b94f-4391-a74d-403bf7d2f97b`::Granted request >9a3a6f4f-bc9b-484a-8a3e-851d8fdafecf::INFO::2014-07-10 08:54:41,387::image::647::Storage.Image::(copyCollapsed) sdUUID=6a70504d-00df-4869-8695-0f442053f6b6 vmUUID= srcImgUUID=b8c3a0af-85ef-42d5-abd5-42a2c2371498 srcVolUUID=022d12c7-cf77-4c96-b939-4dd8d42a2127 dstImgUUID=9cf413b7-7f14-4a61-8c71-913e5b0ea9c0 dstVolUUID=47592965-e853-4e59-9728-d11cca6a7a8a dstSdUUID=9e1aa540-1f4e-4ee3-a152-be381ef6c3bd volType=6 volFormat=RAW preallocate=PREALLOCATED force=False postZero=False >9a3a6f4f-bc9b-484a-8a3e-851d8fdafecf::DEBUG::2014-07-10 08:54:41,389::fileVolume::529::Storage.Volume::(validateVolumePath) validate path for 022d12c7-cf77-4c96-b939-4dd8d42a2127 >9a3a6f4f-bc9b-484a-8a3e-851d8fdafecf::INFO::2014-07-10 08:54:41,408::image::697::Storage.Image::(copyCollapsed) copy source 6a70504d-00df-4869-8695-0f442053f6b6:b8c3a0af-85ef-42d5-abd5-42a2c2371498:022d12c7-cf77-4c96-b939-4dd8d42a2127 vol size 20971520 destination 9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:9cf413b7-7f14-4a61-8c71-913e5b0ea9c0:47592965-e853-4e59-9728-d11cca6a7a8a apparentsize 20971520 >9a3a6f4f-bc9b-484a-8a3e-851d8fdafecf::DEBUG::2014-07-10 08:54:41,409::lvm::427::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' got the operation mutex >9a3a6f4f-bc9b-484a-8a3e-851d8fdafecf::DEBUG::2014-07-10 08:54:41,410::lvm::296::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm lvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/3600601601282300032826addbbdae311|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,vg_name,attr,size,seg_start_pe,devices,tags 9e1aa540-1f4e-4ee3-a152-be381ef6c3bd' (cwd None) >9a3a6f4f-bc9b-484a-8a3e-851d8fdafecf::DEBUG::2014-07-10 08:54:41,592::lvm::296::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >9a3a6f4f-bc9b-484a-8a3e-851d8fdafecf::DEBUG::2014-07-10 08:54:41,598::lvm::462::Storage.LVM::(_reloadlvs) lvs reloaded >9a3a6f4f-bc9b-484a-8a3e-851d8fdafecf::DEBUG::2014-07-10 08:54:41,598::lvm::462::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' released the operation mutex >9a3a6f4f-bc9b-484a-8a3e-851d8fdafecf::INFO::2014-07-10 08:54:41,598::image::285::Storage.Image::(isLegal) image 9cf413b7-7f14-4a61-8c71-913e5b0ea9c0 in domain 9e1aa540-1f4e-4ee3-a152-be381ef6c3bd has vollist [] >9a3a6f4f-bc9b-484a-8a3e-851d8fdafecf::INFO::2014-07-10 08:54:41,599::image::123::Storage.Image::(create) Create placeholder /rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/images/9cf413b7-7f14-4a61-8c71-913e5b0ea9c0 for image's volumes >9a3a6f4f-bc9b-484a-8a3e-851d8fdafecf::DEBUG::2014-07-10 08:54:41,600::task::752::TaskManager.Task::(_save) Task=`9a3a6f4f-bc9b-484a-8a3e-851d8fdafecf`::_save: orig /rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/master/tasks/9a3a6f4f-bc9b-484a-8a3e-851d8fdafecf temp /rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/master/tasks/9a3a6f4f-bc9b-484a-8a3e-851d8fdafecf.temp >9a3a6f4f-bc9b-484a-8a3e-851d8fdafecf::INFO::2014-07-10 08:54:41,609::volume::443::Storage.Volume::(create) Creating volume 47592965-e853-4e59-9728-d11cca6a7a8a >9a3a6f4f-bc9b-484a-8a3e-851d8fdafecf::DEBUG::2014-07-10 08:54:41,609::task::752::TaskManager.Task::(_save) Task=`9a3a6f4f-bc9b-484a-8a3e-851d8fdafecf`::_save: orig /rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/master/tasks/9a3a6f4f-bc9b-484a-8a3e-851d8fdafecf temp /rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/master/tasks/9a3a6f4f-bc9b-484a-8a3e-851d8fdafecf.temp >9a3a6f4f-bc9b-484a-8a3e-851d8fdafecf::DEBUG::2014-07-10 08:54:41,618::task::752::TaskManager.Task::(_save) Task=`9a3a6f4f-bc9b-484a-8a3e-851d8fdafecf`::_save: orig /rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/master/tasks/9a3a6f4f-bc9b-484a-8a3e-851d8fdafecf temp /rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/master/tasks/9a3a6f4f-bc9b-484a-8a3e-851d8fdafecf.temp >9a3a6f4f-bc9b-484a-8a3e-851d8fdafecf::DEBUG::2014-07-10 08:54:41,628::lvm::296::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm lvcreate --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/3600601601282300032826addbbdae311|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } " --autobackup n --contiguous n --size 10m --addtag OVIRT_VOL_INITIALIZING --name 47592965-e853-4e59-9728-d11cca6a7a8a 9e1aa540-1f4e-4ee3-a152-be381ef6c3bd' (cwd None) >9a3a6f4f-bc9b-484a-8a3e-851d8fdafecf::DEBUG::2014-07-10 08:54:41,943::lvm::296::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ' WARNING: This metadata update is NOT backed up\n WARNING: This metadata update is NOT backed up\n'; <rc> = 0 >9a3a6f4f-bc9b-484a-8a3e-851d8fdafecf::DEBUG::2014-07-10 08:54:41,944::lvm::503::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >9a3a6f4f-bc9b-484a-8a3e-851d8fdafecf::DEBUG::2014-07-10 08:54:41,944::lvm::505::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >9a3a6f4f-bc9b-484a-8a3e-851d8fdafecf::DEBUG::2014-07-10 08:54:41,945::lvm::513::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >9a3a6f4f-bc9b-484a-8a3e-851d8fdafecf::DEBUG::2014-07-10 08:54:41,945::lvm::525::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >9a3a6f4f-bc9b-484a-8a3e-851d8fdafecf::WARNING::2014-07-10 08:54:41,945::utils::129::root::(rmFile) File: /rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/images/9cf413b7-7f14-4a61-8c71-913e5b0ea9c0/47592965-e853-4e59-9728-d11cca6a7a8a already removed >9a3a6f4f-bc9b-484a-8a3e-851d8fdafecf::INFO::2014-07-10 08:54:41,946::blockVolume::161::Storage.Volume::(_create) Request to create RAW volume /rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/images/9cf413b7-7f14-4a61-8c71-913e5b0ea9c0/47592965-e853-4e59-9728-d11cca6a7a8a with size = 20480 sectors >9a3a6f4f-bc9b-484a-8a3e-851d8fdafecf::DEBUG::2014-07-10 08:54:41,946::lvm::427::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' got the operation mutex >9a3a6f4f-bc9b-484a-8a3e-851d8fdafecf::DEBUG::2014-07-10 08:54:41,947::lvm::296::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm lvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/3600601601282300032826addbbdae311|/dev/mapper/360060160f4a030003840ec867ddee311|/dev/mapper/367cad74c2fcba00019e6afd20c781e67|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,vg_name,attr,size,seg_start_pe,devices,tags 9e1aa540-1f4e-4ee3-a152-be381ef6c3bd' (cwd None) >9a3a6f4f-bc9b-484a-8a3e-851d8fdafecf::DEBUG::2014-07-10 08:54:42,182::lvm::296::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >9a3a6f4f-bc9b-484a-8a3e-851d8fdafecf::DEBUG::2014-07-10 08:54:42,189::lvm::462::Storage.LVM::(_reloadlvs) lvs reloaded >9a3a6f4f-bc9b-484a-8a3e-851d8fdafecf::DEBUG::2014-07-10 08:54:42,189::lvm::462::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' released the operation mutex >9a3a6f4f-bc9b-484a-8a3e-851d8fdafecf::WARNING::2014-07-10 08:54:42,190::blockSD::761::Storage.StorageDomain::(_getOccupiedMetadataSlots) Could not find mapping for lv 9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/47592965-e853-4e59-9728-d11cca6a7a8a >9a3a6f4f-bc9b-484a-8a3e-851d8fdafecf::DEBUG::2014-07-10 08:54:42,190::blockSD::784::Storage.StorageDomain::(getFreeMetadataSlot) Found freeSlot 4 in VG 9e1aa540-1f4e-4ee3-a152-be381ef6c3bd >9a3a6f4f-bc9b-484a-8a3e-851d8fdafecf::DEBUG::2014-07-10 08:54:42,191::lvm::296::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm lvchange --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/3600601601282300032826addbbdae311|/dev/mapper/360060160f4a030003840ec867ddee311|/dev/mapper/367cad74c2fcba00019e6afd20c781e67|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } " --autobackup n --deltag OVIRT_VOL_INITIALIZING --addtag MD_4 --addtag PU_00000000-0000-0000-0000-000000000000 --addtag IU_9cf413b7-7f14-4a61-8c71-913e5b0ea9c0 9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/47592965-e853-4e59-9728-d11cca6a7a8a' (cwd None) >Thread-18::DEBUG::2014-07-10 08:54:42,417::lvm::373::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-18::DEBUG::2014-07-10 08:54:42,418::lvm::296::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/3600601601282300032826addbbdae311|/dev/mapper/360060160f4a030003840ec867ddee311|/dev/mapper/367cad74c2fcba00019e6afd20c781e67|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name 9e1aa540-1f4e-4ee3-a152-be381ef6c3bd' (cwd None) >9a3a6f4f-bc9b-484a-8a3e-851d8fdafecf::DEBUG::2014-07-10 08:54:42,458::lvm::296::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ' WARNING: This metadata update is NOT backed up\n WARNING: This metadata update is NOT backed up\n'; <rc> = 0 >9a3a6f4f-bc9b-484a-8a3e-851d8fdafecf::DEBUG::2014-07-10 08:54:42,459::lvm::513::OperationMutex::(_invalidatelvs) Operation 'lvm reload operation' is holding the operation mutex, waiting... >Thread-18::DEBUG::2014-07-10 08:54:42,610::lvm::296::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-18::DEBUG::2014-07-10 08:54:42,614::lvm::415::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >9a3a6f4f-bc9b-484a-8a3e-851d8fdafecf::DEBUG::2014-07-10 08:54:42,622::lvm::513::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-18::DEBUG::2014-07-10 08:54:42,627::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/metadata bs=4096 count=1' (cwd None) >9a3a6f4f-bc9b-484a-8a3e-851d8fdafecf::DEBUG::2014-07-10 08:54:42,649::lvm::525::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >9a3a6f4f-bc9b-484a-8a3e-851d8fdafecf::DEBUG::2014-07-10 08:54:42,693::lvm::296::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm lvchange --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/3600601601282300032826addbbdae311|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } " --autobackup n --available n 9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/47592965-e853-4e59-9728-d11cca6a7a8a' (cwd None) >Thread-18::DEBUG::2014-07-10 08:54:42,712::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00082903 s, 4.9 MB/s\n'; <rc> = 0 >9a3a6f4f-bc9b-484a-8a3e-851d8fdafecf::DEBUG::2014-07-10 08:54:42,921::lvm::296::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >9a3a6f4f-bc9b-484a-8a3e-851d8fdafecf::DEBUG::2014-07-10 08:54:42,921::lvm::513::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >9a3a6f4f-bc9b-484a-8a3e-851d8fdafecf::DEBUG::2014-07-10 08:54:42,922::lvm::525::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >9a3a6f4f-bc9b-484a-8a3e-851d8fdafecf::DEBUG::2014-07-10 08:54:42,922::lvm::427::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' got the operation mutex >9a3a6f4f-bc9b-484a-8a3e-851d8fdafecf::DEBUG::2014-07-10 08:54:42,923::lvm::296::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm lvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/3600601601282300032826addbbdae311|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,vg_name,attr,size,seg_start_pe,devices,tags 9e1aa540-1f4e-4ee3-a152-be381ef6c3bd' (cwd None) >Dummy-33::DEBUG::2014-07-10 08:54:42,964::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 08:54:43,063::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0497123 s, 20.6 MB/s\n'; <rc> = 0 >9a3a6f4f-bc9b-484a-8a3e-851d8fdafecf::DEBUG::2014-07-10 08:54:43,111::lvm::296::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >9a3a6f4f-bc9b-484a-8a3e-851d8fdafecf::DEBUG::2014-07-10 08:54:43,118::lvm::462::Storage.LVM::(_reloadlvs) lvs reloaded >9a3a6f4f-bc9b-484a-8a3e-851d8fdafecf::DEBUG::2014-07-10 08:54:43,118::lvm::462::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' released the operation mutex >9a3a6f4f-bc9b-484a-8a3e-851d8fdafecf::INFO::2014-07-10 08:54:43,118::volume::485::Storage.Volume::(create) The requested size for volume 47592965-e853-4e59-9728-d11cca6a7a8a doesn't match the granularity on domain 9e1aa540-1f4e-4ee3-a152-be381ef6c3bd, updating the volume size from 20480 to 262144 >9a3a6f4f-bc9b-484a-8a3e-851d8fdafecf::DEBUG::2014-07-10 08:54:43,119::task::752::TaskManager.Task::(_save) Task=`9a3a6f4f-bc9b-484a-8a3e-851d8fdafecf`::_save: orig /rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/master/tasks/9a3a6f4f-bc9b-484a-8a3e-851d8fdafecf temp /rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/master/tasks/9a3a6f4f-bc9b-484a-8a3e-851d8fdafecf.temp >9a3a6f4f-bc9b-484a-8a3e-851d8fdafecf::DEBUG::2014-07-10 08:54:43,132::blockVolume::604::Storage.Volume::(newVolumeLease) Initializing volume lease volUUID=47592965-e853-4e59-9728-d11cca6a7a8a sdUUID=9e1aa540-1f4e-4ee3-a152-be381ef6c3bd, metaId=('9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 4) >9a3a6f4f-bc9b-484a-8a3e-851d8fdafecf::DEBUG::2014-07-10 08:54:43,153::task::752::TaskManager.Task::(_save) Task=`9a3a6f4f-bc9b-484a-8a3e-851d8fdafecf`::_save: orig /rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/master/tasks/9a3a6f4f-bc9b-484a-8a3e-851d8fdafecf temp /rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/master/tasks/9a3a6f4f-bc9b-484a-8a3e-851d8fdafecf.temp >9a3a6f4f-bc9b-484a-8a3e-851d8fdafecf::INFO::2014-07-10 08:54:43,160::blockVolume::268::Storage.Volume::(extend) Request to extend LV 47592965-e853-4e59-9728-d11cca6a7a8a of image 9cf413b7-7f14-4a61-8c71-913e5b0ea9c0 in VG 9e1aa540-1f4e-4ee3-a152-be381ef6c3bd with size = 20971520 >9a3a6f4f-bc9b-484a-8a3e-851d8fdafecf::DEBUG::2014-07-10 08:54:43,161::lvm::296::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm lvextend --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/3600601601282300032826addbbdae311|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } " --autobackup n --size 10240m 9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/47592965-e853-4e59-9728-d11cca6a7a8a' (cwd None) >9a3a6f4f-bc9b-484a-8a3e-851d8fdafecf::DEBUG::2014-07-10 08:54:43,360::lvm::296::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ' WARNING: This metadata update is NOT backed up\n'; <rc> = 0 >9a3a6f4f-bc9b-484a-8a3e-851d8fdafecf::DEBUG::2014-07-10 08:54:43,361::lvm::503::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >9a3a6f4f-bc9b-484a-8a3e-851d8fdafecf::DEBUG::2014-07-10 08:54:43,361::lvm::505::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >9a3a6f4f-bc9b-484a-8a3e-851d8fdafecf::DEBUG::2014-07-10 08:54:43,361::lvm::513::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >9a3a6f4f-bc9b-484a-8a3e-851d8fdafecf::DEBUG::2014-07-10 08:54:43,362::lvm::525::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >9a3a6f4f-bc9b-484a-8a3e-851d8fdafecf::DEBUG::2014-07-10 08:54:43,362::lvm::427::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' got the operation mutex >9a3a6f4f-bc9b-484a-8a3e-851d8fdafecf::DEBUG::2014-07-10 08:54:43,363::lvm::296::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm lvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/3600601601282300032826addbbdae311|/dev/mapper/360060160f4a030003840ec867ddee311|/dev/mapper/367cad74c2fcba00019e6afd20c781e67|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,vg_name,attr,size,seg_start_pe,devices,tags 9e1aa540-1f4e-4ee3-a152-be381ef6c3bd' (cwd None) >9a3a6f4f-bc9b-484a-8a3e-851d8fdafecf::DEBUG::2014-07-10 08:54:43,572::lvm::296::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >9a3a6f4f-bc9b-484a-8a3e-851d8fdafecf::DEBUG::2014-07-10 08:54:43,580::lvm::462::Storage.LVM::(_reloadlvs) lvs reloaded >9a3a6f4f-bc9b-484a-8a3e-851d8fdafecf::DEBUG::2014-07-10 08:54:43,580::lvm::462::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' released the operation mutex >9a3a6f4f-bc9b-484a-8a3e-851d8fdafecf::DEBUG::2014-07-10 08:54:43,580::blockVolume::572::Storage.Misc.excCmd::(getMetadata) '/bin/dd iflag=direct skip=4 bs=512 if=/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/metadata count=1' (cwd None) >9a3a6f4f-bc9b-484a-8a3e-851d8fdafecf::DEBUG::2014-07-10 08:54:43,592::blockVolume::572::Storage.Misc.excCmd::(getMetadata) SUCCESS: <err> = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.000533796 s, 959 kB/s\n'; <rc> = 0 >9a3a6f4f-bc9b-484a-8a3e-851d8fdafecf::DEBUG::2014-07-10 08:54:43,593::misc::282::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.000533796 s, 959 kB/s'], size: 512 >9a3a6f4f-bc9b-484a-8a3e-851d8fdafecf::INFO::2014-07-10 08:54:43,630::volume::789::Storage.Volume::(prepare) Volume: preparing volume 6a70504d-00df-4869-8695-0f442053f6b6/022d12c7-cf77-4c96-b939-4dd8d42a2127 >9a3a6f4f-bc9b-484a-8a3e-851d8fdafecf::INFO::2014-07-10 08:54:43,640::volume::789::Storage.Volume::(prepare) Volume: preparing volume 9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/47592965-e853-4e59-9728-d11cca6a7a8a >9a3a6f4f-bc9b-484a-8a3e-851d8fdafecf::DEBUG::2014-07-10 08:54:43,640::blockVolume::572::Storage.Misc.excCmd::(getMetadata) '/bin/dd iflag=direct skip=4 bs=512 if=/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/metadata count=1' (cwd None) >9a3a6f4f-bc9b-484a-8a3e-851d8fdafecf::DEBUG::2014-07-10 08:54:43,655::blockVolume::572::Storage.Misc.excCmd::(getMetadata) SUCCESS: <err> = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.000606935 s, 844 kB/s\n'; <rc> = 0 >9a3a6f4f-bc9b-484a-8a3e-851d8fdafecf::DEBUG::2014-07-10 08:54:43,655::misc::282::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.000606935 s, 844 kB/s'], size: 512 >9a3a6f4f-bc9b-484a-8a3e-851d8fdafecf::DEBUG::2014-07-10 08:54:43,656::blockVolume::572::Storage.Misc.excCmd::(getMetadata) '/bin/dd iflag=direct skip=4 bs=512 if=/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/metadata count=1' (cwd None) >9a3a6f4f-bc9b-484a-8a3e-851d8fdafecf::DEBUG::2014-07-10 08:54:43,670::blockVolume::572::Storage.Misc.excCmd::(getMetadata) SUCCESS: <err> = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.000513617 s, 997 kB/s\n'; <rc> = 0 >9a3a6f4f-bc9b-484a-8a3e-851d8fdafecf::DEBUG::2014-07-10 08:54:43,671::misc::282::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.000513617 s, 997 kB/s'], size: 512 >9a3a6f4f-bc9b-484a-8a3e-851d8fdafecf::DEBUG::2014-07-10 08:54:43,672::resourceManager::198::ResourceManager.Request::(__init__) ResName=`9e1aa540-1f4e-4ee3-a152-be381ef6c3bd_lvmActivationNS.47592965-e853-4e59-9728-d11cca6a7a8a`ReqID=`9233d133-1ab5-470b-87cd-13f3bd4c957c`::Request was made in '/usr/share/vdsm/storage/volume.py' line '806' at 'prepare' >9a3a6f4f-bc9b-484a-8a3e-851d8fdafecf::DEBUG::2014-07-10 08:54:43,672::resourceManager::542::ResourceManager::(registerResource) Trying to register resource '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd_lvmActivationNS.47592965-e853-4e59-9728-d11cca6a7a8a' for lock type 'exclusive' >9a3a6f4f-bc9b-484a-8a3e-851d8fdafecf::DEBUG::2014-07-10 08:54:43,673::lvm::296::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm lvchange --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/3600601601282300032826addbbdae311|/dev/mapper/360060160f4a030003840ec867ddee311|/dev/mapper/367cad74c2fcba00019e6afd20c781e67|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } " --autobackup n --available y 9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/47592965-e853-4e59-9728-d11cca6a7a8a' (cwd None) >9a3a6f4f-bc9b-484a-8a3e-851d8fdafecf::DEBUG::2014-07-10 08:54:43,970::lvm::296::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >9a3a6f4f-bc9b-484a-8a3e-851d8fdafecf::DEBUG::2014-07-10 08:54:43,970::lvm::513::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >9a3a6f4f-bc9b-484a-8a3e-851d8fdafecf::DEBUG::2014-07-10 08:54:43,971::lvm::525::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >9a3a6f4f-bc9b-484a-8a3e-851d8fdafecf::DEBUG::2014-07-10 08:54:43,971::resourceManager::601::ResourceManager::(registerResource) Resource '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd_lvmActivationNS.47592965-e853-4e59-9728-d11cca6a7a8a' is free. Now locking as 'exclusive' (1 active user) >9a3a6f4f-bc9b-484a-8a3e-851d8fdafecf::DEBUG::2014-07-10 08:54:43,971::resourceManager::238::ResourceManager.Request::(grant) ResName=`9e1aa540-1f4e-4ee3-a152-be381ef6c3bd_lvmActivationNS.47592965-e853-4e59-9728-d11cca6a7a8a`ReqID=`9233d133-1ab5-470b-87cd-13f3bd4c957c`::Granted request >9a3a6f4f-bc9b-484a-8a3e-851d8fdafecf::DEBUG::2014-07-10 08:54:43,972::lvm::427::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' got the operation mutex >9a3a6f4f-bc9b-484a-8a3e-851d8fdafecf::DEBUG::2014-07-10 08:54:43,973::lvm::296::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm lvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/3600601601282300032826addbbdae311|/dev/mapper/360060160f4a030003840ec867ddee311|/dev/mapper/367cad74c2fcba00019e6afd20c781e67|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,vg_name,attr,size,seg_start_pe,devices,tags 9e1aa540-1f4e-4ee3-a152-be381ef6c3bd' (cwd None) >9a3a6f4f-bc9b-484a-8a3e-851d8fdafecf::DEBUG::2014-07-10 08:54:44,166::lvm::296::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >9a3a6f4f-bc9b-484a-8a3e-851d8fdafecf::DEBUG::2014-07-10 08:54:44,175::lvm::462::Storage.LVM::(_reloadlvs) lvs reloaded >9a3a6f4f-bc9b-484a-8a3e-851d8fdafecf::DEBUG::2014-07-10 08:54:44,176::lvm::462::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' released the operation mutex >9a3a6f4f-bc9b-484a-8a3e-851d8fdafecf::DEBUG::2014-07-10 08:54:44,176::blockVolume::572::Storage.Misc.excCmd::(getMetadata) '/bin/dd iflag=direct skip=4 bs=512 if=/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/metadata count=1' (cwd None) >9a3a6f4f-bc9b-484a-8a3e-851d8fdafecf::DEBUG::2014-07-10 08:54:44,194::blockVolume::572::Storage.Misc.excCmd::(getMetadata) SUCCESS: <err> = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.00650307 s, 78.7 kB/s\n'; <rc> = 0 >9a3a6f4f-bc9b-484a-8a3e-851d8fdafecf::DEBUG::2014-07-10 08:54:44,195::misc::282::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.00650307 s, 78.7 kB/s'], size: 512 >9a3a6f4f-bc9b-484a-8a3e-851d8fdafecf::DEBUG::2014-07-10 08:54:44,196::blockVolume::572::Storage.Misc.excCmd::(getMetadata) '/bin/dd iflag=direct skip=4 bs=512 if=/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/metadata count=1' (cwd None) >9a3a6f4f-bc9b-484a-8a3e-851d8fdafecf::DEBUG::2014-07-10 08:54:44,234::blockVolume::572::Storage.Misc.excCmd::(getMetadata) SUCCESS: <err> = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.0278822 s, 18.4 kB/s\n'; <rc> = 0 >9a3a6f4f-bc9b-484a-8a3e-851d8fdafecf::DEBUG::2014-07-10 08:54:44,235::misc::282::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.0278822 s, 18.4 kB/s'], size: 512 >9a3a6f4f-bc9b-484a-8a3e-851d8fdafecf::DEBUG::2014-07-10 08:54:44,275::blockVolume::572::Storage.Misc.excCmd::(getMetadata) '/bin/dd iflag=direct skip=4 bs=512 if=/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/metadata count=1' (cwd None) >9a3a6f4f-bc9b-484a-8a3e-851d8fdafecf::DEBUG::2014-07-10 08:54:44,286::blockVolume::572::Storage.Misc.excCmd::(getMetadata) SUCCESS: <err> = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.00049639 s, 1.0 MB/s\n'; <rc> = 0 >9a3a6f4f-bc9b-484a-8a3e-851d8fdafecf::DEBUG::2014-07-10 08:54:44,287::misc::282::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.00049639 s, 1.0 MB/s'], size: 512 >9a3a6f4f-bc9b-484a-8a3e-851d8fdafecf::DEBUG::2014-07-10 08:54:44,287::volume::1094::Storage.Volume::(qemuConvert) (qemuConvert): COPY /rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/6a70504d-00df-4869-8695-0f442053f6b6/images/b8c3a0af-85ef-42d5-abd5-42a2c2371498/022d12c7-cf77-4c96-b939-4dd8d42a2127 (raw) to /rhev/data-center/mnt/blockSD/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/images/9cf413b7-7f14-4a61-8c71-913e5b0ea9c0/47592965-e853-4e59-9728-d11cca6a7a8a (raw) START >9a3a6f4f-bc9b-484a-8a3e-851d8fdafecf::DEBUG::2014-07-10 08:54:44,288::utils::683::Storage.Misc.excCmd::(watchCmd) '/bin/nice -n 19 /usr/bin/ionice -c 3 /bin/dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/6a70504d-00df-4869-8695-0f442053f6b6/images/b8c3a0af-85ef-42d5-abd5-42a2c2371498/022d12c7-cf77-4c96-b939-4dd8d42a2127 of=/rhev/data-center/mnt/blockSD/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/images/9cf413b7-7f14-4a61-8c71-913e5b0ea9c0/47592965-e853-4e59-9728-d11cca6a7a8a bs=1048576 seek=0 skip=0 conv=notrunc count=10240 oflag=direct' (cwd None) >9a3a6f4f-bc9b-484a-8a3e-851d8fdafecf::DEBUG::2014-07-10 08:54:44,299::task::752::TaskManager.Task::(_save) Task=`9a3a6f4f-bc9b-484a-8a3e-851d8fdafecf`::_save: orig /rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/master/tasks/9a3a6f4f-bc9b-484a-8a3e-851d8fdafecf temp /rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/master/tasks/9a3a6f4f-bc9b-484a-8a3e-851d8fdafecf.temp >Thread-14::DEBUG::2014-07-10 08:54:44,856::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-14::DEBUG::2014-07-10 08:54:44,858::task::595::TaskManager.Task::(_updateState) Task=`b86cd8e0-18f4-4522-8ba2-46c53242c3d5`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 08:54:44,859::logUtils::44::dispatcher::(wrapper) Run and protect: getAllTasksStatuses(spUUID=None, options=None) >Thread-14::DEBUG::2014-07-10 08:54:44,859::taskManager::102::TaskManager::(getAllTasksStatuses) Entry. >Thread-14::DEBUG::2014-07-10 08:54:44,859::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 9a3a6f4f-bc9b-484a-8a3e-851d8fdafecf >Thread-14::DEBUG::2014-07-10 08:54:44,860::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '9a3a6f4f-bc9b-484a-8a3e-851d8fdafecf'} >Thread-14::DEBUG::2014-07-10 08:54:44,860::taskManager::113::TaskManager::(getAllTasksStatuses) Return: {'9a3a6f4f-bc9b-484a-8a3e-851d8fdafecf': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '9a3a6f4f-bc9b-484a-8a3e-851d8fdafecf'}} >Thread-14::INFO::2014-07-10 08:54:44,860::logUtils::47::dispatcher::(wrapper) Run and protect: getAllTasksStatuses, Return response: {'allTasksStatus': {'9a3a6f4f-bc9b-484a-8a3e-851d8fdafecf': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '9a3a6f4f-bc9b-484a-8a3e-851d8fdafecf'}}} >Thread-14::DEBUG::2014-07-10 08:54:44,861::task::1185::TaskManager.Task::(prepare) Task=`b86cd8e0-18f4-4522-8ba2-46c53242c3d5`::finished: {'allTasksStatus': {'9a3a6f4f-bc9b-484a-8a3e-851d8fdafecf': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '9a3a6f4f-bc9b-484a-8a3e-851d8fdafecf'}}} >Thread-14::DEBUG::2014-07-10 08:54:44,861::task::595::TaskManager.Task::(_updateState) Task=`b86cd8e0-18f4-4522-8ba2-46c53242c3d5`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 08:54:44,861::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 08:54:44,862::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 08:54:44,862::task::990::TaskManager.Task::(_decref) Task=`b86cd8e0-18f4-4522-8ba2-46c53242c3d5`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 08:54:45,078::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 08:54:45,179::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0489683 s, 20.9 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 08:54:47,195::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 08:54:47,271::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0326574 s, 31.4 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 08:54:48,175::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-14::DEBUG::2014-07-10 08:54:48,176::task::595::TaskManager.Task::(_updateState) Task=`5a684f68-9b92-4bc5-a7d7-d89ac467a858`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 08:54:48,177::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-14::INFO::2014-07-10 08:54:48,177::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 08:54:48,177::task::1185::TaskManager.Task::(prepare) Task=`5a684f68-9b92-4bc5-a7d7-d89ac467a858`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 08:54:48,178::task::595::TaskManager.Task::(_updateState) Task=`5a684f68-9b92-4bc5-a7d7-d89ac467a858`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 08:54:48,178::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 08:54:48,178::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 08:54:48,178::task::990::TaskManager.Task::(_decref) Task=`5a684f68-9b92-4bc5-a7d7-d89ac467a858`::ref 0 aborting False >Thread-34::DEBUG::2014-07-10 08:54:48,183::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-34::DEBUG::2014-07-10 08:54:48,183::task::595::TaskManager.Task::(_updateState) Task=`abbcaf42-9721-4fb0-8a67-1a2fadb6e806`::moving from state init -> state preparing >Thread-34::INFO::2014-07-10 08:54:48,184::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-34::DEBUG::2014-07-10 08:54:48,185::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`09f5d102-d208-4269-91c3-d252377dfdba`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-10 08:54:48,185::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' for lock type 'shared' >Thread-34::DEBUG::2014-07-10 08:54:48,185::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-10 08:54:48,186::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`09f5d102-d208-4269-91c3-d252377dfdba`::Granted request >Thread-34::DEBUG::2014-07-10 08:54:48,186::task::827::TaskManager.Task::(resourceAcquired) Task=`abbcaf42-9721-4fb0-8a67-1a2fadb6e806`::_resourcesAcquired: Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee (shared) >Thread-34::DEBUG::2014-07-10 08:54:48,187::task::990::TaskManager.Task::(_decref) Task=`abbcaf42-9721-4fb0-8a67-1a2fadb6e806`::ref 1 aborting False >Thread-34::DEBUG::2014-07-10 08:54:48,187::lvm::373::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-34::DEBUG::2014-07-10 08:54:48,188::lvm::296::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/3600601601282300032826addbbdae311|/dev/mapper/360060160f4a030003840ec867ddee311|/dev/mapper/367cad74c2fcba00019e6afd20c781e67|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name 9e1aa540-1f4e-4ee3-a152-be381ef6c3bd' (cwd None) >Thread-34::DEBUG::2014-07-10 08:54:48,602::lvm::296::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-34::DEBUG::2014-07-10 08:54:48,604::lvm::415::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-34::INFO::2014-07-10 08:54:48,605::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': 'Active', 'diskfree': '1094814007296', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, '6a70504d-00df-4869-8695-0f442053f6b6': {'status': 'Active', 'diskfree': '532069482496', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 08:54:48,606::task::1185::TaskManager.Task::(prepare) Task=`abbcaf42-9721-4fb0-8a67-1a2fadb6e806`::finished: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': 'Active', 'diskfree': '1094814007296', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, '6a70504d-00df-4869-8695-0f442053f6b6': {'status': 'Active', 'diskfree': '532069482496', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 08:54:48,606::task::595::TaskManager.Task::(_updateState) Task=`abbcaf42-9721-4fb0-8a67-1a2fadb6e806`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-10 08:54:48,606::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee': < ResourceRef 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-10 08:54:48,606::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-10 08:54:48,607::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' >Thread-34::DEBUG::2014-07-10 08:54:48,607::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' (0 active users) >Thread-34::DEBUG::2014-07-10 08:54:48,607::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-10 08:54:48,608::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', Clearing records. >Thread-34::DEBUG::2014-07-10 08:54:48,608::task::990::TaskManager.Task::(_decref) Task=`abbcaf42-9721-4fb0-8a67-1a2fadb6e806`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 08:54:49,281::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 08:54:49,377::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0326198 s, 31.4 MB/s\n'; <rc> = 0 >Thread-40::DEBUG::2014-07-10 08:54:49,804::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lion.qa.lab.tlv.redhat.com:_export_yuri2_backup2/6a70504d-00df-4869-8695-0f442053f6b6/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-40::DEBUG::2014-07-10 08:54:50,314::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n369 bytes (369 B) copied, 0.207127 s, 1.8 kB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 08:54:51,392::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 08:54:51,475::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0318251 s, 32.2 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-10 08:54:52,756::domainMonitor::192::Storage.DomainMonitorThread::(_monitorDomain) Refreshing domain 9e1aa540-1f4e-4ee3-a152-be381ef6c3bd >Thread-18::DEBUG::2014-07-10 08:54:52,757::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with LvMetadataRW backend >Thread-18::DEBUG::2014-07-10 08:54:52,757::blockSD::336::Storage.Misc.excCmd::(readlines) '/bin/dd iflag=direct skip=0 bs=2048 if=/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/metadata count=1' (cwd None) >Thread-18::DEBUG::2014-07-10 08:54:52,770::blockSD::336::Storage.Misc.excCmd::(readlines) SUCCESS: <err> = '1+0 records in\n1+0 records out\n2048 bytes (2.0 kB) copied, 0.000595316 s, 3.4 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-10 08:54:52,771::misc::282::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '2048 bytes (2.0 kB) copied, 0.000595316 s, 3.4 MB/s'], size: 2048 >Thread-18::DEBUG::2014-07-10 08:54:52,771::persistentDict::234::Storage.PersistentDict::(refresh) read lines (LvMetadataRW)=[] >Thread-18::WARNING::2014-07-10 08:54:52,771::persistentDict::256::Storage.PersistentDict::(refresh) data has no embedded checksum - trust it as it is >Thread-18::DEBUG::2014-07-10 08:54:52,772::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with VGTagMetadataRW backend >Thread-18::DEBUG::2014-07-10 08:54:52,772::lvm::503::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-18::DEBUG::2014-07-10 08:54:52,773::lvm::505::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-18::DEBUG::2014-07-10 08:54:52,773::lvm::513::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-18::DEBUG::2014-07-10 08:54:52,773::lvm::525::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-18::DEBUG::2014-07-10 08:54:52,774::lvm::373::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-18::DEBUG::2014-07-10 08:54:52,774::lvm::296::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/3600601601282300032826addbbdae311|/dev/mapper/360060160f4a030003840ec867ddee311|/dev/mapper/367cad74c2fcba00019e6afd20c781e67|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name 9e1aa540-1f4e-4ee3-a152-be381ef6c3bd' (cwd None) >Thread-18::DEBUG::2014-07-10 08:54:53,008::lvm::296::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-18::DEBUG::2014-07-10 08:54:53,010::lvm::415::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-18::DEBUG::2014-07-10 08:54:53,011::persistentDict::234::Storage.PersistentDict::(refresh) read lines (VGTagMetadataRW)=['LEASETIMESEC=60', 'VGUUID=9CsMxb-YbRc-yRG7-cQKD-xY3G-GLi5-YxUyPC', 'VERSION=3', 'TYPE=ISCSI', 'LOGBLKSIZE=512', u'PV0=pv:3600601601282300032826addbbdae311,uuid:7qEb8v-jk2X-3CPk-k4XB-eIBk-onYD-807hcV,pestart:0,pecount:8189,mapoffset:0', 'LEASERETRIES=3', 'IOOPTIMEOUTSEC=10', 'LOCKRENEWALINTERVALSEC=5', 'PHYBLKSIZE=512', 'SDUUID=9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'CLASS=Data', 'LOCKPOLICY=', 'DESCRIPTION=SD_REAL', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=DC_REAL', 'ROLE=Master', 'POOL_UUID=4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', 'POOL_SPM_ID=1', 'POOL_SPM_LVER=0', '_SHA_CKSUM=013b5a7910962201c4cceab31b9c6d9c79f7316f', u'POOL_DOMAINS=9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active'] >Thread-18::INFO::2014-07-10 08:54:53,013::sd::384::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 9e1aa540-1f4e-4ee3-a152-be381ef6c3bd_imageNS already registered >Thread-18::INFO::2014-07-10 08:54:53,013::sd::392::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 9e1aa540-1f4e-4ee3-a152-be381ef6c3bd_volumeNS already registered >Thread-18::INFO::2014-07-10 08:54:53,013::blockSD::452::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 9e1aa540-1f4e-4ee3-a152-be381ef6c3bd_lvmActivationNS already registered >Thread-18::DEBUG::2014-07-10 08:54:53,014::lvm::296::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgck --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/3600601601282300032826addbbdae311|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } " 9e1aa540-1f4e-4ee3-a152-be381ef6c3bd' (cwd None) >Thread-18::DEBUG::2014-07-10 08:54:53,213::lvm::296::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-18::DEBUG::2014-07-10 08:54:53,215::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/metadata bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-10 08:54:53,229::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.0014985 s, 2.7 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 08:54:53,491::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 08:54:53,575::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0307969 s, 33.3 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 08:54:54,869::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-14::DEBUG::2014-07-10 08:54:54,870::task::595::TaskManager.Task::(_updateState) Task=`e4d75d97-f868-455b-914a-5afee09bf44b`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 08:54:54,871::logUtils::44::dispatcher::(wrapper) Run and protect: getAllTasksStatuses(spUUID=None, options=None) >Thread-14::DEBUG::2014-07-10 08:54:54,871::taskManager::102::TaskManager::(getAllTasksStatuses) Entry. >Thread-14::DEBUG::2014-07-10 08:54:54,871::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 9a3a6f4f-bc9b-484a-8a3e-851d8fdafecf >Thread-14::DEBUG::2014-07-10 08:54:54,871::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '9a3a6f4f-bc9b-484a-8a3e-851d8fdafecf'} >Thread-14::DEBUG::2014-07-10 08:54:54,872::taskManager::113::TaskManager::(getAllTasksStatuses) Return: {'9a3a6f4f-bc9b-484a-8a3e-851d8fdafecf': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '9a3a6f4f-bc9b-484a-8a3e-851d8fdafecf'}} >Thread-14::INFO::2014-07-10 08:54:54,872::logUtils::47::dispatcher::(wrapper) Run and protect: getAllTasksStatuses, Return response: {'allTasksStatus': {'9a3a6f4f-bc9b-484a-8a3e-851d8fdafecf': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '9a3a6f4f-bc9b-484a-8a3e-851d8fdafecf'}}} >Thread-14::DEBUG::2014-07-10 08:54:54,872::task::1185::TaskManager.Task::(prepare) Task=`e4d75d97-f868-455b-914a-5afee09bf44b`::finished: {'allTasksStatus': {'9a3a6f4f-bc9b-484a-8a3e-851d8fdafecf': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '9a3a6f4f-bc9b-484a-8a3e-851d8fdafecf'}}} >Thread-14::DEBUG::2014-07-10 08:54:54,872::task::595::TaskManager.Task::(_updateState) Task=`e4d75d97-f868-455b-914a-5afee09bf44b`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 08:54:54,873::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 08:54:54,873::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 08:54:54,873::task::990::TaskManager.Task::(_decref) Task=`e4d75d97-f868-455b-914a-5afee09bf44b`::ref 0 aborting False >Thread-14::DEBUG::2014-07-10 08:54:55,371::task::595::TaskManager.Task::(_updateState) Task=`8027494a-cbd3-4c9d-a21c-5e4cd9ba9468`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 08:54:55,371::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::INFO::2014-07-10 08:54:55,372::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0014985', 'lastCheck': '2.1', 'valid': True}, '6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.207127', 'lastCheck': '4.7', 'valid': True}} >Thread-14::DEBUG::2014-07-10 08:54:55,372::task::1185::TaskManager.Task::(prepare) Task=`8027494a-cbd3-4c9d-a21c-5e4cd9ba9468`::finished: {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0014985', 'lastCheck': '2.1', 'valid': True}, '6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.207127', 'lastCheck': '4.7', 'valid': True}} >Thread-14::DEBUG::2014-07-10 08:54:55,372::task::595::TaskManager.Task::(_updateState) Task=`8027494a-cbd3-4c9d-a21c-5e4cd9ba9468`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 08:54:55,372::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 08:54:55,372::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 08:54:55,373::task::990::TaskManager.Task::(_decref) Task=`8027494a-cbd3-4c9d-a21c-5e4cd9ba9468`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 08:54:55,590::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 08:54:55,679::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0325693 s, 31.4 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 08:54:57,695::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 08:54:57,827::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0791149 s, 12.9 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 08:54:58,633::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-14::DEBUG::2014-07-10 08:54:58,634::task::595::TaskManager.Task::(_updateState) Task=`d8777c2e-66c3-4b64-9f4d-4ac51d73f789`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 08:54:58,634::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-14::INFO::2014-07-10 08:54:58,635::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 08:54:58,636::task::1185::TaskManager.Task::(prepare) Task=`d8777c2e-66c3-4b64-9f4d-4ac51d73f789`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 08:54:58,636::task::595::TaskManager.Task::(_updateState) Task=`d8777c2e-66c3-4b64-9f4d-4ac51d73f789`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 08:54:58,636::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 08:54:58,637::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 08:54:58,637::task::990::TaskManager.Task::(_decref) Task=`d8777c2e-66c3-4b64-9f4d-4ac51d73f789`::ref 0 aborting False >Thread-34::DEBUG::2014-07-10 08:54:58,644::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-34::DEBUG::2014-07-10 08:54:58,644::task::595::TaskManager.Task::(_updateState) Task=`d717fc41-1216-4095-8295-af6b4ed57bc3`::moving from state init -> state preparing >Thread-34::INFO::2014-07-10 08:54:58,645::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-34::DEBUG::2014-07-10 08:54:58,646::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`208f8006-3d88-44ac-be88-2861d318717c`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-10 08:54:58,646::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' for lock type 'shared' >Thread-34::DEBUG::2014-07-10 08:54:58,647::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-10 08:54:58,647::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`208f8006-3d88-44ac-be88-2861d318717c`::Granted request >Thread-34::DEBUG::2014-07-10 08:54:58,648::task::827::TaskManager.Task::(resourceAcquired) Task=`d717fc41-1216-4095-8295-af6b4ed57bc3`::_resourcesAcquired: Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee (shared) >Thread-34::DEBUG::2014-07-10 08:54:58,648::task::990::TaskManager.Task::(_decref) Task=`d717fc41-1216-4095-8295-af6b4ed57bc3`::ref 1 aborting False >Thread-34::INFO::2014-07-10 08:54:58,650::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1084210806784', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532069482496', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 08:54:58,650::task::1185::TaskManager.Task::(prepare) Task=`d717fc41-1216-4095-8295-af6b4ed57bc3`::finished: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1084210806784', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532069482496', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 08:54:58,651::task::595::TaskManager.Task::(_updateState) Task=`d717fc41-1216-4095-8295-af6b4ed57bc3`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-10 08:54:58,651::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee': < ResourceRef 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-10 08:54:58,651::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-10 08:54:58,652::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' >Thread-34::DEBUG::2014-07-10 08:54:58,652::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' (0 active users) >Thread-34::DEBUG::2014-07-10 08:54:58,652::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-10 08:54:58,653::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', Clearing records. >Thread-34::DEBUG::2014-07-10 08:54:58,653::task::990::TaskManager.Task::(_decref) Task=`d717fc41-1216-4095-8295-af6b4ed57bc3`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 08:54:59,846::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 08:54:59,924::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0261892 s, 39.1 MB/s\n'; <rc> = 0 >Thread-40::DEBUG::2014-07-10 08:55:01,058::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lion.qa.lab.tlv.redhat.com:_export_yuri2_backup2/6a70504d-00df-4869-8695-0f442053f6b6/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-40::DEBUG::2014-07-10 08:55:01,872::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n369 bytes (369 B) copied, 0.554066 s, 0.7 kB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 08:55:01,939::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 08:55:02,038::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0363598 s, 28.2 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-10 08:55:03,257::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/metadata bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-10 08:55:03,270::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000585616 s, 7.0 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 08:55:04,053::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 08:55:04,519::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.358404 s, 2.9 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 08:55:04,877::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-14::DEBUG::2014-07-10 08:55:04,878::task::595::TaskManager.Task::(_updateState) Task=`4d81b4a3-4d10-4519-be82-0f14b1b21c1d`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 08:55:04,878::logUtils::44::dispatcher::(wrapper) Run and protect: getAllTasksStatuses(spUUID=None, options=None) >Thread-14::DEBUG::2014-07-10 08:55:04,878::taskManager::102::TaskManager::(getAllTasksStatuses) Entry. >Thread-14::DEBUG::2014-07-10 08:55:04,879::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 9a3a6f4f-bc9b-484a-8a3e-851d8fdafecf >Thread-14::DEBUG::2014-07-10 08:55:04,879::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '9a3a6f4f-bc9b-484a-8a3e-851d8fdafecf'} >Thread-14::DEBUG::2014-07-10 08:55:04,879::taskManager::113::TaskManager::(getAllTasksStatuses) Return: {'9a3a6f4f-bc9b-484a-8a3e-851d8fdafecf': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '9a3a6f4f-bc9b-484a-8a3e-851d8fdafecf'}} >Thread-14::INFO::2014-07-10 08:55:04,879::logUtils::47::dispatcher::(wrapper) Run and protect: getAllTasksStatuses, Return response: {'allTasksStatus': {'9a3a6f4f-bc9b-484a-8a3e-851d8fdafecf': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '9a3a6f4f-bc9b-484a-8a3e-851d8fdafecf'}}} >Thread-14::DEBUG::2014-07-10 08:55:04,879::task::1185::TaskManager.Task::(prepare) Task=`4d81b4a3-4d10-4519-be82-0f14b1b21c1d`::finished: {'allTasksStatus': {'9a3a6f4f-bc9b-484a-8a3e-851d8fdafecf': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '9a3a6f4f-bc9b-484a-8a3e-851d8fdafecf'}}} >Thread-14::DEBUG::2014-07-10 08:55:04,880::task::595::TaskManager.Task::(_updateState) Task=`4d81b4a3-4d10-4519-be82-0f14b1b21c1d`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 08:55:04,880::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 08:55:04,880::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 08:55:04,880::task::990::TaskManager.Task::(_decref) Task=`4d81b4a3-4d10-4519-be82-0f14b1b21c1d`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 08:55:06,535::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 08:55:06,622::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0351431 s, 29.1 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 08:55:08,637::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Thread-14::DEBUG::2014-07-10 08:55:08,684::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-14::DEBUG::2014-07-10 08:55:08,688::task::595::TaskManager.Task::(_updateState) Task=`6c3e476d-ea82-4102-9258-cadcd9336e16`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 08:55:08,692::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-14::INFO::2014-07-10 08:55:08,696::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 08:55:08,698::task::1185::TaskManager.Task::(prepare) Task=`6c3e476d-ea82-4102-9258-cadcd9336e16`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 08:55:08,700::task::595::TaskManager.Task::(_updateState) Task=`6c3e476d-ea82-4102-9258-cadcd9336e16`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 08:55:08,702::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 08:55:08,704::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 08:55:08,707::task::990::TaskManager.Task::(_decref) Task=`6c3e476d-ea82-4102-9258-cadcd9336e16`::ref 0 aborting False >Thread-34::DEBUG::2014-07-10 08:55:08,721::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-34::DEBUG::2014-07-10 08:55:08,727::task::595::TaskManager.Task::(_updateState) Task=`e27a069a-adb0-4948-943d-90a78b53158a`::moving from state init -> state preparing >Thread-34::INFO::2014-07-10 08:55:08,730::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-34::DEBUG::2014-07-10 08:55:08,738::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`3166b33b-d6b2-4feb-a634-cbe57665976f`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-10 08:55:08,740::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' for lock type 'shared' >Thread-34::DEBUG::2014-07-10 08:55:08,744::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-10 08:55:08,746::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`3166b33b-d6b2-4feb-a634-cbe57665976f`::Granted request >Thread-34::DEBUG::2014-07-10 08:55:08,755::task::827::TaskManager.Task::(resourceAcquired) Task=`e27a069a-adb0-4948-943d-90a78b53158a`::_resourcesAcquired: Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee (shared) >Thread-34::DEBUG::2014-07-10 08:55:08,760::task::990::TaskManager.Task::(_decref) Task=`e27a069a-adb0-4948-943d-90a78b53158a`::ref 1 aborting False >Thread-34::INFO::2014-07-10 08:55:08,772::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1084210806784', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532069482496', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 08:55:08,774::task::1185::TaskManager.Task::(prepare) Task=`e27a069a-adb0-4948-943d-90a78b53158a`::finished: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1084210806784', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532069482496', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 08:55:08,776::task::595::TaskManager.Task::(_updateState) Task=`e27a069a-adb0-4948-943d-90a78b53158a`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-10 08:55:08,778::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee': < ResourceRef 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-10 08:55:08,780::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-10 08:55:08,784::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' >Thread-34::DEBUG::2014-07-10 08:55:08,787::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' (0 active users) >Thread-34::DEBUG::2014-07-10 08:55:08,789::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-10 08:55:08,791::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', Clearing records. >Thread-34::DEBUG::2014-07-10 08:55:08,795::task::990::TaskManager.Task::(_decref) Task=`e27a069a-adb0-4948-943d-90a78b53158a`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 08:55:08,837::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0369599 s, 27.7 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 08:55:10,520::task::595::TaskManager.Task::(_updateState) Task=`1ce37f5f-13fe-4f8a-9179-4f304e980ae5`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 08:55:10,521::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::INFO::2014-07-10 08:55:10,521::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000585616', 'lastCheck': '7.2', 'valid': True}, '6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.554066', 'lastCheck': '8.5', 'valid': True}} >Thread-14::DEBUG::2014-07-10 08:55:10,521::task::1185::TaskManager.Task::(prepare) Task=`1ce37f5f-13fe-4f8a-9179-4f304e980ae5`::finished: {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000585616', 'lastCheck': '7.2', 'valid': True}, '6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.554066', 'lastCheck': '8.5', 'valid': True}} >Thread-14::DEBUG::2014-07-10 08:55:10,522::task::595::TaskManager.Task::(_updateState) Task=`1ce37f5f-13fe-4f8a-9179-4f304e980ae5`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 08:55:10,522::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 08:55:10,522::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 08:55:10,523::task::990::TaskManager.Task::(_decref) Task=`1ce37f5f-13fe-4f8a-9179-4f304e980ae5`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 08:55:10,852::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 08:55:11,013::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0689172 s, 14.9 MB/s\n'; <rc> = 0 >Thread-40::DEBUG::2014-07-10 08:55:12,194::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lion.qa.lab.tlv.redhat.com:_export_yuri2_backup2/6a70504d-00df-4869-8695-0f442053f6b6/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-40::DEBUG::2014-07-10 08:55:12,924::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n369 bytes (369 B) copied, 0.249467 s, 1.5 kB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 08:55:13,037::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 08:55:13,126::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0338204 s, 30.3 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-10 08:55:13,300::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/metadata bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-10 08:55:13,317::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.0034601 s, 1.2 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 08:55:14,884::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-14::DEBUG::2014-07-10 08:55:14,886::task::595::TaskManager.Task::(_updateState) Task=`dab70aec-049b-4d7b-91e0-4927ac03d159`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 08:55:14,886::logUtils::44::dispatcher::(wrapper) Run and protect: getAllTasksStatuses(spUUID=None, options=None) >Thread-14::DEBUG::2014-07-10 08:55:14,887::taskManager::102::TaskManager::(getAllTasksStatuses) Entry. >Thread-14::DEBUG::2014-07-10 08:55:14,887::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 9a3a6f4f-bc9b-484a-8a3e-851d8fdafecf >Thread-14::DEBUG::2014-07-10 08:55:14,887::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '9a3a6f4f-bc9b-484a-8a3e-851d8fdafecf'} >Thread-14::DEBUG::2014-07-10 08:55:14,887::taskManager::113::TaskManager::(getAllTasksStatuses) Return: {'9a3a6f4f-bc9b-484a-8a3e-851d8fdafecf': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '9a3a6f4f-bc9b-484a-8a3e-851d8fdafecf'}} >Thread-14::INFO::2014-07-10 08:55:14,888::logUtils::47::dispatcher::(wrapper) Run and protect: getAllTasksStatuses, Return response: {'allTasksStatus': {'9a3a6f4f-bc9b-484a-8a3e-851d8fdafecf': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '9a3a6f4f-bc9b-484a-8a3e-851d8fdafecf'}}} >Thread-14::DEBUG::2014-07-10 08:55:14,888::task::1185::TaskManager.Task::(prepare) Task=`dab70aec-049b-4d7b-91e0-4927ac03d159`::finished: {'allTasksStatus': {'9a3a6f4f-bc9b-484a-8a3e-851d8fdafecf': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '9a3a6f4f-bc9b-484a-8a3e-851d8fdafecf'}}} >Thread-14::DEBUG::2014-07-10 08:55:14,891::task::595::TaskManager.Task::(_updateState) Task=`dab70aec-049b-4d7b-91e0-4927ac03d159`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 08:55:14,892::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 08:55:14,892::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 08:55:14,892::task::990::TaskManager.Task::(_decref) Task=`dab70aec-049b-4d7b-91e0-4927ac03d159`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 08:55:15,141::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 08:55:15,221::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0267481 s, 38.3 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 08:55:17,237::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 08:55:17,327::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0382959 s, 26.7 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 08:55:18,831::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-14::DEBUG::2014-07-10 08:55:18,837::task::595::TaskManager.Task::(_updateState) Task=`6d7f665f-2f10-4edb-a3a0-3d8a37cc44ad`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 08:55:18,838::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-14::INFO::2014-07-10 08:55:18,839::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 08:55:18,839::task::1185::TaskManager.Task::(prepare) Task=`6d7f665f-2f10-4edb-a3a0-3d8a37cc44ad`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 08:55:18,840::task::595::TaskManager.Task::(_updateState) Task=`6d7f665f-2f10-4edb-a3a0-3d8a37cc44ad`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 08:55:18,843::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 08:55:18,843::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 08:55:18,844::task::990::TaskManager.Task::(_decref) Task=`6d7f665f-2f10-4edb-a3a0-3d8a37cc44ad`::ref 0 aborting False >Thread-34::DEBUG::2014-07-10 08:55:18,855::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-34::DEBUG::2014-07-10 08:55:18,855::task::595::TaskManager.Task::(_updateState) Task=`bd494998-b347-4838-a23b-c87ca8ed595f`::moving from state init -> state preparing >Thread-34::INFO::2014-07-10 08:55:18,856::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-34::DEBUG::2014-07-10 08:55:18,857::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`f2dcd371-254f-4a95-a7dd-179b6c311f3a`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-10 08:55:18,857::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' for lock type 'shared' >Thread-34::DEBUG::2014-07-10 08:55:18,858::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-10 08:55:18,858::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`f2dcd371-254f-4a95-a7dd-179b6c311f3a`::Granted request >Thread-34::DEBUG::2014-07-10 08:55:18,859::task::827::TaskManager.Task::(resourceAcquired) Task=`bd494998-b347-4838-a23b-c87ca8ed595f`::_resourcesAcquired: Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee (shared) >Thread-34::DEBUG::2014-07-10 08:55:18,859::task::990::TaskManager.Task::(_decref) Task=`bd494998-b347-4838-a23b-c87ca8ed595f`::ref 1 aborting False >Thread-34::INFO::2014-07-10 08:55:18,861::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1084210806784', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532069482496', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 08:55:18,861::task::1185::TaskManager.Task::(prepare) Task=`bd494998-b347-4838-a23b-c87ca8ed595f`::finished: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1084210806784', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532069482496', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 08:55:18,861::task::595::TaskManager.Task::(_updateState) Task=`bd494998-b347-4838-a23b-c87ca8ed595f`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-10 08:55:18,862::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee': < ResourceRef 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-10 08:55:18,862::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-10 08:55:18,862::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' >Thread-34::DEBUG::2014-07-10 08:55:18,863::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' (0 active users) >Thread-34::DEBUG::2014-07-10 08:55:18,863::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-10 08:55:18,863::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', Clearing records. >Thread-34::DEBUG::2014-07-10 08:55:18,864::task::990::TaskManager.Task::(_decref) Task=`bd494998-b347-4838-a23b-c87ca8ed595f`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 08:55:19,342::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 08:55:19,423::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.032122 s, 31.9 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 08:55:21,439::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 08:55:21,525::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0335363 s, 30.5 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-10 08:55:23,345::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/metadata bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-10 08:55:23,360::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000593448 s, 6.9 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 08:55:23,540::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Thread-40::DEBUG::2014-07-10 08:55:23,567::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lion.qa.lab.tlv.redhat.com:_export_yuri2_backup2/6a70504d-00df-4869-8695-0f442053f6b6/dom_md/metadata bs=4096 count=1' (cwd None) >Dummy-33::DEBUG::2014-07-10 08:55:23,647::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0553687 s, 18.5 MB/s\n'; <rc> = 0 >Thread-40::DEBUG::2014-07-10 08:55:24,138::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n369 bytes (369 B) copied, 0.177265 s, 2.1 kB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 08:55:24,897::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-14::DEBUG::2014-07-10 08:55:24,898::task::595::TaskManager.Task::(_updateState) Task=`8aea82fa-5f63-4482-b7b8-60f7936be328`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 08:55:24,898::logUtils::44::dispatcher::(wrapper) Run and protect: getAllTasksStatuses(spUUID=None, options=None) >Thread-14::DEBUG::2014-07-10 08:55:24,898::taskManager::102::TaskManager::(getAllTasksStatuses) Entry. >Thread-14::DEBUG::2014-07-10 08:55:24,898::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 9a3a6f4f-bc9b-484a-8a3e-851d8fdafecf >Thread-14::DEBUG::2014-07-10 08:55:24,899::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '9a3a6f4f-bc9b-484a-8a3e-851d8fdafecf'} >Thread-14::DEBUG::2014-07-10 08:55:24,899::taskManager::113::TaskManager::(getAllTasksStatuses) Return: {'9a3a6f4f-bc9b-484a-8a3e-851d8fdafecf': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '9a3a6f4f-bc9b-484a-8a3e-851d8fdafecf'}} >Thread-14::INFO::2014-07-10 08:55:24,899::logUtils::47::dispatcher::(wrapper) Run and protect: getAllTasksStatuses, Return response: {'allTasksStatus': {'9a3a6f4f-bc9b-484a-8a3e-851d8fdafecf': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '9a3a6f4f-bc9b-484a-8a3e-851d8fdafecf'}}} >Thread-14::DEBUG::2014-07-10 08:55:24,899::task::1185::TaskManager.Task::(prepare) Task=`8aea82fa-5f63-4482-b7b8-60f7936be328`::finished: {'allTasksStatus': {'9a3a6f4f-bc9b-484a-8a3e-851d8fdafecf': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '9a3a6f4f-bc9b-484a-8a3e-851d8fdafecf'}}} >Thread-14::DEBUG::2014-07-10 08:55:24,899::task::595::TaskManager.Task::(_updateState) Task=`8aea82fa-5f63-4482-b7b8-60f7936be328`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 08:55:24,900::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 08:55:24,900::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 08:55:24,900::task::990::TaskManager.Task::(_decref) Task=`8aea82fa-5f63-4482-b7b8-60f7936be328`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 08:55:25,664::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Thread-14::DEBUG::2014-07-10 08:55:25,683::task::595::TaskManager.Task::(_updateState) Task=`5e712fcc-162b-4e51-babe-18206aed45dd`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 08:55:25,688::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::INFO::2014-07-10 08:55:25,692::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000593448', 'lastCheck': '2.3', 'valid': True}, '6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.177265', 'lastCheck': '1.4', 'valid': True}} >Thread-14::DEBUG::2014-07-10 08:55:25,694::task::1185::TaskManager.Task::(prepare) Task=`5e712fcc-162b-4e51-babe-18206aed45dd`::finished: {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000593448', 'lastCheck': '2.3', 'valid': True}, '6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.177265', 'lastCheck': '1.4', 'valid': True}} >Thread-14::DEBUG::2014-07-10 08:55:25,696::task::595::TaskManager.Task::(_updateState) Task=`5e712fcc-162b-4e51-babe-18206aed45dd`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 08:55:25,698::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 08:55:25,701::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 08:55:25,703::task::990::TaskManager.Task::(_decref) Task=`5e712fcc-162b-4e51-babe-18206aed45dd`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 08:55:25,825::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.10636 s, 9.6 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 08:55:27,840::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 08:55:27,928::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0343441 s, 29.8 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 08:55:28,895::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-14::DEBUG::2014-07-10 08:55:28,896::task::595::TaskManager.Task::(_updateState) Task=`973f4698-1aed-460b-b89e-44fda780cdf8`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 08:55:28,896::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-14::INFO::2014-07-10 08:55:28,897::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 08:55:28,897::task::1185::TaskManager.Task::(prepare) Task=`973f4698-1aed-460b-b89e-44fda780cdf8`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 08:55:28,897::task::595::TaskManager.Task::(_updateState) Task=`973f4698-1aed-460b-b89e-44fda780cdf8`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 08:55:28,898::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 08:55:28,898::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 08:55:28,898::task::990::TaskManager.Task::(_decref) Task=`973f4698-1aed-460b-b89e-44fda780cdf8`::ref 0 aborting False >Thread-34::DEBUG::2014-07-10 08:55:28,902::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-34::DEBUG::2014-07-10 08:55:28,903::task::595::TaskManager.Task::(_updateState) Task=`3584d5e4-18b7-443f-a752-cb26914523bd`::moving from state init -> state preparing >Thread-34::INFO::2014-07-10 08:55:28,903::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-34::DEBUG::2014-07-10 08:55:28,903::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`3d2a54c9-caff-4d18-96d4-6159576e9293`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-10 08:55:28,904::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' for lock type 'shared' >Thread-34::DEBUG::2014-07-10 08:55:28,904::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-10 08:55:28,904::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`3d2a54c9-caff-4d18-96d4-6159576e9293`::Granted request >Thread-34::DEBUG::2014-07-10 08:55:28,905::task::827::TaskManager.Task::(resourceAcquired) Task=`3584d5e4-18b7-443f-a752-cb26914523bd`::_resourcesAcquired: Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee (shared) >Thread-34::DEBUG::2014-07-10 08:55:28,905::task::990::TaskManager.Task::(_decref) Task=`3584d5e4-18b7-443f-a752-cb26914523bd`::ref 1 aborting False >Thread-34::INFO::2014-07-10 08:55:28,906::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1084210806784', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532069482496', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 08:55:28,907::task::1185::TaskManager.Task::(prepare) Task=`3584d5e4-18b7-443f-a752-cb26914523bd`::finished: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1084210806784', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532069482496', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 08:55:28,907::task::595::TaskManager.Task::(_updateState) Task=`3584d5e4-18b7-443f-a752-cb26914523bd`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-10 08:55:28,907::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee': < ResourceRef 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-10 08:55:28,907::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-10 08:55:28,908::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' >Thread-34::DEBUG::2014-07-10 08:55:28,908::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' (0 active users) >Thread-34::DEBUG::2014-07-10 08:55:28,909::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-10 08:55:28,909::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', Clearing records. >Thread-34::DEBUG::2014-07-10 08:55:28,909::task::990::TaskManager.Task::(_decref) Task=`3584d5e4-18b7-443f-a752-cb26914523bd`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 08:55:29,946::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 08:55:30,030::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0308984 s, 33.1 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 08:55:32,046::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 08:55:32,131::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0329871 s, 31.0 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-10 08:55:33,389::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/metadata bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-10 08:55:33,404::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000761334 s, 5.4 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 08:55:34,148::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 08:55:34,236::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0355482 s, 28.8 MB/s\n'; <rc> = 0 >Thread-40::DEBUG::2014-07-10 08:55:34,750::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lion.qa.lab.tlv.redhat.com:_export_yuri2_backup2/6a70504d-00df-4869-8695-0f442053f6b6/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-14::DEBUG::2014-07-10 08:55:34,904::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-14::DEBUG::2014-07-10 08:55:34,905::task::595::TaskManager.Task::(_updateState) Task=`47efd8cb-63a6-4bc8-809b-4485736f3c9c`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 08:55:34,906::logUtils::44::dispatcher::(wrapper) Run and protect: getAllTasksStatuses(spUUID=None, options=None) >Thread-14::DEBUG::2014-07-10 08:55:34,906::taskManager::102::TaskManager::(getAllTasksStatuses) Entry. >Thread-14::DEBUG::2014-07-10 08:55:34,907::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 9a3a6f4f-bc9b-484a-8a3e-851d8fdafecf >Thread-14::DEBUG::2014-07-10 08:55:34,907::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '9a3a6f4f-bc9b-484a-8a3e-851d8fdafecf'} >Thread-14::DEBUG::2014-07-10 08:55:34,907::taskManager::113::TaskManager::(getAllTasksStatuses) Return: {'9a3a6f4f-bc9b-484a-8a3e-851d8fdafecf': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '9a3a6f4f-bc9b-484a-8a3e-851d8fdafecf'}} >Thread-14::INFO::2014-07-10 08:55:34,908::logUtils::47::dispatcher::(wrapper) Run and protect: getAllTasksStatuses, Return response: {'allTasksStatus': {'9a3a6f4f-bc9b-484a-8a3e-851d8fdafecf': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '9a3a6f4f-bc9b-484a-8a3e-851d8fdafecf'}}} >Thread-14::DEBUG::2014-07-10 08:55:34,908::task::1185::TaskManager.Task::(prepare) Task=`47efd8cb-63a6-4bc8-809b-4485736f3c9c`::finished: {'allTasksStatus': {'9a3a6f4f-bc9b-484a-8a3e-851d8fdafecf': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '9a3a6f4f-bc9b-484a-8a3e-851d8fdafecf'}}} >Thread-14::DEBUG::2014-07-10 08:55:34,908::task::595::TaskManager.Task::(_updateState) Task=`47efd8cb-63a6-4bc8-809b-4485736f3c9c`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 08:55:34,908::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 08:55:34,909::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 08:55:34,909::task::990::TaskManager.Task::(_decref) Task=`47efd8cb-63a6-4bc8-809b-4485736f3c9c`::ref 0 aborting False >Thread-40::DEBUG::2014-07-10 08:55:35,742::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n369 bytes (369 B) copied, 0.23357 s, 1.6 kB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 08:55:36,251::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 08:55:36,346::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.041051 s, 24.9 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 08:55:38,362::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 08:55:38,446::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0305396 s, 33.5 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 08:55:38,937::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [72f5e52c] >Thread-14::DEBUG::2014-07-10 08:55:38,939::task::595::TaskManager.Task::(_updateState) Task=`4bbb4f29-688e-4435-aa58-b99651a22edd`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 08:55:38,940::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-14::INFO::2014-07-10 08:55:38,940::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 08:55:38,941::task::1185::TaskManager.Task::(prepare) Task=`4bbb4f29-688e-4435-aa58-b99651a22edd`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 08:55:38,941::task::595::TaskManager.Task::(_updateState) Task=`4bbb4f29-688e-4435-aa58-b99651a22edd`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 08:55:38,941::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 08:55:38,942::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 08:55:38,942::task::990::TaskManager.Task::(_decref) Task=`4bbb4f29-688e-4435-aa58-b99651a22edd`::ref 0 aborting False >Thread-34::DEBUG::2014-07-10 08:55:38,948::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [72f5e52c] >Thread-34::DEBUG::2014-07-10 08:55:38,949::task::595::TaskManager.Task::(_updateState) Task=`7591c0fc-99dd-49b3-943a-13843d52d331`::moving from state init -> state preparing >Thread-34::INFO::2014-07-10 08:55:38,949::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-34::DEBUG::2014-07-10 08:55:38,951::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`7fa3393c-6780-4d9b-a98b-acbab87b9d1c`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-10 08:55:38,951::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' for lock type 'shared' >Thread-34::DEBUG::2014-07-10 08:55:38,951::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-10 08:55:38,952::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`7fa3393c-6780-4d9b-a98b-acbab87b9d1c`::Granted request >Thread-34::DEBUG::2014-07-10 08:55:38,952::task::827::TaskManager.Task::(resourceAcquired) Task=`7591c0fc-99dd-49b3-943a-13843d52d331`::_resourcesAcquired: Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee (shared) >Thread-34::DEBUG::2014-07-10 08:55:38,953::task::990::TaskManager.Task::(_decref) Task=`7591c0fc-99dd-49b3-943a-13843d52d331`::ref 1 aborting False >Thread-34::INFO::2014-07-10 08:55:38,954::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1084210806784', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532069482496', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 08:55:38,955::task::1185::TaskManager.Task::(prepare) Task=`7591c0fc-99dd-49b3-943a-13843d52d331`::finished: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1084210806784', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532069482496', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 08:55:38,955::task::595::TaskManager.Task::(_updateState) Task=`7591c0fc-99dd-49b3-943a-13843d52d331`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-10 08:55:38,955::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee': < ResourceRef 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-10 08:55:38,956::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-10 08:55:38,956::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' >Thread-34::DEBUG::2014-07-10 08:55:38,956::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' (0 active users) >Thread-34::DEBUG::2014-07-10 08:55:38,957::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-10 08:55:38,957::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', Clearing records. >Thread-34::DEBUG::2014-07-10 08:55:38,957::task::990::TaskManager.Task::(_decref) Task=`7591c0fc-99dd-49b3-943a-13843d52d331`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 08:55:40,462::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 08:55:40,550::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0361942 s, 28.3 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 08:55:40,874::task::595::TaskManager.Task::(_updateState) Task=`03aa7985-fa32-4f2f-89a4-ba5159e0fcbd`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 08:55:40,875::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::INFO::2014-07-10 08:55:40,876::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000761334', 'lastCheck': '7.4', 'valid': True}, '6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.23357', 'lastCheck': '5.0', 'valid': True}} >Thread-14::DEBUG::2014-07-10 08:55:40,876::task::1185::TaskManager.Task::(prepare) Task=`03aa7985-fa32-4f2f-89a4-ba5159e0fcbd`::finished: {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000761334', 'lastCheck': '7.4', 'valid': True}, '6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.23357', 'lastCheck': '5.0', 'valid': True}} >Thread-14::DEBUG::2014-07-10 08:55:40,876::task::595::TaskManager.Task::(_updateState) Task=`03aa7985-fa32-4f2f-89a4-ba5159e0fcbd`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 08:55:40,876::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 08:55:40,876::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 08:55:40,877::task::990::TaskManager.Task::(_decref) Task=`03aa7985-fa32-4f2f-89a4-ba5159e0fcbd`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 08:55:42,566::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 08:55:42,653::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.035045 s, 29.2 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-10 08:55:43,432::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/metadata bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-10 08:55:43,450::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00322935 s, 1.3 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 08:55:44,668::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 08:55:44,752::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0299622 s, 34.2 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 08:55:44,915::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-14::DEBUG::2014-07-10 08:55:44,916::task::595::TaskManager.Task::(_updateState) Task=`57ed5b8e-38d5-405f-97a6-56c9fa0b6c61`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 08:55:44,917::logUtils::44::dispatcher::(wrapper) Run and protect: getAllTasksStatuses(spUUID=None, options=None) >Thread-14::DEBUG::2014-07-10 08:55:44,917::taskManager::102::TaskManager::(getAllTasksStatuses) Entry. >Thread-14::DEBUG::2014-07-10 08:55:44,918::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 9a3a6f4f-bc9b-484a-8a3e-851d8fdafecf >Thread-14::DEBUG::2014-07-10 08:55:44,918::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '9a3a6f4f-bc9b-484a-8a3e-851d8fdafecf'} >Thread-14::DEBUG::2014-07-10 08:55:44,919::taskManager::113::TaskManager::(getAllTasksStatuses) Return: {'9a3a6f4f-bc9b-484a-8a3e-851d8fdafecf': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '9a3a6f4f-bc9b-484a-8a3e-851d8fdafecf'}} >Thread-14::INFO::2014-07-10 08:55:44,919::logUtils::47::dispatcher::(wrapper) Run and protect: getAllTasksStatuses, Return response: {'allTasksStatus': {'9a3a6f4f-bc9b-484a-8a3e-851d8fdafecf': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '9a3a6f4f-bc9b-484a-8a3e-851d8fdafecf'}}} >Thread-14::DEBUG::2014-07-10 08:55:44,919::task::1185::TaskManager.Task::(prepare) Task=`57ed5b8e-38d5-405f-97a6-56c9fa0b6c61`::finished: {'allTasksStatus': {'9a3a6f4f-bc9b-484a-8a3e-851d8fdafecf': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '9a3a6f4f-bc9b-484a-8a3e-851d8fdafecf'}}} >Thread-14::DEBUG::2014-07-10 08:55:44,920::task::595::TaskManager.Task::(_updateState) Task=`57ed5b8e-38d5-405f-97a6-56c9fa0b6c61`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 08:55:44,920::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 08:55:44,920::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 08:55:44,921::task::990::TaskManager.Task::(_decref) Task=`57ed5b8e-38d5-405f-97a6-56c9fa0b6c61`::ref 0 aborting False >Thread-40::DEBUG::2014-07-10 08:55:46,284::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lion.qa.lab.tlv.redhat.com:_export_yuri2_backup2/6a70504d-00df-4869-8695-0f442053f6b6/dom_md/metadata bs=4096 count=1' (cwd None) >Dummy-33::DEBUG::2014-07-10 08:55:46,768::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 08:55:46,855::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0362102 s, 28.3 MB/s\n'; <rc> = 0 >Thread-40::DEBUG::2014-07-10 08:55:46,876::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n369 bytes (369 B) copied, 0.362118 s, 1.0 kB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 08:55:48,870::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 08:55:48,958::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.029354 s, 34.9 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 08:55:48,995::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-14::DEBUG::2014-07-10 08:55:48,997::task::595::TaskManager.Task::(_updateState) Task=`fac2ad37-e376-4ff9-bebb-448c3e4212ad`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 08:55:48,997::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-14::INFO::2014-07-10 08:55:48,998::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 08:55:48,999::task::1185::TaskManager.Task::(prepare) Task=`fac2ad37-e376-4ff9-bebb-448c3e4212ad`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 08:55:48,999::task::595::TaskManager.Task::(_updateState) Task=`fac2ad37-e376-4ff9-bebb-448c3e4212ad`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 08:55:48,999::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 08:55:48,999::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 08:55:49,000::task::990::TaskManager.Task::(_decref) Task=`fac2ad37-e376-4ff9-bebb-448c3e4212ad`::ref 0 aborting False >Thread-34::DEBUG::2014-07-10 08:55:49,006::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-34::DEBUG::2014-07-10 08:55:49,006::task::595::TaskManager.Task::(_updateState) Task=`8b84b36e-0c93-48d4-bd45-684827cf467f`::moving from state init -> state preparing >Thread-34::INFO::2014-07-10 08:55:49,007::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-34::DEBUG::2014-07-10 08:55:49,008::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`22725c22-9dca-42f7-b121-3da9ee451c5c`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-10 08:55:49,008::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' for lock type 'shared' >Thread-34::DEBUG::2014-07-10 08:55:49,009::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-10 08:55:49,009::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`22725c22-9dca-42f7-b121-3da9ee451c5c`::Granted request >Thread-34::DEBUG::2014-07-10 08:55:49,011::task::827::TaskManager.Task::(resourceAcquired) Task=`8b84b36e-0c93-48d4-bd45-684827cf467f`::_resourcesAcquired: Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee (shared) >Thread-34::DEBUG::2014-07-10 08:55:49,012::task::990::TaskManager.Task::(_decref) Task=`8b84b36e-0c93-48d4-bd45-684827cf467f`::ref 1 aborting False >Thread-34::INFO::2014-07-10 08:55:49,014::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1084210806784', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532069482496', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 08:55:49,014::task::1185::TaskManager.Task::(prepare) Task=`8b84b36e-0c93-48d4-bd45-684827cf467f`::finished: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1084210806784', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532069482496', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 08:55:49,014::task::595::TaskManager.Task::(_updateState) Task=`8b84b36e-0c93-48d4-bd45-684827cf467f`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-10 08:55:49,015::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee': < ResourceRef 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-10 08:55:49,015::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-10 08:55:49,016::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' >Thread-34::DEBUG::2014-07-10 08:55:49,016::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' (0 active users) >Thread-34::DEBUG::2014-07-10 08:55:49,016::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-10 08:55:49,017::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', Clearing records. >Thread-34::DEBUG::2014-07-10 08:55:49,017::task::990::TaskManager.Task::(_decref) Task=`8b84b36e-0c93-48d4-bd45-684827cf467f`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 08:55:50,974::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 08:55:51,057::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0318767 s, 32.1 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 08:55:53,072::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 08:55:53,160::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.035223 s, 29.1 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-10 08:55:53,481::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/metadata bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-10 08:55:53,501::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00106217 s, 3.9 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 08:55:54,928::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-14::DEBUG::2014-07-10 08:55:54,929::task::595::TaskManager.Task::(_updateState) Task=`31b15b4d-bb3a-4093-b34f-618a94e79686`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 08:55:54,930::logUtils::44::dispatcher::(wrapper) Run and protect: getAllTasksStatuses(spUUID=None, options=None) >Thread-14::DEBUG::2014-07-10 08:55:54,930::taskManager::102::TaskManager::(getAllTasksStatuses) Entry. >Thread-14::DEBUG::2014-07-10 08:55:54,930::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 9a3a6f4f-bc9b-484a-8a3e-851d8fdafecf >Thread-14::DEBUG::2014-07-10 08:55:54,930::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '9a3a6f4f-bc9b-484a-8a3e-851d8fdafecf'} >Thread-14::DEBUG::2014-07-10 08:55:54,931::taskManager::113::TaskManager::(getAllTasksStatuses) Return: {'9a3a6f4f-bc9b-484a-8a3e-851d8fdafecf': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '9a3a6f4f-bc9b-484a-8a3e-851d8fdafecf'}} >Thread-14::INFO::2014-07-10 08:55:54,931::logUtils::47::dispatcher::(wrapper) Run and protect: getAllTasksStatuses, Return response: {'allTasksStatus': {'9a3a6f4f-bc9b-484a-8a3e-851d8fdafecf': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '9a3a6f4f-bc9b-484a-8a3e-851d8fdafecf'}}} >Thread-14::DEBUG::2014-07-10 08:55:54,931::task::1185::TaskManager.Task::(prepare) Task=`31b15b4d-bb3a-4093-b34f-618a94e79686`::finished: {'allTasksStatus': {'9a3a6f4f-bc9b-484a-8a3e-851d8fdafecf': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '9a3a6f4f-bc9b-484a-8a3e-851d8fdafecf'}}} >Thread-14::DEBUG::2014-07-10 08:55:54,931::task::595::TaskManager.Task::(_updateState) Task=`31b15b4d-bb3a-4093-b34f-618a94e79686`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 08:55:54,931::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 08:55:54,932::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 08:55:54,932::task::990::TaskManager.Task::(_decref) Task=`31b15b4d-bb3a-4093-b34f-618a94e79686`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 08:55:55,175::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 08:55:55,263::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0357914 s, 28.6 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 08:55:56,026::task::595::TaskManager.Task::(_updateState) Task=`bec844d6-d67f-43bb-b263-7507e89167cc`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 08:55:56,027::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::INFO::2014-07-10 08:55:56,027::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00106217', 'lastCheck': '2.5', 'valid': True}, '6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.362118', 'lastCheck': '9.0', 'valid': True}} >Thread-14::DEBUG::2014-07-10 08:55:56,027::task::1185::TaskManager.Task::(prepare) Task=`bec844d6-d67f-43bb-b263-7507e89167cc`::finished: {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00106217', 'lastCheck': '2.5', 'valid': True}, '6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.362118', 'lastCheck': '9.0', 'valid': True}} >Thread-14::DEBUG::2014-07-10 08:55:56,028::task::595::TaskManager.Task::(_updateState) Task=`bec844d6-d67f-43bb-b263-7507e89167cc`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 08:55:56,028::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 08:55:56,028::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 08:55:56,028::task::990::TaskManager.Task::(_decref) Task=`bec844d6-d67f-43bb-b263-7507e89167cc`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 08:55:57,278::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 08:55:57,363::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0349658 s, 29.3 MB/s\n'; <rc> = 0 >Thread-40::DEBUG::2014-07-10 08:55:58,058::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lion.qa.lab.tlv.redhat.com:_export_yuri2_backup2/6a70504d-00df-4869-8695-0f442053f6b6/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-40::DEBUG::2014-07-10 08:55:58,764::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n369 bytes (369 B) copied, 0.29947 s, 1.2 kB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 08:55:59,052::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-14::DEBUG::2014-07-10 08:55:59,053::task::595::TaskManager.Task::(_updateState) Task=`2e5a0466-d255-45c2-949b-b17e0f98d2ae`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 08:55:59,054::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-14::INFO::2014-07-10 08:55:59,055::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 08:55:59,055::task::1185::TaskManager.Task::(prepare) Task=`2e5a0466-d255-45c2-949b-b17e0f98d2ae`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 08:55:59,055::task::595::TaskManager.Task::(_updateState) Task=`2e5a0466-d255-45c2-949b-b17e0f98d2ae`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 08:55:59,056::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 08:55:59,056::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 08:55:59,056::task::990::TaskManager.Task::(_decref) Task=`2e5a0466-d255-45c2-949b-b17e0f98d2ae`::ref 0 aborting False >Thread-34::DEBUG::2014-07-10 08:55:59,062::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-34::DEBUG::2014-07-10 08:55:59,062::task::595::TaskManager.Task::(_updateState) Task=`50a2307a-dca0-42fc-8382-62b33a9207dc`::moving from state init -> state preparing >Thread-34::INFO::2014-07-10 08:55:59,063::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-34::DEBUG::2014-07-10 08:55:59,064::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`dc4ce8b9-d899-4b19-9904-645827d4ea05`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-10 08:55:59,064::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' for lock type 'shared' >Thread-34::DEBUG::2014-07-10 08:55:59,065::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-10 08:55:59,065::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`dc4ce8b9-d899-4b19-9904-645827d4ea05`::Granted request >Thread-34::DEBUG::2014-07-10 08:55:59,066::task::827::TaskManager.Task::(resourceAcquired) Task=`50a2307a-dca0-42fc-8382-62b33a9207dc`::_resourcesAcquired: Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee (shared) >Thread-34::DEBUG::2014-07-10 08:55:59,066::task::990::TaskManager.Task::(_decref) Task=`50a2307a-dca0-42fc-8382-62b33a9207dc`::ref 1 aborting False >Thread-34::INFO::2014-07-10 08:55:59,068::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1084210806784', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532069482496', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 08:55:59,068::task::1185::TaskManager.Task::(prepare) Task=`50a2307a-dca0-42fc-8382-62b33a9207dc`::finished: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1084210806784', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532069482496', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 08:55:59,069::task::595::TaskManager.Task::(_updateState) Task=`50a2307a-dca0-42fc-8382-62b33a9207dc`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-10 08:55:59,069::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee': < ResourceRef 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-10 08:55:59,069::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-10 08:55:59,070::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' >Thread-34::DEBUG::2014-07-10 08:55:59,070::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' (0 active users) >Thread-34::DEBUG::2014-07-10 08:55:59,071::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-10 08:55:59,071::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', Clearing records. >Thread-34::DEBUG::2014-07-10 08:55:59,071::task::990::TaskManager.Task::(_decref) Task=`50a2307a-dca0-42fc-8382-62b33a9207dc`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 08:55:59,378::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 08:55:59,455::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0260265 s, 39.3 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 08:56:01,501::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 08:56:01,614::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.060208 s, 17.0 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-10 08:56:03,530::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/metadata bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-10 08:56:03,543::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00060959 s, 6.7 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 08:56:03,629::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 08:56:03,719::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0354599 s, 28.9 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 08:56:04,938::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-14::DEBUG::2014-07-10 08:56:04,940::task::595::TaskManager.Task::(_updateState) Task=`b7f308eb-c129-4c04-ab9a-edba98c2e2ff`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 08:56:04,940::logUtils::44::dispatcher::(wrapper) Run and protect: getAllTasksStatuses(spUUID=None, options=None) >Thread-14::DEBUG::2014-07-10 08:56:04,941::taskManager::102::TaskManager::(getAllTasksStatuses) Entry. >Thread-14::DEBUG::2014-07-10 08:56:04,941::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 9a3a6f4f-bc9b-484a-8a3e-851d8fdafecf >Thread-14::DEBUG::2014-07-10 08:56:04,941::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '9a3a6f4f-bc9b-484a-8a3e-851d8fdafecf'} >Thread-14::DEBUG::2014-07-10 08:56:04,942::taskManager::113::TaskManager::(getAllTasksStatuses) Return: {'9a3a6f4f-bc9b-484a-8a3e-851d8fdafecf': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '9a3a6f4f-bc9b-484a-8a3e-851d8fdafecf'}} >Thread-14::INFO::2014-07-10 08:56:04,942::logUtils::47::dispatcher::(wrapper) Run and protect: getAllTasksStatuses, Return response: {'allTasksStatus': {'9a3a6f4f-bc9b-484a-8a3e-851d8fdafecf': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '9a3a6f4f-bc9b-484a-8a3e-851d8fdafecf'}}} >Thread-14::DEBUG::2014-07-10 08:56:04,942::task::1185::TaskManager.Task::(prepare) Task=`b7f308eb-c129-4c04-ab9a-edba98c2e2ff`::finished: {'allTasksStatus': {'9a3a6f4f-bc9b-484a-8a3e-851d8fdafecf': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '9a3a6f4f-bc9b-484a-8a3e-851d8fdafecf'}}} >Thread-14::DEBUG::2014-07-10 08:56:04,942::task::595::TaskManager.Task::(_updateState) Task=`b7f308eb-c129-4c04-ab9a-edba98c2e2ff`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 08:56:04,943::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 08:56:04,943::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 08:56:04,943::task::990::TaskManager.Task::(_decref) Task=`b7f308eb-c129-4c04-ab9a-edba98c2e2ff`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 08:56:05,734::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 08:56:05,816::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0287249 s, 35.6 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 08:56:07,831::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 08:56:07,916::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0335531 s, 30.5 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 08:56:09,118::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-14::DEBUG::2014-07-10 08:56:09,119::task::595::TaskManager.Task::(_updateState) Task=`bac1acef-b846-4a3c-8476-3bf6b9ad6ccf`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 08:56:09,120::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-14::INFO::2014-07-10 08:56:09,121::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 08:56:09,121::task::1185::TaskManager.Task::(prepare) Task=`bac1acef-b846-4a3c-8476-3bf6b9ad6ccf`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 08:56:09,121::task::595::TaskManager.Task::(_updateState) Task=`bac1acef-b846-4a3c-8476-3bf6b9ad6ccf`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 08:56:09,121::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 08:56:09,122::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 08:56:09,122::task::990::TaskManager.Task::(_decref) Task=`bac1acef-b846-4a3c-8476-3bf6b9ad6ccf`::ref 0 aborting False >Thread-34::DEBUG::2014-07-10 08:56:09,126::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-34::DEBUG::2014-07-10 08:56:09,127::task::595::TaskManager.Task::(_updateState) Task=`8cfdf1a2-bad7-4cae-9328-3810efc140a5`::moving from state init -> state preparing >Thread-34::INFO::2014-07-10 08:56:09,127::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-34::DEBUG::2014-07-10 08:56:09,128::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`801f4e5d-bb2e-45df-9f29-8919d8d38409`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-10 08:56:09,129::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' for lock type 'shared' >Thread-34::DEBUG::2014-07-10 08:56:09,129::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-10 08:56:09,129::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`801f4e5d-bb2e-45df-9f29-8919d8d38409`::Granted request >Thread-34::DEBUG::2014-07-10 08:56:09,130::task::827::TaskManager.Task::(resourceAcquired) Task=`8cfdf1a2-bad7-4cae-9328-3810efc140a5`::_resourcesAcquired: Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee (shared) >Thread-34::DEBUG::2014-07-10 08:56:09,131::task::990::TaskManager.Task::(_decref) Task=`8cfdf1a2-bad7-4cae-9328-3810efc140a5`::ref 1 aborting False >Thread-34::INFO::2014-07-10 08:56:09,133::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1084210806784', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532069482496', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 08:56:09,133::task::1185::TaskManager.Task::(prepare) Task=`8cfdf1a2-bad7-4cae-9328-3810efc140a5`::finished: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1084210806784', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532069482496', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 08:56:09,133::task::595::TaskManager.Task::(_updateState) Task=`8cfdf1a2-bad7-4cae-9328-3810efc140a5`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-10 08:56:09,133::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee': < ResourceRef 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-10 08:56:09,134::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-10 08:56:09,134::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' >Thread-34::DEBUG::2014-07-10 08:56:09,134::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' (0 active users) >Thread-34::DEBUG::2014-07-10 08:56:09,135::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-10 08:56:09,135::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', Clearing records. >Thread-34::DEBUG::2014-07-10 08:56:09,135::task::990::TaskManager.Task::(_decref) Task=`8cfdf1a2-bad7-4cae-9328-3810efc140a5`::ref 0 aborting False >Thread-40::DEBUG::2014-07-10 08:56:09,279::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lion.qa.lab.tlv.redhat.com:_export_yuri2_backup2/6a70504d-00df-4869-8695-0f442053f6b6/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-40::DEBUG::2014-07-10 08:56:09,417::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n369 bytes (369 B) copied, 0.000419368 s, 880 kB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 08:56:09,931::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 08:56:10,025::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.041435 s, 24.7 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 08:56:11,163::task::595::TaskManager.Task::(_updateState) Task=`bbda6d45-be5e-4706-97b6-a4d0d0c5d49e`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 08:56:11,164::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::INFO::2014-07-10 08:56:11,165::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00060959', 'lastCheck': '7.6', 'valid': True}, '6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000419368', 'lastCheck': '1.7', 'valid': True}} >Thread-14::DEBUG::2014-07-10 08:56:11,165::task::1185::TaskManager.Task::(prepare) Task=`bbda6d45-be5e-4706-97b6-a4d0d0c5d49e`::finished: {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00060959', 'lastCheck': '7.6', 'valid': True}, '6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000419368', 'lastCheck': '1.7', 'valid': True}} >Thread-14::DEBUG::2014-07-10 08:56:11,165::task::595::TaskManager.Task::(_updateState) Task=`bbda6d45-be5e-4706-97b6-a4d0d0c5d49e`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 08:56:11,165::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 08:56:11,166::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 08:56:11,166::task::990::TaskManager.Task::(_decref) Task=`bbda6d45-be5e-4706-97b6-a4d0d0c5d49e`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 08:56:12,041::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 08:56:12,129::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0363212 s, 28.2 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-10 08:56:13,603::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/metadata bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-10 08:56:13,656::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.0361251 s, 113 kB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 08:56:14,144::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 08:56:14,233::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.035245 s, 29.1 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 08:56:14,949::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-14::DEBUG::2014-07-10 08:56:14,951::task::595::TaskManager.Task::(_updateState) Task=`cc209c76-8362-4c8e-a31c-a090bc886f19`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 08:56:14,951::logUtils::44::dispatcher::(wrapper) Run and protect: getAllTasksStatuses(spUUID=None, options=None) >Thread-14::DEBUG::2014-07-10 08:56:14,951::taskManager::102::TaskManager::(getAllTasksStatuses) Entry. >Thread-14::DEBUG::2014-07-10 08:56:14,952::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 9a3a6f4f-bc9b-484a-8a3e-851d8fdafecf >Thread-14::DEBUG::2014-07-10 08:56:14,952::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '9a3a6f4f-bc9b-484a-8a3e-851d8fdafecf'} >Thread-14::DEBUG::2014-07-10 08:56:14,952::taskManager::113::TaskManager::(getAllTasksStatuses) Return: {'9a3a6f4f-bc9b-484a-8a3e-851d8fdafecf': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '9a3a6f4f-bc9b-484a-8a3e-851d8fdafecf'}} >Thread-14::INFO::2014-07-10 08:56:14,953::logUtils::47::dispatcher::(wrapper) Run and protect: getAllTasksStatuses, Return response: {'allTasksStatus': {'9a3a6f4f-bc9b-484a-8a3e-851d8fdafecf': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '9a3a6f4f-bc9b-484a-8a3e-851d8fdafecf'}}} >Thread-14::DEBUG::2014-07-10 08:56:14,953::task::1185::TaskManager.Task::(prepare) Task=`cc209c76-8362-4c8e-a31c-a090bc886f19`::finished: {'allTasksStatus': {'9a3a6f4f-bc9b-484a-8a3e-851d8fdafecf': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '9a3a6f4f-bc9b-484a-8a3e-851d8fdafecf'}}} >Thread-14::DEBUG::2014-07-10 08:56:14,953::task::595::TaskManager.Task::(_updateState) Task=`cc209c76-8362-4c8e-a31c-a090bc886f19`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 08:56:14,954::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 08:56:14,954::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 08:56:14,954::task::990::TaskManager.Task::(_decref) Task=`cc209c76-8362-4c8e-a31c-a090bc886f19`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 08:56:16,248::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 08:56:16,341::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0377155 s, 27.2 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 08:56:18,356::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 08:56:18,441::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0321289 s, 31.9 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 08:56:19,187::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-14::DEBUG::2014-07-10 08:56:19,189::task::595::TaskManager.Task::(_updateState) Task=`e06c4138-8fa0-4de4-ade0-32864eb11f28`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 08:56:19,189::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-14::INFO::2014-07-10 08:56:19,190::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 08:56:19,190::task::1185::TaskManager.Task::(prepare) Task=`e06c4138-8fa0-4de4-ade0-32864eb11f28`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 08:56:19,191::task::595::TaskManager.Task::(_updateState) Task=`e06c4138-8fa0-4de4-ade0-32864eb11f28`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 08:56:19,191::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 08:56:19,191::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 08:56:19,192::task::990::TaskManager.Task::(_decref) Task=`e06c4138-8fa0-4de4-ade0-32864eb11f28`::ref 0 aborting False >Thread-34::DEBUG::2014-07-10 08:56:19,197::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-34::DEBUG::2014-07-10 08:56:19,198::task::595::TaskManager.Task::(_updateState) Task=`8ff9921b-79a8-47e7-a09f-64e090793793`::moving from state init -> state preparing >Thread-34::INFO::2014-07-10 08:56:19,198::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-34::DEBUG::2014-07-10 08:56:19,202::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`33cc49f8-fd0d-4c54-8d8b-d16753372f00`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-10 08:56:19,202::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' for lock type 'shared' >Thread-34::DEBUG::2014-07-10 08:56:19,206::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-10 08:56:19,206::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`33cc49f8-fd0d-4c54-8d8b-d16753372f00`::Granted request >Thread-34::DEBUG::2014-07-10 08:56:19,210::task::827::TaskManager.Task::(resourceAcquired) Task=`8ff9921b-79a8-47e7-a09f-64e090793793`::_resourcesAcquired: Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee (shared) >Thread-34::DEBUG::2014-07-10 08:56:19,213::task::990::TaskManager.Task::(_decref) Task=`8ff9921b-79a8-47e7-a09f-64e090793793`::ref 1 aborting False >Thread-34::INFO::2014-07-10 08:56:19,220::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1084210806784', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532069482496', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 08:56:19,220::task::1185::TaskManager.Task::(prepare) Task=`8ff9921b-79a8-47e7-a09f-64e090793793`::finished: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1084210806784', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532069482496', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 08:56:19,221::task::595::TaskManager.Task::(_updateState) Task=`8ff9921b-79a8-47e7-a09f-64e090793793`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-10 08:56:19,221::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee': < ResourceRef 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-10 08:56:19,221::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-10 08:56:19,222::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' >Thread-34::DEBUG::2014-07-10 08:56:19,222::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' (0 active users) >Thread-34::DEBUG::2014-07-10 08:56:19,223::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-10 08:56:19,223::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', Clearing records. >Thread-34::DEBUG::2014-07-10 08:56:19,223::task::990::TaskManager.Task::(_decref) Task=`8ff9921b-79a8-47e7-a09f-64e090793793`::ref 0 aborting False >Thread-40::DEBUG::2014-07-10 08:56:19,558::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lion.qa.lab.tlv.redhat.com:_export_yuri2_backup2/6a70504d-00df-4869-8695-0f442053f6b6/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-40::DEBUG::2014-07-10 08:56:20,161::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n369 bytes (369 B) copied, 0.337329 s, 1.1 kB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 08:56:20,457::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 08:56:20,540::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0307514 s, 33.3 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 08:56:22,556::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 08:56:22,643::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0315013 s, 32.5 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-10 08:56:23,717::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/metadata bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-10 08:56:23,789::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.0600529 s, 68.2 kB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 08:56:24,658::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Thread-14::DEBUG::2014-07-10 08:56:24,972::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-14::DEBUG::2014-07-10 08:56:24,984::task::595::TaskManager.Task::(_updateState) Task=`9a6fdfbc-efa1-49c8-b10a-e9861f3dda47`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 08:56:24,992::logUtils::44::dispatcher::(wrapper) Run and protect: getAllTasksStatuses(spUUID=None, options=None) >Thread-14::DEBUG::2014-07-10 08:56:24,998::taskManager::102::TaskManager::(getAllTasksStatuses) Entry. >Thread-14::DEBUG::2014-07-10 08:56:25,005::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 9a3a6f4f-bc9b-484a-8a3e-851d8fdafecf >Thread-14::DEBUG::2014-07-10 08:56:25,011::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '9a3a6f4f-bc9b-484a-8a3e-851d8fdafecf'} >Thread-14::DEBUG::2014-07-10 08:56:25,017::taskManager::113::TaskManager::(getAllTasksStatuses) Return: {'9a3a6f4f-bc9b-484a-8a3e-851d8fdafecf': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '9a3a6f4f-bc9b-484a-8a3e-851d8fdafecf'}} >Thread-14::INFO::2014-07-10 08:56:25,023::logUtils::47::dispatcher::(wrapper) Run and protect: getAllTasksStatuses, Return response: {'allTasksStatus': {'9a3a6f4f-bc9b-484a-8a3e-851d8fdafecf': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '9a3a6f4f-bc9b-484a-8a3e-851d8fdafecf'}}} >Thread-14::DEBUG::2014-07-10 08:56:25,030::task::1185::TaskManager.Task::(prepare) Task=`9a6fdfbc-efa1-49c8-b10a-e9861f3dda47`::finished: {'allTasksStatus': {'9a3a6f4f-bc9b-484a-8a3e-851d8fdafecf': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '9a3a6f4f-bc9b-484a-8a3e-851d8fdafecf'}}} >Thread-14::DEBUG::2014-07-10 08:56:25,037::task::595::TaskManager.Task::(_updateState) Task=`9a6fdfbc-efa1-49c8-b10a-e9861f3dda47`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 08:56:25,043::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 08:56:25,049::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 08:56:25,057::task::990::TaskManager.Task::(_decref) Task=`9a6fdfbc-efa1-49c8-b10a-e9861f3dda47`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 08:56:25,130::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0361869 s, 28.3 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 08:56:26,302::task::595::TaskManager.Task::(_updateState) Task=`64a0c9e2-d356-4741-bb71-cb422ad106a5`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 08:56:26,302::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::INFO::2014-07-10 08:56:26,303::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0600529', 'lastCheck': '2.5', 'valid': True}, '6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.337329', 'lastCheck': '6.0', 'valid': True}} >Thread-14::DEBUG::2014-07-10 08:56:26,303::task::1185::TaskManager.Task::(prepare) Task=`64a0c9e2-d356-4741-bb71-cb422ad106a5`::finished: {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0600529', 'lastCheck': '2.5', 'valid': True}, '6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.337329', 'lastCheck': '6.0', 'valid': True}} >Thread-14::DEBUG::2014-07-10 08:56:26,303::task::595::TaskManager.Task::(_updateState) Task=`64a0c9e2-d356-4741-bb71-cb422ad106a5`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 08:56:26,303::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 08:56:26,304::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 08:56:26,304::task::990::TaskManager.Task::(_decref) Task=`64a0c9e2-d356-4741-bb71-cb422ad106a5`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 08:56:27,264::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 08:56:27,349::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0325018 s, 31.5 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 08:56:29,272::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-14::DEBUG::2014-07-10 08:56:29,274::task::595::TaskManager.Task::(_updateState) Task=`5053d200-527b-4f52-bbef-3919e2f0b91e`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 08:56:29,274::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-14::INFO::2014-07-10 08:56:29,275::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 08:56:29,275::task::1185::TaskManager.Task::(prepare) Task=`5053d200-527b-4f52-bbef-3919e2f0b91e`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 08:56:29,276::task::595::TaskManager.Task::(_updateState) Task=`5053d200-527b-4f52-bbef-3919e2f0b91e`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 08:56:29,276::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 08:56:29,276::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 08:56:29,277::task::990::TaskManager.Task::(_decref) Task=`5053d200-527b-4f52-bbef-3919e2f0b91e`::ref 0 aborting False >Thread-34::DEBUG::2014-07-10 08:56:29,282::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-34::DEBUG::2014-07-10 08:56:29,283::task::595::TaskManager.Task::(_updateState) Task=`606f291c-e421-4eb7-8129-97d79c8f3441`::moving from state init -> state preparing >Thread-34::INFO::2014-07-10 08:56:29,284::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-34::DEBUG::2014-07-10 08:56:29,286::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`652e34b2-c477-46e1-8d45-f28c47024a79`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-10 08:56:29,286::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' for lock type 'shared' >Thread-34::DEBUG::2014-07-10 08:56:29,287::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-10 08:56:29,287::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`652e34b2-c477-46e1-8d45-f28c47024a79`::Granted request >Thread-34::DEBUG::2014-07-10 08:56:29,288::task::827::TaskManager.Task::(resourceAcquired) Task=`606f291c-e421-4eb7-8129-97d79c8f3441`::_resourcesAcquired: Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee (shared) >Thread-34::DEBUG::2014-07-10 08:56:29,288::task::990::TaskManager.Task::(_decref) Task=`606f291c-e421-4eb7-8129-97d79c8f3441`::ref 1 aborting False >Thread-34::INFO::2014-07-10 08:56:29,290::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1084210806784', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532069482496', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 08:56:29,290::task::1185::TaskManager.Task::(prepare) Task=`606f291c-e421-4eb7-8129-97d79c8f3441`::finished: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1084210806784', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532069482496', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 08:56:29,290::task::595::TaskManager.Task::(_updateState) Task=`606f291c-e421-4eb7-8129-97d79c8f3441`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-10 08:56:29,291::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee': < ResourceRef 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-10 08:56:29,291::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-10 08:56:29,291::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' >Thread-34::DEBUG::2014-07-10 08:56:29,292::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' (0 active users) >Thread-34::DEBUG::2014-07-10 08:56:29,292::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-10 08:56:29,292::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', Clearing records. >Thread-34::DEBUG::2014-07-10 08:56:29,293::task::990::TaskManager.Task::(_decref) Task=`606f291c-e421-4eb7-8129-97d79c8f3441`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 08:56:29,365::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 08:56:29,455::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0365076 s, 28.0 MB/s\n'; <rc> = 0 >Thread-40::DEBUG::2014-07-10 08:56:30,653::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lion.qa.lab.tlv.redhat.com:_export_yuri2_backup2/6a70504d-00df-4869-8695-0f442053f6b6/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-40::DEBUG::2014-07-10 08:56:31,082::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n369 bytes (369 B) copied, 0.158254 s, 2.3 kB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 08:56:31,471::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 08:56:31,556::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.031866 s, 32.1 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 08:56:33,572::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 08:56:33,655::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0314948 s, 32.5 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-10 08:56:33,819::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/metadata bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-10 08:56:33,839::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.0084298 s, 486 kB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 08:56:35,084::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-14::DEBUG::2014-07-10 08:56:35,087::task::595::TaskManager.Task::(_updateState) Task=`f3be52c0-cd27-4010-b1f5-5a33a3c352f9`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 08:56:35,088::logUtils::44::dispatcher::(wrapper) Run and protect: getAllTasksStatuses(spUUID=None, options=None) >Thread-14::DEBUG::2014-07-10 08:56:35,089::taskManager::102::TaskManager::(getAllTasksStatuses) Entry. >Thread-14::DEBUG::2014-07-10 08:56:35,092::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 9a3a6f4f-bc9b-484a-8a3e-851d8fdafecf >Thread-14::DEBUG::2014-07-10 08:56:35,093::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '9a3a6f4f-bc9b-484a-8a3e-851d8fdafecf'} >Thread-14::DEBUG::2014-07-10 08:56:35,093::taskManager::113::TaskManager::(getAllTasksStatuses) Return: {'9a3a6f4f-bc9b-484a-8a3e-851d8fdafecf': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '9a3a6f4f-bc9b-484a-8a3e-851d8fdafecf'}} >Thread-14::INFO::2014-07-10 08:56:35,093::logUtils::47::dispatcher::(wrapper) Run and protect: getAllTasksStatuses, Return response: {'allTasksStatus': {'9a3a6f4f-bc9b-484a-8a3e-851d8fdafecf': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '9a3a6f4f-bc9b-484a-8a3e-851d8fdafecf'}}} >Thread-14::DEBUG::2014-07-10 08:56:35,094::task::1185::TaskManager.Task::(prepare) Task=`f3be52c0-cd27-4010-b1f5-5a33a3c352f9`::finished: {'allTasksStatus': {'9a3a6f4f-bc9b-484a-8a3e-851d8fdafecf': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '9a3a6f4f-bc9b-484a-8a3e-851d8fdafecf'}}} >Thread-14::DEBUG::2014-07-10 08:56:35,094::task::595::TaskManager.Task::(_updateState) Task=`f3be52c0-cd27-4010-b1f5-5a33a3c352f9`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 08:56:35,094::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 08:56:35,095::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 08:56:35,095::task::990::TaskManager.Task::(_decref) Task=`f3be52c0-cd27-4010-b1f5-5a33a3c352f9`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 08:56:35,670::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 08:56:35,750::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0261346 s, 39.2 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 08:56:37,766::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 08:56:37,856::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0365223 s, 28.0 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 08:56:39,333::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-14::DEBUG::2014-07-10 08:56:39,338::task::595::TaskManager.Task::(_updateState) Task=`4c171140-b311-4d0a-bb12-218f1932a87f`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 08:56:39,338::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-14::INFO::2014-07-10 08:56:39,339::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 08:56:39,339::task::1185::TaskManager.Task::(prepare) Task=`4c171140-b311-4d0a-bb12-218f1932a87f`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 08:56:39,340::task::595::TaskManager.Task::(_updateState) Task=`4c171140-b311-4d0a-bb12-218f1932a87f`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 08:56:39,340::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 08:56:39,340::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 08:56:39,341::task::990::TaskManager.Task::(_decref) Task=`4c171140-b311-4d0a-bb12-218f1932a87f`::ref 0 aborting False >Thread-34::DEBUG::2014-07-10 08:56:39,346::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-34::DEBUG::2014-07-10 08:56:39,347::task::595::TaskManager.Task::(_updateState) Task=`4170b3ed-a0f4-4548-822f-352cc427dff1`::moving from state init -> state preparing >Thread-34::INFO::2014-07-10 08:56:39,347::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-34::DEBUG::2014-07-10 08:56:39,348::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`669b7ec3-2442-41df-befc-a63a02d22b6c`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-10 08:56:39,348::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' for lock type 'shared' >Thread-34::DEBUG::2014-07-10 08:56:39,349::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-10 08:56:39,349::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`669b7ec3-2442-41df-befc-a63a02d22b6c`::Granted request >Thread-34::DEBUG::2014-07-10 08:56:39,350::task::827::TaskManager.Task::(resourceAcquired) Task=`4170b3ed-a0f4-4548-822f-352cc427dff1`::_resourcesAcquired: Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee (shared) >Thread-34::DEBUG::2014-07-10 08:56:39,351::task::990::TaskManager.Task::(_decref) Task=`4170b3ed-a0f4-4548-822f-352cc427dff1`::ref 1 aborting False >Thread-34::INFO::2014-07-10 08:56:39,352::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1084210806784', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532069482496', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 08:56:39,352::task::1185::TaskManager.Task::(prepare) Task=`4170b3ed-a0f4-4548-822f-352cc427dff1`::finished: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1084210806784', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532069482496', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 08:56:39,353::task::595::TaskManager.Task::(_updateState) Task=`4170b3ed-a0f4-4548-822f-352cc427dff1`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-10 08:56:39,353::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee': < ResourceRef 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-10 08:56:39,353::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-10 08:56:39,354::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' >Thread-34::DEBUG::2014-07-10 08:56:39,354::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' (0 active users) >Thread-34::DEBUG::2014-07-10 08:56:39,354::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-10 08:56:39,354::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', Clearing records. >Thread-34::DEBUG::2014-07-10 08:56:39,355::task::990::TaskManager.Task::(_decref) Task=`4170b3ed-a0f4-4548-822f-352cc427dff1`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 08:56:39,871::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 08:56:39,998::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0270216 s, 37.9 MB/s\n'; <rc> = 0 >Thread-40::DEBUG::2014-07-10 08:56:41,247::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lion.qa.lab.tlv.redhat.com:_export_yuri2_backup2/6a70504d-00df-4869-8695-0f442053f6b6/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-14::DEBUG::2014-07-10 08:56:41,436::task::595::TaskManager.Task::(_updateState) Task=`b54fbb95-c926-4f02-a9bb-5b47d801725a`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 08:56:41,437::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::INFO::2014-07-10 08:56:41,437::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0084298', 'lastCheck': '7.5', 'valid': True}, '6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.158254', 'lastCheck': '10.2', 'valid': True}} >Thread-14::DEBUG::2014-07-10 08:56:41,438::task::1185::TaskManager.Task::(prepare) Task=`b54fbb95-c926-4f02-a9bb-5b47d801725a`::finished: {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0084298', 'lastCheck': '7.5', 'valid': True}, '6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.158254', 'lastCheck': '10.2', 'valid': True}} >Thread-14::DEBUG::2014-07-10 08:56:41,438::task::595::TaskManager.Task::(_updateState) Task=`b54fbb95-c926-4f02-a9bb-5b47d801725a`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 08:56:41,438::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 08:56:41,441::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 08:56:41,444::task::990::TaskManager.Task::(_decref) Task=`b54fbb95-c926-4f02-a9bb-5b47d801725a`::ref 0 aborting False >Thread-40::DEBUG::2014-07-10 08:56:41,458::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n369 bytes (369 B) copied, 0.00360705 s, 102 kB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 08:56:42,018::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 08:56:42,107::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0371381 s, 27.6 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-10 08:56:43,890::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/metadata bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-10 08:56:43,913::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00923999 s, 443 kB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 08:56:44,122::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 08:56:44,205::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0325002 s, 31.5 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 08:56:45,100::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-14::DEBUG::2014-07-10 08:56:45,102::task::595::TaskManager.Task::(_updateState) Task=`2988a61e-b842-46b0-8b81-78c3a4d62a75`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 08:56:45,102::logUtils::44::dispatcher::(wrapper) Run and protect: getAllTasksStatuses(spUUID=None, options=None) >Thread-14::DEBUG::2014-07-10 08:56:45,103::taskManager::102::TaskManager::(getAllTasksStatuses) Entry. >Thread-14::DEBUG::2014-07-10 08:56:45,103::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 9a3a6f4f-bc9b-484a-8a3e-851d8fdafecf >Thread-14::DEBUG::2014-07-10 08:56:45,103::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '9a3a6f4f-bc9b-484a-8a3e-851d8fdafecf'} >Thread-14::DEBUG::2014-07-10 08:56:45,104::taskManager::113::TaskManager::(getAllTasksStatuses) Return: {'9a3a6f4f-bc9b-484a-8a3e-851d8fdafecf': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '9a3a6f4f-bc9b-484a-8a3e-851d8fdafecf'}} >Thread-14::INFO::2014-07-10 08:56:45,104::logUtils::47::dispatcher::(wrapper) Run and protect: getAllTasksStatuses, Return response: {'allTasksStatus': {'9a3a6f4f-bc9b-484a-8a3e-851d8fdafecf': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '9a3a6f4f-bc9b-484a-8a3e-851d8fdafecf'}}} >Thread-14::DEBUG::2014-07-10 08:56:45,104::task::1185::TaskManager.Task::(prepare) Task=`2988a61e-b842-46b0-8b81-78c3a4d62a75`::finished: {'allTasksStatus': {'9a3a6f4f-bc9b-484a-8a3e-851d8fdafecf': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '9a3a6f4f-bc9b-484a-8a3e-851d8fdafecf'}}} >Thread-14::DEBUG::2014-07-10 08:56:45,105::task::595::TaskManager.Task::(_updateState) Task=`2988a61e-b842-46b0-8b81-78c3a4d62a75`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 08:56:45,105::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 08:56:45,105::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 08:56:45,105::task::990::TaskManager.Task::(_decref) Task=`2988a61e-b842-46b0-8b81-78c3a4d62a75`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 08:56:46,221::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 08:56:46,304::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0304586 s, 33.6 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 08:56:48,319::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 08:56:48,408::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0368421 s, 27.8 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 08:56:49,390::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-14::DEBUG::2014-07-10 08:56:49,392::task::595::TaskManager.Task::(_updateState) Task=`d4a6bc54-13cd-49a4-b8d3-7ddc6b101abd`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 08:56:49,393::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-14::INFO::2014-07-10 08:56:49,394::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 08:56:49,394::task::1185::TaskManager.Task::(prepare) Task=`d4a6bc54-13cd-49a4-b8d3-7ddc6b101abd`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 08:56:49,395::task::595::TaskManager.Task::(_updateState) Task=`d4a6bc54-13cd-49a4-b8d3-7ddc6b101abd`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 08:56:49,395::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 08:56:49,395::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 08:56:49,396::task::990::TaskManager.Task::(_decref) Task=`d4a6bc54-13cd-49a4-b8d3-7ddc6b101abd`::ref 0 aborting False >Thread-34::DEBUG::2014-07-10 08:56:49,401::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-34::DEBUG::2014-07-10 08:56:49,402::task::595::TaskManager.Task::(_updateState) Task=`2fae065f-e95e-4b73-97d5-f7b593b6c19d`::moving from state init -> state preparing >Thread-34::INFO::2014-07-10 08:56:49,403::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-34::DEBUG::2014-07-10 08:56:49,404::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`bad29c01-373c-478a-bbb1-8801d8a873bf`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-10 08:56:49,404::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' for lock type 'shared' >Thread-34::DEBUG::2014-07-10 08:56:49,405::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-10 08:56:49,405::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`bad29c01-373c-478a-bbb1-8801d8a873bf`::Granted request >Thread-34::DEBUG::2014-07-10 08:56:49,406::task::827::TaskManager.Task::(resourceAcquired) Task=`2fae065f-e95e-4b73-97d5-f7b593b6c19d`::_resourcesAcquired: Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee (shared) >Thread-34::DEBUG::2014-07-10 08:56:49,406::task::990::TaskManager.Task::(_decref) Task=`2fae065f-e95e-4b73-97d5-f7b593b6c19d`::ref 1 aborting False >Thread-34::INFO::2014-07-10 08:56:49,408::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1084210806784', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532069482496', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 08:56:49,408::task::1185::TaskManager.Task::(prepare) Task=`2fae065f-e95e-4b73-97d5-f7b593b6c19d`::finished: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1084210806784', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532069482496', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 08:56:49,409::task::595::TaskManager.Task::(_updateState) Task=`2fae065f-e95e-4b73-97d5-f7b593b6c19d`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-10 08:56:49,409::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee': < ResourceRef 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-10 08:56:49,409::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-10 08:56:49,410::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' >Thread-34::DEBUG::2014-07-10 08:56:49,410::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' (0 active users) >Thread-34::DEBUG::2014-07-10 08:56:49,410::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-10 08:56:49,411::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', Clearing records. >Thread-34::DEBUG::2014-07-10 08:56:49,411::task::990::TaskManager.Task::(_decref) Task=`2fae065f-e95e-4b73-97d5-f7b593b6c19d`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 08:56:50,424::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 08:56:50,508::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0303339 s, 33.8 MB/s\n'; <rc> = 0 >Thread-40::DEBUG::2014-07-10 08:56:51,497::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lion.qa.lab.tlv.redhat.com:_export_yuri2_backup2/6a70504d-00df-4869-8695-0f442053f6b6/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-40::DEBUG::2014-07-10 08:56:51,512::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n369 bytes (369 B) copied, 0.000462155 s, 798 kB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 08:56:52,525::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 08:56:52,613::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0360441 s, 28.4 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-10 08:56:53,943::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/metadata bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-10 08:56:53,966::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00653342 s, 627 kB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 08:56:54,631::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 08:56:54,716::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0315888 s, 32.4 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 08:56:55,111::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-14::DEBUG::2014-07-10 08:56:55,113::task::595::TaskManager.Task::(_updateState) Task=`e8508d8e-1525-4f66-8b7c-bc1d5fa227bd`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 08:56:55,113::logUtils::44::dispatcher::(wrapper) Run and protect: getAllTasksStatuses(spUUID=None, options=None) >Thread-14::DEBUG::2014-07-10 08:56:55,114::taskManager::102::TaskManager::(getAllTasksStatuses) Entry. >Thread-14::DEBUG::2014-07-10 08:56:55,114::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 9a3a6f4f-bc9b-484a-8a3e-851d8fdafecf >Thread-14::DEBUG::2014-07-10 08:56:55,114::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '9a3a6f4f-bc9b-484a-8a3e-851d8fdafecf'} >Thread-14::DEBUG::2014-07-10 08:56:55,115::taskManager::113::TaskManager::(getAllTasksStatuses) Return: {'9a3a6f4f-bc9b-484a-8a3e-851d8fdafecf': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '9a3a6f4f-bc9b-484a-8a3e-851d8fdafecf'}} >Thread-14::INFO::2014-07-10 08:56:55,115::logUtils::47::dispatcher::(wrapper) Run and protect: getAllTasksStatuses, Return response: {'allTasksStatus': {'9a3a6f4f-bc9b-484a-8a3e-851d8fdafecf': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '9a3a6f4f-bc9b-484a-8a3e-851d8fdafecf'}}} >Thread-14::DEBUG::2014-07-10 08:56:55,115::task::1185::TaskManager.Task::(prepare) Task=`e8508d8e-1525-4f66-8b7c-bc1d5fa227bd`::finished: {'allTasksStatus': {'9a3a6f4f-bc9b-484a-8a3e-851d8fdafecf': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '9a3a6f4f-bc9b-484a-8a3e-851d8fdafecf'}}} >Thread-14::DEBUG::2014-07-10 08:56:55,116::task::595::TaskManager.Task::(_updateState) Task=`e8508d8e-1525-4f66-8b7c-bc1d5fa227bd`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 08:56:55,116::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 08:56:55,116::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 08:56:55,117::task::990::TaskManager.Task::(_decref) Task=`e8508d8e-1525-4f66-8b7c-bc1d5fa227bd`::ref 0 aborting False >Thread-14::DEBUG::2014-07-10 08:56:56,598::task::595::TaskManager.Task::(_updateState) Task=`8da1d07f-fbe1-4198-93a9-e76a734c1a7f`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 08:56:56,598::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::INFO::2014-07-10 08:56:56,599::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00653342', 'lastCheck': '2.6', 'valid': True}, '6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000462155', 'lastCheck': '5.1', 'valid': True}} >Thread-14::DEBUG::2014-07-10 08:56:56,599::task::1185::TaskManager.Task::(prepare) Task=`8da1d07f-fbe1-4198-93a9-e76a734c1a7f`::finished: {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00653342', 'lastCheck': '2.6', 'valid': True}, '6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000462155', 'lastCheck': '5.1', 'valid': True}} >Thread-14::DEBUG::2014-07-10 08:56:56,600::task::595::TaskManager.Task::(_updateState) Task=`8da1d07f-fbe1-4198-93a9-e76a734c1a7f`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 08:56:56,600::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 08:56:56,600::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 08:56:56,601::task::990::TaskManager.Task::(_decref) Task=`8da1d07f-fbe1-4198-93a9-e76a734c1a7f`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 08:56:56,731::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 08:56:56,816::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0324645 s, 31.5 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 08:56:58,831::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 08:56:58,916::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0310611 s, 33.0 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 08:56:59,465::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-14::DEBUG::2014-07-10 08:56:59,467::task::595::TaskManager.Task::(_updateState) Task=`222de208-5b6b-4290-b498-ddae31874030`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 08:56:59,467::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-14::INFO::2014-07-10 08:56:59,468::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 08:56:59,469::task::1185::TaskManager.Task::(prepare) Task=`222de208-5b6b-4290-b498-ddae31874030`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 08:56:59,469::task::595::TaskManager.Task::(_updateState) Task=`222de208-5b6b-4290-b498-ddae31874030`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 08:56:59,469::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 08:56:59,469::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 08:56:59,470::task::990::TaskManager.Task::(_decref) Task=`222de208-5b6b-4290-b498-ddae31874030`::ref 0 aborting False >Thread-34::DEBUG::2014-07-10 08:56:59,475::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-34::DEBUG::2014-07-10 08:56:59,476::task::595::TaskManager.Task::(_updateState) Task=`5df06a31-5d12-4e4f-8433-3cdef69b1347`::moving from state init -> state preparing >Thread-34::INFO::2014-07-10 08:56:59,476::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-34::DEBUG::2014-07-10 08:56:59,477::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`abaaaf9c-edf6-4633-8be2-1c9c13ec53b5`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-10 08:56:59,477::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' for lock type 'shared' >Thread-34::DEBUG::2014-07-10 08:56:59,478::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-10 08:56:59,478::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`abaaaf9c-edf6-4633-8be2-1c9c13ec53b5`::Granted request >Thread-34::DEBUG::2014-07-10 08:56:59,481::task::827::TaskManager.Task::(resourceAcquired) Task=`5df06a31-5d12-4e4f-8433-3cdef69b1347`::_resourcesAcquired: Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee (shared) >Thread-34::DEBUG::2014-07-10 08:56:59,482::task::990::TaskManager.Task::(_decref) Task=`5df06a31-5d12-4e4f-8433-3cdef69b1347`::ref 1 aborting False >Thread-34::INFO::2014-07-10 08:56:59,483::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1084210806784', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532069482496', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 08:56:59,484::task::1185::TaskManager.Task::(prepare) Task=`5df06a31-5d12-4e4f-8433-3cdef69b1347`::finished: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1084210806784', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532069482496', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 08:56:59,484::task::595::TaskManager.Task::(_updateState) Task=`5df06a31-5d12-4e4f-8433-3cdef69b1347`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-10 08:56:59,484::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee': < ResourceRef 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-10 08:56:59,485::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-10 08:56:59,485::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' >Thread-34::DEBUG::2014-07-10 08:56:59,486::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' (0 active users) >Thread-34::DEBUG::2014-07-10 08:56:59,486::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-10 08:56:59,486::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', Clearing records. >Thread-34::DEBUG::2014-07-10 08:56:59,486::task::990::TaskManager.Task::(_decref) Task=`5df06a31-5d12-4e4f-8433-3cdef69b1347`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 08:57:00,931::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 08:57:01,016::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0324228 s, 31.6 MB/s\n'; <rc> = 0 >Thread-40::DEBUG::2014-07-10 08:57:01,986::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lion.qa.lab.tlv.redhat.com:_export_yuri2_backup2/6a70504d-00df-4869-8695-0f442053f6b6/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-40::DEBUG::2014-07-10 08:57:02,615::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n369 bytes (369 B) copied, 0.134511 s, 2.7 kB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 08:57:03,032::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 08:57:03,122::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0363377 s, 28.2 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-10 08:57:03,995::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/metadata bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-10 08:57:04,021::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.011709 s, 350 kB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 08:57:05,122::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [20826f36] >Thread-14::DEBUG::2014-07-10 08:57:05,123::task::595::TaskManager.Task::(_updateState) Task=`fbbc2ae9-0b2d-4698-9251-583434a2490a`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 08:57:05,123::logUtils::44::dispatcher::(wrapper) Run and protect: getAllTasksStatuses(spUUID=None, options=None) >Thread-14::DEBUG::2014-07-10 08:57:05,124::taskManager::102::TaskManager::(getAllTasksStatuses) Entry. >Thread-14::DEBUG::2014-07-10 08:57:05,124::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 9a3a6f4f-bc9b-484a-8a3e-851d8fdafecf >Thread-14::DEBUG::2014-07-10 08:57:05,124::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '9a3a6f4f-bc9b-484a-8a3e-851d8fdafecf'} >Thread-14::DEBUG::2014-07-10 08:57:05,124::taskManager::113::TaskManager::(getAllTasksStatuses) Return: {'9a3a6f4f-bc9b-484a-8a3e-851d8fdafecf': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '9a3a6f4f-bc9b-484a-8a3e-851d8fdafecf'}} >Thread-14::INFO::2014-07-10 08:57:05,124::logUtils::47::dispatcher::(wrapper) Run and protect: getAllTasksStatuses, Return response: {'allTasksStatus': {'9a3a6f4f-bc9b-484a-8a3e-851d8fdafecf': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '9a3a6f4f-bc9b-484a-8a3e-851d8fdafecf'}}} >Thread-14::DEBUG::2014-07-10 08:57:05,125::task::1185::TaskManager.Task::(prepare) Task=`fbbc2ae9-0b2d-4698-9251-583434a2490a`::finished: {'allTasksStatus': {'9a3a6f4f-bc9b-484a-8a3e-851d8fdafecf': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '9a3a6f4f-bc9b-484a-8a3e-851d8fdafecf'}}} >Thread-14::DEBUG::2014-07-10 08:57:05,125::task::595::TaskManager.Task::(_updateState) Task=`fbbc2ae9-0b2d-4698-9251-583434a2490a`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 08:57:05,125::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 08:57:05,125::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 08:57:05,125::task::990::TaskManager.Task::(_decref) Task=`fbbc2ae9-0b2d-4698-9251-583434a2490a`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 08:57:05,137::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 08:57:05,224::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0353054 s, 29.0 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 08:57:07,239::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 08:57:07,319::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0281825 s, 36.3 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 08:57:09,334::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 08:57:09,413::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0274563 s, 37.3 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 08:57:09,521::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-14::DEBUG::2014-07-10 08:57:09,522::task::595::TaskManager.Task::(_updateState) Task=`f32e5e65-bd40-4451-b276-260a27d9ad42`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 08:57:09,523::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-14::INFO::2014-07-10 08:57:09,524::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 08:57:09,524::task::1185::TaskManager.Task::(prepare) Task=`f32e5e65-bd40-4451-b276-260a27d9ad42`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 08:57:09,524::task::595::TaskManager.Task::(_updateState) Task=`f32e5e65-bd40-4451-b276-260a27d9ad42`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 08:57:09,525::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 08:57:09,525::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 08:57:09,526::task::990::TaskManager.Task::(_decref) Task=`f32e5e65-bd40-4451-b276-260a27d9ad42`::ref 0 aborting False >Thread-34::DEBUG::2014-07-10 08:57:09,531::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-34::DEBUG::2014-07-10 08:57:09,531::task::595::TaskManager.Task::(_updateState) Task=`0a0e2761-45c7-4be6-b3e6-cc64a0a37b22`::moving from state init -> state preparing >Thread-34::INFO::2014-07-10 08:57:09,532::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-34::DEBUG::2014-07-10 08:57:09,533::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`dd2acf82-3cd1-4dcc-951c-4fcd781e43fb`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-10 08:57:09,533::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' for lock type 'shared' >Thread-34::DEBUG::2014-07-10 08:57:09,534::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-10 08:57:09,534::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`dd2acf82-3cd1-4dcc-951c-4fcd781e43fb`::Granted request >Thread-34::DEBUG::2014-07-10 08:57:09,535::task::827::TaskManager.Task::(resourceAcquired) Task=`0a0e2761-45c7-4be6-b3e6-cc64a0a37b22`::_resourcesAcquired: Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee (shared) >Thread-34::DEBUG::2014-07-10 08:57:09,535::task::990::TaskManager.Task::(_decref) Task=`0a0e2761-45c7-4be6-b3e6-cc64a0a37b22`::ref 1 aborting False >Thread-34::INFO::2014-07-10 08:57:09,537::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1084210806784', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532069482496', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 08:57:09,538::task::1185::TaskManager.Task::(prepare) Task=`0a0e2761-45c7-4be6-b3e6-cc64a0a37b22`::finished: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1084210806784', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532069482496', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 08:57:09,538::task::595::TaskManager.Task::(_updateState) Task=`0a0e2761-45c7-4be6-b3e6-cc64a0a37b22`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-10 08:57:09,538::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee': < ResourceRef 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-10 08:57:09,539::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-10 08:57:09,539::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' >Thread-34::DEBUG::2014-07-10 08:57:09,539::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' (0 active users) >Thread-34::DEBUG::2014-07-10 08:57:09,540::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-10 08:57:09,540::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', Clearing records. >Thread-34::DEBUG::2014-07-10 08:57:09,540::task::990::TaskManager.Task::(_decref) Task=`0a0e2761-45c7-4be6-b3e6-cc64a0a37b22`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 08:57:11,428::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 08:57:11,505::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0255899 s, 40.0 MB/s\n'; <rc> = 0 >9a3a6f4f-bc9b-484a-8a3e-851d8fdafecf::DEBUG::2014-07-10 08:57:11,658::utils::697::Storage.Misc.excCmd::(watchCmd) SUCCESS: <err> = ['10240+0 records in', '10240+0 records out', '10737418240 bytes (11 GB) copied, 147.356 s, 72.9 MB/s']; <rc> = 0 >9a3a6f4f-bc9b-484a-8a3e-851d8fdafecf::DEBUG::2014-07-10 08:57:11,658::misc::282::Storage.Misc::(validateDDBytes) err: ['10240+0 records in', '10240+0 records out', '10737418240 bytes (11 GB) copied, 147.356 s, 72.9 MB/s'], size: 10737418240 >9a3a6f4f-bc9b-484a-8a3e-851d8fdafecf::DEBUG::2014-07-10 08:57:11,659::volume::1111::Storage.Volume::(qemuConvert) (qemuConvert): COPY /rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/6a70504d-00df-4869-8695-0f442053f6b6/images/b8c3a0af-85ef-42d5-abd5-42a2c2371498/022d12c7-cf77-4c96-b939-4dd8d42a2127 to /rhev/data-center/mnt/blockSD/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/images/9cf413b7-7f14-4a61-8c71-913e5b0ea9c0/47592965-e853-4e59-9728-d11cca6a7a8a DONE >9a3a6f4f-bc9b-484a-8a3e-851d8fdafecf::DEBUG::2014-07-10 08:57:11,659::lvm::427::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' got the operation mutex >9a3a6f4f-bc9b-484a-8a3e-851d8fdafecf::DEBUG::2014-07-10 08:57:11,660::lvm::296::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm lvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/3600601601282300032826addbbdae311|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,vg_name,attr,size,seg_start_pe,devices,tags 9e1aa540-1f4e-4ee3-a152-be381ef6c3bd' (cwd None) >Thread-14::DEBUG::2014-07-10 08:57:11,738::task::595::TaskManager.Task::(_updateState) Task=`a55e4df8-0d88-4faf-9e8b-6b03ecb48b40`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 08:57:11,747::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::INFO::2014-07-10 08:57:11,747::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.011709', 'lastCheck': '7.7', 'valid': True}, '6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.134511', 'lastCheck': '9.0', 'valid': True}} >Thread-14::DEBUG::2014-07-10 08:57:11,748::task::1185::TaskManager.Task::(prepare) Task=`a55e4df8-0d88-4faf-9e8b-6b03ecb48b40`::finished: {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.011709', 'lastCheck': '7.7', 'valid': True}, '6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.134511', 'lastCheck': '9.0', 'valid': True}} >Thread-14::DEBUG::2014-07-10 08:57:11,748::task::595::TaskManager.Task::(_updateState) Task=`a55e4df8-0d88-4faf-9e8b-6b03ecb48b40`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 08:57:11,748::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 08:57:11,749::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 08:57:11,749::task::990::TaskManager.Task::(_decref) Task=`a55e4df8-0d88-4faf-9e8b-6b03ecb48b40`::ref 0 aborting False >9a3a6f4f-bc9b-484a-8a3e-851d8fdafecf::DEBUG::2014-07-10 08:57:12,744::lvm::296::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >9a3a6f4f-bc9b-484a-8a3e-851d8fdafecf::DEBUG::2014-07-10 08:57:12,751::lvm::462::Storage.LVM::(_reloadlvs) lvs reloaded >9a3a6f4f-bc9b-484a-8a3e-851d8fdafecf::DEBUG::2014-07-10 08:57:12,751::lvm::462::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' released the operation mutex >9a3a6f4f-bc9b-484a-8a3e-851d8fdafecf::DEBUG::2014-07-10 08:57:12,752::blockVolume::572::Storage.Misc.excCmd::(getMetadata) '/bin/dd iflag=direct skip=4 bs=512 if=/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/metadata count=1' (cwd None) >Thread-40::DEBUG::2014-07-10 08:57:12,802::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lion.qa.lab.tlv.redhat.com:_export_yuri2_backup2/6a70504d-00df-4869-8695-0f442053f6b6/dom_md/metadata bs=4096 count=1' (cwd None) >9a3a6f4f-bc9b-484a-8a3e-851d8fdafecf::DEBUG::2014-07-10 08:57:12,841::blockVolume::572::Storage.Misc.excCmd::(getMetadata) SUCCESS: <err> = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.0408482 s, 12.5 kB/s\n'; <rc> = 0 >9a3a6f4f-bc9b-484a-8a3e-851d8fdafecf::DEBUG::2014-07-10 08:57:12,844::misc::282::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.0408482 s, 12.5 kB/s'], size: 512 >Thread-40::DEBUG::2014-07-10 08:57:12,846::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n369 bytes (369 B) copied, 0.000365605 s, 1.0 MB/s\n'; <rc> = 0 >9a3a6f4f-bc9b-484a-8a3e-851d8fdafecf::INFO::2014-07-10 08:57:12,853::volume::646::Storage.Volume::(setLegality) sdUUID=9e1aa540-1f4e-4ee3-a152-be381ef6c3bd imgUUID=9cf413b7-7f14-4a61-8c71-913e5b0ea9c0 volUUID = 47592965-e853-4e59-9728-d11cca6a7a8a legality = LEGAL >9a3a6f4f-bc9b-484a-8a3e-851d8fdafecf::DEBUG::2014-07-10 08:57:12,859::blockVolume::572::Storage.Misc.excCmd::(getMetadata) '/bin/dd iflag=direct skip=4 bs=512 if=/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/metadata count=1' (cwd None) >9a3a6f4f-bc9b-484a-8a3e-851d8fdafecf::DEBUG::2014-07-10 08:57:12,889::blockVolume::572::Storage.Misc.excCmd::(getMetadata) SUCCESS: <err> = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.00199833 s, 256 kB/s\n'; <rc> = 0 >9a3a6f4f-bc9b-484a-8a3e-851d8fdafecf::DEBUG::2014-07-10 08:57:12,890::misc::282::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.00199833 s, 256 kB/s'], size: 512 >9a3a6f4f-bc9b-484a-8a3e-851d8fdafecf::INFO::2014-07-10 08:57:12,894::image::780::Storage.Image::(copyCollapsed) Finished copying 6a70504d-00df-4869-8695-0f442053f6b6:022d12c7-cf77-4c96-b939-4dd8d42a2127 -> 9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:47592965-e853-4e59-9728-d11cca6a7a8a >9a3a6f4f-bc9b-484a-8a3e-851d8fdafecf::INFO::2014-07-10 08:57:12,895::blockVolume::393::Storage.Volume::(teardown) Tearing down volume 9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/47592965-e853-4e59-9728-d11cca6a7a8a justme False >9a3a6f4f-bc9b-484a-8a3e-851d8fdafecf::DEBUG::2014-07-10 08:57:12,895::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd_lvmActivationNS.47592965-e853-4e59-9728-d11cca6a7a8a' >9a3a6f4f-bc9b-484a-8a3e-851d8fdafecf::DEBUG::2014-07-10 08:57:12,895::resourceManager::635::ResourceManager::(releaseResource) Released resource '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd_lvmActivationNS.47592965-e853-4e59-9728-d11cca6a7a8a' (0 active users) >9a3a6f4f-bc9b-484a-8a3e-851d8fdafecf::DEBUG::2014-07-10 08:57:12,896::resourceManager::641::ResourceManager::(releaseResource) Resource '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd_lvmActivationNS.47592965-e853-4e59-9728-d11cca6a7a8a' is free, finding out if anyone is waiting for it. >9a3a6f4f-bc9b-484a-8a3e-851d8fdafecf::DEBUG::2014-07-10 08:57:12,896::lvm::296::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm lvchange --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/3600601601282300032826addbbdae311|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } " --autobackup n --available n 9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/47592965-e853-4e59-9728-d11cca6a7a8a' (cwd None) >9a3a6f4f-bc9b-484a-8a3e-851d8fdafecf::DEBUG::2014-07-10 08:57:13,361::lvm::296::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >9a3a6f4f-bc9b-484a-8a3e-851d8fdafecf::DEBUG::2014-07-10 08:57:13,362::lvm::513::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >9a3a6f4f-bc9b-484a-8a3e-851d8fdafecf::DEBUG::2014-07-10 08:57:13,362::lvm::525::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >9a3a6f4f-bc9b-484a-8a3e-851d8fdafecf::DEBUG::2014-07-10 08:57:13,362::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd_lvmActivationNS.47592965-e853-4e59-9728-d11cca6a7a8a', Clearing records. >9a3a6f4f-bc9b-484a-8a3e-851d8fdafecf::DEBUG::2014-07-10 08:57:13,363::lvm::427::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' got the operation mutex >9a3a6f4f-bc9b-484a-8a3e-851d8fdafecf::DEBUG::2014-07-10 08:57:13,364::lvm::296::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm lvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/3600601601282300032826addbbdae311|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,vg_name,attr,size,seg_start_pe,devices,tags 9e1aa540-1f4e-4ee3-a152-be381ef6c3bd' (cwd None) >Dummy-33::DEBUG::2014-07-10 08:57:13,520::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >9a3a6f4f-bc9b-484a-8a3e-851d8fdafecf::DEBUG::2014-07-10 08:57:13,556::lvm::296::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >9a3a6f4f-bc9b-484a-8a3e-851d8fdafecf::DEBUG::2014-07-10 08:57:13,572::lvm::462::Storage.LVM::(_reloadlvs) lvs reloaded >9a3a6f4f-bc9b-484a-8a3e-851d8fdafecf::DEBUG::2014-07-10 08:57:13,573::lvm::462::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' released the operation mutex >9a3a6f4f-bc9b-484a-8a3e-851d8fdafecf::DEBUG::2014-07-10 08:57:13,576::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd_imageNS.9cf413b7-7f14-4a61-8c71-913e5b0ea9c0' >9a3a6f4f-bc9b-484a-8a3e-851d8fdafecf::DEBUG::2014-07-10 08:57:13,578::resourceManager::635::ResourceManager::(releaseResource) Released resource '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd_imageNS.9cf413b7-7f14-4a61-8c71-913e5b0ea9c0' (0 active users) >9a3a6f4f-bc9b-484a-8a3e-851d8fdafecf::DEBUG::2014-07-10 08:57:13,579::resourceManager::641::ResourceManager::(releaseResource) Resource '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd_imageNS.9cf413b7-7f14-4a61-8c71-913e5b0ea9c0' is free, finding out if anyone is waiting for it. >9a3a6f4f-bc9b-484a-8a3e-851d8fdafecf::DEBUG::2014-07-10 08:57:13,580::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd_imageNS.9cf413b7-7f14-4a61-8c71-913e5b0ea9c0', Clearing records. >9a3a6f4f-bc9b-484a-8a3e-851d8fdafecf::DEBUG::2014-07-10 08:57:13,582::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource '6a70504d-00df-4869-8695-0f442053f6b6_imageNS.b8c3a0af-85ef-42d5-abd5-42a2c2371498' >9a3a6f4f-bc9b-484a-8a3e-851d8fdafecf::DEBUG::2014-07-10 08:57:13,583::resourceManager::635::ResourceManager::(releaseResource) Released resource '6a70504d-00df-4869-8695-0f442053f6b6_imageNS.b8c3a0af-85ef-42d5-abd5-42a2c2371498' (0 active users) >9a3a6f4f-bc9b-484a-8a3e-851d8fdafecf::DEBUG::2014-07-10 08:57:13,584::resourceManager::641::ResourceManager::(releaseResource) Resource '6a70504d-00df-4869-8695-0f442053f6b6_imageNS.b8c3a0af-85ef-42d5-abd5-42a2c2371498' is free, finding out if anyone is waiting for it. >9a3a6f4f-bc9b-484a-8a3e-851d8fdafecf::DEBUG::2014-07-10 08:57:13,586::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource '6a70504d-00df-4869-8695-0f442053f6b6_volumeNS.022d12c7-cf77-4c96-b939-4dd8d42a2127' >9a3a6f4f-bc9b-484a-8a3e-851d8fdafecf::DEBUG::2014-07-10 08:57:13,587::resourceManager::635::ResourceManager::(releaseResource) Released resource '6a70504d-00df-4869-8695-0f442053f6b6_volumeNS.022d12c7-cf77-4c96-b939-4dd8d42a2127' (0 active users) >9a3a6f4f-bc9b-484a-8a3e-851d8fdafecf::DEBUG::2014-07-10 08:57:13,588::resourceManager::641::ResourceManager::(releaseResource) Resource '6a70504d-00df-4869-8695-0f442053f6b6_volumeNS.022d12c7-cf77-4c96-b939-4dd8d42a2127' is free, finding out if anyone is waiting for it. >9a3a6f4f-bc9b-484a-8a3e-851d8fdafecf::DEBUG::2014-07-10 08:57:13,589::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource '6a70504d-00df-4869-8695-0f442053f6b6_volumeNS.022d12c7-cf77-4c96-b939-4dd8d42a2127', Clearing records. >9a3a6f4f-bc9b-484a-8a3e-851d8fdafecf::DEBUG::2014-07-10 08:57:13,590::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource '6a70504d-00df-4869-8695-0f442053f6b6_imageNS.b8c3a0af-85ef-42d5-abd5-42a2c2371498', Clearing records. >9a3a6f4f-bc9b-484a-8a3e-851d8fdafecf::DEBUG::2014-07-10 08:57:13,592::task::595::TaskManager.Task::(_updateState) Task=`9a3a6f4f-bc9b-484a-8a3e-851d8fdafecf`::moving from state running -> state finished >9a3a6f4f-bc9b-484a-8a3e-851d8fdafecf::DEBUG::2014-07-10 08:57:13,595::task::752::TaskManager.Task::(_save) Task=`9a3a6f4f-bc9b-484a-8a3e-851d8fdafecf`::_save: orig /rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/master/tasks/9a3a6f4f-bc9b-484a-8a3e-851d8fdafecf temp /rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/master/tasks/9a3a6f4f-bc9b-484a-8a3e-851d8fdafecf.temp >9a3a6f4f-bc9b-484a-8a3e-851d8fdafecf::DEBUG::2014-07-10 08:57:13,631::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': < ResourceRef 'Storage.9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', isValid: 'True' obj: 'None'>, 'Storage.6a70504d-00df-4869-8695-0f442053f6b6': < ResourceRef 'Storage.6a70504d-00df-4869-8695-0f442053f6b6', isValid: 'True' obj: 'None'>} >9a3a6f4f-bc9b-484a-8a3e-851d8fdafecf::DEBUG::2014-07-10 08:57:13,636::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >9a3a6f4f-bc9b-484a-8a3e-851d8fdafecf::DEBUG::2014-07-10 08:57:13,640::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.9e1aa540-1f4e-4ee3-a152-be381ef6c3bd' >9a3a6f4f-bc9b-484a-8a3e-851d8fdafecf::DEBUG::2014-07-10 08:57:13,643::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.9e1aa540-1f4e-4ee3-a152-be381ef6c3bd' (0 active users) >9a3a6f4f-bc9b-484a-8a3e-851d8fdafecf::DEBUG::2014-07-10 08:57:13,646::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.9e1aa540-1f4e-4ee3-a152-be381ef6c3bd' is free, finding out if anyone is waiting for it. >9a3a6f4f-bc9b-484a-8a3e-851d8fdafecf::DEBUG::2014-07-10 08:57:13,648::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', Clearing records. >9a3a6f4f-bc9b-484a-8a3e-851d8fdafecf::DEBUG::2014-07-10 08:57:13,653::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.6a70504d-00df-4869-8695-0f442053f6b6' >9a3a6f4f-bc9b-484a-8a3e-851d8fdafecf::DEBUG::2014-07-10 08:57:13,657::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.6a70504d-00df-4869-8695-0f442053f6b6' (0 active users) >9a3a6f4f-bc9b-484a-8a3e-851d8fdafecf::DEBUG::2014-07-10 08:57:13,659::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.6a70504d-00df-4869-8695-0f442053f6b6' is free, finding out if anyone is waiting for it. >9a3a6f4f-bc9b-484a-8a3e-851d8fdafecf::DEBUG::2014-07-10 08:57:13,661::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.6a70504d-00df-4869-8695-0f442053f6b6', Clearing records. >9a3a6f4f-bc9b-484a-8a3e-851d8fdafecf::DEBUG::2014-07-10 08:57:13,665::task::913::TaskManager.Task::(_runJobs) Task=`9a3a6f4f-bc9b-484a-8a3e-851d8fdafecf`::Task.run: exit - success: result {'uuid': '47592965-e853-4e59-9728-d11cca6a7a8a'} >9a3a6f4f-bc9b-484a-8a3e-851d8fdafecf::DEBUG::2014-07-10 08:57:13,668::task::990::TaskManager.Task::(_decref) Task=`9a3a6f4f-bc9b-484a-8a3e-851d8fdafecf`::ref 0 aborting False >9a3a6f4f-bc9b-484a-8a3e-851d8fdafecf::DEBUG::2014-07-10 08:57:13,670::threadPool::57::Misc.ThreadPool::(setRunningTask) Number of running tasks: 0 >Dummy-33::DEBUG::2014-07-10 08:57:13,710::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.099929 s, 10.2 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-10 08:57:14,050::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/metadata bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-10 08:57:14,064::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000565037 s, 7.2 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 08:57:15,129::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-14::DEBUG::2014-07-10 08:57:15,130::task::595::TaskManager.Task::(_updateState) Task=`93738f1c-1e65-4419-9238-bb857fd8f93b`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 08:57:15,130::logUtils::44::dispatcher::(wrapper) Run and protect: getAllTasksStatuses(spUUID=None, options=None) >Thread-14::DEBUG::2014-07-10 08:57:15,131::taskManager::102::TaskManager::(getAllTasksStatuses) Entry. >Thread-14::DEBUG::2014-07-10 08:57:15,131::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 9a3a6f4f-bc9b-484a-8a3e-851d8fdafecf >Thread-14::DEBUG::2014-07-10 08:57:15,131::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': '1 jobs completed successfully', 'taskState': 'finished', 'taskResult': 'success', 'taskID': '9a3a6f4f-bc9b-484a-8a3e-851d8fdafecf'} >Thread-14::DEBUG::2014-07-10 08:57:15,131::taskManager::113::TaskManager::(getAllTasksStatuses) Return: {'9a3a6f4f-bc9b-484a-8a3e-851d8fdafecf': {'code': 0, 'message': '1 jobs completed successfully', 'taskState': 'finished', 'taskResult': 'success', 'taskID': '9a3a6f4f-bc9b-484a-8a3e-851d8fdafecf'}} >Thread-14::INFO::2014-07-10 08:57:15,131::logUtils::47::dispatcher::(wrapper) Run and protect: getAllTasksStatuses, Return response: {'allTasksStatus': {'9a3a6f4f-bc9b-484a-8a3e-851d8fdafecf': {'code': 0, 'message': '1 jobs completed successfully', 'taskState': 'finished', 'taskResult': 'success', 'taskID': '9a3a6f4f-bc9b-484a-8a3e-851d8fdafecf'}}} >Thread-14::DEBUG::2014-07-10 08:57:15,131::task::1185::TaskManager.Task::(prepare) Task=`93738f1c-1e65-4419-9238-bb857fd8f93b`::finished: {'allTasksStatus': {'9a3a6f4f-bc9b-484a-8a3e-851d8fdafecf': {'code': 0, 'message': '1 jobs completed successfully', 'taskState': 'finished', 'taskResult': 'success', 'taskID': '9a3a6f4f-bc9b-484a-8a3e-851d8fdafecf'}}} >Thread-14::DEBUG::2014-07-10 08:57:15,132::task::595::TaskManager.Task::(_updateState) Task=`93738f1c-1e65-4419-9238-bb857fd8f93b`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 08:57:15,132::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 08:57:15,132::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 08:57:15,132::task::990::TaskManager.Task::(_decref) Task=`93738f1c-1e65-4419-9238-bb857fd8f93b`::ref 0 aborting False >Thread-34::DEBUG::2014-07-10 08:57:15,168::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [155db6e] >Thread-34::DEBUG::2014-07-10 08:57:15,169::task::595::TaskManager.Task::(_updateState) Task=`b52deb60-d987-42e5-9d51-726ce2c948f4`::moving from state init -> state preparing >Thread-34::INFO::2014-07-10 08:57:15,169::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeInfo(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='9cf413b7-7f14-4a61-8c71-913e5b0ea9c0', volUUID='47592965-e853-4e59-9728-d11cca6a7a8a', options=None) >Thread-34::DEBUG::2014-07-10 08:57:15,170::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.9e1aa540-1f4e-4ee3-a152-be381ef6c3bd`ReqID=`2d9e8e25-7832-42b8-9efb-271eeb84220e`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '3089' at 'getVolumeInfo' >Thread-34::DEBUG::2014-07-10 08:57:15,170::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.9e1aa540-1f4e-4ee3-a152-be381ef6c3bd' for lock type 'shared' >Thread-34::DEBUG::2014-07-10 08:57:15,170::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.9e1aa540-1f4e-4ee3-a152-be381ef6c3bd' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-10 08:57:15,170::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.9e1aa540-1f4e-4ee3-a152-be381ef6c3bd`ReqID=`2d9e8e25-7832-42b8-9efb-271eeb84220e`::Granted request >Thread-34::DEBUG::2014-07-10 08:57:15,171::task::827::TaskManager.Task::(resourceAcquired) Task=`b52deb60-d987-42e5-9d51-726ce2c948f4`::_resourcesAcquired: Storage.9e1aa540-1f4e-4ee3-a152-be381ef6c3bd (shared) >Thread-34::DEBUG::2014-07-10 08:57:15,171::task::990::TaskManager.Task::(_decref) Task=`b52deb60-d987-42e5-9d51-726ce2c948f4`::ref 1 aborting False >Thread-34::INFO::2014-07-10 08:57:15,171::volume::879::Storage.Volume::(getInfo) Info request: sdUUID=9e1aa540-1f4e-4ee3-a152-be381ef6c3bd imgUUID=9cf413b7-7f14-4a61-8c71-913e5b0ea9c0 volUUID = 47592965-e853-4e59-9728-d11cca6a7a8a >Thread-34::DEBUG::2014-07-10 08:57:15,172::blockVolume::572::Storage.Misc.excCmd::(getMetadata) '/bin/dd iflag=direct skip=4 bs=512 if=/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/metadata count=1' (cwd None) >Thread-34::DEBUG::2014-07-10 08:57:15,187::blockVolume::572::Storage.Misc.excCmd::(getMetadata) SUCCESS: <err> = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.00465025 s, 110 kB/s\n'; <rc> = 0 >Thread-34::DEBUG::2014-07-10 08:57:15,187::misc::282::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.00465025 s, 110 kB/s'], size: 512 >Thread-34::DEBUG::2014-07-10 08:57:15,188::blockVolume::572::Storage.Misc.excCmd::(getMetadata) '/bin/dd iflag=direct skip=4 bs=512 if=/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/metadata count=1' (cwd None) >Thread-34::DEBUG::2014-07-10 08:57:15,200::blockVolume::572::Storage.Misc.excCmd::(getMetadata) SUCCESS: <err> = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.000481571 s, 1.1 MB/s\n'; <rc> = 0 >Thread-34::DEBUG::2014-07-10 08:57:15,201::misc::282::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.000481571 s, 1.1 MB/s'], size: 512 >Thread-34::INFO::2014-07-10 08:57:15,201::volume::909::Storage.Volume::(getInfo) 9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/9cf413b7-7f14-4a61-8c71-913e5b0ea9c0/47592965-e853-4e59-9728-d11cca6a7a8a info is {'status': 'OK', 'domain': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'voltype': 'SHARED', 'description': '', 'parent': '00000000-0000-0000-0000-000000000000', 'format': 'RAW', 'image': '9cf413b7-7f14-4a61-8c71-913e5b0ea9c0', 'ctime': '1404982483', 'disktype': '2', 'legality': 'LEGAL', 'mtime': '1404982484', 'apparentsize': '10737418240', 'children': [], 'pool': '', 'capacity': '10737418240', 'uuid': '47592965-e853-4e59-9728-d11cca6a7a8a', 'truesize': '10737418240', 'type': 'PREALLOCATED'} >Thread-34::INFO::2014-07-10 08:57:15,201::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeInfo, Return response: {'info': {'status': 'OK', 'domain': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'voltype': 'SHARED', 'description': '', 'parent': '00000000-0000-0000-0000-000000000000', 'format': 'RAW', 'image': '9cf413b7-7f14-4a61-8c71-913e5b0ea9c0', 'ctime': '1404982483', 'disktype': '2', 'legality': 'LEGAL', 'mtime': '1404982484', 'apparentsize': '10737418240', 'children': [], 'pool': '', 'capacity': '10737418240', 'uuid': '47592965-e853-4e59-9728-d11cca6a7a8a', 'truesize': '10737418240', 'type': 'PREALLOCATED'}} >Thread-34::DEBUG::2014-07-10 08:57:15,202::task::1185::TaskManager.Task::(prepare) Task=`b52deb60-d987-42e5-9d51-726ce2c948f4`::finished: {'info': {'status': 'OK', 'domain': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'voltype': 'SHARED', 'description': '', 'parent': '00000000-0000-0000-0000-000000000000', 'format': 'RAW', 'image': '9cf413b7-7f14-4a61-8c71-913e5b0ea9c0', 'ctime': '1404982483', 'disktype': '2', 'legality': 'LEGAL', 'mtime': '1404982484', 'apparentsize': '10737418240', 'children': [], 'pool': '', 'capacity': '10737418240', 'uuid': '47592965-e853-4e59-9728-d11cca6a7a8a', 'truesize': '10737418240', 'type': 'PREALLOCATED'}} >Thread-34::DEBUG::2014-07-10 08:57:15,202::task::595::TaskManager.Task::(_updateState) Task=`b52deb60-d987-42e5-9d51-726ce2c948f4`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-10 08:57:15,202::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': < ResourceRef 'Storage.9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-10 08:57:15,202::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-10 08:57:15,203::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.9e1aa540-1f4e-4ee3-a152-be381ef6c3bd' >Thread-34::DEBUG::2014-07-10 08:57:15,203::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.9e1aa540-1f4e-4ee3-a152-be381ef6c3bd' (0 active users) >Thread-34::DEBUG::2014-07-10 08:57:15,203::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.9e1aa540-1f4e-4ee3-a152-be381ef6c3bd' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-10 08:57:15,204::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', Clearing records. >Thread-34::DEBUG::2014-07-10 08:57:15,204::task::990::TaskManager.Task::(_decref) Task=`b52deb60-d987-42e5-9d51-726ce2c948f4`::ref 0 aborting False >Thread-14::DEBUG::2014-07-10 08:57:15,235::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-14::DEBUG::2014-07-10 08:57:15,236::task::595::TaskManager.Task::(_updateState) Task=`620bdfff-89d9-43f4-906c-06190f16d1ff`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 08:57:15,236::logUtils::44::dispatcher::(wrapper) Run and protect: clearTask(taskID='9a3a6f4f-bc9b-484a-8a3e-851d8fdafecf', spUUID=None, options=None) >Thread-14::DEBUG::2014-07-10 08:57:15,236::taskManager::161::TaskManager::(clearTask) Entry. taskID: 9a3a6f4f-bc9b-484a-8a3e-851d8fdafecf >Thread-14::DEBUG::2014-07-10 08:57:15,238::taskManager::166::TaskManager::(clearTask) Return. >Thread-14::INFO::2014-07-10 08:57:15,238::logUtils::47::dispatcher::(wrapper) Run and protect: clearTask, Return response: None >Thread-14::DEBUG::2014-07-10 08:57:15,238::task::1185::TaskManager.Task::(prepare) Task=`620bdfff-89d9-43f4-906c-06190f16d1ff`::finished: None >Thread-14::DEBUG::2014-07-10 08:57:15,239::task::595::TaskManager.Task::(_updateState) Task=`620bdfff-89d9-43f4-906c-06190f16d1ff`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 08:57:15,239::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 08:57:15,239::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 08:57:15,239::task::990::TaskManager.Task::(_decref) Task=`620bdfff-89d9-43f4-906c-06190f16d1ff`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 08:57:15,725::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 08:57:15,815::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0360704 s, 28.4 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 08:57:17,831::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 08:57:17,922::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0429775 s, 23.8 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 08:57:19,571::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-14::DEBUG::2014-07-10 08:57:19,572::task::595::TaskManager.Task::(_updateState) Task=`70833613-e371-4559-aa9b-1805f27bf46e`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 08:57:19,573::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-14::INFO::2014-07-10 08:57:19,573::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 08:57:19,573::task::1185::TaskManager.Task::(prepare) Task=`70833613-e371-4559-aa9b-1805f27bf46e`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 08:57:19,574::task::595::TaskManager.Task::(_updateState) Task=`70833613-e371-4559-aa9b-1805f27bf46e`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 08:57:19,574::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 08:57:19,574::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 08:57:19,574::task::990::TaskManager.Task::(_decref) Task=`70833613-e371-4559-aa9b-1805f27bf46e`::ref 0 aborting False >Thread-34::DEBUG::2014-07-10 08:57:19,579::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-34::DEBUG::2014-07-10 08:57:19,579::task::595::TaskManager.Task::(_updateState) Task=`d14a994a-4dc4-4b98-a0e5-5c4809c1160e`::moving from state init -> state preparing >Thread-34::INFO::2014-07-10 08:57:19,579::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-34::DEBUG::2014-07-10 08:57:19,580::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`5feed1d6-7e4d-4c32-a9d5-53b26a0dbede`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-10 08:57:19,580::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' for lock type 'shared' >Thread-34::DEBUG::2014-07-10 08:57:19,581::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-10 08:57:19,581::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`5feed1d6-7e4d-4c32-a9d5-53b26a0dbede`::Granted request >Thread-34::DEBUG::2014-07-10 08:57:19,581::task::827::TaskManager.Task::(resourceAcquired) Task=`d14a994a-4dc4-4b98-a0e5-5c4809c1160e`::_resourcesAcquired: Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee (shared) >Thread-34::DEBUG::2014-07-10 08:57:19,581::task::990::TaskManager.Task::(_decref) Task=`d14a994a-4dc4-4b98-a0e5-5c4809c1160e`::ref 1 aborting False >Thread-34::INFO::2014-07-10 08:57:19,583::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1084210806784', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532069482496', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 08:57:19,583::task::1185::TaskManager.Task::(prepare) Task=`d14a994a-4dc4-4b98-a0e5-5c4809c1160e`::finished: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1084210806784', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532069482496', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 08:57:19,584::task::595::TaskManager.Task::(_updateState) Task=`d14a994a-4dc4-4b98-a0e5-5c4809c1160e`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-10 08:57:19,584::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee': < ResourceRef 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-10 08:57:19,584::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-10 08:57:19,585::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' >Thread-34::DEBUG::2014-07-10 08:57:19,585::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' (0 active users) >Thread-34::DEBUG::2014-07-10 08:57:19,585::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-10 08:57:19,585::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', Clearing records. >Thread-34::DEBUG::2014-07-10 08:57:19,585::task::990::TaskManager.Task::(_decref) Task=`d14a994a-4dc4-4b98-a0e5-5c4809c1160e`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 08:57:19,937::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 08:57:20,078::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0905737 s, 11.3 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 08:57:22,093::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 08:57:22,196::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0514456 s, 19.9 MB/s\n'; <rc> = 0 >Thread-40::DEBUG::2014-07-10 08:57:22,889::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lion.qa.lab.tlv.redhat.com:_export_yuri2_backup2/6a70504d-00df-4869-8695-0f442053f6b6/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-40::DEBUG::2014-07-10 08:57:22,903::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n369 bytes (369 B) copied, 0.000534607 s, 690 kB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-10 08:57:24,095::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/metadata bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-10 08:57:24,108::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000813888 s, 5.0 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 08:57:24,212::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 08:57:24,298::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0349377 s, 29.3 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 08:57:26,313::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 08:57:26,437::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0357397 s, 28.7 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 08:57:26,903::task::595::TaskManager.Task::(_updateState) Task=`ac25d308-9dd6-4179-a297-11ba26a70ca0`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 08:57:26,904::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::INFO::2014-07-10 08:57:26,904::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000813888', 'lastCheck': '2.8', 'valid': True}, '6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000534607', 'lastCheck': '4.0', 'valid': True}} >Thread-14::DEBUG::2014-07-10 08:57:26,904::task::1185::TaskManager.Task::(prepare) Task=`ac25d308-9dd6-4179-a297-11ba26a70ca0`::finished: {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000813888', 'lastCheck': '2.8', 'valid': True}, '6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000534607', 'lastCheck': '4.0', 'valid': True}} >Thread-14::DEBUG::2014-07-10 08:57:26,904::task::595::TaskManager.Task::(_updateState) Task=`ac25d308-9dd6-4179-a297-11ba26a70ca0`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 08:57:26,904::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 08:57:26,905::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 08:57:26,905::task::990::TaskManager.Task::(_decref) Task=`ac25d308-9dd6-4179-a297-11ba26a70ca0`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 08:57:28,447::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 08:57:28,533::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0357567 s, 28.6 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 08:57:29,619::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-14::DEBUG::2014-07-10 08:57:29,620::task::595::TaskManager.Task::(_updateState) Task=`1e79b544-6bf8-4812-b1d4-6dbda9c6e550`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 08:57:29,621::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-14::INFO::2014-07-10 08:57:29,621::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 08:57:29,621::task::1185::TaskManager.Task::(prepare) Task=`1e79b544-6bf8-4812-b1d4-6dbda9c6e550`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 08:57:29,621::task::595::TaskManager.Task::(_updateState) Task=`1e79b544-6bf8-4812-b1d4-6dbda9c6e550`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 08:57:29,622::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 08:57:29,622::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 08:57:29,622::task::990::TaskManager.Task::(_decref) Task=`1e79b544-6bf8-4812-b1d4-6dbda9c6e550`::ref 0 aborting False >Thread-34::DEBUG::2014-07-10 08:57:29,626::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-34::DEBUG::2014-07-10 08:57:29,627::task::595::TaskManager.Task::(_updateState) Task=`e210994c-c180-4650-947d-d2bd04a5af21`::moving from state init -> state preparing >Thread-34::INFO::2014-07-10 08:57:29,627::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-34::DEBUG::2014-07-10 08:57:29,628::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`a260e0bc-8706-489c-924a-73a3ac07bb43`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-10 08:57:29,628::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' for lock type 'shared' >Thread-34::DEBUG::2014-07-10 08:57:29,628::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-10 08:57:29,628::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`a260e0bc-8706-489c-924a-73a3ac07bb43`::Granted request >Thread-34::DEBUG::2014-07-10 08:57:29,629::task::827::TaskManager.Task::(resourceAcquired) Task=`e210994c-c180-4650-947d-d2bd04a5af21`::_resourcesAcquired: Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee (shared) >Thread-34::DEBUG::2014-07-10 08:57:29,629::task::990::TaskManager.Task::(_decref) Task=`e210994c-c180-4650-947d-d2bd04a5af21`::ref 1 aborting False >Thread-34::INFO::2014-07-10 08:57:29,630::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1084210806784', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532069482496', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 08:57:29,630::task::1185::TaskManager.Task::(prepare) Task=`e210994c-c180-4650-947d-d2bd04a5af21`::finished: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1084210806784', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532069482496', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 08:57:29,630::task::595::TaskManager.Task::(_updateState) Task=`e210994c-c180-4650-947d-d2bd04a5af21`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-10 08:57:29,630::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee': < ResourceRef 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-10 08:57:29,631::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-10 08:57:29,631::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' >Thread-34::DEBUG::2014-07-10 08:57:29,631::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' (0 active users) >Thread-34::DEBUG::2014-07-10 08:57:29,631::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-10 08:57:29,631::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', Clearing records. >Thread-34::DEBUG::2014-07-10 08:57:29,632::task::990::TaskManager.Task::(_decref) Task=`e210994c-c180-4650-947d-d2bd04a5af21`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 08:57:30,548::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 08:57:30,630::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0299591 s, 34.2 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 08:57:32,644::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 08:57:32,725::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0305528 s, 33.5 MB/s\n'; <rc> = 0 >Thread-40::DEBUG::2014-07-10 08:57:32,933::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lion.qa.lab.tlv.redhat.com:_export_yuri2_backup2/6a70504d-00df-4869-8695-0f442053f6b6/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-40::DEBUG::2014-07-10 08:57:32,947::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n369 bytes (369 B) copied, 0.000540634 s, 683 kB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-10 08:57:34,139::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/metadata bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-10 08:57:34,151::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000616777 s, 6.6 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 08:57:34,740::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 08:57:34,828::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0351345 s, 29.1 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 08:57:36,843::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 08:57:36,927::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0318111 s, 32.2 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 08:57:38,942::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 08:57:39,035::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0299911 s, 34.1 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 08:57:39,660::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-14::DEBUG::2014-07-10 08:57:39,661::task::595::TaskManager.Task::(_updateState) Task=`3c921288-680d-4e2f-8ab0-0f0744dc0346`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 08:57:39,662::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-14::INFO::2014-07-10 08:57:39,662::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 08:57:39,663::task::1185::TaskManager.Task::(prepare) Task=`3c921288-680d-4e2f-8ab0-0f0744dc0346`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 08:57:39,663::task::595::TaskManager.Task::(_updateState) Task=`3c921288-680d-4e2f-8ab0-0f0744dc0346`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 08:57:39,663::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 08:57:39,663::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 08:57:39,663::task::990::TaskManager.Task::(_decref) Task=`3c921288-680d-4e2f-8ab0-0f0744dc0346`::ref 0 aborting False >Thread-34::DEBUG::2014-07-10 08:57:39,668::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-34::DEBUG::2014-07-10 08:57:39,668::task::595::TaskManager.Task::(_updateState) Task=`3dcbaec2-2e4c-4fed-bdba-79e5691c687a`::moving from state init -> state preparing >Thread-34::INFO::2014-07-10 08:57:39,668::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-34::DEBUG::2014-07-10 08:57:39,669::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`839791dd-d086-4358-bd42-6b1646db1c24`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-10 08:57:39,669::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' for lock type 'shared' >Thread-34::DEBUG::2014-07-10 08:57:39,670::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-10 08:57:39,670::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`839791dd-d086-4358-bd42-6b1646db1c24`::Granted request >Thread-34::DEBUG::2014-07-10 08:57:39,670::task::827::TaskManager.Task::(resourceAcquired) Task=`3dcbaec2-2e4c-4fed-bdba-79e5691c687a`::_resourcesAcquired: Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee (shared) >Thread-34::DEBUG::2014-07-10 08:57:39,670::task::990::TaskManager.Task::(_decref) Task=`3dcbaec2-2e4c-4fed-bdba-79e5691c687a`::ref 1 aborting False >Thread-34::INFO::2014-07-10 08:57:39,672::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1084210806784', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532069482496', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 08:57:39,672::task::1185::TaskManager.Task::(prepare) Task=`3dcbaec2-2e4c-4fed-bdba-79e5691c687a`::finished: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1084210806784', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532069482496', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 08:57:39,672::task::595::TaskManager.Task::(_updateState) Task=`3dcbaec2-2e4c-4fed-bdba-79e5691c687a`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-10 08:57:39,672::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee': < ResourceRef 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-10 08:57:39,672::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-10 08:57:39,673::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' >Thread-34::DEBUG::2014-07-10 08:57:39,673::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' (0 active users) >Thread-34::DEBUG::2014-07-10 08:57:39,673::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-10 08:57:39,673::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', Clearing records. >Thread-34::DEBUG::2014-07-10 08:57:39,674::task::990::TaskManager.Task::(_decref) Task=`3dcbaec2-2e4c-4fed-bdba-79e5691c687a`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 08:57:41,050::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 08:57:41,168::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.06767 s, 15.1 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 08:57:42,037::task::595::TaskManager.Task::(_updateState) Task=`537c5565-1d06-4896-a906-1cbfc944e842`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 08:57:42,038::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::INFO::2014-07-10 08:57:42,038::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000616777', 'lastCheck': '7.9', 'valid': True}, '6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000540634', 'lastCheck': '9.1', 'valid': True}} >Thread-14::DEBUG::2014-07-10 08:57:42,039::task::1185::TaskManager.Task::(prepare) Task=`537c5565-1d06-4896-a906-1cbfc944e842`::finished: {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000616777', 'lastCheck': '7.9', 'valid': True}, '6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000540634', 'lastCheck': '9.1', 'valid': True}} >Thread-14::DEBUG::2014-07-10 08:57:42,039::task::595::TaskManager.Task::(_updateState) Task=`537c5565-1d06-4896-a906-1cbfc944e842`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 08:57:42,039::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 08:57:42,039::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 08:57:42,039::task::990::TaskManager.Task::(_decref) Task=`537c5565-1d06-4896-a906-1cbfc944e842`::ref 0 aborting False >Thread-40::DEBUG::2014-07-10 08:57:42,950::domainMonitor::192::Storage.DomainMonitorThread::(_monitorDomain) Refreshing domain 6a70504d-00df-4869-8695-0f442053f6b6 >Thread-40::DEBUG::2014-07-10 08:57:42,977::fileSD::150::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/lion.qa.lab.tlv.redhat.com:_export_yuri2_backup2/6a70504d-00df-4869-8695-0f442053f6b6 >Thread-40::DEBUG::2014-07-10 08:57:42,979::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend >Thread-40::DEBUG::2014-07-10 08:57:42,982::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Backup', 'DESCRIPTION=test', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=0', 'POOL_UUID=4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', 'REMOTE_PATH=lion.qa.lab.tlv.redhat.com:/export/yuri2/backup2', 'ROLE=Regular', 'SDUUID=6a70504d-00df-4869-8695-0f442053f6b6', 'TYPE=NFS', 'VERSION=0', '_SHA_CKSUM=aab6b8e901ec435cd5f9de3c9e3f8b45dca569e0'] >Thread-40::DEBUG::2014-07-10 08:57:42,984::fileSD::609::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images [] >Thread-40::INFO::2014-07-10 08:57:42,984::sd::384::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 6a70504d-00df-4869-8695-0f442053f6b6_imageNS already registered >Thread-40::INFO::2014-07-10 08:57:42,984::sd::392::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 6a70504d-00df-4869-8695-0f442053f6b6_volumeNS already registered >Thread-40::DEBUG::2014-07-10 08:57:43,004::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lion.qa.lab.tlv.redhat.com:_export_yuri2_backup2/6a70504d-00df-4869-8695-0f442053f6b6/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-40::DEBUG::2014-07-10 08:57:43,017::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n369 bytes (369 B) copied, 0.0004103 s, 899 kB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 08:57:43,183::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 08:57:43,276::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0406439 s, 25.2 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-10 08:57:44,181::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/metadata bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-10 08:57:44,193::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000931927 s, 4.4 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 08:57:45,291::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 08:57:45,372::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0301029 s, 34.0 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 08:57:47,387::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 08:57:47,461::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0335471 s, 30.5 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 08:57:49,471::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 08:57:49,552::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0314893 s, 32.5 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 08:57:49,717::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-14::DEBUG::2014-07-10 08:57:49,719::task::595::TaskManager.Task::(_updateState) Task=`a8b3a0bb-be64-4ffa-97b6-4b149e90c9c4`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 08:57:49,719::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-14::INFO::2014-07-10 08:57:49,720::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 08:57:49,720::task::1185::TaskManager.Task::(prepare) Task=`a8b3a0bb-be64-4ffa-97b6-4b149e90c9c4`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 08:57:49,720::task::595::TaskManager.Task::(_updateState) Task=`a8b3a0bb-be64-4ffa-97b6-4b149e90c9c4`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 08:57:49,720::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 08:57:49,720::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 08:57:49,721::task::990::TaskManager.Task::(_decref) Task=`a8b3a0bb-be64-4ffa-97b6-4b149e90c9c4`::ref 0 aborting False >Thread-34::DEBUG::2014-07-10 08:57:49,725::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-34::DEBUG::2014-07-10 08:57:49,726::task::595::TaskManager.Task::(_updateState) Task=`6e639b96-b3ba-4715-b219-fcd2ed936751`::moving from state init -> state preparing >Thread-34::INFO::2014-07-10 08:57:49,726::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-34::DEBUG::2014-07-10 08:57:49,726::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`5279caa6-531d-4ea6-ab7d-ba40aea6bb49`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-10 08:57:49,727::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' for lock type 'shared' >Thread-34::DEBUG::2014-07-10 08:57:49,727::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-10 08:57:49,727::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`5279caa6-531d-4ea6-ab7d-ba40aea6bb49`::Granted request >Thread-34::DEBUG::2014-07-10 08:57:49,728::task::827::TaskManager.Task::(resourceAcquired) Task=`6e639b96-b3ba-4715-b219-fcd2ed936751`::_resourcesAcquired: Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee (shared) >Thread-34::DEBUG::2014-07-10 08:57:49,728::task::990::TaskManager.Task::(_decref) Task=`6e639b96-b3ba-4715-b219-fcd2ed936751`::ref 1 aborting False >Thread-34::INFO::2014-07-10 08:57:49,729::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1084210806784', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532069482496', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 08:57:49,729::task::1185::TaskManager.Task::(prepare) Task=`6e639b96-b3ba-4715-b219-fcd2ed936751`::finished: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1084210806784', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532069482496', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 08:57:49,730::task::595::TaskManager.Task::(_updateState) Task=`6e639b96-b3ba-4715-b219-fcd2ed936751`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-10 08:57:49,730::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee': < ResourceRef 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-10 08:57:49,730::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-10 08:57:49,730::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' >Thread-34::DEBUG::2014-07-10 08:57:49,731::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' (0 active users) >Thread-34::DEBUG::2014-07-10 08:57:49,731::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-10 08:57:49,731::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', Clearing records. >Thread-34::DEBUG::2014-07-10 08:57:49,731::task::990::TaskManager.Task::(_decref) Task=`6e639b96-b3ba-4715-b219-fcd2ed936751`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 08:57:51,567::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 08:57:51,642::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0256347 s, 39.9 MB/s\n'; <rc> = 0 >Thread-40::DEBUG::2014-07-10 08:57:53,047::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lion.qa.lab.tlv.redhat.com:_export_yuri2_backup2/6a70504d-00df-4869-8695-0f442053f6b6/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-40::DEBUG::2014-07-10 08:57:53,061::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n369 bytes (369 B) copied, 0.000460514 s, 801 kB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 08:57:53,657::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 08:57:53,744::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0353808 s, 28.9 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-10 08:57:54,222::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/metadata bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-10 08:57:54,235::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00066278 s, 6.2 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 08:57:55,760::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 08:57:55,841::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0311018 s, 32.9 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 08:57:57,159::task::595::TaskManager.Task::(_updateState) Task=`dd78d4d0-1569-4b98-89ec-e91f3af3cb90`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 08:57:57,160::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::INFO::2014-07-10 08:57:57,160::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00066278', 'lastCheck': '2.9', 'valid': True}, '6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000460514', 'lastCheck': '4.1', 'valid': True}} >Thread-14::DEBUG::2014-07-10 08:57:57,160::task::1185::TaskManager.Task::(prepare) Task=`dd78d4d0-1569-4b98-89ec-e91f3af3cb90`::finished: {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00066278', 'lastCheck': '2.9', 'valid': True}, '6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000460514', 'lastCheck': '4.1', 'valid': True}} >Thread-14::DEBUG::2014-07-10 08:57:57,161::task::595::TaskManager.Task::(_updateState) Task=`dd78d4d0-1569-4b98-89ec-e91f3af3cb90`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 08:57:57,161::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 08:57:57,161::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 08:57:57,161::task::990::TaskManager.Task::(_decref) Task=`dd78d4d0-1569-4b98-89ec-e91f3af3cb90`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 08:57:57,856::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 08:57:57,937::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0316556 s, 32.3 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 08:57:59,764::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-14::DEBUG::2014-07-10 08:57:59,765::task::595::TaskManager.Task::(_updateState) Task=`d17095a6-acd1-4001-b8b6-0a335f00a0e3`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 08:57:59,765::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-14::INFO::2014-07-10 08:57:59,766::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 08:57:59,766::task::1185::TaskManager.Task::(prepare) Task=`d17095a6-acd1-4001-b8b6-0a335f00a0e3`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 08:57:59,766::task::595::TaskManager.Task::(_updateState) Task=`d17095a6-acd1-4001-b8b6-0a335f00a0e3`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 08:57:59,766::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 08:57:59,767::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 08:57:59,767::task::990::TaskManager.Task::(_decref) Task=`d17095a6-acd1-4001-b8b6-0a335f00a0e3`::ref 0 aborting False >Thread-34::DEBUG::2014-07-10 08:57:59,771::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-34::DEBUG::2014-07-10 08:57:59,771::task::595::TaskManager.Task::(_updateState) Task=`6957c9aa-8f4a-4127-b0a8-f22b331b6545`::moving from state init -> state preparing >Thread-34::INFO::2014-07-10 08:57:59,772::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-34::DEBUG::2014-07-10 08:57:59,772::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`d7b1df3b-5048-4998-a12a-79122c52c852`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-10 08:57:59,772::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' for lock type 'shared' >Thread-34::DEBUG::2014-07-10 08:57:59,773::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-10 08:57:59,773::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`d7b1df3b-5048-4998-a12a-79122c52c852`::Granted request >Thread-34::DEBUG::2014-07-10 08:57:59,773::task::827::TaskManager.Task::(resourceAcquired) Task=`6957c9aa-8f4a-4127-b0a8-f22b331b6545`::_resourcesAcquired: Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee (shared) >Thread-34::DEBUG::2014-07-10 08:57:59,774::task::990::TaskManager.Task::(_decref) Task=`6957c9aa-8f4a-4127-b0a8-f22b331b6545`::ref 1 aborting False >Thread-34::INFO::2014-07-10 08:57:59,775::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1084210806784', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532069482496', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 08:57:59,775::task::1185::TaskManager.Task::(prepare) Task=`6957c9aa-8f4a-4127-b0a8-f22b331b6545`::finished: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1084210806784', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532069482496', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 08:57:59,775::task::595::TaskManager.Task::(_updateState) Task=`6957c9aa-8f4a-4127-b0a8-f22b331b6545`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-10 08:57:59,775::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee': < ResourceRef 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-10 08:57:59,775::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-10 08:57:59,776::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' >Thread-34::DEBUG::2014-07-10 08:57:59,776::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' (0 active users) >Thread-34::DEBUG::2014-07-10 08:57:59,776::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-10 08:57:59,776::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', Clearing records. >Thread-34::DEBUG::2014-07-10 08:57:59,776::task::990::TaskManager.Task::(_decref) Task=`6957c9aa-8f4a-4127-b0a8-f22b331b6545`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 08:57:59,953::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 08:58:00,029::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0263978 s, 38.8 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 08:58:02,044::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 08:58:02,131::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0352706 s, 29.0 MB/s\n'; <rc> = 0 >Thread-40::DEBUG::2014-07-10 08:58:03,087::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lion.qa.lab.tlv.redhat.com:_export_yuri2_backup2/6a70504d-00df-4869-8695-0f442053f6b6/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-40::DEBUG::2014-07-10 08:58:03,099::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n369 bytes (369 B) copied, 0.000463384 s, 796 kB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 08:58:04,147::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 08:58:04,253::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0542197 s, 18.9 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-10 08:58:04,266::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/metadata bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-10 08:58:04,297::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000500209 s, 8.2 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 08:58:06,307::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 08:58:06,406::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0502515 s, 20.4 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 08:58:08,421::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 08:58:08,503::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0316579 s, 32.3 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 08:58:09,841::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-14::DEBUG::2014-07-10 08:58:09,842::task::595::TaskManager.Task::(_updateState) Task=`3021fb65-117f-4065-a41f-92cf4377fdec`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 08:58:09,842::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-14::INFO::2014-07-10 08:58:09,843::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 08:58:09,843::task::1185::TaskManager.Task::(prepare) Task=`3021fb65-117f-4065-a41f-92cf4377fdec`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 08:58:09,843::task::595::TaskManager.Task::(_updateState) Task=`3021fb65-117f-4065-a41f-92cf4377fdec`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 08:58:09,843::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 08:58:09,844::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 08:58:09,844::task::990::TaskManager.Task::(_decref) Task=`3021fb65-117f-4065-a41f-92cf4377fdec`::ref 0 aborting False >Thread-34::DEBUG::2014-07-10 08:58:09,848::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-34::DEBUG::2014-07-10 08:58:09,848::task::595::TaskManager.Task::(_updateState) Task=`2f51ba05-09cf-4eba-b933-41bb41fafe01`::moving from state init -> state preparing >Thread-34::INFO::2014-07-10 08:58:09,848::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-34::DEBUG::2014-07-10 08:58:09,849::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`2fe7ca54-356c-4e0b-8160-0ec94864d3eb`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-10 08:58:09,849::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' for lock type 'shared' >Thread-34::DEBUG::2014-07-10 08:58:09,850::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-10 08:58:09,850::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`2fe7ca54-356c-4e0b-8160-0ec94864d3eb`::Granted request >Thread-34::DEBUG::2014-07-10 08:58:09,850::task::827::TaskManager.Task::(resourceAcquired) Task=`2f51ba05-09cf-4eba-b933-41bb41fafe01`::_resourcesAcquired: Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee (shared) >Thread-34::DEBUG::2014-07-10 08:58:09,851::task::990::TaskManager.Task::(_decref) Task=`2f51ba05-09cf-4eba-b933-41bb41fafe01`::ref 1 aborting False >Thread-34::INFO::2014-07-10 08:58:09,852::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1084210806784', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532069482496', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 08:58:09,852::task::1185::TaskManager.Task::(prepare) Task=`2f51ba05-09cf-4eba-b933-41bb41fafe01`::finished: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1084210806784', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532069482496', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 08:58:09,852::task::595::TaskManager.Task::(_updateState) Task=`2f51ba05-09cf-4eba-b933-41bb41fafe01`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-10 08:58:09,852::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee': < ResourceRef 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-10 08:58:09,853::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-10 08:58:09,853::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' >Thread-34::DEBUG::2014-07-10 08:58:09,853::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' (0 active users) >Thread-34::DEBUG::2014-07-10 08:58:09,853::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-10 08:58:09,853::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', Clearing records. >Thread-34::DEBUG::2014-07-10 08:58:09,854::task::990::TaskManager.Task::(_decref) Task=`2f51ba05-09cf-4eba-b933-41bb41fafe01`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 08:58:10,517::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 08:58:10,614::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0471455 s, 21.7 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 08:58:12,282::task::595::TaskManager.Task::(_updateState) Task=`f6c9170a-6957-4fcd-b245-61f20003f1b2`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 08:58:12,282::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::INFO::2014-07-10 08:58:12,283::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000500209', 'lastCheck': '8.0', 'valid': True}, '6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000463384', 'lastCheck': '9.2', 'valid': True}} >Thread-14::DEBUG::2014-07-10 08:58:12,283::task::1185::TaskManager.Task::(prepare) Task=`f6c9170a-6957-4fcd-b245-61f20003f1b2`::finished: {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000500209', 'lastCheck': '8.0', 'valid': True}, '6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000463384', 'lastCheck': '9.2', 'valid': True}} >Thread-14::DEBUG::2014-07-10 08:58:12,283::task::595::TaskManager.Task::(_updateState) Task=`f6c9170a-6957-4fcd-b245-61f20003f1b2`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 08:58:12,283::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 08:58:12,283::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 08:58:12,284::task::990::TaskManager.Task::(_decref) Task=`f6c9170a-6957-4fcd-b245-61f20003f1b2`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 08:58:12,629::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 08:58:12,724::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0449806 s, 22.8 MB/s\n'; <rc> = 0 >Thread-40::DEBUG::2014-07-10 08:58:13,128::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lion.qa.lab.tlv.redhat.com:_export_yuri2_backup2/6a70504d-00df-4869-8695-0f442053f6b6/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-40::DEBUG::2014-07-10 08:58:13,140::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n369 bytes (369 B) copied, 0.000468109 s, 788 kB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-10 08:58:14,333::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/metadata bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-10 08:58:14,344::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000739014 s, 5.5 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 08:58:14,739::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 08:58:14,853::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.060674 s, 16.9 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 08:58:16,867::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 08:58:16,973::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0559856 s, 18.3 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 08:58:18,988::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 08:58:19,074::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0354485 s, 28.9 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 08:58:19,884::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-14::DEBUG::2014-07-10 08:58:19,885::task::595::TaskManager.Task::(_updateState) Task=`0f05f788-9b64-458b-b640-47a3ff0e53b8`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 08:58:19,885::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-14::INFO::2014-07-10 08:58:19,886::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 08:58:19,886::task::1185::TaskManager.Task::(prepare) Task=`0f05f788-9b64-458b-b640-47a3ff0e53b8`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 08:58:19,886::task::595::TaskManager.Task::(_updateState) Task=`0f05f788-9b64-458b-b640-47a3ff0e53b8`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 08:58:19,886::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 08:58:19,886::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 08:58:19,887::task::990::TaskManager.Task::(_decref) Task=`0f05f788-9b64-458b-b640-47a3ff0e53b8`::ref 0 aborting False >Thread-34::DEBUG::2014-07-10 08:58:19,891::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-34::DEBUG::2014-07-10 08:58:19,892::task::595::TaskManager.Task::(_updateState) Task=`a644d2b9-3061-4de3-bb84-de3fd4dc81ad`::moving from state init -> state preparing >Thread-34::INFO::2014-07-10 08:58:19,892::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-34::DEBUG::2014-07-10 08:58:19,893::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`6e5ce86a-14e7-4a0a-a201-46c540561034`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-10 08:58:19,893::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' for lock type 'shared' >Thread-34::DEBUG::2014-07-10 08:58:19,893::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-10 08:58:19,893::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`6e5ce86a-14e7-4a0a-a201-46c540561034`::Granted request >Thread-34::DEBUG::2014-07-10 08:58:19,894::task::827::TaskManager.Task::(resourceAcquired) Task=`a644d2b9-3061-4de3-bb84-de3fd4dc81ad`::_resourcesAcquired: Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee (shared) >Thread-34::DEBUG::2014-07-10 08:58:19,894::task::990::TaskManager.Task::(_decref) Task=`a644d2b9-3061-4de3-bb84-de3fd4dc81ad`::ref 1 aborting False >Thread-34::INFO::2014-07-10 08:58:19,895::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1084210806784', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532069482496', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 08:58:19,896::task::1185::TaskManager.Task::(prepare) Task=`a644d2b9-3061-4de3-bb84-de3fd4dc81ad`::finished: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1084210806784', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532069482496', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 08:58:19,896::task::595::TaskManager.Task::(_updateState) Task=`a644d2b9-3061-4de3-bb84-de3fd4dc81ad`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-10 08:58:19,896::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee': < ResourceRef 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-10 08:58:19,896::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-10 08:58:19,896::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' >Thread-34::DEBUG::2014-07-10 08:58:19,897::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' (0 active users) >Thread-34::DEBUG::2014-07-10 08:58:19,897::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-10 08:58:19,897::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', Clearing records. >Thread-34::DEBUG::2014-07-10 08:58:19,897::task::990::TaskManager.Task::(_decref) Task=`a644d2b9-3061-4de3-bb84-de3fd4dc81ad`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 08:58:21,089::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 08:58:21,165::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0264775 s, 38.7 MB/s\n'; <rc> = 0 >Thread-40::DEBUG::2014-07-10 08:58:23,169::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lion.qa.lab.tlv.redhat.com:_export_yuri2_backup2/6a70504d-00df-4869-8695-0f442053f6b6/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-40::DEBUG::2014-07-10 08:58:23,182::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n369 bytes (369 B) copied, 0.000484266 s, 762 kB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 08:58:23,185::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 08:58:23,272::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.035161 s, 29.1 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-10 08:58:24,373::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/metadata bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-10 08:58:24,385::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000697222 s, 5.9 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 08:58:25,287::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 08:58:25,373::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0355024 s, 28.8 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 08:58:27,388::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Thread-14::DEBUG::2014-07-10 08:58:27,427::task::595::TaskManager.Task::(_updateState) Task=`e6ff0d3f-3bd8-482a-af80-869d88f784e0`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 08:58:27,428::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::INFO::2014-07-10 08:58:27,429::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000697222', 'lastCheck': '3.0', 'valid': True}, '6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000484266', 'lastCheck': '4.2', 'valid': True}} >Thread-14::DEBUG::2014-07-10 08:58:27,430::task::1185::TaskManager.Task::(prepare) Task=`e6ff0d3f-3bd8-482a-af80-869d88f784e0`::finished: {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000697222', 'lastCheck': '3.0', 'valid': True}, '6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000484266', 'lastCheck': '4.2', 'valid': True}} >Thread-14::DEBUG::2014-07-10 08:58:27,430::task::595::TaskManager.Task::(_updateState) Task=`e6ff0d3f-3bd8-482a-af80-869d88f784e0`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 08:58:27,431::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 08:58:27,431::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 08:58:27,432::task::990::TaskManager.Task::(_decref) Task=`e6ff0d3f-3bd8-482a-af80-869d88f784e0`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 08:58:27,485::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0406352 s, 25.2 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 08:58:29,500::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 08:58:29,578::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0277398 s, 36.9 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 08:58:29,932::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-14::DEBUG::2014-07-10 08:58:29,933::task::595::TaskManager.Task::(_updateState) Task=`89a6eb92-13b0-4a0d-8c01-b06c77161b3e`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 08:58:29,934::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-14::INFO::2014-07-10 08:58:29,934::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 08:58:29,934::task::1185::TaskManager.Task::(prepare) Task=`89a6eb92-13b0-4a0d-8c01-b06c77161b3e`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 08:58:29,935::task::595::TaskManager.Task::(_updateState) Task=`89a6eb92-13b0-4a0d-8c01-b06c77161b3e`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 08:58:29,935::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 08:58:29,935::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 08:58:29,935::task::990::TaskManager.Task::(_decref) Task=`89a6eb92-13b0-4a0d-8c01-b06c77161b3e`::ref 0 aborting False >Thread-34::DEBUG::2014-07-10 08:58:29,939::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-34::DEBUG::2014-07-10 08:58:29,940::task::595::TaskManager.Task::(_updateState) Task=`f308ab59-cc05-47d6-96cf-f200930f453c`::moving from state init -> state preparing >Thread-34::INFO::2014-07-10 08:58:29,940::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-34::DEBUG::2014-07-10 08:58:29,941::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`906abda8-c804-46e9-b718-1e97c404596a`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-10 08:58:29,941::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' for lock type 'shared' >Thread-34::DEBUG::2014-07-10 08:58:29,941::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-10 08:58:29,942::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`906abda8-c804-46e9-b718-1e97c404596a`::Granted request >Thread-34::DEBUG::2014-07-10 08:58:29,942::task::827::TaskManager.Task::(resourceAcquired) Task=`f308ab59-cc05-47d6-96cf-f200930f453c`::_resourcesAcquired: Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee (shared) >Thread-34::DEBUG::2014-07-10 08:58:29,942::task::990::TaskManager.Task::(_decref) Task=`f308ab59-cc05-47d6-96cf-f200930f453c`::ref 1 aborting False >Thread-34::INFO::2014-07-10 08:58:29,944::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1084210806784', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532069482496', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 08:58:29,944::task::1185::TaskManager.Task::(prepare) Task=`f308ab59-cc05-47d6-96cf-f200930f453c`::finished: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1084210806784', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532069482496', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 08:58:29,944::task::595::TaskManager.Task::(_updateState) Task=`f308ab59-cc05-47d6-96cf-f200930f453c`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-10 08:58:29,944::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee': < ResourceRef 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-10 08:58:29,944::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-10 08:58:29,945::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' >Thread-34::DEBUG::2014-07-10 08:58:29,945::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' (0 active users) >Thread-34::DEBUG::2014-07-10 08:58:29,945::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-10 08:58:29,945::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', Clearing records. >Thread-34::DEBUG::2014-07-10 08:58:29,945::task::990::TaskManager.Task::(_decref) Task=`f308ab59-cc05-47d6-96cf-f200930f453c`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 08:58:31,593::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 08:58:31,672::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.032039 s, 32.0 MB/s\n'; <rc> = 0 >Thread-40::DEBUG::2014-07-10 08:58:33,223::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lion.qa.lab.tlv.redhat.com:_export_yuri2_backup2/6a70504d-00df-4869-8695-0f442053f6b6/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-40::DEBUG::2014-07-10 08:58:33,235::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n369 bytes (369 B) copied, 0.000453162 s, 814 kB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 08:58:33,689::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 08:58:33,769::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0317525 s, 32.2 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-10 08:58:34,426::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/metadata bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-10 08:58:34,448::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.0109962 s, 372 kB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 08:58:35,786::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 08:58:35,862::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0270563 s, 37.8 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 08:58:37,877::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 08:58:37,959::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0322281 s, 31.8 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 08:58:39,972::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-14::DEBUG::2014-07-10 08:58:39,976::task::595::TaskManager.Task::(_updateState) Task=`9c6b2628-af66-44ca-89fa-5561d283d973`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 08:58:39,978::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Dummy-33::DEBUG::2014-07-10 08:58:39,978::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Thread-14::INFO::2014-07-10 08:58:39,997::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 08:58:40,000::task::1185::TaskManager.Task::(prepare) Task=`9c6b2628-af66-44ca-89fa-5561d283d973`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 08:58:40,003::task::595::TaskManager.Task::(_updateState) Task=`9c6b2628-af66-44ca-89fa-5561d283d973`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 08:58:40,005::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 08:58:40,007::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 08:58:40,010::task::990::TaskManager.Task::(_decref) Task=`9c6b2628-af66-44ca-89fa-5561d283d973`::ref 0 aborting False >Thread-34::DEBUG::2014-07-10 08:58:40,022::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-34::DEBUG::2014-07-10 08:58:40,026::task::595::TaskManager.Task::(_updateState) Task=`c1c88958-4c17-441f-a325-82f0644d31ca`::moving from state init -> state preparing >Thread-34::INFO::2014-07-10 08:58:40,029::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-34::DEBUG::2014-07-10 08:58:40,034::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`38370dce-ef5e-4887-be43-4ff8ee20bb70`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-10 08:58:40,036::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' for lock type 'shared' >Thread-34::DEBUG::2014-07-10 08:58:40,039::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-10 08:58:40,041::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`38370dce-ef5e-4887-be43-4ff8ee20bb70`::Granted request >Thread-34::DEBUG::2014-07-10 08:58:40,045::task::827::TaskManager.Task::(resourceAcquired) Task=`c1c88958-4c17-441f-a325-82f0644d31ca`::_resourcesAcquired: Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee (shared) >Thread-34::DEBUG::2014-07-10 08:58:40,048::task::990::TaskManager.Task::(_decref) Task=`c1c88958-4c17-441f-a325-82f0644d31ca`::ref 1 aborting False >Thread-34::INFO::2014-07-10 08:58:40,058::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1084210806784', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532069482496', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 08:58:40,059::task::1185::TaskManager.Task::(prepare) Task=`c1c88958-4c17-441f-a325-82f0644d31ca`::finished: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1084210806784', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532069482496', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 08:58:40,061::task::595::TaskManager.Task::(_updateState) Task=`c1c88958-4c17-441f-a325-82f0644d31ca`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-10 08:58:40,063::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee': < ResourceRef 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-10 08:58:40,065::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-10 08:58:40,068::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' >Thread-34::DEBUG::2014-07-10 08:58:40,070::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' (0 active users) >Thread-34::DEBUG::2014-07-10 08:58:40,072::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-10 08:58:40,074::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', Clearing records. >Thread-34::DEBUG::2014-07-10 08:58:40,077::task::990::TaskManager.Task::(_decref) Task=`c1c88958-4c17-441f-a325-82f0644d31ca`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 08:58:40,150::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.121327 s, 8.4 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 08:58:42,165::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 08:58:42,242::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0271852 s, 37.7 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 08:58:42,563::task::595::TaskManager.Task::(_updateState) Task=`2a760eef-8198-45cd-8e6e-e121775717ee`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 08:58:42,563::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::INFO::2014-07-10 08:58:42,563::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0109962', 'lastCheck': '8.1', 'valid': True}, '6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000453162', 'lastCheck': '9.3', 'valid': True}} >Thread-14::DEBUG::2014-07-10 08:58:42,564::task::1185::TaskManager.Task::(prepare) Task=`2a760eef-8198-45cd-8e6e-e121775717ee`::finished: {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0109962', 'lastCheck': '8.1', 'valid': True}, '6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000453162', 'lastCheck': '9.3', 'valid': True}} >Thread-14::DEBUG::2014-07-10 08:58:42,564::task::595::TaskManager.Task::(_updateState) Task=`2a760eef-8198-45cd-8e6e-e121775717ee`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 08:58:42,564::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 08:58:42,564::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 08:58:42,564::task::990::TaskManager.Task::(_decref) Task=`2a760eef-8198-45cd-8e6e-e121775717ee`::ref 0 aborting False >Thread-40::DEBUG::2014-07-10 08:58:43,264::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lion.qa.lab.tlv.redhat.com:_export_yuri2_backup2/6a70504d-00df-4869-8695-0f442053f6b6/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-40::DEBUG::2014-07-10 08:58:43,276::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n369 bytes (369 B) copied, 0.000445462 s, 828 kB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 08:58:44,257::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 08:58:44,346::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0403731 s, 25.4 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-10 08:58:44,477::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/metadata bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-10 08:58:44,489::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000712123 s, 5.8 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 08:58:46,364::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 08:58:46,441::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0268853 s, 38.1 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 08:58:48,456::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 08:58:48,535::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0302455 s, 33.9 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 08:58:50,114::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-14::DEBUG::2014-07-10 08:58:50,116::task::595::TaskManager.Task::(_updateState) Task=`d105d298-809b-45e2-bce9-765308e0cc18`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 08:58:50,116::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-14::INFO::2014-07-10 08:58:50,117::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 08:58:50,117::task::1185::TaskManager.Task::(prepare) Task=`d105d298-809b-45e2-bce9-765308e0cc18`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 08:58:50,117::task::595::TaskManager.Task::(_updateState) Task=`d105d298-809b-45e2-bce9-765308e0cc18`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 08:58:50,117::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 08:58:50,117::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 08:58:50,118::task::990::TaskManager.Task::(_decref) Task=`d105d298-809b-45e2-bce9-765308e0cc18`::ref 0 aborting False >Thread-34::DEBUG::2014-07-10 08:58:50,122::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-34::DEBUG::2014-07-10 08:58:50,122::task::595::TaskManager.Task::(_updateState) Task=`4ccd373d-2299-492e-889f-7e3bcb781f2b`::moving from state init -> state preparing >Thread-34::INFO::2014-07-10 08:58:50,123::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-34::DEBUG::2014-07-10 08:58:50,123::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`17894b9c-3f3d-4443-8064-9219ee0bba82`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-10 08:58:50,124::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' for lock type 'shared' >Thread-34::DEBUG::2014-07-10 08:58:50,124::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-10 08:58:50,124::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`17894b9c-3f3d-4443-8064-9219ee0bba82`::Granted request >Thread-34::DEBUG::2014-07-10 08:58:50,125::task::827::TaskManager.Task::(resourceAcquired) Task=`4ccd373d-2299-492e-889f-7e3bcb781f2b`::_resourcesAcquired: Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee (shared) >Thread-34::DEBUG::2014-07-10 08:58:50,125::task::990::TaskManager.Task::(_decref) Task=`4ccd373d-2299-492e-889f-7e3bcb781f2b`::ref 1 aborting False >Thread-34::INFO::2014-07-10 08:58:50,126::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1084210806784', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532069482496', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 08:58:50,126::task::1185::TaskManager.Task::(prepare) Task=`4ccd373d-2299-492e-889f-7e3bcb781f2b`::finished: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1084210806784', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532069482496', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 08:58:50,127::task::595::TaskManager.Task::(_updateState) Task=`4ccd373d-2299-492e-889f-7e3bcb781f2b`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-10 08:58:50,127::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee': < ResourceRef 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-10 08:58:50,127::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-10 08:58:50,127::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' >Thread-34::DEBUG::2014-07-10 08:58:50,127::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' (0 active users) >Thread-34::DEBUG::2014-07-10 08:58:50,128::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-10 08:58:50,128::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', Clearing records. >Thread-34::DEBUG::2014-07-10 08:58:50,128::task::990::TaskManager.Task::(_decref) Task=`4ccd373d-2299-492e-889f-7e3bcb781f2b`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 08:58:50,550::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 08:58:50,626::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0257115 s, 39.8 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 08:58:52,641::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 08:58:52,728::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0368361 s, 27.8 MB/s\n'; <rc> = 0 >Thread-40::DEBUG::2014-07-10 08:58:53,305::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lion.qa.lab.tlv.redhat.com:_export_yuri2_backup2/6a70504d-00df-4869-8695-0f442053f6b6/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-40::DEBUG::2014-07-10 08:58:53,316::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n369 bytes (369 B) copied, 0.000578339 s, 638 kB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-10 08:58:54,514::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/metadata bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-10 08:58:54,526::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000728189 s, 5.6 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 08:58:54,743::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 08:58:54,829::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0354145 s, 28.9 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 08:58:56,845::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 08:58:56,926::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0322426 s, 31.8 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 08:58:57,690::task::595::TaskManager.Task::(_updateState) Task=`50dd8561-54df-4785-aaa6-c76ba77e4173`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 08:58:57,691::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::INFO::2014-07-10 08:58:57,691::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000728189', 'lastCheck': '3.1', 'valid': True}, '6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000578339', 'lastCheck': '4.4', 'valid': True}} >Thread-14::DEBUG::2014-07-10 08:58:57,691::task::1185::TaskManager.Task::(prepare) Task=`50dd8561-54df-4785-aaa6-c76ba77e4173`::finished: {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000728189', 'lastCheck': '3.1', 'valid': True}, '6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000578339', 'lastCheck': '4.4', 'valid': True}} >Thread-14::DEBUG::2014-07-10 08:58:57,691::task::595::TaskManager.Task::(_updateState) Task=`50dd8561-54df-4785-aaa6-c76ba77e4173`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 08:58:57,692::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 08:58:57,692::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 08:58:57,692::task::990::TaskManager.Task::(_decref) Task=`50dd8561-54df-4785-aaa6-c76ba77e4173`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 08:58:58,940::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 08:58:59,021::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0320844 s, 31.9 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 08:59:00,155::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-14::DEBUG::2014-07-10 08:59:00,156::task::595::TaskManager.Task::(_updateState) Task=`7bb48985-80be-47c4-870c-9b3e009604ba`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 08:59:00,157::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-14::INFO::2014-07-10 08:59:00,157::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 08:59:00,158::task::1185::TaskManager.Task::(prepare) Task=`7bb48985-80be-47c4-870c-9b3e009604ba`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 08:59:00,158::task::595::TaskManager.Task::(_updateState) Task=`7bb48985-80be-47c4-870c-9b3e009604ba`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 08:59:00,158::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 08:59:00,158::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 08:59:00,158::task::990::TaskManager.Task::(_decref) Task=`7bb48985-80be-47c4-870c-9b3e009604ba`::ref 0 aborting False >Thread-34::DEBUG::2014-07-10 08:59:00,163::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-34::DEBUG::2014-07-10 08:59:00,163::task::595::TaskManager.Task::(_updateState) Task=`a6be8ca0-c134-4fb7-83a1-4b6db8be7fd0`::moving from state init -> state preparing >Thread-34::INFO::2014-07-10 08:59:00,163::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-34::DEBUG::2014-07-10 08:59:00,164::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`76f70de2-997d-4dbc-a57e-2d59ed272a97`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-10 08:59:00,164::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' for lock type 'shared' >Thread-34::DEBUG::2014-07-10 08:59:00,165::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-10 08:59:00,165::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`76f70de2-997d-4dbc-a57e-2d59ed272a97`::Granted request >Thread-34::DEBUG::2014-07-10 08:59:00,165::task::827::TaskManager.Task::(resourceAcquired) Task=`a6be8ca0-c134-4fb7-83a1-4b6db8be7fd0`::_resourcesAcquired: Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee (shared) >Thread-34::DEBUG::2014-07-10 08:59:00,166::task::990::TaskManager.Task::(_decref) Task=`a6be8ca0-c134-4fb7-83a1-4b6db8be7fd0`::ref 1 aborting False >Thread-34::INFO::2014-07-10 08:59:00,167::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1084210806784', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532069482496', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 08:59:00,167::task::1185::TaskManager.Task::(prepare) Task=`a6be8ca0-c134-4fb7-83a1-4b6db8be7fd0`::finished: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1084210806784', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532069482496', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 08:59:00,167::task::595::TaskManager.Task::(_updateState) Task=`a6be8ca0-c134-4fb7-83a1-4b6db8be7fd0`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-10 08:59:00,167::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee': < ResourceRef 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-10 08:59:00,168::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-10 08:59:00,168::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' >Thread-34::DEBUG::2014-07-10 08:59:00,168::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' (0 active users) >Thread-34::DEBUG::2014-07-10 08:59:00,168::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-10 08:59:00,168::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', Clearing records. >Thread-34::DEBUG::2014-07-10 08:59:00,169::task::990::TaskManager.Task::(_decref) Task=`a6be8ca0-c134-4fb7-83a1-4b6db8be7fd0`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 08:59:01,036::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 08:59:01,122::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0358781 s, 28.5 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 08:59:03,137::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 08:59:03,256::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0268323 s, 38.2 MB/s\n'; <rc> = 0 >Thread-40::DEBUG::2014-07-10 08:59:03,346::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lion.qa.lab.tlv.redhat.com:_export_yuri2_backup2/6a70504d-00df-4869-8695-0f442053f6b6/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-40::DEBUG::2014-07-10 08:59:03,358::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n369 bytes (369 B) copied, 0.000406629 s, 907 kB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-10 08:59:04,554::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/metadata bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-10 08:59:04,565::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000603301 s, 6.8 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 08:59:05,272::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 08:59:05,357::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0356553 s, 28.7 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 08:59:07,372::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 08:59:07,449::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0278653 s, 36.7 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 08:59:09,464::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 08:59:09,540::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0278955 s, 36.7 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 08:59:10,254::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-14::DEBUG::2014-07-10 08:59:10,255::task::595::TaskManager.Task::(_updateState) Task=`45d21d59-9e08-4656-be14-7861bc816d31`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 08:59:10,256::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-14::INFO::2014-07-10 08:59:10,256::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 08:59:10,257::task::1185::TaskManager.Task::(prepare) Task=`45d21d59-9e08-4656-be14-7861bc816d31`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 08:59:10,257::task::595::TaskManager.Task::(_updateState) Task=`45d21d59-9e08-4656-be14-7861bc816d31`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 08:59:10,257::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 08:59:10,257::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 08:59:10,257::task::990::TaskManager.Task::(_decref) Task=`45d21d59-9e08-4656-be14-7861bc816d31`::ref 0 aborting False >Thread-34::DEBUG::2014-07-10 08:59:10,261::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-34::DEBUG::2014-07-10 08:59:10,262::task::595::TaskManager.Task::(_updateState) Task=`7d7e7e6a-ae4a-41e4-aef5-ba9d8d3f6bd1`::moving from state init -> state preparing >Thread-34::INFO::2014-07-10 08:59:10,262::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-34::DEBUG::2014-07-10 08:59:10,264::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`b78bf45e-85a1-4f7b-bff2-8db5096af555`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-10 08:59:10,265::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' for lock type 'shared' >Thread-34::DEBUG::2014-07-10 08:59:10,265::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-10 08:59:10,265::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`b78bf45e-85a1-4f7b-bff2-8db5096af555`::Granted request >Thread-34::DEBUG::2014-07-10 08:59:10,266::task::827::TaskManager.Task::(resourceAcquired) Task=`7d7e7e6a-ae4a-41e4-aef5-ba9d8d3f6bd1`::_resourcesAcquired: Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee (shared) >Thread-34::DEBUG::2014-07-10 08:59:10,266::task::990::TaskManager.Task::(_decref) Task=`7d7e7e6a-ae4a-41e4-aef5-ba9d8d3f6bd1`::ref 1 aborting False >Thread-34::INFO::2014-07-10 08:59:10,267::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1084210806784', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532069482496', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 08:59:10,267::task::1185::TaskManager.Task::(prepare) Task=`7d7e7e6a-ae4a-41e4-aef5-ba9d8d3f6bd1`::finished: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1084210806784', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532069482496', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 08:59:10,268::task::595::TaskManager.Task::(_updateState) Task=`7d7e7e6a-ae4a-41e4-aef5-ba9d8d3f6bd1`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-10 08:59:10,268::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee': < ResourceRef 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-10 08:59:10,268::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-10 08:59:10,268::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' >Thread-34::DEBUG::2014-07-10 08:59:10,268::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' (0 active users) >Thread-34::DEBUG::2014-07-10 08:59:10,269::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-10 08:59:10,269::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', Clearing records. >Thread-34::DEBUG::2014-07-10 08:59:10,269::task::990::TaskManager.Task::(_decref) Task=`7d7e7e6a-ae4a-41e4-aef5-ba9d8d3f6bd1`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 08:59:11,555::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 08:59:11,635::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0293584 s, 34.9 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 08:59:12,813::task::595::TaskManager.Task::(_updateState) Task=`09c40978-1c5a-4efd-b631-263084d06dda`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 08:59:12,813::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::INFO::2014-07-10 08:59:12,814::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000603301', 'lastCheck': '8.2', 'valid': True}, '6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000406629', 'lastCheck': '9.5', 'valid': True}} >Thread-14::DEBUG::2014-07-10 08:59:12,814::task::1185::TaskManager.Task::(prepare) Task=`09c40978-1c5a-4efd-b631-263084d06dda`::finished: {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000603301', 'lastCheck': '8.2', 'valid': True}, '6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000406629', 'lastCheck': '9.5', 'valid': True}} >Thread-14::DEBUG::2014-07-10 08:59:12,814::task::595::TaskManager.Task::(_updateState) Task=`09c40978-1c5a-4efd-b631-263084d06dda`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 08:59:12,814::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 08:59:12,814::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 08:59:12,815::task::990::TaskManager.Task::(_decref) Task=`09c40978-1c5a-4efd-b631-263084d06dda`::ref 0 aborting False >Thread-40::DEBUG::2014-07-10 08:59:13,387::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lion.qa.lab.tlv.redhat.com:_export_yuri2_backup2/6a70504d-00df-4869-8695-0f442053f6b6/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-40::DEBUG::2014-07-10 08:59:13,399::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n369 bytes (369 B) copied, 0.000510412 s, 723 kB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 08:59:13,650::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 08:59:13,733::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0347485 s, 29.5 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-10 08:59:14,600::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/metadata bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-10 08:59:14,612::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000727791 s, 5.6 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 08:59:15,749::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 08:59:16,180::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.038214 s, 26.8 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 08:59:18,355::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 08:59:18,432::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0268387 s, 38.2 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 08:59:20,304::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-14::DEBUG::2014-07-10 08:59:20,305::task::595::TaskManager.Task::(_updateState) Task=`572ed14f-0eeb-455d-90f2-8c28b786c33a`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 08:59:20,305::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-14::INFO::2014-07-10 08:59:20,306::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 08:59:20,306::task::1185::TaskManager.Task::(prepare) Task=`572ed14f-0eeb-455d-90f2-8c28b786c33a`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 08:59:20,306::task::595::TaskManager.Task::(_updateState) Task=`572ed14f-0eeb-455d-90f2-8c28b786c33a`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 08:59:20,306::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 08:59:20,307::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 08:59:20,307::task::990::TaskManager.Task::(_decref) Task=`572ed14f-0eeb-455d-90f2-8c28b786c33a`::ref 0 aborting False >Thread-34::DEBUG::2014-07-10 08:59:20,311::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-34::DEBUG::2014-07-10 08:59:20,311::task::595::TaskManager.Task::(_updateState) Task=`d9aae35a-51b2-4bbb-967f-c63e9bb15144`::moving from state init -> state preparing >Thread-34::INFO::2014-07-10 08:59:20,312::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-34::DEBUG::2014-07-10 08:59:20,312::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`391dc5ee-dbc1-4c41-82bc-75ad637f15df`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-10 08:59:20,313::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' for lock type 'shared' >Thread-34::DEBUG::2014-07-10 08:59:20,313::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-10 08:59:20,313::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`391dc5ee-dbc1-4c41-82bc-75ad637f15df`::Granted request >Thread-34::DEBUG::2014-07-10 08:59:20,314::task::827::TaskManager.Task::(resourceAcquired) Task=`d9aae35a-51b2-4bbb-967f-c63e9bb15144`::_resourcesAcquired: Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee (shared) >Thread-34::DEBUG::2014-07-10 08:59:20,314::task::990::TaskManager.Task::(_decref) Task=`d9aae35a-51b2-4bbb-967f-c63e9bb15144`::ref 1 aborting False >Thread-34::INFO::2014-07-10 08:59:20,315::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1084210806784', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532069482496', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 08:59:20,315::task::1185::TaskManager.Task::(prepare) Task=`d9aae35a-51b2-4bbb-967f-c63e9bb15144`::finished: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1084210806784', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532069482496', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 08:59:20,316::task::595::TaskManager.Task::(_updateState) Task=`d9aae35a-51b2-4bbb-967f-c63e9bb15144`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-10 08:59:20,316::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee': < ResourceRef 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-10 08:59:20,316::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-10 08:59:20,316::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' >Thread-34::DEBUG::2014-07-10 08:59:20,316::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' (0 active users) >Thread-34::DEBUG::2014-07-10 08:59:20,317::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-10 08:59:20,317::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', Clearing records. >Thread-34::DEBUG::2014-07-10 08:59:20,317::task::990::TaskManager.Task::(_decref) Task=`d9aae35a-51b2-4bbb-967f-c63e9bb15144`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 08:59:20,447::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 08:59:20,533::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0358021 s, 28.6 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 08:59:22,544::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 08:59:22,622::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0259221 s, 39.5 MB/s\n'; <rc> = 0 >Thread-40::DEBUG::2014-07-10 08:59:23,451::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lion.qa.lab.tlv.redhat.com:_export_yuri2_backup2/6a70504d-00df-4869-8695-0f442053f6b6/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-40::DEBUG::2014-07-10 08:59:23,463::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n369 bytes (369 B) copied, 0.000450833 s, 818 kB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 08:59:24,637::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Thread-18::DEBUG::2014-07-10 08:59:24,647::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/metadata bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-10 08:59:24,670::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000546433 s, 7.5 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 08:59:25,021::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.326729 s, 3.1 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 08:59:27,037::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 08:59:27,116::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0287205 s, 35.7 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 08:59:27,972::task::595::TaskManager.Task::(_updateState) Task=`afef39cb-55a4-4bb2-8712-31091fc4df2c`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 08:59:27,972::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::INFO::2014-07-10 08:59:27,973::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000546433', 'lastCheck': '3.0', 'valid': True}, '6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000450833', 'lastCheck': '4.5', 'valid': True}} >Thread-14::DEBUG::2014-07-10 08:59:27,973::task::1185::TaskManager.Task::(prepare) Task=`afef39cb-55a4-4bb2-8712-31091fc4df2c`::finished: {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000546433', 'lastCheck': '3.0', 'valid': True}, '6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000450833', 'lastCheck': '4.5', 'valid': True}} >Thread-14::DEBUG::2014-07-10 08:59:27,973::task::595::TaskManager.Task::(_updateState) Task=`afef39cb-55a4-4bb2-8712-31091fc4df2c`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 08:59:27,974::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 08:59:27,974::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 08:59:27,974::task::990::TaskManager.Task::(_decref) Task=`afef39cb-55a4-4bb2-8712-31091fc4df2c`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 08:59:29,131::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 08:59:29,217::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0343812 s, 29.8 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 08:59:30,358::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-14::DEBUG::2014-07-10 08:59:30,360::task::595::TaskManager.Task::(_updateState) Task=`f9aca0dc-01a0-491e-b62c-a63aa06ba386`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 08:59:30,360::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-14::INFO::2014-07-10 08:59:30,361::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 08:59:30,361::task::1185::TaskManager.Task::(prepare) Task=`f9aca0dc-01a0-491e-b62c-a63aa06ba386`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 08:59:30,361::task::595::TaskManager.Task::(_updateState) Task=`f9aca0dc-01a0-491e-b62c-a63aa06ba386`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 08:59:30,361::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 08:59:30,362::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 08:59:30,362::task::990::TaskManager.Task::(_decref) Task=`f9aca0dc-01a0-491e-b62c-a63aa06ba386`::ref 0 aborting False >Thread-34::DEBUG::2014-07-10 08:59:30,366::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-34::DEBUG::2014-07-10 08:59:30,367::task::595::TaskManager.Task::(_updateState) Task=`f67c7f45-8568-4479-8d67-6e44e0f354eb`::moving from state init -> state preparing >Thread-34::INFO::2014-07-10 08:59:30,367::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-34::DEBUG::2014-07-10 08:59:30,368::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`4e96c9c3-dff3-40f1-ab2c-769fd820269e`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-10 08:59:30,368::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' for lock type 'shared' >Thread-34::DEBUG::2014-07-10 08:59:30,368::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-10 08:59:30,368::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`4e96c9c3-dff3-40f1-ab2c-769fd820269e`::Granted request >Thread-34::DEBUG::2014-07-10 08:59:30,369::task::827::TaskManager.Task::(resourceAcquired) Task=`f67c7f45-8568-4479-8d67-6e44e0f354eb`::_resourcesAcquired: Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee (shared) >Thread-34::DEBUG::2014-07-10 08:59:30,369::task::990::TaskManager.Task::(_decref) Task=`f67c7f45-8568-4479-8d67-6e44e0f354eb`::ref 1 aborting False >Thread-34::INFO::2014-07-10 08:59:30,370::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1084210806784', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532069482496', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 08:59:30,371::task::1185::TaskManager.Task::(prepare) Task=`f67c7f45-8568-4479-8d67-6e44e0f354eb`::finished: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1084210806784', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532069482496', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 08:59:30,371::task::595::TaskManager.Task::(_updateState) Task=`f67c7f45-8568-4479-8d67-6e44e0f354eb`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-10 08:59:30,371::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee': < ResourceRef 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-10 08:59:30,371::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-10 08:59:30,372::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' >Thread-34::DEBUG::2014-07-10 08:59:30,372::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' (0 active users) >Thread-34::DEBUG::2014-07-10 08:59:30,372::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-10 08:59:30,372::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', Clearing records. >Thread-34::DEBUG::2014-07-10 08:59:30,372::task::990::TaskManager.Task::(_decref) Task=`f67c7f45-8568-4479-8d67-6e44e0f354eb`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 08:59:31,232::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 08:59:31,316::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0319345 s, 32.1 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 08:59:33,331::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 08:59:33,407::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0274886 s, 37.3 MB/s\n'; <rc> = 0 >Thread-40::DEBUG::2014-07-10 08:59:33,493::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lion.qa.lab.tlv.redhat.com:_export_yuri2_backup2/6a70504d-00df-4869-8695-0f442053f6b6/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-40::DEBUG::2014-07-10 08:59:33,507::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n369 bytes (369 B) copied, 0.000468669 s, 787 kB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-10 08:59:34,950::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/metadata bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-10 08:59:34,962::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000738296 s, 5.5 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 08:59:35,422::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 08:59:35,502::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0300918 s, 34.0 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 08:59:37,517::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 08:59:37,623::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0250123 s, 40.9 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 08:59:39,638::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 08:59:39,713::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0273431 s, 37.5 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 08:59:40,395::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-14::DEBUG::2014-07-10 08:59:40,396::task::595::TaskManager.Task::(_updateState) Task=`bb1cca40-a4ee-492c-b782-e548cb7b853b`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 08:59:40,396::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-14::INFO::2014-07-10 08:59:40,397::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 08:59:40,397::task::1185::TaskManager.Task::(prepare) Task=`bb1cca40-a4ee-492c-b782-e548cb7b853b`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 08:59:40,397::task::595::TaskManager.Task::(_updateState) Task=`bb1cca40-a4ee-492c-b782-e548cb7b853b`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 08:59:40,398::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 08:59:40,398::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 08:59:40,398::task::990::TaskManager.Task::(_decref) Task=`bb1cca40-a4ee-492c-b782-e548cb7b853b`::ref 0 aborting False >Thread-34::DEBUG::2014-07-10 08:59:40,402::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-34::DEBUG::2014-07-10 08:59:40,403::task::595::TaskManager.Task::(_updateState) Task=`45a8d6ee-389b-435c-a8ed-98b0d0610ec6`::moving from state init -> state preparing >Thread-34::INFO::2014-07-10 08:59:40,403::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-34::DEBUG::2014-07-10 08:59:40,404::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`e298d1cd-b533-4520-b3af-ea862d82733c`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-10 08:59:40,404::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' for lock type 'shared' >Thread-34::DEBUG::2014-07-10 08:59:40,404::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-10 08:59:40,404::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`e298d1cd-b533-4520-b3af-ea862d82733c`::Granted request >Thread-34::DEBUG::2014-07-10 08:59:40,405::task::827::TaskManager.Task::(resourceAcquired) Task=`45a8d6ee-389b-435c-a8ed-98b0d0610ec6`::_resourcesAcquired: Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee (shared) >Thread-34::DEBUG::2014-07-10 08:59:40,405::task::990::TaskManager.Task::(_decref) Task=`45a8d6ee-389b-435c-a8ed-98b0d0610ec6`::ref 1 aborting False >Thread-34::INFO::2014-07-10 08:59:40,406::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1084210806784', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532069482496', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 08:59:40,407::task::1185::TaskManager.Task::(prepare) Task=`45a8d6ee-389b-435c-a8ed-98b0d0610ec6`::finished: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1084210806784', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532069482496', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 08:59:40,407::task::595::TaskManager.Task::(_updateState) Task=`45a8d6ee-389b-435c-a8ed-98b0d0610ec6`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-10 08:59:40,407::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee': < ResourceRef 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-10 08:59:40,407::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-10 08:59:40,407::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' >Thread-34::DEBUG::2014-07-10 08:59:40,408::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' (0 active users) >Thread-34::DEBUG::2014-07-10 08:59:40,408::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-10 08:59:40,408::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', Clearing records. >Thread-34::DEBUG::2014-07-10 08:59:40,408::task::990::TaskManager.Task::(_decref) Task=`45a8d6ee-389b-435c-a8ed-98b0d0610ec6`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 08:59:41,728::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 08:59:41,807::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0275495 s, 37.2 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 08:59:43,102::task::595::TaskManager.Task::(_updateState) Task=`6c0a5387-9604-48dd-96a1-665c9e8bad52`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 08:59:43,103::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::INFO::2014-07-10 08:59:43,103::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000738296', 'lastCheck': '8.1', 'valid': True}, '6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000468669', 'lastCheck': '9.6', 'valid': True}} >Thread-14::DEBUG::2014-07-10 08:59:43,103::task::1185::TaskManager.Task::(prepare) Task=`6c0a5387-9604-48dd-96a1-665c9e8bad52`::finished: {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000738296', 'lastCheck': '8.1', 'valid': True}, '6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000468669', 'lastCheck': '9.6', 'valid': True}} >Thread-14::DEBUG::2014-07-10 08:59:43,104::task::595::TaskManager.Task::(_updateState) Task=`6c0a5387-9604-48dd-96a1-665c9e8bad52`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 08:59:43,104::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 08:59:43,104::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 08:59:43,104::task::990::TaskManager.Task::(_decref) Task=`6c0a5387-9604-48dd-96a1-665c9e8bad52`::ref 0 aborting False >Thread-40::DEBUG::2014-07-10 08:59:43,546::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lion.qa.lab.tlv.redhat.com:_export_yuri2_backup2/6a70504d-00df-4869-8695-0f442053f6b6/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-40::DEBUG::2014-07-10 08:59:43,560::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n369 bytes (369 B) copied, 0.000501877 s, 735 kB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 08:59:43,823::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 08:59:43,903::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.030264 s, 33.8 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-10 08:59:44,990::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/metadata bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-10 08:59:45,004::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000686137 s, 6.0 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 08:59:45,918::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 08:59:46,011::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0346977 s, 29.5 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 08:59:48,026::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 08:59:48,102::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.027031 s, 37.9 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 08:59:50,117::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 08:59:50,199::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0325451 s, 31.5 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 08:59:50,436::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-14::DEBUG::2014-07-10 08:59:50,437::task::595::TaskManager.Task::(_updateState) Task=`3be691df-3c58-4bda-9baa-e71bee91aef2`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 08:59:50,437::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-14::INFO::2014-07-10 08:59:50,438::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 08:59:50,438::task::1185::TaskManager.Task::(prepare) Task=`3be691df-3c58-4bda-9baa-e71bee91aef2`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 08:59:50,438::task::595::TaskManager.Task::(_updateState) Task=`3be691df-3c58-4bda-9baa-e71bee91aef2`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 08:59:50,439::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 08:59:50,439::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 08:59:50,439::task::990::TaskManager.Task::(_decref) Task=`3be691df-3c58-4bda-9baa-e71bee91aef2`::ref 0 aborting False >Thread-34::DEBUG::2014-07-10 08:59:50,444::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-34::DEBUG::2014-07-10 08:59:50,444::task::595::TaskManager.Task::(_updateState) Task=`80813ceb-dfc8-40a7-b095-215319923ada`::moving from state init -> state preparing >Thread-34::INFO::2014-07-10 08:59:50,444::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-34::DEBUG::2014-07-10 08:59:50,445::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`d3df260b-9b4a-4578-a00e-6ec925dd9ad5`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-10 08:59:50,445::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' for lock type 'shared' >Thread-34::DEBUG::2014-07-10 08:59:50,446::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-10 08:59:50,446::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`d3df260b-9b4a-4578-a00e-6ec925dd9ad5`::Granted request >Thread-34::DEBUG::2014-07-10 08:59:50,446::task::827::TaskManager.Task::(resourceAcquired) Task=`80813ceb-dfc8-40a7-b095-215319923ada`::_resourcesAcquired: Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee (shared) >Thread-34::DEBUG::2014-07-10 08:59:50,447::task::990::TaskManager.Task::(_decref) Task=`80813ceb-dfc8-40a7-b095-215319923ada`::ref 1 aborting False >Thread-34::INFO::2014-07-10 08:59:50,448::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1084210806784', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532069482496', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 08:59:50,448::task::1185::TaskManager.Task::(prepare) Task=`80813ceb-dfc8-40a7-b095-215319923ada`::finished: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1084210806784', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532069482496', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 08:59:50,448::task::595::TaskManager.Task::(_updateState) Task=`80813ceb-dfc8-40a7-b095-215319923ada`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-10 08:59:50,448::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee': < ResourceRef 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-10 08:59:50,449::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-10 08:59:50,449::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' >Thread-34::DEBUG::2014-07-10 08:59:50,449::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' (0 active users) >Thread-34::DEBUG::2014-07-10 08:59:50,449::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-10 08:59:50,449::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', Clearing records. >Thread-34::DEBUG::2014-07-10 08:59:50,450::task::990::TaskManager.Task::(_decref) Task=`80813ceb-dfc8-40a7-b095-215319923ada`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 08:59:52,214::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 08:59:52,294::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0290036 s, 35.3 MB/s\n'; <rc> = 0 >Thread-40::DEBUG::2014-07-10 08:59:53,587::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lion.qa.lab.tlv.redhat.com:_export_yuri2_backup2/6a70504d-00df-4869-8695-0f442053f6b6/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-40::DEBUG::2014-07-10 08:59:53,600::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n369 bytes (369 B) copied, 0.000485436 s, 760 kB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 08:59:54,310::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 08:59:54,396::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0344133 s, 29.8 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-10 08:59:55,032::domainMonitor::192::Storage.DomainMonitorThread::(_monitorDomain) Refreshing domain 9e1aa540-1f4e-4ee3-a152-be381ef6c3bd >Thread-18::DEBUG::2014-07-10 08:59:55,033::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with LvMetadataRW backend >Thread-18::DEBUG::2014-07-10 08:59:55,033::blockSD::336::Storage.Misc.excCmd::(readlines) '/bin/dd iflag=direct skip=0 bs=2048 if=/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/metadata count=1' (cwd None) >Thread-18::DEBUG::2014-07-10 08:59:55,046::blockSD::336::Storage.Misc.excCmd::(readlines) SUCCESS: <err> = '1+0 records in\n1+0 records out\n2048 bytes (2.0 kB) copied, 0.000593748 s, 3.4 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-10 08:59:55,047::misc::282::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '2048 bytes (2.0 kB) copied, 0.000593748 s, 3.4 MB/s'], size: 2048 >Thread-18::DEBUG::2014-07-10 08:59:55,047::persistentDict::234::Storage.PersistentDict::(refresh) read lines (LvMetadataRW)=[] >Thread-18::WARNING::2014-07-10 08:59:55,047::persistentDict::256::Storage.PersistentDict::(refresh) data has no embedded checksum - trust it as it is >Thread-18::DEBUG::2014-07-10 08:59:55,047::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with VGTagMetadataRW backend >Thread-18::DEBUG::2014-07-10 08:59:55,048::lvm::503::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-18::DEBUG::2014-07-10 08:59:55,048::lvm::505::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-18::DEBUG::2014-07-10 08:59:55,048::lvm::513::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-18::DEBUG::2014-07-10 08:59:55,049::lvm::525::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-18::DEBUG::2014-07-10 08:59:55,049::lvm::373::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-18::DEBUG::2014-07-10 08:59:55,050::lvm::296::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/3600601601282300032826addbbdae311|/dev/mapper/360060160f4a030003840ec867ddee311|/dev/mapper/367cad74c2fcba00019e6afd20c781e67|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name 9e1aa540-1f4e-4ee3-a152-be381ef6c3bd' (cwd None) >Thread-18::DEBUG::2014-07-10 08:59:55,322::lvm::296::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-18::DEBUG::2014-07-10 08:59:55,324::lvm::415::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-18::DEBUG::2014-07-10 08:59:55,324::persistentDict::234::Storage.PersistentDict::(refresh) read lines (VGTagMetadataRW)=['LEASETIMESEC=60', 'VGUUID=9CsMxb-YbRc-yRG7-cQKD-xY3G-GLi5-YxUyPC', 'VERSION=3', 'TYPE=ISCSI', 'LOGBLKSIZE=512', u'PV0=pv:3600601601282300032826addbbdae311,uuid:7qEb8v-jk2X-3CPk-k4XB-eIBk-onYD-807hcV,pestart:0,pecount:8189,mapoffset:0', 'LEASERETRIES=3', 'IOOPTIMEOUTSEC=10', 'LOCKRENEWALINTERVALSEC=5', 'PHYBLKSIZE=512', 'SDUUID=9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'CLASS=Data', 'LOCKPOLICY=', 'DESCRIPTION=SD_REAL', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=DC_REAL', 'ROLE=Master', 'POOL_UUID=4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', 'POOL_SPM_ID=1', 'POOL_SPM_LVER=0', '_SHA_CKSUM=013b5a7910962201c4cceab31b9c6d9c79f7316f', u'POOL_DOMAINS=9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active'] >Thread-18::INFO::2014-07-10 08:59:55,326::sd::384::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 9e1aa540-1f4e-4ee3-a152-be381ef6c3bd_imageNS already registered >Thread-18::INFO::2014-07-10 08:59:55,326::sd::392::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 9e1aa540-1f4e-4ee3-a152-be381ef6c3bd_volumeNS already registered >Thread-18::INFO::2014-07-10 08:59:55,327::blockSD::452::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 9e1aa540-1f4e-4ee3-a152-be381ef6c3bd_lvmActivationNS already registered >Thread-18::DEBUG::2014-07-10 08:59:55,327::lvm::296::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgck --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/3600601601282300032826addbbdae311|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } " 9e1aa540-1f4e-4ee3-a152-be381ef6c3bd' (cwd None) >Thread-18::DEBUG::2014-07-10 08:59:55,518::lvm::296::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-18::DEBUG::2014-07-10 08:59:55,519::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/metadata bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-10 08:59:55,532::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000630607 s, 6.5 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 08:59:56,411::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 08:59:56,644::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.182131 s, 5.6 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 08:59:58,228::task::595::TaskManager.Task::(_updateState) Task=`f699fe6d-0d2a-4580-94e8-83b2622940b5`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 08:59:58,228::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::INFO::2014-07-10 08:59:58,229::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000630607', 'lastCheck': '2.7', 'valid': True}, '6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000485436', 'lastCheck': '4.6', 'valid': True}} >Thread-14::DEBUG::2014-07-10 08:59:58,229::task::1185::TaskManager.Task::(prepare) Task=`f699fe6d-0d2a-4580-94e8-83b2622940b5`::finished: {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000630607', 'lastCheck': '2.7', 'valid': True}, '6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000485436', 'lastCheck': '4.6', 'valid': True}} >Thread-14::DEBUG::2014-07-10 08:59:58,229::task::595::TaskManager.Task::(_updateState) Task=`f699fe6d-0d2a-4580-94e8-83b2622940b5`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 08:59:58,229::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 08:59:58,230::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 08:59:58,230::task::990::TaskManager.Task::(_decref) Task=`f699fe6d-0d2a-4580-94e8-83b2622940b5`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 08:59:58,659::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 08:59:58,766::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0547426 s, 18.7 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 09:00:00,480::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-14::DEBUG::2014-07-10 09:00:00,481::task::595::TaskManager.Task::(_updateState) Task=`c71af580-25ff-4bb6-a5f3-096c62b3dbe8`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 09:00:00,482::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-14::INFO::2014-07-10 09:00:00,482::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:00:00,482::task::1185::TaskManager.Task::(prepare) Task=`c71af580-25ff-4bb6-a5f3-096c62b3dbe8`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:00:00,483::task::595::TaskManager.Task::(_updateState) Task=`c71af580-25ff-4bb6-a5f3-096c62b3dbe8`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 09:00:00,483::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 09:00:00,483::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 09:00:00,483::task::990::TaskManager.Task::(_decref) Task=`c71af580-25ff-4bb6-a5f3-096c62b3dbe8`::ref 0 aborting False >Thread-34::DEBUG::2014-07-10 09:00:00,487::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-34::DEBUG::2014-07-10 09:00:00,487::task::595::TaskManager.Task::(_updateState) Task=`7376d3b7-12b5-47fa-956b-332d03476a1f`::moving from state init -> state preparing >Thread-34::INFO::2014-07-10 09:00:00,488::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-34::DEBUG::2014-07-10 09:00:00,488::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`75a2c8a7-847a-4eec-9983-2e89b85d194d`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-10 09:00:00,488::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' for lock type 'shared' >Thread-34::DEBUG::2014-07-10 09:00:00,489::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-10 09:00:00,489::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`75a2c8a7-847a-4eec-9983-2e89b85d194d`::Granted request >Thread-34::DEBUG::2014-07-10 09:00:00,493::task::827::TaskManager.Task::(resourceAcquired) Task=`7376d3b7-12b5-47fa-956b-332d03476a1f`::_resourcesAcquired: Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee (shared) >Thread-34::DEBUG::2014-07-10 09:00:00,493::task::990::TaskManager.Task::(_decref) Task=`7376d3b7-12b5-47fa-956b-332d03476a1f`::ref 1 aborting False >Thread-34::INFO::2014-07-10 09:00:00,495::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1084210806784', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532069482496', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:00:00,495::task::1185::TaskManager.Task::(prepare) Task=`7376d3b7-12b5-47fa-956b-332d03476a1f`::finished: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1084210806784', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532069482496', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:00:00,495::task::595::TaskManager.Task::(_updateState) Task=`7376d3b7-12b5-47fa-956b-332d03476a1f`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-10 09:00:00,495::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee': < ResourceRef 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-10 09:00:00,495::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-10 09:00:00,496::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' >Thread-34::DEBUG::2014-07-10 09:00:00,496::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' (0 active users) >Thread-34::DEBUG::2014-07-10 09:00:00,496::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-10 09:00:00,496::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', Clearing records. >Thread-34::DEBUG::2014-07-10 09:00:00,497::task::990::TaskManager.Task::(_decref) Task=`7376d3b7-12b5-47fa-956b-332d03476a1f`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 09:00:00,781::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:00:00,888::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0554909 s, 18.5 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:00:02,903::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:00:03,015::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.053759 s, 19.0 MB/s\n'; <rc> = 0 >Thread-40::DEBUG::2014-07-10 09:00:03,632::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lion.qa.lab.tlv.redhat.com:_export_yuri2_backup2/6a70504d-00df-4869-8695-0f442053f6b6/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-40::DEBUG::2014-07-10 09:00:03,646::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n369 bytes (369 B) copied, 0.000451541 s, 817 kB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:00:05,031::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:00:05,130::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0486997 s, 21.0 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-10 09:00:05,560::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/metadata bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-10 09:00:05,585::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.0123549 s, 332 kB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:00:07,146::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:00:07,240::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0428378 s, 23.9 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:00:09,255::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:00:09,349::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0453775 s, 22.6 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 09:00:10,528::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-14::DEBUG::2014-07-10 09:00:10,529::task::595::TaskManager.Task::(_updateState) Task=`76640e4d-ce2c-48b0-8e80-99d4e4467dfd`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 09:00:10,529::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-14::INFO::2014-07-10 09:00:10,530::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:00:10,530::task::1185::TaskManager.Task::(prepare) Task=`76640e4d-ce2c-48b0-8e80-99d4e4467dfd`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:00:10,530::task::595::TaskManager.Task::(_updateState) Task=`76640e4d-ce2c-48b0-8e80-99d4e4467dfd`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 09:00:10,530::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 09:00:10,530::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 09:00:10,531::task::990::TaskManager.Task::(_decref) Task=`76640e4d-ce2c-48b0-8e80-99d4e4467dfd`::ref 0 aborting False >Thread-34::DEBUG::2014-07-10 09:00:10,534::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-34::DEBUG::2014-07-10 09:00:10,535::task::595::TaskManager.Task::(_updateState) Task=`1b8656d8-6c36-4f7e-9f8c-fc508ab57ac4`::moving from state init -> state preparing >Thread-34::INFO::2014-07-10 09:00:10,535::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-34::DEBUG::2014-07-10 09:00:10,536::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`fa9cfc4d-f72c-4f5a-9a1c-e618b7386fd9`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-10 09:00:10,536::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' for lock type 'shared' >Thread-34::DEBUG::2014-07-10 09:00:10,536::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-10 09:00:10,537::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`fa9cfc4d-f72c-4f5a-9a1c-e618b7386fd9`::Granted request >Thread-34::DEBUG::2014-07-10 09:00:10,537::task::827::TaskManager.Task::(resourceAcquired) Task=`1b8656d8-6c36-4f7e-9f8c-fc508ab57ac4`::_resourcesAcquired: Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee (shared) >Thread-34::DEBUG::2014-07-10 09:00:10,537::task::990::TaskManager.Task::(_decref) Task=`1b8656d8-6c36-4f7e-9f8c-fc508ab57ac4`::ref 1 aborting False >Thread-34::INFO::2014-07-10 09:00:10,538::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1084210806784', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532069482496', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:00:10,539::task::1185::TaskManager.Task::(prepare) Task=`1b8656d8-6c36-4f7e-9f8c-fc508ab57ac4`::finished: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1084210806784', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532069482496', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:00:10,539::task::595::TaskManager.Task::(_updateState) Task=`1b8656d8-6c36-4f7e-9f8c-fc508ab57ac4`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-10 09:00:10,539::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee': < ResourceRef 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-10 09:00:10,539::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-10 09:00:10,540::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' >Thread-34::DEBUG::2014-07-10 09:00:10,540::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' (0 active users) >Thread-34::DEBUG::2014-07-10 09:00:10,540::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-10 09:00:10,540::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', Clearing records. >Thread-34::DEBUG::2014-07-10 09:00:10,540::task::990::TaskManager.Task::(_decref) Task=`1b8656d8-6c36-4f7e-9f8c-fc508ab57ac4`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 09:00:11,364::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:00:11,456::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0419687 s, 24.4 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 09:00:13,374::task::595::TaskManager.Task::(_updateState) Task=`a10468c0-2973-4ef7-ada8-d333b8494352`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 09:00:13,374::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::INFO::2014-07-10 09:00:13,375::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0123549', 'lastCheck': '7.8', 'valid': True}, '6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000451541', 'lastCheck': '9.7', 'valid': True}} >Thread-14::DEBUG::2014-07-10 09:00:13,375::task::1185::TaskManager.Task::(prepare) Task=`a10468c0-2973-4ef7-ada8-d333b8494352`::finished: {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0123549', 'lastCheck': '7.8', 'valid': True}, '6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000451541', 'lastCheck': '9.7', 'valid': True}} >Thread-14::DEBUG::2014-07-10 09:00:13,375::task::595::TaskManager.Task::(_updateState) Task=`a10468c0-2973-4ef7-ada8-d333b8494352`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 09:00:13,375::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 09:00:13,375::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 09:00:13,376::task::990::TaskManager.Task::(_decref) Task=`a10468c0-2973-4ef7-ada8-d333b8494352`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 09:00:13,471::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Thread-40::DEBUG::2014-07-10 09:00:13,672::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lion.qa.lab.tlv.redhat.com:_export_yuri2_backup2/6a70504d-00df-4869-8695-0f442053f6b6/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-40::DEBUG::2014-07-10 09:00:13,686::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n369 bytes (369 B) copied, 0.000539603 s, 684 kB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:00:13,787::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.266891 s, 3.8 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-10 09:00:15,614::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/metadata bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-10 09:00:15,627::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000599333 s, 6.8 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:00:15,802::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:00:15,997::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0946997 s, 10.8 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:00:18,014::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:00:18,111::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0474432 s, 21.6 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:00:20,126::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:00:20,231::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0545991 s, 18.8 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 09:00:20,579::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-14::DEBUG::2014-07-10 09:00:20,580::task::595::TaskManager.Task::(_updateState) Task=`11b52f28-278e-4d82-8723-53b115270844`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 09:00:20,580::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-14::INFO::2014-07-10 09:00:20,581::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:00:20,581::task::1185::TaskManager.Task::(prepare) Task=`11b52f28-278e-4d82-8723-53b115270844`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:00:20,581::task::595::TaskManager.Task::(_updateState) Task=`11b52f28-278e-4d82-8723-53b115270844`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 09:00:20,582::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 09:00:20,582::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 09:00:20,582::task::990::TaskManager.Task::(_decref) Task=`11b52f28-278e-4d82-8723-53b115270844`::ref 0 aborting False >Thread-34::DEBUG::2014-07-10 09:00:20,586::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-34::DEBUG::2014-07-10 09:00:20,587::task::595::TaskManager.Task::(_updateState) Task=`c4744e0a-df1d-4def-afbf-d21ff5250daa`::moving from state init -> state preparing >Thread-34::INFO::2014-07-10 09:00:20,587::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-34::DEBUG::2014-07-10 09:00:20,588::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`c2d212eb-498b-4a49-bbc4-f82746dfe3e3`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-10 09:00:20,588::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' for lock type 'shared' >Thread-34::DEBUG::2014-07-10 09:00:20,588::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-10 09:00:20,588::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`c2d212eb-498b-4a49-bbc4-f82746dfe3e3`::Granted request >Thread-34::DEBUG::2014-07-10 09:00:20,591::task::827::TaskManager.Task::(resourceAcquired) Task=`c4744e0a-df1d-4def-afbf-d21ff5250daa`::_resourcesAcquired: Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee (shared) >Thread-34::DEBUG::2014-07-10 09:00:20,591::task::990::TaskManager.Task::(_decref) Task=`c4744e0a-df1d-4def-afbf-d21ff5250daa`::ref 1 aborting False >Thread-34::INFO::2014-07-10 09:00:20,592::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1084210806784', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532069482496', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:00:20,593::task::1185::TaskManager.Task::(prepare) Task=`c4744e0a-df1d-4def-afbf-d21ff5250daa`::finished: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1084210806784', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532069482496', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:00:20,593::task::595::TaskManager.Task::(_updateState) Task=`c4744e0a-df1d-4def-afbf-d21ff5250daa`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-10 09:00:20,593::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee': < ResourceRef 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-10 09:00:20,593::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-10 09:00:20,593::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' >Thread-34::DEBUG::2014-07-10 09:00:20,594::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' (0 active users) >Thread-34::DEBUG::2014-07-10 09:00:20,594::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-10 09:00:20,594::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', Clearing records. >Thread-34::DEBUG::2014-07-10 09:00:20,594::task::990::TaskManager.Task::(_decref) Task=`c4744e0a-df1d-4def-afbf-d21ff5250daa`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 09:00:22,246::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:00:22,333::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0348841 s, 29.4 MB/s\n'; <rc> = 0 >Thread-40::DEBUG::2014-07-10 09:00:23,711::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lion.qa.lab.tlv.redhat.com:_export_yuri2_backup2/6a70504d-00df-4869-8695-0f442053f6b6/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-40::DEBUG::2014-07-10 09:00:23,724::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n369 bytes (369 B) copied, 0.000487464 s, 757 kB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:00:24,348::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:00:24,435::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0345879 s, 29.6 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-10 09:00:25,655::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/metadata bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-10 09:00:25,669::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000596318 s, 6.9 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:00:26,451::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:00:26,548::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0467245 s, 21.9 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 09:00:28,510::task::595::TaskManager.Task::(_updateState) Task=`3cbd4385-e155-44b1-ba16-def2e8855317`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 09:00:28,511::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::INFO::2014-07-10 09:00:28,511::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000596318', 'lastCheck': '2.8', 'valid': True}, '6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000487464', 'lastCheck': '4.8', 'valid': True}} >Thread-14::DEBUG::2014-07-10 09:00:28,511::task::1185::TaskManager.Task::(prepare) Task=`3cbd4385-e155-44b1-ba16-def2e8855317`::finished: {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000596318', 'lastCheck': '2.8', 'valid': True}, '6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000487464', 'lastCheck': '4.8', 'valid': True}} >Thread-14::DEBUG::2014-07-10 09:00:28,512::task::595::TaskManager.Task::(_updateState) Task=`3cbd4385-e155-44b1-ba16-def2e8855317`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 09:00:28,512::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 09:00:28,512::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 09:00:28,512::task::990::TaskManager.Task::(_decref) Task=`3cbd4385-e155-44b1-ba16-def2e8855317`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 09:00:28,563::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:00:28,643::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0289942 s, 35.3 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 09:00:30,628::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-14::DEBUG::2014-07-10 09:00:30,629::task::595::TaskManager.Task::(_updateState) Task=`c4e82ac5-54c6-47c4-919f-ed67d513d792`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 09:00:30,629::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-14::INFO::2014-07-10 09:00:30,629::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:00:30,630::task::1185::TaskManager.Task::(prepare) Task=`c4e82ac5-54c6-47c4-919f-ed67d513d792`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:00:30,630::task::595::TaskManager.Task::(_updateState) Task=`c4e82ac5-54c6-47c4-919f-ed67d513d792`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 09:00:30,630::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 09:00:30,630::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 09:00:30,630::task::990::TaskManager.Task::(_decref) Task=`c4e82ac5-54c6-47c4-919f-ed67d513d792`::ref 0 aborting False >Thread-34::DEBUG::2014-07-10 09:00:30,634::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-34::DEBUG::2014-07-10 09:00:30,635::task::595::TaskManager.Task::(_updateState) Task=`680af483-2cfe-4058-8484-c7174d643ba2`::moving from state init -> state preparing >Thread-34::INFO::2014-07-10 09:00:30,635::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-34::DEBUG::2014-07-10 09:00:30,636::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`663a6237-d9b7-432a-989b-da49595b4635`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-10 09:00:30,636::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' for lock type 'shared' >Thread-34::DEBUG::2014-07-10 09:00:30,636::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-10 09:00:30,636::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`663a6237-d9b7-432a-989b-da49595b4635`::Granted request >Thread-34::DEBUG::2014-07-10 09:00:30,637::task::827::TaskManager.Task::(resourceAcquired) Task=`680af483-2cfe-4058-8484-c7174d643ba2`::_resourcesAcquired: Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee (shared) >Thread-34::DEBUG::2014-07-10 09:00:30,637::task::990::TaskManager.Task::(_decref) Task=`680af483-2cfe-4058-8484-c7174d643ba2`::ref 1 aborting False >Thread-34::INFO::2014-07-10 09:00:30,638::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1084210806784', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532069482496', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:00:30,638::task::1185::TaskManager.Task::(prepare) Task=`680af483-2cfe-4058-8484-c7174d643ba2`::finished: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1084210806784', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532069482496', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:00:30,638::task::595::TaskManager.Task::(_updateState) Task=`680af483-2cfe-4058-8484-c7174d643ba2`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-10 09:00:30,638::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee': < ResourceRef 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-10 09:00:30,639::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-10 09:00:30,639::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' >Thread-34::DEBUG::2014-07-10 09:00:30,639::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' (0 active users) >Thread-34::DEBUG::2014-07-10 09:00:30,639::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-10 09:00:30,639::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', Clearing records. >Thread-34::DEBUG::2014-07-10 09:00:30,640::task::990::TaskManager.Task::(_decref) Task=`680af483-2cfe-4058-8484-c7174d643ba2`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 09:00:30,658::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:00:30,738::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0291744 s, 35.1 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:00:32,753::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:00:32,834::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0291961 s, 35.1 MB/s\n'; <rc> = 0 >Thread-40::DEBUG::2014-07-10 09:00:33,754::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lion.qa.lab.tlv.redhat.com:_export_yuri2_backup2/6a70504d-00df-4869-8695-0f442053f6b6/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-40::DEBUG::2014-07-10 09:00:33,768::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n369 bytes (369 B) copied, 0.000501395 s, 736 kB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:00:34,850::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:00:34,936::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0347128 s, 29.5 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-10 09:00:35,698::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/metadata bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-10 09:00:35,711::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000670942 s, 6.1 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:00:36,952::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:00:37,045::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0372435 s, 27.5 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:00:39,060::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:00:39,139::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0292402 s, 35.0 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 09:00:40,667::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-14::DEBUG::2014-07-10 09:00:40,668::task::595::TaskManager.Task::(_updateState) Task=`8ca3d97d-7244-41e5-857d-acdd41cd68cb`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 09:00:40,669::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-14::INFO::2014-07-10 09:00:40,669::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:00:40,670::task::1185::TaskManager.Task::(prepare) Task=`8ca3d97d-7244-41e5-857d-acdd41cd68cb`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:00:40,670::task::595::TaskManager.Task::(_updateState) Task=`8ca3d97d-7244-41e5-857d-acdd41cd68cb`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 09:00:40,670::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 09:00:40,670::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 09:00:40,670::task::990::TaskManager.Task::(_decref) Task=`8ca3d97d-7244-41e5-857d-acdd41cd68cb`::ref 0 aborting False >Thread-34::DEBUG::2014-07-10 09:00:40,714::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-34::DEBUG::2014-07-10 09:00:40,714::task::595::TaskManager.Task::(_updateState) Task=`2eba47c6-b3a2-4da4-ba95-fdff31d413d7`::moving from state init -> state preparing >Thread-34::INFO::2014-07-10 09:00:40,715::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-34::DEBUG::2014-07-10 09:00:40,715::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`b24e2107-297e-4a64-8df9-e150f432d870`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-10 09:00:40,716::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' for lock type 'shared' >Thread-34::DEBUG::2014-07-10 09:00:40,716::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-10 09:00:40,716::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`b24e2107-297e-4a64-8df9-e150f432d870`::Granted request >Thread-34::DEBUG::2014-07-10 09:00:40,717::task::827::TaskManager.Task::(resourceAcquired) Task=`2eba47c6-b3a2-4da4-ba95-fdff31d413d7`::_resourcesAcquired: Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee (shared) >Thread-34::DEBUG::2014-07-10 09:00:40,717::task::990::TaskManager.Task::(_decref) Task=`2eba47c6-b3a2-4da4-ba95-fdff31d413d7`::ref 1 aborting False >Thread-34::INFO::2014-07-10 09:00:40,718::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1084210806784', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532069482496', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:00:40,718::task::1185::TaskManager.Task::(prepare) Task=`2eba47c6-b3a2-4da4-ba95-fdff31d413d7`::finished: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1084210806784', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532069482496', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:00:40,718::task::595::TaskManager.Task::(_updateState) Task=`2eba47c6-b3a2-4da4-ba95-fdff31d413d7`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-10 09:00:40,719::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee': < ResourceRef 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-10 09:00:40,719::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-10 09:00:40,719::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' >Thread-34::DEBUG::2014-07-10 09:00:40,719::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' (0 active users) >Thread-34::DEBUG::2014-07-10 09:00:40,720::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-10 09:00:40,720::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', Clearing records. >Thread-34::DEBUG::2014-07-10 09:00:40,720::task::990::TaskManager.Task::(_decref) Task=`2eba47c6-b3a2-4da4-ba95-fdff31d413d7`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 09:00:41,154::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:00:41,236::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0329258 s, 31.1 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:00:43,251::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:00:43,327::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0274402 s, 37.3 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 09:00:43,639::task::595::TaskManager.Task::(_updateState) Task=`0343e03f-a517-4173-8e5a-924e059126df`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 09:00:43,640::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::INFO::2014-07-10 09:00:43,640::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000670942', 'lastCheck': '7.9', 'valid': True}, '6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000501395', 'lastCheck': '9.9', 'valid': True}} >Thread-14::DEBUG::2014-07-10 09:00:43,640::task::1185::TaskManager.Task::(prepare) Task=`0343e03f-a517-4173-8e5a-924e059126df`::finished: {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000670942', 'lastCheck': '7.9', 'valid': True}, '6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000501395', 'lastCheck': '9.9', 'valid': True}} >Thread-14::DEBUG::2014-07-10 09:00:43,641::task::595::TaskManager.Task::(_updateState) Task=`0343e03f-a517-4173-8e5a-924e059126df`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 09:00:43,641::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 09:00:43,641::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 09:00:43,641::task::990::TaskManager.Task::(_decref) Task=`0343e03f-a517-4173-8e5a-924e059126df`::ref 0 aborting False >Thread-40::DEBUG::2014-07-10 09:00:43,798::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lion.qa.lab.tlv.redhat.com:_export_yuri2_backup2/6a70504d-00df-4869-8695-0f442053f6b6/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-40::DEBUG::2014-07-10 09:00:43,812::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n369 bytes (369 B) copied, 0.000456491 s, 808 kB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:00:45,343::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:00:45,418::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0252012 s, 40.6 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-10 09:00:45,739::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/metadata bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-10 09:00:45,753::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000740936 s, 5.5 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:00:47,434::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:00:47,522::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0373723 s, 27.4 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:00:49,536::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:00:49,613::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0276116 s, 37.1 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 09:00:50,750::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-14::DEBUG::2014-07-10 09:00:50,751::task::595::TaskManager.Task::(_updateState) Task=`6c00d8aa-06ed-4d85-9e75-098e08f9fdd4`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 09:00:50,751::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-14::INFO::2014-07-10 09:00:50,752::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:00:50,752::task::1185::TaskManager.Task::(prepare) Task=`6c00d8aa-06ed-4d85-9e75-098e08f9fdd4`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:00:50,752::task::595::TaskManager.Task::(_updateState) Task=`6c00d8aa-06ed-4d85-9e75-098e08f9fdd4`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 09:00:50,752::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 09:00:50,753::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 09:00:50,753::task::990::TaskManager.Task::(_decref) Task=`6c00d8aa-06ed-4d85-9e75-098e08f9fdd4`::ref 0 aborting False >Thread-34::DEBUG::2014-07-10 09:00:50,756::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-34::DEBUG::2014-07-10 09:00:50,757::task::595::TaskManager.Task::(_updateState) Task=`7e3509e7-f6e6-4f78-bf1a-875dccb495a2`::moving from state init -> state preparing >Thread-34::INFO::2014-07-10 09:00:50,757::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-34::DEBUG::2014-07-10 09:00:50,758::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`f6aed997-3cb7-4a26-90b4-3ee5184025a9`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-10 09:00:50,758::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' for lock type 'shared' >Thread-34::DEBUG::2014-07-10 09:00:50,758::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-10 09:00:50,758::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`f6aed997-3cb7-4a26-90b4-3ee5184025a9`::Granted request >Thread-34::DEBUG::2014-07-10 09:00:50,759::task::827::TaskManager.Task::(resourceAcquired) Task=`7e3509e7-f6e6-4f78-bf1a-875dccb495a2`::_resourcesAcquired: Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee (shared) >Thread-34::DEBUG::2014-07-10 09:00:50,759::task::990::TaskManager.Task::(_decref) Task=`7e3509e7-f6e6-4f78-bf1a-875dccb495a2`::ref 1 aborting False >Thread-34::INFO::2014-07-10 09:00:50,760::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1084210806784', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532069482496', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:00:50,760::task::1185::TaskManager.Task::(prepare) Task=`7e3509e7-f6e6-4f78-bf1a-875dccb495a2`::finished: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1084210806784', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532069482496', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:00:50,760::task::595::TaskManager.Task::(_updateState) Task=`7e3509e7-f6e6-4f78-bf1a-875dccb495a2`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-10 09:00:50,760::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee': < ResourceRef 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-10 09:00:50,761::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-10 09:00:50,761::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' >Thread-34::DEBUG::2014-07-10 09:00:50,761::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' (0 active users) >Thread-34::DEBUG::2014-07-10 09:00:50,761::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-10 09:00:50,761::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', Clearing records. >Thread-34::DEBUG::2014-07-10 09:00:50,762::task::990::TaskManager.Task::(_decref) Task=`7e3509e7-f6e6-4f78-bf1a-875dccb495a2`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 09:00:51,628::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:00:51,714::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0348912 s, 29.3 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:00:53,730::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:00:53,803::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0244742 s, 41.8 MB/s\n'; <rc> = 0 >Thread-40::DEBUG::2014-07-10 09:00:53,847::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lion.qa.lab.tlv.redhat.com:_export_yuri2_backup2/6a70504d-00df-4869-8695-0f442053f6b6/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-40::DEBUG::2014-07-10 09:00:53,861::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n369 bytes (369 B) copied, 0.000452503 s, 815 kB/s\n'; <rc> = 0 >Thread-34::DEBUG::2014-07-10 09:00:55,645::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [21a41ea9] >Thread-34::DEBUG::2014-07-10 09:00:55,646::task::595::TaskManager.Task::(_updateState) Task=`3941144a-1a6c-4bfa-b337-9ac68be74f9c`::moving from state init -> state preparing >Thread-34::INFO::2014-07-10 09:00:55,647::logUtils::44::dispatcher::(wrapper) Run and protect: createVolume(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='0cd7d6ce-f497-4243-a690-c57744861eea', size='10737418240', volFormat=4, preallocate=2, diskType=2, volUUID='10b6a7dd-dc6c-43fa-ba17-92e4331b0e0b', desc='', srcImgUUID='9cf413b7-7f14-4a61-8c71-913e5b0ea9c0', srcVolUUID='47592965-e853-4e59-9728-d11cca6a7a8a') >Thread-34::DEBUG::2014-07-10 09:00:55,648::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.9e1aa540-1f4e-4ee3-a152-be381ef6c3bd`ReqID=`bca4d4eb-7a4c-4646-8174-dd750d322571`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '1464' at 'createVolume' >Thread-34::DEBUG::2014-07-10 09:00:55,648::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.9e1aa540-1f4e-4ee3-a152-be381ef6c3bd' for lock type 'shared' >Thread-34::DEBUG::2014-07-10 09:00:55,648::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.9e1aa540-1f4e-4ee3-a152-be381ef6c3bd' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-10 09:00:55,648::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.9e1aa540-1f4e-4ee3-a152-be381ef6c3bd`ReqID=`bca4d4eb-7a4c-4646-8174-dd750d322571`::Granted request >Thread-34::DEBUG::2014-07-10 09:00:55,649::task::827::TaskManager.Task::(resourceAcquired) Task=`3941144a-1a6c-4bfa-b337-9ac68be74f9c`::_resourcesAcquired: Storage.9e1aa540-1f4e-4ee3-a152-be381ef6c3bd (shared) >Thread-34::DEBUG::2014-07-10 09:00:55,649::task::990::TaskManager.Task::(_decref) Task=`3941144a-1a6c-4bfa-b337-9ac68be74f9c`::ref 1 aborting False >Thread-34::DEBUG::2014-07-10 09:00:55,651::task::752::TaskManager.Task::(_save) Task=`3941144a-1a6c-4bfa-b337-9ac68be74f9c`::_save: orig /rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/master/tasks/3941144a-1a6c-4bfa-b337-9ac68be74f9c temp /rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/master/tasks/3941144a-1a6c-4bfa-b337-9ac68be74f9c.temp >Thread-34::DEBUG::2014-07-10 09:00:55,659::taskManager::68::TaskManager::(scheduleJob) scheduled job createVolume for task 3941144a-1a6c-4bfa-b337-9ac68be74f9c >Thread-34::INFO::2014-07-10 09:00:55,659::logUtils::47::dispatcher::(wrapper) Run and protect: createVolume, Return response: None >Thread-34::DEBUG::2014-07-10 09:00:55,659::task::1180::TaskManager.Task::(prepare) Task=`3941144a-1a6c-4bfa-b337-9ac68be74f9c`::Prepare: 1 jobs exist, move to acquiring >Thread-34::DEBUG::2014-07-10 09:00:55,659::task::595::TaskManager.Task::(_updateState) Task=`3941144a-1a6c-4bfa-b337-9ac68be74f9c`::moving from state preparing -> state acquiring >Thread-34::DEBUG::2014-07-10 09:00:55,660::task::752::TaskManager.Task::(_save) Task=`3941144a-1a6c-4bfa-b337-9ac68be74f9c`::_save: orig /rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/master/tasks/3941144a-1a6c-4bfa-b337-9ac68be74f9c temp /rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/master/tasks/3941144a-1a6c-4bfa-b337-9ac68be74f9c.temp >Thread-34::DEBUG::2014-07-10 09:00:55,667::task::595::TaskManager.Task::(_updateState) Task=`3941144a-1a6c-4bfa-b337-9ac68be74f9c`::moving from state acquiring -> state queued >Thread-34::DEBUG::2014-07-10 09:00:55,668::task::752::TaskManager.Task::(_save) Task=`3941144a-1a6c-4bfa-b337-9ac68be74f9c`::_save: orig /rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/master/tasks/3941144a-1a6c-4bfa-b337-9ac68be74f9c temp /rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/master/tasks/3941144a-1a6c-4bfa-b337-9ac68be74f9c.temp >Thread-34::DEBUG::2014-07-10 09:00:55,675::taskManager::50::TaskManager::(_queueTask) queuing task: 3941144a-1a6c-4bfa-b337-9ac68be74f9c >Thread-34::DEBUG::2014-07-10 09:00:55,675::taskManager::56::TaskManager::(_queueTask) task queued: 3941144a-1a6c-4bfa-b337-9ac68be74f9c >9a3a6f4f-bc9b-484a-8a3e-851d8fdafecf::DEBUG::2014-07-10 09:00:55,676::threadPool::57::Misc.ThreadPool::(setRunningTask) Number of running tasks: 1 >Thread-34::DEBUG::2014-07-10 09:00:55,677::task::1182::TaskManager.Task::(prepare) Task=`3941144a-1a6c-4bfa-b337-9ac68be74f9c`::returning >3941144a-1a6c-4bfa-b337-9ac68be74f9c::DEBUG::2014-07-10 09:00:55,679::threadPool::200::Misc.ThreadPool.WorkerThread::(_processNextTask) Task: 3941144a-1a6c-4bfa-b337-9ac68be74f9c running: <bound method Task.commit of <storage.task.Task instance at 0x7f620c065e60>> with: None >Thread-34::DEBUG::2014-07-10 09:00:55,680::task::990::TaskManager.Task::(_decref) Task=`3941144a-1a6c-4bfa-b337-9ac68be74f9c`::ref 0 aborting False >3941144a-1a6c-4bfa-b337-9ac68be74f9c::DEBUG::2014-07-10 09:00:55,681::task::1194::TaskManager.Task::(commit) Task=`3941144a-1a6c-4bfa-b337-9ac68be74f9c`::committing task: 3941144a-1a6c-4bfa-b337-9ac68be74f9c >3941144a-1a6c-4bfa-b337-9ac68be74f9c::DEBUG::2014-07-10 09:00:55,684::task::595::TaskManager.Task::(_updateState) Task=`3941144a-1a6c-4bfa-b337-9ac68be74f9c`::moving from state queued -> state running >3941144a-1a6c-4bfa-b337-9ac68be74f9c::DEBUG::2014-07-10 09:00:55,688::task::752::TaskManager.Task::(_save) Task=`3941144a-1a6c-4bfa-b337-9ac68be74f9c`::_save: orig /rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/master/tasks/3941144a-1a6c-4bfa-b337-9ac68be74f9c temp /rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/master/tasks/3941144a-1a6c-4bfa-b337-9ac68be74f9c.temp >3941144a-1a6c-4bfa-b337-9ac68be74f9c::DEBUG::2014-07-10 09:00:55,696::task::905::TaskManager.Task::(_runJobs) Task=`3941144a-1a6c-4bfa-b337-9ac68be74f9c`::Task.run: running job 0: createVolume: <bound method StoragePool.createVolume of <storage.sp.StoragePool object at 0x7f62180b9dd0>> (args: ('9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', '0cd7d6ce-f497-4243-a690-c57744861eea', 20971520, 4, 2, 2, '10b6a7dd-dc6c-43fa-ba17-92e4331b0e0b', '', '9cf413b7-7f14-4a61-8c71-913e5b0ea9c0', '47592965-e853-4e59-9728-d11cca6a7a8a') kwargs: {}) >3941144a-1a6c-4bfa-b337-9ac68be74f9c::DEBUG::2014-07-10 09:00:55,696::task::331::TaskManager.Task::(run) Task=`3941144a-1a6c-4bfa-b337-9ac68be74f9c`::Job.run: running createVolume: <bound method StoragePool.createVolume of <storage.sp.StoragePool object at 0x7f62180b9dd0>> (args: ('9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', '0cd7d6ce-f497-4243-a690-c57744861eea', 20971520, 4, 2, 2, '10b6a7dd-dc6c-43fa-ba17-92e4331b0e0b', '', '9cf413b7-7f14-4a61-8c71-913e5b0ea9c0', '47592965-e853-4e59-9728-d11cca6a7a8a') kwargs: {}) callback None >3941144a-1a6c-4bfa-b337-9ac68be74f9c::DEBUG::2014-07-10 09:00:55,697::lvm::427::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' got the operation mutex >3941144a-1a6c-4bfa-b337-9ac68be74f9c::DEBUG::2014-07-10 09:00:55,698::lvm::296::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm lvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/3600601601282300032826addbbdae311|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,vg_name,attr,size,seg_start_pe,devices,tags 9e1aa540-1f4e-4ee3-a152-be381ef6c3bd' (cwd None) >Thread-18::DEBUG::2014-07-10 09:00:55,781::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/metadata bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-10 09:00:55,795::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000590172 s, 6.9 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:00:55,823::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:00:55,907::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0348186 s, 29.4 MB/s\n'; <rc> = 0 >3941144a-1a6c-4bfa-b337-9ac68be74f9c::DEBUG::2014-07-10 09:00:55,979::lvm::296::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >3941144a-1a6c-4bfa-b337-9ac68be74f9c::DEBUG::2014-07-10 09:00:55,987::lvm::462::Storage.LVM::(_reloadlvs) lvs reloaded >3941144a-1a6c-4bfa-b337-9ac68be74f9c::DEBUG::2014-07-10 09:00:55,987::lvm::462::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' released the operation mutex >3941144a-1a6c-4bfa-b337-9ac68be74f9c::DEBUG::2014-07-10 09:00:55,988::blockVolume::572::Storage.Misc.excCmd::(getMetadata) '/bin/dd iflag=direct skip=4 bs=512 if=/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/metadata count=1' (cwd None) >3941144a-1a6c-4bfa-b337-9ac68be74f9c::DEBUG::2014-07-10 09:00:56,001::blockVolume::572::Storage.Misc.excCmd::(getMetadata) SUCCESS: <err> = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.000657195 s, 779 kB/s\n'; <rc> = 0 >3941144a-1a6c-4bfa-b337-9ac68be74f9c::DEBUG::2014-07-10 09:00:56,002::misc::282::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.000657195 s, 779 kB/s'], size: 512 >3941144a-1a6c-4bfa-b337-9ac68be74f9c::DEBUG::2014-07-10 09:00:56,003::resourceManager::198::ResourceManager.Request::(__init__) ResName=`9e1aa540-1f4e-4ee3-a152-be381ef6c3bd_imageNS.0cd7d6ce-f497-4243-a690-c57744861eea`ReqID=`cfb990be-5e27-4450-9335-2f2523dd39a0`::Request was made in '/usr/share/vdsm/storage/sp.py' line '1767' at 'createVolume' >3941144a-1a6c-4bfa-b337-9ac68be74f9c::DEBUG::2014-07-10 09:00:56,003::resourceManager::542::ResourceManager::(registerResource) Trying to register resource '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd_imageNS.0cd7d6ce-f497-4243-a690-c57744861eea' for lock type 'exclusive' >3941144a-1a6c-4bfa-b337-9ac68be74f9c::DEBUG::2014-07-10 09:00:56,004::lvm::427::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' got the operation mutex >3941144a-1a6c-4bfa-b337-9ac68be74f9c::DEBUG::2014-07-10 09:00:56,005::lvm::296::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm lvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/3600601601282300032826addbbdae311|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,vg_name,attr,size,seg_start_pe,devices,tags 9e1aa540-1f4e-4ee3-a152-be381ef6c3bd' (cwd None) >3941144a-1a6c-4bfa-b337-9ac68be74f9c::DEBUG::2014-07-10 09:00:56,212::lvm::296::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >3941144a-1a6c-4bfa-b337-9ac68be74f9c::DEBUG::2014-07-10 09:00:56,219::lvm::462::Storage.LVM::(_reloadlvs) lvs reloaded >3941144a-1a6c-4bfa-b337-9ac68be74f9c::DEBUG::2014-07-10 09:00:56,219::lvm::462::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' released the operation mutex >3941144a-1a6c-4bfa-b337-9ac68be74f9c::DEBUG::2014-07-10 09:00:56,220::resourceFactories::125::Storage.ResourcesFactories::(__getResourceCandidatesList) Image 0cd7d6ce-f497-4243-a690-c57744861eea does not exist in domain 9e1aa540-1f4e-4ee3-a152-be381ef6c3bd >3941144a-1a6c-4bfa-b337-9ac68be74f9c::DEBUG::2014-07-10 09:00:56,220::resourceManager::601::ResourceManager::(registerResource) Resource '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd_imageNS.0cd7d6ce-f497-4243-a690-c57744861eea' is free. Now locking as 'exclusive' (1 active user) >3941144a-1a6c-4bfa-b337-9ac68be74f9c::DEBUG::2014-07-10 09:00:56,220::resourceManager::238::ResourceManager.Request::(grant) ResName=`9e1aa540-1f4e-4ee3-a152-be381ef6c3bd_imageNS.0cd7d6ce-f497-4243-a690-c57744861eea`ReqID=`cfb990be-5e27-4450-9335-2f2523dd39a0`::Granted request >3941144a-1a6c-4bfa-b337-9ac68be74f9c::INFO::2014-07-10 09:00:56,221::image::123::Storage.Image::(create) Create placeholder /rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/images/0cd7d6ce-f497-4243-a690-c57744861eea for image's volumes >3941144a-1a6c-4bfa-b337-9ac68be74f9c::DEBUG::2014-07-10 09:00:56,222::task::752::TaskManager.Task::(_save) Task=`3941144a-1a6c-4bfa-b337-9ac68be74f9c`::_save: orig /rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/master/tasks/3941144a-1a6c-4bfa-b337-9ac68be74f9c temp /rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/master/tasks/3941144a-1a6c-4bfa-b337-9ac68be74f9c.temp >3941144a-1a6c-4bfa-b337-9ac68be74f9c::DEBUG::2014-07-10 09:00:56,231::blockVolume::572::Storage.Misc.excCmd::(getMetadata) '/bin/dd iflag=direct skip=4 bs=512 if=/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/metadata count=1' (cwd None) >3941144a-1a6c-4bfa-b337-9ac68be74f9c::DEBUG::2014-07-10 09:00:56,248::blockVolume::572::Storage.Misc.excCmd::(getMetadata) SUCCESS: <err> = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.00494343 s, 104 kB/s\n'; <rc> = 0 >3941144a-1a6c-4bfa-b337-9ac68be74f9c::DEBUG::2014-07-10 09:00:56,248::misc::282::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.00494343 s, 104 kB/s'], size: 512 >3941144a-1a6c-4bfa-b337-9ac68be74f9c::DEBUG::2014-07-10 09:00:56,249::volume::300::Storage.Volume::(share) Share volume 47592965-e853-4e59-9728-d11cca6a7a8a to /rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/images/0cd7d6ce-f497-4243-a690-c57744861eea >3941144a-1a6c-4bfa-b337-9ac68be74f9c::DEBUG::2014-07-10 09:00:56,249::blockVolume::572::Storage.Misc.excCmd::(getMetadata) '/bin/dd iflag=direct skip=4 bs=512 if=/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/metadata count=1' (cwd None) >3941144a-1a6c-4bfa-b337-9ac68be74f9c::DEBUG::2014-07-10 09:00:56,288::blockVolume::572::Storage.Misc.excCmd::(getMetadata) SUCCESS: <err> = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.0274982 s, 18.6 kB/s\n'; <rc> = 0 >3941144a-1a6c-4bfa-b337-9ac68be74f9c::DEBUG::2014-07-10 09:00:56,289::misc::282::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.0274982 s, 18.6 kB/s'], size: 512 >3941144a-1a6c-4bfa-b337-9ac68be74f9c::DEBUG::2014-07-10 09:00:56,290::task::752::TaskManager.Task::(_save) Task=`3941144a-1a6c-4bfa-b337-9ac68be74f9c`::_save: orig /rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/master/tasks/3941144a-1a6c-4bfa-b337-9ac68be74f9c temp /rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/master/tasks/3941144a-1a6c-4bfa-b337-9ac68be74f9c.temp >3941144a-1a6c-4bfa-b337-9ac68be74f9c::DEBUG::2014-07-10 09:00:56,301::blockVolume::353::Storage.Volume::(_share) Share volume 47592965-e853-4e59-9728-d11cca6a7a8a to /rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/images/0cd7d6ce-f497-4243-a690-c57744861eea >3941144a-1a6c-4bfa-b337-9ac68be74f9c::DEBUG::2014-07-10 09:00:56,309::blockVolume::572::Storage.Misc.excCmd::(getMetadata) '/bin/dd iflag=direct skip=4 bs=512 if=/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/metadata count=1' (cwd None) >3941144a-1a6c-4bfa-b337-9ac68be74f9c::DEBUG::2014-07-10 09:00:56,349::blockVolume::572::Storage.Misc.excCmd::(getMetadata) SUCCESS: <err> = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.00056101 s, 913 kB/s\n'; <rc> = 0 >3941144a-1a6c-4bfa-b337-9ac68be74f9c::DEBUG::2014-07-10 09:00:56,353::misc::282::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.00056101 s, 913 kB/s'], size: 512 >3941144a-1a6c-4bfa-b337-9ac68be74f9c::INFO::2014-07-10 09:00:56,354::volume::443::Storage.Volume::(create) Creating volume 10b6a7dd-dc6c-43fa-ba17-92e4331b0e0b >3941144a-1a6c-4bfa-b337-9ac68be74f9c::DEBUG::2014-07-10 09:00:56,357::task::752::TaskManager.Task::(_save) Task=`3941144a-1a6c-4bfa-b337-9ac68be74f9c`::_save: orig /rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/master/tasks/3941144a-1a6c-4bfa-b337-9ac68be74f9c temp /rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/master/tasks/3941144a-1a6c-4bfa-b337-9ac68be74f9c.temp >3941144a-1a6c-4bfa-b337-9ac68be74f9c::DEBUG::2014-07-10 09:00:56,369::task::752::TaskManager.Task::(_save) Task=`3941144a-1a6c-4bfa-b337-9ac68be74f9c`::_save: orig /rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/master/tasks/3941144a-1a6c-4bfa-b337-9ac68be74f9c temp /rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/master/tasks/3941144a-1a6c-4bfa-b337-9ac68be74f9c.temp >3941144a-1a6c-4bfa-b337-9ac68be74f9c::DEBUG::2014-07-10 09:00:56,396::lvm::296::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm lvcreate --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/3600601601282300032826addbbdae311|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } " --autobackup n --contiguous n --size 1024m --addtag OVIRT_VOL_INITIALIZING --name 10b6a7dd-dc6c-43fa-ba17-92e4331b0e0b 9e1aa540-1f4e-4ee3-a152-be381ef6c3bd' (cwd None) >3941144a-1a6c-4bfa-b337-9ac68be74f9c::DEBUG::2014-07-10 09:00:56,718::lvm::296::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ' WARNING: This metadata update is NOT backed up\n WARNING: This metadata update is NOT backed up\n'; <rc> = 0 >3941144a-1a6c-4bfa-b337-9ac68be74f9c::DEBUG::2014-07-10 09:00:56,719::lvm::503::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >3941144a-1a6c-4bfa-b337-9ac68be74f9c::DEBUG::2014-07-10 09:00:56,719::lvm::505::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >3941144a-1a6c-4bfa-b337-9ac68be74f9c::DEBUG::2014-07-10 09:00:56,719::lvm::513::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >3941144a-1a6c-4bfa-b337-9ac68be74f9c::DEBUG::2014-07-10 09:00:56,719::lvm::525::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >3941144a-1a6c-4bfa-b337-9ac68be74f9c::WARNING::2014-07-10 09:00:56,720::utils::129::root::(rmFile) File: /rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/images/0cd7d6ce-f497-4243-a690-c57744861eea/10b6a7dd-dc6c-43fa-ba17-92e4331b0e0b already removed >3941144a-1a6c-4bfa-b337-9ac68be74f9c::INFO::2014-07-10 09:00:56,723::blockVolume::169::Storage.Volume::(_create) Request to create snapshot 0cd7d6ce-f497-4243-a690-c57744861eea/10b6a7dd-dc6c-43fa-ba17-92e4331b0e0b of volume 9cf413b7-7f14-4a61-8c71-913e5b0ea9c0/47592965-e853-4e59-9728-d11cca6a7a8a >3941144a-1a6c-4bfa-b337-9ac68be74f9c::DEBUG::2014-07-10 09:00:56,724::task::752::TaskManager.Task::(_save) Task=`3941144a-1a6c-4bfa-b337-9ac68be74f9c`::_save: orig /rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/master/tasks/3941144a-1a6c-4bfa-b337-9ac68be74f9c temp /rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/master/tasks/3941144a-1a6c-4bfa-b337-9ac68be74f9c.temp >3941144a-1a6c-4bfa-b337-9ac68be74f9c::DEBUG::2014-07-10 09:00:56,735::blockVolume::572::Storage.Misc.excCmd::(getMetadata) '/bin/dd iflag=direct skip=4 bs=512 if=/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/metadata count=1' (cwd None) >3941144a-1a6c-4bfa-b337-9ac68be74f9c::DEBUG::2014-07-10 09:00:56,747::blockVolume::572::Storage.Misc.excCmd::(getMetadata) SUCCESS: <err> = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.000663757 s, 771 kB/s\n'; <rc> = 0 >3941144a-1a6c-4bfa-b337-9ac68be74f9c::DEBUG::2014-07-10 09:00:56,748::misc::282::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.000663757 s, 771 kB/s'], size: 512 >3941144a-1a6c-4bfa-b337-9ac68be74f9c::INFO::2014-07-10 09:00:56,749::volume::789::Storage.Volume::(prepare) Volume: preparing volume 9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/47592965-e853-4e59-9728-d11cca6a7a8a >3941144a-1a6c-4bfa-b337-9ac68be74f9c::DEBUG::2014-07-10 09:00:56,749::blockVolume::572::Storage.Misc.excCmd::(getMetadata) '/bin/dd iflag=direct skip=4 bs=512 if=/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/metadata count=1' (cwd None) >3941144a-1a6c-4bfa-b337-9ac68be74f9c::DEBUG::2014-07-10 09:00:56,770::blockVolume::572::Storage.Misc.excCmd::(getMetadata) SUCCESS: <err> = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.0101346 s, 50.5 kB/s\n'; <rc> = 0 >3941144a-1a6c-4bfa-b337-9ac68be74f9c::DEBUG::2014-07-10 09:00:56,771::misc::282::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.0101346 s, 50.5 kB/s'], size: 512 >3941144a-1a6c-4bfa-b337-9ac68be74f9c::DEBUG::2014-07-10 09:00:56,772::resourceManager::198::ResourceManager.Request::(__init__) ResName=`9e1aa540-1f4e-4ee3-a152-be381ef6c3bd_lvmActivationNS.47592965-e853-4e59-9728-d11cca6a7a8a`ReqID=`755a63db-ba43-4830-883e-c69c033bd5d4`::Request was made in '/usr/share/vdsm/storage/volume.py' line '806' at 'prepare' >3941144a-1a6c-4bfa-b337-9ac68be74f9c::DEBUG::2014-07-10 09:00:56,772::resourceManager::542::ResourceManager::(registerResource) Trying to register resource '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd_lvmActivationNS.47592965-e853-4e59-9728-d11cca6a7a8a' for lock type 'shared' >3941144a-1a6c-4bfa-b337-9ac68be74f9c::DEBUG::2014-07-10 09:00:56,773::lvm::296::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm lvchange --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/3600601601282300032826addbbdae311|/dev/mapper/360060160f4a030003840ec867ddee311|/dev/mapper/367cad74c2fcba00019e6afd20c781e67|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } " --autobackup n --available y 9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/47592965-e853-4e59-9728-d11cca6a7a8a' (cwd None) >3941144a-1a6c-4bfa-b337-9ac68be74f9c::DEBUG::2014-07-10 09:00:57,157::lvm::296::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >3941144a-1a6c-4bfa-b337-9ac68be74f9c::DEBUG::2014-07-10 09:00:57,157::lvm::513::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >3941144a-1a6c-4bfa-b337-9ac68be74f9c::DEBUG::2014-07-10 09:00:57,158::lvm::525::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >3941144a-1a6c-4bfa-b337-9ac68be74f9c::DEBUG::2014-07-10 09:00:57,158::resourceManager::601::ResourceManager::(registerResource) Resource '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd_lvmActivationNS.47592965-e853-4e59-9728-d11cca6a7a8a' is free. Now locking as 'shared' (1 active user) >3941144a-1a6c-4bfa-b337-9ac68be74f9c::DEBUG::2014-07-10 09:00:57,158::resourceManager::238::ResourceManager.Request::(grant) ResName=`9e1aa540-1f4e-4ee3-a152-be381ef6c3bd_lvmActivationNS.47592965-e853-4e59-9728-d11cca6a7a8a`ReqID=`755a63db-ba43-4830-883e-c69c033bd5d4`::Granted request >3941144a-1a6c-4bfa-b337-9ac68be74f9c::DEBUG::2014-07-10 09:00:57,159::lvm::427::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' got the operation mutex >3941144a-1a6c-4bfa-b337-9ac68be74f9c::DEBUG::2014-07-10 09:00:57,160::lvm::296::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm lvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/3600601601282300032826addbbdae311|/dev/mapper/360060160f4a030003840ec867ddee311|/dev/mapper/367cad74c2fcba00019e6afd20c781e67|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,vg_name,attr,size,seg_start_pe,devices,tags 9e1aa540-1f4e-4ee3-a152-be381ef6c3bd' (cwd None) >3941144a-1a6c-4bfa-b337-9ac68be74f9c::DEBUG::2014-07-10 09:00:57,360::lvm::296::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >3941144a-1a6c-4bfa-b337-9ac68be74f9c::DEBUG::2014-07-10 09:00:57,371::lvm::462::Storage.LVM::(_reloadlvs) lvs reloaded >3941144a-1a6c-4bfa-b337-9ac68be74f9c::DEBUG::2014-07-10 09:00:57,371::lvm::462::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' released the operation mutex >3941144a-1a6c-4bfa-b337-9ac68be74f9c::DEBUG::2014-07-10 09:00:57,372::blockVolume::572::Storage.Misc.excCmd::(getMetadata) '/bin/dd iflag=direct skip=4 bs=512 if=/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/metadata count=1' (cwd None) >3941144a-1a6c-4bfa-b337-9ac68be74f9c::DEBUG::2014-07-10 09:00:57,383::blockVolume::572::Storage.Misc.excCmd::(getMetadata) SUCCESS: <err> = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.000644555 s, 794 kB/s\n'; <rc> = 0 >3941144a-1a6c-4bfa-b337-9ac68be74f9c::DEBUG::2014-07-10 09:00:57,384::misc::282::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.000644555 s, 794 kB/s'], size: 512 >3941144a-1a6c-4bfa-b337-9ac68be74f9c::DEBUG::2014-07-10 09:00:57,384::volume::270::Storage.Volume::(clone) Volume.clone: /rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/images/0cd7d6ce-f497-4243-a690-c57744861eea/47592965-e853-4e59-9728-d11cca6a7a8a to /rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/images/0cd7d6ce-f497-4243-a690-c57744861eea/10b6a7dd-dc6c-43fa-ba17-92e4331b0e0b >3941144a-1a6c-4bfa-b337-9ac68be74f9c::DEBUG::2014-07-10 09:00:57,385::blockVolume::572::Storage.Misc.excCmd::(getMetadata) '/bin/dd iflag=direct skip=4 bs=512 if=/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/metadata count=1' (cwd None) >3941144a-1a6c-4bfa-b337-9ac68be74f9c::DEBUG::2014-07-10 09:00:57,424::blockVolume::572::Storage.Misc.excCmd::(getMetadata) SUCCESS: <err> = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.0280133 s, 18.3 kB/s\n'; <rc> = 0 >3941144a-1a6c-4bfa-b337-9ac68be74f9c::DEBUG::2014-07-10 09:00:57,424::misc::282::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.0280133 s, 18.3 kB/s'], size: 512 >3941144a-1a6c-4bfa-b337-9ac68be74f9c::DEBUG::2014-07-10 09:00:57,425::blockVolume::572::Storage.Misc.excCmd::(getMetadata) '/bin/dd iflag=direct skip=4 bs=512 if=/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/metadata count=1' (cwd None) >3941144a-1a6c-4bfa-b337-9ac68be74f9c::DEBUG::2014-07-10 09:00:57,463::blockVolume::572::Storage.Misc.excCmd::(getMetadata) SUCCESS: <err> = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.0291326 s, 17.6 kB/s\n'; <rc> = 0 >3941144a-1a6c-4bfa-b337-9ac68be74f9c::DEBUG::2014-07-10 09:00:57,464::misc::282::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.0291326 s, 17.6 kB/s'], size: 512 >3941144a-1a6c-4bfa-b337-9ac68be74f9c::DEBUG::2014-07-10 09:00:57,465::volume::1042::Storage.Misc.excCmd::(createVolume) '/usr/bin/qemu-img create -f qcow2 -F raw -b ../0cd7d6ce-f497-4243-a690-c57744861eea/47592965-e853-4e59-9728-d11cca6a7a8a /rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/images/0cd7d6ce-f497-4243-a690-c57744861eea/10b6a7dd-dc6c-43fa-ba17-92e4331b0e0b' (cwd /rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/images/0cd7d6ce-f497-4243-a690-c57744861eea) >3941144a-1a6c-4bfa-b337-9ac68be74f9c::DEBUG::2014-07-10 09:00:57,548::volume::1042::Storage.Misc.excCmd::(createVolume) SUCCESS: <err> = ''; <rc> = 0 >3941144a-1a6c-4bfa-b337-9ac68be74f9c::INFO::2014-07-10 09:00:57,548::blockVolume::393::Storage.Volume::(teardown) Tearing down volume 9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/47592965-e853-4e59-9728-d11cca6a7a8a justme False >3941144a-1a6c-4bfa-b337-9ac68be74f9c::DEBUG::2014-07-10 09:00:57,549::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd_lvmActivationNS.47592965-e853-4e59-9728-d11cca6a7a8a' >3941144a-1a6c-4bfa-b337-9ac68be74f9c::DEBUG::2014-07-10 09:00:57,549::resourceManager::635::ResourceManager::(releaseResource) Released resource '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd_lvmActivationNS.47592965-e853-4e59-9728-d11cca6a7a8a' (0 active users) >3941144a-1a6c-4bfa-b337-9ac68be74f9c::DEBUG::2014-07-10 09:00:57,549::resourceManager::641::ResourceManager::(releaseResource) Resource '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd_lvmActivationNS.47592965-e853-4e59-9728-d11cca6a7a8a' is free, finding out if anyone is waiting for it. >3941144a-1a6c-4bfa-b337-9ac68be74f9c::DEBUG::2014-07-10 09:00:57,550::lvm::296::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm lvchange --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/3600601601282300032826addbbdae311|/dev/mapper/360060160f4a030003840ec867ddee311|/dev/mapper/367cad74c2fcba00019e6afd20c781e67|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } " --autobackup n --available n 9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/47592965-e853-4e59-9728-d11cca6a7a8a' (cwd None) >3941144a-1a6c-4bfa-b337-9ac68be74f9c::DEBUG::2014-07-10 09:00:57,772::lvm::296::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >3941144a-1a6c-4bfa-b337-9ac68be74f9c::DEBUG::2014-07-10 09:00:57,773::lvm::513::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >3941144a-1a6c-4bfa-b337-9ac68be74f9c::DEBUG::2014-07-10 09:00:57,773::lvm::525::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >3941144a-1a6c-4bfa-b337-9ac68be74f9c::DEBUG::2014-07-10 09:00:57,774::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd_lvmActivationNS.47592965-e853-4e59-9728-d11cca6a7a8a', Clearing records. >3941144a-1a6c-4bfa-b337-9ac68be74f9c::DEBUG::2014-07-10 09:00:57,774::lvm::427::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' got the operation mutex >3941144a-1a6c-4bfa-b337-9ac68be74f9c::DEBUG::2014-07-10 09:00:57,775::lvm::296::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm lvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/3600601601282300032826addbbdae311|/dev/mapper/360060160f4a030003840ec867ddee311|/dev/mapper/367cad74c2fcba00019e6afd20c781e67|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,vg_name,attr,size,seg_start_pe,devices,tags 9e1aa540-1f4e-4ee3-a152-be381ef6c3bd' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:00:57,923::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >3941144a-1a6c-4bfa-b337-9ac68be74f9c::DEBUG::2014-07-10 09:00:57,974::lvm::296::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >3941144a-1a6c-4bfa-b337-9ac68be74f9c::DEBUG::2014-07-10 09:00:58,000::lvm::462::Storage.LVM::(_reloadlvs) lvs reloaded >3941144a-1a6c-4bfa-b337-9ac68be74f9c::DEBUG::2014-07-10 09:00:58,001::lvm::462::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' released the operation mutex >3941144a-1a6c-4bfa-b337-9ac68be74f9c::DEBUG::2014-07-10 09:00:58,003::lvm::427::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' got the operation mutex >3941144a-1a6c-4bfa-b337-9ac68be74f9c::DEBUG::2014-07-10 09:00:58,011::lvm::296::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm lvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/3600601601282300032826addbbdae311|/dev/mapper/360060160f4a030003840ec867ddee311|/dev/mapper/367cad74c2fcba00019e6afd20c781e67|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,vg_name,attr,size,seg_start_pe,devices,tags 9e1aa540-1f4e-4ee3-a152-be381ef6c3bd' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:00:58,064::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0347636 s, 29.5 MB/s\n'; <rc> = 0 >3941144a-1a6c-4bfa-b337-9ac68be74f9c::DEBUG::2014-07-10 09:00:58,210::lvm::296::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >3941144a-1a6c-4bfa-b337-9ac68be74f9c::DEBUG::2014-07-10 09:00:58,218::lvm::462::Storage.LVM::(_reloadlvs) lvs reloaded >3941144a-1a6c-4bfa-b337-9ac68be74f9c::DEBUG::2014-07-10 09:00:58,219::lvm::462::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' released the operation mutex >3941144a-1a6c-4bfa-b337-9ac68be74f9c::WARNING::2014-07-10 09:00:58,219::blockSD::761::Storage.StorageDomain::(_getOccupiedMetadataSlots) Could not find mapping for lv 9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/10b6a7dd-dc6c-43fa-ba17-92e4331b0e0b >3941144a-1a6c-4bfa-b337-9ac68be74f9c::DEBUG::2014-07-10 09:00:58,219::blockSD::784::Storage.StorageDomain::(getFreeMetadataSlot) Found freeSlot 5 in VG 9e1aa540-1f4e-4ee3-a152-be381ef6c3bd >3941144a-1a6c-4bfa-b337-9ac68be74f9c::DEBUG::2014-07-10 09:00:58,220::lvm::296::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm lvchange --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/3600601601282300032826addbbdae311|/dev/mapper/360060160f4a030003840ec867ddee311|/dev/mapper/367cad74c2fcba00019e6afd20c781e67|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } " --autobackup n --deltag OVIRT_VOL_INITIALIZING --addtag PU_47592965-e853-4e59-9728-d11cca6a7a8a --addtag MD_5 --addtag IU_0cd7d6ce-f497-4243-a690-c57744861eea 9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/10b6a7dd-dc6c-43fa-ba17-92e4331b0e0b' (cwd None) >3941144a-1a6c-4bfa-b337-9ac68be74f9c::DEBUG::2014-07-10 09:00:58,450::lvm::296::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ' WARNING: This metadata update is NOT backed up\n WARNING: This metadata update is NOT backed up\n'; <rc> = 0 >3941144a-1a6c-4bfa-b337-9ac68be74f9c::DEBUG::2014-07-10 09:00:58,451::lvm::513::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >3941144a-1a6c-4bfa-b337-9ac68be74f9c::DEBUG::2014-07-10 09:00:58,451::lvm::525::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >3941144a-1a6c-4bfa-b337-9ac68be74f9c::DEBUG::2014-07-10 09:00:58,452::lvm::296::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm lvchange --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/3600601601282300032826addbbdae311|/dev/mapper/360060160f4a030003840ec867ddee311|/dev/mapper/367cad74c2fcba00019e6afd20c781e67|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } " --autobackup n --available n 9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/10b6a7dd-dc6c-43fa-ba17-92e4331b0e0b' (cwd None) >3941144a-1a6c-4bfa-b337-9ac68be74f9c::DEBUG::2014-07-10 09:00:58,675::lvm::296::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >3941144a-1a6c-4bfa-b337-9ac68be74f9c::DEBUG::2014-07-10 09:00:58,676::lvm::513::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >3941144a-1a6c-4bfa-b337-9ac68be74f9c::DEBUG::2014-07-10 09:00:58,676::lvm::525::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >3941144a-1a6c-4bfa-b337-9ac68be74f9c::DEBUG::2014-07-10 09:00:58,678::task::752::TaskManager.Task::(_save) Task=`3941144a-1a6c-4bfa-b337-9ac68be74f9c`::_save: orig /rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/master/tasks/3941144a-1a6c-4bfa-b337-9ac68be74f9c temp /rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/master/tasks/3941144a-1a6c-4bfa-b337-9ac68be74f9c.temp >3941144a-1a6c-4bfa-b337-9ac68be74f9c::DEBUG::2014-07-10 09:00:58,690::blockVolume::604::Storage.Volume::(newVolumeLease) Initializing volume lease volUUID=10b6a7dd-dc6c-43fa-ba17-92e4331b0e0b sdUUID=9e1aa540-1f4e-4ee3-a152-be381ef6c3bd, metaId=('9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 5) >3941144a-1a6c-4bfa-b337-9ac68be74f9c::DEBUG::2014-07-10 09:00:58,698::task::752::TaskManager.Task::(_save) Task=`3941144a-1a6c-4bfa-b337-9ac68be74f9c`::_save: orig /rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/master/tasks/3941144a-1a6c-4bfa-b337-9ac68be74f9c temp /rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/master/tasks/3941144a-1a6c-4bfa-b337-9ac68be74f9c.temp >3941144a-1a6c-4bfa-b337-9ac68be74f9c::DEBUG::2014-07-10 09:00:58,707::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd_imageNS.0cd7d6ce-f497-4243-a690-c57744861eea' >3941144a-1a6c-4bfa-b337-9ac68be74f9c::DEBUG::2014-07-10 09:00:58,707::resourceManager::635::ResourceManager::(releaseResource) Released resource '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd_imageNS.0cd7d6ce-f497-4243-a690-c57744861eea' (0 active users) >3941144a-1a6c-4bfa-b337-9ac68be74f9c::DEBUG::2014-07-10 09:00:58,708::resourceManager::641::ResourceManager::(releaseResource) Resource '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd_imageNS.0cd7d6ce-f497-4243-a690-c57744861eea' is free, finding out if anyone is waiting for it. >3941144a-1a6c-4bfa-b337-9ac68be74f9c::DEBUG::2014-07-10 09:00:58,708::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd_imageNS.0cd7d6ce-f497-4243-a690-c57744861eea', Clearing records. >3941144a-1a6c-4bfa-b337-9ac68be74f9c::DEBUG::2014-07-10 09:00:58,708::task::595::TaskManager.Task::(_updateState) Task=`3941144a-1a6c-4bfa-b337-9ac68be74f9c`::moving from state running -> state finished >3941144a-1a6c-4bfa-b337-9ac68be74f9c::DEBUG::2014-07-10 09:00:58,709::task::752::TaskManager.Task::(_save) Task=`3941144a-1a6c-4bfa-b337-9ac68be74f9c`::_save: orig /rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/master/tasks/3941144a-1a6c-4bfa-b337-9ac68be74f9c temp /rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/master/tasks/3941144a-1a6c-4bfa-b337-9ac68be74f9c.temp >3941144a-1a6c-4bfa-b337-9ac68be74f9c::DEBUG::2014-07-10 09:00:58,717::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': < ResourceRef 'Storage.9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', isValid: 'True' obj: 'None'>} >3941144a-1a6c-4bfa-b337-9ac68be74f9c::DEBUG::2014-07-10 09:00:58,717::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >3941144a-1a6c-4bfa-b337-9ac68be74f9c::DEBUG::2014-07-10 09:00:58,718::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.9e1aa540-1f4e-4ee3-a152-be381ef6c3bd' >3941144a-1a6c-4bfa-b337-9ac68be74f9c::DEBUG::2014-07-10 09:00:58,718::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.9e1aa540-1f4e-4ee3-a152-be381ef6c3bd' (0 active users) >3941144a-1a6c-4bfa-b337-9ac68be74f9c::DEBUG::2014-07-10 09:00:58,718::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.9e1aa540-1f4e-4ee3-a152-be381ef6c3bd' is free, finding out if anyone is waiting for it. >3941144a-1a6c-4bfa-b337-9ac68be74f9c::DEBUG::2014-07-10 09:00:58,718::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', Clearing records. >3941144a-1a6c-4bfa-b337-9ac68be74f9c::DEBUG::2014-07-10 09:00:58,718::task::913::TaskManager.Task::(_runJobs) Task=`3941144a-1a6c-4bfa-b337-9ac68be74f9c`::Task.run: exit - success: result {'uuid': '10b6a7dd-dc6c-43fa-ba17-92e4331b0e0b'} >3941144a-1a6c-4bfa-b337-9ac68be74f9c::DEBUG::2014-07-10 09:00:58,719::task::990::TaskManager.Task::(_decref) Task=`3941144a-1a6c-4bfa-b337-9ac68be74f9c`::ref 0 aborting False >3941144a-1a6c-4bfa-b337-9ac68be74f9c::DEBUG::2014-07-10 09:00:58,719::threadPool::57::Misc.ThreadPool::(setRunningTask) Number of running tasks: 0 >Thread-14::DEBUG::2014-07-10 09:00:58,770::task::595::TaskManager.Task::(_updateState) Task=`5cee6766-4081-4fca-8ad3-286a7a7a8f5a`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 09:00:58,771::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::INFO::2014-07-10 09:00:58,771::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000590172', 'lastCheck': '2.9', 'valid': True}, '6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000452503', 'lastCheck': '4.9', 'valid': True}} >Thread-14::DEBUG::2014-07-10 09:00:58,772::task::1185::TaskManager.Task::(prepare) Task=`5cee6766-4081-4fca-8ad3-286a7a7a8f5a`::finished: {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000590172', 'lastCheck': '2.9', 'valid': True}, '6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000452503', 'lastCheck': '4.9', 'valid': True}} >Thread-14::DEBUG::2014-07-10 09:00:58,772::task::595::TaskManager.Task::(_updateState) Task=`5cee6766-4081-4fca-8ad3-286a7a7a8f5a`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 09:00:58,772::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 09:00:58,772::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 09:00:58,772::task::990::TaskManager.Task::(_decref) Task=`5cee6766-4081-4fca-8ad3-286a7a7a8f5a`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 09:01:00,079::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:01:00,159::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0286885 s, 35.7 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 09:01:00,811::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-14::DEBUG::2014-07-10 09:01:00,813::task::595::TaskManager.Task::(_updateState) Task=`d16619a8-5245-4af5-8d00-7707062916aa`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 09:01:00,813::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-14::INFO::2014-07-10 09:01:00,814::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:01:00,814::task::1185::TaskManager.Task::(prepare) Task=`d16619a8-5245-4af5-8d00-7707062916aa`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:01:00,814::task::595::TaskManager.Task::(_updateState) Task=`d16619a8-5245-4af5-8d00-7707062916aa`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 09:01:00,815::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 09:01:00,815::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 09:01:00,815::task::990::TaskManager.Task::(_decref) Task=`d16619a8-5245-4af5-8d00-7707062916aa`::ref 0 aborting False >Thread-34::DEBUG::2014-07-10 09:01:00,819::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-34::DEBUG::2014-07-10 09:01:00,820::task::595::TaskManager.Task::(_updateState) Task=`93bac1e2-b594-4c81-90ad-e11de0575eca`::moving from state init -> state preparing >Thread-34::INFO::2014-07-10 09:01:00,820::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-34::DEBUG::2014-07-10 09:01:00,821::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`b3f90714-3410-431b-ac3d-6e293af12aeb`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-10 09:01:00,821::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' for lock type 'shared' >Thread-34::DEBUG::2014-07-10 09:01:00,821::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-10 09:01:00,821::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`b3f90714-3410-431b-ac3d-6e293af12aeb`::Granted request >Thread-34::DEBUG::2014-07-10 09:01:00,822::task::827::TaskManager.Task::(resourceAcquired) Task=`93bac1e2-b594-4c81-90ad-e11de0575eca`::_resourcesAcquired: Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee (shared) >Thread-34::DEBUG::2014-07-10 09:01:00,822::task::990::TaskManager.Task::(_decref) Task=`93bac1e2-b594-4c81-90ad-e11de0575eca`::ref 1 aborting False >Thread-34::DEBUG::2014-07-10 09:01:00,823::lvm::373::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-34::DEBUG::2014-07-10 09:01:00,823::lvm::296::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/3600601601282300032826addbbdae311|/dev/mapper/360060160f4a030003840ec867ddee311|/dev/mapper/367cad74c2fcba00019e6afd20c781e67|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name 9e1aa540-1f4e-4ee3-a152-be381ef6c3bd' (cwd None) >Thread-34::DEBUG::2014-07-10 09:01:01,019::lvm::296::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-34::DEBUG::2014-07-10 09:01:01,021::lvm::415::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-34::INFO::2014-07-10 09:01:01,022::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1084210806784', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532069482496', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:01:01,022::task::1185::TaskManager.Task::(prepare) Task=`93bac1e2-b594-4c81-90ad-e11de0575eca`::finished: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1084210806784', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532069482496', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:01:01,023::task::595::TaskManager.Task::(_updateState) Task=`93bac1e2-b594-4c81-90ad-e11de0575eca`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-10 09:01:01,023::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee': < ResourceRef 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-10 09:01:01,023::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-10 09:01:01,024::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' >Thread-34::DEBUG::2014-07-10 09:01:01,024::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' (0 active users) >Thread-34::DEBUG::2014-07-10 09:01:01,024::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-10 09:01:01,024::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', Clearing records. >Thread-34::DEBUG::2014-07-10 09:01:01,025::task::990::TaskManager.Task::(_decref) Task=`93bac1e2-b594-4c81-90ad-e11de0575eca`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 09:01:02,174::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:01:02,261::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0349328 s, 29.3 MB/s\n'; <rc> = 0 >Thread-40::DEBUG::2014-07-10 09:01:03,889::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lion.qa.lab.tlv.redhat.com:_export_yuri2_backup2/6a70504d-00df-4869-8695-0f442053f6b6/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-40::DEBUG::2014-07-10 09:01:03,904::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n369 bytes (369 B) copied, 0.000461666 s, 799 kB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:01:04,276::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:01:04,363::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0345901 s, 29.6 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 09:01:05,130::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [72f5e52c] >Thread-14::DEBUG::2014-07-10 09:01:05,131::task::595::TaskManager.Task::(_updateState) Task=`82e11f94-b038-4ded-8860-7f5c7e87e682`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 09:01:05,131::logUtils::44::dispatcher::(wrapper) Run and protect: getAllTasksStatuses(spUUID=None, options=None) >Thread-14::DEBUG::2014-07-10 09:01:05,132::taskManager::102::TaskManager::(getAllTasksStatuses) Entry. >Thread-14::DEBUG::2014-07-10 09:01:05,132::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 3941144a-1a6c-4bfa-b337-9ac68be74f9c >Thread-14::DEBUG::2014-07-10 09:01:05,132::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': '1 jobs completed successfully', 'taskState': 'finished', 'taskResult': 'success', 'taskID': '3941144a-1a6c-4bfa-b337-9ac68be74f9c'} >Thread-14::DEBUG::2014-07-10 09:01:05,132::taskManager::113::TaskManager::(getAllTasksStatuses) Return: {'3941144a-1a6c-4bfa-b337-9ac68be74f9c': {'code': 0, 'message': '1 jobs completed successfully', 'taskState': 'finished', 'taskResult': 'success', 'taskID': '3941144a-1a6c-4bfa-b337-9ac68be74f9c'}} >Thread-14::INFO::2014-07-10 09:01:05,132::logUtils::47::dispatcher::(wrapper) Run and protect: getAllTasksStatuses, Return response: {'allTasksStatus': {'3941144a-1a6c-4bfa-b337-9ac68be74f9c': {'code': 0, 'message': '1 jobs completed successfully', 'taskState': 'finished', 'taskResult': 'success', 'taskID': '3941144a-1a6c-4bfa-b337-9ac68be74f9c'}}} >Thread-14::DEBUG::2014-07-10 09:01:05,133::task::1185::TaskManager.Task::(prepare) Task=`82e11f94-b038-4ded-8860-7f5c7e87e682`::finished: {'allTasksStatus': {'3941144a-1a6c-4bfa-b337-9ac68be74f9c': {'code': 0, 'message': '1 jobs completed successfully', 'taskState': 'finished', 'taskResult': 'success', 'taskID': '3941144a-1a6c-4bfa-b337-9ac68be74f9c'}}} >Thread-14::DEBUG::2014-07-10 09:01:05,133::task::595::TaskManager.Task::(_updateState) Task=`82e11f94-b038-4ded-8860-7f5c7e87e682`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 09:01:05,133::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 09:01:05,133::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 09:01:05,134::task::990::TaskManager.Task::(_decref) Task=`82e11f94-b038-4ded-8860-7f5c7e87e682`::ref 0 aborting False >Thread-34::DEBUG::2014-07-10 09:01:05,185::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [21a41ea9] >Thread-34::DEBUG::2014-07-10 09:01:05,185::task::595::TaskManager.Task::(_updateState) Task=`088289d5-a494-4846-9781-ff1bf74ab8c2`::moving from state init -> state preparing >Thread-34::INFO::2014-07-10 09:01:05,186::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeInfo(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='0cd7d6ce-f497-4243-a690-c57744861eea', volUUID='10b6a7dd-dc6c-43fa-ba17-92e4331b0e0b', options=None) >Thread-34::DEBUG::2014-07-10 09:01:05,186::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.9e1aa540-1f4e-4ee3-a152-be381ef6c3bd`ReqID=`471fce80-88c1-4ebf-8bb8-17f24fb2ec28`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '3089' at 'getVolumeInfo' >Thread-34::DEBUG::2014-07-10 09:01:05,186::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.9e1aa540-1f4e-4ee3-a152-be381ef6c3bd' for lock type 'shared' >Thread-34::DEBUG::2014-07-10 09:01:05,187::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.9e1aa540-1f4e-4ee3-a152-be381ef6c3bd' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-10 09:01:05,187::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.9e1aa540-1f4e-4ee3-a152-be381ef6c3bd`ReqID=`471fce80-88c1-4ebf-8bb8-17f24fb2ec28`::Granted request >Thread-34::DEBUG::2014-07-10 09:01:05,188::task::827::TaskManager.Task::(resourceAcquired) Task=`088289d5-a494-4846-9781-ff1bf74ab8c2`::_resourcesAcquired: Storage.9e1aa540-1f4e-4ee3-a152-be381ef6c3bd (shared) >Thread-34::DEBUG::2014-07-10 09:01:05,188::task::990::TaskManager.Task::(_decref) Task=`088289d5-a494-4846-9781-ff1bf74ab8c2`::ref 1 aborting False >Thread-34::DEBUG::2014-07-10 09:01:05,188::lvm::427::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' got the operation mutex >Thread-34::DEBUG::2014-07-10 09:01:05,189::lvm::296::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm lvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/3600601601282300032826addbbdae311|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,vg_name,attr,size,seg_start_pe,devices,tags 9e1aa540-1f4e-4ee3-a152-be381ef6c3bd' (cwd None) >Thread-34::DEBUG::2014-07-10 09:01:05,434::lvm::296::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-34::DEBUG::2014-07-10 09:01:05,442::lvm::462::Storage.LVM::(_reloadlvs) lvs reloaded >Thread-34::DEBUG::2014-07-10 09:01:05,443::lvm::462::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' released the operation mutex >Thread-34::INFO::2014-07-10 09:01:05,443::volume::879::Storage.Volume::(getInfo) Info request: sdUUID=9e1aa540-1f4e-4ee3-a152-be381ef6c3bd imgUUID=0cd7d6ce-f497-4243-a690-c57744861eea volUUID = 10b6a7dd-dc6c-43fa-ba17-92e4331b0e0b >Thread-34::DEBUG::2014-07-10 09:01:05,444::blockVolume::572::Storage.Misc.excCmd::(getMetadata) '/bin/dd iflag=direct skip=5 bs=512 if=/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/metadata count=1' (cwd None) >Thread-34::DEBUG::2014-07-10 09:01:05,458::blockVolume::572::Storage.Misc.excCmd::(getMetadata) SUCCESS: <err> = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.000558996 s, 916 kB/s\n'; <rc> = 0 >Thread-34::DEBUG::2014-07-10 09:01:05,459::misc::282::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.000558996 s, 916 kB/s'], size: 512 >Thread-34::DEBUG::2014-07-10 09:01:05,460::blockVolume::572::Storage.Misc.excCmd::(getMetadata) '/bin/dd iflag=direct skip=5 bs=512 if=/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/metadata count=1' (cwd None) >Thread-34::DEBUG::2014-07-10 09:01:05,515::blockVolume::572::Storage.Misc.excCmd::(getMetadata) SUCCESS: <err> = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.043979 s, 11.6 kB/s\n'; <rc> = 0 >Thread-34::DEBUG::2014-07-10 09:01:05,515::misc::282::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.043979 s, 11.6 kB/s'], size: 512 >Thread-34::INFO::2014-07-10 09:01:05,515::volume::909::Storage.Volume::(getInfo) 9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/0cd7d6ce-f497-4243-a690-c57744861eea/10b6a7dd-dc6c-43fa-ba17-92e4331b0e0b info is {'status': 'OK', 'domain': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'voltype': 'LEAF', 'description': '', 'parent': '47592965-e853-4e59-9728-d11cca6a7a8a', 'format': 'COW', 'image': '0cd7d6ce-f497-4243-a690-c57744861eea', 'ctime': '1404982858', 'disktype': '2', 'legality': 'LEGAL', 'mtime': '1404982858', 'apparentsize': '1073741824', 'children': [], 'pool': '', 'capacity': '10737418240', 'uuid': '10b6a7dd-dc6c-43fa-ba17-92e4331b0e0b', 'truesize': '1073741824', 'type': 'SPARSE'} >Thread-34::INFO::2014-07-10 09:01:05,516::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeInfo, Return response: {'info': {'status': 'OK', 'domain': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'voltype': 'LEAF', 'description': '', 'parent': '47592965-e853-4e59-9728-d11cca6a7a8a', 'format': 'COW', 'image': '0cd7d6ce-f497-4243-a690-c57744861eea', 'ctime': '1404982858', 'disktype': '2', 'legality': 'LEGAL', 'mtime': '1404982858', 'apparentsize': '1073741824', 'children': [], 'pool': '', 'capacity': '10737418240', 'uuid': '10b6a7dd-dc6c-43fa-ba17-92e4331b0e0b', 'truesize': '1073741824', 'type': 'SPARSE'}} >Thread-34::DEBUG::2014-07-10 09:01:05,516::task::1185::TaskManager.Task::(prepare) Task=`088289d5-a494-4846-9781-ff1bf74ab8c2`::finished: {'info': {'status': 'OK', 'domain': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'voltype': 'LEAF', 'description': '', 'parent': '47592965-e853-4e59-9728-d11cca6a7a8a', 'format': 'COW', 'image': '0cd7d6ce-f497-4243-a690-c57744861eea', 'ctime': '1404982858', 'disktype': '2', 'legality': 'LEGAL', 'mtime': '1404982858', 'apparentsize': '1073741824', 'children': [], 'pool': '', 'capacity': '10737418240', 'uuid': '10b6a7dd-dc6c-43fa-ba17-92e4331b0e0b', 'truesize': '1073741824', 'type': 'SPARSE'}} >Thread-34::DEBUG::2014-07-10 09:01:05,516::task::595::TaskManager.Task::(_updateState) Task=`088289d5-a494-4846-9781-ff1bf74ab8c2`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-10 09:01:05,516::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': < ResourceRef 'Storage.9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-10 09:01:05,517::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-10 09:01:05,517::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.9e1aa540-1f4e-4ee3-a152-be381ef6c3bd' >Thread-34::DEBUG::2014-07-10 09:01:05,518::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.9e1aa540-1f4e-4ee3-a152-be381ef6c3bd' (0 active users) >Thread-34::DEBUG::2014-07-10 09:01:05,518::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.9e1aa540-1f4e-4ee3-a152-be381ef6c3bd' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-10 09:01:05,518::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', Clearing records. >Thread-34::DEBUG::2014-07-10 09:01:05,518::task::990::TaskManager.Task::(_decref) Task=`088289d5-a494-4846-9781-ff1bf74ab8c2`::ref 0 aborting False >Thread-14::DEBUG::2014-07-10 09:01:05,616::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-14::DEBUG::2014-07-10 09:01:05,616::task::595::TaskManager.Task::(_updateState) Task=`df4432dc-bf0a-48c2-96f1-594b6f58110b`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 09:01:05,617::logUtils::44::dispatcher::(wrapper) Run and protect: clearTask(taskID='3941144a-1a6c-4bfa-b337-9ac68be74f9c', spUUID=None, options=None) >Thread-14::DEBUG::2014-07-10 09:01:05,617::taskManager::161::TaskManager::(clearTask) Entry. taskID: 3941144a-1a6c-4bfa-b337-9ac68be74f9c >Thread-14::DEBUG::2014-07-10 09:01:05,618::taskManager::166::TaskManager::(clearTask) Return. >Thread-14::INFO::2014-07-10 09:01:05,619::logUtils::47::dispatcher::(wrapper) Run and protect: clearTask, Return response: None >Thread-14::DEBUG::2014-07-10 09:01:05,619::task::1185::TaskManager.Task::(prepare) Task=`df4432dc-bf0a-48c2-96f1-594b6f58110b`::finished: None >Thread-14::DEBUG::2014-07-10 09:01:05,619::task::595::TaskManager.Task::(_updateState) Task=`df4432dc-bf0a-48c2-96f1-594b6f58110b`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 09:01:05,619::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 09:01:05,619::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 09:01:05,620::task::990::TaskManager.Task::(_decref) Task=`df4432dc-bf0a-48c2-96f1-594b6f58110b`::ref 0 aborting False >Thread-18::DEBUG::2014-07-10 09:01:05,822::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/metadata bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-10 09:01:05,834::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000673638 s, 6.1 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:01:06,378::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:01:06,516::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0341414 s, 30.0 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 09:01:06,797::BindingXMLRPC::1067::vds::(wrapper) client [10.35.3.13]::call vmCreate with ({'acpiEnable': 'true', 'emulatedMachine': 'rhel6.5.0', 'vmId': 'ed909f7e-0ee2-4f6f-b4a5-a165f689a276', 'memGuaranteedSize': 1024, 'spiceSslCipherSuite': 'DEFAULT', 'timeOffset': '0', 'cpuType': 'Conroe', 'custom': {'device_1d0dceb6-9bdc-479f-bfc3-2d3d0812021cdevice_1e0f274f-1905-4c87-8127-27496691ca69': 'VmDevice {vmId=ed909f7e-0ee2-4f6f-b4a5-a165f689a276, deviceId=1e0f274f-1905-4c87-8127-27496691ca69, device=unix, type=CHANNEL, bootOrder=0, specParams={}, address={port=2, bus=0, controller=0, type=virtio-serial}, managed=false, plugged=true, readOnly=false, deviceAlias=channel1, customProperties={}, snapshotId=null}', 'device_1d0dceb6-9bdc-479f-bfc3-2d3d0812021cdevice_1e0f274f-1905-4c87-8127-27496691ca69device_9f76b6fc-cb15-4e91-8e53-17ffd9d0d0e1device_c882c070-1434-4258-92dc-18958a83a434device_ca2f3ea0-190a-42d7-a099-2e4ab0f3a2a6': 'VmDevice {vmId=ed909f7e-0ee2-4f6f-b4a5-a165f689a276, deviceId=ca2f3ea0-190a-42d7-a099-2e4ab0f3a2a6, device=virtio-serial, type=CONTROLLER, bootOrder=0, specParams={}, address={bus=0x00, domain=0x0000, type=pci, slot=0x05, function=0x0}, managed=false, plugged=true, readOnly=false, deviceAlias=virtio-serial0, customProperties={}, snapshotId=null}', 'device_1d0dceb6-9bdc-479f-bfc3-2d3d0812021cdevice_1e0f274f-1905-4c87-8127-27496691ca69device_9f76b6fc-cb15-4e91-8e53-17ffd9d0d0e1': 'VmDevice {vmId=ed909f7e-0ee2-4f6f-b4a5-a165f689a276, deviceId=9f76b6fc-cb15-4e91-8e53-17ffd9d0d0e1, device=ide, type=CONTROLLER, bootOrder=0, specParams={}, address={bus=0x00, domain=0x0000, type=pci, slot=0x01, function=0x1}, managed=false, plugged=true, readOnly=false, deviceAlias=ide0, customProperties={}, snapshotId=null}', 'device_1d0dceb6-9bdc-479f-bfc3-2d3d0812021cdevice_1e0f274f-1905-4c87-8127-27496691ca69device_9f76b6fc-cb15-4e91-8e53-17ffd9d0d0e1device_c882c070-1434-4258-92dc-18958a83a434': 'VmDevice {vmId=ed909f7e-0ee2-4f6f-b4a5-a165f689a276, deviceId=c882c070-1434-4258-92dc-18958a83a434, device=unix, type=CHANNEL, bootOrder=0, specParams={}, address={port=1, bus=0, controller=0, type=virtio-serial}, managed=false, plugged=true, readOnly=false, deviceAlias=channel0, customProperties={}, snapshotId=null}', 'device_1d0dceb6-9bdc-479f-bfc3-2d3d0812021c': 'VmDevice {vmId=ed909f7e-0ee2-4f6f-b4a5-a165f689a276, deviceId=1d0dceb6-9bdc-479f-bfc3-2d3d0812021c, device=spicevmc, type=CHANNEL, bootOrder=0, specParams={}, address={port=3, bus=0, controller=0, type=virtio-serial}, managed=false, plugged=true, readOnly=false, deviceAlias=channel2, customProperties={}, snapshotId=null}'}, 'smp': '2', 'vmType': 'kvm', 'memSize': 1024, 'smpCoresPerSocket': '2', 'vmName': 'scale_1', 'nice': '0', 'smartcardEnable': 'false', 'keyboardLayout': 'en-us', 'kvmEnable': 'true', 'pitReinjection': 'false', 'transparentHugePages': 'true', 'devices': [{'index': '3', 'iface': 'ide', 'specParams': {'vmPayload': {'volId': 'config-2', 'file': {'openstack/latest/meta_data.json': 'ewogICJsYXVuY2hfaW5kZXgiIDogIjAiLAogICJhdmFpbGFiaWxpdHlfem9uZSIgOiAibm92YSIs\nCiAgInV1aWQiIDogIjBiMTAwMTRmLWY3YmEtNDgzMi1iNzQ4LTBhMGQ3NjQ4OWM5MSIsCiAgIm1l\ndGEiIDogewogICAgImVzc2VudGlhbCIgOiAiZmFsc2UiLAogICAgInJvbGUiIDogInNlcnZlciIs\nCiAgICAiZHNtb2RlIiA6ICJsb2NhbCIKICB9Cn0=\n', 'openstack/latest/user_data': 'I2Nsb3VkLWNvbmZpZwpzc2hfcHdhdXRoOiB0cnVlCmRpc2FibGVfcm9vdDogMApvdXRwdXQ6CiAg\nYWxsOiAnPj4gL3Zhci9sb2cvY2xvdWQtaW5pdC1vdXRwdXQubG9nJwp1c2VyOiByb290CmNocGFz\nc3dkOgogIGV4cGlyZTogZmFsc2UKcnVuY21kOgotICdzZWQgLWkgJycvXmRhdGFzb3VyY2VfbGlz\ndDogL2QnJyAvZXRjL2Nsb3VkL2Nsb3VkLmNmZzsgZWNobyAnJ2RhdGFzb3VyY2VfbGlzdDoKICBb\nIk5vQ2xvdWQiLCAiQ29uZmlnRHJpdmUiXScnID4+IC9ldGMvY2xvdWQvY2xvdWQuY2ZnJwo=\n'}}}, 'readonly': 'true', 'deviceId': 'd217e6c7-a8f9-4f35-a610-d28d41296bc9', 'path': '', 'device': 'cdrom', 'shared': 'false', 'type': 'disk'}, {'device': 'qxl', 'specParams': {'vram': '32768', 'ram': '65536', 'heads': '1'}, 'type': 'video', 'deviceId': 'a4b3e8df-e99d-4519-b368-cf124422a806'}, {'index': '2', 'iface': 'ide', 'specParams': {'path': ''}, 'readonly': 'true', 'deviceId': '2b231cd8-3fea-439d-a73d-67b0f3ed1f6b', 'path': '', 'device': 'cdrom', 'shared': 'false', 'type': 'disk'}, {'index': 0, 'iface': 'virtio', 'format': 'cow', 'bootOrder': '1', 'poolID': '4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', 'volumeID': '10b6a7dd-dc6c-43fa-ba17-92e4331b0e0b', 'imageID': '0cd7d6ce-f497-4243-a690-c57744861eea', 'specParams': {}, 'readonly': 'false', 'domainID': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'optional': 'false', 'deviceId': '0cd7d6ce-f497-4243-a690-c57744861eea', 'address': {'slot': '0x06', 'bus': '0x00', 'domain': '0x0000', 'type': 'pci', 'function': '0x0'}, 'device': 'disk', 'shared': 'false', 'propagateErrors': 'off', 'type': 'disk'}, {'nicModel': 'pv', 'macAddr': '00:1a:4a:de:6d:7a', 'linkActive': 'true', 'network': 'rhevm', 'filter': 'vdsm-no-mac-spoofing', 'specParams': {'inbound': {}, 'outbound': {}}, 'deviceId': 'b2b5755c-2939-4f5a-a882-6bae89dead18', 'device': 'bridge', 'type': 'interface'}, {'device': 'memballoon', 'specParams': {'model': 'virtio'}, 'type': 'balloon', 'deviceId': '44db05fa-80c1-40db-9215-b6b19b3869c2'}, {'index': '0', 'specParams': {}, 'deviceId': 'd79e2801-f75e-406c-9d61-c09f8fb52cb8', 'address': {'slot': '0x04', 'bus': '0x00', 'domain': '0x0000', 'type': 'pci', 'function': '0x0'}, 'device': 'scsi', 'model': 'virtio-scsi', 'type': 'controller'}], 'maxVCpus': '160', 'spiceSecureChannels': 'smain,sinputs,scursor,splayback,srecord,sdisplay,susbredir,ssmartcard', 'display': 'qxl'},) {} flowID [41c7d587] >Thread-14::INFO::2014-07-10 09:01:06,801::API::667::vds::(_getNetworkIp) network None: using 0 >Thread-14::INFO::2014-07-10 09:01:06,801::clientIF::366::vds::(createVm) vmContainerLock acquired by vm ed909f7e-0ee2-4f6f-b4a5-a165f689a276 >Thread-14::DEBUG::2014-07-10 09:01:06,802::libvirtconnection::145::root::(get) trying to connect libvirt >Thread-14::DEBUG::2014-07-10 09:01:06,956::clientIF::379::vds::(createVm) Total desktops after creation of ed909f7e-0ee2-4f6f-b4a5-a165f689a276 is 1 >Thread-46::DEBUG::2014-07-10 09:01:06,957::vm::2270::vm.Vm::(_startUnderlyingVm) vmId=`ed909f7e-0ee2-4f6f-b4a5-a165f689a276`::Start >Thread-14::DEBUG::2014-07-10 09:01:06,963::BindingXMLRPC::1074::vds::(wrapper) return vmCreate with {'status': {'message': 'Done', 'code': 0}, 'vmList': {'status': 'WaitForLaunch', 'acpiEnable': 'true', 'emulatedMachine': 'rhel6.5.0', 'vmId': 'ed909f7e-0ee2-4f6f-b4a5-a165f689a276', 'pid': '0', 'memGuaranteedSize': 1024, 'timeOffset': '0', 'keyboardLayout': 'en-us', 'displayPort': '-1', 'displaySecurePort': '-1', 'spiceSslCipherSuite': 'DEFAULT', 'cpuType': 'Conroe', 'smp': '2', 'clientIp': '', 'nicModel': 'rtl8139,pv', 'smartcardEnable': 'false', 'kvmEnable': 'true', 'pitReinjection': 'false', 'transparentHugePages': 'true', 'devices': [{'index': '3', 'iface': 'ide', 'specParams': {'vmPayload': {'volId': 'config-2', 'file': {'openstack/latest/meta_data.json': 'ewogICJsYXVuY2hfaW5kZXgiIDogIjAiLAogICJhdmFpbGFiaWxpdHlfem9uZSIgOiAibm92YSIs\nCiAgInV1aWQiIDogIjBiMTAwMTRmLWY3YmEtNDgzMi1iNzQ4LTBhMGQ3NjQ4OWM5MSIsCiAgIm1l\ndGEiIDogewogICAgImVzc2VudGlhbCIgOiAiZmFsc2UiLAogICAgInJvbGUiIDogInNlcnZlciIs\nCiAgICAiZHNtb2RlIiA6ICJsb2NhbCIKICB9Cn0=\n', 'openstack/latest/user_data': 'I2Nsb3VkLWNvbmZpZwpzc2hfcHdhdXRoOiB0cnVlCmRpc2FibGVfcm9vdDogMApvdXRwdXQ6CiAg\nYWxsOiAnPj4gL3Zhci9sb2cvY2xvdWQtaW5pdC1vdXRwdXQubG9nJwp1c2VyOiByb290CmNocGFz\nc3dkOgogIGV4cGlyZTogZmFsc2UKcnVuY21kOgotICdzZWQgLWkgJycvXmRhdGFzb3VyY2VfbGlz\ndDogL2QnJyAvZXRjL2Nsb3VkL2Nsb3VkLmNmZzsgZWNobyAnJ2RhdGFzb3VyY2VfbGlzdDoKICBb\nIk5vQ2xvdWQiLCAiQ29uZmlnRHJpdmUiXScnID4+IC9ldGMvY2xvdWQvY2xvdWQuY2ZnJwo=\n'}}}, 'readonly': 'true', 'deviceId': 'd217e6c7-a8f9-4f35-a610-d28d41296bc9', 'path': '', 'device': 'cdrom', 'shared': 'false', 'type': 'disk'}, {'device': 'qxl', 'specParams': {'vram': '32768', 'ram': '65536', 'heads': '1'}, 'type': 'video', 'deviceId': 'a4b3e8df-e99d-4519-b368-cf124422a806'}, {'index': '2', 'iface': 'ide', 'specParams': {'path': ''}, 'readonly': 'true', 'deviceId': '2b231cd8-3fea-439d-a73d-67b0f3ed1f6b', 'path': '', 'device': 'cdrom', 'shared': 'false', 'type': 'disk'}, {'index': 0, 'iface': 'virtio', 'format': 'cow', 'bootOrder': '1', 'poolID': '4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', 'volumeID': '10b6a7dd-dc6c-43fa-ba17-92e4331b0e0b', 'imageID': '0cd7d6ce-f497-4243-a690-c57744861eea', 'specParams': {}, 'readonly': 'false', 'domainID': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'optional': 'false', 'deviceId': '0cd7d6ce-f497-4243-a690-c57744861eea', 'address': {'slot': '0x06', 'bus': '0x00', 'domain': '0x0000', 'type': 'pci', 'function': '0x0'}, 'device': 'disk', 'shared': 'false', 'propagateErrors': 'off', 'type': 'disk'}, {'nicModel': 'pv', 'macAddr': '00:1a:4a:de:6d:7a', 'linkActive': 'true', 'network': 'rhevm', 'filter': 'vdsm-no-mac-spoofing', 'specParams': {'inbound': {}, 'outbound': {}}, 'deviceId': 'b2b5755c-2939-4f5a-a882-6bae89dead18', 'device': 'bridge', 'type': 'interface'}, {'device': 'memballoon', 'specParams': {'model': 'virtio'}, 'type': 'balloon', 'deviceId': '44db05fa-80c1-40db-9215-b6b19b3869c2'}, {'index': '0', 'specParams': {}, 'deviceId': 'd79e2801-f75e-406c-9d61-c09f8fb52cb8', 'address': {'slot': '0x04', 'bus': '0x00', 'domain': '0x0000', 'type': 'pci', 'function': '0x0'}, 'device': 'scsi', 'model': 'virtio-scsi', 'type': 'controller'}], 'custom': {'device_1d0dceb6-9bdc-479f-bfc3-2d3d0812021cdevice_1e0f274f-1905-4c87-8127-27496691ca69': 'VmDevice {vmId=ed909f7e-0ee2-4f6f-b4a5-a165f689a276, deviceId=1e0f274f-1905-4c87-8127-27496691ca69, device=unix, type=CHANNEL, bootOrder=0, specParams={}, address={port=2, bus=0, controller=0, type=virtio-serial}, managed=false, plugged=true, readOnly=false, deviceAlias=channel1, customProperties={}, snapshotId=null}', 'device_1d0dceb6-9bdc-479f-bfc3-2d3d0812021cdevice_1e0f274f-1905-4c87-8127-27496691ca69device_9f76b6fc-cb15-4e91-8e53-17ffd9d0d0e1device_c882c070-1434-4258-92dc-18958a83a434device_ca2f3ea0-190a-42d7-a099-2e4ab0f3a2a6': 'VmDevice {vmId=ed909f7e-0ee2-4f6f-b4a5-a165f689a276, deviceId=ca2f3ea0-190a-42d7-a099-2e4ab0f3a2a6, device=virtio-serial, type=CONTROLLER, bootOrder=0, specParams={}, address={bus=0x00, domain=0x0000, type=pci, slot=0x05, function=0x0}, managed=false, plugged=true, readOnly=false, deviceAlias=virtio-serial0, customProperties={}, snapshotId=null}', 'device_1d0dceb6-9bdc-479f-bfc3-2d3d0812021cdevice_1e0f274f-1905-4c87-8127-27496691ca69device_9f76b6fc-cb15-4e91-8e53-17ffd9d0d0e1': 'VmDevice {vmId=ed909f7e-0ee2-4f6f-b4a5-a165f689a276, deviceId=9f76b6fc-cb15-4e91-8e53-17ffd9d0d0e1, device=ide, type=CONTROLLER, bootOrder=0, specParams={}, address={bus=0x00, domain=0x0000, type=pci, slot=0x01, function=0x1}, managed=false, plugged=true, readOnly=false, deviceAlias=ide0, customProperties={}, snapshotId=null}', 'device_1d0dceb6-9bdc-479f-bfc3-2d3d0812021cdevice_1e0f274f-1905-4c87-8127-27496691ca69device_9f76b6fc-cb15-4e91-8e53-17ffd9d0d0e1device_c882c070-1434-4258-92dc-18958a83a434': 'VmDevice {vmId=ed909f7e-0ee2-4f6f-b4a5-a165f689a276, deviceId=c882c070-1434-4258-92dc-18958a83a434, device=unix, type=CHANNEL, bootOrder=0, specParams={}, address={port=1, bus=0, controller=0, type=virtio-serial}, managed=false, plugged=true, readOnly=false, deviceAlias=channel0, customProperties={}, snapshotId=null}', 'device_1d0dceb6-9bdc-479f-bfc3-2d3d0812021c': 'VmDevice {vmId=ed909f7e-0ee2-4f6f-b4a5-a165f689a276, deviceId=1d0dceb6-9bdc-479f-bfc3-2d3d0812021c, device=spicevmc, type=CHANNEL, bootOrder=0, specParams={}, address={port=3, bus=0, controller=0, type=virtio-serial}, managed=false, plugged=true, readOnly=false, deviceAlias=channel2, customProperties={}, snapshotId=null}'}, 'vmType': 'kvm', 'memSize': 1024, 'displayIp': '0', 'maxVCpus': '160', 'spiceSecureChannels': 'smain,sinputs,scursor,splayback,srecord,sdisplay,susbredir,ssmartcard', 'smpCoresPerSocket': '2', 'vmName': 'scale_1', 'display': 'qxl', 'nice': '0'}} >Thread-46::DEBUG::2014-07-10 09:01:06,968::vm::2274::vm.Vm::(_startUnderlyingVm) vmId=`ed909f7e-0ee2-4f6f-b4a5-a165f689a276`::_ongoingCreations acquired >Thread-46::INFO::2014-07-10 09:01:06,977::vm::3151::vm.Vm::(_run) vmId=`ed909f7e-0ee2-4f6f-b4a5-a165f689a276`::VM wrapper has started >Thread-46::DEBUG::2014-07-10 09:01:06,994::task::595::TaskManager.Task::(_updateState) Task=`aed89e51-8767-4dfe-be5b-7fdabd4344d0`::moving from state init -> state preparing >Thread-46::INFO::2014-07-10 09:01:07,007::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='0cd7d6ce-f497-4243-a690-c57744861eea', volUUID='10b6a7dd-dc6c-43fa-ba17-92e4331b0e0b', options=None) >Thread-46::INFO::2014-07-10 09:01:07,022::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-46::DEBUG::2014-07-10 09:01:07,031::task::1185::TaskManager.Task::(prepare) Task=`aed89e51-8767-4dfe-be5b-7fdabd4344d0`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-46::DEBUG::2014-07-10 09:01:07,039::task::595::TaskManager.Task::(_updateState) Task=`aed89e51-8767-4dfe-be5b-7fdabd4344d0`::moving from state preparing -> state finished >Thread-46::DEBUG::2014-07-10 09:01:07,043::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-46::DEBUG::2014-07-10 09:01:07,048::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-46::DEBUG::2014-07-10 09:01:07,058::task::990::TaskManager.Task::(_decref) Task=`aed89e51-8767-4dfe-be5b-7fdabd4344d0`::ref 0 aborting False >Thread-46::INFO::2014-07-10 09:01:07,121::clientIF::324::vds::(prepareVolumePath) prepared volume path: /var/run/vdsm/payload/ed909f7e-0ee2-4f6f-b4a5-a165f689a276.d6172be8e329bcb7ee42a4a94e1e66c1.img >Thread-46::INFO::2014-07-10 09:01:07,122::clientIF::324::vds::(prepareVolumePath) prepared volume path: >Thread-46::DEBUG::2014-07-10 09:01:07,122::task::595::TaskManager.Task::(_updateState) Task=`922d9fe5-dc6e-46c5-a11f-6faa7df23bc1`::moving from state init -> state preparing >Thread-46::INFO::2014-07-10 09:01:07,123::logUtils::44::dispatcher::(wrapper) Run and protect: prepareImage(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='0cd7d6ce-f497-4243-a690-c57744861eea', leafUUID='10b6a7dd-dc6c-43fa-ba17-92e4331b0e0b') >Thread-46::DEBUG::2014-07-10 09:01:07,123::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.9e1aa540-1f4e-4ee3-a152-be381ef6c3bd`ReqID=`6a01062d-4ca6-4190-b520-d4aa3c54d46a`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '3248' at 'prepareImage' >Thread-46::DEBUG::2014-07-10 09:01:07,123::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.9e1aa540-1f4e-4ee3-a152-be381ef6c3bd' for lock type 'shared' >Thread-46::DEBUG::2014-07-10 09:01:07,124::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.9e1aa540-1f4e-4ee3-a152-be381ef6c3bd' is free. Now locking as 'shared' (1 active user) >Thread-46::DEBUG::2014-07-10 09:01:07,124::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.9e1aa540-1f4e-4ee3-a152-be381ef6c3bd`ReqID=`6a01062d-4ca6-4190-b520-d4aa3c54d46a`::Granted request >Thread-46::DEBUG::2014-07-10 09:01:07,125::task::827::TaskManager.Task::(resourceAcquired) Task=`922d9fe5-dc6e-46c5-a11f-6faa7df23bc1`::_resourcesAcquired: Storage.9e1aa540-1f4e-4ee3-a152-be381ef6c3bd (shared) >Thread-46::DEBUG::2014-07-10 09:01:07,125::task::990::TaskManager.Task::(_decref) Task=`922d9fe5-dc6e-46c5-a11f-6faa7df23bc1`::ref 1 aborting False >Thread-46::DEBUG::2014-07-10 09:01:07,125::lvm::427::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' got the operation mutex >Thread-46::DEBUG::2014-07-10 09:01:07,126::lvm::296::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm lvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/3600601601282300032826addbbdae311|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,vg_name,attr,size,seg_start_pe,devices,tags 9e1aa540-1f4e-4ee3-a152-be381ef6c3bd' (cwd None) >Thread-46::DEBUG::2014-07-10 09:01:07,330::lvm::296::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-46::DEBUG::2014-07-10 09:01:07,339::lvm::462::Storage.LVM::(_reloadlvs) lvs reloaded >Thread-46::DEBUG::2014-07-10 09:01:07,340::lvm::462::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' released the operation mutex >Thread-46::DEBUG::2014-07-10 09:01:07,342::lvm::296::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm lvchange --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/3600601601282300032826addbbdae311|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } " --autobackup n --available y 9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/47592965-e853-4e59-9728-d11cca6a7a8a 9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/10b6a7dd-dc6c-43fa-ba17-92e4331b0e0b' (cwd None) >Thread-46::DEBUG::2014-07-10 09:01:07,811::lvm::296::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-46::DEBUG::2014-07-10 09:01:07,812::lvm::513::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-46::DEBUG::2014-07-10 09:01:07,813::lvm::525::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-46::DEBUG::2014-07-10 09:01:07,814::blockSD::1057::Storage.StorageDomain::(linkBCImage) path to image directory already exists: /rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/images/0cd7d6ce-f497-4243-a690-c57744861eea >Thread-46::DEBUG::2014-07-10 09:01:07,814::lvm::427::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' got the operation mutex >Thread-46::DEBUG::2014-07-10 09:01:07,815::lvm::296::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm lvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/3600601601282300032826addbbdae311|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,vg_name,attr,size,seg_start_pe,devices,tags 9e1aa540-1f4e-4ee3-a152-be381ef6c3bd' (cwd None) >Thread-46::DEBUG::2014-07-10 09:01:08,009::lvm::296::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-46::DEBUG::2014-07-10 09:01:08,017::lvm::462::Storage.LVM::(_reloadlvs) lvs reloaded >Thread-46::DEBUG::2014-07-10 09:01:08,017::lvm::462::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' released the operation mutex >Thread-46::INFO::2014-07-10 09:01:08,018::logUtils::47::dispatcher::(wrapper) Run and protect: prepareImage, Return response: {'info': {'domainID': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'volType': 'path', 'leaseOffset': 110100480, 'path': '/rhev/data-center/mnt/blockSD/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/images/0cd7d6ce-f497-4243-a690-c57744861eea/10b6a7dd-dc6c-43fa-ba17-92e4331b0e0b', 'volumeID': '10b6a7dd-dc6c-43fa-ba17-92e4331b0e0b', 'leasePath': '/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/leases', 'imageID': '0cd7d6ce-f497-4243-a690-c57744861eea'}, 'path': '/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/images/0cd7d6ce-f497-4243-a690-c57744861eea/10b6a7dd-dc6c-43fa-ba17-92e4331b0e0b', 'imgVolumesInfo': [{'domainID': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'volType': 'path', 'leaseOffset': 109051904, 'path': '/rhev/data-center/mnt/blockSD/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/images/0cd7d6ce-f497-4243-a690-c57744861eea/47592965-e853-4e59-9728-d11cca6a7a8a', 'volumeID': '47592965-e853-4e59-9728-d11cca6a7a8a', 'leasePath': '/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/leases', 'imageID': '0cd7d6ce-f497-4243-a690-c57744861eea'}, {'domainID': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'volType': 'path', 'leaseOffset': 110100480, 'path': '/rhev/data-center/mnt/blockSD/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/images/0cd7d6ce-f497-4243-a690-c57744861eea/10b6a7dd-dc6c-43fa-ba17-92e4331b0e0b', 'volumeID': '10b6a7dd-dc6c-43fa-ba17-92e4331b0e0b', 'leasePath': '/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/leases', 'imageID': '0cd7d6ce-f497-4243-a690-c57744861eea'}]} >Thread-46::DEBUG::2014-07-10 09:01:08,019::task::1185::TaskManager.Task::(prepare) Task=`922d9fe5-dc6e-46c5-a11f-6faa7df23bc1`::finished: {'info': {'domainID': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'volType': 'path', 'leaseOffset': 110100480, 'path': '/rhev/data-center/mnt/blockSD/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/images/0cd7d6ce-f497-4243-a690-c57744861eea/10b6a7dd-dc6c-43fa-ba17-92e4331b0e0b', 'volumeID': '10b6a7dd-dc6c-43fa-ba17-92e4331b0e0b', 'leasePath': '/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/leases', 'imageID': '0cd7d6ce-f497-4243-a690-c57744861eea'}, 'path': '/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/images/0cd7d6ce-f497-4243-a690-c57744861eea/10b6a7dd-dc6c-43fa-ba17-92e4331b0e0b', 'imgVolumesInfo': [{'domainID': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'volType': 'path', 'leaseOffset': 109051904, 'path': '/rhev/data-center/mnt/blockSD/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/images/0cd7d6ce-f497-4243-a690-c57744861eea/47592965-e853-4e59-9728-d11cca6a7a8a', 'volumeID': '47592965-e853-4e59-9728-d11cca6a7a8a', 'leasePath': '/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/leases', 'imageID': '0cd7d6ce-f497-4243-a690-c57744861eea'}, {'domainID': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'volType': 'path', 'leaseOffset': 110100480, 'path': '/rhev/data-center/mnt/blockSD/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/images/0cd7d6ce-f497-4243-a690-c57744861eea/10b6a7dd-dc6c-43fa-ba17-92e4331b0e0b', 'volumeID': '10b6a7dd-dc6c-43fa-ba17-92e4331b0e0b', 'leasePath': '/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/leases', 'imageID': '0cd7d6ce-f497-4243-a690-c57744861eea'}]} >Thread-46::DEBUG::2014-07-10 09:01:08,019::task::595::TaskManager.Task::(_updateState) Task=`922d9fe5-dc6e-46c5-a11f-6faa7df23bc1`::moving from state preparing -> state finished >Thread-46::DEBUG::2014-07-10 09:01:08,019::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': < ResourceRef 'Storage.9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', isValid: 'True' obj: 'None'>} >Thread-46::DEBUG::2014-07-10 09:01:08,019::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-46::DEBUG::2014-07-10 09:01:08,020::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.9e1aa540-1f4e-4ee3-a152-be381ef6c3bd' >Thread-46::DEBUG::2014-07-10 09:01:08,020::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.9e1aa540-1f4e-4ee3-a152-be381ef6c3bd' (0 active users) >Thread-46::DEBUG::2014-07-10 09:01:08,020::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.9e1aa540-1f4e-4ee3-a152-be381ef6c3bd' is free, finding out if anyone is waiting for it. >Thread-46::DEBUG::2014-07-10 09:01:08,021::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', Clearing records. >Thread-46::DEBUG::2014-07-10 09:01:08,021::task::990::TaskManager.Task::(_decref) Task=`922d9fe5-dc6e-46c5-a11f-6faa7df23bc1`::ref 0 aborting False >Thread-46::INFO::2014-07-10 09:01:08,021::clientIF::324::vds::(prepareVolumePath) prepared volume path: /rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/images/0cd7d6ce-f497-4243-a690-c57744861eea/10b6a7dd-dc6c-43fa-ba17-92e4331b0e0b >Thread-46::DEBUG::2014-07-10 09:01:08,046::utils::642::root::(execCmd) '/usr/libexec/vdsm/hooks/before_vm_start/50_vhostmd' (cwd None) >Thread-46::DEBUG::2014-07-10 09:01:08,151::utils::662::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-46::INFO::2014-07-10 09:01:08,152::hooks::100::root::(_runHooksDir) >Thread-46::DEBUG::2014-07-10 09:01:08,152::vm::3190::vm.Vm::(_run) vmId=`ed909f7e-0ee2-4f6f-b4a5-a165f689a276`::<?xml version="1.0" encoding="utf-8"?> ><domain type="kvm"> > <name>scale_1</name> > <uuid>ed909f7e-0ee2-4f6f-b4a5-a165f689a276</uuid> > <memory>1048576</memory> > <currentMemory>1048576</currentMemory> > <vcpu current="2">160</vcpu> > <memtune> > <min_guarantee>1048576</min_guarantee> > </memtune> > <devices> > <channel type="unix"> > <target name="com.redhat.rhevm.vdsm" type="virtio"/> > <source mode="bind" path="/var/lib/libvirt/qemu/channels/ed909f7e-0ee2-4f6f-b4a5-a165f689a276.com.redhat.rhevm.vdsm"/> > </channel> > <channel type="unix"> > <target name="org.qemu.guest_agent.0" type="virtio"/> > <source mode="bind" path="/var/lib/libvirt/qemu/channels/ed909f7e-0ee2-4f6f-b4a5-a165f689a276.org.qemu.guest_agent.0"/> > </channel> > <input bus="ps2" type="mouse"/> > <channel type="spicevmc"> > <target name="com.redhat.spice.0" type="virtio"/> > </channel> > <graphics autoport="yes" keymap="en-us" listen="0" passwd="*****" passwdValidTo="1970-01-01T00:00:01" port="-1" tlsPort="-1" type="spice"> > <channel mode="secure" name="main"/> > <channel mode="secure" name="inputs"/> > <channel mode="secure" name="cursor"/> > <channel mode="secure" name="playback"/> > <channel mode="secure" name="record"/> > <channel mode="secure" name="display"/> > <channel mode="secure" name="usbredir"/> > <channel mode="secure" name="smartcard"/> > </graphics> > <memballoon model="virtio"/> > <controller index="0" model="virtio-scsi" type="scsi"> > <address bus="0x00" domain="0x0000" function="0x0" slot="0x04" type="pci"/> > </controller> > <video> > <model heads="1" ram="65536" type="qxl" vram="32768"/> > </video> > <interface type="bridge"> > <mac address="00:1a:4a:de:6d:7a"/> > <model type="virtio"/> > <source bridge="rhevm"/> > <filterref filter="vdsm-no-mac-spoofing"/> > <link state="up"/> > <bandwidth/> > </interface> > <disk device="cdrom" snapshot="no" type="file"> > <source file="/var/run/vdsm/payload/ed909f7e-0ee2-4f6f-b4a5-a165f689a276.d6172be8e329bcb7ee42a4a94e1e66c1.img" startupPolicy="optional"/> > <target bus="ide" dev="hdd"/> > <readonly/> > <serial/> > </disk> > <disk device="cdrom" snapshot="no" type="file"> > <source file="" startupPolicy="optional"/> > <target bus="ide" dev="hdc"/> > <readonly/> > <serial/> > </disk> > <disk device="disk" snapshot="no" type="block"> > <address bus="0x00" domain="0x0000" function="0x0" slot="0x06" type="pci"/> > <source dev="/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/images/0cd7d6ce-f497-4243-a690-c57744861eea/10b6a7dd-dc6c-43fa-ba17-92e4331b0e0b"/> > <target bus="virtio" dev="vda"/> > <serial>0cd7d6ce-f497-4243-a690-c57744861eea</serial> > <boot order="1"/> > <driver cache="none" error_policy="stop" io="native" name="qemu" type="qcow2"/> > </disk> > </devices> > <os> > <type arch="x86_64" machine="rhel6.5.0">hvm</type> > <smbios mode="sysinfo"/> > </os> > <sysinfo type="smbios"> > <system> > <entry name="manufacturer">Red Hat</entry> > <entry name="product">RHEV Hypervisor</entry> > <entry name="version">6.5-20140707.0.el6ev</entry> > <entry name="serial">52BAF97B-FF2F-E311-0000-100000000005</entry> > <entry name="uuid">ed909f7e-0ee2-4f6f-b4a5-a165f689a276</entry> > </system> > </sysinfo> > <clock adjustment="0" offset="variable"> > <timer name="rtc" tickpolicy="catchup"/> > </clock> > <features> > <acpi/> > </features> > <cpu match="exact"> > <model>Conroe</model> > <topology cores="2" sockets="80" threads="1"/> > </cpu> ></domain> > >Dummy-33::DEBUG::2014-07-10 09:01:08,532::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:01:08,619::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0346238 s, 29.6 MB/s\n'; <rc> = 0 >libvirtEventLoop::DEBUG::2014-07-10 09:01:09,201::vm::5176::vm.Vm::(_onLibvirtLifecycleEvent) vmId=`ed909f7e-0ee2-4f6f-b4a5-a165f689a276`::event Started detail 0 opaque None >Thread-46::DEBUG::2014-07-10 09:01:09,228::vm::5032::vm.Vm::(_getUnderlyingDriveInfo) vmId=`ed909f7e-0ee2-4f6f-b4a5-a165f689a276`::Looking for drive with attributes {'name': u'hdc', 'bootOrder': '', 'boot': [], 'readonly': True, 'address': {u'bus': u'1', u'controller': u'0', u'type': u'drive', u'target': u'0', u'unit': u'0'}, 'path': '', 'type': u'cdrom'} >Thread-46::DEBUG::2014-07-10 09:01:09,228::vm::5053::vm.Vm::(_getUnderlyingDriveInfo) vmId=`ed909f7e-0ee2-4f6f-b4a5-a165f689a276`::Matched {'name': (u'hdc', u'hdc'), 'bootOrder': ('', None), 'boot': ([], None), 'readonly': (True, True), 'address': ({u'bus': u'1', u'controller': u'0', u'type': u'drive', u'target': u'0', u'unit': u'0'}, {u'bus': u'1', u'controller': u'0', u'type': u'drive', u'target': u'0', u'unit': u'0'}), 'path': ('', ''), 'type': (u'cdrom', u'cdrom')} >Thread-46::DEBUG::2014-07-10 09:01:09,229::vm::5072::vm.Vm::(_getUnderlyingDriveInfo) vmId=`ed909f7e-0ee2-4f6f-b4a5-a165f689a276`::Matched {'name': (u'hdc', u'hdc'), 'bootOrder': ('', None), 'boot': ([], None), 'readonly': (True, 'True'), 'address': ({u'bus': u'1', u'controller': u'0', u'type': u'drive', u'target': u'0', u'unit': u'0'}, {u'bus': u'1', u'controller': u'0', u'type': u'drive', u'target': u'0', u'unit': u'0'}), 'path': ('', ''), 'type': (u'cdrom', 'disk')} >Thread-46::DEBUG::2014-07-10 09:01:09,229::vm::5032::vm.Vm::(_getUnderlyingDriveInfo) vmId=`ed909f7e-0ee2-4f6f-b4a5-a165f689a276`::Looking for drive with attributes {'name': u'hdd', 'bootOrder': '', 'boot': [], 'readonly': True, 'address': {u'bus': u'1', u'controller': u'0', u'type': u'drive', u'target': u'0', u'unit': u'1'}, 'path': u'/var/run/vdsm/payload/ed909f7e-0ee2-4f6f-b4a5-a165f689a276.d6172be8e329bcb7ee42a4a94e1e66c1.img', 'type': u'cdrom'} >Thread-46::DEBUG::2014-07-10 09:01:09,229::vm::5053::vm.Vm::(_getUnderlyingDriveInfo) vmId=`ed909f7e-0ee2-4f6f-b4a5-a165f689a276`::Matched {'name': (u'hdd', u'hdd'), 'bootOrder': ('', None), 'boot': ([], None), 'readonly': (True, True), 'address': ({u'bus': u'1', u'controller': u'0', u'type': u'drive', u'target': u'0', u'unit': u'1'}, {u'bus': u'1', u'controller': u'0', u'type': u'drive', u'target': u'0', u'unit': u'1'}), 'path': (u'/var/run/vdsm/payload/ed909f7e-0ee2-4f6f-b4a5-a165f689a276.d6172be8e329bcb7ee42a4a94e1e66c1.img', '/var/run/vdsm/payload/ed909f7e-0ee2-4f6f-b4a5-a165f689a276.d6172be8e329bcb7ee42a4a94e1e66c1.img'), 'type': (u'cdrom', u'cdrom')} >Thread-46::DEBUG::2014-07-10 09:01:09,229::vm::5072::vm.Vm::(_getUnderlyingDriveInfo) vmId=`ed909f7e-0ee2-4f6f-b4a5-a165f689a276`::Matched {'name': (u'hdd', u'hdd'), 'bootOrder': ('', None), 'boot': ([], None), 'readonly': (True, 'True'), 'address': ({u'bus': u'1', u'controller': u'0', u'type': u'drive', u'target': u'0', u'unit': u'1'}, {u'bus': u'1', u'controller': u'0', u'type': u'drive', u'target': u'0', u'unit': u'1'}), 'path': (u'/var/run/vdsm/payload/ed909f7e-0ee2-4f6f-b4a5-a165f689a276.d6172be8e329bcb7ee42a4a94e1e66c1.img', '/var/run/vdsm/payload/ed909f7e-0ee2-4f6f-b4a5-a165f689a276.d6172be8e329bcb7ee42a4a94e1e66c1.img'), 'type': (u'cdrom', 'disk')} >Thread-46::DEBUG::2014-07-10 09:01:09,230::vm::5032::vm.Vm::(_getUnderlyingDriveInfo) vmId=`ed909f7e-0ee2-4f6f-b4a5-a165f689a276`::Looking for drive with attributes {'name': u'vda', 'bootOrder': u'1', 'boot': [<DOM Element: boot at 0x7f62180a6758>], 'readonly': False, 'address': {u'slot': u'0x06', u'bus': u'0x00', u'domain': u'0x0000', u'type': u'pci', u'function': u'0x0'}, 'path': u'/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/images/0cd7d6ce-f497-4243-a690-c57744861eea/10b6a7dd-dc6c-43fa-ba17-92e4331b0e0b', 'type': u'disk'} >Thread-46::DEBUG::2014-07-10 09:01:09,230::vm::5053::vm.Vm::(_getUnderlyingDriveInfo) vmId=`ed909f7e-0ee2-4f6f-b4a5-a165f689a276`::Matched {'name': (u'vda', u'vda'), 'bootOrder': (u'1', u'1'), 'boot': ([<DOM Element: boot at 0x7f62180a6758>], None), 'readonly': (False, False), 'address': ({u'slot': u'0x06', u'bus': u'0x00', u'domain': u'0x0000', u'type': u'pci', u'function': u'0x0'}, {u'slot': u'0x06', u'bus': u'0x00', u'domain': u'0x0000', u'type': u'pci', u'function': u'0x0'}), 'path': (u'/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/images/0cd7d6ce-f497-4243-a690-c57744861eea/10b6a7dd-dc6c-43fa-ba17-92e4331b0e0b', '/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/images/0cd7d6ce-f497-4243-a690-c57744861eea/10b6a7dd-dc6c-43fa-ba17-92e4331b0e0b'), 'type': (u'disk', u'disk')} >Thread-46::DEBUG::2014-07-10 09:01:09,230::vm::5072::vm.Vm::(_getUnderlyingDriveInfo) vmId=`ed909f7e-0ee2-4f6f-b4a5-a165f689a276`::Matched {'name': (u'vda', u'vda'), 'bootOrder': (u'1', u'1'), 'boot': ([<DOM Element: boot at 0x7f62180a6758>], None), 'readonly': (False, 'False'), 'address': ({u'slot': u'0x06', u'bus': u'0x00', u'domain': u'0x0000', u'type': u'pci', u'function': u'0x0'}, {u'slot': u'0x06', u'bus': u'0x00', u'domain': u'0x0000', u'type': u'pci', u'function': u'0x0'}), 'path': (u'/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/images/0cd7d6ce-f497-4243-a690-c57744861eea/10b6a7dd-dc6c-43fa-ba17-92e4331b0e0b', '/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/images/0cd7d6ce-f497-4243-a690-c57744861eea/10b6a7dd-dc6c-43fa-ba17-92e4331b0e0b'), 'type': (u'disk', 'disk')} >Thread-46::DEBUG::2014-07-10 09:01:09,278::sampling::285::vm.Vm::(start) vmId=`ed909f7e-0ee2-4f6f-b4a5-a165f689a276`::Start statistics collection >Thread-48::DEBUG::2014-07-10 09:01:09,279::sampling::314::vm.Vm::(run) vmId=`ed909f7e-0ee2-4f6f-b4a5-a165f689a276`::Stats thread started >Thread-48::DEBUG::2014-07-10 09:01:09,286::task::595::TaskManager.Task::(_updateState) Task=`ec01ab84-592d-46da-a864-2c4bee10241f`::moving from state init -> state preparing >Thread-48::INFO::2014-07-10 09:01:09,287::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='0cd7d6ce-f497-4243-a690-c57744861eea', volUUID='10b6a7dd-dc6c-43fa-ba17-92e4331b0e0b', options=None) >Thread-48::INFO::2014-07-10 09:01:09,287::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-48::DEBUG::2014-07-10 09:01:09,287::task::1185::TaskManager.Task::(prepare) Task=`ec01ab84-592d-46da-a864-2c4bee10241f`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-48::DEBUG::2014-07-10 09:01:09,287::task::595::TaskManager.Task::(_updateState) Task=`ec01ab84-592d-46da-a864-2c4bee10241f`::moving from state preparing -> state finished >Thread-48::DEBUG::2014-07-10 09:01:09,288::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-48::DEBUG::2014-07-10 09:01:09,288::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-48::DEBUG::2014-07-10 09:01:09,288::task::990::TaskManager.Task::(_decref) Task=`ec01ab84-592d-46da-a864-2c4bee10241f`::ref 0 aborting False >Thread-46::DEBUG::2014-07-10 09:01:09,293::vmChannels::198::vds::(register) Add fileno 59 to listener's channels. >Thread-46::WARNING::2014-07-10 09:01:09,298::vm::3715::vm.Vm::(_readPauseCode) vmId=`ed909f7e-0ee2-4f6f-b4a5-a165f689a276`::_readPauseCode unsupported by libvirt vm >Thread-46::DEBUG::2014-07-10 09:01:09,315::vm::2291::vm.Vm::(_startUnderlyingVm) vmId=`ed909f7e-0ee2-4f6f-b4a5-a165f689a276`::_ongoingCreations released >VM Channels Listener::DEBUG::2014-07-10 09:01:09,889::vmChannels::106::vds::(_do_add_channels) fileno 59 was added to unconnected channels. >VM Channels Listener::DEBUG::2014-07-10 09:01:09,890::vmChannels::132::vds::(_handle_unconnected) Trying to connect fileno 59. >VM Channels Listener::DEBUG::2014-07-10 09:01:09,890::guestIF::194::vm.Vm::(_connect) vmId=`ed909f7e-0ee2-4f6f-b4a5-a165f689a276`::Attempting connection to /var/lib/libvirt/qemu/channels/ed909f7e-0ee2-4f6f-b4a5-a165f689a276.com.redhat.rhevm.vdsm >VM Channels Listener::DEBUG::2014-07-10 09:01:09,891::guestIF::197::vm.Vm::(_connect) vmId=`ed909f7e-0ee2-4f6f-b4a5-a165f689a276`::Connected to /var/lib/libvirt/qemu/channels/ed909f7e-0ee2-4f6f-b4a5-a165f689a276.com.redhat.rhevm.vdsm >VM Channels Listener::DEBUG::2014-07-10 09:01:09,892::vmChannels::148::vds::(_handle_unconnected) Connecting to fileno 59 succeeded. >Dummy-33::DEBUG::2014-07-10 09:01:10,634::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:01:10,714::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0286754 s, 35.7 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 09:01:10,909::BindingXMLRPC::1067::vds::(wrapper) client [10.35.3.13]::call vmGetStats with ('ed909f7e-0ee2-4f6f-b4a5-a165f689a276',) {} >Thread-14::DEBUG::2014-07-10 09:01:10,910::vm::598::vm.Vm::(_getCpuStats) vmId=`ed909f7e-0ee2-4f6f-b4a5-a165f689a276`::CPU stats not available: 'NoneType' object is unsubscriptable >Thread-14::DEBUG::2014-07-10 09:01:10,910::vm::654::vm.Vm::(_getNetworkStats) vmId=`ed909f7e-0ee2-4f6f-b4a5-a165f689a276`::Network stats not available >Thread-14::DEBUG::2014-07-10 09:01:10,910::vm::676::vm.Vm::(_getDiskStats) vmId=`ed909f7e-0ee2-4f6f-b4a5-a165f689a276`::Disk hdd stats not available >Thread-14::DEBUG::2014-07-10 09:01:10,911::vm::676::vm.Vm::(_getDiskStats) vmId=`ed909f7e-0ee2-4f6f-b4a5-a165f689a276`::Disk hdc stats not available >Thread-14::DEBUG::2014-07-10 09:01:10,911::vm::676::vm.Vm::(_getDiskStats) vmId=`ed909f7e-0ee2-4f6f-b4a5-a165f689a276`::Disk vda stats not available >Thread-14::DEBUG::2014-07-10 09:01:10,911::vm::715::vm.Vm::(_getDiskLatency) vmId=`ed909f7e-0ee2-4f6f-b4a5-a165f689a276`::Disk hdd latency not available >Thread-14::DEBUG::2014-07-10 09:01:10,911::vm::715::vm.Vm::(_getDiskLatency) vmId=`ed909f7e-0ee2-4f6f-b4a5-a165f689a276`::Disk hdc latency not available >Thread-14::DEBUG::2014-07-10 09:01:10,911::vm::715::vm.Vm::(_getDiskLatency) vmId=`ed909f7e-0ee2-4f6f-b4a5-a165f689a276`::Disk vda latency not available >Thread-14::DEBUG::2014-07-10 09:01:10,912::BindingXMLRPC::1074::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Powering up', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '11613', 'displayIp': '0', 'displayPort': u'5900', 'session': 'Unknown', 'displaySecurePort': u'5901', 'timeOffset': '0', 'hash': '7841224975033595397', 'balloonInfo': {'balloon_max': '1048576', 'balloon_target': '1048576', 'balloon_cur': '0', 'balloon_min': '1048576'}, 'pauseCode': 'NOERR', 'clientIp': '', 'kvmEnable': 'true', 'network': {u'vnet0': {'state': 'unknown', 'macAddr': '00:1a:4a:de:6d:7a', 'speed': '1000', 'name': u'vnet0'}}, 'vmId': 'ed909f7e-0ee2-4f6f-b4a5-a165f689a276', 'displayType': 'qxl', 'cpuUser': '0.00', 'disks': {u'vda': {'truesize': '1073741824', 'apparentsize': '1073741824', 'imageID': '0cd7d6ce-f497-4243-a690-c57744861eea'}, u'hdd': {'truesize': '0', 'apparentsize': '0'}, u'hdc': {'truesize': '0', 'apparentsize': '0'}}, 'monitorResponse': '0', 'statsAge': '1.63', 'elapsedTime': '4', 'vmType': 'kvm', 'cpuSys': '0.00', 'guestCPUCount': -1, 'appsList': [], 'guestIPs': ''}]} >Thread-14::DEBUG::2014-07-10 09:01:11,081::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-14::DEBUG::2014-07-10 09:01:11,081::task::595::TaskManager.Task::(_updateState) Task=`788a0d1f-fcaf-400c-bf12-b2ac508c9803`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 09:01:11,082::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-14::INFO::2014-07-10 09:01:11,082::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:01:11,083::task::1185::TaskManager.Task::(prepare) Task=`788a0d1f-fcaf-400c-bf12-b2ac508c9803`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:01:11,083::task::595::TaskManager.Task::(_updateState) Task=`788a0d1f-fcaf-400c-bf12-b2ac508c9803`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 09:01:11,083::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 09:01:11,083::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 09:01:11,083::task::990::TaskManager.Task::(_decref) Task=`788a0d1f-fcaf-400c-bf12-b2ac508c9803`::ref 0 aborting False >Thread-34::DEBUG::2014-07-10 09:01:11,127::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-34::DEBUG::2014-07-10 09:01:11,128::task::595::TaskManager.Task::(_updateState) Task=`d9d42299-f7a4-45da-a52f-dda632d73252`::moving from state init -> state preparing >Thread-34::INFO::2014-07-10 09:01:11,128::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-34::DEBUG::2014-07-10 09:01:11,129::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`f8ed86cb-da0d-4d17-82d3-17667767bc51`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-10 09:01:11,129::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' for lock type 'shared' >Thread-34::DEBUG::2014-07-10 09:01:11,129::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-10 09:01:11,130::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`f8ed86cb-da0d-4d17-82d3-17667767bc51`::Granted request >Thread-34::DEBUG::2014-07-10 09:01:11,130::task::827::TaskManager.Task::(resourceAcquired) Task=`d9d42299-f7a4-45da-a52f-dda632d73252`::_resourcesAcquired: Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee (shared) >Thread-34::DEBUG::2014-07-10 09:01:11,130::task::990::TaskManager.Task::(_decref) Task=`d9d42299-f7a4-45da-a52f-dda632d73252`::ref 1 aborting False >Thread-34::INFO::2014-07-10 09:01:11,131::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1083137064960', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532069482496', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:01:11,132::task::1185::TaskManager.Task::(prepare) Task=`d9d42299-f7a4-45da-a52f-dda632d73252`::finished: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1083137064960', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532069482496', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:01:11,132::task::595::TaskManager.Task::(_updateState) Task=`d9d42299-f7a4-45da-a52f-dda632d73252`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-10 09:01:11,132::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee': < ResourceRef 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-10 09:01:11,132::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-10 09:01:11,133::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' >Thread-34::DEBUG::2014-07-10 09:01:11,133::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' (0 active users) >Thread-34::DEBUG::2014-07-10 09:01:11,133::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-10 09:01:11,133::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', Clearing records. >Thread-34::DEBUG::2014-07-10 09:01:11,133::task::990::TaskManager.Task::(_decref) Task=`d9d42299-f7a4-45da-a52f-dda632d73252`::ref 0 aborting False >Thread-34::DEBUG::2014-07-10 09:01:11,609::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [5d8ae20c] >Thread-34::DEBUG::2014-07-10 09:01:11,610::task::595::TaskManager.Task::(_updateState) Task=`7fc7681e-8725-425e-88ea-fd4cfdcab46e`::moving from state init -> state preparing >Thread-34::INFO::2014-07-10 09:01:11,610::logUtils::44::dispatcher::(wrapper) Run and protect: createVolume(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='76fdb054-02cd-42ed-9721-b3e65b34c3a4', size='10737418240', volFormat=4, preallocate=2, diskType=2, volUUID='022dfe46-2cf7-4915-80b3-883158e3ca83', desc='', srcImgUUID='9cf413b7-7f14-4a61-8c71-913e5b0ea9c0', srcVolUUID='47592965-e853-4e59-9728-d11cca6a7a8a') >Thread-34::DEBUG::2014-07-10 09:01:11,611::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.9e1aa540-1f4e-4ee3-a152-be381ef6c3bd`ReqID=`80192121-4d90-4a63-9917-965293daaa88`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '1464' at 'createVolume' >Thread-34::DEBUG::2014-07-10 09:01:11,611::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.9e1aa540-1f4e-4ee3-a152-be381ef6c3bd' for lock type 'shared' >Thread-34::DEBUG::2014-07-10 09:01:11,612::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.9e1aa540-1f4e-4ee3-a152-be381ef6c3bd' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-10 09:01:11,612::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.9e1aa540-1f4e-4ee3-a152-be381ef6c3bd`ReqID=`80192121-4d90-4a63-9917-965293daaa88`::Granted request >Thread-34::DEBUG::2014-07-10 09:01:11,612::task::827::TaskManager.Task::(resourceAcquired) Task=`7fc7681e-8725-425e-88ea-fd4cfdcab46e`::_resourcesAcquired: Storage.9e1aa540-1f4e-4ee3-a152-be381ef6c3bd (shared) >Thread-34::DEBUG::2014-07-10 09:01:11,613::task::990::TaskManager.Task::(_decref) Task=`7fc7681e-8725-425e-88ea-fd4cfdcab46e`::ref 1 aborting False >Thread-34::DEBUG::2014-07-10 09:01:11,615::task::752::TaskManager.Task::(_save) Task=`7fc7681e-8725-425e-88ea-fd4cfdcab46e`::_save: orig /rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/master/tasks/7fc7681e-8725-425e-88ea-fd4cfdcab46e temp /rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/master/tasks/7fc7681e-8725-425e-88ea-fd4cfdcab46e.temp >Thread-34::DEBUG::2014-07-10 09:01:11,623::taskManager::68::TaskManager::(scheduleJob) scheduled job createVolume for task 7fc7681e-8725-425e-88ea-fd4cfdcab46e >Thread-34::INFO::2014-07-10 09:01:11,623::logUtils::47::dispatcher::(wrapper) Run and protect: createVolume, Return response: None >Thread-34::DEBUG::2014-07-10 09:01:11,624::task::1180::TaskManager.Task::(prepare) Task=`7fc7681e-8725-425e-88ea-fd4cfdcab46e`::Prepare: 1 jobs exist, move to acquiring >Thread-34::DEBUG::2014-07-10 09:01:11,624::task::595::TaskManager.Task::(_updateState) Task=`7fc7681e-8725-425e-88ea-fd4cfdcab46e`::moving from state preparing -> state acquiring >Thread-34::DEBUG::2014-07-10 09:01:11,624::task::752::TaskManager.Task::(_save) Task=`7fc7681e-8725-425e-88ea-fd4cfdcab46e`::_save: orig /rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/master/tasks/7fc7681e-8725-425e-88ea-fd4cfdcab46e temp /rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/master/tasks/7fc7681e-8725-425e-88ea-fd4cfdcab46e.temp >Thread-34::DEBUG::2014-07-10 09:01:11,631::task::595::TaskManager.Task::(_updateState) Task=`7fc7681e-8725-425e-88ea-fd4cfdcab46e`::moving from state acquiring -> state queued >Thread-34::DEBUG::2014-07-10 09:01:11,632::task::752::TaskManager.Task::(_save) Task=`7fc7681e-8725-425e-88ea-fd4cfdcab46e`::_save: orig /rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/master/tasks/7fc7681e-8725-425e-88ea-fd4cfdcab46e temp /rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/master/tasks/7fc7681e-8725-425e-88ea-fd4cfdcab46e.temp >Thread-34::DEBUG::2014-07-10 09:01:11,638::taskManager::50::TaskManager::(_queueTask) queuing task: 7fc7681e-8725-425e-88ea-fd4cfdcab46e >Thread-34::DEBUG::2014-07-10 09:01:11,639::taskManager::56::TaskManager::(_queueTask) task queued: 7fc7681e-8725-425e-88ea-fd4cfdcab46e >Thread-2::DEBUG::2014-07-10 09:01:11,639::threadPool::57::Misc.ThreadPool::(setRunningTask) Number of running tasks: 1 >Thread-34::DEBUG::2014-07-10 09:01:11,640::task::1182::TaskManager.Task::(prepare) Task=`7fc7681e-8725-425e-88ea-fd4cfdcab46e`::returning >7fc7681e-8725-425e-88ea-fd4cfdcab46e::DEBUG::2014-07-10 09:01:11,640::threadPool::200::Misc.ThreadPool.WorkerThread::(_processNextTask) Task: 7fc7681e-8725-425e-88ea-fd4cfdcab46e running: <bound method Task.commit of <storage.task.Task instance at 0x7f6218146a28>> with: None >Thread-34::DEBUG::2014-07-10 09:01:11,641::task::990::TaskManager.Task::(_decref) Task=`7fc7681e-8725-425e-88ea-fd4cfdcab46e`::ref 0 aborting False >7fc7681e-8725-425e-88ea-fd4cfdcab46e::DEBUG::2014-07-10 09:01:11,642::task::1194::TaskManager.Task::(commit) Task=`7fc7681e-8725-425e-88ea-fd4cfdcab46e`::committing task: 7fc7681e-8725-425e-88ea-fd4cfdcab46e >7fc7681e-8725-425e-88ea-fd4cfdcab46e::DEBUG::2014-07-10 09:01:11,643::task::595::TaskManager.Task::(_updateState) Task=`7fc7681e-8725-425e-88ea-fd4cfdcab46e`::moving from state queued -> state running >7fc7681e-8725-425e-88ea-fd4cfdcab46e::DEBUG::2014-07-10 09:01:11,644::task::752::TaskManager.Task::(_save) Task=`7fc7681e-8725-425e-88ea-fd4cfdcab46e`::_save: orig /rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/master/tasks/7fc7681e-8725-425e-88ea-fd4cfdcab46e temp /rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/master/tasks/7fc7681e-8725-425e-88ea-fd4cfdcab46e.temp >7fc7681e-8725-425e-88ea-fd4cfdcab46e::DEBUG::2014-07-10 09:01:11,652::task::905::TaskManager.Task::(_runJobs) Task=`7fc7681e-8725-425e-88ea-fd4cfdcab46e`::Task.run: running job 0: createVolume: <bound method StoragePool.createVolume of <storage.sp.StoragePool object at 0x7f62180b9dd0>> (args: ('9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', '76fdb054-02cd-42ed-9721-b3e65b34c3a4', 20971520, 4, 2, 2, '022dfe46-2cf7-4915-80b3-883158e3ca83', '', '9cf413b7-7f14-4a61-8c71-913e5b0ea9c0', '47592965-e853-4e59-9728-d11cca6a7a8a') kwargs: {}) >7fc7681e-8725-425e-88ea-fd4cfdcab46e::DEBUG::2014-07-10 09:01:11,652::task::331::TaskManager.Task::(run) Task=`7fc7681e-8725-425e-88ea-fd4cfdcab46e`::Job.run: running createVolume: <bound method StoragePool.createVolume of <storage.sp.StoragePool object at 0x7f62180b9dd0>> (args: ('9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', '76fdb054-02cd-42ed-9721-b3e65b34c3a4', 20971520, 4, 2, 2, '022dfe46-2cf7-4915-80b3-883158e3ca83', '', '9cf413b7-7f14-4a61-8c71-913e5b0ea9c0', '47592965-e853-4e59-9728-d11cca6a7a8a') kwargs: {}) callback None >7fc7681e-8725-425e-88ea-fd4cfdcab46e::DEBUG::2014-07-10 09:01:11,653::blockVolume::572::Storage.Misc.excCmd::(getMetadata) '/bin/dd iflag=direct skip=4 bs=512 if=/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/metadata count=1' (cwd None) >7fc7681e-8725-425e-88ea-fd4cfdcab46e::DEBUG::2014-07-10 09:01:11,665::blockVolume::572::Storage.Misc.excCmd::(getMetadata) SUCCESS: <err> = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.000623272 s, 821 kB/s\n'; <rc> = 0 >7fc7681e-8725-425e-88ea-fd4cfdcab46e::DEBUG::2014-07-10 09:01:11,665::misc::282::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.000623272 s, 821 kB/s'], size: 512 >7fc7681e-8725-425e-88ea-fd4cfdcab46e::DEBUG::2014-07-10 09:01:11,666::resourceManager::198::ResourceManager.Request::(__init__) ResName=`9e1aa540-1f4e-4ee3-a152-be381ef6c3bd_imageNS.76fdb054-02cd-42ed-9721-b3e65b34c3a4`ReqID=`922f92a0-89c7-493c-a655-8405584f8965`::Request was made in '/usr/share/vdsm/storage/sp.py' line '1767' at 'createVolume' >7fc7681e-8725-425e-88ea-fd4cfdcab46e::DEBUG::2014-07-10 09:01:11,666::resourceManager::542::ResourceManager::(registerResource) Trying to register resource '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd_imageNS.76fdb054-02cd-42ed-9721-b3e65b34c3a4' for lock type 'exclusive' >7fc7681e-8725-425e-88ea-fd4cfdcab46e::DEBUG::2014-07-10 09:01:11,667::lvm::427::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' got the operation mutex >7fc7681e-8725-425e-88ea-fd4cfdcab46e::DEBUG::2014-07-10 09:01:11,668::lvm::296::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm lvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/3600601601282300032826addbbdae311|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,vg_name,attr,size,seg_start_pe,devices,tags 9e1aa540-1f4e-4ee3-a152-be381ef6c3bd' (cwd None) >7fc7681e-8725-425e-88ea-fd4cfdcab46e::DEBUG::2014-07-10 09:01:11,908::lvm::296::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >7fc7681e-8725-425e-88ea-fd4cfdcab46e::DEBUG::2014-07-10 09:01:11,917::lvm::462::Storage.LVM::(_reloadlvs) lvs reloaded >7fc7681e-8725-425e-88ea-fd4cfdcab46e::DEBUG::2014-07-10 09:01:11,917::lvm::462::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' released the operation mutex >7fc7681e-8725-425e-88ea-fd4cfdcab46e::DEBUG::2014-07-10 09:01:11,918::resourceFactories::125::Storage.ResourcesFactories::(__getResourceCandidatesList) Image 76fdb054-02cd-42ed-9721-b3e65b34c3a4 does not exist in domain 9e1aa540-1f4e-4ee3-a152-be381ef6c3bd >7fc7681e-8725-425e-88ea-fd4cfdcab46e::DEBUG::2014-07-10 09:01:11,918::resourceManager::601::ResourceManager::(registerResource) Resource '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd_imageNS.76fdb054-02cd-42ed-9721-b3e65b34c3a4' is free. Now locking as 'exclusive' (1 active user) >7fc7681e-8725-425e-88ea-fd4cfdcab46e::DEBUG::2014-07-10 09:01:11,918::resourceManager::238::ResourceManager.Request::(grant) ResName=`9e1aa540-1f4e-4ee3-a152-be381ef6c3bd_imageNS.76fdb054-02cd-42ed-9721-b3e65b34c3a4`ReqID=`922f92a0-89c7-493c-a655-8405584f8965`::Granted request >7fc7681e-8725-425e-88ea-fd4cfdcab46e::INFO::2014-07-10 09:01:11,919::image::123::Storage.Image::(create) Create placeholder /rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/images/76fdb054-02cd-42ed-9721-b3e65b34c3a4 for image's volumes >7fc7681e-8725-425e-88ea-fd4cfdcab46e::DEBUG::2014-07-10 09:01:11,920::task::752::TaskManager.Task::(_save) Task=`7fc7681e-8725-425e-88ea-fd4cfdcab46e`::_save: orig /rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/master/tasks/7fc7681e-8725-425e-88ea-fd4cfdcab46e temp /rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/master/tasks/7fc7681e-8725-425e-88ea-fd4cfdcab46e.temp >7fc7681e-8725-425e-88ea-fd4cfdcab46e::DEBUG::2014-07-10 09:01:11,929::blockVolume::572::Storage.Misc.excCmd::(getMetadata) '/bin/dd iflag=direct skip=4 bs=512 if=/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/metadata count=1' (cwd None) >7fc7681e-8725-425e-88ea-fd4cfdcab46e::DEBUG::2014-07-10 09:01:11,942::blockVolume::572::Storage.Misc.excCmd::(getMetadata) SUCCESS: <err> = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.000657217 s, 779 kB/s\n'; <rc> = 0 >7fc7681e-8725-425e-88ea-fd4cfdcab46e::DEBUG::2014-07-10 09:01:11,943::misc::282::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.000657217 s, 779 kB/s'], size: 512 >7fc7681e-8725-425e-88ea-fd4cfdcab46e::DEBUG::2014-07-10 09:01:11,943::volume::300::Storage.Volume::(share) Share volume 47592965-e853-4e59-9728-d11cca6a7a8a to /rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/images/76fdb054-02cd-42ed-9721-b3e65b34c3a4 >7fc7681e-8725-425e-88ea-fd4cfdcab46e::DEBUG::2014-07-10 09:01:11,944::blockVolume::572::Storage.Misc.excCmd::(getMetadata) '/bin/dd iflag=direct skip=4 bs=512 if=/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/metadata count=1' (cwd None) >7fc7681e-8725-425e-88ea-fd4cfdcab46e::DEBUG::2014-07-10 09:01:11,982::blockVolume::572::Storage.Misc.excCmd::(getMetadata) SUCCESS: <err> = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.0257778 s, 19.9 kB/s\n'; <rc> = 0 >7fc7681e-8725-425e-88ea-fd4cfdcab46e::DEBUG::2014-07-10 09:01:11,982::misc::282::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.0257778 s, 19.9 kB/s'], size: 512 >7fc7681e-8725-425e-88ea-fd4cfdcab46e::DEBUG::2014-07-10 09:01:11,983::task::752::TaskManager.Task::(_save) Task=`7fc7681e-8725-425e-88ea-fd4cfdcab46e`::_save: orig /rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/master/tasks/7fc7681e-8725-425e-88ea-fd4cfdcab46e temp /rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/master/tasks/7fc7681e-8725-425e-88ea-fd4cfdcab46e.temp >7fc7681e-8725-425e-88ea-fd4cfdcab46e::DEBUG::2014-07-10 09:01:12,004::blockVolume::353::Storage.Volume::(_share) Share volume 47592965-e853-4e59-9728-d11cca6a7a8a to /rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/images/76fdb054-02cd-42ed-9721-b3e65b34c3a4 >7fc7681e-8725-425e-88ea-fd4cfdcab46e::DEBUG::2014-07-10 09:01:12,005::blockVolume::572::Storage.Misc.excCmd::(getMetadata) '/bin/dd iflag=direct skip=4 bs=512 if=/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/metadata count=1' (cwd None) >7fc7681e-8725-425e-88ea-fd4cfdcab46e::DEBUG::2014-07-10 09:01:12,017::blockVolume::572::Storage.Misc.excCmd::(getMetadata) SUCCESS: <err> = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.000573639 s, 893 kB/s\n'; <rc> = 0 >7fc7681e-8725-425e-88ea-fd4cfdcab46e::DEBUG::2014-07-10 09:01:12,017::misc::282::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.000573639 s, 893 kB/s'], size: 512 >7fc7681e-8725-425e-88ea-fd4cfdcab46e::INFO::2014-07-10 09:01:12,017::volume::443::Storage.Volume::(create) Creating volume 022dfe46-2cf7-4915-80b3-883158e3ca83 >7fc7681e-8725-425e-88ea-fd4cfdcab46e::DEBUG::2014-07-10 09:01:12,019::task::752::TaskManager.Task::(_save) Task=`7fc7681e-8725-425e-88ea-fd4cfdcab46e`::_save: orig /rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/master/tasks/7fc7681e-8725-425e-88ea-fd4cfdcab46e temp /rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/master/tasks/7fc7681e-8725-425e-88ea-fd4cfdcab46e.temp >7fc7681e-8725-425e-88ea-fd4cfdcab46e::DEBUG::2014-07-10 09:01:12,029::task::752::TaskManager.Task::(_save) Task=`7fc7681e-8725-425e-88ea-fd4cfdcab46e`::_save: orig /rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/master/tasks/7fc7681e-8725-425e-88ea-fd4cfdcab46e temp /rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/master/tasks/7fc7681e-8725-425e-88ea-fd4cfdcab46e.temp >7fc7681e-8725-425e-88ea-fd4cfdcab46e::DEBUG::2014-07-10 09:01:12,039::lvm::296::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm lvcreate --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/3600601601282300032826addbbdae311|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } " --autobackup n --contiguous n --size 1024m --addtag OVIRT_VOL_INITIALIZING --name 022dfe46-2cf7-4915-80b3-883158e3ca83 9e1aa540-1f4e-4ee3-a152-be381ef6c3bd' (cwd None) >7fc7681e-8725-425e-88ea-fd4cfdcab46e::DEBUG::2014-07-10 09:01:12,336::lvm::296::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ' WARNING: This metadata update is NOT backed up\n WARNING: This metadata update is NOT backed up\n'; <rc> = 0 >7fc7681e-8725-425e-88ea-fd4cfdcab46e::DEBUG::2014-07-10 09:01:12,337::lvm::503::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >7fc7681e-8725-425e-88ea-fd4cfdcab46e::DEBUG::2014-07-10 09:01:12,344::lvm::505::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >7fc7681e-8725-425e-88ea-fd4cfdcab46e::DEBUG::2014-07-10 09:01:12,345::lvm::513::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >7fc7681e-8725-425e-88ea-fd4cfdcab46e::DEBUG::2014-07-10 09:01:12,345::lvm::525::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >7fc7681e-8725-425e-88ea-fd4cfdcab46e::WARNING::2014-07-10 09:01:12,345::utils::129::root::(rmFile) File: /rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/images/76fdb054-02cd-42ed-9721-b3e65b34c3a4/022dfe46-2cf7-4915-80b3-883158e3ca83 already removed >7fc7681e-8725-425e-88ea-fd4cfdcab46e::INFO::2014-07-10 09:01:12,346::blockVolume::169::Storage.Volume::(_create) Request to create snapshot 76fdb054-02cd-42ed-9721-b3e65b34c3a4/022dfe46-2cf7-4915-80b3-883158e3ca83 of volume 9cf413b7-7f14-4a61-8c71-913e5b0ea9c0/47592965-e853-4e59-9728-d11cca6a7a8a >7fc7681e-8725-425e-88ea-fd4cfdcab46e::DEBUG::2014-07-10 09:01:12,347::task::752::TaskManager.Task::(_save) Task=`7fc7681e-8725-425e-88ea-fd4cfdcab46e`::_save: orig /rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/master/tasks/7fc7681e-8725-425e-88ea-fd4cfdcab46e temp /rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/master/tasks/7fc7681e-8725-425e-88ea-fd4cfdcab46e.temp >7fc7681e-8725-425e-88ea-fd4cfdcab46e::DEBUG::2014-07-10 09:01:12,359::blockVolume::572::Storage.Misc.excCmd::(getMetadata) '/bin/dd iflag=direct skip=4 bs=512 if=/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/metadata count=1' (cwd None) >7fc7681e-8725-425e-88ea-fd4cfdcab46e::DEBUG::2014-07-10 09:01:12,371::blockVolume::572::Storage.Misc.excCmd::(getMetadata) SUCCESS: <err> = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.000498858 s, 1.0 MB/s\n'; <rc> = 0 >7fc7681e-8725-425e-88ea-fd4cfdcab46e::DEBUG::2014-07-10 09:01:12,372::misc::282::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.000498858 s, 1.0 MB/s'], size: 512 >7fc7681e-8725-425e-88ea-fd4cfdcab46e::INFO::2014-07-10 09:01:12,372::volume::789::Storage.Volume::(prepare) Volume: preparing volume 9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/47592965-e853-4e59-9728-d11cca6a7a8a >7fc7681e-8725-425e-88ea-fd4cfdcab46e::DEBUG::2014-07-10 09:01:12,373::blockVolume::572::Storage.Misc.excCmd::(getMetadata) '/bin/dd iflag=direct skip=4 bs=512 if=/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/metadata count=1' (cwd None) >7fc7681e-8725-425e-88ea-fd4cfdcab46e::DEBUG::2014-07-10 09:01:12,385::blockVolume::572::Storage.Misc.excCmd::(getMetadata) SUCCESS: <err> = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.000439698 s, 1.2 MB/s\n'; <rc> = 0 >7fc7681e-8725-425e-88ea-fd4cfdcab46e::DEBUG::2014-07-10 09:01:12,386::misc::282::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.000439698 s, 1.2 MB/s'], size: 512 >7fc7681e-8725-425e-88ea-fd4cfdcab46e::DEBUG::2014-07-10 09:01:12,387::resourceManager::198::ResourceManager.Request::(__init__) ResName=`9e1aa540-1f4e-4ee3-a152-be381ef6c3bd_lvmActivationNS.47592965-e853-4e59-9728-d11cca6a7a8a`ReqID=`ea50071e-4dcb-4787-9f14-430ceb7ecacd`::Request was made in '/usr/share/vdsm/storage/volume.py' line '806' at 'prepare' >7fc7681e-8725-425e-88ea-fd4cfdcab46e::DEBUG::2014-07-10 09:01:12,387::resourceManager::542::ResourceManager::(registerResource) Trying to register resource '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd_lvmActivationNS.47592965-e853-4e59-9728-d11cca6a7a8a' for lock type 'shared' >7fc7681e-8725-425e-88ea-fd4cfdcab46e::DEBUG::2014-07-10 09:01:12,388::resourceManager::601::ResourceManager::(registerResource) Resource '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd_lvmActivationNS.47592965-e853-4e59-9728-d11cca6a7a8a' is free. Now locking as 'shared' (1 active user) >7fc7681e-8725-425e-88ea-fd4cfdcab46e::DEBUG::2014-07-10 09:01:12,388::resourceManager::238::ResourceManager.Request::(grant) ResName=`9e1aa540-1f4e-4ee3-a152-be381ef6c3bd_lvmActivationNS.47592965-e853-4e59-9728-d11cca6a7a8a`ReqID=`ea50071e-4dcb-4787-9f14-430ceb7ecacd`::Granted request >7fc7681e-8725-425e-88ea-fd4cfdcab46e::DEBUG::2014-07-10 09:01:12,389::blockVolume::572::Storage.Misc.excCmd::(getMetadata) '/bin/dd iflag=direct skip=4 bs=512 if=/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/metadata count=1' (cwd None) >7fc7681e-8725-425e-88ea-fd4cfdcab46e::DEBUG::2014-07-10 09:01:12,402::blockVolume::572::Storage.Misc.excCmd::(getMetadata) SUCCESS: <err> = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.000423801 s, 1.2 MB/s\n'; <rc> = 0 >7fc7681e-8725-425e-88ea-fd4cfdcab46e::DEBUG::2014-07-10 09:01:12,403::misc::282::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.000423801 s, 1.2 MB/s'], size: 512 >7fc7681e-8725-425e-88ea-fd4cfdcab46e::DEBUG::2014-07-10 09:01:12,403::volume::270::Storage.Volume::(clone) Volume.clone: /rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/images/76fdb054-02cd-42ed-9721-b3e65b34c3a4/47592965-e853-4e59-9728-d11cca6a7a8a to /rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/images/76fdb054-02cd-42ed-9721-b3e65b34c3a4/022dfe46-2cf7-4915-80b3-883158e3ca83 >7fc7681e-8725-425e-88ea-fd4cfdcab46e::DEBUG::2014-07-10 09:01:12,404::blockVolume::572::Storage.Misc.excCmd::(getMetadata) '/bin/dd iflag=direct skip=4 bs=512 if=/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/metadata count=1' (cwd None) >7fc7681e-8725-425e-88ea-fd4cfdcab46e::DEBUG::2014-07-10 09:01:12,415::blockVolume::572::Storage.Misc.excCmd::(getMetadata) SUCCESS: <err> = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.000460442 s, 1.1 MB/s\n'; <rc> = 0 >7fc7681e-8725-425e-88ea-fd4cfdcab46e::DEBUG::2014-07-10 09:01:12,416::misc::282::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.000460442 s, 1.1 MB/s'], size: 512 >7fc7681e-8725-425e-88ea-fd4cfdcab46e::DEBUG::2014-07-10 09:01:12,416::blockVolume::572::Storage.Misc.excCmd::(getMetadata) '/bin/dd iflag=direct skip=4 bs=512 if=/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/metadata count=1' (cwd None) >7fc7681e-8725-425e-88ea-fd4cfdcab46e::DEBUG::2014-07-10 09:01:12,455::blockVolume::572::Storage.Misc.excCmd::(getMetadata) SUCCESS: <err> = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.0278362 s, 18.4 kB/s\n'; <rc> = 0 >7fc7681e-8725-425e-88ea-fd4cfdcab46e::DEBUG::2014-07-10 09:01:12,456::misc::282::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.0278362 s, 18.4 kB/s'], size: 512 >7fc7681e-8725-425e-88ea-fd4cfdcab46e::DEBUG::2014-07-10 09:01:12,457::volume::1042::Storage.Misc.excCmd::(createVolume) '/usr/bin/qemu-img create -f qcow2 -F raw -b ../76fdb054-02cd-42ed-9721-b3e65b34c3a4/47592965-e853-4e59-9728-d11cca6a7a8a /rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/images/76fdb054-02cd-42ed-9721-b3e65b34c3a4/022dfe46-2cf7-4915-80b3-883158e3ca83' (cwd /rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/images/76fdb054-02cd-42ed-9721-b3e65b34c3a4) >7fc7681e-8725-425e-88ea-fd4cfdcab46e::DEBUG::2014-07-10 09:01:12,515::volume::1042::Storage.Misc.excCmd::(createVolume) SUCCESS: <err> = ''; <rc> = 0 >7fc7681e-8725-425e-88ea-fd4cfdcab46e::INFO::2014-07-10 09:01:12,515::blockVolume::393::Storage.Volume::(teardown) Tearing down volume 9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/47592965-e853-4e59-9728-d11cca6a7a8a justme False >7fc7681e-8725-425e-88ea-fd4cfdcab46e::DEBUG::2014-07-10 09:01:12,515::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd_lvmActivationNS.47592965-e853-4e59-9728-d11cca6a7a8a' >7fc7681e-8725-425e-88ea-fd4cfdcab46e::DEBUG::2014-07-10 09:01:12,516::resourceManager::635::ResourceManager::(releaseResource) Released resource '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd_lvmActivationNS.47592965-e853-4e59-9728-d11cca6a7a8a' (0 active users) >7fc7681e-8725-425e-88ea-fd4cfdcab46e::DEBUG::2014-07-10 09:01:12,516::resourceManager::641::ResourceManager::(releaseResource) Resource '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd_lvmActivationNS.47592965-e853-4e59-9728-d11cca6a7a8a' is free, finding out if anyone is waiting for it. >7fc7681e-8725-425e-88ea-fd4cfdcab46e::DEBUG::2014-07-10 09:01:12,517::lvm::296::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm lvchange --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/3600601601282300032826addbbdae311|/dev/mapper/360060160f4a030003840ec867ddee311|/dev/mapper/367cad74c2fcba00019e6afd20c781e67|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } " --autobackup n --available n 9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/47592965-e853-4e59-9728-d11cca6a7a8a' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:01:12,730::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >GuestMonitor-scale_1::DEBUG::2014-07-10 09:01:12,756::vm::598::vm.Vm::(_getCpuStats) vmId=`ed909f7e-0ee2-4f6f-b4a5-a165f689a276`::CPU stats not available: 'NoneType' object is unsubscriptable >GuestMonitor-scale_1::DEBUG::2014-07-10 09:01:12,759::vm::654::vm.Vm::(_getNetworkStats) vmId=`ed909f7e-0ee2-4f6f-b4a5-a165f689a276`::Network stats not available >GuestMonitor-scale_1::DEBUG::2014-07-10 09:01:12,762::vm::676::vm.Vm::(_getDiskStats) vmId=`ed909f7e-0ee2-4f6f-b4a5-a165f689a276`::Disk hdd stats not available >GuestMonitor-scale_1::DEBUG::2014-07-10 09:01:12,764::vm::676::vm.Vm::(_getDiskStats) vmId=`ed909f7e-0ee2-4f6f-b4a5-a165f689a276`::Disk hdc stats not available >GuestMonitor-scale_1::DEBUG::2014-07-10 09:01:12,767::vm::676::vm.Vm::(_getDiskStats) vmId=`ed909f7e-0ee2-4f6f-b4a5-a165f689a276`::Disk vda stats not available >GuestMonitor-scale_1::DEBUG::2014-07-10 09:01:12,769::vm::715::vm.Vm::(_getDiskLatency) vmId=`ed909f7e-0ee2-4f6f-b4a5-a165f689a276`::Disk hdd latency not available >GuestMonitor-scale_1::DEBUG::2014-07-10 09:01:12,772::vm::715::vm.Vm::(_getDiskLatency) vmId=`ed909f7e-0ee2-4f6f-b4a5-a165f689a276`::Disk hdc latency not available >GuestMonitor-scale_1::DEBUG::2014-07-10 09:01:12,774::vm::715::vm.Vm::(_getDiskLatency) vmId=`ed909f7e-0ee2-4f6f-b4a5-a165f689a276`::Disk vda latency not available >GuestMonitor-scale_1::DEBUG::2014-07-10 09:01:12,781::vm::598::vm.Vm::(_getCpuStats) vmId=`ed909f7e-0ee2-4f6f-b4a5-a165f689a276`::CPU stats not available: 'NoneType' object is unsubscriptable >GuestMonitor-scale_1::DEBUG::2014-07-10 09:01:12,784::vm::654::vm.Vm::(_getNetworkStats) vmId=`ed909f7e-0ee2-4f6f-b4a5-a165f689a276`::Network stats not available >GuestMonitor-scale_1::DEBUG::2014-07-10 09:01:12,786::vm::676::vm.Vm::(_getDiskStats) vmId=`ed909f7e-0ee2-4f6f-b4a5-a165f689a276`::Disk hdd stats not available >GuestMonitor-scale_1::DEBUG::2014-07-10 09:01:12,788::vm::676::vm.Vm::(_getDiskStats) vmId=`ed909f7e-0ee2-4f6f-b4a5-a165f689a276`::Disk hdc stats not available >GuestMonitor-scale_1::DEBUG::2014-07-10 09:01:12,791::vm::676::vm.Vm::(_getDiskStats) vmId=`ed909f7e-0ee2-4f6f-b4a5-a165f689a276`::Disk vda stats not available >GuestMonitor-scale_1::DEBUG::2014-07-10 09:01:12,794::vm::715::vm.Vm::(_getDiskLatency) vmId=`ed909f7e-0ee2-4f6f-b4a5-a165f689a276`::Disk hdd latency not available >GuestMonitor-scale_1::DEBUG::2014-07-10 09:01:12,796::vm::715::vm.Vm::(_getDiskLatency) vmId=`ed909f7e-0ee2-4f6f-b4a5-a165f689a276`::Disk hdc latency not available >GuestMonitor-scale_1::DEBUG::2014-07-10 09:01:12,798::vm::715::vm.Vm::(_getDiskLatency) vmId=`ed909f7e-0ee2-4f6f-b4a5-a165f689a276`::Disk vda latency not available >Dummy-33::DEBUG::2014-07-10 09:01:12,873::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0912731 s, 11.2 MB/s\n'; <rc> = 0 >Thread-40::DEBUG::2014-07-10 09:01:13,937::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lion.qa.lab.tlv.redhat.com:_export_yuri2_backup2/6a70504d-00df-4869-8695-0f442053f6b6/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-40::DEBUG::2014-07-10 09:01:13,951::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n369 bytes (369 B) copied, 0.000458586 s, 805 kB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 09:01:14,025::task::595::TaskManager.Task::(_updateState) Task=`c051e7d6-6222-4cd0-9323-b7ff140a94e7`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 09:01:14,026::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::INFO::2014-07-10 09:01:14,026::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000673638', 'lastCheck': '8.2', 'valid': True}, '6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000458586', 'lastCheck': '0.1', 'valid': True}} >Thread-14::DEBUG::2014-07-10 09:01:14,026::task::1185::TaskManager.Task::(prepare) Task=`c051e7d6-6222-4cd0-9323-b7ff140a94e7`::finished: {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000673638', 'lastCheck': '8.2', 'valid': True}, '6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000458586', 'lastCheck': '0.1', 'valid': True}} >Thread-14::DEBUG::2014-07-10 09:01:14,027::task::595::TaskManager.Task::(_updateState) Task=`c051e7d6-6222-4cd0-9323-b7ff140a94e7`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 09:01:14,027::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 09:01:14,027::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 09:01:14,027::task::990::TaskManager.Task::(_decref) Task=`c051e7d6-6222-4cd0-9323-b7ff140a94e7`::ref 0 aborting False >Thread-14::DEBUG::2014-07-10 09:01:14,040::vm::598::vm.Vm::(_getCpuStats) vmId=`ed909f7e-0ee2-4f6f-b4a5-a165f689a276`::CPU stats not available: 'NoneType' object is unsubscriptable >Thread-14::DEBUG::2014-07-10 09:01:14,040::vm::654::vm.Vm::(_getNetworkStats) vmId=`ed909f7e-0ee2-4f6f-b4a5-a165f689a276`::Network stats not available >Thread-14::DEBUG::2014-07-10 09:01:14,040::vm::676::vm.Vm::(_getDiskStats) vmId=`ed909f7e-0ee2-4f6f-b4a5-a165f689a276`::Disk hdd stats not available >Thread-14::DEBUG::2014-07-10 09:01:14,041::vm::676::vm.Vm::(_getDiskStats) vmId=`ed909f7e-0ee2-4f6f-b4a5-a165f689a276`::Disk hdc stats not available >Thread-14::DEBUG::2014-07-10 09:01:14,041::vm::676::vm.Vm::(_getDiskStats) vmId=`ed909f7e-0ee2-4f6f-b4a5-a165f689a276`::Disk vda stats not available >Thread-14::DEBUG::2014-07-10 09:01:14,041::vm::715::vm.Vm::(_getDiskLatency) vmId=`ed909f7e-0ee2-4f6f-b4a5-a165f689a276`::Disk hdd latency not available >Thread-14::DEBUG::2014-07-10 09:01:14,041::vm::715::vm.Vm::(_getDiskLatency) vmId=`ed909f7e-0ee2-4f6f-b4a5-a165f689a276`::Disk hdc latency not available >Thread-14::DEBUG::2014-07-10 09:01:14,041::vm::715::vm.Vm::(_getDiskLatency) vmId=`ed909f7e-0ee2-4f6f-b4a5-a165f689a276`::Disk vda latency not available >Dummy-33::DEBUG::2014-07-10 09:01:14,888::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:01:14,968::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0278981 s, 36.7 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 09:01:15,172::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-14::DEBUG::2014-07-10 09:01:15,173::task::595::TaskManager.Task::(_updateState) Task=`75b75cd1-7859-4d99-96f2-ca0c7a62a55c`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 09:01:15,173::logUtils::44::dispatcher::(wrapper) Run and protect: getAllTasksStatuses(spUUID=None, options=None) >Thread-14::DEBUG::2014-07-10 09:01:15,174::taskManager::102::TaskManager::(getAllTasksStatuses) Entry. >Thread-14::DEBUG::2014-07-10 09:01:15,174::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 7fc7681e-8725-425e-88ea-fd4cfdcab46e >Thread-14::DEBUG::2014-07-10 09:01:15,174::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '7fc7681e-8725-425e-88ea-fd4cfdcab46e'} >Thread-14::DEBUG::2014-07-10 09:01:15,174::taskManager::113::TaskManager::(getAllTasksStatuses) Return: {'7fc7681e-8725-425e-88ea-fd4cfdcab46e': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '7fc7681e-8725-425e-88ea-fd4cfdcab46e'}} >Thread-14::INFO::2014-07-10 09:01:15,174::logUtils::47::dispatcher::(wrapper) Run and protect: getAllTasksStatuses, Return response: {'allTasksStatus': {'7fc7681e-8725-425e-88ea-fd4cfdcab46e': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '7fc7681e-8725-425e-88ea-fd4cfdcab46e'}}} >Thread-14::DEBUG::2014-07-10 09:01:15,175::task::1185::TaskManager.Task::(prepare) Task=`75b75cd1-7859-4d99-96f2-ca0c7a62a55c`::finished: {'allTasksStatus': {'7fc7681e-8725-425e-88ea-fd4cfdcab46e': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '7fc7681e-8725-425e-88ea-fd4cfdcab46e'}}} >Thread-14::DEBUG::2014-07-10 09:01:15,175::task::595::TaskManager.Task::(_updateState) Task=`75b75cd1-7859-4d99-96f2-ca0c7a62a55c`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 09:01:15,175::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 09:01:15,175::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 09:01:15,175::task::990::TaskManager.Task::(_decref) Task=`75b75cd1-7859-4d99-96f2-ca0c7a62a55c`::ref 0 aborting False >Thread-18::DEBUG::2014-07-10 09:01:15,863::lvm::373::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-18::DEBUG::2014-07-10 09:01:15,864::lvm::296::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/3600601601282300032826addbbdae311|/dev/mapper/360060160f4a030003840ec867ddee311|/dev/mapper/367cad74c2fcba00019e6afd20c781e67|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name 9e1aa540-1f4e-4ee3-a152-be381ef6c3bd' (cwd None) >Thread-18::DEBUG::2014-07-10 09:01:16,089::lvm::296::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-18::DEBUG::2014-07-10 09:01:16,091::lvm::415::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-18::DEBUG::2014-07-10 09:01:16,092::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/metadata bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-10 09:01:16,113::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00846658 s, 484 kB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:01:16,984::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:01:17,067::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0328236 s, 31.2 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 09:01:17,123::BindingXMLRPC::1067::vds::(wrapper) client [10.35.3.13]::call vmGetStats with ('ed909f7e-0ee2-4f6f-b4a5-a165f689a276',) {} >Thread-14::DEBUG::2014-07-10 09:01:17,124::vm::598::vm.Vm::(_getCpuStats) vmId=`ed909f7e-0ee2-4f6f-b4a5-a165f689a276`::CPU stats not available: 'NoneType' object is unsubscriptable >Thread-14::DEBUG::2014-07-10 09:01:17,124::vm::654::vm.Vm::(_getNetworkStats) vmId=`ed909f7e-0ee2-4f6f-b4a5-a165f689a276`::Network stats not available >Thread-14::DEBUG::2014-07-10 09:01:17,124::vm::676::vm.Vm::(_getDiskStats) vmId=`ed909f7e-0ee2-4f6f-b4a5-a165f689a276`::Disk hdd stats not available >Thread-14::DEBUG::2014-07-10 09:01:17,124::vm::676::vm.Vm::(_getDiskStats) vmId=`ed909f7e-0ee2-4f6f-b4a5-a165f689a276`::Disk hdc stats not available >Thread-14::DEBUG::2014-07-10 09:01:17,125::vm::676::vm.Vm::(_getDiskStats) vmId=`ed909f7e-0ee2-4f6f-b4a5-a165f689a276`::Disk vda stats not available >Thread-14::DEBUG::2014-07-10 09:01:17,125::vm::715::vm.Vm::(_getDiskLatency) vmId=`ed909f7e-0ee2-4f6f-b4a5-a165f689a276`::Disk hdd latency not available >Thread-14::DEBUG::2014-07-10 09:01:17,125::vm::715::vm.Vm::(_getDiskLatency) vmId=`ed909f7e-0ee2-4f6f-b4a5-a165f689a276`::Disk hdc latency not available >Thread-14::DEBUG::2014-07-10 09:01:17,125::vm::715::vm.Vm::(_getDiskLatency) vmId=`ed909f7e-0ee2-4f6f-b4a5-a165f689a276`::Disk vda latency not available >Thread-14::DEBUG::2014-07-10 09:01:17,126::BindingXMLRPC::1074::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Powering up', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '11613', 'displayIp': '0', 'displayPort': u'5900', 'session': 'Unknown', 'displaySecurePort': u'5901', 'timeOffset': '0', 'hash': '7841224975033595397', 'balloonInfo': {'balloon_max': '1048576', 'balloon_target': '1048576', 'balloon_cur': '0', 'balloon_min': '1048576'}, 'pauseCode': 'NOERR', 'clientIp': '', 'kvmEnable': 'true', 'network': {u'vnet0': {'state': 'unknown', 'macAddr': '00:1a:4a:de:6d:7a', 'speed': '1000', 'name': u'vnet0'}}, 'vmId': 'ed909f7e-0ee2-4f6f-b4a5-a165f689a276', 'displayType': 'qxl', 'cpuUser': '0.00', 'disks': {u'vda': {'truesize': '1073741824', 'apparentsize': '1073741824', 'imageID': '0cd7d6ce-f497-4243-a690-c57744861eea'}, u'hdd': {'truesize': '0', 'apparentsize': '0'}, u'hdc': {'truesize': '0', 'apparentsize': '0'}}, 'monitorResponse': '0', 'statsAge': '1.70', 'elapsedTime': '10', 'vmType': 'kvm', 'cpuSys': '0.00', 'guestCPUCount': -1, 'appsList': [], 'guestIPs': ''}]} >7fc7681e-8725-425e-88ea-fd4cfdcab46e::DEBUG::2014-07-10 09:01:17,561::lvm::296::Storage.Misc.excCmd::(cmd) FAILED: <err> = ' Logical volume 9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/47592965-e853-4e59-9728-d11cca6a7a8a in use.\n'; <rc> = 5 >7fc7681e-8725-425e-88ea-fd4cfdcab46e::DEBUG::2014-07-10 09:01:17,564::lvm::513::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >7fc7681e-8725-425e-88ea-fd4cfdcab46e::DEBUG::2014-07-10 09:01:17,565::lvm::525::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >7fc7681e-8725-425e-88ea-fd4cfdcab46e::WARNING::2014-07-10 09:01:17,565::resourceFactories::61::Storage.ResourcesFactories::(close) Failure deactivate LV 9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/47592965-e853-4e59-9728-d11cca6a7a8a (Cannot deactivate Logical Volume: ('General Storage Exception: ("5 [] [\' Logical volume 9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/47592965-e853-4e59-9728-d11cca6a7a8a in use.\']\\n9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/[\'47592965-e853-4e59-9728-d11cca6a7a8a\']",)',)) >7fc7681e-8725-425e-88ea-fd4cfdcab46e::DEBUG::2014-07-10 09:01:17,565::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd_lvmActivationNS.47592965-e853-4e59-9728-d11cca6a7a8a', Clearing records. >7fc7681e-8725-425e-88ea-fd4cfdcab46e::DEBUG::2014-07-10 09:01:17,566::lvm::427::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' got the operation mutex >7fc7681e-8725-425e-88ea-fd4cfdcab46e::DEBUG::2014-07-10 09:01:17,566::lvm::296::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm lvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/3600601601282300032826addbbdae311|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,vg_name,attr,size,seg_start_pe,devices,tags 9e1aa540-1f4e-4ee3-a152-be381ef6c3bd' (cwd None) >7fc7681e-8725-425e-88ea-fd4cfdcab46e::DEBUG::2014-07-10 09:01:17,756::lvm::296::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >7fc7681e-8725-425e-88ea-fd4cfdcab46e::DEBUG::2014-07-10 09:01:17,767::lvm::462::Storage.LVM::(_reloadlvs) lvs reloaded >7fc7681e-8725-425e-88ea-fd4cfdcab46e::DEBUG::2014-07-10 09:01:17,767::lvm::462::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' released the operation mutex >7fc7681e-8725-425e-88ea-fd4cfdcab46e::DEBUG::2014-07-10 09:01:17,767::lvm::427::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' got the operation mutex >7fc7681e-8725-425e-88ea-fd4cfdcab46e::DEBUG::2014-07-10 09:01:17,768::lvm::296::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm lvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/3600601601282300032826addbbdae311|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,vg_name,attr,size,seg_start_pe,devices,tags 9e1aa540-1f4e-4ee3-a152-be381ef6c3bd' (cwd None) >GuestMonitor-scale_1::DEBUG::2014-07-10 09:01:17,808::vm::598::vm.Vm::(_getCpuStats) vmId=`ed909f7e-0ee2-4f6f-b4a5-a165f689a276`::CPU stats not available: 'NoneType' object is unsubscriptable >GuestMonitor-scale_1::DEBUG::2014-07-10 09:01:17,810::vm::654::vm.Vm::(_getNetworkStats) vmId=`ed909f7e-0ee2-4f6f-b4a5-a165f689a276`::Network stats not available >GuestMonitor-scale_1::DEBUG::2014-07-10 09:01:17,810::vm::676::vm.Vm::(_getDiskStats) vmId=`ed909f7e-0ee2-4f6f-b4a5-a165f689a276`::Disk hdd stats not available >GuestMonitor-scale_1::DEBUG::2014-07-10 09:01:17,810::vm::676::vm.Vm::(_getDiskStats) vmId=`ed909f7e-0ee2-4f6f-b4a5-a165f689a276`::Disk hdc stats not available >GuestMonitor-scale_1::DEBUG::2014-07-10 09:01:17,811::vm::676::vm.Vm::(_getDiskStats) vmId=`ed909f7e-0ee2-4f6f-b4a5-a165f689a276`::Disk vda stats not available >GuestMonitor-scale_1::DEBUG::2014-07-10 09:01:17,811::vm::715::vm.Vm::(_getDiskLatency) vmId=`ed909f7e-0ee2-4f6f-b4a5-a165f689a276`::Disk hdd latency not available >GuestMonitor-scale_1::DEBUG::2014-07-10 09:01:17,812::vm::715::vm.Vm::(_getDiskLatency) vmId=`ed909f7e-0ee2-4f6f-b4a5-a165f689a276`::Disk hdc latency not available >GuestMonitor-scale_1::DEBUG::2014-07-10 09:01:17,812::vm::715::vm.Vm::(_getDiskLatency) vmId=`ed909f7e-0ee2-4f6f-b4a5-a165f689a276`::Disk vda latency not available >GuestMonitor-scale_1::DEBUG::2014-07-10 09:01:17,813::vm::598::vm.Vm::(_getCpuStats) vmId=`ed909f7e-0ee2-4f6f-b4a5-a165f689a276`::CPU stats not available: 'NoneType' object is unsubscriptable >GuestMonitor-scale_1::DEBUG::2014-07-10 09:01:17,813::vm::654::vm.Vm::(_getNetworkStats) vmId=`ed909f7e-0ee2-4f6f-b4a5-a165f689a276`::Network stats not available >GuestMonitor-scale_1::DEBUG::2014-07-10 09:01:17,814::vm::676::vm.Vm::(_getDiskStats) vmId=`ed909f7e-0ee2-4f6f-b4a5-a165f689a276`::Disk hdd stats not available >GuestMonitor-scale_1::DEBUG::2014-07-10 09:01:17,814::vm::676::vm.Vm::(_getDiskStats) vmId=`ed909f7e-0ee2-4f6f-b4a5-a165f689a276`::Disk hdc stats not available >GuestMonitor-scale_1::DEBUG::2014-07-10 09:01:17,814::vm::676::vm.Vm::(_getDiskStats) vmId=`ed909f7e-0ee2-4f6f-b4a5-a165f689a276`::Disk vda stats not available >GuestMonitor-scale_1::DEBUG::2014-07-10 09:01:17,815::vm::715::vm.Vm::(_getDiskLatency) vmId=`ed909f7e-0ee2-4f6f-b4a5-a165f689a276`::Disk hdd latency not available >GuestMonitor-scale_1::DEBUG::2014-07-10 09:01:17,815::vm::715::vm.Vm::(_getDiskLatency) vmId=`ed909f7e-0ee2-4f6f-b4a5-a165f689a276`::Disk hdc latency not available >GuestMonitor-scale_1::DEBUG::2014-07-10 09:01:17,815::vm::715::vm.Vm::(_getDiskLatency) vmId=`ed909f7e-0ee2-4f6f-b4a5-a165f689a276`::Disk vda latency not available >7fc7681e-8725-425e-88ea-fd4cfdcab46e::DEBUG::2014-07-10 09:01:17,954::lvm::296::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >7fc7681e-8725-425e-88ea-fd4cfdcab46e::DEBUG::2014-07-10 09:01:17,963::lvm::462::Storage.LVM::(_reloadlvs) lvs reloaded >7fc7681e-8725-425e-88ea-fd4cfdcab46e::DEBUG::2014-07-10 09:01:17,963::lvm::462::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' released the operation mutex >7fc7681e-8725-425e-88ea-fd4cfdcab46e::WARNING::2014-07-10 09:01:17,964::blockSD::761::Storage.StorageDomain::(_getOccupiedMetadataSlots) Could not find mapping for lv 9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/022dfe46-2cf7-4915-80b3-883158e3ca83 >7fc7681e-8725-425e-88ea-fd4cfdcab46e::DEBUG::2014-07-10 09:01:17,964::blockSD::784::Storage.StorageDomain::(getFreeMetadataSlot) Found freeSlot 6 in VG 9e1aa540-1f4e-4ee3-a152-be381ef6c3bd >7fc7681e-8725-425e-88ea-fd4cfdcab46e::DEBUG::2014-07-10 09:01:17,965::lvm::296::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm lvchange --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/3600601601282300032826addbbdae311|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } " --autobackup n --deltag OVIRT_VOL_INITIALIZING --addtag MD_6 --addtag PU_47592965-e853-4e59-9728-d11cca6a7a8a --addtag IU_76fdb054-02cd-42ed-9721-b3e65b34c3a4 9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/022dfe46-2cf7-4915-80b3-883158e3ca83' (cwd None) >7fc7681e-8725-425e-88ea-fd4cfdcab46e::DEBUG::2014-07-10 09:01:18,171::lvm::296::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ' WARNING: This metadata update is NOT backed up\n WARNING: This metadata update is NOT backed up\n'; <rc> = 0 >7fc7681e-8725-425e-88ea-fd4cfdcab46e::DEBUG::2014-07-10 09:01:18,172::lvm::513::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >7fc7681e-8725-425e-88ea-fd4cfdcab46e::DEBUG::2014-07-10 09:01:18,172::lvm::525::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >7fc7681e-8725-425e-88ea-fd4cfdcab46e::DEBUG::2014-07-10 09:01:18,173::lvm::296::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm lvchange --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/3600601601282300032826addbbdae311|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } " --autobackup n --available n 9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/022dfe46-2cf7-4915-80b3-883158e3ca83' (cwd None) >7fc7681e-8725-425e-88ea-fd4cfdcab46e::DEBUG::2014-07-10 09:01:18,545::lvm::296::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >7fc7681e-8725-425e-88ea-fd4cfdcab46e::DEBUG::2014-07-10 09:01:18,546::lvm::513::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >7fc7681e-8725-425e-88ea-fd4cfdcab46e::DEBUG::2014-07-10 09:01:18,546::lvm::525::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >7fc7681e-8725-425e-88ea-fd4cfdcab46e::DEBUG::2014-07-10 09:01:18,548::task::752::TaskManager.Task::(_save) Task=`7fc7681e-8725-425e-88ea-fd4cfdcab46e`::_save: orig /rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/master/tasks/7fc7681e-8725-425e-88ea-fd4cfdcab46e temp /rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/master/tasks/7fc7681e-8725-425e-88ea-fd4cfdcab46e.temp >7fc7681e-8725-425e-88ea-fd4cfdcab46e::DEBUG::2014-07-10 09:01:18,561::blockVolume::604::Storage.Volume::(newVolumeLease) Initializing volume lease volUUID=022dfe46-2cf7-4915-80b3-883158e3ca83 sdUUID=9e1aa540-1f4e-4ee3-a152-be381ef6c3bd, metaId=('9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 6) >7fc7681e-8725-425e-88ea-fd4cfdcab46e::DEBUG::2014-07-10 09:01:18,569::task::752::TaskManager.Task::(_save) Task=`7fc7681e-8725-425e-88ea-fd4cfdcab46e`::_save: orig /rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/master/tasks/7fc7681e-8725-425e-88ea-fd4cfdcab46e temp /rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/master/tasks/7fc7681e-8725-425e-88ea-fd4cfdcab46e.temp >7fc7681e-8725-425e-88ea-fd4cfdcab46e::DEBUG::2014-07-10 09:01:18,578::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd_imageNS.76fdb054-02cd-42ed-9721-b3e65b34c3a4' >7fc7681e-8725-425e-88ea-fd4cfdcab46e::DEBUG::2014-07-10 09:01:18,578::resourceManager::635::ResourceManager::(releaseResource) Released resource '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd_imageNS.76fdb054-02cd-42ed-9721-b3e65b34c3a4' (0 active users) >7fc7681e-8725-425e-88ea-fd4cfdcab46e::DEBUG::2014-07-10 09:01:18,579::resourceManager::641::ResourceManager::(releaseResource) Resource '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd_imageNS.76fdb054-02cd-42ed-9721-b3e65b34c3a4' is free, finding out if anyone is waiting for it. >7fc7681e-8725-425e-88ea-fd4cfdcab46e::DEBUG::2014-07-10 09:01:18,579::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd_imageNS.76fdb054-02cd-42ed-9721-b3e65b34c3a4', Clearing records. >7fc7681e-8725-425e-88ea-fd4cfdcab46e::DEBUG::2014-07-10 09:01:18,579::task::595::TaskManager.Task::(_updateState) Task=`7fc7681e-8725-425e-88ea-fd4cfdcab46e`::moving from state running -> state finished >7fc7681e-8725-425e-88ea-fd4cfdcab46e::DEBUG::2014-07-10 09:01:18,580::task::752::TaskManager.Task::(_save) Task=`7fc7681e-8725-425e-88ea-fd4cfdcab46e`::_save: orig /rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/master/tasks/7fc7681e-8725-425e-88ea-fd4cfdcab46e temp /rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/master/tasks/7fc7681e-8725-425e-88ea-fd4cfdcab46e.temp >7fc7681e-8725-425e-88ea-fd4cfdcab46e::DEBUG::2014-07-10 09:01:18,588::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': < ResourceRef 'Storage.9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', isValid: 'True' obj: 'None'>} >7fc7681e-8725-425e-88ea-fd4cfdcab46e::DEBUG::2014-07-10 09:01:18,588::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >7fc7681e-8725-425e-88ea-fd4cfdcab46e::DEBUG::2014-07-10 09:01:18,589::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.9e1aa540-1f4e-4ee3-a152-be381ef6c3bd' >7fc7681e-8725-425e-88ea-fd4cfdcab46e::DEBUG::2014-07-10 09:01:18,589::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.9e1aa540-1f4e-4ee3-a152-be381ef6c3bd' (0 active users) >7fc7681e-8725-425e-88ea-fd4cfdcab46e::DEBUG::2014-07-10 09:01:18,589::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.9e1aa540-1f4e-4ee3-a152-be381ef6c3bd' is free, finding out if anyone is waiting for it. >7fc7681e-8725-425e-88ea-fd4cfdcab46e::DEBUG::2014-07-10 09:01:18,589::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', Clearing records. >7fc7681e-8725-425e-88ea-fd4cfdcab46e::DEBUG::2014-07-10 09:01:18,590::task::913::TaskManager.Task::(_runJobs) Task=`7fc7681e-8725-425e-88ea-fd4cfdcab46e`::Task.run: exit - success: result {'uuid': '022dfe46-2cf7-4915-80b3-883158e3ca83'} >7fc7681e-8725-425e-88ea-fd4cfdcab46e::DEBUG::2014-07-10 09:01:18,590::task::990::TaskManager.Task::(_decref) Task=`7fc7681e-8725-425e-88ea-fd4cfdcab46e`::ref 0 aborting False >7fc7681e-8725-425e-88ea-fd4cfdcab46e::DEBUG::2014-07-10 09:01:18,590::threadPool::57::Misc.ThreadPool::(setRunningTask) Number of running tasks: 0 >Dummy-33::DEBUG::2014-07-10 09:01:19,082::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:01:19,168::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0341387 s, 30.0 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 09:01:20,152::BindingXMLRPC::1067::vds::(wrapper) client [10.35.3.13]::call vmGetStats with ('ed909f7e-0ee2-4f6f-b4a5-a165f689a276',) {} >Thread-14::DEBUG::2014-07-10 09:01:20,153::vm::598::vm.Vm::(_getCpuStats) vmId=`ed909f7e-0ee2-4f6f-b4a5-a165f689a276`::CPU stats not available: 'NoneType' object is unsubscriptable >Thread-14::DEBUG::2014-07-10 09:01:20,153::vm::654::vm.Vm::(_getNetworkStats) vmId=`ed909f7e-0ee2-4f6f-b4a5-a165f689a276`::Network stats not available >Thread-14::DEBUG::2014-07-10 09:01:20,153::vm::676::vm.Vm::(_getDiskStats) vmId=`ed909f7e-0ee2-4f6f-b4a5-a165f689a276`::Disk hdd stats not available >Thread-14::DEBUG::2014-07-10 09:01:20,154::vm::676::vm.Vm::(_getDiskStats) vmId=`ed909f7e-0ee2-4f6f-b4a5-a165f689a276`::Disk hdc stats not available >Thread-14::DEBUG::2014-07-10 09:01:20,154::vm::676::vm.Vm::(_getDiskStats) vmId=`ed909f7e-0ee2-4f6f-b4a5-a165f689a276`::Disk vda stats not available >Thread-14::DEBUG::2014-07-10 09:01:20,154::vm::715::vm.Vm::(_getDiskLatency) vmId=`ed909f7e-0ee2-4f6f-b4a5-a165f689a276`::Disk hdd latency not available >Thread-14::DEBUG::2014-07-10 09:01:20,154::vm::715::vm.Vm::(_getDiskLatency) vmId=`ed909f7e-0ee2-4f6f-b4a5-a165f689a276`::Disk hdc latency not available >Thread-14::DEBUG::2014-07-10 09:01:20,155::vm::715::vm.Vm::(_getDiskLatency) vmId=`ed909f7e-0ee2-4f6f-b4a5-a165f689a276`::Disk vda latency not available >Thread-14::DEBUG::2014-07-10 09:01:20,155::BindingXMLRPC::1074::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Powering up', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '11613', 'displayIp': '0', 'displayPort': u'5900', 'session': 'Unknown', 'displaySecurePort': u'5901', 'timeOffset': '0', 'hash': '7841224975033595397', 'balloonInfo': {'balloon_max': '1048576', 'balloon_target': '1048576', 'balloon_cur': '0', 'balloon_min': '1048576'}, 'pauseCode': 'NOERR', 'clientIp': '', 'kvmEnable': 'true', 'network': {u'vnet0': {'state': 'unknown', 'macAddr': '00:1a:4a:de:6d:7a', 'speed': '1000', 'name': u'vnet0'}}, 'vmId': 'ed909f7e-0ee2-4f6f-b4a5-a165f689a276', 'displayType': 'qxl', 'cpuUser': '0.00', 'disks': {u'vda': {'truesize': '1073741824', 'apparentsize': '1073741824', 'imageID': '0cd7d6ce-f497-4243-a690-c57744861eea'}, u'hdd': {'truesize': '0', 'apparentsize': '0'}, u'hdc': {'truesize': '0', 'apparentsize': '0'}}, 'monitorResponse': '0', 'statsAge': '0.72', 'elapsedTime': '13', 'vmType': 'kvm', 'cpuSys': '0.00', 'guestCPUCount': -1, 'appsList': [], 'guestIPs': ''}]} >Thread-14::DEBUG::2014-07-10 09:01:21,177::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-14::DEBUG::2014-07-10 09:01:21,178::task::595::TaskManager.Task::(_updateState) Task=`c0e0e7f8-d3c0-446a-996e-781e9be3e16b`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 09:01:21,178::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-14::INFO::2014-07-10 09:01:21,179::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:01:21,179::task::1185::TaskManager.Task::(prepare) Task=`c0e0e7f8-d3c0-446a-996e-781e9be3e16b`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:01:21,179::task::595::TaskManager.Task::(_updateState) Task=`c0e0e7f8-d3c0-446a-996e-781e9be3e16b`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 09:01:21,180::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 09:01:21,180::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 09:01:21,180::task::990::TaskManager.Task::(_decref) Task=`c0e0e7f8-d3c0-446a-996e-781e9be3e16b`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 09:01:21,183::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Thread-34::DEBUG::2014-07-10 09:01:21,195::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-34::DEBUG::2014-07-10 09:01:21,198::task::595::TaskManager.Task::(_updateState) Task=`1d9f8f0d-ae84-4721-bc15-7233b83d911f`::moving from state init -> state preparing >Thread-34::INFO::2014-07-10 09:01:21,199::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-34::DEBUG::2014-07-10 09:01:21,201::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`7abf84dc-e71c-4032-aa25-d4448d6d3523`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-10 09:01:21,202::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' for lock type 'shared' >Thread-34::DEBUG::2014-07-10 09:01:21,203::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-10 09:01:21,204::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`7abf84dc-e71c-4032-aa25-d4448d6d3523`::Granted request >Thread-34::DEBUG::2014-07-10 09:01:21,207::task::827::TaskManager.Task::(resourceAcquired) Task=`1d9f8f0d-ae84-4721-bc15-7233b83d911f`::_resourcesAcquired: Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee (shared) >Thread-34::DEBUG::2014-07-10 09:01:21,208::task::990::TaskManager.Task::(_decref) Task=`1d9f8f0d-ae84-4721-bc15-7233b83d911f`::ref 1 aborting False >Thread-34::INFO::2014-07-10 09:01:21,210::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1082063323136', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532069482496', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:01:21,211::task::1185::TaskManager.Task::(prepare) Task=`1d9f8f0d-ae84-4721-bc15-7233b83d911f`::finished: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1082063323136', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532069482496', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:01:21,211::task::595::TaskManager.Task::(_updateState) Task=`1d9f8f0d-ae84-4721-bc15-7233b83d911f`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-10 09:01:21,212::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee': < ResourceRef 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-10 09:01:21,213::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-10 09:01:21,214::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' >Thread-34::DEBUG::2014-07-10 09:01:21,214::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' (0 active users) >Thread-34::DEBUG::2014-07-10 09:01:21,215::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-10 09:01:21,216::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', Clearing records. >Thread-34::DEBUG::2014-07-10 09:01:21,217::task::990::TaskManager.Task::(_decref) Task=`1d9f8f0d-ae84-4721-bc15-7233b83d911f`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 09:01:21,279::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0451084 s, 22.7 MB/s\n'; <rc> = 0 >GuestMonitor-scale_1::DEBUG::2014-07-10 09:01:22,822::vm::598::vm.Vm::(_getCpuStats) vmId=`ed909f7e-0ee2-4f6f-b4a5-a165f689a276`::CPU stats not available: 'NoneType' object is unsubscriptable >GuestMonitor-scale_1::DEBUG::2014-07-10 09:01:22,823::vm::654::vm.Vm::(_getNetworkStats) vmId=`ed909f7e-0ee2-4f6f-b4a5-a165f689a276`::Network stats not available >GuestMonitor-scale_1::DEBUG::2014-07-10 09:01:22,823::vm::676::vm.Vm::(_getDiskStats) vmId=`ed909f7e-0ee2-4f6f-b4a5-a165f689a276`::Disk hdd stats not available >GuestMonitor-scale_1::DEBUG::2014-07-10 09:01:22,823::vm::676::vm.Vm::(_getDiskStats) vmId=`ed909f7e-0ee2-4f6f-b4a5-a165f689a276`::Disk hdc stats not available >GuestMonitor-scale_1::DEBUG::2014-07-10 09:01:22,824::vm::676::vm.Vm::(_getDiskStats) vmId=`ed909f7e-0ee2-4f6f-b4a5-a165f689a276`::Disk vda stats not available >GuestMonitor-scale_1::DEBUG::2014-07-10 09:01:22,824::vm::715::vm.Vm::(_getDiskLatency) vmId=`ed909f7e-0ee2-4f6f-b4a5-a165f689a276`::Disk hdd latency not available >GuestMonitor-scale_1::DEBUG::2014-07-10 09:01:22,824::vm::715::vm.Vm::(_getDiskLatency) vmId=`ed909f7e-0ee2-4f6f-b4a5-a165f689a276`::Disk hdc latency not available >GuestMonitor-scale_1::DEBUG::2014-07-10 09:01:22,824::vm::715::vm.Vm::(_getDiskLatency) vmId=`ed909f7e-0ee2-4f6f-b4a5-a165f689a276`::Disk vda latency not available >GuestMonitor-scale_1::DEBUG::2014-07-10 09:01:22,825::vm::598::vm.Vm::(_getCpuStats) vmId=`ed909f7e-0ee2-4f6f-b4a5-a165f689a276`::CPU stats not available: 'NoneType' object is unsubscriptable >GuestMonitor-scale_1::DEBUG::2014-07-10 09:01:22,825::vm::654::vm.Vm::(_getNetworkStats) vmId=`ed909f7e-0ee2-4f6f-b4a5-a165f689a276`::Network stats not available >GuestMonitor-scale_1::DEBUG::2014-07-10 09:01:22,825::vm::676::vm.Vm::(_getDiskStats) vmId=`ed909f7e-0ee2-4f6f-b4a5-a165f689a276`::Disk hdd stats not available >GuestMonitor-scale_1::DEBUG::2014-07-10 09:01:22,825::vm::676::vm.Vm::(_getDiskStats) vmId=`ed909f7e-0ee2-4f6f-b4a5-a165f689a276`::Disk hdc stats not available >GuestMonitor-scale_1::DEBUG::2014-07-10 09:01:22,826::vm::676::vm.Vm::(_getDiskStats) vmId=`ed909f7e-0ee2-4f6f-b4a5-a165f689a276`::Disk vda stats not available >GuestMonitor-scale_1::DEBUG::2014-07-10 09:01:22,826::vm::715::vm.Vm::(_getDiskLatency) vmId=`ed909f7e-0ee2-4f6f-b4a5-a165f689a276`::Disk hdd latency not available >GuestMonitor-scale_1::DEBUG::2014-07-10 09:01:22,826::vm::715::vm.Vm::(_getDiskLatency) vmId=`ed909f7e-0ee2-4f6f-b4a5-a165f689a276`::Disk hdc latency not available >GuestMonitor-scale_1::DEBUG::2014-07-10 09:01:22,826::vm::715::vm.Vm::(_getDiskLatency) vmId=`ed909f7e-0ee2-4f6f-b4a5-a165f689a276`::Disk vda latency not available >Thread-14::DEBUG::2014-07-10 09:01:23,170::BindingXMLRPC::1067::vds::(wrapper) client [10.35.3.13]::call vmGetStats with ('ed909f7e-0ee2-4f6f-b4a5-a165f689a276',) {} >Thread-14::DEBUG::2014-07-10 09:01:23,171::vm::598::vm.Vm::(_getCpuStats) vmId=`ed909f7e-0ee2-4f6f-b4a5-a165f689a276`::CPU stats not available: 'NoneType' object is unsubscriptable >Thread-14::DEBUG::2014-07-10 09:01:23,172::vm::654::vm.Vm::(_getNetworkStats) vmId=`ed909f7e-0ee2-4f6f-b4a5-a165f689a276`::Network stats not available >Thread-14::DEBUG::2014-07-10 09:01:23,172::vm::676::vm.Vm::(_getDiskStats) vmId=`ed909f7e-0ee2-4f6f-b4a5-a165f689a276`::Disk hdd stats not available >Thread-14::DEBUG::2014-07-10 09:01:23,172::vm::676::vm.Vm::(_getDiskStats) vmId=`ed909f7e-0ee2-4f6f-b4a5-a165f689a276`::Disk hdc stats not available >Thread-14::DEBUG::2014-07-10 09:01:23,173::vm::676::vm.Vm::(_getDiskStats) vmId=`ed909f7e-0ee2-4f6f-b4a5-a165f689a276`::Disk vda stats not available >Thread-14::DEBUG::2014-07-10 09:01:23,173::vm::715::vm.Vm::(_getDiskLatency) vmId=`ed909f7e-0ee2-4f6f-b4a5-a165f689a276`::Disk hdd latency not available >Thread-14::DEBUG::2014-07-10 09:01:23,173::vm::715::vm.Vm::(_getDiskLatency) vmId=`ed909f7e-0ee2-4f6f-b4a5-a165f689a276`::Disk hdc latency not available >Thread-14::DEBUG::2014-07-10 09:01:23,173::vm::715::vm.Vm::(_getDiskLatency) vmId=`ed909f7e-0ee2-4f6f-b4a5-a165f689a276`::Disk vda latency not available >Thread-14::DEBUG::2014-07-10 09:01:23,174::BindingXMLRPC::1074::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Powering up', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '11613', 'displayIp': '0', 'displayPort': u'5900', 'session': 'Unknown', 'displaySecurePort': u'5901', 'timeOffset': '0', 'hash': '7841224975033595397', 'balloonInfo': {'balloon_max': '1048576', 'balloon_target': '1048576', 'balloon_cur': '0', 'balloon_min': '1048576'}, 'pauseCode': 'NOERR', 'clientIp': '', 'kvmEnable': 'true', 'network': {u'vnet0': {'state': 'unknown', 'macAddr': '00:1a:4a:de:6d:7a', 'speed': '1000', 'name': u'vnet0'}}, 'vmId': 'ed909f7e-0ee2-4f6f-b4a5-a165f689a276', 'displayType': 'qxl', 'cpuUser': '0.00', 'disks': {u'vda': {'truesize': '1073741824', 'apparentsize': '1073741824', 'imageID': '0cd7d6ce-f497-4243-a690-c57744861eea'}, u'hdd': {'truesize': '0', 'apparentsize': '0'}, u'hdc': {'truesize': '0', 'apparentsize': '0'}}, 'monitorResponse': '0', 'statsAge': '1.73', 'elapsedTime': '16', 'vmType': 'kvm', 'cpuSys': '0.00', 'guestCPUCount': -1, 'appsList': [], 'guestIPs': ''}]} >Dummy-33::DEBUG::2014-07-10 09:01:23,294::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:01:23,389::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0335916 s, 30.5 MB/s\n'; <rc> = 0 >Thread-40::DEBUG::2014-07-10 09:01:23,977::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lion.qa.lab.tlv.redhat.com:_export_yuri2_backup2/6a70504d-00df-4869-8695-0f442053f6b6/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-40::DEBUG::2014-07-10 09:01:23,993::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n369 bytes (369 B) copied, 0.000423174 s, 872 kB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 09:01:25,180::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-14::DEBUG::2014-07-10 09:01:25,181::task::595::TaskManager.Task::(_updateState) Task=`9e2c7298-7ede-4640-b24a-bf0a8aa1cfd3`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 09:01:25,182::logUtils::44::dispatcher::(wrapper) Run and protect: getAllTasksStatuses(spUUID=None, options=None) >Thread-14::DEBUG::2014-07-10 09:01:25,182::taskManager::102::TaskManager::(getAllTasksStatuses) Entry. >Thread-14::DEBUG::2014-07-10 09:01:25,182::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 7fc7681e-8725-425e-88ea-fd4cfdcab46e >Thread-14::DEBUG::2014-07-10 09:01:25,182::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': '1 jobs completed successfully', 'taskState': 'finished', 'taskResult': 'success', 'taskID': '7fc7681e-8725-425e-88ea-fd4cfdcab46e'} >Thread-14::DEBUG::2014-07-10 09:01:25,183::taskManager::113::TaskManager::(getAllTasksStatuses) Return: {'7fc7681e-8725-425e-88ea-fd4cfdcab46e': {'code': 0, 'message': '1 jobs completed successfully', 'taskState': 'finished', 'taskResult': 'success', 'taskID': '7fc7681e-8725-425e-88ea-fd4cfdcab46e'}} >Thread-14::INFO::2014-07-10 09:01:25,183::logUtils::47::dispatcher::(wrapper) Run and protect: getAllTasksStatuses, Return response: {'allTasksStatus': {'7fc7681e-8725-425e-88ea-fd4cfdcab46e': {'code': 0, 'message': '1 jobs completed successfully', 'taskState': 'finished', 'taskResult': 'success', 'taskID': '7fc7681e-8725-425e-88ea-fd4cfdcab46e'}}} >Thread-14::DEBUG::2014-07-10 09:01:25,183::task::1185::TaskManager.Task::(prepare) Task=`9e2c7298-7ede-4640-b24a-bf0a8aa1cfd3`::finished: {'allTasksStatus': {'7fc7681e-8725-425e-88ea-fd4cfdcab46e': {'code': 0, 'message': '1 jobs completed successfully', 'taskState': 'finished', 'taskResult': 'success', 'taskID': '7fc7681e-8725-425e-88ea-fd4cfdcab46e'}}} >Thread-14::DEBUG::2014-07-10 09:01:25,183::task::595::TaskManager.Task::(_updateState) Task=`9e2c7298-7ede-4640-b24a-bf0a8aa1cfd3`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 09:01:25,183::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 09:01:25,184::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 09:01:25,184::task::990::TaskManager.Task::(_decref) Task=`9e2c7298-7ede-4640-b24a-bf0a8aa1cfd3`::ref 0 aborting False >Thread-34::DEBUG::2014-07-10 09:01:25,226::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [5d8ae20c] >Thread-34::DEBUG::2014-07-10 09:01:25,226::task::595::TaskManager.Task::(_updateState) Task=`2328e7b8-17c0-4e1b-90ce-9ab9824a38fd`::moving from state init -> state preparing >Thread-34::INFO::2014-07-10 09:01:25,227::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeInfo(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='76fdb054-02cd-42ed-9721-b3e65b34c3a4', volUUID='022dfe46-2cf7-4915-80b3-883158e3ca83', options=None) >Thread-34::DEBUG::2014-07-10 09:01:25,227::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.9e1aa540-1f4e-4ee3-a152-be381ef6c3bd`ReqID=`da9e5c41-5b0d-489d-a0e7-32fc7eeabf1a`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '3089' at 'getVolumeInfo' >Thread-34::DEBUG::2014-07-10 09:01:25,228::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.9e1aa540-1f4e-4ee3-a152-be381ef6c3bd' for lock type 'shared' >Thread-34::DEBUG::2014-07-10 09:01:25,228::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.9e1aa540-1f4e-4ee3-a152-be381ef6c3bd' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-10 09:01:25,228::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.9e1aa540-1f4e-4ee3-a152-be381ef6c3bd`ReqID=`da9e5c41-5b0d-489d-a0e7-32fc7eeabf1a`::Granted request >Thread-34::DEBUG::2014-07-10 09:01:25,229::task::827::TaskManager.Task::(resourceAcquired) Task=`2328e7b8-17c0-4e1b-90ce-9ab9824a38fd`::_resourcesAcquired: Storage.9e1aa540-1f4e-4ee3-a152-be381ef6c3bd (shared) >Thread-34::DEBUG::2014-07-10 09:01:25,229::task::990::TaskManager.Task::(_decref) Task=`2328e7b8-17c0-4e1b-90ce-9ab9824a38fd`::ref 1 aborting False >Thread-34::DEBUG::2014-07-10 09:01:25,229::lvm::427::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' got the operation mutex >Thread-34::DEBUG::2014-07-10 09:01:25,230::lvm::296::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm lvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/3600601601282300032826addbbdae311|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,vg_name,attr,size,seg_start_pe,devices,tags 9e1aa540-1f4e-4ee3-a152-be381ef6c3bd' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:01:25,405::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Thread-34::DEBUG::2014-07-10 09:01:25,477::lvm::296::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-34::DEBUG::2014-07-10 09:01:25,498::lvm::462::Storage.LVM::(_reloadlvs) lvs reloaded >Thread-34::DEBUG::2014-07-10 09:01:25,500::lvm::462::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' released the operation mutex >Thread-34::INFO::2014-07-10 09:01:25,502::volume::879::Storage.Volume::(getInfo) Info request: sdUUID=9e1aa540-1f4e-4ee3-a152-be381ef6c3bd imgUUID=76fdb054-02cd-42ed-9721-b3e65b34c3a4 volUUID = 022dfe46-2cf7-4915-80b3-883158e3ca83 >Thread-34::DEBUG::2014-07-10 09:01:25,504::blockVolume::572::Storage.Misc.excCmd::(getMetadata) '/bin/dd iflag=direct skip=6 bs=512 if=/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/metadata count=1' (cwd None) >Thread-34::DEBUG::2014-07-10 09:01:25,544::blockVolume::572::Storage.Misc.excCmd::(getMetadata) SUCCESS: <err> = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.00041893 s, 1.2 MB/s\n'; <rc> = 0 >Thread-34::DEBUG::2014-07-10 09:01:25,548::misc::282::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.00041893 s, 1.2 MB/s'], size: 512 >Thread-34::DEBUG::2014-07-10 09:01:25,557::blockVolume::572::Storage.Misc.excCmd::(getMetadata) '/bin/dd iflag=direct skip=6 bs=512 if=/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/metadata count=1' (cwd None) >Thread-34::DEBUG::2014-07-10 09:01:25,595::blockVolume::572::Storage.Misc.excCmd::(getMetadata) SUCCESS: <err> = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.000647855 s, 790 kB/s\n'; <rc> = 0 >Thread-34::DEBUG::2014-07-10 09:01:25,598::misc::282::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.000647855 s, 790 kB/s'], size: 512 >Thread-34::INFO::2014-07-10 09:01:25,600::volume::909::Storage.Volume::(getInfo) 9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/76fdb054-02cd-42ed-9721-b3e65b34c3a4/022dfe46-2cf7-4915-80b3-883158e3ca83 info is {'status': 'OK', 'domain': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'voltype': 'LEAF', 'description': '', 'parent': '47592965-e853-4e59-9728-d11cca6a7a8a', 'format': 'COW', 'image': '76fdb054-02cd-42ed-9721-b3e65b34c3a4', 'ctime': '1404982878', 'disktype': '2', 'legality': 'LEGAL', 'mtime': '1404982878', 'apparentsize': '1073741824', 'children': [], 'pool': '', 'capacity': '10737418240', 'uuid': '022dfe46-2cf7-4915-80b3-883158e3ca83', 'truesize': '1073741824', 'type': 'SPARSE'} >Thread-34::INFO::2014-07-10 09:01:25,602::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeInfo, Return response: {'info': {'status': 'OK', 'domain': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'voltype': 'LEAF', 'description': '', 'parent': '47592965-e853-4e59-9728-d11cca6a7a8a', 'format': 'COW', 'image': '76fdb054-02cd-42ed-9721-b3e65b34c3a4', 'ctime': '1404982878', 'disktype': '2', 'legality': 'LEGAL', 'mtime': '1404982878', 'apparentsize': '1073741824', 'children': [], 'pool': '', 'capacity': '10737418240', 'uuid': '022dfe46-2cf7-4915-80b3-883158e3ca83', 'truesize': '1073741824', 'type': 'SPARSE'}} >Thread-34::DEBUG::2014-07-10 09:01:25,604::task::1185::TaskManager.Task::(prepare) Task=`2328e7b8-17c0-4e1b-90ce-9ab9824a38fd`::finished: {'info': {'status': 'OK', 'domain': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'voltype': 'LEAF', 'description': '', 'parent': '47592965-e853-4e59-9728-d11cca6a7a8a', 'format': 'COW', 'image': '76fdb054-02cd-42ed-9721-b3e65b34c3a4', 'ctime': '1404982878', 'disktype': '2', 'legality': 'LEGAL', 'mtime': '1404982878', 'apparentsize': '1073741824', 'children': [], 'pool': '', 'capacity': '10737418240', 'uuid': '022dfe46-2cf7-4915-80b3-883158e3ca83', 'truesize': '1073741824', 'type': 'SPARSE'}} >Thread-34::DEBUG::2014-07-10 09:01:25,606::task::595::TaskManager.Task::(_updateState) Task=`2328e7b8-17c0-4e1b-90ce-9ab9824a38fd`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-10 09:01:25,608::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': < ResourceRef 'Storage.9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-10 09:01:25,610::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-10 09:01:25,614::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.9e1aa540-1f4e-4ee3-a152-be381ef6c3bd' >Thread-34::DEBUG::2014-07-10 09:01:25,617::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.9e1aa540-1f4e-4ee3-a152-be381ef6c3bd' (0 active users) >Thread-34::DEBUG::2014-07-10 09:01:25,619::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.9e1aa540-1f4e-4ee3-a152-be381ef6c3bd' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-10 09:01:25,621::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', Clearing records. >Thread-34::DEBUG::2014-07-10 09:01:25,624::task::990::TaskManager.Task::(_decref) Task=`2328e7b8-17c0-4e1b-90ce-9ab9824a38fd`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 09:01:25,667::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0497097 s, 20.6 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 09:01:25,674::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-14::DEBUG::2014-07-10 09:01:25,677::task::595::TaskManager.Task::(_updateState) Task=`52b18321-76c9-4146-b53a-a364568db22c`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 09:01:25,678::logUtils::44::dispatcher::(wrapper) Run and protect: clearTask(taskID='7fc7681e-8725-425e-88ea-fd4cfdcab46e', spUUID=None, options=None) >Thread-14::DEBUG::2014-07-10 09:01:25,680::taskManager::161::TaskManager::(clearTask) Entry. taskID: 7fc7681e-8725-425e-88ea-fd4cfdcab46e >Thread-14::DEBUG::2014-07-10 09:01:25,685::taskManager::166::TaskManager::(clearTask) Return. >Thread-14::INFO::2014-07-10 09:01:25,687::logUtils::47::dispatcher::(wrapper) Run and protect: clearTask, Return response: None >Thread-14::DEBUG::2014-07-10 09:01:25,688::task::1185::TaskManager.Task::(prepare) Task=`52b18321-76c9-4146-b53a-a364568db22c`::finished: None >Thread-14::DEBUG::2014-07-10 09:01:25,688::task::595::TaskManager.Task::(_updateState) Task=`52b18321-76c9-4146-b53a-a364568db22c`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 09:01:25,689::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 09:01:25,690::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 09:01:25,692::task::990::TaskManager.Task::(_decref) Task=`52b18321-76c9-4146-b53a-a364568db22c`::ref 0 aborting False >Thread-18::DEBUG::2014-07-10 09:01:26,141::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/metadata bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-10 09:01:26,160::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000665282 s, 6.2 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 09:01:26,202::BindingXMLRPC::1067::vds::(wrapper) client [10.35.3.13]::call vmGetStats with ('ed909f7e-0ee2-4f6f-b4a5-a165f689a276',) {} >Thread-14::DEBUG::2014-07-10 09:01:26,207::vm::676::vm.Vm::(_getDiskStats) vmId=`ed909f7e-0ee2-4f6f-b4a5-a165f689a276`::Disk hdd stats not available >Thread-14::DEBUG::2014-07-10 09:01:26,207::vm::676::vm.Vm::(_getDiskStats) vmId=`ed909f7e-0ee2-4f6f-b4a5-a165f689a276`::Disk hdc stats not available >Thread-14::DEBUG::2014-07-10 09:01:26,207::vm::676::vm.Vm::(_getDiskStats) vmId=`ed909f7e-0ee2-4f6f-b4a5-a165f689a276`::Disk vda stats not available >Thread-14::DEBUG::2014-07-10 09:01:26,207::vm::715::vm.Vm::(_getDiskLatency) vmId=`ed909f7e-0ee2-4f6f-b4a5-a165f689a276`::Disk hdd latency not available >Thread-14::DEBUG::2014-07-10 09:01:26,208::vm::715::vm.Vm::(_getDiskLatency) vmId=`ed909f7e-0ee2-4f6f-b4a5-a165f689a276`::Disk hdc latency not available >Thread-14::DEBUG::2014-07-10 09:01:26,208::vm::715::vm.Vm::(_getDiskLatency) vmId=`ed909f7e-0ee2-4f6f-b4a5-a165f689a276`::Disk vda latency not available >Thread-14::DEBUG::2014-07-10 09:01:26,208::BindingXMLRPC::1074::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Powering up', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '11613', 'displayIp': '0', 'displayPort': u'5900', 'session': 'Unknown', 'displaySecurePort': u'5901', 'timeOffset': '0', 'hash': '7841224975033595397', 'balloonInfo': {'balloon_max': '1048576', 'balloon_target': '1048576', 'balloon_cur': '1048576', 'balloon_min': '1048576'}, 'pauseCode': 'NOERR', 'clientIp': '', 'kvmEnable': 'true', 'network': {u'vnet0': {'macAddr': '00:1a:4a:de:6d:7a', 'rxDropped': '0', 'rxErrors': '0', 'txDropped': '0', 'txRate': '0.0', 'rxRate': '0.0', 'txErrors': '0', 'state': 'unknown', 'speed': '1000', 'name': u'vnet0'}}, 'vmId': 'ed909f7e-0ee2-4f6f-b4a5-a165f689a276', 'displayType': 'qxl', 'cpuUser': '44.65', 'disks': {u'vda': {'truesize': '1073741824', 'apparentsize': '1073741824', 'imageID': '0cd7d6ce-f497-4243-a690-c57744861eea'}, u'hdd': {'truesize': '0', 'apparentsize': '0'}, u'hdc': {'truesize': '0', 'apparentsize': '0'}}, 'monitorResponse': '0', 'statsAge': '0.73', 'elapsedTime': '19', 'vmType': 'kvm', 'cpuSys': '22.67', 'guestCPUCount': -1, 'appsList': [], 'guestIPs': ''}]} >Thread-14::DEBUG::2014-07-10 09:01:26,626::BindingXMLRPC::1067::vds::(wrapper) client [10.35.3.13]::call vmCreate with ({'acpiEnable': 'true', 'emulatedMachine': 'rhel6.5.0', 'vmId': '52e238aa-e62a-48a8-a200-604e72422f3f', 'memGuaranteedSize': 1024, 'spiceSslCipherSuite': 'DEFAULT', 'timeOffset': '0', 'cpuType': 'Conroe', 'custom': {'device_53f473b0-ef82-4ee7-af4a-05239a0caabddevice_56f8b061-fe34-4dbf-ac4b-f271a9b07e21device_66c13e23-c712-4219-b4b2-c2a0be3fe007': 'VmDevice {vmId=52e238aa-e62a-48a8-a200-604e72422f3f, deviceId=66c13e23-c712-4219-b4b2-c2a0be3fe007, device=unix, type=CHANNEL, bootOrder=0, specParams={}, address={port=1, bus=0, controller=0, type=virtio-serial}, managed=false, plugged=true, readOnly=false, deviceAlias=channel0, customProperties={}, snapshotId=null}', 'device_53f473b0-ef82-4ee7-af4a-05239a0caabddevice_56f8b061-fe34-4dbf-ac4b-f271a9b07e21': 'VmDevice {vmId=52e238aa-e62a-48a8-a200-604e72422f3f, deviceId=56f8b061-fe34-4dbf-ac4b-f271a9b07e21, device=unix, type=CHANNEL, bootOrder=0, specParams={}, address={port=2, bus=0, controller=0, type=virtio-serial}, managed=false, plugged=true, readOnly=false, deviceAlias=channel1, customProperties={}, snapshotId=null}', 'device_53f473b0-ef82-4ee7-af4a-05239a0caabddevice_56f8b061-fe34-4dbf-ac4b-f271a9b07e21device_66c13e23-c712-4219-b4b2-c2a0be3fe007device_6e1507f5-f718-4690-a2fa-48a3b2ab1beedevice_8008a4cf-e50c-4ded-be2f-5893bd472ebc': 'VmDevice {vmId=52e238aa-e62a-48a8-a200-604e72422f3f, deviceId=8008a4cf-e50c-4ded-be2f-5893bd472ebc, device=virtio-serial, type=CONTROLLER, bootOrder=0, specParams={}, address={bus=0x00, domain=0x0000, type=pci, slot=0x05, function=0x0}, managed=false, plugged=true, readOnly=false, deviceAlias=virtio-serial0, customProperties={}, snapshotId=null}', 'device_53f473b0-ef82-4ee7-af4a-05239a0caabddevice_56f8b061-fe34-4dbf-ac4b-f271a9b07e21device_66c13e23-c712-4219-b4b2-c2a0be3fe007device_6e1507f5-f718-4690-a2fa-48a3b2ab1bee': 'VmDevice {vmId=52e238aa-e62a-48a8-a200-604e72422f3f, deviceId=6e1507f5-f718-4690-a2fa-48a3b2ab1bee, device=spicevmc, type=CHANNEL, bootOrder=0, specParams={}, address={port=3, bus=0, controller=0, type=virtio-serial}, managed=false, plugged=true, readOnly=false, deviceAlias=channel2, customProperties={}, snapshotId=null}', 'device_53f473b0-ef82-4ee7-af4a-05239a0caabd': 'VmDevice {vmId=52e238aa-e62a-48a8-a200-604e72422f3f, deviceId=53f473b0-ef82-4ee7-af4a-05239a0caabd, device=ide, type=CONTROLLER, bootOrder=0, specParams={}, address={bus=0x00, domain=0x0000, type=pci, slot=0x01, function=0x1}, managed=false, plugged=true, readOnly=false, deviceAlias=ide0, customProperties={}, snapshotId=null}'}, 'smp': '2', 'vmType': 'kvm', 'memSize': 1024, 'smpCoresPerSocket': '2', 'vmName': 'scale_2', 'nice': '0', 'smartcardEnable': 'false', 'keyboardLayout': 'en-us', 'kvmEnable': 'true', 'pitReinjection': 'false', 'transparentHugePages': 'true', 'devices': [{'index': '3', 'iface': 'ide', 'specParams': {'vmPayload': {'volId': 'config-2', 'file': {'openstack/latest/meta_data.json': 'ewogICJsYXVuY2hfaW5kZXgiIDogIjAiLAogICJhdmFpbGFiaWxpdHlfem9uZSIgOiAibm92YSIs\nCiAgInV1aWQiIDogIjYxOGNkNWYyLWU4ZjItNDNiZS04Y2JhLTdmYzNmMGNmYTNjNCIsCiAgIm1l\ndGEiIDogewogICAgImVzc2VudGlhbCIgOiAiZmFsc2UiLAogICAgInJvbGUiIDogInNlcnZlciIs\nCiAgICAiZHNtb2RlIiA6ICJsb2NhbCIKICB9Cn0=\n', 'openstack/latest/user_data': 'I2Nsb3VkLWNvbmZpZwpzc2hfcHdhdXRoOiB0cnVlCmRpc2FibGVfcm9vdDogMApvdXRwdXQ6CiAg\nYWxsOiAnPj4gL3Zhci9sb2cvY2xvdWQtaW5pdC1vdXRwdXQubG9nJwp1c2VyOiByb290CmNocGFz\nc3dkOgogIGV4cGlyZTogZmFsc2UKcnVuY21kOgotICdzZWQgLWkgJycvXmRhdGFzb3VyY2VfbGlz\ndDogL2QnJyAvZXRjL2Nsb3VkL2Nsb3VkLmNmZzsgZWNobyAnJ2RhdGFzb3VyY2VfbGlzdDoKICBb\nIk5vQ2xvdWQiLCAiQ29uZmlnRHJpdmUiXScnID4+IC9ldGMvY2xvdWQvY2xvdWQuY2ZnJwo=\n'}}}, 'readonly': 'true', 'deviceId': 'db196801-8063-476f-b320-1f71b2792c2a', 'path': '', 'device': 'cdrom', 'shared': 'false', 'type': 'disk'}, {'device': 'qxl', 'specParams': {'vram': '32768', 'ram': '65536', 'heads': '1'}, 'type': 'video', 'deviceId': '75f58d7e-6784-472c-bb50-b9293bb3ca16'}, {'index': '2', 'iface': 'ide', 'specParams': {'path': ''}, 'readonly': 'true', 'deviceId': '84d5561a-b520-42af-b2da-df90eed666dd', 'path': '', 'device': 'cdrom', 'shared': 'false', 'type': 'disk'}, {'index': 0, 'iface': 'virtio', 'format': 'cow', 'bootOrder': '1', 'poolID': '4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', 'volumeID': '022dfe46-2cf7-4915-80b3-883158e3ca83', 'imageID': '76fdb054-02cd-42ed-9721-b3e65b34c3a4', 'specParams': {}, 'readonly': 'false', 'domainID': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'optional': 'false', 'deviceId': '76fdb054-02cd-42ed-9721-b3e65b34c3a4', 'address': {'slot': '0x06', 'bus': '0x00', 'domain': '0x0000', 'type': 'pci', 'function': '0x0'}, 'device': 'disk', 'shared': 'false', 'propagateErrors': 'off', 'type': 'disk'}, {'nicModel': 'pv', 'macAddr': '00:1a:4a:de:6d:7b', 'linkActive': 'true', 'network': 'rhevm', 'filter': 'vdsm-no-mac-spoofing', 'specParams': {'inbound': {}, 'outbound': {}}, 'deviceId': 'eadb1867-f1dc-4a3f-bc2b-e7b3bb16147f', 'device': 'bridge', 'type': 'interface'}, {'device': 'memballoon', 'specParams': {'model': 'virtio'}, 'type': 'balloon', 'deviceId': 'e8a277a5-4440-4ee0-908c-0bdd6e8b5ad2'}, {'index': '0', 'specParams': {}, 'deviceId': 'a5fe341a-44d0-434f-9ff0-fae86cf92492', 'address': {'slot': '0x04', 'bus': '0x00', 'domain': '0x0000', 'type': 'pci', 'function': '0x0'}, 'device': 'scsi', 'model': 'virtio-scsi', 'type': 'controller'}], 'maxVCpus': '160', 'spiceSecureChannels': 'smain,sinputs,scursor,splayback,srecord,sdisplay,susbredir,ssmartcard', 'display': 'qxl'},) {} flowID [7dbb12c] >Thread-14::INFO::2014-07-10 09:01:26,630::API::667::vds::(_getNetworkIp) network None: using 0 >Thread-14::INFO::2014-07-10 09:01:26,631::clientIF::366::vds::(createVm) vmContainerLock acquired by vm 52e238aa-e62a-48a8-a200-604e72422f3f >Thread-14::DEBUG::2014-07-10 09:01:26,636::clientIF::379::vds::(createVm) Total desktops after creation of 52e238aa-e62a-48a8-a200-604e72422f3f is 2 >Thread-49::DEBUG::2014-07-10 09:01:26,637::vm::2270::vm.Vm::(_startUnderlyingVm) vmId=`52e238aa-e62a-48a8-a200-604e72422f3f`::Start >Thread-14::DEBUG::2014-07-10 09:01:26,639::BindingXMLRPC::1074::vds::(wrapper) return vmCreate with {'status': {'message': 'Done', 'code': 0}, 'vmList': {'status': 'WaitForLaunch', 'acpiEnable': 'true', 'emulatedMachine': 'rhel6.5.0', 'vmId': '52e238aa-e62a-48a8-a200-604e72422f3f', 'pid': '0', 'memGuaranteedSize': 1024, 'timeOffset': '0', 'keyboardLayout': 'en-us', 'displayPort': '-1', 'displaySecurePort': '-1', 'spiceSslCipherSuite': 'DEFAULT', 'cpuType': 'Conroe', 'smp': '2', 'clientIp': '', 'nicModel': 'rtl8139,pv', 'smartcardEnable': 'false', 'kvmEnable': 'true', 'pitReinjection': 'false', 'transparentHugePages': 'true', 'devices': [{'index': '3', 'iface': 'ide', 'specParams': {'vmPayload': {'volId': 'config-2', 'file': {'openstack/latest/meta_data.json': 'ewogICJsYXVuY2hfaW5kZXgiIDogIjAiLAogICJhdmFpbGFiaWxpdHlfem9uZSIgOiAibm92YSIs\nCiAgInV1aWQiIDogIjYxOGNkNWYyLWU4ZjItNDNiZS04Y2JhLTdmYzNmMGNmYTNjNCIsCiAgIm1l\ndGEiIDogewogICAgImVzc2VudGlhbCIgOiAiZmFsc2UiLAogICAgInJvbGUiIDogInNlcnZlciIs\nCiAgICAiZHNtb2RlIiA6ICJsb2NhbCIKICB9Cn0=\n', 'openstack/latest/user_data': 'I2Nsb3VkLWNvbmZpZwpzc2hfcHdhdXRoOiB0cnVlCmRpc2FibGVfcm9vdDogMApvdXRwdXQ6CiAg\nYWxsOiAnPj4gL3Zhci9sb2cvY2xvdWQtaW5pdC1vdXRwdXQubG9nJwp1c2VyOiByb290CmNocGFz\nc3dkOgogIGV4cGlyZTogZmFsc2UKcnVuY21kOgotICdzZWQgLWkgJycvXmRhdGFzb3VyY2VfbGlz\ndDogL2QnJyAvZXRjL2Nsb3VkL2Nsb3VkLmNmZzsgZWNobyAnJ2RhdGFzb3VyY2VfbGlzdDoKICBb\nIk5vQ2xvdWQiLCAiQ29uZmlnRHJpdmUiXScnID4+IC9ldGMvY2xvdWQvY2xvdWQuY2ZnJwo=\n'}}}, 'readonly': 'true', 'deviceId': 'db196801-8063-476f-b320-1f71b2792c2a', 'path': '', 'device': 'cdrom', 'shared': 'false', 'type': 'disk'}, {'device': 'qxl', 'specParams': {'vram': '32768', 'ram': '65536', 'heads': '1'}, 'type': 'video', 'deviceId': '75f58d7e-6784-472c-bb50-b9293bb3ca16'}, {'index': '2', 'iface': 'ide', 'specParams': {'path': ''}, 'readonly': 'true', 'deviceId': '84d5561a-b520-42af-b2da-df90eed666dd', 'path': '', 'device': 'cdrom', 'shared': 'false', 'type': 'disk'}, {'index': 0, 'iface': 'virtio', 'format': 'cow', 'bootOrder': '1', 'poolID': '4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', 'volumeID': '022dfe46-2cf7-4915-80b3-883158e3ca83', 'imageID': '76fdb054-02cd-42ed-9721-b3e65b34c3a4', 'specParams': {}, 'readonly': 'false', 'domainID': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'optional': 'false', 'deviceId': '76fdb054-02cd-42ed-9721-b3e65b34c3a4', 'address': {'slot': '0x06', 'bus': '0x00', 'domain': '0x0000', 'type': 'pci', 'function': '0x0'}, 'device': 'disk', 'shared': 'false', 'propagateErrors': 'off', 'type': 'disk'}, {'nicModel': 'pv', 'macAddr': '00:1a:4a:de:6d:7b', 'linkActive': 'true', 'network': 'rhevm', 'filter': 'vdsm-no-mac-spoofing', 'specParams': {'inbound': {}, 'outbound': {}}, 'deviceId': 'eadb1867-f1dc-4a3f-bc2b-e7b3bb16147f', 'device': 'bridge', 'type': 'interface'}, {'device': 'memballoon', 'specParams': {'model': 'virtio'}, 'type': 'balloon', 'deviceId': 'e8a277a5-4440-4ee0-908c-0bdd6e8b5ad2'}, {'index': '0', 'specParams': {}, 'deviceId': 'a5fe341a-44d0-434f-9ff0-fae86cf92492', 'address': {'slot': '0x04', 'bus': '0x00', 'domain': '0x0000', 'type': 'pci', 'function': '0x0'}, 'device': 'scsi', 'model': 'virtio-scsi', 'type': 'controller'}], 'custom': {'device_53f473b0-ef82-4ee7-af4a-05239a0caabddevice_56f8b061-fe34-4dbf-ac4b-f271a9b07e21device_66c13e23-c712-4219-b4b2-c2a0be3fe007': 'VmDevice {vmId=52e238aa-e62a-48a8-a200-604e72422f3f, deviceId=66c13e23-c712-4219-b4b2-c2a0be3fe007, device=unix, type=CHANNEL, bootOrder=0, specParams={}, address={port=1, bus=0, controller=0, type=virtio-serial}, managed=false, plugged=true, readOnly=false, deviceAlias=channel0, customProperties={}, snapshotId=null}', 'device_53f473b0-ef82-4ee7-af4a-05239a0caabddevice_56f8b061-fe34-4dbf-ac4b-f271a9b07e21': 'VmDevice {vmId=52e238aa-e62a-48a8-a200-604e72422f3f, deviceId=56f8b061-fe34-4dbf-ac4b-f271a9b07e21, device=unix, type=CHANNEL, bootOrder=0, specParams={}, address={port=2, bus=0, controller=0, type=virtio-serial}, managed=false, plugged=true, readOnly=false, deviceAlias=channel1, customProperties={}, snapshotId=null}', 'device_53f473b0-ef82-4ee7-af4a-05239a0caabddevice_56f8b061-fe34-4dbf-ac4b-f271a9b07e21device_66c13e23-c712-4219-b4b2-c2a0be3fe007device_6e1507f5-f718-4690-a2fa-48a3b2ab1beedevice_8008a4cf-e50c-4ded-be2f-5893bd472ebc': 'VmDevice {vmId=52e238aa-e62a-48a8-a200-604e72422f3f, deviceId=8008a4cf-e50c-4ded-be2f-5893bd472ebc, device=virtio-serial, type=CONTROLLER, bootOrder=0, specParams={}, address={bus=0x00, domain=0x0000, type=pci, slot=0x05, function=0x0}, managed=false, plugged=true, readOnly=false, deviceAlias=virtio-serial0, customProperties={}, snapshotId=null}', 'device_53f473b0-ef82-4ee7-af4a-05239a0caabddevice_56f8b061-fe34-4dbf-ac4b-f271a9b07e21device_66c13e23-c712-4219-b4b2-c2a0be3fe007device_6e1507f5-f718-4690-a2fa-48a3b2ab1bee': 'VmDevice {vmId=52e238aa-e62a-48a8-a200-604e72422f3f, deviceId=6e1507f5-f718-4690-a2fa-48a3b2ab1bee, device=spicevmc, type=CHANNEL, bootOrder=0, specParams={}, address={port=3, bus=0, controller=0, type=virtio-serial}, managed=false, plugged=true, readOnly=false, deviceAlias=channel2, customProperties={}, snapshotId=null}', 'device_53f473b0-ef82-4ee7-af4a-05239a0caabd': 'VmDevice {vmId=52e238aa-e62a-48a8-a200-604e72422f3f, deviceId=53f473b0-ef82-4ee7-af4a-05239a0caabd, device=ide, type=CONTROLLER, bootOrder=0, specParams={}, address={bus=0x00, domain=0x0000, type=pci, slot=0x01, function=0x1}, managed=false, plugged=true, readOnly=false, deviceAlias=ide0, customProperties={}, snapshotId=null}'}, 'vmType': 'kvm', 'memSize': 1024, 'displayIp': '0', 'maxVCpus': '160', 'spiceSecureChannels': 'smain,sinputs,scursor,splayback,srecord,sdisplay,susbredir,ssmartcard', 'smpCoresPerSocket': '2', 'vmName': 'scale_2', 'display': 'qxl', 'nice': '0'}} >Thread-49::DEBUG::2014-07-10 09:01:26,642::vm::2274::vm.Vm::(_startUnderlyingVm) vmId=`52e238aa-e62a-48a8-a200-604e72422f3f`::_ongoingCreations acquired >Thread-49::INFO::2014-07-10 09:01:26,644::vm::3151::vm.Vm::(_run) vmId=`52e238aa-e62a-48a8-a200-604e72422f3f`::VM wrapper has started >Thread-49::DEBUG::2014-07-10 09:01:26,650::task::595::TaskManager.Task::(_updateState) Task=`b6e10743-dbe8-4953-9f46-7038d249f73c`::moving from state init -> state preparing >Thread-49::INFO::2014-07-10 09:01:26,653::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='76fdb054-02cd-42ed-9721-b3e65b34c3a4', volUUID='022dfe46-2cf7-4915-80b3-883158e3ca83', options=None) >Thread-49::INFO::2014-07-10 09:01:26,657::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-49::DEBUG::2014-07-10 09:01:26,660::task::1185::TaskManager.Task::(prepare) Task=`b6e10743-dbe8-4953-9f46-7038d249f73c`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-49::DEBUG::2014-07-10 09:01:26,663::task::595::TaskManager.Task::(_updateState) Task=`b6e10743-dbe8-4953-9f46-7038d249f73c`::moving from state preparing -> state finished >Thread-49::DEBUG::2014-07-10 09:01:26,664::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-49::DEBUG::2014-07-10 09:01:26,664::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-49::DEBUG::2014-07-10 09:01:26,664::task::990::TaskManager.Task::(_decref) Task=`b6e10743-dbe8-4953-9f46-7038d249f73c`::ref 0 aborting False >Thread-49::INFO::2014-07-10 09:01:26,726::clientIF::324::vds::(prepareVolumePath) prepared volume path: /var/run/vdsm/payload/52e238aa-e62a-48a8-a200-604e72422f3f.8dce43d0ca014a4e558491fe5f357e03.img >Thread-49::INFO::2014-07-10 09:01:26,726::clientIF::324::vds::(prepareVolumePath) prepared volume path: >Thread-49::DEBUG::2014-07-10 09:01:26,727::task::595::TaskManager.Task::(_updateState) Task=`6d52449a-975d-49fc-9ecd-17667ca36384`::moving from state init -> state preparing >Thread-49::INFO::2014-07-10 09:01:26,727::logUtils::44::dispatcher::(wrapper) Run and protect: prepareImage(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='76fdb054-02cd-42ed-9721-b3e65b34c3a4', leafUUID='022dfe46-2cf7-4915-80b3-883158e3ca83') >Thread-49::DEBUG::2014-07-10 09:01:26,728::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.9e1aa540-1f4e-4ee3-a152-be381ef6c3bd`ReqID=`a26f2822-684f-4caa-ac32-ff8f3161c29e`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '3248' at 'prepareImage' >Thread-49::DEBUG::2014-07-10 09:01:26,728::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.9e1aa540-1f4e-4ee3-a152-be381ef6c3bd' for lock type 'shared' >Thread-49::DEBUG::2014-07-10 09:01:26,729::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.9e1aa540-1f4e-4ee3-a152-be381ef6c3bd' is free. Now locking as 'shared' (1 active user) >Thread-49::DEBUG::2014-07-10 09:01:26,729::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.9e1aa540-1f4e-4ee3-a152-be381ef6c3bd`ReqID=`a26f2822-684f-4caa-ac32-ff8f3161c29e`::Granted request >Thread-49::DEBUG::2014-07-10 09:01:26,730::task::827::TaskManager.Task::(resourceAcquired) Task=`6d52449a-975d-49fc-9ecd-17667ca36384`::_resourcesAcquired: Storage.9e1aa540-1f4e-4ee3-a152-be381ef6c3bd (shared) >Thread-49::DEBUG::2014-07-10 09:01:26,730::task::990::TaskManager.Task::(_decref) Task=`6d52449a-975d-49fc-9ecd-17667ca36384`::ref 1 aborting False >Thread-49::DEBUG::2014-07-10 09:01:26,731::lvm::427::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' got the operation mutex >Thread-49::DEBUG::2014-07-10 09:01:26,732::lvm::296::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm lvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/3600601601282300032826addbbdae311|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,vg_name,attr,size,seg_start_pe,devices,tags 9e1aa540-1f4e-4ee3-a152-be381ef6c3bd' (cwd None) >Thread-49::DEBUG::2014-07-10 09:01:26,928::lvm::296::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-49::DEBUG::2014-07-10 09:01:26,939::lvm::462::Storage.LVM::(_reloadlvs) lvs reloaded >Thread-49::DEBUG::2014-07-10 09:01:26,939::lvm::462::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' released the operation mutex >Thread-49::DEBUG::2014-07-10 09:01:26,941::lvm::296::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm lvchange --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/3600601601282300032826addbbdae311|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } " --autobackup n --available y 9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/022dfe46-2cf7-4915-80b3-883158e3ca83' (cwd None) >Thread-49::DEBUG::2014-07-10 09:01:27,593::lvm::296::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-49::DEBUG::2014-07-10 09:01:27,595::lvm::513::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-49::DEBUG::2014-07-10 09:01:27,595::lvm::525::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-49::DEBUG::2014-07-10 09:01:27,597::blockSD::1057::Storage.StorageDomain::(linkBCImage) path to image directory already exists: /rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/images/76fdb054-02cd-42ed-9721-b3e65b34c3a4 >Thread-49::DEBUG::2014-07-10 09:01:27,597::lvm::427::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' got the operation mutex >Thread-49::DEBUG::2014-07-10 09:01:27,598::lvm::296::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm lvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/3600601601282300032826addbbdae311|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,vg_name,attr,size,seg_start_pe,devices,tags 9e1aa540-1f4e-4ee3-a152-be381ef6c3bd' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:01:27,700::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:01:27,790::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0343031 s, 29.9 MB/s\n'; <rc> = 0 >Thread-49::DEBUG::2014-07-10 09:01:27,810::lvm::296::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >GuestMonitor-scale_1::DEBUG::2014-07-10 09:01:27,835::vm::676::vm.Vm::(_getDiskStats) vmId=`ed909f7e-0ee2-4f6f-b4a5-a165f689a276`::Disk hdd stats not available >GuestMonitor-scale_1::DEBUG::2014-07-10 09:01:27,839::vm::676::vm.Vm::(_getDiskStats) vmId=`ed909f7e-0ee2-4f6f-b4a5-a165f689a276`::Disk hdc stats not available >GuestMonitor-scale_1::DEBUG::2014-07-10 09:01:27,844::vm::676::vm.Vm::(_getDiskStats) vmId=`ed909f7e-0ee2-4f6f-b4a5-a165f689a276`::Disk vda stats not available >GuestMonitor-scale_1::DEBUG::2014-07-10 09:01:27,848::vm::715::vm.Vm::(_getDiskLatency) vmId=`ed909f7e-0ee2-4f6f-b4a5-a165f689a276`::Disk hdd latency not available >GuestMonitor-scale_1::DEBUG::2014-07-10 09:01:27,853::vm::715::vm.Vm::(_getDiskLatency) vmId=`ed909f7e-0ee2-4f6f-b4a5-a165f689a276`::Disk hdc latency not available >GuestMonitor-scale_1::DEBUG::2014-07-10 09:01:27,856::vm::715::vm.Vm::(_getDiskLatency) vmId=`ed909f7e-0ee2-4f6f-b4a5-a165f689a276`::Disk vda latency not available >GuestMonitor-scale_1::DEBUG::2014-07-10 09:01:27,865::vm::676::vm.Vm::(_getDiskStats) vmId=`ed909f7e-0ee2-4f6f-b4a5-a165f689a276`::Disk hdd stats not available >GuestMonitor-scale_1::DEBUG::2014-07-10 09:01:27,869::vm::676::vm.Vm::(_getDiskStats) vmId=`ed909f7e-0ee2-4f6f-b4a5-a165f689a276`::Disk hdc stats not available >GuestMonitor-scale_1::DEBUG::2014-07-10 09:01:27,876::vm::676::vm.Vm::(_getDiskStats) vmId=`ed909f7e-0ee2-4f6f-b4a5-a165f689a276`::Disk vda stats not available >GuestMonitor-scale_1::DEBUG::2014-07-10 09:01:27,880::vm::715::vm.Vm::(_getDiskLatency) vmId=`ed909f7e-0ee2-4f6f-b4a5-a165f689a276`::Disk hdd latency not available >Thread-49::DEBUG::2014-07-10 09:01:27,884::lvm::462::Storage.LVM::(_reloadlvs) lvs reloaded >GuestMonitor-scale_1::DEBUG::2014-07-10 09:01:27,885::vm::715::vm.Vm::(_getDiskLatency) vmId=`ed909f7e-0ee2-4f6f-b4a5-a165f689a276`::Disk hdc latency not available >GuestMonitor-scale_1::DEBUG::2014-07-10 09:01:27,890::vm::715::vm.Vm::(_getDiskLatency) vmId=`ed909f7e-0ee2-4f6f-b4a5-a165f689a276`::Disk vda latency not available >Thread-49::DEBUG::2014-07-10 09:01:27,892::lvm::462::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' released the operation mutex >Thread-49::INFO::2014-07-10 09:01:27,901::logUtils::47::dispatcher::(wrapper) Run and protect: prepareImage, Return response: {'info': {'domainID': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'volType': 'path', 'leaseOffset': 111149056, 'path': '/rhev/data-center/mnt/blockSD/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/images/76fdb054-02cd-42ed-9721-b3e65b34c3a4/022dfe46-2cf7-4915-80b3-883158e3ca83', 'volumeID': '022dfe46-2cf7-4915-80b3-883158e3ca83', 'leasePath': '/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/leases', 'imageID': '76fdb054-02cd-42ed-9721-b3e65b34c3a4'}, 'path': '/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/images/76fdb054-02cd-42ed-9721-b3e65b34c3a4/022dfe46-2cf7-4915-80b3-883158e3ca83', 'imgVolumesInfo': [{'domainID': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'volType': 'path', 'leaseOffset': 111149056, 'path': '/rhev/data-center/mnt/blockSD/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/images/76fdb054-02cd-42ed-9721-b3e65b34c3a4/022dfe46-2cf7-4915-80b3-883158e3ca83', 'volumeID': '022dfe46-2cf7-4915-80b3-883158e3ca83', 'leasePath': '/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/leases', 'imageID': '76fdb054-02cd-42ed-9721-b3e65b34c3a4'}, {'domainID': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'volType': 'path', 'leaseOffset': 109051904, 'path': '/rhev/data-center/mnt/blockSD/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/images/76fdb054-02cd-42ed-9721-b3e65b34c3a4/47592965-e853-4e59-9728-d11cca6a7a8a', 'volumeID': '47592965-e853-4e59-9728-d11cca6a7a8a', 'leasePath': '/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/leases', 'imageID': '76fdb054-02cd-42ed-9721-b3e65b34c3a4'}]} >Thread-49::DEBUG::2014-07-10 09:01:27,904::task::1185::TaskManager.Task::(prepare) Task=`6d52449a-975d-49fc-9ecd-17667ca36384`::finished: {'info': {'domainID': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'volType': 'path', 'leaseOffset': 111149056, 'path': '/rhev/data-center/mnt/blockSD/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/images/76fdb054-02cd-42ed-9721-b3e65b34c3a4/022dfe46-2cf7-4915-80b3-883158e3ca83', 'volumeID': '022dfe46-2cf7-4915-80b3-883158e3ca83', 'leasePath': '/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/leases', 'imageID': '76fdb054-02cd-42ed-9721-b3e65b34c3a4'}, 'path': '/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/images/76fdb054-02cd-42ed-9721-b3e65b34c3a4/022dfe46-2cf7-4915-80b3-883158e3ca83', 'imgVolumesInfo': [{'domainID': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'volType': 'path', 'leaseOffset': 111149056, 'path': '/rhev/data-center/mnt/blockSD/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/images/76fdb054-02cd-42ed-9721-b3e65b34c3a4/022dfe46-2cf7-4915-80b3-883158e3ca83', 'volumeID': '022dfe46-2cf7-4915-80b3-883158e3ca83', 'leasePath': '/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/leases', 'imageID': '76fdb054-02cd-42ed-9721-b3e65b34c3a4'}, {'domainID': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'volType': 'path', 'leaseOffset': 109051904, 'path': '/rhev/data-center/mnt/blockSD/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/images/76fdb054-02cd-42ed-9721-b3e65b34c3a4/47592965-e853-4e59-9728-d11cca6a7a8a', 'volumeID': '47592965-e853-4e59-9728-d11cca6a7a8a', 'leasePath': '/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/leases', 'imageID': '76fdb054-02cd-42ed-9721-b3e65b34c3a4'}]} >Thread-49::DEBUG::2014-07-10 09:01:27,906::task::595::TaskManager.Task::(_updateState) Task=`6d52449a-975d-49fc-9ecd-17667ca36384`::moving from state preparing -> state finished >Thread-49::DEBUG::2014-07-10 09:01:27,908::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': < ResourceRef 'Storage.9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', isValid: 'True' obj: 'None'>} >Thread-49::DEBUG::2014-07-10 09:01:27,910::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-49::DEBUG::2014-07-10 09:01:27,914::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.9e1aa540-1f4e-4ee3-a152-be381ef6c3bd' >Thread-49::DEBUG::2014-07-10 09:01:27,917::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.9e1aa540-1f4e-4ee3-a152-be381ef6c3bd' (0 active users) >Thread-49::DEBUG::2014-07-10 09:01:27,920::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.9e1aa540-1f4e-4ee3-a152-be381ef6c3bd' is free, finding out if anyone is waiting for it. >Thread-49::DEBUG::2014-07-10 09:01:27,922::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', Clearing records. >Thread-49::DEBUG::2014-07-10 09:01:27,926::task::990::TaskManager.Task::(_decref) Task=`6d52449a-975d-49fc-9ecd-17667ca36384`::ref 0 aborting False >Thread-49::INFO::2014-07-10 09:01:27,932::clientIF::324::vds::(prepareVolumePath) prepared volume path: /rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/images/76fdb054-02cd-42ed-9721-b3e65b34c3a4/022dfe46-2cf7-4915-80b3-883158e3ca83 >Thread-49::DEBUG::2014-07-10 09:01:27,966::utils::642::root::(execCmd) '/usr/libexec/vdsm/hooks/before_vm_start/50_vhostmd' (cwd None) >Thread-49::DEBUG::2014-07-10 09:01:28,074::utils::662::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-49::INFO::2014-07-10 09:01:28,074::hooks::100::root::(_runHooksDir) >Thread-49::DEBUG::2014-07-10 09:01:28,075::vm::3190::vm.Vm::(_run) vmId=`52e238aa-e62a-48a8-a200-604e72422f3f`::<?xml version="1.0" encoding="utf-8"?> ><domain type="kvm"> > <name>scale_2</name> > <uuid>52e238aa-e62a-48a8-a200-604e72422f3f</uuid> > <memory>1048576</memory> > <currentMemory>1048576</currentMemory> > <vcpu current="2">160</vcpu> > <memtune> > <min_guarantee>1048576</min_guarantee> > </memtune> > <devices> > <channel type="unix"> > <target name="com.redhat.rhevm.vdsm" type="virtio"/> > <source mode="bind" path="/var/lib/libvirt/qemu/channels/52e238aa-e62a-48a8-a200-604e72422f3f.com.redhat.rhevm.vdsm"/> > </channel> > <channel type="unix"> > <target name="org.qemu.guest_agent.0" type="virtio"/> > <source mode="bind" path="/var/lib/libvirt/qemu/channels/52e238aa-e62a-48a8-a200-604e72422f3f.org.qemu.guest_agent.0"/> > </channel> > <input bus="ps2" type="mouse"/> > <channel type="spicevmc"> > <target name="com.redhat.spice.0" type="virtio"/> > </channel> > <graphics autoport="yes" keymap="en-us" listen="0" passwd="*****" passwdValidTo="1970-01-01T00:00:01" port="-1" tlsPort="-1" type="spice"> > <channel mode="secure" name="main"/> > <channel mode="secure" name="inputs"/> > <channel mode="secure" name="cursor"/> > <channel mode="secure" name="playback"/> > <channel mode="secure" name="record"/> > <channel mode="secure" name="display"/> > <channel mode="secure" name="usbredir"/> > <channel mode="secure" name="smartcard"/> > </graphics> > <memballoon model="virtio"/> > <controller index="0" model="virtio-scsi" type="scsi"> > <address bus="0x00" domain="0x0000" function="0x0" slot="0x04" type="pci"/> > </controller> > <video> > <model heads="1" ram="65536" type="qxl" vram="32768"/> > </video> > <interface type="bridge"> > <mac address="00:1a:4a:de:6d:7b"/> > <model type="virtio"/> > <source bridge="rhevm"/> > <filterref filter="vdsm-no-mac-spoofing"/> > <link state="up"/> > <bandwidth/> > </interface> > <disk device="cdrom" snapshot="no" type="file"> > <source file="/var/run/vdsm/payload/52e238aa-e62a-48a8-a200-604e72422f3f.8dce43d0ca014a4e558491fe5f357e03.img" startupPolicy="optional"/> > <target bus="ide" dev="hdd"/> > <readonly/> > <serial/> > </disk> > <disk device="cdrom" snapshot="no" type="file"> > <source file="" startupPolicy="optional"/> > <target bus="ide" dev="hdc"/> > <readonly/> > <serial/> > </disk> > <disk device="disk" snapshot="no" type="block"> > <address bus="0x00" domain="0x0000" function="0x0" slot="0x06" type="pci"/> > <source dev="/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/images/76fdb054-02cd-42ed-9721-b3e65b34c3a4/022dfe46-2cf7-4915-80b3-883158e3ca83"/> > <target bus="virtio" dev="vda"/> > <serial>76fdb054-02cd-42ed-9721-b3e65b34c3a4</serial> > <boot order="1"/> > <driver cache="none" error_policy="stop" io="native" name="qemu" type="qcow2"/> > </disk> > </devices> > <os> > <type arch="x86_64" machine="rhel6.5.0">hvm</type> > <smbios mode="sysinfo"/> > </os> > <sysinfo type="smbios"> > <system> > <entry name="manufacturer">Red Hat</entry> > <entry name="product">RHEV Hypervisor</entry> > <entry name="version">6.5-20140707.0.el6ev</entry> > <entry name="serial">52BAF97B-FF2F-E311-0000-100000000005</entry> > <entry name="uuid">52e238aa-e62a-48a8-a200-604e72422f3f</entry> > </system> > </sysinfo> > <clock adjustment="0" offset="variable"> > <timer name="rtc" tickpolicy="catchup"/> > </clock> > <features> > <acpi/> > </features> > <cpu match="exact"> > <model>Conroe</model> > <topology cores="2" sockets="80" threads="1"/> > </cpu> ></domain> > >libvirtEventLoop::DEBUG::2014-07-10 09:01:29,004::vm::5176::vm.Vm::(_onLibvirtLifecycleEvent) vmId=`52e238aa-e62a-48a8-a200-604e72422f3f`::event Started detail 0 opaque None >Thread-49::DEBUG::2014-07-10 09:01:29,039::vm::5032::vm.Vm::(_getUnderlyingDriveInfo) vmId=`52e238aa-e62a-48a8-a200-604e72422f3f`::Looking for drive with attributes {'name': u'hdc', 'bootOrder': '', 'boot': [], 'readonly': True, 'address': {u'bus': u'1', u'controller': u'0', u'type': u'drive', u'target': u'0', u'unit': u'0'}, 'path': '', 'type': u'cdrom'} >Thread-49::DEBUG::2014-07-10 09:01:29,040::vm::5053::vm.Vm::(_getUnderlyingDriveInfo) vmId=`52e238aa-e62a-48a8-a200-604e72422f3f`::Matched {'name': (u'hdc', u'hdc'), 'bootOrder': ('', None), 'boot': ([], None), 'readonly': (True, True), 'address': ({u'bus': u'1', u'controller': u'0', u'type': u'drive', u'target': u'0', u'unit': u'0'}, {u'bus': u'1', u'controller': u'0', u'type': u'drive', u'target': u'0', u'unit': u'0'}), 'path': ('', ''), 'type': (u'cdrom', u'cdrom')} >Thread-49::DEBUG::2014-07-10 09:01:29,040::vm::5072::vm.Vm::(_getUnderlyingDriveInfo) vmId=`52e238aa-e62a-48a8-a200-604e72422f3f`::Matched {'name': (u'hdc', u'hdc'), 'bootOrder': ('', None), 'boot': ([], None), 'readonly': (True, 'True'), 'address': ({u'bus': u'1', u'controller': u'0', u'type': u'drive', u'target': u'0', u'unit': u'0'}, {u'bus': u'1', u'controller': u'0', u'type': u'drive', u'target': u'0', u'unit': u'0'}), 'path': ('', ''), 'type': (u'cdrom', 'disk')} >Thread-49::DEBUG::2014-07-10 09:01:29,041::vm::5032::vm.Vm::(_getUnderlyingDriveInfo) vmId=`52e238aa-e62a-48a8-a200-604e72422f3f`::Looking for drive with attributes {'name': u'hdd', 'bootOrder': '', 'boot': [], 'readonly': True, 'address': {u'bus': u'1', u'controller': u'0', u'type': u'drive', u'target': u'0', u'unit': u'1'}, 'path': u'/var/run/vdsm/payload/52e238aa-e62a-48a8-a200-604e72422f3f.8dce43d0ca014a4e558491fe5f357e03.img', 'type': u'cdrom'} >Thread-49::DEBUG::2014-07-10 09:01:29,041::vm::5053::vm.Vm::(_getUnderlyingDriveInfo) vmId=`52e238aa-e62a-48a8-a200-604e72422f3f`::Matched {'name': (u'hdd', u'hdd'), 'bootOrder': ('', None), 'boot': ([], None), 'readonly': (True, True), 'address': ({u'bus': u'1', u'controller': u'0', u'type': u'drive', u'target': u'0', u'unit': u'1'}, {u'bus': u'1', u'controller': u'0', u'type': u'drive', u'target': u'0', u'unit': u'1'}), 'path': (u'/var/run/vdsm/payload/52e238aa-e62a-48a8-a200-604e72422f3f.8dce43d0ca014a4e558491fe5f357e03.img', '/var/run/vdsm/payload/52e238aa-e62a-48a8-a200-604e72422f3f.8dce43d0ca014a4e558491fe5f357e03.img'), 'type': (u'cdrom', u'cdrom')} >Thread-49::DEBUG::2014-07-10 09:01:29,041::vm::5072::vm.Vm::(_getUnderlyingDriveInfo) vmId=`52e238aa-e62a-48a8-a200-604e72422f3f`::Matched {'name': (u'hdd', u'hdd'), 'bootOrder': ('', None), 'boot': ([], None), 'readonly': (True, 'True'), 'address': ({u'bus': u'1', u'controller': u'0', u'type': u'drive', u'target': u'0', u'unit': u'1'}, {u'bus': u'1', u'controller': u'0', u'type': u'drive', u'target': u'0', u'unit': u'1'}), 'path': (u'/var/run/vdsm/payload/52e238aa-e62a-48a8-a200-604e72422f3f.8dce43d0ca014a4e558491fe5f357e03.img', '/var/run/vdsm/payload/52e238aa-e62a-48a8-a200-604e72422f3f.8dce43d0ca014a4e558491fe5f357e03.img'), 'type': (u'cdrom', 'disk')} >Thread-49::DEBUG::2014-07-10 09:01:29,042::vm::5032::vm.Vm::(_getUnderlyingDriveInfo) vmId=`52e238aa-e62a-48a8-a200-604e72422f3f`::Looking for drive with attributes {'name': u'vda', 'bootOrder': u'1', 'boot': [<DOM Element: boot at 0x7f6218050290>], 'readonly': False, 'address': {u'slot': u'0x06', u'bus': u'0x00', u'domain': u'0x0000', u'type': u'pci', u'function': u'0x0'}, 'path': u'/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/images/76fdb054-02cd-42ed-9721-b3e65b34c3a4/022dfe46-2cf7-4915-80b3-883158e3ca83', 'type': u'disk'} >Thread-49::DEBUG::2014-07-10 09:01:29,042::vm::5053::vm.Vm::(_getUnderlyingDriveInfo) vmId=`52e238aa-e62a-48a8-a200-604e72422f3f`::Matched {'name': (u'vda', u'vda'), 'bootOrder': (u'1', u'1'), 'boot': ([<DOM Element: boot at 0x7f6218050290>], None), 'readonly': (False, False), 'address': ({u'slot': u'0x06', u'bus': u'0x00', u'domain': u'0x0000', u'type': u'pci', u'function': u'0x0'}, {u'slot': u'0x06', u'bus': u'0x00', u'domain': u'0x0000', u'type': u'pci', u'function': u'0x0'}), 'path': (u'/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/images/76fdb054-02cd-42ed-9721-b3e65b34c3a4/022dfe46-2cf7-4915-80b3-883158e3ca83', '/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/images/76fdb054-02cd-42ed-9721-b3e65b34c3a4/022dfe46-2cf7-4915-80b3-883158e3ca83'), 'type': (u'disk', u'disk')} >Thread-49::DEBUG::2014-07-10 09:01:29,042::vm::5072::vm.Vm::(_getUnderlyingDriveInfo) vmId=`52e238aa-e62a-48a8-a200-604e72422f3f`::Matched {'name': (u'vda', u'vda'), 'bootOrder': (u'1', u'1'), 'boot': ([<DOM Element: boot at 0x7f6218050290>], None), 'readonly': (False, 'False'), 'address': ({u'slot': u'0x06', u'bus': u'0x00', u'domain': u'0x0000', u'type': u'pci', u'function': u'0x0'}, {u'slot': u'0x06', u'bus': u'0x00', u'domain': u'0x0000', u'type': u'pci', u'function': u'0x0'}), 'path': (u'/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/images/76fdb054-02cd-42ed-9721-b3e65b34c3a4/022dfe46-2cf7-4915-80b3-883158e3ca83', '/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/images/76fdb054-02cd-42ed-9721-b3e65b34c3a4/022dfe46-2cf7-4915-80b3-883158e3ca83'), 'type': (u'disk', 'disk')} >Thread-49::DEBUG::2014-07-10 09:01:29,102::sampling::285::vm.Vm::(start) vmId=`52e238aa-e62a-48a8-a200-604e72422f3f`::Start statistics collection >Thread-51::DEBUG::2014-07-10 09:01:29,103::sampling::314::vm.Vm::(run) vmId=`52e238aa-e62a-48a8-a200-604e72422f3f`::Stats thread started >Thread-49::DEBUG::2014-07-10 09:01:29,109::vmChannels::198::vds::(register) Add fileno 61 to listener's channels. >Thread-51::DEBUG::2014-07-10 09:01:29,111::task::595::TaskManager.Task::(_updateState) Task=`17062778-46f5-46d6-a698-148697191072`::moving from state init -> state preparing >Thread-51::INFO::2014-07-10 09:01:29,111::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='76fdb054-02cd-42ed-9721-b3e65b34c3a4', volUUID='022dfe46-2cf7-4915-80b3-883158e3ca83', options=None) >Thread-51::INFO::2014-07-10 09:01:29,112::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-51::DEBUG::2014-07-10 09:01:29,112::task::1185::TaskManager.Task::(prepare) Task=`17062778-46f5-46d6-a698-148697191072`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-51::DEBUG::2014-07-10 09:01:29,112::task::595::TaskManager.Task::(_updateState) Task=`17062778-46f5-46d6-a698-148697191072`::moving from state preparing -> state finished >Thread-51::DEBUG::2014-07-10 09:01:29,112::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-51::DEBUG::2014-07-10 09:01:29,112::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-51::DEBUG::2014-07-10 09:01:29,113::task::990::TaskManager.Task::(_decref) Task=`17062778-46f5-46d6-a698-148697191072`::ref 0 aborting False >Thread-49::WARNING::2014-07-10 09:01:29,114::vm::3715::vm.Vm::(_readPauseCode) vmId=`52e238aa-e62a-48a8-a200-604e72422f3f`::_readPauseCode unsupported by libvirt vm >Thread-49::DEBUG::2014-07-10 09:01:29,123::vm::2291::vm.Vm::(_startUnderlyingVm) vmId=`52e238aa-e62a-48a8-a200-604e72422f3f`::_ongoingCreations released >Thread-14::DEBUG::2014-07-10 09:01:29,218::task::595::TaskManager.Task::(_updateState) Task=`f0afd7d8-fd11-455d-a88a-32f140352313`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 09:01:29,219::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::INFO::2014-07-10 09:01:29,219::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000665282', 'lastCheck': '3.0', 'valid': True}, '6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000423174', 'lastCheck': '5.2', 'valid': True}} >Thread-14::DEBUG::2014-07-10 09:01:29,219::task::1185::TaskManager.Task::(prepare) Task=`f0afd7d8-fd11-455d-a88a-32f140352313`::finished: {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000665282', 'lastCheck': '3.0', 'valid': True}, '6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000423174', 'lastCheck': '5.2', 'valid': True}} >Thread-14::DEBUG::2014-07-10 09:01:29,219::task::595::TaskManager.Task::(_updateState) Task=`f0afd7d8-fd11-455d-a88a-32f140352313`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 09:01:29,220::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 09:01:29,220::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 09:01:29,220::task::990::TaskManager.Task::(_decref) Task=`f0afd7d8-fd11-455d-a88a-32f140352313`::ref 0 aborting False >Thread-14::DEBUG::2014-07-10 09:01:29,232::vm::598::vm.Vm::(_getCpuStats) vmId=`52e238aa-e62a-48a8-a200-604e72422f3f`::CPU stats not available: 'NoneType' object is unsubscriptable >Thread-14::DEBUG::2014-07-10 09:01:29,232::vm::654::vm.Vm::(_getNetworkStats) vmId=`52e238aa-e62a-48a8-a200-604e72422f3f`::Network stats not available >Thread-14::DEBUG::2014-07-10 09:01:29,232::vm::676::vm.Vm::(_getDiskStats) vmId=`52e238aa-e62a-48a8-a200-604e72422f3f`::Disk hdd stats not available >Thread-14::DEBUG::2014-07-10 09:01:29,232::vm::676::vm.Vm::(_getDiskStats) vmId=`52e238aa-e62a-48a8-a200-604e72422f3f`::Disk hdc stats not available >Thread-14::DEBUG::2014-07-10 09:01:29,233::vm::676::vm.Vm::(_getDiskStats) vmId=`52e238aa-e62a-48a8-a200-604e72422f3f`::Disk vda stats not available >Thread-14::DEBUG::2014-07-10 09:01:29,233::vm::715::vm.Vm::(_getDiskLatency) vmId=`52e238aa-e62a-48a8-a200-604e72422f3f`::Disk hdd latency not available >Thread-14::DEBUG::2014-07-10 09:01:29,233::vm::715::vm.Vm::(_getDiskLatency) vmId=`52e238aa-e62a-48a8-a200-604e72422f3f`::Disk hdc latency not available >Thread-14::DEBUG::2014-07-10 09:01:29,233::vm::715::vm.Vm::(_getDiskLatency) vmId=`52e238aa-e62a-48a8-a200-604e72422f3f`::Disk vda latency not available >Thread-14::DEBUG::2014-07-10 09:01:29,234::vm::676::vm.Vm::(_getDiskStats) vmId=`ed909f7e-0ee2-4f6f-b4a5-a165f689a276`::Disk hdd stats not available >Thread-14::DEBUG::2014-07-10 09:01:29,234::vm::676::vm.Vm::(_getDiskStats) vmId=`ed909f7e-0ee2-4f6f-b4a5-a165f689a276`::Disk hdc stats not available >Thread-14::DEBUG::2014-07-10 09:01:29,234::vm::676::vm.Vm::(_getDiskStats) vmId=`ed909f7e-0ee2-4f6f-b4a5-a165f689a276`::Disk vda stats not available >Thread-14::DEBUG::2014-07-10 09:01:29,234::vm::715::vm.Vm::(_getDiskLatency) vmId=`ed909f7e-0ee2-4f6f-b4a5-a165f689a276`::Disk hdd latency not available >Thread-14::DEBUG::2014-07-10 09:01:29,235::vm::715::vm.Vm::(_getDiskLatency) vmId=`ed909f7e-0ee2-4f6f-b4a5-a165f689a276`::Disk hdc latency not available >Thread-14::DEBUG::2014-07-10 09:01:29,235::vm::715::vm.Vm::(_getDiskLatency) vmId=`ed909f7e-0ee2-4f6f-b4a5-a165f689a276`::Disk vda latency not available >VM Channels Listener::DEBUG::2014-07-10 09:01:29,921::vmChannels::106::vds::(_do_add_channels) fileno 61 was added to unconnected channels. >VM Channels Listener::DEBUG::2014-07-10 09:01:29,921::vmChannels::132::vds::(_handle_unconnected) Trying to connect fileno 61. >VM Channels Listener::DEBUG::2014-07-10 09:01:29,922::guestIF::194::vm.Vm::(_connect) vmId=`52e238aa-e62a-48a8-a200-604e72422f3f`::Attempting connection to /var/lib/libvirt/qemu/channels/52e238aa-e62a-48a8-a200-604e72422f3f.com.redhat.rhevm.vdsm >VM Channels Listener::DEBUG::2014-07-10 09:01:29,922::guestIF::197::vm.Vm::(_connect) vmId=`52e238aa-e62a-48a8-a200-604e72422f3f`::Connected to /var/lib/libvirt/qemu/channels/52e238aa-e62a-48a8-a200-604e72422f3f.com.redhat.rhevm.vdsm >VM Channels Listener::DEBUG::2014-07-10 09:01:29,922::vmChannels::148::vds::(_handle_unconnected) Connecting to fileno 61 succeeded. >Dummy-33::DEBUG::2014-07-10 09:01:29,948::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:01:30,039::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0387943 s, 26.4 MB/s\n'; <rc> = 0 >Thread-34::DEBUG::2014-07-10 09:01:30,054::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [1be1df25] >Thread-34::DEBUG::2014-07-10 09:01:30,057::task::595::TaskManager.Task::(_updateState) Task=`987e9b60-127c-4388-96f0-10643f60289c`::moving from state init -> state preparing >Thread-34::INFO::2014-07-10 09:01:30,060::logUtils::44::dispatcher::(wrapper) Run and protect: createVolume(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='28408446-e5fd-4565-a976-e760951593fe', size='10737418240', volFormat=4, preallocate=2, diskType=2, volUUID='776303a2-5585-451e-826e-0e338d4a1e98', desc='', srcImgUUID='9cf413b7-7f14-4a61-8c71-913e5b0ea9c0', srcVolUUID='47592965-e853-4e59-9728-d11cca6a7a8a') >Thread-34::DEBUG::2014-07-10 09:01:30,065::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.9e1aa540-1f4e-4ee3-a152-be381ef6c3bd`ReqID=`5ba08314-2e7d-4d13-b848-62ba16cd5ff7`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '1464' at 'createVolume' >Thread-34::DEBUG::2014-07-10 09:01:30,066::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.9e1aa540-1f4e-4ee3-a152-be381ef6c3bd' for lock type 'shared' >Thread-34::DEBUG::2014-07-10 09:01:30,069::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.9e1aa540-1f4e-4ee3-a152-be381ef6c3bd' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-10 09:01:30,070::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.9e1aa540-1f4e-4ee3-a152-be381ef6c3bd`ReqID=`5ba08314-2e7d-4d13-b848-62ba16cd5ff7`::Granted request >Thread-34::DEBUG::2014-07-10 09:01:30,074::task::827::TaskManager.Task::(resourceAcquired) Task=`987e9b60-127c-4388-96f0-10643f60289c`::_resourcesAcquired: Storage.9e1aa540-1f4e-4ee3-a152-be381ef6c3bd (shared) >Thread-34::DEBUG::2014-07-10 09:01:30,076::task::990::TaskManager.Task::(_decref) Task=`987e9b60-127c-4388-96f0-10643f60289c`::ref 1 aborting False >Thread-34::DEBUG::2014-07-10 09:01:30,083::task::752::TaskManager.Task::(_save) Task=`987e9b60-127c-4388-96f0-10643f60289c`::_save: orig /rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/master/tasks/987e9b60-127c-4388-96f0-10643f60289c temp /rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/master/tasks/987e9b60-127c-4388-96f0-10643f60289c.temp >Thread-34::DEBUG::2014-07-10 09:01:30,106::taskManager::68::TaskManager::(scheduleJob) scheduled job createVolume for task 987e9b60-127c-4388-96f0-10643f60289c >Thread-34::INFO::2014-07-10 09:01:30,106::logUtils::47::dispatcher::(wrapper) Run and protect: createVolume, Return response: None >Thread-34::DEBUG::2014-07-10 09:01:30,106::task::1180::TaskManager.Task::(prepare) Task=`987e9b60-127c-4388-96f0-10643f60289c`::Prepare: 1 jobs exist, move to acquiring >Thread-34::DEBUG::2014-07-10 09:01:30,107::task::595::TaskManager.Task::(_updateState) Task=`987e9b60-127c-4388-96f0-10643f60289c`::moving from state preparing -> state acquiring >Thread-34::DEBUG::2014-07-10 09:01:30,107::task::752::TaskManager.Task::(_save) Task=`987e9b60-127c-4388-96f0-10643f60289c`::_save: orig /rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/master/tasks/987e9b60-127c-4388-96f0-10643f60289c temp /rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/master/tasks/987e9b60-127c-4388-96f0-10643f60289c.temp >Thread-34::DEBUG::2014-07-10 09:01:30,113::task::595::TaskManager.Task::(_updateState) Task=`987e9b60-127c-4388-96f0-10643f60289c`::moving from state acquiring -> state queued >Thread-34::DEBUG::2014-07-10 09:01:30,114::task::752::TaskManager.Task::(_save) Task=`987e9b60-127c-4388-96f0-10643f60289c`::_save: orig /rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/master/tasks/987e9b60-127c-4388-96f0-10643f60289c temp /rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/master/tasks/987e9b60-127c-4388-96f0-10643f60289c.temp >Thread-34::DEBUG::2014-07-10 09:01:30,120::taskManager::50::TaskManager::(_queueTask) queuing task: 987e9b60-127c-4388-96f0-10643f60289c >Thread-34::DEBUG::2014-07-10 09:01:30,120::taskManager::56::TaskManager::(_queueTask) task queued: 987e9b60-127c-4388-96f0-10643f60289c >7fc7681e-8725-425e-88ea-fd4cfdcab46e::DEBUG::2014-07-10 09:01:30,121::threadPool::57::Misc.ThreadPool::(setRunningTask) Number of running tasks: 1 >Thread-34::DEBUG::2014-07-10 09:01:30,123::task::1182::TaskManager.Task::(prepare) Task=`987e9b60-127c-4388-96f0-10643f60289c`::returning >987e9b60-127c-4388-96f0-10643f60289c::DEBUG::2014-07-10 09:01:30,124::threadPool::200::Misc.ThreadPool.WorkerThread::(_processNextTask) Task: 987e9b60-127c-4388-96f0-10643f60289c running: <bound method Task.commit of <storage.task.Task instance at 0x7f62180ac050>> with: None >Thread-34::DEBUG::2014-07-10 09:01:30,126::task::990::TaskManager.Task::(_decref) Task=`987e9b60-127c-4388-96f0-10643f60289c`::ref 0 aborting False >987e9b60-127c-4388-96f0-10643f60289c::DEBUG::2014-07-10 09:01:30,126::task::1194::TaskManager.Task::(commit) Task=`987e9b60-127c-4388-96f0-10643f60289c`::committing task: 987e9b60-127c-4388-96f0-10643f60289c >987e9b60-127c-4388-96f0-10643f60289c::DEBUG::2014-07-10 09:01:30,129::task::595::TaskManager.Task::(_updateState) Task=`987e9b60-127c-4388-96f0-10643f60289c`::moving from state queued -> state running >987e9b60-127c-4388-96f0-10643f60289c::DEBUG::2014-07-10 09:01:30,133::task::752::TaskManager.Task::(_save) Task=`987e9b60-127c-4388-96f0-10643f60289c`::_save: orig /rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/master/tasks/987e9b60-127c-4388-96f0-10643f60289c temp /rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/master/tasks/987e9b60-127c-4388-96f0-10643f60289c.temp >987e9b60-127c-4388-96f0-10643f60289c::DEBUG::2014-07-10 09:01:30,141::task::905::TaskManager.Task::(_runJobs) Task=`987e9b60-127c-4388-96f0-10643f60289c`::Task.run: running job 0: createVolume: <bound method StoragePool.createVolume of <storage.sp.StoragePool object at 0x7f62180b9dd0>> (args: ('9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', '28408446-e5fd-4565-a976-e760951593fe', 20971520, 4, 2, 2, '776303a2-5585-451e-826e-0e338d4a1e98', '', '9cf413b7-7f14-4a61-8c71-913e5b0ea9c0', '47592965-e853-4e59-9728-d11cca6a7a8a') kwargs: {}) >987e9b60-127c-4388-96f0-10643f60289c::DEBUG::2014-07-10 09:01:30,142::task::331::TaskManager.Task::(run) Task=`987e9b60-127c-4388-96f0-10643f60289c`::Job.run: running createVolume: <bound method StoragePool.createVolume of <storage.sp.StoragePool object at 0x7f62180b9dd0>> (args: ('9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', '28408446-e5fd-4565-a976-e760951593fe', 20971520, 4, 2, 2, '776303a2-5585-451e-826e-0e338d4a1e98', '', '9cf413b7-7f14-4a61-8c71-913e5b0ea9c0', '47592965-e853-4e59-9728-d11cca6a7a8a') kwargs: {}) callback None >987e9b60-127c-4388-96f0-10643f60289c::DEBUG::2014-07-10 09:01:30,142::blockVolume::572::Storage.Misc.excCmd::(getMetadata) '/bin/dd iflag=direct skip=4 bs=512 if=/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/metadata count=1' (cwd None) >987e9b60-127c-4388-96f0-10643f60289c::DEBUG::2014-07-10 09:01:30,155::blockVolume::572::Storage.Misc.excCmd::(getMetadata) SUCCESS: <err> = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.000415921 s, 1.2 MB/s\n'; <rc> = 0 >987e9b60-127c-4388-96f0-10643f60289c::DEBUG::2014-07-10 09:01:30,155::misc::282::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.000415921 s, 1.2 MB/s'], size: 512 >987e9b60-127c-4388-96f0-10643f60289c::DEBUG::2014-07-10 09:01:30,156::resourceManager::198::ResourceManager.Request::(__init__) ResName=`9e1aa540-1f4e-4ee3-a152-be381ef6c3bd_imageNS.28408446-e5fd-4565-a976-e760951593fe`ReqID=`6c7d0d60-5b47-4d64-bd4c-5817752007c0`::Request was made in '/usr/share/vdsm/storage/sp.py' line '1767' at 'createVolume' >987e9b60-127c-4388-96f0-10643f60289c::DEBUG::2014-07-10 09:01:30,156::resourceManager::542::ResourceManager::(registerResource) Trying to register resource '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd_imageNS.28408446-e5fd-4565-a976-e760951593fe' for lock type 'exclusive' >987e9b60-127c-4388-96f0-10643f60289c::DEBUG::2014-07-10 09:01:30,157::lvm::427::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' got the operation mutex >987e9b60-127c-4388-96f0-10643f60289c::DEBUG::2014-07-10 09:01:30,158::lvm::296::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm lvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/3600601601282300032826addbbdae311|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,vg_name,attr,size,seg_start_pe,devices,tags 9e1aa540-1f4e-4ee3-a152-be381ef6c3bd' (cwd None) >987e9b60-127c-4388-96f0-10643f60289c::DEBUG::2014-07-10 09:01:30,376::lvm::296::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >987e9b60-127c-4388-96f0-10643f60289c::DEBUG::2014-07-10 09:01:30,385::lvm::462::Storage.LVM::(_reloadlvs) lvs reloaded >987e9b60-127c-4388-96f0-10643f60289c::DEBUG::2014-07-10 09:01:30,386::lvm::462::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' released the operation mutex >987e9b60-127c-4388-96f0-10643f60289c::DEBUG::2014-07-10 09:01:30,397::resourceFactories::125::Storage.ResourcesFactories::(__getResourceCandidatesList) Image 28408446-e5fd-4565-a976-e760951593fe does not exist in domain 9e1aa540-1f4e-4ee3-a152-be381ef6c3bd >987e9b60-127c-4388-96f0-10643f60289c::DEBUG::2014-07-10 09:01:30,398::resourceManager::601::ResourceManager::(registerResource) Resource '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd_imageNS.28408446-e5fd-4565-a976-e760951593fe' is free. Now locking as 'exclusive' (1 active user) >987e9b60-127c-4388-96f0-10643f60289c::DEBUG::2014-07-10 09:01:30,398::resourceManager::238::ResourceManager.Request::(grant) ResName=`9e1aa540-1f4e-4ee3-a152-be381ef6c3bd_imageNS.28408446-e5fd-4565-a976-e760951593fe`ReqID=`6c7d0d60-5b47-4d64-bd4c-5817752007c0`::Granted request >987e9b60-127c-4388-96f0-10643f60289c::INFO::2014-07-10 09:01:30,399::image::123::Storage.Image::(create) Create placeholder /rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/images/28408446-e5fd-4565-a976-e760951593fe for image's volumes >987e9b60-127c-4388-96f0-10643f60289c::DEBUG::2014-07-10 09:01:30,400::task::752::TaskManager.Task::(_save) Task=`987e9b60-127c-4388-96f0-10643f60289c`::_save: orig /rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/master/tasks/987e9b60-127c-4388-96f0-10643f60289c temp /rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/master/tasks/987e9b60-127c-4388-96f0-10643f60289c.temp >987e9b60-127c-4388-96f0-10643f60289c::DEBUG::2014-07-10 09:01:30,409::blockVolume::572::Storage.Misc.excCmd::(getMetadata) '/bin/dd iflag=direct skip=4 bs=512 if=/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/metadata count=1' (cwd None) >987e9b60-127c-4388-96f0-10643f60289c::DEBUG::2014-07-10 09:01:30,423::blockVolume::572::Storage.Misc.excCmd::(getMetadata) SUCCESS: <err> = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.000518046 s, 988 kB/s\n'; <rc> = 0 >987e9b60-127c-4388-96f0-10643f60289c::DEBUG::2014-07-10 09:01:30,423::misc::282::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.000518046 s, 988 kB/s'], size: 512 >987e9b60-127c-4388-96f0-10643f60289c::DEBUG::2014-07-10 09:01:30,424::volume::300::Storage.Volume::(share) Share volume 47592965-e853-4e59-9728-d11cca6a7a8a to /rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/images/28408446-e5fd-4565-a976-e760951593fe >987e9b60-127c-4388-96f0-10643f60289c::DEBUG::2014-07-10 09:01:30,424::blockVolume::572::Storage.Misc.excCmd::(getMetadata) '/bin/dd iflag=direct skip=4 bs=512 if=/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/metadata count=1' (cwd None) >987e9b60-127c-4388-96f0-10643f60289c::DEBUG::2014-07-10 09:01:30,435::blockVolume::572::Storage.Misc.excCmd::(getMetadata) SUCCESS: <err> = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.00038367 s, 1.3 MB/s\n'; <rc> = 0 >987e9b60-127c-4388-96f0-10643f60289c::DEBUG::2014-07-10 09:01:30,436::misc::282::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.00038367 s, 1.3 MB/s'], size: 512 >987e9b60-127c-4388-96f0-10643f60289c::DEBUG::2014-07-10 09:01:30,437::task::752::TaskManager.Task::(_save) Task=`987e9b60-127c-4388-96f0-10643f60289c`::_save: orig /rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/master/tasks/987e9b60-127c-4388-96f0-10643f60289c temp /rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/master/tasks/987e9b60-127c-4388-96f0-10643f60289c.temp >987e9b60-127c-4388-96f0-10643f60289c::DEBUG::2014-07-10 09:01:30,444::blockVolume::353::Storage.Volume::(_share) Share volume 47592965-e853-4e59-9728-d11cca6a7a8a to /rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/images/28408446-e5fd-4565-a976-e760951593fe >987e9b60-127c-4388-96f0-10643f60289c::DEBUG::2014-07-10 09:01:30,445::blockVolume::572::Storage.Misc.excCmd::(getMetadata) '/bin/dd iflag=direct skip=4 bs=512 if=/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/metadata count=1' (cwd None) >987e9b60-127c-4388-96f0-10643f60289c::DEBUG::2014-07-10 09:01:30,457::blockVolume::572::Storage.Misc.excCmd::(getMetadata) SUCCESS: <err> = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.000558281 s, 917 kB/s\n'; <rc> = 0 >987e9b60-127c-4388-96f0-10643f60289c::DEBUG::2014-07-10 09:01:30,457::misc::282::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.000558281 s, 917 kB/s'], size: 512 >987e9b60-127c-4388-96f0-10643f60289c::INFO::2014-07-10 09:01:30,458::volume::443::Storage.Volume::(create) Creating volume 776303a2-5585-451e-826e-0e338d4a1e98 >987e9b60-127c-4388-96f0-10643f60289c::DEBUG::2014-07-10 09:01:30,459::task::752::TaskManager.Task::(_save) Task=`987e9b60-127c-4388-96f0-10643f60289c`::_save: orig /rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/master/tasks/987e9b60-127c-4388-96f0-10643f60289c temp /rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/master/tasks/987e9b60-127c-4388-96f0-10643f60289c.temp >987e9b60-127c-4388-96f0-10643f60289c::DEBUG::2014-07-10 09:01:30,469::task::752::TaskManager.Task::(_save) Task=`987e9b60-127c-4388-96f0-10643f60289c`::_save: orig /rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/master/tasks/987e9b60-127c-4388-96f0-10643f60289c temp /rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/master/tasks/987e9b60-127c-4388-96f0-10643f60289c.temp >987e9b60-127c-4388-96f0-10643f60289c::DEBUG::2014-07-10 09:01:30,480::lvm::296::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm lvcreate --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/3600601601282300032826addbbdae311|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } " --autobackup n --contiguous n --size 1024m --addtag OVIRT_VOL_INITIALIZING --name 776303a2-5585-451e-826e-0e338d4a1e98 9e1aa540-1f4e-4ee3-a152-be381ef6c3bd' (cwd None) >987e9b60-127c-4388-96f0-10643f60289c::DEBUG::2014-07-10 09:01:30,809::lvm::296::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ' WARNING: This metadata update is NOT backed up\n WARNING: This metadata update is NOT backed up\n'; <rc> = 0 >987e9b60-127c-4388-96f0-10643f60289c::DEBUG::2014-07-10 09:01:30,809::lvm::503::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >987e9b60-127c-4388-96f0-10643f60289c::DEBUG::2014-07-10 09:01:30,810::lvm::505::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >987e9b60-127c-4388-96f0-10643f60289c::DEBUG::2014-07-10 09:01:30,810::lvm::513::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >987e9b60-127c-4388-96f0-10643f60289c::DEBUG::2014-07-10 09:01:30,810::lvm::525::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >987e9b60-127c-4388-96f0-10643f60289c::WARNING::2014-07-10 09:01:30,811::utils::129::root::(rmFile) File: /rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/images/28408446-e5fd-4565-a976-e760951593fe/776303a2-5585-451e-826e-0e338d4a1e98 already removed >987e9b60-127c-4388-96f0-10643f60289c::INFO::2014-07-10 09:01:30,811::blockVolume::169::Storage.Volume::(_create) Request to create snapshot 28408446-e5fd-4565-a976-e760951593fe/776303a2-5585-451e-826e-0e338d4a1e98 of volume 9cf413b7-7f14-4a61-8c71-913e5b0ea9c0/47592965-e853-4e59-9728-d11cca6a7a8a >987e9b60-127c-4388-96f0-10643f60289c::DEBUG::2014-07-10 09:01:30,812::task::752::TaskManager.Task::(_save) Task=`987e9b60-127c-4388-96f0-10643f60289c`::_save: orig /rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/master/tasks/987e9b60-127c-4388-96f0-10643f60289c temp /rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/master/tasks/987e9b60-127c-4388-96f0-10643f60289c.temp >987e9b60-127c-4388-96f0-10643f60289c::DEBUG::2014-07-10 09:01:30,828::blockVolume::572::Storage.Misc.excCmd::(getMetadata) '/bin/dd iflag=direct skip=4 bs=512 if=/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/metadata count=1' (cwd None) >987e9b60-127c-4388-96f0-10643f60289c::DEBUG::2014-07-10 09:01:30,841::blockVolume::572::Storage.Misc.excCmd::(getMetadata) SUCCESS: <err> = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.000417273 s, 1.2 MB/s\n'; <rc> = 0 >987e9b60-127c-4388-96f0-10643f60289c::DEBUG::2014-07-10 09:01:30,841::misc::282::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.000417273 s, 1.2 MB/s'], size: 512 >987e9b60-127c-4388-96f0-10643f60289c::INFO::2014-07-10 09:01:30,842::volume::789::Storage.Volume::(prepare) Volume: preparing volume 9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/47592965-e853-4e59-9728-d11cca6a7a8a >987e9b60-127c-4388-96f0-10643f60289c::DEBUG::2014-07-10 09:01:30,842::blockVolume::572::Storage.Misc.excCmd::(getMetadata) '/bin/dd iflag=direct skip=4 bs=512 if=/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/metadata count=1' (cwd None) >987e9b60-127c-4388-96f0-10643f60289c::DEBUG::2014-07-10 09:01:30,855::blockVolume::572::Storage.Misc.excCmd::(getMetadata) SUCCESS: <err> = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.000678328 s, 755 kB/s\n'; <rc> = 0 >987e9b60-127c-4388-96f0-10643f60289c::DEBUG::2014-07-10 09:01:30,856::misc::282::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.000678328 s, 755 kB/s'], size: 512 >987e9b60-127c-4388-96f0-10643f60289c::DEBUG::2014-07-10 09:01:30,857::resourceManager::198::ResourceManager.Request::(__init__) ResName=`9e1aa540-1f4e-4ee3-a152-be381ef6c3bd_lvmActivationNS.47592965-e853-4e59-9728-d11cca6a7a8a`ReqID=`c9f4491a-cdbe-4ad4-ab4a-8f6244d07de1`::Request was made in '/usr/share/vdsm/storage/volume.py' line '806' at 'prepare' >987e9b60-127c-4388-96f0-10643f60289c::DEBUG::2014-07-10 09:01:30,857::resourceManager::542::ResourceManager::(registerResource) Trying to register resource '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd_lvmActivationNS.47592965-e853-4e59-9728-d11cca6a7a8a' for lock type 'shared' >987e9b60-127c-4388-96f0-10643f60289c::DEBUG::2014-07-10 09:01:30,858::resourceManager::601::ResourceManager::(registerResource) Resource '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd_lvmActivationNS.47592965-e853-4e59-9728-d11cca6a7a8a' is free. Now locking as 'shared' (1 active user) >987e9b60-127c-4388-96f0-10643f60289c::DEBUG::2014-07-10 09:01:30,858::resourceManager::238::ResourceManager.Request::(grant) ResName=`9e1aa540-1f4e-4ee3-a152-be381ef6c3bd_lvmActivationNS.47592965-e853-4e59-9728-d11cca6a7a8a`ReqID=`c9f4491a-cdbe-4ad4-ab4a-8f6244d07de1`::Granted request >987e9b60-127c-4388-96f0-10643f60289c::DEBUG::2014-07-10 09:01:30,859::blockVolume::572::Storage.Misc.excCmd::(getMetadata) '/bin/dd iflag=direct skip=4 bs=512 if=/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/metadata count=1' (cwd None) >987e9b60-127c-4388-96f0-10643f60289c::DEBUG::2014-07-10 09:01:30,872::blockVolume::572::Storage.Misc.excCmd::(getMetadata) SUCCESS: <err> = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.000603649 s, 848 kB/s\n'; <rc> = 0 >987e9b60-127c-4388-96f0-10643f60289c::DEBUG::2014-07-10 09:01:30,873::misc::282::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.000603649 s, 848 kB/s'], size: 512 >987e9b60-127c-4388-96f0-10643f60289c::DEBUG::2014-07-10 09:01:30,873::volume::270::Storage.Volume::(clone) Volume.clone: /rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/images/28408446-e5fd-4565-a976-e760951593fe/47592965-e853-4e59-9728-d11cca6a7a8a to /rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/images/28408446-e5fd-4565-a976-e760951593fe/776303a2-5585-451e-826e-0e338d4a1e98 >987e9b60-127c-4388-96f0-10643f60289c::DEBUG::2014-07-10 09:01:30,874::blockVolume::572::Storage.Misc.excCmd::(getMetadata) '/bin/dd iflag=direct skip=4 bs=512 if=/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/metadata count=1' (cwd None) >987e9b60-127c-4388-96f0-10643f60289c::DEBUG::2014-07-10 09:01:30,886::blockVolume::572::Storage.Misc.excCmd::(getMetadata) SUCCESS: <err> = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.000495573 s, 1.0 MB/s\n'; <rc> = 0 >987e9b60-127c-4388-96f0-10643f60289c::DEBUG::2014-07-10 09:01:30,887::misc::282::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.000495573 s, 1.0 MB/s'], size: 512 >987e9b60-127c-4388-96f0-10643f60289c::DEBUG::2014-07-10 09:01:30,887::blockVolume::572::Storage.Misc.excCmd::(getMetadata) '/bin/dd iflag=direct skip=4 bs=512 if=/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/metadata count=1' (cwd None) >987e9b60-127c-4388-96f0-10643f60289c::DEBUG::2014-07-10 09:01:30,940::blockVolume::572::Storage.Misc.excCmd::(getMetadata) SUCCESS: <err> = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.0414122 s, 12.4 kB/s\n'; <rc> = 0 >987e9b60-127c-4388-96f0-10643f60289c::DEBUG::2014-07-10 09:01:30,941::misc::282::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.0414122 s, 12.4 kB/s'], size: 512 >987e9b60-127c-4388-96f0-10643f60289c::DEBUG::2014-07-10 09:01:30,941::volume::1042::Storage.Misc.excCmd::(createVolume) '/usr/bin/qemu-img create -f qcow2 -F raw -b ../28408446-e5fd-4565-a976-e760951593fe/47592965-e853-4e59-9728-d11cca6a7a8a /rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/images/28408446-e5fd-4565-a976-e760951593fe/776303a2-5585-451e-826e-0e338d4a1e98' (cwd /rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/images/28408446-e5fd-4565-a976-e760951593fe) >987e9b60-127c-4388-96f0-10643f60289c::DEBUG::2014-07-10 09:01:31,004::volume::1042::Storage.Misc.excCmd::(createVolume) SUCCESS: <err> = ''; <rc> = 0 >987e9b60-127c-4388-96f0-10643f60289c::INFO::2014-07-10 09:01:31,004::blockVolume::393::Storage.Volume::(teardown) Tearing down volume 9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/47592965-e853-4e59-9728-d11cca6a7a8a justme False >987e9b60-127c-4388-96f0-10643f60289c::DEBUG::2014-07-10 09:01:31,005::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd_lvmActivationNS.47592965-e853-4e59-9728-d11cca6a7a8a' >987e9b60-127c-4388-96f0-10643f60289c::DEBUG::2014-07-10 09:01:31,005::resourceManager::635::ResourceManager::(releaseResource) Released resource '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd_lvmActivationNS.47592965-e853-4e59-9728-d11cca6a7a8a' (0 active users) >987e9b60-127c-4388-96f0-10643f60289c::DEBUG::2014-07-10 09:01:31,005::resourceManager::641::ResourceManager::(releaseResource) Resource '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd_lvmActivationNS.47592965-e853-4e59-9728-d11cca6a7a8a' is free, finding out if anyone is waiting for it. >987e9b60-127c-4388-96f0-10643f60289c::DEBUG::2014-07-10 09:01:31,006::lvm::296::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm lvchange --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/3600601601282300032826addbbdae311|/dev/mapper/360060160f4a030003840ec867ddee311|/dev/mapper/367cad74c2fcba00019e6afd20c781e67|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } " --autobackup n --available n 9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/47592965-e853-4e59-9728-d11cca6a7a8a' (cwd None) >Thread-14::DEBUG::2014-07-10 09:01:31,267::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-14::DEBUG::2014-07-10 09:01:31,268::task::595::TaskManager.Task::(_updateState) Task=`40a35344-db4b-43b6-a432-fb7304ef4761`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 09:01:31,268::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-14::INFO::2014-07-10 09:01:31,269::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:01:31,269::task::1185::TaskManager.Task::(prepare) Task=`40a35344-db4b-43b6-a432-fb7304ef4761`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:01:31,269::task::595::TaskManager.Task::(_updateState) Task=`40a35344-db4b-43b6-a432-fb7304ef4761`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 09:01:31,270::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 09:01:31,270::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 09:01:31,270::task::990::TaskManager.Task::(_decref) Task=`40a35344-db4b-43b6-a432-fb7304ef4761`::ref 0 aborting False >Thread-34::DEBUG::2014-07-10 09:01:31,313::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-34::DEBUG::2014-07-10 09:01:31,314::task::595::TaskManager.Task::(_updateState) Task=`705eb3ab-7e31-4ed2-9e98-ba0885633f87`::moving from state init -> state preparing >Thread-34::INFO::2014-07-10 09:01:31,314::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-34::DEBUG::2014-07-10 09:01:31,315::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`850759d9-b788-46f8-8a8e-bd157cbdf540`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-10 09:01:31,315::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' for lock type 'shared' >Thread-34::DEBUG::2014-07-10 09:01:31,315::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-10 09:01:31,315::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`850759d9-b788-46f8-8a8e-bd157cbdf540`::Granted request >Thread-34::DEBUG::2014-07-10 09:01:31,316::task::827::TaskManager.Task::(resourceAcquired) Task=`705eb3ab-7e31-4ed2-9e98-ba0885633f87`::_resourcesAcquired: Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee (shared) >Thread-34::DEBUG::2014-07-10 09:01:31,316::task::990::TaskManager.Task::(_decref) Task=`705eb3ab-7e31-4ed2-9e98-ba0885633f87`::ref 1 aborting False >Thread-34::DEBUG::2014-07-10 09:01:31,317::lvm::373::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-34::DEBUG::2014-07-10 09:01:31,317::lvm::296::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/3600601601282300032826addbbdae311|/dev/mapper/360060160f4a030003840ec867ddee311|/dev/mapper/367cad74c2fcba00019e6afd20c781e67|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name 9e1aa540-1f4e-4ee3-a152-be381ef6c3bd' (cwd None) >Thread-34::DEBUG::2014-07-10 09:01:31,558::lvm::296::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-34::DEBUG::2014-07-10 09:01:31,561::lvm::415::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-34::INFO::2014-07-10 09:01:31,562::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1082063323136', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532069482496', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:01:31,562::task::1185::TaskManager.Task::(prepare) Task=`705eb3ab-7e31-4ed2-9e98-ba0885633f87`::finished: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1082063323136', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532069482496', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:01:31,563::task::595::TaskManager.Task::(_updateState) Task=`705eb3ab-7e31-4ed2-9e98-ba0885633f87`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-10 09:01:31,563::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee': < ResourceRef 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-10 09:01:31,563::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-10 09:01:31,564::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' >Thread-34::DEBUG::2014-07-10 09:01:31,564::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' (0 active users) >Thread-34::DEBUG::2014-07-10 09:01:31,564::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-10 09:01:31,564::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', Clearing records. >Thread-34::DEBUG::2014-07-10 09:01:31,565::task::990::TaskManager.Task::(_decref) Task=`705eb3ab-7e31-4ed2-9e98-ba0885633f87`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 09:01:32,107::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:01:32,193::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0343453 s, 29.8 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 09:01:32,374::BindingXMLRPC::1067::vds::(wrapper) client [10.35.3.13]::call vmGetStats with ('52e238aa-e62a-48a8-a200-604e72422f3f',) {} >Thread-14::DEBUG::2014-07-10 09:01:32,374::vm::598::vm.Vm::(_getCpuStats) vmId=`52e238aa-e62a-48a8-a200-604e72422f3f`::CPU stats not available: 'NoneType' object is unsubscriptable >Thread-14::DEBUG::2014-07-10 09:01:32,375::vm::654::vm.Vm::(_getNetworkStats) vmId=`52e238aa-e62a-48a8-a200-604e72422f3f`::Network stats not available >Thread-14::DEBUG::2014-07-10 09:01:32,375::vm::676::vm.Vm::(_getDiskStats) vmId=`52e238aa-e62a-48a8-a200-604e72422f3f`::Disk hdd stats not available >Thread-14::DEBUG::2014-07-10 09:01:32,375::vm::676::vm.Vm::(_getDiskStats) vmId=`52e238aa-e62a-48a8-a200-604e72422f3f`::Disk hdc stats not available >Thread-14::DEBUG::2014-07-10 09:01:32,375::vm::676::vm.Vm::(_getDiskStats) vmId=`52e238aa-e62a-48a8-a200-604e72422f3f`::Disk vda stats not available >Thread-14::DEBUG::2014-07-10 09:01:32,376::vm::715::vm.Vm::(_getDiskLatency) vmId=`52e238aa-e62a-48a8-a200-604e72422f3f`::Disk hdd latency not available >Thread-14::DEBUG::2014-07-10 09:01:32,376::vm::715::vm.Vm::(_getDiskLatency) vmId=`52e238aa-e62a-48a8-a200-604e72422f3f`::Disk hdc latency not available >Thread-14::DEBUG::2014-07-10 09:01:32,376::vm::715::vm.Vm::(_getDiskLatency) vmId=`52e238aa-e62a-48a8-a200-604e72422f3f`::Disk vda latency not available >Thread-14::DEBUG::2014-07-10 09:01:32,376::BindingXMLRPC::1074::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Powering up', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '12236', 'displayIp': '0', 'displayPort': u'5902', 'session': 'Unknown', 'displaySecurePort': u'5903', 'timeOffset': '0', 'hash': '-5500930374920933700', 'balloonInfo': {'balloon_max': '1048576', 'balloon_target': '1048576', 'balloon_cur': '0', 'balloon_min': '1048576'}, 'pauseCode': 'NOERR', 'clientIp': '', 'kvmEnable': 'true', 'network': {u'vnet1': {'state': 'unknown', 'macAddr': '00:1a:4a:de:6d:7b', 'speed': '1000', 'name': u'vnet1'}}, 'vmId': '52e238aa-e62a-48a8-a200-604e72422f3f', 'displayType': 'qxl', 'cpuUser': '0.00', 'disks': {u'vda': {'truesize': '1073741824', 'apparentsize': '1073741824', 'imageID': '76fdb054-02cd-42ed-9721-b3e65b34c3a4'}, u'hdd': {'truesize': '0', 'apparentsize': '0'}, u'hdc': {'truesize': '0', 'apparentsize': '0'}}, 'monitorResponse': '0', 'statsAge': '1.20', 'elapsedTime': '5', 'vmType': 'kvm', 'cpuSys': '0.00', 'guestCPUCount': -1, 'appsList': [], 'guestIPs': ''}]} >Thread-14::DEBUG::2014-07-10 09:01:32,381::BindingXMLRPC::1067::vds::(wrapper) client [10.35.3.13]::call vmGetStats with ('ed909f7e-0ee2-4f6f-b4a5-a165f689a276',) {} >Thread-14::DEBUG::2014-07-10 09:01:32,382::vm::676::vm.Vm::(_getDiskStats) vmId=`ed909f7e-0ee2-4f6f-b4a5-a165f689a276`::Disk hdd stats not available >Thread-14::DEBUG::2014-07-10 09:01:32,382::vm::676::vm.Vm::(_getDiskStats) vmId=`ed909f7e-0ee2-4f6f-b4a5-a165f689a276`::Disk hdc stats not available >Thread-14::DEBUG::2014-07-10 09:01:32,382::vm::676::vm.Vm::(_getDiskStats) vmId=`ed909f7e-0ee2-4f6f-b4a5-a165f689a276`::Disk vda stats not available >Thread-14::DEBUG::2014-07-10 09:01:32,382::vm::715::vm.Vm::(_getDiskLatency) vmId=`ed909f7e-0ee2-4f6f-b4a5-a165f689a276`::Disk hdd latency not available >Thread-14::DEBUG::2014-07-10 09:01:32,382::vm::715::vm.Vm::(_getDiskLatency) vmId=`ed909f7e-0ee2-4f6f-b4a5-a165f689a276`::Disk hdc latency not available >Thread-14::DEBUG::2014-07-10 09:01:32,383::vm::715::vm.Vm::(_getDiskLatency) vmId=`ed909f7e-0ee2-4f6f-b4a5-a165f689a276`::Disk vda latency not available >Thread-14::DEBUG::2014-07-10 09:01:32,383::BindingXMLRPC::1074::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Powering up', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '11613', 'displayIp': '0', 'displayPort': u'5900', 'session': 'Unknown', 'displaySecurePort': u'5901', 'timeOffset': '0', 'hash': '7841224975033595397', 'balloonInfo': {'balloon_max': '1048576', 'balloon_target': '1048576', 'balloon_cur': '1048576', 'balloon_min': '1048576'}, 'pauseCode': 'NOERR', 'clientIp': '', 'kvmEnable': 'true', 'network': {u'vnet0': {'macAddr': '00:1a:4a:de:6d:7a', 'rxDropped': '0', 'rxErrors': '0', 'txDropped': '0', 'txRate': '0.0', 'rxRate': '0.0', 'txErrors': '0', 'state': 'unknown', 'speed': '1000', 'name': u'vnet0'}}, 'vmId': 'ed909f7e-0ee2-4f6f-b4a5-a165f689a276', 'displayType': 'qxl', 'cpuUser': '44.65', 'disks': {u'vda': {'truesize': '1073741824', 'apparentsize': '1073741824', 'imageID': '0cd7d6ce-f497-4243-a690-c57744861eea'}, u'hdd': {'truesize': '0', 'apparentsize': '0'}, u'hdc': {'truesize': '0', 'apparentsize': '0'}}, 'monitorResponse': '0', 'statsAge': '0.88', 'elapsedTime': '25', 'vmType': 'kvm', 'cpuSys': '22.67', 'guestCPUCount': -1, 'appsList': [], 'guestIPs': ''}]} >GuestMonitor-scale_2::DEBUG::2014-07-10 09:01:32,781::vm::598::vm.Vm::(_getCpuStats) vmId=`52e238aa-e62a-48a8-a200-604e72422f3f`::CPU stats not available: 'NoneType' object is unsubscriptable >GuestMonitor-scale_2::DEBUG::2014-07-10 09:01:32,782::vm::654::vm.Vm::(_getNetworkStats) vmId=`52e238aa-e62a-48a8-a200-604e72422f3f`::Network stats not available >GuestMonitor-scale_2::DEBUG::2014-07-10 09:01:32,782::vm::676::vm.Vm::(_getDiskStats) vmId=`52e238aa-e62a-48a8-a200-604e72422f3f`::Disk hdd stats not available >GuestMonitor-scale_2::DEBUG::2014-07-10 09:01:32,782::vm::676::vm.Vm::(_getDiskStats) vmId=`52e238aa-e62a-48a8-a200-604e72422f3f`::Disk hdc stats not available >GuestMonitor-scale_2::DEBUG::2014-07-10 09:01:32,782::vm::676::vm.Vm::(_getDiskStats) vmId=`52e238aa-e62a-48a8-a200-604e72422f3f`::Disk vda stats not available >GuestMonitor-scale_2::DEBUG::2014-07-10 09:01:32,783::vm::715::vm.Vm::(_getDiskLatency) vmId=`52e238aa-e62a-48a8-a200-604e72422f3f`::Disk hdd latency not available >GuestMonitor-scale_2::DEBUG::2014-07-10 09:01:32,783::vm::715::vm.Vm::(_getDiskLatency) vmId=`52e238aa-e62a-48a8-a200-604e72422f3f`::Disk hdc latency not available >GuestMonitor-scale_2::DEBUG::2014-07-10 09:01:32,783::vm::715::vm.Vm::(_getDiskLatency) vmId=`52e238aa-e62a-48a8-a200-604e72422f3f`::Disk vda latency not available >GuestMonitor-scale_2::DEBUG::2014-07-10 09:01:32,784::vm::598::vm.Vm::(_getCpuStats) vmId=`52e238aa-e62a-48a8-a200-604e72422f3f`::CPU stats not available: 'NoneType' object is unsubscriptable >GuestMonitor-scale_2::DEBUG::2014-07-10 09:01:32,784::vm::654::vm.Vm::(_getNetworkStats) vmId=`52e238aa-e62a-48a8-a200-604e72422f3f`::Network stats not available >GuestMonitor-scale_2::DEBUG::2014-07-10 09:01:32,784::vm::676::vm.Vm::(_getDiskStats) vmId=`52e238aa-e62a-48a8-a200-604e72422f3f`::Disk hdd stats not available >GuestMonitor-scale_2::DEBUG::2014-07-10 09:01:32,784::vm::676::vm.Vm::(_getDiskStats) vmId=`52e238aa-e62a-48a8-a200-604e72422f3f`::Disk hdc stats not available >GuestMonitor-scale_2::DEBUG::2014-07-10 09:01:32,784::vm::676::vm.Vm::(_getDiskStats) vmId=`52e238aa-e62a-48a8-a200-604e72422f3f`::Disk vda stats not available >GuestMonitor-scale_2::DEBUG::2014-07-10 09:01:32,784::vm::715::vm.Vm::(_getDiskLatency) vmId=`52e238aa-e62a-48a8-a200-604e72422f3f`::Disk hdd latency not available >GuestMonitor-scale_2::DEBUG::2014-07-10 09:01:32,785::vm::715::vm.Vm::(_getDiskLatency) vmId=`52e238aa-e62a-48a8-a200-604e72422f3f`::Disk hdc latency not available >GuestMonitor-scale_2::DEBUG::2014-07-10 09:01:32,785::vm::715::vm.Vm::(_getDiskLatency) vmId=`52e238aa-e62a-48a8-a200-604e72422f3f`::Disk vda latency not available >GuestMonitor-scale_1::DEBUG::2014-07-10 09:01:32,901::vm::676::vm.Vm::(_getDiskStats) vmId=`ed909f7e-0ee2-4f6f-b4a5-a165f689a276`::Disk hdd stats not available >GuestMonitor-scale_1::DEBUG::2014-07-10 09:01:32,902::vm::676::vm.Vm::(_getDiskStats) vmId=`ed909f7e-0ee2-4f6f-b4a5-a165f689a276`::Disk hdc stats not available >GuestMonitor-scale_1::DEBUG::2014-07-10 09:01:32,902::vm::676::vm.Vm::(_getDiskStats) vmId=`ed909f7e-0ee2-4f6f-b4a5-a165f689a276`::Disk vda stats not available >GuestMonitor-scale_1::DEBUG::2014-07-10 09:01:32,902::vm::715::vm.Vm::(_getDiskLatency) vmId=`ed909f7e-0ee2-4f6f-b4a5-a165f689a276`::Disk hdd latency not available >GuestMonitor-scale_1::DEBUG::2014-07-10 09:01:32,902::vm::715::vm.Vm::(_getDiskLatency) vmId=`ed909f7e-0ee2-4f6f-b4a5-a165f689a276`::Disk hdc latency not available >GuestMonitor-scale_1::DEBUG::2014-07-10 09:01:32,902::vm::715::vm.Vm::(_getDiskLatency) vmId=`ed909f7e-0ee2-4f6f-b4a5-a165f689a276`::Disk vda latency not available >GuestMonitor-scale_1::DEBUG::2014-07-10 09:01:32,903::vm::676::vm.Vm::(_getDiskStats) vmId=`ed909f7e-0ee2-4f6f-b4a5-a165f689a276`::Disk hdd stats not available >GuestMonitor-scale_1::DEBUG::2014-07-10 09:01:32,903::vm::676::vm.Vm::(_getDiskStats) vmId=`ed909f7e-0ee2-4f6f-b4a5-a165f689a276`::Disk hdc stats not available >GuestMonitor-scale_1::DEBUG::2014-07-10 09:01:32,903::vm::676::vm.Vm::(_getDiskStats) vmId=`ed909f7e-0ee2-4f6f-b4a5-a165f689a276`::Disk vda stats not available >GuestMonitor-scale_1::DEBUG::2014-07-10 09:01:32,903::vm::715::vm.Vm::(_getDiskLatency) vmId=`ed909f7e-0ee2-4f6f-b4a5-a165f689a276`::Disk hdd latency not available >GuestMonitor-scale_1::DEBUG::2014-07-10 09:01:32,904::vm::715::vm.Vm::(_getDiskLatency) vmId=`ed909f7e-0ee2-4f6f-b4a5-a165f689a276`::Disk hdc latency not available >GuestMonitor-scale_1::DEBUG::2014-07-10 09:01:32,904::vm::715::vm.Vm::(_getDiskLatency) vmId=`ed909f7e-0ee2-4f6f-b4a5-a165f689a276`::Disk vda latency not available >Thread-40::DEBUG::2014-07-10 09:01:34,023::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lion.qa.lab.tlv.redhat.com:_export_yuri2_backup2/6a70504d-00df-4869-8695-0f442053f6b6/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-40::DEBUG::2014-07-10 09:01:34,041::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n369 bytes (369 B) copied, 0.000454361 s, 812 kB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:01:34,209::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:01:34,298::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.034406 s, 29.8 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 09:01:35,220::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-14::DEBUG::2014-07-10 09:01:35,222::task::595::TaskManager.Task::(_updateState) Task=`74c4a194-0fb6-4c9d-ba05-625a4d1c00cc`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 09:01:35,222::logUtils::44::dispatcher::(wrapper) Run and protect: getAllTasksStatuses(spUUID=None, options=None) >Thread-14::DEBUG::2014-07-10 09:01:35,223::taskManager::102::TaskManager::(getAllTasksStatuses) Entry. >Thread-14::DEBUG::2014-07-10 09:01:35,223::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 987e9b60-127c-4388-96f0-10643f60289c >Thread-14::DEBUG::2014-07-10 09:01:35,223::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '987e9b60-127c-4388-96f0-10643f60289c'} >Thread-14::DEBUG::2014-07-10 09:01:35,223::taskManager::113::TaskManager::(getAllTasksStatuses) Return: {'987e9b60-127c-4388-96f0-10643f60289c': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '987e9b60-127c-4388-96f0-10643f60289c'}} >Thread-14::INFO::2014-07-10 09:01:35,224::logUtils::47::dispatcher::(wrapper) Run and protect: getAllTasksStatuses, Return response: {'allTasksStatus': {'987e9b60-127c-4388-96f0-10643f60289c': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '987e9b60-127c-4388-96f0-10643f60289c'}}} >Thread-14::DEBUG::2014-07-10 09:01:35,224::task::1185::TaskManager.Task::(prepare) Task=`74c4a194-0fb6-4c9d-ba05-625a4d1c00cc`::finished: {'allTasksStatus': {'987e9b60-127c-4388-96f0-10643f60289c': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '987e9b60-127c-4388-96f0-10643f60289c'}}} >Thread-14::DEBUG::2014-07-10 09:01:35,225::task::595::TaskManager.Task::(_updateState) Task=`74c4a194-0fb6-4c9d-ba05-625a4d1c00cc`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 09:01:35,225::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 09:01:35,225::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 09:01:35,225::task::990::TaskManager.Task::(_decref) Task=`74c4a194-0fb6-4c9d-ba05-625a4d1c00cc`::ref 0 aborting False >Thread-14::DEBUG::2014-07-10 09:01:35,397::BindingXMLRPC::1067::vds::(wrapper) client [10.35.3.13]::call vmGetStats with ('52e238aa-e62a-48a8-a200-604e72422f3f',) {} >Thread-14::DEBUG::2014-07-10 09:01:35,397::vm::598::vm.Vm::(_getCpuStats) vmId=`52e238aa-e62a-48a8-a200-604e72422f3f`::CPU stats not available: 'NoneType' object is unsubscriptable >Thread-14::DEBUG::2014-07-10 09:01:35,398::vm::654::vm.Vm::(_getNetworkStats) vmId=`52e238aa-e62a-48a8-a200-604e72422f3f`::Network stats not available >Thread-14::DEBUG::2014-07-10 09:01:35,398::vm::676::vm.Vm::(_getDiskStats) vmId=`52e238aa-e62a-48a8-a200-604e72422f3f`::Disk hdd stats not available >Thread-14::DEBUG::2014-07-10 09:01:35,398::vm::676::vm.Vm::(_getDiskStats) vmId=`52e238aa-e62a-48a8-a200-604e72422f3f`::Disk hdc stats not available >Thread-14::DEBUG::2014-07-10 09:01:35,398::vm::676::vm.Vm::(_getDiskStats) vmId=`52e238aa-e62a-48a8-a200-604e72422f3f`::Disk vda stats not available >Thread-14::DEBUG::2014-07-10 09:01:35,399::vm::715::vm.Vm::(_getDiskLatency) vmId=`52e238aa-e62a-48a8-a200-604e72422f3f`::Disk hdd latency not available >Thread-14::DEBUG::2014-07-10 09:01:35,399::vm::715::vm.Vm::(_getDiskLatency) vmId=`52e238aa-e62a-48a8-a200-604e72422f3f`::Disk hdc latency not available >Thread-14::DEBUG::2014-07-10 09:01:35,399::vm::715::vm.Vm::(_getDiskLatency) vmId=`52e238aa-e62a-48a8-a200-604e72422f3f`::Disk vda latency not available >Thread-14::DEBUG::2014-07-10 09:01:35,399::BindingXMLRPC::1074::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Powering up', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '12236', 'displayIp': '0', 'displayPort': u'5902', 'session': 'Unknown', 'displaySecurePort': u'5903', 'timeOffset': '0', 'hash': '-5500930374920933700', 'balloonInfo': {'balloon_max': '1048576', 'balloon_target': '1048576', 'balloon_cur': '0', 'balloon_min': '1048576'}, 'pauseCode': 'NOERR', 'clientIp': '', 'kvmEnable': 'true', 'network': {u'vnet1': {'state': 'unknown', 'macAddr': '00:1a:4a:de:6d:7b', 'speed': '1000', 'name': u'vnet1'}}, 'vmId': '52e238aa-e62a-48a8-a200-604e72422f3f', 'displayType': 'qxl', 'cpuUser': '0.00', 'disks': {u'vda': {'truesize': '1073741824', 'apparentsize': '1073741824', 'imageID': '76fdb054-02cd-42ed-9721-b3e65b34c3a4'}, u'hdd': {'truesize': '0', 'apparentsize': '0'}, u'hdc': {'truesize': '0', 'apparentsize': '0'}}, 'monitorResponse': '0', 'statsAge': '0.21', 'elapsedTime': '8', 'vmType': 'kvm', 'cpuSys': '0.00', 'guestCPUCount': -1, 'appsList': [], 'guestIPs': ''}]} >Thread-14::DEBUG::2014-07-10 09:01:35,404::BindingXMLRPC::1067::vds::(wrapper) client [10.35.3.13]::call vmGetStats with ('ed909f7e-0ee2-4f6f-b4a5-a165f689a276',) {} >Thread-14::DEBUG::2014-07-10 09:01:35,404::vm::676::vm.Vm::(_getDiskStats) vmId=`ed909f7e-0ee2-4f6f-b4a5-a165f689a276`::Disk hdd stats not available >Thread-14::DEBUG::2014-07-10 09:01:35,405::vm::676::vm.Vm::(_getDiskStats) vmId=`ed909f7e-0ee2-4f6f-b4a5-a165f689a276`::Disk hdc stats not available >Thread-14::DEBUG::2014-07-10 09:01:35,405::vm::676::vm.Vm::(_getDiskStats) vmId=`ed909f7e-0ee2-4f6f-b4a5-a165f689a276`::Disk vda stats not available >Thread-14::DEBUG::2014-07-10 09:01:35,405::vm::715::vm.Vm::(_getDiskLatency) vmId=`ed909f7e-0ee2-4f6f-b4a5-a165f689a276`::Disk hdd latency not available >Thread-14::DEBUG::2014-07-10 09:01:35,405::vm::715::vm.Vm::(_getDiskLatency) vmId=`ed909f7e-0ee2-4f6f-b4a5-a165f689a276`::Disk hdc latency not available >Thread-14::DEBUG::2014-07-10 09:01:35,405::vm::715::vm.Vm::(_getDiskLatency) vmId=`ed909f7e-0ee2-4f6f-b4a5-a165f689a276`::Disk vda latency not available >Thread-14::DEBUG::2014-07-10 09:01:35,406::BindingXMLRPC::1074::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Powering up', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '11613', 'displayIp': '0', 'displayPort': u'5900', 'session': 'Unknown', 'displaySecurePort': u'5901', 'timeOffset': '0', 'hash': '7841224975033595397', 'balloonInfo': {'balloon_max': '1048576', 'balloon_target': '1048576', 'balloon_cur': '1048576', 'balloon_min': '1048576'}, 'pauseCode': 'NOERR', 'clientIp': '', 'kvmEnable': 'true', 'network': {u'vnet0': {'macAddr': '00:1a:4a:de:6d:7a', 'rxDropped': '0', 'rxErrors': '0', 'txDropped': '0', 'txRate': '0.0', 'rxRate': '0.0', 'txErrors': '0', 'state': 'unknown', 'speed': '1000', 'name': u'vnet0'}}, 'vmId': 'ed909f7e-0ee2-4f6f-b4a5-a165f689a276', 'displayType': 'qxl', 'cpuUser': '44.65', 'disks': {u'vda': {'truesize': '1073741824', 'apparentsize': '1073741824', 'imageID': '0cd7d6ce-f497-4243-a690-c57744861eea'}, u'hdd': {'truesize': '0', 'apparentsize': '0'}, u'hdc': {'truesize': '0', 'apparentsize': '0'}}, 'monitorResponse': '0', 'statsAge': '1.90', 'elapsedTime': '28', 'vmType': 'kvm', 'cpuSys': '22.67', 'guestCPUCount': -1, 'appsList': [], 'guestIPs': ''}]} >987e9b60-127c-4388-96f0-10643f60289c::DEBUG::2014-07-10 09:01:36,056::lvm::296::Storage.Misc.excCmd::(cmd) FAILED: <err> = ' Logical volume 9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/47592965-e853-4e59-9728-d11cca6a7a8a in use.\n'; <rc> = 5 >987e9b60-127c-4388-96f0-10643f60289c::DEBUG::2014-07-10 09:01:36,062::lvm::513::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >987e9b60-127c-4388-96f0-10643f60289c::DEBUG::2014-07-10 09:01:36,062::lvm::525::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >987e9b60-127c-4388-96f0-10643f60289c::WARNING::2014-07-10 09:01:36,063::resourceFactories::61::Storage.ResourcesFactories::(close) Failure deactivate LV 9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/47592965-e853-4e59-9728-d11cca6a7a8a (Cannot deactivate Logical Volume: ('General Storage Exception: ("5 [] [\' Logical volume 9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/47592965-e853-4e59-9728-d11cca6a7a8a in use.\']\\n9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/[\'47592965-e853-4e59-9728-d11cca6a7a8a\']",)',)) >987e9b60-127c-4388-96f0-10643f60289c::DEBUG::2014-07-10 09:01:36,063::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd_lvmActivationNS.47592965-e853-4e59-9728-d11cca6a7a8a', Clearing records. >987e9b60-127c-4388-96f0-10643f60289c::DEBUG::2014-07-10 09:01:36,064::lvm::427::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' got the operation mutex >987e9b60-127c-4388-96f0-10643f60289c::DEBUG::2014-07-10 09:01:36,065::lvm::296::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm lvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/3600601601282300032826addbbdae311|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,vg_name,attr,size,seg_start_pe,devices,tags 9e1aa540-1f4e-4ee3-a152-be381ef6c3bd' (cwd None) >Thread-18::DEBUG::2014-07-10 09:01:36,212::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/metadata bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-10 09:01:36,246::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.0196445 s, 209 kB/s\n'; <rc> = 0 >987e9b60-127c-4388-96f0-10643f60289c::DEBUG::2014-07-10 09:01:36,283::lvm::296::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:01:36,325::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >987e9b60-127c-4388-96f0-10643f60289c::DEBUG::2014-07-10 09:01:36,364::lvm::462::Storage.LVM::(_reloadlvs) lvs reloaded >987e9b60-127c-4388-96f0-10643f60289c::DEBUG::2014-07-10 09:01:36,372::lvm::462::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' released the operation mutex >987e9b60-127c-4388-96f0-10643f60289c::DEBUG::2014-07-10 09:01:36,383::lvm::427::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' got the operation mutex >987e9b60-127c-4388-96f0-10643f60289c::DEBUG::2014-07-10 09:01:36,411::lvm::296::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm lvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/3600601601282300032826addbbdae311|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,vg_name,attr,size,seg_start_pe,devices,tags 9e1aa540-1f4e-4ee3-a152-be381ef6c3bd' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:01:36,512::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.135286 s, 7.6 MB/s\n'; <rc> = 0 >987e9b60-127c-4388-96f0-10643f60289c::DEBUG::2014-07-10 09:01:36,602::lvm::296::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >987e9b60-127c-4388-96f0-10643f60289c::DEBUG::2014-07-10 09:01:36,613::lvm::462::Storage.LVM::(_reloadlvs) lvs reloaded >987e9b60-127c-4388-96f0-10643f60289c::DEBUG::2014-07-10 09:01:36,614::lvm::462::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' released the operation mutex >987e9b60-127c-4388-96f0-10643f60289c::WARNING::2014-07-10 09:01:36,614::blockSD::761::Storage.StorageDomain::(_getOccupiedMetadataSlots) Could not find mapping for lv 9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/776303a2-5585-451e-826e-0e338d4a1e98 >987e9b60-127c-4388-96f0-10643f60289c::DEBUG::2014-07-10 09:01:36,615::blockSD::784::Storage.StorageDomain::(getFreeMetadataSlot) Found freeSlot 7 in VG 9e1aa540-1f4e-4ee3-a152-be381ef6c3bd >987e9b60-127c-4388-96f0-10643f60289c::DEBUG::2014-07-10 09:01:36,616::lvm::296::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm lvchange --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/3600601601282300032826addbbdae311|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } " --autobackup n --deltag OVIRT_VOL_INITIALIZING --addtag MD_7 --addtag IU_28408446-e5fd-4565-a976-e760951593fe --addtag PU_47592965-e853-4e59-9728-d11cca6a7a8a 9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/776303a2-5585-451e-826e-0e338d4a1e98' (cwd None) >987e9b60-127c-4388-96f0-10643f60289c::DEBUG::2014-07-10 09:01:36,888::lvm::296::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ' WARNING: This metadata update is NOT backed up\n WARNING: This metadata update is NOT backed up\n'; <rc> = 0 >987e9b60-127c-4388-96f0-10643f60289c::DEBUG::2014-07-10 09:01:36,889::lvm::513::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >987e9b60-127c-4388-96f0-10643f60289c::DEBUG::2014-07-10 09:01:36,889::lvm::525::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >987e9b60-127c-4388-96f0-10643f60289c::DEBUG::2014-07-10 09:01:36,890::lvm::296::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm lvchange --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/3600601601282300032826addbbdae311|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } " --autobackup n --available n 9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/776303a2-5585-451e-826e-0e338d4a1e98' (cwd None) >987e9b60-127c-4388-96f0-10643f60289c::DEBUG::2014-07-10 09:01:37,261::lvm::296::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >987e9b60-127c-4388-96f0-10643f60289c::DEBUG::2014-07-10 09:01:37,262::lvm::513::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >987e9b60-127c-4388-96f0-10643f60289c::DEBUG::2014-07-10 09:01:37,262::lvm::525::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >987e9b60-127c-4388-96f0-10643f60289c::DEBUG::2014-07-10 09:01:37,264::task::752::TaskManager.Task::(_save) Task=`987e9b60-127c-4388-96f0-10643f60289c`::_save: orig /rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/master/tasks/987e9b60-127c-4388-96f0-10643f60289c temp /rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/master/tasks/987e9b60-127c-4388-96f0-10643f60289c.temp >987e9b60-127c-4388-96f0-10643f60289c::DEBUG::2014-07-10 09:01:37,278::blockVolume::604::Storage.Volume::(newVolumeLease) Initializing volume lease volUUID=776303a2-5585-451e-826e-0e338d4a1e98 sdUUID=9e1aa540-1f4e-4ee3-a152-be381ef6c3bd, metaId=('9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 7) >987e9b60-127c-4388-96f0-10643f60289c::DEBUG::2014-07-10 09:01:37,285::task::752::TaskManager.Task::(_save) Task=`987e9b60-127c-4388-96f0-10643f60289c`::_save: orig /rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/master/tasks/987e9b60-127c-4388-96f0-10643f60289c temp /rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/master/tasks/987e9b60-127c-4388-96f0-10643f60289c.temp >987e9b60-127c-4388-96f0-10643f60289c::DEBUG::2014-07-10 09:01:37,294::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd_imageNS.28408446-e5fd-4565-a976-e760951593fe' >987e9b60-127c-4388-96f0-10643f60289c::DEBUG::2014-07-10 09:01:37,294::resourceManager::635::ResourceManager::(releaseResource) Released resource '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd_imageNS.28408446-e5fd-4565-a976-e760951593fe' (0 active users) >987e9b60-127c-4388-96f0-10643f60289c::DEBUG::2014-07-10 09:01:37,294::resourceManager::641::ResourceManager::(releaseResource) Resource '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd_imageNS.28408446-e5fd-4565-a976-e760951593fe' is free, finding out if anyone is waiting for it. >987e9b60-127c-4388-96f0-10643f60289c::DEBUG::2014-07-10 09:01:37,294::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd_imageNS.28408446-e5fd-4565-a976-e760951593fe', Clearing records. >987e9b60-127c-4388-96f0-10643f60289c::DEBUG::2014-07-10 09:01:37,295::task::595::TaskManager.Task::(_updateState) Task=`987e9b60-127c-4388-96f0-10643f60289c`::moving from state running -> state finished >987e9b60-127c-4388-96f0-10643f60289c::DEBUG::2014-07-10 09:01:37,296::task::752::TaskManager.Task::(_save) Task=`987e9b60-127c-4388-96f0-10643f60289c`::_save: orig /rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/master/tasks/987e9b60-127c-4388-96f0-10643f60289c temp /rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/master/tasks/987e9b60-127c-4388-96f0-10643f60289c.temp >987e9b60-127c-4388-96f0-10643f60289c::DEBUG::2014-07-10 09:01:37,306::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': < ResourceRef 'Storage.9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', isValid: 'True' obj: 'None'>} >987e9b60-127c-4388-96f0-10643f60289c::DEBUG::2014-07-10 09:01:37,306::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >987e9b60-127c-4388-96f0-10643f60289c::DEBUG::2014-07-10 09:01:37,306::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.9e1aa540-1f4e-4ee3-a152-be381ef6c3bd' >987e9b60-127c-4388-96f0-10643f60289c::DEBUG::2014-07-10 09:01:37,307::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.9e1aa540-1f4e-4ee3-a152-be381ef6c3bd' (0 active users) >987e9b60-127c-4388-96f0-10643f60289c::DEBUG::2014-07-10 09:01:37,307::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.9e1aa540-1f4e-4ee3-a152-be381ef6c3bd' is free, finding out if anyone is waiting for it. >987e9b60-127c-4388-96f0-10643f60289c::DEBUG::2014-07-10 09:01:37,307::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', Clearing records. >987e9b60-127c-4388-96f0-10643f60289c::DEBUG::2014-07-10 09:01:37,307::task::913::TaskManager.Task::(_runJobs) Task=`987e9b60-127c-4388-96f0-10643f60289c`::Task.run: exit - success: result {'uuid': '776303a2-5585-451e-826e-0e338d4a1e98'} >987e9b60-127c-4388-96f0-10643f60289c::DEBUG::2014-07-10 09:01:37,308::task::990::TaskManager.Task::(_decref) Task=`987e9b60-127c-4388-96f0-10643f60289c`::ref 0 aborting False >987e9b60-127c-4388-96f0-10643f60289c::DEBUG::2014-07-10 09:01:37,308::threadPool::57::Misc.ThreadPool::(setRunningTask) Number of running tasks: 0 >GuestMonitor-scale_2::DEBUG::2014-07-10 09:01:37,791::vm::598::vm.Vm::(_getCpuStats) vmId=`52e238aa-e62a-48a8-a200-604e72422f3f`::CPU stats not available: 'NoneType' object is unsubscriptable >GuestMonitor-scale_2::DEBUG::2014-07-10 09:01:37,792::vm::654::vm.Vm::(_getNetworkStats) vmId=`52e238aa-e62a-48a8-a200-604e72422f3f`::Network stats not available >GuestMonitor-scale_2::DEBUG::2014-07-10 09:01:37,792::vm::676::vm.Vm::(_getDiskStats) vmId=`52e238aa-e62a-48a8-a200-604e72422f3f`::Disk hdd stats not available >GuestMonitor-scale_2::DEBUG::2014-07-10 09:01:37,792::vm::676::vm.Vm::(_getDiskStats) vmId=`52e238aa-e62a-48a8-a200-604e72422f3f`::Disk hdc stats not available >GuestMonitor-scale_2::DEBUG::2014-07-10 09:01:37,793::vm::676::vm.Vm::(_getDiskStats) vmId=`52e238aa-e62a-48a8-a200-604e72422f3f`::Disk vda stats not available >GuestMonitor-scale_2::DEBUG::2014-07-10 09:01:37,793::vm::715::vm.Vm::(_getDiskLatency) vmId=`52e238aa-e62a-48a8-a200-604e72422f3f`::Disk hdd latency not available >GuestMonitor-scale_2::DEBUG::2014-07-10 09:01:37,793::vm::715::vm.Vm::(_getDiskLatency) vmId=`52e238aa-e62a-48a8-a200-604e72422f3f`::Disk hdc latency not available >GuestMonitor-scale_2::DEBUG::2014-07-10 09:01:37,793::vm::715::vm.Vm::(_getDiskLatency) vmId=`52e238aa-e62a-48a8-a200-604e72422f3f`::Disk vda latency not available >GuestMonitor-scale_2::DEBUG::2014-07-10 09:01:37,794::vm::598::vm.Vm::(_getCpuStats) vmId=`52e238aa-e62a-48a8-a200-604e72422f3f`::CPU stats not available: 'NoneType' object is unsubscriptable >GuestMonitor-scale_2::DEBUG::2014-07-10 09:01:37,794::vm::654::vm.Vm::(_getNetworkStats) vmId=`52e238aa-e62a-48a8-a200-604e72422f3f`::Network stats not available >GuestMonitor-scale_2::DEBUG::2014-07-10 09:01:37,794::vm::676::vm.Vm::(_getDiskStats) vmId=`52e238aa-e62a-48a8-a200-604e72422f3f`::Disk hdd stats not available >GuestMonitor-scale_2::DEBUG::2014-07-10 09:01:37,794::vm::676::vm.Vm::(_getDiskStats) vmId=`52e238aa-e62a-48a8-a200-604e72422f3f`::Disk hdc stats not available >GuestMonitor-scale_2::DEBUG::2014-07-10 09:01:37,795::vm::676::vm.Vm::(_getDiskStats) vmId=`52e238aa-e62a-48a8-a200-604e72422f3f`::Disk vda stats not available >GuestMonitor-scale_2::DEBUG::2014-07-10 09:01:37,795::vm::715::vm.Vm::(_getDiskLatency) vmId=`52e238aa-e62a-48a8-a200-604e72422f3f`::Disk hdd latency not available >GuestMonitor-scale_2::DEBUG::2014-07-10 09:01:37,795::vm::715::vm.Vm::(_getDiskLatency) vmId=`52e238aa-e62a-48a8-a200-604e72422f3f`::Disk hdc latency not available >GuestMonitor-scale_2::DEBUG::2014-07-10 09:01:37,795::vm::715::vm.Vm::(_getDiskLatency) vmId=`52e238aa-e62a-48a8-a200-604e72422f3f`::Disk vda latency not available >GuestMonitor-scale_1::DEBUG::2014-07-10 09:01:37,910::vm::676::vm.Vm::(_getDiskStats) vmId=`ed909f7e-0ee2-4f6f-b4a5-a165f689a276`::Disk hdd stats not available >GuestMonitor-scale_1::DEBUG::2014-07-10 09:01:37,910::vm::676::vm.Vm::(_getDiskStats) vmId=`ed909f7e-0ee2-4f6f-b4a5-a165f689a276`::Disk hdc stats not available >GuestMonitor-scale_1::DEBUG::2014-07-10 09:01:37,910::vm::676::vm.Vm::(_getDiskStats) vmId=`ed909f7e-0ee2-4f6f-b4a5-a165f689a276`::Disk vda stats not available >GuestMonitor-scale_1::DEBUG::2014-07-10 09:01:37,910::vm::715::vm.Vm::(_getDiskLatency) vmId=`ed909f7e-0ee2-4f6f-b4a5-a165f689a276`::Disk hdd latency not available >GuestMonitor-scale_1::DEBUG::2014-07-10 09:01:37,911::vm::715::vm.Vm::(_getDiskLatency) vmId=`ed909f7e-0ee2-4f6f-b4a5-a165f689a276`::Disk hdc latency not available >GuestMonitor-scale_1::DEBUG::2014-07-10 09:01:37,911::vm::715::vm.Vm::(_getDiskLatency) vmId=`ed909f7e-0ee2-4f6f-b4a5-a165f689a276`::Disk vda latency not available >GuestMonitor-scale_1::DEBUG::2014-07-10 09:01:37,911::vm::676::vm.Vm::(_getDiskStats) vmId=`ed909f7e-0ee2-4f6f-b4a5-a165f689a276`::Disk hdd stats not available >GuestMonitor-scale_1::DEBUG::2014-07-10 09:01:37,912::vm::676::vm.Vm::(_getDiskStats) vmId=`ed909f7e-0ee2-4f6f-b4a5-a165f689a276`::Disk hdc stats not available >GuestMonitor-scale_1::DEBUG::2014-07-10 09:01:37,912::vm::676::vm.Vm::(_getDiskStats) vmId=`ed909f7e-0ee2-4f6f-b4a5-a165f689a276`::Disk vda stats not available >GuestMonitor-scale_1::DEBUG::2014-07-10 09:01:37,912::vm::715::vm.Vm::(_getDiskLatency) vmId=`ed909f7e-0ee2-4f6f-b4a5-a165f689a276`::Disk hdd latency not available >GuestMonitor-scale_1::DEBUG::2014-07-10 09:01:37,912::vm::715::vm.Vm::(_getDiskLatency) vmId=`ed909f7e-0ee2-4f6f-b4a5-a165f689a276`::Disk hdc latency not available >GuestMonitor-scale_1::DEBUG::2014-07-10 09:01:37,912::vm::715::vm.Vm::(_getDiskLatency) vmId=`ed909f7e-0ee2-4f6f-b4a5-a165f689a276`::Disk vda latency not available >Thread-14::DEBUG::2014-07-10 09:01:38,421::BindingXMLRPC::1067::vds::(wrapper) client [10.35.3.13]::call vmGetStats with ('52e238aa-e62a-48a8-a200-604e72422f3f',) {} >Thread-14::DEBUG::2014-07-10 09:01:38,422::vm::598::vm.Vm::(_getCpuStats) vmId=`52e238aa-e62a-48a8-a200-604e72422f3f`::CPU stats not available: 'NoneType' object is unsubscriptable >Thread-14::DEBUG::2014-07-10 09:01:38,422::vm::654::vm.Vm::(_getNetworkStats) vmId=`52e238aa-e62a-48a8-a200-604e72422f3f`::Network stats not available >Thread-14::DEBUG::2014-07-10 09:01:38,422::vm::676::vm.Vm::(_getDiskStats) vmId=`52e238aa-e62a-48a8-a200-604e72422f3f`::Disk hdd stats not available >Thread-14::DEBUG::2014-07-10 09:01:38,423::vm::676::vm.Vm::(_getDiskStats) vmId=`52e238aa-e62a-48a8-a200-604e72422f3f`::Disk hdc stats not available >Thread-14::DEBUG::2014-07-10 09:01:38,423::vm::676::vm.Vm::(_getDiskStats) vmId=`52e238aa-e62a-48a8-a200-604e72422f3f`::Disk vda stats not available >Thread-14::DEBUG::2014-07-10 09:01:38,423::vm::715::vm.Vm::(_getDiskLatency) vmId=`52e238aa-e62a-48a8-a200-604e72422f3f`::Disk hdd latency not available >Thread-14::DEBUG::2014-07-10 09:01:38,423::vm::715::vm.Vm::(_getDiskLatency) vmId=`52e238aa-e62a-48a8-a200-604e72422f3f`::Disk hdc latency not available >Thread-14::DEBUG::2014-07-10 09:01:38,423::vm::715::vm.Vm::(_getDiskLatency) vmId=`52e238aa-e62a-48a8-a200-604e72422f3f`::Disk vda latency not available >Thread-14::DEBUG::2014-07-10 09:01:38,424::BindingXMLRPC::1074::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Powering up', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '12236', 'displayIp': '0', 'displayPort': u'5902', 'session': 'Unknown', 'displaySecurePort': u'5903', 'timeOffset': '0', 'hash': '-5500930374920933700', 'balloonInfo': {'balloon_max': '1048576', 'balloon_target': '1048576', 'balloon_cur': '0', 'balloon_min': '1048576'}, 'pauseCode': 'NOERR', 'clientIp': '', 'kvmEnable': 'true', 'network': {u'vnet1': {'state': 'unknown', 'macAddr': '00:1a:4a:de:6d:7b', 'speed': '1000', 'name': u'vnet1'}}, 'vmId': '52e238aa-e62a-48a8-a200-604e72422f3f', 'displayType': 'qxl', 'cpuUser': '0.00', 'disks': {u'vda': {'truesize': '1073741824', 'apparentsize': '1073741824', 'imageID': '76fdb054-02cd-42ed-9721-b3e65b34c3a4'}, u'hdd': {'truesize': '0', 'apparentsize': '0'}, u'hdc': {'truesize': '0', 'apparentsize': '0'}}, 'monitorResponse': '0', 'statsAge': '1.23', 'elapsedTime': '11', 'vmType': 'kvm', 'cpuSys': '0.00', 'guestCPUCount': -1, 'appsList': [], 'guestIPs': ''}]} >Thread-14::DEBUG::2014-07-10 09:01:38,428::BindingXMLRPC::1067::vds::(wrapper) client [10.35.3.13]::call vmGetStats with ('ed909f7e-0ee2-4f6f-b4a5-a165f689a276',) {} >Thread-14::DEBUG::2014-07-10 09:01:38,429::vm::676::vm.Vm::(_getDiskStats) vmId=`ed909f7e-0ee2-4f6f-b4a5-a165f689a276`::Disk hdd stats not available >Thread-14::DEBUG::2014-07-10 09:01:38,429::vm::676::vm.Vm::(_getDiskStats) vmId=`ed909f7e-0ee2-4f6f-b4a5-a165f689a276`::Disk hdc stats not available >Thread-14::DEBUG::2014-07-10 09:01:38,429::vm::676::vm.Vm::(_getDiskStats) vmId=`ed909f7e-0ee2-4f6f-b4a5-a165f689a276`::Disk vda stats not available >Thread-14::DEBUG::2014-07-10 09:01:38,429::vm::715::vm.Vm::(_getDiskLatency) vmId=`ed909f7e-0ee2-4f6f-b4a5-a165f689a276`::Disk hdd latency not available >Thread-14::DEBUG::2014-07-10 09:01:38,430::vm::715::vm.Vm::(_getDiskLatency) vmId=`ed909f7e-0ee2-4f6f-b4a5-a165f689a276`::Disk hdc latency not available >Thread-14::DEBUG::2014-07-10 09:01:38,430::vm::715::vm.Vm::(_getDiskLatency) vmId=`ed909f7e-0ee2-4f6f-b4a5-a165f689a276`::Disk vda latency not available >Thread-14::DEBUG::2014-07-10 09:01:38,430::BindingXMLRPC::1074::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Powering up', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '11613', 'displayIp': '0', 'displayPort': u'5900', 'session': 'Unknown', 'displaySecurePort': u'5901', 'timeOffset': '0', 'hash': '7841224975033595397', 'balloonInfo': {'balloon_max': '1048576', 'balloon_target': '1048576', 'balloon_cur': '1048576', 'balloon_min': '1048576'}, 'pauseCode': 'NOERR', 'clientIp': '', 'kvmEnable': 'true', 'network': {u'vnet0': {'macAddr': '00:1a:4a:de:6d:7a', 'rxDropped': '0', 'rxErrors': '0', 'txDropped': '0', 'txRate': '0.0', 'rxRate': '0.0', 'txErrors': '0', 'state': 'unknown', 'speed': '1000', 'name': u'vnet0'}}, 'vmId': 'ed909f7e-0ee2-4f6f-b4a5-a165f689a276', 'displayType': 'qxl', 'cpuUser': '44.65', 'disks': {u'vda': {'truesize': '1073741824', 'apparentsize': '1073741824', 'imageID': '0cd7d6ce-f497-4243-a690-c57744861eea'}, u'hdd': {'truesize': '0', 'apparentsize': '0'}, u'hdc': {'truesize': '0', 'apparentsize': '0'}}, 'monitorResponse': '0', 'statsAge': '0.91', 'elapsedTime': '31', 'vmType': 'kvm', 'cpuSys': '22.67', 'guestCPUCount': -1, 'appsList': [], 'guestIPs': ''}]} >Dummy-33::DEBUG::2014-07-10 09:01:38,527::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:01:38,610::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0306718 s, 33.4 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-07-10 09:01:39,936::vmChannels::95::vds::(_handle_timeouts) Timeout on fileno 59. >Dummy-33::DEBUG::2014-07-10 09:01:40,624::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:01:40,730::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0533537 s, 19.2 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 09:01:41,447::BindingXMLRPC::1067::vds::(wrapper) client [10.35.3.13]::call vmGetStats with ('52e238aa-e62a-48a8-a200-604e72422f3f',) {} >Thread-14::DEBUG::2014-07-10 09:01:41,448::vm::598::vm.Vm::(_getCpuStats) vmId=`52e238aa-e62a-48a8-a200-604e72422f3f`::CPU stats not available: 'NoneType' object is unsubscriptable >Thread-14::DEBUG::2014-07-10 09:01:41,448::vm::654::vm.Vm::(_getNetworkStats) vmId=`52e238aa-e62a-48a8-a200-604e72422f3f`::Network stats not available >Thread-14::DEBUG::2014-07-10 09:01:41,448::vm::676::vm.Vm::(_getDiskStats) vmId=`52e238aa-e62a-48a8-a200-604e72422f3f`::Disk hdd stats not available >Thread-14::DEBUG::2014-07-10 09:01:41,448::vm::676::vm.Vm::(_getDiskStats) vmId=`52e238aa-e62a-48a8-a200-604e72422f3f`::Disk hdc stats not available >Thread-14::DEBUG::2014-07-10 09:01:41,449::vm::676::vm.Vm::(_getDiskStats) vmId=`52e238aa-e62a-48a8-a200-604e72422f3f`::Disk vda stats not available >Thread-14::DEBUG::2014-07-10 09:01:41,449::vm::715::vm.Vm::(_getDiskLatency) vmId=`52e238aa-e62a-48a8-a200-604e72422f3f`::Disk hdd latency not available >Thread-14::DEBUG::2014-07-10 09:01:41,449::vm::715::vm.Vm::(_getDiskLatency) vmId=`52e238aa-e62a-48a8-a200-604e72422f3f`::Disk hdc latency not available >Thread-14::DEBUG::2014-07-10 09:01:41,449::vm::715::vm.Vm::(_getDiskLatency) vmId=`52e238aa-e62a-48a8-a200-604e72422f3f`::Disk vda latency not available >Thread-14::DEBUG::2014-07-10 09:01:41,450::BindingXMLRPC::1074::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Powering up', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '12236', 'displayIp': '0', 'displayPort': u'5902', 'session': 'Unknown', 'displaySecurePort': u'5903', 'timeOffset': '0', 'hash': '-5500930374920933700', 'balloonInfo': {'balloon_max': '1048576', 'balloon_target': '1048576', 'balloon_cur': '0', 'balloon_min': '1048576'}, 'pauseCode': 'NOERR', 'clientIp': '', 'kvmEnable': 'true', 'network': {u'vnet1': {'state': 'unknown', 'macAddr': '00:1a:4a:de:6d:7b', 'speed': '1000', 'name': u'vnet1'}}, 'vmId': '52e238aa-e62a-48a8-a200-604e72422f3f', 'displayType': 'qxl', 'cpuUser': '0.00', 'disks': {u'vda': {'truesize': '1073741824', 'apparentsize': '1073741824', 'imageID': '76fdb054-02cd-42ed-9721-b3e65b34c3a4'}, u'hdd': {'truesize': '0', 'apparentsize': '0'}, u'hdc': {'truesize': '0', 'apparentsize': '0'}}, 'monitorResponse': '0', 'statsAge': '0.24', 'elapsedTime': '14', 'vmType': 'kvm', 'cpuSys': '0.00', 'guestCPUCount': -1, 'appsList': [], 'guestIPs': ''}]} >Thread-14::DEBUG::2014-07-10 09:01:41,455::BindingXMLRPC::1067::vds::(wrapper) client [10.35.3.13]::call vmGetStats with ('ed909f7e-0ee2-4f6f-b4a5-a165f689a276',) {} >Thread-14::DEBUG::2014-07-10 09:01:41,455::vm::676::vm.Vm::(_getDiskStats) vmId=`ed909f7e-0ee2-4f6f-b4a5-a165f689a276`::Disk hdd stats not available >Thread-14::DEBUG::2014-07-10 09:01:41,456::vm::676::vm.Vm::(_getDiskStats) vmId=`ed909f7e-0ee2-4f6f-b4a5-a165f689a276`::Disk hdc stats not available >Thread-14::DEBUG::2014-07-10 09:01:41,456::vm::676::vm.Vm::(_getDiskStats) vmId=`ed909f7e-0ee2-4f6f-b4a5-a165f689a276`::Disk vda stats not available >Thread-14::DEBUG::2014-07-10 09:01:41,457::vm::715::vm.Vm::(_getDiskLatency) vmId=`ed909f7e-0ee2-4f6f-b4a5-a165f689a276`::Disk hdd latency not available >Thread-14::DEBUG::2014-07-10 09:01:41,457::vm::715::vm.Vm::(_getDiskLatency) vmId=`ed909f7e-0ee2-4f6f-b4a5-a165f689a276`::Disk hdc latency not available >Thread-14::DEBUG::2014-07-10 09:01:41,457::vm::715::vm.Vm::(_getDiskLatency) vmId=`ed909f7e-0ee2-4f6f-b4a5-a165f689a276`::Disk vda latency not available >Thread-14::DEBUG::2014-07-10 09:01:41,458::BindingXMLRPC::1074::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Powering up', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '11613', 'displayIp': '0', 'displayPort': u'5900', 'session': 'Unknown', 'displaySecurePort': u'5901', 'timeOffset': '0', 'hash': '7841224975033595397', 'balloonInfo': {'balloon_max': '1048576', 'balloon_target': '1048576', 'balloon_cur': '1048576', 'balloon_min': '1048576'}, 'pauseCode': 'NOERR', 'clientIp': '', 'kvmEnable': 'true', 'network': {u'vnet0': {'macAddr': '00:1a:4a:de:6d:7a', 'rxDropped': '0', 'rxErrors': '0', 'txDropped': '0', 'txRate': '0.0', 'rxRate': '0.0', 'txErrors': '0', 'state': 'unknown', 'speed': '1000', 'name': u'vnet0'}}, 'vmId': 'ed909f7e-0ee2-4f6f-b4a5-a165f689a276', 'displayType': 'qxl', 'cpuUser': '47.19', 'disks': {u'vda': {'truesize': '1073741824', 'apparentsize': '1073741824', 'imageID': '0cd7d6ce-f497-4243-a690-c57744861eea'}, u'hdd': {'truesize': '0', 'apparentsize': '0'}, u'hdc': {'truesize': '0', 'apparentsize': '0'}}, 'monitorResponse': '0', 'statsAge': '1.93', 'elapsedTime': '34', 'vmType': 'kvm', 'cpuSys': '3.39', 'guestCPUCount': -1, 'appsList': [], 'guestIPs': ''}]} >Thread-14::DEBUG::2014-07-10 09:01:41,591::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-14::DEBUG::2014-07-10 09:01:41,592::task::595::TaskManager.Task::(_updateState) Task=`625e9b1f-361b-4c2d-9d22-2965ad329d1b`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 09:01:41,593::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-14::INFO::2014-07-10 09:01:41,593::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:01:41,593::task::1185::TaskManager.Task::(prepare) Task=`625e9b1f-361b-4c2d-9d22-2965ad329d1b`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:01:41,594::task::595::TaskManager.Task::(_updateState) Task=`625e9b1f-361b-4c2d-9d22-2965ad329d1b`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 09:01:41,594::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 09:01:41,594::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 09:01:41,594::task::990::TaskManager.Task::(_decref) Task=`625e9b1f-361b-4c2d-9d22-2965ad329d1b`::ref 0 aborting False >Thread-34::DEBUG::2014-07-10 09:01:41,599::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-34::DEBUG::2014-07-10 09:01:41,599::task::595::TaskManager.Task::(_updateState) Task=`ade2ed55-e210-4288-b2c2-008ea2e0d2aa`::moving from state init -> state preparing >Thread-34::INFO::2014-07-10 09:01:41,600::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-34::DEBUG::2014-07-10 09:01:41,601::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`8760f898-994a-44ed-9c7a-053bd851f8fa`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-10 09:01:41,601::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' for lock type 'shared' >Thread-34::DEBUG::2014-07-10 09:01:41,602::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-10 09:01:41,602::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`8760f898-994a-44ed-9c7a-053bd851f8fa`::Granted request >Thread-34::DEBUG::2014-07-10 09:01:41,603::task::827::TaskManager.Task::(resourceAcquired) Task=`ade2ed55-e210-4288-b2c2-008ea2e0d2aa`::_resourcesAcquired: Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee (shared) >Thread-34::DEBUG::2014-07-10 09:01:41,603::task::990::TaskManager.Task::(_decref) Task=`ade2ed55-e210-4288-b2c2-008ea2e0d2aa`::ref 1 aborting False >Thread-34::INFO::2014-07-10 09:01:41,605::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1080989581312', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532069482496', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:01:41,606::task::1185::TaskManager.Task::(prepare) Task=`ade2ed55-e210-4288-b2c2-008ea2e0d2aa`::finished: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1080989581312', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532069482496', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:01:41,606::task::595::TaskManager.Task::(_updateState) Task=`ade2ed55-e210-4288-b2c2-008ea2e0d2aa`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-10 09:01:41,606::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee': < ResourceRef 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-10 09:01:41,607::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-10 09:01:41,607::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' >Thread-34::DEBUG::2014-07-10 09:01:41,608::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' (0 active users) >Thread-34::DEBUG::2014-07-10 09:01:41,608::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-10 09:01:41,608::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', Clearing records. >Thread-34::DEBUG::2014-07-10 09:01:41,609::task::990::TaskManager.Task::(_decref) Task=`ade2ed55-e210-4288-b2c2-008ea2e0d2aa`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 09:01:42,745::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >GuestMonitor-scale_2::DEBUG::2014-07-10 09:01:42,802::vm::598::vm.Vm::(_getCpuStats) vmId=`52e238aa-e62a-48a8-a200-604e72422f3f`::CPU stats not available: 'NoneType' object is unsubscriptable >GuestMonitor-scale_2::DEBUG::2014-07-10 09:01:42,804::vm::654::vm.Vm::(_getNetworkStats) vmId=`52e238aa-e62a-48a8-a200-604e72422f3f`::Network stats not available >GuestMonitor-scale_2::DEBUG::2014-07-10 09:01:42,804::vm::676::vm.Vm::(_getDiskStats) vmId=`52e238aa-e62a-48a8-a200-604e72422f3f`::Disk hdd stats not available >GuestMonitor-scale_2::DEBUG::2014-07-10 09:01:42,805::vm::676::vm.Vm::(_getDiskStats) vmId=`52e238aa-e62a-48a8-a200-604e72422f3f`::Disk hdc stats not available >GuestMonitor-scale_2::DEBUG::2014-07-10 09:01:42,806::vm::676::vm.Vm::(_getDiskStats) vmId=`52e238aa-e62a-48a8-a200-604e72422f3f`::Disk vda stats not available >GuestMonitor-scale_2::DEBUG::2014-07-10 09:01:42,807::vm::715::vm.Vm::(_getDiskLatency) vmId=`52e238aa-e62a-48a8-a200-604e72422f3f`::Disk hdd latency not available >GuestMonitor-scale_2::DEBUG::2014-07-10 09:01:42,807::vm::715::vm.Vm::(_getDiskLatency) vmId=`52e238aa-e62a-48a8-a200-604e72422f3f`::Disk hdc latency not available >GuestMonitor-scale_2::DEBUG::2014-07-10 09:01:42,808::vm::715::vm.Vm::(_getDiskLatency) vmId=`52e238aa-e62a-48a8-a200-604e72422f3f`::Disk vda latency not available >GuestMonitor-scale_2::DEBUG::2014-07-10 09:01:42,809::vm::598::vm.Vm::(_getCpuStats) vmId=`52e238aa-e62a-48a8-a200-604e72422f3f`::CPU stats not available: 'NoneType' object is unsubscriptable >GuestMonitor-scale_2::DEBUG::2014-07-10 09:01:42,810::vm::654::vm.Vm::(_getNetworkStats) vmId=`52e238aa-e62a-48a8-a200-604e72422f3f`::Network stats not available >GuestMonitor-scale_2::DEBUG::2014-07-10 09:01:42,811::vm::676::vm.Vm::(_getDiskStats) vmId=`52e238aa-e62a-48a8-a200-604e72422f3f`::Disk hdd stats not available >GuestMonitor-scale_2::DEBUG::2014-07-10 09:01:42,811::vm::676::vm.Vm::(_getDiskStats) vmId=`52e238aa-e62a-48a8-a200-604e72422f3f`::Disk hdc stats not available >GuestMonitor-scale_2::DEBUG::2014-07-10 09:01:42,812::vm::676::vm.Vm::(_getDiskStats) vmId=`52e238aa-e62a-48a8-a200-604e72422f3f`::Disk vda stats not available >GuestMonitor-scale_2::DEBUG::2014-07-10 09:01:42,813::vm::715::vm.Vm::(_getDiskLatency) vmId=`52e238aa-e62a-48a8-a200-604e72422f3f`::Disk hdd latency not available >GuestMonitor-scale_2::DEBUG::2014-07-10 09:01:42,813::vm::715::vm.Vm::(_getDiskLatency) vmId=`52e238aa-e62a-48a8-a200-604e72422f3f`::Disk hdc latency not available >GuestMonitor-scale_2::DEBUG::2014-07-10 09:01:42,814::vm::715::vm.Vm::(_getDiskLatency) vmId=`52e238aa-e62a-48a8-a200-604e72422f3f`::Disk vda latency not available >Dummy-33::DEBUG::2014-07-10 09:01:42,867::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0581394 s, 17.6 MB/s\n'; <rc> = 0 >GuestMonitor-scale_1::DEBUG::2014-07-10 09:01:42,918::vm::676::vm.Vm::(_getDiskStats) vmId=`ed909f7e-0ee2-4f6f-b4a5-a165f689a276`::Disk hdd stats not available >GuestMonitor-scale_1::DEBUG::2014-07-10 09:01:42,919::vm::676::vm.Vm::(_getDiskStats) vmId=`ed909f7e-0ee2-4f6f-b4a5-a165f689a276`::Disk hdc stats not available >GuestMonitor-scale_1::DEBUG::2014-07-10 09:01:42,919::vm::676::vm.Vm::(_getDiskStats) vmId=`ed909f7e-0ee2-4f6f-b4a5-a165f689a276`::Disk vda stats not available >GuestMonitor-scale_1::DEBUG::2014-07-10 09:01:42,920::vm::715::vm.Vm::(_getDiskLatency) vmId=`ed909f7e-0ee2-4f6f-b4a5-a165f689a276`::Disk hdd latency not available >GuestMonitor-scale_1::DEBUG::2014-07-10 09:01:42,920::vm::715::vm.Vm::(_getDiskLatency) vmId=`ed909f7e-0ee2-4f6f-b4a5-a165f689a276`::Disk hdc latency not available >GuestMonitor-scale_1::DEBUG::2014-07-10 09:01:42,920::vm::715::vm.Vm::(_getDiskLatency) vmId=`ed909f7e-0ee2-4f6f-b4a5-a165f689a276`::Disk vda latency not available >GuestMonitor-scale_1::DEBUG::2014-07-10 09:01:42,921::vm::676::vm.Vm::(_getDiskStats) vmId=`ed909f7e-0ee2-4f6f-b4a5-a165f689a276`::Disk hdd stats not available >GuestMonitor-scale_1::DEBUG::2014-07-10 09:01:42,921::vm::676::vm.Vm::(_getDiskStats) vmId=`ed909f7e-0ee2-4f6f-b4a5-a165f689a276`::Disk hdc stats not available >GuestMonitor-scale_1::DEBUG::2014-07-10 09:01:42,921::vm::676::vm.Vm::(_getDiskStats) vmId=`ed909f7e-0ee2-4f6f-b4a5-a165f689a276`::Disk vda stats not available >GuestMonitor-scale_1::DEBUG::2014-07-10 09:01:42,921::vm::715::vm.Vm::(_getDiskLatency) vmId=`ed909f7e-0ee2-4f6f-b4a5-a165f689a276`::Disk hdd latency not available >GuestMonitor-scale_1::DEBUG::2014-07-10 09:01:42,921::vm::715::vm.Vm::(_getDiskLatency) vmId=`ed909f7e-0ee2-4f6f-b4a5-a165f689a276`::Disk hdc latency not available >GuestMonitor-scale_1::DEBUG::2014-07-10 09:01:42,922::vm::715::vm.Vm::(_getDiskLatency) vmId=`ed909f7e-0ee2-4f6f-b4a5-a165f689a276`::Disk vda latency not available >Thread-40::DEBUG::2014-07-10 09:01:44,075::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lion.qa.lab.tlv.redhat.com:_export_yuri2_backup2/6a70504d-00df-4869-8695-0f442053f6b6/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-40::DEBUG::2014-07-10 09:01:44,089::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n369 bytes (369 B) copied, 0.000431922 s, 854 kB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 09:01:44,470::task::595::TaskManager.Task::(_updateState) Task=`715b3d3b-18e9-4097-a8d5-e3df20612c82`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 09:01:44,471::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::INFO::2014-07-10 09:01:44,471::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0196445', 'lastCheck': '8.0', 'valid': True}, '6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000431922', 'lastCheck': '0.4', 'valid': True}} >Thread-14::DEBUG::2014-07-10 09:01:44,471::task::1185::TaskManager.Task::(prepare) Task=`715b3d3b-18e9-4097-a8d5-e3df20612c82`::finished: {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0196445', 'lastCheck': '8.0', 'valid': True}, '6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000431922', 'lastCheck': '0.4', 'valid': True}} >Thread-14::DEBUG::2014-07-10 09:01:44,471::task::595::TaskManager.Task::(_updateState) Task=`715b3d3b-18e9-4097-a8d5-e3df20612c82`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 09:01:44,472::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 09:01:44,472::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 09:01:44,472::task::990::TaskManager.Task::(_decref) Task=`715b3d3b-18e9-4097-a8d5-e3df20612c82`::ref 0 aborting False >Thread-14::DEBUG::2014-07-10 09:01:44,484::vm::676::vm.Vm::(_getDiskStats) vmId=`52e238aa-e62a-48a8-a200-604e72422f3f`::Disk hdd stats not available >Thread-14::DEBUG::2014-07-10 09:01:44,484::vm::676::vm.Vm::(_getDiskStats) vmId=`52e238aa-e62a-48a8-a200-604e72422f3f`::Disk hdc stats not available >Thread-14::DEBUG::2014-07-10 09:01:44,484::vm::676::vm.Vm::(_getDiskStats) vmId=`52e238aa-e62a-48a8-a200-604e72422f3f`::Disk vda stats not available >Thread-14::DEBUG::2014-07-10 09:01:44,485::vm::715::vm.Vm::(_getDiskLatency) vmId=`52e238aa-e62a-48a8-a200-604e72422f3f`::Disk hdd latency not available >Thread-14::DEBUG::2014-07-10 09:01:44,485::vm::715::vm.Vm::(_getDiskLatency) vmId=`52e238aa-e62a-48a8-a200-604e72422f3f`::Disk hdc latency not available >Thread-14::DEBUG::2014-07-10 09:01:44,485::vm::715::vm.Vm::(_getDiskLatency) vmId=`52e238aa-e62a-48a8-a200-604e72422f3f`::Disk vda latency not available >Thread-14::DEBUG::2014-07-10 09:01:44,486::vm::676::vm.Vm::(_getDiskStats) vmId=`ed909f7e-0ee2-4f6f-b4a5-a165f689a276`::Disk hdd stats not available >Thread-14::DEBUG::2014-07-10 09:01:44,486::vm::676::vm.Vm::(_getDiskStats) vmId=`ed909f7e-0ee2-4f6f-b4a5-a165f689a276`::Disk hdc stats not available >Thread-14::DEBUG::2014-07-10 09:01:44,486::vm::676::vm.Vm::(_getDiskStats) vmId=`ed909f7e-0ee2-4f6f-b4a5-a165f689a276`::Disk vda stats not available >Thread-14::DEBUG::2014-07-10 09:01:44,486::vm::715::vm.Vm::(_getDiskLatency) vmId=`ed909f7e-0ee2-4f6f-b4a5-a165f689a276`::Disk hdd latency not available >Thread-14::DEBUG::2014-07-10 09:01:44,487::vm::715::vm.Vm::(_getDiskLatency) vmId=`ed909f7e-0ee2-4f6f-b4a5-a165f689a276`::Disk hdc latency not available >Thread-14::DEBUG::2014-07-10 09:01:44,487::vm::715::vm.Vm::(_getDiskLatency) vmId=`ed909f7e-0ee2-4f6f-b4a5-a165f689a276`::Disk vda latency not available >Dummy-33::DEBUG::2014-07-10 09:01:44,888::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:01:45,001::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0590922 s, 17.3 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 09:01:45,231::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-14::DEBUG::2014-07-10 09:01:45,232::task::595::TaskManager.Task::(_updateState) Task=`d12213d8-343c-49e8-b5c1-7b28925ac945`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 09:01:45,233::logUtils::44::dispatcher::(wrapper) Run and protect: getAllTasksStatuses(spUUID=None, options=None) >Thread-14::DEBUG::2014-07-10 09:01:45,233::taskManager::102::TaskManager::(getAllTasksStatuses) Entry. >Thread-14::DEBUG::2014-07-10 09:01:45,233::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 987e9b60-127c-4388-96f0-10643f60289c >Thread-14::DEBUG::2014-07-10 09:01:45,233::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': '1 jobs completed successfully', 'taskState': 'finished', 'taskResult': 'success', 'taskID': '987e9b60-127c-4388-96f0-10643f60289c'} >Thread-14::DEBUG::2014-07-10 09:01:45,234::taskManager::113::TaskManager::(getAllTasksStatuses) Return: {'987e9b60-127c-4388-96f0-10643f60289c': {'code': 0, 'message': '1 jobs completed successfully', 'taskState': 'finished', 'taskResult': 'success', 'taskID': '987e9b60-127c-4388-96f0-10643f60289c'}} >Thread-14::INFO::2014-07-10 09:01:45,234::logUtils::47::dispatcher::(wrapper) Run and protect: getAllTasksStatuses, Return response: {'allTasksStatus': {'987e9b60-127c-4388-96f0-10643f60289c': {'code': 0, 'message': '1 jobs completed successfully', 'taskState': 'finished', 'taskResult': 'success', 'taskID': '987e9b60-127c-4388-96f0-10643f60289c'}}} >Thread-14::DEBUG::2014-07-10 09:01:45,234::task::1185::TaskManager.Task::(prepare) Task=`d12213d8-343c-49e8-b5c1-7b28925ac945`::finished: {'allTasksStatus': {'987e9b60-127c-4388-96f0-10643f60289c': {'code': 0, 'message': '1 jobs completed successfully', 'taskState': 'finished', 'taskResult': 'success', 'taskID': '987e9b60-127c-4388-96f0-10643f60289c'}}} >Thread-14::DEBUG::2014-07-10 09:01:45,234::task::595::TaskManager.Task::(_updateState) Task=`d12213d8-343c-49e8-b5c1-7b28925ac945`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 09:01:45,235::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 09:01:45,235::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 09:01:45,235::task::990::TaskManager.Task::(_decref) Task=`d12213d8-343c-49e8-b5c1-7b28925ac945`::ref 0 aborting False >Thread-34::DEBUG::2014-07-10 09:01:45,275::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [1be1df25] >Thread-34::DEBUG::2014-07-10 09:01:45,276::task::595::TaskManager.Task::(_updateState) Task=`f243df4f-d490-4aa6-baa4-a40ec6d5202e`::moving from state init -> state preparing >Thread-34::INFO::2014-07-10 09:01:45,276::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeInfo(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='28408446-e5fd-4565-a976-e760951593fe', volUUID='776303a2-5585-451e-826e-0e338d4a1e98', options=None) >Thread-34::DEBUG::2014-07-10 09:01:45,277::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.9e1aa540-1f4e-4ee3-a152-be381ef6c3bd`ReqID=`8de4307f-b6c7-4b82-9775-3e9a3c70d0db`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '3089' at 'getVolumeInfo' >Thread-34::DEBUG::2014-07-10 09:01:45,278::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.9e1aa540-1f4e-4ee3-a152-be381ef6c3bd' for lock type 'shared' >Thread-34::DEBUG::2014-07-10 09:01:45,278::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.9e1aa540-1f4e-4ee3-a152-be381ef6c3bd' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-10 09:01:45,278::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.9e1aa540-1f4e-4ee3-a152-be381ef6c3bd`ReqID=`8de4307f-b6c7-4b82-9775-3e9a3c70d0db`::Granted request >Thread-34::DEBUG::2014-07-10 09:01:45,279::task::827::TaskManager.Task::(resourceAcquired) Task=`f243df4f-d490-4aa6-baa4-a40ec6d5202e`::_resourcesAcquired: Storage.9e1aa540-1f4e-4ee3-a152-be381ef6c3bd (shared) >Thread-34::DEBUG::2014-07-10 09:01:45,279::task::990::TaskManager.Task::(_decref) Task=`f243df4f-d490-4aa6-baa4-a40ec6d5202e`::ref 1 aborting False >Thread-34::DEBUG::2014-07-10 09:01:45,280::lvm::427::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' got the operation mutex >Thread-34::DEBUG::2014-07-10 09:01:45,281::lvm::296::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm lvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/3600601601282300032826addbbdae311|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,vg_name,attr,size,seg_start_pe,devices,tags 9e1aa540-1f4e-4ee3-a152-be381ef6c3bd' (cwd None) >Thread-34::DEBUG::2014-07-10 09:01:45,496::lvm::296::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-34::DEBUG::2014-07-10 09:01:45,506::lvm::462::Storage.LVM::(_reloadlvs) lvs reloaded >Thread-34::DEBUG::2014-07-10 09:01:45,506::lvm::462::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' released the operation mutex >Thread-34::INFO::2014-07-10 09:01:45,507::volume::879::Storage.Volume::(getInfo) Info request: sdUUID=9e1aa540-1f4e-4ee3-a152-be381ef6c3bd imgUUID=28408446-e5fd-4565-a976-e760951593fe volUUID = 776303a2-5585-451e-826e-0e338d4a1e98 >Thread-34::DEBUG::2014-07-10 09:01:45,507::blockVolume::572::Storage.Misc.excCmd::(getMetadata) '/bin/dd iflag=direct skip=7 bs=512 if=/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/metadata count=1' (cwd None) >Thread-34::DEBUG::2014-07-10 09:01:45,522::blockVolume::572::Storage.Misc.excCmd::(getMetadata) SUCCESS: <err> = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.000528369 s, 969 kB/s\n'; <rc> = 0 >Thread-34::DEBUG::2014-07-10 09:01:45,523::misc::282::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.000528369 s, 969 kB/s'], size: 512 >Thread-34::DEBUG::2014-07-10 09:01:45,524::blockVolume::572::Storage.Misc.excCmd::(getMetadata) '/bin/dd iflag=direct skip=7 bs=512 if=/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/metadata count=1' (cwd None) >Thread-34::DEBUG::2014-07-10 09:01:45,538::blockVolume::572::Storage.Misc.excCmd::(getMetadata) SUCCESS: <err> = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.000747672 s, 685 kB/s\n'; <rc> = 0 >Thread-34::DEBUG::2014-07-10 09:01:45,538::misc::282::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.000747672 s, 685 kB/s'], size: 512 >Thread-34::INFO::2014-07-10 09:01:45,539::volume::909::Storage.Volume::(getInfo) 9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/28408446-e5fd-4565-a976-e760951593fe/776303a2-5585-451e-826e-0e338d4a1e98 info is {'status': 'OK', 'domain': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'voltype': 'LEAF', 'description': '', 'parent': '47592965-e853-4e59-9728-d11cca6a7a8a', 'format': 'COW', 'image': '28408446-e5fd-4565-a976-e760951593fe', 'ctime': '1404982897', 'disktype': '2', 'legality': 'LEGAL', 'mtime': '1404982897', 'apparentsize': '1073741824', 'children': [], 'pool': '', 'capacity': '10737418240', 'uuid': '776303a2-5585-451e-826e-0e338d4a1e98', 'truesize': '1073741824', 'type': 'SPARSE'} >Thread-34::INFO::2014-07-10 09:01:45,539::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeInfo, Return response: {'info': {'status': 'OK', 'domain': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'voltype': 'LEAF', 'description': '', 'parent': '47592965-e853-4e59-9728-d11cca6a7a8a', 'format': 'COW', 'image': '28408446-e5fd-4565-a976-e760951593fe', 'ctime': '1404982897', 'disktype': '2', 'legality': 'LEGAL', 'mtime': '1404982897', 'apparentsize': '1073741824', 'children': [], 'pool': '', 'capacity': '10737418240', 'uuid': '776303a2-5585-451e-826e-0e338d4a1e98', 'truesize': '1073741824', 'type': 'SPARSE'}} >Thread-34::DEBUG::2014-07-10 09:01:45,539::task::1185::TaskManager.Task::(prepare) Task=`f243df4f-d490-4aa6-baa4-a40ec6d5202e`::finished: {'info': {'status': 'OK', 'domain': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'voltype': 'LEAF', 'description': '', 'parent': '47592965-e853-4e59-9728-d11cca6a7a8a', 'format': 'COW', 'image': '28408446-e5fd-4565-a976-e760951593fe', 'ctime': '1404982897', 'disktype': '2', 'legality': 'LEGAL', 'mtime': '1404982897', 'apparentsize': '1073741824', 'children': [], 'pool': '', 'capacity': '10737418240', 'uuid': '776303a2-5585-451e-826e-0e338d4a1e98', 'truesize': '1073741824', 'type': 'SPARSE'}} >Thread-34::DEBUG::2014-07-10 09:01:45,540::task::595::TaskManager.Task::(_updateState) Task=`f243df4f-d490-4aa6-baa4-a40ec6d5202e`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-10 09:01:45,540::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': < ResourceRef 'Storage.9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-10 09:01:45,540::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-10 09:01:45,541::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.9e1aa540-1f4e-4ee3-a152-be381ef6c3bd' >Thread-34::DEBUG::2014-07-10 09:01:45,541::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.9e1aa540-1f4e-4ee3-a152-be381ef6c3bd' (0 active users) >Thread-34::DEBUG::2014-07-10 09:01:45,541::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.9e1aa540-1f4e-4ee3-a152-be381ef6c3bd' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-10 09:01:45,541::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', Clearing records. >Thread-34::DEBUG::2014-07-10 09:01:45,542::task::990::TaskManager.Task::(_decref) Task=`f243df4f-d490-4aa6-baa4-a40ec6d5202e`::ref 0 aborting False >Thread-14::DEBUG::2014-07-10 09:01:45,581::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-14::DEBUG::2014-07-10 09:01:45,582::task::595::TaskManager.Task::(_updateState) Task=`8904efb6-c29d-4e41-9282-89e07de8e62a`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 09:01:45,582::logUtils::44::dispatcher::(wrapper) Run and protect: clearTask(taskID='987e9b60-127c-4388-96f0-10643f60289c', spUUID=None, options=None) >Thread-14::DEBUG::2014-07-10 09:01:45,582::taskManager::161::TaskManager::(clearTask) Entry. taskID: 987e9b60-127c-4388-96f0-10643f60289c >Thread-14::DEBUG::2014-07-10 09:01:45,584::taskManager::166::TaskManager::(clearTask) Return. >Thread-14::INFO::2014-07-10 09:01:45,584::logUtils::47::dispatcher::(wrapper) Run and protect: clearTask, Return response: None >Thread-14::DEBUG::2014-07-10 09:01:45,584::task::1185::TaskManager.Task::(prepare) Task=`8904efb6-c29d-4e41-9282-89e07de8e62a`::finished: None >Thread-14::DEBUG::2014-07-10 09:01:45,585::task::595::TaskManager.Task::(_updateState) Task=`8904efb6-c29d-4e41-9282-89e07de8e62a`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 09:01:45,585::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 09:01:45,585::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 09:01:45,585::task::990::TaskManager.Task::(_decref) Task=`8904efb6-c29d-4e41-9282-89e07de8e62a`::ref 0 aborting False >Thread-14::DEBUG::2014-07-10 09:01:46,335::BindingXMLRPC::1067::vds::(wrapper) client [10.35.3.13]::call vmCreate with ({'acpiEnable': 'true', 'emulatedMachine': 'rhel6.5.0', 'vmId': '949f6c19-87b5-4f16-a91c-0049749423ea', 'memGuaranteedSize': 1024, 'spiceSslCipherSuite': 'DEFAULT', 'timeOffset': '0', 'cpuType': 'Conroe', 'custom': {'device_0deeb8f6-b54b-4aa0-a669-e82794e68855device_5c70176e-ef6a-44a9-954e-b01ddfbf7fd3': 'VmDevice {vmId=949f6c19-87b5-4f16-a91c-0049749423ea, deviceId=5c70176e-ef6a-44a9-954e-b01ddfbf7fd3, device=unix, type=CHANNEL, bootOrder=0, specParams={}, address={port=1, bus=0, controller=0, type=virtio-serial}, managed=false, plugged=true, readOnly=false, deviceAlias=channel0, customProperties={}, snapshotId=null}', 'device_0deeb8f6-b54b-4aa0-a669-e82794e68855': 'VmDevice {vmId=949f6c19-87b5-4f16-a91c-0049749423ea, deviceId=0deeb8f6-b54b-4aa0-a669-e82794e68855, device=spicevmc, type=CHANNEL, bootOrder=0, specParams={}, address={port=3, bus=0, controller=0, type=virtio-serial}, managed=false, plugged=true, readOnly=false, deviceAlias=channel2, customProperties={}, snapshotId=null}', 'device_0deeb8f6-b54b-4aa0-a669-e82794e68855device_5c70176e-ef6a-44a9-954e-b01ddfbf7fd3device_98ab7cf0-f4f8-4c5c-b327-2af6c5b93eb8': 'VmDevice {vmId=949f6c19-87b5-4f16-a91c-0049749423ea, deviceId=98ab7cf0-f4f8-4c5c-b327-2af6c5b93eb8, device=unix, type=CHANNEL, bootOrder=0, specParams={}, address={port=2, bus=0, controller=0, type=virtio-serial}, managed=false, plugged=true, readOnly=false, deviceAlias=channel1, customProperties={}, snapshotId=null}', 'device_0deeb8f6-b54b-4aa0-a669-e82794e68855device_5c70176e-ef6a-44a9-954e-b01ddfbf7fd3device_98ab7cf0-f4f8-4c5c-b327-2af6c5b93eb8device_be35ac43-3291-4a19-b0b4-4b2878413cbc': 'VmDevice {vmId=949f6c19-87b5-4f16-a91c-0049749423ea, deviceId=be35ac43-3291-4a19-b0b4-4b2878413cbc, device=ide, type=CONTROLLER, bootOrder=0, specParams={}, address={bus=0x00, domain=0x0000, type=pci, slot=0x01, function=0x1}, managed=false, plugged=true, readOnly=false, deviceAlias=ide0, customProperties={}, snapshotId=null}', 'device_0deeb8f6-b54b-4aa0-a669-e82794e68855device_5c70176e-ef6a-44a9-954e-b01ddfbf7fd3device_98ab7cf0-f4f8-4c5c-b327-2af6c5b93eb8device_be35ac43-3291-4a19-b0b4-4b2878413cbcdevice_fd7cf6d6-2014-4d65-a424-aec06590f576': 'VmDevice {vmId=949f6c19-87b5-4f16-a91c-0049749423ea, deviceId=fd7cf6d6-2014-4d65-a424-aec06590f576, device=virtio-serial, type=CONTROLLER, bootOrder=0, specParams={}, address={bus=0x00, domain=0x0000, type=pci, slot=0x05, function=0x0}, managed=false, plugged=true, readOnly=false, deviceAlias=virtio-serial0, customProperties={}, snapshotId=null}'}, 'smp': '2', 'vmType': 'kvm', 'memSize': 1024, 'smpCoresPerSocket': '2', 'vmName': 'scale_3', 'nice': '0', 'smartcardEnable': 'false', 'keyboardLayout': 'en-us', 'kvmEnable': 'true', 'pitReinjection': 'false', 'transparentHugePages': 'true', 'devices': [{'index': '3', 'iface': 'ide', 'specParams': {'vmPayload': {'volId': 'config-2', 'file': {'openstack/latest/meta_data.json': 'ewogICJsYXVuY2hfaW5kZXgiIDogIjAiLAogICJhdmFpbGFiaWxpdHlfem9uZSIgOiAibm92YSIs\nCiAgInV1aWQiIDogImQxZWRlOWE5LTMwNGYtNGZkYi1iYTRkLTc3ZDM3OGIxMzk3NSIsCiAgIm1l\ndGEiIDogewogICAgImVzc2VudGlhbCIgOiAiZmFsc2UiLAogICAgInJvbGUiIDogInNlcnZlciIs\nCiAgICAiZHNtb2RlIiA6ICJsb2NhbCIKICB9Cn0=\n', 'openstack/latest/user_data': 'I2Nsb3VkLWNvbmZpZwpzc2hfcHdhdXRoOiB0cnVlCmRpc2FibGVfcm9vdDogMApvdXRwdXQ6CiAg\nYWxsOiAnPj4gL3Zhci9sb2cvY2xvdWQtaW5pdC1vdXRwdXQubG9nJwp1c2VyOiByb290CmNocGFz\nc3dkOgogIGV4cGlyZTogZmFsc2UKcnVuY21kOgotICdzZWQgLWkgJycvXmRhdGFzb3VyY2VfbGlz\ndDogL2QnJyAvZXRjL2Nsb3VkL2Nsb3VkLmNmZzsgZWNobyAnJ2RhdGFzb3VyY2VfbGlzdDoKICBb\nIk5vQ2xvdWQiLCAiQ29uZmlnRHJpdmUiXScnID4+IC9ldGMvY2xvdWQvY2xvdWQuY2ZnJwo=\n'}}}, 'readonly': 'true', 'deviceId': 'ff9da3d5-1181-49b3-ba97-c658b718d02a', 'path': '', 'device': 'cdrom', 'shared': 'false', 'type': 'disk'}, {'device': 'qxl', 'specParams': {'vram': '32768', 'ram': '65536', 'heads': '1'}, 'type': 'video', 'deviceId': '116cad81-1263-41e9-8921-25ec2f9f2ef9'}, {'index': '2', 'iface': 'ide', 'specParams': {'path': ''}, 'readonly': 'true', 'deviceId': '360ee856-6d89-47f8-9eac-c97deef7d7ec', 'path': '', 'device': 'cdrom', 'shared': 'false', 'type': 'disk'}, {'index': 0, 'iface': 'virtio', 'format': 'cow', 'bootOrder': '1', 'poolID': '4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', 'volumeID': '776303a2-5585-451e-826e-0e338d4a1e98', 'imageID': '28408446-e5fd-4565-a976-e760951593fe', 'specParams': {}, 'readonly': 'false', 'domainID': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'optional': 'false', 'deviceId': '28408446-e5fd-4565-a976-e760951593fe', 'address': {'slot': '0x06', 'bus': '0x00', 'domain': '0x0000', 'type': 'pci', 'function': '0x0'}, 'device': 'disk', 'shared': 'false', 'propagateErrors': 'off', 'type': 'disk'}, {'nicModel': 'pv', 'macAddr': '00:1a:4a:de:6d:7e', 'linkActive': 'true', 'network': 'rhevm', 'filter': 'vdsm-no-mac-spoofing', 'specParams': {'inbound': {}, 'outbound': {}}, 'deviceId': 'a26407ea-3132-4435-8180-5542669782e6', 'device': 'bridge', 'type': 'interface'}, {'device': 'memballoon', 'specParams': {'model': 'virtio'}, 'type': 'balloon', 'deviceId': '7cf42829-f444-49a2-9d75-d38384dd05df'}, {'index': '0', 'specParams': {}, 'deviceId': '16bb3e0e-6378-4fb7-ba88-cb27ea2ae560', 'address': {'slot': '0x04', 'bus': '0x00', 'domain': '0x0000', 'type': 'pci', 'function': '0x0'}, 'device': 'scsi', 'model': 'virtio-scsi', 'type': 'controller'}], 'maxVCpus': '160', 'spiceSecureChannels': 'smain,sinputs,scursor,splayback,srecord,sdisplay,susbredir,ssmartcard', 'display': 'qxl'},) {} flowID [5b80dee1] >Thread-14::INFO::2014-07-10 09:01:46,339::API::667::vds::(_getNetworkIp) network None: using 0 >Thread-14::INFO::2014-07-10 09:01:46,340::clientIF::366::vds::(createVm) vmContainerLock acquired by vm 949f6c19-87b5-4f16-a91c-0049749423ea >Thread-14::DEBUG::2014-07-10 09:01:46,347::clientIF::379::vds::(createVm) Total desktops after creation of 949f6c19-87b5-4f16-a91c-0049749423ea is 3 >Thread-52::DEBUG::2014-07-10 09:01:46,348::vm::2270::vm.Vm::(_startUnderlyingVm) vmId=`949f6c19-87b5-4f16-a91c-0049749423ea`::Start >Thread-14::DEBUG::2014-07-10 09:01:46,350::BindingXMLRPC::1074::vds::(wrapper) return vmCreate with {'status': {'message': 'Done', 'code': 0}, 'vmList': {'status': 'WaitForLaunch', 'acpiEnable': 'true', 'emulatedMachine': 'rhel6.5.0', 'vmId': '949f6c19-87b5-4f16-a91c-0049749423ea', 'pid': '0', 'memGuaranteedSize': 1024, 'timeOffset': '0', 'keyboardLayout': 'en-us', 'displayPort': '-1', 'displaySecurePort': '-1', 'spiceSslCipherSuite': 'DEFAULT', 'cpuType': 'Conroe', 'smp': '2', 'clientIp': '', 'nicModel': 'rtl8139,pv', 'smartcardEnable': 'false', 'kvmEnable': 'true', 'pitReinjection': 'false', 'transparentHugePages': 'true', 'devices': [{'index': '3', 'iface': 'ide', 'specParams': {'vmPayload': {'volId': 'config-2', 'file': {'openstack/latest/meta_data.json': 'ewogICJsYXVuY2hfaW5kZXgiIDogIjAiLAogICJhdmFpbGFiaWxpdHlfem9uZSIgOiAibm92YSIs\nCiAgInV1aWQiIDogImQxZWRlOWE5LTMwNGYtNGZkYi1iYTRkLTc3ZDM3OGIxMzk3NSIsCiAgIm1l\ndGEiIDogewogICAgImVzc2VudGlhbCIgOiAiZmFsc2UiLAogICAgInJvbGUiIDogInNlcnZlciIs\nCiAgICAiZHNtb2RlIiA6ICJsb2NhbCIKICB9Cn0=\n', 'openstack/latest/user_data': 'I2Nsb3VkLWNvbmZpZwpzc2hfcHdhdXRoOiB0cnVlCmRpc2FibGVfcm9vdDogMApvdXRwdXQ6CiAg\nYWxsOiAnPj4gL3Zhci9sb2cvY2xvdWQtaW5pdC1vdXRwdXQubG9nJwp1c2VyOiByb290CmNocGFz\nc3dkOgogIGV4cGlyZTogZmFsc2UKcnVuY21kOgotICdzZWQgLWkgJycvXmRhdGFzb3VyY2VfbGlz\ndDogL2QnJyAvZXRjL2Nsb3VkL2Nsb3VkLmNmZzsgZWNobyAnJ2RhdGFzb3VyY2VfbGlzdDoKICBb\nIk5vQ2xvdWQiLCAiQ29uZmlnRHJpdmUiXScnID4+IC9ldGMvY2xvdWQvY2xvdWQuY2ZnJwo=\n'}}}, 'readonly': 'true', 'deviceId': 'ff9da3d5-1181-49b3-ba97-c658b718d02a', 'path': '', 'device': 'cdrom', 'shared': 'false', 'type': 'disk'}, {'device': 'qxl', 'specParams': {'vram': '32768', 'ram': '65536', 'heads': '1'}, 'type': 'video', 'deviceId': '116cad81-1263-41e9-8921-25ec2f9f2ef9'}, {'index': '2', 'iface': 'ide', 'specParams': {'path': ''}, 'readonly': 'true', 'deviceId': '360ee856-6d89-47f8-9eac-c97deef7d7ec', 'path': '', 'device': 'cdrom', 'shared': 'false', 'type': 'disk'}, {'index': 0, 'iface': 'virtio', 'format': 'cow', 'bootOrder': '1', 'poolID': '4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', 'volumeID': '776303a2-5585-451e-826e-0e338d4a1e98', 'imageID': '28408446-e5fd-4565-a976-e760951593fe', 'specParams': {}, 'readonly': 'false', 'domainID': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'optional': 'false', 'deviceId': '28408446-e5fd-4565-a976-e760951593fe', 'address': {'slot': '0x06', 'bus': '0x00', 'domain': '0x0000', 'type': 'pci', 'function': '0x0'}, 'device': 'disk', 'shared': 'false', 'propagateErrors': 'off', 'type': 'disk'}, {'nicModel': 'pv', 'macAddr': '00:1a:4a:de:6d:7e', 'linkActive': 'true', 'network': 'rhevm', 'filter': 'vdsm-no-mac-spoofing', 'specParams': {'inbound': {}, 'outbound': {}}, 'deviceId': 'a26407ea-3132-4435-8180-5542669782e6', 'device': 'bridge', 'type': 'interface'}, {'device': 'memballoon', 'specParams': {'model': 'virtio'}, 'type': 'balloon', 'deviceId': '7cf42829-f444-49a2-9d75-d38384dd05df'}, {'index': '0', 'specParams': {}, 'deviceId': '16bb3e0e-6378-4fb7-ba88-cb27ea2ae560', 'address': {'slot': '0x04', 'bus': '0x00', 'domain': '0x0000', 'type': 'pci', 'function': '0x0'}, 'device': 'scsi', 'model': 'virtio-scsi', 'type': 'controller'}], 'custom': {'device_0deeb8f6-b54b-4aa0-a669-e82794e68855device_5c70176e-ef6a-44a9-954e-b01ddfbf7fd3': 'VmDevice {vmId=949f6c19-87b5-4f16-a91c-0049749423ea, deviceId=5c70176e-ef6a-44a9-954e-b01ddfbf7fd3, device=unix, type=CHANNEL, bootOrder=0, specParams={}, address={port=1, bus=0, controller=0, type=virtio-serial}, managed=false, plugged=true, readOnly=false, deviceAlias=channel0, customProperties={}, snapshotId=null}', 'device_0deeb8f6-b54b-4aa0-a669-e82794e68855': 'VmDevice {vmId=949f6c19-87b5-4f16-a91c-0049749423ea, deviceId=0deeb8f6-b54b-4aa0-a669-e82794e68855, device=spicevmc, type=CHANNEL, bootOrder=0, specParams={}, address={port=3, bus=0, controller=0, type=virtio-serial}, managed=false, plugged=true, readOnly=false, deviceAlias=channel2, customProperties={}, snapshotId=null}', 'device_0deeb8f6-b54b-4aa0-a669-e82794e68855device_5c70176e-ef6a-44a9-954e-b01ddfbf7fd3device_98ab7cf0-f4f8-4c5c-b327-2af6c5b93eb8': 'VmDevice {vmId=949f6c19-87b5-4f16-a91c-0049749423ea, deviceId=98ab7cf0-f4f8-4c5c-b327-2af6c5b93eb8, device=unix, type=CHANNEL, bootOrder=0, specParams={}, address={port=2, bus=0, controller=0, type=virtio-serial}, managed=false, plugged=true, readOnly=false, deviceAlias=channel1, customProperties={}, snapshotId=null}', 'device_0deeb8f6-b54b-4aa0-a669-e82794e68855device_5c70176e-ef6a-44a9-954e-b01ddfbf7fd3device_98ab7cf0-f4f8-4c5c-b327-2af6c5b93eb8device_be35ac43-3291-4a19-b0b4-4b2878413cbc': 'VmDevice {vmId=949f6c19-87b5-4f16-a91c-0049749423ea, deviceId=be35ac43-3291-4a19-b0b4-4b2878413cbc, device=ide, type=CONTROLLER, bootOrder=0, specParams={}, address={bus=0x00, domain=0x0000, type=pci, slot=0x01, function=0x1}, managed=false, plugged=true, readOnly=false, deviceAlias=ide0, customProperties={}, snapshotId=null}', 'device_0deeb8f6-b54b-4aa0-a669-e82794e68855device_5c70176e-ef6a-44a9-954e-b01ddfbf7fd3device_98ab7cf0-f4f8-4c5c-b327-2af6c5b93eb8device_be35ac43-3291-4a19-b0b4-4b2878413cbcdevice_fd7cf6d6-2014-4d65-a424-aec06590f576': 'VmDevice {vmId=949f6c19-87b5-4f16-a91c-0049749423ea, deviceId=fd7cf6d6-2014-4d65-a424-aec06590f576, device=virtio-serial, type=CONTROLLER, bootOrder=0, specParams={}, address={bus=0x00, domain=0x0000, type=pci, slot=0x05, function=0x0}, managed=false, plugged=true, readOnly=false, deviceAlias=virtio-serial0, customProperties={}, snapshotId=null}'}, 'vmType': 'kvm', 'memSize': 1024, 'displayIp': '0', 'maxVCpus': '160', 'spiceSecureChannels': 'smain,sinputs,scursor,splayback,srecord,sdisplay,susbredir,ssmartcard', 'smpCoresPerSocket': '2', 'vmName': 'scale_3', 'display': 'qxl', 'nice': '0'}} >Thread-52::DEBUG::2014-07-10 09:01:46,352::vm::2274::vm.Vm::(_startUnderlyingVm) vmId=`949f6c19-87b5-4f16-a91c-0049749423ea`::_ongoingCreations acquired >Thread-52::INFO::2014-07-10 09:01:46,355::vm::3151::vm.Vm::(_run) vmId=`949f6c19-87b5-4f16-a91c-0049749423ea`::VM wrapper has started >Thread-52::DEBUG::2014-07-10 09:01:46,360::task::595::TaskManager.Task::(_updateState) Task=`ec4a2b4c-44c3-427b-a92c-0911874ae735`::moving from state init -> state preparing >Thread-52::INFO::2014-07-10 09:01:46,363::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='28408446-e5fd-4565-a976-e760951593fe', volUUID='776303a2-5585-451e-826e-0e338d4a1e98', options=None) >Thread-52::INFO::2014-07-10 09:01:46,367::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-52::DEBUG::2014-07-10 09:01:46,369::task::1185::TaskManager.Task::(prepare) Task=`ec4a2b4c-44c3-427b-a92c-0911874ae735`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-52::DEBUG::2014-07-10 09:01:46,372::task::595::TaskManager.Task::(_updateState) Task=`ec4a2b4c-44c3-427b-a92c-0911874ae735`::moving from state preparing -> state finished >Thread-52::DEBUG::2014-07-10 09:01:46,374::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-52::DEBUG::2014-07-10 09:01:46,376::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-52::DEBUG::2014-07-10 09:01:46,378::task::990::TaskManager.Task::(_decref) Task=`ec4a2b4c-44c3-427b-a92c-0911874ae735`::ref 0 aborting False >Thread-52::INFO::2014-07-10 09:01:46,450::clientIF::324::vds::(prepareVolumePath) prepared volume path: /var/run/vdsm/payload/949f6c19-87b5-4f16-a91c-0049749423ea.77a2e25a207d72bb98c33c5375b167bf.img >Thread-52::INFO::2014-07-10 09:01:46,453::clientIF::324::vds::(prepareVolumePath) prepared volume path: >Thread-18::DEBUG::2014-07-10 09:01:46,455::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/metadata bs=4096 count=1' (cwd None) >Thread-52::DEBUG::2014-07-10 09:01:46,456::task::595::TaskManager.Task::(_updateState) Task=`c87cfeaa-155a-4928-9a08-878182d1e912`::moving from state init -> state preparing >Thread-52::INFO::2014-07-10 09:01:46,475::logUtils::44::dispatcher::(wrapper) Run and protect: prepareImage(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='28408446-e5fd-4565-a976-e760951593fe', leafUUID='776303a2-5585-451e-826e-0e338d4a1e98') >Thread-52::DEBUG::2014-07-10 09:01:46,483::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.9e1aa540-1f4e-4ee3-a152-be381ef6c3bd`ReqID=`e20d7b87-2579-49cb-bc47-aca271df2542`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '3248' at 'prepareImage' >Thread-52::DEBUG::2014-07-10 09:01:46,484::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.9e1aa540-1f4e-4ee3-a152-be381ef6c3bd' for lock type 'shared' >Thread-52::DEBUG::2014-07-10 09:01:46,489::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.9e1aa540-1f4e-4ee3-a152-be381ef6c3bd' is free. Now locking as 'shared' (1 active user) >Thread-52::DEBUG::2014-07-10 09:01:46,491::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.9e1aa540-1f4e-4ee3-a152-be381ef6c3bd`ReqID=`e20d7b87-2579-49cb-bc47-aca271df2542`::Granted request >Thread-52::DEBUG::2014-07-10 09:01:46,497::task::827::TaskManager.Task::(resourceAcquired) Task=`c87cfeaa-155a-4928-9a08-878182d1e912`::_resourcesAcquired: Storage.9e1aa540-1f4e-4ee3-a152-be381ef6c3bd (shared) >Thread-52::DEBUG::2014-07-10 09:01:46,499::task::990::TaskManager.Task::(_decref) Task=`c87cfeaa-155a-4928-9a08-878182d1e912`::ref 1 aborting False >Thread-52::DEBUG::2014-07-10 09:01:46,504::lvm::427::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' got the operation mutex >Thread-52::DEBUG::2014-07-10 09:01:46,515::lvm::296::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm lvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/3600601601282300032826addbbdae311|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,vg_name,attr,size,seg_start_pe,devices,tags 9e1aa540-1f4e-4ee3-a152-be381ef6c3bd' (cwd None) >Thread-18::DEBUG::2014-07-10 09:01:46,534::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000471 s, 8.7 MB/s\n'; <rc> = 0 >Thread-52::DEBUG::2014-07-10 09:01:46,720::lvm::296::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-52::DEBUG::2014-07-10 09:01:46,731::lvm::462::Storage.LVM::(_reloadlvs) lvs reloaded >Thread-52::DEBUG::2014-07-10 09:01:46,732::lvm::462::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' released the operation mutex >Thread-52::DEBUG::2014-07-10 09:01:46,733::lvm::296::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm lvchange --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/3600601601282300032826addbbdae311|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } " --autobackup n --available y 9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/776303a2-5585-451e-826e-0e338d4a1e98' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:01:47,016::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:01:47,122::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0508796 s, 20.1 MB/s\n'; <rc> = 0 >Thread-52::DEBUG::2014-07-10 09:01:47,322::lvm::296::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-52::DEBUG::2014-07-10 09:01:47,323::lvm::513::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-52::DEBUG::2014-07-10 09:01:47,323::lvm::525::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-52::DEBUG::2014-07-10 09:01:47,325::blockSD::1057::Storage.StorageDomain::(linkBCImage) path to image directory already exists: /rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/images/28408446-e5fd-4565-a976-e760951593fe >Thread-52::DEBUG::2014-07-10 09:01:47,326::lvm::427::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' got the operation mutex >Thread-52::DEBUG::2014-07-10 09:01:47,326::lvm::296::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm lvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/3600601601282300032826addbbdae311|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,vg_name,attr,size,seg_start_pe,devices,tags 9e1aa540-1f4e-4ee3-a152-be381ef6c3bd' (cwd None) >Thread-52::DEBUG::2014-07-10 09:01:47,519::lvm::296::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-52::DEBUG::2014-07-10 09:01:47,529::lvm::462::Storage.LVM::(_reloadlvs) lvs reloaded >Thread-52::DEBUG::2014-07-10 09:01:47,529::lvm::462::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' released the operation mutex >Thread-52::INFO::2014-07-10 09:01:47,530::logUtils::47::dispatcher::(wrapper) Run and protect: prepareImage, Return response: {'info': {'domainID': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'volType': 'path', 'leaseOffset': 112197632, 'path': '/rhev/data-center/mnt/blockSD/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/images/28408446-e5fd-4565-a976-e760951593fe/776303a2-5585-451e-826e-0e338d4a1e98', 'volumeID': '776303a2-5585-451e-826e-0e338d4a1e98', 'leasePath': '/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/leases', 'imageID': '28408446-e5fd-4565-a976-e760951593fe'}, 'path': '/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/images/28408446-e5fd-4565-a976-e760951593fe/776303a2-5585-451e-826e-0e338d4a1e98', 'imgVolumesInfo': [{'domainID': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'volType': 'path', 'leaseOffset': 109051904, 'path': '/rhev/data-center/mnt/blockSD/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/images/28408446-e5fd-4565-a976-e760951593fe/47592965-e853-4e59-9728-d11cca6a7a8a', 'volumeID': '47592965-e853-4e59-9728-d11cca6a7a8a', 'leasePath': '/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/leases', 'imageID': '28408446-e5fd-4565-a976-e760951593fe'}, {'domainID': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'volType': 'path', 'leaseOffset': 112197632, 'path': '/rhev/data-center/mnt/blockSD/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/images/28408446-e5fd-4565-a976-e760951593fe/776303a2-5585-451e-826e-0e338d4a1e98', 'volumeID': '776303a2-5585-451e-826e-0e338d4a1e98', 'leasePath': '/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/leases', 'imageID': '28408446-e5fd-4565-a976-e760951593fe'}]} >Thread-52::DEBUG::2014-07-10 09:01:47,530::task::1185::TaskManager.Task::(prepare) Task=`c87cfeaa-155a-4928-9a08-878182d1e912`::finished: {'info': {'domainID': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'volType': 'path', 'leaseOffset': 112197632, 'path': '/rhev/data-center/mnt/blockSD/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/images/28408446-e5fd-4565-a976-e760951593fe/776303a2-5585-451e-826e-0e338d4a1e98', 'volumeID': '776303a2-5585-451e-826e-0e338d4a1e98', 'leasePath': '/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/leases', 'imageID': '28408446-e5fd-4565-a976-e760951593fe'}, 'path': '/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/images/28408446-e5fd-4565-a976-e760951593fe/776303a2-5585-451e-826e-0e338d4a1e98', 'imgVolumesInfo': [{'domainID': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'volType': 'path', 'leaseOffset': 109051904, 'path': '/rhev/data-center/mnt/blockSD/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/images/28408446-e5fd-4565-a976-e760951593fe/47592965-e853-4e59-9728-d11cca6a7a8a', 'volumeID': '47592965-e853-4e59-9728-d11cca6a7a8a', 'leasePath': '/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/leases', 'imageID': '28408446-e5fd-4565-a976-e760951593fe'}, {'domainID': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'volType': 'path', 'leaseOffset': 112197632, 'path': '/rhev/data-center/mnt/blockSD/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/images/28408446-e5fd-4565-a976-e760951593fe/776303a2-5585-451e-826e-0e338d4a1e98', 'volumeID': '776303a2-5585-451e-826e-0e338d4a1e98', 'leasePath': '/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/leases', 'imageID': '28408446-e5fd-4565-a976-e760951593fe'}]} >Thread-52::DEBUG::2014-07-10 09:01:47,531::task::595::TaskManager.Task::(_updateState) Task=`c87cfeaa-155a-4928-9a08-878182d1e912`::moving from state preparing -> state finished >Thread-52::DEBUG::2014-07-10 09:01:47,531::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': < ResourceRef 'Storage.9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', isValid: 'True' obj: 'None'>} >Thread-52::DEBUG::2014-07-10 09:01:47,531::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-52::DEBUG::2014-07-10 09:01:47,532::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.9e1aa540-1f4e-4ee3-a152-be381ef6c3bd' >Thread-52::DEBUG::2014-07-10 09:01:47,532::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.9e1aa540-1f4e-4ee3-a152-be381ef6c3bd' (0 active users) >Thread-52::DEBUG::2014-07-10 09:01:47,532::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.9e1aa540-1f4e-4ee3-a152-be381ef6c3bd' is free, finding out if anyone is waiting for it. >Thread-52::DEBUG::2014-07-10 09:01:47,532::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', Clearing records. >Thread-52::DEBUG::2014-07-10 09:01:47,533::task::990::TaskManager.Task::(_decref) Task=`c87cfeaa-155a-4928-9a08-878182d1e912`::ref 0 aborting False >Thread-52::INFO::2014-07-10 09:01:47,533::clientIF::324::vds::(prepareVolumePath) prepared volume path: /rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/images/28408446-e5fd-4565-a976-e760951593fe/776303a2-5585-451e-826e-0e338d4a1e98 >Thread-52::DEBUG::2014-07-10 09:01:47,562::utils::642::root::(execCmd) '/usr/libexec/vdsm/hooks/before_vm_start/50_vhostmd' (cwd None) >Thread-14::DEBUG::2014-07-10 09:01:47,582::BindingXMLRPC::1067::vds::(wrapper) client [10.35.3.13]::call vmGetStats with ('52e238aa-e62a-48a8-a200-604e72422f3f',) {} >Thread-14::DEBUG::2014-07-10 09:01:47,583::vm::676::vm.Vm::(_getDiskStats) vmId=`52e238aa-e62a-48a8-a200-604e72422f3f`::Disk hdd stats not available >Thread-14::DEBUG::2014-07-10 09:01:47,584::vm::676::vm.Vm::(_getDiskStats) vmId=`52e238aa-e62a-48a8-a200-604e72422f3f`::Disk hdc stats not available >Thread-14::DEBUG::2014-07-10 09:01:47,584::vm::676::vm.Vm::(_getDiskStats) vmId=`52e238aa-e62a-48a8-a200-604e72422f3f`::Disk vda stats not available >Thread-14::DEBUG::2014-07-10 09:01:47,584::vm::715::vm.Vm::(_getDiskLatency) vmId=`52e238aa-e62a-48a8-a200-604e72422f3f`::Disk hdd latency not available >Thread-14::DEBUG::2014-07-10 09:01:47,584::vm::715::vm.Vm::(_getDiskLatency) vmId=`52e238aa-e62a-48a8-a200-604e72422f3f`::Disk hdc latency not available >Thread-14::DEBUG::2014-07-10 09:01:47,584::vm::715::vm.Vm::(_getDiskLatency) vmId=`52e238aa-e62a-48a8-a200-604e72422f3f`::Disk vda latency not available >Thread-14::DEBUG::2014-07-10 09:01:47,585::BindingXMLRPC::1074::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Powering up', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '12236', 'displayIp': '0', 'displayPort': u'5902', 'session': 'Unknown', 'displaySecurePort': u'5903', 'timeOffset': '0', 'hash': '-5500930374920933700', 'balloonInfo': {'balloon_max': '1048576', 'balloon_target': '1048576', 'balloon_cur': '1048576', 'balloon_min': '1048576'}, 'pauseCode': 'NOERR', 'clientIp': '', 'kvmEnable': 'true', 'network': {u'vnet1': {'macAddr': '00:1a:4a:de:6d:7b', 'rxDropped': '0', 'rxErrors': '0', 'txDropped': '0', 'txRate': '0.0', 'rxRate': '0.0', 'txErrors': '0', 'state': 'unknown', 'speed': '1000', 'name': u'vnet1'}}, 'vmId': '52e238aa-e62a-48a8-a200-604e72422f3f', 'displayType': 'qxl', 'cpuUser': '43.94', 'disks': {u'vda': {'truesize': '1073741824', 'apparentsize': '1073741824', 'imageID': '76fdb054-02cd-42ed-9721-b3e65b34c3a4'}, u'hdd': {'truesize': '0', 'apparentsize': '0'}, u'hdc': {'truesize': '0', 'apparentsize': '0'}}, 'monitorResponse': '0', 'statsAge': '0.34', 'elapsedTime': '20', 'vmType': 'kvm', 'cpuSys': '23.61', 'guestCPUCount': -1, 'appsList': [], 'guestIPs': ''}]} >Thread-14::DEBUG::2014-07-10 09:01:47,589::BindingXMLRPC::1067::vds::(wrapper) client [10.35.3.13]::call vmGetStats with ('ed909f7e-0ee2-4f6f-b4a5-a165f689a276',) {} >Thread-14::DEBUG::2014-07-10 09:01:47,590::vm::676::vm.Vm::(_getDiskStats) vmId=`ed909f7e-0ee2-4f6f-b4a5-a165f689a276`::Disk hdd stats not available >Thread-14::DEBUG::2014-07-10 09:01:47,590::vm::676::vm.Vm::(_getDiskStats) vmId=`ed909f7e-0ee2-4f6f-b4a5-a165f689a276`::Disk hdc stats not available >Thread-14::DEBUG::2014-07-10 09:01:47,590::vm::676::vm.Vm::(_getDiskStats) vmId=`ed909f7e-0ee2-4f6f-b4a5-a165f689a276`::Disk vda stats not available >Thread-14::DEBUG::2014-07-10 09:01:47,590::vm::715::vm.Vm::(_getDiskLatency) vmId=`ed909f7e-0ee2-4f6f-b4a5-a165f689a276`::Disk hdd latency not available >Thread-14::DEBUG::2014-07-10 09:01:47,591::vm::715::vm.Vm::(_getDiskLatency) vmId=`ed909f7e-0ee2-4f6f-b4a5-a165f689a276`::Disk hdc latency not available >Thread-14::DEBUG::2014-07-10 09:01:47,591::vm::715::vm.Vm::(_getDiskLatency) vmId=`ed909f7e-0ee2-4f6f-b4a5-a165f689a276`::Disk vda latency not available >Thread-14::DEBUG::2014-07-10 09:01:47,591::BindingXMLRPC::1074::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Powering up', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '11613', 'displayIp': '0', 'displayPort': u'5900', 'session': 'Unknown', 'displaySecurePort': u'5901', 'timeOffset': '0', 'hash': '7841224975033595397', 'balloonInfo': {'balloon_max': '1048576', 'balloon_target': '1048576', 'balloon_cur': '1048576', 'balloon_min': '1048576'}, 'pauseCode': 'NOERR', 'clientIp': '', 'kvmEnable': 'true', 'network': {u'vnet0': {'macAddr': '00:1a:4a:de:6d:7a', 'rxDropped': '0', 'rxErrors': '0', 'txDropped': '0', 'txRate': '0.0', 'rxRate': '0.0', 'txErrors': '0', 'state': 'unknown', 'speed': '1000', 'name': u'vnet0'}}, 'vmId': 'ed909f7e-0ee2-4f6f-b4a5-a165f689a276', 'displayType': 'qxl', 'cpuUser': '47.19', 'disks': {u'vda': {'truesize': '1073741824', 'apparentsize': '1073741824', 'imageID': '0cd7d6ce-f497-4243-a690-c57744861eea'}, u'hdd': {'truesize': '0', 'apparentsize': '0'}, u'hdc': {'truesize': '0', 'apparentsize': '0'}}, 'monitorResponse': '0', 'statsAge': '0.03', 'elapsedTime': '40', 'vmType': 'kvm', 'cpuSys': '3.39', 'guestCPUCount': -1, 'appsList': [], 'guestIPs': ''}]} >Thread-52::DEBUG::2014-07-10 09:01:47,669::utils::662::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-52::INFO::2014-07-10 09:01:47,670::hooks::100::root::(_runHooksDir) >Thread-52::DEBUG::2014-07-10 09:01:47,670::vm::3190::vm.Vm::(_run) vmId=`949f6c19-87b5-4f16-a91c-0049749423ea`::<?xml version="1.0" encoding="utf-8"?> ><domain type="kvm"> > <name>scale_3</name> > <uuid>949f6c19-87b5-4f16-a91c-0049749423ea</uuid> > <memory>1048576</memory> > <currentMemory>1048576</currentMemory> > <vcpu current="2">160</vcpu> > <memtune> > <min_guarantee>1048576</min_guarantee> > </memtune> > <devices> > <channel type="unix"> > <target name="com.redhat.rhevm.vdsm" type="virtio"/> > <source mode="bind" path="/var/lib/libvirt/qemu/channels/949f6c19-87b5-4f16-a91c-0049749423ea.com.redhat.rhevm.vdsm"/> > </channel> > <channel type="unix"> > <target name="org.qemu.guest_agent.0" type="virtio"/> > <source mode="bind" path="/var/lib/libvirt/qemu/channels/949f6c19-87b5-4f16-a91c-0049749423ea.org.qemu.guest_agent.0"/> > </channel> > <input bus="ps2" type="mouse"/> > <channel type="spicevmc"> > <target name="com.redhat.spice.0" type="virtio"/> > </channel> > <graphics autoport="yes" keymap="en-us" listen="0" passwd="*****" passwdValidTo="1970-01-01T00:00:01" port="-1" tlsPort="-1" type="spice"> > <channel mode="secure" name="main"/> > <channel mode="secure" name="inputs"/> > <channel mode="secure" name="cursor"/> > <channel mode="secure" name="playback"/> > <channel mode="secure" name="record"/> > <channel mode="secure" name="display"/> > <channel mode="secure" name="usbredir"/> > <channel mode="secure" name="smartcard"/> > </graphics> > <memballoon model="virtio"/> > <controller index="0" model="virtio-scsi" type="scsi"> > <address bus="0x00" domain="0x0000" function="0x0" slot="0x04" type="pci"/> > </controller> > <video> > <model heads="1" ram="65536" type="qxl" vram="32768"/> > </video> > <interface type="bridge"> > <mac address="00:1a:4a:de:6d:7e"/> > <model type="virtio"/> > <source bridge="rhevm"/> > <filterref filter="vdsm-no-mac-spoofing"/> > <link state="up"/> > <bandwidth/> > </interface> > <disk device="cdrom" snapshot="no" type="file"> > <source file="/var/run/vdsm/payload/949f6c19-87b5-4f16-a91c-0049749423ea.77a2e25a207d72bb98c33c5375b167bf.img" startupPolicy="optional"/> > <target bus="ide" dev="hdd"/> > <readonly/> > <serial/> > </disk> > <disk device="cdrom" snapshot="no" type="file"> > <source file="" startupPolicy="optional"/> > <target bus="ide" dev="hdc"/> > <readonly/> > <serial/> > </disk> > <disk device="disk" snapshot="no" type="block"> > <address bus="0x00" domain="0x0000" function="0x0" slot="0x06" type="pci"/> > <source dev="/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/images/28408446-e5fd-4565-a976-e760951593fe/776303a2-5585-451e-826e-0e338d4a1e98"/> > <target bus="virtio" dev="vda"/> > <serial>28408446-e5fd-4565-a976-e760951593fe</serial> > <boot order="1"/> > <driver cache="none" error_policy="stop" io="native" name="qemu" type="qcow2"/> > </disk> > </devices> > <os> > <type arch="x86_64" machine="rhel6.5.0">hvm</type> > <smbios mode="sysinfo"/> > </os> > <sysinfo type="smbios"> > <system> > <entry name="manufacturer">Red Hat</entry> > <entry name="product">RHEV Hypervisor</entry> > <entry name="version">6.5-20140707.0.el6ev</entry> > <entry name="serial">52BAF97B-FF2F-E311-0000-100000000005</entry> > <entry name="uuid">949f6c19-87b5-4f16-a91c-0049749423ea</entry> > </system> > </sysinfo> > <clock adjustment="0" offset="variable"> > <timer name="rtc" tickpolicy="catchup"/> > </clock> > <features> > <acpi/> > </features> > <cpu match="exact"> > <model>Conroe</model> > <topology cores="2" sockets="80" threads="1"/> > </cpu> ></domain> > >GuestMonitor-scale_2::DEBUG::2014-07-10 09:01:47,822::vm::676::vm.Vm::(_getDiskStats) vmId=`52e238aa-e62a-48a8-a200-604e72422f3f`::Disk hdd stats not available >GuestMonitor-scale_2::DEBUG::2014-07-10 09:01:47,822::vm::676::vm.Vm::(_getDiskStats) vmId=`52e238aa-e62a-48a8-a200-604e72422f3f`::Disk hdc stats not available >GuestMonitor-scale_2::DEBUG::2014-07-10 09:01:47,822::vm::676::vm.Vm::(_getDiskStats) vmId=`52e238aa-e62a-48a8-a200-604e72422f3f`::Disk vda stats not available >GuestMonitor-scale_2::DEBUG::2014-07-10 09:01:47,822::vm::715::vm.Vm::(_getDiskLatency) vmId=`52e238aa-e62a-48a8-a200-604e72422f3f`::Disk hdd latency not available >GuestMonitor-scale_2::DEBUG::2014-07-10 09:01:47,822::vm::715::vm.Vm::(_getDiskLatency) vmId=`52e238aa-e62a-48a8-a200-604e72422f3f`::Disk hdc latency not available >GuestMonitor-scale_2::DEBUG::2014-07-10 09:01:47,823::vm::715::vm.Vm::(_getDiskLatency) vmId=`52e238aa-e62a-48a8-a200-604e72422f3f`::Disk vda latency not available >GuestMonitor-scale_2::DEBUG::2014-07-10 09:01:47,823::vm::676::vm.Vm::(_getDiskStats) vmId=`52e238aa-e62a-48a8-a200-604e72422f3f`::Disk hdd stats not available >GuestMonitor-scale_2::DEBUG::2014-07-10 09:01:47,823::vm::676::vm.Vm::(_getDiskStats) vmId=`52e238aa-e62a-48a8-a200-604e72422f3f`::Disk hdc stats not available >GuestMonitor-scale_2::DEBUG::2014-07-10 09:01:47,824::vm::676::vm.Vm::(_getDiskStats) vmId=`52e238aa-e62a-48a8-a200-604e72422f3f`::Disk vda stats not available >GuestMonitor-scale_2::DEBUG::2014-07-10 09:01:47,824::vm::715::vm.Vm::(_getDiskLatency) vmId=`52e238aa-e62a-48a8-a200-604e72422f3f`::Disk hdd latency not available >GuestMonitor-scale_2::DEBUG::2014-07-10 09:01:47,824::vm::715::vm.Vm::(_getDiskLatency) vmId=`52e238aa-e62a-48a8-a200-604e72422f3f`::Disk hdc latency not available >GuestMonitor-scale_2::DEBUG::2014-07-10 09:01:47,824::vm::715::vm.Vm::(_getDiskLatency) vmId=`52e238aa-e62a-48a8-a200-604e72422f3f`::Disk vda latency not available >GuestMonitor-scale_1::DEBUG::2014-07-10 09:01:47,927::vm::676::vm.Vm::(_getDiskStats) vmId=`ed909f7e-0ee2-4f6f-b4a5-a165f689a276`::Disk hdd stats not available >GuestMonitor-scale_1::DEBUG::2014-07-10 09:01:47,928::vm::676::vm.Vm::(_getDiskStats) vmId=`ed909f7e-0ee2-4f6f-b4a5-a165f689a276`::Disk hdc stats not available >GuestMonitor-scale_1::DEBUG::2014-07-10 09:01:47,928::vm::676::vm.Vm::(_getDiskStats) vmId=`ed909f7e-0ee2-4f6f-b4a5-a165f689a276`::Disk vda stats not available >GuestMonitor-scale_1::DEBUG::2014-07-10 09:01:47,928::vm::715::vm.Vm::(_getDiskLatency) vmId=`ed909f7e-0ee2-4f6f-b4a5-a165f689a276`::Disk hdd latency not available >GuestMonitor-scale_1::DEBUG::2014-07-10 09:01:47,928::vm::715::vm.Vm::(_getDiskLatency) vmId=`ed909f7e-0ee2-4f6f-b4a5-a165f689a276`::Disk hdc latency not available >GuestMonitor-scale_1::DEBUG::2014-07-10 09:01:47,929::vm::715::vm.Vm::(_getDiskLatency) vmId=`ed909f7e-0ee2-4f6f-b4a5-a165f689a276`::Disk vda latency not available >GuestMonitor-scale_1::DEBUG::2014-07-10 09:01:47,929::vm::676::vm.Vm::(_getDiskStats) vmId=`ed909f7e-0ee2-4f6f-b4a5-a165f689a276`::Disk hdd stats not available >GuestMonitor-scale_1::DEBUG::2014-07-10 09:01:47,929::vm::676::vm.Vm::(_getDiskStats) vmId=`ed909f7e-0ee2-4f6f-b4a5-a165f689a276`::Disk hdc stats not available >GuestMonitor-scale_1::DEBUG::2014-07-10 09:01:47,929::vm::676::vm.Vm::(_getDiskStats) vmId=`ed909f7e-0ee2-4f6f-b4a5-a165f689a276`::Disk vda stats not available >GuestMonitor-scale_1::DEBUG::2014-07-10 09:01:47,930::vm::715::vm.Vm::(_getDiskLatency) vmId=`ed909f7e-0ee2-4f6f-b4a5-a165f689a276`::Disk hdd latency not available >GuestMonitor-scale_1::DEBUG::2014-07-10 09:01:47,930::vm::715::vm.Vm::(_getDiskLatency) vmId=`ed909f7e-0ee2-4f6f-b4a5-a165f689a276`::Disk hdc latency not available >GuestMonitor-scale_1::DEBUG::2014-07-10 09:01:47,930::vm::715::vm.Vm::(_getDiskLatency) vmId=`ed909f7e-0ee2-4f6f-b4a5-a165f689a276`::Disk vda latency not available >libvirtEventLoop::DEBUG::2014-07-10 09:01:48,641::vm::5176::vm.Vm::(_onLibvirtLifecycleEvent) vmId=`949f6c19-87b5-4f16-a91c-0049749423ea`::event Started detail 0 opaque None >Thread-52::DEBUG::2014-07-10 09:01:48,674::vm::5032::vm.Vm::(_getUnderlyingDriveInfo) vmId=`949f6c19-87b5-4f16-a91c-0049749423ea`::Looking for drive with attributes {'name': u'hdc', 'bootOrder': '', 'boot': [], 'readonly': True, 'address': {u'bus': u'1', u'controller': u'0', u'type': u'drive', u'target': u'0', u'unit': u'0'}, 'path': '', 'type': u'cdrom'} >Thread-52::DEBUG::2014-07-10 09:01:48,675::vm::5053::vm.Vm::(_getUnderlyingDriveInfo) vmId=`949f6c19-87b5-4f16-a91c-0049749423ea`::Matched {'name': (u'hdc', u'hdc'), 'bootOrder': ('', None), 'boot': ([], None), 'readonly': (True, True), 'address': ({u'bus': u'1', u'controller': u'0', u'type': u'drive', u'target': u'0', u'unit': u'0'}, {u'bus': u'1', u'controller': u'0', u'type': u'drive', u'target': u'0', u'unit': u'0'}), 'path': ('', ''), 'type': (u'cdrom', u'cdrom')} >Thread-52::DEBUG::2014-07-10 09:01:48,675::vm::5072::vm.Vm::(_getUnderlyingDriveInfo) vmId=`949f6c19-87b5-4f16-a91c-0049749423ea`::Matched {'name': (u'hdc', u'hdc'), 'bootOrder': ('', None), 'boot': ([], None), 'readonly': (True, 'True'), 'address': ({u'bus': u'1', u'controller': u'0', u'type': u'drive', u'target': u'0', u'unit': u'0'}, {u'bus': u'1', u'controller': u'0', u'type': u'drive', u'target': u'0', u'unit': u'0'}), 'path': ('', ''), 'type': (u'cdrom', 'disk')} >Thread-52::DEBUG::2014-07-10 09:01:48,676::vm::5032::vm.Vm::(_getUnderlyingDriveInfo) vmId=`949f6c19-87b5-4f16-a91c-0049749423ea`::Looking for drive with attributes {'name': u'hdd', 'bootOrder': '', 'boot': [], 'readonly': True, 'address': {u'bus': u'1', u'controller': u'0', u'type': u'drive', u'target': u'0', u'unit': u'1'}, 'path': u'/var/run/vdsm/payload/949f6c19-87b5-4f16-a91c-0049749423ea.77a2e25a207d72bb98c33c5375b167bf.img', 'type': u'cdrom'} >Thread-52::DEBUG::2014-07-10 09:01:48,676::vm::5053::vm.Vm::(_getUnderlyingDriveInfo) vmId=`949f6c19-87b5-4f16-a91c-0049749423ea`::Matched {'name': (u'hdd', u'hdd'), 'bootOrder': ('', None), 'boot': ([], None), 'readonly': (True, True), 'address': ({u'bus': u'1', u'controller': u'0', u'type': u'drive', u'target': u'0', u'unit': u'1'}, {u'bus': u'1', u'controller': u'0', u'type': u'drive', u'target': u'0', u'unit': u'1'}), 'path': (u'/var/run/vdsm/payload/949f6c19-87b5-4f16-a91c-0049749423ea.77a2e25a207d72bb98c33c5375b167bf.img', '/var/run/vdsm/payload/949f6c19-87b5-4f16-a91c-0049749423ea.77a2e25a207d72bb98c33c5375b167bf.img'), 'type': (u'cdrom', u'cdrom')} >Thread-52::DEBUG::2014-07-10 09:01:48,676::vm::5072::vm.Vm::(_getUnderlyingDriveInfo) vmId=`949f6c19-87b5-4f16-a91c-0049749423ea`::Matched {'name': (u'hdd', u'hdd'), 'bootOrder': ('', None), 'boot': ([], None), 'readonly': (True, 'True'), 'address': ({u'bus': u'1', u'controller': u'0', u'type': u'drive', u'target': u'0', u'unit': u'1'}, {u'bus': u'1', u'controller': u'0', u'type': u'drive', u'target': u'0', u'unit': u'1'}), 'path': (u'/var/run/vdsm/payload/949f6c19-87b5-4f16-a91c-0049749423ea.77a2e25a207d72bb98c33c5375b167bf.img', '/var/run/vdsm/payload/949f6c19-87b5-4f16-a91c-0049749423ea.77a2e25a207d72bb98c33c5375b167bf.img'), 'type': (u'cdrom', 'disk')} >Thread-52::DEBUG::2014-07-10 09:01:48,677::vm::5032::vm.Vm::(_getUnderlyingDriveInfo) vmId=`949f6c19-87b5-4f16-a91c-0049749423ea`::Looking for drive with attributes {'name': u'vda', 'bootOrder': u'1', 'boot': [<DOM Element: boot at 0x7f61b4041f80>], 'readonly': False, 'address': {u'slot': u'0x06', u'bus': u'0x00', u'domain': u'0x0000', u'type': u'pci', u'function': u'0x0'}, 'path': u'/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/images/28408446-e5fd-4565-a976-e760951593fe/776303a2-5585-451e-826e-0e338d4a1e98', 'type': u'disk'} >Thread-52::DEBUG::2014-07-10 09:01:48,677::vm::5053::vm.Vm::(_getUnderlyingDriveInfo) vmId=`949f6c19-87b5-4f16-a91c-0049749423ea`::Matched {'name': (u'vda', u'vda'), 'bootOrder': (u'1', u'1'), 'boot': ([<DOM Element: boot at 0x7f61b4041f80>], None), 'readonly': (False, False), 'address': ({u'slot': u'0x06', u'bus': u'0x00', u'domain': u'0x0000', u'type': u'pci', u'function': u'0x0'}, {u'slot': u'0x06', u'bus': u'0x00', u'domain': u'0x0000', u'type': u'pci', u'function': u'0x0'}), 'path': (u'/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/images/28408446-e5fd-4565-a976-e760951593fe/776303a2-5585-451e-826e-0e338d4a1e98', '/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/images/28408446-e5fd-4565-a976-e760951593fe/776303a2-5585-451e-826e-0e338d4a1e98'), 'type': (u'disk', u'disk')} >Thread-52::DEBUG::2014-07-10 09:01:48,677::vm::5072::vm.Vm::(_getUnderlyingDriveInfo) vmId=`949f6c19-87b5-4f16-a91c-0049749423ea`::Matched {'name': (u'vda', u'vda'), 'bootOrder': (u'1', u'1'), 'boot': ([<DOM Element: boot at 0x7f61b4041f80>], None), 'readonly': (False, 'False'), 'address': ({u'slot': u'0x06', u'bus': u'0x00', u'domain': u'0x0000', u'type': u'pci', u'function': u'0x0'}, {u'slot': u'0x06', u'bus': u'0x00', u'domain': u'0x0000', u'type': u'pci', u'function': u'0x0'}), 'path': (u'/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/images/28408446-e5fd-4565-a976-e760951593fe/776303a2-5585-451e-826e-0e338d4a1e98', '/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/images/28408446-e5fd-4565-a976-e760951593fe/776303a2-5585-451e-826e-0e338d4a1e98'), 'type': (u'disk', 'disk')} >VM Channels Listener::DEBUG::2014-07-10 09:01:48,718::guestIF::274::vm.Vm::(_handleMessage) vmId=`ed909f7e-0ee2-4f6f-b4a5-a165f689a276`::username: u'None' >Thread-52::DEBUG::2014-07-10 09:01:48,754::sampling::285::vm.Vm::(start) vmId=`949f6c19-87b5-4f16-a91c-0049749423ea`::Start statistics collection >Thread-54::DEBUG::2014-07-10 09:01:48,756::sampling::314::vm.Vm::(run) vmId=`949f6c19-87b5-4f16-a91c-0049749423ea`::Stats thread started >Thread-52::DEBUG::2014-07-10 09:01:48,762::vmChannels::198::vds::(register) Add fileno 62 to listener's channels. >Thread-54::DEBUG::2014-07-10 09:01:48,764::task::595::TaskManager.Task::(_updateState) Task=`86079e10-0da4-4df9-9c19-d708b42e87f1`::moving from state init -> state preparing >Thread-54::INFO::2014-07-10 09:01:48,765::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='28408446-e5fd-4565-a976-e760951593fe', volUUID='776303a2-5585-451e-826e-0e338d4a1e98', options=None) >Thread-54::INFO::2014-07-10 09:01:48,767::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-54::DEBUG::2014-07-10 09:01:48,768::task::1185::TaskManager.Task::(prepare) Task=`86079e10-0da4-4df9-9c19-d708b42e87f1`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-54::DEBUG::2014-07-10 09:01:48,768::task::595::TaskManager.Task::(_updateState) Task=`86079e10-0da4-4df9-9c19-d708b42e87f1`::moving from state preparing -> state finished >Thread-54::DEBUG::2014-07-10 09:01:48,768::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-54::DEBUG::2014-07-10 09:01:48,768::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-54::DEBUG::2014-07-10 09:01:48,768::task::990::TaskManager.Task::(_decref) Task=`86079e10-0da4-4df9-9c19-d708b42e87f1`::ref 0 aborting False >Thread-52::WARNING::2014-07-10 09:01:48,765::vm::3715::vm.Vm::(_readPauseCode) vmId=`949f6c19-87b5-4f16-a91c-0049749423ea`::_readPauseCode unsupported by libvirt vm >Thread-52::DEBUG::2014-07-10 09:01:48,786::vm::2291::vm.Vm::(_startUnderlyingVm) vmId=`949f6c19-87b5-4f16-a91c-0049749423ea`::_ongoingCreations released >VM Channels Listener::DEBUG::2014-07-10 09:01:48,938::vmChannels::106::vds::(_do_add_channels) fileno 62 was added to unconnected channels. >VM Channels Listener::DEBUG::2014-07-10 09:01:48,939::vmChannels::132::vds::(_handle_unconnected) Trying to connect fileno 62. >VM Channels Listener::DEBUG::2014-07-10 09:01:48,939::guestIF::194::vm.Vm::(_connect) vmId=`949f6c19-87b5-4f16-a91c-0049749423ea`::Attempting connection to /var/lib/libvirt/qemu/channels/949f6c19-87b5-4f16-a91c-0049749423ea.com.redhat.rhevm.vdsm >VM Channels Listener::DEBUG::2014-07-10 09:01:48,940::guestIF::197::vm.Vm::(_connect) vmId=`949f6c19-87b5-4f16-a91c-0049749423ea`::Connected to /var/lib/libvirt/qemu/channels/949f6c19-87b5-4f16-a91c-0049749423ea.com.redhat.rhevm.vdsm >VM Channels Listener::DEBUG::2014-07-10 09:01:48,940::vmChannels::148::vds::(_handle_unconnected) Connecting to fileno 62 succeeded. >Dummy-33::DEBUG::2014-07-10 09:01:49,137::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:01:49,238::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0469687 s, 21.8 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 09:01:50,608::BindingXMLRPC::1067::vds::(wrapper) client [10.35.3.13]::call vmGetStats with ('52e238aa-e62a-48a8-a200-604e72422f3f',) {} flowID [72f5e52c] >Thread-14::DEBUG::2014-07-10 09:01:50,610::vm::676::vm.Vm::(_getDiskStats) vmId=`52e238aa-e62a-48a8-a200-604e72422f3f`::Disk hdd stats not available >Thread-14::DEBUG::2014-07-10 09:01:50,610::vm::676::vm.Vm::(_getDiskStats) vmId=`52e238aa-e62a-48a8-a200-604e72422f3f`::Disk hdc stats not available >Thread-14::DEBUG::2014-07-10 09:01:50,610::vm::676::vm.Vm::(_getDiskStats) vmId=`52e238aa-e62a-48a8-a200-604e72422f3f`::Disk vda stats not available >Thread-14::DEBUG::2014-07-10 09:01:50,611::vm::715::vm.Vm::(_getDiskLatency) vmId=`52e238aa-e62a-48a8-a200-604e72422f3f`::Disk hdd latency not available >Thread-14::DEBUG::2014-07-10 09:01:50,611::vm::715::vm.Vm::(_getDiskLatency) vmId=`52e238aa-e62a-48a8-a200-604e72422f3f`::Disk hdc latency not available >Thread-14::DEBUG::2014-07-10 09:01:50,611::vm::715::vm.Vm::(_getDiskLatency) vmId=`52e238aa-e62a-48a8-a200-604e72422f3f`::Disk vda latency not available >Thread-14::DEBUG::2014-07-10 09:01:50,612::BindingXMLRPC::1074::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Powering up', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '12236', 'displayIp': '0', 'displayPort': u'5902', 'session': 'Unknown', 'displaySecurePort': u'5903', 'timeOffset': '0', 'hash': '-5500930374920933700', 'balloonInfo': {'balloon_max': '1048576', 'balloon_target': '1048576', 'balloon_cur': '1048576', 'balloon_min': '1048576'}, 'pauseCode': 'NOERR', 'clientIp': '', 'kvmEnable': 'true', 'network': {u'vnet1': {'macAddr': '00:1a:4a:de:6d:7b', 'rxDropped': '0', 'rxErrors': '0', 'txDropped': '0', 'txRate': '0.0', 'rxRate': '0.0', 'txErrors': '0', 'state': 'unknown', 'speed': '1000', 'name': u'vnet1'}}, 'vmId': '52e238aa-e62a-48a8-a200-604e72422f3f', 'displayType': 'qxl', 'cpuUser': '43.94', 'disks': {u'vda': {'truesize': '1073741824', 'apparentsize': '1073741824', 'imageID': '76fdb054-02cd-42ed-9721-b3e65b34c3a4'}, u'hdd': {'truesize': '0', 'apparentsize': '0'}, u'hdc': {'truesize': '0', 'apparentsize': '0'}}, 'monitorResponse': '0', 'statsAge': '1.36', 'elapsedTime': '23', 'vmType': 'kvm', 'cpuSys': '23.61', 'guestCPUCount': -1, 'appsList': [], 'guestIPs': ''}]} >Thread-14::DEBUG::2014-07-10 09:01:50,617::BindingXMLRPC::1067::vds::(wrapper) client [10.35.3.13]::call vmGetStats with ('ed909f7e-0ee2-4f6f-b4a5-a165f689a276',) {} flowID [72f5e52c] >Thread-14::DEBUG::2014-07-10 09:01:50,617::vm::676::vm.Vm::(_getDiskStats) vmId=`ed909f7e-0ee2-4f6f-b4a5-a165f689a276`::Disk hdd stats not available >Thread-14::DEBUG::2014-07-10 09:01:50,617::vm::676::vm.Vm::(_getDiskStats) vmId=`ed909f7e-0ee2-4f6f-b4a5-a165f689a276`::Disk hdc stats not available >Thread-14::DEBUG::2014-07-10 09:01:50,618::vm::676::vm.Vm::(_getDiskStats) vmId=`ed909f7e-0ee2-4f6f-b4a5-a165f689a276`::Disk vda stats not available >Thread-14::DEBUG::2014-07-10 09:01:50,618::vm::715::vm.Vm::(_getDiskLatency) vmId=`ed909f7e-0ee2-4f6f-b4a5-a165f689a276`::Disk hdd latency not available >Thread-14::DEBUG::2014-07-10 09:01:50,618::vm::715::vm.Vm::(_getDiskLatency) vmId=`ed909f7e-0ee2-4f6f-b4a5-a165f689a276`::Disk hdc latency not available >Thread-14::DEBUG::2014-07-10 09:01:50,618::vm::715::vm.Vm::(_getDiskLatency) vmId=`ed909f7e-0ee2-4f6f-b4a5-a165f689a276`::Disk vda latency not available >Thread-14::DEBUG::2014-07-10 09:01:50,618::BindingXMLRPC::1074::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'username': u'None', 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': u'localhost.localdomain', 'pid': '11613', 'session': 'Unknown', 'displaySecurePort': u'5901', 'timeOffset': '0', 'balloonInfo': {'balloon_max': '1048576', 'balloon_target': '1048576', 'balloon_cur': '1048576', 'balloon_min': '1048576'}, 'pauseCode': 'NOERR', 'disksUsage': [{u'path': u'/', u'total': '4792987648', u'used': '1843052544', u'fs': u'ext4'}, {u'path': u'/boot', u'total': '507744256', u'used': '40272896', u'fs': u'ext4'}, {u'path': u'/home', u'total': '458985472', u'used': '10766336', u'fs': u'ext4'}], 'network': {u'vnet0': {'macAddr': '00:1a:4a:de:6d:7a', 'rxDropped': '0', 'rxErrors': '0', 'txDropped': '0', 'txRate': '0.0', 'rxRate': '0.0', 'txErrors': '0', 'state': 'unknown', 'speed': '1000', 'name': u'vnet0'}}, 'vmType': 'kvm', 'guestName': u'localhost.localdomain', 'elapsedTime': '43', 'memoryStats': {}, 'cpuSys': '3.39', 'appsList': [u'kernel-2.6.32-431.el6', u'rhevm-guest-agent-common-1.0.9-1.el6ev'], 'guestOs': u'2.6.32-431.el6.x86_64', 'displayType': 'qxl', 'status': 'Up', 'hash': '7841224975033595397', 'lastLogin': 1404982908.717828, 'vmId': 'ed909f7e-0ee2-4f6f-b4a5-a165f689a276', 'displayIp': '0', 'displayPort': u'5900', 'clientIp': '', 'kvmEnable': 'true', 'disks': {u'vda': {'truesize': '1073741824', 'apparentsize': '1073741824', 'imageID': '0cd7d6ce-f497-4243-a690-c57744861eea'}, u'hdd': {'truesize': '0', 'apparentsize': '0'}, u'hdc': {'truesize': '0', 'apparentsize': '0'}}, 'monitorResponse': '0', 'statsAge': '1.04', 'cpuUser': '47.19', 'guestCPUCount': -1, 'guestIPs': u'10.35.17.73', 'netIfaces': [{u'hw': u'00:1a:4a:de:6d:7a', u'name': u'eth0', u'inet': [u'10.35.17.73'], u'inet6': [u'fe80::21a:4aff:fede:6d7a']}]}]} >Thread-14::DEBUG::2014-07-10 09:01:50,626::BindingXMLRPC::1067::vds::(wrapper) client [10.35.3.13]::call vmGetStats with ('949f6c19-87b5-4f16-a91c-0049749423ea',) {} flowID [72f5e52c] >Thread-14::DEBUG::2014-07-10 09:01:50,626::vm::598::vm.Vm::(_getCpuStats) vmId=`949f6c19-87b5-4f16-a91c-0049749423ea`::CPU stats not available: 'NoneType' object is unsubscriptable >Thread-14::DEBUG::2014-07-10 09:01:50,626::vm::654::vm.Vm::(_getNetworkStats) vmId=`949f6c19-87b5-4f16-a91c-0049749423ea`::Network stats not available >Thread-14::DEBUG::2014-07-10 09:01:50,627::vm::676::vm.Vm::(_getDiskStats) vmId=`949f6c19-87b5-4f16-a91c-0049749423ea`::Disk hdd stats not available >Thread-14::DEBUG::2014-07-10 09:01:50,627::vm::676::vm.Vm::(_getDiskStats) vmId=`949f6c19-87b5-4f16-a91c-0049749423ea`::Disk hdc stats not available >Thread-14::DEBUG::2014-07-10 09:01:50,627::vm::676::vm.Vm::(_getDiskStats) vmId=`949f6c19-87b5-4f16-a91c-0049749423ea`::Disk vda stats not available >Thread-14::DEBUG::2014-07-10 09:01:50,627::vm::715::vm.Vm::(_getDiskLatency) vmId=`949f6c19-87b5-4f16-a91c-0049749423ea`::Disk hdd latency not available >Thread-14::DEBUG::2014-07-10 09:01:50,627::vm::715::vm.Vm::(_getDiskLatency) vmId=`949f6c19-87b5-4f16-a91c-0049749423ea`::Disk hdc latency not available >Thread-14::DEBUG::2014-07-10 09:01:50,628::vm::715::vm.Vm::(_getDiskLatency) vmId=`949f6c19-87b5-4f16-a91c-0049749423ea`::Disk vda latency not available >Thread-14::DEBUG::2014-07-10 09:01:50,628::BindingXMLRPC::1074::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Powering up', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '12860', 'displayIp': '0', 'displayPort': u'5904', 'session': 'Unknown', 'displaySecurePort': u'5905', 'timeOffset': '0', 'hash': '-1803473594666319662', 'balloonInfo': {'balloon_max': '1048576', 'balloon_target': '1048576', 'balloon_cur': '0', 'balloon_min': '1048576'}, 'pauseCode': 'NOERR', 'clientIp': '', 'kvmEnable': 'true', 'network': {u'vnet2': {'state': 'unknown', 'macAddr': '00:1a:4a:de:6d:7e', 'speed': '1000', 'name': u'vnet2'}}, 'vmId': '949f6c19-87b5-4f16-a91c-0049749423ea', 'displayType': 'qxl', 'cpuUser': '0.00', 'disks': {u'vda': {'truesize': '1073741824', 'apparentsize': '1073741824', 'imageID': '28408446-e5fd-4565-a976-e760951593fe'}, u'hdd': {'truesize': '0', 'apparentsize': '0'}, u'hdc': {'truesize': '0', 'apparentsize': '0'}}, 'monitorResponse': '0', 'statsAge': '1.87', 'elapsedTime': '4', 'vmType': 'kvm', 'cpuSys': '0.00', 'guestCPUCount': -1, 'appsList': [], 'guestIPs': ''}]} >Thread-34::DEBUG::2014-07-10 09:01:50,874::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [50ce8598] >Thread-34::DEBUG::2014-07-10 09:01:50,875::task::595::TaskManager.Task::(_updateState) Task=`459f9833-5455-4a84-a83e-98aead3d52c9`::moving from state init -> state preparing >Thread-34::INFO::2014-07-10 09:01:50,876::logUtils::44::dispatcher::(wrapper) Run and protect: createVolume(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='b6f6c0da-e67f-4902-b9ac-3069571a42fe', size='10737418240', volFormat=4, preallocate=2, diskType=2, volUUID='c4cd1da8-05b7-45e0-80b1-1183d21443d9', desc='', srcImgUUID='9cf413b7-7f14-4a61-8c71-913e5b0ea9c0', srcVolUUID='47592965-e853-4e59-9728-d11cca6a7a8a') >Thread-34::DEBUG::2014-07-10 09:01:50,876::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.9e1aa540-1f4e-4ee3-a152-be381ef6c3bd`ReqID=`4055f042-5175-4c84-aab3-3f657721393d`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '1464' at 'createVolume' >Thread-34::DEBUG::2014-07-10 09:01:50,877::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.9e1aa540-1f4e-4ee3-a152-be381ef6c3bd' for lock type 'shared' >Thread-34::DEBUG::2014-07-10 09:01:50,877::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.9e1aa540-1f4e-4ee3-a152-be381ef6c3bd' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-10 09:01:50,877::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.9e1aa540-1f4e-4ee3-a152-be381ef6c3bd`ReqID=`4055f042-5175-4c84-aab3-3f657721393d`::Granted request >Thread-34::DEBUG::2014-07-10 09:01:50,878::task::827::TaskManager.Task::(resourceAcquired) Task=`459f9833-5455-4a84-a83e-98aead3d52c9`::_resourcesAcquired: Storage.9e1aa540-1f4e-4ee3-a152-be381ef6c3bd (shared) >Thread-34::DEBUG::2014-07-10 09:01:50,878::task::990::TaskManager.Task::(_decref) Task=`459f9833-5455-4a84-a83e-98aead3d52c9`::ref 1 aborting False >Thread-34::DEBUG::2014-07-10 09:01:50,879::task::752::TaskManager.Task::(_save) Task=`459f9833-5455-4a84-a83e-98aead3d52c9`::_save: orig /rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/master/tasks/459f9833-5455-4a84-a83e-98aead3d52c9 temp /rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/master/tasks/459f9833-5455-4a84-a83e-98aead3d52c9.temp >Thread-34::DEBUG::2014-07-10 09:01:50,886::taskManager::68::TaskManager::(scheduleJob) scheduled job createVolume for task 459f9833-5455-4a84-a83e-98aead3d52c9 >Thread-34::INFO::2014-07-10 09:01:50,886::logUtils::47::dispatcher::(wrapper) Run and protect: createVolume, Return response: None >Thread-34::DEBUG::2014-07-10 09:01:50,886::task::1180::TaskManager.Task::(prepare) Task=`459f9833-5455-4a84-a83e-98aead3d52c9`::Prepare: 1 jobs exist, move to acquiring >Thread-34::DEBUG::2014-07-10 09:01:50,887::task::595::TaskManager.Task::(_updateState) Task=`459f9833-5455-4a84-a83e-98aead3d52c9`::moving from state preparing -> state acquiring >Thread-34::DEBUG::2014-07-10 09:01:50,887::task::752::TaskManager.Task::(_save) Task=`459f9833-5455-4a84-a83e-98aead3d52c9`::_save: orig /rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/master/tasks/459f9833-5455-4a84-a83e-98aead3d52c9 temp /rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/master/tasks/459f9833-5455-4a84-a83e-98aead3d52c9.temp >Thread-34::DEBUG::2014-07-10 09:01:50,894::task::595::TaskManager.Task::(_updateState) Task=`459f9833-5455-4a84-a83e-98aead3d52c9`::moving from state acquiring -> state queued >Thread-34::DEBUG::2014-07-10 09:01:50,894::task::752::TaskManager.Task::(_save) Task=`459f9833-5455-4a84-a83e-98aead3d52c9`::_save: orig /rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/master/tasks/459f9833-5455-4a84-a83e-98aead3d52c9 temp /rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/master/tasks/459f9833-5455-4a84-a83e-98aead3d52c9.temp >Thread-34::DEBUG::2014-07-10 09:01:50,900::taskManager::50::TaskManager::(_queueTask) queuing task: 459f9833-5455-4a84-a83e-98aead3d52c9 >Thread-34::DEBUG::2014-07-10 09:01:50,900::taskManager::56::TaskManager::(_queueTask) task queued: 459f9833-5455-4a84-a83e-98aead3d52c9 >Thread-34::DEBUG::2014-07-10 09:01:50,900::task::1182::TaskManager.Task::(prepare) Task=`459f9833-5455-4a84-a83e-98aead3d52c9`::returning >Thread-1::DEBUG::2014-07-10 09:01:50,900::threadPool::57::Misc.ThreadPool::(setRunningTask) Number of running tasks: 1 >Thread-34::DEBUG::2014-07-10 09:01:50,901::task::990::TaskManager.Task::(_decref) Task=`459f9833-5455-4a84-a83e-98aead3d52c9`::ref 0 aborting False >459f9833-5455-4a84-a83e-98aead3d52c9::DEBUG::2014-07-10 09:01:50,901::threadPool::200::Misc.ThreadPool.WorkerThread::(_processNextTask) Task: 459f9833-5455-4a84-a83e-98aead3d52c9 running: <bound method Task.commit of <storage.task.Task instance at 0x7f621c3ea998>> with: None >459f9833-5455-4a84-a83e-98aead3d52c9::DEBUG::2014-07-10 09:01:50,901::task::1194::TaskManager.Task::(commit) Task=`459f9833-5455-4a84-a83e-98aead3d52c9`::committing task: 459f9833-5455-4a84-a83e-98aead3d52c9 >459f9833-5455-4a84-a83e-98aead3d52c9::DEBUG::2014-07-10 09:01:50,902::task::595::TaskManager.Task::(_updateState) Task=`459f9833-5455-4a84-a83e-98aead3d52c9`::moving from state queued -> state running >459f9833-5455-4a84-a83e-98aead3d52c9::DEBUG::2014-07-10 09:01:50,902::task::752::TaskManager.Task::(_save) Task=`459f9833-5455-4a84-a83e-98aead3d52c9`::_save: orig /rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/master/tasks/459f9833-5455-4a84-a83e-98aead3d52c9 temp /rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/master/tasks/459f9833-5455-4a84-a83e-98aead3d52c9.temp >459f9833-5455-4a84-a83e-98aead3d52c9::DEBUG::2014-07-10 09:01:50,910::task::905::TaskManager.Task::(_runJobs) Task=`459f9833-5455-4a84-a83e-98aead3d52c9`::Task.run: running job 0: createVolume: <bound method StoragePool.createVolume of <storage.sp.StoragePool object at 0x7f62180b9dd0>> (args: ('9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'b6f6c0da-e67f-4902-b9ac-3069571a42fe', 20971520, 4, 2, 2, 'c4cd1da8-05b7-45e0-80b1-1183d21443d9', '', '9cf413b7-7f14-4a61-8c71-913e5b0ea9c0', '47592965-e853-4e59-9728-d11cca6a7a8a') kwargs: {}) >459f9833-5455-4a84-a83e-98aead3d52c9::DEBUG::2014-07-10 09:01:50,910::task::331::TaskManager.Task::(run) Task=`459f9833-5455-4a84-a83e-98aead3d52c9`::Job.run: running createVolume: <bound method StoragePool.createVolume of <storage.sp.StoragePool object at 0x7f62180b9dd0>> (args: ('9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'b6f6c0da-e67f-4902-b9ac-3069571a42fe', 20971520, 4, 2, 2, 'c4cd1da8-05b7-45e0-80b1-1183d21443d9', '', '9cf413b7-7f14-4a61-8c71-913e5b0ea9c0', '47592965-e853-4e59-9728-d11cca6a7a8a') kwargs: {}) callback None >459f9833-5455-4a84-a83e-98aead3d52c9::DEBUG::2014-07-10 09:01:50,911::blockVolume::572::Storage.Misc.excCmd::(getMetadata) '/bin/dd iflag=direct skip=4 bs=512 if=/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/metadata count=1' (cwd None) >459f9833-5455-4a84-a83e-98aead3d52c9::DEBUG::2014-07-10 09:01:50,928::blockVolume::572::Storage.Misc.excCmd::(getMetadata) SUCCESS: <err> = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.000538216 s, 951 kB/s\n'; <rc> = 0 >459f9833-5455-4a84-a83e-98aead3d52c9::DEBUG::2014-07-10 09:01:50,929::misc::282::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.000538216 s, 951 kB/s'], size: 512 >459f9833-5455-4a84-a83e-98aead3d52c9::DEBUG::2014-07-10 09:01:50,930::resourceManager::198::ResourceManager.Request::(__init__) ResName=`9e1aa540-1f4e-4ee3-a152-be381ef6c3bd_imageNS.b6f6c0da-e67f-4902-b9ac-3069571a42fe`ReqID=`a992b040-8d03-4816-bf0c-0d827268fb33`::Request was made in '/usr/share/vdsm/storage/sp.py' line '1767' at 'createVolume' >459f9833-5455-4a84-a83e-98aead3d52c9::DEBUG::2014-07-10 09:01:50,930::resourceManager::542::ResourceManager::(registerResource) Trying to register resource '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd_imageNS.b6f6c0da-e67f-4902-b9ac-3069571a42fe' for lock type 'exclusive' >459f9833-5455-4a84-a83e-98aead3d52c9::DEBUG::2014-07-10 09:01:50,931::lvm::427::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' got the operation mutex >459f9833-5455-4a84-a83e-98aead3d52c9::DEBUG::2014-07-10 09:01:50,932::lvm::296::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm lvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/3600601601282300032826addbbdae311|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,vg_name,attr,size,seg_start_pe,devices,tags 9e1aa540-1f4e-4ee3-a152-be381ef6c3bd' (cwd None) >459f9833-5455-4a84-a83e-98aead3d52c9::DEBUG::2014-07-10 09:01:51,149::lvm::296::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >459f9833-5455-4a84-a83e-98aead3d52c9::DEBUG::2014-07-10 09:01:51,160::lvm::462::Storage.LVM::(_reloadlvs) lvs reloaded >459f9833-5455-4a84-a83e-98aead3d52c9::DEBUG::2014-07-10 09:01:51,160::lvm::462::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' released the operation mutex >459f9833-5455-4a84-a83e-98aead3d52c9::DEBUG::2014-07-10 09:01:51,172::resourceFactories::125::Storage.ResourcesFactories::(__getResourceCandidatesList) Image b6f6c0da-e67f-4902-b9ac-3069571a42fe does not exist in domain 9e1aa540-1f4e-4ee3-a152-be381ef6c3bd >459f9833-5455-4a84-a83e-98aead3d52c9::DEBUG::2014-07-10 09:01:51,173::resourceManager::601::ResourceManager::(registerResource) Resource '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd_imageNS.b6f6c0da-e67f-4902-b9ac-3069571a42fe' is free. Now locking as 'exclusive' (1 active user) >459f9833-5455-4a84-a83e-98aead3d52c9::DEBUG::2014-07-10 09:01:51,173::resourceManager::238::ResourceManager.Request::(grant) ResName=`9e1aa540-1f4e-4ee3-a152-be381ef6c3bd_imageNS.b6f6c0da-e67f-4902-b9ac-3069571a42fe`ReqID=`a992b040-8d03-4816-bf0c-0d827268fb33`::Granted request >459f9833-5455-4a84-a83e-98aead3d52c9::INFO::2014-07-10 09:01:51,174::image::123::Storage.Image::(create) Create placeholder /rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/images/b6f6c0da-e67f-4902-b9ac-3069571a42fe for image's volumes >459f9833-5455-4a84-a83e-98aead3d52c9::DEBUG::2014-07-10 09:01:51,175::task::752::TaskManager.Task::(_save) Task=`459f9833-5455-4a84-a83e-98aead3d52c9`::_save: orig /rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/master/tasks/459f9833-5455-4a84-a83e-98aead3d52c9 temp /rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/master/tasks/459f9833-5455-4a84-a83e-98aead3d52c9.temp >459f9833-5455-4a84-a83e-98aead3d52c9::DEBUG::2014-07-10 09:01:51,183::blockVolume::572::Storage.Misc.excCmd::(getMetadata) '/bin/dd iflag=direct skip=4 bs=512 if=/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/metadata count=1' (cwd None) >459f9833-5455-4a84-a83e-98aead3d52c9::DEBUG::2014-07-10 09:01:51,198::blockVolume::572::Storage.Misc.excCmd::(getMetadata) SUCCESS: <err> = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.000459119 s, 1.1 MB/s\n'; <rc> = 0 >459f9833-5455-4a84-a83e-98aead3d52c9::DEBUG::2014-07-10 09:01:51,199::misc::282::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.000459119 s, 1.1 MB/s'], size: 512 >459f9833-5455-4a84-a83e-98aead3d52c9::DEBUG::2014-07-10 09:01:51,199::volume::300::Storage.Volume::(share) Share volume 47592965-e853-4e59-9728-d11cca6a7a8a to /rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/images/b6f6c0da-e67f-4902-b9ac-3069571a42fe >459f9833-5455-4a84-a83e-98aead3d52c9::DEBUG::2014-07-10 09:01:51,199::blockVolume::572::Storage.Misc.excCmd::(getMetadata) '/bin/dd iflag=direct skip=4 bs=512 if=/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/metadata count=1' (cwd None) >459f9833-5455-4a84-a83e-98aead3d52c9::DEBUG::2014-07-10 09:01:51,214::blockVolume::572::Storage.Misc.excCmd::(getMetadata) SUCCESS: <err> = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.000606222 s, 845 kB/s\n'; <rc> = 0 >459f9833-5455-4a84-a83e-98aead3d52c9::DEBUG::2014-07-10 09:01:51,215::misc::282::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.000606222 s, 845 kB/s'], size: 512 >459f9833-5455-4a84-a83e-98aead3d52c9::DEBUG::2014-07-10 09:01:51,216::task::752::TaskManager.Task::(_save) Task=`459f9833-5455-4a84-a83e-98aead3d52c9`::_save: orig /rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/master/tasks/459f9833-5455-4a84-a83e-98aead3d52c9 temp /rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/master/tasks/459f9833-5455-4a84-a83e-98aead3d52c9.temp >459f9833-5455-4a84-a83e-98aead3d52c9::DEBUG::2014-07-10 09:01:51,224::blockVolume::353::Storage.Volume::(_share) Share volume 47592965-e853-4e59-9728-d11cca6a7a8a to /rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/images/b6f6c0da-e67f-4902-b9ac-3069571a42fe >459f9833-5455-4a84-a83e-98aead3d52c9::DEBUG::2014-07-10 09:01:51,225::blockVolume::572::Storage.Misc.excCmd::(getMetadata) '/bin/dd iflag=direct skip=4 bs=512 if=/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/metadata count=1' (cwd None) >459f9833-5455-4a84-a83e-98aead3d52c9::DEBUG::2014-07-10 09:01:51,252::blockVolume::572::Storage.Misc.excCmd::(getMetadata) SUCCESS: <err> = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.0152429 s, 33.6 kB/s\n'; <rc> = 0 >459f9833-5455-4a84-a83e-98aead3d52c9::DEBUG::2014-07-10 09:01:51,252::misc::282::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.0152429 s, 33.6 kB/s'], size: 512 >459f9833-5455-4a84-a83e-98aead3d52c9::INFO::2014-07-10 09:01:51,252::volume::443::Storage.Volume::(create) Creating volume c4cd1da8-05b7-45e0-80b1-1183d21443d9 >Dummy-33::DEBUG::2014-07-10 09:01:51,259::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >459f9833-5455-4a84-a83e-98aead3d52c9::DEBUG::2014-07-10 09:01:51,260::task::752::TaskManager.Task::(_save) Task=`459f9833-5455-4a84-a83e-98aead3d52c9`::_save: orig /rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/master/tasks/459f9833-5455-4a84-a83e-98aead3d52c9 temp /rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/master/tasks/459f9833-5455-4a84-a83e-98aead3d52c9.temp >459f9833-5455-4a84-a83e-98aead3d52c9::DEBUG::2014-07-10 09:01:51,341::task::752::TaskManager.Task::(_save) Task=`459f9833-5455-4a84-a83e-98aead3d52c9`::_save: orig /rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/master/tasks/459f9833-5455-4a84-a83e-98aead3d52c9 temp /rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/master/tasks/459f9833-5455-4a84-a83e-98aead3d52c9.temp >459f9833-5455-4a84-a83e-98aead3d52c9::DEBUG::2014-07-10 09:01:51,412::lvm::296::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm lvcreate --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/3600601601282300032826addbbdae311|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } " --autobackup n --contiguous n --size 1024m --addtag OVIRT_VOL_INITIALIZING --name c4cd1da8-05b7-45e0-80b1-1183d21443d9 9e1aa540-1f4e-4ee3-a152-be381ef6c3bd' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:01:51,486::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.16922 s, 6.1 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 09:01:51,642::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-14::DEBUG::2014-07-10 09:01:51,645::task::595::TaskManager.Task::(_updateState) Task=`6920bcbd-30f9-44c7-bf57-84a0750241d7`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 09:01:51,647::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-14::INFO::2014-07-10 09:01:51,648::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:01:51,648::task::1185::TaskManager.Task::(prepare) Task=`6920bcbd-30f9-44c7-bf57-84a0750241d7`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:01:51,649::task::595::TaskManager.Task::(_updateState) Task=`6920bcbd-30f9-44c7-bf57-84a0750241d7`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 09:01:51,649::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 09:01:51,650::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 09:01:51,650::task::990::TaskManager.Task::(_decref) Task=`6920bcbd-30f9-44c7-bf57-84a0750241d7`::ref 0 aborting False >Thread-34::DEBUG::2014-07-10 09:01:51,655::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-34::DEBUG::2014-07-10 09:01:51,655::task::595::TaskManager.Task::(_updateState) Task=`288cafe8-cea6-4951-b852-2661e1153a9a`::moving from state init -> state preparing >Thread-34::INFO::2014-07-10 09:01:51,656::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-34::DEBUG::2014-07-10 09:01:51,657::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`682bb15c-3340-4e49-b959-e56062041356`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-10 09:01:51,657::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' for lock type 'shared' >Thread-34::DEBUG::2014-07-10 09:01:51,658::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-10 09:01:51,658::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`682bb15c-3340-4e49-b959-e56062041356`::Granted request >Thread-34::DEBUG::2014-07-10 09:01:51,658::task::827::TaskManager.Task::(resourceAcquired) Task=`288cafe8-cea6-4951-b852-2661e1153a9a`::_resourcesAcquired: Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee (shared) >Thread-34::DEBUG::2014-07-10 09:01:51,658::task::990::TaskManager.Task::(_decref) Task=`288cafe8-cea6-4951-b852-2661e1153a9a`::ref 1 aborting False >Thread-34::INFO::2014-07-10 09:01:51,660::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1080989581312', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532069482496', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:01:51,660::task::1185::TaskManager.Task::(prepare) Task=`288cafe8-cea6-4951-b852-2661e1153a9a`::finished: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1080989581312', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532069482496', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:01:51,660::task::595::TaskManager.Task::(_updateState) Task=`288cafe8-cea6-4951-b852-2661e1153a9a`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-10 09:01:51,660::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee': < ResourceRef 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-10 09:01:51,661::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-10 09:01:51,661::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' >Thread-34::DEBUG::2014-07-10 09:01:51,661::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' (0 active users) >Thread-34::DEBUG::2014-07-10 09:01:51,661::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-10 09:01:51,661::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', Clearing records. >Thread-34::DEBUG::2014-07-10 09:01:51,662::task::990::TaskManager.Task::(_decref) Task=`288cafe8-cea6-4951-b852-2661e1153a9a`::ref 0 aborting False >459f9833-5455-4a84-a83e-98aead3d52c9::DEBUG::2014-07-10 09:01:51,867::lvm::296::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ' WARNING: This metadata update is NOT backed up\n WARNING: This metadata update is NOT backed up\n'; <rc> = 0 >459f9833-5455-4a84-a83e-98aead3d52c9::DEBUG::2014-07-10 09:01:51,867::lvm::503::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >459f9833-5455-4a84-a83e-98aead3d52c9::DEBUG::2014-07-10 09:01:51,868::lvm::505::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >459f9833-5455-4a84-a83e-98aead3d52c9::DEBUG::2014-07-10 09:01:51,868::lvm::513::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >459f9833-5455-4a84-a83e-98aead3d52c9::DEBUG::2014-07-10 09:01:51,868::lvm::525::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >459f9833-5455-4a84-a83e-98aead3d52c9::WARNING::2014-07-10 09:01:51,869::utils::129::root::(rmFile) File: /rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/images/b6f6c0da-e67f-4902-b9ac-3069571a42fe/c4cd1da8-05b7-45e0-80b1-1183d21443d9 already removed >459f9833-5455-4a84-a83e-98aead3d52c9::INFO::2014-07-10 09:01:51,869::blockVolume::169::Storage.Volume::(_create) Request to create snapshot b6f6c0da-e67f-4902-b9ac-3069571a42fe/c4cd1da8-05b7-45e0-80b1-1183d21443d9 of volume 9cf413b7-7f14-4a61-8c71-913e5b0ea9c0/47592965-e853-4e59-9728-d11cca6a7a8a >459f9833-5455-4a84-a83e-98aead3d52c9::DEBUG::2014-07-10 09:01:51,875::task::752::TaskManager.Task::(_save) Task=`459f9833-5455-4a84-a83e-98aead3d52c9`::_save: orig /rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/master/tasks/459f9833-5455-4a84-a83e-98aead3d52c9 temp /rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/master/tasks/459f9833-5455-4a84-a83e-98aead3d52c9.temp >459f9833-5455-4a84-a83e-98aead3d52c9::DEBUG::2014-07-10 09:01:51,886::blockVolume::572::Storage.Misc.excCmd::(getMetadata) '/bin/dd iflag=direct skip=4 bs=512 if=/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/metadata count=1' (cwd None) >459f9833-5455-4a84-a83e-98aead3d52c9::DEBUG::2014-07-10 09:01:51,902::blockVolume::572::Storage.Misc.excCmd::(getMetadata) SUCCESS: <err> = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.000445548 s, 1.1 MB/s\n'; <rc> = 0 >459f9833-5455-4a84-a83e-98aead3d52c9::DEBUG::2014-07-10 09:01:51,903::misc::282::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.000445548 s, 1.1 MB/s'], size: 512 >459f9833-5455-4a84-a83e-98aead3d52c9::INFO::2014-07-10 09:01:51,903::volume::789::Storage.Volume::(prepare) Volume: preparing volume 9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/47592965-e853-4e59-9728-d11cca6a7a8a >459f9833-5455-4a84-a83e-98aead3d52c9::DEBUG::2014-07-10 09:01:51,904::blockVolume::572::Storage.Misc.excCmd::(getMetadata) '/bin/dd iflag=direct skip=4 bs=512 if=/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/metadata count=1' (cwd None) >459f9833-5455-4a84-a83e-98aead3d52c9::DEBUG::2014-07-10 09:01:51,916::blockVolume::572::Storage.Misc.excCmd::(getMetadata) SUCCESS: <err> = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.00040498 s, 1.3 MB/s\n'; <rc> = 0 >459f9833-5455-4a84-a83e-98aead3d52c9::DEBUG::2014-07-10 09:01:51,917::misc::282::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.00040498 s, 1.3 MB/s'], size: 512 >459f9833-5455-4a84-a83e-98aead3d52c9::DEBUG::2014-07-10 09:01:51,918::resourceManager::198::ResourceManager.Request::(__init__) ResName=`9e1aa540-1f4e-4ee3-a152-be381ef6c3bd_lvmActivationNS.47592965-e853-4e59-9728-d11cca6a7a8a`ReqID=`bdd25f86-00fe-4762-a2a2-3a6d80d04af3`::Request was made in '/usr/share/vdsm/storage/volume.py' line '806' at 'prepare' >459f9833-5455-4a84-a83e-98aead3d52c9::DEBUG::2014-07-10 09:01:51,918::resourceManager::542::ResourceManager::(registerResource) Trying to register resource '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd_lvmActivationNS.47592965-e853-4e59-9728-d11cca6a7a8a' for lock type 'shared' >459f9833-5455-4a84-a83e-98aead3d52c9::DEBUG::2014-07-10 09:01:51,918::resourceManager::601::ResourceManager::(registerResource) Resource '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd_lvmActivationNS.47592965-e853-4e59-9728-d11cca6a7a8a' is free. Now locking as 'shared' (1 active user) >459f9833-5455-4a84-a83e-98aead3d52c9::DEBUG::2014-07-10 09:01:51,918::resourceManager::238::ResourceManager.Request::(grant) ResName=`9e1aa540-1f4e-4ee3-a152-be381ef6c3bd_lvmActivationNS.47592965-e853-4e59-9728-d11cca6a7a8a`ReqID=`bdd25f86-00fe-4762-a2a2-3a6d80d04af3`::Granted request >459f9833-5455-4a84-a83e-98aead3d52c9::DEBUG::2014-07-10 09:01:51,919::blockVolume::572::Storage.Misc.excCmd::(getMetadata) '/bin/dd iflag=direct skip=4 bs=512 if=/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/metadata count=1' (cwd None) >459f9833-5455-4a84-a83e-98aead3d52c9::DEBUG::2014-07-10 09:01:51,937::blockVolume::572::Storage.Misc.excCmd::(getMetadata) SUCCESS: <err> = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.000509812 s, 1.0 MB/s\n'; <rc> = 0 >459f9833-5455-4a84-a83e-98aead3d52c9::DEBUG::2014-07-10 09:01:51,938::misc::282::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.000509812 s, 1.0 MB/s'], size: 512 >459f9833-5455-4a84-a83e-98aead3d52c9::DEBUG::2014-07-10 09:01:51,938::volume::270::Storage.Volume::(clone) Volume.clone: /rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/images/b6f6c0da-e67f-4902-b9ac-3069571a42fe/47592965-e853-4e59-9728-d11cca6a7a8a to /rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/images/b6f6c0da-e67f-4902-b9ac-3069571a42fe/c4cd1da8-05b7-45e0-80b1-1183d21443d9 >459f9833-5455-4a84-a83e-98aead3d52c9::DEBUG::2014-07-10 09:01:51,939::blockVolume::572::Storage.Misc.excCmd::(getMetadata) '/bin/dd iflag=direct skip=4 bs=512 if=/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/metadata count=1' (cwd None) >459f9833-5455-4a84-a83e-98aead3d52c9::DEBUG::2014-07-10 09:01:51,953::blockVolume::572::Storage.Misc.excCmd::(getMetadata) SUCCESS: <err> = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.000562606 s, 910 kB/s\n'; <rc> = 0 >459f9833-5455-4a84-a83e-98aead3d52c9::DEBUG::2014-07-10 09:01:51,954::misc::282::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.000562606 s, 910 kB/s'], size: 512 >459f9833-5455-4a84-a83e-98aead3d52c9::DEBUG::2014-07-10 09:01:51,955::blockVolume::572::Storage.Misc.excCmd::(getMetadata) '/bin/dd iflag=direct skip=4 bs=512 if=/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/metadata count=1' (cwd None) >459f9833-5455-4a84-a83e-98aead3d52c9::DEBUG::2014-07-10 09:01:51,965::blockVolume::572::Storage.Misc.excCmd::(getMetadata) SUCCESS: <err> = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.000357525 s, 1.4 MB/s\n'; <rc> = 0 >459f9833-5455-4a84-a83e-98aead3d52c9::DEBUG::2014-07-10 09:01:51,966::misc::282::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.000357525 s, 1.4 MB/s'], size: 512 >459f9833-5455-4a84-a83e-98aead3d52c9::DEBUG::2014-07-10 09:01:51,966::volume::1042::Storage.Misc.excCmd::(createVolume) '/usr/bin/qemu-img create -f qcow2 -F raw -b ../b6f6c0da-e67f-4902-b9ac-3069571a42fe/47592965-e853-4e59-9728-d11cca6a7a8a /rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/images/b6f6c0da-e67f-4902-b9ac-3069571a42fe/c4cd1da8-05b7-45e0-80b1-1183d21443d9' (cwd /rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/images/b6f6c0da-e67f-4902-b9ac-3069571a42fe) >459f9833-5455-4a84-a83e-98aead3d52c9::DEBUG::2014-07-10 09:01:52,048::volume::1042::Storage.Misc.excCmd::(createVolume) SUCCESS: <err> = ''; <rc> = 0 >459f9833-5455-4a84-a83e-98aead3d52c9::INFO::2014-07-10 09:01:52,049::blockVolume::393::Storage.Volume::(teardown) Tearing down volume 9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/47592965-e853-4e59-9728-d11cca6a7a8a justme False >459f9833-5455-4a84-a83e-98aead3d52c9::DEBUG::2014-07-10 09:01:52,049::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd_lvmActivationNS.47592965-e853-4e59-9728-d11cca6a7a8a' >459f9833-5455-4a84-a83e-98aead3d52c9::DEBUG::2014-07-10 09:01:52,049::resourceManager::635::ResourceManager::(releaseResource) Released resource '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd_lvmActivationNS.47592965-e853-4e59-9728-d11cca6a7a8a' (0 active users) >459f9833-5455-4a84-a83e-98aead3d52c9::DEBUG::2014-07-10 09:01:52,049::resourceManager::641::ResourceManager::(releaseResource) Resource '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd_lvmActivationNS.47592965-e853-4e59-9728-d11cca6a7a8a' is free, finding out if anyone is waiting for it. >459f9833-5455-4a84-a83e-98aead3d52c9::DEBUG::2014-07-10 09:01:52,050::lvm::296::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm lvchange --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/3600601601282300032826addbbdae311|/dev/mapper/360060160f4a030003840ec867ddee311|/dev/mapper/367cad74c2fcba00019e6afd20c781e67|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } " --autobackup n --available n 9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/47592965-e853-4e59-9728-d11cca6a7a8a' (cwd None) >GuestMonitor-scale_3::DEBUG::2014-07-10 09:01:52,806::vm::598::vm.Vm::(_getCpuStats) vmId=`949f6c19-87b5-4f16-a91c-0049749423ea`::CPU stats not available: 'NoneType' object is unsubscriptable >GuestMonitor-scale_3::DEBUG::2014-07-10 09:01:52,806::vm::654::vm.Vm::(_getNetworkStats) vmId=`949f6c19-87b5-4f16-a91c-0049749423ea`::Network stats not available >GuestMonitor-scale_3::DEBUG::2014-07-10 09:01:52,806::vm::676::vm.Vm::(_getDiskStats) vmId=`949f6c19-87b5-4f16-a91c-0049749423ea`::Disk hdd stats not available >GuestMonitor-scale_3::DEBUG::2014-07-10 09:01:52,807::vm::676::vm.Vm::(_getDiskStats) vmId=`949f6c19-87b5-4f16-a91c-0049749423ea`::Disk hdc stats not available >GuestMonitor-scale_3::DEBUG::2014-07-10 09:01:52,807::vm::676::vm.Vm::(_getDiskStats) vmId=`949f6c19-87b5-4f16-a91c-0049749423ea`::Disk vda stats not available >GuestMonitor-scale_3::DEBUG::2014-07-10 09:01:52,807::vm::715::vm.Vm::(_getDiskLatency) vmId=`949f6c19-87b5-4f16-a91c-0049749423ea`::Disk hdd latency not available >GuestMonitor-scale_3::DEBUG::2014-07-10 09:01:52,807::vm::715::vm.Vm::(_getDiskLatency) vmId=`949f6c19-87b5-4f16-a91c-0049749423ea`::Disk hdc latency not available >GuestMonitor-scale_3::DEBUG::2014-07-10 09:01:52,808::vm::715::vm.Vm::(_getDiskLatency) vmId=`949f6c19-87b5-4f16-a91c-0049749423ea`::Disk vda latency not available >GuestMonitor-scale_3::DEBUG::2014-07-10 09:01:52,808::vm::598::vm.Vm::(_getCpuStats) vmId=`949f6c19-87b5-4f16-a91c-0049749423ea`::CPU stats not available: 'NoneType' object is unsubscriptable >GuestMonitor-scale_3::DEBUG::2014-07-10 09:01:52,809::vm::654::vm.Vm::(_getNetworkStats) vmId=`949f6c19-87b5-4f16-a91c-0049749423ea`::Network stats not available >GuestMonitor-scale_3::DEBUG::2014-07-10 09:01:52,809::vm::676::vm.Vm::(_getDiskStats) vmId=`949f6c19-87b5-4f16-a91c-0049749423ea`::Disk hdd stats not available >GuestMonitor-scale_3::DEBUG::2014-07-10 09:01:52,809::vm::676::vm.Vm::(_getDiskStats) vmId=`949f6c19-87b5-4f16-a91c-0049749423ea`::Disk hdc stats not available >GuestMonitor-scale_3::DEBUG::2014-07-10 09:01:52,809::vm::676::vm.Vm::(_getDiskStats) vmId=`949f6c19-87b5-4f16-a91c-0049749423ea`::Disk vda stats not available >GuestMonitor-scale_3::DEBUG::2014-07-10 09:01:52,809::vm::715::vm.Vm::(_getDiskLatency) vmId=`949f6c19-87b5-4f16-a91c-0049749423ea`::Disk hdd latency not available >GuestMonitor-scale_3::DEBUG::2014-07-10 09:01:52,810::vm::715::vm.Vm::(_getDiskLatency) vmId=`949f6c19-87b5-4f16-a91c-0049749423ea`::Disk hdc latency not available >GuestMonitor-scale_3::DEBUG::2014-07-10 09:01:52,810::vm::715::vm.Vm::(_getDiskLatency) vmId=`949f6c19-87b5-4f16-a91c-0049749423ea`::Disk vda latency not available >GuestMonitor-scale_2::DEBUG::2014-07-10 09:01:52,829::vm::676::vm.Vm::(_getDiskStats) vmId=`52e238aa-e62a-48a8-a200-604e72422f3f`::Disk hdd stats not available >GuestMonitor-scale_2::DEBUG::2014-07-10 09:01:52,829::vm::676::vm.Vm::(_getDiskStats) vmId=`52e238aa-e62a-48a8-a200-604e72422f3f`::Disk hdc stats not available >GuestMonitor-scale_2::DEBUG::2014-07-10 09:01:52,829::vm::676::vm.Vm::(_getDiskStats) vmId=`52e238aa-e62a-48a8-a200-604e72422f3f`::Disk vda stats not available >GuestMonitor-scale_2::DEBUG::2014-07-10 09:01:52,829::vm::715::vm.Vm::(_getDiskLatency) vmId=`52e238aa-e62a-48a8-a200-604e72422f3f`::Disk hdd latency not available >GuestMonitor-scale_2::DEBUG::2014-07-10 09:01:52,829::vm::715::vm.Vm::(_getDiskLatency) vmId=`52e238aa-e62a-48a8-a200-604e72422f3f`::Disk hdc latency not available >GuestMonitor-scale_2::DEBUG::2014-07-10 09:01:52,830::vm::715::vm.Vm::(_getDiskLatency) vmId=`52e238aa-e62a-48a8-a200-604e72422f3f`::Disk vda latency not available >GuestMonitor-scale_2::DEBUG::2014-07-10 09:01:52,830::vm::676::vm.Vm::(_getDiskStats) vmId=`52e238aa-e62a-48a8-a200-604e72422f3f`::Disk hdd stats not available >GuestMonitor-scale_2::DEBUG::2014-07-10 09:01:52,830::vm::676::vm.Vm::(_getDiskStats) vmId=`52e238aa-e62a-48a8-a200-604e72422f3f`::Disk hdc stats not available >GuestMonitor-scale_2::DEBUG::2014-07-10 09:01:52,831::vm::676::vm.Vm::(_getDiskStats) vmId=`52e238aa-e62a-48a8-a200-604e72422f3f`::Disk vda stats not available >GuestMonitor-scale_2::DEBUG::2014-07-10 09:01:52,831::vm::715::vm.Vm::(_getDiskLatency) vmId=`52e238aa-e62a-48a8-a200-604e72422f3f`::Disk hdd latency not available >GuestMonitor-scale_2::DEBUG::2014-07-10 09:01:52,831::vm::715::vm.Vm::(_getDiskLatency) vmId=`52e238aa-e62a-48a8-a200-604e72422f3f`::Disk hdc latency not available >GuestMonitor-scale_2::DEBUG::2014-07-10 09:01:52,831::vm::715::vm.Vm::(_getDiskLatency) vmId=`52e238aa-e62a-48a8-a200-604e72422f3f`::Disk vda latency not available >GuestMonitor-scale_1::DEBUG::2014-07-10 09:01:52,937::vm::676::vm.Vm::(_getDiskStats) vmId=`ed909f7e-0ee2-4f6f-b4a5-a165f689a276`::Disk hdd stats not available >GuestMonitor-scale_1::DEBUG::2014-07-10 09:01:52,937::vm::676::vm.Vm::(_getDiskStats) vmId=`ed909f7e-0ee2-4f6f-b4a5-a165f689a276`::Disk hdc stats not available >GuestMonitor-scale_1::DEBUG::2014-07-10 09:01:52,938::vm::676::vm.Vm::(_getDiskStats) vmId=`ed909f7e-0ee2-4f6f-b4a5-a165f689a276`::Disk vda stats not available >GuestMonitor-scale_1::DEBUG::2014-07-10 09:01:52,938::vm::715::vm.Vm::(_getDiskLatency) vmId=`ed909f7e-0ee2-4f6f-b4a5-a165f689a276`::Disk hdd latency not available >GuestMonitor-scale_1::DEBUG::2014-07-10 09:01:52,938::vm::715::vm.Vm::(_getDiskLatency) vmId=`ed909f7e-0ee2-4f6f-b4a5-a165f689a276`::Disk hdc latency not available >GuestMonitor-scale_1::DEBUG::2014-07-10 09:01:52,938::vm::715::vm.Vm::(_getDiskLatency) vmId=`ed909f7e-0ee2-4f6f-b4a5-a165f689a276`::Disk vda latency not available >GuestMonitor-scale_1::DEBUG::2014-07-10 09:01:52,939::vm::676::vm.Vm::(_getDiskStats) vmId=`ed909f7e-0ee2-4f6f-b4a5-a165f689a276`::Disk hdd stats not available >GuestMonitor-scale_1::DEBUG::2014-07-10 09:01:52,939::vm::676::vm.Vm::(_getDiskStats) vmId=`ed909f7e-0ee2-4f6f-b4a5-a165f689a276`::Disk hdc stats not available >GuestMonitor-scale_1::DEBUG::2014-07-10 09:01:52,939::vm::676::vm.Vm::(_getDiskStats) vmId=`ed909f7e-0ee2-4f6f-b4a5-a165f689a276`::Disk vda stats not available >GuestMonitor-scale_1::DEBUG::2014-07-10 09:01:52,939::vm::715::vm.Vm::(_getDiskLatency) vmId=`ed909f7e-0ee2-4f6f-b4a5-a165f689a276`::Disk hdd latency not available >GuestMonitor-scale_1::DEBUG::2014-07-10 09:01:52,940::vm::715::vm.Vm::(_getDiskLatency) vmId=`ed909f7e-0ee2-4f6f-b4a5-a165f689a276`::Disk hdc latency not available >GuestMonitor-scale_1::DEBUG::2014-07-10 09:01:52,940::vm::715::vm.Vm::(_getDiskLatency) vmId=`ed909f7e-0ee2-4f6f-b4a5-a165f689a276`::Disk vda latency not available >Dummy-33::DEBUG::2014-07-10 09:01:53,509::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:01:53,611::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.048626 s, 21.1 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 09:01:53,749::BindingXMLRPC::1067::vds::(wrapper) client [10.35.3.13]::call vmGetStats with ('52e238aa-e62a-48a8-a200-604e72422f3f',) {} >Thread-14::DEBUG::2014-07-10 09:01:53,750::vm::676::vm.Vm::(_getDiskStats) vmId=`52e238aa-e62a-48a8-a200-604e72422f3f`::Disk hdd stats not available >Thread-14::DEBUG::2014-07-10 09:01:53,750::vm::676::vm.Vm::(_getDiskStats) vmId=`52e238aa-e62a-48a8-a200-604e72422f3f`::Disk hdc stats not available >Thread-14::DEBUG::2014-07-10 09:01:53,750::vm::676::vm.Vm::(_getDiskStats) vmId=`52e238aa-e62a-48a8-a200-604e72422f3f`::Disk vda stats not available >Thread-14::DEBUG::2014-07-10 09:01:53,750::vm::715::vm.Vm::(_getDiskLatency) vmId=`52e238aa-e62a-48a8-a200-604e72422f3f`::Disk hdd latency not available >Thread-14::DEBUG::2014-07-10 09:01:53,750::vm::715::vm.Vm::(_getDiskLatency) vmId=`52e238aa-e62a-48a8-a200-604e72422f3f`::Disk hdc latency not available >Thread-14::DEBUG::2014-07-10 09:01:53,751::vm::715::vm.Vm::(_getDiskLatency) vmId=`52e238aa-e62a-48a8-a200-604e72422f3f`::Disk vda latency not available >Thread-14::DEBUG::2014-07-10 09:01:53,751::BindingXMLRPC::1074::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Powering up', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '12236', 'displayIp': '0', 'displayPort': u'5902', 'session': 'Unknown', 'displaySecurePort': u'5903', 'timeOffset': '0', 'hash': '-5500930374920933700', 'balloonInfo': {'balloon_max': '1048576', 'balloon_target': '1048576', 'balloon_cur': '1048576', 'balloon_min': '1048576'}, 'pauseCode': 'NOERR', 'clientIp': '', 'kvmEnable': 'true', 'network': {u'vnet1': {'macAddr': '00:1a:4a:de:6d:7b', 'rxDropped': '0', 'rxErrors': '0', 'txDropped': '0', 'txRate': '0.0', 'rxRate': '0.0', 'txErrors': '0', 'state': 'unknown', 'speed': '1000', 'name': u'vnet1'}}, 'vmId': '52e238aa-e62a-48a8-a200-604e72422f3f', 'displayType': 'qxl', 'cpuUser': '43.94', 'disks': {u'vda': {'truesize': '1073741824', 'apparentsize': '1073741824', 'imageID': '76fdb054-02cd-42ed-9721-b3e65b34c3a4'}, u'hdd': {'truesize': '0', 'apparentsize': '0'}, u'hdc': {'truesize': '0', 'apparentsize': '0'}}, 'monitorResponse': '0', 'statsAge': '0.45', 'elapsedTime': '27', 'vmType': 'kvm', 'cpuSys': '23.61', 'guestCPUCount': -1, 'appsList': [], 'guestIPs': ''}]} >Thread-14::DEBUG::2014-07-10 09:01:53,756::BindingXMLRPC::1067::vds::(wrapper) client [10.35.3.13]::call vmGetStats with ('949f6c19-87b5-4f16-a91c-0049749423ea',) {} >Thread-14::DEBUG::2014-07-10 09:01:53,756::vm::598::vm.Vm::(_getCpuStats) vmId=`949f6c19-87b5-4f16-a91c-0049749423ea`::CPU stats not available: 'NoneType' object is unsubscriptable >Thread-14::DEBUG::2014-07-10 09:01:53,756::vm::654::vm.Vm::(_getNetworkStats) vmId=`949f6c19-87b5-4f16-a91c-0049749423ea`::Network stats not available >Thread-14::DEBUG::2014-07-10 09:01:53,756::vm::676::vm.Vm::(_getDiskStats) vmId=`949f6c19-87b5-4f16-a91c-0049749423ea`::Disk hdd stats not available >Thread-14::DEBUG::2014-07-10 09:01:53,756::vm::676::vm.Vm::(_getDiskStats) vmId=`949f6c19-87b5-4f16-a91c-0049749423ea`::Disk hdc stats not available >Thread-14::DEBUG::2014-07-10 09:01:53,757::vm::676::vm.Vm::(_getDiskStats) vmId=`949f6c19-87b5-4f16-a91c-0049749423ea`::Disk vda stats not available >Thread-14::DEBUG::2014-07-10 09:01:53,757::vm::715::vm.Vm::(_getDiskLatency) vmId=`949f6c19-87b5-4f16-a91c-0049749423ea`::Disk hdd latency not available >Thread-14::DEBUG::2014-07-10 09:01:53,757::vm::715::vm.Vm::(_getDiskLatency) vmId=`949f6c19-87b5-4f16-a91c-0049749423ea`::Disk hdc latency not available >Thread-14::DEBUG::2014-07-10 09:01:53,757::vm::715::vm.Vm::(_getDiskLatency) vmId=`949f6c19-87b5-4f16-a91c-0049749423ea`::Disk vda latency not available >Thread-14::DEBUG::2014-07-10 09:01:53,757::BindingXMLRPC::1074::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Powering up', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '12860', 'displayIp': '0', 'displayPort': u'5904', 'session': 'Unknown', 'displaySecurePort': u'5905', 'timeOffset': '0', 'hash': '-1803473594666319662', 'balloonInfo': {'balloon_max': '1048576', 'balloon_target': '1048576', 'balloon_cur': '0', 'balloon_min': '1048576'}, 'pauseCode': 'NOERR', 'clientIp': '', 'kvmEnable': 'true', 'network': {u'vnet2': {'state': 'unknown', 'macAddr': '00:1a:4a:de:6d:7e', 'speed': '1000', 'name': u'vnet2'}}, 'vmId': '949f6c19-87b5-4f16-a91c-0049749423ea', 'displayType': 'qxl', 'cpuUser': '0.00', 'disks': {u'vda': {'truesize': '1073741824', 'apparentsize': '1073741824', 'imageID': '28408446-e5fd-4565-a976-e760951593fe'}, u'hdd': {'truesize': '0', 'apparentsize': '0'}, u'hdc': {'truesize': '0', 'apparentsize': '0'}}, 'monitorResponse': '0', 'statsAge': '0.92', 'elapsedTime': '7', 'vmType': 'kvm', 'cpuSys': '0.00', 'guestCPUCount': -1, 'appsList': [], 'guestIPs': ''}]} >Thread-40::DEBUG::2014-07-10 09:01:54,117::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lion.qa.lab.tlv.redhat.com:_export_yuri2_backup2/6a70504d-00df-4869-8695-0f442053f6b6/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-40::DEBUG::2014-07-10 09:01:54,131::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n369 bytes (369 B) copied, 0.000415201 s, 889 kB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 09:01:55,256::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-14::DEBUG::2014-07-10 09:01:55,257::task::595::TaskManager.Task::(_updateState) Task=`6b83c14f-1b85-422e-b412-8093ebec9e94`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 09:01:55,257::logUtils::44::dispatcher::(wrapper) Run and protect: getAllTasksStatuses(spUUID=None, options=None) >Thread-14::DEBUG::2014-07-10 09:01:55,257::taskManager::102::TaskManager::(getAllTasksStatuses) Entry. >Thread-14::DEBUG::2014-07-10 09:01:55,258::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 459f9833-5455-4a84-a83e-98aead3d52c9 >Thread-14::DEBUG::2014-07-10 09:01:55,258::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '459f9833-5455-4a84-a83e-98aead3d52c9'} >Thread-14::DEBUG::2014-07-10 09:01:55,258::taskManager::113::TaskManager::(getAllTasksStatuses) Return: {'459f9833-5455-4a84-a83e-98aead3d52c9': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '459f9833-5455-4a84-a83e-98aead3d52c9'}} >Thread-14::INFO::2014-07-10 09:01:55,258::logUtils::47::dispatcher::(wrapper) Run and protect: getAllTasksStatuses, Return response: {'allTasksStatus': {'459f9833-5455-4a84-a83e-98aead3d52c9': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '459f9833-5455-4a84-a83e-98aead3d52c9'}}} >Thread-14::DEBUG::2014-07-10 09:01:55,258::task::1185::TaskManager.Task::(prepare) Task=`6b83c14f-1b85-422e-b412-8093ebec9e94`::finished: {'allTasksStatus': {'459f9833-5455-4a84-a83e-98aead3d52c9': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '459f9833-5455-4a84-a83e-98aead3d52c9'}}} >Thread-14::DEBUG::2014-07-10 09:01:55,259::task::595::TaskManager.Task::(_updateState) Task=`6b83c14f-1b85-422e-b412-8093ebec9e94`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 09:01:55,259::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 09:01:55,259::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 09:01:55,259::task::990::TaskManager.Task::(_decref) Task=`6b83c14f-1b85-422e-b412-8093ebec9e94`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 09:01:55,627::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:01:55,710::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0300009 s, 34.1 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-10 09:01:56,566::lvm::373::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-18::DEBUG::2014-07-10 09:01:56,568::lvm::296::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/3600601601282300032826addbbdae311|/dev/mapper/360060160f4a030003840ec867ddee311|/dev/mapper/367cad74c2fcba00019e6afd20c781e67|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name 9e1aa540-1f4e-4ee3-a152-be381ef6c3bd' (cwd None) >Thread-14::DEBUG::2014-07-10 09:01:56,772::BindingXMLRPC::1067::vds::(wrapper) client [10.35.3.13]::call vmGetStats with ('52e238aa-e62a-48a8-a200-604e72422f3f',) {} >Thread-14::DEBUG::2014-07-10 09:01:56,773::vm::676::vm.Vm::(_getDiskStats) vmId=`52e238aa-e62a-48a8-a200-604e72422f3f`::Disk hdd stats not available >Thread-14::DEBUG::2014-07-10 09:01:56,774::vm::676::vm.Vm::(_getDiskStats) vmId=`52e238aa-e62a-48a8-a200-604e72422f3f`::Disk hdc stats not available >Thread-14::DEBUG::2014-07-10 09:01:56,774::vm::676::vm.Vm::(_getDiskStats) vmId=`52e238aa-e62a-48a8-a200-604e72422f3f`::Disk vda stats not available >Thread-14::DEBUG::2014-07-10 09:01:56,775::vm::715::vm.Vm::(_getDiskLatency) vmId=`52e238aa-e62a-48a8-a200-604e72422f3f`::Disk hdd latency not available >Thread-14::DEBUG::2014-07-10 09:01:56,775::vm::715::vm.Vm::(_getDiskLatency) vmId=`52e238aa-e62a-48a8-a200-604e72422f3f`::Disk hdc latency not available >Thread-14::DEBUG::2014-07-10 09:01:56,775::vm::715::vm.Vm::(_getDiskLatency) vmId=`52e238aa-e62a-48a8-a200-604e72422f3f`::Disk vda latency not available >Thread-14::DEBUG::2014-07-10 09:01:56,776::BindingXMLRPC::1074::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Powering up', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '12236', 'displayIp': '0', 'displayPort': u'5902', 'session': 'Unknown', 'displaySecurePort': u'5903', 'timeOffset': '0', 'hash': '-5500930374920933700', 'balloonInfo': {'balloon_max': '1048576', 'balloon_target': '1048576', 'balloon_cur': '1048576', 'balloon_min': '1048576'}, 'pauseCode': 'NOERR', 'clientIp': '', 'kvmEnable': 'true', 'network': {u'vnet1': {'macAddr': '00:1a:4a:de:6d:7b', 'rxDropped': '0', 'rxErrors': '0', 'txDropped': '0', 'txRate': '0.0', 'rxRate': '0.0', 'txErrors': '0', 'state': 'unknown', 'speed': '1000', 'name': u'vnet1'}}, 'vmId': '52e238aa-e62a-48a8-a200-604e72422f3f', 'displayType': 'qxl', 'cpuUser': '43.94', 'disks': {u'vda': {'truesize': '1073741824', 'apparentsize': '1073741824', 'imageID': '76fdb054-02cd-42ed-9721-b3e65b34c3a4'}, u'hdd': {'truesize': '0', 'apparentsize': '0'}, u'hdc': {'truesize': '0', 'apparentsize': '0'}}, 'monitorResponse': '0', 'statsAge': '1.47', 'elapsedTime': '30', 'vmType': 'kvm', 'cpuSys': '23.61', 'guestCPUCount': -1, 'appsList': [], 'guestIPs': ''}]} >Thread-14::DEBUG::2014-07-10 09:01:56,780::BindingXMLRPC::1067::vds::(wrapper) client [10.35.3.13]::call vmGetStats with ('949f6c19-87b5-4f16-a91c-0049749423ea',) {} >Thread-14::DEBUG::2014-07-10 09:01:56,781::vm::598::vm.Vm::(_getCpuStats) vmId=`949f6c19-87b5-4f16-a91c-0049749423ea`::CPU stats not available: 'NoneType' object is unsubscriptable >Thread-14::DEBUG::2014-07-10 09:01:56,781::vm::654::vm.Vm::(_getNetworkStats) vmId=`949f6c19-87b5-4f16-a91c-0049749423ea`::Network stats not available >Thread-14::DEBUG::2014-07-10 09:01:56,782::vm::676::vm.Vm::(_getDiskStats) vmId=`949f6c19-87b5-4f16-a91c-0049749423ea`::Disk hdd stats not available >Thread-14::DEBUG::2014-07-10 09:01:56,784::vm::676::vm.Vm::(_getDiskStats) vmId=`949f6c19-87b5-4f16-a91c-0049749423ea`::Disk hdc stats not available >Thread-14::DEBUG::2014-07-10 09:01:56,787::vm::676::vm.Vm::(_getDiskStats) vmId=`949f6c19-87b5-4f16-a91c-0049749423ea`::Disk vda stats not available >Thread-18::DEBUG::2014-07-10 09:01:56,789::lvm::296::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-14::DEBUG::2014-07-10 09:01:56,789::vm::715::vm.Vm::(_getDiskLatency) vmId=`949f6c19-87b5-4f16-a91c-0049749423ea`::Disk hdd latency not available >Thread-14::DEBUG::2014-07-10 09:01:56,793::vm::715::vm.Vm::(_getDiskLatency) vmId=`949f6c19-87b5-4f16-a91c-0049749423ea`::Disk hdc latency not available >Thread-14::DEBUG::2014-07-10 09:01:56,796::vm::715::vm.Vm::(_getDiskLatency) vmId=`949f6c19-87b5-4f16-a91c-0049749423ea`::Disk vda latency not available >Thread-18::DEBUG::2014-07-10 09:01:56,798::lvm::415::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-14::DEBUG::2014-07-10 09:01:56,801::BindingXMLRPC::1074::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Powering up', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '12860', 'displayIp': '0', 'displayPort': u'5904', 'session': 'Unknown', 'displaySecurePort': u'5905', 'timeOffset': '0', 'hash': '-1803473594666319662', 'balloonInfo': {'balloon_max': '1048576', 'balloon_target': '1048576', 'balloon_cur': '0', 'balloon_min': '1048576'}, 'pauseCode': 'NOERR', 'clientIp': '', 'kvmEnable': 'true', 'network': {u'vnet2': {'state': 'unknown', 'macAddr': '00:1a:4a:de:6d:7e', 'speed': '1000', 'name': u'vnet2'}}, 'vmId': '949f6c19-87b5-4f16-a91c-0049749423ea', 'displayType': 'qxl', 'cpuUser': '0.00', 'disks': {u'vda': {'truesize': '1073741824', 'apparentsize': '1073741824', 'imageID': '28408446-e5fd-4565-a976-e760951593fe'}, u'hdd': {'truesize': '0', 'apparentsize': '0'}, u'hdc': {'truesize': '0', 'apparentsize': '0'}}, 'monitorResponse': '0', 'statsAge': '1.93', 'elapsedTime': '10', 'vmType': 'kvm', 'cpuSys': '0.00', 'guestCPUCount': -1, 'appsList': [], 'guestIPs': ''}]} >Thread-18::DEBUG::2014-07-10 09:01:56,805::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/metadata bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-10 09:01:56,829::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00135719 s, 3.0 MB/s\n'; <rc> = 0 >459f9833-5455-4a84-a83e-98aead3d52c9::DEBUG::2014-07-10 09:01:57,110::lvm::296::Storage.Misc.excCmd::(cmd) FAILED: <err> = ' Logical volume 9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/47592965-e853-4e59-9728-d11cca6a7a8a in use.\n'; <rc> = 5 >459f9833-5455-4a84-a83e-98aead3d52c9::DEBUG::2014-07-10 09:01:57,113::lvm::513::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >459f9833-5455-4a84-a83e-98aead3d52c9::DEBUG::2014-07-10 09:01:57,114::lvm::525::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >459f9833-5455-4a84-a83e-98aead3d52c9::WARNING::2014-07-10 09:01:57,114::resourceFactories::61::Storage.ResourcesFactories::(close) Failure deactivate LV 9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/47592965-e853-4e59-9728-d11cca6a7a8a (Cannot deactivate Logical Volume: ('General Storage Exception: ("5 [] [\' Logical volume 9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/47592965-e853-4e59-9728-d11cca6a7a8a in use.\']\\n9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/[\'47592965-e853-4e59-9728-d11cca6a7a8a\']",)',)) >459f9833-5455-4a84-a83e-98aead3d52c9::DEBUG::2014-07-10 09:01:57,114::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd_lvmActivationNS.47592965-e853-4e59-9728-d11cca6a7a8a', Clearing records. >459f9833-5455-4a84-a83e-98aead3d52c9::DEBUG::2014-07-10 09:01:57,115::lvm::427::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' got the operation mutex >459f9833-5455-4a84-a83e-98aead3d52c9::DEBUG::2014-07-10 09:01:57,115::lvm::296::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm lvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/3600601601282300032826addbbdae311|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,vg_name,attr,size,seg_start_pe,devices,tags 9e1aa540-1f4e-4ee3-a152-be381ef6c3bd' (cwd None) >459f9833-5455-4a84-a83e-98aead3d52c9::DEBUG::2014-07-10 09:01:57,301::lvm::296::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >459f9833-5455-4a84-a83e-98aead3d52c9::DEBUG::2014-07-10 09:01:57,314::lvm::462::Storage.LVM::(_reloadlvs) lvs reloaded >459f9833-5455-4a84-a83e-98aead3d52c9::DEBUG::2014-07-10 09:01:57,314::lvm::462::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' released the operation mutex >459f9833-5455-4a84-a83e-98aead3d52c9::DEBUG::2014-07-10 09:01:57,314::lvm::427::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' got the operation mutex >459f9833-5455-4a84-a83e-98aead3d52c9::DEBUG::2014-07-10 09:01:57,315::lvm::296::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm lvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/3600601601282300032826addbbdae311|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,vg_name,attr,size,seg_start_pe,devices,tags 9e1aa540-1f4e-4ee3-a152-be381ef6c3bd' (cwd None) >459f9833-5455-4a84-a83e-98aead3d52c9::DEBUG::2014-07-10 09:01:57,497::lvm::296::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >459f9833-5455-4a84-a83e-98aead3d52c9::DEBUG::2014-07-10 09:01:57,507::lvm::462::Storage.LVM::(_reloadlvs) lvs reloaded >459f9833-5455-4a84-a83e-98aead3d52c9::DEBUG::2014-07-10 09:01:57,508::lvm::462::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' released the operation mutex >459f9833-5455-4a84-a83e-98aead3d52c9::WARNING::2014-07-10 09:01:57,508::blockSD::761::Storage.StorageDomain::(_getOccupiedMetadataSlots) Could not find mapping for lv 9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/c4cd1da8-05b7-45e0-80b1-1183d21443d9 >459f9833-5455-4a84-a83e-98aead3d52c9::DEBUG::2014-07-10 09:01:57,508::blockSD::784::Storage.StorageDomain::(getFreeMetadataSlot) Found freeSlot 8 in VG 9e1aa540-1f4e-4ee3-a152-be381ef6c3bd >459f9833-5455-4a84-a83e-98aead3d52c9::DEBUG::2014-07-10 09:01:57,509::lvm::296::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm lvchange --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/3600601601282300032826addbbdae311|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } " --autobackup n --deltag OVIRT_VOL_INITIALIZING --addtag PU_47592965-e853-4e59-9728-d11cca6a7a8a --addtag MD_8 --addtag IU_b6f6c0da-e67f-4902-b9ac-3069571a42fe 9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/c4cd1da8-05b7-45e0-80b1-1183d21443d9' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:01:57,725::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >459f9833-5455-4a84-a83e-98aead3d52c9::DEBUG::2014-07-10 09:01:57,745::lvm::296::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ' WARNING: This metadata update is NOT backed up\n WARNING: This metadata update is NOT backed up\n'; <rc> = 0 >459f9833-5455-4a84-a83e-98aead3d52c9::DEBUG::2014-07-10 09:01:57,749::lvm::513::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >459f9833-5455-4a84-a83e-98aead3d52c9::DEBUG::2014-07-10 09:01:57,752::lvm::525::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >459f9833-5455-4a84-a83e-98aead3d52c9::DEBUG::2014-07-10 09:01:57,761::lvm::296::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm lvchange --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/3600601601282300032826addbbdae311|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } " --autobackup n --available n 9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/c4cd1da8-05b7-45e0-80b1-1183d21443d9' (cwd None) >GuestMonitor-scale_3::DEBUG::2014-07-10 09:01:57,821::vm::598::vm.Vm::(_getCpuStats) vmId=`949f6c19-87b5-4f16-a91c-0049749423ea`::CPU stats not available: 'NoneType' object is unsubscriptable >GuestMonitor-scale_3::DEBUG::2014-07-10 09:01:57,828::vm::654::vm.Vm::(_getNetworkStats) vmId=`949f6c19-87b5-4f16-a91c-0049749423ea`::Network stats not available >GuestMonitor-scale_3::DEBUG::2014-07-10 09:01:57,832::vm::676::vm.Vm::(_getDiskStats) vmId=`949f6c19-87b5-4f16-a91c-0049749423ea`::Disk hdd stats not available >GuestMonitor-scale_3::DEBUG::2014-07-10 09:01:57,835::vm::676::vm.Vm::(_getDiskStats) vmId=`949f6c19-87b5-4f16-a91c-0049749423ea`::Disk hdc stats not available >GuestMonitor-scale_2::DEBUG::2014-07-10 09:01:57,841::vm::676::vm.Vm::(_getDiskStats) vmId=`52e238aa-e62a-48a8-a200-604e72422f3f`::Disk hdd stats not available >GuestMonitor-scale_3::DEBUG::2014-07-10 09:01:57,843::vm::676::vm.Vm::(_getDiskStats) vmId=`949f6c19-87b5-4f16-a91c-0049749423ea`::Disk vda stats not available >GuestMonitor-scale_2::DEBUG::2014-07-10 09:01:57,847::vm::676::vm.Vm::(_getDiskStats) vmId=`52e238aa-e62a-48a8-a200-604e72422f3f`::Disk hdc stats not available >GuestMonitor-scale_3::DEBUG::2014-07-10 09:01:57,847::vm::715::vm.Vm::(_getDiskLatency) vmId=`949f6c19-87b5-4f16-a91c-0049749423ea`::Disk hdd latency not available >GuestMonitor-scale_2::DEBUG::2014-07-10 09:01:57,852::vm::676::vm.Vm::(_getDiskStats) vmId=`52e238aa-e62a-48a8-a200-604e72422f3f`::Disk vda stats not available >GuestMonitor-scale_3::DEBUG::2014-07-10 09:01:57,853::vm::715::vm.Vm::(_getDiskLatency) vmId=`949f6c19-87b5-4f16-a91c-0049749423ea`::Disk hdc latency not available >GuestMonitor-scale_2::DEBUG::2014-07-10 09:01:57,857::vm::715::vm.Vm::(_getDiskLatency) vmId=`52e238aa-e62a-48a8-a200-604e72422f3f`::Disk hdd latency not available >GuestMonitor-scale_3::DEBUG::2014-07-10 09:01:57,858::vm::715::vm.Vm::(_getDiskLatency) vmId=`949f6c19-87b5-4f16-a91c-0049749423ea`::Disk vda latency not available >GuestMonitor-scale_2::DEBUG::2014-07-10 09:01:57,861::vm::715::vm.Vm::(_getDiskLatency) vmId=`52e238aa-e62a-48a8-a200-604e72422f3f`::Disk hdc latency not available >GuestMonitor-scale_2::DEBUG::2014-07-10 09:01:57,866::vm::715::vm.Vm::(_getDiskLatency) vmId=`52e238aa-e62a-48a8-a200-604e72422f3f`::Disk vda latency not available >GuestMonitor-scale_3::DEBUG::2014-07-10 09:01:57,870::vm::598::vm.Vm::(_getCpuStats) vmId=`949f6c19-87b5-4f16-a91c-0049749423ea`::CPU stats not available: 'NoneType' object is unsubscriptable >GuestMonitor-scale_3::DEBUG::2014-07-10 09:01:57,878::vm::654::vm.Vm::(_getNetworkStats) vmId=`949f6c19-87b5-4f16-a91c-0049749423ea`::Network stats not available >GuestMonitor-scale_2::DEBUG::2014-07-10 09:01:57,879::vm::676::vm.Vm::(_getDiskStats) vmId=`52e238aa-e62a-48a8-a200-604e72422f3f`::Disk hdd stats not available >GuestMonitor-scale_3::DEBUG::2014-07-10 09:01:57,884::vm::676::vm.Vm::(_getDiskStats) vmId=`949f6c19-87b5-4f16-a91c-0049749423ea`::Disk hdd stats not available >GuestMonitor-scale_2::DEBUG::2014-07-10 09:01:57,884::vm::676::vm.Vm::(_getDiskStats) vmId=`52e238aa-e62a-48a8-a200-604e72422f3f`::Disk hdc stats not available >GuestMonitor-scale_3::DEBUG::2014-07-10 09:01:57,889::vm::676::vm.Vm::(_getDiskStats) vmId=`949f6c19-87b5-4f16-a91c-0049749423ea`::Disk hdc stats not available >GuestMonitor-scale_2::DEBUG::2014-07-10 09:01:57,890::vm::676::vm.Vm::(_getDiskStats) vmId=`52e238aa-e62a-48a8-a200-604e72422f3f`::Disk vda stats not available >GuestMonitor-scale_2::DEBUG::2014-07-10 09:01:57,895::vm::715::vm.Vm::(_getDiskLatency) vmId=`52e238aa-e62a-48a8-a200-604e72422f3f`::Disk hdd latency not available >GuestMonitor-scale_3::DEBUG::2014-07-10 09:01:57,895::vm::676::vm.Vm::(_getDiskStats) vmId=`949f6c19-87b5-4f16-a91c-0049749423ea`::Disk vda stats not available >GuestMonitor-scale_2::DEBUG::2014-07-10 09:01:57,899::vm::715::vm.Vm::(_getDiskLatency) vmId=`52e238aa-e62a-48a8-a200-604e72422f3f`::Disk hdc latency not available >GuestMonitor-scale_3::DEBUG::2014-07-10 09:01:57,901::vm::715::vm.Vm::(_getDiskLatency) vmId=`949f6c19-87b5-4f16-a91c-0049749423ea`::Disk hdd latency not available >GuestMonitor-scale_2::DEBUG::2014-07-10 09:01:57,904::vm::715::vm.Vm::(_getDiskLatency) vmId=`52e238aa-e62a-48a8-a200-604e72422f3f`::Disk vda latency not available >GuestMonitor-scale_3::DEBUG::2014-07-10 09:01:57,907::vm::715::vm.Vm::(_getDiskLatency) vmId=`949f6c19-87b5-4f16-a91c-0049749423ea`::Disk hdc latency not available >GuestMonitor-scale_3::DEBUG::2014-07-10 09:01:57,912::vm::715::vm.Vm::(_getDiskLatency) vmId=`949f6c19-87b5-4f16-a91c-0049749423ea`::Disk vda latency not available >Dummy-33::DEBUG::2014-07-10 09:01:57,944::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0614741 s, 16.7 MB/s\n'; <rc> = 0 >GuestMonitor-scale_1::DEBUG::2014-07-10 09:01:57,949::vm::676::vm.Vm::(_getDiskStats) vmId=`ed909f7e-0ee2-4f6f-b4a5-a165f689a276`::Disk hdd stats not available >GuestMonitor-scale_1::DEBUG::2014-07-10 09:01:57,952::vm::676::vm.Vm::(_getDiskStats) vmId=`ed909f7e-0ee2-4f6f-b4a5-a165f689a276`::Disk hdc stats not available >GuestMonitor-scale_1::DEBUG::2014-07-10 09:01:57,955::vm::676::vm.Vm::(_getDiskStats) vmId=`ed909f7e-0ee2-4f6f-b4a5-a165f689a276`::Disk vda stats not available >GuestMonitor-scale_1::DEBUG::2014-07-10 09:01:57,957::vm::715::vm.Vm::(_getDiskLatency) vmId=`ed909f7e-0ee2-4f6f-b4a5-a165f689a276`::Disk hdd latency not available >GuestMonitor-scale_1::DEBUG::2014-07-10 09:01:57,959::vm::715::vm.Vm::(_getDiskLatency) vmId=`ed909f7e-0ee2-4f6f-b4a5-a165f689a276`::Disk hdc latency not available >GuestMonitor-scale_1::DEBUG::2014-07-10 09:01:57,960::vm::715::vm.Vm::(_getDiskLatency) vmId=`ed909f7e-0ee2-4f6f-b4a5-a165f689a276`::Disk vda latency not available >GuestMonitor-scale_1::DEBUG::2014-07-10 09:01:57,966::vm::676::vm.Vm::(_getDiskStats) vmId=`ed909f7e-0ee2-4f6f-b4a5-a165f689a276`::Disk hdd stats not available >GuestMonitor-scale_1::DEBUG::2014-07-10 09:01:57,967::vm::676::vm.Vm::(_getDiskStats) vmId=`ed909f7e-0ee2-4f6f-b4a5-a165f689a276`::Disk hdc stats not available >GuestMonitor-scale_1::DEBUG::2014-07-10 09:01:57,969::vm::676::vm.Vm::(_getDiskStats) vmId=`ed909f7e-0ee2-4f6f-b4a5-a165f689a276`::Disk vda stats not available >GuestMonitor-scale_1::DEBUG::2014-07-10 09:01:57,970::vm::715::vm.Vm::(_getDiskLatency) vmId=`ed909f7e-0ee2-4f6f-b4a5-a165f689a276`::Disk hdd latency not available >GuestMonitor-scale_1::DEBUG::2014-07-10 09:01:57,972::vm::715::vm.Vm::(_getDiskLatency) vmId=`ed909f7e-0ee2-4f6f-b4a5-a165f689a276`::Disk hdc latency not available >GuestMonitor-scale_1::DEBUG::2014-07-10 09:01:57,973::vm::715::vm.Vm::(_getDiskLatency) vmId=`ed909f7e-0ee2-4f6f-b4a5-a165f689a276`::Disk vda latency not available >459f9833-5455-4a84-a83e-98aead3d52c9::DEBUG::2014-07-10 09:01:58,186::lvm::296::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >459f9833-5455-4a84-a83e-98aead3d52c9::DEBUG::2014-07-10 09:01:58,187::lvm::513::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >459f9833-5455-4a84-a83e-98aead3d52c9::DEBUG::2014-07-10 09:01:58,187::lvm::525::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >459f9833-5455-4a84-a83e-98aead3d52c9::DEBUG::2014-07-10 09:01:58,189::task::752::TaskManager.Task::(_save) Task=`459f9833-5455-4a84-a83e-98aead3d52c9`::_save: orig /rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/master/tasks/459f9833-5455-4a84-a83e-98aead3d52c9 temp /rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/master/tasks/459f9833-5455-4a84-a83e-98aead3d52c9.temp >459f9833-5455-4a84-a83e-98aead3d52c9::DEBUG::2014-07-10 09:01:58,208::blockVolume::604::Storage.Volume::(newVolumeLease) Initializing volume lease volUUID=c4cd1da8-05b7-45e0-80b1-1183d21443d9 sdUUID=9e1aa540-1f4e-4ee3-a152-be381ef6c3bd, metaId=('9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 8) >459f9833-5455-4a84-a83e-98aead3d52c9::DEBUG::2014-07-10 09:01:58,215::task::752::TaskManager.Task::(_save) Task=`459f9833-5455-4a84-a83e-98aead3d52c9`::_save: orig /rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/master/tasks/459f9833-5455-4a84-a83e-98aead3d52c9 temp /rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/master/tasks/459f9833-5455-4a84-a83e-98aead3d52c9.temp >459f9833-5455-4a84-a83e-98aead3d52c9::DEBUG::2014-07-10 09:01:58,224::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd_imageNS.b6f6c0da-e67f-4902-b9ac-3069571a42fe' >459f9833-5455-4a84-a83e-98aead3d52c9::DEBUG::2014-07-10 09:01:58,225::resourceManager::635::ResourceManager::(releaseResource) Released resource '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd_imageNS.b6f6c0da-e67f-4902-b9ac-3069571a42fe' (0 active users) >459f9833-5455-4a84-a83e-98aead3d52c9::DEBUG::2014-07-10 09:01:58,225::resourceManager::641::ResourceManager::(releaseResource) Resource '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd_imageNS.b6f6c0da-e67f-4902-b9ac-3069571a42fe' is free, finding out if anyone is waiting for it. >459f9833-5455-4a84-a83e-98aead3d52c9::DEBUG::2014-07-10 09:01:58,225::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd_imageNS.b6f6c0da-e67f-4902-b9ac-3069571a42fe', Clearing records. >459f9833-5455-4a84-a83e-98aead3d52c9::DEBUG::2014-07-10 09:01:58,225::task::595::TaskManager.Task::(_updateState) Task=`459f9833-5455-4a84-a83e-98aead3d52c9`::moving from state running -> state finished >459f9833-5455-4a84-a83e-98aead3d52c9::DEBUG::2014-07-10 09:01:58,226::task::752::TaskManager.Task::(_save) Task=`459f9833-5455-4a84-a83e-98aead3d52c9`::_save: orig /rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/master/tasks/459f9833-5455-4a84-a83e-98aead3d52c9 temp /rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/master/tasks/459f9833-5455-4a84-a83e-98aead3d52c9.temp >459f9833-5455-4a84-a83e-98aead3d52c9::DEBUG::2014-07-10 09:01:58,240::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': < ResourceRef 'Storage.9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', isValid: 'True' obj: 'None'>} >459f9833-5455-4a84-a83e-98aead3d52c9::DEBUG::2014-07-10 09:01:58,240::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >459f9833-5455-4a84-a83e-98aead3d52c9::DEBUG::2014-07-10 09:01:58,240::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.9e1aa540-1f4e-4ee3-a152-be381ef6c3bd' >459f9833-5455-4a84-a83e-98aead3d52c9::DEBUG::2014-07-10 09:01:58,241::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.9e1aa540-1f4e-4ee3-a152-be381ef6c3bd' (0 active users) >459f9833-5455-4a84-a83e-98aead3d52c9::DEBUG::2014-07-10 09:01:58,241::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.9e1aa540-1f4e-4ee3-a152-be381ef6c3bd' is free, finding out if anyone is waiting for it. >459f9833-5455-4a84-a83e-98aead3d52c9::DEBUG::2014-07-10 09:01:58,241::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', Clearing records. >459f9833-5455-4a84-a83e-98aead3d52c9::DEBUG::2014-07-10 09:01:58,241::task::913::TaskManager.Task::(_runJobs) Task=`459f9833-5455-4a84-a83e-98aead3d52c9`::Task.run: exit - success: result {'uuid': 'c4cd1da8-05b7-45e0-80b1-1183d21443d9'} >459f9833-5455-4a84-a83e-98aead3d52c9::DEBUG::2014-07-10 09:01:58,242::task::990::TaskManager.Task::(_decref) Task=`459f9833-5455-4a84-a83e-98aead3d52c9`::ref 0 aborting False >459f9833-5455-4a84-a83e-98aead3d52c9::DEBUG::2014-07-10 09:01:58,242::threadPool::57::Misc.ThreadPool::(setRunningTask) Number of running tasks: 0 >Thread-14::DEBUG::2014-07-10 09:01:59,836::task::595::TaskManager.Task::(_updateState) Task=`9af19a99-f3ee-4448-9238-96cf7bdeb0d3`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 09:01:59,836::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::INFO::2014-07-10 09:01:59,837::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00135719', 'lastCheck': '3.0', 'valid': True}, '6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000415201', 'lastCheck': '5.7', 'valid': True}} >Thread-14::DEBUG::2014-07-10 09:01:59,837::task::1185::TaskManager.Task::(prepare) Task=`9af19a99-f3ee-4448-9238-96cf7bdeb0d3`::finished: {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00135719', 'lastCheck': '3.0', 'valid': True}, '6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000415201', 'lastCheck': '5.7', 'valid': True}} >Thread-14::DEBUG::2014-07-10 09:01:59,837::task::595::TaskManager.Task::(_updateState) Task=`9af19a99-f3ee-4448-9238-96cf7bdeb0d3`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 09:01:59,837::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 09:01:59,838::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 09:01:59,838::task::990::TaskManager.Task::(_decref) Task=`9af19a99-f3ee-4448-9238-96cf7bdeb0d3`::ref 0 aborting False >Thread-14::DEBUG::2014-07-10 09:01:59,850::vm::598::vm.Vm::(_getCpuStats) vmId=`949f6c19-87b5-4f16-a91c-0049749423ea`::CPU stats not available: 'NoneType' object is unsubscriptable >Thread-14::DEBUG::2014-07-10 09:01:59,850::vm::654::vm.Vm::(_getNetworkStats) vmId=`949f6c19-87b5-4f16-a91c-0049749423ea`::Network stats not available >Thread-14::DEBUG::2014-07-10 09:01:59,851::vm::676::vm.Vm::(_getDiskStats) vmId=`949f6c19-87b5-4f16-a91c-0049749423ea`::Disk hdd stats not available >Thread-14::DEBUG::2014-07-10 09:01:59,851::vm::676::vm.Vm::(_getDiskStats) vmId=`949f6c19-87b5-4f16-a91c-0049749423ea`::Disk hdc stats not available >Thread-14::DEBUG::2014-07-10 09:01:59,851::vm::676::vm.Vm::(_getDiskStats) vmId=`949f6c19-87b5-4f16-a91c-0049749423ea`::Disk vda stats not available >Thread-14::DEBUG::2014-07-10 09:01:59,851::vm::715::vm.Vm::(_getDiskLatency) vmId=`949f6c19-87b5-4f16-a91c-0049749423ea`::Disk hdd latency not available >Thread-14::DEBUG::2014-07-10 09:01:59,851::vm::715::vm.Vm::(_getDiskLatency) vmId=`949f6c19-87b5-4f16-a91c-0049749423ea`::Disk hdc latency not available >Thread-14::DEBUG::2014-07-10 09:01:59,852::vm::715::vm.Vm::(_getDiskLatency) vmId=`949f6c19-87b5-4f16-a91c-0049749423ea`::Disk vda latency not available >Thread-14::DEBUG::2014-07-10 09:01:59,852::vm::676::vm.Vm::(_getDiskStats) vmId=`52e238aa-e62a-48a8-a200-604e72422f3f`::Disk hdd stats not available >Thread-14::DEBUG::2014-07-10 09:01:59,852::vm::676::vm.Vm::(_getDiskStats) vmId=`52e238aa-e62a-48a8-a200-604e72422f3f`::Disk hdc stats not available >Thread-14::DEBUG::2014-07-10 09:01:59,853::vm::676::vm.Vm::(_getDiskStats) vmId=`52e238aa-e62a-48a8-a200-604e72422f3f`::Disk vda stats not available >Thread-14::DEBUG::2014-07-10 09:01:59,853::vm::715::vm.Vm::(_getDiskLatency) vmId=`52e238aa-e62a-48a8-a200-604e72422f3f`::Disk hdd latency not available >Thread-14::DEBUG::2014-07-10 09:01:59,853::vm::715::vm.Vm::(_getDiskLatency) vmId=`52e238aa-e62a-48a8-a200-604e72422f3f`::Disk hdc latency not available >Thread-14::DEBUG::2014-07-10 09:01:59,853::vm::715::vm.Vm::(_getDiskLatency) vmId=`52e238aa-e62a-48a8-a200-604e72422f3f`::Disk vda latency not available >Thread-14::DEBUG::2014-07-10 09:01:59,853::vm::676::vm.Vm::(_getDiskStats) vmId=`ed909f7e-0ee2-4f6f-b4a5-a165f689a276`::Disk hdd stats not available >Thread-14::DEBUG::2014-07-10 09:01:59,854::vm::676::vm.Vm::(_getDiskStats) vmId=`ed909f7e-0ee2-4f6f-b4a5-a165f689a276`::Disk hdc stats not available >Thread-14::DEBUG::2014-07-10 09:01:59,854::vm::676::vm.Vm::(_getDiskStats) vmId=`ed909f7e-0ee2-4f6f-b4a5-a165f689a276`::Disk vda stats not available >Thread-14::DEBUG::2014-07-10 09:01:59,854::vm::715::vm.Vm::(_getDiskLatency) vmId=`ed909f7e-0ee2-4f6f-b4a5-a165f689a276`::Disk hdd latency not available >Thread-14::DEBUG::2014-07-10 09:01:59,854::vm::715::vm.Vm::(_getDiskLatency) vmId=`ed909f7e-0ee2-4f6f-b4a5-a165f689a276`::Disk hdc latency not available >Thread-14::DEBUG::2014-07-10 09:01:59,854::vm::715::vm.Vm::(_getDiskLatency) vmId=`ed909f7e-0ee2-4f6f-b4a5-a165f689a276`::Disk vda latency not available >Dummy-33::DEBUG::2014-07-10 09:01:59,991::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >VM Channels Listener::DEBUG::2014-07-10 09:02:00,075::vmChannels::95::vds::(_handle_timeouts) Timeout on fileno 61. >Dummy-33::DEBUG::2014-07-10 09:02:00,096::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0504656 s, 20.3 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 09:02:01,705::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-14::DEBUG::2014-07-10 09:02:01,706::task::595::TaskManager.Task::(_updateState) Task=`f603e2be-8beb-41a4-8679-f86ea489f96e`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 09:02:01,707::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-14::INFO::2014-07-10 09:02:01,707::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:02:01,708::task::1185::TaskManager.Task::(prepare) Task=`f603e2be-8beb-41a4-8679-f86ea489f96e`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:02:01,708::task::595::TaskManager.Task::(_updateState) Task=`f603e2be-8beb-41a4-8679-f86ea489f96e`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 09:02:01,708::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 09:02:01,708::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 09:02:01,708::task::990::TaskManager.Task::(_decref) Task=`f603e2be-8beb-41a4-8679-f86ea489f96e`::ref 0 aborting False >Thread-34::DEBUG::2014-07-10 09:02:01,713::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-34::DEBUG::2014-07-10 09:02:01,714::task::595::TaskManager.Task::(_updateState) Task=`024a04df-7d8a-4431-b9b2-7a631da997e9`::moving from state init -> state preparing >Thread-34::INFO::2014-07-10 09:02:01,714::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-34::DEBUG::2014-07-10 09:02:01,715::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`0b99594e-9478-402c-a4bb-2642d0e36b56`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-10 09:02:01,715::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' for lock type 'shared' >Thread-34::DEBUG::2014-07-10 09:02:01,716::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-10 09:02:01,716::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`0b99594e-9478-402c-a4bb-2642d0e36b56`::Granted request >Thread-34::DEBUG::2014-07-10 09:02:01,716::task::827::TaskManager.Task::(resourceAcquired) Task=`024a04df-7d8a-4431-b9b2-7a631da997e9`::_resourcesAcquired: Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee (shared) >Thread-34::DEBUG::2014-07-10 09:02:01,717::task::990::TaskManager.Task::(_decref) Task=`024a04df-7d8a-4431-b9b2-7a631da997e9`::ref 1 aborting False >Thread-34::INFO::2014-07-10 09:02:01,718::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1079915839488', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532069482496', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:02:01,719::task::1185::TaskManager.Task::(prepare) Task=`024a04df-7d8a-4431-b9b2-7a631da997e9`::finished: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1079915839488', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532069482496', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:02:01,719::task::595::TaskManager.Task::(_updateState) Task=`024a04df-7d8a-4431-b9b2-7a631da997e9`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-10 09:02:01,719::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee': < ResourceRef 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-10 09:02:01,719::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-10 09:02:01,719::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' >Thread-34::DEBUG::2014-07-10 09:02:01,720::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' (0 active users) >Thread-34::DEBUG::2014-07-10 09:02:01,720::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-10 09:02:01,720::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', Clearing records. >Thread-34::DEBUG::2014-07-10 09:02:01,720::task::990::TaskManager.Task::(_decref) Task=`024a04df-7d8a-4431-b9b2-7a631da997e9`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 09:02:02,112::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:02:02,241::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0580936 s, 17.6 MB/s\n'; <rc> = 0 >GuestMonitor-scale_2::DEBUG::2014-07-10 09:02:02,918::vm::676::vm.Vm::(_getDiskStats) vmId=`52e238aa-e62a-48a8-a200-604e72422f3f`::Disk hdd stats not available >GuestMonitor-scale_2::DEBUG::2014-07-10 09:02:02,919::vm::676::vm.Vm::(_getDiskStats) vmId=`52e238aa-e62a-48a8-a200-604e72422f3f`::Disk hdc stats not available >GuestMonitor-scale_2::DEBUG::2014-07-10 09:02:02,919::vm::676::vm.Vm::(_getDiskStats) vmId=`52e238aa-e62a-48a8-a200-604e72422f3f`::Disk vda stats not available >GuestMonitor-scale_2::DEBUG::2014-07-10 09:02:02,920::vm::715::vm.Vm::(_getDiskLatency) vmId=`52e238aa-e62a-48a8-a200-604e72422f3f`::Disk hdd latency not available >GuestMonitor-scale_2::DEBUG::2014-07-10 09:02:02,920::vm::715::vm.Vm::(_getDiskLatency) vmId=`52e238aa-e62a-48a8-a200-604e72422f3f`::Disk hdc latency not available >GuestMonitor-scale_2::DEBUG::2014-07-10 09:02:02,920::vm::715::vm.Vm::(_getDiskLatency) vmId=`52e238aa-e62a-48a8-a200-604e72422f3f`::Disk vda latency not available >GuestMonitor-scale_2::DEBUG::2014-07-10 09:02:02,921::vm::676::vm.Vm::(_getDiskStats) vmId=`52e238aa-e62a-48a8-a200-604e72422f3f`::Disk hdd stats not available >GuestMonitor-scale_2::DEBUG::2014-07-10 09:02:02,921::vm::676::vm.Vm::(_getDiskStats) vmId=`52e238aa-e62a-48a8-a200-604e72422f3f`::Disk hdc stats not available >GuestMonitor-scale_2::DEBUG::2014-07-10 09:02:02,921::vm::676::vm.Vm::(_getDiskStats) vmId=`52e238aa-e62a-48a8-a200-604e72422f3f`::Disk vda stats not available >GuestMonitor-scale_2::DEBUG::2014-07-10 09:02:02,921::vm::715::vm.Vm::(_getDiskLatency) vmId=`52e238aa-e62a-48a8-a200-604e72422f3f`::Disk hdd latency not available >GuestMonitor-scale_2::DEBUG::2014-07-10 09:02:02,921::vm::715::vm.Vm::(_getDiskLatency) vmId=`52e238aa-e62a-48a8-a200-604e72422f3f`::Disk hdc latency not available >GuestMonitor-scale_2::DEBUG::2014-07-10 09:02:02,922::vm::715::vm.Vm::(_getDiskLatency) vmId=`52e238aa-e62a-48a8-a200-604e72422f3f`::Disk vda latency not available >GuestMonitor-scale_3::DEBUG::2014-07-10 09:02:02,924::vm::598::vm.Vm::(_getCpuStats) vmId=`949f6c19-87b5-4f16-a91c-0049749423ea`::CPU stats not available: 'NoneType' object is unsubscriptable >GuestMonitor-scale_3::DEBUG::2014-07-10 09:02:02,924::vm::654::vm.Vm::(_getNetworkStats) vmId=`949f6c19-87b5-4f16-a91c-0049749423ea`::Network stats not available >GuestMonitor-scale_3::DEBUG::2014-07-10 09:02:02,924::vm::676::vm.Vm::(_getDiskStats) vmId=`949f6c19-87b5-4f16-a91c-0049749423ea`::Disk hdd stats not available >GuestMonitor-scale_3::DEBUG::2014-07-10 09:02:02,924::vm::676::vm.Vm::(_getDiskStats) vmId=`949f6c19-87b5-4f16-a91c-0049749423ea`::Disk hdc stats not available >GuestMonitor-scale_3::DEBUG::2014-07-10 09:02:02,925::vm::676::vm.Vm::(_getDiskStats) vmId=`949f6c19-87b5-4f16-a91c-0049749423ea`::Disk vda stats not available >GuestMonitor-scale_3::DEBUG::2014-07-10 09:02:02,925::vm::715::vm.Vm::(_getDiskLatency) vmId=`949f6c19-87b5-4f16-a91c-0049749423ea`::Disk hdd latency not available >GuestMonitor-scale_3::DEBUG::2014-07-10 09:02:02,925::vm::715::vm.Vm::(_getDiskLatency) vmId=`949f6c19-87b5-4f16-a91c-0049749423ea`::Disk hdc latency not available >GuestMonitor-scale_3::DEBUG::2014-07-10 09:02:02,925::vm::715::vm.Vm::(_getDiskLatency) vmId=`949f6c19-87b5-4f16-a91c-0049749423ea`::Disk vda latency not available >GuestMonitor-scale_3::DEBUG::2014-07-10 09:02:02,925::vm::598::vm.Vm::(_getCpuStats) vmId=`949f6c19-87b5-4f16-a91c-0049749423ea`::CPU stats not available: 'NoneType' object is unsubscriptable >GuestMonitor-scale_3::DEBUG::2014-07-10 09:02:02,926::vm::654::vm.Vm::(_getNetworkStats) vmId=`949f6c19-87b5-4f16-a91c-0049749423ea`::Network stats not available >GuestMonitor-scale_3::DEBUG::2014-07-10 09:02:02,926::vm::676::vm.Vm::(_getDiskStats) vmId=`949f6c19-87b5-4f16-a91c-0049749423ea`::Disk hdd stats not available >GuestMonitor-scale_3::DEBUG::2014-07-10 09:02:02,926::vm::676::vm.Vm::(_getDiskStats) vmId=`949f6c19-87b5-4f16-a91c-0049749423ea`::Disk hdc stats not available >GuestMonitor-scale_3::DEBUG::2014-07-10 09:02:02,926::vm::676::vm.Vm::(_getDiskStats) vmId=`949f6c19-87b5-4f16-a91c-0049749423ea`::Disk vda stats not available >GuestMonitor-scale_3::DEBUG::2014-07-10 09:02:02,926::vm::715::vm.Vm::(_getDiskLatency) vmId=`949f6c19-87b5-4f16-a91c-0049749423ea`::Disk hdd latency not available >GuestMonitor-scale_3::DEBUG::2014-07-10 09:02:02,926::vm::715::vm.Vm::(_getDiskLatency) vmId=`949f6c19-87b5-4f16-a91c-0049749423ea`::Disk hdc latency not available >GuestMonitor-scale_3::DEBUG::2014-07-10 09:02:02,927::vm::715::vm.Vm::(_getDiskLatency) vmId=`949f6c19-87b5-4f16-a91c-0049749423ea`::Disk vda latency not available >GuestMonitor-scale_1::DEBUG::2014-07-10 09:02:02,984::vm::676::vm.Vm::(_getDiskStats) vmId=`ed909f7e-0ee2-4f6f-b4a5-a165f689a276`::Disk hdd stats not available >Thread-14::DEBUG::2014-07-10 09:02:02,984::BindingXMLRPC::1067::vds::(wrapper) client [10.35.3.13]::call vmGetStats with ('52e238aa-e62a-48a8-a200-604e72422f3f',) {} >GuestMonitor-scale_1::DEBUG::2014-07-10 09:02:02,985::vm::676::vm.Vm::(_getDiskStats) vmId=`ed909f7e-0ee2-4f6f-b4a5-a165f689a276`::Disk hdc stats not available >Thread-14::DEBUG::2014-07-10 09:02:02,986::vm::676::vm.Vm::(_getDiskStats) vmId=`52e238aa-e62a-48a8-a200-604e72422f3f`::Disk hdd stats not available >GuestMonitor-scale_1::DEBUG::2014-07-10 09:02:02,987::vm::676::vm.Vm::(_getDiskStats) vmId=`ed909f7e-0ee2-4f6f-b4a5-a165f689a276`::Disk vda stats not available >Thread-14::DEBUG::2014-07-10 09:02:02,987::vm::676::vm.Vm::(_getDiskStats) vmId=`52e238aa-e62a-48a8-a200-604e72422f3f`::Disk hdc stats not available >GuestMonitor-scale_1::DEBUG::2014-07-10 09:02:02,988::vm::715::vm.Vm::(_getDiskLatency) vmId=`ed909f7e-0ee2-4f6f-b4a5-a165f689a276`::Disk hdd latency not available >Thread-14::DEBUG::2014-07-10 09:02:02,988::vm::676::vm.Vm::(_getDiskStats) vmId=`52e238aa-e62a-48a8-a200-604e72422f3f`::Disk vda stats not available >GuestMonitor-scale_1::DEBUG::2014-07-10 09:02:02,989::vm::715::vm.Vm::(_getDiskLatency) vmId=`ed909f7e-0ee2-4f6f-b4a5-a165f689a276`::Disk hdc latency not available >Thread-14::DEBUG::2014-07-10 09:02:02,989::vm::715::vm.Vm::(_getDiskLatency) vmId=`52e238aa-e62a-48a8-a200-604e72422f3f`::Disk hdd latency not available >GuestMonitor-scale_1::DEBUG::2014-07-10 09:02:02,989::vm::715::vm.Vm::(_getDiskLatency) vmId=`ed909f7e-0ee2-4f6f-b4a5-a165f689a276`::Disk vda latency not available >Thread-14::DEBUG::2014-07-10 09:02:02,990::vm::715::vm.Vm::(_getDiskLatency) vmId=`52e238aa-e62a-48a8-a200-604e72422f3f`::Disk hdc latency not available >GuestMonitor-scale_1::DEBUG::2014-07-10 09:02:02,991::vm::676::vm.Vm::(_getDiskStats) vmId=`ed909f7e-0ee2-4f6f-b4a5-a165f689a276`::Disk hdd stats not available >Thread-14::DEBUG::2014-07-10 09:02:02,991::vm::715::vm.Vm::(_getDiskLatency) vmId=`52e238aa-e62a-48a8-a200-604e72422f3f`::Disk vda latency not available >GuestMonitor-scale_1::DEBUG::2014-07-10 09:02:02,992::vm::676::vm.Vm::(_getDiskStats) vmId=`ed909f7e-0ee2-4f6f-b4a5-a165f689a276`::Disk hdc stats not available >Thread-14::DEBUG::2014-07-10 09:02:02,993::BindingXMLRPC::1074::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Powering up', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '12236', 'displayIp': '0', 'displayPort': u'5902', 'session': 'Unknown', 'displaySecurePort': u'5903', 'timeOffset': '0', 'hash': '-5500930374920933700', 'balloonInfo': {'balloon_max': '1048576', 'balloon_target': '1048576', 'balloon_cur': '1048576', 'balloon_min': '1048576'}, 'pauseCode': 'NOERR', 'clientIp': '', 'kvmEnable': 'true', 'network': {u'vnet1': {'macAddr': '00:1a:4a:de:6d:7b', 'rxDropped': '0', 'rxErrors': '0', 'txDropped': '0', 'txRate': '0.0', 'rxRate': '0.0', 'txErrors': '0', 'state': 'unknown', 'speed': '1000', 'name': u'vnet1'}}, 'vmId': '52e238aa-e62a-48a8-a200-604e72422f3f', 'displayType': 'qxl', 'cpuUser': '46.44', 'disks': {u'vda': {'truesize': '1073741824', 'apparentsize': '1073741824', 'imageID': '76fdb054-02cd-42ed-9721-b3e65b34c3a4'}, u'hdd': {'truesize': '0', 'apparentsize': '0'}, u'hdc': {'truesize': '0', 'apparentsize': '0'}}, 'monitorResponse': '0', 'statsAge': '1.64', 'elapsedTime': '36', 'vmType': 'kvm', 'cpuSys': '1.72', 'guestCPUCount': -1, 'appsList': [], 'guestIPs': ''}]} >GuestMonitor-scale_1::DEBUG::2014-07-10 09:02:02,993::vm::676::vm.Vm::(_getDiskStats) vmId=`ed909f7e-0ee2-4f6f-b4a5-a165f689a276`::Disk vda stats not available >GuestMonitor-scale_1::DEBUG::2014-07-10 09:02:02,995::vm::715::vm.Vm::(_getDiskLatency) vmId=`ed909f7e-0ee2-4f6f-b4a5-a165f689a276`::Disk hdd latency not available >GuestMonitor-scale_1::DEBUG::2014-07-10 09:02:02,995::vm::715::vm.Vm::(_getDiskLatency) vmId=`ed909f7e-0ee2-4f6f-b4a5-a165f689a276`::Disk hdc latency not available >GuestMonitor-scale_1::DEBUG::2014-07-10 09:02:02,995::vm::715::vm.Vm::(_getDiskLatency) vmId=`ed909f7e-0ee2-4f6f-b4a5-a165f689a276`::Disk vda latency not available >Thread-14::DEBUG::2014-07-10 09:02:02,999::BindingXMLRPC::1067::vds::(wrapper) client [10.35.3.13]::call vmGetStats with ('949f6c19-87b5-4f16-a91c-0049749423ea',) {} >Thread-14::DEBUG::2014-07-10 09:02:02,999::vm::598::vm.Vm::(_getCpuStats) vmId=`949f6c19-87b5-4f16-a91c-0049749423ea`::CPU stats not available: 'NoneType' object is unsubscriptable >Thread-14::DEBUG::2014-07-10 09:02:03,000::vm::654::vm.Vm::(_getNetworkStats) vmId=`949f6c19-87b5-4f16-a91c-0049749423ea`::Network stats not available >Thread-14::DEBUG::2014-07-10 09:02:03,000::vm::676::vm.Vm::(_getDiskStats) vmId=`949f6c19-87b5-4f16-a91c-0049749423ea`::Disk hdd stats not available >Thread-14::DEBUG::2014-07-10 09:02:03,000::vm::676::vm.Vm::(_getDiskStats) vmId=`949f6c19-87b5-4f16-a91c-0049749423ea`::Disk hdc stats not available >Thread-14::DEBUG::2014-07-10 09:02:03,000::vm::676::vm.Vm::(_getDiskStats) vmId=`949f6c19-87b5-4f16-a91c-0049749423ea`::Disk vda stats not available >Thread-14::DEBUG::2014-07-10 09:02:03,000::vm::715::vm.Vm::(_getDiskLatency) vmId=`949f6c19-87b5-4f16-a91c-0049749423ea`::Disk hdd latency not available >Thread-14::DEBUG::2014-07-10 09:02:03,001::vm::715::vm.Vm::(_getDiskLatency) vmId=`949f6c19-87b5-4f16-a91c-0049749423ea`::Disk hdc latency not available >Thread-14::DEBUG::2014-07-10 09:02:03,001::vm::715::vm.Vm::(_getDiskLatency) vmId=`949f6c19-87b5-4f16-a91c-0049749423ea`::Disk vda latency not available >Thread-14::DEBUG::2014-07-10 09:02:03,001::BindingXMLRPC::1074::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Powering up', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '12860', 'displayIp': '0', 'displayPort': u'5904', 'session': 'Unknown', 'displaySecurePort': u'5905', 'timeOffset': '0', 'hash': '-1803473594666319662', 'balloonInfo': {'balloon_max': '1048576', 'balloon_target': '1048576', 'balloon_cur': '0', 'balloon_min': '1048576'}, 'pauseCode': 'NOERR', 'clientIp': '', 'kvmEnable': 'true', 'network': {u'vnet2': {'state': 'unknown', 'macAddr': '00:1a:4a:de:6d:7e', 'speed': '1000', 'name': u'vnet2'}}, 'vmId': '949f6c19-87b5-4f16-a91c-0049749423ea', 'displayType': 'qxl', 'cpuUser': '0.00', 'disks': {u'vda': {'truesize': '1073741824', 'apparentsize': '1073741824', 'imageID': '28408446-e5fd-4565-a976-e760951593fe'}, u'hdd': {'truesize': '0', 'apparentsize': '0'}, u'hdc': {'truesize': '0', 'apparentsize': '0'}}, 'monitorResponse': '0', 'statsAge': '0.12', 'elapsedTime': '16', 'vmType': 'kvm', 'cpuSys': '0.00', 'guestCPUCount': -1, 'appsList': [], 'guestIPs': ''}]} >Thread-40::DEBUG::2014-07-10 09:02:04,163::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lion.qa.lab.tlv.redhat.com:_export_yuri2_backup2/6a70504d-00df-4869-8695-0f442053f6b6/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-40::DEBUG::2014-07-10 09:02:04,179::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n369 bytes (369 B) copied, 0.000407977 s, 904 kB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:02:04,255::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:02:04,375::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.065714 s, 15.6 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 09:02:05,262::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-14::DEBUG::2014-07-10 09:02:05,262::task::595::TaskManager.Task::(_updateState) Task=`389da9c4-7534-48ad-943c-720c030a9a9a`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 09:02:05,263::logUtils::44::dispatcher::(wrapper) Run and protect: getAllTasksStatuses(spUUID=None, options=None) >Thread-14::DEBUG::2014-07-10 09:02:05,263::taskManager::102::TaskManager::(getAllTasksStatuses) Entry. >Thread-14::DEBUG::2014-07-10 09:02:05,263::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 459f9833-5455-4a84-a83e-98aead3d52c9 >Thread-14::DEBUG::2014-07-10 09:02:05,263::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': '1 jobs completed successfully', 'taskState': 'finished', 'taskResult': 'success', 'taskID': '459f9833-5455-4a84-a83e-98aead3d52c9'} >Thread-14::DEBUG::2014-07-10 09:02:05,264::taskManager::113::TaskManager::(getAllTasksStatuses) Return: {'459f9833-5455-4a84-a83e-98aead3d52c9': {'code': 0, 'message': '1 jobs completed successfully', 'taskState': 'finished', 'taskResult': 'success', 'taskID': '459f9833-5455-4a84-a83e-98aead3d52c9'}} >Thread-14::INFO::2014-07-10 09:02:05,264::logUtils::47::dispatcher::(wrapper) Run and protect: getAllTasksStatuses, Return response: {'allTasksStatus': {'459f9833-5455-4a84-a83e-98aead3d52c9': {'code': 0, 'message': '1 jobs completed successfully', 'taskState': 'finished', 'taskResult': 'success', 'taskID': '459f9833-5455-4a84-a83e-98aead3d52c9'}}} >Thread-14::DEBUG::2014-07-10 09:02:05,264::task::1185::TaskManager.Task::(prepare) Task=`389da9c4-7534-48ad-943c-720c030a9a9a`::finished: {'allTasksStatus': {'459f9833-5455-4a84-a83e-98aead3d52c9': {'code': 0, 'message': '1 jobs completed successfully', 'taskState': 'finished', 'taskResult': 'success', 'taskID': '459f9833-5455-4a84-a83e-98aead3d52c9'}}} >Thread-14::DEBUG::2014-07-10 09:02:05,264::task::595::TaskManager.Task::(_updateState) Task=`389da9c4-7534-48ad-943c-720c030a9a9a`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 09:02:05,265::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 09:02:05,265::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 09:02:05,265::task::990::TaskManager.Task::(_decref) Task=`389da9c4-7534-48ad-943c-720c030a9a9a`::ref 0 aborting False >Thread-34::DEBUG::2014-07-10 09:02:05,308::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [50ce8598] >Thread-34::DEBUG::2014-07-10 09:02:05,308::task::595::TaskManager.Task::(_updateState) Task=`686531dd-43ca-4296-a2bd-d1c0a59a682e`::moving from state init -> state preparing >Thread-34::INFO::2014-07-10 09:02:05,309::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeInfo(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='b6f6c0da-e67f-4902-b9ac-3069571a42fe', volUUID='c4cd1da8-05b7-45e0-80b1-1183d21443d9', options=None) >Thread-34::DEBUG::2014-07-10 09:02:05,309::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.9e1aa540-1f4e-4ee3-a152-be381ef6c3bd`ReqID=`8f9de0d0-7eba-473e-90f8-af5e262316d8`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '3089' at 'getVolumeInfo' >Thread-34::DEBUG::2014-07-10 09:02:05,310::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.9e1aa540-1f4e-4ee3-a152-be381ef6c3bd' for lock type 'shared' >Thread-34::DEBUG::2014-07-10 09:02:05,310::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.9e1aa540-1f4e-4ee3-a152-be381ef6c3bd' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-10 09:02:05,310::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.9e1aa540-1f4e-4ee3-a152-be381ef6c3bd`ReqID=`8f9de0d0-7eba-473e-90f8-af5e262316d8`::Granted request >Thread-34::DEBUG::2014-07-10 09:02:05,311::task::827::TaskManager.Task::(resourceAcquired) Task=`686531dd-43ca-4296-a2bd-d1c0a59a682e`::_resourcesAcquired: Storage.9e1aa540-1f4e-4ee3-a152-be381ef6c3bd (shared) >Thread-34::DEBUG::2014-07-10 09:02:05,311::task::990::TaskManager.Task::(_decref) Task=`686531dd-43ca-4296-a2bd-d1c0a59a682e`::ref 1 aborting False >Thread-34::DEBUG::2014-07-10 09:02:05,311::lvm::427::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' got the operation mutex >Thread-34::DEBUG::2014-07-10 09:02:05,312::lvm::296::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm lvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/3600601601282300032826addbbdae311|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,vg_name,attr,size,seg_start_pe,devices,tags 9e1aa540-1f4e-4ee3-a152-be381ef6c3bd' (cwd None) >Thread-34::DEBUG::2014-07-10 09:02:05,562::lvm::296::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-34::DEBUG::2014-07-10 09:02:05,573::lvm::462::Storage.LVM::(_reloadlvs) lvs reloaded >Thread-34::DEBUG::2014-07-10 09:02:05,573::lvm::462::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' released the operation mutex >Thread-34::INFO::2014-07-10 09:02:05,573::volume::879::Storage.Volume::(getInfo) Info request: sdUUID=9e1aa540-1f4e-4ee3-a152-be381ef6c3bd imgUUID=b6f6c0da-e67f-4902-b9ac-3069571a42fe volUUID = c4cd1da8-05b7-45e0-80b1-1183d21443d9 >Thread-34::DEBUG::2014-07-10 09:02:05,574::blockVolume::572::Storage.Misc.excCmd::(getMetadata) '/bin/dd iflag=direct skip=8 bs=512 if=/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/metadata count=1' (cwd None) >Thread-34::DEBUG::2014-07-10 09:02:05,588::blockVolume::572::Storage.Misc.excCmd::(getMetadata) SUCCESS: <err> = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.000648842 s, 789 kB/s\n'; <rc> = 0 >Thread-34::DEBUG::2014-07-10 09:02:05,588::misc::282::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.000648842 s, 789 kB/s'], size: 512 >Thread-34::DEBUG::2014-07-10 09:02:05,589::blockVolume::572::Storage.Misc.excCmd::(getMetadata) '/bin/dd iflag=direct skip=8 bs=512 if=/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/metadata count=1' (cwd None) >Thread-34::DEBUG::2014-07-10 09:02:05,603::blockVolume::572::Storage.Misc.excCmd::(getMetadata) SUCCESS: <err> = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.000522634 s, 980 kB/s\n'; <rc> = 0 >Thread-34::DEBUG::2014-07-10 09:02:05,604::misc::282::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.000522634 s, 980 kB/s'], size: 512 >Thread-34::INFO::2014-07-10 09:02:05,604::volume::909::Storage.Volume::(getInfo) 9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/b6f6c0da-e67f-4902-b9ac-3069571a42fe/c4cd1da8-05b7-45e0-80b1-1183d21443d9 info is {'status': 'OK', 'domain': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'voltype': 'LEAF', 'description': '', 'parent': '47592965-e853-4e59-9728-d11cca6a7a8a', 'format': 'COW', 'image': 'b6f6c0da-e67f-4902-b9ac-3069571a42fe', 'ctime': '1404982918', 'disktype': '2', 'legality': 'LEGAL', 'mtime': '1404982918', 'apparentsize': '1073741824', 'children': [], 'pool': '', 'capacity': '10737418240', 'uuid': 'c4cd1da8-05b7-45e0-80b1-1183d21443d9', 'truesize': '1073741824', 'type': 'SPARSE'} >Thread-34::INFO::2014-07-10 09:02:05,604::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeInfo, Return response: {'info': {'status': 'OK', 'domain': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'voltype': 'LEAF', 'description': '', 'parent': '47592965-e853-4e59-9728-d11cca6a7a8a', 'format': 'COW', 'image': 'b6f6c0da-e67f-4902-b9ac-3069571a42fe', 'ctime': '1404982918', 'disktype': '2', 'legality': 'LEGAL', 'mtime': '1404982918', 'apparentsize': '1073741824', 'children': [], 'pool': '', 'capacity': '10737418240', 'uuid': 'c4cd1da8-05b7-45e0-80b1-1183d21443d9', 'truesize': '1073741824', 'type': 'SPARSE'}} >Thread-34::DEBUG::2014-07-10 09:02:05,605::task::1185::TaskManager.Task::(prepare) Task=`686531dd-43ca-4296-a2bd-d1c0a59a682e`::finished: {'info': {'status': 'OK', 'domain': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'voltype': 'LEAF', 'description': '', 'parent': '47592965-e853-4e59-9728-d11cca6a7a8a', 'format': 'COW', 'image': 'b6f6c0da-e67f-4902-b9ac-3069571a42fe', 'ctime': '1404982918', 'disktype': '2', 'legality': 'LEGAL', 'mtime': '1404982918', 'apparentsize': '1073741824', 'children': [], 'pool': '', 'capacity': '10737418240', 'uuid': 'c4cd1da8-05b7-45e0-80b1-1183d21443d9', 'truesize': '1073741824', 'type': 'SPARSE'}} >Thread-34::DEBUG::2014-07-10 09:02:05,605::task::595::TaskManager.Task::(_updateState) Task=`686531dd-43ca-4296-a2bd-d1c0a59a682e`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-10 09:02:05,605::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': < ResourceRef 'Storage.9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-10 09:02:05,605::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-10 09:02:05,606::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.9e1aa540-1f4e-4ee3-a152-be381ef6c3bd' >Thread-34::DEBUG::2014-07-10 09:02:05,606::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.9e1aa540-1f4e-4ee3-a152-be381ef6c3bd' (0 active users) >Thread-34::DEBUG::2014-07-10 09:02:05,606::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.9e1aa540-1f4e-4ee3-a152-be381ef6c3bd' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-10 09:02:05,606::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', Clearing records. >Thread-34::DEBUG::2014-07-10 09:02:05,607::task::990::TaskManager.Task::(_decref) Task=`686531dd-43ca-4296-a2bd-d1c0a59a682e`::ref 0 aborting False >Thread-14::DEBUG::2014-07-10 09:02:05,647::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-14::DEBUG::2014-07-10 09:02:05,647::task::595::TaskManager.Task::(_updateState) Task=`854c5543-04d3-4ad2-be59-a3c26af60b3c`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 09:02:05,648::logUtils::44::dispatcher::(wrapper) Run and protect: clearTask(taskID='459f9833-5455-4a84-a83e-98aead3d52c9', spUUID=None, options=None) >Thread-14::DEBUG::2014-07-10 09:02:05,648::taskManager::161::TaskManager::(clearTask) Entry. taskID: 459f9833-5455-4a84-a83e-98aead3d52c9 >Thread-14::DEBUG::2014-07-10 09:02:05,649::taskManager::166::TaskManager::(clearTask) Return. >Thread-14::INFO::2014-07-10 09:02:05,650::logUtils::47::dispatcher::(wrapper) Run and protect: clearTask, Return response: None >Thread-14::DEBUG::2014-07-10 09:02:05,650::task::1185::TaskManager.Task::(prepare) Task=`854c5543-04d3-4ad2-be59-a3c26af60b3c`::finished: None >Thread-14::DEBUG::2014-07-10 09:02:05,650::task::595::TaskManager.Task::(_updateState) Task=`854c5543-04d3-4ad2-be59-a3c26af60b3c`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 09:02:05,650::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 09:02:05,650::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 09:02:05,651::task::990::TaskManager.Task::(_decref) Task=`854c5543-04d3-4ad2-be59-a3c26af60b3c`::ref 0 aborting False >Thread-14::DEBUG::2014-07-10 09:02:06,013::BindingXMLRPC::1067::vds::(wrapper) client [10.35.3.13]::call vmGetStats with ('52e238aa-e62a-48a8-a200-604e72422f3f',) {} >Thread-14::DEBUG::2014-07-10 09:02:06,014::vm::676::vm.Vm::(_getDiskStats) vmId=`52e238aa-e62a-48a8-a200-604e72422f3f`::Disk hdd stats not available >Thread-14::DEBUG::2014-07-10 09:02:06,014::vm::676::vm.Vm::(_getDiskStats) vmId=`52e238aa-e62a-48a8-a200-604e72422f3f`::Disk hdc stats not available >Thread-14::DEBUG::2014-07-10 09:02:06,014::vm::676::vm.Vm::(_getDiskStats) vmId=`52e238aa-e62a-48a8-a200-604e72422f3f`::Disk vda stats not available >Thread-14::DEBUG::2014-07-10 09:02:06,015::vm::715::vm.Vm::(_getDiskLatency) vmId=`52e238aa-e62a-48a8-a200-604e72422f3f`::Disk hdd latency not available >Thread-14::DEBUG::2014-07-10 09:02:06,015::vm::715::vm.Vm::(_getDiskLatency) vmId=`52e238aa-e62a-48a8-a200-604e72422f3f`::Disk hdc latency not available >Thread-14::DEBUG::2014-07-10 09:02:06,015::vm::715::vm.Vm::(_getDiskLatency) vmId=`52e238aa-e62a-48a8-a200-604e72422f3f`::Disk vda latency not available >Thread-14::DEBUG::2014-07-10 09:02:06,015::BindingXMLRPC::1074::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Powering up', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '12236', 'displayIp': '0', 'displayPort': u'5902', 'session': 'Unknown', 'displaySecurePort': u'5903', 'timeOffset': '0', 'hash': '-5500930374920933700', 'balloonInfo': {'balloon_max': '1048576', 'balloon_target': '1048576', 'balloon_cur': '1048576', 'balloon_min': '1048576'}, 'pauseCode': 'NOERR', 'clientIp': '', 'kvmEnable': 'true', 'network': {u'vnet1': {'macAddr': '00:1a:4a:de:6d:7b', 'rxDropped': '0', 'rxErrors': '0', 'txDropped': '0', 'txRate': '0.0', 'rxRate': '0.0', 'txErrors': '0', 'state': 'unknown', 'speed': '1000', 'name': u'vnet1'}}, 'vmId': '52e238aa-e62a-48a8-a200-604e72422f3f', 'displayType': 'qxl', 'cpuUser': '46.44', 'disks': {u'vda': {'truesize': '1073741824', 'apparentsize': '1073741824', 'imageID': '76fdb054-02cd-42ed-9721-b3e65b34c3a4'}, u'hdd': {'truesize': '0', 'apparentsize': '0'}, u'hdc': {'truesize': '0', 'apparentsize': '0'}}, 'monitorResponse': '0', 'statsAge': '0.66', 'elapsedTime': '39', 'vmType': 'kvm', 'cpuSys': '1.72', 'guestCPUCount': -1, 'appsList': [], 'guestIPs': ''}]} >Thread-14::DEBUG::2014-07-10 09:02:06,020::BindingXMLRPC::1067::vds::(wrapper) client [10.35.3.13]::call vmGetStats with ('949f6c19-87b5-4f16-a91c-0049749423ea',) {} >Thread-14::DEBUG::2014-07-10 09:02:06,020::vm::676::vm.Vm::(_getDiskStats) vmId=`949f6c19-87b5-4f16-a91c-0049749423ea`::Disk hdd stats not available >Thread-14::DEBUG::2014-07-10 09:02:06,021::vm::676::vm.Vm::(_getDiskStats) vmId=`949f6c19-87b5-4f16-a91c-0049749423ea`::Disk hdc stats not available >Thread-14::DEBUG::2014-07-10 09:02:06,021::vm::676::vm.Vm::(_getDiskStats) vmId=`949f6c19-87b5-4f16-a91c-0049749423ea`::Disk vda stats not available >Thread-14::DEBUG::2014-07-10 09:02:06,021::vm::715::vm.Vm::(_getDiskLatency) vmId=`949f6c19-87b5-4f16-a91c-0049749423ea`::Disk hdd latency not available >Thread-14::DEBUG::2014-07-10 09:02:06,021::vm::715::vm.Vm::(_getDiskLatency) vmId=`949f6c19-87b5-4f16-a91c-0049749423ea`::Disk hdc latency not available >Thread-14::DEBUG::2014-07-10 09:02:06,021::vm::715::vm.Vm::(_getDiskLatency) vmId=`949f6c19-87b5-4f16-a91c-0049749423ea`::Disk vda latency not available >Thread-14::DEBUG::2014-07-10 09:02:06,022::BindingXMLRPC::1074::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Powering up', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '12860', 'displayIp': '0', 'displayPort': u'5904', 'session': 'Unknown', 'displaySecurePort': u'5905', 'timeOffset': '0', 'hash': '-1803473594666319662', 'balloonInfo': {'balloon_max': '1048576', 'balloon_target': '1048576', 'balloon_cur': '1048576', 'balloon_min': '1048576'}, 'pauseCode': 'NOERR', 'clientIp': '', 'kvmEnable': 'true', 'network': {u'vnet2': {'macAddr': '00:1a:4a:de:6d:7e', 'rxDropped': '0', 'rxErrors': '0', 'txDropped': '0', 'txRate': '0.0', 'rxRate': '0.0', 'txErrors': '0', 'state': 'unknown', 'speed': '1000', 'name': u'vnet2'}}, 'vmId': '949f6c19-87b5-4f16-a91c-0049749423ea', 'displayType': 'qxl', 'cpuUser': '44.67', 'disks': {u'vda': {'truesize': '1073741824', 'apparentsize': '1073741824', 'imageID': '28408446-e5fd-4565-a976-e760951593fe'}, u'hdd': {'truesize': '0', 'apparentsize': '0'}, u'hdc': {'truesize': '0', 'apparentsize': '0'}}, 'monitorResponse': '0', 'statsAge': '1.12', 'elapsedTime': '19', 'vmType': 'kvm', 'cpuSys': '21.95', 'guestCPUCount': -1, 'appsList': [], 'guestIPs': ''}]} >Thread-14::DEBUG::2014-07-10 09:02:06,054::BindingXMLRPC::1067::vds::(wrapper) client [10.35.3.13]::call vmCreate with ({'acpiEnable': 'true', 'emulatedMachine': 'rhel6.5.0', 'vmId': '0e968db5-5d49-467f-9ff3-afc37b64364f', 'memGuaranteedSize': 1024, 'spiceSslCipherSuite': 'DEFAULT', 'timeOffset': '0', 'cpuType': 'Conroe', 'custom': {'device_798a900d-2477-43da-840d-256c0e84a18c': 'VmDevice {vmId=0e968db5-5d49-467f-9ff3-afc37b64364f, deviceId=798a900d-2477-43da-840d-256c0e84a18c, device=spicevmc, type=CHANNEL, bootOrder=0, specParams={}, address={port=3, bus=0, controller=0, type=virtio-serial}, managed=false, plugged=true, readOnly=false, deviceAlias=channel2, customProperties={}, snapshotId=null}', 'device_798a900d-2477-43da-840d-256c0e84a18cdevice_90531d69-9815-48e0-87e2-0eb07ce800bedevice_9fe71b49-fe03-4e11-acba-87aeb0a8d2f9device_b625f19d-3595-442a-8de7-84c3cef991a7device_e1876636-5bd8-4442-b82f-1403cdb5aac1': 'VmDevice {vmId=0e968db5-5d49-467f-9ff3-afc37b64364f, deviceId=e1876636-5bd8-4442-b82f-1403cdb5aac1, device=unix, type=CHANNEL, bootOrder=0, specParams={}, address={port=2, bus=0, controller=0, type=virtio-serial}, managed=false, plugged=true, readOnly=false, deviceAlias=channel1, customProperties={}, snapshotId=null}', 'device_798a900d-2477-43da-840d-256c0e84a18cdevice_90531d69-9815-48e0-87e2-0eb07ce800be': 'VmDevice {vmId=0e968db5-5d49-467f-9ff3-afc37b64364f, deviceId=90531d69-9815-48e0-87e2-0eb07ce800be, device=ide, type=CONTROLLER, bootOrder=0, specParams={}, address={bus=0x00, domain=0x0000, type=pci, slot=0x01, function=0x1}, managed=false, plugged=true, readOnly=false, deviceAlias=ide0, customProperties={}, snapshotId=null}', 'device_798a900d-2477-43da-840d-256c0e84a18cdevice_90531d69-9815-48e0-87e2-0eb07ce800bedevice_9fe71b49-fe03-4e11-acba-87aeb0a8d2f9': 'VmDevice {vmId=0e968db5-5d49-467f-9ff3-afc37b64364f, deviceId=9fe71b49-fe03-4e11-acba-87aeb0a8d2f9, device=unix, type=CHANNEL, bootOrder=0, specParams={}, address={port=1, bus=0, controller=0, type=virtio-serial}, managed=false, plugged=true, readOnly=false, deviceAlias=channel0, customProperties={}, snapshotId=null}', 'device_798a900d-2477-43da-840d-256c0e84a18cdevice_90531d69-9815-48e0-87e2-0eb07ce800bedevice_9fe71b49-fe03-4e11-acba-87aeb0a8d2f9device_b625f19d-3595-442a-8de7-84c3cef991a7': 'VmDevice {vmId=0e968db5-5d49-467f-9ff3-afc37b64364f, deviceId=b625f19d-3595-442a-8de7-84c3cef991a7, device=virtio-serial, type=CONTROLLER, bootOrder=0, specParams={}, address={bus=0x00, domain=0x0000, type=pci, slot=0x05, function=0x0}, managed=false, plugged=true, readOnly=false, deviceAlias=virtio-serial0, customProperties={}, snapshotId=null}'}, 'smp': '2', 'vmType': 'kvm', 'memSize': 1024, 'smpCoresPerSocket': '2', 'vmName': 'scale_4', 'nice': '0', 'smartcardEnable': 'false', 'keyboardLayout': 'en-us', 'kvmEnable': 'true', 'pitReinjection': 'false', 'transparentHugePages': 'true', 'devices': [{'index': '3', 'iface': 'ide', 'specParams': {'vmPayload': {'volId': 'config-2', 'file': {'openstack/latest/meta_data.json': 'ewogICJsYXVuY2hfaW5kZXgiIDogIjAiLAogICJhdmFpbGFiaWxpdHlfem9uZSIgOiAibm92YSIs\nCiAgInV1aWQiIDogIjFlOTA1YjI0LTljNGEtNGYwZS04NDNhLWRhOTg4ZDQxOGRhZiIsCiAgIm1l\ndGEiIDogewogICAgImVzc2VudGlhbCIgOiAiZmFsc2UiLAogICAgInJvbGUiIDogInNlcnZlciIs\nCiAgICAiZHNtb2RlIiA6ICJsb2NhbCIKICB9Cn0=\n', 'openstack/latest/user_data': 'I2Nsb3VkLWNvbmZpZwpzc2hfcHdhdXRoOiB0cnVlCmRpc2FibGVfcm9vdDogMApvdXRwdXQ6CiAg\nYWxsOiAnPj4gL3Zhci9sb2cvY2xvdWQtaW5pdC1vdXRwdXQubG9nJwp1c2VyOiByb290CmNocGFz\nc3dkOgogIGV4cGlyZTogZmFsc2UKcnVuY21kOgotICdzZWQgLWkgJycvXmRhdGFzb3VyY2VfbGlz\ndDogL2QnJyAvZXRjL2Nsb3VkL2Nsb3VkLmNmZzsgZWNobyAnJ2RhdGFzb3VyY2VfbGlzdDoKICBb\nIk5vQ2xvdWQiLCAiQ29uZmlnRHJpdmUiXScnID4+IC9ldGMvY2xvdWQvY2xvdWQuY2ZnJwo=\n'}}}, 'readonly': 'true', 'deviceId': 'b127a834-96c0-4c49-96ec-2736fe586133', 'path': '', 'device': 'cdrom', 'shared': 'false', 'type': 'disk'}, {'device': 'qxl', 'specParams': {'vram': '32768', 'ram': '65536', 'heads': '1'}, 'type': 'video', 'deviceId': '12da9394-af45-491a-9a49-1d056ce991fb'}, {'index': '2', 'iface': 'ide', 'specParams': {'path': ''}, 'readonly': 'true', 'deviceId': '208e05af-ab0a-4623-bca7-f432a5309a2a', 'path': '', 'device': 'cdrom', 'shared': 'false', 'type': 'disk'}, {'index': 0, 'iface': 'virtio', 'format': 'cow', 'bootOrder': '1', 'poolID': '4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', 'volumeID': 'c4cd1da8-05b7-45e0-80b1-1183d21443d9', 'imageID': 'b6f6c0da-e67f-4902-b9ac-3069571a42fe', 'specParams': {}, 'readonly': 'false', 'domainID': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'optional': 'false', 'deviceId': 'b6f6c0da-e67f-4902-b9ac-3069571a42fe', 'address': {'slot': '0x06', 'bus': '0x00', 'domain': '0x0000', 'type': 'pci', 'function': '0x0'}, 'device': 'disk', 'shared': 'false', 'propagateErrors': 'off', 'type': 'disk'}, {'nicModel': 'pv', 'macAddr': '00:1a:4a:de:6d:7f', 'linkActive': 'true', 'network': 'rhevm', 'filter': 'vdsm-no-mac-spoofing', 'specParams': {'inbound': {}, 'outbound': {}}, 'deviceId': '30e7f4b6-b9f0-4cfa-b0de-94e497ebc281', 'device': 'bridge', 'type': 'interface'}, {'device': 'memballoon', 'specParams': {'model': 'virtio'}, 'type': 'balloon', 'deviceId': '3e26b78e-e2f7-43bd-a235-77340973976e'}, {'index': '0', 'specParams': {}, 'deviceId': 'd086ec0f-71c0-43ca-8c52-3a787af3e76f', 'address': {'slot': '0x04', 'bus': '0x00', 'domain': '0x0000', 'type': 'pci', 'function': '0x0'}, 'device': 'scsi', 'model': 'virtio-scsi', 'type': 'controller'}], 'maxVCpus': '160', 'spiceSecureChannels': 'smain,sinputs,scursor,splayback,srecord,sdisplay,susbredir,ssmartcard', 'display': 'qxl'},) {} flowID [4b398c7b] >Thread-14::INFO::2014-07-10 09:02:06,058::API::667::vds::(_getNetworkIp) network None: using 0 >Thread-14::INFO::2014-07-10 09:02:06,059::clientIF::366::vds::(createVm) vmContainerLock acquired by vm 0e968db5-5d49-467f-9ff3-afc37b64364f >Thread-55::DEBUG::2014-07-10 09:02:06,063::vm::2270::vm.Vm::(_startUnderlyingVm) vmId=`0e968db5-5d49-467f-9ff3-afc37b64364f`::Start >Thread-14::DEBUG::2014-07-10 09:02:06,064::clientIF::379::vds::(createVm) Total desktops after creation of 0e968db5-5d49-467f-9ff3-afc37b64364f is 4 >Thread-55::DEBUG::2014-07-10 09:02:06,064::vm::2274::vm.Vm::(_startUnderlyingVm) vmId=`0e968db5-5d49-467f-9ff3-afc37b64364f`::_ongoingCreations acquired >Thread-14::DEBUG::2014-07-10 09:02:06,065::BindingXMLRPC::1074::vds::(wrapper) return vmCreate with {'status': {'message': 'Done', 'code': 0}, 'vmList': {'status': 'WaitForLaunch', 'acpiEnable': 'true', 'emulatedMachine': 'rhel6.5.0', 'vmId': '0e968db5-5d49-467f-9ff3-afc37b64364f', 'pid': '0', 'memGuaranteedSize': 1024, 'timeOffset': '0', 'keyboardLayout': 'en-us', 'displayPort': '-1', 'displaySecurePort': '-1', 'spiceSslCipherSuite': 'DEFAULT', 'cpuType': 'Conroe', 'smp': '2', 'clientIp': '', 'nicModel': 'rtl8139,pv', 'smartcardEnable': 'false', 'kvmEnable': 'true', 'pitReinjection': 'false', 'transparentHugePages': 'true', 'devices': [{'index': '3', 'iface': 'ide', 'specParams': {'vmPayload': {'volId': 'config-2', 'file': {'openstack/latest/meta_data.json': 'ewogICJsYXVuY2hfaW5kZXgiIDogIjAiLAogICJhdmFpbGFiaWxpdHlfem9uZSIgOiAibm92YSIs\nCiAgInV1aWQiIDogIjFlOTA1YjI0LTljNGEtNGYwZS04NDNhLWRhOTg4ZDQxOGRhZiIsCiAgIm1l\ndGEiIDogewogICAgImVzc2VudGlhbCIgOiAiZmFsc2UiLAogICAgInJvbGUiIDogInNlcnZlciIs\nCiAgICAiZHNtb2RlIiA6ICJsb2NhbCIKICB9Cn0=\n', 'openstack/latest/user_data': 'I2Nsb3VkLWNvbmZpZwpzc2hfcHdhdXRoOiB0cnVlCmRpc2FibGVfcm9vdDogMApvdXRwdXQ6CiAg\nYWxsOiAnPj4gL3Zhci9sb2cvY2xvdWQtaW5pdC1vdXRwdXQubG9nJwp1c2VyOiByb290CmNocGFz\nc3dkOgogIGV4cGlyZTogZmFsc2UKcnVuY21kOgotICdzZWQgLWkgJycvXmRhdGFzb3VyY2VfbGlz\ndDogL2QnJyAvZXRjL2Nsb3VkL2Nsb3VkLmNmZzsgZWNobyAnJ2RhdGFzb3VyY2VfbGlzdDoKICBb\nIk5vQ2xvdWQiLCAiQ29uZmlnRHJpdmUiXScnID4+IC9ldGMvY2xvdWQvY2xvdWQuY2ZnJwo=\n'}}}, 'readonly': 'true', 'deviceId': 'b127a834-96c0-4c49-96ec-2736fe586133', 'path': '', 'device': 'cdrom', 'shared': 'false', 'type': 'disk'}, {'device': 'qxl', 'specParams': {'vram': '32768', 'ram': '65536', 'heads': '1'}, 'type': 'video', 'deviceId': '12da9394-af45-491a-9a49-1d056ce991fb'}, {'index': '2', 'iface': 'ide', 'specParams': {'path': ''}, 'readonly': 'true', 'deviceId': '208e05af-ab0a-4623-bca7-f432a5309a2a', 'path': '', 'device': 'cdrom', 'shared': 'false', 'type': 'disk'}, {'index': 0, 'iface': 'virtio', 'format': 'cow', 'bootOrder': '1', 'poolID': '4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', 'volumeID': 'c4cd1da8-05b7-45e0-80b1-1183d21443d9', 'imageID': 'b6f6c0da-e67f-4902-b9ac-3069571a42fe', 'specParams': {}, 'readonly': 'false', 'domainID': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'optional': 'false', 'deviceId': 'b6f6c0da-e67f-4902-b9ac-3069571a42fe', 'address': {'slot': '0x06', 'bus': '0x00', 'domain': '0x0000', 'type': 'pci', 'function': '0x0'}, 'device': 'disk', 'shared': 'false', 'propagateErrors': 'off', 'type': 'disk'}, {'nicModel': 'pv', 'macAddr': '00:1a:4a:de:6d:7f', 'linkActive': 'true', 'network': 'rhevm', 'filter': 'vdsm-no-mac-spoofing', 'specParams': {'inbound': {}, 'outbound': {}}, 'deviceId': '30e7f4b6-b9f0-4cfa-b0de-94e497ebc281', 'device': 'bridge', 'type': 'interface'}, {'device': 'memballoon', 'specParams': {'model': 'virtio'}, 'type': 'balloon', 'deviceId': '3e26b78e-e2f7-43bd-a235-77340973976e'}, {'index': '0', 'specParams': {}, 'deviceId': 'd086ec0f-71c0-43ca-8c52-3a787af3e76f', 'address': {'slot': '0x04', 'bus': '0x00', 'domain': '0x0000', 'type': 'pci', 'function': '0x0'}, 'device': 'scsi', 'model': 'virtio-scsi', 'type': 'controller'}], 'custom': {'device_798a900d-2477-43da-840d-256c0e84a18c': 'VmDevice {vmId=0e968db5-5d49-467f-9ff3-afc37b64364f, deviceId=798a900d-2477-43da-840d-256c0e84a18c, device=spicevmc, type=CHANNEL, bootOrder=0, specParams={}, address={port=3, bus=0, controller=0, type=virtio-serial}, managed=false, plugged=true, readOnly=false, deviceAlias=channel2, customProperties={}, snapshotId=null}', 'device_798a900d-2477-43da-840d-256c0e84a18cdevice_90531d69-9815-48e0-87e2-0eb07ce800bedevice_9fe71b49-fe03-4e11-acba-87aeb0a8d2f9device_b625f19d-3595-442a-8de7-84c3cef991a7device_e1876636-5bd8-4442-b82f-1403cdb5aac1': 'VmDevice {vmId=0e968db5-5d49-467f-9ff3-afc37b64364f, deviceId=e1876636-5bd8-4442-b82f-1403cdb5aac1, device=unix, type=CHANNEL, bootOrder=0, specParams={}, address={port=2, bus=0, controller=0, type=virtio-serial}, managed=false, plugged=true, readOnly=false, deviceAlias=channel1, customProperties={}, snapshotId=null}', 'device_798a900d-2477-43da-840d-256c0e84a18cdevice_90531d69-9815-48e0-87e2-0eb07ce800be': 'VmDevice {vmId=0e968db5-5d49-467f-9ff3-afc37b64364f, deviceId=90531d69-9815-48e0-87e2-0eb07ce800be, device=ide, type=CONTROLLER, bootOrder=0, specParams={}, address={bus=0x00, domain=0x0000, type=pci, slot=0x01, function=0x1}, managed=false, plugged=true, readOnly=false, deviceAlias=ide0, customProperties={}, snapshotId=null}', 'device_798a900d-2477-43da-840d-256c0e84a18cdevice_90531d69-9815-48e0-87e2-0eb07ce800bedevice_9fe71b49-fe03-4e11-acba-87aeb0a8d2f9': 'VmDevice {vmId=0e968db5-5d49-467f-9ff3-afc37b64364f, deviceId=9fe71b49-fe03-4e11-acba-87aeb0a8d2f9, device=unix, type=CHANNEL, bootOrder=0, specParams={}, address={port=1, bus=0, controller=0, type=virtio-serial}, managed=false, plugged=true, readOnly=false, deviceAlias=channel0, customProperties={}, snapshotId=null}', 'device_798a900d-2477-43da-840d-256c0e84a18cdevice_90531d69-9815-48e0-87e2-0eb07ce800bedevice_9fe71b49-fe03-4e11-acba-87aeb0a8d2f9device_b625f19d-3595-442a-8de7-84c3cef991a7': 'VmDevice {vmId=0e968db5-5d49-467f-9ff3-afc37b64364f, deviceId=b625f19d-3595-442a-8de7-84c3cef991a7, device=virtio-serial, type=CONTROLLER, bootOrder=0, specParams={}, address={bus=0x00, domain=0x0000, type=pci, slot=0x05, function=0x0}, managed=false, plugged=true, readOnly=false, deviceAlias=virtio-serial0, customProperties={}, snapshotId=null}'}, 'vmType': 'kvm', 'memSize': 1024, 'displayIp': '0', 'maxVCpus': '160', 'spiceSecureChannels': 'smain,sinputs,scursor,splayback,srecord,sdisplay,susbredir,ssmartcard', 'smpCoresPerSocket': '2', 'vmName': 'scale_4', 'display': 'qxl', 'nice': '0'}} >Thread-55::INFO::2014-07-10 09:02:06,065::vm::3151::vm.Vm::(_run) vmId=`0e968db5-5d49-467f-9ff3-afc37b64364f`::VM wrapper has started >Thread-55::DEBUG::2014-07-10 09:02:06,068::task::595::TaskManager.Task::(_updateState) Task=`6bf6cb66-3c8a-435a-8586-28ca24a3ad85`::moving from state init -> state preparing >Thread-55::INFO::2014-07-10 09:02:06,069::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='b6f6c0da-e67f-4902-b9ac-3069571a42fe', volUUID='c4cd1da8-05b7-45e0-80b1-1183d21443d9', options=None) >Thread-55::INFO::2014-07-10 09:02:06,070::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-55::DEBUG::2014-07-10 09:02:06,070::task::1185::TaskManager.Task::(prepare) Task=`6bf6cb66-3c8a-435a-8586-28ca24a3ad85`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-55::DEBUG::2014-07-10 09:02:06,071::task::595::TaskManager.Task::(_updateState) Task=`6bf6cb66-3c8a-435a-8586-28ca24a3ad85`::moving from state preparing -> state finished >Thread-55::DEBUG::2014-07-10 09:02:06,071::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-55::DEBUG::2014-07-10 09:02:06,071::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-55::DEBUG::2014-07-10 09:02:06,071::task::990::TaskManager.Task::(_decref) Task=`6bf6cb66-3c8a-435a-8586-28ca24a3ad85`::ref 0 aborting False >Thread-55::INFO::2014-07-10 09:02:06,135::clientIF::324::vds::(prepareVolumePath) prepared volume path: /var/run/vdsm/payload/0e968db5-5d49-467f-9ff3-afc37b64364f.1545eb57546aea9ff3ba0bfa70c1b5ef.img >Thread-55::INFO::2014-07-10 09:02:06,135::clientIF::324::vds::(prepareVolumePath) prepared volume path: >Thread-55::DEBUG::2014-07-10 09:02:06,136::task::595::TaskManager.Task::(_updateState) Task=`1518240a-c3be-465c-84f5-8e5d4477ac9b`::moving from state init -> state preparing >Thread-55::INFO::2014-07-10 09:02:06,136::logUtils::44::dispatcher::(wrapper) Run and protect: prepareImage(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='b6f6c0da-e67f-4902-b9ac-3069571a42fe', leafUUID='c4cd1da8-05b7-45e0-80b1-1183d21443d9') >Thread-55::DEBUG::2014-07-10 09:02:06,136::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.9e1aa540-1f4e-4ee3-a152-be381ef6c3bd`ReqID=`af312841-9417-48d9-b0e2-09dab9e777ea`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '3248' at 'prepareImage' >Thread-55::DEBUG::2014-07-10 09:02:06,137::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.9e1aa540-1f4e-4ee3-a152-be381ef6c3bd' for lock type 'shared' >Thread-55::DEBUG::2014-07-10 09:02:06,137::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.9e1aa540-1f4e-4ee3-a152-be381ef6c3bd' is free. Now locking as 'shared' (1 active user) >Thread-55::DEBUG::2014-07-10 09:02:06,137::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.9e1aa540-1f4e-4ee3-a152-be381ef6c3bd`ReqID=`af312841-9417-48d9-b0e2-09dab9e777ea`::Granted request >Thread-55::DEBUG::2014-07-10 09:02:06,137::task::827::TaskManager.Task::(resourceAcquired) Task=`1518240a-c3be-465c-84f5-8e5d4477ac9b`::_resourcesAcquired: Storage.9e1aa540-1f4e-4ee3-a152-be381ef6c3bd (shared) >Thread-55::DEBUG::2014-07-10 09:02:06,138::task::990::TaskManager.Task::(_decref) Task=`1518240a-c3be-465c-84f5-8e5d4477ac9b`::ref 1 aborting False >Thread-55::DEBUG::2014-07-10 09:02:06,138::lvm::427::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' got the operation mutex >Thread-55::DEBUG::2014-07-10 09:02:06,139::lvm::296::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm lvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/3600601601282300032826addbbdae311|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,vg_name,attr,size,seg_start_pe,devices,tags 9e1aa540-1f4e-4ee3-a152-be381ef6c3bd' (cwd None) >Thread-55::DEBUG::2014-07-10 09:02:06,342::lvm::296::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-55::DEBUG::2014-07-10 09:02:06,358::lvm::462::Storage.LVM::(_reloadlvs) lvs reloaded >Thread-55::DEBUG::2014-07-10 09:02:06,358::lvm::462::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' released the operation mutex >Thread-55::DEBUG::2014-07-10 09:02:06,363::lvm::296::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm lvchange --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/3600601601282300032826addbbdae311|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } " --autobackup n --available y 9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/c4cd1da8-05b7-45e0-80b1-1183d21443d9' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:02:06,391::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:02:06,494::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0487036 s, 21.0 MB/s\n'; <rc> = 0 >Thread-55::DEBUG::2014-07-10 09:02:06,763::lvm::296::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-55::DEBUG::2014-07-10 09:02:06,764::lvm::513::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-55::DEBUG::2014-07-10 09:02:06,764::lvm::525::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-55::DEBUG::2014-07-10 09:02:06,766::blockSD::1057::Storage.StorageDomain::(linkBCImage) path to image directory already exists: /rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/images/b6f6c0da-e67f-4902-b9ac-3069571a42fe >Thread-55::DEBUG::2014-07-10 09:02:06,766::lvm::427::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' got the operation mutex >Thread-55::DEBUG::2014-07-10 09:02:06,767::lvm::296::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm lvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/3600601601282300032826addbbdae311|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,vg_name,attr,size,seg_start_pe,devices,tags 9e1aa540-1f4e-4ee3-a152-be381ef6c3bd' (cwd None) >Thread-18::DEBUG::2014-07-10 09:02:06,864::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/metadata bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-10 09:02:06,878::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000602024 s, 6.8 MB/s\n'; <rc> = 0 >Thread-55::DEBUG::2014-07-10 09:02:06,958::lvm::296::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-55::DEBUG::2014-07-10 09:02:06,969::lvm::462::Storage.LVM::(_reloadlvs) lvs reloaded >Thread-55::DEBUG::2014-07-10 09:02:06,969::lvm::462::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' released the operation mutex >Thread-55::INFO::2014-07-10 09:02:06,970::logUtils::47::dispatcher::(wrapper) Run and protect: prepareImage, Return response: {'info': {'domainID': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'volType': 'path', 'leaseOffset': 113246208, 'path': '/rhev/data-center/mnt/blockSD/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/images/b6f6c0da-e67f-4902-b9ac-3069571a42fe/c4cd1da8-05b7-45e0-80b1-1183d21443d9', 'volumeID': 'c4cd1da8-05b7-45e0-80b1-1183d21443d9', 'leasePath': '/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/leases', 'imageID': 'b6f6c0da-e67f-4902-b9ac-3069571a42fe'}, 'path': '/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/images/b6f6c0da-e67f-4902-b9ac-3069571a42fe/c4cd1da8-05b7-45e0-80b1-1183d21443d9', 'imgVolumesInfo': [{'domainID': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'volType': 'path', 'leaseOffset': 109051904, 'path': '/rhev/data-center/mnt/blockSD/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/images/b6f6c0da-e67f-4902-b9ac-3069571a42fe/47592965-e853-4e59-9728-d11cca6a7a8a', 'volumeID': '47592965-e853-4e59-9728-d11cca6a7a8a', 'leasePath': '/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/leases', 'imageID': 'b6f6c0da-e67f-4902-b9ac-3069571a42fe'}, {'domainID': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'volType': 'path', 'leaseOffset': 113246208, 'path': '/rhev/data-center/mnt/blockSD/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/images/b6f6c0da-e67f-4902-b9ac-3069571a42fe/c4cd1da8-05b7-45e0-80b1-1183d21443d9', 'volumeID': 'c4cd1da8-05b7-45e0-80b1-1183d21443d9', 'leasePath': '/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/leases', 'imageID': 'b6f6c0da-e67f-4902-b9ac-3069571a42fe'}]} >Thread-55::DEBUG::2014-07-10 09:02:06,970::task::1185::TaskManager.Task::(prepare) Task=`1518240a-c3be-465c-84f5-8e5d4477ac9b`::finished: {'info': {'domainID': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'volType': 'path', 'leaseOffset': 113246208, 'path': '/rhev/data-center/mnt/blockSD/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/images/b6f6c0da-e67f-4902-b9ac-3069571a42fe/c4cd1da8-05b7-45e0-80b1-1183d21443d9', 'volumeID': 'c4cd1da8-05b7-45e0-80b1-1183d21443d9', 'leasePath': '/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/leases', 'imageID': 'b6f6c0da-e67f-4902-b9ac-3069571a42fe'}, 'path': '/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/images/b6f6c0da-e67f-4902-b9ac-3069571a42fe/c4cd1da8-05b7-45e0-80b1-1183d21443d9', 'imgVolumesInfo': [{'domainID': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'volType': 'path', 'leaseOffset': 109051904, 'path': '/rhev/data-center/mnt/blockSD/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/images/b6f6c0da-e67f-4902-b9ac-3069571a42fe/47592965-e853-4e59-9728-d11cca6a7a8a', 'volumeID': '47592965-e853-4e59-9728-d11cca6a7a8a', 'leasePath': '/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/leases', 'imageID': 'b6f6c0da-e67f-4902-b9ac-3069571a42fe'}, {'domainID': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'volType': 'path', 'leaseOffset': 113246208, 'path': '/rhev/data-center/mnt/blockSD/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/images/b6f6c0da-e67f-4902-b9ac-3069571a42fe/c4cd1da8-05b7-45e0-80b1-1183d21443d9', 'volumeID': 'c4cd1da8-05b7-45e0-80b1-1183d21443d9', 'leasePath': '/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/leases', 'imageID': 'b6f6c0da-e67f-4902-b9ac-3069571a42fe'}]} >Thread-55::DEBUG::2014-07-10 09:02:06,970::task::595::TaskManager.Task::(_updateState) Task=`1518240a-c3be-465c-84f5-8e5d4477ac9b`::moving from state preparing -> state finished >Thread-55::DEBUG::2014-07-10 09:02:06,970::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': < ResourceRef 'Storage.9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', isValid: 'True' obj: 'None'>} >Thread-55::DEBUG::2014-07-10 09:02:06,971::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-55::DEBUG::2014-07-10 09:02:06,971::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.9e1aa540-1f4e-4ee3-a152-be381ef6c3bd' >Thread-55::DEBUG::2014-07-10 09:02:06,971::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.9e1aa540-1f4e-4ee3-a152-be381ef6c3bd' (0 active users) >Thread-55::DEBUG::2014-07-10 09:02:06,972::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.9e1aa540-1f4e-4ee3-a152-be381ef6c3bd' is free, finding out if anyone is waiting for it. >Thread-55::DEBUG::2014-07-10 09:02:06,972::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', Clearing records. >Thread-55::DEBUG::2014-07-10 09:02:06,972::task::990::TaskManager.Task::(_decref) Task=`1518240a-c3be-465c-84f5-8e5d4477ac9b`::ref 0 aborting False >Thread-55::INFO::2014-07-10 09:02:06,972::clientIF::324::vds::(prepareVolumePath) prepared volume path: /rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/images/b6f6c0da-e67f-4902-b9ac-3069571a42fe/c4cd1da8-05b7-45e0-80b1-1183d21443d9 >Thread-55::DEBUG::2014-07-10 09:02:06,999::utils::642::root::(execCmd) '/usr/libexec/vdsm/hooks/before_vm_start/50_vhostmd' (cwd None) >Thread-55::DEBUG::2014-07-10 09:02:07,106::utils::662::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-55::INFO::2014-07-10 09:02:07,107::hooks::100::root::(_runHooksDir) >Thread-55::DEBUG::2014-07-10 09:02:07,108::vm::3190::vm.Vm::(_run) vmId=`0e968db5-5d49-467f-9ff3-afc37b64364f`::<?xml version="1.0" encoding="utf-8"?> ><domain type="kvm"> > <name>scale_4</name> > <uuid>0e968db5-5d49-467f-9ff3-afc37b64364f</uuid> > <memory>1048576</memory> > <currentMemory>1048576</currentMemory> > <vcpu current="2">160</vcpu> > <memtune> > <min_guarantee>1048576</min_guarantee> > </memtune> > <devices> > <channel type="unix"> > <target name="com.redhat.rhevm.vdsm" type="virtio"/> > <source mode="bind" path="/var/lib/libvirt/qemu/channels/0e968db5-5d49-467f-9ff3-afc37b64364f.com.redhat.rhevm.vdsm"/> > </channel> > <channel type="unix"> > <target name="org.qemu.guest_agent.0" type="virtio"/> > <source mode="bind" path="/var/lib/libvirt/qemu/channels/0e968db5-5d49-467f-9ff3-afc37b64364f.org.qemu.guest_agent.0"/> > </channel> > <input bus="ps2" type="mouse"/> > <channel type="spicevmc"> > <target name="com.redhat.spice.0" type="virtio"/> > </channel> > <graphics autoport="yes" keymap="en-us" listen="0" passwd="*****" passwdValidTo="1970-01-01T00:00:01" port="-1" tlsPort="-1" type="spice"> > <channel mode="secure" name="main"/> > <channel mode="secure" name="inputs"/> > <channel mode="secure" name="cursor"/> > <channel mode="secure" name="playback"/> > <channel mode="secure" name="record"/> > <channel mode="secure" name="display"/> > <channel mode="secure" name="usbredir"/> > <channel mode="secure" name="smartcard"/> > </graphics> > <memballoon model="virtio"/> > <controller index="0" model="virtio-scsi" type="scsi"> > <address bus="0x00" domain="0x0000" function="0x0" slot="0x04" type="pci"/> > </controller> > <video> > <model heads="1" ram="65536" type="qxl" vram="32768"/> > </video> > <interface type="bridge"> > <mac address="00:1a:4a:de:6d:7f"/> > <model type="virtio"/> > <source bridge="rhevm"/> > <filterref filter="vdsm-no-mac-spoofing"/> > <link state="up"/> > <bandwidth/> > </interface> > <disk device="cdrom" snapshot="no" type="file"> > <source file="/var/run/vdsm/payload/0e968db5-5d49-467f-9ff3-afc37b64364f.1545eb57546aea9ff3ba0bfa70c1b5ef.img" startupPolicy="optional"/> > <target bus="ide" dev="hdd"/> > <readonly/> > <serial/> > </disk> > <disk device="cdrom" snapshot="no" type="file"> > <source file="" startupPolicy="optional"/> > <target bus="ide" dev="hdc"/> > <readonly/> > <serial/> > </disk> > <disk device="disk" snapshot="no" type="block"> > <address bus="0x00" domain="0x0000" function="0x0" slot="0x06" type="pci"/> > <source dev="/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/images/b6f6c0da-e67f-4902-b9ac-3069571a42fe/c4cd1da8-05b7-45e0-80b1-1183d21443d9"/> > <target bus="virtio" dev="vda"/> > <serial>b6f6c0da-e67f-4902-b9ac-3069571a42fe</serial> > <boot order="1"/> > <driver cache="none" error_policy="stop" io="native" name="qemu" type="qcow2"/> > </disk> > </devices> > <os> > <type arch="x86_64" machine="rhel6.5.0">hvm</type> > <smbios mode="sysinfo"/> > </os> > <sysinfo type="smbios"> > <system> > <entry name="manufacturer">Red Hat</entry> > <entry name="product">RHEV Hypervisor</entry> > <entry name="version">6.5-20140707.0.el6ev</entry> > <entry name="serial">52BAF97B-FF2F-E311-0000-100000000005</entry> > <entry name="uuid">0e968db5-5d49-467f-9ff3-afc37b64364f</entry> > </system> > </sysinfo> > <clock adjustment="0" offset="variable"> > <timer name="rtc" tickpolicy="catchup"/> > </clock> > <features> > <acpi/> > </features> > <cpu match="exact"> > <model>Conroe</model> > <topology cores="2" sockets="80" threads="1"/> > </cpu> ></domain> > >GuestMonitor-scale_2::DEBUG::2014-07-10 09:02:07,928::vm::676::vm.Vm::(_getDiskStats) vmId=`52e238aa-e62a-48a8-a200-604e72422f3f`::Disk hdd stats not available >GuestMonitor-scale_3::DEBUG::2014-07-10 09:02:07,932::vm::676::vm.Vm::(_getDiskStats) vmId=`949f6c19-87b5-4f16-a91c-0049749423ea`::Disk hdd stats not available >GuestMonitor-scale_2::DEBUG::2014-07-10 09:02:07,939::vm::676::vm.Vm::(_getDiskStats) vmId=`52e238aa-e62a-48a8-a200-604e72422f3f`::Disk hdc stats not available >GuestMonitor-scale_3::DEBUG::2014-07-10 09:02:07,939::vm::676::vm.Vm::(_getDiskStats) vmId=`949f6c19-87b5-4f16-a91c-0049749423ea`::Disk hdc stats not available >GuestMonitor-scale_2::DEBUG::2014-07-10 09:02:07,940::vm::676::vm.Vm::(_getDiskStats) vmId=`52e238aa-e62a-48a8-a200-604e72422f3f`::Disk vda stats not available >GuestMonitor-scale_3::DEBUG::2014-07-10 09:02:07,940::vm::676::vm.Vm::(_getDiskStats) vmId=`949f6c19-87b5-4f16-a91c-0049749423ea`::Disk vda stats not available >GuestMonitor-scale_2::DEBUG::2014-07-10 09:02:07,941::vm::715::vm.Vm::(_getDiskLatency) vmId=`52e238aa-e62a-48a8-a200-604e72422f3f`::Disk hdd latency not available >libvirtEventLoop::DEBUG::2014-07-10 09:02:07,944::vm::5176::vm.Vm::(_onLibvirtLifecycleEvent) vmId=`0e968db5-5d49-467f-9ff3-afc37b64364f`::event Started detail 0 opaque None >GuestMonitor-scale_3::DEBUG::2014-07-10 09:02:07,946::vm::715::vm.Vm::(_getDiskLatency) vmId=`949f6c19-87b5-4f16-a91c-0049749423ea`::Disk hdd latency not available >GuestMonitor-scale_2::DEBUG::2014-07-10 09:02:07,950::vm::715::vm.Vm::(_getDiskLatency) vmId=`52e238aa-e62a-48a8-a200-604e72422f3f`::Disk hdc latency not available >GuestMonitor-scale_3::DEBUG::2014-07-10 09:02:07,955::vm::715::vm.Vm::(_getDiskLatency) vmId=`949f6c19-87b5-4f16-a91c-0049749423ea`::Disk hdc latency not available >GuestMonitor-scale_2::DEBUG::2014-07-10 09:02:07,957::vm::715::vm.Vm::(_getDiskLatency) vmId=`52e238aa-e62a-48a8-a200-604e72422f3f`::Disk vda latency not available >GuestMonitor-scale_3::DEBUG::2014-07-10 09:02:07,961::vm::715::vm.Vm::(_getDiskLatency) vmId=`949f6c19-87b5-4f16-a91c-0049749423ea`::Disk vda latency not available >GuestMonitor-scale_2::DEBUG::2014-07-10 09:02:07,971::vm::676::vm.Vm::(_getDiskStats) vmId=`52e238aa-e62a-48a8-a200-604e72422f3f`::Disk hdd stats not available >GuestMonitor-scale_3::DEBUG::2014-07-10 09:02:07,975::vm::676::vm.Vm::(_getDiskStats) vmId=`949f6c19-87b5-4f16-a91c-0049749423ea`::Disk hdd stats not available >GuestMonitor-scale_2::DEBUG::2014-07-10 09:02:07,977::vm::676::vm.Vm::(_getDiskStats) vmId=`52e238aa-e62a-48a8-a200-604e72422f3f`::Disk hdc stats not available >GuestMonitor-scale_3::DEBUG::2014-07-10 09:02:07,981::vm::676::vm.Vm::(_getDiskStats) vmId=`949f6c19-87b5-4f16-a91c-0049749423ea`::Disk hdc stats not available >GuestMonitor-scale_2::DEBUG::2014-07-10 09:02:07,985::vm::676::vm.Vm::(_getDiskStats) vmId=`52e238aa-e62a-48a8-a200-604e72422f3f`::Disk vda stats not available >GuestMonitor-scale_3::DEBUG::2014-07-10 09:02:07,987::vm::676::vm.Vm::(_getDiskStats) vmId=`949f6c19-87b5-4f16-a91c-0049749423ea`::Disk vda stats not available >GuestMonitor-scale_2::DEBUG::2014-07-10 09:02:07,990::vm::715::vm.Vm::(_getDiskLatency) vmId=`52e238aa-e62a-48a8-a200-604e72422f3f`::Disk hdd latency not available >GuestMonitor-scale_3::DEBUG::2014-07-10 09:02:07,993::vm::715::vm.Vm::(_getDiskLatency) vmId=`949f6c19-87b5-4f16-a91c-0049749423ea`::Disk hdd latency not available >GuestMonitor-scale_2::DEBUG::2014-07-10 09:02:07,995::vm::715::vm.Vm::(_getDiskLatency) vmId=`52e238aa-e62a-48a8-a200-604e72422f3f`::Disk hdc latency not available >GuestMonitor-scale_3::DEBUG::2014-07-10 09:02:07,999::vm::715::vm.Vm::(_getDiskLatency) vmId=`949f6c19-87b5-4f16-a91c-0049749423ea`::Disk hdc latency not available >GuestMonitor-scale_2::DEBUG::2014-07-10 09:02:08,001::vm::715::vm.Vm::(_getDiskLatency) vmId=`52e238aa-e62a-48a8-a200-604e72422f3f`::Disk vda latency not available >GuestMonitor-scale_3::DEBUG::2014-07-10 09:02:08,005::vm::715::vm.Vm::(_getDiskLatency) vmId=`949f6c19-87b5-4f16-a91c-0049749423ea`::Disk vda latency not available >GuestMonitor-scale_1::DEBUG::2014-07-10 09:02:08,007::vm::676::vm.Vm::(_getDiskStats) vmId=`ed909f7e-0ee2-4f6f-b4a5-a165f689a276`::Disk hdd stats not available >GuestMonitor-scale_1::DEBUG::2014-07-10 09:02:08,013::vm::676::vm.Vm::(_getDiskStats) vmId=`ed909f7e-0ee2-4f6f-b4a5-a165f689a276`::Disk hdc stats not available >GuestMonitor-scale_1::DEBUG::2014-07-10 09:02:08,015::vm::676::vm.Vm::(_getDiskStats) vmId=`ed909f7e-0ee2-4f6f-b4a5-a165f689a276`::Disk vda stats not available >GuestMonitor-scale_1::DEBUG::2014-07-10 09:02:08,015::vm::715::vm.Vm::(_getDiskLatency) vmId=`ed909f7e-0ee2-4f6f-b4a5-a165f689a276`::Disk hdd latency not available >GuestMonitor-scale_1::DEBUG::2014-07-10 09:02:08,017::vm::715::vm.Vm::(_getDiskLatency) vmId=`ed909f7e-0ee2-4f6f-b4a5-a165f689a276`::Disk hdc latency not available >GuestMonitor-scale_1::DEBUG::2014-07-10 09:02:08,017::vm::715::vm.Vm::(_getDiskLatency) vmId=`ed909f7e-0ee2-4f6f-b4a5-a165f689a276`::Disk vda latency not available >GuestMonitor-scale_1::DEBUG::2014-07-10 09:02:08,020::vm::676::vm.Vm::(_getDiskStats) vmId=`ed909f7e-0ee2-4f6f-b4a5-a165f689a276`::Disk hdd stats not available >GuestMonitor-scale_1::DEBUG::2014-07-10 09:02:08,022::vm::676::vm.Vm::(_getDiskStats) vmId=`ed909f7e-0ee2-4f6f-b4a5-a165f689a276`::Disk hdc stats not available >GuestMonitor-scale_1::DEBUG::2014-07-10 09:02:08,025::vm::676::vm.Vm::(_getDiskStats) vmId=`ed909f7e-0ee2-4f6f-b4a5-a165f689a276`::Disk vda stats not available >GuestMonitor-scale_1::DEBUG::2014-07-10 09:02:08,028::vm::715::vm.Vm::(_getDiskLatency) vmId=`ed909f7e-0ee2-4f6f-b4a5-a165f689a276`::Disk hdd latency not available >GuestMonitor-scale_1::DEBUG::2014-07-10 09:02:08,031::vm::715::vm.Vm::(_getDiskLatency) vmId=`ed909f7e-0ee2-4f6f-b4a5-a165f689a276`::Disk hdc latency not available >GuestMonitor-scale_1::DEBUG::2014-07-10 09:02:08,033::vm::715::vm.Vm::(_getDiskLatency) vmId=`ed909f7e-0ee2-4f6f-b4a5-a165f689a276`::Disk vda latency not available >Thread-55::DEBUG::2014-07-10 09:02:08,062::vm::5032::vm.Vm::(_getUnderlyingDriveInfo) vmId=`0e968db5-5d49-467f-9ff3-afc37b64364f`::Looking for drive with attributes {'name': u'hdc', 'bootOrder': '', 'boot': [], 'readonly': True, 'address': {u'bus': u'1', u'controller': u'0', u'type': u'drive', u'target': u'0', u'unit': u'0'}, 'path': '', 'type': u'cdrom'} >Thread-55::DEBUG::2014-07-10 09:02:08,062::vm::5053::vm.Vm::(_getUnderlyingDriveInfo) vmId=`0e968db5-5d49-467f-9ff3-afc37b64364f`::Matched {'name': (u'hdc', u'hdc'), 'bootOrder': ('', None), 'boot': ([], None), 'readonly': (True, True), 'address': ({u'bus': u'1', u'controller': u'0', u'type': u'drive', u'target': u'0', u'unit': u'0'}, {u'bus': u'1', u'controller': u'0', u'type': u'drive', u'target': u'0', u'unit': u'0'}), 'path': ('', ''), 'type': (u'cdrom', u'cdrom')} >Thread-55::DEBUG::2014-07-10 09:02:08,063::vm::5072::vm.Vm::(_getUnderlyingDriveInfo) vmId=`0e968db5-5d49-467f-9ff3-afc37b64364f`::Matched {'name': (u'hdc', u'hdc'), 'bootOrder': ('', None), 'boot': ([], None), 'readonly': (True, 'True'), 'address': ({u'bus': u'1', u'controller': u'0', u'type': u'drive', u'target': u'0', u'unit': u'0'}, {u'bus': u'1', u'controller': u'0', u'type': u'drive', u'target': u'0', u'unit': u'0'}), 'path': ('', ''), 'type': (u'cdrom', 'disk')} >Thread-55::DEBUG::2014-07-10 09:02:08,063::vm::5032::vm.Vm::(_getUnderlyingDriveInfo) vmId=`0e968db5-5d49-467f-9ff3-afc37b64364f`::Looking for drive with attributes {'name': u'hdd', 'bootOrder': '', 'boot': [], 'readonly': True, 'address': {u'bus': u'1', u'controller': u'0', u'type': u'drive', u'target': u'0', u'unit': u'1'}, 'path': u'/var/run/vdsm/payload/0e968db5-5d49-467f-9ff3-afc37b64364f.1545eb57546aea9ff3ba0bfa70c1b5ef.img', 'type': u'cdrom'} >Thread-55::DEBUG::2014-07-10 09:02:08,063::vm::5053::vm.Vm::(_getUnderlyingDriveInfo) vmId=`0e968db5-5d49-467f-9ff3-afc37b64364f`::Matched {'name': (u'hdd', u'hdd'), 'bootOrder': ('', None), 'boot': ([], None), 'readonly': (True, True), 'address': ({u'bus': u'1', u'controller': u'0', u'type': u'drive', u'target': u'0', u'unit': u'1'}, {u'bus': u'1', u'controller': u'0', u'type': u'drive', u'target': u'0', u'unit': u'1'}), 'path': (u'/var/run/vdsm/payload/0e968db5-5d49-467f-9ff3-afc37b64364f.1545eb57546aea9ff3ba0bfa70c1b5ef.img', '/var/run/vdsm/payload/0e968db5-5d49-467f-9ff3-afc37b64364f.1545eb57546aea9ff3ba0bfa70c1b5ef.img'), 'type': (u'cdrom', u'cdrom')} >Thread-55::DEBUG::2014-07-10 09:02:08,064::vm::5072::vm.Vm::(_getUnderlyingDriveInfo) vmId=`0e968db5-5d49-467f-9ff3-afc37b64364f`::Matched {'name': (u'hdd', u'hdd'), 'bootOrder': ('', None), 'boot': ([], None), 'readonly': (True, 'True'), 'address': ({u'bus': u'1', u'controller': u'0', u'type': u'drive', u'target': u'0', u'unit': u'1'}, {u'bus': u'1', u'controller': u'0', u'type': u'drive', u'target': u'0', u'unit': u'1'}), 'path': (u'/var/run/vdsm/payload/0e968db5-5d49-467f-9ff3-afc37b64364f.1545eb57546aea9ff3ba0bfa70c1b5ef.img', '/var/run/vdsm/payload/0e968db5-5d49-467f-9ff3-afc37b64364f.1545eb57546aea9ff3ba0bfa70c1b5ef.img'), 'type': (u'cdrom', 'disk')} >Thread-55::DEBUG::2014-07-10 09:02:08,064::vm::5032::vm.Vm::(_getUnderlyingDriveInfo) vmId=`0e968db5-5d49-467f-9ff3-afc37b64364f`::Looking for drive with attributes {'name': u'vda', 'bootOrder': u'1', 'boot': [<DOM Element: boot at 0x7f6198431e18>], 'readonly': False, 'address': {u'slot': u'0x06', u'bus': u'0x00', u'domain': u'0x0000', u'type': u'pci', u'function': u'0x0'}, 'path': u'/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/images/b6f6c0da-e67f-4902-b9ac-3069571a42fe/c4cd1da8-05b7-45e0-80b1-1183d21443d9', 'type': u'disk'} >Thread-55::DEBUG::2014-07-10 09:02:08,064::vm::5053::vm.Vm::(_getUnderlyingDriveInfo) vmId=`0e968db5-5d49-467f-9ff3-afc37b64364f`::Matched {'name': (u'vda', u'vda'), 'bootOrder': (u'1', u'1'), 'boot': ([<DOM Element: boot at 0x7f6198431e18>], None), 'readonly': (False, False), 'address': ({u'slot': u'0x06', u'bus': u'0x00', u'domain': u'0x0000', u'type': u'pci', u'function': u'0x0'}, {u'slot': u'0x06', u'bus': u'0x00', u'domain': u'0x0000', u'type': u'pci', u'function': u'0x0'}), 'path': (u'/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/images/b6f6c0da-e67f-4902-b9ac-3069571a42fe/c4cd1da8-05b7-45e0-80b1-1183d21443d9', '/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/images/b6f6c0da-e67f-4902-b9ac-3069571a42fe/c4cd1da8-05b7-45e0-80b1-1183d21443d9'), 'type': (u'disk', u'disk')} >Thread-55::DEBUG::2014-07-10 09:02:08,065::vm::5072::vm.Vm::(_getUnderlyingDriveInfo) vmId=`0e968db5-5d49-467f-9ff3-afc37b64364f`::Matched {'name': (u'vda', u'vda'), 'bootOrder': (u'1', u'1'), 'boot': ([<DOM Element: boot at 0x7f6198431e18>], None), 'readonly': (False, 'False'), 'address': ({u'slot': u'0x06', u'bus': u'0x00', u'domain': u'0x0000', u'type': u'pci', u'function': u'0x0'}, {u'slot': u'0x06', u'bus': u'0x00', u'domain': u'0x0000', u'type': u'pci', u'function': u'0x0'}), 'path': (u'/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/images/b6f6c0da-e67f-4902-b9ac-3069571a42fe/c4cd1da8-05b7-45e0-80b1-1183d21443d9', '/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/images/b6f6c0da-e67f-4902-b9ac-3069571a42fe/c4cd1da8-05b7-45e0-80b1-1183d21443d9'), 'type': (u'disk', 'disk')} >Thread-55::DEBUG::2014-07-10 09:02:08,227::sampling::285::vm.Vm::(start) vmId=`0e968db5-5d49-467f-9ff3-afc37b64364f`::Start statistics collection >Thread-57::DEBUG::2014-07-10 09:02:08,229::sampling::314::vm.Vm::(run) vmId=`0e968db5-5d49-467f-9ff3-afc37b64364f`::Stats thread started >Thread-57::DEBUG::2014-07-10 09:02:08,236::task::595::TaskManager.Task::(_updateState) Task=`d3fad86d-9373-4656-8161-1905259e907b`::moving from state init -> state preparing >Thread-57::INFO::2014-07-10 09:02:08,237::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='b6f6c0da-e67f-4902-b9ac-3069571a42fe', volUUID='c4cd1da8-05b7-45e0-80b1-1183d21443d9', options=None) >Thread-55::DEBUG::2014-07-10 09:02:08,238::vmChannels::198::vds::(register) Add fileno 63 to listener's channels. >Thread-57::INFO::2014-07-10 09:02:08,241::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-57::DEBUG::2014-07-10 09:02:08,241::task::1185::TaskManager.Task::(prepare) Task=`d3fad86d-9373-4656-8161-1905259e907b`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-57::DEBUG::2014-07-10 09:02:08,241::task::595::TaskManager.Task::(_updateState) Task=`d3fad86d-9373-4656-8161-1905259e907b`::moving from state preparing -> state finished >Thread-57::DEBUG::2014-07-10 09:02:08,241::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-57::DEBUG::2014-07-10 09:02:08,242::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-57::DEBUG::2014-07-10 09:02:08,242::task::990::TaskManager.Task::(_decref) Task=`d3fad86d-9373-4656-8161-1905259e907b`::ref 0 aborting False >Thread-55::WARNING::2014-07-10 09:02:08,244::vm::3715::vm.Vm::(_readPauseCode) vmId=`0e968db5-5d49-467f-9ff3-afc37b64364f`::_readPauseCode unsupported by libvirt vm >Thread-55::DEBUG::2014-07-10 09:02:08,253::vm::2291::vm.Vm::(_startUnderlyingVm) vmId=`0e968db5-5d49-467f-9ff3-afc37b64364f`::_ongoingCreations released >Dummy-33::DEBUG::2014-07-10 09:02:08,510::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:02:08,594::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0320142 s, 32.0 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 09:02:09,055::BindingXMLRPC::1067::vds::(wrapper) client [10.35.3.13]::call vmGetStats with ('52e238aa-e62a-48a8-a200-604e72422f3f',) {} >Thread-14::DEBUG::2014-07-10 09:02:09,056::vm::676::vm.Vm::(_getDiskStats) vmId=`52e238aa-e62a-48a8-a200-604e72422f3f`::Disk hdd stats not available >Thread-14::DEBUG::2014-07-10 09:02:09,057::vm::676::vm.Vm::(_getDiskStats) vmId=`52e238aa-e62a-48a8-a200-604e72422f3f`::Disk hdc stats not available >Thread-14::DEBUG::2014-07-10 09:02:09,057::vm::676::vm.Vm::(_getDiskStats) vmId=`52e238aa-e62a-48a8-a200-604e72422f3f`::Disk vda stats not available >Thread-14::DEBUG::2014-07-10 09:02:09,057::vm::715::vm.Vm::(_getDiskLatency) vmId=`52e238aa-e62a-48a8-a200-604e72422f3f`::Disk hdd latency not available >Thread-14::DEBUG::2014-07-10 09:02:09,057::vm::715::vm.Vm::(_getDiskLatency) vmId=`52e238aa-e62a-48a8-a200-604e72422f3f`::Disk hdc latency not available >Thread-14::DEBUG::2014-07-10 09:02:09,057::vm::715::vm.Vm::(_getDiskLatency) vmId=`52e238aa-e62a-48a8-a200-604e72422f3f`::Disk vda latency not available >Thread-14::DEBUG::2014-07-10 09:02:09,058::BindingXMLRPC::1074::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Powering up', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '12236', 'displayIp': '0', 'displayPort': u'5902', 'session': 'Unknown', 'displaySecurePort': u'5903', 'timeOffset': '0', 'hash': '-5500930374920933700', 'balloonInfo': {'balloon_max': '1048576', 'balloon_target': '1048576', 'balloon_cur': '1048576', 'balloon_min': '1048576'}, 'pauseCode': 'NOERR', 'clientIp': '', 'kvmEnable': 'true', 'network': {u'vnet1': {'macAddr': '00:1a:4a:de:6d:7b', 'rxDropped': '0', 'rxErrors': '0', 'txDropped': '0', 'txRate': '0.0', 'rxRate': '0.0', 'txErrors': '0', 'state': 'unknown', 'speed': '1000', 'name': u'vnet1'}}, 'vmId': '52e238aa-e62a-48a8-a200-604e72422f3f', 'displayType': 'qxl', 'cpuUser': '46.44', 'disks': {u'vda': {'truesize': '1073741824', 'apparentsize': '1073741824', 'imageID': '76fdb054-02cd-42ed-9721-b3e65b34c3a4'}, u'hdd': {'truesize': '0', 'apparentsize': '0'}, u'hdc': {'truesize': '0', 'apparentsize': '0'}}, 'monitorResponse': '0', 'statsAge': '1.69', 'elapsedTime': '42', 'vmType': 'kvm', 'cpuSys': '1.72', 'guestCPUCount': -1, 'appsList': [], 'guestIPs': ''}]} >Thread-14::DEBUG::2014-07-10 09:02:09,062::BindingXMLRPC::1067::vds::(wrapper) client [10.35.3.13]::call vmGetStats with ('0e968db5-5d49-467f-9ff3-afc37b64364f',) {} >Thread-14::DEBUG::2014-07-10 09:02:09,063::vm::598::vm.Vm::(_getCpuStats) vmId=`0e968db5-5d49-467f-9ff3-afc37b64364f`::CPU stats not available: 'NoneType' object is unsubscriptable >Thread-14::DEBUG::2014-07-10 09:02:09,063::vm::654::vm.Vm::(_getNetworkStats) vmId=`0e968db5-5d49-467f-9ff3-afc37b64364f`::Network stats not available >Thread-14::DEBUG::2014-07-10 09:02:09,063::vm::676::vm.Vm::(_getDiskStats) vmId=`0e968db5-5d49-467f-9ff3-afc37b64364f`::Disk hdd stats not available >Thread-14::DEBUG::2014-07-10 09:02:09,063::vm::676::vm.Vm::(_getDiskStats) vmId=`0e968db5-5d49-467f-9ff3-afc37b64364f`::Disk hdc stats not available >Thread-14::DEBUG::2014-07-10 09:02:09,064::vm::676::vm.Vm::(_getDiskStats) vmId=`0e968db5-5d49-467f-9ff3-afc37b64364f`::Disk vda stats not available >Thread-14::DEBUG::2014-07-10 09:02:09,064::vm::715::vm.Vm::(_getDiskLatency) vmId=`0e968db5-5d49-467f-9ff3-afc37b64364f`::Disk hdd latency not available >Thread-14::DEBUG::2014-07-10 09:02:09,064::vm::715::vm.Vm::(_getDiskLatency) vmId=`0e968db5-5d49-467f-9ff3-afc37b64364f`::Disk hdc latency not available >Thread-14::DEBUG::2014-07-10 09:02:09,064::vm::715::vm.Vm::(_getDiskLatency) vmId=`0e968db5-5d49-467f-9ff3-afc37b64364f`::Disk vda latency not available >Thread-14::DEBUG::2014-07-10 09:02:09,064::BindingXMLRPC::1074::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Powering up', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '13498', 'displayIp': '0', 'displayPort': u'5906', 'session': 'Unknown', 'displaySecurePort': u'5907', 'timeOffset': '0', 'hash': '-6274297782377519393', 'balloonInfo': {'balloon_max': '1048576', 'balloon_target': '1048576', 'balloon_cur': '0', 'balloon_min': '1048576'}, 'pauseCode': 'NOERR', 'clientIp': '', 'kvmEnable': 'true', 'network': {u'vnet3': {'state': 'unknown', 'macAddr': '00:1a:4a:de:6d:7f', 'speed': '1000', 'name': u'vnet3'}}, 'vmId': '0e968db5-5d49-467f-9ff3-afc37b64364f', 'displayType': 'qxl', 'cpuUser': '0.00', 'disks': {u'vda': {'truesize': '1073741824', 'apparentsize': '1073741824', 'imageID': 'b6f6c0da-e67f-4902-b9ac-3069571a42fe'}, u'hdd': {'truesize': '0', 'apparentsize': '0'}, u'hdc': {'truesize': '0', 'apparentsize': '0'}}, 'monitorResponse': '0', 'statsAge': '0.83', 'elapsedTime': '3', 'vmType': 'kvm', 'cpuSys': '0.00', 'guestCPUCount': -1, 'appsList': [], 'guestIPs': ''}]} >Thread-14::DEBUG::2014-07-10 09:02:09,069::BindingXMLRPC::1067::vds::(wrapper) client [10.35.3.13]::call vmGetStats with ('949f6c19-87b5-4f16-a91c-0049749423ea',) {} >Thread-14::DEBUG::2014-07-10 09:02:09,069::vm::676::vm.Vm::(_getDiskStats) vmId=`949f6c19-87b5-4f16-a91c-0049749423ea`::Disk hdd stats not available >Thread-14::DEBUG::2014-07-10 09:02:09,069::vm::676::vm.Vm::(_getDiskStats) vmId=`949f6c19-87b5-4f16-a91c-0049749423ea`::Disk hdc stats not available >Thread-14::DEBUG::2014-07-10 09:02:09,070::vm::676::vm.Vm::(_getDiskStats) vmId=`949f6c19-87b5-4f16-a91c-0049749423ea`::Disk vda stats not available >Thread-14::DEBUG::2014-07-10 09:02:09,070::vm::715::vm.Vm::(_getDiskLatency) vmId=`949f6c19-87b5-4f16-a91c-0049749423ea`::Disk hdd latency not available >Thread-14::DEBUG::2014-07-10 09:02:09,070::vm::715::vm.Vm::(_getDiskLatency) vmId=`949f6c19-87b5-4f16-a91c-0049749423ea`::Disk hdc latency not available >Thread-14::DEBUG::2014-07-10 09:02:09,070::vm::715::vm.Vm::(_getDiskLatency) vmId=`949f6c19-87b5-4f16-a91c-0049749423ea`::Disk vda latency not available >Thread-14::DEBUG::2014-07-10 09:02:09,070::BindingXMLRPC::1074::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Powering up', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '12860', 'displayIp': '0', 'displayPort': u'5904', 'session': 'Unknown', 'displaySecurePort': u'5905', 'timeOffset': '0', 'hash': '-1803473594666319662', 'balloonInfo': {'balloon_max': '1048576', 'balloon_target': '1048576', 'balloon_cur': '1048576', 'balloon_min': '1048576'}, 'pauseCode': 'NOERR', 'clientIp': '', 'kvmEnable': 'true', 'network': {u'vnet2': {'macAddr': '00:1a:4a:de:6d:7e', 'rxDropped': '0', 'rxErrors': '0', 'txDropped': '0', 'txRate': '0.0', 'rxRate': '0.0', 'txErrors': '0', 'state': 'unknown', 'speed': '1000', 'name': u'vnet2'}}, 'vmId': '949f6c19-87b5-4f16-a91c-0049749423ea', 'displayType': 'qxl', 'cpuUser': '44.67', 'disks': {u'vda': {'truesize': '1073741824', 'apparentsize': '1073741824', 'imageID': '28408446-e5fd-4565-a976-e760951593fe'}, u'hdd': {'truesize': '0', 'apparentsize': '0'}, u'hdc': {'truesize': '0', 'apparentsize': '0'}}, 'monitorResponse': '0', 'statsAge': '0.15', 'elapsedTime': '22', 'vmType': 'kvm', 'cpuSys': '21.95', 'guestCPUCount': -1, 'appsList': [], 'guestIPs': ''}]} >VM Channels Listener::DEBUG::2014-07-10 09:02:09,119::vmChannels::106::vds::(_do_add_channels) fileno 63 was added to unconnected channels. >VM Channels Listener::DEBUG::2014-07-10 09:02:09,119::vmChannels::132::vds::(_handle_unconnected) Trying to connect fileno 63. >VM Channels Listener::DEBUG::2014-07-10 09:02:09,119::guestIF::194::vm.Vm::(_connect) vmId=`0e968db5-5d49-467f-9ff3-afc37b64364f`::Attempting connection to /var/lib/libvirt/qemu/channels/0e968db5-5d49-467f-9ff3-afc37b64364f.com.redhat.rhevm.vdsm >VM Channels Listener::DEBUG::2014-07-10 09:02:09,120::guestIF::197::vm.Vm::(_connect) vmId=`0e968db5-5d49-467f-9ff3-afc37b64364f`::Connected to /var/lib/libvirt/qemu/channels/0e968db5-5d49-467f-9ff3-afc37b64364f.com.redhat.rhevm.vdsm >VM Channels Listener::DEBUG::2014-07-10 09:02:09,120::vmChannels::148::vds::(_handle_unconnected) Connecting to fileno 63 succeeded. >Thread-34::DEBUG::2014-07-10 09:02:09,468::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [25a41cf8] >Thread-34::DEBUG::2014-07-10 09:02:09,469::task::595::TaskManager.Task::(_updateState) Task=`2657ae52-ccac-4722-b0ee-3c4045d468ef`::moving from state init -> state preparing >Thread-34::INFO::2014-07-10 09:02:09,470::logUtils::44::dispatcher::(wrapper) Run and protect: createVolume(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='b034d5b0-e1e0-4011-b49b-4d45ddb11556', size='10737418240', volFormat=4, preallocate=2, diskType=2, volUUID='3d7f62b5-328f-4d8e-8b69-873cfb5ae14d', desc='', srcImgUUID='9cf413b7-7f14-4a61-8c71-913e5b0ea9c0', srcVolUUID='47592965-e853-4e59-9728-d11cca6a7a8a') >Thread-34::DEBUG::2014-07-10 09:02:09,474::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.9e1aa540-1f4e-4ee3-a152-be381ef6c3bd`ReqID=`6dc85bba-fc31-4542-988d-271e123a5429`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '1464' at 'createVolume' >Thread-34::DEBUG::2014-07-10 09:02:09,474::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.9e1aa540-1f4e-4ee3-a152-be381ef6c3bd' for lock type 'shared' >Thread-34::DEBUG::2014-07-10 09:02:09,475::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.9e1aa540-1f4e-4ee3-a152-be381ef6c3bd' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-10 09:02:09,475::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.9e1aa540-1f4e-4ee3-a152-be381ef6c3bd`ReqID=`6dc85bba-fc31-4542-988d-271e123a5429`::Granted request >Thread-34::DEBUG::2014-07-10 09:02:09,476::task::827::TaskManager.Task::(resourceAcquired) Task=`2657ae52-ccac-4722-b0ee-3c4045d468ef`::_resourcesAcquired: Storage.9e1aa540-1f4e-4ee3-a152-be381ef6c3bd (shared) >Thread-34::DEBUG::2014-07-10 09:02:09,476::task::990::TaskManager.Task::(_decref) Task=`2657ae52-ccac-4722-b0ee-3c4045d468ef`::ref 1 aborting False >Thread-34::DEBUG::2014-07-10 09:02:09,479::task::752::TaskManager.Task::(_save) Task=`2657ae52-ccac-4722-b0ee-3c4045d468ef`::_save: orig /rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/master/tasks/2657ae52-ccac-4722-b0ee-3c4045d468ef temp /rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/master/tasks/2657ae52-ccac-4722-b0ee-3c4045d468ef.temp >Thread-34::DEBUG::2014-07-10 09:02:09,487::taskManager::68::TaskManager::(scheduleJob) scheduled job createVolume for task 2657ae52-ccac-4722-b0ee-3c4045d468ef >Thread-34::INFO::2014-07-10 09:02:09,487::logUtils::47::dispatcher::(wrapper) Run and protect: createVolume, Return response: None >Thread-34::DEBUG::2014-07-10 09:02:09,487::task::1180::TaskManager.Task::(prepare) Task=`2657ae52-ccac-4722-b0ee-3c4045d468ef`::Prepare: 1 jobs exist, move to acquiring >Thread-34::DEBUG::2014-07-10 09:02:09,487::task::595::TaskManager.Task::(_updateState) Task=`2657ae52-ccac-4722-b0ee-3c4045d468ef`::moving from state preparing -> state acquiring >Thread-34::DEBUG::2014-07-10 09:02:09,488::task::752::TaskManager.Task::(_save) Task=`2657ae52-ccac-4722-b0ee-3c4045d468ef`::_save: orig /rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/master/tasks/2657ae52-ccac-4722-b0ee-3c4045d468ef temp /rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/master/tasks/2657ae52-ccac-4722-b0ee-3c4045d468ef.temp >Thread-34::DEBUG::2014-07-10 09:02:09,495::task::595::TaskManager.Task::(_updateState) Task=`2657ae52-ccac-4722-b0ee-3c4045d468ef`::moving from state acquiring -> state queued >Thread-34::DEBUG::2014-07-10 09:02:09,495::task::752::TaskManager.Task::(_save) Task=`2657ae52-ccac-4722-b0ee-3c4045d468ef`::_save: orig /rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/master/tasks/2657ae52-ccac-4722-b0ee-3c4045d468ef temp /rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/master/tasks/2657ae52-ccac-4722-b0ee-3c4045d468ef.temp >Thread-34::DEBUG::2014-07-10 09:02:09,502::taskManager::50::TaskManager::(_queueTask) queuing task: 2657ae52-ccac-4722-b0ee-3c4045d468ef >Thread-34::DEBUG::2014-07-10 09:02:09,502::taskManager::56::TaskManager::(_queueTask) task queued: 2657ae52-ccac-4722-b0ee-3c4045d468ef >Thread-6::DEBUG::2014-07-10 09:02:09,503::threadPool::57::Misc.ThreadPool::(setRunningTask) Number of running tasks: 1 >Thread-34::DEBUG::2014-07-10 09:02:09,504::task::1182::TaskManager.Task::(prepare) Task=`2657ae52-ccac-4722-b0ee-3c4045d468ef`::returning >2657ae52-ccac-4722-b0ee-3c4045d468ef::DEBUG::2014-07-10 09:02:09,504::threadPool::200::Misc.ThreadPool.WorkerThread::(_processNextTask) Task: 2657ae52-ccac-4722-b0ee-3c4045d468ef running: <bound method Task.commit of <storage.task.Task instance at 0x7f621812de18>> with: None >Thread-34::DEBUG::2014-07-10 09:02:09,505::task::990::TaskManager.Task::(_decref) Task=`2657ae52-ccac-4722-b0ee-3c4045d468ef`::ref 0 aborting False >2657ae52-ccac-4722-b0ee-3c4045d468ef::DEBUG::2014-07-10 09:02:09,506::task::1194::TaskManager.Task::(commit) Task=`2657ae52-ccac-4722-b0ee-3c4045d468ef`::committing task: 2657ae52-ccac-4722-b0ee-3c4045d468ef >2657ae52-ccac-4722-b0ee-3c4045d468ef::DEBUG::2014-07-10 09:02:09,507::task::595::TaskManager.Task::(_updateState) Task=`2657ae52-ccac-4722-b0ee-3c4045d468ef`::moving from state queued -> state running >2657ae52-ccac-4722-b0ee-3c4045d468ef::DEBUG::2014-07-10 09:02:09,508::task::752::TaskManager.Task::(_save) Task=`2657ae52-ccac-4722-b0ee-3c4045d468ef`::_save: orig /rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/master/tasks/2657ae52-ccac-4722-b0ee-3c4045d468ef temp /rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/master/tasks/2657ae52-ccac-4722-b0ee-3c4045d468ef.temp >2657ae52-ccac-4722-b0ee-3c4045d468ef::DEBUG::2014-07-10 09:02:09,516::task::905::TaskManager.Task::(_runJobs) Task=`2657ae52-ccac-4722-b0ee-3c4045d468ef`::Task.run: running job 0: createVolume: <bound method StoragePool.createVolume of <storage.sp.StoragePool object at 0x7f62180b9dd0>> (args: ('9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'b034d5b0-e1e0-4011-b49b-4d45ddb11556', 20971520, 4, 2, 2, '3d7f62b5-328f-4d8e-8b69-873cfb5ae14d', '', '9cf413b7-7f14-4a61-8c71-913e5b0ea9c0', '47592965-e853-4e59-9728-d11cca6a7a8a') kwargs: {}) >2657ae52-ccac-4722-b0ee-3c4045d468ef::DEBUG::2014-07-10 09:02:09,516::task::331::TaskManager.Task::(run) Task=`2657ae52-ccac-4722-b0ee-3c4045d468ef`::Job.run: running createVolume: <bound method StoragePool.createVolume of <storage.sp.StoragePool object at 0x7f62180b9dd0>> (args: ('9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'b034d5b0-e1e0-4011-b49b-4d45ddb11556', 20971520, 4, 2, 2, '3d7f62b5-328f-4d8e-8b69-873cfb5ae14d', '', '9cf413b7-7f14-4a61-8c71-913e5b0ea9c0', '47592965-e853-4e59-9728-d11cca6a7a8a') kwargs: {}) callback None >2657ae52-ccac-4722-b0ee-3c4045d468ef::DEBUG::2014-07-10 09:02:09,517::blockVolume::572::Storage.Misc.excCmd::(getMetadata) '/bin/dd iflag=direct skip=4 bs=512 if=/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/metadata count=1' (cwd None) >2657ae52-ccac-4722-b0ee-3c4045d468ef::DEBUG::2014-07-10 09:02:09,533::blockVolume::572::Storage.Misc.excCmd::(getMetadata) SUCCESS: <err> = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.000469951 s, 1.1 MB/s\n'; <rc> = 0 >2657ae52-ccac-4722-b0ee-3c4045d468ef::DEBUG::2014-07-10 09:02:09,534::misc::282::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.000469951 s, 1.1 MB/s'], size: 512 >2657ae52-ccac-4722-b0ee-3c4045d468ef::DEBUG::2014-07-10 09:02:09,535::resourceManager::198::ResourceManager.Request::(__init__) ResName=`9e1aa540-1f4e-4ee3-a152-be381ef6c3bd_imageNS.b034d5b0-e1e0-4011-b49b-4d45ddb11556`ReqID=`08f6bd43-6ffd-45a6-a0ce-8e5c0704c1ae`::Request was made in '/usr/share/vdsm/storage/sp.py' line '1767' at 'createVolume' >2657ae52-ccac-4722-b0ee-3c4045d468ef::DEBUG::2014-07-10 09:02:09,535::resourceManager::542::ResourceManager::(registerResource) Trying to register resource '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd_imageNS.b034d5b0-e1e0-4011-b49b-4d45ddb11556' for lock type 'exclusive' >2657ae52-ccac-4722-b0ee-3c4045d468ef::DEBUG::2014-07-10 09:02:09,537::lvm::427::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' got the operation mutex >2657ae52-ccac-4722-b0ee-3c4045d468ef::DEBUG::2014-07-10 09:02:09,537::lvm::296::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm lvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/3600601601282300032826addbbdae311|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,vg_name,attr,size,seg_start_pe,devices,tags 9e1aa540-1f4e-4ee3-a152-be381ef6c3bd' (cwd None) >Thread-48::DEBUG::2014-07-10 09:02:09,661::task::595::TaskManager.Task::(_updateState) Task=`8295486d-967a-4d0e-be86-7351067b7e3d`::moving from state init -> state preparing >Thread-48::INFO::2014-07-10 09:02:09,662::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='0cd7d6ce-f497-4243-a690-c57744861eea', volUUID='10b6a7dd-dc6c-43fa-ba17-92e4331b0e0b', options=None) >Thread-48::INFO::2014-07-10 09:02:09,662::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-48::DEBUG::2014-07-10 09:02:09,663::task::1185::TaskManager.Task::(prepare) Task=`8295486d-967a-4d0e-be86-7351067b7e3d`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-48::DEBUG::2014-07-10 09:02:09,663::task::595::TaskManager.Task::(_updateState) Task=`8295486d-967a-4d0e-be86-7351067b7e3d`::moving from state preparing -> state finished >Thread-48::DEBUG::2014-07-10 09:02:09,663::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-48::DEBUG::2014-07-10 09:02:09,663::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-48::DEBUG::2014-07-10 09:02:09,663::task::990::TaskManager.Task::(_decref) Task=`8295486d-967a-4d0e-be86-7351067b7e3d`::ref 0 aborting False >2657ae52-ccac-4722-b0ee-3c4045d468ef::DEBUG::2014-07-10 09:02:09,780::lvm::296::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >2657ae52-ccac-4722-b0ee-3c4045d468ef::DEBUG::2014-07-10 09:02:09,791::lvm::462::Storage.LVM::(_reloadlvs) lvs reloaded >2657ae52-ccac-4722-b0ee-3c4045d468ef::DEBUG::2014-07-10 09:02:09,792::lvm::462::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' released the operation mutex >2657ae52-ccac-4722-b0ee-3c4045d468ef::DEBUG::2014-07-10 09:02:09,792::resourceFactories::125::Storage.ResourcesFactories::(__getResourceCandidatesList) Image b034d5b0-e1e0-4011-b49b-4d45ddb11556 does not exist in domain 9e1aa540-1f4e-4ee3-a152-be381ef6c3bd >2657ae52-ccac-4722-b0ee-3c4045d468ef::DEBUG::2014-07-10 09:02:09,792::resourceManager::601::ResourceManager::(registerResource) Resource '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd_imageNS.b034d5b0-e1e0-4011-b49b-4d45ddb11556' is free. Now locking as 'exclusive' (1 active user) >2657ae52-ccac-4722-b0ee-3c4045d468ef::DEBUG::2014-07-10 09:02:09,792::resourceManager::238::ResourceManager.Request::(grant) ResName=`9e1aa540-1f4e-4ee3-a152-be381ef6c3bd_imageNS.b034d5b0-e1e0-4011-b49b-4d45ddb11556`ReqID=`08f6bd43-6ffd-45a6-a0ce-8e5c0704c1ae`::Granted request >2657ae52-ccac-4722-b0ee-3c4045d468ef::INFO::2014-07-10 09:02:09,794::image::123::Storage.Image::(create) Create placeholder /rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/images/b034d5b0-e1e0-4011-b49b-4d45ddb11556 for image's volumes >2657ae52-ccac-4722-b0ee-3c4045d468ef::DEBUG::2014-07-10 09:02:09,795::task::752::TaskManager.Task::(_save) Task=`2657ae52-ccac-4722-b0ee-3c4045d468ef`::_save: orig /rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/master/tasks/2657ae52-ccac-4722-b0ee-3c4045d468ef temp /rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/master/tasks/2657ae52-ccac-4722-b0ee-3c4045d468ef.temp >2657ae52-ccac-4722-b0ee-3c4045d468ef::DEBUG::2014-07-10 09:02:09,804::blockVolume::572::Storage.Misc.excCmd::(getMetadata) '/bin/dd iflag=direct skip=4 bs=512 if=/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/metadata count=1' (cwd None) >2657ae52-ccac-4722-b0ee-3c4045d468ef::DEBUG::2014-07-10 09:02:09,819::blockVolume::572::Storage.Misc.excCmd::(getMetadata) SUCCESS: <err> = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.000571577 s, 896 kB/s\n'; <rc> = 0 >2657ae52-ccac-4722-b0ee-3c4045d468ef::DEBUG::2014-07-10 09:02:09,820::misc::282::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.000571577 s, 896 kB/s'], size: 512 >2657ae52-ccac-4722-b0ee-3c4045d468ef::DEBUG::2014-07-10 09:02:09,820::volume::300::Storage.Volume::(share) Share volume 47592965-e853-4e59-9728-d11cca6a7a8a to /rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/images/b034d5b0-e1e0-4011-b49b-4d45ddb11556 >2657ae52-ccac-4722-b0ee-3c4045d468ef::DEBUG::2014-07-10 09:02:09,821::blockVolume::572::Storage.Misc.excCmd::(getMetadata) '/bin/dd iflag=direct skip=4 bs=512 if=/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/metadata count=1' (cwd None) >2657ae52-ccac-4722-b0ee-3c4045d468ef::DEBUG::2014-07-10 09:02:09,837::blockVolume::572::Storage.Misc.excCmd::(getMetadata) SUCCESS: <err> = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.00326848 s, 157 kB/s\n'; <rc> = 0 >2657ae52-ccac-4722-b0ee-3c4045d468ef::DEBUG::2014-07-10 09:02:09,838::misc::282::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.00326848 s, 157 kB/s'], size: 512 >2657ae52-ccac-4722-b0ee-3c4045d468ef::DEBUG::2014-07-10 09:02:09,839::task::752::TaskManager.Task::(_save) Task=`2657ae52-ccac-4722-b0ee-3c4045d468ef`::_save: orig /rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/master/tasks/2657ae52-ccac-4722-b0ee-3c4045d468ef temp /rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/master/tasks/2657ae52-ccac-4722-b0ee-3c4045d468ef.temp >2657ae52-ccac-4722-b0ee-3c4045d468ef::DEBUG::2014-07-10 09:02:09,853::blockVolume::353::Storage.Volume::(_share) Share volume 47592965-e853-4e59-9728-d11cca6a7a8a to /rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/images/b034d5b0-e1e0-4011-b49b-4d45ddb11556 >2657ae52-ccac-4722-b0ee-3c4045d468ef::DEBUG::2014-07-10 09:02:09,853::blockVolume::572::Storage.Misc.excCmd::(getMetadata) '/bin/dd iflag=direct skip=4 bs=512 if=/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/metadata count=1' (cwd None) >2657ae52-ccac-4722-b0ee-3c4045d468ef::DEBUG::2014-07-10 09:02:09,869::blockVolume::572::Storage.Misc.excCmd::(getMetadata) SUCCESS: <err> = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.000567285 s, 903 kB/s\n'; <rc> = 0 >2657ae52-ccac-4722-b0ee-3c4045d468ef::DEBUG::2014-07-10 09:02:09,869::misc::282::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.000567285 s, 903 kB/s'], size: 512 >2657ae52-ccac-4722-b0ee-3c4045d468ef::INFO::2014-07-10 09:02:09,869::volume::443::Storage.Volume::(create) Creating volume 3d7f62b5-328f-4d8e-8b69-873cfb5ae14d >2657ae52-ccac-4722-b0ee-3c4045d468ef::DEBUG::2014-07-10 09:02:09,871::task::752::TaskManager.Task::(_save) Task=`2657ae52-ccac-4722-b0ee-3c4045d468ef`::_save: orig /rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/master/tasks/2657ae52-ccac-4722-b0ee-3c4045d468ef temp /rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/master/tasks/2657ae52-ccac-4722-b0ee-3c4045d468ef.temp >2657ae52-ccac-4722-b0ee-3c4045d468ef::DEBUG::2014-07-10 09:02:09,881::task::752::TaskManager.Task::(_save) Task=`2657ae52-ccac-4722-b0ee-3c4045d468ef`::_save: orig /rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/master/tasks/2657ae52-ccac-4722-b0ee-3c4045d468ef temp /rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/master/tasks/2657ae52-ccac-4722-b0ee-3c4045d468ef.temp >2657ae52-ccac-4722-b0ee-3c4045d468ef::DEBUG::2014-07-10 09:02:09,893::lvm::296::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm lvcreate --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/3600601601282300032826addbbdae311|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } " --autobackup n --contiguous n --size 1024m --addtag OVIRT_VOL_INITIALIZING --name 3d7f62b5-328f-4d8e-8b69-873cfb5ae14d 9e1aa540-1f4e-4ee3-a152-be381ef6c3bd' (cwd None) >2657ae52-ccac-4722-b0ee-3c4045d468ef::DEBUG::2014-07-10 09:02:10,257::lvm::296::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ' WARNING: This metadata update is NOT backed up\n WARNING: This metadata update is NOT backed up\n'; <rc> = 0 >2657ae52-ccac-4722-b0ee-3c4045d468ef::DEBUG::2014-07-10 09:02:10,258::lvm::503::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >2657ae52-ccac-4722-b0ee-3c4045d468ef::DEBUG::2014-07-10 09:02:10,259::lvm::505::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >2657ae52-ccac-4722-b0ee-3c4045d468ef::DEBUG::2014-07-10 09:02:10,259::lvm::513::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >2657ae52-ccac-4722-b0ee-3c4045d468ef::DEBUG::2014-07-10 09:02:10,259::lvm::525::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >2657ae52-ccac-4722-b0ee-3c4045d468ef::WARNING::2014-07-10 09:02:10,260::utils::129::root::(rmFile) File: /rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/images/b034d5b0-e1e0-4011-b49b-4d45ddb11556/3d7f62b5-328f-4d8e-8b69-873cfb5ae14d already removed >2657ae52-ccac-4722-b0ee-3c4045d468ef::INFO::2014-07-10 09:02:10,260::blockVolume::169::Storage.Volume::(_create) Request to create snapshot b034d5b0-e1e0-4011-b49b-4d45ddb11556/3d7f62b5-328f-4d8e-8b69-873cfb5ae14d of volume 9cf413b7-7f14-4a61-8c71-913e5b0ea9c0/47592965-e853-4e59-9728-d11cca6a7a8a >2657ae52-ccac-4722-b0ee-3c4045d468ef::DEBUG::2014-07-10 09:02:10,261::task::752::TaskManager.Task::(_save) Task=`2657ae52-ccac-4722-b0ee-3c4045d468ef`::_save: orig /rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/master/tasks/2657ae52-ccac-4722-b0ee-3c4045d468ef temp /rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/master/tasks/2657ae52-ccac-4722-b0ee-3c4045d468ef.temp >2657ae52-ccac-4722-b0ee-3c4045d468ef::DEBUG::2014-07-10 09:02:10,273::blockVolume::572::Storage.Misc.excCmd::(getMetadata) '/bin/dd iflag=direct skip=4 bs=512 if=/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/metadata count=1' (cwd None) >2657ae52-ccac-4722-b0ee-3c4045d468ef::DEBUG::2014-07-10 09:02:10,301::blockVolume::572::Storage.Misc.excCmd::(getMetadata) SUCCESS: <err> = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.000431133 s, 1.2 MB/s\n'; <rc> = 0 >2657ae52-ccac-4722-b0ee-3c4045d468ef::DEBUG::2014-07-10 09:02:10,302::misc::282::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.000431133 s, 1.2 MB/s'], size: 512 >2657ae52-ccac-4722-b0ee-3c4045d468ef::INFO::2014-07-10 09:02:10,302::volume::789::Storage.Volume::(prepare) Volume: preparing volume 9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/47592965-e853-4e59-9728-d11cca6a7a8a >2657ae52-ccac-4722-b0ee-3c4045d468ef::DEBUG::2014-07-10 09:02:10,303::blockVolume::572::Storage.Misc.excCmd::(getMetadata) '/bin/dd iflag=direct skip=4 bs=512 if=/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/metadata count=1' (cwd None) >2657ae52-ccac-4722-b0ee-3c4045d468ef::DEBUG::2014-07-10 09:02:10,320::blockVolume::572::Storage.Misc.excCmd::(getMetadata) SUCCESS: <err> = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.000398472 s, 1.3 MB/s\n'; <rc> = 0 >2657ae52-ccac-4722-b0ee-3c4045d468ef::DEBUG::2014-07-10 09:02:10,320::misc::282::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.000398472 s, 1.3 MB/s'], size: 512 >2657ae52-ccac-4722-b0ee-3c4045d468ef::DEBUG::2014-07-10 09:02:10,321::resourceManager::198::ResourceManager.Request::(__init__) ResName=`9e1aa540-1f4e-4ee3-a152-be381ef6c3bd_lvmActivationNS.47592965-e853-4e59-9728-d11cca6a7a8a`ReqID=`85fd6a34-a8ef-4630-ab57-97661b5f37fc`::Request was made in '/usr/share/vdsm/storage/volume.py' line '806' at 'prepare' >2657ae52-ccac-4722-b0ee-3c4045d468ef::DEBUG::2014-07-10 09:02:10,321::resourceManager::542::ResourceManager::(registerResource) Trying to register resource '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd_lvmActivationNS.47592965-e853-4e59-9728-d11cca6a7a8a' for lock type 'shared' >2657ae52-ccac-4722-b0ee-3c4045d468ef::DEBUG::2014-07-10 09:02:10,322::resourceManager::601::ResourceManager::(registerResource) Resource '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd_lvmActivationNS.47592965-e853-4e59-9728-d11cca6a7a8a' is free. Now locking as 'shared' (1 active user) >2657ae52-ccac-4722-b0ee-3c4045d468ef::DEBUG::2014-07-10 09:02:10,322::resourceManager::238::ResourceManager.Request::(grant) ResName=`9e1aa540-1f4e-4ee3-a152-be381ef6c3bd_lvmActivationNS.47592965-e853-4e59-9728-d11cca6a7a8a`ReqID=`85fd6a34-a8ef-4630-ab57-97661b5f37fc`::Granted request >2657ae52-ccac-4722-b0ee-3c4045d468ef::DEBUG::2014-07-10 09:02:10,323::blockVolume::572::Storage.Misc.excCmd::(getMetadata) '/bin/dd iflag=direct skip=4 bs=512 if=/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/metadata count=1' (cwd None) >2657ae52-ccac-4722-b0ee-3c4045d468ef::DEBUG::2014-07-10 09:02:10,340::blockVolume::572::Storage.Misc.excCmd::(getMetadata) SUCCESS: <err> = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.000589689 s, 868 kB/s\n'; <rc> = 0 >2657ae52-ccac-4722-b0ee-3c4045d468ef::DEBUG::2014-07-10 09:02:10,341::misc::282::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.000589689 s, 868 kB/s'], size: 512 >2657ae52-ccac-4722-b0ee-3c4045d468ef::DEBUG::2014-07-10 09:02:10,342::volume::270::Storage.Volume::(clone) Volume.clone: /rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/images/b034d5b0-e1e0-4011-b49b-4d45ddb11556/47592965-e853-4e59-9728-d11cca6a7a8a to /rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/images/b034d5b0-e1e0-4011-b49b-4d45ddb11556/3d7f62b5-328f-4d8e-8b69-873cfb5ae14d >2657ae52-ccac-4722-b0ee-3c4045d468ef::DEBUG::2014-07-10 09:02:10,342::blockVolume::572::Storage.Misc.excCmd::(getMetadata) '/bin/dd iflag=direct skip=4 bs=512 if=/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/metadata count=1' (cwd None) >2657ae52-ccac-4722-b0ee-3c4045d468ef::DEBUG::2014-07-10 09:02:10,358::blockVolume::572::Storage.Misc.excCmd::(getMetadata) SUCCESS: <err> = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.000452092 s, 1.1 MB/s\n'; <rc> = 0 >2657ae52-ccac-4722-b0ee-3c4045d468ef::DEBUG::2014-07-10 09:02:10,359::misc::282::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.000452092 s, 1.1 MB/s'], size: 512 >2657ae52-ccac-4722-b0ee-3c4045d468ef::DEBUG::2014-07-10 09:02:10,360::blockVolume::572::Storage.Misc.excCmd::(getMetadata) '/bin/dd iflag=direct skip=4 bs=512 if=/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/metadata count=1' (cwd None) >2657ae52-ccac-4722-b0ee-3c4045d468ef::DEBUG::2014-07-10 09:02:10,375::blockVolume::572::Storage.Misc.excCmd::(getMetadata) SUCCESS: <err> = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.00041367 s, 1.2 MB/s\n'; <rc> = 0 >2657ae52-ccac-4722-b0ee-3c4045d468ef::DEBUG::2014-07-10 09:02:10,375::misc::282::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.00041367 s, 1.2 MB/s'], size: 512 >2657ae52-ccac-4722-b0ee-3c4045d468ef::DEBUG::2014-07-10 09:02:10,376::volume::1042::Storage.Misc.excCmd::(createVolume) '/usr/bin/qemu-img create -f qcow2 -F raw -b ../b034d5b0-e1e0-4011-b49b-4d45ddb11556/47592965-e853-4e59-9728-d11cca6a7a8a /rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/images/b034d5b0-e1e0-4011-b49b-4d45ddb11556/3d7f62b5-328f-4d8e-8b69-873cfb5ae14d' (cwd /rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/images/b034d5b0-e1e0-4011-b49b-4d45ddb11556) >2657ae52-ccac-4722-b0ee-3c4045d468ef::DEBUG::2014-07-10 09:02:10,437::volume::1042::Storage.Misc.excCmd::(createVolume) SUCCESS: <err> = ''; <rc> = 0 >2657ae52-ccac-4722-b0ee-3c4045d468ef::INFO::2014-07-10 09:02:10,438::blockVolume::393::Storage.Volume::(teardown) Tearing down volume 9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/47592965-e853-4e59-9728-d11cca6a7a8a justme False >2657ae52-ccac-4722-b0ee-3c4045d468ef::DEBUG::2014-07-10 09:02:10,438::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd_lvmActivationNS.47592965-e853-4e59-9728-d11cca6a7a8a' >2657ae52-ccac-4722-b0ee-3c4045d468ef::DEBUG::2014-07-10 09:02:10,438::resourceManager::635::ResourceManager::(releaseResource) Released resource '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd_lvmActivationNS.47592965-e853-4e59-9728-d11cca6a7a8a' (0 active users) >2657ae52-ccac-4722-b0ee-3c4045d468ef::DEBUG::2014-07-10 09:02:10,438::resourceManager::641::ResourceManager::(releaseResource) Resource '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd_lvmActivationNS.47592965-e853-4e59-9728-d11cca6a7a8a' is free, finding out if anyone is waiting for it. >2657ae52-ccac-4722-b0ee-3c4045d468ef::DEBUG::2014-07-10 09:02:10,439::lvm::296::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm lvchange --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/3600601601282300032826addbbdae311|/dev/mapper/360060160f4a030003840ec867ddee311|/dev/mapper/367cad74c2fcba00019e6afd20c781e67|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } " --autobackup n --available n 9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/47592965-e853-4e59-9728-d11cca6a7a8a' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:02:10,609::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:02:10,728::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0630935 s, 16.2 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-07-10 09:02:10,770::guestIF::274::vm.Vm::(_handleMessage) vmId=`52e238aa-e62a-48a8-a200-604e72422f3f`::username: u'None' >Thread-14::DEBUG::2014-07-10 09:02:11,766::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-14::DEBUG::2014-07-10 09:02:11,767::task::595::TaskManager.Task::(_updateState) Task=`63af099c-08db-43ed-862a-58a7424311dc`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 09:02:11,768::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-14::INFO::2014-07-10 09:02:11,768::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:02:11,768::task::1185::TaskManager.Task::(prepare) Task=`63af099c-08db-43ed-862a-58a7424311dc`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:02:11,769::task::595::TaskManager.Task::(_updateState) Task=`63af099c-08db-43ed-862a-58a7424311dc`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 09:02:11,769::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 09:02:11,769::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 09:02:11,769::task::990::TaskManager.Task::(_decref) Task=`63af099c-08db-43ed-862a-58a7424311dc`::ref 0 aborting False >Thread-34::DEBUG::2014-07-10 09:02:11,813::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-34::DEBUG::2014-07-10 09:02:11,814::task::595::TaskManager.Task::(_updateState) Task=`443952e3-3854-4039-ad07-ba9538abfdf5`::moving from state init -> state preparing >Thread-34::INFO::2014-07-10 09:02:11,815::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-34::DEBUG::2014-07-10 09:02:11,815::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`3ef6a862-11d7-4f36-82ea-d6bb4e304a7b`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-10 09:02:11,815::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' for lock type 'shared' >Thread-34::DEBUG::2014-07-10 09:02:11,816::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-10 09:02:11,816::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`3ef6a862-11d7-4f36-82ea-d6bb4e304a7b`::Granted request >Thread-34::DEBUG::2014-07-10 09:02:11,817::task::827::TaskManager.Task::(resourceAcquired) Task=`443952e3-3854-4039-ad07-ba9538abfdf5`::_resourcesAcquired: Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee (shared) >Thread-34::DEBUG::2014-07-10 09:02:11,817::task::990::TaskManager.Task::(_decref) Task=`443952e3-3854-4039-ad07-ba9538abfdf5`::ref 1 aborting False >Thread-34::DEBUG::2014-07-10 09:02:11,817::lvm::373::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-34::DEBUG::2014-07-10 09:02:11,818::lvm::296::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/3600601601282300032826addbbdae311|/dev/mapper/360060160f4a030003840ec867ddee311|/dev/mapper/367cad74c2fcba00019e6afd20c781e67|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name 9e1aa540-1f4e-4ee3-a152-be381ef6c3bd' (cwd None) >Thread-34::DEBUG::2014-07-10 09:02:12,019::lvm::296::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-34::DEBUG::2014-07-10 09:02:12,022::lvm::415::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-34::INFO::2014-07-10 09:02:12,023::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1079915839488', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532069482496', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:02:12,023::task::1185::TaskManager.Task::(prepare) Task=`443952e3-3854-4039-ad07-ba9538abfdf5`::finished: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1079915839488', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532069482496', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:02:12,024::task::595::TaskManager.Task::(_updateState) Task=`443952e3-3854-4039-ad07-ba9538abfdf5`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-10 09:02:12,024::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee': < ResourceRef 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-10 09:02:12,024::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-10 09:02:12,025::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' >Thread-34::DEBUG::2014-07-10 09:02:12,025::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' (0 active users) >Thread-34::DEBUG::2014-07-10 09:02:12,025::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-10 09:02:12,025::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', Clearing records. >Thread-34::DEBUG::2014-07-10 09:02:12,026::task::990::TaskManager.Task::(_decref) Task=`443952e3-3854-4039-ad07-ba9538abfdf5`::ref 0 aborting False >Thread-14::DEBUG::2014-07-10 09:02:12,145::BindingXMLRPC::1067::vds::(wrapper) client [10.35.3.13]::call vmGetStats with ('52e238aa-e62a-48a8-a200-604e72422f3f',) {} >Thread-14::DEBUG::2014-07-10 09:02:12,146::vm::676::vm.Vm::(_getDiskStats) vmId=`52e238aa-e62a-48a8-a200-604e72422f3f`::Disk hdd stats not available >Thread-14::DEBUG::2014-07-10 09:02:12,146::vm::676::vm.Vm::(_getDiskStats) vmId=`52e238aa-e62a-48a8-a200-604e72422f3f`::Disk hdc stats not available >Thread-14::DEBUG::2014-07-10 09:02:12,146::vm::676::vm.Vm::(_getDiskStats) vmId=`52e238aa-e62a-48a8-a200-604e72422f3f`::Disk vda stats not available >Thread-14::DEBUG::2014-07-10 09:02:12,147::vm::715::vm.Vm::(_getDiskLatency) vmId=`52e238aa-e62a-48a8-a200-604e72422f3f`::Disk hdd latency not available >Thread-14::DEBUG::2014-07-10 09:02:12,147::vm::715::vm.Vm::(_getDiskLatency) vmId=`52e238aa-e62a-48a8-a200-604e72422f3f`::Disk hdc latency not available >Thread-14::DEBUG::2014-07-10 09:02:12,147::vm::715::vm.Vm::(_getDiskLatency) vmId=`52e238aa-e62a-48a8-a200-604e72422f3f`::Disk vda latency not available >Thread-14::DEBUG::2014-07-10 09:02:12,148::BindingXMLRPC::1074::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'username': u'None', 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': u'vm-18-179.eng.lab.tlv.redhat.com', 'pid': '12236', 'session': 'Unknown', 'displaySecurePort': u'5903', 'timeOffset': '0', 'balloonInfo': {'balloon_max': '1048576', 'balloon_target': '1048576', 'balloon_cur': '1048576', 'balloon_min': '1048576'}, 'pauseCode': 'NOERR', 'disksUsage': [{u'path': u'/', u'total': '4792987648', u'used': '1843060736', u'fs': u'ext4'}, {u'path': u'/boot', u'total': '507744256', u'used': '40272896', u'fs': u'ext4'}, {u'path': u'/home', u'total': '458985472', u'used': '10766336', u'fs': u'ext4'}], 'network': {u'vnet1': {'macAddr': '00:1a:4a:de:6d:7b', 'rxDropped': '0', 'rxErrors': '0', 'txDropped': '0', 'txRate': '0.0', 'rxRate': '0.0', 'txErrors': '0', 'state': 'unknown', 'speed': '1000', 'name': u'vnet1'}}, 'vmType': 'kvm', 'guestName': u'vm-18-179.eng.lab.tlv.redhat.com', 'elapsedTime': '45', 'memoryStats': {}, 'cpuSys': '1.72', 'appsList': [u'kernel-2.6.32-431.el6', u'rhevm-guest-agent-common-1.0.9-1.el6ev'], 'guestOs': u'2.6.32-431.el6.x86_64', 'displayType': 'qxl', 'status': 'Up', 'hash': '-5500930374920933700', 'lastLogin': 1404982930.770546, 'vmId': '52e238aa-e62a-48a8-a200-604e72422f3f', 'displayIp': '0', 'displayPort': u'5902', 'clientIp': '', 'kvmEnable': 'true', 'disks': {u'vda': {'truesize': '1073741824', 'apparentsize': '1073741824', 'imageID': '76fdb054-02cd-42ed-9721-b3e65b34c3a4'}, u'hdd': {'truesize': '0', 'apparentsize': '0'}, u'hdc': {'truesize': '0', 'apparentsize': '0'}}, 'monitorResponse': '0', 'statsAge': '0.67', 'cpuUser': '46.44', 'guestCPUCount': -1, 'guestIPs': u'10.35.18.179', 'netIfaces': [{u'hw': u'00:1a:4a:de:6d:7b', u'name': u'eth0', u'inet': [u'10.35.18.179'], u'inet6': [u'fe80::21a:4aff:fede:6d7b']}]}]} >Thread-14::DEBUG::2014-07-10 09:02:12,153::BindingXMLRPC::1067::vds::(wrapper) client [10.35.3.13]::call vmGetStats with ('0e968db5-5d49-467f-9ff3-afc37b64364f',) {} >Thread-14::DEBUG::2014-07-10 09:02:12,153::vm::598::vm.Vm::(_getCpuStats) vmId=`0e968db5-5d49-467f-9ff3-afc37b64364f`::CPU stats not available: 'NoneType' object is unsubscriptable >Thread-14::DEBUG::2014-07-10 09:02:12,153::vm::654::vm.Vm::(_getNetworkStats) vmId=`0e968db5-5d49-467f-9ff3-afc37b64364f`::Network stats not available >Thread-14::DEBUG::2014-07-10 09:02:12,154::vm::676::vm.Vm::(_getDiskStats) vmId=`0e968db5-5d49-467f-9ff3-afc37b64364f`::Disk hdd stats not available >Thread-14::DEBUG::2014-07-10 09:02:12,154::vm::676::vm.Vm::(_getDiskStats) vmId=`0e968db5-5d49-467f-9ff3-afc37b64364f`::Disk hdc stats not available >Thread-14::DEBUG::2014-07-10 09:02:12,154::vm::676::vm.Vm::(_getDiskStats) vmId=`0e968db5-5d49-467f-9ff3-afc37b64364f`::Disk vda stats not available >Thread-14::DEBUG::2014-07-10 09:02:12,154::vm::715::vm.Vm::(_getDiskLatency) vmId=`0e968db5-5d49-467f-9ff3-afc37b64364f`::Disk hdd latency not available >Thread-14::DEBUG::2014-07-10 09:02:12,155::vm::715::vm.Vm::(_getDiskLatency) vmId=`0e968db5-5d49-467f-9ff3-afc37b64364f`::Disk hdc latency not available >Thread-14::DEBUG::2014-07-10 09:02:12,155::vm::715::vm.Vm::(_getDiskLatency) vmId=`0e968db5-5d49-467f-9ff3-afc37b64364f`::Disk vda latency not available >Thread-14::DEBUG::2014-07-10 09:02:12,155::BindingXMLRPC::1074::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Powering up', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '13498', 'displayIp': '0', 'displayPort': u'5906', 'session': 'Unknown', 'displaySecurePort': u'5907', 'timeOffset': '0', 'hash': '-6274297782377519393', 'balloonInfo': {'balloon_max': '1048576', 'balloon_target': '1048576', 'balloon_cur': '0', 'balloon_min': '1048576'}, 'pauseCode': 'NOERR', 'clientIp': '', 'kvmEnable': 'true', 'network': {u'vnet3': {'state': 'unknown', 'macAddr': '00:1a:4a:de:6d:7f', 'speed': '1000', 'name': u'vnet3'}}, 'vmId': '0e968db5-5d49-467f-9ff3-afc37b64364f', 'displayType': 'qxl', 'cpuUser': '0.00', 'disks': {u'vda': {'truesize': '1073741824', 'apparentsize': '1073741824', 'imageID': 'b6f6c0da-e67f-4902-b9ac-3069571a42fe'}, u'hdd': {'truesize': '0', 'apparentsize': '0'}, u'hdc': {'truesize': '0', 'apparentsize': '0'}}, 'monitorResponse': '0', 'statsAge': '1.84', 'elapsedTime': '6', 'vmType': 'kvm', 'cpuSys': '0.00', 'guestCPUCount': -1, 'appsList': [], 'guestIPs': ''}]} >Thread-14::DEBUG::2014-07-10 09:02:12,159::BindingXMLRPC::1067::vds::(wrapper) client [10.35.3.13]::call vmGetStats with ('949f6c19-87b5-4f16-a91c-0049749423ea',) {} >Thread-14::DEBUG::2014-07-10 09:02:12,160::vm::676::vm.Vm::(_getDiskStats) vmId=`949f6c19-87b5-4f16-a91c-0049749423ea`::Disk hdd stats not available >Thread-14::DEBUG::2014-07-10 09:02:12,160::vm::676::vm.Vm::(_getDiskStats) vmId=`949f6c19-87b5-4f16-a91c-0049749423ea`::Disk hdc stats not available >Thread-14::DEBUG::2014-07-10 09:02:12,160::vm::676::vm.Vm::(_getDiskStats) vmId=`949f6c19-87b5-4f16-a91c-0049749423ea`::Disk vda stats not available >Thread-14::DEBUG::2014-07-10 09:02:12,161::vm::715::vm.Vm::(_getDiskLatency) vmId=`949f6c19-87b5-4f16-a91c-0049749423ea`::Disk hdd latency not available >Thread-14::DEBUG::2014-07-10 09:02:12,161::vm::715::vm.Vm::(_getDiskLatency) vmId=`949f6c19-87b5-4f16-a91c-0049749423ea`::Disk hdc latency not available >Thread-14::DEBUG::2014-07-10 09:02:12,161::vm::715::vm.Vm::(_getDiskLatency) vmId=`949f6c19-87b5-4f16-a91c-0049749423ea`::Disk vda latency not available >Thread-14::DEBUG::2014-07-10 09:02:12,161::BindingXMLRPC::1074::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Powering up', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '12860', 'displayIp': '0', 'displayPort': u'5904', 'session': 'Unknown', 'displaySecurePort': u'5905', 'timeOffset': '0', 'hash': '-1803473594666319662', 'balloonInfo': {'balloon_max': '1048576', 'balloon_target': '1048576', 'balloon_cur': '1048576', 'balloon_min': '1048576'}, 'pauseCode': 'NOERR', 'clientIp': '', 'kvmEnable': 'true', 'network': {u'vnet2': {'macAddr': '00:1a:4a:de:6d:7e', 'rxDropped': '0', 'rxErrors': '0', 'txDropped': '0', 'txRate': '0.0', 'rxRate': '0.0', 'txErrors': '0', 'state': 'unknown', 'speed': '1000', 'name': u'vnet2'}}, 'vmId': '949f6c19-87b5-4f16-a91c-0049749423ea', 'displayType': 'qxl', 'cpuUser': '44.67', 'disks': {u'vda': {'truesize': '1073741824', 'apparentsize': '1073741824', 'imageID': '28408446-e5fd-4565-a976-e760951593fe'}, u'hdd': {'truesize': '0', 'apparentsize': '0'}, u'hdc': {'truesize': '0', 'apparentsize': '0'}}, 'monitorResponse': '0', 'statsAge': '1.23', 'elapsedTime': '25', 'vmType': 'kvm', 'cpuSys': '21.95', 'guestCPUCount': -1, 'appsList': [], 'guestIPs': ''}]} >Dummy-33::DEBUG::2014-07-10 09:02:12,744::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >GuestMonitor-scale_4::DEBUG::2014-07-10 09:02:12,845::vm::598::vm.Vm::(_getCpuStats) vmId=`0e968db5-5d49-467f-9ff3-afc37b64364f`::CPU stats not available: 'NoneType' object is unsubscriptable >GuestMonitor-scale_4::DEBUG::2014-07-10 09:02:12,848::vm::654::vm.Vm::(_getNetworkStats) vmId=`0e968db5-5d49-467f-9ff3-afc37b64364f`::Network stats not available >GuestMonitor-scale_4::DEBUG::2014-07-10 09:02:12,851::vm::676::vm.Vm::(_getDiskStats) vmId=`0e968db5-5d49-467f-9ff3-afc37b64364f`::Disk hdd stats not available >GuestMonitor-scale_4::DEBUG::2014-07-10 09:02:12,854::vm::676::vm.Vm::(_getDiskStats) vmId=`0e968db5-5d49-467f-9ff3-afc37b64364f`::Disk hdc stats not available >GuestMonitor-scale_4::DEBUG::2014-07-10 09:02:12,856::vm::676::vm.Vm::(_getDiskStats) vmId=`0e968db5-5d49-467f-9ff3-afc37b64364f`::Disk vda stats not available >GuestMonitor-scale_4::DEBUG::2014-07-10 09:02:12,858::vm::715::vm.Vm::(_getDiskLatency) vmId=`0e968db5-5d49-467f-9ff3-afc37b64364f`::Disk hdd latency not available >GuestMonitor-scale_4::DEBUG::2014-07-10 09:02:12,861::vm::715::vm.Vm::(_getDiskLatency) vmId=`0e968db5-5d49-467f-9ff3-afc37b64364f`::Disk hdc latency not available >GuestMonitor-scale_4::DEBUG::2014-07-10 09:02:12,863::vm::715::vm.Vm::(_getDiskLatency) vmId=`0e968db5-5d49-467f-9ff3-afc37b64364f`::Disk vda latency not available >GuestMonitor-scale_4::DEBUG::2014-07-10 09:02:12,871::vm::598::vm.Vm::(_getCpuStats) vmId=`0e968db5-5d49-467f-9ff3-afc37b64364f`::CPU stats not available: 'NoneType' object is unsubscriptable >GuestMonitor-scale_4::DEBUG::2014-07-10 09:02:12,874::vm::654::vm.Vm::(_getNetworkStats) vmId=`0e968db5-5d49-467f-9ff3-afc37b64364f`::Network stats not available >GuestMonitor-scale_4::DEBUG::2014-07-10 09:02:12,877::vm::676::vm.Vm::(_getDiskStats) vmId=`0e968db5-5d49-467f-9ff3-afc37b64364f`::Disk hdd stats not available >GuestMonitor-scale_4::DEBUG::2014-07-10 09:02:12,879::vm::676::vm.Vm::(_getDiskStats) vmId=`0e968db5-5d49-467f-9ff3-afc37b64364f`::Disk hdc stats not available >GuestMonitor-scale_4::DEBUG::2014-07-10 09:02:12,882::vm::676::vm.Vm::(_getDiskStats) vmId=`0e968db5-5d49-467f-9ff3-afc37b64364f`::Disk vda stats not available >GuestMonitor-scale_4::DEBUG::2014-07-10 09:02:12,885::vm::715::vm.Vm::(_getDiskLatency) vmId=`0e968db5-5d49-467f-9ff3-afc37b64364f`::Disk hdd latency not available >GuestMonitor-scale_4::DEBUG::2014-07-10 09:02:12,887::vm::715::vm.Vm::(_getDiskLatency) vmId=`0e968db5-5d49-467f-9ff3-afc37b64364f`::Disk hdc latency not available >GuestMonitor-scale_4::DEBUG::2014-07-10 09:02:12,889::vm::715::vm.Vm::(_getDiskLatency) vmId=`0e968db5-5d49-467f-9ff3-afc37b64364f`::Disk vda latency not available >Dummy-33::DEBUG::2014-07-10 09:02:12,905::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0338295 s, 30.3 MB/s\n'; <rc> = 0 >GuestMonitor-scale_2::DEBUG::2014-07-10 09:02:13,019::vm::676::vm.Vm::(_getDiskStats) vmId=`52e238aa-e62a-48a8-a200-604e72422f3f`::Disk hdd stats not available >GuestMonitor-scale_2::DEBUG::2014-07-10 09:02:13,019::vm::676::vm.Vm::(_getDiskStats) vmId=`52e238aa-e62a-48a8-a200-604e72422f3f`::Disk hdc stats not available >GuestMonitor-scale_2::DEBUG::2014-07-10 09:02:13,019::vm::676::vm.Vm::(_getDiskStats) vmId=`52e238aa-e62a-48a8-a200-604e72422f3f`::Disk vda stats not available >GuestMonitor-scale_2::DEBUG::2014-07-10 09:02:13,019::vm::715::vm.Vm::(_getDiskLatency) vmId=`52e238aa-e62a-48a8-a200-604e72422f3f`::Disk hdd latency not available >GuestMonitor-scale_2::DEBUG::2014-07-10 09:02:13,020::vm::715::vm.Vm::(_getDiskLatency) vmId=`52e238aa-e62a-48a8-a200-604e72422f3f`::Disk hdc latency not available >GuestMonitor-scale_2::DEBUG::2014-07-10 09:02:13,020::vm::715::vm.Vm::(_getDiskLatency) vmId=`52e238aa-e62a-48a8-a200-604e72422f3f`::Disk vda latency not available >GuestMonitor-scale_3::DEBUG::2014-07-10 09:02:13,024::vm::676::vm.Vm::(_getDiskStats) vmId=`949f6c19-87b5-4f16-a91c-0049749423ea`::Disk hdd stats not available >GuestMonitor-scale_2::DEBUG::2014-07-10 09:02:13,026::vm::676::vm.Vm::(_getDiskStats) vmId=`52e238aa-e62a-48a8-a200-604e72422f3f`::Disk hdd stats not available >GuestMonitor-scale_3::DEBUG::2014-07-10 09:02:13,026::vm::676::vm.Vm::(_getDiskStats) vmId=`949f6c19-87b5-4f16-a91c-0049749423ea`::Disk hdc stats not available >GuestMonitor-scale_2::DEBUG::2014-07-10 09:02:13,027::vm::676::vm.Vm::(_getDiskStats) vmId=`52e238aa-e62a-48a8-a200-604e72422f3f`::Disk hdc stats not available >GuestMonitor-scale_3::DEBUG::2014-07-10 09:02:13,027::vm::676::vm.Vm::(_getDiskStats) vmId=`949f6c19-87b5-4f16-a91c-0049749423ea`::Disk vda stats not available >GuestMonitor-scale_2::DEBUG::2014-07-10 09:02:13,028::vm::676::vm.Vm::(_getDiskStats) vmId=`52e238aa-e62a-48a8-a200-604e72422f3f`::Disk vda stats not available >GuestMonitor-scale_3::DEBUG::2014-07-10 09:02:13,029::vm::715::vm.Vm::(_getDiskLatency) vmId=`949f6c19-87b5-4f16-a91c-0049749423ea`::Disk hdd latency not available >GuestMonitor-scale_2::DEBUG::2014-07-10 09:02:13,029::vm::715::vm.Vm::(_getDiskLatency) vmId=`52e238aa-e62a-48a8-a200-604e72422f3f`::Disk hdd latency not available >GuestMonitor-scale_3::DEBUG::2014-07-10 09:02:13,030::vm::715::vm.Vm::(_getDiskLatency) vmId=`949f6c19-87b5-4f16-a91c-0049749423ea`::Disk hdc latency not available >GuestMonitor-scale_2::DEBUG::2014-07-10 09:02:13,031::vm::715::vm.Vm::(_getDiskLatency) vmId=`52e238aa-e62a-48a8-a200-604e72422f3f`::Disk hdc latency not available >GuestMonitor-scale_3::DEBUG::2014-07-10 09:02:13,031::vm::715::vm.Vm::(_getDiskLatency) vmId=`949f6c19-87b5-4f16-a91c-0049749423ea`::Disk vda latency not available >GuestMonitor-scale_2::DEBUG::2014-07-10 09:02:13,032::vm::715::vm.Vm::(_getDiskLatency) vmId=`52e238aa-e62a-48a8-a200-604e72422f3f`::Disk vda latency not available >GuestMonitor-scale_3::DEBUG::2014-07-10 09:02:13,034::vm::676::vm.Vm::(_getDiskStats) vmId=`949f6c19-87b5-4f16-a91c-0049749423ea`::Disk hdd stats not available >GuestMonitor-scale_3::DEBUG::2014-07-10 09:02:13,034::vm::676::vm.Vm::(_getDiskStats) vmId=`949f6c19-87b5-4f16-a91c-0049749423ea`::Disk hdc stats not available >GuestMonitor-scale_3::DEBUG::2014-07-10 09:02:13,034::vm::676::vm.Vm::(_getDiskStats) vmId=`949f6c19-87b5-4f16-a91c-0049749423ea`::Disk vda stats not available >GuestMonitor-scale_3::DEBUG::2014-07-10 09:02:13,034::vm::715::vm.Vm::(_getDiskLatency) vmId=`949f6c19-87b5-4f16-a91c-0049749423ea`::Disk hdd latency not available >GuestMonitor-scale_3::DEBUG::2014-07-10 09:02:13,034::vm::715::vm.Vm::(_getDiskLatency) vmId=`949f6c19-87b5-4f16-a91c-0049749423ea`::Disk hdc latency not available >GuestMonitor-scale_3::DEBUG::2014-07-10 09:02:13,035::vm::715::vm.Vm::(_getDiskLatency) vmId=`949f6c19-87b5-4f16-a91c-0049749423ea`::Disk vda latency not available >Thread-40::DEBUG::2014-07-10 09:02:14,216::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lion.qa.lab.tlv.redhat.com:_export_yuri2_backup2/6a70504d-00df-4869-8695-0f442053f6b6/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-40::DEBUG::2014-07-10 09:02:14,229::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n369 bytes (369 B) copied, 0.000469452 s, 786 kB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:02:14,923::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:02:15,017::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0388635 s, 26.3 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 09:02:15,201::task::595::TaskManager.Task::(_updateState) Task=`8be507ff-ed40-4c8b-80a9-2b2c38bf0a3c`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 09:02:15,201::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::INFO::2014-07-10 09:02:15,202::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000602024', 'lastCheck': '8.3', 'valid': True}, '6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000469452', 'lastCheck': '1.0', 'valid': True}} >Thread-14::DEBUG::2014-07-10 09:02:15,202::task::1185::TaskManager.Task::(prepare) Task=`8be507ff-ed40-4c8b-80a9-2b2c38bf0a3c`::finished: {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000602024', 'lastCheck': '8.3', 'valid': True}, '6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000469452', 'lastCheck': '1.0', 'valid': True}} >Thread-14::DEBUG::2014-07-10 09:02:15,202::task::595::TaskManager.Task::(_updateState) Task=`8be507ff-ed40-4c8b-80a9-2b2c38bf0a3c`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 09:02:15,202::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 09:02:15,202::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 09:02:15,203::task::990::TaskManager.Task::(_decref) Task=`8be507ff-ed40-4c8b-80a9-2b2c38bf0a3c`::ref 0 aborting False >Thread-14::DEBUG::2014-07-10 09:02:15,215::vm::676::vm.Vm::(_getDiskStats) vmId=`949f6c19-87b5-4f16-a91c-0049749423ea`::Disk hdd stats not available >Thread-14::DEBUG::2014-07-10 09:02:15,215::vm::676::vm.Vm::(_getDiskStats) vmId=`949f6c19-87b5-4f16-a91c-0049749423ea`::Disk hdc stats not available >Thread-14::DEBUG::2014-07-10 09:02:15,215::vm::676::vm.Vm::(_getDiskStats) vmId=`949f6c19-87b5-4f16-a91c-0049749423ea`::Disk vda stats not available >Thread-14::DEBUG::2014-07-10 09:02:15,216::vm::715::vm.Vm::(_getDiskLatency) vmId=`949f6c19-87b5-4f16-a91c-0049749423ea`::Disk hdd latency not available >Thread-14::DEBUG::2014-07-10 09:02:15,216::vm::715::vm.Vm::(_getDiskLatency) vmId=`949f6c19-87b5-4f16-a91c-0049749423ea`::Disk hdc latency not available >Thread-14::DEBUG::2014-07-10 09:02:15,216::vm::715::vm.Vm::(_getDiskLatency) vmId=`949f6c19-87b5-4f16-a91c-0049749423ea`::Disk vda latency not available >Thread-14::DEBUG::2014-07-10 09:02:15,217::vm::676::vm.Vm::(_getDiskStats) vmId=`52e238aa-e62a-48a8-a200-604e72422f3f`::Disk hdd stats not available >Thread-14::DEBUG::2014-07-10 09:02:15,217::vm::676::vm.Vm::(_getDiskStats) vmId=`52e238aa-e62a-48a8-a200-604e72422f3f`::Disk hdc stats not available >Thread-14::DEBUG::2014-07-10 09:02:15,217::vm::676::vm.Vm::(_getDiskStats) vmId=`52e238aa-e62a-48a8-a200-604e72422f3f`::Disk vda stats not available >Thread-14::DEBUG::2014-07-10 09:02:15,217::vm::715::vm.Vm::(_getDiskLatency) vmId=`52e238aa-e62a-48a8-a200-604e72422f3f`::Disk hdd latency not available >Thread-14::DEBUG::2014-07-10 09:02:15,217::vm::715::vm.Vm::(_getDiskLatency) vmId=`52e238aa-e62a-48a8-a200-604e72422f3f`::Disk hdc latency not available >Thread-14::DEBUG::2014-07-10 09:02:15,218::vm::715::vm.Vm::(_getDiskLatency) vmId=`52e238aa-e62a-48a8-a200-604e72422f3f`::Disk vda latency not available >Thread-14::DEBUG::2014-07-10 09:02:15,219::vm::598::vm.Vm::(_getCpuStats) vmId=`0e968db5-5d49-467f-9ff3-afc37b64364f`::CPU stats not available: 'NoneType' object is unsubscriptable >Thread-14::DEBUG::2014-07-10 09:02:15,219::vm::654::vm.Vm::(_getNetworkStats) vmId=`0e968db5-5d49-467f-9ff3-afc37b64364f`::Network stats not available >Thread-14::DEBUG::2014-07-10 09:02:15,219::vm::676::vm.Vm::(_getDiskStats) vmId=`0e968db5-5d49-467f-9ff3-afc37b64364f`::Disk hdd stats not available >Thread-14::DEBUG::2014-07-10 09:02:15,219::vm::676::vm.Vm::(_getDiskStats) vmId=`0e968db5-5d49-467f-9ff3-afc37b64364f`::Disk hdc stats not available >Thread-14::DEBUG::2014-07-10 09:02:15,220::vm::676::vm.Vm::(_getDiskStats) vmId=`0e968db5-5d49-467f-9ff3-afc37b64364f`::Disk vda stats not available >Thread-14::DEBUG::2014-07-10 09:02:15,220::vm::715::vm.Vm::(_getDiskLatency) vmId=`0e968db5-5d49-467f-9ff3-afc37b64364f`::Disk hdd latency not available >Thread-14::DEBUG::2014-07-10 09:02:15,220::vm::715::vm.Vm::(_getDiskLatency) vmId=`0e968db5-5d49-467f-9ff3-afc37b64364f`::Disk hdc latency not available >Thread-14::DEBUG::2014-07-10 09:02:15,220::vm::715::vm.Vm::(_getDiskLatency) vmId=`0e968db5-5d49-467f-9ff3-afc37b64364f`::Disk vda latency not available >Thread-14::DEBUG::2014-07-10 09:02:15,289::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-14::DEBUG::2014-07-10 09:02:15,289::task::595::TaskManager.Task::(_updateState) Task=`d977aef9-2ab9-4081-b6f4-546ab570f8e1`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 09:02:15,290::logUtils::44::dispatcher::(wrapper) Run and protect: getAllTasksStatuses(spUUID=None, options=None) >Thread-14::DEBUG::2014-07-10 09:02:15,290::taskManager::102::TaskManager::(getAllTasksStatuses) Entry. >Thread-14::DEBUG::2014-07-10 09:02:15,290::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 2657ae52-ccac-4722-b0ee-3c4045d468ef >Thread-14::DEBUG::2014-07-10 09:02:15,290::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '2657ae52-ccac-4722-b0ee-3c4045d468ef'} >Thread-14::DEBUG::2014-07-10 09:02:15,290::taskManager::113::TaskManager::(getAllTasksStatuses) Return: {'2657ae52-ccac-4722-b0ee-3c4045d468ef': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '2657ae52-ccac-4722-b0ee-3c4045d468ef'}} >Thread-14::INFO::2014-07-10 09:02:15,291::logUtils::47::dispatcher::(wrapper) Run and protect: getAllTasksStatuses, Return response: {'allTasksStatus': {'2657ae52-ccac-4722-b0ee-3c4045d468ef': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '2657ae52-ccac-4722-b0ee-3c4045d468ef'}}} >Thread-14::DEBUG::2014-07-10 09:02:15,291::task::1185::TaskManager.Task::(prepare) Task=`d977aef9-2ab9-4081-b6f4-546ab570f8e1`::finished: {'allTasksStatus': {'2657ae52-ccac-4722-b0ee-3c4045d468ef': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '2657ae52-ccac-4722-b0ee-3c4045d468ef'}}} >Thread-14::DEBUG::2014-07-10 09:02:15,291::task::595::TaskManager.Task::(_updateState) Task=`d977aef9-2ab9-4081-b6f4-546ab570f8e1`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 09:02:15,291::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 09:02:15,291::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 09:02:15,291::task::990::TaskManager.Task::(_decref) Task=`d977aef9-2ab9-4081-b6f4-546ab570f8e1`::ref 0 aborting False >2657ae52-ccac-4722-b0ee-3c4045d468ef::DEBUG::2014-07-10 09:02:15,518::lvm::296::Storage.Misc.excCmd::(cmd) FAILED: <err> = ' Logical volume 9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/47592965-e853-4e59-9728-d11cca6a7a8a in use.\n'; <rc> = 5 >2657ae52-ccac-4722-b0ee-3c4045d468ef::DEBUG::2014-07-10 09:02:15,524::lvm::513::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >2657ae52-ccac-4722-b0ee-3c4045d468ef::DEBUG::2014-07-10 09:02:15,525::lvm::525::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >2657ae52-ccac-4722-b0ee-3c4045d468ef::WARNING::2014-07-10 09:02:15,525::resourceFactories::61::Storage.ResourcesFactories::(close) Failure deactivate LV 9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/47592965-e853-4e59-9728-d11cca6a7a8a (Cannot deactivate Logical Volume: ('General Storage Exception: ("5 [] [\' Logical volume 9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/47592965-e853-4e59-9728-d11cca6a7a8a in use.\']\\n9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/[\'47592965-e853-4e59-9728-d11cca6a7a8a\']",)',)) >2657ae52-ccac-4722-b0ee-3c4045d468ef::DEBUG::2014-07-10 09:02:15,525::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd_lvmActivationNS.47592965-e853-4e59-9728-d11cca6a7a8a', Clearing records. >2657ae52-ccac-4722-b0ee-3c4045d468ef::DEBUG::2014-07-10 09:02:15,526::lvm::427::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' got the operation mutex >2657ae52-ccac-4722-b0ee-3c4045d468ef::DEBUG::2014-07-10 09:02:15,527::lvm::296::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm lvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/3600601601282300032826addbbdae311|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,vg_name,attr,size,seg_start_pe,devices,tags 9e1aa540-1f4e-4ee3-a152-be381ef6c3bd' (cwd None) >2657ae52-ccac-4722-b0ee-3c4045d468ef::DEBUG::2014-07-10 09:02:15,731::lvm::296::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >2657ae52-ccac-4722-b0ee-3c4045d468ef::DEBUG::2014-07-10 09:02:15,754::lvm::462::Storage.LVM::(_reloadlvs) lvs reloaded >2657ae52-ccac-4722-b0ee-3c4045d468ef::DEBUG::2014-07-10 09:02:15,754::lvm::462::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' released the operation mutex >2657ae52-ccac-4722-b0ee-3c4045d468ef::DEBUG::2014-07-10 09:02:15,755::lvm::427::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' got the operation mutex >2657ae52-ccac-4722-b0ee-3c4045d468ef::DEBUG::2014-07-10 09:02:15,756::lvm::296::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm lvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/3600601601282300032826addbbdae311|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,vg_name,attr,size,seg_start_pe,devices,tags 9e1aa540-1f4e-4ee3-a152-be381ef6c3bd' (cwd None) >2657ae52-ccac-4722-b0ee-3c4045d468ef::DEBUG::2014-07-10 09:02:15,946::lvm::296::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >2657ae52-ccac-4722-b0ee-3c4045d468ef::DEBUG::2014-07-10 09:02:15,957::lvm::462::Storage.LVM::(_reloadlvs) lvs reloaded >2657ae52-ccac-4722-b0ee-3c4045d468ef::DEBUG::2014-07-10 09:02:15,957::lvm::462::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' released the operation mutex >2657ae52-ccac-4722-b0ee-3c4045d468ef::WARNING::2014-07-10 09:02:15,957::blockSD::761::Storage.StorageDomain::(_getOccupiedMetadataSlots) Could not find mapping for lv 9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/3d7f62b5-328f-4d8e-8b69-873cfb5ae14d >2657ae52-ccac-4722-b0ee-3c4045d468ef::DEBUG::2014-07-10 09:02:15,958::blockSD::784::Storage.StorageDomain::(getFreeMetadataSlot) Found freeSlot 9 in VG 9e1aa540-1f4e-4ee3-a152-be381ef6c3bd >2657ae52-ccac-4722-b0ee-3c4045d468ef::DEBUG::2014-07-10 09:02:15,958::lvm::296::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm lvchange --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/3600601601282300032826addbbdae311|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } " --autobackup n --deltag OVIRT_VOL_INITIALIZING --addtag PU_47592965-e853-4e59-9728-d11cca6a7a8a --addtag IU_b034d5b0-e1e0-4011-b49b-4d45ddb11556 --addtag MD_9 9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/3d7f62b5-328f-4d8e-8b69-873cfb5ae14d' (cwd None) >2657ae52-ccac-4722-b0ee-3c4045d468ef::DEBUG::2014-07-10 09:02:16,176::lvm::296::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ' WARNING: This metadata update is NOT backed up\n WARNING: This metadata update is NOT backed up\n'; <rc> = 0 >2657ae52-ccac-4722-b0ee-3c4045d468ef::DEBUG::2014-07-10 09:02:16,177::lvm::513::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >2657ae52-ccac-4722-b0ee-3c4045d468ef::DEBUG::2014-07-10 09:02:16,177::lvm::525::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >2657ae52-ccac-4722-b0ee-3c4045d468ef::DEBUG::2014-07-10 09:02:16,179::lvm::296::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm lvchange --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/3600601601282300032826addbbdae311|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } " --autobackup n --available n 9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/3d7f62b5-328f-4d8e-8b69-873cfb5ae14d' (cwd None) >2657ae52-ccac-4722-b0ee-3c4045d468ef::DEBUG::2014-07-10 09:02:16,596::lvm::296::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >2657ae52-ccac-4722-b0ee-3c4045d468ef::DEBUG::2014-07-10 09:02:16,596::lvm::513::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >2657ae52-ccac-4722-b0ee-3c4045d468ef::DEBUG::2014-07-10 09:02:16,597::lvm::525::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >2657ae52-ccac-4722-b0ee-3c4045d468ef::DEBUG::2014-07-10 09:02:16,599::task::752::TaskManager.Task::(_save) Task=`2657ae52-ccac-4722-b0ee-3c4045d468ef`::_save: orig /rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/master/tasks/2657ae52-ccac-4722-b0ee-3c4045d468ef temp /rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/master/tasks/2657ae52-ccac-4722-b0ee-3c4045d468ef.temp >2657ae52-ccac-4722-b0ee-3c4045d468ef::DEBUG::2014-07-10 09:02:16,612::blockVolume::604::Storage.Volume::(newVolumeLease) Initializing volume lease volUUID=3d7f62b5-328f-4d8e-8b69-873cfb5ae14d sdUUID=9e1aa540-1f4e-4ee3-a152-be381ef6c3bd, metaId=('9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 9) >2657ae52-ccac-4722-b0ee-3c4045d468ef::DEBUG::2014-07-10 09:02:16,619::task::752::TaskManager.Task::(_save) Task=`2657ae52-ccac-4722-b0ee-3c4045d468ef`::_save: orig /rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/master/tasks/2657ae52-ccac-4722-b0ee-3c4045d468ef temp /rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/master/tasks/2657ae52-ccac-4722-b0ee-3c4045d468ef.temp >2657ae52-ccac-4722-b0ee-3c4045d468ef::DEBUG::2014-07-10 09:02:16,642::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd_imageNS.b034d5b0-e1e0-4011-b49b-4d45ddb11556' >2657ae52-ccac-4722-b0ee-3c4045d468ef::DEBUG::2014-07-10 09:02:16,643::resourceManager::635::ResourceManager::(releaseResource) Released resource '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd_imageNS.b034d5b0-e1e0-4011-b49b-4d45ddb11556' (0 active users) >2657ae52-ccac-4722-b0ee-3c4045d468ef::DEBUG::2014-07-10 09:02:16,643::resourceManager::641::ResourceManager::(releaseResource) Resource '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd_imageNS.b034d5b0-e1e0-4011-b49b-4d45ddb11556' is free, finding out if anyone is waiting for it. >2657ae52-ccac-4722-b0ee-3c4045d468ef::DEBUG::2014-07-10 09:02:16,643::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd_imageNS.b034d5b0-e1e0-4011-b49b-4d45ddb11556', Clearing records. >2657ae52-ccac-4722-b0ee-3c4045d468ef::DEBUG::2014-07-10 09:02:16,643::task::595::TaskManager.Task::(_updateState) Task=`2657ae52-ccac-4722-b0ee-3c4045d468ef`::moving from state running -> state finished >2657ae52-ccac-4722-b0ee-3c4045d468ef::DEBUG::2014-07-10 09:02:16,644::task::752::TaskManager.Task::(_save) Task=`2657ae52-ccac-4722-b0ee-3c4045d468ef`::_save: orig /rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/master/tasks/2657ae52-ccac-4722-b0ee-3c4045d468ef temp /rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/master/tasks/2657ae52-ccac-4722-b0ee-3c4045d468ef.temp >2657ae52-ccac-4722-b0ee-3c4045d468ef::DEBUG::2014-07-10 09:02:16,653::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': < ResourceRef 'Storage.9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', isValid: 'True' obj: 'None'>} >2657ae52-ccac-4722-b0ee-3c4045d468ef::DEBUG::2014-07-10 09:02:16,653::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >2657ae52-ccac-4722-b0ee-3c4045d468ef::DEBUG::2014-07-10 09:02:16,653::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.9e1aa540-1f4e-4ee3-a152-be381ef6c3bd' >2657ae52-ccac-4722-b0ee-3c4045d468ef::DEBUG::2014-07-10 09:02:16,653::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.9e1aa540-1f4e-4ee3-a152-be381ef6c3bd' (0 active users) >2657ae52-ccac-4722-b0ee-3c4045d468ef::DEBUG::2014-07-10 09:02:16,654::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.9e1aa540-1f4e-4ee3-a152-be381ef6c3bd' is free, finding out if anyone is waiting for it. >2657ae52-ccac-4722-b0ee-3c4045d468ef::DEBUG::2014-07-10 09:02:16,654::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', Clearing records. >2657ae52-ccac-4722-b0ee-3c4045d468ef::DEBUG::2014-07-10 09:02:16,654::task::913::TaskManager.Task::(_runJobs) Task=`2657ae52-ccac-4722-b0ee-3c4045d468ef`::Task.run: exit - success: result {'uuid': '3d7f62b5-328f-4d8e-8b69-873cfb5ae14d'} >2657ae52-ccac-4722-b0ee-3c4045d468ef::DEBUG::2014-07-10 09:02:16,654::task::990::TaskManager.Task::(_decref) Task=`2657ae52-ccac-4722-b0ee-3c4045d468ef`::ref 0 aborting False >2657ae52-ccac-4722-b0ee-3c4045d468ef::DEBUG::2014-07-10 09:02:16,655::threadPool::57::Misc.ThreadPool::(setRunningTask) Number of running tasks: 0 >Thread-18::DEBUG::2014-07-10 09:02:16,908::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/metadata bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-10 09:02:16,922::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000431843 s, 9.5 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:02:17,032::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:02:17,141::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0572577 s, 17.9 MB/s\n'; <rc> = 0 >GuestMonitor-scale_4::DEBUG::2014-07-10 09:02:17,900::vm::598::vm.Vm::(_getCpuStats) vmId=`0e968db5-5d49-467f-9ff3-afc37b64364f`::CPU stats not available: 'NoneType' object is unsubscriptable >GuestMonitor-scale_4::DEBUG::2014-07-10 09:02:17,901::vm::654::vm.Vm::(_getNetworkStats) vmId=`0e968db5-5d49-467f-9ff3-afc37b64364f`::Network stats not available >GuestMonitor-scale_4::DEBUG::2014-07-10 09:02:17,901::vm::676::vm.Vm::(_getDiskStats) vmId=`0e968db5-5d49-467f-9ff3-afc37b64364f`::Disk hdd stats not available >GuestMonitor-scale_4::DEBUG::2014-07-10 09:02:17,901::vm::676::vm.Vm::(_getDiskStats) vmId=`0e968db5-5d49-467f-9ff3-afc37b64364f`::Disk hdc stats not available >GuestMonitor-scale_4::DEBUG::2014-07-10 09:02:17,901::vm::676::vm.Vm::(_getDiskStats) vmId=`0e968db5-5d49-467f-9ff3-afc37b64364f`::Disk vda stats not available >GuestMonitor-scale_4::DEBUG::2014-07-10 09:02:17,902::vm::715::vm.Vm::(_getDiskLatency) vmId=`0e968db5-5d49-467f-9ff3-afc37b64364f`::Disk hdd latency not available >GuestMonitor-scale_4::DEBUG::2014-07-10 09:02:17,902::vm::715::vm.Vm::(_getDiskLatency) vmId=`0e968db5-5d49-467f-9ff3-afc37b64364f`::Disk hdc latency not available >GuestMonitor-scale_4::DEBUG::2014-07-10 09:02:17,902::vm::715::vm.Vm::(_getDiskLatency) vmId=`0e968db5-5d49-467f-9ff3-afc37b64364f`::Disk vda latency not available >GuestMonitor-scale_4::DEBUG::2014-07-10 09:02:17,902::vm::598::vm.Vm::(_getCpuStats) vmId=`0e968db5-5d49-467f-9ff3-afc37b64364f`::CPU stats not available: 'NoneType' object is unsubscriptable >GuestMonitor-scale_4::DEBUG::2014-07-10 09:02:17,903::vm::654::vm.Vm::(_getNetworkStats) vmId=`0e968db5-5d49-467f-9ff3-afc37b64364f`::Network stats not available >GuestMonitor-scale_4::DEBUG::2014-07-10 09:02:17,903::vm::676::vm.Vm::(_getDiskStats) vmId=`0e968db5-5d49-467f-9ff3-afc37b64364f`::Disk hdd stats not available >GuestMonitor-scale_4::DEBUG::2014-07-10 09:02:17,903::vm::676::vm.Vm::(_getDiskStats) vmId=`0e968db5-5d49-467f-9ff3-afc37b64364f`::Disk hdc stats not available >GuestMonitor-scale_4::DEBUG::2014-07-10 09:02:17,903::vm::676::vm.Vm::(_getDiskStats) vmId=`0e968db5-5d49-467f-9ff3-afc37b64364f`::Disk vda stats not available >GuestMonitor-scale_4::DEBUG::2014-07-10 09:02:17,903::vm::715::vm.Vm::(_getDiskLatency) vmId=`0e968db5-5d49-467f-9ff3-afc37b64364f`::Disk hdd latency not available >GuestMonitor-scale_4::DEBUG::2014-07-10 09:02:17,903::vm::715::vm.Vm::(_getDiskLatency) vmId=`0e968db5-5d49-467f-9ff3-afc37b64364f`::Disk hdc latency not available >GuestMonitor-scale_4::DEBUG::2014-07-10 09:02:17,904::vm::715::vm.Vm::(_getDiskLatency) vmId=`0e968db5-5d49-467f-9ff3-afc37b64364f`::Disk vda latency not available >GuestMonitor-scale_2::DEBUG::2014-07-10 09:02:18,039::vm::676::vm.Vm::(_getDiskStats) vmId=`52e238aa-e62a-48a8-a200-604e72422f3f`::Disk hdd stats not available >GuestMonitor-scale_2::DEBUG::2014-07-10 09:02:18,039::vm::676::vm.Vm::(_getDiskStats) vmId=`52e238aa-e62a-48a8-a200-604e72422f3f`::Disk hdc stats not available >GuestMonitor-scale_2::DEBUG::2014-07-10 09:02:18,039::vm::676::vm.Vm::(_getDiskStats) vmId=`52e238aa-e62a-48a8-a200-604e72422f3f`::Disk vda stats not available >GuestMonitor-scale_2::DEBUG::2014-07-10 09:02:18,040::vm::715::vm.Vm::(_getDiskLatency) vmId=`52e238aa-e62a-48a8-a200-604e72422f3f`::Disk hdd latency not available >GuestMonitor-scale_2::DEBUG::2014-07-10 09:02:18,040::vm::715::vm.Vm::(_getDiskLatency) vmId=`52e238aa-e62a-48a8-a200-604e72422f3f`::Disk hdc latency not available >GuestMonitor-scale_2::DEBUG::2014-07-10 09:02:18,040::vm::715::vm.Vm::(_getDiskLatency) vmId=`52e238aa-e62a-48a8-a200-604e72422f3f`::Disk vda latency not available >GuestMonitor-scale_2::DEBUG::2014-07-10 09:02:18,041::vm::676::vm.Vm::(_getDiskStats) vmId=`52e238aa-e62a-48a8-a200-604e72422f3f`::Disk hdd stats not available >GuestMonitor-scale_3::DEBUG::2014-07-10 09:02:18,041::vm::676::vm.Vm::(_getDiskStats) vmId=`949f6c19-87b5-4f16-a91c-0049749423ea`::Disk hdd stats not available >GuestMonitor-scale_2::DEBUG::2014-07-10 09:02:18,041::vm::676::vm.Vm::(_getDiskStats) vmId=`52e238aa-e62a-48a8-a200-604e72422f3f`::Disk hdc stats not available >GuestMonitor-scale_3::DEBUG::2014-07-10 09:02:18,042::vm::676::vm.Vm::(_getDiskStats) vmId=`949f6c19-87b5-4f16-a91c-0049749423ea`::Disk hdc stats not available >GuestMonitor-scale_2::DEBUG::2014-07-10 09:02:18,042::vm::676::vm.Vm::(_getDiskStats) vmId=`52e238aa-e62a-48a8-a200-604e72422f3f`::Disk vda stats not available >GuestMonitor-scale_3::DEBUG::2014-07-10 09:02:18,042::vm::676::vm.Vm::(_getDiskStats) vmId=`949f6c19-87b5-4f16-a91c-0049749423ea`::Disk vda stats not available >GuestMonitor-scale_2::DEBUG::2014-07-10 09:02:18,042::vm::715::vm.Vm::(_getDiskLatency) vmId=`52e238aa-e62a-48a8-a200-604e72422f3f`::Disk hdd latency not available >GuestMonitor-scale_3::DEBUG::2014-07-10 09:02:18,042::vm::715::vm.Vm::(_getDiskLatency) vmId=`949f6c19-87b5-4f16-a91c-0049749423ea`::Disk hdd latency not available >GuestMonitor-scale_2::DEBUG::2014-07-10 09:02:18,043::vm::715::vm.Vm::(_getDiskLatency) vmId=`52e238aa-e62a-48a8-a200-604e72422f3f`::Disk hdc latency not available >GuestMonitor-scale_3::DEBUG::2014-07-10 09:02:18,043::vm::715::vm.Vm::(_getDiskLatency) vmId=`949f6c19-87b5-4f16-a91c-0049749423ea`::Disk hdc latency not available >GuestMonitor-scale_2::DEBUG::2014-07-10 09:02:18,043::vm::715::vm.Vm::(_getDiskLatency) vmId=`52e238aa-e62a-48a8-a200-604e72422f3f`::Disk vda latency not available >GuestMonitor-scale_3::DEBUG::2014-07-10 09:02:18,043::vm::715::vm.Vm::(_getDiskLatency) vmId=`949f6c19-87b5-4f16-a91c-0049749423ea`::Disk vda latency not available >GuestMonitor-scale_3::DEBUG::2014-07-10 09:02:18,044::vm::676::vm.Vm::(_getDiskStats) vmId=`949f6c19-87b5-4f16-a91c-0049749423ea`::Disk hdd stats not available >GuestMonitor-scale_3::DEBUG::2014-07-10 09:02:18,045::vm::676::vm.Vm::(_getDiskStats) vmId=`949f6c19-87b5-4f16-a91c-0049749423ea`::Disk hdc stats not available >GuestMonitor-scale_3::DEBUG::2014-07-10 09:02:18,045::vm::676::vm.Vm::(_getDiskStats) vmId=`949f6c19-87b5-4f16-a91c-0049749423ea`::Disk vda stats not available >GuestMonitor-scale_3::DEBUG::2014-07-10 09:02:18,045::vm::715::vm.Vm::(_getDiskLatency) vmId=`949f6c19-87b5-4f16-a91c-0049749423ea`::Disk hdd latency not available >GuestMonitor-scale_3::DEBUG::2014-07-10 09:02:18,045::vm::715::vm.Vm::(_getDiskLatency) vmId=`949f6c19-87b5-4f16-a91c-0049749423ea`::Disk hdc latency not available >GuestMonitor-scale_3::DEBUG::2014-07-10 09:02:18,045::vm::715::vm.Vm::(_getDiskLatency) vmId=`949f6c19-87b5-4f16-a91c-0049749423ea`::Disk vda latency not available >Thread-14::DEBUG::2014-07-10 09:02:18,330::BindingXMLRPC::1067::vds::(wrapper) client [10.35.3.13]::call vmGetStats with ('0e968db5-5d49-467f-9ff3-afc37b64364f',) {} >Thread-14::DEBUG::2014-07-10 09:02:18,331::vm::598::vm.Vm::(_getCpuStats) vmId=`0e968db5-5d49-467f-9ff3-afc37b64364f`::CPU stats not available: 'NoneType' object is unsubscriptable >Thread-14::DEBUG::2014-07-10 09:02:18,331::vm::654::vm.Vm::(_getNetworkStats) vmId=`0e968db5-5d49-467f-9ff3-afc37b64364f`::Network stats not available >Thread-14::DEBUG::2014-07-10 09:02:18,331::vm::676::vm.Vm::(_getDiskStats) vmId=`0e968db5-5d49-467f-9ff3-afc37b64364f`::Disk hdd stats not available >Thread-14::DEBUG::2014-07-10 09:02:18,331::vm::676::vm.Vm::(_getDiskStats) vmId=`0e968db5-5d49-467f-9ff3-afc37b64364f`::Disk hdc stats not available >Thread-14::DEBUG::2014-07-10 09:02:18,331::vm::676::vm.Vm::(_getDiskStats) vmId=`0e968db5-5d49-467f-9ff3-afc37b64364f`::Disk vda stats not available >Thread-14::DEBUG::2014-07-10 09:02:18,332::vm::715::vm.Vm::(_getDiskLatency) vmId=`0e968db5-5d49-467f-9ff3-afc37b64364f`::Disk hdd latency not available >Thread-14::DEBUG::2014-07-10 09:02:18,332::vm::715::vm.Vm::(_getDiskLatency) vmId=`0e968db5-5d49-467f-9ff3-afc37b64364f`::Disk hdc latency not available >Thread-14::DEBUG::2014-07-10 09:02:18,332::vm::715::vm.Vm::(_getDiskLatency) vmId=`0e968db5-5d49-467f-9ff3-afc37b64364f`::Disk vda latency not available >Thread-14::DEBUG::2014-07-10 09:02:18,333::BindingXMLRPC::1074::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Powering up', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '13498', 'displayIp': '0', 'displayPort': u'5906', 'session': 'Unknown', 'displaySecurePort': u'5907', 'timeOffset': '0', 'hash': '-6274297782377519393', 'balloonInfo': {'balloon_max': '1048576', 'balloon_target': '1048576', 'balloon_cur': '0', 'balloon_min': '1048576'}, 'pauseCode': 'NOERR', 'clientIp': '', 'kvmEnable': 'true', 'network': {u'vnet3': {'state': 'unknown', 'macAddr': '00:1a:4a:de:6d:7f', 'speed': '1000', 'name': u'vnet3'}}, 'vmId': '0e968db5-5d49-467f-9ff3-afc37b64364f', 'displayType': 'qxl', 'cpuUser': '0.00', 'disks': {u'vda': {'truesize': '1073741824', 'apparentsize': '1073741824', 'imageID': 'b6f6c0da-e67f-4902-b9ac-3069571a42fe'}, u'hdd': {'truesize': '0', 'apparentsize': '0'}, u'hdc': {'truesize': '0', 'apparentsize': '0'}}, 'monitorResponse': '0', 'statsAge': '1.98', 'elapsedTime': '12', 'vmType': 'kvm', 'cpuSys': '0.00', 'guestCPUCount': -1, 'appsList': [], 'guestIPs': ''}]} >Thread-14::DEBUG::2014-07-10 09:02:18,337::BindingXMLRPC::1067::vds::(wrapper) client [10.35.3.13]::call vmGetStats with ('949f6c19-87b5-4f16-a91c-0049749423ea',) {} >Thread-14::DEBUG::2014-07-10 09:02:18,337::vm::676::vm.Vm::(_getDiskStats) vmId=`949f6c19-87b5-4f16-a91c-0049749423ea`::Disk hdd stats not available >Thread-14::DEBUG::2014-07-10 09:02:18,338::vm::676::vm.Vm::(_getDiskStats) vmId=`949f6c19-87b5-4f16-a91c-0049749423ea`::Disk hdc stats not available >Thread-14::DEBUG::2014-07-10 09:02:18,338::vm::676::vm.Vm::(_getDiskStats) vmId=`949f6c19-87b5-4f16-a91c-0049749423ea`::Disk vda stats not available >Thread-14::DEBUG::2014-07-10 09:02:18,338::vm::715::vm.Vm::(_getDiskLatency) vmId=`949f6c19-87b5-4f16-a91c-0049749423ea`::Disk hdd latency not available >Thread-14::DEBUG::2014-07-10 09:02:18,338::vm::715::vm.Vm::(_getDiskLatency) vmId=`949f6c19-87b5-4f16-a91c-0049749423ea`::Disk hdc latency not available >Thread-14::DEBUG::2014-07-10 09:02:18,338::vm::715::vm.Vm::(_getDiskLatency) vmId=`949f6c19-87b5-4f16-a91c-0049749423ea`::Disk vda latency not available >Thread-14::DEBUG::2014-07-10 09:02:18,338::BindingXMLRPC::1074::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Powering up', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '12860', 'displayIp': '0', 'displayPort': u'5904', 'session': 'Unknown', 'displaySecurePort': u'5905', 'timeOffset': '0', 'hash': '-1803473594666319662', 'balloonInfo': {'balloon_max': '1048576', 'balloon_target': '1048576', 'balloon_cur': '1048576', 'balloon_min': '1048576'}, 'pauseCode': 'NOERR', 'clientIp': '', 'kvmEnable': 'true', 'network': {u'vnet2': {'macAddr': '00:1a:4a:de:6d:7e', 'rxDropped': '0', 'rxErrors': '0', 'txDropped': '0', 'txRate': '0.0', 'rxRate': '0.0', 'txErrors': '0', 'state': 'unknown', 'speed': '1000', 'name': u'vnet2'}}, 'vmId': '949f6c19-87b5-4f16-a91c-0049749423ea', 'displayType': 'qxl', 'cpuUser': '44.67', 'disks': {u'vda': {'truesize': '1073741824', 'apparentsize': '1073741824', 'imageID': '28408446-e5fd-4565-a976-e760951593fe'}, u'hdd': {'truesize': '0', 'apparentsize': '0'}, u'hdc': {'truesize': '0', 'apparentsize': '0'}}, 'monitorResponse': '0', 'statsAge': '1.39', 'elapsedTime': '31', 'vmType': 'kvm', 'cpuSys': '21.95', 'guestCPUCount': -1, 'appsList': [], 'guestIPs': ''}]} >VM Channels Listener::DEBUG::2014-07-10 09:02:19,119::vmChannels::95::vds::(_handle_timeouts) Timeout on fileno 62. >Dummy-33::DEBUG::2014-07-10 09:02:19,156::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:02:19,274::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0669008 s, 15.3 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:02:21,290::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Thread-14::DEBUG::2014-07-10 09:02:21,355::BindingXMLRPC::1067::vds::(wrapper) client [10.35.3.13]::call vmGetStats with ('0e968db5-5d49-467f-9ff3-afc37b64364f',) {} >Thread-14::DEBUG::2014-07-10 09:02:21,357::vm::598::vm.Vm::(_getCpuStats) vmId=`0e968db5-5d49-467f-9ff3-afc37b64364f`::CPU stats not available: 'NoneType' object is unsubscriptable >Thread-14::DEBUG::2014-07-10 09:02:21,358::vm::654::vm.Vm::(_getNetworkStats) vmId=`0e968db5-5d49-467f-9ff3-afc37b64364f`::Network stats not available >Thread-14::DEBUG::2014-07-10 09:02:21,359::vm::676::vm.Vm::(_getDiskStats) vmId=`0e968db5-5d49-467f-9ff3-afc37b64364f`::Disk hdd stats not available >Thread-14::DEBUG::2014-07-10 09:02:21,360::vm::676::vm.Vm::(_getDiskStats) vmId=`0e968db5-5d49-467f-9ff3-afc37b64364f`::Disk hdc stats not available >Thread-14::DEBUG::2014-07-10 09:02:21,361::vm::676::vm.Vm::(_getDiskStats) vmId=`0e968db5-5d49-467f-9ff3-afc37b64364f`::Disk vda stats not available >Thread-14::DEBUG::2014-07-10 09:02:21,362::vm::715::vm.Vm::(_getDiskLatency) vmId=`0e968db5-5d49-467f-9ff3-afc37b64364f`::Disk hdd latency not available >Thread-14::DEBUG::2014-07-10 09:02:21,362::vm::715::vm.Vm::(_getDiskLatency) vmId=`0e968db5-5d49-467f-9ff3-afc37b64364f`::Disk hdc latency not available >Thread-14::DEBUG::2014-07-10 09:02:21,363::vm::715::vm.Vm::(_getDiskLatency) vmId=`0e968db5-5d49-467f-9ff3-afc37b64364f`::Disk vda latency not available >Thread-14::DEBUG::2014-07-10 09:02:21,364::BindingXMLRPC::1074::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Powering up', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '13498', 'displayIp': '0', 'displayPort': u'5906', 'session': 'Unknown', 'displaySecurePort': u'5907', 'timeOffset': '0', 'hash': '-6274297782377519393', 'balloonInfo': {'balloon_max': '1048576', 'balloon_target': '1048576', 'balloon_cur': '0', 'balloon_min': '1048576'}, 'pauseCode': 'NOERR', 'clientIp': '', 'kvmEnable': 'true', 'network': {u'vnet3': {'state': 'unknown', 'macAddr': '00:1a:4a:de:6d:7f', 'speed': '1000', 'name': u'vnet3'}}, 'vmId': '0e968db5-5d49-467f-9ff3-afc37b64364f', 'displayType': 'qxl', 'cpuUser': '0.00', 'disks': {u'vda': {'truesize': '1073741824', 'apparentsize': '1073741824', 'imageID': 'b6f6c0da-e67f-4902-b9ac-3069571a42fe'}, u'hdd': {'truesize': '0', 'apparentsize': '0'}, u'hdc': {'truesize': '0', 'apparentsize': '0'}}, 'monitorResponse': '0', 'statsAge': '0.99', 'elapsedTime': '15', 'vmType': 'kvm', 'cpuSys': '0.00', 'guestCPUCount': -1, 'appsList': [], 'guestIPs': ''}]} >Thread-14::DEBUG::2014-07-10 09:02:21,371::BindingXMLRPC::1067::vds::(wrapper) client [10.35.3.13]::call vmGetStats with ('949f6c19-87b5-4f16-a91c-0049749423ea',) {} >Thread-14::DEBUG::2014-07-10 09:02:21,372::vm::676::vm.Vm::(_getDiskStats) vmId=`949f6c19-87b5-4f16-a91c-0049749423ea`::Disk hdd stats not available >Thread-14::DEBUG::2014-07-10 09:02:21,373::vm::676::vm.Vm::(_getDiskStats) vmId=`949f6c19-87b5-4f16-a91c-0049749423ea`::Disk hdc stats not available >Thread-14::DEBUG::2014-07-10 09:02:21,373::vm::676::vm.Vm::(_getDiskStats) vmId=`949f6c19-87b5-4f16-a91c-0049749423ea`::Disk vda stats not available >Thread-14::DEBUG::2014-07-10 09:02:21,374::vm::715::vm.Vm::(_getDiskLatency) vmId=`949f6c19-87b5-4f16-a91c-0049749423ea`::Disk hdd latency not available >Thread-14::DEBUG::2014-07-10 09:02:21,375::vm::715::vm.Vm::(_getDiskLatency) vmId=`949f6c19-87b5-4f16-a91c-0049749423ea`::Disk hdc latency not available >Thread-14::DEBUG::2014-07-10 09:02:21,376::vm::715::vm.Vm::(_getDiskLatency) vmId=`949f6c19-87b5-4f16-a91c-0049749423ea`::Disk vda latency not available >Thread-14::DEBUG::2014-07-10 09:02:21,378::BindingXMLRPC::1074::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Powering up', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '12860', 'displayIp': '0', 'displayPort': u'5904', 'session': 'Unknown', 'displaySecurePort': u'5905', 'timeOffset': '0', 'hash': '-1803473594666319662', 'balloonInfo': {'balloon_max': '1048576', 'balloon_target': '1048576', 'balloon_cur': '1048576', 'balloon_min': '1048576'}, 'pauseCode': 'NOERR', 'clientIp': '', 'kvmEnable': 'true', 'network': {u'vnet2': {'macAddr': '00:1a:4a:de:6d:7e', 'rxDropped': '0', 'rxErrors': '0', 'txDropped': '0', 'txRate': '0.0', 'rxRate': '0.0', 'txErrors': '0', 'state': 'unknown', 'speed': '1000', 'name': u'vnet2'}}, 'vmId': '949f6c19-87b5-4f16-a91c-0049749423ea', 'displayType': 'qxl', 'cpuUser': '48.23', 'disks': {u'vda': {'truesize': '1073741824', 'apparentsize': '1073741824', 'imageID': '28408446-e5fd-4565-a976-e760951593fe'}, u'hdd': {'truesize': '0', 'apparentsize': '0'}, u'hdc': {'truesize': '0', 'apparentsize': '0'}}, 'monitorResponse': '0', 'statsAge': '0.40', 'elapsedTime': '35', 'vmType': 'kvm', 'cpuSys': '4.25', 'guestCPUCount': -1, 'appsList': [], 'guestIPs': ''}]} >Dummy-33::DEBUG::2014-07-10 09:02:21,438::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0940358 s, 10.9 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 09:02:22,050::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-14::DEBUG::2014-07-10 09:02:22,052::task::595::TaskManager.Task::(_updateState) Task=`a3c4804a-d0bb-4111-bf6d-fb4e4e817ac4`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 09:02:22,052::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-14::INFO::2014-07-10 09:02:22,052::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:02:22,053::task::1185::TaskManager.Task::(prepare) Task=`a3c4804a-d0bb-4111-bf6d-fb4e4e817ac4`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:02:22,053::task::595::TaskManager.Task::(_updateState) Task=`a3c4804a-d0bb-4111-bf6d-fb4e4e817ac4`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 09:02:22,053::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 09:02:22,053::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 09:02:22,054::task::990::TaskManager.Task::(_decref) Task=`a3c4804a-d0bb-4111-bf6d-fb4e4e817ac4`::ref 0 aborting False >Thread-34::DEBUG::2014-07-10 09:02:22,058::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-34::DEBUG::2014-07-10 09:02:22,058::task::595::TaskManager.Task::(_updateState) Task=`814acb20-2855-486b-af9e-2db2526e05a2`::moving from state init -> state preparing >Thread-34::INFO::2014-07-10 09:02:22,059::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-34::DEBUG::2014-07-10 09:02:22,059::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`f2942d3f-171b-4b13-a080-369bd2d832a3`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-10 09:02:22,060::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' for lock type 'shared' >Thread-34::DEBUG::2014-07-10 09:02:22,060::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-10 09:02:22,060::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`f2942d3f-171b-4b13-a080-369bd2d832a3`::Granted request >Thread-34::DEBUG::2014-07-10 09:02:22,061::task::827::TaskManager.Task::(resourceAcquired) Task=`814acb20-2855-486b-af9e-2db2526e05a2`::_resourcesAcquired: Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee (shared) >Thread-34::DEBUG::2014-07-10 09:02:22,061::task::990::TaskManager.Task::(_decref) Task=`814acb20-2855-486b-af9e-2db2526e05a2`::ref 1 aborting False >Thread-34::INFO::2014-07-10 09:02:22,062::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1078842097664', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532069482496', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:02:22,062::task::1185::TaskManager.Task::(prepare) Task=`814acb20-2855-486b-af9e-2db2526e05a2`::finished: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1078842097664', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532069482496', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:02:22,063::task::595::TaskManager.Task::(_updateState) Task=`814acb20-2855-486b-af9e-2db2526e05a2`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-10 09:02:22,063::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee': < ResourceRef 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-10 09:02:22,063::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-10 09:02:22,063::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' >Thread-34::DEBUG::2014-07-10 09:02:22,063::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' (0 active users) >Thread-34::DEBUG::2014-07-10 09:02:22,064::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-10 09:02:22,064::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', Clearing records. >Thread-34::DEBUG::2014-07-10 09:02:22,064::task::990::TaskManager.Task::(_decref) Task=`814acb20-2855-486b-af9e-2db2526e05a2`::ref 0 aborting False >GuestMonitor-scale_4::DEBUG::2014-07-10 09:02:22,910::vm::598::vm.Vm::(_getCpuStats) vmId=`0e968db5-5d49-467f-9ff3-afc37b64364f`::CPU stats not available: 'NoneType' object is unsubscriptable >GuestMonitor-scale_4::DEBUG::2014-07-10 09:02:22,910::vm::654::vm.Vm::(_getNetworkStats) vmId=`0e968db5-5d49-467f-9ff3-afc37b64364f`::Network stats not available >GuestMonitor-scale_4::DEBUG::2014-07-10 09:02:22,911::vm::676::vm.Vm::(_getDiskStats) vmId=`0e968db5-5d49-467f-9ff3-afc37b64364f`::Disk hdd stats not available >GuestMonitor-scale_4::DEBUG::2014-07-10 09:02:22,911::vm::676::vm.Vm::(_getDiskStats) vmId=`0e968db5-5d49-467f-9ff3-afc37b64364f`::Disk hdc stats not available >GuestMonitor-scale_4::DEBUG::2014-07-10 09:02:22,911::vm::676::vm.Vm::(_getDiskStats) vmId=`0e968db5-5d49-467f-9ff3-afc37b64364f`::Disk vda stats not available >GuestMonitor-scale_4::DEBUG::2014-07-10 09:02:22,911::vm::715::vm.Vm::(_getDiskLatency) vmId=`0e968db5-5d49-467f-9ff3-afc37b64364f`::Disk hdd latency not available >GuestMonitor-scale_4::DEBUG::2014-07-10 09:02:22,911::vm::715::vm.Vm::(_getDiskLatency) vmId=`0e968db5-5d49-467f-9ff3-afc37b64364f`::Disk hdc latency not available >GuestMonitor-scale_4::DEBUG::2014-07-10 09:02:22,912::vm::715::vm.Vm::(_getDiskLatency) vmId=`0e968db5-5d49-467f-9ff3-afc37b64364f`::Disk vda latency not available >GuestMonitor-scale_4::DEBUG::2014-07-10 09:02:22,912::vm::598::vm.Vm::(_getCpuStats) vmId=`0e968db5-5d49-467f-9ff3-afc37b64364f`::CPU stats not available: 'NoneType' object is unsubscriptable >GuestMonitor-scale_4::DEBUG::2014-07-10 09:02:22,912::vm::654::vm.Vm::(_getNetworkStats) vmId=`0e968db5-5d49-467f-9ff3-afc37b64364f`::Network stats not available >GuestMonitor-scale_4::DEBUG::2014-07-10 09:02:22,913::vm::676::vm.Vm::(_getDiskStats) vmId=`0e968db5-5d49-467f-9ff3-afc37b64364f`::Disk hdd stats not available >GuestMonitor-scale_4::DEBUG::2014-07-10 09:02:22,913::vm::676::vm.Vm::(_getDiskStats) vmId=`0e968db5-5d49-467f-9ff3-afc37b64364f`::Disk hdc stats not available >GuestMonitor-scale_4::DEBUG::2014-07-10 09:02:22,913::vm::676::vm.Vm::(_getDiskStats) vmId=`0e968db5-5d49-467f-9ff3-afc37b64364f`::Disk vda stats not available >GuestMonitor-scale_4::DEBUG::2014-07-10 09:02:22,913::vm::715::vm.Vm::(_getDiskLatency) vmId=`0e968db5-5d49-467f-9ff3-afc37b64364f`::Disk hdd latency not available >GuestMonitor-scale_4::DEBUG::2014-07-10 09:02:22,913::vm::715::vm.Vm::(_getDiskLatency) vmId=`0e968db5-5d49-467f-9ff3-afc37b64364f`::Disk hdc latency not available >GuestMonitor-scale_4::DEBUG::2014-07-10 09:02:22,914::vm::715::vm.Vm::(_getDiskLatency) vmId=`0e968db5-5d49-467f-9ff3-afc37b64364f`::Disk vda latency not available >GuestMonitor-scale_2::DEBUG::2014-07-10 09:02:23,050::vm::676::vm.Vm::(_getDiskStats) vmId=`52e238aa-e62a-48a8-a200-604e72422f3f`::Disk hdd stats not available >GuestMonitor-scale_2::DEBUG::2014-07-10 09:02:23,050::vm::676::vm.Vm::(_getDiskStats) vmId=`52e238aa-e62a-48a8-a200-604e72422f3f`::Disk hdc stats not available >GuestMonitor-scale_2::DEBUG::2014-07-10 09:02:23,051::vm::676::vm.Vm::(_getDiskStats) vmId=`52e238aa-e62a-48a8-a200-604e72422f3f`::Disk vda stats not available >GuestMonitor-scale_3::DEBUG::2014-07-10 09:02:23,052::vm::676::vm.Vm::(_getDiskStats) vmId=`949f6c19-87b5-4f16-a91c-0049749423ea`::Disk hdd stats not available >GuestMonitor-scale_2::DEBUG::2014-07-10 09:02:23,052::vm::715::vm.Vm::(_getDiskLatency) vmId=`52e238aa-e62a-48a8-a200-604e72422f3f`::Disk hdd latency not available >GuestMonitor-scale_3::DEBUG::2014-07-10 09:02:23,053::vm::676::vm.Vm::(_getDiskStats) vmId=`949f6c19-87b5-4f16-a91c-0049749423ea`::Disk hdc stats not available >GuestMonitor-scale_2::DEBUG::2014-07-10 09:02:23,054::vm::715::vm.Vm::(_getDiskLatency) vmId=`52e238aa-e62a-48a8-a200-604e72422f3f`::Disk hdc latency not available >GuestMonitor-scale_3::DEBUG::2014-07-10 09:02:23,055::vm::676::vm.Vm::(_getDiskStats) vmId=`949f6c19-87b5-4f16-a91c-0049749423ea`::Disk vda stats not available >GuestMonitor-scale_2::DEBUG::2014-07-10 09:02:23,055::vm::715::vm.Vm::(_getDiskLatency) vmId=`52e238aa-e62a-48a8-a200-604e72422f3f`::Disk vda latency not available >GuestMonitor-scale_3::DEBUG::2014-07-10 09:02:23,056::vm::715::vm.Vm::(_getDiskLatency) vmId=`949f6c19-87b5-4f16-a91c-0049749423ea`::Disk hdd latency not available >GuestMonitor-scale_3::DEBUG::2014-07-10 09:02:23,057::vm::715::vm.Vm::(_getDiskLatency) vmId=`949f6c19-87b5-4f16-a91c-0049749423ea`::Disk hdc latency not available >GuestMonitor-scale_2::DEBUG::2014-07-10 09:02:23,058::vm::676::vm.Vm::(_getDiskStats) vmId=`52e238aa-e62a-48a8-a200-604e72422f3f`::Disk hdd stats not available >GuestMonitor-scale_3::DEBUG::2014-07-10 09:02:23,060::vm::715::vm.Vm::(_getDiskLatency) vmId=`949f6c19-87b5-4f16-a91c-0049749423ea`::Disk vda latency not available >GuestMonitor-scale_2::DEBUG::2014-07-10 09:02:23,061::vm::676::vm.Vm::(_getDiskStats) vmId=`52e238aa-e62a-48a8-a200-604e72422f3f`::Disk hdc stats not available >GuestMonitor-scale_2::DEBUG::2014-07-10 09:02:23,063::vm::676::vm.Vm::(_getDiskStats) vmId=`52e238aa-e62a-48a8-a200-604e72422f3f`::Disk vda stats not available >GuestMonitor-scale_3::DEBUG::2014-07-10 09:02:23,065::vm::676::vm.Vm::(_getDiskStats) vmId=`949f6c19-87b5-4f16-a91c-0049749423ea`::Disk hdd stats not available >GuestMonitor-scale_2::DEBUG::2014-07-10 09:02:23,066::vm::715::vm.Vm::(_getDiskLatency) vmId=`52e238aa-e62a-48a8-a200-604e72422f3f`::Disk hdd latency not available >GuestMonitor-scale_3::DEBUG::2014-07-10 09:02:23,067::vm::676::vm.Vm::(_getDiskStats) vmId=`949f6c19-87b5-4f16-a91c-0049749423ea`::Disk hdc stats not available >GuestMonitor-scale_2::DEBUG::2014-07-10 09:02:23,068::vm::715::vm.Vm::(_getDiskLatency) vmId=`52e238aa-e62a-48a8-a200-604e72422f3f`::Disk hdc latency not available >GuestMonitor-scale_3::DEBUG::2014-07-10 09:02:23,068::vm::676::vm.Vm::(_getDiskStats) vmId=`949f6c19-87b5-4f16-a91c-0049749423ea`::Disk vda stats not available >GuestMonitor-scale_2::DEBUG::2014-07-10 09:02:23,069::vm::715::vm.Vm::(_getDiskLatency) vmId=`52e238aa-e62a-48a8-a200-604e72422f3f`::Disk vda latency not available >GuestMonitor-scale_3::DEBUG::2014-07-10 09:02:23,070::vm::715::vm.Vm::(_getDiskLatency) vmId=`949f6c19-87b5-4f16-a91c-0049749423ea`::Disk hdd latency not available >GuestMonitor-scale_3::DEBUG::2014-07-10 09:02:23,071::vm::715::vm.Vm::(_getDiskLatency) vmId=`949f6c19-87b5-4f16-a91c-0049749423ea`::Disk hdc latency not available >GuestMonitor-scale_3::DEBUG::2014-07-10 09:02:23,071::vm::715::vm.Vm::(_getDiskLatency) vmId=`949f6c19-87b5-4f16-a91c-0049749423ea`::Disk vda latency not available >Dummy-33::DEBUG::2014-07-10 09:02:23,453::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:02:23,586::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0777361 s, 13.2 MB/s\n'; <rc> = 0 >Thread-40::DEBUG::2014-07-10 09:02:24,255::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lion.qa.lab.tlv.redhat.com:_export_yuri2_backup2/6a70504d-00df-4869-8695-0f442053f6b6/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-40::DEBUG::2014-07-10 09:02:24,270::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n369 bytes (369 B) copied, 0.000399723 s, 923 kB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 09:02:24,396::BindingXMLRPC::1067::vds::(wrapper) client [10.35.3.13]::call vmGetStats with ('0e968db5-5d49-467f-9ff3-afc37b64364f',) {} >Thread-14::DEBUG::2014-07-10 09:02:24,397::vm::676::vm.Vm::(_getDiskStats) vmId=`0e968db5-5d49-467f-9ff3-afc37b64364f`::Disk hdd stats not available >Thread-14::DEBUG::2014-07-10 09:02:24,397::vm::676::vm.Vm::(_getDiskStats) vmId=`0e968db5-5d49-467f-9ff3-afc37b64364f`::Disk hdc stats not available >Thread-14::DEBUG::2014-07-10 09:02:24,398::vm::676::vm.Vm::(_getDiskStats) vmId=`0e968db5-5d49-467f-9ff3-afc37b64364f`::Disk vda stats not available >Thread-14::DEBUG::2014-07-10 09:02:24,398::vm::715::vm.Vm::(_getDiskLatency) vmId=`0e968db5-5d49-467f-9ff3-afc37b64364f`::Disk hdd latency not available >Thread-14::DEBUG::2014-07-10 09:02:24,398::vm::715::vm.Vm::(_getDiskLatency) vmId=`0e968db5-5d49-467f-9ff3-afc37b64364f`::Disk hdc latency not available >Thread-14::DEBUG::2014-07-10 09:02:24,399::vm::715::vm.Vm::(_getDiskLatency) vmId=`0e968db5-5d49-467f-9ff3-afc37b64364f`::Disk vda latency not available >Thread-14::DEBUG::2014-07-10 09:02:24,399::BindingXMLRPC::1074::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Powering up', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '13498', 'displayIp': '0', 'displayPort': u'5906', 'session': 'Unknown', 'displaySecurePort': u'5907', 'timeOffset': '0', 'hash': '-6274297782377519393', 'balloonInfo': {'balloon_max': '1048576', 'balloon_target': '1048576', 'balloon_cur': '1048576', 'balloon_min': '1048576'}, 'pauseCode': 'NOERR', 'clientIp': '', 'kvmEnable': 'true', 'network': {u'vnet3': {'macAddr': '00:1a:4a:de:6d:7f', 'rxDropped': '0', 'rxErrors': '0', 'txDropped': '0', 'txRate': '0.0', 'rxRate': '0.0', 'txErrors': '0', 'state': 'unknown', 'speed': '1000', 'name': u'vnet3'}}, 'vmId': '0e968db5-5d49-467f-9ff3-afc37b64364f', 'displayType': 'qxl', 'cpuUser': '43.03', 'disks': {u'vda': {'truesize': '1073741824', 'apparentsize': '1073741824', 'imageID': 'b6f6c0da-e67f-4902-b9ac-3069571a42fe'}, u'hdd': {'truesize': '0', 'apparentsize': '0'}, u'hdc': {'truesize': '0', 'apparentsize': '0'}}, 'monitorResponse': '0', 'statsAge': '1.00', 'elapsedTime': '18', 'vmType': 'kvm', 'cpuSys': '23.56', 'guestCPUCount': -1, 'appsList': [], 'guestIPs': ''}]} >Thread-14::DEBUG::2014-07-10 09:02:24,420::BindingXMLRPC::1067::vds::(wrapper) client [10.35.3.13]::call vmGetStats with ('949f6c19-87b5-4f16-a91c-0049749423ea',) {} >Thread-14::DEBUG::2014-07-10 09:02:24,421::vm::676::vm.Vm::(_getDiskStats) vmId=`949f6c19-87b5-4f16-a91c-0049749423ea`::Disk hdd stats not available >Thread-14::DEBUG::2014-07-10 09:02:24,421::vm::676::vm.Vm::(_getDiskStats) vmId=`949f6c19-87b5-4f16-a91c-0049749423ea`::Disk hdc stats not available >Thread-14::DEBUG::2014-07-10 09:02:24,421::vm::676::vm.Vm::(_getDiskStats) vmId=`949f6c19-87b5-4f16-a91c-0049749423ea`::Disk vda stats not available >Thread-14::DEBUG::2014-07-10 09:02:24,421::vm::715::vm.Vm::(_getDiskLatency) vmId=`949f6c19-87b5-4f16-a91c-0049749423ea`::Disk hdd latency not available >Thread-14::DEBUG::2014-07-10 09:02:24,422::vm::715::vm.Vm::(_getDiskLatency) vmId=`949f6c19-87b5-4f16-a91c-0049749423ea`::Disk hdc latency not available >Thread-14::DEBUG::2014-07-10 09:02:24,422::vm::715::vm.Vm::(_getDiskLatency) vmId=`949f6c19-87b5-4f16-a91c-0049749423ea`::Disk vda latency not available >Thread-14::DEBUG::2014-07-10 09:02:24,423::BindingXMLRPC::1074::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Powering up', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '12860', 'displayIp': '0', 'displayPort': u'5904', 'session': 'Unknown', 'displaySecurePort': u'5905', 'timeOffset': '0', 'hash': '-1803473594666319662', 'balloonInfo': {'balloon_max': '1048576', 'balloon_target': '1048576', 'balloon_cur': '1048576', 'balloon_min': '1048576'}, 'pauseCode': 'NOERR', 'clientIp': '', 'kvmEnable': 'true', 'network': {u'vnet2': {'macAddr': '00:1a:4a:de:6d:7e', 'rxDropped': '0', 'rxErrors': '0', 'txDropped': '0', 'txRate': '0.0', 'rxRate': '0.0', 'txErrors': '0', 'state': 'unknown', 'speed': '1000', 'name': u'vnet2'}}, 'vmId': '949f6c19-87b5-4f16-a91c-0049749423ea', 'displayType': 'qxl', 'cpuUser': '48.23', 'disks': {u'vda': {'truesize': '1073741824', 'apparentsize': '1073741824', 'imageID': '28408446-e5fd-4565-a976-e760951593fe'}, u'hdd': {'truesize': '0', 'apparentsize': '0'}, u'hdc': {'truesize': '0', 'apparentsize': '0'}}, 'monitorResponse': '0', 'statsAge': '1.44', 'elapsedTime': '38', 'vmType': 'kvm', 'cpuSys': '4.25', 'guestCPUCount': -1, 'appsList': [], 'guestIPs': ''}]} >Thread-14::DEBUG::2014-07-10 09:02:25,296::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-14::DEBUG::2014-07-10 09:02:25,298::task::595::TaskManager.Task::(_updateState) Task=`1b4cc435-f588-4cf3-a1fe-d8bbc63d0282`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 09:02:25,298::logUtils::44::dispatcher::(wrapper) Run and protect: getAllTasksStatuses(spUUID=None, options=None) >Thread-14::DEBUG::2014-07-10 09:02:25,298::taskManager::102::TaskManager::(getAllTasksStatuses) Entry. >Thread-14::DEBUG::2014-07-10 09:02:25,299::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 2657ae52-ccac-4722-b0ee-3c4045d468ef >Thread-14::DEBUG::2014-07-10 09:02:25,299::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': '1 jobs completed successfully', 'taskState': 'finished', 'taskResult': 'success', 'taskID': '2657ae52-ccac-4722-b0ee-3c4045d468ef'} >Thread-14::DEBUG::2014-07-10 09:02:25,299::taskManager::113::TaskManager::(getAllTasksStatuses) Return: {'2657ae52-ccac-4722-b0ee-3c4045d468ef': {'code': 0, 'message': '1 jobs completed successfully', 'taskState': 'finished', 'taskResult': 'success', 'taskID': '2657ae52-ccac-4722-b0ee-3c4045d468ef'}} >Thread-14::INFO::2014-07-10 09:02:25,299::logUtils::47::dispatcher::(wrapper) Run and protect: getAllTasksStatuses, Return response: {'allTasksStatus': {'2657ae52-ccac-4722-b0ee-3c4045d468ef': {'code': 0, 'message': '1 jobs completed successfully', 'taskState': 'finished', 'taskResult': 'success', 'taskID': '2657ae52-ccac-4722-b0ee-3c4045d468ef'}}} >Thread-14::DEBUG::2014-07-10 09:02:25,299::task::1185::TaskManager.Task::(prepare) Task=`1b4cc435-f588-4cf3-a1fe-d8bbc63d0282`::finished: {'allTasksStatus': {'2657ae52-ccac-4722-b0ee-3c4045d468ef': {'code': 0, 'message': '1 jobs completed successfully', 'taskState': 'finished', 'taskResult': 'success', 'taskID': '2657ae52-ccac-4722-b0ee-3c4045d468ef'}}} >Thread-14::DEBUG::2014-07-10 09:02:25,300::task::595::TaskManager.Task::(_updateState) Task=`1b4cc435-f588-4cf3-a1fe-d8bbc63d0282`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 09:02:25,300::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 09:02:25,300::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 09:02:25,300::task::990::TaskManager.Task::(_decref) Task=`1b4cc435-f588-4cf3-a1fe-d8bbc63d0282`::ref 0 aborting False >Thread-34::DEBUG::2014-07-10 09:02:25,358::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [25a41cf8] >Thread-34::DEBUG::2014-07-10 09:02:25,358::task::595::TaskManager.Task::(_updateState) Task=`98aa1ca8-31bc-4aa6-a628-50ea9b7c912f`::moving from state init -> state preparing >Thread-34::INFO::2014-07-10 09:02:25,358::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeInfo(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='b034d5b0-e1e0-4011-b49b-4d45ddb11556', volUUID='3d7f62b5-328f-4d8e-8b69-873cfb5ae14d', options=None) >Thread-34::DEBUG::2014-07-10 09:02:25,359::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.9e1aa540-1f4e-4ee3-a152-be381ef6c3bd`ReqID=`9d8a4389-f2c0-46a1-9425-79089ee259b1`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '3089' at 'getVolumeInfo' >Thread-34::DEBUG::2014-07-10 09:02:25,359::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.9e1aa540-1f4e-4ee3-a152-be381ef6c3bd' for lock type 'shared' >Thread-34::DEBUG::2014-07-10 09:02:25,360::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.9e1aa540-1f4e-4ee3-a152-be381ef6c3bd' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-10 09:02:25,360::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.9e1aa540-1f4e-4ee3-a152-be381ef6c3bd`ReqID=`9d8a4389-f2c0-46a1-9425-79089ee259b1`::Granted request >Thread-34::DEBUG::2014-07-10 09:02:25,361::task::827::TaskManager.Task::(resourceAcquired) Task=`98aa1ca8-31bc-4aa6-a628-50ea9b7c912f`::_resourcesAcquired: Storage.9e1aa540-1f4e-4ee3-a152-be381ef6c3bd (shared) >Thread-34::DEBUG::2014-07-10 09:02:25,361::task::990::TaskManager.Task::(_decref) Task=`98aa1ca8-31bc-4aa6-a628-50ea9b7c912f`::ref 1 aborting False >Thread-34::DEBUG::2014-07-10 09:02:25,362::lvm::427::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' got the operation mutex >Thread-34::DEBUG::2014-07-10 09:02:25,363::lvm::296::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm lvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/3600601601282300032826addbbdae311|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,vg_name,attr,size,seg_start_pe,devices,tags 9e1aa540-1f4e-4ee3-a152-be381ef6c3bd' (cwd None) >Thread-34::DEBUG::2014-07-10 09:02:25,597::lvm::296::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:02:25,607::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Thread-34::DEBUG::2014-07-10 09:02:25,635::lvm::462::Storage.LVM::(_reloadlvs) lvs reloaded >Thread-34::DEBUG::2014-07-10 09:02:25,636::lvm::462::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' released the operation mutex >Thread-34::INFO::2014-07-10 09:02:25,637::volume::879::Storage.Volume::(getInfo) Info request: sdUUID=9e1aa540-1f4e-4ee3-a152-be381ef6c3bd imgUUID=b034d5b0-e1e0-4011-b49b-4d45ddb11556 volUUID = 3d7f62b5-328f-4d8e-8b69-873cfb5ae14d >Thread-34::DEBUG::2014-07-10 09:02:25,637::blockVolume::572::Storage.Misc.excCmd::(getMetadata) '/bin/dd iflag=direct skip=9 bs=512 if=/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/metadata count=1' (cwd None) >Thread-34::DEBUG::2014-07-10 09:02:25,680::blockVolume::572::Storage.Misc.excCmd::(getMetadata) SUCCESS: <err> = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.00051436 s, 995 kB/s\n'; <rc> = 0 >Thread-34::DEBUG::2014-07-10 09:02:25,683::misc::282::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.00051436 s, 995 kB/s'], size: 512 >Thread-34::DEBUG::2014-07-10 09:02:25,694::blockVolume::572::Storage.Misc.excCmd::(getMetadata) '/bin/dd iflag=direct skip=9 bs=512 if=/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/metadata count=1' (cwd None) >Thread-34::DEBUG::2014-07-10 09:02:25,722::blockVolume::572::Storage.Misc.excCmd::(getMetadata) SUCCESS: <err> = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.000627637 s, 816 kB/s\n'; <rc> = 0 >Thread-34::DEBUG::2014-07-10 09:02:25,725::misc::282::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.000627637 s, 816 kB/s'], size: 512 >Thread-34::INFO::2014-07-10 09:02:25,727::volume::909::Storage.Volume::(getInfo) 9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/b034d5b0-e1e0-4011-b49b-4d45ddb11556/3d7f62b5-328f-4d8e-8b69-873cfb5ae14d info is {'status': 'OK', 'domain': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'voltype': 'LEAF', 'description': '', 'parent': '47592965-e853-4e59-9728-d11cca6a7a8a', 'format': 'COW', 'image': 'b034d5b0-e1e0-4011-b49b-4d45ddb11556', 'ctime': '1404982936', 'disktype': '2', 'legality': 'LEGAL', 'mtime': '1404982936', 'apparentsize': '1073741824', 'children': [], 'pool': '', 'capacity': '10737418240', 'uuid': '3d7f62b5-328f-4d8e-8b69-873cfb5ae14d', 'truesize': '1073741824', 'type': 'SPARSE'} >Thread-34::INFO::2014-07-10 09:02:25,728::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeInfo, Return response: {'info': {'status': 'OK', 'domain': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'voltype': 'LEAF', 'description': '', 'parent': '47592965-e853-4e59-9728-d11cca6a7a8a', 'format': 'COW', 'image': 'b034d5b0-e1e0-4011-b49b-4d45ddb11556', 'ctime': '1404982936', 'disktype': '2', 'legality': 'LEGAL', 'mtime': '1404982936', 'apparentsize': '1073741824', 'children': [], 'pool': '', 'capacity': '10737418240', 'uuid': '3d7f62b5-328f-4d8e-8b69-873cfb5ae14d', 'truesize': '1073741824', 'type': 'SPARSE'}} >Thread-34::DEBUG::2014-07-10 09:02:25,730::task::1185::TaskManager.Task::(prepare) Task=`98aa1ca8-31bc-4aa6-a628-50ea9b7c912f`::finished: {'info': {'status': 'OK', 'domain': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'voltype': 'LEAF', 'description': '', 'parent': '47592965-e853-4e59-9728-d11cca6a7a8a', 'format': 'COW', 'image': 'b034d5b0-e1e0-4011-b49b-4d45ddb11556', 'ctime': '1404982936', 'disktype': '2', 'legality': 'LEGAL', 'mtime': '1404982936', 'apparentsize': '1073741824', 'children': [], 'pool': '', 'capacity': '10737418240', 'uuid': '3d7f62b5-328f-4d8e-8b69-873cfb5ae14d', 'truesize': '1073741824', 'type': 'SPARSE'}} >Thread-34::DEBUG::2014-07-10 09:02:25,731::task::595::TaskManager.Task::(_updateState) Task=`98aa1ca8-31bc-4aa6-a628-50ea9b7c912f`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-10 09:02:25,735::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': < ResourceRef 'Storage.9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-10 09:02:25,736::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-10 09:02:25,739::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.9e1aa540-1f4e-4ee3-a152-be381ef6c3bd' >Thread-34::DEBUG::2014-07-10 09:02:25,742::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.9e1aa540-1f4e-4ee3-a152-be381ef6c3bd' (0 active users) >Thread-34::DEBUG::2014-07-10 09:02:25,743::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.9e1aa540-1f4e-4ee3-a152-be381ef6c3bd' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-10 09:02:25,745::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', Clearing records. >Thread-34::DEBUG::2014-07-10 09:02:25,748::task::990::TaskManager.Task::(_decref) Task=`98aa1ca8-31bc-4aa6-a628-50ea9b7c912f`::ref 0 aborting False >Thread-14::DEBUG::2014-07-10 09:02:25,801::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-14::DEBUG::2014-07-10 09:02:25,806::task::595::TaskManager.Task::(_updateState) Task=`37a43480-9ee3-4f98-85b8-9d033ab3a39a`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 09:02:25,810::logUtils::44::dispatcher::(wrapper) Run and protect: clearTask(taskID='2657ae52-ccac-4722-b0ee-3c4045d468ef', spUUID=None, options=None) >Thread-14::DEBUG::2014-07-10 09:02:25,812::taskManager::161::TaskManager::(clearTask) Entry. taskID: 2657ae52-ccac-4722-b0ee-3c4045d468ef >Thread-14::DEBUG::2014-07-10 09:02:25,818::taskManager::166::TaskManager::(clearTask) Return. >Thread-14::INFO::2014-07-10 09:02:25,820::logUtils::47::dispatcher::(wrapper) Run and protect: clearTask, Return response: None >Thread-14::DEBUG::2014-07-10 09:02:25,822::task::1185::TaskManager.Task::(prepare) Task=`37a43480-9ee3-4f98-85b8-9d033ab3a39a`::finished: None >Thread-14::DEBUG::2014-07-10 09:02:25,824::task::595::TaskManager.Task::(_updateState) Task=`37a43480-9ee3-4f98-85b8-9d033ab3a39a`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 09:02:25,826::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 09:02:25,828::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 09:02:25,831::task::990::TaskManager.Task::(_decref) Task=`37a43480-9ee3-4f98-85b8-9d033ab3a39a`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 09:02:25,863::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.15671 s, 6.5 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 09:02:26,617::BindingXMLRPC::1067::vds::(wrapper) client [10.35.3.13]::call vmCreate with ({'acpiEnable': 'true', 'emulatedMachine': 'rhel6.5.0', 'vmId': '2386fa8c-f537-495c-ae07-e178171d77f2', 'memGuaranteedSize': 1024, 'spiceSslCipherSuite': 'DEFAULT', 'timeOffset': '0', 'cpuType': 'Conroe', 'custom': {'device_07c7a58e-8c75-4512-ba6a-38f01db238fbdevice_3a66de58-3e07-4e2f-b439-996ee23aa84bdevice_577d135b-bd8f-4dac-bb17-a204b68e050adevice_6f93d722-957f-4c84-9360-9c4cc7f06ff7': 'VmDevice {vmId=2386fa8c-f537-495c-ae07-e178171d77f2, deviceId=6f93d722-957f-4c84-9360-9c4cc7f06ff7, device=ide, type=CONTROLLER, bootOrder=0, specParams={}, address={bus=0x00, domain=0x0000, type=pci, slot=0x01, function=0x1}, managed=false, plugged=true, readOnly=false, deviceAlias=ide0, customProperties={}, snapshotId=null}', 'device_07c7a58e-8c75-4512-ba6a-38f01db238fbdevice_3a66de58-3e07-4e2f-b439-996ee23aa84bdevice_577d135b-bd8f-4dac-bb17-a204b68e050adevice_6f93d722-957f-4c84-9360-9c4cc7f06ff7device_b956bd65-0cc7-4378-8603-0bd4c9e93c36': 'VmDevice {vmId=2386fa8c-f537-495c-ae07-e178171d77f2, deviceId=b956bd65-0cc7-4378-8603-0bd4c9e93c36, device=virtio-serial, type=CONTROLLER, bootOrder=0, specParams={}, address={bus=0x00, domain=0x0000, type=pci, slot=0x05, function=0x0}, managed=false, plugged=true, readOnly=false, deviceAlias=virtio-serial0, customProperties={}, snapshotId=null}', 'device_07c7a58e-8c75-4512-ba6a-38f01db238fbdevice_3a66de58-3e07-4e2f-b439-996ee23aa84bdevice_577d135b-bd8f-4dac-bb17-a204b68e050a': 'VmDevice {vmId=2386fa8c-f537-495c-ae07-e178171d77f2, deviceId=577d135b-bd8f-4dac-bb17-a204b68e050a, device=unix, type=CHANNEL, bootOrder=0, specParams={}, address={port=2, bus=0, controller=0, type=virtio-serial}, managed=false, plugged=true, readOnly=false, deviceAlias=channel1, customProperties={}, snapshotId=null}', 'device_07c7a58e-8c75-4512-ba6a-38f01db238fb': 'VmDevice {vmId=2386fa8c-f537-495c-ae07-e178171d77f2, deviceId=07c7a58e-8c75-4512-ba6a-38f01db238fb, device=unix, type=CHANNEL, bootOrder=0, specParams={}, address={port=1, bus=0, controller=0, type=virtio-serial}, managed=false, plugged=true, readOnly=false, deviceAlias=channel0, customProperties={}, snapshotId=null}', 'device_07c7a58e-8c75-4512-ba6a-38f01db238fbdevice_3a66de58-3e07-4e2f-b439-996ee23aa84b': 'VmDevice {vmId=2386fa8c-f537-495c-ae07-e178171d77f2, deviceId=3a66de58-3e07-4e2f-b439-996ee23aa84b, device=spicevmc, type=CHANNEL, bootOrder=0, specParams={}, address={port=3, bus=0, controller=0, type=virtio-serial}, managed=false, plugged=true, readOnly=false, deviceAlias=channel2, customProperties={}, snapshotId=null}'}, 'smp': '2', 'vmType': 'kvm', 'memSize': 1024, 'smpCoresPerSocket': '2', 'vmName': 'scale_5', 'nice': '0', 'smartcardEnable': 'false', 'keyboardLayout': 'en-us', 'kvmEnable': 'true', 'pitReinjection': 'false', 'transparentHugePages': 'true', 'devices': [{'index': '3', 'iface': 'ide', 'specParams': {'vmPayload': {'volId': 'config-2', 'file': {'openstack/latest/meta_data.json': 'ewogICJsYXVuY2hfaW5kZXgiIDogIjAiLAogICJhdmFpbGFiaWxpdHlfem9uZSIgOiAibm92YSIs\nCiAgInV1aWQiIDogIjM2NTdiNTllLTBiNWQtNGY2ZC1hZjg4LWMzNjM4MjNhM2RjYiIsCiAgIm1l\ndGEiIDogewogICAgImVzc2VudGlhbCIgOiAiZmFsc2UiLAogICAgInJvbGUiIDogInNlcnZlciIs\nCiAgICAiZHNtb2RlIiA6ICJsb2NhbCIKICB9Cn0=\n', 'openstack/latest/user_data': 'I2Nsb3VkLWNvbmZpZwpzc2hfcHdhdXRoOiB0cnVlCmRpc2FibGVfcm9vdDogMApvdXRwdXQ6CiAg\nYWxsOiAnPj4gL3Zhci9sb2cvY2xvdWQtaW5pdC1vdXRwdXQubG9nJwp1c2VyOiByb290CmNocGFz\nc3dkOgogIGV4cGlyZTogZmFsc2UKcnVuY21kOgotICdzZWQgLWkgJycvXmRhdGFzb3VyY2VfbGlz\ndDogL2QnJyAvZXRjL2Nsb3VkL2Nsb3VkLmNmZzsgZWNobyAnJ2RhdGFzb3VyY2VfbGlzdDoKICBb\nIk5vQ2xvdWQiLCAiQ29uZmlnRHJpdmUiXScnID4+IC9ldGMvY2xvdWQvY2xvdWQuY2ZnJwo=\n'}}}, 'readonly': 'true', 'deviceId': '93b8370a-87e5-48f7-ad71-c3e8140017b4', 'path': '', 'device': 'cdrom', 'shared': 'false', 'type': 'disk'}, {'device': 'qxl', 'specParams': {'vram': '32768', 'ram': '65536', 'heads': '1'}, 'type': 'video', 'deviceId': '2e400b13-fbc3-4f39-af46-b22c04541a6a'}, {'index': '2', 'iface': 'ide', 'specParams': {'path': ''}, 'readonly': 'true', 'deviceId': '5fd3dd6d-2d1f-4caa-856a-578ef1499cf5', 'path': '', 'device': 'cdrom', 'shared': 'false', 'type': 'disk'}, {'index': 0, 'iface': 'virtio', 'format': 'cow', 'bootOrder': '1', 'poolID': '4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', 'volumeID': '3d7f62b5-328f-4d8e-8b69-873cfb5ae14d', 'imageID': 'b034d5b0-e1e0-4011-b49b-4d45ddb11556', 'specParams': {}, 'readonly': 'false', 'domainID': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'optional': 'false', 'deviceId': 'b034d5b0-e1e0-4011-b49b-4d45ddb11556', 'address': {'slot': '0x06', 'bus': '0x00', 'domain': '0x0000', 'type': 'pci', 'function': '0x0'}, 'device': 'disk', 'shared': 'false', 'propagateErrors': 'off', 'type': 'disk'}, {'nicModel': 'pv', 'macAddr': '00:1a:4a:de:6d:7c', 'linkActive': 'true', 'network': 'rhevm', 'filter': 'vdsm-no-mac-spoofing', 'specParams': {'inbound': {}, 'outbound': {}}, 'deviceId': '602ac16a-040a-4ac7-9705-82e954c48629', 'device': 'bridge', 'type': 'interface'}, {'device': 'memballoon', 'specParams': {'model': 'virtio'}, 'type': 'balloon', 'deviceId': '28e11219-c8d0-45bc-b820-5e990d6896e8'}, {'index': '0', 'specParams': {}, 'deviceId': '5800e3bf-56e8-4906-a11c-64d50f58ebfb', 'address': {'slot': '0x04', 'bus': '0x00', 'domain': '0x0000', 'type': 'pci', 'function': '0x0'}, 'device': 'scsi', 'model': 'virtio-scsi', 'type': 'controller'}], 'maxVCpus': '160', 'spiceSecureChannels': 'smain,sinputs,scursor,splayback,srecord,sdisplay,susbredir,ssmartcard', 'display': 'qxl'},) {} flowID [25539b4b] >Thread-14::INFO::2014-07-10 09:02:26,620::API::667::vds::(_getNetworkIp) network None: using 0 >Thread-14::INFO::2014-07-10 09:02:26,620::clientIF::366::vds::(createVm) vmContainerLock acquired by vm 2386fa8c-f537-495c-ae07-e178171d77f2 >Thread-14::DEBUG::2014-07-10 09:02:26,626::clientIF::379::vds::(createVm) Total desktops after creation of 2386fa8c-f537-495c-ae07-e178171d77f2 is 5 >Thread-58::DEBUG::2014-07-10 09:02:26,627::vm::2270::vm.Vm::(_startUnderlyingVm) vmId=`2386fa8c-f537-495c-ae07-e178171d77f2`::Start >Thread-14::DEBUG::2014-07-10 09:02:26,629::BindingXMLRPC::1074::vds::(wrapper) return vmCreate with {'status': {'message': 'Done', 'code': 0}, 'vmList': {'status': 'WaitForLaunch', 'acpiEnable': 'true', 'emulatedMachine': 'rhel6.5.0', 'vmId': '2386fa8c-f537-495c-ae07-e178171d77f2', 'pid': '0', 'memGuaranteedSize': 1024, 'timeOffset': '0', 'keyboardLayout': 'en-us', 'displayPort': '-1', 'displaySecurePort': '-1', 'spiceSslCipherSuite': 'DEFAULT', 'cpuType': 'Conroe', 'smp': '2', 'clientIp': '', 'nicModel': 'rtl8139,pv', 'smartcardEnable': 'false', 'kvmEnable': 'true', 'pitReinjection': 'false', 'transparentHugePages': 'true', 'devices': [{'index': '3', 'iface': 'ide', 'specParams': {'vmPayload': {'volId': 'config-2', 'file': {'openstack/latest/meta_data.json': 'ewogICJsYXVuY2hfaW5kZXgiIDogIjAiLAogICJhdmFpbGFiaWxpdHlfem9uZSIgOiAibm92YSIs\nCiAgInV1aWQiIDogIjM2NTdiNTllLTBiNWQtNGY2ZC1hZjg4LWMzNjM4MjNhM2RjYiIsCiAgIm1l\ndGEiIDogewogICAgImVzc2VudGlhbCIgOiAiZmFsc2UiLAogICAgInJvbGUiIDogInNlcnZlciIs\nCiAgICAiZHNtb2RlIiA6ICJsb2NhbCIKICB9Cn0=\n', 'openstack/latest/user_data': 'I2Nsb3VkLWNvbmZpZwpzc2hfcHdhdXRoOiB0cnVlCmRpc2FibGVfcm9vdDogMApvdXRwdXQ6CiAg\nYWxsOiAnPj4gL3Zhci9sb2cvY2xvdWQtaW5pdC1vdXRwdXQubG9nJwp1c2VyOiByb290CmNocGFz\nc3dkOgogIGV4cGlyZTogZmFsc2UKcnVuY21kOgotICdzZWQgLWkgJycvXmRhdGFzb3VyY2VfbGlz\ndDogL2QnJyAvZXRjL2Nsb3VkL2Nsb3VkLmNmZzsgZWNobyAnJ2RhdGFzb3VyY2VfbGlzdDoKICBb\nIk5vQ2xvdWQiLCAiQ29uZmlnRHJpdmUiXScnID4+IC9ldGMvY2xvdWQvY2xvdWQuY2ZnJwo=\n'}}}, 'readonly': 'true', 'deviceId': '93b8370a-87e5-48f7-ad71-c3e8140017b4', 'path': '', 'device': 'cdrom', 'shared': 'false', 'type': 'disk'}, {'device': 'qxl', 'specParams': {'vram': '32768', 'ram': '65536', 'heads': '1'}, 'type': 'video', 'deviceId': '2e400b13-fbc3-4f39-af46-b22c04541a6a'}, {'index': '2', 'iface': 'ide', 'specParams': {'path': ''}, 'readonly': 'true', 'deviceId': '5fd3dd6d-2d1f-4caa-856a-578ef1499cf5', 'path': '', 'device': 'cdrom', 'shared': 'false', 'type': 'disk'}, {'index': 0, 'iface': 'virtio', 'format': 'cow', 'bootOrder': '1', 'poolID': '4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', 'volumeID': '3d7f62b5-328f-4d8e-8b69-873cfb5ae14d', 'imageID': 'b034d5b0-e1e0-4011-b49b-4d45ddb11556', 'specParams': {}, 'readonly': 'false', 'domainID': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'optional': 'false', 'deviceId': 'b034d5b0-e1e0-4011-b49b-4d45ddb11556', 'address': {'slot': '0x06', 'bus': '0x00', 'domain': '0x0000', 'type': 'pci', 'function': '0x0'}, 'device': 'disk', 'shared': 'false', 'propagateErrors': 'off', 'type': 'disk'}, {'nicModel': 'pv', 'macAddr': '00:1a:4a:de:6d:7c', 'linkActive': 'true', 'network': 'rhevm', 'filter': 'vdsm-no-mac-spoofing', 'specParams': {'inbound': {}, 'outbound': {}}, 'deviceId': '602ac16a-040a-4ac7-9705-82e954c48629', 'device': 'bridge', 'type': 'interface'}, {'device': 'memballoon', 'specParams': {'model': 'virtio'}, 'type': 'balloon', 'deviceId': '28e11219-c8d0-45bc-b820-5e990d6896e8'}, {'index': '0', 'specParams': {}, 'deviceId': '5800e3bf-56e8-4906-a11c-64d50f58ebfb', 'address': {'slot': '0x04', 'bus': '0x00', 'domain': '0x0000', 'type': 'pci', 'function': '0x0'}, 'device': 'scsi', 'model': 'virtio-scsi', 'type': 'controller'}], 'custom': {'device_07c7a58e-8c75-4512-ba6a-38f01db238fbdevice_3a66de58-3e07-4e2f-b439-996ee23aa84bdevice_577d135b-bd8f-4dac-bb17-a204b68e050adevice_6f93d722-957f-4c84-9360-9c4cc7f06ff7': 'VmDevice {vmId=2386fa8c-f537-495c-ae07-e178171d77f2, deviceId=6f93d722-957f-4c84-9360-9c4cc7f06ff7, device=ide, type=CONTROLLER, bootOrder=0, specParams={}, address={bus=0x00, domain=0x0000, type=pci, slot=0x01, function=0x1}, managed=false, plugged=true, readOnly=false, deviceAlias=ide0, customProperties={}, snapshotId=null}', 'device_07c7a58e-8c75-4512-ba6a-38f01db238fbdevice_3a66de58-3e07-4e2f-b439-996ee23aa84bdevice_577d135b-bd8f-4dac-bb17-a204b68e050adevice_6f93d722-957f-4c84-9360-9c4cc7f06ff7device_b956bd65-0cc7-4378-8603-0bd4c9e93c36': 'VmDevice {vmId=2386fa8c-f537-495c-ae07-e178171d77f2, deviceId=b956bd65-0cc7-4378-8603-0bd4c9e93c36, device=virtio-serial, type=CONTROLLER, bootOrder=0, specParams={}, address={bus=0x00, domain=0x0000, type=pci, slot=0x05, function=0x0}, managed=false, plugged=true, readOnly=false, deviceAlias=virtio-serial0, customProperties={}, snapshotId=null}', 'device_07c7a58e-8c75-4512-ba6a-38f01db238fbdevice_3a66de58-3e07-4e2f-b439-996ee23aa84bdevice_577d135b-bd8f-4dac-bb17-a204b68e050a': 'VmDevice {vmId=2386fa8c-f537-495c-ae07-e178171d77f2, deviceId=577d135b-bd8f-4dac-bb17-a204b68e050a, device=unix, type=CHANNEL, bootOrder=0, specParams={}, address={port=2, bus=0, controller=0, type=virtio-serial}, managed=false, plugged=true, readOnly=false, deviceAlias=channel1, customProperties={}, snapshotId=null}', 'device_07c7a58e-8c75-4512-ba6a-38f01db238fb': 'VmDevice {vmId=2386fa8c-f537-495c-ae07-e178171d77f2, deviceId=07c7a58e-8c75-4512-ba6a-38f01db238fb, device=unix, type=CHANNEL, bootOrder=0, specParams={}, address={port=1, bus=0, controller=0, type=virtio-serial}, managed=false, plugged=true, readOnly=false, deviceAlias=channel0, customProperties={}, snapshotId=null}', 'device_07c7a58e-8c75-4512-ba6a-38f01db238fbdevice_3a66de58-3e07-4e2f-b439-996ee23aa84b': 'VmDevice {vmId=2386fa8c-f537-495c-ae07-e178171d77f2, deviceId=3a66de58-3e07-4e2f-b439-996ee23aa84b, device=spicevmc, type=CHANNEL, bootOrder=0, specParams={}, address={port=3, bus=0, controller=0, type=virtio-serial}, managed=false, plugged=true, readOnly=false, deviceAlias=channel2, customProperties={}, snapshotId=null}'}, 'vmType': 'kvm', 'memSize': 1024, 'displayIp': '0', 'maxVCpus': '160', 'spiceSecureChannels': 'smain,sinputs,scursor,splayback,srecord,sdisplay,susbredir,ssmartcard', 'smpCoresPerSocket': '2', 'vmName': 'scale_5', 'display': 'qxl', 'nice': '0'}} >Thread-58::DEBUG::2014-07-10 09:02:26,631::vm::2274::vm.Vm::(_startUnderlyingVm) vmId=`2386fa8c-f537-495c-ae07-e178171d77f2`::_ongoingCreations acquired >Thread-58::INFO::2014-07-10 09:02:26,634::vm::3151::vm.Vm::(_run) vmId=`2386fa8c-f537-495c-ae07-e178171d77f2`::VM wrapper has started >Thread-58::DEBUG::2014-07-10 09:02:26,639::task::595::TaskManager.Task::(_updateState) Task=`60d13774-99cc-4b10-b9fe-42f430df6caa`::moving from state init -> state preparing >Thread-58::INFO::2014-07-10 09:02:26,642::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='b034d5b0-e1e0-4011-b49b-4d45ddb11556', volUUID='3d7f62b5-328f-4d8e-8b69-873cfb5ae14d', options=None) >Thread-58::INFO::2014-07-10 09:02:26,646::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-58::DEBUG::2014-07-10 09:02:26,648::task::1185::TaskManager.Task::(prepare) Task=`60d13774-99cc-4b10-b9fe-42f430df6caa`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-58::DEBUG::2014-07-10 09:02:26,650::task::595::TaskManager.Task::(_updateState) Task=`60d13774-99cc-4b10-b9fe-42f430df6caa`::moving from state preparing -> state finished >Thread-58::DEBUG::2014-07-10 09:02:26,652::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-58::DEBUG::2014-07-10 09:02:26,654::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-58::DEBUG::2014-07-10 09:02:26,656::task::990::TaskManager.Task::(_decref) Task=`60d13774-99cc-4b10-b9fe-42f430df6caa`::ref 0 aborting False >Thread-58::INFO::2014-07-10 09:02:26,724::clientIF::324::vds::(prepareVolumePath) prepared volume path: /var/run/vdsm/payload/2386fa8c-f537-495c-ae07-e178171d77f2.d22956e19192ae7cd57d5d31bf777cdc.img >Thread-58::INFO::2014-07-10 09:02:26,724::clientIF::324::vds::(prepareVolumePath) prepared volume path: >Thread-58::DEBUG::2014-07-10 09:02:26,725::task::595::TaskManager.Task::(_updateState) Task=`59b662e1-c064-4d62-a3a9-a8e07a041fcf`::moving from state init -> state preparing >Thread-58::INFO::2014-07-10 09:02:26,725::logUtils::44::dispatcher::(wrapper) Run and protect: prepareImage(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='b034d5b0-e1e0-4011-b49b-4d45ddb11556', leafUUID='3d7f62b5-328f-4d8e-8b69-873cfb5ae14d') >Thread-58::DEBUG::2014-07-10 09:02:26,726::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.9e1aa540-1f4e-4ee3-a152-be381ef6c3bd`ReqID=`36528157-82e3-49c4-8090-d405e9f17447`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '3248' at 'prepareImage' >Thread-58::DEBUG::2014-07-10 09:02:26,726::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.9e1aa540-1f4e-4ee3-a152-be381ef6c3bd' for lock type 'shared' >Thread-58::DEBUG::2014-07-10 09:02:26,727::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.9e1aa540-1f4e-4ee3-a152-be381ef6c3bd' is free. Now locking as 'shared' (1 active user) >Thread-58::DEBUG::2014-07-10 09:02:26,727::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.9e1aa540-1f4e-4ee3-a152-be381ef6c3bd`ReqID=`36528157-82e3-49c4-8090-d405e9f17447`::Granted request >Thread-58::DEBUG::2014-07-10 09:02:26,727::task::827::TaskManager.Task::(resourceAcquired) Task=`59b662e1-c064-4d62-a3a9-a8e07a041fcf`::_resourcesAcquired: Storage.9e1aa540-1f4e-4ee3-a152-be381ef6c3bd (shared) >Thread-58::DEBUG::2014-07-10 09:02:26,727::task::990::TaskManager.Task::(_decref) Task=`59b662e1-c064-4d62-a3a9-a8e07a041fcf`::ref 1 aborting False >Thread-58::DEBUG::2014-07-10 09:02:26,728::lvm::427::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' got the operation mutex >Thread-58::DEBUG::2014-07-10 09:02:26,728::lvm::296::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm lvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/3600601601282300032826addbbdae311|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,vg_name,attr,size,seg_start_pe,devices,tags 9e1aa540-1f4e-4ee3-a152-be381ef6c3bd' (cwd None) >Thread-58::DEBUG::2014-07-10 09:02:26,943::lvm::296::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-18::DEBUG::2014-07-10 09:02:26,964::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/metadata bs=4096 count=1' (cwd None) >Thread-58::DEBUG::2014-07-10 09:02:27,000::lvm::462::Storage.LVM::(_reloadlvs) lvs reloaded >Thread-58::DEBUG::2014-07-10 09:02:27,003::lvm::462::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' released the operation mutex >Thread-58::DEBUG::2014-07-10 09:02:27,017::lvm::296::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm lvchange --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/3600601601282300032826addbbdae311|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } " --autobackup n --available y 9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/3d7f62b5-328f-4d8e-8b69-873cfb5ae14d' (cwd None) >Thread-18::DEBUG::2014-07-10 09:02:27,035::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000527639 s, 7.8 MB/s\n'; <rc> = 0 >Thread-58::DEBUG::2014-07-10 09:02:27,428::lvm::296::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-58::DEBUG::2014-07-10 09:02:27,434::lvm::513::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-58::DEBUG::2014-07-10 09:02:27,445::lvm::525::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-58::DEBUG::2014-07-10 09:02:27,449::blockSD::1057::Storage.StorageDomain::(linkBCImage) path to image directory already exists: /rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/images/b034d5b0-e1e0-4011-b49b-4d45ddb11556 >Thread-14::DEBUG::2014-07-10 09:02:27,454::BindingXMLRPC::1067::vds::(wrapper) client [10.35.3.13]::call vmGetStats with ('0e968db5-5d49-467f-9ff3-afc37b64364f',) {} >Thread-58::DEBUG::2014-07-10 09:02:27,456::lvm::427::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' got the operation mutex >Thread-14::DEBUG::2014-07-10 09:02:27,462::vm::676::vm.Vm::(_getDiskStats) vmId=`0e968db5-5d49-467f-9ff3-afc37b64364f`::Disk hdd stats not available >Thread-14::DEBUG::2014-07-10 09:02:27,467::vm::676::vm.Vm::(_getDiskStats) vmId=`0e968db5-5d49-467f-9ff3-afc37b64364f`::Disk hdc stats not available >Thread-14::DEBUG::2014-07-10 09:02:27,473::vm::676::vm.Vm::(_getDiskStats) vmId=`0e968db5-5d49-467f-9ff3-afc37b64364f`::Disk vda stats not available >Thread-14::DEBUG::2014-07-10 09:02:27,476::vm::715::vm.Vm::(_getDiskLatency) vmId=`0e968db5-5d49-467f-9ff3-afc37b64364f`::Disk hdd latency not available >Thread-14::DEBUG::2014-07-10 09:02:27,480::vm::715::vm.Vm::(_getDiskLatency) vmId=`0e968db5-5d49-467f-9ff3-afc37b64364f`::Disk hdc latency not available >Thread-14::DEBUG::2014-07-10 09:02:27,484::vm::715::vm.Vm::(_getDiskLatency) vmId=`0e968db5-5d49-467f-9ff3-afc37b64364f`::Disk vda latency not available >Thread-58::DEBUG::2014-07-10 09:02:27,485::lvm::296::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm lvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/3600601601282300032826addbbdae311|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,vg_name,attr,size,seg_start_pe,devices,tags 9e1aa540-1f4e-4ee3-a152-be381ef6c3bd' (cwd None) >Thread-14::DEBUG::2014-07-10 09:02:27,486::BindingXMLRPC::1074::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Powering up', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '13498', 'displayIp': '0', 'displayPort': u'5906', 'session': 'Unknown', 'displaySecurePort': u'5907', 'timeOffset': '0', 'hash': '-6274297782377519393', 'balloonInfo': {'balloon_max': '1048576', 'balloon_target': '1048576', 'balloon_cur': '1048576', 'balloon_min': '1048576'}, 'pauseCode': 'NOERR', 'clientIp': '', 'kvmEnable': 'true', 'network': {u'vnet3': {'macAddr': '00:1a:4a:de:6d:7f', 'rxDropped': '0', 'rxErrors': '0', 'txDropped': '0', 'txRate': '0.0', 'rxRate': '0.0', 'txErrors': '0', 'state': 'unknown', 'speed': '1000', 'name': u'vnet3'}}, 'vmId': '0e968db5-5d49-467f-9ff3-afc37b64364f', 'displayType': 'qxl', 'cpuUser': '43.03', 'disks': {u'vda': {'truesize': '1073741824', 'apparentsize': '1073741824', 'imageID': 'b6f6c0da-e67f-4902-b9ac-3069571a42fe'}, u'hdd': {'truesize': '0', 'apparentsize': '0'}, u'hdc': {'truesize': '0', 'apparentsize': '0'}}, 'monitorResponse': '0', 'statsAge': '1.04', 'elapsedTime': '21', 'vmType': 'kvm', 'cpuSys': '23.56', 'guestCPUCount': -1, 'appsList': [], 'guestIPs': ''}]} >Thread-14::DEBUG::2014-07-10 09:02:27,509::BindingXMLRPC::1067::vds::(wrapper) client [10.35.3.13]::call vmGetStats with ('949f6c19-87b5-4f16-a91c-0049749423ea',) {} >Thread-14::DEBUG::2014-07-10 09:02:27,510::vm::676::vm.Vm::(_getDiskStats) vmId=`949f6c19-87b5-4f16-a91c-0049749423ea`::Disk hdd stats not available >Thread-14::DEBUG::2014-07-10 09:02:27,510::vm::676::vm.Vm::(_getDiskStats) vmId=`949f6c19-87b5-4f16-a91c-0049749423ea`::Disk hdc stats not available >Thread-14::DEBUG::2014-07-10 09:02:27,511::vm::676::vm.Vm::(_getDiskStats) vmId=`949f6c19-87b5-4f16-a91c-0049749423ea`::Disk vda stats not available >Thread-14::DEBUG::2014-07-10 09:02:27,511::vm::715::vm.Vm::(_getDiskLatency) vmId=`949f6c19-87b5-4f16-a91c-0049749423ea`::Disk hdd latency not available >Thread-14::DEBUG::2014-07-10 09:02:27,512::vm::715::vm.Vm::(_getDiskLatency) vmId=`949f6c19-87b5-4f16-a91c-0049749423ea`::Disk hdc latency not available >Thread-14::DEBUG::2014-07-10 09:02:27,512::vm::715::vm.Vm::(_getDiskLatency) vmId=`949f6c19-87b5-4f16-a91c-0049749423ea`::Disk vda latency not available >Thread-14::DEBUG::2014-07-10 09:02:27,513::BindingXMLRPC::1074::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Powering up', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '12860', 'displayIp': '0', 'displayPort': u'5904', 'session': 'Unknown', 'displaySecurePort': u'5905', 'timeOffset': '0', 'hash': '-1803473594666319662', 'balloonInfo': {'balloon_max': '1048576', 'balloon_target': '1048576', 'balloon_cur': '1048576', 'balloon_min': '1048576'}, 'pauseCode': 'NOERR', 'clientIp': '', 'kvmEnable': 'true', 'network': {u'vnet2': {'macAddr': '00:1a:4a:de:6d:7e', 'rxDropped': '0', 'rxErrors': '0', 'txDropped': '0', 'txRate': '0.0', 'rxRate': '0.0', 'txErrors': '0', 'state': 'unknown', 'speed': '1000', 'name': u'vnet2'}}, 'vmId': '949f6c19-87b5-4f16-a91c-0049749423ea', 'displayType': 'qxl', 'cpuUser': '48.23', 'disks': {u'vda': {'truesize': '1073741824', 'apparentsize': '1073741824', 'imageID': '28408446-e5fd-4565-a976-e760951593fe'}, u'hdd': {'truesize': '0', 'apparentsize': '0'}, u'hdc': {'truesize': '0', 'apparentsize': '0'}}, 'monitorResponse': '0', 'statsAge': '0.51', 'elapsedTime': '41', 'vmType': 'kvm', 'cpuSys': '4.25', 'guestCPUCount': -1, 'appsList': [], 'guestIPs': ''}]} >Thread-58::DEBUG::2014-07-10 09:02:27,703::lvm::296::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-58::DEBUG::2014-07-10 09:02:27,715::lvm::462::Storage.LVM::(_reloadlvs) lvs reloaded >Thread-58::DEBUG::2014-07-10 09:02:27,716::lvm::462::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' released the operation mutex >Thread-58::INFO::2014-07-10 09:02:27,716::logUtils::47::dispatcher::(wrapper) Run and protect: prepareImage, Return response: {'info': {'domainID': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'volType': 'path', 'leaseOffset': 114294784, 'path': '/rhev/data-center/mnt/blockSD/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/images/b034d5b0-e1e0-4011-b49b-4d45ddb11556/3d7f62b5-328f-4d8e-8b69-873cfb5ae14d', 'volumeID': '3d7f62b5-328f-4d8e-8b69-873cfb5ae14d', 'leasePath': '/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/leases', 'imageID': 'b034d5b0-e1e0-4011-b49b-4d45ddb11556'}, 'path': '/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/images/b034d5b0-e1e0-4011-b49b-4d45ddb11556/3d7f62b5-328f-4d8e-8b69-873cfb5ae14d', 'imgVolumesInfo': [{'domainID': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'volType': 'path', 'leaseOffset': 109051904, 'path': '/rhev/data-center/mnt/blockSD/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/images/b034d5b0-e1e0-4011-b49b-4d45ddb11556/47592965-e853-4e59-9728-d11cca6a7a8a', 'volumeID': '47592965-e853-4e59-9728-d11cca6a7a8a', 'leasePath': '/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/leases', 'imageID': 'b034d5b0-e1e0-4011-b49b-4d45ddb11556'}, {'domainID': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'volType': 'path', 'leaseOffset': 114294784, 'path': '/rhev/data-center/mnt/blockSD/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/images/b034d5b0-e1e0-4011-b49b-4d45ddb11556/3d7f62b5-328f-4d8e-8b69-873cfb5ae14d', 'volumeID': '3d7f62b5-328f-4d8e-8b69-873cfb5ae14d', 'leasePath': '/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/leases', 'imageID': 'b034d5b0-e1e0-4011-b49b-4d45ddb11556'}]} >Thread-58::DEBUG::2014-07-10 09:02:27,717::task::1185::TaskManager.Task::(prepare) Task=`59b662e1-c064-4d62-a3a9-a8e07a041fcf`::finished: {'info': {'domainID': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'volType': 'path', 'leaseOffset': 114294784, 'path': '/rhev/data-center/mnt/blockSD/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/images/b034d5b0-e1e0-4011-b49b-4d45ddb11556/3d7f62b5-328f-4d8e-8b69-873cfb5ae14d', 'volumeID': '3d7f62b5-328f-4d8e-8b69-873cfb5ae14d', 'leasePath': '/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/leases', 'imageID': 'b034d5b0-e1e0-4011-b49b-4d45ddb11556'}, 'path': '/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/images/b034d5b0-e1e0-4011-b49b-4d45ddb11556/3d7f62b5-328f-4d8e-8b69-873cfb5ae14d', 'imgVolumesInfo': [{'domainID': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'volType': 'path', 'leaseOffset': 109051904, 'path': '/rhev/data-center/mnt/blockSD/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/images/b034d5b0-e1e0-4011-b49b-4d45ddb11556/47592965-e853-4e59-9728-d11cca6a7a8a', 'volumeID': '47592965-e853-4e59-9728-d11cca6a7a8a', 'leasePath': '/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/leases', 'imageID': 'b034d5b0-e1e0-4011-b49b-4d45ddb11556'}, {'domainID': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'volType': 'path', 'leaseOffset': 114294784, 'path': '/rhev/data-center/mnt/blockSD/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/images/b034d5b0-e1e0-4011-b49b-4d45ddb11556/3d7f62b5-328f-4d8e-8b69-873cfb5ae14d', 'volumeID': '3d7f62b5-328f-4d8e-8b69-873cfb5ae14d', 'leasePath': '/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/leases', 'imageID': 'b034d5b0-e1e0-4011-b49b-4d45ddb11556'}]} >Thread-58::DEBUG::2014-07-10 09:02:27,717::task::595::TaskManager.Task::(_updateState) Task=`59b662e1-c064-4d62-a3a9-a8e07a041fcf`::moving from state preparing -> state finished >Thread-58::DEBUG::2014-07-10 09:02:27,717::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': < ResourceRef 'Storage.9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', isValid: 'True' obj: 'None'>} >Thread-58::DEBUG::2014-07-10 09:02:27,717::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-58::DEBUG::2014-07-10 09:02:27,718::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.9e1aa540-1f4e-4ee3-a152-be381ef6c3bd' >Thread-58::DEBUG::2014-07-10 09:02:27,718::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.9e1aa540-1f4e-4ee3-a152-be381ef6c3bd' (0 active users) >Thread-58::DEBUG::2014-07-10 09:02:27,718::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.9e1aa540-1f4e-4ee3-a152-be381ef6c3bd' is free, finding out if anyone is waiting for it. >Thread-58::DEBUG::2014-07-10 09:02:27,719::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', Clearing records. >Thread-58::DEBUG::2014-07-10 09:02:27,719::task::990::TaskManager.Task::(_decref) Task=`59b662e1-c064-4d62-a3a9-a8e07a041fcf`::ref 0 aborting False >Thread-58::INFO::2014-07-10 09:02:27,719::clientIF::324::vds::(prepareVolumePath) prepared volume path: /rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/images/b034d5b0-e1e0-4011-b49b-4d45ddb11556/3d7f62b5-328f-4d8e-8b69-873cfb5ae14d >Thread-58::DEBUG::2014-07-10 09:02:27,741::utils::642::root::(execCmd) '/usr/libexec/vdsm/hooks/before_vm_start/50_vhostmd' (cwd None) >Thread-58::DEBUG::2014-07-10 09:02:27,851::utils::662::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-58::INFO::2014-07-10 09:02:27,852::hooks::100::root::(_runHooksDir) >Thread-58::DEBUG::2014-07-10 09:02:27,853::vm::3190::vm.Vm::(_run) vmId=`2386fa8c-f537-495c-ae07-e178171d77f2`::<?xml version="1.0" encoding="utf-8"?> ><domain type="kvm"> > <name>scale_5</name> > <uuid>2386fa8c-f537-495c-ae07-e178171d77f2</uuid> > <memory>1048576</memory> > <currentMemory>1048576</currentMemory> > <vcpu current="2">160</vcpu> > <memtune> > <min_guarantee>1048576</min_guarantee> > </memtune> > <devices> > <channel type="unix"> > <target name="com.redhat.rhevm.vdsm" type="virtio"/> > <source mode="bind" path="/var/lib/libvirt/qemu/channels/2386fa8c-f537-495c-ae07-e178171d77f2.com.redhat.rhevm.vdsm"/> > </channel> > <channel type="unix"> > <target name="org.qemu.guest_agent.0" type="virtio"/> > <source mode="bind" path="/var/lib/libvirt/qemu/channels/2386fa8c-f537-495c-ae07-e178171d77f2.org.qemu.guest_agent.0"/> > </channel> > <input bus="ps2" type="mouse"/> > <channel type="spicevmc"> > <target name="com.redhat.spice.0" type="virtio"/> > </channel> > <graphics autoport="yes" keymap="en-us" listen="0" passwd="*****" passwdValidTo="1970-01-01T00:00:01" port="-1" tlsPort="-1" type="spice"> > <channel mode="secure" name="main"/> > <channel mode="secure" name="inputs"/> > <channel mode="secure" name="cursor"/> > <channel mode="secure" name="playback"/> > <channel mode="secure" name="record"/> > <channel mode="secure" name="display"/> > <channel mode="secure" name="usbredir"/> > <channel mode="secure" name="smartcard"/> > </graphics> > <memballoon model="virtio"/> > <controller index="0" model="virtio-scsi" type="scsi"> > <address bus="0x00" domain="0x0000" function="0x0" slot="0x04" type="pci"/> > </controller> > <video> > <model heads="1" ram="65536" type="qxl" vram="32768"/> > </video> > <interface type="bridge"> > <mac address="00:1a:4a:de:6d:7c"/> > <model type="virtio"/> > <source bridge="rhevm"/> > <filterref filter="vdsm-no-mac-spoofing"/> > <link state="up"/> > <bandwidth/> > </interface> > <disk device="cdrom" snapshot="no" type="file"> > <source file="/var/run/vdsm/payload/2386fa8c-f537-495c-ae07-e178171d77f2.d22956e19192ae7cd57d5d31bf777cdc.img" startupPolicy="optional"/> > <target bus="ide" dev="hdd"/> > <readonly/> > <serial/> > </disk> > <disk device="cdrom" snapshot="no" type="file"> > <source file="" startupPolicy="optional"/> > <target bus="ide" dev="hdc"/> > <readonly/> > <serial/> > </disk> > <disk device="disk" snapshot="no" type="block"> > <address bus="0x00" domain="0x0000" function="0x0" slot="0x06" type="pci"/> > <source dev="/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/images/b034d5b0-e1e0-4011-b49b-4d45ddb11556/3d7f62b5-328f-4d8e-8b69-873cfb5ae14d"/> > <target bus="virtio" dev="vda"/> > <serial>b034d5b0-e1e0-4011-b49b-4d45ddb11556</serial> > <boot order="1"/> > <driver cache="none" error_policy="stop" io="native" name="qemu" type="qcow2"/> > </disk> > </devices> > <os> > <type arch="x86_64" machine="rhel6.5.0">hvm</type> > <smbios mode="sysinfo"/> > </os> > <sysinfo type="smbios"> > <system> > <entry name="manufacturer">Red Hat</entry> > <entry name="product">RHEV Hypervisor</entry> > <entry name="version">6.5-20140707.0.el6ev</entry> > <entry name="serial">52BAF97B-FF2F-E311-0000-100000000005</entry> > <entry name="uuid">2386fa8c-f537-495c-ae07-e178171d77f2</entry> > </system> > </sysinfo> > <clock adjustment="0" offset="variable"> > <timer name="rtc" tickpolicy="catchup"/> > </clock> > <features> > <acpi/> > </features> > <cpu match="exact"> > <model>Conroe</model> > <topology cores="2" sockets="80" threads="1"/> > </cpu> ></domain> > >Dummy-33::DEBUG::2014-07-10 09:02:27,879::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >GuestMonitor-scale_4::DEBUG::2014-07-10 09:02:27,921::vm::676::vm.Vm::(_getDiskStats) vmId=`0e968db5-5d49-467f-9ff3-afc37b64364f`::Disk hdd stats not available >GuestMonitor-scale_4::DEBUG::2014-07-10 09:02:27,922::vm::676::vm.Vm::(_getDiskStats) vmId=`0e968db5-5d49-467f-9ff3-afc37b64364f`::Disk hdc stats not available >GuestMonitor-scale_4::DEBUG::2014-07-10 09:02:27,922::vm::676::vm.Vm::(_getDiskStats) vmId=`0e968db5-5d49-467f-9ff3-afc37b64364f`::Disk vda stats not available >GuestMonitor-scale_4::DEBUG::2014-07-10 09:02:27,922::vm::715::vm.Vm::(_getDiskLatency) vmId=`0e968db5-5d49-467f-9ff3-afc37b64364f`::Disk hdd latency not available >GuestMonitor-scale_4::DEBUG::2014-07-10 09:02:27,922::vm::715::vm.Vm::(_getDiskLatency) vmId=`0e968db5-5d49-467f-9ff3-afc37b64364f`::Disk hdc latency not available >GuestMonitor-scale_4::DEBUG::2014-07-10 09:02:27,922::vm::715::vm.Vm::(_getDiskLatency) vmId=`0e968db5-5d49-467f-9ff3-afc37b64364f`::Disk vda latency not available >GuestMonitor-scale_4::DEBUG::2014-07-10 09:02:27,923::vm::676::vm.Vm::(_getDiskStats) vmId=`0e968db5-5d49-467f-9ff3-afc37b64364f`::Disk hdd stats not available >GuestMonitor-scale_4::DEBUG::2014-07-10 09:02:27,923::vm::676::vm.Vm::(_getDiskStats) vmId=`0e968db5-5d49-467f-9ff3-afc37b64364f`::Disk hdc stats not available >GuestMonitor-scale_4::DEBUG::2014-07-10 09:02:27,923::vm::676::vm.Vm::(_getDiskStats) vmId=`0e968db5-5d49-467f-9ff3-afc37b64364f`::Disk vda stats not available >GuestMonitor-scale_4::DEBUG::2014-07-10 09:02:27,924::vm::715::vm.Vm::(_getDiskLatency) vmId=`0e968db5-5d49-467f-9ff3-afc37b64364f`::Disk hdd latency not available >GuestMonitor-scale_4::DEBUG::2014-07-10 09:02:27,924::vm::715::vm.Vm::(_getDiskLatency) vmId=`0e968db5-5d49-467f-9ff3-afc37b64364f`::Disk hdc latency not available >GuestMonitor-scale_4::DEBUG::2014-07-10 09:02:27,924::vm::715::vm.Vm::(_getDiskLatency) vmId=`0e968db5-5d49-467f-9ff3-afc37b64364f`::Disk vda latency not available >Dummy-33::DEBUG::2014-07-10 09:02:28,000::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0692085 s, 14.8 MB/s\n'; <rc> = 0 >GuestMonitor-scale_2::DEBUG::2014-07-10 09:02:28,076::vm::676::vm.Vm::(_getDiskStats) vmId=`52e238aa-e62a-48a8-a200-604e72422f3f`::Disk hdd stats not available >GuestMonitor-scale_3::DEBUG::2014-07-10 09:02:28,078::vm::676::vm.Vm::(_getDiskStats) vmId=`949f6c19-87b5-4f16-a91c-0049749423ea`::Disk hdd stats not available >GuestMonitor-scale_2::DEBUG::2014-07-10 09:02:28,078::vm::676::vm.Vm::(_getDiskStats) vmId=`52e238aa-e62a-48a8-a200-604e72422f3f`::Disk hdc stats not available >GuestMonitor-scale_3::DEBUG::2014-07-10 09:02:28,079::vm::676::vm.Vm::(_getDiskStats) vmId=`949f6c19-87b5-4f16-a91c-0049749423ea`::Disk hdc stats not available >GuestMonitor-scale_2::DEBUG::2014-07-10 09:02:28,080::vm::676::vm.Vm::(_getDiskStats) vmId=`52e238aa-e62a-48a8-a200-604e72422f3f`::Disk vda stats not available >GuestMonitor-scale_3::DEBUG::2014-07-10 09:02:28,080::vm::676::vm.Vm::(_getDiskStats) vmId=`949f6c19-87b5-4f16-a91c-0049749423ea`::Disk vda stats not available >GuestMonitor-scale_2::DEBUG::2014-07-10 09:02:28,081::vm::715::vm.Vm::(_getDiskLatency) vmId=`52e238aa-e62a-48a8-a200-604e72422f3f`::Disk hdd latency not available >GuestMonitor-scale_3::DEBUG::2014-07-10 09:02:28,081::vm::715::vm.Vm::(_getDiskLatency) vmId=`949f6c19-87b5-4f16-a91c-0049749423ea`::Disk hdd latency not available >GuestMonitor-scale_3::DEBUG::2014-07-10 09:02:28,083::vm::715::vm.Vm::(_getDiskLatency) vmId=`949f6c19-87b5-4f16-a91c-0049749423ea`::Disk hdc latency not available >GuestMonitor-scale_2::DEBUG::2014-07-10 09:02:28,082::vm::715::vm.Vm::(_getDiskLatency) vmId=`52e238aa-e62a-48a8-a200-604e72422f3f`::Disk hdc latency not available >GuestMonitor-scale_3::DEBUG::2014-07-10 09:02:28,083::vm::715::vm.Vm::(_getDiskLatency) vmId=`949f6c19-87b5-4f16-a91c-0049749423ea`::Disk vda latency not available >GuestMonitor-scale_2::DEBUG::2014-07-10 09:02:28,084::vm::715::vm.Vm::(_getDiskLatency) vmId=`52e238aa-e62a-48a8-a200-604e72422f3f`::Disk vda latency not available >GuestMonitor-scale_3::DEBUG::2014-07-10 09:02:28,086::vm::676::vm.Vm::(_getDiskStats) vmId=`949f6c19-87b5-4f16-a91c-0049749423ea`::Disk hdd stats not available >GuestMonitor-scale_3::DEBUG::2014-07-10 09:02:28,087::vm::676::vm.Vm::(_getDiskStats) vmId=`949f6c19-87b5-4f16-a91c-0049749423ea`::Disk hdc stats not available >GuestMonitor-scale_2::DEBUG::2014-07-10 09:02:28,087::vm::676::vm.Vm::(_getDiskStats) vmId=`52e238aa-e62a-48a8-a200-604e72422f3f`::Disk hdd stats not available >GuestMonitor-scale_3::DEBUG::2014-07-10 09:02:28,088::vm::676::vm.Vm::(_getDiskStats) vmId=`949f6c19-87b5-4f16-a91c-0049749423ea`::Disk vda stats not available >GuestMonitor-scale_2::DEBUG::2014-07-10 09:02:28,089::vm::676::vm.Vm::(_getDiskStats) vmId=`52e238aa-e62a-48a8-a200-604e72422f3f`::Disk hdc stats not available >GuestMonitor-scale_3::DEBUG::2014-07-10 09:02:28,089::vm::715::vm.Vm::(_getDiskLatency) vmId=`949f6c19-87b5-4f16-a91c-0049749423ea`::Disk hdd latency not available >GuestMonitor-scale_2::DEBUG::2014-07-10 09:02:28,090::vm::676::vm.Vm::(_getDiskStats) vmId=`52e238aa-e62a-48a8-a200-604e72422f3f`::Disk vda stats not available >GuestMonitor-scale_3::DEBUG::2014-07-10 09:02:28,090::vm::715::vm.Vm::(_getDiskLatency) vmId=`949f6c19-87b5-4f16-a91c-0049749423ea`::Disk hdc latency not available >GuestMonitor-scale_2::DEBUG::2014-07-10 09:02:28,091::vm::715::vm.Vm::(_getDiskLatency) vmId=`52e238aa-e62a-48a8-a200-604e72422f3f`::Disk hdd latency not available >GuestMonitor-scale_3::DEBUG::2014-07-10 09:02:28,091::vm::715::vm.Vm::(_getDiskLatency) vmId=`949f6c19-87b5-4f16-a91c-0049749423ea`::Disk vda latency not available >GuestMonitor-scale_2::DEBUG::2014-07-10 09:02:28,092::vm::715::vm.Vm::(_getDiskLatency) vmId=`52e238aa-e62a-48a8-a200-604e72422f3f`::Disk hdc latency not available >GuestMonitor-scale_2::DEBUG::2014-07-10 09:02:28,093::vm::715::vm.Vm::(_getDiskLatency) vmId=`52e238aa-e62a-48a8-a200-604e72422f3f`::Disk vda latency not available >VM Channels Listener::DEBUG::2014-07-10 09:02:28,344::guestIF::274::vm.Vm::(_handleMessage) vmId=`949f6c19-87b5-4f16-a91c-0049749423ea`::username: u'None' >libvirtEventLoop::DEBUG::2014-07-10 09:02:28,783::vm::5176::vm.Vm::(_onLibvirtLifecycleEvent) vmId=`2386fa8c-f537-495c-ae07-e178171d77f2`::event Started detail 0 opaque None >Thread-58::DEBUG::2014-07-10 09:02:28,822::vm::5032::vm.Vm::(_getUnderlyingDriveInfo) vmId=`2386fa8c-f537-495c-ae07-e178171d77f2`::Looking for drive with attributes {'name': u'hdc', 'bootOrder': '', 'boot': [], 'readonly': True, 'address': {u'bus': u'1', u'controller': u'0', u'type': u'drive', u'target': u'0', u'unit': u'0'}, 'path': '', 'type': u'cdrom'} >Thread-58::DEBUG::2014-07-10 09:02:28,823::vm::5053::vm.Vm::(_getUnderlyingDriveInfo) vmId=`2386fa8c-f537-495c-ae07-e178171d77f2`::Matched {'name': (u'hdc', u'hdc'), 'bootOrder': ('', None), 'boot': ([], None), 'readonly': (True, True), 'address': ({u'bus': u'1', u'controller': u'0', u'type': u'drive', u'target': u'0', u'unit': u'0'}, {u'bus': u'1', u'controller': u'0', u'type': u'drive', u'target': u'0', u'unit': u'0'}), 'path': ('', ''), 'type': (u'cdrom', u'cdrom')} >Thread-58::DEBUG::2014-07-10 09:02:28,823::vm::5072::vm.Vm::(_getUnderlyingDriveInfo) vmId=`2386fa8c-f537-495c-ae07-e178171d77f2`::Matched {'name': (u'hdc', u'hdc'), 'bootOrder': ('', None), 'boot': ([], None), 'readonly': (True, 'True'), 'address': ({u'bus': u'1', u'controller': u'0', u'type': u'drive', u'target': u'0', u'unit': u'0'}, {u'bus': u'1', u'controller': u'0', u'type': u'drive', u'target': u'0', u'unit': u'0'}), 'path': ('', ''), 'type': (u'cdrom', 'disk')} >Thread-58::DEBUG::2014-07-10 09:02:28,824::vm::5032::vm.Vm::(_getUnderlyingDriveInfo) vmId=`2386fa8c-f537-495c-ae07-e178171d77f2`::Looking for drive with attributes {'name': u'hdd', 'bootOrder': '', 'boot': [], 'readonly': True, 'address': {u'bus': u'1', u'controller': u'0', u'type': u'drive', u'target': u'0', u'unit': u'1'}, 'path': u'/var/run/vdsm/payload/2386fa8c-f537-495c-ae07-e178171d77f2.d22956e19192ae7cd57d5d31bf777cdc.img', 'type': u'cdrom'} >Thread-58::DEBUG::2014-07-10 09:02:28,824::vm::5053::vm.Vm::(_getUnderlyingDriveInfo) vmId=`2386fa8c-f537-495c-ae07-e178171d77f2`::Matched {'name': (u'hdd', u'hdd'), 'bootOrder': ('', None), 'boot': ([], None), 'readonly': (True, True), 'address': ({u'bus': u'1', u'controller': u'0', u'type': u'drive', u'target': u'0', u'unit': u'1'}, {u'bus': u'1', u'controller': u'0', u'type': u'drive', u'target': u'0', u'unit': u'1'}), 'path': (u'/var/run/vdsm/payload/2386fa8c-f537-495c-ae07-e178171d77f2.d22956e19192ae7cd57d5d31bf777cdc.img', '/var/run/vdsm/payload/2386fa8c-f537-495c-ae07-e178171d77f2.d22956e19192ae7cd57d5d31bf777cdc.img'), 'type': (u'cdrom', u'cdrom')} >Thread-58::DEBUG::2014-07-10 09:02:28,824::vm::5072::vm.Vm::(_getUnderlyingDriveInfo) vmId=`2386fa8c-f537-495c-ae07-e178171d77f2`::Matched {'name': (u'hdd', u'hdd'), 'bootOrder': ('', None), 'boot': ([], None), 'readonly': (True, 'True'), 'address': ({u'bus': u'1', u'controller': u'0', u'type': u'drive', u'target': u'0', u'unit': u'1'}, {u'bus': u'1', u'controller': u'0', u'type': u'drive', u'target': u'0', u'unit': u'1'}), 'path': (u'/var/run/vdsm/payload/2386fa8c-f537-495c-ae07-e178171d77f2.d22956e19192ae7cd57d5d31bf777cdc.img', '/var/run/vdsm/payload/2386fa8c-f537-495c-ae07-e178171d77f2.d22956e19192ae7cd57d5d31bf777cdc.img'), 'type': (u'cdrom', 'disk')} >Thread-58::DEBUG::2014-07-10 09:02:28,825::vm::5032::vm.Vm::(_getUnderlyingDriveInfo) vmId=`2386fa8c-f537-495c-ae07-e178171d77f2`::Looking for drive with attributes {'name': u'vda', 'bootOrder': u'1', 'boot': [<DOM Element: boot at 0x7f621c3d7518>], 'readonly': False, 'address': {u'slot': u'0x06', u'bus': u'0x00', u'domain': u'0x0000', u'type': u'pci', u'function': u'0x0'}, 'path': u'/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/images/b034d5b0-e1e0-4011-b49b-4d45ddb11556/3d7f62b5-328f-4d8e-8b69-873cfb5ae14d', 'type': u'disk'} >Thread-58::DEBUG::2014-07-10 09:02:28,825::vm::5053::vm.Vm::(_getUnderlyingDriveInfo) vmId=`2386fa8c-f537-495c-ae07-e178171d77f2`::Matched {'name': (u'vda', u'vda'), 'bootOrder': (u'1', u'1'), 'boot': ([<DOM Element: boot at 0x7f621c3d7518>], None), 'readonly': (False, False), 'address': ({u'slot': u'0x06', u'bus': u'0x00', u'domain': u'0x0000', u'type': u'pci', u'function': u'0x0'}, {u'slot': u'0x06', u'bus': u'0x00', u'domain': u'0x0000', u'type': u'pci', u'function': u'0x0'}), 'path': (u'/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/images/b034d5b0-e1e0-4011-b49b-4d45ddb11556/3d7f62b5-328f-4d8e-8b69-873cfb5ae14d', '/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/images/b034d5b0-e1e0-4011-b49b-4d45ddb11556/3d7f62b5-328f-4d8e-8b69-873cfb5ae14d'), 'type': (u'disk', u'disk')} >Thread-58::DEBUG::2014-07-10 09:02:28,825::vm::5072::vm.Vm::(_getUnderlyingDriveInfo) vmId=`2386fa8c-f537-495c-ae07-e178171d77f2`::Matched {'name': (u'vda', u'vda'), 'bootOrder': (u'1', u'1'), 'boot': ([<DOM Element: boot at 0x7f621c3d7518>], None), 'readonly': (False, 'False'), 'address': ({u'slot': u'0x06', u'bus': u'0x00', u'domain': u'0x0000', u'type': u'pci', u'function': u'0x0'}, {u'slot': u'0x06', u'bus': u'0x00', u'domain': u'0x0000', u'type': u'pci', u'function': u'0x0'}), 'path': (u'/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/images/b034d5b0-e1e0-4011-b49b-4d45ddb11556/3d7f62b5-328f-4d8e-8b69-873cfb5ae14d', '/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/images/b034d5b0-e1e0-4011-b49b-4d45ddb11556/3d7f62b5-328f-4d8e-8b69-873cfb5ae14d'), 'type': (u'disk', 'disk')} >Thread-58::DEBUG::2014-07-10 09:02:28,888::sampling::285::vm.Vm::(start) vmId=`2386fa8c-f537-495c-ae07-e178171d77f2`::Start statistics collection >Thread-60::DEBUG::2014-07-10 09:02:28,889::sampling::314::vm.Vm::(run) vmId=`2386fa8c-f537-495c-ae07-e178171d77f2`::Stats thread started >Thread-60::DEBUG::2014-07-10 09:02:28,897::task::595::TaskManager.Task::(_updateState) Task=`de2112c1-f68e-46b0-87dd-508a435c6312`::moving from state init -> state preparing >Thread-60::INFO::2014-07-10 09:02:28,898::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='b034d5b0-e1e0-4011-b49b-4d45ddb11556', volUUID='3d7f62b5-328f-4d8e-8b69-873cfb5ae14d', options=None) >Thread-60::INFO::2014-07-10 09:02:28,899::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-60::DEBUG::2014-07-10 09:02:28,899::task::1185::TaskManager.Task::(prepare) Task=`de2112c1-f68e-46b0-87dd-508a435c6312`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-60::DEBUG::2014-07-10 09:02:28,899::task::595::TaskManager.Task::(_updateState) Task=`de2112c1-f68e-46b0-87dd-508a435c6312`::moving from state preparing -> state finished >Thread-60::DEBUG::2014-07-10 09:02:28,899::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-60::DEBUG::2014-07-10 09:02:28,899::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-60::DEBUG::2014-07-10 09:02:28,900::task::990::TaskManager.Task::(_decref) Task=`de2112c1-f68e-46b0-87dd-508a435c6312`::ref 0 aborting False >Thread-58::DEBUG::2014-07-10 09:02:28,915::vmChannels::198::vds::(register) Add fileno 65 to listener's channels. >Thread-58::WARNING::2014-07-10 09:02:28,920::vm::3715::vm.Vm::(_readPauseCode) vmId=`2386fa8c-f537-495c-ae07-e178171d77f2`::_readPauseCode unsupported by libvirt vm >Thread-58::DEBUG::2014-07-10 09:02:28,932::vm::2291::vm.Vm::(_startUnderlyingVm) vmId=`2386fa8c-f537-495c-ae07-e178171d77f2`::_ongoingCreations released >Thread-51::DEBUG::2014-07-10 09:02:29,551::task::595::TaskManager.Task::(_updateState) Task=`9f6523bf-49cb-4eb1-9ae9-7550c572392b`::moving from state init -> state preparing >Thread-51::INFO::2014-07-10 09:02:29,552::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='76fdb054-02cd-42ed-9721-b3e65b34c3a4', volUUID='022dfe46-2cf7-4915-80b3-883158e3ca83', options=None) >Thread-51::INFO::2014-07-10 09:02:29,553::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-51::DEBUG::2014-07-10 09:02:29,553::task::1185::TaskManager.Task::(prepare) Task=`9f6523bf-49cb-4eb1-9ae9-7550c572392b`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-51::DEBUG::2014-07-10 09:02:29,553::task::595::TaskManager.Task::(_updateState) Task=`9f6523bf-49cb-4eb1-9ae9-7550c572392b`::moving from state preparing -> state finished >Thread-51::DEBUG::2014-07-10 09:02:29,553::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-51::DEBUG::2014-07-10 09:02:29,554::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-51::DEBUG::2014-07-10 09:02:29,554::task::990::TaskManager.Task::(_decref) Task=`9f6523bf-49cb-4eb1-9ae9-7550c572392b`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-07-10 09:02:29,698::vmChannels::106::vds::(_do_add_channels) fileno 65 was added to unconnected channels. >VM Channels Listener::DEBUG::2014-07-10 09:02:29,698::vmChannels::132::vds::(_handle_unconnected) Trying to connect fileno 65. >VM Channels Listener::DEBUG::2014-07-10 09:02:29,699::guestIF::194::vm.Vm::(_connect) vmId=`2386fa8c-f537-495c-ae07-e178171d77f2`::Attempting connection to /var/lib/libvirt/qemu/channels/2386fa8c-f537-495c-ae07-e178171d77f2.com.redhat.rhevm.vdsm >VM Channels Listener::DEBUG::2014-07-10 09:02:29,699::guestIF::197::vm.Vm::(_connect) vmId=`2386fa8c-f537-495c-ae07-e178171d77f2`::Connected to /var/lib/libvirt/qemu/channels/2386fa8c-f537-495c-ae07-e178171d77f2.com.redhat.rhevm.vdsm >VM Channels Listener::DEBUG::2014-07-10 09:02:29,700::vmChannels::148::vds::(_handle_unconnected) Connecting to fileno 65 succeeded. >Dummy-33::DEBUG::2014-07-10 09:02:30,015::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:02:30,118::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0522398 s, 19.6 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 09:02:30,524::task::595::TaskManager.Task::(_updateState) Task=`6d405c41-20e0-4cec-9c28-cacbcd87683a`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 09:02:30,525::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::INFO::2014-07-10 09:02:30,525::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000527639', 'lastCheck': '3.5', 'valid': True}, '6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000399723', 'lastCheck': '6.3', 'valid': True}} >Thread-14::DEBUG::2014-07-10 09:02:30,526::task::1185::TaskManager.Task::(prepare) Task=`6d405c41-20e0-4cec-9c28-cacbcd87683a`::finished: {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000527639', 'lastCheck': '3.5', 'valid': True}, '6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000399723', 'lastCheck': '6.3', 'valid': True}} >Thread-14::DEBUG::2014-07-10 09:02:30,526::task::595::TaskManager.Task::(_updateState) Task=`6d405c41-20e0-4cec-9c28-cacbcd87683a`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 09:02:30,526::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 09:02:30,526::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 09:02:30,526::task::990::TaskManager.Task::(_decref) Task=`6d405c41-20e0-4cec-9c28-cacbcd87683a`::ref 0 aborting False >Thread-14::DEBUG::2014-07-10 09:02:30,540::vm::598::vm.Vm::(_getCpuStats) vmId=`2386fa8c-f537-495c-ae07-e178171d77f2`::CPU stats not available: 'NoneType' object is unsubscriptable >Thread-14::DEBUG::2014-07-10 09:02:30,540::vm::654::vm.Vm::(_getNetworkStats) vmId=`2386fa8c-f537-495c-ae07-e178171d77f2`::Network stats not available >Thread-14::DEBUG::2014-07-10 09:02:30,540::vm::676::vm.Vm::(_getDiskStats) vmId=`2386fa8c-f537-495c-ae07-e178171d77f2`::Disk hdd stats not available >Thread-14::DEBUG::2014-07-10 09:02:30,541::vm::676::vm.Vm::(_getDiskStats) vmId=`2386fa8c-f537-495c-ae07-e178171d77f2`::Disk hdc stats not available >Thread-14::DEBUG::2014-07-10 09:02:30,541::vm::676::vm.Vm::(_getDiskStats) vmId=`2386fa8c-f537-495c-ae07-e178171d77f2`::Disk vda stats not available >Thread-14::DEBUG::2014-07-10 09:02:30,541::vm::715::vm.Vm::(_getDiskLatency) vmId=`2386fa8c-f537-495c-ae07-e178171d77f2`::Disk hdd latency not available >Thread-14::DEBUG::2014-07-10 09:02:30,541::vm::715::vm.Vm::(_getDiskLatency) vmId=`2386fa8c-f537-495c-ae07-e178171d77f2`::Disk hdc latency not available >Thread-14::DEBUG::2014-07-10 09:02:30,541::vm::715::vm.Vm::(_getDiskLatency) vmId=`2386fa8c-f537-495c-ae07-e178171d77f2`::Disk vda latency not available >Thread-14::DEBUG::2014-07-10 09:02:30,542::vm::676::vm.Vm::(_getDiskStats) vmId=`949f6c19-87b5-4f16-a91c-0049749423ea`::Disk hdd stats not available >Thread-14::DEBUG::2014-07-10 09:02:30,542::vm::676::vm.Vm::(_getDiskStats) vmId=`949f6c19-87b5-4f16-a91c-0049749423ea`::Disk hdc stats not available >Thread-14::DEBUG::2014-07-10 09:02:30,542::vm::676::vm.Vm::(_getDiskStats) vmId=`949f6c19-87b5-4f16-a91c-0049749423ea`::Disk vda stats not available >Thread-14::DEBUG::2014-07-10 09:02:30,543::vm::715::vm.Vm::(_getDiskLatency) vmId=`949f6c19-87b5-4f16-a91c-0049749423ea`::Disk hdd latency not available >Thread-14::DEBUG::2014-07-10 09:02:30,543::vm::715::vm.Vm::(_getDiskLatency) vmId=`949f6c19-87b5-4f16-a91c-0049749423ea`::Disk hdc latency not available >Thread-14::DEBUG::2014-07-10 09:02:30,543::vm::715::vm.Vm::(_getDiskLatency) vmId=`949f6c19-87b5-4f16-a91c-0049749423ea`::Disk vda latency not available >Thread-14::DEBUG::2014-07-10 09:02:30,544::vm::676::vm.Vm::(_getDiskStats) vmId=`0e968db5-5d49-467f-9ff3-afc37b64364f`::Disk hdd stats not available >Thread-14::DEBUG::2014-07-10 09:02:30,545::vm::676::vm.Vm::(_getDiskStats) vmId=`0e968db5-5d49-467f-9ff3-afc37b64364f`::Disk hdc stats not available >Thread-14::DEBUG::2014-07-10 09:02:30,545::vm::676::vm.Vm::(_getDiskStats) vmId=`0e968db5-5d49-467f-9ff3-afc37b64364f`::Disk vda stats not available >Thread-14::DEBUG::2014-07-10 09:02:30,545::vm::715::vm.Vm::(_getDiskLatency) vmId=`0e968db5-5d49-467f-9ff3-afc37b64364f`::Disk hdd latency not available >Thread-14::DEBUG::2014-07-10 09:02:30,546::vm::715::vm.Vm::(_getDiskLatency) vmId=`0e968db5-5d49-467f-9ff3-afc37b64364f`::Disk hdc latency not available >Thread-14::DEBUG::2014-07-10 09:02:30,546::vm::715::vm.Vm::(_getDiskLatency) vmId=`0e968db5-5d49-467f-9ff3-afc37b64364f`::Disk vda latency not available >Thread-34::DEBUG::2014-07-10 09:02:31,114::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [14e21488] >Thread-34::DEBUG::2014-07-10 09:02:31,116::task::595::TaskManager.Task::(_updateState) Task=`48379855-da89-43ed-8dd4-a4bae06c4219`::moving from state init -> state preparing >Thread-34::INFO::2014-07-10 09:02:31,116::logUtils::44::dispatcher::(wrapper) Run and protect: createVolume(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='aa20346a-4d3a-4e07-b8e1-52c0ebe4168c', size='10737418240', volFormat=4, preallocate=2, diskType=2, volUUID='58fefce2-9bce-4bff-8949-8c6ce8122b27', desc='', srcImgUUID='9cf413b7-7f14-4a61-8c71-913e5b0ea9c0', srcVolUUID='47592965-e853-4e59-9728-d11cca6a7a8a') >Thread-34::DEBUG::2014-07-10 09:02:31,117::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.9e1aa540-1f4e-4ee3-a152-be381ef6c3bd`ReqID=`24cb597f-31ae-4a85-8997-617279ec9dfb`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '1464' at 'createVolume' >Thread-34::DEBUG::2014-07-10 09:02:31,118::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.9e1aa540-1f4e-4ee3-a152-be381ef6c3bd' for lock type 'shared' >Thread-34::DEBUG::2014-07-10 09:02:31,118::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.9e1aa540-1f4e-4ee3-a152-be381ef6c3bd' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-10 09:02:31,119::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.9e1aa540-1f4e-4ee3-a152-be381ef6c3bd`ReqID=`24cb597f-31ae-4a85-8997-617279ec9dfb`::Granted request >Thread-34::DEBUG::2014-07-10 09:02:31,119::task::827::TaskManager.Task::(resourceAcquired) Task=`48379855-da89-43ed-8dd4-a4bae06c4219`::_resourcesAcquired: Storage.9e1aa540-1f4e-4ee3-a152-be381ef6c3bd (shared) >Thread-34::DEBUG::2014-07-10 09:02:31,120::task::990::TaskManager.Task::(_decref) Task=`48379855-da89-43ed-8dd4-a4bae06c4219`::ref 1 aborting False >Thread-34::DEBUG::2014-07-10 09:02:31,123::task::752::TaskManager.Task::(_save) Task=`48379855-da89-43ed-8dd4-a4bae06c4219`::_save: orig /rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/master/tasks/48379855-da89-43ed-8dd4-a4bae06c4219 temp /rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/master/tasks/48379855-da89-43ed-8dd4-a4bae06c4219.temp >Thread-34::DEBUG::2014-07-10 09:02:31,130::taskManager::68::TaskManager::(scheduleJob) scheduled job createVolume for task 48379855-da89-43ed-8dd4-a4bae06c4219 >Thread-34::INFO::2014-07-10 09:02:31,130::logUtils::47::dispatcher::(wrapper) Run and protect: createVolume, Return response: None >Thread-34::DEBUG::2014-07-10 09:02:31,130::task::1180::TaskManager.Task::(prepare) Task=`48379855-da89-43ed-8dd4-a4bae06c4219`::Prepare: 1 jobs exist, move to acquiring >Thread-34::DEBUG::2014-07-10 09:02:31,130::task::595::TaskManager.Task::(_updateState) Task=`48379855-da89-43ed-8dd4-a4bae06c4219`::moving from state preparing -> state acquiring >Thread-34::DEBUG::2014-07-10 09:02:31,131::task::752::TaskManager.Task::(_save) Task=`48379855-da89-43ed-8dd4-a4bae06c4219`::_save: orig /rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/master/tasks/48379855-da89-43ed-8dd4-a4bae06c4219 temp /rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/master/tasks/48379855-da89-43ed-8dd4-a4bae06c4219.temp >Thread-34::DEBUG::2014-07-10 09:02:31,138::task::595::TaskManager.Task::(_updateState) Task=`48379855-da89-43ed-8dd4-a4bae06c4219`::moving from state acquiring -> state queued >Thread-34::DEBUG::2014-07-10 09:02:31,138::task::752::TaskManager.Task::(_save) Task=`48379855-da89-43ed-8dd4-a4bae06c4219`::_save: orig /rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/master/tasks/48379855-da89-43ed-8dd4-a4bae06c4219 temp /rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/master/tasks/48379855-da89-43ed-8dd4-a4bae06c4219.temp >Thread-34::DEBUG::2014-07-10 09:02:31,145::taskManager::50::TaskManager::(_queueTask) queuing task: 48379855-da89-43ed-8dd4-a4bae06c4219 >Thread-34::DEBUG::2014-07-10 09:02:31,145::taskManager::56::TaskManager::(_queueTask) task queued: 48379855-da89-43ed-8dd4-a4bae06c4219 >459f9833-5455-4a84-a83e-98aead3d52c9::DEBUG::2014-07-10 09:02:31,146::threadPool::57::Misc.ThreadPool::(setRunningTask) Number of running tasks: 1 >Thread-34::DEBUG::2014-07-10 09:02:31,147::task::1182::TaskManager.Task::(prepare) Task=`48379855-da89-43ed-8dd4-a4bae06c4219`::returning >48379855-da89-43ed-8dd4-a4bae06c4219::DEBUG::2014-07-10 09:02:31,149::threadPool::200::Misc.ThreadPool.WorkerThread::(_processNextTask) Task: 48379855-da89-43ed-8dd4-a4bae06c4219 running: <bound method Task.commit of <storage.task.Task instance at 0x7f62180cff38>> with: None >Thread-34::DEBUG::2014-07-10 09:02:31,151::task::990::TaskManager.Task::(_decref) Task=`48379855-da89-43ed-8dd4-a4bae06c4219`::ref 0 aborting False >48379855-da89-43ed-8dd4-a4bae06c4219::DEBUG::2014-07-10 09:02:31,152::task::1194::TaskManager.Task::(commit) Task=`48379855-da89-43ed-8dd4-a4bae06c4219`::committing task: 48379855-da89-43ed-8dd4-a4bae06c4219 >48379855-da89-43ed-8dd4-a4bae06c4219::DEBUG::2014-07-10 09:02:31,155::task::595::TaskManager.Task::(_updateState) Task=`48379855-da89-43ed-8dd4-a4bae06c4219`::moving from state queued -> state running >48379855-da89-43ed-8dd4-a4bae06c4219::DEBUG::2014-07-10 09:02:31,158::task::752::TaskManager.Task::(_save) Task=`48379855-da89-43ed-8dd4-a4bae06c4219`::_save: orig /rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/master/tasks/48379855-da89-43ed-8dd4-a4bae06c4219 temp /rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/master/tasks/48379855-da89-43ed-8dd4-a4bae06c4219.temp >48379855-da89-43ed-8dd4-a4bae06c4219::DEBUG::2014-07-10 09:02:31,168::task::905::TaskManager.Task::(_runJobs) Task=`48379855-da89-43ed-8dd4-a4bae06c4219`::Task.run: running job 0: createVolume: <bound method StoragePool.createVolume of <storage.sp.StoragePool object at 0x7f62180b9dd0>> (args: ('9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'aa20346a-4d3a-4e07-b8e1-52c0ebe4168c', 20971520, 4, 2, 2, '58fefce2-9bce-4bff-8949-8c6ce8122b27', '', '9cf413b7-7f14-4a61-8c71-913e5b0ea9c0', '47592965-e853-4e59-9728-d11cca6a7a8a') kwargs: {}) >48379855-da89-43ed-8dd4-a4bae06c4219::DEBUG::2014-07-10 09:02:31,168::task::331::TaskManager.Task::(run) Task=`48379855-da89-43ed-8dd4-a4bae06c4219`::Job.run: running createVolume: <bound method StoragePool.createVolume of <storage.sp.StoragePool object at 0x7f62180b9dd0>> (args: ('9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'aa20346a-4d3a-4e07-b8e1-52c0ebe4168c', 20971520, 4, 2, 2, '58fefce2-9bce-4bff-8949-8c6ce8122b27', '', '9cf413b7-7f14-4a61-8c71-913e5b0ea9c0', '47592965-e853-4e59-9728-d11cca6a7a8a') kwargs: {}) callback None >48379855-da89-43ed-8dd4-a4bae06c4219::DEBUG::2014-07-10 09:02:31,170::blockVolume::572::Storage.Misc.excCmd::(getMetadata) '/bin/dd iflag=direct skip=4 bs=512 if=/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/metadata count=1' (cwd None) >48379855-da89-43ed-8dd4-a4bae06c4219::DEBUG::2014-07-10 09:02:31,187::blockVolume::572::Storage.Misc.excCmd::(getMetadata) SUCCESS: <err> = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.000607926 s, 842 kB/s\n'; <rc> = 0 >48379855-da89-43ed-8dd4-a4bae06c4219::DEBUG::2014-07-10 09:02:31,188::misc::282::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.000607926 s, 842 kB/s'], size: 512 >48379855-da89-43ed-8dd4-a4bae06c4219::DEBUG::2014-07-10 09:02:31,189::resourceManager::198::ResourceManager.Request::(__init__) ResName=`9e1aa540-1f4e-4ee3-a152-be381ef6c3bd_imageNS.aa20346a-4d3a-4e07-b8e1-52c0ebe4168c`ReqID=`9d05bfaf-6ba2-4a8f-a4ec-d01ab6917d14`::Request was made in '/usr/share/vdsm/storage/sp.py' line '1767' at 'createVolume' >48379855-da89-43ed-8dd4-a4bae06c4219::DEBUG::2014-07-10 09:02:31,189::resourceManager::542::ResourceManager::(registerResource) Trying to register resource '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd_imageNS.aa20346a-4d3a-4e07-b8e1-52c0ebe4168c' for lock type 'exclusive' >48379855-da89-43ed-8dd4-a4bae06c4219::DEBUG::2014-07-10 09:02:31,190::lvm::427::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' got the operation mutex >48379855-da89-43ed-8dd4-a4bae06c4219::DEBUG::2014-07-10 09:02:31,190::lvm::296::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm lvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/3600601601282300032826addbbdae311|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,vg_name,attr,size,seg_start_pe,devices,tags 9e1aa540-1f4e-4ee3-a152-be381ef6c3bd' (cwd None) >48379855-da89-43ed-8dd4-a4bae06c4219::DEBUG::2014-07-10 09:02:31,456::lvm::296::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >48379855-da89-43ed-8dd4-a4bae06c4219::DEBUG::2014-07-10 09:02:31,471::lvm::462::Storage.LVM::(_reloadlvs) lvs reloaded >48379855-da89-43ed-8dd4-a4bae06c4219::DEBUG::2014-07-10 09:02:31,472::lvm::462::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' released the operation mutex >48379855-da89-43ed-8dd4-a4bae06c4219::DEBUG::2014-07-10 09:02:31,472::resourceFactories::125::Storage.ResourcesFactories::(__getResourceCandidatesList) Image aa20346a-4d3a-4e07-b8e1-52c0ebe4168c does not exist in domain 9e1aa540-1f4e-4ee3-a152-be381ef6c3bd >48379855-da89-43ed-8dd4-a4bae06c4219::DEBUG::2014-07-10 09:02:31,472::resourceManager::601::ResourceManager::(registerResource) Resource '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd_imageNS.aa20346a-4d3a-4e07-b8e1-52c0ebe4168c' is free. Now locking as 'exclusive' (1 active user) >48379855-da89-43ed-8dd4-a4bae06c4219::DEBUG::2014-07-10 09:02:31,473::resourceManager::238::ResourceManager.Request::(grant) ResName=`9e1aa540-1f4e-4ee3-a152-be381ef6c3bd_imageNS.aa20346a-4d3a-4e07-b8e1-52c0ebe4168c`ReqID=`9d05bfaf-6ba2-4a8f-a4ec-d01ab6917d14`::Granted request >48379855-da89-43ed-8dd4-a4bae06c4219::INFO::2014-07-10 09:02:31,474::image::123::Storage.Image::(create) Create placeholder /rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/images/aa20346a-4d3a-4e07-b8e1-52c0ebe4168c for image's volumes >48379855-da89-43ed-8dd4-a4bae06c4219::DEBUG::2014-07-10 09:02:31,476::task::752::TaskManager.Task::(_save) Task=`48379855-da89-43ed-8dd4-a4bae06c4219`::_save: orig /rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/master/tasks/48379855-da89-43ed-8dd4-a4bae06c4219 temp /rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/master/tasks/48379855-da89-43ed-8dd4-a4bae06c4219.temp >48379855-da89-43ed-8dd4-a4bae06c4219::DEBUG::2014-07-10 09:02:31,486::blockVolume::572::Storage.Misc.excCmd::(getMetadata) '/bin/dd iflag=direct skip=4 bs=512 if=/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/metadata count=1' (cwd None) >48379855-da89-43ed-8dd4-a4bae06c4219::DEBUG::2014-07-10 09:02:31,501::blockVolume::572::Storage.Misc.excCmd::(getMetadata) SUCCESS: <err> = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.000397737 s, 1.3 MB/s\n'; <rc> = 0 >48379855-da89-43ed-8dd4-a4bae06c4219::DEBUG::2014-07-10 09:02:31,501::misc::282::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.000397737 s, 1.3 MB/s'], size: 512 >48379855-da89-43ed-8dd4-a4bae06c4219::DEBUG::2014-07-10 09:02:31,502::volume::300::Storage.Volume::(share) Share volume 47592965-e853-4e59-9728-d11cca6a7a8a to /rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/images/aa20346a-4d3a-4e07-b8e1-52c0ebe4168c >48379855-da89-43ed-8dd4-a4bae06c4219::DEBUG::2014-07-10 09:02:31,502::blockVolume::572::Storage.Misc.excCmd::(getMetadata) '/bin/dd iflag=direct skip=4 bs=512 if=/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/metadata count=1' (cwd None) >48379855-da89-43ed-8dd4-a4bae06c4219::DEBUG::2014-07-10 09:02:31,519::blockVolume::572::Storage.Misc.excCmd::(getMetadata) SUCCESS: <err> = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.000462319 s, 1.1 MB/s\n'; <rc> = 0 >48379855-da89-43ed-8dd4-a4bae06c4219::DEBUG::2014-07-10 09:02:31,520::misc::282::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.000462319 s, 1.1 MB/s'], size: 512 >48379855-da89-43ed-8dd4-a4bae06c4219::DEBUG::2014-07-10 09:02:31,525::task::752::TaskManager.Task::(_save) Task=`48379855-da89-43ed-8dd4-a4bae06c4219`::_save: orig /rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/master/tasks/48379855-da89-43ed-8dd4-a4bae06c4219 temp /rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/master/tasks/48379855-da89-43ed-8dd4-a4bae06c4219.temp >48379855-da89-43ed-8dd4-a4bae06c4219::DEBUG::2014-07-10 09:02:31,542::blockVolume::353::Storage.Volume::(_share) Share volume 47592965-e853-4e59-9728-d11cca6a7a8a to /rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/images/aa20346a-4d3a-4e07-b8e1-52c0ebe4168c >48379855-da89-43ed-8dd4-a4bae06c4219::DEBUG::2014-07-10 09:02:31,542::blockVolume::572::Storage.Misc.excCmd::(getMetadata) '/bin/dd iflag=direct skip=4 bs=512 if=/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/metadata count=1' (cwd None) >48379855-da89-43ed-8dd4-a4bae06c4219::DEBUG::2014-07-10 09:02:31,572::blockVolume::572::Storage.Misc.excCmd::(getMetadata) SUCCESS: <err> = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.000376044 s, 1.4 MB/s\n'; <rc> = 0 >48379855-da89-43ed-8dd4-a4bae06c4219::DEBUG::2014-07-10 09:02:31,574::misc::282::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.000376044 s, 1.4 MB/s'], size: 512 >48379855-da89-43ed-8dd4-a4bae06c4219::INFO::2014-07-10 09:02:31,575::volume::443::Storage.Volume::(create) Creating volume 58fefce2-9bce-4bff-8949-8c6ce8122b27 >48379855-da89-43ed-8dd4-a4bae06c4219::DEBUG::2014-07-10 09:02:31,576::task::752::TaskManager.Task::(_save) Task=`48379855-da89-43ed-8dd4-a4bae06c4219`::_save: orig /rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/master/tasks/48379855-da89-43ed-8dd4-a4bae06c4219 temp /rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/master/tasks/48379855-da89-43ed-8dd4-a4bae06c4219.temp >48379855-da89-43ed-8dd4-a4bae06c4219::DEBUG::2014-07-10 09:02:31,587::task::752::TaskManager.Task::(_save) Task=`48379855-da89-43ed-8dd4-a4bae06c4219`::_save: orig /rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/master/tasks/48379855-da89-43ed-8dd4-a4bae06c4219 temp /rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/master/tasks/48379855-da89-43ed-8dd4-a4bae06c4219.temp >48379855-da89-43ed-8dd4-a4bae06c4219::DEBUG::2014-07-10 09:02:31,597::lvm::296::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm lvcreate --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/3600601601282300032826addbbdae311|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } " --autobackup n --contiguous n --size 1024m --addtag OVIRT_VOL_INITIALIZING --name 58fefce2-9bce-4bff-8949-8c6ce8122b27 9e1aa540-1f4e-4ee3-a152-be381ef6c3bd' (cwd None) >48379855-da89-43ed-8dd4-a4bae06c4219::DEBUG::2014-07-10 09:02:32,046::lvm::296::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ' WARNING: This metadata update is NOT backed up\n WARNING: This metadata update is NOT backed up\n'; <rc> = 0 >48379855-da89-43ed-8dd4-a4bae06c4219::DEBUG::2014-07-10 09:02:32,047::lvm::503::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >48379855-da89-43ed-8dd4-a4bae06c4219::DEBUG::2014-07-10 09:02:32,047::lvm::505::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >48379855-da89-43ed-8dd4-a4bae06c4219::DEBUG::2014-07-10 09:02:32,048::lvm::513::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >48379855-da89-43ed-8dd4-a4bae06c4219::DEBUG::2014-07-10 09:02:32,048::lvm::525::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >48379855-da89-43ed-8dd4-a4bae06c4219::WARNING::2014-07-10 09:02:32,048::utils::129::root::(rmFile) File: /rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/images/aa20346a-4d3a-4e07-b8e1-52c0ebe4168c/58fefce2-9bce-4bff-8949-8c6ce8122b27 already removed >48379855-da89-43ed-8dd4-a4bae06c4219::INFO::2014-07-10 09:02:32,050::blockVolume::169::Storage.Volume::(_create) Request to create snapshot aa20346a-4d3a-4e07-b8e1-52c0ebe4168c/58fefce2-9bce-4bff-8949-8c6ce8122b27 of volume 9cf413b7-7f14-4a61-8c71-913e5b0ea9c0/47592965-e853-4e59-9728-d11cca6a7a8a >48379855-da89-43ed-8dd4-a4bae06c4219::DEBUG::2014-07-10 09:02:32,051::task::752::TaskManager.Task::(_save) Task=`48379855-da89-43ed-8dd4-a4bae06c4219`::_save: orig /rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/master/tasks/48379855-da89-43ed-8dd4-a4bae06c4219 temp /rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/master/tasks/48379855-da89-43ed-8dd4-a4bae06c4219.temp >48379855-da89-43ed-8dd4-a4bae06c4219::DEBUG::2014-07-10 09:02:32,063::blockVolume::572::Storage.Misc.excCmd::(getMetadata) '/bin/dd iflag=direct skip=4 bs=512 if=/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/metadata count=1' (cwd None) >48379855-da89-43ed-8dd4-a4bae06c4219::DEBUG::2014-07-10 09:02:32,079::blockVolume::572::Storage.Misc.excCmd::(getMetadata) SUCCESS: <err> = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.00047274 s, 1.1 MB/s\n'; <rc> = 0 >48379855-da89-43ed-8dd4-a4bae06c4219::DEBUG::2014-07-10 09:02:32,080::misc::282::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.00047274 s, 1.1 MB/s'], size: 512 >48379855-da89-43ed-8dd4-a4bae06c4219::INFO::2014-07-10 09:02:32,080::volume::789::Storage.Volume::(prepare) Volume: preparing volume 9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/47592965-e853-4e59-9728-d11cca6a7a8a >48379855-da89-43ed-8dd4-a4bae06c4219::DEBUG::2014-07-10 09:02:32,081::blockVolume::572::Storage.Misc.excCmd::(getMetadata) '/bin/dd iflag=direct skip=4 bs=512 if=/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/metadata count=1' (cwd None) >Thread-14::DEBUG::2014-07-10 09:02:32,097::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [20826f36] >Thread-14::DEBUG::2014-07-10 09:02:32,100::task::595::TaskManager.Task::(_updateState) Task=`a1afa5d0-b96d-4203-9101-54bec0c1b578`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 09:02:32,102::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-14::INFO::2014-07-10 09:02:32,104::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:02:32,105::task::1185::TaskManager.Task::(prepare) Task=`a1afa5d0-b96d-4203-9101-54bec0c1b578`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:02:32,106::task::595::TaskManager.Task::(_updateState) Task=`a1afa5d0-b96d-4203-9101-54bec0c1b578`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 09:02:32,107::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 09:02:32,108::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 09:02:32,109::task::990::TaskManager.Task::(_decref) Task=`a1afa5d0-b96d-4203-9101-54bec0c1b578`::ref 0 aborting False >48379855-da89-43ed-8dd4-a4bae06c4219::DEBUG::2014-07-10 09:02:32,109::blockVolume::572::Storage.Misc.excCmd::(getMetadata) SUCCESS: <err> = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.000434716 s, 1.2 MB/s\n'; <rc> = 0 >48379855-da89-43ed-8dd4-a4bae06c4219::DEBUG::2014-07-10 09:02:32,111::misc::282::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.000434716 s, 1.2 MB/s'], size: 512 >48379855-da89-43ed-8dd4-a4bae06c4219::DEBUG::2014-07-10 09:02:32,113::resourceManager::198::ResourceManager.Request::(__init__) ResName=`9e1aa540-1f4e-4ee3-a152-be381ef6c3bd_lvmActivationNS.47592965-e853-4e59-9728-d11cca6a7a8a`ReqID=`e790c4b3-78d5-403a-bf44-a318bbf8d6f3`::Request was made in '/usr/share/vdsm/storage/volume.py' line '806' at 'prepare' >48379855-da89-43ed-8dd4-a4bae06c4219::DEBUG::2014-07-10 09:02:32,114::resourceManager::542::ResourceManager::(registerResource) Trying to register resource '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd_lvmActivationNS.47592965-e853-4e59-9728-d11cca6a7a8a' for lock type 'shared' >48379855-da89-43ed-8dd4-a4bae06c4219::DEBUG::2014-07-10 09:02:32,117::resourceManager::601::ResourceManager::(registerResource) Resource '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd_lvmActivationNS.47592965-e853-4e59-9728-d11cca6a7a8a' is free. Now locking as 'shared' (1 active user) >48379855-da89-43ed-8dd4-a4bae06c4219::DEBUG::2014-07-10 09:02:32,117::resourceManager::238::ResourceManager.Request::(grant) ResName=`9e1aa540-1f4e-4ee3-a152-be381ef6c3bd_lvmActivationNS.47592965-e853-4e59-9728-d11cca6a7a8a`ReqID=`e790c4b3-78d5-403a-bf44-a318bbf8d6f3`::Granted request >48379855-da89-43ed-8dd4-a4bae06c4219::DEBUG::2014-07-10 09:02:32,118::blockVolume::572::Storage.Misc.excCmd::(getMetadata) '/bin/dd iflag=direct skip=4 bs=512 if=/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/metadata count=1' (cwd None) >48379855-da89-43ed-8dd4-a4bae06c4219::DEBUG::2014-07-10 09:02:32,135::blockVolume::572::Storage.Misc.excCmd::(getMetadata) SUCCESS: <err> = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.000666583 s, 768 kB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:02:32,138::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >48379855-da89-43ed-8dd4-a4bae06c4219::DEBUG::2014-07-10 09:02:32,139::misc::282::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.000666583 s, 768 kB/s'], size: 512 >48379855-da89-43ed-8dd4-a4bae06c4219::DEBUG::2014-07-10 09:02:32,162::volume::270::Storage.Volume::(clone) Volume.clone: /rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/images/aa20346a-4d3a-4e07-b8e1-52c0ebe4168c/47592965-e853-4e59-9728-d11cca6a7a8a to /rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/images/aa20346a-4d3a-4e07-b8e1-52c0ebe4168c/58fefce2-9bce-4bff-8949-8c6ce8122b27 >Thread-34::DEBUG::2014-07-10 09:02:32,168::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [20826f36] >Thread-34::DEBUG::2014-07-10 09:02:32,173::task::595::TaskManager.Task::(_updateState) Task=`13a0fb17-39f5-4eeb-ba93-e4e6ad4ebc3b`::moving from state init -> state preparing >48379855-da89-43ed-8dd4-a4bae06c4219::DEBUG::2014-07-10 09:02:32,173::blockVolume::572::Storage.Misc.excCmd::(getMetadata) '/bin/dd iflag=direct skip=4 bs=512 if=/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/metadata count=1' (cwd None) >Thread-34::INFO::2014-07-10 09:02:32,193::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-34::DEBUG::2014-07-10 09:02:32,203::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`61ed987b-1178-4259-be3e-133585aff9fb`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-10 09:02:32,206::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' for lock type 'shared' >Thread-34::DEBUG::2014-07-10 09:02:32,215::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-10 09:02:32,223::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`61ed987b-1178-4259-be3e-133585aff9fb`::Granted request >Thread-34::DEBUG::2014-07-10 09:02:32,238::task::827::TaskManager.Task::(resourceAcquired) Task=`13a0fb17-39f5-4eeb-ba93-e4e6ad4ebc3b`::_resourcesAcquired: Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee (shared) >Thread-34::DEBUG::2014-07-10 09:02:32,244::task::990::TaskManager.Task::(_decref) Task=`13a0fb17-39f5-4eeb-ba93-e4e6ad4ebc3b`::ref 1 aborting False >48379855-da89-43ed-8dd4-a4bae06c4219::DEBUG::2014-07-10 09:02:32,250::blockVolume::572::Storage.Misc.excCmd::(getMetadata) SUCCESS: <err> = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.00042221 s, 1.2 MB/s\n'; <rc> = 0 >48379855-da89-43ed-8dd4-a4bae06c4219::DEBUG::2014-07-10 09:02:32,257::misc::282::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.00042221 s, 1.2 MB/s'], size: 512 >Thread-34::DEBUG::2014-07-10 09:02:32,261::lvm::373::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >48379855-da89-43ed-8dd4-a4bae06c4219::DEBUG::2014-07-10 09:02:32,272::blockVolume::572::Storage.Misc.excCmd::(getMetadata) '/bin/dd iflag=direct skip=4 bs=512 if=/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/metadata count=1' (cwd None) >Thread-34::DEBUG::2014-07-10 09:02:32,311::lvm::296::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/3600601601282300032826addbbdae311|/dev/mapper/360060160f4a030003840ec867ddee311|/dev/mapper/367cad74c2fcba00019e6afd20c781e67|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name 9e1aa540-1f4e-4ee3-a152-be381ef6c3bd' (cwd None) >48379855-da89-43ed-8dd4-a4bae06c4219::DEBUG::2014-07-10 09:02:32,345::blockVolume::572::Storage.Misc.excCmd::(getMetadata) SUCCESS: <err> = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.000409336 s, 1.3 MB/s\n'; <rc> = 0 >48379855-da89-43ed-8dd4-a4bae06c4219::DEBUG::2014-07-10 09:02:32,349::misc::282::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.000409336 s, 1.3 MB/s'], size: 512 >48379855-da89-43ed-8dd4-a4bae06c4219::DEBUG::2014-07-10 09:02:32,356::volume::1042::Storage.Misc.excCmd::(createVolume) '/usr/bin/qemu-img create -f qcow2 -F raw -b ../aa20346a-4d3a-4e07-b8e1-52c0ebe4168c/47592965-e853-4e59-9728-d11cca6a7a8a /rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/images/aa20346a-4d3a-4e07-b8e1-52c0ebe4168c/58fefce2-9bce-4bff-8949-8c6ce8122b27' (cwd /rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/images/aa20346a-4d3a-4e07-b8e1-52c0ebe4168c) >Dummy-33::DEBUG::2014-07-10 09:02:32,436::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.241003 s, 4.2 MB/s\n'; <rc> = 0 >Thread-34::DEBUG::2014-07-10 09:02:32,556::lvm::296::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-34::DEBUG::2014-07-10 09:02:32,558::lvm::415::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-34::INFO::2014-07-10 09:02:32,559::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1078842097664', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532069482496', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:02:32,560::task::1185::TaskManager.Task::(prepare) Task=`13a0fb17-39f5-4eeb-ba93-e4e6ad4ebc3b`::finished: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1078842097664', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532069482496', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:02:32,560::task::595::TaskManager.Task::(_updateState) Task=`13a0fb17-39f5-4eeb-ba93-e4e6ad4ebc3b`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-10 09:02:32,560::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee': < ResourceRef 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-10 09:02:32,560::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-10 09:02:32,561::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' >Thread-34::DEBUG::2014-07-10 09:02:32,561::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' (0 active users) >Thread-34::DEBUG::2014-07-10 09:02:32,561::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-10 09:02:32,562::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', Clearing records. >Thread-34::DEBUG::2014-07-10 09:02:32,562::task::990::TaskManager.Task::(_decref) Task=`13a0fb17-39f5-4eeb-ba93-e4e6ad4ebc3b`::ref 0 aborting False >48379855-da89-43ed-8dd4-a4bae06c4219::DEBUG::2014-07-10 09:02:32,583::volume::1042::Storage.Misc.excCmd::(createVolume) SUCCESS: <err> = ''; <rc> = 0 >48379855-da89-43ed-8dd4-a4bae06c4219::INFO::2014-07-10 09:02:32,583::blockVolume::393::Storage.Volume::(teardown) Tearing down volume 9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/47592965-e853-4e59-9728-d11cca6a7a8a justme False >48379855-da89-43ed-8dd4-a4bae06c4219::DEBUG::2014-07-10 09:02:32,584::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd_lvmActivationNS.47592965-e853-4e59-9728-d11cca6a7a8a' >48379855-da89-43ed-8dd4-a4bae06c4219::DEBUG::2014-07-10 09:02:32,584::resourceManager::635::ResourceManager::(releaseResource) Released resource '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd_lvmActivationNS.47592965-e853-4e59-9728-d11cca6a7a8a' (0 active users) >48379855-da89-43ed-8dd4-a4bae06c4219::DEBUG::2014-07-10 09:02:32,584::resourceManager::641::ResourceManager::(releaseResource) Resource '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd_lvmActivationNS.47592965-e853-4e59-9728-d11cca6a7a8a' is free, finding out if anyone is waiting for it. >48379855-da89-43ed-8dd4-a4bae06c4219::DEBUG::2014-07-10 09:02:32,585::lvm::296::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm lvchange --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/3600601601282300032826addbbdae311|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } " --autobackup n --available n 9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/47592965-e853-4e59-9728-d11cca6a7a8a' (cwd None) >GuestMonitor-scale_5::DEBUG::2014-07-10 09:02:32,864::vm::598::vm.Vm::(_getCpuStats) vmId=`2386fa8c-f537-495c-ae07-e178171d77f2`::CPU stats not available: 'NoneType' object is unsubscriptable >GuestMonitor-scale_5::DEBUG::2014-07-10 09:02:32,864::vm::654::vm.Vm::(_getNetworkStats) vmId=`2386fa8c-f537-495c-ae07-e178171d77f2`::Network stats not available >GuestMonitor-scale_5::DEBUG::2014-07-10 09:02:32,865::vm::676::vm.Vm::(_getDiskStats) vmId=`2386fa8c-f537-495c-ae07-e178171d77f2`::Disk hdd stats not available >GuestMonitor-scale_5::DEBUG::2014-07-10 09:02:32,865::vm::676::vm.Vm::(_getDiskStats) vmId=`2386fa8c-f537-495c-ae07-e178171d77f2`::Disk hdc stats not available >GuestMonitor-scale_5::DEBUG::2014-07-10 09:02:32,865::vm::676::vm.Vm::(_getDiskStats) vmId=`2386fa8c-f537-495c-ae07-e178171d77f2`::Disk vda stats not available >GuestMonitor-scale_5::DEBUG::2014-07-10 09:02:32,865::vm::715::vm.Vm::(_getDiskLatency) vmId=`2386fa8c-f537-495c-ae07-e178171d77f2`::Disk hdd latency not available >GuestMonitor-scale_5::DEBUG::2014-07-10 09:02:32,866::vm::715::vm.Vm::(_getDiskLatency) vmId=`2386fa8c-f537-495c-ae07-e178171d77f2`::Disk hdc latency not available >GuestMonitor-scale_5::DEBUG::2014-07-10 09:02:32,866::vm::715::vm.Vm::(_getDiskLatency) vmId=`2386fa8c-f537-495c-ae07-e178171d77f2`::Disk vda latency not available >GuestMonitor-scale_5::DEBUG::2014-07-10 09:02:32,867::vm::598::vm.Vm::(_getCpuStats) vmId=`2386fa8c-f537-495c-ae07-e178171d77f2`::CPU stats not available: 'NoneType' object is unsubscriptable >GuestMonitor-scale_5::DEBUG::2014-07-10 09:02:32,867::vm::654::vm.Vm::(_getNetworkStats) vmId=`2386fa8c-f537-495c-ae07-e178171d77f2`::Network stats not available >GuestMonitor-scale_5::DEBUG::2014-07-10 09:02:32,867::vm::676::vm.Vm::(_getDiskStats) vmId=`2386fa8c-f537-495c-ae07-e178171d77f2`::Disk hdd stats not available >GuestMonitor-scale_5::DEBUG::2014-07-10 09:02:32,868::vm::676::vm.Vm::(_getDiskStats) vmId=`2386fa8c-f537-495c-ae07-e178171d77f2`::Disk hdc stats not available >GuestMonitor-scale_5::DEBUG::2014-07-10 09:02:32,868::vm::676::vm.Vm::(_getDiskStats) vmId=`2386fa8c-f537-495c-ae07-e178171d77f2`::Disk vda stats not available >GuestMonitor-scale_5::DEBUG::2014-07-10 09:02:32,868::vm::715::vm.Vm::(_getDiskLatency) vmId=`2386fa8c-f537-495c-ae07-e178171d77f2`::Disk hdd latency not available >GuestMonitor-scale_5::DEBUG::2014-07-10 09:02:32,868::vm::715::vm.Vm::(_getDiskLatency) vmId=`2386fa8c-f537-495c-ae07-e178171d77f2`::Disk hdc latency not available >GuestMonitor-scale_5::DEBUG::2014-07-10 09:02:32,868::vm::715::vm.Vm::(_getDiskLatency) vmId=`2386fa8c-f537-495c-ae07-e178171d77f2`::Disk vda latency not available >GuestMonitor-scale_4::DEBUG::2014-07-10 09:02:32,930::vm::676::vm.Vm::(_getDiskStats) vmId=`0e968db5-5d49-467f-9ff3-afc37b64364f`::Disk hdd stats not available >GuestMonitor-scale_4::DEBUG::2014-07-10 09:02:32,930::vm::676::vm.Vm::(_getDiskStats) vmId=`0e968db5-5d49-467f-9ff3-afc37b64364f`::Disk hdc stats not available >GuestMonitor-scale_4::DEBUG::2014-07-10 09:02:32,931::vm::676::vm.Vm::(_getDiskStats) vmId=`0e968db5-5d49-467f-9ff3-afc37b64364f`::Disk vda stats not available >GuestMonitor-scale_4::DEBUG::2014-07-10 09:02:32,931::vm::715::vm.Vm::(_getDiskLatency) vmId=`0e968db5-5d49-467f-9ff3-afc37b64364f`::Disk hdd latency not available >GuestMonitor-scale_4::DEBUG::2014-07-10 09:02:32,931::vm::715::vm.Vm::(_getDiskLatency) vmId=`0e968db5-5d49-467f-9ff3-afc37b64364f`::Disk hdc latency not available >GuestMonitor-scale_4::DEBUG::2014-07-10 09:02:32,931::vm::715::vm.Vm::(_getDiskLatency) vmId=`0e968db5-5d49-467f-9ff3-afc37b64364f`::Disk vda latency not available >GuestMonitor-scale_4::DEBUG::2014-07-10 09:02:32,932::vm::676::vm.Vm::(_getDiskStats) vmId=`0e968db5-5d49-467f-9ff3-afc37b64364f`::Disk hdd stats not available >GuestMonitor-scale_4::DEBUG::2014-07-10 09:02:32,932::vm::676::vm.Vm::(_getDiskStats) vmId=`0e968db5-5d49-467f-9ff3-afc37b64364f`::Disk hdc stats not available >GuestMonitor-scale_4::DEBUG::2014-07-10 09:02:32,932::vm::676::vm.Vm::(_getDiskStats) vmId=`0e968db5-5d49-467f-9ff3-afc37b64364f`::Disk vda stats not available >GuestMonitor-scale_4::DEBUG::2014-07-10 09:02:32,932::vm::715::vm.Vm::(_getDiskLatency) vmId=`0e968db5-5d49-467f-9ff3-afc37b64364f`::Disk hdd latency not available >GuestMonitor-scale_4::DEBUG::2014-07-10 09:02:32,932::vm::715::vm.Vm::(_getDiskLatency) vmId=`0e968db5-5d49-467f-9ff3-afc37b64364f`::Disk hdc latency not available >GuestMonitor-scale_4::DEBUG::2014-07-10 09:02:32,932::vm::715::vm.Vm::(_getDiskLatency) vmId=`0e968db5-5d49-467f-9ff3-afc37b64364f`::Disk vda latency not available >GuestMonitor-scale_3::DEBUG::2014-07-10 09:02:33,099::vm::676::vm.Vm::(_getDiskStats) vmId=`949f6c19-87b5-4f16-a91c-0049749423ea`::Disk hdd stats not available >GuestMonitor-scale_3::DEBUG::2014-07-10 09:02:33,100::vm::676::vm.Vm::(_getDiskStats) vmId=`949f6c19-87b5-4f16-a91c-0049749423ea`::Disk hdc stats not available >GuestMonitor-scale_3::DEBUG::2014-07-10 09:02:33,101::vm::676::vm.Vm::(_getDiskStats) vmId=`949f6c19-87b5-4f16-a91c-0049749423ea`::Disk vda stats not available >GuestMonitor-scale_3::DEBUG::2014-07-10 09:02:33,101::vm::715::vm.Vm::(_getDiskLatency) vmId=`949f6c19-87b5-4f16-a91c-0049749423ea`::Disk hdd latency not available >GuestMonitor-scale_3::DEBUG::2014-07-10 09:02:33,101::vm::715::vm.Vm::(_getDiskLatency) vmId=`949f6c19-87b5-4f16-a91c-0049749423ea`::Disk hdc latency not available >GuestMonitor-scale_3::DEBUG::2014-07-10 09:02:33,101::vm::715::vm.Vm::(_getDiskLatency) vmId=`949f6c19-87b5-4f16-a91c-0049749423ea`::Disk vda latency not available >GuestMonitor-scale_3::DEBUG::2014-07-10 09:02:33,102::vm::676::vm.Vm::(_getDiskStats) vmId=`949f6c19-87b5-4f16-a91c-0049749423ea`::Disk hdd stats not available >GuestMonitor-scale_3::DEBUG::2014-07-10 09:02:33,102::vm::676::vm.Vm::(_getDiskStats) vmId=`949f6c19-87b5-4f16-a91c-0049749423ea`::Disk hdc stats not available >GuestMonitor-scale_3::DEBUG::2014-07-10 09:02:33,102::vm::676::vm.Vm::(_getDiskStats) vmId=`949f6c19-87b5-4f16-a91c-0049749423ea`::Disk vda stats not available >GuestMonitor-scale_3::DEBUG::2014-07-10 09:02:33,102::vm::715::vm.Vm::(_getDiskLatency) vmId=`949f6c19-87b5-4f16-a91c-0049749423ea`::Disk hdd latency not available >GuestMonitor-scale_3::DEBUG::2014-07-10 09:02:33,102::vm::715::vm.Vm::(_getDiskLatency) vmId=`949f6c19-87b5-4f16-a91c-0049749423ea`::Disk hdc latency not available >GuestMonitor-scale_3::DEBUG::2014-07-10 09:02:33,102::vm::715::vm.Vm::(_getDiskLatency) vmId=`949f6c19-87b5-4f16-a91c-0049749423ea`::Disk vda latency not available >Thread-14::DEBUG::2014-07-10 09:02:33,705::BindingXMLRPC::1067::vds::(wrapper) client [10.35.3.13]::call vmGetStats with ('2386fa8c-f537-495c-ae07-e178171d77f2',) {} >Thread-14::DEBUG::2014-07-10 09:02:33,705::vm::598::vm.Vm::(_getCpuStats) vmId=`2386fa8c-f537-495c-ae07-e178171d77f2`::CPU stats not available: 'NoneType' object is unsubscriptable >Thread-14::DEBUG::2014-07-10 09:02:33,706::vm::654::vm.Vm::(_getNetworkStats) vmId=`2386fa8c-f537-495c-ae07-e178171d77f2`::Network stats not available >Thread-14::DEBUG::2014-07-10 09:02:33,706::vm::676::vm.Vm::(_getDiskStats) vmId=`2386fa8c-f537-495c-ae07-e178171d77f2`::Disk hdd stats not available >Thread-14::DEBUG::2014-07-10 09:02:33,706::vm::676::vm.Vm::(_getDiskStats) vmId=`2386fa8c-f537-495c-ae07-e178171d77f2`::Disk hdc stats not available >Thread-14::DEBUG::2014-07-10 09:02:33,706::vm::676::vm.Vm::(_getDiskStats) vmId=`2386fa8c-f537-495c-ae07-e178171d77f2`::Disk vda stats not available >Thread-14::DEBUG::2014-07-10 09:02:33,706::vm::715::vm.Vm::(_getDiskLatency) vmId=`2386fa8c-f537-495c-ae07-e178171d77f2`::Disk hdd latency not available >Thread-14::DEBUG::2014-07-10 09:02:33,707::vm::715::vm.Vm::(_getDiskLatency) vmId=`2386fa8c-f537-495c-ae07-e178171d77f2`::Disk hdc latency not available >Thread-14::DEBUG::2014-07-10 09:02:33,707::vm::715::vm.Vm::(_getDiskLatency) vmId=`2386fa8c-f537-495c-ae07-e178171d77f2`::Disk vda latency not available >Thread-14::DEBUG::2014-07-10 09:02:33,707::BindingXMLRPC::1074::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Powering up', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '14143', 'displayIp': '0', 'displayPort': u'5908', 'session': 'Unknown', 'displaySecurePort': u'5909', 'timeOffset': '0', 'hash': '-2423634698834682900', 'balloonInfo': {'balloon_max': '1048576', 'balloon_target': '1048576', 'balloon_cur': '0', 'balloon_min': '1048576'}, 'pauseCode': 'NOERR', 'clientIp': '', 'kvmEnable': 'true', 'network': {u'vnet4': {'state': 'unknown', 'macAddr': '00:1a:4a:de:6d:7c', 'speed': '1000', 'name': u'vnet4'}}, 'vmId': '2386fa8c-f537-495c-ae07-e178171d77f2', 'displayType': 'qxl', 'cpuUser': '0.00', 'disks': {u'vda': {'truesize': '1073741824', 'apparentsize': '1073741824', 'imageID': 'b034d5b0-e1e0-4011-b49b-4d45ddb11556'}, u'hdd': {'truesize': '0', 'apparentsize': '0'}, u'hdc': {'truesize': '0', 'apparentsize': '0'}}, 'monitorResponse': '0', 'statsAge': '0.73', 'elapsedTime': '7', 'vmType': 'kvm', 'cpuSys': '0.00', 'guestCPUCount': -1, 'appsList': [], 'guestIPs': ''}]} >Thread-14::DEBUG::2014-07-10 09:02:33,711::BindingXMLRPC::1067::vds::(wrapper) client [10.35.3.13]::call vmGetStats with ('0e968db5-5d49-467f-9ff3-afc37b64364f',) {} >Thread-14::DEBUG::2014-07-10 09:02:33,712::vm::676::vm.Vm::(_getDiskStats) vmId=`0e968db5-5d49-467f-9ff3-afc37b64364f`::Disk hdd stats not available >Thread-14::DEBUG::2014-07-10 09:02:33,712::vm::676::vm.Vm::(_getDiskStats) vmId=`0e968db5-5d49-467f-9ff3-afc37b64364f`::Disk hdc stats not available >Thread-14::DEBUG::2014-07-10 09:02:33,712::vm::676::vm.Vm::(_getDiskStats) vmId=`0e968db5-5d49-467f-9ff3-afc37b64364f`::Disk vda stats not available >Thread-14::DEBUG::2014-07-10 09:02:33,712::vm::715::vm.Vm::(_getDiskLatency) vmId=`0e968db5-5d49-467f-9ff3-afc37b64364f`::Disk hdd latency not available >Thread-14::DEBUG::2014-07-10 09:02:33,712::vm::715::vm.Vm::(_getDiskLatency) vmId=`0e968db5-5d49-467f-9ff3-afc37b64364f`::Disk hdc latency not available >Thread-14::DEBUG::2014-07-10 09:02:33,713::vm::715::vm.Vm::(_getDiskLatency) vmId=`0e968db5-5d49-467f-9ff3-afc37b64364f`::Disk vda latency not available >Thread-14::DEBUG::2014-07-10 09:02:33,713::BindingXMLRPC::1074::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Powering up', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '13498', 'displayIp': '0', 'displayPort': u'5906', 'session': 'Unknown', 'displaySecurePort': u'5907', 'timeOffset': '0', 'hash': '-6274297782377519393', 'balloonInfo': {'balloon_max': '1048576', 'balloon_target': '1048576', 'balloon_cur': '1048576', 'balloon_min': '1048576'}, 'pauseCode': 'NOERR', 'clientIp': '', 'kvmEnable': 'true', 'network': {u'vnet3': {'macAddr': '00:1a:4a:de:6d:7f', 'rxDropped': '0', 'rxErrors': '0', 'txDropped': '0', 'txRate': '0.0', 'rxRate': '0.0', 'txErrors': '0', 'state': 'unknown', 'speed': '1000', 'name': u'vnet3'}}, 'vmId': '0e968db5-5d49-467f-9ff3-afc37b64364f', 'displayType': 'qxl', 'cpuUser': '43.03', 'disks': {u'vda': {'truesize': '1073741824', 'apparentsize': '1073741824', 'imageID': 'b6f6c0da-e67f-4902-b9ac-3069571a42fe'}, u'hdd': {'truesize': '0', 'apparentsize': '0'}, u'hdc': {'truesize': '0', 'apparentsize': '0'}}, 'monitorResponse': '0', 'statsAge': '1.27', 'elapsedTime': '27', 'vmType': 'kvm', 'cpuSys': '23.56', 'guestCPUCount': -1, 'appsList': [], 'guestIPs': ''}]} >Thread-40::DEBUG::2014-07-10 09:02:34,300::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lion.qa.lab.tlv.redhat.com:_export_yuri2_backup2/6a70504d-00df-4869-8695-0f442053f6b6/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-40::DEBUG::2014-07-10 09:02:34,317::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n369 bytes (369 B) copied, 0.000462419 s, 798 kB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:02:34,452::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:02:34,576::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0710487 s, 14.4 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 09:02:35,330::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-14::DEBUG::2014-07-10 09:02:35,331::task::595::TaskManager.Task::(_updateState) Task=`6539bee9-7648-4b23-a9b7-ba9e99cf7743`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 09:02:35,332::logUtils::44::dispatcher::(wrapper) Run and protect: getAllTasksStatuses(spUUID=None, options=None) >Thread-14::DEBUG::2014-07-10 09:02:35,332::taskManager::102::TaskManager::(getAllTasksStatuses) Entry. >Thread-14::DEBUG::2014-07-10 09:02:35,332::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 48379855-da89-43ed-8dd4-a4bae06c4219 >Thread-14::DEBUG::2014-07-10 09:02:35,332::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '48379855-da89-43ed-8dd4-a4bae06c4219'} >Thread-14::DEBUG::2014-07-10 09:02:35,333::taskManager::113::TaskManager::(getAllTasksStatuses) Return: {'48379855-da89-43ed-8dd4-a4bae06c4219': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '48379855-da89-43ed-8dd4-a4bae06c4219'}} >Thread-14::INFO::2014-07-10 09:02:35,333::logUtils::47::dispatcher::(wrapper) Run and protect: getAllTasksStatuses, Return response: {'allTasksStatus': {'48379855-da89-43ed-8dd4-a4bae06c4219': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '48379855-da89-43ed-8dd4-a4bae06c4219'}}} >Thread-14::DEBUG::2014-07-10 09:02:35,333::task::1185::TaskManager.Task::(prepare) Task=`6539bee9-7648-4b23-a9b7-ba9e99cf7743`::finished: {'allTasksStatus': {'48379855-da89-43ed-8dd4-a4bae06c4219': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '48379855-da89-43ed-8dd4-a4bae06c4219'}}} >Thread-14::DEBUG::2014-07-10 09:02:35,333::task::595::TaskManager.Task::(_updateState) Task=`6539bee9-7648-4b23-a9b7-ba9e99cf7743`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 09:02:35,333::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 09:02:35,334::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 09:02:35,334::task::990::TaskManager.Task::(_decref) Task=`6539bee9-7648-4b23-a9b7-ba9e99cf7743`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 09:02:36,591::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:02:36,668::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0263656 s, 38.8 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 09:02:36,727::BindingXMLRPC::1067::vds::(wrapper) client [10.35.3.13]::call vmGetStats with ('2386fa8c-f537-495c-ae07-e178171d77f2',) {} >Thread-14::DEBUG::2014-07-10 09:02:36,727::vm::598::vm.Vm::(_getCpuStats) vmId=`2386fa8c-f537-495c-ae07-e178171d77f2`::CPU stats not available: 'NoneType' object is unsubscriptable >Thread-14::DEBUG::2014-07-10 09:02:36,728::vm::654::vm.Vm::(_getNetworkStats) vmId=`2386fa8c-f537-495c-ae07-e178171d77f2`::Network stats not available >Thread-14::DEBUG::2014-07-10 09:02:36,728::vm::676::vm.Vm::(_getDiskStats) vmId=`2386fa8c-f537-495c-ae07-e178171d77f2`::Disk hdd stats not available >Thread-14::DEBUG::2014-07-10 09:02:36,728::vm::676::vm.Vm::(_getDiskStats) vmId=`2386fa8c-f537-495c-ae07-e178171d77f2`::Disk hdc stats not available >Thread-14::DEBUG::2014-07-10 09:02:36,728::vm::676::vm.Vm::(_getDiskStats) vmId=`2386fa8c-f537-495c-ae07-e178171d77f2`::Disk vda stats not available >Thread-14::DEBUG::2014-07-10 09:02:36,729::vm::715::vm.Vm::(_getDiskLatency) vmId=`2386fa8c-f537-495c-ae07-e178171d77f2`::Disk hdd latency not available >Thread-14::DEBUG::2014-07-10 09:02:36,729::vm::715::vm.Vm::(_getDiskLatency) vmId=`2386fa8c-f537-495c-ae07-e178171d77f2`::Disk hdc latency not available >Thread-14::DEBUG::2014-07-10 09:02:36,729::vm::715::vm.Vm::(_getDiskLatency) vmId=`2386fa8c-f537-495c-ae07-e178171d77f2`::Disk vda latency not available >Thread-14::DEBUG::2014-07-10 09:02:36,730::BindingXMLRPC::1074::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Powering up', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '14143', 'displayIp': '0', 'displayPort': u'5908', 'session': 'Unknown', 'displaySecurePort': u'5909', 'timeOffset': '0', 'hash': '-2423634698834682900', 'balloonInfo': {'balloon_max': '1048576', 'balloon_target': '1048576', 'balloon_cur': '0', 'balloon_min': '1048576'}, 'pauseCode': 'NOERR', 'clientIp': '', 'kvmEnable': 'true', 'network': {u'vnet4': {'state': 'unknown', 'macAddr': '00:1a:4a:de:6d:7c', 'speed': '1000', 'name': u'vnet4'}}, 'vmId': '2386fa8c-f537-495c-ae07-e178171d77f2', 'displayType': 'qxl', 'cpuUser': '0.00', 'disks': {u'vda': {'truesize': '1073741824', 'apparentsize': '1073741824', 'imageID': 'b034d5b0-e1e0-4011-b49b-4d45ddb11556'}, u'hdd': {'truesize': '0', 'apparentsize': '0'}, u'hdc': {'truesize': '0', 'apparentsize': '0'}}, 'monitorResponse': '0', 'statsAge': '1.74', 'elapsedTime': '10', 'vmType': 'kvm', 'cpuSys': '0.00', 'guestCPUCount': -1, 'appsList': [], 'guestIPs': ''}]} >Thread-14::DEBUG::2014-07-10 09:02:36,734::BindingXMLRPC::1067::vds::(wrapper) client [10.35.3.13]::call vmGetStats with ('0e968db5-5d49-467f-9ff3-afc37b64364f',) {} >Thread-14::DEBUG::2014-07-10 09:02:36,735::vm::676::vm.Vm::(_getDiskStats) vmId=`0e968db5-5d49-467f-9ff3-afc37b64364f`::Disk hdd stats not available >Thread-14::DEBUG::2014-07-10 09:02:36,735::vm::676::vm.Vm::(_getDiskStats) vmId=`0e968db5-5d49-467f-9ff3-afc37b64364f`::Disk hdc stats not available >Thread-14::DEBUG::2014-07-10 09:02:36,735::vm::676::vm.Vm::(_getDiskStats) vmId=`0e968db5-5d49-467f-9ff3-afc37b64364f`::Disk vda stats not available >Thread-14::DEBUG::2014-07-10 09:02:36,736::vm::715::vm.Vm::(_getDiskLatency) vmId=`0e968db5-5d49-467f-9ff3-afc37b64364f`::Disk hdd latency not available >Thread-14::DEBUG::2014-07-10 09:02:36,736::vm::715::vm.Vm::(_getDiskLatency) vmId=`0e968db5-5d49-467f-9ff3-afc37b64364f`::Disk hdc latency not available >Thread-14::DEBUG::2014-07-10 09:02:36,736::vm::715::vm.Vm::(_getDiskLatency) vmId=`0e968db5-5d49-467f-9ff3-afc37b64364f`::Disk vda latency not available >Thread-14::DEBUG::2014-07-10 09:02:36,736::BindingXMLRPC::1074::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Powering up', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '13498', 'displayIp': '0', 'displayPort': u'5906', 'session': 'Unknown', 'displaySecurePort': u'5907', 'timeOffset': '0', 'hash': '-6274297782377519393', 'balloonInfo': {'balloon_max': '1048576', 'balloon_target': '1048576', 'balloon_cur': '1048576', 'balloon_min': '1048576'}, 'pauseCode': 'NOERR', 'clientIp': '', 'kvmEnable': 'true', 'network': {u'vnet3': {'macAddr': '00:1a:4a:de:6d:7f', 'rxDropped': '0', 'rxErrors': '0', 'txDropped': '0', 'txRate': '0.0', 'rxRate': '0.0', 'txErrors': '0', 'state': 'unknown', 'speed': '1000', 'name': u'vnet3'}}, 'vmId': '0e968db5-5d49-467f-9ff3-afc37b64364f', 'displayType': 'qxl', 'cpuUser': '43.03', 'disks': {u'vda': {'truesize': '1073741824', 'apparentsize': '1073741824', 'imageID': 'b6f6c0da-e67f-4902-b9ac-3069571a42fe'}, u'hdd': {'truesize': '0', 'apparentsize': '0'}, u'hdc': {'truesize': '0', 'apparentsize': '0'}}, 'monitorResponse': '0', 'statsAge': '0.27', 'elapsedTime': '30', 'vmType': 'kvm', 'cpuSys': '23.56', 'guestCPUCount': -1, 'appsList': [], 'guestIPs': ''}]} >Thread-18::DEBUG::2014-07-10 09:02:37,065::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/metadata bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-10 09:02:37,085::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00440884 s, 929 kB/s\n'; <rc> = 0 >48379855-da89-43ed-8dd4-a4bae06c4219::DEBUG::2014-07-10 09:02:37,588::lvm::296::Storage.Misc.excCmd::(cmd) FAILED: <err> = ' Logical volume 9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/47592965-e853-4e59-9728-d11cca6a7a8a in use.\n'; <rc> = 5 >48379855-da89-43ed-8dd4-a4bae06c4219::DEBUG::2014-07-10 09:02:37,592::lvm::306::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm lvchange --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/3600601601282300032826addbbdae311|/dev/mapper/360060160f4a030003840ec867ddee311|/dev/mapper/367cad74c2fcba00019e6afd20c781e67|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } " --autobackup n --available n 9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/47592965-e853-4e59-9728-d11cca6a7a8a' (cwd None) >GuestMonitor-scale_5::DEBUG::2014-07-10 09:02:37,875::vm::598::vm.Vm::(_getCpuStats) vmId=`2386fa8c-f537-495c-ae07-e178171d77f2`::CPU stats not available: 'NoneType' object is unsubscriptable >GuestMonitor-scale_5::DEBUG::2014-07-10 09:02:37,876::vm::654::vm.Vm::(_getNetworkStats) vmId=`2386fa8c-f537-495c-ae07-e178171d77f2`::Network stats not available >GuestMonitor-scale_5::DEBUG::2014-07-10 09:02:37,877::vm::676::vm.Vm::(_getDiskStats) vmId=`2386fa8c-f537-495c-ae07-e178171d77f2`::Disk hdd stats not available >GuestMonitor-scale_5::DEBUG::2014-07-10 09:02:37,877::vm::676::vm.Vm::(_getDiskStats) vmId=`2386fa8c-f537-495c-ae07-e178171d77f2`::Disk hdc stats not available >GuestMonitor-scale_5::DEBUG::2014-07-10 09:02:37,878::vm::676::vm.Vm::(_getDiskStats) vmId=`2386fa8c-f537-495c-ae07-e178171d77f2`::Disk vda stats not available >GuestMonitor-scale_5::DEBUG::2014-07-10 09:02:37,878::vm::715::vm.Vm::(_getDiskLatency) vmId=`2386fa8c-f537-495c-ae07-e178171d77f2`::Disk hdd latency not available >GuestMonitor-scale_5::DEBUG::2014-07-10 09:02:37,879::vm::715::vm.Vm::(_getDiskLatency) vmId=`2386fa8c-f537-495c-ae07-e178171d77f2`::Disk hdc latency not available >GuestMonitor-scale_5::DEBUG::2014-07-10 09:02:37,879::vm::715::vm.Vm::(_getDiskLatency) vmId=`2386fa8c-f537-495c-ae07-e178171d77f2`::Disk vda latency not available >GuestMonitor-scale_5::DEBUG::2014-07-10 09:02:37,880::vm::598::vm.Vm::(_getCpuStats) vmId=`2386fa8c-f537-495c-ae07-e178171d77f2`::CPU stats not available: 'NoneType' object is unsubscriptable >GuestMonitor-scale_5::DEBUG::2014-07-10 09:02:37,880::vm::654::vm.Vm::(_getNetworkStats) vmId=`2386fa8c-f537-495c-ae07-e178171d77f2`::Network stats not available >GuestMonitor-scale_5::DEBUG::2014-07-10 09:02:37,881::vm::676::vm.Vm::(_getDiskStats) vmId=`2386fa8c-f537-495c-ae07-e178171d77f2`::Disk hdd stats not available >GuestMonitor-scale_5::DEBUG::2014-07-10 09:02:37,881::vm::676::vm.Vm::(_getDiskStats) vmId=`2386fa8c-f537-495c-ae07-e178171d77f2`::Disk hdc stats not available >GuestMonitor-scale_5::DEBUG::2014-07-10 09:02:37,881::vm::676::vm.Vm::(_getDiskStats) vmId=`2386fa8c-f537-495c-ae07-e178171d77f2`::Disk vda stats not available >GuestMonitor-scale_5::DEBUG::2014-07-10 09:02:37,882::vm::715::vm.Vm::(_getDiskLatency) vmId=`2386fa8c-f537-495c-ae07-e178171d77f2`::Disk hdd latency not available >GuestMonitor-scale_5::DEBUG::2014-07-10 09:02:37,882::vm::715::vm.Vm::(_getDiskLatency) vmId=`2386fa8c-f537-495c-ae07-e178171d77f2`::Disk hdc latency not available >GuestMonitor-scale_5::DEBUG::2014-07-10 09:02:37,882::vm::715::vm.Vm::(_getDiskLatency) vmId=`2386fa8c-f537-495c-ae07-e178171d77f2`::Disk vda latency not available >GuestMonitor-scale_4::DEBUG::2014-07-10 09:02:37,938::vm::676::vm.Vm::(_getDiskStats) vmId=`0e968db5-5d49-467f-9ff3-afc37b64364f`::Disk hdd stats not available >GuestMonitor-scale_4::DEBUG::2014-07-10 09:02:37,939::vm::676::vm.Vm::(_getDiskStats) vmId=`0e968db5-5d49-467f-9ff3-afc37b64364f`::Disk hdc stats not available >GuestMonitor-scale_4::DEBUG::2014-07-10 09:02:37,939::vm::676::vm.Vm::(_getDiskStats) vmId=`0e968db5-5d49-467f-9ff3-afc37b64364f`::Disk vda stats not available >GuestMonitor-scale_4::DEBUG::2014-07-10 09:02:37,939::vm::715::vm.Vm::(_getDiskLatency) vmId=`0e968db5-5d49-467f-9ff3-afc37b64364f`::Disk hdd latency not available >GuestMonitor-scale_4::DEBUG::2014-07-10 09:02:37,940::vm::715::vm.Vm::(_getDiskLatency) vmId=`0e968db5-5d49-467f-9ff3-afc37b64364f`::Disk hdc latency not available >GuestMonitor-scale_4::DEBUG::2014-07-10 09:02:37,940::vm::715::vm.Vm::(_getDiskLatency) vmId=`0e968db5-5d49-467f-9ff3-afc37b64364f`::Disk vda latency not available >GuestMonitor-scale_4::DEBUG::2014-07-10 09:02:37,941::vm::676::vm.Vm::(_getDiskStats) vmId=`0e968db5-5d49-467f-9ff3-afc37b64364f`::Disk hdd stats not available >GuestMonitor-scale_4::DEBUG::2014-07-10 09:02:37,941::vm::676::vm.Vm::(_getDiskStats) vmId=`0e968db5-5d49-467f-9ff3-afc37b64364f`::Disk hdc stats not available >GuestMonitor-scale_4::DEBUG::2014-07-10 09:02:37,942::vm::676::vm.Vm::(_getDiskStats) vmId=`0e968db5-5d49-467f-9ff3-afc37b64364f`::Disk vda stats not available >GuestMonitor-scale_4::DEBUG::2014-07-10 09:02:37,942::vm::715::vm.Vm::(_getDiskLatency) vmId=`0e968db5-5d49-467f-9ff3-afc37b64364f`::Disk hdd latency not available >GuestMonitor-scale_4::DEBUG::2014-07-10 09:02:37,942::vm::715::vm.Vm::(_getDiskLatency) vmId=`0e968db5-5d49-467f-9ff3-afc37b64364f`::Disk hdc latency not available >GuestMonitor-scale_4::DEBUG::2014-07-10 09:02:37,943::vm::715::vm.Vm::(_getDiskLatency) vmId=`0e968db5-5d49-467f-9ff3-afc37b64364f`::Disk vda latency not available >GuestMonitor-scale_3::DEBUG::2014-07-10 09:02:38,109::vm::676::vm.Vm::(_getDiskStats) vmId=`949f6c19-87b5-4f16-a91c-0049749423ea`::Disk hdd stats not available >GuestMonitor-scale_3::DEBUG::2014-07-10 09:02:38,109::vm::676::vm.Vm::(_getDiskStats) vmId=`949f6c19-87b5-4f16-a91c-0049749423ea`::Disk hdc stats not available >GuestMonitor-scale_3::DEBUG::2014-07-10 09:02:38,109::vm::676::vm.Vm::(_getDiskStats) vmId=`949f6c19-87b5-4f16-a91c-0049749423ea`::Disk vda stats not available >GuestMonitor-scale_3::DEBUG::2014-07-10 09:02:38,109::vm::715::vm.Vm::(_getDiskLatency) vmId=`949f6c19-87b5-4f16-a91c-0049749423ea`::Disk hdd latency not available >GuestMonitor-scale_3::DEBUG::2014-07-10 09:02:38,109::vm::715::vm.Vm::(_getDiskLatency) vmId=`949f6c19-87b5-4f16-a91c-0049749423ea`::Disk hdc latency not available >GuestMonitor-scale_3::DEBUG::2014-07-10 09:02:38,110::vm::715::vm.Vm::(_getDiskLatency) vmId=`949f6c19-87b5-4f16-a91c-0049749423ea`::Disk vda latency not available >GuestMonitor-scale_3::DEBUG::2014-07-10 09:02:38,110::vm::676::vm.Vm::(_getDiskStats) vmId=`949f6c19-87b5-4f16-a91c-0049749423ea`::Disk hdd stats not available >GuestMonitor-scale_3::DEBUG::2014-07-10 09:02:38,110::vm::676::vm.Vm::(_getDiskStats) vmId=`949f6c19-87b5-4f16-a91c-0049749423ea`::Disk hdc stats not available >GuestMonitor-scale_3::DEBUG::2014-07-10 09:02:38,111::vm::676::vm.Vm::(_getDiskStats) vmId=`949f6c19-87b5-4f16-a91c-0049749423ea`::Disk vda stats not available >GuestMonitor-scale_3::DEBUG::2014-07-10 09:02:38,111::vm::715::vm.Vm::(_getDiskLatency) vmId=`949f6c19-87b5-4f16-a91c-0049749423ea`::Disk hdd latency not available >GuestMonitor-scale_3::DEBUG::2014-07-10 09:02:38,111::vm::715::vm.Vm::(_getDiskLatency) vmId=`949f6c19-87b5-4f16-a91c-0049749423ea`::Disk hdc latency not available >GuestMonitor-scale_3::DEBUG::2014-07-10 09:02:38,111::vm::715::vm.Vm::(_getDiskLatency) vmId=`949f6c19-87b5-4f16-a91c-0049749423ea`::Disk vda latency not available >Dummy-33::DEBUG::2014-07-10 09:02:38,683::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:02:38,759::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0322916 s, 31.7 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-07-10 09:02:39,158::vmChannels::95::vds::(_handle_timeouts) Timeout on fileno 63. >Thread-14::DEBUG::2014-07-10 09:02:39,750::BindingXMLRPC::1067::vds::(wrapper) client [10.35.3.13]::call vmGetStats with ('2386fa8c-f537-495c-ae07-e178171d77f2',) {} flowID [72f5e52c] >Thread-14::DEBUG::2014-07-10 09:02:39,751::vm::598::vm.Vm::(_getCpuStats) vmId=`2386fa8c-f537-495c-ae07-e178171d77f2`::CPU stats not available: 'NoneType' object is unsubscriptable >Thread-14::DEBUG::2014-07-10 09:02:39,751::vm::654::vm.Vm::(_getNetworkStats) vmId=`2386fa8c-f537-495c-ae07-e178171d77f2`::Network stats not available >Thread-14::DEBUG::2014-07-10 09:02:39,751::vm::676::vm.Vm::(_getDiskStats) vmId=`2386fa8c-f537-495c-ae07-e178171d77f2`::Disk hdd stats not available >Thread-14::DEBUG::2014-07-10 09:02:39,751::vm::676::vm.Vm::(_getDiskStats) vmId=`2386fa8c-f537-495c-ae07-e178171d77f2`::Disk hdc stats not available >Thread-14::DEBUG::2014-07-10 09:02:39,751::vm::676::vm.Vm::(_getDiskStats) vmId=`2386fa8c-f537-495c-ae07-e178171d77f2`::Disk vda stats not available >Thread-14::DEBUG::2014-07-10 09:02:39,752::vm::715::vm.Vm::(_getDiskLatency) vmId=`2386fa8c-f537-495c-ae07-e178171d77f2`::Disk hdd latency not available >Thread-14::DEBUG::2014-07-10 09:02:39,752::vm::715::vm.Vm::(_getDiskLatency) vmId=`2386fa8c-f537-495c-ae07-e178171d77f2`::Disk hdc latency not available >Thread-14::DEBUG::2014-07-10 09:02:39,752::vm::715::vm.Vm::(_getDiskLatency) vmId=`2386fa8c-f537-495c-ae07-e178171d77f2`::Disk vda latency not available >Thread-14::DEBUG::2014-07-10 09:02:39,752::BindingXMLRPC::1074::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Powering up', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '14143', 'displayIp': '0', 'displayPort': u'5908', 'session': 'Unknown', 'displaySecurePort': u'5909', 'timeOffset': '0', 'hash': '-2423634698834682900', 'balloonInfo': {'balloon_max': '1048576', 'balloon_target': '1048576', 'balloon_cur': '0', 'balloon_min': '1048576'}, 'pauseCode': 'NOERR', 'clientIp': '', 'kvmEnable': 'true', 'network': {u'vnet4': {'state': 'unknown', 'macAddr': '00:1a:4a:de:6d:7c', 'speed': '1000', 'name': u'vnet4'}}, 'vmId': '2386fa8c-f537-495c-ae07-e178171d77f2', 'displayType': 'qxl', 'cpuUser': '0.00', 'disks': {u'vda': {'truesize': '1073741824', 'apparentsize': '1073741824', 'imageID': 'b034d5b0-e1e0-4011-b49b-4d45ddb11556'}, u'hdd': {'truesize': '0', 'apparentsize': '0'}, u'hdc': {'truesize': '0', 'apparentsize': '0'}}, 'monitorResponse': '0', 'statsAge': '0.75', 'elapsedTime': '13', 'vmType': 'kvm', 'cpuSys': '0.00', 'guestCPUCount': -1, 'appsList': [], 'guestIPs': ''}]} >Thread-14::DEBUG::2014-07-10 09:02:39,757::BindingXMLRPC::1067::vds::(wrapper) client [10.35.3.13]::call vmGetStats with ('0e968db5-5d49-467f-9ff3-afc37b64364f',) {} flowID [72f5e52c] >Thread-14::DEBUG::2014-07-10 09:02:39,757::vm::676::vm.Vm::(_getDiskStats) vmId=`0e968db5-5d49-467f-9ff3-afc37b64364f`::Disk hdd stats not available >Thread-14::DEBUG::2014-07-10 09:02:39,757::vm::676::vm.Vm::(_getDiskStats) vmId=`0e968db5-5d49-467f-9ff3-afc37b64364f`::Disk hdc stats not available >Thread-14::DEBUG::2014-07-10 09:02:39,758::vm::676::vm.Vm::(_getDiskStats) vmId=`0e968db5-5d49-467f-9ff3-afc37b64364f`::Disk vda stats not available >Thread-14::DEBUG::2014-07-10 09:02:39,758::vm::715::vm.Vm::(_getDiskLatency) vmId=`0e968db5-5d49-467f-9ff3-afc37b64364f`::Disk hdd latency not available >Thread-14::DEBUG::2014-07-10 09:02:39,758::vm::715::vm.Vm::(_getDiskLatency) vmId=`0e968db5-5d49-467f-9ff3-afc37b64364f`::Disk hdc latency not available >Thread-14::DEBUG::2014-07-10 09:02:39,758::vm::715::vm.Vm::(_getDiskLatency) vmId=`0e968db5-5d49-467f-9ff3-afc37b64364f`::Disk vda latency not available >Thread-14::DEBUG::2014-07-10 09:02:39,759::BindingXMLRPC::1074::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Powering up', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '13498', 'displayIp': '0', 'displayPort': u'5906', 'session': 'Unknown', 'displaySecurePort': u'5907', 'timeOffset': '0', 'hash': '-6274297782377519393', 'balloonInfo': {'balloon_max': '1048576', 'balloon_target': '1048576', 'balloon_cur': '1048576', 'balloon_min': '1048576'}, 'pauseCode': 'NOERR', 'clientIp': '', 'kvmEnable': 'true', 'network': {u'vnet3': {'macAddr': '00:1a:4a:de:6d:7f', 'rxDropped': '0', 'rxErrors': '0', 'txDropped': '0', 'txRate': '0.0', 'rxRate': '0.0', 'txErrors': '0', 'state': 'unknown', 'speed': '1000', 'name': u'vnet3'}}, 'vmId': '0e968db5-5d49-467f-9ff3-afc37b64364f', 'displayType': 'qxl', 'cpuUser': '43.05', 'disks': {u'vda': {'truesize': '1073741824', 'apparentsize': '1073741824', 'imageID': 'b6f6c0da-e67f-4902-b9ac-3069571a42fe'}, u'hdd': {'truesize': '0', 'apparentsize': '0'}, u'hdc': {'truesize': '0', 'apparentsize': '0'}}, 'monitorResponse': '0', 'statsAge': '1.28', 'elapsedTime': '33', 'vmType': 'kvm', 'cpuSys': '3.38', 'guestCPUCount': -1, 'appsList': [], 'guestIPs': ''}]} >Dummy-33::DEBUG::2014-07-10 09:02:40,770::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:02:40,908::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0834002 s, 12.3 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 09:02:42,583::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-14::DEBUG::2014-07-10 09:02:42,585::task::595::TaskManager.Task::(_updateState) Task=`ab83a935-db43-4070-a47c-50ee4c5a0837`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 09:02:42,585::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-14::INFO::2014-07-10 09:02:42,586::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:02:42,586::task::1185::TaskManager.Task::(prepare) Task=`ab83a935-db43-4070-a47c-50ee4c5a0837`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:02:42,586::task::595::TaskManager.Task::(_updateState) Task=`ab83a935-db43-4070-a47c-50ee4c5a0837`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 09:02:42,586::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 09:02:42,586::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 09:02:42,586::task::990::TaskManager.Task::(_decref) Task=`ab83a935-db43-4070-a47c-50ee4c5a0837`::ref 0 aborting False >Thread-34::DEBUG::2014-07-10 09:02:42,591::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-34::DEBUG::2014-07-10 09:02:42,591::task::595::TaskManager.Task::(_updateState) Task=`567fbb8f-9e95-4cd6-af6d-c838ff5b8631`::moving from state init -> state preparing >Thread-34::INFO::2014-07-10 09:02:42,592::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-34::DEBUG::2014-07-10 09:02:42,594::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`6690fdd1-a02b-491e-ab2b-e2013192601a`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-10 09:02:42,595::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' for lock type 'shared' >Thread-34::DEBUG::2014-07-10 09:02:42,595::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-10 09:02:42,595::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`6690fdd1-a02b-491e-ab2b-e2013192601a`::Granted request >Thread-34::DEBUG::2014-07-10 09:02:42,596::task::827::TaskManager.Task::(resourceAcquired) Task=`567fbb8f-9e95-4cd6-af6d-c838ff5b8631`::_resourcesAcquired: Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee (shared) >Thread-34::DEBUG::2014-07-10 09:02:42,596::task::990::TaskManager.Task::(_decref) Task=`567fbb8f-9e95-4cd6-af6d-c838ff5b8631`::ref 1 aborting False >Thread-34::INFO::2014-07-10 09:02:42,597::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1077768355840', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532069482496', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:02:42,597::task::1185::TaskManager.Task::(prepare) Task=`567fbb8f-9e95-4cd6-af6d-c838ff5b8631`::finished: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1077768355840', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532069482496', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:02:42,597::task::595::TaskManager.Task::(_updateState) Task=`567fbb8f-9e95-4cd6-af6d-c838ff5b8631`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-10 09:02:42,597::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee': < ResourceRef 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-10 09:02:42,598::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-10 09:02:42,598::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' >Thread-34::DEBUG::2014-07-10 09:02:42,598::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' (0 active users) >Thread-34::DEBUG::2014-07-10 09:02:42,598::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-10 09:02:42,598::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', Clearing records. >Thread-34::DEBUG::2014-07-10 09:02:42,599::task::990::TaskManager.Task::(_decref) Task=`567fbb8f-9e95-4cd6-af6d-c838ff5b8631`::ref 0 aborting False >48379855-da89-43ed-8dd4-a4bae06c4219::DEBUG::2014-07-10 09:02:42,610::lvm::306::Storage.Misc.excCmd::(cmd) FAILED: <err> = ' Logical volume 9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/47592965-e853-4e59-9728-d11cca6a7a8a in use.\n'; <rc> = 5 >48379855-da89-43ed-8dd4-a4bae06c4219::DEBUG::2014-07-10 09:02:42,611::lvm::513::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >48379855-da89-43ed-8dd4-a4bae06c4219::DEBUG::2014-07-10 09:02:42,611::lvm::525::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >48379855-da89-43ed-8dd4-a4bae06c4219::WARNING::2014-07-10 09:02:42,611::resourceFactories::61::Storage.ResourcesFactories::(close) Failure deactivate LV 9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/47592965-e853-4e59-9728-d11cca6a7a8a (Cannot deactivate Logical Volume: ('General Storage Exception: ("5 [] [\' Logical volume 9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/47592965-e853-4e59-9728-d11cca6a7a8a in use.\']\\n9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/[\'47592965-e853-4e59-9728-d11cca6a7a8a\']",)',)) >48379855-da89-43ed-8dd4-a4bae06c4219::DEBUG::2014-07-10 09:02:42,612::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd_lvmActivationNS.47592965-e853-4e59-9728-d11cca6a7a8a', Clearing records. >48379855-da89-43ed-8dd4-a4bae06c4219::DEBUG::2014-07-10 09:02:42,612::lvm::427::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' got the operation mutex >48379855-da89-43ed-8dd4-a4bae06c4219::DEBUG::2014-07-10 09:02:42,613::lvm::296::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm lvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/3600601601282300032826addbbdae311|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,vg_name,attr,size,seg_start_pe,devices,tags 9e1aa540-1f4e-4ee3-a152-be381ef6c3bd' (cwd None) >Thread-14::DEBUG::2014-07-10 09:02:42,781::BindingXMLRPC::1067::vds::(wrapper) client [10.35.3.13]::call vmGetStats with ('2386fa8c-f537-495c-ae07-e178171d77f2',) {} >Thread-14::DEBUG::2014-07-10 09:02:42,782::vm::598::vm.Vm::(_getCpuStats) vmId=`2386fa8c-f537-495c-ae07-e178171d77f2`::CPU stats not available: 'NoneType' object is unsubscriptable >Thread-14::DEBUG::2014-07-10 09:02:42,782::vm::654::vm.Vm::(_getNetworkStats) vmId=`2386fa8c-f537-495c-ae07-e178171d77f2`::Network stats not available >Thread-14::DEBUG::2014-07-10 09:02:42,782::vm::676::vm.Vm::(_getDiskStats) vmId=`2386fa8c-f537-495c-ae07-e178171d77f2`::Disk hdd stats not available >Thread-14::DEBUG::2014-07-10 09:02:42,783::vm::676::vm.Vm::(_getDiskStats) vmId=`2386fa8c-f537-495c-ae07-e178171d77f2`::Disk hdc stats not available >Thread-14::DEBUG::2014-07-10 09:02:42,783::vm::676::vm.Vm::(_getDiskStats) vmId=`2386fa8c-f537-495c-ae07-e178171d77f2`::Disk vda stats not available >Thread-14::DEBUG::2014-07-10 09:02:42,783::vm::715::vm.Vm::(_getDiskLatency) vmId=`2386fa8c-f537-495c-ae07-e178171d77f2`::Disk hdd latency not available >Thread-14::DEBUG::2014-07-10 09:02:42,783::vm::715::vm.Vm::(_getDiskLatency) vmId=`2386fa8c-f537-495c-ae07-e178171d77f2`::Disk hdc latency not available >Thread-14::DEBUG::2014-07-10 09:02:42,783::vm::715::vm.Vm::(_getDiskLatency) vmId=`2386fa8c-f537-495c-ae07-e178171d77f2`::Disk vda latency not available >Thread-14::DEBUG::2014-07-10 09:02:42,784::BindingXMLRPC::1074::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Powering up', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '14143', 'displayIp': '0', 'displayPort': u'5908', 'session': 'Unknown', 'displaySecurePort': u'5909', 'timeOffset': '0', 'hash': '-2423634698834682900', 'balloonInfo': {'balloon_max': '1048576', 'balloon_target': '1048576', 'balloon_cur': '0', 'balloon_min': '1048576'}, 'pauseCode': 'NOERR', 'clientIp': '', 'kvmEnable': 'true', 'network': {u'vnet4': {'state': 'unknown', 'macAddr': '00:1a:4a:de:6d:7c', 'speed': '1000', 'name': u'vnet4'}}, 'vmId': '2386fa8c-f537-495c-ae07-e178171d77f2', 'displayType': 'qxl', 'cpuUser': '0.00', 'disks': {u'vda': {'truesize': '1073741824', 'apparentsize': '1073741824', 'imageID': 'b034d5b0-e1e0-4011-b49b-4d45ddb11556'}, u'hdd': {'truesize': '0', 'apparentsize': '0'}, u'hdc': {'truesize': '0', 'apparentsize': '0'}}, 'monitorResponse': '0', 'statsAge': '1.77', 'elapsedTime': '16', 'vmType': 'kvm', 'cpuSys': '0.00', 'guestCPUCount': -1, 'appsList': [], 'guestIPs': ''}]} >Thread-14::DEBUG::2014-07-10 09:02:42,788::BindingXMLRPC::1067::vds::(wrapper) client [10.35.3.13]::call vmGetStats with ('0e968db5-5d49-467f-9ff3-afc37b64364f',) {} >Thread-14::DEBUG::2014-07-10 09:02:42,789::vm::676::vm.Vm::(_getDiskStats) vmId=`0e968db5-5d49-467f-9ff3-afc37b64364f`::Disk hdd stats not available >Thread-14::DEBUG::2014-07-10 09:02:42,789::vm::676::vm.Vm::(_getDiskStats) vmId=`0e968db5-5d49-467f-9ff3-afc37b64364f`::Disk hdc stats not available >Thread-14::DEBUG::2014-07-10 09:02:42,789::vm::676::vm.Vm::(_getDiskStats) vmId=`0e968db5-5d49-467f-9ff3-afc37b64364f`::Disk vda stats not available >Thread-14::DEBUG::2014-07-10 09:02:42,789::vm::715::vm.Vm::(_getDiskLatency) vmId=`0e968db5-5d49-467f-9ff3-afc37b64364f`::Disk hdd latency not available >Thread-14::DEBUG::2014-07-10 09:02:42,790::vm::715::vm.Vm::(_getDiskLatency) vmId=`0e968db5-5d49-467f-9ff3-afc37b64364f`::Disk hdc latency not available >Thread-14::DEBUG::2014-07-10 09:02:42,790::vm::715::vm.Vm::(_getDiskLatency) vmId=`0e968db5-5d49-467f-9ff3-afc37b64364f`::Disk vda latency not available >Thread-14::DEBUG::2014-07-10 09:02:42,790::BindingXMLRPC::1074::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Powering up', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '13498', 'displayIp': '0', 'displayPort': u'5906', 'session': 'Unknown', 'displaySecurePort': u'5907', 'timeOffset': '0', 'hash': '-6274297782377519393', 'balloonInfo': {'balloon_max': '1048576', 'balloon_target': '1048576', 'balloon_cur': '1048576', 'balloon_min': '1048576'}, 'pauseCode': 'NOERR', 'clientIp': '', 'kvmEnable': 'true', 'network': {u'vnet3': {'macAddr': '00:1a:4a:de:6d:7f', 'rxDropped': '0', 'rxErrors': '0', 'txDropped': '0', 'txRate': '0.0', 'rxRate': '0.0', 'txErrors': '0', 'state': 'unknown', 'speed': '1000', 'name': u'vnet3'}}, 'vmId': '0e968db5-5d49-467f-9ff3-afc37b64364f', 'displayType': 'qxl', 'cpuUser': '43.05', 'disks': {u'vda': {'truesize': '1073741824', 'apparentsize': '1073741824', 'imageID': 'b6f6c0da-e67f-4902-b9ac-3069571a42fe'}, u'hdd': {'truesize': '0', 'apparentsize': '0'}, u'hdc': {'truesize': '0', 'apparentsize': '0'}}, 'monitorResponse': '0', 'statsAge': '0.29', 'elapsedTime': '36', 'vmType': 'kvm', 'cpuSys': '3.38', 'guestCPUCount': -1, 'appsList': [], 'guestIPs': ''}]} >48379855-da89-43ed-8dd4-a4bae06c4219::DEBUG::2014-07-10 09:02:42,814::lvm::296::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >48379855-da89-43ed-8dd4-a4bae06c4219::DEBUG::2014-07-10 09:02:42,827::lvm::462::Storage.LVM::(_reloadlvs) lvs reloaded >48379855-da89-43ed-8dd4-a4bae06c4219::DEBUG::2014-07-10 09:02:42,827::lvm::462::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' released the operation mutex >48379855-da89-43ed-8dd4-a4bae06c4219::DEBUG::2014-07-10 09:02:42,828::lvm::427::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' got the operation mutex >48379855-da89-43ed-8dd4-a4bae06c4219::DEBUG::2014-07-10 09:02:42,828::lvm::296::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm lvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/3600601601282300032826addbbdae311|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,vg_name,attr,size,seg_start_pe,devices,tags 9e1aa540-1f4e-4ee3-a152-be381ef6c3bd' (cwd None) >GuestMonitor-scale_5::DEBUG::2014-07-10 09:02:42,889::vm::598::vm.Vm::(_getCpuStats) vmId=`2386fa8c-f537-495c-ae07-e178171d77f2`::CPU stats not available: 'NoneType' object is unsubscriptable >GuestMonitor-scale_5::DEBUG::2014-07-10 09:02:42,889::vm::654::vm.Vm::(_getNetworkStats) vmId=`2386fa8c-f537-495c-ae07-e178171d77f2`::Network stats not available >GuestMonitor-scale_5::DEBUG::2014-07-10 09:02:42,890::vm::676::vm.Vm::(_getDiskStats) vmId=`2386fa8c-f537-495c-ae07-e178171d77f2`::Disk hdd stats not available >GuestMonitor-scale_5::DEBUG::2014-07-10 09:02:42,890::vm::676::vm.Vm::(_getDiskStats) vmId=`2386fa8c-f537-495c-ae07-e178171d77f2`::Disk hdc stats not available >GuestMonitor-scale_5::DEBUG::2014-07-10 09:02:42,890::vm::676::vm.Vm::(_getDiskStats) vmId=`2386fa8c-f537-495c-ae07-e178171d77f2`::Disk vda stats not available >GuestMonitor-scale_5::DEBUG::2014-07-10 09:02:42,890::vm::715::vm.Vm::(_getDiskLatency) vmId=`2386fa8c-f537-495c-ae07-e178171d77f2`::Disk hdd latency not available >GuestMonitor-scale_5::DEBUG::2014-07-10 09:02:42,891::vm::715::vm.Vm::(_getDiskLatency) vmId=`2386fa8c-f537-495c-ae07-e178171d77f2`::Disk hdc latency not available >GuestMonitor-scale_5::DEBUG::2014-07-10 09:02:42,891::vm::715::vm.Vm::(_getDiskLatency) vmId=`2386fa8c-f537-495c-ae07-e178171d77f2`::Disk vda latency not available >GuestMonitor-scale_5::DEBUG::2014-07-10 09:02:42,891::vm::598::vm.Vm::(_getCpuStats) vmId=`2386fa8c-f537-495c-ae07-e178171d77f2`::CPU stats not available: 'NoneType' object is unsubscriptable >GuestMonitor-scale_5::DEBUG::2014-07-10 09:02:42,892::vm::654::vm.Vm::(_getNetworkStats) vmId=`2386fa8c-f537-495c-ae07-e178171d77f2`::Network stats not available >GuestMonitor-scale_5::DEBUG::2014-07-10 09:02:42,892::vm::676::vm.Vm::(_getDiskStats) vmId=`2386fa8c-f537-495c-ae07-e178171d77f2`::Disk hdd stats not available >GuestMonitor-scale_5::DEBUG::2014-07-10 09:02:42,892::vm::676::vm.Vm::(_getDiskStats) vmId=`2386fa8c-f537-495c-ae07-e178171d77f2`::Disk hdc stats not available >GuestMonitor-scale_5::DEBUG::2014-07-10 09:02:42,892::vm::676::vm.Vm::(_getDiskStats) vmId=`2386fa8c-f537-495c-ae07-e178171d77f2`::Disk vda stats not available >GuestMonitor-scale_5::DEBUG::2014-07-10 09:02:42,892::vm::715::vm.Vm::(_getDiskLatency) vmId=`2386fa8c-f537-495c-ae07-e178171d77f2`::Disk hdd latency not available >GuestMonitor-scale_5::DEBUG::2014-07-10 09:02:42,893::vm::715::vm.Vm::(_getDiskLatency) vmId=`2386fa8c-f537-495c-ae07-e178171d77f2`::Disk hdc latency not available >GuestMonitor-scale_5::DEBUG::2014-07-10 09:02:42,893::vm::715::vm.Vm::(_getDiskLatency) vmId=`2386fa8c-f537-495c-ae07-e178171d77f2`::Disk vda latency not available >Dummy-33::DEBUG::2014-07-10 09:02:42,923::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >GuestMonitor-scale_4::DEBUG::2014-07-10 09:02:42,949::vm::676::vm.Vm::(_getDiskStats) vmId=`0e968db5-5d49-467f-9ff3-afc37b64364f`::Disk hdd stats not available >GuestMonitor-scale_4::DEBUG::2014-07-10 09:02:42,950::vm::676::vm.Vm::(_getDiskStats) vmId=`0e968db5-5d49-467f-9ff3-afc37b64364f`::Disk hdc stats not available >GuestMonitor-scale_4::DEBUG::2014-07-10 09:02:42,951::vm::676::vm.Vm::(_getDiskStats) vmId=`0e968db5-5d49-467f-9ff3-afc37b64364f`::Disk vda stats not available >GuestMonitor-scale_4::DEBUG::2014-07-10 09:02:42,951::vm::715::vm.Vm::(_getDiskLatency) vmId=`0e968db5-5d49-467f-9ff3-afc37b64364f`::Disk hdd latency not available >GuestMonitor-scale_4::DEBUG::2014-07-10 09:02:42,952::vm::715::vm.Vm::(_getDiskLatency) vmId=`0e968db5-5d49-467f-9ff3-afc37b64364f`::Disk hdc latency not available >GuestMonitor-scale_4::DEBUG::2014-07-10 09:02:42,952::vm::715::vm.Vm::(_getDiskLatency) vmId=`0e968db5-5d49-467f-9ff3-afc37b64364f`::Disk vda latency not available >GuestMonitor-scale_4::DEBUG::2014-07-10 09:02:42,958::vm::676::vm.Vm::(_getDiskStats) vmId=`0e968db5-5d49-467f-9ff3-afc37b64364f`::Disk hdd stats not available >GuestMonitor-scale_4::DEBUG::2014-07-10 09:02:42,961::vm::676::vm.Vm::(_getDiskStats) vmId=`0e968db5-5d49-467f-9ff3-afc37b64364f`::Disk hdc stats not available >GuestMonitor-scale_4::DEBUG::2014-07-10 09:02:42,964::vm::676::vm.Vm::(_getDiskStats) vmId=`0e968db5-5d49-467f-9ff3-afc37b64364f`::Disk vda stats not available >GuestMonitor-scale_4::DEBUG::2014-07-10 09:02:42,966::vm::715::vm.Vm::(_getDiskLatency) vmId=`0e968db5-5d49-467f-9ff3-afc37b64364f`::Disk hdd latency not available >GuestMonitor-scale_4::DEBUG::2014-07-10 09:02:42,969::vm::715::vm.Vm::(_getDiskLatency) vmId=`0e968db5-5d49-467f-9ff3-afc37b64364f`::Disk hdc latency not available >GuestMonitor-scale_4::DEBUG::2014-07-10 09:02:42,971::vm::715::vm.Vm::(_getDiskLatency) vmId=`0e968db5-5d49-467f-9ff3-afc37b64364f`::Disk vda latency not available >48379855-da89-43ed-8dd4-a4bae06c4219::DEBUG::2014-07-10 09:02:43,044::lvm::296::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >GuestMonitor-scale_3::DEBUG::2014-07-10 09:02:43,127::vm::676::vm.Vm::(_getDiskStats) vmId=`949f6c19-87b5-4f16-a91c-0049749423ea`::Disk hdd stats not available >48379855-da89-43ed-8dd4-a4bae06c4219::DEBUG::2014-07-10 09:02:43,129::lvm::462::Storage.LVM::(_reloadlvs) lvs reloaded >GuestMonitor-scale_3::DEBUG::2014-07-10 09:02:43,138::vm::676::vm.Vm::(_getDiskStats) vmId=`949f6c19-87b5-4f16-a91c-0049749423ea`::Disk hdc stats not available >48379855-da89-43ed-8dd4-a4bae06c4219::DEBUG::2014-07-10 09:02:43,143::lvm::462::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' released the operation mutex >GuestMonitor-scale_3::DEBUG::2014-07-10 09:02:43,148::vm::676::vm.Vm::(_getDiskStats) vmId=`949f6c19-87b5-4f16-a91c-0049749423ea`::Disk vda stats not available >48379855-da89-43ed-8dd4-a4bae06c4219::WARNING::2014-07-10 09:02:43,155::blockSD::761::Storage.StorageDomain::(_getOccupiedMetadataSlots) Could not find mapping for lv 9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/58fefce2-9bce-4bff-8949-8c6ce8122b27 >GuestMonitor-scale_3::DEBUG::2014-07-10 09:02:43,156::vm::715::vm.Vm::(_getDiskLatency) vmId=`949f6c19-87b5-4f16-a91c-0049749423ea`::Disk hdd latency not available >48379855-da89-43ed-8dd4-a4bae06c4219::DEBUG::2014-07-10 09:02:43,163::blockSD::784::Storage.StorageDomain::(getFreeMetadataSlot) Found freeSlot 10 in VG 9e1aa540-1f4e-4ee3-a152-be381ef6c3bd >GuestMonitor-scale_3::DEBUG::2014-07-10 09:02:43,163::vm::715::vm.Vm::(_getDiskLatency) vmId=`949f6c19-87b5-4f16-a91c-0049749423ea`::Disk hdc latency not available >GuestMonitor-scale_3::DEBUG::2014-07-10 09:02:43,173::vm::715::vm.Vm::(_getDiskLatency) vmId=`949f6c19-87b5-4f16-a91c-0049749423ea`::Disk vda latency not available >GuestMonitor-scale_3::DEBUG::2014-07-10 09:02:43,190::vm::676::vm.Vm::(_getDiskStats) vmId=`949f6c19-87b5-4f16-a91c-0049749423ea`::Disk hdd stats not available >GuestMonitor-scale_3::DEBUG::2014-07-10 09:02:43,198::vm::676::vm.Vm::(_getDiskStats) vmId=`949f6c19-87b5-4f16-a91c-0049749423ea`::Disk hdc stats not available >GuestMonitor-scale_3::DEBUG::2014-07-10 09:02:43,206::vm::676::vm.Vm::(_getDiskStats) vmId=`949f6c19-87b5-4f16-a91c-0049749423ea`::Disk vda stats not available >48379855-da89-43ed-8dd4-a4bae06c4219::DEBUG::2014-07-10 09:02:43,212::lvm::296::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm lvchange --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/3600601601282300032826addbbdae311|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } " --autobackup n --deltag OVIRT_VOL_INITIALIZING --addtag PU_47592965-e853-4e59-9728-d11cca6a7a8a --addtag MD_10 --addtag IU_aa20346a-4d3a-4e07-b8e1-52c0ebe4168c 9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/58fefce2-9bce-4bff-8949-8c6ce8122b27' (cwd None) >GuestMonitor-scale_3::DEBUG::2014-07-10 09:02:43,214::vm::715::vm.Vm::(_getDiskLatency) vmId=`949f6c19-87b5-4f16-a91c-0049749423ea`::Disk hdd latency not available >GuestMonitor-scale_3::DEBUG::2014-07-10 09:02:43,241::vm::715::vm.Vm::(_getDiskLatency) vmId=`949f6c19-87b5-4f16-a91c-0049749423ea`::Disk hdc latency not available >GuestMonitor-scale_3::DEBUG::2014-07-10 09:02:43,244::vm::715::vm.Vm::(_getDiskLatency) vmId=`949f6c19-87b5-4f16-a91c-0049749423ea`::Disk vda latency not available >Dummy-33::DEBUG::2014-07-10 09:02:43,279::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0699974 s, 14.6 MB/s\n'; <rc> = 0 >48379855-da89-43ed-8dd4-a4bae06c4219::DEBUG::2014-07-10 09:02:43,460::lvm::296::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ' WARNING: This metadata update is NOT backed up\n WARNING: This metadata update is NOT backed up\n'; <rc> = 0 >48379855-da89-43ed-8dd4-a4bae06c4219::DEBUG::2014-07-10 09:02:43,461::lvm::513::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >48379855-da89-43ed-8dd4-a4bae06c4219::DEBUG::2014-07-10 09:02:43,462::lvm::525::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >48379855-da89-43ed-8dd4-a4bae06c4219::DEBUG::2014-07-10 09:02:43,463::lvm::296::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm lvchange --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/3600601601282300032826addbbdae311|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } " --autobackup n --available n 9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/58fefce2-9bce-4bff-8949-8c6ce8122b27' (cwd None) >48379855-da89-43ed-8dd4-a4bae06c4219::DEBUG::2014-07-10 09:02:43,730::lvm::296::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >48379855-da89-43ed-8dd4-a4bae06c4219::DEBUG::2014-07-10 09:02:43,731::lvm::513::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >48379855-da89-43ed-8dd4-a4bae06c4219::DEBUG::2014-07-10 09:02:43,741::lvm::525::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >48379855-da89-43ed-8dd4-a4bae06c4219::DEBUG::2014-07-10 09:02:43,742::task::752::TaskManager.Task::(_save) Task=`48379855-da89-43ed-8dd4-a4bae06c4219`::_save: orig /rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/master/tasks/48379855-da89-43ed-8dd4-a4bae06c4219 temp /rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/master/tasks/48379855-da89-43ed-8dd4-a4bae06c4219.temp >48379855-da89-43ed-8dd4-a4bae06c4219::DEBUG::2014-07-10 09:02:43,755::blockVolume::604::Storage.Volume::(newVolumeLease) Initializing volume lease volUUID=58fefce2-9bce-4bff-8949-8c6ce8122b27 sdUUID=9e1aa540-1f4e-4ee3-a152-be381ef6c3bd, metaId=('9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 10) >48379855-da89-43ed-8dd4-a4bae06c4219::DEBUG::2014-07-10 09:02:43,771::task::752::TaskManager.Task::(_save) Task=`48379855-da89-43ed-8dd4-a4bae06c4219`::_save: orig /rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/master/tasks/48379855-da89-43ed-8dd4-a4bae06c4219 temp /rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/master/tasks/48379855-da89-43ed-8dd4-a4bae06c4219.temp >48379855-da89-43ed-8dd4-a4bae06c4219::DEBUG::2014-07-10 09:02:43,780::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd_imageNS.aa20346a-4d3a-4e07-b8e1-52c0ebe4168c' >48379855-da89-43ed-8dd4-a4bae06c4219::DEBUG::2014-07-10 09:02:43,780::resourceManager::635::ResourceManager::(releaseResource) Released resource '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd_imageNS.aa20346a-4d3a-4e07-b8e1-52c0ebe4168c' (0 active users) >48379855-da89-43ed-8dd4-a4bae06c4219::DEBUG::2014-07-10 09:02:43,780::resourceManager::641::ResourceManager::(releaseResource) Resource '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd_imageNS.aa20346a-4d3a-4e07-b8e1-52c0ebe4168c' is free, finding out if anyone is waiting for it. >48379855-da89-43ed-8dd4-a4bae06c4219::DEBUG::2014-07-10 09:02:43,781::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd_imageNS.aa20346a-4d3a-4e07-b8e1-52c0ebe4168c', Clearing records. >48379855-da89-43ed-8dd4-a4bae06c4219::DEBUG::2014-07-10 09:02:43,781::task::595::TaskManager.Task::(_updateState) Task=`48379855-da89-43ed-8dd4-a4bae06c4219`::moving from state running -> state finished >48379855-da89-43ed-8dd4-a4bae06c4219::DEBUG::2014-07-10 09:02:43,782::task::752::TaskManager.Task::(_save) Task=`48379855-da89-43ed-8dd4-a4bae06c4219`::_save: orig /rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/master/tasks/48379855-da89-43ed-8dd4-a4bae06c4219 temp /rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/master/tasks/48379855-da89-43ed-8dd4-a4bae06c4219.temp >48379855-da89-43ed-8dd4-a4bae06c4219::DEBUG::2014-07-10 09:02:43,791::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': < ResourceRef 'Storage.9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', isValid: 'True' obj: 'None'>} >48379855-da89-43ed-8dd4-a4bae06c4219::DEBUG::2014-07-10 09:02:43,792::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >48379855-da89-43ed-8dd4-a4bae06c4219::DEBUG::2014-07-10 09:02:43,792::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.9e1aa540-1f4e-4ee3-a152-be381ef6c3bd' >48379855-da89-43ed-8dd4-a4bae06c4219::DEBUG::2014-07-10 09:02:43,792::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.9e1aa540-1f4e-4ee3-a152-be381ef6c3bd' (0 active users) >48379855-da89-43ed-8dd4-a4bae06c4219::DEBUG::2014-07-10 09:02:43,792::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.9e1aa540-1f4e-4ee3-a152-be381ef6c3bd' is free, finding out if anyone is waiting for it. >48379855-da89-43ed-8dd4-a4bae06c4219::DEBUG::2014-07-10 09:02:43,792::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', Clearing records. >48379855-da89-43ed-8dd4-a4bae06c4219::DEBUG::2014-07-10 09:02:43,793::task::913::TaskManager.Task::(_runJobs) Task=`48379855-da89-43ed-8dd4-a4bae06c4219`::Task.run: exit - success: result {'uuid': '58fefce2-9bce-4bff-8949-8c6ce8122b27'} >48379855-da89-43ed-8dd4-a4bae06c4219::DEBUG::2014-07-10 09:02:43,793::task::990::TaskManager.Task::(_decref) Task=`48379855-da89-43ed-8dd4-a4bae06c4219`::ref 0 aborting False >48379855-da89-43ed-8dd4-a4bae06c4219::DEBUG::2014-07-10 09:02:43,793::threadPool::57::Misc.ThreadPool::(setRunningTask) Number of running tasks: 0 >Thread-40::DEBUG::2014-07-10 09:02:44,320::domainMonitor::192::Storage.DomainMonitorThread::(_monitorDomain) Refreshing domain 6a70504d-00df-4869-8695-0f442053f6b6 >Thread-40::DEBUG::2014-07-10 09:02:44,351::fileSD::150::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/lion.qa.lab.tlv.redhat.com:_export_yuri2_backup2/6a70504d-00df-4869-8695-0f442053f6b6 >Thread-40::DEBUG::2014-07-10 09:02:44,355::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend >Thread-40::DEBUG::2014-07-10 09:02:44,362::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Backup', 'DESCRIPTION=test', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=0', 'POOL_UUID=4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', 'REMOTE_PATH=lion.qa.lab.tlv.redhat.com:/export/yuri2/backup2', 'ROLE=Regular', 'SDUUID=6a70504d-00df-4869-8695-0f442053f6b6', 'TYPE=NFS', 'VERSION=0', '_SHA_CKSUM=aab6b8e901ec435cd5f9de3c9e3f8b45dca569e0'] >Thread-40::DEBUG::2014-07-10 09:02:44,364::fileSD::609::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images [] >Thread-40::INFO::2014-07-10 09:02:44,364::sd::384::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 6a70504d-00df-4869-8695-0f442053f6b6_imageNS already registered >Thread-40::INFO::2014-07-10 09:02:44,364::sd::392::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 6a70504d-00df-4869-8695-0f442053f6b6_volumeNS already registered >Thread-40::DEBUG::2014-07-10 09:02:44,391::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lion.qa.lab.tlv.redhat.com:_export_yuri2_backup2/6a70504d-00df-4869-8695-0f442053f6b6/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-40::DEBUG::2014-07-10 09:02:44,407::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n369 bytes (369 B) copied, 0.000489765 s, 753 kB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:02:45,294::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Thread-14::DEBUG::2014-07-10 09:02:45,349::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-14::DEBUG::2014-07-10 09:02:45,352::task::595::TaskManager.Task::(_updateState) Task=`e4089cda-8908-46cd-b454-2ced06b616de`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 09:02:45,353::logUtils::44::dispatcher::(wrapper) Run and protect: getAllTasksStatuses(spUUID=None, options=None) >Thread-14::DEBUG::2014-07-10 09:02:45,356::taskManager::102::TaskManager::(getAllTasksStatuses) Entry. >Thread-14::DEBUG::2014-07-10 09:02:45,358::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 48379855-da89-43ed-8dd4-a4bae06c4219 >Thread-14::DEBUG::2014-07-10 09:02:45,360::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': '1 jobs completed successfully', 'taskState': 'finished', 'taskResult': 'success', 'taskID': '48379855-da89-43ed-8dd4-a4bae06c4219'} >Thread-14::DEBUG::2014-07-10 09:02:45,362::taskManager::113::TaskManager::(getAllTasksStatuses) Return: {'48379855-da89-43ed-8dd4-a4bae06c4219': {'code': 0, 'message': '1 jobs completed successfully', 'taskState': 'finished', 'taskResult': 'success', 'taskID': '48379855-da89-43ed-8dd4-a4bae06c4219'}} >Thread-14::INFO::2014-07-10 09:02:45,364::logUtils::47::dispatcher::(wrapper) Run and protect: getAllTasksStatuses, Return response: {'allTasksStatus': {'48379855-da89-43ed-8dd4-a4bae06c4219': {'code': 0, 'message': '1 jobs completed successfully', 'taskState': 'finished', 'taskResult': 'success', 'taskID': '48379855-da89-43ed-8dd4-a4bae06c4219'}}} >Thread-14::DEBUG::2014-07-10 09:02:45,366::task::1185::TaskManager.Task::(prepare) Task=`e4089cda-8908-46cd-b454-2ced06b616de`::finished: {'allTasksStatus': {'48379855-da89-43ed-8dd4-a4bae06c4219': {'code': 0, 'message': '1 jobs completed successfully', 'taskState': 'finished', 'taskResult': 'success', 'taskID': '48379855-da89-43ed-8dd4-a4bae06c4219'}}} >Thread-14::DEBUG::2014-07-10 09:02:45,368::task::595::TaskManager.Task::(_updateState) Task=`e4089cda-8908-46cd-b454-2ced06b616de`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 09:02:45,370::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 09:02:45,373::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 09:02:45,375::task::990::TaskManager.Task::(_decref) Task=`e4089cda-8908-46cd-b454-2ced06b616de`::ref 0 aborting False >Thread-34::DEBUG::2014-07-10 09:02:45,436::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [14e21488] >Thread-34::DEBUG::2014-07-10 09:02:45,441::task::595::TaskManager.Task::(_updateState) Task=`15dedbed-c0b2-49ef-a22b-8e90a2cecf68`::moving from state init -> state preparing >Thread-34::INFO::2014-07-10 09:02:45,445::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeInfo(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='aa20346a-4d3a-4e07-b8e1-52c0ebe4168c', volUUID='58fefce2-9bce-4bff-8949-8c6ce8122b27', options=None) >Thread-34::DEBUG::2014-07-10 09:02:45,451::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.9e1aa540-1f4e-4ee3-a152-be381ef6c3bd`ReqID=`fa39006f-f62d-4ad8-9869-44fe9a4a6696`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '3089' at 'getVolumeInfo' >Thread-34::DEBUG::2014-07-10 09:02:45,453::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.9e1aa540-1f4e-4ee3-a152-be381ef6c3bd' for lock type 'shared' >Thread-34::DEBUG::2014-07-10 09:02:45,457::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.9e1aa540-1f4e-4ee3-a152-be381ef6c3bd' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-10 09:02:45,460::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.9e1aa540-1f4e-4ee3-a152-be381ef6c3bd`ReqID=`fa39006f-f62d-4ad8-9869-44fe9a4a6696`::Granted request >Thread-34::DEBUG::2014-07-10 09:02:45,466::task::827::TaskManager.Task::(resourceAcquired) Task=`15dedbed-c0b2-49ef-a22b-8e90a2cecf68`::_resourcesAcquired: Storage.9e1aa540-1f4e-4ee3-a152-be381ef6c3bd (shared) >Thread-34::DEBUG::2014-07-10 09:02:45,468::task::990::TaskManager.Task::(_decref) Task=`15dedbed-c0b2-49ef-a22b-8e90a2cecf68`::ref 1 aborting False >Thread-34::DEBUG::2014-07-10 09:02:45,474::lvm::427::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' got the operation mutex >Thread-34::DEBUG::2014-07-10 09:02:45,486::lvm::296::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm lvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/3600601601282300032826addbbdae311|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,vg_name,attr,size,seg_start_pe,devices,tags 9e1aa540-1f4e-4ee3-a152-be381ef6c3bd' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:02:45,522::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.102634 s, 10.0 MB/s\n'; <rc> = 0 >Thread-34::DEBUG::2014-07-10 09:02:45,710::lvm::296::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-34::DEBUG::2014-07-10 09:02:45,736::lvm::462::Storage.LVM::(_reloadlvs) lvs reloaded >Thread-34::DEBUG::2014-07-10 09:02:45,736::lvm::462::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' released the operation mutex >Thread-34::INFO::2014-07-10 09:02:45,737::volume::879::Storage.Volume::(getInfo) Info request: sdUUID=9e1aa540-1f4e-4ee3-a152-be381ef6c3bd imgUUID=aa20346a-4d3a-4e07-b8e1-52c0ebe4168c volUUID = 58fefce2-9bce-4bff-8949-8c6ce8122b27 >Thread-34::DEBUG::2014-07-10 09:02:45,738::blockVolume::572::Storage.Misc.excCmd::(getMetadata) '/bin/dd iflag=direct skip=10 bs=512 if=/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/metadata count=1' (cwd None) >Thread-34::DEBUG::2014-07-10 09:02:45,768::blockVolume::572::Storage.Misc.excCmd::(getMetadata) SUCCESS: <err> = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.000533722 s, 959 kB/s\n'; <rc> = 0 >Thread-34::DEBUG::2014-07-10 09:02:45,771::misc::282::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.000533722 s, 959 kB/s'], size: 512 >Thread-34::DEBUG::2014-07-10 09:02:45,773::blockVolume::572::Storage.Misc.excCmd::(getMetadata) '/bin/dd iflag=direct skip=10 bs=512 if=/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/metadata count=1' (cwd None) >Thread-34::DEBUG::2014-07-10 09:02:45,788::blockVolume::572::Storage.Misc.excCmd::(getMetadata) SUCCESS: <err> = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.000490856 s, 1.0 MB/s\n'; <rc> = 0 >Thread-34::DEBUG::2014-07-10 09:02:45,789::misc::282::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.000490856 s, 1.0 MB/s'], size: 512 >Thread-34::INFO::2014-07-10 09:02:45,789::volume::909::Storage.Volume::(getInfo) 9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/aa20346a-4d3a-4e07-b8e1-52c0ebe4168c/58fefce2-9bce-4bff-8949-8c6ce8122b27 info is {'status': 'OK', 'domain': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'voltype': 'LEAF', 'description': '', 'parent': '47592965-e853-4e59-9728-d11cca6a7a8a', 'format': 'COW', 'image': 'aa20346a-4d3a-4e07-b8e1-52c0ebe4168c', 'ctime': '1404982963', 'disktype': '2', 'legality': 'LEGAL', 'mtime': '1404982963', 'apparentsize': '1073741824', 'children': [], 'pool': '', 'capacity': '10737418240', 'uuid': '58fefce2-9bce-4bff-8949-8c6ce8122b27', 'truesize': '1073741824', 'type': 'SPARSE'} >Thread-34::INFO::2014-07-10 09:02:45,789::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeInfo, Return response: {'info': {'status': 'OK', 'domain': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'voltype': 'LEAF', 'description': '', 'parent': '47592965-e853-4e59-9728-d11cca6a7a8a', 'format': 'COW', 'image': 'aa20346a-4d3a-4e07-b8e1-52c0ebe4168c', 'ctime': '1404982963', 'disktype': '2', 'legality': 'LEGAL', 'mtime': '1404982963', 'apparentsize': '1073741824', 'children': [], 'pool': '', 'capacity': '10737418240', 'uuid': '58fefce2-9bce-4bff-8949-8c6ce8122b27', 'truesize': '1073741824', 'type': 'SPARSE'}} >Thread-34::DEBUG::2014-07-10 09:02:45,789::task::1185::TaskManager.Task::(prepare) Task=`15dedbed-c0b2-49ef-a22b-8e90a2cecf68`::finished: {'info': {'status': 'OK', 'domain': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'voltype': 'LEAF', 'description': '', 'parent': '47592965-e853-4e59-9728-d11cca6a7a8a', 'format': 'COW', 'image': 'aa20346a-4d3a-4e07-b8e1-52c0ebe4168c', 'ctime': '1404982963', 'disktype': '2', 'legality': 'LEGAL', 'mtime': '1404982963', 'apparentsize': '1073741824', 'children': [], 'pool': '', 'capacity': '10737418240', 'uuid': '58fefce2-9bce-4bff-8949-8c6ce8122b27', 'truesize': '1073741824', 'type': 'SPARSE'}} >Thread-34::DEBUG::2014-07-10 09:02:45,790::task::595::TaskManager.Task::(_updateState) Task=`15dedbed-c0b2-49ef-a22b-8e90a2cecf68`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-10 09:02:45,790::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': < ResourceRef 'Storage.9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-10 09:02:45,790::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-10 09:02:45,791::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.9e1aa540-1f4e-4ee3-a152-be381ef6c3bd' >Thread-34::DEBUG::2014-07-10 09:02:45,791::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.9e1aa540-1f4e-4ee3-a152-be381ef6c3bd' (0 active users) >Thread-34::DEBUG::2014-07-10 09:02:45,791::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.9e1aa540-1f4e-4ee3-a152-be381ef6c3bd' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-10 09:02:45,791::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', Clearing records. >Thread-34::DEBUG::2014-07-10 09:02:45,792::task::990::TaskManager.Task::(_decref) Task=`15dedbed-c0b2-49ef-a22b-8e90a2cecf68`::ref 0 aborting False >Thread-14::DEBUG::2014-07-10 09:02:45,801::task::595::TaskManager.Task::(_updateState) Task=`32680741-deb0-4574-9d94-075359cfd3bc`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 09:02:45,802::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::INFO::2014-07-10 09:02:45,802::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00440884', 'lastCheck': '8.7', 'valid': True}, '6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000489765', 'lastCheck': '1.4', 'valid': True}} >Thread-14::DEBUG::2014-07-10 09:02:45,802::task::1185::TaskManager.Task::(prepare) Task=`32680741-deb0-4574-9d94-075359cfd3bc`::finished: {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00440884', 'lastCheck': '8.7', 'valid': True}, '6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000489765', 'lastCheck': '1.4', 'valid': True}} >Thread-14::DEBUG::2014-07-10 09:02:45,803::task::595::TaskManager.Task::(_updateState) Task=`32680741-deb0-4574-9d94-075359cfd3bc`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 09:02:45,803::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 09:02:45,803::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 09:02:45,803::task::990::TaskManager.Task::(_decref) Task=`32680741-deb0-4574-9d94-075359cfd3bc`::ref 0 aborting False >Thread-14::DEBUG::2014-07-10 09:02:45,818::vm::676::vm.Vm::(_getDiskStats) vmId=`2386fa8c-f537-495c-ae07-e178171d77f2`::Disk hdd stats not available >Thread-14::DEBUG::2014-07-10 09:02:45,818::vm::676::vm.Vm::(_getDiskStats) vmId=`2386fa8c-f537-495c-ae07-e178171d77f2`::Disk hdc stats not available >Thread-14::DEBUG::2014-07-10 09:02:45,818::vm::676::vm.Vm::(_getDiskStats) vmId=`2386fa8c-f537-495c-ae07-e178171d77f2`::Disk vda stats not available >Thread-14::DEBUG::2014-07-10 09:02:45,819::vm::715::vm.Vm::(_getDiskLatency) vmId=`2386fa8c-f537-495c-ae07-e178171d77f2`::Disk hdd latency not available >Thread-14::DEBUG::2014-07-10 09:02:45,819::vm::715::vm.Vm::(_getDiskLatency) vmId=`2386fa8c-f537-495c-ae07-e178171d77f2`::Disk hdc latency not available >Thread-14::DEBUG::2014-07-10 09:02:45,819::vm::715::vm.Vm::(_getDiskLatency) vmId=`2386fa8c-f537-495c-ae07-e178171d77f2`::Disk vda latency not available >Thread-14::DEBUG::2014-07-10 09:02:45,820::vm::676::vm.Vm::(_getDiskStats) vmId=`949f6c19-87b5-4f16-a91c-0049749423ea`::Disk hdd stats not available >Thread-14::DEBUG::2014-07-10 09:02:45,820::vm::676::vm.Vm::(_getDiskStats) vmId=`949f6c19-87b5-4f16-a91c-0049749423ea`::Disk hdc stats not available >Thread-14::DEBUG::2014-07-10 09:02:45,820::vm::676::vm.Vm::(_getDiskStats) vmId=`949f6c19-87b5-4f16-a91c-0049749423ea`::Disk vda stats not available >Thread-14::DEBUG::2014-07-10 09:02:45,820::vm::715::vm.Vm::(_getDiskLatency) vmId=`949f6c19-87b5-4f16-a91c-0049749423ea`::Disk hdd latency not available >Thread-14::DEBUG::2014-07-10 09:02:45,821::vm::715::vm.Vm::(_getDiskLatency) vmId=`949f6c19-87b5-4f16-a91c-0049749423ea`::Disk hdc latency not available >Thread-14::DEBUG::2014-07-10 09:02:45,821::vm::715::vm.Vm::(_getDiskLatency) vmId=`949f6c19-87b5-4f16-a91c-0049749423ea`::Disk vda latency not available >Thread-14::DEBUG::2014-07-10 09:02:45,822::vm::676::vm.Vm::(_getDiskStats) vmId=`0e968db5-5d49-467f-9ff3-afc37b64364f`::Disk hdd stats not available >Thread-14::DEBUG::2014-07-10 09:02:45,823::vm::676::vm.Vm::(_getDiskStats) vmId=`0e968db5-5d49-467f-9ff3-afc37b64364f`::Disk hdc stats not available >Thread-14::DEBUG::2014-07-10 09:02:45,823::vm::676::vm.Vm::(_getDiskStats) vmId=`0e968db5-5d49-467f-9ff3-afc37b64364f`::Disk vda stats not available >Thread-14::DEBUG::2014-07-10 09:02:45,823::vm::715::vm.Vm::(_getDiskLatency) vmId=`0e968db5-5d49-467f-9ff3-afc37b64364f`::Disk hdd latency not available >Thread-14::DEBUG::2014-07-10 09:02:45,823::vm::715::vm.Vm::(_getDiskLatency) vmId=`0e968db5-5d49-467f-9ff3-afc37b64364f`::Disk hdc latency not available >Thread-14::DEBUG::2014-07-10 09:02:45,823::vm::715::vm.Vm::(_getDiskLatency) vmId=`0e968db5-5d49-467f-9ff3-afc37b64364f`::Disk vda latency not available >Thread-13::DEBUG::2014-07-10 09:02:45,831::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-13::DEBUG::2014-07-10 09:02:45,835::task::595::TaskManager.Task::(_updateState) Task=`2d1ca3e4-dceb-43ca-bda0-3a2a1787f0ed`::moving from state init -> state preparing >Thread-13::INFO::2014-07-10 09:02:45,837::logUtils::44::dispatcher::(wrapper) Run and protect: clearTask(taskID='48379855-da89-43ed-8dd4-a4bae06c4219', spUUID=None, options=None) >Thread-13::DEBUG::2014-07-10 09:02:45,838::taskManager::161::TaskManager::(clearTask) Entry. taskID: 48379855-da89-43ed-8dd4-a4bae06c4219 >Thread-13::DEBUG::2014-07-10 09:02:45,848::taskManager::166::TaskManager::(clearTask) Return. >Thread-13::INFO::2014-07-10 09:02:45,849::logUtils::47::dispatcher::(wrapper) Run and protect: clearTask, Return response: None >Thread-13::DEBUG::2014-07-10 09:02:45,850::task::1185::TaskManager.Task::(prepare) Task=`2d1ca3e4-dceb-43ca-bda0-3a2a1787f0ed`::finished: None >Thread-13::DEBUG::2014-07-10 09:02:45,850::task::595::TaskManager.Task::(_updateState) Task=`2d1ca3e4-dceb-43ca-bda0-3a2a1787f0ed`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-07-10 09:02:45,850::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-07-10 09:02:45,850::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-07-10 09:02:45,851::task::990::TaskManager.Task::(_decref) Task=`2d1ca3e4-dceb-43ca-bda0-3a2a1787f0ed`::ref 0 aborting False >Thread-13::DEBUG::2014-07-10 09:02:46,165::BindingXMLRPC::1067::vds::(wrapper) client [10.35.3.13]::call vmCreate with ({'acpiEnable': 'true', 'emulatedMachine': 'rhel6.5.0', 'vmId': '7fc21bb8-bd92-4924-acef-8360998e92a1', 'memGuaranteedSize': 1024, 'spiceSslCipherSuite': 'DEFAULT', 'timeOffset': '0', 'cpuType': 'Conroe', 'custom': {'device_20a1a8b0-f686-4dba-8647-5de01b6ff15bdevice_38aaafa3-edda-4ea4-b5ce-800ec8635184': 'VmDevice {vmId=7fc21bb8-bd92-4924-acef-8360998e92a1, deviceId=38aaafa3-edda-4ea4-b5ce-800ec8635184, device=unix, type=CHANNEL, bootOrder=0, specParams={}, address={port=1, bus=0, controller=0, type=virtio-serial}, managed=false, plugged=true, readOnly=false, deviceAlias=channel0, customProperties={}, snapshotId=null}', 'device_20a1a8b0-f686-4dba-8647-5de01b6ff15bdevice_38aaafa3-edda-4ea4-b5ce-800ec8635184device_4f250a85-285d-45c4-abba-c364d8c041df': 'VmDevice {vmId=7fc21bb8-bd92-4924-acef-8360998e92a1, deviceId=4f250a85-285d-45c4-abba-c364d8c041df, device=unix, type=CHANNEL, bootOrder=0, specParams={}, address={port=2, bus=0, controller=0, type=virtio-serial}, managed=false, plugged=true, readOnly=false, deviceAlias=channel1, customProperties={}, snapshotId=null}', 'device_20a1a8b0-f686-4dba-8647-5de01b6ff15b': 'VmDevice {vmId=7fc21bb8-bd92-4924-acef-8360998e92a1, deviceId=20a1a8b0-f686-4dba-8647-5de01b6ff15b, device=ide, type=CONTROLLER, bootOrder=0, specParams={}, address={bus=0x00, domain=0x0000, type=pci, slot=0x01, function=0x1}, managed=false, plugged=true, readOnly=false, deviceAlias=ide0, customProperties={}, snapshotId=null}', 'device_20a1a8b0-f686-4dba-8647-5de01b6ff15bdevice_38aaafa3-edda-4ea4-b5ce-800ec8635184device_4f250a85-285d-45c4-abba-c364d8c041dfdevice_72aa05f4-2fa4-410a-af10-0425a7fe2262': 'VmDevice {vmId=7fc21bb8-bd92-4924-acef-8360998e92a1, deviceId=72aa05f4-2fa4-410a-af10-0425a7fe2262, device=virtio-serial, type=CONTROLLER, bootOrder=0, specParams={}, address={bus=0x00, domain=0x0000, type=pci, slot=0x05, function=0x0}, managed=false, plugged=true, readOnly=false, deviceAlias=virtio-serial0, customProperties={}, snapshotId=null}', 'device_20a1a8b0-f686-4dba-8647-5de01b6ff15bdevice_38aaafa3-edda-4ea4-b5ce-800ec8635184device_4f250a85-285d-45c4-abba-c364d8c041dfdevice_72aa05f4-2fa4-410a-af10-0425a7fe2262device_f3ef1fb1-7a50-4067-9fad-03fc9aee0661': 'VmDevice {vmId=7fc21bb8-bd92-4924-acef-8360998e92a1, deviceId=f3ef1fb1-7a50-4067-9fad-03fc9aee0661, device=spicevmc, type=CHANNEL, bootOrder=0, specParams={}, address={port=3, bus=0, controller=0, type=virtio-serial}, managed=false, plugged=true, readOnly=false, deviceAlias=channel2, customProperties={}, snapshotId=null}'}, 'smp': '2', 'vmType': 'kvm', 'memSize': 1024, 'smpCoresPerSocket': '2', 'vmName': 'scale_6', 'nice': '0', 'smartcardEnable': 'false', 'keyboardLayout': 'en-us', 'kvmEnable': 'true', 'pitReinjection': 'false', 'transparentHugePages': 'true', 'devices': [{'index': '3', 'iface': 'ide', 'specParams': {'vmPayload': {'volId': 'config-2', 'file': {'openstack/latest/meta_data.json': 'ewogICJsYXVuY2hfaW5kZXgiIDogIjAiLAogICJhdmFpbGFiaWxpdHlfem9uZSIgOiAibm92YSIs\nCiAgInV1aWQiIDogImI3ZGJjN2I1LTYzMWMtNDQ3YS1iY2E0LTMzMzEzYjA2YjZmZiIsCiAgIm1l\ndGEiIDogewogICAgImVzc2VudGlhbCIgOiAiZmFsc2UiLAogICAgInJvbGUiIDogInNlcnZlciIs\nCiAgICAiZHNtb2RlIiA6ICJsb2NhbCIKICB9Cn0=\n', 'openstack/latest/user_data': 'I2Nsb3VkLWNvbmZpZwpzc2hfcHdhdXRoOiB0cnVlCmRpc2FibGVfcm9vdDogMApvdXRwdXQ6CiAg\nYWxsOiAnPj4gL3Zhci9sb2cvY2xvdWQtaW5pdC1vdXRwdXQubG9nJwp1c2VyOiByb290CmNocGFz\nc3dkOgogIGV4cGlyZTogZmFsc2UKcnVuY21kOgotICdzZWQgLWkgJycvXmRhdGFzb3VyY2VfbGlz\ndDogL2QnJyAvZXRjL2Nsb3VkL2Nsb3VkLmNmZzsgZWNobyAnJ2RhdGFzb3VyY2VfbGlzdDoKICBb\nIk5vQ2xvdWQiLCAiQ29uZmlnRHJpdmUiXScnID4+IC9ldGMvY2xvdWQvY2xvdWQuY2ZnJwo=\n'}}}, 'readonly': 'true', 'deviceId': 'b1a3a117-fdf0-4606-b92a-c2c99ddf089c', 'path': '', 'device': 'cdrom', 'shared': 'false', 'type': 'disk'}, {'device': 'qxl', 'specParams': {'vram': '32768', 'ram': '65536', 'heads': '1'}, 'type': 'video', 'deviceId': '62dc1d3f-368d-4610-ac66-808df9ae0f3f'}, {'index': '2', 'iface': 'ide', 'specParams': {'path': ''}, 'readonly': 'true', 'deviceId': '872057c8-702b-42ed-bf26-74836b78edc0', 'path': '', 'device': 'cdrom', 'shared': 'false', 'type': 'disk'}, {'index': 0, 'iface': 'virtio', 'format': 'cow', 'bootOrder': '1', 'poolID': '4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', 'volumeID': '58fefce2-9bce-4bff-8949-8c6ce8122b27', 'imageID': 'aa20346a-4d3a-4e07-b8e1-52c0ebe4168c', 'specParams': {}, 'readonly': 'false', 'domainID': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'optional': 'false', 'deviceId': 'aa20346a-4d3a-4e07-b8e1-52c0ebe4168c', 'address': {'slot': '0x06', 'bus': '0x00', 'domain': '0x0000', 'type': 'pci', 'function': '0x0'}, 'device': 'disk', 'shared': 'false', 'propagateErrors': 'off', 'type': 'disk'}, {'nicModel': 'pv', 'macAddr': '00:1a:4a:de:6d:7d', 'linkActive': 'true', 'network': 'rhevm', 'filter': 'vdsm-no-mac-spoofing', 'specParams': {'inbound': {}, 'outbound': {}}, 'deviceId': '0c0ab911-d156-4b66-b507-d8e5ca85c184', 'device': 'bridge', 'type': 'interface'}, {'device': 'memballoon', 'specParams': {'model': 'virtio'}, 'type': 'balloon', 'deviceId': 'cfc59d25-e03b-4291-8a6f-11aab3b98731'}, {'index': '0', 'specParams': {}, 'deviceId': '75e8dc1e-a94b-4631-96cf-ee897e77d3b0', 'address': {'slot': '0x04', 'bus': '0x00', 'domain': '0x0000', 'type': 'pci', 'function': '0x0'}, 'device': 'scsi', 'model': 'virtio-scsi', 'type': 'controller'}], 'maxVCpus': '160', 'spiceSecureChannels': 'smain,sinputs,scursor,splayback,srecord,sdisplay,susbredir,ssmartcard', 'display': 'qxl'},) {} flowID [5da15e09] >Thread-13::INFO::2014-07-10 09:02:46,169::API::667::vds::(_getNetworkIp) network None: using 0 >Thread-13::INFO::2014-07-10 09:02:46,169::clientIF::366::vds::(createVm) vmContainerLock acquired by vm 7fc21bb8-bd92-4924-acef-8360998e92a1 >Thread-62::DEBUG::2014-07-10 09:02:46,175::vm::2270::vm.Vm::(_startUnderlyingVm) vmId=`7fc21bb8-bd92-4924-acef-8360998e92a1`::Start >Thread-13::DEBUG::2014-07-10 09:02:46,175::clientIF::379::vds::(createVm) Total desktops after creation of 7fc21bb8-bd92-4924-acef-8360998e92a1 is 6 >Thread-62::DEBUG::2014-07-10 09:02:46,178::vm::2274::vm.Vm::(_startUnderlyingVm) vmId=`7fc21bb8-bd92-4924-acef-8360998e92a1`::_ongoingCreations acquired >Thread-13::DEBUG::2014-07-10 09:02:46,178::BindingXMLRPC::1074::vds::(wrapper) return vmCreate with {'status': {'message': 'Done', 'code': 0}, 'vmList': {'status': 'WaitForLaunch', 'acpiEnable': 'true', 'emulatedMachine': 'rhel6.5.0', 'vmId': '7fc21bb8-bd92-4924-acef-8360998e92a1', 'pid': '0', 'memGuaranteedSize': 1024, 'timeOffset': '0', 'keyboardLayout': 'en-us', 'displayPort': '-1', 'displaySecurePort': '-1', 'spiceSslCipherSuite': 'DEFAULT', 'cpuType': 'Conroe', 'smp': '2', 'clientIp': '', 'nicModel': 'rtl8139,pv', 'smartcardEnable': 'false', 'kvmEnable': 'true', 'pitReinjection': 'false', 'transparentHugePages': 'true', 'devices': [{'index': '3', 'iface': 'ide', 'specParams': {'vmPayload': {'volId': 'config-2', 'file': {'openstack/latest/meta_data.json': 'ewogICJsYXVuY2hfaW5kZXgiIDogIjAiLAogICJhdmFpbGFiaWxpdHlfem9uZSIgOiAibm92YSIs\nCiAgInV1aWQiIDogImI3ZGJjN2I1LTYzMWMtNDQ3YS1iY2E0LTMzMzEzYjA2YjZmZiIsCiAgIm1l\ndGEiIDogewogICAgImVzc2VudGlhbCIgOiAiZmFsc2UiLAogICAgInJvbGUiIDogInNlcnZlciIs\nCiAgICAiZHNtb2RlIiA6ICJsb2NhbCIKICB9Cn0=\n', 'openstack/latest/user_data': 'I2Nsb3VkLWNvbmZpZwpzc2hfcHdhdXRoOiB0cnVlCmRpc2FibGVfcm9vdDogMApvdXRwdXQ6CiAg\nYWxsOiAnPj4gL3Zhci9sb2cvY2xvdWQtaW5pdC1vdXRwdXQubG9nJwp1c2VyOiByb290CmNocGFz\nc3dkOgogIGV4cGlyZTogZmFsc2UKcnVuY21kOgotICdzZWQgLWkgJycvXmRhdGFzb3VyY2VfbGlz\ndDogL2QnJyAvZXRjL2Nsb3VkL2Nsb3VkLmNmZzsgZWNobyAnJ2RhdGFzb3VyY2VfbGlzdDoKICBb\nIk5vQ2xvdWQiLCAiQ29uZmlnRHJpdmUiXScnID4+IC9ldGMvY2xvdWQvY2xvdWQuY2ZnJwo=\n'}}}, 'readonly': 'true', 'deviceId': 'b1a3a117-fdf0-4606-b92a-c2c99ddf089c', 'path': '', 'device': 'cdrom', 'shared': 'false', 'type': 'disk'}, {'device': 'qxl', 'specParams': {'vram': '32768', 'ram': '65536', 'heads': '1'}, 'type': 'video', 'deviceId': '62dc1d3f-368d-4610-ac66-808df9ae0f3f'}, {'index': '2', 'iface': 'ide', 'specParams': {'path': ''}, 'readonly': 'true', 'deviceId': '872057c8-702b-42ed-bf26-74836b78edc0', 'path': '', 'device': 'cdrom', 'shared': 'false', 'type': 'disk'}, {'index': 0, 'iface': 'virtio', 'format': 'cow', 'bootOrder': '1', 'poolID': '4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', 'volumeID': '58fefce2-9bce-4bff-8949-8c6ce8122b27', 'imageID': 'aa20346a-4d3a-4e07-b8e1-52c0ebe4168c', 'specParams': {}, 'readonly': 'false', 'domainID': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'optional': 'false', 'deviceId': 'aa20346a-4d3a-4e07-b8e1-52c0ebe4168c', 'address': {'slot': '0x06', 'bus': '0x00', 'domain': '0x0000', 'type': 'pci', 'function': '0x0'}, 'device': 'disk', 'shared': 'false', 'propagateErrors': 'off', 'type': 'disk'}, {'nicModel': 'pv', 'macAddr': '00:1a:4a:de:6d:7d', 'linkActive': 'true', 'network': 'rhevm', 'filter': 'vdsm-no-mac-spoofing', 'specParams': {'inbound': {}, 'outbound': {}}, 'deviceId': '0c0ab911-d156-4b66-b507-d8e5ca85c184', 'device': 'bridge', 'type': 'interface'}, {'device': 'memballoon', 'specParams': {'model': 'virtio'}, 'type': 'balloon', 'deviceId': 'cfc59d25-e03b-4291-8a6f-11aab3b98731'}, {'index': '0', 'specParams': {}, 'deviceId': '75e8dc1e-a94b-4631-96cf-ee897e77d3b0', 'address': {'slot': '0x04', 'bus': '0x00', 'domain': '0x0000', 'type': 'pci', 'function': '0x0'}, 'device': 'scsi', 'model': 'virtio-scsi', 'type': 'controller'}], 'custom': {'device_20a1a8b0-f686-4dba-8647-5de01b6ff15bdevice_38aaafa3-edda-4ea4-b5ce-800ec8635184': 'VmDevice {vmId=7fc21bb8-bd92-4924-acef-8360998e92a1, deviceId=38aaafa3-edda-4ea4-b5ce-800ec8635184, device=unix, type=CHANNEL, bootOrder=0, specParams={}, address={port=1, bus=0, controller=0, type=virtio-serial}, managed=false, plugged=true, readOnly=false, deviceAlias=channel0, customProperties={}, snapshotId=null}', 'device_20a1a8b0-f686-4dba-8647-5de01b6ff15bdevice_38aaafa3-edda-4ea4-b5ce-800ec8635184device_4f250a85-285d-45c4-abba-c364d8c041df': 'VmDevice {vmId=7fc21bb8-bd92-4924-acef-8360998e92a1, deviceId=4f250a85-285d-45c4-abba-c364d8c041df, device=unix, type=CHANNEL, bootOrder=0, specParams={}, address={port=2, bus=0, controller=0, type=virtio-serial}, managed=false, plugged=true, readOnly=false, deviceAlias=channel1, customProperties={}, snapshotId=null}', 'device_20a1a8b0-f686-4dba-8647-5de01b6ff15b': 'VmDevice {vmId=7fc21bb8-bd92-4924-acef-8360998e92a1, deviceId=20a1a8b0-f686-4dba-8647-5de01b6ff15b, device=ide, type=CONTROLLER, bootOrder=0, specParams={}, address={bus=0x00, domain=0x0000, type=pci, slot=0x01, function=0x1}, managed=false, plugged=true, readOnly=false, deviceAlias=ide0, customProperties={}, snapshotId=null}', 'device_20a1a8b0-f686-4dba-8647-5de01b6ff15bdevice_38aaafa3-edda-4ea4-b5ce-800ec8635184device_4f250a85-285d-45c4-abba-c364d8c041dfdevice_72aa05f4-2fa4-410a-af10-0425a7fe2262': 'VmDevice {vmId=7fc21bb8-bd92-4924-acef-8360998e92a1, deviceId=72aa05f4-2fa4-410a-af10-0425a7fe2262, device=virtio-serial, type=CONTROLLER, bootOrder=0, specParams={}, address={bus=0x00, domain=0x0000, type=pci, slot=0x05, function=0x0}, managed=false, plugged=true, readOnly=false, deviceAlias=virtio-serial0, customProperties={}, snapshotId=null}', 'device_20a1a8b0-f686-4dba-8647-5de01b6ff15bdevice_38aaafa3-edda-4ea4-b5ce-800ec8635184device_4f250a85-285d-45c4-abba-c364d8c041dfdevice_72aa05f4-2fa4-410a-af10-0425a7fe2262device_f3ef1fb1-7a50-4067-9fad-03fc9aee0661': 'VmDevice {vmId=7fc21bb8-bd92-4924-acef-8360998e92a1, deviceId=f3ef1fb1-7a50-4067-9fad-03fc9aee0661, device=spicevmc, type=CHANNEL, bootOrder=0, specParams={}, address={port=3, bus=0, controller=0, type=virtio-serial}, managed=false, plugged=true, readOnly=false, deviceAlias=channel2, customProperties={}, snapshotId=null}'}, 'vmType': 'kvm', 'memSize': 1024, 'displayIp': '0', 'maxVCpus': '160', 'spiceSecureChannels': 'smain,sinputs,scursor,splayback,srecord,sdisplay,susbredir,ssmartcard', 'smpCoresPerSocket': '2', 'vmName': 'scale_6', 'display': 'qxl', 'nice': '0'}} >Thread-62::INFO::2014-07-10 09:02:46,181::vm::3151::vm.Vm::(_run) vmId=`7fc21bb8-bd92-4924-acef-8360998e92a1`::VM wrapper has started >Thread-62::DEBUG::2014-07-10 09:02:46,186::task::595::TaskManager.Task::(_updateState) Task=`1c353c79-e843-4d59-9fdb-29b23d6df376`::moving from state init -> state preparing >Thread-62::INFO::2014-07-10 09:02:46,189::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='aa20346a-4d3a-4e07-b8e1-52c0ebe4168c', volUUID='58fefce2-9bce-4bff-8949-8c6ce8122b27', options=None) >Thread-62::INFO::2014-07-10 09:02:46,193::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-62::DEBUG::2014-07-10 09:02:46,195::task::1185::TaskManager.Task::(prepare) Task=`1c353c79-e843-4d59-9fdb-29b23d6df376`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-62::DEBUG::2014-07-10 09:02:46,195::task::595::TaskManager.Task::(_updateState) Task=`1c353c79-e843-4d59-9fdb-29b23d6df376`::moving from state preparing -> state finished >Thread-62::DEBUG::2014-07-10 09:02:46,197::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-62::DEBUG::2014-07-10 09:02:46,199::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-62::DEBUG::2014-07-10 09:02:46,201::task::990::TaskManager.Task::(_decref) Task=`1c353c79-e843-4d59-9fdb-29b23d6df376`::ref 0 aborting False >Thread-62::INFO::2014-07-10 09:02:46,264::clientIF::324::vds::(prepareVolumePath) prepared volume path: /var/run/vdsm/payload/7fc21bb8-bd92-4924-acef-8360998e92a1.b57ec2f5df19bc658959a6d6d7be8e33.img >Thread-62::INFO::2014-07-10 09:02:46,266::clientIF::324::vds::(prepareVolumePath) prepared volume path: >Thread-62::DEBUG::2014-07-10 09:02:46,267::task::595::TaskManager.Task::(_updateState) Task=`ccbdd949-63b8-4d85-af3f-b96ae7e0f85f`::moving from state init -> state preparing >Thread-62::INFO::2014-07-10 09:02:46,267::logUtils::44::dispatcher::(wrapper) Run and protect: prepareImage(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='aa20346a-4d3a-4e07-b8e1-52c0ebe4168c', leafUUID='58fefce2-9bce-4bff-8949-8c6ce8122b27') >Thread-62::DEBUG::2014-07-10 09:02:46,268::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.9e1aa540-1f4e-4ee3-a152-be381ef6c3bd`ReqID=`2a691a36-214b-4cd9-b248-dfd689219ad9`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '3248' at 'prepareImage' >Thread-62::DEBUG::2014-07-10 09:02:46,268::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.9e1aa540-1f4e-4ee3-a152-be381ef6c3bd' for lock type 'shared' >Thread-62::DEBUG::2014-07-10 09:02:46,268::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.9e1aa540-1f4e-4ee3-a152-be381ef6c3bd' is free. Now locking as 'shared' (1 active user) >Thread-62::DEBUG::2014-07-10 09:02:46,268::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.9e1aa540-1f4e-4ee3-a152-be381ef6c3bd`ReqID=`2a691a36-214b-4cd9-b248-dfd689219ad9`::Granted request >Thread-62::DEBUG::2014-07-10 09:02:46,270::task::827::TaskManager.Task::(resourceAcquired) Task=`ccbdd949-63b8-4d85-af3f-b96ae7e0f85f`::_resourcesAcquired: Storage.9e1aa540-1f4e-4ee3-a152-be381ef6c3bd (shared) >Thread-62::DEBUG::2014-07-10 09:02:46,270::task::990::TaskManager.Task::(_decref) Task=`ccbdd949-63b8-4d85-af3f-b96ae7e0f85f`::ref 1 aborting False >Thread-62::DEBUG::2014-07-10 09:02:46,271::lvm::427::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' got the operation mutex >Thread-62::DEBUG::2014-07-10 09:02:46,272::lvm::296::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm lvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/3600601601282300032826addbbdae311|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,vg_name,attr,size,seg_start_pe,devices,tags 9e1aa540-1f4e-4ee3-a152-be381ef6c3bd' (cwd None) >Thread-62::DEBUG::2014-07-10 09:02:46,477::lvm::296::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-62::DEBUG::2014-07-10 09:02:46,489::lvm::462::Storage.LVM::(_reloadlvs) lvs reloaded >Thread-62::DEBUG::2014-07-10 09:02:46,490::lvm::462::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' released the operation mutex >Thread-62::DEBUG::2014-07-10 09:02:46,491::lvm::296::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm lvchange --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/3600601601282300032826addbbdae311|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } " --autobackup n --available y 9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/58fefce2-9bce-4bff-8949-8c6ce8122b27' (cwd None) >Thread-62::DEBUG::2014-07-10 09:02:47,013::lvm::296::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-62::DEBUG::2014-07-10 09:02:47,014::lvm::513::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-62::DEBUG::2014-07-10 09:02:47,014::lvm::525::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-62::DEBUG::2014-07-10 09:02:47,015::blockSD::1057::Storage.StorageDomain::(linkBCImage) path to image directory already exists: /rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/images/aa20346a-4d3a-4e07-b8e1-52c0ebe4168c >Thread-62::DEBUG::2014-07-10 09:02:47,016::lvm::427::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' got the operation mutex >Thread-62::DEBUG::2014-07-10 09:02:47,016::lvm::296::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm lvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/3600601601282300032826addbbdae311|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,vg_name,attr,size,seg_start_pe,devices,tags 9e1aa540-1f4e-4ee3-a152-be381ef6c3bd' (cwd None) >Thread-18::DEBUG::2014-07-10 09:02:47,116::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/metadata bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-10 09:02:47,130::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000714876 s, 5.7 MB/s\n'; <rc> = 0 >Thread-62::DEBUG::2014-07-10 09:02:47,212::lvm::296::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-62::DEBUG::2014-07-10 09:02:47,227::lvm::462::Storage.LVM::(_reloadlvs) lvs reloaded >Thread-62::DEBUG::2014-07-10 09:02:47,228::lvm::462::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' released the operation mutex >Thread-62::INFO::2014-07-10 09:02:47,229::logUtils::47::dispatcher::(wrapper) Run and protect: prepareImage, Return response: {'info': {'domainID': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'volType': 'path', 'leaseOffset': 115343360, 'path': '/rhev/data-center/mnt/blockSD/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/images/aa20346a-4d3a-4e07-b8e1-52c0ebe4168c/58fefce2-9bce-4bff-8949-8c6ce8122b27', 'volumeID': '58fefce2-9bce-4bff-8949-8c6ce8122b27', 'leasePath': '/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/leases', 'imageID': 'aa20346a-4d3a-4e07-b8e1-52c0ebe4168c'}, 'path': '/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/images/aa20346a-4d3a-4e07-b8e1-52c0ebe4168c/58fefce2-9bce-4bff-8949-8c6ce8122b27', 'imgVolumesInfo': [{'domainID': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'volType': 'path', 'leaseOffset': 115343360, 'path': '/rhev/data-center/mnt/blockSD/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/images/aa20346a-4d3a-4e07-b8e1-52c0ebe4168c/58fefce2-9bce-4bff-8949-8c6ce8122b27', 'volumeID': '58fefce2-9bce-4bff-8949-8c6ce8122b27', 'leasePath': '/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/leases', 'imageID': 'aa20346a-4d3a-4e07-b8e1-52c0ebe4168c'}, {'domainID': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'volType': 'path', 'leaseOffset': 109051904, 'path': '/rhev/data-center/mnt/blockSD/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/images/aa20346a-4d3a-4e07-b8e1-52c0ebe4168c/47592965-e853-4e59-9728-d11cca6a7a8a', 'volumeID': '47592965-e853-4e59-9728-d11cca6a7a8a', 'leasePath': '/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/leases', 'imageID': 'aa20346a-4d3a-4e07-b8e1-52c0ebe4168c'}]} >Thread-62::DEBUG::2014-07-10 09:02:47,229::task::1185::TaskManager.Task::(prepare) Task=`ccbdd949-63b8-4d85-af3f-b96ae7e0f85f`::finished: {'info': {'domainID': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'volType': 'path', 'leaseOffset': 115343360, 'path': '/rhev/data-center/mnt/blockSD/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/images/aa20346a-4d3a-4e07-b8e1-52c0ebe4168c/58fefce2-9bce-4bff-8949-8c6ce8122b27', 'volumeID': '58fefce2-9bce-4bff-8949-8c6ce8122b27', 'leasePath': '/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/leases', 'imageID': 'aa20346a-4d3a-4e07-b8e1-52c0ebe4168c'}, 'path': '/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/images/aa20346a-4d3a-4e07-b8e1-52c0ebe4168c/58fefce2-9bce-4bff-8949-8c6ce8122b27', 'imgVolumesInfo': [{'domainID': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'volType': 'path', 'leaseOffset': 115343360, 'path': '/rhev/data-center/mnt/blockSD/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/images/aa20346a-4d3a-4e07-b8e1-52c0ebe4168c/58fefce2-9bce-4bff-8949-8c6ce8122b27', 'volumeID': '58fefce2-9bce-4bff-8949-8c6ce8122b27', 'leasePath': '/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/leases', 'imageID': 'aa20346a-4d3a-4e07-b8e1-52c0ebe4168c'}, {'domainID': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'volType': 'path', 'leaseOffset': 109051904, 'path': '/rhev/data-center/mnt/blockSD/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/images/aa20346a-4d3a-4e07-b8e1-52c0ebe4168c/47592965-e853-4e59-9728-d11cca6a7a8a', 'volumeID': '47592965-e853-4e59-9728-d11cca6a7a8a', 'leasePath': '/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/leases', 'imageID': 'aa20346a-4d3a-4e07-b8e1-52c0ebe4168c'}]} >Thread-62::DEBUG::2014-07-10 09:02:47,229::task::595::TaskManager.Task::(_updateState) Task=`ccbdd949-63b8-4d85-af3f-b96ae7e0f85f`::moving from state preparing -> state finished >Thread-62::DEBUG::2014-07-10 09:02:47,230::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': < ResourceRef 'Storage.9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', isValid: 'True' obj: 'None'>} >Thread-62::DEBUG::2014-07-10 09:02:47,230::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-62::DEBUG::2014-07-10 09:02:47,230::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.9e1aa540-1f4e-4ee3-a152-be381ef6c3bd' >Thread-62::DEBUG::2014-07-10 09:02:47,231::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.9e1aa540-1f4e-4ee3-a152-be381ef6c3bd' (0 active users) >Thread-62::DEBUG::2014-07-10 09:02:47,231::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.9e1aa540-1f4e-4ee3-a152-be381ef6c3bd' is free, finding out if anyone is waiting for it. >Thread-62::DEBUG::2014-07-10 09:02:47,231::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', Clearing records. >Thread-62::DEBUG::2014-07-10 09:02:47,231::task::990::TaskManager.Task::(_decref) Task=`ccbdd949-63b8-4d85-af3f-b96ae7e0f85f`::ref 0 aborting False >Thread-62::INFO::2014-07-10 09:02:47,232::clientIF::324::vds::(prepareVolumePath) prepared volume path: /rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/images/aa20346a-4d3a-4e07-b8e1-52c0ebe4168c/58fefce2-9bce-4bff-8949-8c6ce8122b27 >Thread-62::DEBUG::2014-07-10 09:02:47,254::utils::642::root::(execCmd) '/usr/libexec/vdsm/hooks/before_vm_start/50_vhostmd' (cwd None) >Thread-62::DEBUG::2014-07-10 09:02:47,375::utils::662::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-62::INFO::2014-07-10 09:02:47,376::hooks::100::root::(_runHooksDir) >Thread-62::DEBUG::2014-07-10 09:02:47,377::vm::3190::vm.Vm::(_run) vmId=`7fc21bb8-bd92-4924-acef-8360998e92a1`::<?xml version="1.0" encoding="utf-8"?> ><domain type="kvm"> > <name>scale_6</name> > <uuid>7fc21bb8-bd92-4924-acef-8360998e92a1</uuid> > <memory>1048576</memory> > <currentMemory>1048576</currentMemory> > <vcpu current="2">160</vcpu> > <memtune> > <min_guarantee>1048576</min_guarantee> > </memtune> > <devices> > <channel type="unix"> > <target name="com.redhat.rhevm.vdsm" type="virtio"/> > <source mode="bind" path="/var/lib/libvirt/qemu/channels/7fc21bb8-bd92-4924-acef-8360998e92a1.com.redhat.rhevm.vdsm"/> > </channel> > <channel type="unix"> > <target name="org.qemu.guest_agent.0" type="virtio"/> > <source mode="bind" path="/var/lib/libvirt/qemu/channels/7fc21bb8-bd92-4924-acef-8360998e92a1.org.qemu.guest_agent.0"/> > </channel> > <input bus="ps2" type="mouse"/> > <channel type="spicevmc"> > <target name="com.redhat.spice.0" type="virtio"/> > </channel> > <graphics autoport="yes" keymap="en-us" listen="0" passwd="*****" passwdValidTo="1970-01-01T00:00:01" port="-1" tlsPort="-1" type="spice"> > <channel mode="secure" name="main"/> > <channel mode="secure" name="inputs"/> > <channel mode="secure" name="cursor"/> > <channel mode="secure" name="playback"/> > <channel mode="secure" name="record"/> > <channel mode="secure" name="display"/> > <channel mode="secure" name="usbredir"/> > <channel mode="secure" name="smartcard"/> > </graphics> > <memballoon model="virtio"/> > <controller index="0" model="virtio-scsi" type="scsi"> > <address bus="0x00" domain="0x0000" function="0x0" slot="0x04" type="pci"/> > </controller> > <video> > <model heads="1" ram="65536" type="qxl" vram="32768"/> > </video> > <interface type="bridge"> > <mac address="00:1a:4a:de:6d:7d"/> > <model type="virtio"/> > <source bridge="rhevm"/> > <filterref filter="vdsm-no-mac-spoofing"/> > <link state="up"/> > <bandwidth/> > </interface> > <disk device="cdrom" snapshot="no" type="file"> > <source file="/var/run/vdsm/payload/7fc21bb8-bd92-4924-acef-8360998e92a1.b57ec2f5df19bc658959a6d6d7be8e33.img" startupPolicy="optional"/> > <target bus="ide" dev="hdd"/> > <readonly/> > <serial/> > </disk> > <disk device="cdrom" snapshot="no" type="file"> > <source file="" startupPolicy="optional"/> > <target bus="ide" dev="hdc"/> > <readonly/> > <serial/> > </disk> > <disk device="disk" snapshot="no" type="block"> > <address bus="0x00" domain="0x0000" function="0x0" slot="0x06" type="pci"/> > <source dev="/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/images/aa20346a-4d3a-4e07-b8e1-52c0ebe4168c/58fefce2-9bce-4bff-8949-8c6ce8122b27"/> > <target bus="virtio" dev="vda"/> > <serial>aa20346a-4d3a-4e07-b8e1-52c0ebe4168c</serial> > <boot order="1"/> > <driver cache="none" error_policy="stop" io="native" name="qemu" type="qcow2"/> > </disk> > </devices> > <os> > <type arch="x86_64" machine="rhel6.5.0">hvm</type> > <smbios mode="sysinfo"/> > </os> > <sysinfo type="smbios"> > <system> > <entry name="manufacturer">Red Hat</entry> > <entry name="product">RHEV Hypervisor</entry> > <entry name="version">6.5-20140707.0.el6ev</entry> > <entry name="serial">52BAF97B-FF2F-E311-0000-100000000005</entry> > <entry name="uuid">7fc21bb8-bd92-4924-acef-8360998e92a1</entry> > </system> > </sysinfo> > <clock adjustment="0" offset="variable"> > <timer name="rtc" tickpolicy="catchup"/> > </clock> > <features> > <acpi/> > </features> > <cpu match="exact"> > <model>Conroe</model> > <topology cores="2" sockets="80" threads="1"/> > </cpu> ></domain> > >Dummy-33::DEBUG::2014-07-10 09:02:47,538::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:02:47,668::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0564536 s, 18.1 MB/s\n'; <rc> = 0 >GuestMonitor-scale_5::DEBUG::2014-07-10 09:02:47,900::vm::676::vm.Vm::(_getDiskStats) vmId=`2386fa8c-f537-495c-ae07-e178171d77f2`::Disk hdd stats not available >GuestMonitor-scale_5::DEBUG::2014-07-10 09:02:47,903::vm::676::vm.Vm::(_getDiskStats) vmId=`2386fa8c-f537-495c-ae07-e178171d77f2`::Disk hdc stats not available >GuestMonitor-scale_5::DEBUG::2014-07-10 09:02:47,903::vm::676::vm.Vm::(_getDiskStats) vmId=`2386fa8c-f537-495c-ae07-e178171d77f2`::Disk vda stats not available >GuestMonitor-scale_5::DEBUG::2014-07-10 09:02:47,903::vm::715::vm.Vm::(_getDiskLatency) vmId=`2386fa8c-f537-495c-ae07-e178171d77f2`::Disk hdd latency not available >GuestMonitor-scale_5::DEBUG::2014-07-10 09:02:47,903::vm::715::vm.Vm::(_getDiskLatency) vmId=`2386fa8c-f537-495c-ae07-e178171d77f2`::Disk hdc latency not available >GuestMonitor-scale_5::DEBUG::2014-07-10 09:02:47,904::vm::715::vm.Vm::(_getDiskLatency) vmId=`2386fa8c-f537-495c-ae07-e178171d77f2`::Disk vda latency not available >GuestMonitor-scale_5::DEBUG::2014-07-10 09:02:47,905::vm::676::vm.Vm::(_getDiskStats) vmId=`2386fa8c-f537-495c-ae07-e178171d77f2`::Disk hdd stats not available >GuestMonitor-scale_5::DEBUG::2014-07-10 09:02:47,905::vm::676::vm.Vm::(_getDiskStats) vmId=`2386fa8c-f537-495c-ae07-e178171d77f2`::Disk hdc stats not available >GuestMonitor-scale_5::DEBUG::2014-07-10 09:02:47,905::vm::676::vm.Vm::(_getDiskStats) vmId=`2386fa8c-f537-495c-ae07-e178171d77f2`::Disk vda stats not available >GuestMonitor-scale_5::DEBUG::2014-07-10 09:02:47,906::vm::715::vm.Vm::(_getDiskLatency) vmId=`2386fa8c-f537-495c-ae07-e178171d77f2`::Disk hdd latency not available >GuestMonitor-scale_5::DEBUG::2014-07-10 09:02:47,906::vm::715::vm.Vm::(_getDiskLatency) vmId=`2386fa8c-f537-495c-ae07-e178171d77f2`::Disk hdc latency not available >GuestMonitor-scale_5::DEBUG::2014-07-10 09:02:47,906::vm::715::vm.Vm::(_getDiskLatency) vmId=`2386fa8c-f537-495c-ae07-e178171d77f2`::Disk vda latency not available >GuestMonitor-scale_4::DEBUG::2014-07-10 09:02:47,981::vm::676::vm.Vm::(_getDiskStats) vmId=`0e968db5-5d49-467f-9ff3-afc37b64364f`::Disk hdd stats not available >GuestMonitor-scale_4::DEBUG::2014-07-10 09:02:47,981::vm::676::vm.Vm::(_getDiskStats) vmId=`0e968db5-5d49-467f-9ff3-afc37b64364f`::Disk hdc stats not available >GuestMonitor-scale_4::DEBUG::2014-07-10 09:02:47,982::vm::676::vm.Vm::(_getDiskStats) vmId=`0e968db5-5d49-467f-9ff3-afc37b64364f`::Disk vda stats not available >GuestMonitor-scale_4::DEBUG::2014-07-10 09:02:47,982::vm::715::vm.Vm::(_getDiskLatency) vmId=`0e968db5-5d49-467f-9ff3-afc37b64364f`::Disk hdd latency not available >GuestMonitor-scale_4::DEBUG::2014-07-10 09:02:47,982::vm::715::vm.Vm::(_getDiskLatency) vmId=`0e968db5-5d49-467f-9ff3-afc37b64364f`::Disk hdc latency not available >GuestMonitor-scale_4::DEBUG::2014-07-10 09:02:47,982::vm::715::vm.Vm::(_getDiskLatency) vmId=`0e968db5-5d49-467f-9ff3-afc37b64364f`::Disk vda latency not available >GuestMonitor-scale_4::DEBUG::2014-07-10 09:02:47,983::vm::676::vm.Vm::(_getDiskStats) vmId=`0e968db5-5d49-467f-9ff3-afc37b64364f`::Disk hdd stats not available >GuestMonitor-scale_4::DEBUG::2014-07-10 09:02:47,983::vm::676::vm.Vm::(_getDiskStats) vmId=`0e968db5-5d49-467f-9ff3-afc37b64364f`::Disk hdc stats not available >GuestMonitor-scale_4::DEBUG::2014-07-10 09:02:47,983::vm::676::vm.Vm::(_getDiskStats) vmId=`0e968db5-5d49-467f-9ff3-afc37b64364f`::Disk vda stats not available >GuestMonitor-scale_4::DEBUG::2014-07-10 09:02:47,983::vm::715::vm.Vm::(_getDiskLatency) vmId=`0e968db5-5d49-467f-9ff3-afc37b64364f`::Disk hdd latency not available >GuestMonitor-scale_4::DEBUG::2014-07-10 09:02:47,984::vm::715::vm.Vm::(_getDiskLatency) vmId=`0e968db5-5d49-467f-9ff3-afc37b64364f`::Disk hdc latency not available >GuestMonitor-scale_4::DEBUG::2014-07-10 09:02:47,984::vm::715::vm.Vm::(_getDiskLatency) vmId=`0e968db5-5d49-467f-9ff3-afc37b64364f`::Disk vda latency not available >GuestMonitor-scale_3::DEBUG::2014-07-10 09:02:48,255::vm::676::vm.Vm::(_getDiskStats) vmId=`949f6c19-87b5-4f16-a91c-0049749423ea`::Disk hdd stats not available >GuestMonitor-scale_3::DEBUG::2014-07-10 09:02:48,256::vm::676::vm.Vm::(_getDiskStats) vmId=`949f6c19-87b5-4f16-a91c-0049749423ea`::Disk hdc stats not available >GuestMonitor-scale_3::DEBUG::2014-07-10 09:02:48,256::vm::676::vm.Vm::(_getDiskStats) vmId=`949f6c19-87b5-4f16-a91c-0049749423ea`::Disk vda stats not available >GuestMonitor-scale_3::DEBUG::2014-07-10 09:02:48,256::vm::715::vm.Vm::(_getDiskLatency) vmId=`949f6c19-87b5-4f16-a91c-0049749423ea`::Disk hdd latency not available >GuestMonitor-scale_3::DEBUG::2014-07-10 09:02:48,256::vm::715::vm.Vm::(_getDiskLatency) vmId=`949f6c19-87b5-4f16-a91c-0049749423ea`::Disk hdc latency not available >GuestMonitor-scale_3::DEBUG::2014-07-10 09:02:48,257::vm::715::vm.Vm::(_getDiskLatency) vmId=`949f6c19-87b5-4f16-a91c-0049749423ea`::Disk vda latency not available >GuestMonitor-scale_3::DEBUG::2014-07-10 09:02:48,257::vm::676::vm.Vm::(_getDiskStats) vmId=`949f6c19-87b5-4f16-a91c-0049749423ea`::Disk hdd stats not available >GuestMonitor-scale_3::DEBUG::2014-07-10 09:02:48,257::vm::676::vm.Vm::(_getDiskStats) vmId=`949f6c19-87b5-4f16-a91c-0049749423ea`::Disk hdc stats not available >GuestMonitor-scale_3::DEBUG::2014-07-10 09:02:48,257::vm::676::vm.Vm::(_getDiskStats) vmId=`949f6c19-87b5-4f16-a91c-0049749423ea`::Disk vda stats not available >GuestMonitor-scale_3::DEBUG::2014-07-10 09:02:48,258::vm::715::vm.Vm::(_getDiskLatency) vmId=`949f6c19-87b5-4f16-a91c-0049749423ea`::Disk hdd latency not available >GuestMonitor-scale_3::DEBUG::2014-07-10 09:02:48,258::vm::715::vm.Vm::(_getDiskLatency) vmId=`949f6c19-87b5-4f16-a91c-0049749423ea`::Disk hdc latency not available >GuestMonitor-scale_3::DEBUG::2014-07-10 09:02:48,258::vm::715::vm.Vm::(_getDiskLatency) vmId=`949f6c19-87b5-4f16-a91c-0049749423ea`::Disk vda latency not available >libvirtEventLoop::DEBUG::2014-07-10 09:02:48,346::vm::5176::vm.Vm::(_onLibvirtLifecycleEvent) vmId=`7fc21bb8-bd92-4924-acef-8360998e92a1`::event Started detail 0 opaque None >Thread-62::DEBUG::2014-07-10 09:02:48,377::vm::5032::vm.Vm::(_getUnderlyingDriveInfo) vmId=`7fc21bb8-bd92-4924-acef-8360998e92a1`::Looking for drive with attributes {'name': u'hdc', 'bootOrder': '', 'boot': [], 'readonly': True, 'address': {u'bus': u'1', u'controller': u'0', u'type': u'drive', u'target': u'0', u'unit': u'0'}, 'path': '', 'type': u'cdrom'} >Thread-62::DEBUG::2014-07-10 09:02:48,379::vm::5053::vm.Vm::(_getUnderlyingDriveInfo) vmId=`7fc21bb8-bd92-4924-acef-8360998e92a1`::Matched {'name': (u'hdc', u'hdc'), 'bootOrder': ('', None), 'boot': ([], None), 'readonly': (True, True), 'address': ({u'bus': u'1', u'controller': u'0', u'type': u'drive', u'target': u'0', u'unit': u'0'}, {u'bus': u'1', u'controller': u'0', u'type': u'drive', u'target': u'0', u'unit': u'0'}), 'path': ('', ''), 'type': (u'cdrom', u'cdrom')} >Thread-62::DEBUG::2014-07-10 09:02:48,379::vm::5072::vm.Vm::(_getUnderlyingDriveInfo) vmId=`7fc21bb8-bd92-4924-acef-8360998e92a1`::Matched {'name': (u'hdc', u'hdc'), 'bootOrder': ('', None), 'boot': ([], None), 'readonly': (True, 'True'), 'address': ({u'bus': u'1', u'controller': u'0', u'type': u'drive', u'target': u'0', u'unit': u'0'}, {u'bus': u'1', u'controller': u'0', u'type': u'drive', u'target': u'0', u'unit': u'0'}), 'path': ('', ''), 'type': (u'cdrom', 'disk')} >Thread-62::DEBUG::2014-07-10 09:02:48,380::vm::5032::vm.Vm::(_getUnderlyingDriveInfo) vmId=`7fc21bb8-bd92-4924-acef-8360998e92a1`::Looking for drive with attributes {'name': u'hdd', 'bootOrder': '', 'boot': [], 'readonly': True, 'address': {u'bus': u'1', u'controller': u'0', u'type': u'drive', u'target': u'0', u'unit': u'1'}, 'path': u'/var/run/vdsm/payload/7fc21bb8-bd92-4924-acef-8360998e92a1.b57ec2f5df19bc658959a6d6d7be8e33.img', 'type': u'cdrom'} >Thread-62::DEBUG::2014-07-10 09:02:48,380::vm::5053::vm.Vm::(_getUnderlyingDriveInfo) vmId=`7fc21bb8-bd92-4924-acef-8360998e92a1`::Matched {'name': (u'hdd', u'hdd'), 'bootOrder': ('', None), 'boot': ([], None), 'readonly': (True, True), 'address': ({u'bus': u'1', u'controller': u'0', u'type': u'drive', u'target': u'0', u'unit': u'1'}, {u'bus': u'1', u'controller': u'0', u'type': u'drive', u'target': u'0', u'unit': u'1'}), 'path': (u'/var/run/vdsm/payload/7fc21bb8-bd92-4924-acef-8360998e92a1.b57ec2f5df19bc658959a6d6d7be8e33.img', '/var/run/vdsm/payload/7fc21bb8-bd92-4924-acef-8360998e92a1.b57ec2f5df19bc658959a6d6d7be8e33.img'), 'type': (u'cdrom', u'cdrom')} >Thread-62::DEBUG::2014-07-10 09:02:48,380::vm::5072::vm.Vm::(_getUnderlyingDriveInfo) vmId=`7fc21bb8-bd92-4924-acef-8360998e92a1`::Matched {'name': (u'hdd', u'hdd'), 'bootOrder': ('', None), 'boot': ([], None), 'readonly': (True, 'True'), 'address': ({u'bus': u'1', u'controller': u'0', u'type': u'drive', u'target': u'0', u'unit': u'1'}, {u'bus': u'1', u'controller': u'0', u'type': u'drive', u'target': u'0', u'unit': u'1'}), 'path': (u'/var/run/vdsm/payload/7fc21bb8-bd92-4924-acef-8360998e92a1.b57ec2f5df19bc658959a6d6d7be8e33.img', '/var/run/vdsm/payload/7fc21bb8-bd92-4924-acef-8360998e92a1.b57ec2f5df19bc658959a6d6d7be8e33.img'), 'type': (u'cdrom', 'disk')} >Thread-62::DEBUG::2014-07-10 09:02:48,381::vm::5032::vm.Vm::(_getUnderlyingDriveInfo) vmId=`7fc21bb8-bd92-4924-acef-8360998e92a1`::Looking for drive with attributes {'name': u'vda', 'bootOrder': u'1', 'boot': [<DOM Element: boot at 0x7f619843eb48>], 'readonly': False, 'address': {u'slot': u'0x06', u'bus': u'0x00', u'domain': u'0x0000', u'type': u'pci', u'function': u'0x0'}, 'path': u'/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/images/aa20346a-4d3a-4e07-b8e1-52c0ebe4168c/58fefce2-9bce-4bff-8949-8c6ce8122b27', 'type': u'disk'} >Thread-62::DEBUG::2014-07-10 09:02:48,381::vm::5053::vm.Vm::(_getUnderlyingDriveInfo) vmId=`7fc21bb8-bd92-4924-acef-8360998e92a1`::Matched {'name': (u'vda', u'vda'), 'bootOrder': (u'1', u'1'), 'boot': ([<DOM Element: boot at 0x7f619843eb48>], None), 'readonly': (False, False), 'address': ({u'slot': u'0x06', u'bus': u'0x00', u'domain': u'0x0000', u'type': u'pci', u'function': u'0x0'}, {u'slot': u'0x06', u'bus': u'0x00', u'domain': u'0x0000', u'type': u'pci', u'function': u'0x0'}), 'path': (u'/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/images/aa20346a-4d3a-4e07-b8e1-52c0ebe4168c/58fefce2-9bce-4bff-8949-8c6ce8122b27', '/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/images/aa20346a-4d3a-4e07-b8e1-52c0ebe4168c/58fefce2-9bce-4bff-8949-8c6ce8122b27'), 'type': (u'disk', u'disk')} >Thread-62::DEBUG::2014-07-10 09:02:48,381::vm::5072::vm.Vm::(_getUnderlyingDriveInfo) vmId=`7fc21bb8-bd92-4924-acef-8360998e92a1`::Matched {'name': (u'vda', u'vda'), 'bootOrder': (u'1', u'1'), 'boot': ([<DOM Element: boot at 0x7f619843eb48>], None), 'readonly': (False, 'False'), 'address': ({u'slot': u'0x06', u'bus': u'0x00', u'domain': u'0x0000', u'type': u'pci', u'function': u'0x0'}, {u'slot': u'0x06', u'bus': u'0x00', u'domain': u'0x0000', u'type': u'pci', u'function': u'0x0'}), 'path': (u'/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/images/aa20346a-4d3a-4e07-b8e1-52c0ebe4168c/58fefce2-9bce-4bff-8949-8c6ce8122b27', '/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/images/aa20346a-4d3a-4e07-b8e1-52c0ebe4168c/58fefce2-9bce-4bff-8949-8c6ce8122b27'), 'type': (u'disk', 'disk')} >Thread-62::DEBUG::2014-07-10 09:02:48,433::sampling::285::vm.Vm::(start) vmId=`7fc21bb8-bd92-4924-acef-8360998e92a1`::Start statistics collection >Thread-64::DEBUG::2014-07-10 09:02:48,435::sampling::314::vm.Vm::(run) vmId=`7fc21bb8-bd92-4924-acef-8360998e92a1`::Stats thread started >Thread-64::DEBUG::2014-07-10 09:02:48,445::task::595::TaskManager.Task::(_updateState) Task=`b62b91a4-f0bf-475b-8323-20633ca716dc`::moving from state init -> state preparing >Thread-64::INFO::2014-07-10 09:02:48,446::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='aa20346a-4d3a-4e07-b8e1-52c0ebe4168c', volUUID='58fefce2-9bce-4bff-8949-8c6ce8122b27', options=None) >Thread-64::INFO::2014-07-10 09:02:48,446::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-64::DEBUG::2014-07-10 09:02:48,446::task::1185::TaskManager.Task::(prepare) Task=`b62b91a4-f0bf-475b-8323-20633ca716dc`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-64::DEBUG::2014-07-10 09:02:48,446::task::595::TaskManager.Task::(_updateState) Task=`b62b91a4-f0bf-475b-8323-20633ca716dc`::moving from state preparing -> state finished >Thread-64::DEBUG::2014-07-10 09:02:48,447::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-64::DEBUG::2014-07-10 09:02:48,447::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-64::DEBUG::2014-07-10 09:02:48,447::task::990::TaskManager.Task::(_decref) Task=`b62b91a4-f0bf-475b-8323-20633ca716dc`::ref 0 aborting False >Thread-62::DEBUG::2014-07-10 09:02:48,451::vmChannels::198::vds::(register) Add fileno 66 to listener's channels. >Thread-62::WARNING::2014-07-10 09:02:48,454::vm::3715::vm.Vm::(_readPauseCode) vmId=`7fc21bb8-bd92-4924-acef-8360998e92a1`::_readPauseCode unsupported by libvirt vm >Thread-62::DEBUG::2014-07-10 09:02:48,462::vm::2291::vm.Vm::(_startUnderlyingVm) vmId=`7fc21bb8-bd92-4924-acef-8360998e92a1`::_ongoingCreations released >Thread-13::DEBUG::2014-07-10 09:02:48,948::BindingXMLRPC::1067::vds::(wrapper) client [10.35.3.13]::call vmGetStats with ('2386fa8c-f537-495c-ae07-e178171d77f2',) {} >Thread-13::DEBUG::2014-07-10 09:02:48,949::vm::676::vm.Vm::(_getDiskStats) vmId=`2386fa8c-f537-495c-ae07-e178171d77f2`::Disk hdd stats not available >Thread-13::DEBUG::2014-07-10 09:02:48,949::vm::676::vm.Vm::(_getDiskStats) vmId=`2386fa8c-f537-495c-ae07-e178171d77f2`::Disk hdc stats not available >Thread-13::DEBUG::2014-07-10 09:02:48,949::vm::676::vm.Vm::(_getDiskStats) vmId=`2386fa8c-f537-495c-ae07-e178171d77f2`::Disk vda stats not available >Thread-13::DEBUG::2014-07-10 09:02:48,949::vm::715::vm.Vm::(_getDiskLatency) vmId=`2386fa8c-f537-495c-ae07-e178171d77f2`::Disk hdd latency not available >Thread-13::DEBUG::2014-07-10 09:02:48,950::vm::715::vm.Vm::(_getDiskLatency) vmId=`2386fa8c-f537-495c-ae07-e178171d77f2`::Disk hdc latency not available >Thread-13::DEBUG::2014-07-10 09:02:48,950::vm::715::vm.Vm::(_getDiskLatency) vmId=`2386fa8c-f537-495c-ae07-e178171d77f2`::Disk vda latency not available >Thread-13::DEBUG::2014-07-10 09:02:48,950::BindingXMLRPC::1074::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Powering up', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '14143', 'displayIp': '0', 'displayPort': u'5908', 'session': 'Unknown', 'displaySecurePort': u'5909', 'timeOffset': '0', 'hash': '-2423634698834682900', 'balloonInfo': {'balloon_max': '1048576', 'balloon_target': '1048576', 'balloon_cur': '1048576', 'balloon_min': '1048576'}, 'pauseCode': 'NOERR', 'clientIp': '', 'kvmEnable': 'true', 'network': {u'vnet4': {'macAddr': '00:1a:4a:de:6d:7c', 'rxDropped': '0', 'rxErrors': '0', 'txDropped': '0', 'txRate': '0.0', 'rxRate': '0.0', 'txErrors': '0', 'state': 'unknown', 'speed': '1000', 'name': u'vnet4'}}, 'vmId': '2386fa8c-f537-495c-ae07-e178171d77f2', 'displayType': 'qxl', 'cpuUser': '45.48', 'disks': {u'vda': {'truesize': '1073741824', 'apparentsize': '1073741824', 'imageID': 'b034d5b0-e1e0-4011-b49b-4d45ddb11556'}, u'hdd': {'truesize': '0', 'apparentsize': '0'}, u'hdc': {'truesize': '0', 'apparentsize': '0'}}, 'monitorResponse': '0', 'statsAge': '1.90', 'elapsedTime': '22', 'vmType': 'kvm', 'cpuSys': '21.94', 'guestCPUCount': -1, 'appsList': [], 'guestIPs': ''}]} >Thread-13::DEBUG::2014-07-10 09:02:48,954::BindingXMLRPC::1067::vds::(wrapper) client [10.35.3.13]::call vmGetStats with ('0e968db5-5d49-467f-9ff3-afc37b64364f',) {} >Thread-13::DEBUG::2014-07-10 09:02:48,955::vm::676::vm.Vm::(_getDiskStats) vmId=`0e968db5-5d49-467f-9ff3-afc37b64364f`::Disk hdd stats not available >Thread-13::DEBUG::2014-07-10 09:02:48,955::vm::676::vm.Vm::(_getDiskStats) vmId=`0e968db5-5d49-467f-9ff3-afc37b64364f`::Disk hdc stats not available >Thread-13::DEBUG::2014-07-10 09:02:48,955::vm::676::vm.Vm::(_getDiskStats) vmId=`0e968db5-5d49-467f-9ff3-afc37b64364f`::Disk vda stats not available >Thread-13::DEBUG::2014-07-10 09:02:48,955::vm::715::vm.Vm::(_getDiskLatency) vmId=`0e968db5-5d49-467f-9ff3-afc37b64364f`::Disk hdd latency not available >Thread-13::DEBUG::2014-07-10 09:02:48,956::vm::715::vm.Vm::(_getDiskLatency) vmId=`0e968db5-5d49-467f-9ff3-afc37b64364f`::Disk hdc latency not available >Thread-13::DEBUG::2014-07-10 09:02:48,956::vm::715::vm.Vm::(_getDiskLatency) vmId=`0e968db5-5d49-467f-9ff3-afc37b64364f`::Disk vda latency not available >Thread-13::DEBUG::2014-07-10 09:02:48,956::BindingXMLRPC::1074::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Powering up', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '13498', 'displayIp': '0', 'displayPort': u'5906', 'session': 'Unknown', 'displaySecurePort': u'5907', 'timeOffset': '0', 'hash': '-6274297782377519393', 'balloonInfo': {'balloon_max': '1048576', 'balloon_target': '1048576', 'balloon_cur': '1048576', 'balloon_min': '1048576'}, 'pauseCode': 'NOERR', 'clientIp': '', 'kvmEnable': 'true', 'network': {u'vnet3': {'macAddr': '00:1a:4a:de:6d:7f', 'rxDropped': '0', 'rxErrors': '0', 'txDropped': '0', 'txRate': '0.0', 'rxRate': '0.0', 'txErrors': '0', 'state': 'unknown', 'speed': '1000', 'name': u'vnet3'}}, 'vmId': '0e968db5-5d49-467f-9ff3-afc37b64364f', 'displayType': 'qxl', 'cpuUser': '43.05', 'disks': {u'vda': {'truesize': '1073741824', 'apparentsize': '1073741824', 'imageID': 'b6f6c0da-e67f-4902-b9ac-3069571a42fe'}, u'hdd': {'truesize': '0', 'apparentsize': '0'}, u'hdc': {'truesize': '0', 'apparentsize': '0'}}, 'monitorResponse': '0', 'statsAge': '0.43', 'elapsedTime': '42', 'vmType': 'kvm', 'cpuSys': '3.38', 'guestCPUCount': -1, 'appsList': [], 'guestIPs': ''}]} >Thread-13::DEBUG::2014-07-10 09:02:48,960::BindingXMLRPC::1067::vds::(wrapper) client [10.35.3.13]::call vmGetStats with ('7fc21bb8-bd92-4924-acef-8360998e92a1',) {} >Thread-13::DEBUG::2014-07-10 09:02:48,960::vm::598::vm.Vm::(_getCpuStats) vmId=`7fc21bb8-bd92-4924-acef-8360998e92a1`::CPU stats not available: 'NoneType' object is unsubscriptable >Thread-13::DEBUG::2014-07-10 09:02:48,960::vm::654::vm.Vm::(_getNetworkStats) vmId=`7fc21bb8-bd92-4924-acef-8360998e92a1`::Network stats not available >Thread-13::DEBUG::2014-07-10 09:02:48,961::vm::676::vm.Vm::(_getDiskStats) vmId=`7fc21bb8-bd92-4924-acef-8360998e92a1`::Disk hdd stats not available >Thread-13::DEBUG::2014-07-10 09:02:48,961::vm::676::vm.Vm::(_getDiskStats) vmId=`7fc21bb8-bd92-4924-acef-8360998e92a1`::Disk hdc stats not available >Thread-13::DEBUG::2014-07-10 09:02:48,961::vm::676::vm.Vm::(_getDiskStats) vmId=`7fc21bb8-bd92-4924-acef-8360998e92a1`::Disk vda stats not available >Thread-13::DEBUG::2014-07-10 09:02:48,961::vm::715::vm.Vm::(_getDiskLatency) vmId=`7fc21bb8-bd92-4924-acef-8360998e92a1`::Disk hdd latency not available >Thread-13::DEBUG::2014-07-10 09:02:48,961::vm::715::vm.Vm::(_getDiskLatency) vmId=`7fc21bb8-bd92-4924-acef-8360998e92a1`::Disk hdc latency not available >Thread-13::DEBUG::2014-07-10 09:02:48,961::vm::715::vm.Vm::(_getDiskLatency) vmId=`7fc21bb8-bd92-4924-acef-8360998e92a1`::Disk vda latency not available >Thread-13::DEBUG::2014-07-10 09:02:48,962::BindingXMLRPC::1074::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Powering up', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '14800', 'displayIp': '0', 'displayPort': u'5910', 'session': 'Unknown', 'displaySecurePort': u'5911', 'timeOffset': '0', 'hash': '-831008492253830849', 'balloonInfo': {'balloon_max': '1048576', 'balloon_target': '1048576', 'balloon_cur': '0', 'balloon_min': '1048576'}, 'pauseCode': 'NOERR', 'clientIp': '', 'kvmEnable': 'true', 'network': {u'vnet5': {'state': 'unknown', 'macAddr': '00:1a:4a:de:6d:7d', 'speed': '1000', 'name': u'vnet5'}}, 'vmId': '7fc21bb8-bd92-4924-acef-8360998e92a1', 'displayType': 'qxl', 'cpuUser': '0.00', 'disks': {u'vda': {'truesize': '1073741824', 'apparentsize': '1073741824', 'imageID': 'aa20346a-4d3a-4e07-b8e1-52c0ebe4168c'}, u'hdd': {'truesize': '0', 'apparentsize': '0'}, u'hdc': {'truesize': '0', 'apparentsize': '0'}}, 'monitorResponse': '0', 'statsAge': '0.52', 'elapsedTime': '2', 'vmType': 'kvm', 'cpuSys': '0.00', 'guestCPUCount': -1, 'appsList': [], 'guestIPs': ''}]} >Thread-54::DEBUG::2014-07-10 09:02:49,103::task::595::TaskManager.Task::(_updateState) Task=`2e144085-f042-4154-a095-ea8c8d10a6f5`::moving from state init -> state preparing >Thread-54::INFO::2014-07-10 09:02:49,103::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='28408446-e5fd-4565-a976-e760951593fe', volUUID='776303a2-5585-451e-826e-0e338d4a1e98', options=None) >Thread-54::INFO::2014-07-10 09:02:49,104::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-54::DEBUG::2014-07-10 09:02:49,104::task::1185::TaskManager.Task::(prepare) Task=`2e144085-f042-4154-a095-ea8c8d10a6f5`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-54::DEBUG::2014-07-10 09:02:49,104::task::595::TaskManager.Task::(_updateState) Task=`2e144085-f042-4154-a095-ea8c8d10a6f5`::moving from state preparing -> state finished >Thread-54::DEBUG::2014-07-10 09:02:49,104::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-54::DEBUG::2014-07-10 09:02:49,105::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-54::DEBUG::2014-07-10 09:02:49,105::task::990::TaskManager.Task::(_decref) Task=`2e144085-f042-4154-a095-ea8c8d10a6f5`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-07-10 09:02:49,181::vmChannels::106::vds::(_do_add_channels) fileno 66 was added to unconnected channels. >VM Channels Listener::DEBUG::2014-07-10 09:02:49,181::vmChannels::132::vds::(_handle_unconnected) Trying to connect fileno 66. >VM Channels Listener::DEBUG::2014-07-10 09:02:49,181::guestIF::194::vm.Vm::(_connect) vmId=`7fc21bb8-bd92-4924-acef-8360998e92a1`::Attempting connection to /var/lib/libvirt/qemu/channels/7fc21bb8-bd92-4924-acef-8360998e92a1.com.redhat.rhevm.vdsm >VM Channels Listener::DEBUG::2014-07-10 09:02:49,182::guestIF::197::vm.Vm::(_connect) vmId=`7fc21bb8-bd92-4924-acef-8360998e92a1`::Connected to /var/lib/libvirt/qemu/channels/7fc21bb8-bd92-4924-acef-8360998e92a1.com.redhat.rhevm.vdsm >VM Channels Listener::DEBUG::2014-07-10 09:02:49,183::vmChannels::148::vds::(_handle_unconnected) Connecting to fileno 66 succeeded. >Thread-34::DEBUG::2014-07-10 09:02:49,597::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [44b2df69] >Thread-34::DEBUG::2014-07-10 09:02:49,599::task::595::TaskManager.Task::(_updateState) Task=`834c3ccd-bc24-4cc0-aa77-3298bd8de161`::moving from state init -> state preparing >Thread-34::INFO::2014-07-10 09:02:49,599::logUtils::44::dispatcher::(wrapper) Run and protect: createVolume(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='f30c2cb7-a43a-4bf5-82b5-cfe07336f65c', size='10737418240', volFormat=4, preallocate=2, diskType=2, volUUID='b0fbb3c9-55af-4a3a-95ad-fc56a80b9cf5', desc='', srcImgUUID='9cf413b7-7f14-4a61-8c71-913e5b0ea9c0', srcVolUUID='47592965-e853-4e59-9728-d11cca6a7a8a') >Thread-34::DEBUG::2014-07-10 09:02:49,600::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.9e1aa540-1f4e-4ee3-a152-be381ef6c3bd`ReqID=`de12d780-c0f2-434e-8ab3-f2875c0216fe`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '1464' at 'createVolume' >Thread-34::DEBUG::2014-07-10 09:02:49,600::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.9e1aa540-1f4e-4ee3-a152-be381ef6c3bd' for lock type 'shared' >Thread-34::DEBUG::2014-07-10 09:02:49,600::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.9e1aa540-1f4e-4ee3-a152-be381ef6c3bd' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-10 09:02:49,600::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.9e1aa540-1f4e-4ee3-a152-be381ef6c3bd`ReqID=`de12d780-c0f2-434e-8ab3-f2875c0216fe`::Granted request >Thread-34::DEBUG::2014-07-10 09:02:49,601::task::827::TaskManager.Task::(resourceAcquired) Task=`834c3ccd-bc24-4cc0-aa77-3298bd8de161`::_resourcesAcquired: Storage.9e1aa540-1f4e-4ee3-a152-be381ef6c3bd (shared) >Thread-34::DEBUG::2014-07-10 09:02:49,601::task::990::TaskManager.Task::(_decref) Task=`834c3ccd-bc24-4cc0-aa77-3298bd8de161`::ref 1 aborting False >Thread-34::DEBUG::2014-07-10 09:02:49,603::task::752::TaskManager.Task::(_save) Task=`834c3ccd-bc24-4cc0-aa77-3298bd8de161`::_save: orig /rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/master/tasks/834c3ccd-bc24-4cc0-aa77-3298bd8de161 temp /rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/master/tasks/834c3ccd-bc24-4cc0-aa77-3298bd8de161.temp >Thread-34::DEBUG::2014-07-10 09:02:49,609::taskManager::68::TaskManager::(scheduleJob) scheduled job createVolume for task 834c3ccd-bc24-4cc0-aa77-3298bd8de161 >Thread-34::INFO::2014-07-10 09:02:49,609::logUtils::47::dispatcher::(wrapper) Run and protect: createVolume, Return response: None >Thread-34::DEBUG::2014-07-10 09:02:49,609::task::1180::TaskManager.Task::(prepare) Task=`834c3ccd-bc24-4cc0-aa77-3298bd8de161`::Prepare: 1 jobs exist, move to acquiring >Thread-34::DEBUG::2014-07-10 09:02:49,609::task::595::TaskManager.Task::(_updateState) Task=`834c3ccd-bc24-4cc0-aa77-3298bd8de161`::moving from state preparing -> state acquiring >Thread-34::DEBUG::2014-07-10 09:02:49,610::task::752::TaskManager.Task::(_save) Task=`834c3ccd-bc24-4cc0-aa77-3298bd8de161`::_save: orig /rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/master/tasks/834c3ccd-bc24-4cc0-aa77-3298bd8de161 temp /rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/master/tasks/834c3ccd-bc24-4cc0-aa77-3298bd8de161.temp >Thread-34::DEBUG::2014-07-10 09:02:49,616::task::595::TaskManager.Task::(_updateState) Task=`834c3ccd-bc24-4cc0-aa77-3298bd8de161`::moving from state acquiring -> state queued >Thread-34::DEBUG::2014-07-10 09:02:49,616::task::752::TaskManager.Task::(_save) Task=`834c3ccd-bc24-4cc0-aa77-3298bd8de161`::_save: orig /rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/master/tasks/834c3ccd-bc24-4cc0-aa77-3298bd8de161 temp /rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/master/tasks/834c3ccd-bc24-4cc0-aa77-3298bd8de161.temp >Thread-34::DEBUG::2014-07-10 09:02:49,622::taskManager::50::TaskManager::(_queueTask) queuing task: 834c3ccd-bc24-4cc0-aa77-3298bd8de161 >Thread-34::DEBUG::2014-07-10 09:02:49,622::taskManager::56::TaskManager::(_queueTask) task queued: 834c3ccd-bc24-4cc0-aa77-3298bd8de161 >2657ae52-ccac-4722-b0ee-3c4045d468ef::DEBUG::2014-07-10 09:02:49,623::threadPool::57::Misc.ThreadPool::(setRunningTask) Number of running tasks: 1 >Thread-34::DEBUG::2014-07-10 09:02:49,623::task::1182::TaskManager.Task::(prepare) Task=`834c3ccd-bc24-4cc0-aa77-3298bd8de161`::returning >834c3ccd-bc24-4cc0-aa77-3298bd8de161::DEBUG::2014-07-10 09:02:49,624::threadPool::200::Misc.ThreadPool.WorkerThread::(_processNextTask) Task: 834c3ccd-bc24-4cc0-aa77-3298bd8de161 running: <bound method Task.commit of <storage.task.Task instance at 0x7f621c3425f0>> with: None >Thread-34::DEBUG::2014-07-10 09:02:49,625::task::990::TaskManager.Task::(_decref) Task=`834c3ccd-bc24-4cc0-aa77-3298bd8de161`::ref 0 aborting False >834c3ccd-bc24-4cc0-aa77-3298bd8de161::DEBUG::2014-07-10 09:02:49,625::task::1194::TaskManager.Task::(commit) Task=`834c3ccd-bc24-4cc0-aa77-3298bd8de161`::committing task: 834c3ccd-bc24-4cc0-aa77-3298bd8de161 >834c3ccd-bc24-4cc0-aa77-3298bd8de161::DEBUG::2014-07-10 09:02:49,626::task::595::TaskManager.Task::(_updateState) Task=`834c3ccd-bc24-4cc0-aa77-3298bd8de161`::moving from state queued -> state running >834c3ccd-bc24-4cc0-aa77-3298bd8de161::DEBUG::2014-07-10 09:02:49,627::task::752::TaskManager.Task::(_save) Task=`834c3ccd-bc24-4cc0-aa77-3298bd8de161`::_save: orig /rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/master/tasks/834c3ccd-bc24-4cc0-aa77-3298bd8de161 temp /rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/master/tasks/834c3ccd-bc24-4cc0-aa77-3298bd8de161.temp >834c3ccd-bc24-4cc0-aa77-3298bd8de161::DEBUG::2014-07-10 09:02:49,635::task::905::TaskManager.Task::(_runJobs) Task=`834c3ccd-bc24-4cc0-aa77-3298bd8de161`::Task.run: running job 0: createVolume: <bound method StoragePool.createVolume of <storage.sp.StoragePool object at 0x7f62180b9dd0>> (args: ('9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'f30c2cb7-a43a-4bf5-82b5-cfe07336f65c', 20971520, 4, 2, 2, 'b0fbb3c9-55af-4a3a-95ad-fc56a80b9cf5', '', '9cf413b7-7f14-4a61-8c71-913e5b0ea9c0', '47592965-e853-4e59-9728-d11cca6a7a8a') kwargs: {}) >834c3ccd-bc24-4cc0-aa77-3298bd8de161::DEBUG::2014-07-10 09:02:49,635::task::331::TaskManager.Task::(run) Task=`834c3ccd-bc24-4cc0-aa77-3298bd8de161`::Job.run: running createVolume: <bound method StoragePool.createVolume of <storage.sp.StoragePool object at 0x7f62180b9dd0>> (args: ('9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'f30c2cb7-a43a-4bf5-82b5-cfe07336f65c', 20971520, 4, 2, 2, 'b0fbb3c9-55af-4a3a-95ad-fc56a80b9cf5', '', '9cf413b7-7f14-4a61-8c71-913e5b0ea9c0', '47592965-e853-4e59-9728-d11cca6a7a8a') kwargs: {}) callback None >834c3ccd-bc24-4cc0-aa77-3298bd8de161::DEBUG::2014-07-10 09:02:49,636::blockVolume::572::Storage.Misc.excCmd::(getMetadata) '/bin/dd iflag=direct skip=4 bs=512 if=/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/metadata count=1' (cwd None) >834c3ccd-bc24-4cc0-aa77-3298bd8de161::DEBUG::2014-07-10 09:02:49,657::blockVolume::572::Storage.Misc.excCmd::(getMetadata) SUCCESS: <err> = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.000548216 s, 934 kB/s\n'; <rc> = 0 >834c3ccd-bc24-4cc0-aa77-3298bd8de161::DEBUG::2014-07-10 09:02:49,657::misc::282::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.000548216 s, 934 kB/s'], size: 512 >834c3ccd-bc24-4cc0-aa77-3298bd8de161::DEBUG::2014-07-10 09:02:49,659::resourceManager::198::ResourceManager.Request::(__init__) ResName=`9e1aa540-1f4e-4ee3-a152-be381ef6c3bd_imageNS.f30c2cb7-a43a-4bf5-82b5-cfe07336f65c`ReqID=`51512f55-00b8-42af-bdaf-f358eab8bad4`::Request was made in '/usr/share/vdsm/storage/sp.py' line '1767' at 'createVolume' >834c3ccd-bc24-4cc0-aa77-3298bd8de161::DEBUG::2014-07-10 09:02:49,659::resourceManager::542::ResourceManager::(registerResource) Trying to register resource '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd_imageNS.f30c2cb7-a43a-4bf5-82b5-cfe07336f65c' for lock type 'exclusive' >834c3ccd-bc24-4cc0-aa77-3298bd8de161::DEBUG::2014-07-10 09:02:49,660::lvm::427::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' got the operation mutex >834c3ccd-bc24-4cc0-aa77-3298bd8de161::DEBUG::2014-07-10 09:02:49,661::lvm::296::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm lvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/3600601601282300032826addbbdae311|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,vg_name,attr,size,seg_start_pe,devices,tags 9e1aa540-1f4e-4ee3-a152-be381ef6c3bd' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:02:49,684::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:02:49,765::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0300226 s, 34.1 MB/s\n'; <rc> = 0 >834c3ccd-bc24-4cc0-aa77-3298bd8de161::DEBUG::2014-07-10 09:02:49,899::lvm::296::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >834c3ccd-bc24-4cc0-aa77-3298bd8de161::DEBUG::2014-07-10 09:02:49,913::lvm::462::Storage.LVM::(_reloadlvs) lvs reloaded >834c3ccd-bc24-4cc0-aa77-3298bd8de161::DEBUG::2014-07-10 09:02:49,914::lvm::462::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' released the operation mutex >834c3ccd-bc24-4cc0-aa77-3298bd8de161::DEBUG::2014-07-10 09:02:49,914::resourceFactories::125::Storage.ResourcesFactories::(__getResourceCandidatesList) Image f30c2cb7-a43a-4bf5-82b5-cfe07336f65c does not exist in domain 9e1aa540-1f4e-4ee3-a152-be381ef6c3bd >834c3ccd-bc24-4cc0-aa77-3298bd8de161::DEBUG::2014-07-10 09:02:49,914::resourceManager::601::ResourceManager::(registerResource) Resource '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd_imageNS.f30c2cb7-a43a-4bf5-82b5-cfe07336f65c' is free. Now locking as 'exclusive' (1 active user) >834c3ccd-bc24-4cc0-aa77-3298bd8de161::DEBUG::2014-07-10 09:02:49,915::resourceManager::238::ResourceManager.Request::(grant) ResName=`9e1aa540-1f4e-4ee3-a152-be381ef6c3bd_imageNS.f30c2cb7-a43a-4bf5-82b5-cfe07336f65c`ReqID=`51512f55-00b8-42af-bdaf-f358eab8bad4`::Granted request >834c3ccd-bc24-4cc0-aa77-3298bd8de161::INFO::2014-07-10 09:02:49,916::image::123::Storage.Image::(create) Create placeholder /rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/images/f30c2cb7-a43a-4bf5-82b5-cfe07336f65c for image's volumes >834c3ccd-bc24-4cc0-aa77-3298bd8de161::DEBUG::2014-07-10 09:02:49,917::task::752::TaskManager.Task::(_save) Task=`834c3ccd-bc24-4cc0-aa77-3298bd8de161`::_save: orig /rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/master/tasks/834c3ccd-bc24-4cc0-aa77-3298bd8de161 temp /rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/master/tasks/834c3ccd-bc24-4cc0-aa77-3298bd8de161.temp >834c3ccd-bc24-4cc0-aa77-3298bd8de161::DEBUG::2014-07-10 09:02:49,925::blockVolume::572::Storage.Misc.excCmd::(getMetadata) '/bin/dd iflag=direct skip=4 bs=512 if=/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/metadata count=1' (cwd None) >834c3ccd-bc24-4cc0-aa77-3298bd8de161::DEBUG::2014-07-10 09:02:49,943::blockVolume::572::Storage.Misc.excCmd::(getMetadata) SUCCESS: <err> = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.000620183 s, 826 kB/s\n'; <rc> = 0 >834c3ccd-bc24-4cc0-aa77-3298bd8de161::DEBUG::2014-07-10 09:02:49,944::misc::282::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.000620183 s, 826 kB/s'], size: 512 >834c3ccd-bc24-4cc0-aa77-3298bd8de161::DEBUG::2014-07-10 09:02:49,944::volume::300::Storage.Volume::(share) Share volume 47592965-e853-4e59-9728-d11cca6a7a8a to /rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/images/f30c2cb7-a43a-4bf5-82b5-cfe07336f65c >834c3ccd-bc24-4cc0-aa77-3298bd8de161::DEBUG::2014-07-10 09:02:49,945::blockVolume::572::Storage.Misc.excCmd::(getMetadata) '/bin/dd iflag=direct skip=4 bs=512 if=/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/metadata count=1' (cwd None) >834c3ccd-bc24-4cc0-aa77-3298bd8de161::DEBUG::2014-07-10 09:02:49,957::blockVolume::572::Storage.Misc.excCmd::(getMetadata) SUCCESS: <err> = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.000487073 s, 1.1 MB/s\n'; <rc> = 0 >834c3ccd-bc24-4cc0-aa77-3298bd8de161::DEBUG::2014-07-10 09:02:49,958::misc::282::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.000487073 s, 1.1 MB/s'], size: 512 >834c3ccd-bc24-4cc0-aa77-3298bd8de161::DEBUG::2014-07-10 09:02:49,959::task::752::TaskManager.Task::(_save) Task=`834c3ccd-bc24-4cc0-aa77-3298bd8de161`::_save: orig /rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/master/tasks/834c3ccd-bc24-4cc0-aa77-3298bd8de161 temp /rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/master/tasks/834c3ccd-bc24-4cc0-aa77-3298bd8de161.temp >834c3ccd-bc24-4cc0-aa77-3298bd8de161::DEBUG::2014-07-10 09:02:49,968::blockVolume::353::Storage.Volume::(_share) Share volume 47592965-e853-4e59-9728-d11cca6a7a8a to /rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/images/f30c2cb7-a43a-4bf5-82b5-cfe07336f65c >834c3ccd-bc24-4cc0-aa77-3298bd8de161::DEBUG::2014-07-10 09:02:49,969::blockVolume::572::Storage.Misc.excCmd::(getMetadata) '/bin/dd iflag=direct skip=4 bs=512 if=/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/metadata count=1' (cwd None) >834c3ccd-bc24-4cc0-aa77-3298bd8de161::DEBUG::2014-07-10 09:02:49,985::blockVolume::572::Storage.Misc.excCmd::(getMetadata) SUCCESS: <err> = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.000508254 s, 1.0 MB/s\n'; <rc> = 0 >834c3ccd-bc24-4cc0-aa77-3298bd8de161::DEBUG::2014-07-10 09:02:49,986::misc::282::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.000508254 s, 1.0 MB/s'], size: 512 >834c3ccd-bc24-4cc0-aa77-3298bd8de161::INFO::2014-07-10 09:02:49,986::volume::443::Storage.Volume::(create) Creating volume b0fbb3c9-55af-4a3a-95ad-fc56a80b9cf5 >834c3ccd-bc24-4cc0-aa77-3298bd8de161::DEBUG::2014-07-10 09:02:49,988::task::752::TaskManager.Task::(_save) Task=`834c3ccd-bc24-4cc0-aa77-3298bd8de161`::_save: orig /rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/master/tasks/834c3ccd-bc24-4cc0-aa77-3298bd8de161 temp /rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/master/tasks/834c3ccd-bc24-4cc0-aa77-3298bd8de161.temp >834c3ccd-bc24-4cc0-aa77-3298bd8de161::DEBUG::2014-07-10 09:02:49,997::task::752::TaskManager.Task::(_save) Task=`834c3ccd-bc24-4cc0-aa77-3298bd8de161`::_save: orig /rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/master/tasks/834c3ccd-bc24-4cc0-aa77-3298bd8de161 temp /rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/master/tasks/834c3ccd-bc24-4cc0-aa77-3298bd8de161.temp >834c3ccd-bc24-4cc0-aa77-3298bd8de161::DEBUG::2014-07-10 09:02:50,012::lvm::296::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm lvcreate --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/3600601601282300032826addbbdae311|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } " --autobackup n --contiguous n --size 1024m --addtag OVIRT_VOL_INITIALIZING --name b0fbb3c9-55af-4a3a-95ad-fc56a80b9cf5 9e1aa540-1f4e-4ee3-a152-be381ef6c3bd' (cwd None) >VM Channels Listener::DEBUG::2014-07-10 09:02:50,123::guestIF::274::vm.Vm::(_handleMessage) vmId=`0e968db5-5d49-467f-9ff3-afc37b64364f`::username: u'None' >834c3ccd-bc24-4cc0-aa77-3298bd8de161::DEBUG::2014-07-10 09:02:50,632::lvm::296::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ' WARNING: This metadata update is NOT backed up\n WARNING: This metadata update is NOT backed up\n'; <rc> = 0 >834c3ccd-bc24-4cc0-aa77-3298bd8de161::DEBUG::2014-07-10 09:02:50,633::lvm::503::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >834c3ccd-bc24-4cc0-aa77-3298bd8de161::DEBUG::2014-07-10 09:02:50,633::lvm::505::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >834c3ccd-bc24-4cc0-aa77-3298bd8de161::DEBUG::2014-07-10 09:02:50,634::lvm::513::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >834c3ccd-bc24-4cc0-aa77-3298bd8de161::DEBUG::2014-07-10 09:02:50,634::lvm::525::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >834c3ccd-bc24-4cc0-aa77-3298bd8de161::WARNING::2014-07-10 09:02:50,634::utils::129::root::(rmFile) File: /rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/images/f30c2cb7-a43a-4bf5-82b5-cfe07336f65c/b0fbb3c9-55af-4a3a-95ad-fc56a80b9cf5 already removed >834c3ccd-bc24-4cc0-aa77-3298bd8de161::INFO::2014-07-10 09:02:50,636::blockVolume::169::Storage.Volume::(_create) Request to create snapshot f30c2cb7-a43a-4bf5-82b5-cfe07336f65c/b0fbb3c9-55af-4a3a-95ad-fc56a80b9cf5 of volume 9cf413b7-7f14-4a61-8c71-913e5b0ea9c0/47592965-e853-4e59-9728-d11cca6a7a8a >834c3ccd-bc24-4cc0-aa77-3298bd8de161::DEBUG::2014-07-10 09:02:50,637::task::752::TaskManager.Task::(_save) Task=`834c3ccd-bc24-4cc0-aa77-3298bd8de161`::_save: orig /rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/master/tasks/834c3ccd-bc24-4cc0-aa77-3298bd8de161 temp /rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/master/tasks/834c3ccd-bc24-4cc0-aa77-3298bd8de161.temp >834c3ccd-bc24-4cc0-aa77-3298bd8de161::DEBUG::2014-07-10 09:02:50,649::blockVolume::572::Storage.Misc.excCmd::(getMetadata) '/bin/dd iflag=direct skip=4 bs=512 if=/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/metadata count=1' (cwd None) >834c3ccd-bc24-4cc0-aa77-3298bd8de161::DEBUG::2014-07-10 09:02:50,665::blockVolume::572::Storage.Misc.excCmd::(getMetadata) SUCCESS: <err> = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.000493536 s, 1.0 MB/s\n'; <rc> = 0 >834c3ccd-bc24-4cc0-aa77-3298bd8de161::DEBUG::2014-07-10 09:02:50,665::misc::282::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.000493536 s, 1.0 MB/s'], size: 512 >834c3ccd-bc24-4cc0-aa77-3298bd8de161::INFO::2014-07-10 09:02:50,666::volume::789::Storage.Volume::(prepare) Volume: preparing volume 9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/47592965-e853-4e59-9728-d11cca6a7a8a >834c3ccd-bc24-4cc0-aa77-3298bd8de161::DEBUG::2014-07-10 09:02:50,666::blockVolume::572::Storage.Misc.excCmd::(getMetadata) '/bin/dd iflag=direct skip=4 bs=512 if=/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/metadata count=1' (cwd None) >834c3ccd-bc24-4cc0-aa77-3298bd8de161::DEBUG::2014-07-10 09:02:50,680::blockVolume::572::Storage.Misc.excCmd::(getMetadata) SUCCESS: <err> = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.000652988 s, 784 kB/s\n'; <rc> = 0 >834c3ccd-bc24-4cc0-aa77-3298bd8de161::DEBUG::2014-07-10 09:02:50,681::misc::282::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.000652988 s, 784 kB/s'], size: 512 >834c3ccd-bc24-4cc0-aa77-3298bd8de161::DEBUG::2014-07-10 09:02:50,682::resourceManager::198::ResourceManager.Request::(__init__) ResName=`9e1aa540-1f4e-4ee3-a152-be381ef6c3bd_lvmActivationNS.47592965-e853-4e59-9728-d11cca6a7a8a`ReqID=`cdcc520f-9b22-4d23-8968-1509c1ed3c05`::Request was made in '/usr/share/vdsm/storage/volume.py' line '806' at 'prepare' >834c3ccd-bc24-4cc0-aa77-3298bd8de161::DEBUG::2014-07-10 09:02:50,682::resourceManager::542::ResourceManager::(registerResource) Trying to register resource '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd_lvmActivationNS.47592965-e853-4e59-9728-d11cca6a7a8a' for lock type 'shared' >834c3ccd-bc24-4cc0-aa77-3298bd8de161::DEBUG::2014-07-10 09:02:50,682::resourceManager::601::ResourceManager::(registerResource) Resource '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd_lvmActivationNS.47592965-e853-4e59-9728-d11cca6a7a8a' is free. Now locking as 'shared' (1 active user) >834c3ccd-bc24-4cc0-aa77-3298bd8de161::DEBUG::2014-07-10 09:02:50,683::resourceManager::238::ResourceManager.Request::(grant) ResName=`9e1aa540-1f4e-4ee3-a152-be381ef6c3bd_lvmActivationNS.47592965-e853-4e59-9728-d11cca6a7a8a`ReqID=`cdcc520f-9b22-4d23-8968-1509c1ed3c05`::Granted request >834c3ccd-bc24-4cc0-aa77-3298bd8de161::DEBUG::2014-07-10 09:02:50,683::blockVolume::572::Storage.Misc.excCmd::(getMetadata) '/bin/dd iflag=direct skip=4 bs=512 if=/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/metadata count=1' (cwd None) >834c3ccd-bc24-4cc0-aa77-3298bd8de161::DEBUG::2014-07-10 09:02:50,695::blockVolume::572::Storage.Misc.excCmd::(getMetadata) SUCCESS: <err> = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.000440185 s, 1.2 MB/s\n'; <rc> = 0 >834c3ccd-bc24-4cc0-aa77-3298bd8de161::DEBUG::2014-07-10 09:02:50,695::misc::282::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.000440185 s, 1.2 MB/s'], size: 512 >834c3ccd-bc24-4cc0-aa77-3298bd8de161::DEBUG::2014-07-10 09:02:50,695::volume::270::Storage.Volume::(clone) Volume.clone: /rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/images/f30c2cb7-a43a-4bf5-82b5-cfe07336f65c/47592965-e853-4e59-9728-d11cca6a7a8a to /rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/images/f30c2cb7-a43a-4bf5-82b5-cfe07336f65c/b0fbb3c9-55af-4a3a-95ad-fc56a80b9cf5 >834c3ccd-bc24-4cc0-aa77-3298bd8de161::DEBUG::2014-07-10 09:02:50,696::blockVolume::572::Storage.Misc.excCmd::(getMetadata) '/bin/dd iflag=direct skip=4 bs=512 if=/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/metadata count=1' (cwd None) >834c3ccd-bc24-4cc0-aa77-3298bd8de161::DEBUG::2014-07-10 09:02:50,706::blockVolume::572::Storage.Misc.excCmd::(getMetadata) SUCCESS: <err> = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.000543868 s, 941 kB/s\n'; <rc> = 0 >834c3ccd-bc24-4cc0-aa77-3298bd8de161::DEBUG::2014-07-10 09:02:50,707::misc::282::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.000543868 s, 941 kB/s'], size: 512 >834c3ccd-bc24-4cc0-aa77-3298bd8de161::DEBUG::2014-07-10 09:02:50,707::blockVolume::572::Storage.Misc.excCmd::(getMetadata) '/bin/dd iflag=direct skip=4 bs=512 if=/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/metadata count=1' (cwd None) >834c3ccd-bc24-4cc0-aa77-3298bd8de161::DEBUG::2014-07-10 09:02:50,719::blockVolume::572::Storage.Misc.excCmd::(getMetadata) SUCCESS: <err> = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.000396175 s, 1.3 MB/s\n'; <rc> = 0 >834c3ccd-bc24-4cc0-aa77-3298bd8de161::DEBUG::2014-07-10 09:02:50,720::misc::282::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.000396175 s, 1.3 MB/s'], size: 512 >834c3ccd-bc24-4cc0-aa77-3298bd8de161::DEBUG::2014-07-10 09:02:50,720::volume::1042::Storage.Misc.excCmd::(createVolume) '/usr/bin/qemu-img create -f qcow2 -F raw -b ../f30c2cb7-a43a-4bf5-82b5-cfe07336f65c/47592965-e853-4e59-9728-d11cca6a7a8a /rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/images/f30c2cb7-a43a-4bf5-82b5-cfe07336f65c/b0fbb3c9-55af-4a3a-95ad-fc56a80b9cf5' (cwd /rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/images/f30c2cb7-a43a-4bf5-82b5-cfe07336f65c) >834c3ccd-bc24-4cc0-aa77-3298bd8de161::DEBUG::2014-07-10 09:02:50,778::volume::1042::Storage.Misc.excCmd::(createVolume) SUCCESS: <err> = ''; <rc> = 0 >834c3ccd-bc24-4cc0-aa77-3298bd8de161::INFO::2014-07-10 09:02:50,779::blockVolume::393::Storage.Volume::(teardown) Tearing down volume 9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/47592965-e853-4e59-9728-d11cca6a7a8a justme False >834c3ccd-bc24-4cc0-aa77-3298bd8de161::DEBUG::2014-07-10 09:02:50,779::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd_lvmActivationNS.47592965-e853-4e59-9728-d11cca6a7a8a' >834c3ccd-bc24-4cc0-aa77-3298bd8de161::DEBUG::2014-07-10 09:02:50,779::resourceManager::635::ResourceManager::(releaseResource) Released resource '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd_lvmActivationNS.47592965-e853-4e59-9728-d11cca6a7a8a' (0 active users) >834c3ccd-bc24-4cc0-aa77-3298bd8de161::DEBUG::2014-07-10 09:02:50,779::resourceManager::641::ResourceManager::(releaseResource) Resource '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd_lvmActivationNS.47592965-e853-4e59-9728-d11cca6a7a8a' is free, finding out if anyone is waiting for it. >834c3ccd-bc24-4cc0-aa77-3298bd8de161::DEBUG::2014-07-10 09:02:50,780::lvm::296::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm lvchange --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/3600601601282300032826addbbdae311|/dev/mapper/360060160f4a030003840ec867ddee311|/dev/mapper/367cad74c2fcba00019e6afd20c781e67|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } " --autobackup n --available n 9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/47592965-e853-4e59-9728-d11cca6a7a8a' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:02:51,781::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:02:51,927::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0875766 s, 11.7 MB/s\n'; <rc> = 0 >Thread-13::DEBUG::2014-07-10 09:02:52,037::BindingXMLRPC::1067::vds::(wrapper) client [10.35.3.13]::call vmGetStats with ('2386fa8c-f537-495c-ae07-e178171d77f2',) {} >Thread-13::DEBUG::2014-07-10 09:02:52,038::vm::676::vm.Vm::(_getDiskStats) vmId=`2386fa8c-f537-495c-ae07-e178171d77f2`::Disk hdd stats not available >Thread-13::DEBUG::2014-07-10 09:02:52,038::vm::676::vm.Vm::(_getDiskStats) vmId=`2386fa8c-f537-495c-ae07-e178171d77f2`::Disk hdc stats not available >Thread-13::DEBUG::2014-07-10 09:02:52,039::vm::676::vm.Vm::(_getDiskStats) vmId=`2386fa8c-f537-495c-ae07-e178171d77f2`::Disk vda stats not available >Thread-13::DEBUG::2014-07-10 09:02:52,039::vm::715::vm.Vm::(_getDiskLatency) vmId=`2386fa8c-f537-495c-ae07-e178171d77f2`::Disk hdd latency not available >Thread-13::DEBUG::2014-07-10 09:02:52,039::vm::715::vm.Vm::(_getDiskLatency) vmId=`2386fa8c-f537-495c-ae07-e178171d77f2`::Disk hdc latency not available >Thread-13::DEBUG::2014-07-10 09:02:52,039::vm::715::vm.Vm::(_getDiskLatency) vmId=`2386fa8c-f537-495c-ae07-e178171d77f2`::Disk vda latency not available >Thread-13::DEBUG::2014-07-10 09:02:52,040::BindingXMLRPC::1074::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Powering up', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '14143', 'displayIp': '0', 'displayPort': u'5908', 'session': 'Unknown', 'displaySecurePort': u'5909', 'timeOffset': '0', 'hash': '-2423634698834682900', 'balloonInfo': {'balloon_max': '1048576', 'balloon_target': '1048576', 'balloon_cur': '1048576', 'balloon_min': '1048576'}, 'pauseCode': 'NOERR', 'clientIp': '', 'kvmEnable': 'true', 'network': {u'vnet4': {'macAddr': '00:1a:4a:de:6d:7c', 'rxDropped': '0', 'rxErrors': '0', 'txDropped': '0', 'txRate': '0.0', 'rxRate': '0.0', 'txErrors': '0', 'state': 'unknown', 'speed': '1000', 'name': u'vnet4'}}, 'vmId': '2386fa8c-f537-495c-ae07-e178171d77f2', 'displayType': 'qxl', 'cpuUser': '45.48', 'disks': {u'vda': {'truesize': '1073741824', 'apparentsize': '1073741824', 'imageID': 'b034d5b0-e1e0-4011-b49b-4d45ddb11556'}, u'hdd': {'truesize': '0', 'apparentsize': '0'}, u'hdc': {'truesize': '0', 'apparentsize': '0'}}, 'monitorResponse': '0', 'statsAge': '0.97', 'elapsedTime': '25', 'vmType': 'kvm', 'cpuSys': '21.94', 'guestCPUCount': -1, 'appsList': [], 'guestIPs': ''}]} >Thread-13::DEBUG::2014-07-10 09:02:52,044::BindingXMLRPC::1067::vds::(wrapper) client [10.35.3.13]::call vmGetStats with ('0e968db5-5d49-467f-9ff3-afc37b64364f',) {} >Thread-13::DEBUG::2014-07-10 09:02:52,045::vm::676::vm.Vm::(_getDiskStats) vmId=`0e968db5-5d49-467f-9ff3-afc37b64364f`::Disk hdd stats not available >Thread-13::DEBUG::2014-07-10 09:02:52,045::vm::676::vm.Vm::(_getDiskStats) vmId=`0e968db5-5d49-467f-9ff3-afc37b64364f`::Disk hdc stats not available >Thread-13::DEBUG::2014-07-10 09:02:52,046::vm::676::vm.Vm::(_getDiskStats) vmId=`0e968db5-5d49-467f-9ff3-afc37b64364f`::Disk vda stats not available >Thread-13::DEBUG::2014-07-10 09:02:52,046::vm::715::vm.Vm::(_getDiskLatency) vmId=`0e968db5-5d49-467f-9ff3-afc37b64364f`::Disk hdd latency not available >Thread-13::DEBUG::2014-07-10 09:02:52,046::vm::715::vm.Vm::(_getDiskLatency) vmId=`0e968db5-5d49-467f-9ff3-afc37b64364f`::Disk hdc latency not available >Thread-13::DEBUG::2014-07-10 09:02:52,046::vm::715::vm.Vm::(_getDiskLatency) vmId=`0e968db5-5d49-467f-9ff3-afc37b64364f`::Disk vda latency not available >Thread-13::DEBUG::2014-07-10 09:02:52,046::BindingXMLRPC::1074::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'username': u'None', 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': u'localhost.localdomain', 'pid': '13498', 'session': 'Unknown', 'displaySecurePort': u'5907', 'timeOffset': '0', 'balloonInfo': {'balloon_max': '1048576', 'balloon_target': '1048576', 'balloon_cur': '1048576', 'balloon_min': '1048576'}, 'pauseCode': 'NOERR', 'disksUsage': [{u'path': u'/', u'total': '4792987648', u'used': '1843052544', u'fs': u'ext4'}, {u'path': u'/boot', u'total': '507744256', u'used': '40272896', u'fs': u'ext4'}, {u'path': u'/home', u'total': '458985472', u'used': '10766336', u'fs': u'ext4'}], 'network': {u'vnet3': {'macAddr': '00:1a:4a:de:6d:7f', 'rxDropped': '0', 'rxErrors': '0', 'txDropped': '0', 'txRate': '0.0', 'rxRate': '0.0', 'txErrors': '0', 'state': 'unknown', 'speed': '1000', 'name': u'vnet3'}}, 'vmType': 'kvm', 'guestName': u'localhost.localdomain', 'elapsedTime': '45', 'memoryStats': {}, 'cpuSys': '3.38', 'appsList': [u'kernel-2.6.32-431.el6', u'rhevm-guest-agent-common-1.0.9-1.el6ev'], 'guestOs': u'2.6.32-431.el6.x86_64', 'displayType': 'qxl', 'status': 'Up', 'hash': '-6274297782377519393', 'lastLogin': 1404982970.1235559, 'vmId': '0e968db5-5d49-467f-9ff3-afc37b64364f', 'displayIp': '0', 'displayPort': u'5906', 'clientIp': '', 'kvmEnable': 'true', 'disks': {u'vda': {'truesize': '1073741824', 'apparentsize': '1073741824', 'imageID': 'b6f6c0da-e67f-4902-b9ac-3069571a42fe'}, u'hdd': {'truesize': '0', 'apparentsize': '0'}, u'hdc': {'truesize': '0', 'apparentsize': '0'}}, 'monitorResponse': '0', 'statsAge': '1.51', 'cpuUser': '43.05', 'guestCPUCount': -1, 'guestIPs': u'10.35.17.227', 'netIfaces': [{u'hw': u'00:1a:4a:de:6d:7f', u'name': u'eth0', u'inet': [u'10.35.17.227'], u'inet6': [u'fe80::21a:4aff:fede:6d7f']}]}]} >Thread-13::DEBUG::2014-07-10 09:02:52,052::BindingXMLRPC::1067::vds::(wrapper) client [10.35.3.13]::call vmGetStats with ('7fc21bb8-bd92-4924-acef-8360998e92a1',) {} >Thread-13::DEBUG::2014-07-10 09:02:52,052::vm::598::vm.Vm::(_getCpuStats) vmId=`7fc21bb8-bd92-4924-acef-8360998e92a1`::CPU stats not available: 'NoneType' object is unsubscriptable >Thread-13::DEBUG::2014-07-10 09:02:52,052::vm::654::vm.Vm::(_getNetworkStats) vmId=`7fc21bb8-bd92-4924-acef-8360998e92a1`::Network stats not available >Thread-13::DEBUG::2014-07-10 09:02:52,052::vm::676::vm.Vm::(_getDiskStats) vmId=`7fc21bb8-bd92-4924-acef-8360998e92a1`::Disk hdd stats not available >Thread-13::DEBUG::2014-07-10 09:02:52,052::vm::676::vm.Vm::(_getDiskStats) vmId=`7fc21bb8-bd92-4924-acef-8360998e92a1`::Disk hdc stats not available >Thread-13::DEBUG::2014-07-10 09:02:52,053::vm::676::vm.Vm::(_getDiskStats) vmId=`7fc21bb8-bd92-4924-acef-8360998e92a1`::Disk vda stats not available >Thread-13::DEBUG::2014-07-10 09:02:52,053::vm::715::vm.Vm::(_getDiskLatency) vmId=`7fc21bb8-bd92-4924-acef-8360998e92a1`::Disk hdd latency not available >Thread-13::DEBUG::2014-07-10 09:02:52,053::vm::715::vm.Vm::(_getDiskLatency) vmId=`7fc21bb8-bd92-4924-acef-8360998e92a1`::Disk hdc latency not available >Thread-13::DEBUG::2014-07-10 09:02:52,053::vm::715::vm.Vm::(_getDiskLatency) vmId=`7fc21bb8-bd92-4924-acef-8360998e92a1`::Disk vda latency not available >Thread-13::DEBUG::2014-07-10 09:02:52,054::BindingXMLRPC::1074::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Powering up', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '14800', 'displayIp': '0', 'displayPort': u'5910', 'session': 'Unknown', 'displaySecurePort': u'5911', 'timeOffset': '0', 'hash': '-831008492253830849', 'balloonInfo': {'balloon_max': '1048576', 'balloon_target': '1048576', 'balloon_cur': '0', 'balloon_min': '1048576'}, 'pauseCode': 'NOERR', 'clientIp': '', 'kvmEnable': 'true', 'network': {u'vnet5': {'state': 'unknown', 'macAddr': '00:1a:4a:de:6d:7d', 'speed': '1000', 'name': u'vnet5'}}, 'vmId': '7fc21bb8-bd92-4924-acef-8360998e92a1', 'displayType': 'qxl', 'cpuUser': '0.00', 'disks': {u'vda': {'truesize': '1073741824', 'apparentsize': '1073741824', 'imageID': 'aa20346a-4d3a-4e07-b8e1-52c0ebe4168c'}, u'hdd': {'truesize': '0', 'apparentsize': '0'}, u'hdc': {'truesize': '0', 'apparentsize': '0'}}, 'monitorResponse': '0', 'statsAge': '1.51', 'elapsedTime': '5', 'vmType': 'kvm', 'cpuSys': '0.00', 'guestCPUCount': -1, 'appsList': [], 'guestIPs': ''}]} >Thread-13::DEBUG::2014-07-10 09:02:52,633::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-13::DEBUG::2014-07-10 09:02:52,634::task::595::TaskManager.Task::(_updateState) Task=`64429fa1-fef6-4aaf-aa9d-4f533b6399de`::moving from state init -> state preparing >Thread-13::INFO::2014-07-10 09:02:52,634::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-13::INFO::2014-07-10 09:02:52,635::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-13::DEBUG::2014-07-10 09:02:52,635::task::1185::TaskManager.Task::(prepare) Task=`64429fa1-fef6-4aaf-aa9d-4f533b6399de`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-13::DEBUG::2014-07-10 09:02:52,635::task::595::TaskManager.Task::(_updateState) Task=`64429fa1-fef6-4aaf-aa9d-4f533b6399de`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-07-10 09:02:52,635::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-07-10 09:02:52,636::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-07-10 09:02:52,636::task::990::TaskManager.Task::(_decref) Task=`64429fa1-fef6-4aaf-aa9d-4f533b6399de`::ref 0 aborting False >Thread-34::DEBUG::2014-07-10 09:02:52,640::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-34::DEBUG::2014-07-10 09:02:52,640::task::595::TaskManager.Task::(_updateState) Task=`e734c96f-26d5-49c1-a532-1c293c8d1a89`::moving from state init -> state preparing >Thread-34::INFO::2014-07-10 09:02:52,641::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-34::DEBUG::2014-07-10 09:02:52,643::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`885a2d34-f1a1-44fe-8fa4-a9598c57b554`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-10 09:02:52,643::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' for lock type 'shared' >Thread-34::DEBUG::2014-07-10 09:02:52,644::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-10 09:02:52,644::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`885a2d34-f1a1-44fe-8fa4-a9598c57b554`::Granted request >Thread-34::DEBUG::2014-07-10 09:02:52,645::task::827::TaskManager.Task::(resourceAcquired) Task=`e734c96f-26d5-49c1-a532-1c293c8d1a89`::_resourcesAcquired: Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee (shared) >Thread-34::DEBUG::2014-07-10 09:02:52,645::task::990::TaskManager.Task::(_decref) Task=`e734c96f-26d5-49c1-a532-1c293c8d1a89`::ref 1 aborting False >Thread-34::DEBUG::2014-07-10 09:02:52,646::lvm::373::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-34::DEBUG::2014-07-10 09:02:52,647::lvm::296::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/3600601601282300032826addbbdae311|/dev/mapper/360060160f4a030003840ec867ddee311|/dev/mapper/367cad74c2fcba00019e6afd20c781e67|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name 9e1aa540-1f4e-4ee3-a152-be381ef6c3bd' (cwd None) >Thread-34::DEBUG::2014-07-10 09:02:52,869::lvm::296::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-34::DEBUG::2014-07-10 09:02:52,871::lvm::415::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-34::INFO::2014-07-10 09:02:52,872::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1077768355840', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532069482496', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:02:52,873::task::1185::TaskManager.Task::(prepare) Task=`e734c96f-26d5-49c1-a532-1c293c8d1a89`::finished: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1077768355840', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532069482496', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:02:52,873::task::595::TaskManager.Task::(_updateState) Task=`e734c96f-26d5-49c1-a532-1c293c8d1a89`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-10 09:02:52,873::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee': < ResourceRef 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-10 09:02:52,873::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-10 09:02:52,874::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' >Thread-34::DEBUG::2014-07-10 09:02:52,874::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' (0 active users) >Thread-34::DEBUG::2014-07-10 09:02:52,874::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-10 09:02:52,875::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', Clearing records. >Thread-34::DEBUG::2014-07-10 09:02:52,875::task::990::TaskManager.Task::(_decref) Task=`e734c96f-26d5-49c1-a532-1c293c8d1a89`::ref 0 aborting False >GuestMonitor-scale_6::DEBUG::2014-07-10 09:02:52,893::vm::598::vm.Vm::(_getCpuStats) vmId=`7fc21bb8-bd92-4924-acef-8360998e92a1`::CPU stats not available: 'NoneType' object is unsubscriptable >GuestMonitor-scale_6::DEBUG::2014-07-10 09:02:52,894::vm::654::vm.Vm::(_getNetworkStats) vmId=`7fc21bb8-bd92-4924-acef-8360998e92a1`::Network stats not available >GuestMonitor-scale_6::DEBUG::2014-07-10 09:02:52,894::vm::676::vm.Vm::(_getDiskStats) vmId=`7fc21bb8-bd92-4924-acef-8360998e92a1`::Disk hdd stats not available >GuestMonitor-scale_6::DEBUG::2014-07-10 09:02:52,894::vm::676::vm.Vm::(_getDiskStats) vmId=`7fc21bb8-bd92-4924-acef-8360998e92a1`::Disk hdc stats not available >GuestMonitor-scale_6::DEBUG::2014-07-10 09:02:52,894::vm::676::vm.Vm::(_getDiskStats) vmId=`7fc21bb8-bd92-4924-acef-8360998e92a1`::Disk vda stats not available >GuestMonitor-scale_6::DEBUG::2014-07-10 09:02:52,895::vm::715::vm.Vm::(_getDiskLatency) vmId=`7fc21bb8-bd92-4924-acef-8360998e92a1`::Disk hdd latency not available >GuestMonitor-scale_6::DEBUG::2014-07-10 09:02:52,895::vm::715::vm.Vm::(_getDiskLatency) vmId=`7fc21bb8-bd92-4924-acef-8360998e92a1`::Disk hdc latency not available >GuestMonitor-scale_6::DEBUG::2014-07-10 09:02:52,895::vm::715::vm.Vm::(_getDiskLatency) vmId=`7fc21bb8-bd92-4924-acef-8360998e92a1`::Disk vda latency not available >GuestMonitor-scale_6::DEBUG::2014-07-10 09:02:52,896::vm::598::vm.Vm::(_getCpuStats) vmId=`7fc21bb8-bd92-4924-acef-8360998e92a1`::CPU stats not available: 'NoneType' object is unsubscriptable >GuestMonitor-scale_6::DEBUG::2014-07-10 09:02:52,896::vm::654::vm.Vm::(_getNetworkStats) vmId=`7fc21bb8-bd92-4924-acef-8360998e92a1`::Network stats not available >GuestMonitor-scale_6::DEBUG::2014-07-10 09:02:52,896::vm::676::vm.Vm::(_getDiskStats) vmId=`7fc21bb8-bd92-4924-acef-8360998e92a1`::Disk hdd stats not available >GuestMonitor-scale_6::DEBUG::2014-07-10 09:02:52,896::vm::676::vm.Vm::(_getDiskStats) vmId=`7fc21bb8-bd92-4924-acef-8360998e92a1`::Disk hdc stats not available >GuestMonitor-scale_6::DEBUG::2014-07-10 09:02:52,897::vm::676::vm.Vm::(_getDiskStats) vmId=`7fc21bb8-bd92-4924-acef-8360998e92a1`::Disk vda stats not available >GuestMonitor-scale_6::DEBUG::2014-07-10 09:02:52,897::vm::715::vm.Vm::(_getDiskLatency) vmId=`7fc21bb8-bd92-4924-acef-8360998e92a1`::Disk hdd latency not available >GuestMonitor-scale_6::DEBUG::2014-07-10 09:02:52,897::vm::715::vm.Vm::(_getDiskLatency) vmId=`7fc21bb8-bd92-4924-acef-8360998e92a1`::Disk hdc latency not available >GuestMonitor-scale_6::DEBUG::2014-07-10 09:02:52,897::vm::715::vm.Vm::(_getDiskLatency) vmId=`7fc21bb8-bd92-4924-acef-8360998e92a1`::Disk vda latency not available >GuestMonitor-scale_5::DEBUG::2014-07-10 09:02:52,912::vm::676::vm.Vm::(_getDiskStats) vmId=`2386fa8c-f537-495c-ae07-e178171d77f2`::Disk hdd stats not available >GuestMonitor-scale_5::DEBUG::2014-07-10 09:02:52,912::vm::676::vm.Vm::(_getDiskStats) vmId=`2386fa8c-f537-495c-ae07-e178171d77f2`::Disk hdc stats not available >GuestMonitor-scale_5::DEBUG::2014-07-10 09:02:52,912::vm::676::vm.Vm::(_getDiskStats) vmId=`2386fa8c-f537-495c-ae07-e178171d77f2`::Disk vda stats not available >GuestMonitor-scale_5::DEBUG::2014-07-10 09:02:52,913::vm::715::vm.Vm::(_getDiskLatency) vmId=`2386fa8c-f537-495c-ae07-e178171d77f2`::Disk hdd latency not available >GuestMonitor-scale_5::DEBUG::2014-07-10 09:02:52,913::vm::715::vm.Vm::(_getDiskLatency) vmId=`2386fa8c-f537-495c-ae07-e178171d77f2`::Disk hdc latency not available >GuestMonitor-scale_5::DEBUG::2014-07-10 09:02:52,913::vm::715::vm.Vm::(_getDiskLatency) vmId=`2386fa8c-f537-495c-ae07-e178171d77f2`::Disk vda latency not available >GuestMonitor-scale_5::DEBUG::2014-07-10 09:02:52,914::vm::676::vm.Vm::(_getDiskStats) vmId=`2386fa8c-f537-495c-ae07-e178171d77f2`::Disk hdd stats not available >GuestMonitor-scale_5::DEBUG::2014-07-10 09:02:52,914::vm::676::vm.Vm::(_getDiskStats) vmId=`2386fa8c-f537-495c-ae07-e178171d77f2`::Disk hdc stats not available >GuestMonitor-scale_5::DEBUG::2014-07-10 09:02:52,914::vm::676::vm.Vm::(_getDiskStats) vmId=`2386fa8c-f537-495c-ae07-e178171d77f2`::Disk vda stats not available >GuestMonitor-scale_5::DEBUG::2014-07-10 09:02:52,914::vm::715::vm.Vm::(_getDiskLatency) vmId=`2386fa8c-f537-495c-ae07-e178171d77f2`::Disk hdd latency not available >GuestMonitor-scale_5::DEBUG::2014-07-10 09:02:52,914::vm::715::vm.Vm::(_getDiskLatency) vmId=`2386fa8c-f537-495c-ae07-e178171d77f2`::Disk hdc latency not available >GuestMonitor-scale_5::DEBUG::2014-07-10 09:02:52,915::vm::715::vm.Vm::(_getDiskLatency) vmId=`2386fa8c-f537-495c-ae07-e178171d77f2`::Disk vda latency not available >GuestMonitor-scale_4::DEBUG::2014-07-10 09:02:52,990::vm::676::vm.Vm::(_getDiskStats) vmId=`0e968db5-5d49-467f-9ff3-afc37b64364f`::Disk hdd stats not available >GuestMonitor-scale_4::DEBUG::2014-07-10 09:02:52,990::vm::676::vm.Vm::(_getDiskStats) vmId=`0e968db5-5d49-467f-9ff3-afc37b64364f`::Disk hdc stats not available >GuestMonitor-scale_4::DEBUG::2014-07-10 09:02:52,990::vm::676::vm.Vm::(_getDiskStats) vmId=`0e968db5-5d49-467f-9ff3-afc37b64364f`::Disk vda stats not available >GuestMonitor-scale_4::DEBUG::2014-07-10 09:02:52,990::vm::715::vm.Vm::(_getDiskLatency) vmId=`0e968db5-5d49-467f-9ff3-afc37b64364f`::Disk hdd latency not available >GuestMonitor-scale_4::DEBUG::2014-07-10 09:02:52,991::vm::715::vm.Vm::(_getDiskLatency) vmId=`0e968db5-5d49-467f-9ff3-afc37b64364f`::Disk hdc latency not available >GuestMonitor-scale_4::DEBUG::2014-07-10 09:02:52,991::vm::715::vm.Vm::(_getDiskLatency) vmId=`0e968db5-5d49-467f-9ff3-afc37b64364f`::Disk vda latency not available >GuestMonitor-scale_4::DEBUG::2014-07-10 09:02:52,991::vm::676::vm.Vm::(_getDiskStats) vmId=`0e968db5-5d49-467f-9ff3-afc37b64364f`::Disk hdd stats not available >GuestMonitor-scale_4::DEBUG::2014-07-10 09:02:52,992::vm::676::vm.Vm::(_getDiskStats) vmId=`0e968db5-5d49-467f-9ff3-afc37b64364f`::Disk hdc stats not available >GuestMonitor-scale_4::DEBUG::2014-07-10 09:02:52,992::vm::676::vm.Vm::(_getDiskStats) vmId=`0e968db5-5d49-467f-9ff3-afc37b64364f`::Disk vda stats not available >GuestMonitor-scale_4::DEBUG::2014-07-10 09:02:52,992::vm::715::vm.Vm::(_getDiskLatency) vmId=`0e968db5-5d49-467f-9ff3-afc37b64364f`::Disk hdd latency not available >GuestMonitor-scale_4::DEBUG::2014-07-10 09:02:52,992::vm::715::vm.Vm::(_getDiskLatency) vmId=`0e968db5-5d49-467f-9ff3-afc37b64364f`::Disk hdc latency not available >GuestMonitor-scale_4::DEBUG::2014-07-10 09:02:52,992::vm::715::vm.Vm::(_getDiskLatency) vmId=`0e968db5-5d49-467f-9ff3-afc37b64364f`::Disk vda latency not available >Dummy-33::DEBUG::2014-07-10 09:02:53,942::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:02:54,018::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0250528 s, 40.9 MB/s\n'; <rc> = 0 >Thread-40::DEBUG::2014-07-10 09:02:54,455::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lion.qa.lab.tlv.redhat.com:_export_yuri2_backup2/6a70504d-00df-4869-8695-0f442053f6b6/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-40::DEBUG::2014-07-10 09:02:54,473::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n369 bytes (369 B) copied, 0.000375619 s, 982 kB/s\n'; <rc> = 0 >Thread-13::DEBUG::2014-07-10 09:02:55,104::BindingXMLRPC::1067::vds::(wrapper) client [10.35.3.13]::call vmGetStats with ('2386fa8c-f537-495c-ae07-e178171d77f2',) {} >Thread-13::DEBUG::2014-07-10 09:02:55,105::vm::676::vm.Vm::(_getDiskStats) vmId=`2386fa8c-f537-495c-ae07-e178171d77f2`::Disk hdd stats not available >Thread-13::DEBUG::2014-07-10 09:02:55,105::vm::676::vm.Vm::(_getDiskStats) vmId=`2386fa8c-f537-495c-ae07-e178171d77f2`::Disk hdc stats not available >Thread-13::DEBUG::2014-07-10 09:02:55,105::vm::676::vm.Vm::(_getDiskStats) vmId=`2386fa8c-f537-495c-ae07-e178171d77f2`::Disk vda stats not available >Thread-13::DEBUG::2014-07-10 09:02:55,105::vm::715::vm.Vm::(_getDiskLatency) vmId=`2386fa8c-f537-495c-ae07-e178171d77f2`::Disk hdd latency not available >Thread-13::DEBUG::2014-07-10 09:02:55,106::vm::715::vm.Vm::(_getDiskLatency) vmId=`2386fa8c-f537-495c-ae07-e178171d77f2`::Disk hdc latency not available >Thread-13::DEBUG::2014-07-10 09:02:55,106::vm::715::vm.Vm::(_getDiskLatency) vmId=`2386fa8c-f537-495c-ae07-e178171d77f2`::Disk vda latency not available >Thread-13::DEBUG::2014-07-10 09:02:55,106::BindingXMLRPC::1074::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Powering up', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '14143', 'displayIp': '0', 'displayPort': u'5908', 'session': 'Unknown', 'displaySecurePort': u'5909', 'timeOffset': '0', 'hash': '-2423634698834682900', 'balloonInfo': {'balloon_max': '1048576', 'balloon_target': '1048576', 'balloon_cur': '1048576', 'balloon_min': '1048576'}, 'pauseCode': 'NOERR', 'clientIp': '', 'kvmEnable': 'true', 'network': {u'vnet4': {'macAddr': '00:1a:4a:de:6d:7c', 'rxDropped': '0', 'rxErrors': '0', 'txDropped': '0', 'txRate': '0.0', 'rxRate': '0.0', 'txErrors': '0', 'state': 'unknown', 'speed': '1000', 'name': u'vnet4'}}, 'vmId': '2386fa8c-f537-495c-ae07-e178171d77f2', 'displayType': 'qxl', 'cpuUser': '45.48', 'disks': {u'vda': {'truesize': '1073741824', 'apparentsize': '1073741824', 'imageID': 'b034d5b0-e1e0-4011-b49b-4d45ddb11556'}, u'hdd': {'truesize': '0', 'apparentsize': '0'}, u'hdc': {'truesize': '0', 'apparentsize': '0'}}, 'monitorResponse': '0', 'statsAge': '0.02', 'elapsedTime': '28', 'vmType': 'kvm', 'cpuSys': '21.94', 'guestCPUCount': -1, 'appsList': [], 'guestIPs': ''}]} >Thread-13::DEBUG::2014-07-10 09:02:55,111::BindingXMLRPC::1067::vds::(wrapper) client [10.35.3.13]::call vmGetStats with ('7fc21bb8-bd92-4924-acef-8360998e92a1',) {} >Thread-13::DEBUG::2014-07-10 09:02:55,111::vm::598::vm.Vm::(_getCpuStats) vmId=`7fc21bb8-bd92-4924-acef-8360998e92a1`::CPU stats not available: 'NoneType' object is unsubscriptable >Thread-13::DEBUG::2014-07-10 09:02:55,111::vm::654::vm.Vm::(_getNetworkStats) vmId=`7fc21bb8-bd92-4924-acef-8360998e92a1`::Network stats not available >Thread-13::DEBUG::2014-07-10 09:02:55,111::vm::676::vm.Vm::(_getDiskStats) vmId=`7fc21bb8-bd92-4924-acef-8360998e92a1`::Disk hdd stats not available >Thread-13::DEBUG::2014-07-10 09:02:55,112::vm::676::vm.Vm::(_getDiskStats) vmId=`7fc21bb8-bd92-4924-acef-8360998e92a1`::Disk hdc stats not available >Thread-13::DEBUG::2014-07-10 09:02:55,112::vm::676::vm.Vm::(_getDiskStats) vmId=`7fc21bb8-bd92-4924-acef-8360998e92a1`::Disk vda stats not available >Thread-13::DEBUG::2014-07-10 09:02:55,112::vm::715::vm.Vm::(_getDiskLatency) vmId=`7fc21bb8-bd92-4924-acef-8360998e92a1`::Disk hdd latency not available >Thread-13::DEBUG::2014-07-10 09:02:55,112::vm::715::vm.Vm::(_getDiskLatency) vmId=`7fc21bb8-bd92-4924-acef-8360998e92a1`::Disk hdc latency not available >Thread-13::DEBUG::2014-07-10 09:02:55,112::vm::715::vm.Vm::(_getDiskLatency) vmId=`7fc21bb8-bd92-4924-acef-8360998e92a1`::Disk vda latency not available >Thread-13::DEBUG::2014-07-10 09:02:55,113::BindingXMLRPC::1074::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Powering up', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '14800', 'displayIp': '0', 'displayPort': u'5910', 'session': 'Unknown', 'displaySecurePort': u'5911', 'timeOffset': '0', 'hash': '-831008492253830849', 'balloonInfo': {'balloon_max': '1048576', 'balloon_target': '1048576', 'balloon_cur': '0', 'balloon_min': '1048576'}, 'pauseCode': 'NOERR', 'clientIp': '', 'kvmEnable': 'true', 'network': {u'vnet5': {'state': 'unknown', 'macAddr': '00:1a:4a:de:6d:7d', 'speed': '1000', 'name': u'vnet5'}}, 'vmId': '7fc21bb8-bd92-4924-acef-8360998e92a1', 'displayType': 'qxl', 'cpuUser': '0.00', 'disks': {u'vda': {'truesize': '1073741824', 'apparentsize': '1073741824', 'imageID': 'aa20346a-4d3a-4e07-b8e1-52c0ebe4168c'}, u'hdd': {'truesize': '0', 'apparentsize': '0'}, u'hdc': {'truesize': '0', 'apparentsize': '0'}}, 'monitorResponse': '0', 'statsAge': '0.56', 'elapsedTime': '8', 'vmType': 'kvm', 'cpuSys': '0.00', 'guestCPUCount': -1, 'appsList': [], 'guestIPs': ''}]} >Thread-13::DEBUG::2014-07-10 09:02:55,403::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-13::DEBUG::2014-07-10 09:02:55,404::task::595::TaskManager.Task::(_updateState) Task=`744474b1-a204-4bd6-a02f-14c1d53aca28`::moving from state init -> state preparing >Thread-13::INFO::2014-07-10 09:02:55,404::logUtils::44::dispatcher::(wrapper) Run and protect: getAllTasksStatuses(spUUID=None, options=None) >Thread-13::DEBUG::2014-07-10 09:02:55,405::taskManager::102::TaskManager::(getAllTasksStatuses) Entry. >Thread-13::DEBUG::2014-07-10 09:02:55,405::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 834c3ccd-bc24-4cc0-aa77-3298bd8de161 >Thread-13::DEBUG::2014-07-10 09:02:55,405::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '834c3ccd-bc24-4cc0-aa77-3298bd8de161'} >Thread-13::DEBUG::2014-07-10 09:02:55,405::taskManager::113::TaskManager::(getAllTasksStatuses) Return: {'834c3ccd-bc24-4cc0-aa77-3298bd8de161': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '834c3ccd-bc24-4cc0-aa77-3298bd8de161'}} >Thread-13::INFO::2014-07-10 09:02:55,405::logUtils::47::dispatcher::(wrapper) Run and protect: getAllTasksStatuses, Return response: {'allTasksStatus': {'834c3ccd-bc24-4cc0-aa77-3298bd8de161': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '834c3ccd-bc24-4cc0-aa77-3298bd8de161'}}} >Thread-13::DEBUG::2014-07-10 09:02:55,406::task::1185::TaskManager.Task::(prepare) Task=`744474b1-a204-4bd6-a02f-14c1d53aca28`::finished: {'allTasksStatus': {'834c3ccd-bc24-4cc0-aa77-3298bd8de161': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '834c3ccd-bc24-4cc0-aa77-3298bd8de161'}}} >Thread-13::DEBUG::2014-07-10 09:02:55,406::task::595::TaskManager.Task::(_updateState) Task=`744474b1-a204-4bd6-a02f-14c1d53aca28`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-07-10 09:02:55,406::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-07-10 09:02:55,406::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-07-10 09:02:55,406::task::990::TaskManager.Task::(_decref) Task=`744474b1-a204-4bd6-a02f-14c1d53aca28`::ref 0 aborting False >834c3ccd-bc24-4cc0-aa77-3298bd8de161::DEBUG::2014-07-10 09:02:55,815::lvm::296::Storage.Misc.excCmd::(cmd) FAILED: <err> = ' Logical volume 9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/47592965-e853-4e59-9728-d11cca6a7a8a in use.\n'; <rc> = 5 >834c3ccd-bc24-4cc0-aa77-3298bd8de161::DEBUG::2014-07-10 09:02:55,819::lvm::513::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >834c3ccd-bc24-4cc0-aa77-3298bd8de161::DEBUG::2014-07-10 09:02:55,820::lvm::525::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >834c3ccd-bc24-4cc0-aa77-3298bd8de161::WARNING::2014-07-10 09:02:55,820::resourceFactories::61::Storage.ResourcesFactories::(close) Failure deactivate LV 9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/47592965-e853-4e59-9728-d11cca6a7a8a (Cannot deactivate Logical Volume: ('General Storage Exception: ("5 [] [\' Logical volume 9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/47592965-e853-4e59-9728-d11cca6a7a8a in use.\']\\n9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/[\'47592965-e853-4e59-9728-d11cca6a7a8a\']",)',)) >834c3ccd-bc24-4cc0-aa77-3298bd8de161::DEBUG::2014-07-10 09:02:55,820::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd_lvmActivationNS.47592965-e853-4e59-9728-d11cca6a7a8a', Clearing records. >834c3ccd-bc24-4cc0-aa77-3298bd8de161::DEBUG::2014-07-10 09:02:55,821::lvm::427::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' got the operation mutex >834c3ccd-bc24-4cc0-aa77-3298bd8de161::DEBUG::2014-07-10 09:02:55,821::lvm::296::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm lvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/3600601601282300032826addbbdae311|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,vg_name,attr,size,seg_start_pe,devices,tags 9e1aa540-1f4e-4ee3-a152-be381ef6c3bd' (cwd None) >834c3ccd-bc24-4cc0-aa77-3298bd8de161::DEBUG::2014-07-10 09:02:56,013::lvm::296::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >834c3ccd-bc24-4cc0-aa77-3298bd8de161::DEBUG::2014-07-10 09:02:56,027::lvm::462::Storage.LVM::(_reloadlvs) lvs reloaded >834c3ccd-bc24-4cc0-aa77-3298bd8de161::DEBUG::2014-07-10 09:02:56,027::lvm::462::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' released the operation mutex >834c3ccd-bc24-4cc0-aa77-3298bd8de161::DEBUG::2014-07-10 09:02:56,028::lvm::427::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' got the operation mutex >834c3ccd-bc24-4cc0-aa77-3298bd8de161::DEBUG::2014-07-10 09:02:56,028::lvm::296::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm lvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/3600601601282300032826addbbdae311|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,vg_name,attr,size,seg_start_pe,devices,tags 9e1aa540-1f4e-4ee3-a152-be381ef6c3bd' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:02:56,047::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:02:56,153::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0472484 s, 21.7 MB/s\n'; <rc> = 0 >834c3ccd-bc24-4cc0-aa77-3298bd8de161::DEBUG::2014-07-10 09:02:56,223::lvm::296::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >834c3ccd-bc24-4cc0-aa77-3298bd8de161::DEBUG::2014-07-10 09:02:56,237::lvm::462::Storage.LVM::(_reloadlvs) lvs reloaded >834c3ccd-bc24-4cc0-aa77-3298bd8de161::DEBUG::2014-07-10 09:02:56,238::lvm::462::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' released the operation mutex >834c3ccd-bc24-4cc0-aa77-3298bd8de161::WARNING::2014-07-10 09:02:56,238::blockSD::761::Storage.StorageDomain::(_getOccupiedMetadataSlots) Could not find mapping for lv 9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/b0fbb3c9-55af-4a3a-95ad-fc56a80b9cf5 >834c3ccd-bc24-4cc0-aa77-3298bd8de161::DEBUG::2014-07-10 09:02:56,238::blockSD::784::Storage.StorageDomain::(getFreeMetadataSlot) Found freeSlot 11 in VG 9e1aa540-1f4e-4ee3-a152-be381ef6c3bd >834c3ccd-bc24-4cc0-aa77-3298bd8de161::DEBUG::2014-07-10 09:02:56,239::lvm::296::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm lvchange --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/3600601601282300032826addbbdae311|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } " --autobackup n --deltag OVIRT_VOL_INITIALIZING --addtag PU_47592965-e853-4e59-9728-d11cca6a7a8a --addtag IU_f30c2cb7-a43a-4bf5-82b5-cfe07336f65c --addtag MD_11 9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/b0fbb3c9-55af-4a3a-95ad-fc56a80b9cf5' (cwd None) >834c3ccd-bc24-4cc0-aa77-3298bd8de161::DEBUG::2014-07-10 09:02:56,549::lvm::296::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ' WARNING: This metadata update is NOT backed up\n WARNING: This metadata update is NOT backed up\n'; <rc> = 0 >834c3ccd-bc24-4cc0-aa77-3298bd8de161::DEBUG::2014-07-10 09:02:56,550::lvm::513::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >834c3ccd-bc24-4cc0-aa77-3298bd8de161::DEBUG::2014-07-10 09:02:56,562::lvm::525::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >834c3ccd-bc24-4cc0-aa77-3298bd8de161::DEBUG::2014-07-10 09:02:56,563::lvm::296::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm lvchange --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/3600601601282300032826addbbdae311|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } " --autobackup n --available n 9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/b0fbb3c9-55af-4a3a-95ad-fc56a80b9cf5' (cwd None) >834c3ccd-bc24-4cc0-aa77-3298bd8de161::DEBUG::2014-07-10 09:02:56,982::lvm::296::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >834c3ccd-bc24-4cc0-aa77-3298bd8de161::DEBUG::2014-07-10 09:02:56,983::lvm::513::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >834c3ccd-bc24-4cc0-aa77-3298bd8de161::DEBUG::2014-07-10 09:02:56,983::lvm::525::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >834c3ccd-bc24-4cc0-aa77-3298bd8de161::DEBUG::2014-07-10 09:02:56,985::task::752::TaskManager.Task::(_save) Task=`834c3ccd-bc24-4cc0-aa77-3298bd8de161`::_save: orig /rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/master/tasks/834c3ccd-bc24-4cc0-aa77-3298bd8de161 temp /rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/master/tasks/834c3ccd-bc24-4cc0-aa77-3298bd8de161.temp >834c3ccd-bc24-4cc0-aa77-3298bd8de161::DEBUG::2014-07-10 09:02:56,997::blockVolume::604::Storage.Volume::(newVolumeLease) Initializing volume lease volUUID=b0fbb3c9-55af-4a3a-95ad-fc56a80b9cf5 sdUUID=9e1aa540-1f4e-4ee3-a152-be381ef6c3bd, metaId=('9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 11) >834c3ccd-bc24-4cc0-aa77-3298bd8de161::DEBUG::2014-07-10 09:02:57,004::task::752::TaskManager.Task::(_save) Task=`834c3ccd-bc24-4cc0-aa77-3298bd8de161`::_save: orig /rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/master/tasks/834c3ccd-bc24-4cc0-aa77-3298bd8de161 temp /rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/master/tasks/834c3ccd-bc24-4cc0-aa77-3298bd8de161.temp >834c3ccd-bc24-4cc0-aa77-3298bd8de161::DEBUG::2014-07-10 09:02:57,013::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd_imageNS.f30c2cb7-a43a-4bf5-82b5-cfe07336f65c' >834c3ccd-bc24-4cc0-aa77-3298bd8de161::DEBUG::2014-07-10 09:02:57,013::resourceManager::635::ResourceManager::(releaseResource) Released resource '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd_imageNS.f30c2cb7-a43a-4bf5-82b5-cfe07336f65c' (0 active users) >834c3ccd-bc24-4cc0-aa77-3298bd8de161::DEBUG::2014-07-10 09:02:57,014::resourceManager::641::ResourceManager::(releaseResource) Resource '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd_imageNS.f30c2cb7-a43a-4bf5-82b5-cfe07336f65c' is free, finding out if anyone is waiting for it. >834c3ccd-bc24-4cc0-aa77-3298bd8de161::DEBUG::2014-07-10 09:02:57,014::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd_imageNS.f30c2cb7-a43a-4bf5-82b5-cfe07336f65c', Clearing records. >834c3ccd-bc24-4cc0-aa77-3298bd8de161::DEBUG::2014-07-10 09:02:57,014::task::595::TaskManager.Task::(_updateState) Task=`834c3ccd-bc24-4cc0-aa77-3298bd8de161`::moving from state running -> state finished >834c3ccd-bc24-4cc0-aa77-3298bd8de161::DEBUG::2014-07-10 09:02:57,015::task::752::TaskManager.Task::(_save) Task=`834c3ccd-bc24-4cc0-aa77-3298bd8de161`::_save: orig /rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/master/tasks/834c3ccd-bc24-4cc0-aa77-3298bd8de161 temp /rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/master/tasks/834c3ccd-bc24-4cc0-aa77-3298bd8de161.temp >834c3ccd-bc24-4cc0-aa77-3298bd8de161::DEBUG::2014-07-10 09:02:57,024::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': < ResourceRef 'Storage.9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', isValid: 'True' obj: 'None'>} >834c3ccd-bc24-4cc0-aa77-3298bd8de161::DEBUG::2014-07-10 09:02:57,025::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >834c3ccd-bc24-4cc0-aa77-3298bd8de161::DEBUG::2014-07-10 09:02:57,025::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.9e1aa540-1f4e-4ee3-a152-be381ef6c3bd' >834c3ccd-bc24-4cc0-aa77-3298bd8de161::DEBUG::2014-07-10 09:02:57,025::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.9e1aa540-1f4e-4ee3-a152-be381ef6c3bd' (0 active users) >834c3ccd-bc24-4cc0-aa77-3298bd8de161::DEBUG::2014-07-10 09:02:57,026::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.9e1aa540-1f4e-4ee3-a152-be381ef6c3bd' is free, finding out if anyone is waiting for it. >834c3ccd-bc24-4cc0-aa77-3298bd8de161::DEBUG::2014-07-10 09:02:57,026::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', Clearing records. >834c3ccd-bc24-4cc0-aa77-3298bd8de161::DEBUG::2014-07-10 09:02:57,026::task::913::TaskManager.Task::(_runJobs) Task=`834c3ccd-bc24-4cc0-aa77-3298bd8de161`::Task.run: exit - success: result {'uuid': 'b0fbb3c9-55af-4a3a-95ad-fc56a80b9cf5'} >834c3ccd-bc24-4cc0-aa77-3298bd8de161::DEBUG::2014-07-10 09:02:57,026::task::990::TaskManager.Task::(_decref) Task=`834c3ccd-bc24-4cc0-aa77-3298bd8de161`::ref 0 aborting False >834c3ccd-bc24-4cc0-aa77-3298bd8de161::DEBUG::2014-07-10 09:02:57,026::threadPool::57::Misc.ThreadPool::(setRunningTask) Number of running tasks: 0 >Thread-18::DEBUG::2014-07-10 09:02:57,162::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/metadata bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-10 09:02:57,179::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000538364 s, 7.6 MB/s\n'; <rc> = 0 >GuestMonitor-scale_6::DEBUG::2014-07-10 09:02:57,904::vm::598::vm.Vm::(_getCpuStats) vmId=`7fc21bb8-bd92-4924-acef-8360998e92a1`::CPU stats not available: 'NoneType' object is unsubscriptable >GuestMonitor-scale_6::DEBUG::2014-07-10 09:02:57,905::vm::654::vm.Vm::(_getNetworkStats) vmId=`7fc21bb8-bd92-4924-acef-8360998e92a1`::Network stats not available >GuestMonitor-scale_6::DEBUG::2014-07-10 09:02:57,905::vm::676::vm.Vm::(_getDiskStats) vmId=`7fc21bb8-bd92-4924-acef-8360998e92a1`::Disk hdd stats not available >GuestMonitor-scale_6::DEBUG::2014-07-10 09:02:57,906::vm::676::vm.Vm::(_getDiskStats) vmId=`7fc21bb8-bd92-4924-acef-8360998e92a1`::Disk hdc stats not available >GuestMonitor-scale_6::DEBUG::2014-07-10 09:02:57,906::vm::676::vm.Vm::(_getDiskStats) vmId=`7fc21bb8-bd92-4924-acef-8360998e92a1`::Disk vda stats not available >GuestMonitor-scale_6::DEBUG::2014-07-10 09:02:57,906::vm::715::vm.Vm::(_getDiskLatency) vmId=`7fc21bb8-bd92-4924-acef-8360998e92a1`::Disk hdd latency not available >GuestMonitor-scale_6::DEBUG::2014-07-10 09:02:57,907::vm::715::vm.Vm::(_getDiskLatency) vmId=`7fc21bb8-bd92-4924-acef-8360998e92a1`::Disk hdc latency not available >GuestMonitor-scale_6::DEBUG::2014-07-10 09:02:57,907::vm::715::vm.Vm::(_getDiskLatency) vmId=`7fc21bb8-bd92-4924-acef-8360998e92a1`::Disk vda latency not available >GuestMonitor-scale_6::DEBUG::2014-07-10 09:02:57,908::vm::598::vm.Vm::(_getCpuStats) vmId=`7fc21bb8-bd92-4924-acef-8360998e92a1`::CPU stats not available: 'NoneType' object is unsubscriptable >GuestMonitor-scale_6::DEBUG::2014-07-10 09:02:57,908::vm::654::vm.Vm::(_getNetworkStats) vmId=`7fc21bb8-bd92-4924-acef-8360998e92a1`::Network stats not available >GuestMonitor-scale_6::DEBUG::2014-07-10 09:02:57,909::vm::676::vm.Vm::(_getDiskStats) vmId=`7fc21bb8-bd92-4924-acef-8360998e92a1`::Disk hdd stats not available >GuestMonitor-scale_6::DEBUG::2014-07-10 09:02:57,909::vm::676::vm.Vm::(_getDiskStats) vmId=`7fc21bb8-bd92-4924-acef-8360998e92a1`::Disk hdc stats not available >GuestMonitor-scale_6::DEBUG::2014-07-10 09:02:57,909::vm::676::vm.Vm::(_getDiskStats) vmId=`7fc21bb8-bd92-4924-acef-8360998e92a1`::Disk vda stats not available >GuestMonitor-scale_6::DEBUG::2014-07-10 09:02:57,910::vm::715::vm.Vm::(_getDiskLatency) vmId=`7fc21bb8-bd92-4924-acef-8360998e92a1`::Disk hdd latency not available >GuestMonitor-scale_6::DEBUG::2014-07-10 09:02:57,910::vm::715::vm.Vm::(_getDiskLatency) vmId=`7fc21bb8-bd92-4924-acef-8360998e92a1`::Disk hdc latency not available >GuestMonitor-scale_6::DEBUG::2014-07-10 09:02:57,910::vm::715::vm.Vm::(_getDiskLatency) vmId=`7fc21bb8-bd92-4924-acef-8360998e92a1`::Disk vda latency not available >GuestMonitor-scale_5::DEBUG::2014-07-10 09:02:57,922::vm::676::vm.Vm::(_getDiskStats) vmId=`2386fa8c-f537-495c-ae07-e178171d77f2`::Disk hdd stats not available >GuestMonitor-scale_5::DEBUG::2014-07-10 09:02:57,924::vm::676::vm.Vm::(_getDiskStats) vmId=`2386fa8c-f537-495c-ae07-e178171d77f2`::Disk hdc stats not available >GuestMonitor-scale_5::DEBUG::2014-07-10 09:02:57,925::vm::676::vm.Vm::(_getDiskStats) vmId=`2386fa8c-f537-495c-ae07-e178171d77f2`::Disk vda stats not available >GuestMonitor-scale_5::DEBUG::2014-07-10 09:02:57,925::vm::715::vm.Vm::(_getDiskLatency) vmId=`2386fa8c-f537-495c-ae07-e178171d77f2`::Disk hdd latency not available >GuestMonitor-scale_5::DEBUG::2014-07-10 09:02:57,926::vm::715::vm.Vm::(_getDiskLatency) vmId=`2386fa8c-f537-495c-ae07-e178171d77f2`::Disk hdc latency not available >GuestMonitor-scale_5::DEBUG::2014-07-10 09:02:57,926::vm::715::vm.Vm::(_getDiskLatency) vmId=`2386fa8c-f537-495c-ae07-e178171d77f2`::Disk vda latency not available >GuestMonitor-scale_5::DEBUG::2014-07-10 09:02:57,927::vm::676::vm.Vm::(_getDiskStats) vmId=`2386fa8c-f537-495c-ae07-e178171d77f2`::Disk hdd stats not available >GuestMonitor-scale_5::DEBUG::2014-07-10 09:02:57,928::vm::676::vm.Vm::(_getDiskStats) vmId=`2386fa8c-f537-495c-ae07-e178171d77f2`::Disk hdc stats not available >GuestMonitor-scale_5::DEBUG::2014-07-10 09:02:57,928::vm::676::vm.Vm::(_getDiskStats) vmId=`2386fa8c-f537-495c-ae07-e178171d77f2`::Disk vda stats not available >GuestMonitor-scale_5::DEBUG::2014-07-10 09:02:57,928::vm::715::vm.Vm::(_getDiskLatency) vmId=`2386fa8c-f537-495c-ae07-e178171d77f2`::Disk hdd latency not available >GuestMonitor-scale_5::DEBUG::2014-07-10 09:02:57,929::vm::715::vm.Vm::(_getDiskLatency) vmId=`2386fa8c-f537-495c-ae07-e178171d77f2`::Disk hdc latency not available >GuestMonitor-scale_5::DEBUG::2014-07-10 09:02:57,929::vm::715::vm.Vm::(_getDiskLatency) vmId=`2386fa8c-f537-495c-ae07-e178171d77f2`::Disk vda latency not available >GuestMonitor-scale_4::DEBUG::2014-07-10 09:02:57,995::vm::676::vm.Vm::(_getDiskStats) vmId=`0e968db5-5d49-467f-9ff3-afc37b64364f`::Disk hdd stats not available >GuestMonitor-scale_4::DEBUG::2014-07-10 09:02:57,996::vm::676::vm.Vm::(_getDiskStats) vmId=`0e968db5-5d49-467f-9ff3-afc37b64364f`::Disk hdc stats not available >GuestMonitor-scale_4::DEBUG::2014-07-10 09:02:57,996::vm::676::vm.Vm::(_getDiskStats) vmId=`0e968db5-5d49-467f-9ff3-afc37b64364f`::Disk vda stats not available >GuestMonitor-scale_4::DEBUG::2014-07-10 09:02:57,996::vm::715::vm.Vm::(_getDiskLatency) vmId=`0e968db5-5d49-467f-9ff3-afc37b64364f`::Disk hdd latency not available >GuestMonitor-scale_4::DEBUG::2014-07-10 09:02:57,997::vm::715::vm.Vm::(_getDiskLatency) vmId=`0e968db5-5d49-467f-9ff3-afc37b64364f`::Disk hdc latency not available >GuestMonitor-scale_4::DEBUG::2014-07-10 09:02:57,997::vm::715::vm.Vm::(_getDiskLatency) vmId=`0e968db5-5d49-467f-9ff3-afc37b64364f`::Disk vda latency not available >GuestMonitor-scale_4::DEBUG::2014-07-10 09:02:57,997::vm::676::vm.Vm::(_getDiskStats) vmId=`0e968db5-5d49-467f-9ff3-afc37b64364f`::Disk hdd stats not available >GuestMonitor-scale_4::DEBUG::2014-07-10 09:02:57,998::vm::676::vm.Vm::(_getDiskStats) vmId=`0e968db5-5d49-467f-9ff3-afc37b64364f`::Disk hdc stats not available >GuestMonitor-scale_4::DEBUG::2014-07-10 09:02:57,998::vm::676::vm.Vm::(_getDiskStats) vmId=`0e968db5-5d49-467f-9ff3-afc37b64364f`::Disk vda stats not available >GuestMonitor-scale_4::DEBUG::2014-07-10 09:02:57,998::vm::715::vm.Vm::(_getDiskLatency) vmId=`0e968db5-5d49-467f-9ff3-afc37b64364f`::Disk hdd latency not available >GuestMonitor-scale_4::DEBUG::2014-07-10 09:02:57,998::vm::715::vm.Vm::(_getDiskLatency) vmId=`0e968db5-5d49-467f-9ff3-afc37b64364f`::Disk hdc latency not available >GuestMonitor-scale_4::DEBUG::2014-07-10 09:02:57,998::vm::715::vm.Vm::(_getDiskLatency) vmId=`0e968db5-5d49-467f-9ff3-afc37b64364f`::Disk vda latency not available >Thread-13::DEBUG::2014-07-10 09:02:58,126::BindingXMLRPC::1067::vds::(wrapper) client [10.35.3.13]::call vmGetStats with ('2386fa8c-f537-495c-ae07-e178171d77f2',) {} >Thread-13::DEBUG::2014-07-10 09:02:58,127::vm::676::vm.Vm::(_getDiskStats) vmId=`2386fa8c-f537-495c-ae07-e178171d77f2`::Disk hdd stats not available >Thread-13::DEBUG::2014-07-10 09:02:58,127::vm::676::vm.Vm::(_getDiskStats) vmId=`2386fa8c-f537-495c-ae07-e178171d77f2`::Disk hdc stats not available >Thread-13::DEBUG::2014-07-10 09:02:58,128::vm::676::vm.Vm::(_getDiskStats) vmId=`2386fa8c-f537-495c-ae07-e178171d77f2`::Disk vda stats not available >Thread-13::DEBUG::2014-07-10 09:02:58,128::vm::715::vm.Vm::(_getDiskLatency) vmId=`2386fa8c-f537-495c-ae07-e178171d77f2`::Disk hdd latency not available >Thread-13::DEBUG::2014-07-10 09:02:58,128::vm::715::vm.Vm::(_getDiskLatency) vmId=`2386fa8c-f537-495c-ae07-e178171d77f2`::Disk hdc latency not available >Thread-13::DEBUG::2014-07-10 09:02:58,128::vm::715::vm.Vm::(_getDiskLatency) vmId=`2386fa8c-f537-495c-ae07-e178171d77f2`::Disk vda latency not available >Thread-13::DEBUG::2014-07-10 09:02:58,129::BindingXMLRPC::1074::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Powering up', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '14143', 'displayIp': '0', 'displayPort': u'5908', 'session': 'Unknown', 'displaySecurePort': u'5909', 'timeOffset': '0', 'hash': '-2423634698834682900', 'balloonInfo': {'balloon_max': '1048576', 'balloon_target': '1048576', 'balloon_cur': '1048576', 'balloon_min': '1048576'}, 'pauseCode': 'NOERR', 'clientIp': '', 'kvmEnable': 'true', 'network': {u'vnet4': {'macAddr': '00:1a:4a:de:6d:7c', 'rxDropped': '0', 'rxErrors': '0', 'txDropped': '0', 'txRate': '0.0', 'rxRate': '0.0', 'txErrors': '0', 'state': 'unknown', 'speed': '1000', 'name': u'vnet4'}}, 'vmId': '2386fa8c-f537-495c-ae07-e178171d77f2', 'displayType': 'qxl', 'cpuUser': '45.48', 'disks': {u'vda': {'truesize': '1073741824', 'apparentsize': '1073741824', 'imageID': 'b034d5b0-e1e0-4011-b49b-4d45ddb11556'}, u'hdd': {'truesize': '0', 'apparentsize': '0'}, u'hdc': {'truesize': '0', 'apparentsize': '0'}}, 'monitorResponse': '0', 'statsAge': '1.03', 'elapsedTime': '31', 'vmType': 'kvm', 'cpuSys': '21.94', 'guestCPUCount': -1, 'appsList': [], 'guestIPs': ''}]} >Thread-13::DEBUG::2014-07-10 09:02:58,133::BindingXMLRPC::1067::vds::(wrapper) client [10.35.3.13]::call vmGetStats with ('7fc21bb8-bd92-4924-acef-8360998e92a1',) {} >Thread-13::DEBUG::2014-07-10 09:02:58,133::vm::598::vm.Vm::(_getCpuStats) vmId=`7fc21bb8-bd92-4924-acef-8360998e92a1`::CPU stats not available: 'NoneType' object is unsubscriptable >Thread-13::DEBUG::2014-07-10 09:02:58,133::vm::654::vm.Vm::(_getNetworkStats) vmId=`7fc21bb8-bd92-4924-acef-8360998e92a1`::Network stats not available >Thread-13::DEBUG::2014-07-10 09:02:58,134::vm::676::vm.Vm::(_getDiskStats) vmId=`7fc21bb8-bd92-4924-acef-8360998e92a1`::Disk hdd stats not available >Thread-13::DEBUG::2014-07-10 09:02:58,134::vm::676::vm.Vm::(_getDiskStats) vmId=`7fc21bb8-bd92-4924-acef-8360998e92a1`::Disk hdc stats not available >Thread-13::DEBUG::2014-07-10 09:02:58,134::vm::676::vm.Vm::(_getDiskStats) vmId=`7fc21bb8-bd92-4924-acef-8360998e92a1`::Disk vda stats not available >Thread-13::DEBUG::2014-07-10 09:02:58,134::vm::715::vm.Vm::(_getDiskLatency) vmId=`7fc21bb8-bd92-4924-acef-8360998e92a1`::Disk hdd latency not available >Thread-13::DEBUG::2014-07-10 09:02:58,134::vm::715::vm.Vm::(_getDiskLatency) vmId=`7fc21bb8-bd92-4924-acef-8360998e92a1`::Disk hdc latency not available >Thread-13::DEBUG::2014-07-10 09:02:58,135::vm::715::vm.Vm::(_getDiskLatency) vmId=`7fc21bb8-bd92-4924-acef-8360998e92a1`::Disk vda latency not available >Thread-13::DEBUG::2014-07-10 09:02:58,135::BindingXMLRPC::1074::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Powering up', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '14800', 'displayIp': '0', 'displayPort': u'5910', 'session': 'Unknown', 'displaySecurePort': u'5911', 'timeOffset': '0', 'hash': '-831008492253830849', 'balloonInfo': {'balloon_max': '1048576', 'balloon_target': '1048576', 'balloon_cur': '0', 'balloon_min': '1048576'}, 'pauseCode': 'NOERR', 'clientIp': '', 'kvmEnable': 'true', 'network': {u'vnet5': {'state': 'unknown', 'macAddr': '00:1a:4a:de:6d:7d', 'speed': '1000', 'name': u'vnet5'}}, 'vmId': '7fc21bb8-bd92-4924-acef-8360998e92a1', 'displayType': 'qxl', 'cpuUser': '0.00', 'disks': {u'vda': {'truesize': '1073741824', 'apparentsize': '1073741824', 'imageID': 'aa20346a-4d3a-4e07-b8e1-52c0ebe4168c'}, u'hdd': {'truesize': '0', 'apparentsize': '0'}, u'hdc': {'truesize': '0', 'apparentsize': '0'}}, 'monitorResponse': '0', 'statsAge': '1.55', 'elapsedTime': '11', 'vmType': 'kvm', 'cpuSys': '0.00', 'guestCPUCount': -1, 'appsList': [], 'guestIPs': ''}]} >Dummy-33::DEBUG::2014-07-10 09:02:58,168::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:02:58,298::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0599 s, 17.1 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-07-10 09:03:00,281::vmChannels::95::vds::(_handle_timeouts) Timeout on fileno 65. >Dummy-33::DEBUG::2014-07-10 09:03:00,313::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:03:00,409::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0420187 s, 24.4 MB/s\n'; <rc> = 0 >Thread-13::DEBUG::2014-07-10 09:03:01,160::task::595::TaskManager.Task::(_updateState) Task=`aa108ebf-8290-4da5-8d3a-97287d48f6d7`::moving from state init -> state preparing >Thread-13::INFO::2014-07-10 09:03:01,162::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-13::INFO::2014-07-10 09:03:01,163::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000538364', 'lastCheck': '4.0', 'valid': True}, '6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000375619', 'lastCheck': '6.7', 'valid': True}} >Thread-13::DEBUG::2014-07-10 09:03:01,163::task::1185::TaskManager.Task::(prepare) Task=`aa108ebf-8290-4da5-8d3a-97287d48f6d7`::finished: {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000538364', 'lastCheck': '4.0', 'valid': True}, '6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000375619', 'lastCheck': '6.7', 'valid': True}} >Thread-13::DEBUG::2014-07-10 09:03:01,163::task::595::TaskManager.Task::(_updateState) Task=`aa108ebf-8290-4da5-8d3a-97287d48f6d7`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-07-10 09:03:01,164::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-07-10 09:03:01,164::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-07-10 09:03:01,164::task::990::TaskManager.Task::(_decref) Task=`aa108ebf-8290-4da5-8d3a-97287d48f6d7`::ref 0 aborting False >Thread-13::DEBUG::2014-07-10 09:03:01,177::vm::598::vm.Vm::(_getCpuStats) vmId=`7fc21bb8-bd92-4924-acef-8360998e92a1`::CPU stats not available: 'NoneType' object is unsubscriptable >Thread-13::DEBUG::2014-07-10 09:03:01,178::vm::654::vm.Vm::(_getNetworkStats) vmId=`7fc21bb8-bd92-4924-acef-8360998e92a1`::Network stats not available >Thread-13::DEBUG::2014-07-10 09:03:01,178::vm::676::vm.Vm::(_getDiskStats) vmId=`7fc21bb8-bd92-4924-acef-8360998e92a1`::Disk hdd stats not available >Thread-13::DEBUG::2014-07-10 09:03:01,178::vm::676::vm.Vm::(_getDiskStats) vmId=`7fc21bb8-bd92-4924-acef-8360998e92a1`::Disk hdc stats not available >Thread-13::DEBUG::2014-07-10 09:03:01,178::vm::676::vm.Vm::(_getDiskStats) vmId=`7fc21bb8-bd92-4924-acef-8360998e92a1`::Disk vda stats not available >Thread-13::DEBUG::2014-07-10 09:03:01,178::vm::715::vm.Vm::(_getDiskLatency) vmId=`7fc21bb8-bd92-4924-acef-8360998e92a1`::Disk hdd latency not available >Thread-13::DEBUG::2014-07-10 09:03:01,179::vm::715::vm.Vm::(_getDiskLatency) vmId=`7fc21bb8-bd92-4924-acef-8360998e92a1`::Disk hdc latency not available >Thread-13::DEBUG::2014-07-10 09:03:01,179::vm::715::vm.Vm::(_getDiskLatency) vmId=`7fc21bb8-bd92-4924-acef-8360998e92a1`::Disk vda latency not available >Thread-13::DEBUG::2014-07-10 09:03:01,181::vm::676::vm.Vm::(_getDiskStats) vmId=`0e968db5-5d49-467f-9ff3-afc37b64364f`::Disk hdd stats not available >Thread-13::DEBUG::2014-07-10 09:03:01,181::vm::676::vm.Vm::(_getDiskStats) vmId=`0e968db5-5d49-467f-9ff3-afc37b64364f`::Disk hdc stats not available >Thread-13::DEBUG::2014-07-10 09:03:01,181::vm::676::vm.Vm::(_getDiskStats) vmId=`0e968db5-5d49-467f-9ff3-afc37b64364f`::Disk vda stats not available >Thread-13::DEBUG::2014-07-10 09:03:01,182::vm::715::vm.Vm::(_getDiskLatency) vmId=`0e968db5-5d49-467f-9ff3-afc37b64364f`::Disk hdd latency not available >Thread-13::DEBUG::2014-07-10 09:03:01,182::vm::715::vm.Vm::(_getDiskLatency) vmId=`0e968db5-5d49-467f-9ff3-afc37b64364f`::Disk hdc latency not available >Thread-13::DEBUG::2014-07-10 09:03:01,182::vm::715::vm.Vm::(_getDiskLatency) vmId=`0e968db5-5d49-467f-9ff3-afc37b64364f`::Disk vda latency not available >Thread-13::DEBUG::2014-07-10 09:03:01,183::vm::676::vm.Vm::(_getDiskStats) vmId=`2386fa8c-f537-495c-ae07-e178171d77f2`::Disk hdd stats not available >Thread-13::DEBUG::2014-07-10 09:03:01,183::vm::676::vm.Vm::(_getDiskStats) vmId=`2386fa8c-f537-495c-ae07-e178171d77f2`::Disk hdc stats not available >Thread-13::DEBUG::2014-07-10 09:03:01,183::vm::676::vm.Vm::(_getDiskStats) vmId=`2386fa8c-f537-495c-ae07-e178171d77f2`::Disk vda stats not available >Thread-13::DEBUG::2014-07-10 09:03:01,183::vm::715::vm.Vm::(_getDiskLatency) vmId=`2386fa8c-f537-495c-ae07-e178171d77f2`::Disk hdd latency not available >Thread-13::DEBUG::2014-07-10 09:03:01,183::vm::715::vm.Vm::(_getDiskLatency) vmId=`2386fa8c-f537-495c-ae07-e178171d77f2`::Disk hdc latency not available >Thread-13::DEBUG::2014-07-10 09:03:01,184::vm::715::vm.Vm::(_getDiskLatency) vmId=`2386fa8c-f537-495c-ae07-e178171d77f2`::Disk vda latency not available >Dummy-33::DEBUG::2014-07-10 09:03:02,424::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:03:02,527::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0488447 s, 21.0 MB/s\n'; <rc> = 0 >GuestMonitor-scale_6::DEBUG::2014-07-10 09:03:02,917::vm::598::vm.Vm::(_getCpuStats) vmId=`7fc21bb8-bd92-4924-acef-8360998e92a1`::CPU stats not available: 'NoneType' object is unsubscriptable >GuestMonitor-scale_6::DEBUG::2014-07-10 09:03:02,918::vm::654::vm.Vm::(_getNetworkStats) vmId=`7fc21bb8-bd92-4924-acef-8360998e92a1`::Network stats not available >GuestMonitor-scale_6::DEBUG::2014-07-10 09:03:02,918::vm::676::vm.Vm::(_getDiskStats) vmId=`7fc21bb8-bd92-4924-acef-8360998e92a1`::Disk hdd stats not available >GuestMonitor-scale_6::DEBUG::2014-07-10 09:03:02,918::vm::676::vm.Vm::(_getDiskStats) vmId=`7fc21bb8-bd92-4924-acef-8360998e92a1`::Disk hdc stats not available >GuestMonitor-scale_6::DEBUG::2014-07-10 09:03:02,918::vm::676::vm.Vm::(_getDiskStats) vmId=`7fc21bb8-bd92-4924-acef-8360998e92a1`::Disk vda stats not available >GuestMonitor-scale_6::DEBUG::2014-07-10 09:03:02,919::vm::715::vm.Vm::(_getDiskLatency) vmId=`7fc21bb8-bd92-4924-acef-8360998e92a1`::Disk hdd latency not available >GuestMonitor-scale_6::DEBUG::2014-07-10 09:03:02,919::vm::715::vm.Vm::(_getDiskLatency) vmId=`7fc21bb8-bd92-4924-acef-8360998e92a1`::Disk hdc latency not available >GuestMonitor-scale_6::DEBUG::2014-07-10 09:03:02,919::vm::715::vm.Vm::(_getDiskLatency) vmId=`7fc21bb8-bd92-4924-acef-8360998e92a1`::Disk vda latency not available >GuestMonitor-scale_6::DEBUG::2014-07-10 09:03:02,919::vm::598::vm.Vm::(_getCpuStats) vmId=`7fc21bb8-bd92-4924-acef-8360998e92a1`::CPU stats not available: 'NoneType' object is unsubscriptable >GuestMonitor-scale_6::DEBUG::2014-07-10 09:03:02,920::vm::654::vm.Vm::(_getNetworkStats) vmId=`7fc21bb8-bd92-4924-acef-8360998e92a1`::Network stats not available >GuestMonitor-scale_6::DEBUG::2014-07-10 09:03:02,920::vm::676::vm.Vm::(_getDiskStats) vmId=`7fc21bb8-bd92-4924-acef-8360998e92a1`::Disk hdd stats not available >GuestMonitor-scale_6::DEBUG::2014-07-10 09:03:02,920::vm::676::vm.Vm::(_getDiskStats) vmId=`7fc21bb8-bd92-4924-acef-8360998e92a1`::Disk hdc stats not available >GuestMonitor-scale_6::DEBUG::2014-07-10 09:03:02,920::vm::676::vm.Vm::(_getDiskStats) vmId=`7fc21bb8-bd92-4924-acef-8360998e92a1`::Disk vda stats not available >GuestMonitor-scale_6::DEBUG::2014-07-10 09:03:02,920::vm::715::vm.Vm::(_getDiskLatency) vmId=`7fc21bb8-bd92-4924-acef-8360998e92a1`::Disk hdd latency not available >GuestMonitor-scale_6::DEBUG::2014-07-10 09:03:02,920::vm::715::vm.Vm::(_getDiskLatency) vmId=`7fc21bb8-bd92-4924-acef-8360998e92a1`::Disk hdc latency not available >GuestMonitor-scale_6::DEBUG::2014-07-10 09:03:02,921::vm::715::vm.Vm::(_getDiskLatency) vmId=`7fc21bb8-bd92-4924-acef-8360998e92a1`::Disk vda latency not available >Thread-13::DEBUG::2014-07-10 09:03:02,929::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-13::DEBUG::2014-07-10 09:03:02,930::task::595::TaskManager.Task::(_updateState) Task=`4772e569-57b4-4e0e-acc3-cac519a043a1`::moving from state init -> state preparing >Thread-13::INFO::2014-07-10 09:03:02,930::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-13::INFO::2014-07-10 09:03:02,931::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-13::DEBUG::2014-07-10 09:03:02,931::task::1185::TaskManager.Task::(prepare) Task=`4772e569-57b4-4e0e-acc3-cac519a043a1`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-13::DEBUG::2014-07-10 09:03:02,931::task::595::TaskManager.Task::(_updateState) Task=`4772e569-57b4-4e0e-acc3-cac519a043a1`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-07-10 09:03:02,931::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-07-10 09:03:02,932::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-07-10 09:03:02,932::task::990::TaskManager.Task::(_decref) Task=`4772e569-57b4-4e0e-acc3-cac519a043a1`::ref 0 aborting False >GuestMonitor-scale_5::DEBUG::2014-07-10 09:03:02,936::vm::676::vm.Vm::(_getDiskStats) vmId=`2386fa8c-f537-495c-ae07-e178171d77f2`::Disk hdd stats not available >Thread-34::DEBUG::2014-07-10 09:03:02,937::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >GuestMonitor-scale_5::DEBUG::2014-07-10 09:03:02,937::vm::676::vm.Vm::(_getDiskStats) vmId=`2386fa8c-f537-495c-ae07-e178171d77f2`::Disk hdc stats not available >Thread-34::DEBUG::2014-07-10 09:03:02,938::task::595::TaskManager.Task::(_updateState) Task=`8545b440-eebf-48c8-8f04-bad19b2b15ac`::moving from state init -> state preparing >GuestMonitor-scale_5::DEBUG::2014-07-10 09:03:02,939::vm::676::vm.Vm::(_getDiskStats) vmId=`2386fa8c-f537-495c-ae07-e178171d77f2`::Disk vda stats not available >Thread-34::INFO::2014-07-10 09:03:02,939::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >GuestMonitor-scale_5::DEBUG::2014-07-10 09:03:02,939::vm::715::vm.Vm::(_getDiskLatency) vmId=`2386fa8c-f537-495c-ae07-e178171d77f2`::Disk hdd latency not available >GuestMonitor-scale_5::DEBUG::2014-07-10 09:03:02,941::vm::715::vm.Vm::(_getDiskLatency) vmId=`2386fa8c-f537-495c-ae07-e178171d77f2`::Disk hdc latency not available >Thread-34::DEBUG::2014-07-10 09:03:02,941::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`05a20cd1-5f63-448c-8390-f989cee892e9`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >GuestMonitor-scale_5::DEBUG::2014-07-10 09:03:02,942::vm::715::vm.Vm::(_getDiskLatency) vmId=`2386fa8c-f537-495c-ae07-e178171d77f2`::Disk vda latency not available >Thread-34::DEBUG::2014-07-10 09:03:02,942::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' for lock type 'shared' >GuestMonitor-scale_5::DEBUG::2014-07-10 09:03:02,943::vm::676::vm.Vm::(_getDiskStats) vmId=`2386fa8c-f537-495c-ae07-e178171d77f2`::Disk hdd stats not available >Thread-34::DEBUG::2014-07-10 09:03:02,944::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free. Now locking as 'shared' (1 active user) >GuestMonitor-scale_5::DEBUG::2014-07-10 09:03:02,944::vm::676::vm.Vm::(_getDiskStats) vmId=`2386fa8c-f537-495c-ae07-e178171d77f2`::Disk hdc stats not available >Thread-34::DEBUG::2014-07-10 09:03:02,945::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`05a20cd1-5f63-448c-8390-f989cee892e9`::Granted request >GuestMonitor-scale_5::DEBUG::2014-07-10 09:03:02,945::vm::676::vm.Vm::(_getDiskStats) vmId=`2386fa8c-f537-495c-ae07-e178171d77f2`::Disk vda stats not available >GuestMonitor-scale_5::DEBUG::2014-07-10 09:03:02,946::vm::715::vm.Vm::(_getDiskLatency) vmId=`2386fa8c-f537-495c-ae07-e178171d77f2`::Disk hdd latency not available >Thread-34::DEBUG::2014-07-10 09:03:02,947::task::827::TaskManager.Task::(resourceAcquired) Task=`8545b440-eebf-48c8-8f04-bad19b2b15ac`::_resourcesAcquired: Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee (shared) >GuestMonitor-scale_5::DEBUG::2014-07-10 09:03:02,947::vm::715::vm.Vm::(_getDiskLatency) vmId=`2386fa8c-f537-495c-ae07-e178171d77f2`::Disk hdc latency not available >Thread-34::DEBUG::2014-07-10 09:03:02,948::task::990::TaskManager.Task::(_decref) Task=`8545b440-eebf-48c8-8f04-bad19b2b15ac`::ref 1 aborting False >GuestMonitor-scale_5::DEBUG::2014-07-10 09:03:02,948::vm::715::vm.Vm::(_getDiskLatency) vmId=`2386fa8c-f537-495c-ae07-e178171d77f2`::Disk vda latency not available >Thread-34::INFO::2014-07-10 09:03:02,950::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1076694614016', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532069482496', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:03:02,950::task::1185::TaskManager.Task::(prepare) Task=`8545b440-eebf-48c8-8f04-bad19b2b15ac`::finished: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1076694614016', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532069482496', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:03:02,951::task::595::TaskManager.Task::(_updateState) Task=`8545b440-eebf-48c8-8f04-bad19b2b15ac`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-10 09:03:02,951::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee': < ResourceRef 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-10 09:03:02,951::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-10 09:03:02,951::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' >Thread-34::DEBUG::2014-07-10 09:03:02,952::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' (0 active users) >Thread-34::DEBUG::2014-07-10 09:03:02,952::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-10 09:03:02,952::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', Clearing records. >Thread-34::DEBUG::2014-07-10 09:03:02,952::task::990::TaskManager.Task::(_decref) Task=`8545b440-eebf-48c8-8f04-bad19b2b15ac`::ref 0 aborting False >GuestMonitor-scale_4::DEBUG::2014-07-10 09:03:03,001::vm::676::vm.Vm::(_getDiskStats) vmId=`0e968db5-5d49-467f-9ff3-afc37b64364f`::Disk hdd stats not available >GuestMonitor-scale_4::DEBUG::2014-07-10 09:03:03,002::vm::676::vm.Vm::(_getDiskStats) vmId=`0e968db5-5d49-467f-9ff3-afc37b64364f`::Disk hdc stats not available >GuestMonitor-scale_4::DEBUG::2014-07-10 09:03:03,002::vm::676::vm.Vm::(_getDiskStats) vmId=`0e968db5-5d49-467f-9ff3-afc37b64364f`::Disk vda stats not available >GuestMonitor-scale_4::DEBUG::2014-07-10 09:03:03,002::vm::715::vm.Vm::(_getDiskLatency) vmId=`0e968db5-5d49-467f-9ff3-afc37b64364f`::Disk hdd latency not available >GuestMonitor-scale_4::DEBUG::2014-07-10 09:03:03,002::vm::715::vm.Vm::(_getDiskLatency) vmId=`0e968db5-5d49-467f-9ff3-afc37b64364f`::Disk hdc latency not available >GuestMonitor-scale_4::DEBUG::2014-07-10 09:03:03,002::vm::715::vm.Vm::(_getDiskLatency) vmId=`0e968db5-5d49-467f-9ff3-afc37b64364f`::Disk vda latency not available >GuestMonitor-scale_4::DEBUG::2014-07-10 09:03:03,003::vm::676::vm.Vm::(_getDiskStats) vmId=`0e968db5-5d49-467f-9ff3-afc37b64364f`::Disk hdd stats not available >GuestMonitor-scale_4::DEBUG::2014-07-10 09:03:03,003::vm::676::vm.Vm::(_getDiskStats) vmId=`0e968db5-5d49-467f-9ff3-afc37b64364f`::Disk hdc stats not available >GuestMonitor-scale_4::DEBUG::2014-07-10 09:03:03,003::vm::676::vm.Vm::(_getDiskStats) vmId=`0e968db5-5d49-467f-9ff3-afc37b64364f`::Disk vda stats not available >GuestMonitor-scale_4::DEBUG::2014-07-10 09:03:03,004::vm::715::vm.Vm::(_getDiskLatency) vmId=`0e968db5-5d49-467f-9ff3-afc37b64364f`::Disk hdd latency not available >GuestMonitor-scale_4::DEBUG::2014-07-10 09:03:03,004::vm::715::vm.Vm::(_getDiskLatency) vmId=`0e968db5-5d49-467f-9ff3-afc37b64364f`::Disk hdc latency not available >GuestMonitor-scale_4::DEBUG::2014-07-10 09:03:03,004::vm::715::vm.Vm::(_getDiskLatency) vmId=`0e968db5-5d49-467f-9ff3-afc37b64364f`::Disk vda latency not available >Thread-13::DEBUG::2014-07-10 09:03:04,304::BindingXMLRPC::1067::vds::(wrapper) client [10.35.3.13]::call vmGetStats with ('2386fa8c-f537-495c-ae07-e178171d77f2',) {} >Thread-13::DEBUG::2014-07-10 09:03:04,304::vm::676::vm.Vm::(_getDiskStats) vmId=`2386fa8c-f537-495c-ae07-e178171d77f2`::Disk hdd stats not available >Thread-13::DEBUG::2014-07-10 09:03:04,305::vm::676::vm.Vm::(_getDiskStats) vmId=`2386fa8c-f537-495c-ae07-e178171d77f2`::Disk hdc stats not available >Thread-13::DEBUG::2014-07-10 09:03:04,305::vm::676::vm.Vm::(_getDiskStats) vmId=`2386fa8c-f537-495c-ae07-e178171d77f2`::Disk vda stats not available >Thread-13::DEBUG::2014-07-10 09:03:04,305::vm::715::vm.Vm::(_getDiskLatency) vmId=`2386fa8c-f537-495c-ae07-e178171d77f2`::Disk hdd latency not available >Thread-13::DEBUG::2014-07-10 09:03:04,305::vm::715::vm.Vm::(_getDiskLatency) vmId=`2386fa8c-f537-495c-ae07-e178171d77f2`::Disk hdc latency not available >Thread-13::DEBUG::2014-07-10 09:03:04,305::vm::715::vm.Vm::(_getDiskLatency) vmId=`2386fa8c-f537-495c-ae07-e178171d77f2`::Disk vda latency not available >Thread-13::DEBUG::2014-07-10 09:03:04,306::BindingXMLRPC::1074::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Powering up', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '14143', 'displayIp': '0', 'displayPort': u'5908', 'session': 'Unknown', 'displaySecurePort': u'5909', 'timeOffset': '0', 'hash': '-2423634698834682900', 'balloonInfo': {'balloon_max': '1048576', 'balloon_target': '1048576', 'balloon_cur': '1048576', 'balloon_min': '1048576'}, 'pauseCode': 'NOERR', 'clientIp': '', 'kvmEnable': 'true', 'network': {u'vnet4': {'macAddr': '00:1a:4a:de:6d:7c', 'rxDropped': '0', 'rxErrors': '0', 'txDropped': '0', 'txRate': '0.0', 'rxRate': '0.0', 'txErrors': '0', 'state': 'unknown', 'speed': '1000', 'name': u'vnet4'}}, 'vmId': '2386fa8c-f537-495c-ae07-e178171d77f2', 'displayType': 'qxl', 'cpuUser': '43.14', 'disks': {u'vda': {'truesize': '1073741824', 'apparentsize': '1073741824', 'imageID': 'b034d5b0-e1e0-4011-b49b-4d45ddb11556'}, u'hdd': {'truesize': '0', 'apparentsize': '0'}, u'hdc': {'truesize': '0', 'apparentsize': '0'}}, 'monitorResponse': '0', 'statsAge': '1.18', 'elapsedTime': '37', 'vmType': 'kvm', 'cpuSys': '6.77', 'guestCPUCount': -1, 'appsList': [], 'guestIPs': ''}]} >Thread-13::DEBUG::2014-07-10 09:03:04,310::BindingXMLRPC::1067::vds::(wrapper) client [10.35.3.13]::call vmGetStats with ('7fc21bb8-bd92-4924-acef-8360998e92a1',) {} >Thread-13::DEBUG::2014-07-10 09:03:04,310::vm::676::vm.Vm::(_getDiskStats) vmId=`7fc21bb8-bd92-4924-acef-8360998e92a1`::Disk hdd stats not available >Thread-13::DEBUG::2014-07-10 09:03:04,311::vm::676::vm.Vm::(_getDiskStats) vmId=`7fc21bb8-bd92-4924-acef-8360998e92a1`::Disk hdc stats not available >Thread-13::DEBUG::2014-07-10 09:03:04,311::vm::676::vm.Vm::(_getDiskStats) vmId=`7fc21bb8-bd92-4924-acef-8360998e92a1`::Disk vda stats not available >Thread-13::DEBUG::2014-07-10 09:03:04,311::vm::715::vm.Vm::(_getDiskLatency) vmId=`7fc21bb8-bd92-4924-acef-8360998e92a1`::Disk hdd latency not available >Thread-13::DEBUG::2014-07-10 09:03:04,311::vm::715::vm.Vm::(_getDiskLatency) vmId=`7fc21bb8-bd92-4924-acef-8360998e92a1`::Disk hdc latency not available >Thread-13::DEBUG::2014-07-10 09:03:04,311::vm::715::vm.Vm::(_getDiskLatency) vmId=`7fc21bb8-bd92-4924-acef-8360998e92a1`::Disk vda latency not available >Thread-13::DEBUG::2014-07-10 09:03:04,312::BindingXMLRPC::1074::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Powering up', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '14800', 'displayIp': '0', 'displayPort': u'5910', 'session': 'Unknown', 'displaySecurePort': u'5911', 'timeOffset': '0', 'hash': '-831008492253830849', 'balloonInfo': {'balloon_max': '1048576', 'balloon_target': '1048576', 'balloon_cur': '1048576', 'balloon_min': '1048576'}, 'pauseCode': 'NOERR', 'clientIp': '', 'kvmEnable': 'true', 'network': {u'vnet5': {'macAddr': '00:1a:4a:de:6d:7d', 'rxDropped': '0', 'rxErrors': '0', 'txDropped': '0', 'txRate': '0.0', 'rxRate': '0.0', 'txErrors': '0', 'state': 'unknown', 'speed': '1000', 'name': u'vnet5'}}, 'vmId': '7fc21bb8-bd92-4924-acef-8360998e92a1', 'displayType': 'qxl', 'cpuUser': '46.56', 'disks': {u'vda': {'truesize': '1073741824', 'apparentsize': '1073741824', 'imageID': 'aa20346a-4d3a-4e07-b8e1-52c0ebe4168c'}, u'hdd': {'truesize': '0', 'apparentsize': '0'}, u'hdc': {'truesize': '0', 'apparentsize': '0'}}, 'monitorResponse': '0', 'statsAge': '0.71', 'elapsedTime': '18', 'vmType': 'kvm', 'cpuSys': '21.04', 'guestCPUCount': -1, 'appsList': [], 'guestIPs': ''}]} >Thread-40::DEBUG::2014-07-10 09:03:04,501::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lion.qa.lab.tlv.redhat.com:_export_yuri2_backup2/6a70504d-00df-4869-8695-0f442053f6b6/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-40::DEBUG::2014-07-10 09:03:04,519::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n369 bytes (369 B) copied, 0.000630652 s, 585 kB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:03:04,543::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:03:04,665::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0655258 s, 15.6 MB/s\n'; <rc> = 0 >Thread-13::DEBUG::2014-07-10 09:03:05,411::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-13::DEBUG::2014-07-10 09:03:05,412::task::595::TaskManager.Task::(_updateState) Task=`3dd00d74-afbe-4846-b805-1a8e7a30633d`::moving from state init -> state preparing >Thread-13::INFO::2014-07-10 09:03:05,412::logUtils::44::dispatcher::(wrapper) Run and protect: getAllTasksStatuses(spUUID=None, options=None) >Thread-13::DEBUG::2014-07-10 09:03:05,413::taskManager::102::TaskManager::(getAllTasksStatuses) Entry. >Thread-13::DEBUG::2014-07-10 09:03:05,413::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 834c3ccd-bc24-4cc0-aa77-3298bd8de161 >Thread-13::DEBUG::2014-07-10 09:03:05,413::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': '1 jobs completed successfully', 'taskState': 'finished', 'taskResult': 'success', 'taskID': '834c3ccd-bc24-4cc0-aa77-3298bd8de161'} >Thread-13::DEBUG::2014-07-10 09:03:05,413::taskManager::113::TaskManager::(getAllTasksStatuses) Return: {'834c3ccd-bc24-4cc0-aa77-3298bd8de161': {'code': 0, 'message': '1 jobs completed successfully', 'taskState': 'finished', 'taskResult': 'success', 'taskID': '834c3ccd-bc24-4cc0-aa77-3298bd8de161'}} >Thread-13::INFO::2014-07-10 09:03:05,413::logUtils::47::dispatcher::(wrapper) Run and protect: getAllTasksStatuses, Return response: {'allTasksStatus': {'834c3ccd-bc24-4cc0-aa77-3298bd8de161': {'code': 0, 'message': '1 jobs completed successfully', 'taskState': 'finished', 'taskResult': 'success', 'taskID': '834c3ccd-bc24-4cc0-aa77-3298bd8de161'}}} >Thread-13::DEBUG::2014-07-10 09:03:05,414::task::1185::TaskManager.Task::(prepare) Task=`3dd00d74-afbe-4846-b805-1a8e7a30633d`::finished: {'allTasksStatus': {'834c3ccd-bc24-4cc0-aa77-3298bd8de161': {'code': 0, 'message': '1 jobs completed successfully', 'taskState': 'finished', 'taskResult': 'success', 'taskID': '834c3ccd-bc24-4cc0-aa77-3298bd8de161'}}} >Thread-13::DEBUG::2014-07-10 09:03:05,414::task::595::TaskManager.Task::(_updateState) Task=`3dd00d74-afbe-4846-b805-1a8e7a30633d`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-07-10 09:03:05,414::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-07-10 09:03:05,414::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-07-10 09:03:05,415::task::990::TaskManager.Task::(_decref) Task=`3dd00d74-afbe-4846-b805-1a8e7a30633d`::ref 0 aborting False >Thread-34::DEBUG::2014-07-10 09:03:05,457::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [44b2df69] >Thread-34::DEBUG::2014-07-10 09:03:05,458::task::595::TaskManager.Task::(_updateState) Task=`433de28c-89f0-4abc-a047-ded0f1d588aa`::moving from state init -> state preparing >Thread-34::INFO::2014-07-10 09:03:05,458::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeInfo(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='f30c2cb7-a43a-4bf5-82b5-cfe07336f65c', volUUID='b0fbb3c9-55af-4a3a-95ad-fc56a80b9cf5', options=None) >Thread-34::DEBUG::2014-07-10 09:03:05,459::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.9e1aa540-1f4e-4ee3-a152-be381ef6c3bd`ReqID=`305fb8df-fda7-4985-8173-24ddf9d4a70d`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '3089' at 'getVolumeInfo' >Thread-34::DEBUG::2014-07-10 09:03:05,459::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.9e1aa540-1f4e-4ee3-a152-be381ef6c3bd' for lock type 'shared' >Thread-34::DEBUG::2014-07-10 09:03:05,459::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.9e1aa540-1f4e-4ee3-a152-be381ef6c3bd' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-10 09:03:05,460::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.9e1aa540-1f4e-4ee3-a152-be381ef6c3bd`ReqID=`305fb8df-fda7-4985-8173-24ddf9d4a70d`::Granted request >Thread-34::DEBUG::2014-07-10 09:03:05,460::task::827::TaskManager.Task::(resourceAcquired) Task=`433de28c-89f0-4abc-a047-ded0f1d588aa`::_resourcesAcquired: Storage.9e1aa540-1f4e-4ee3-a152-be381ef6c3bd (shared) >Thread-34::DEBUG::2014-07-10 09:03:05,460::task::990::TaskManager.Task::(_decref) Task=`433de28c-89f0-4abc-a047-ded0f1d588aa`::ref 1 aborting False >Thread-34::DEBUG::2014-07-10 09:03:05,461::lvm::427::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' got the operation mutex >Thread-34::DEBUG::2014-07-10 09:03:05,461::lvm::296::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm lvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/3600601601282300032826addbbdae311|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,vg_name,attr,size,seg_start_pe,devices,tags 9e1aa540-1f4e-4ee3-a152-be381ef6c3bd' (cwd None) >Thread-34::DEBUG::2014-07-10 09:03:05,685::lvm::296::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-34::DEBUG::2014-07-10 09:03:05,699::lvm::462::Storage.LVM::(_reloadlvs) lvs reloaded >Thread-34::DEBUG::2014-07-10 09:03:05,699::lvm::462::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' released the operation mutex >Thread-34::INFO::2014-07-10 09:03:05,700::volume::879::Storage.Volume::(getInfo) Info request: sdUUID=9e1aa540-1f4e-4ee3-a152-be381ef6c3bd imgUUID=f30c2cb7-a43a-4bf5-82b5-cfe07336f65c volUUID = b0fbb3c9-55af-4a3a-95ad-fc56a80b9cf5 >Thread-34::DEBUG::2014-07-10 09:03:05,700::blockVolume::572::Storage.Misc.excCmd::(getMetadata) '/bin/dd iflag=direct skip=11 bs=512 if=/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/metadata count=1' (cwd None) >Thread-34::DEBUG::2014-07-10 09:03:05,714::blockVolume::572::Storage.Misc.excCmd::(getMetadata) SUCCESS: <err> = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.000550098 s, 931 kB/s\n'; <rc> = 0 >Thread-34::DEBUG::2014-07-10 09:03:05,715::misc::282::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.000550098 s, 931 kB/s'], size: 512 >Thread-34::DEBUG::2014-07-10 09:03:05,716::blockVolume::572::Storage.Misc.excCmd::(getMetadata) '/bin/dd iflag=direct skip=11 bs=512 if=/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/metadata count=1' (cwd None) >Thread-34::DEBUG::2014-07-10 09:03:05,727::blockVolume::572::Storage.Misc.excCmd::(getMetadata) SUCCESS: <err> = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.000448018 s, 1.1 MB/s\n'; <rc> = 0 >Thread-34::DEBUG::2014-07-10 09:03:05,728::misc::282::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.000448018 s, 1.1 MB/s'], size: 512 >Thread-34::INFO::2014-07-10 09:03:05,728::volume::909::Storage.Volume::(getInfo) 9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/f30c2cb7-a43a-4bf5-82b5-cfe07336f65c/b0fbb3c9-55af-4a3a-95ad-fc56a80b9cf5 info is {'status': 'OK', 'domain': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'voltype': 'LEAF', 'description': '', 'parent': '47592965-e853-4e59-9728-d11cca6a7a8a', 'format': 'COW', 'image': 'f30c2cb7-a43a-4bf5-82b5-cfe07336f65c', 'ctime': '1404982976', 'disktype': '2', 'legality': 'LEGAL', 'mtime': '1404982976', 'apparentsize': '1073741824', 'children': [], 'pool': '', 'capacity': '10737418240', 'uuid': 'b0fbb3c9-55af-4a3a-95ad-fc56a80b9cf5', 'truesize': '1073741824', 'type': 'SPARSE'} >Thread-34::INFO::2014-07-10 09:03:05,728::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeInfo, Return response: {'info': {'status': 'OK', 'domain': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'voltype': 'LEAF', 'description': '', 'parent': '47592965-e853-4e59-9728-d11cca6a7a8a', 'format': 'COW', 'image': 'f30c2cb7-a43a-4bf5-82b5-cfe07336f65c', 'ctime': '1404982976', 'disktype': '2', 'legality': 'LEGAL', 'mtime': '1404982976', 'apparentsize': '1073741824', 'children': [], 'pool': '', 'capacity': '10737418240', 'uuid': 'b0fbb3c9-55af-4a3a-95ad-fc56a80b9cf5', 'truesize': '1073741824', 'type': 'SPARSE'}} >Thread-34::DEBUG::2014-07-10 09:03:05,729::task::1185::TaskManager.Task::(prepare) Task=`433de28c-89f0-4abc-a047-ded0f1d588aa`::finished: {'info': {'status': 'OK', 'domain': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'voltype': 'LEAF', 'description': '', 'parent': '47592965-e853-4e59-9728-d11cca6a7a8a', 'format': 'COW', 'image': 'f30c2cb7-a43a-4bf5-82b5-cfe07336f65c', 'ctime': '1404982976', 'disktype': '2', 'legality': 'LEGAL', 'mtime': '1404982976', 'apparentsize': '1073741824', 'children': [], 'pool': '', 'capacity': '10737418240', 'uuid': 'b0fbb3c9-55af-4a3a-95ad-fc56a80b9cf5', 'truesize': '1073741824', 'type': 'SPARSE'}} >Thread-34::DEBUG::2014-07-10 09:03:05,729::task::595::TaskManager.Task::(_updateState) Task=`433de28c-89f0-4abc-a047-ded0f1d588aa`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-10 09:03:05,729::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': < ResourceRef 'Storage.9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-10 09:03:05,730::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-10 09:03:05,730::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.9e1aa540-1f4e-4ee3-a152-be381ef6c3bd' >Thread-34::DEBUG::2014-07-10 09:03:05,730::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.9e1aa540-1f4e-4ee3-a152-be381ef6c3bd' (0 active users) >Thread-34::DEBUG::2014-07-10 09:03:05,730::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.9e1aa540-1f4e-4ee3-a152-be381ef6c3bd' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-10 09:03:05,731::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', Clearing records. >Thread-34::DEBUG::2014-07-10 09:03:05,731::task::990::TaskManager.Task::(_decref) Task=`433de28c-89f0-4abc-a047-ded0f1d588aa`::ref 0 aborting False >Thread-13::DEBUG::2014-07-10 09:03:05,771::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-13::DEBUG::2014-07-10 09:03:05,771::task::595::TaskManager.Task::(_updateState) Task=`1fef6f8f-f9e7-4a53-b56c-ad3c62602b63`::moving from state init -> state preparing >Thread-13::INFO::2014-07-10 09:03:05,771::logUtils::44::dispatcher::(wrapper) Run and protect: clearTask(taskID='834c3ccd-bc24-4cc0-aa77-3298bd8de161', spUUID=None, options=None) >Thread-13::DEBUG::2014-07-10 09:03:05,772::taskManager::161::TaskManager::(clearTask) Entry. taskID: 834c3ccd-bc24-4cc0-aa77-3298bd8de161 >Thread-13::DEBUG::2014-07-10 09:03:05,773::taskManager::166::TaskManager::(clearTask) Return. >Thread-13::INFO::2014-07-10 09:03:05,773::logUtils::47::dispatcher::(wrapper) Run and protect: clearTask, Return response: None >Thread-13::DEBUG::2014-07-10 09:03:05,773::task::1185::TaskManager.Task::(prepare) Task=`1fef6f8f-f9e7-4a53-b56c-ad3c62602b63`::finished: None >Thread-13::DEBUG::2014-07-10 09:03:05,774::task::595::TaskManager.Task::(_updateState) Task=`1fef6f8f-f9e7-4a53-b56c-ad3c62602b63`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-07-10 09:03:05,774::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-07-10 09:03:05,774::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-07-10 09:03:05,774::task::990::TaskManager.Task::(_decref) Task=`1fef6f8f-f9e7-4a53-b56c-ad3c62602b63`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 09:03:06,680::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:03:06,789::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0544266 s, 18.8 MB/s\n'; <rc> = 0 >Thread-13::DEBUG::2014-07-10 09:03:06,891::BindingXMLRPC::1067::vds::(wrapper) client [10.35.3.13]::call vmCreate with ({'acpiEnable': 'true', 'emulatedMachine': 'rhel6.5.0', 'vmId': 'a766ed65-ac2e-4862-8ff0-0352480cf6f1', 'memGuaranteedSize': 1024, 'spiceSslCipherSuite': 'DEFAULT', 'timeOffset': '0', 'cpuType': 'Conroe', 'custom': {'device_5d6fbbae-0e2c-4af7-a34d-24cf1fd393e4device_5de3edb3-d4f4-4e0e-92cf-9ad5e6c556afdevice_636632cb-12d7-4044-b22f-9b276a2f0143': 'VmDevice {vmId=a766ed65-ac2e-4862-8ff0-0352480cf6f1, deviceId=636632cb-12d7-4044-b22f-9b276a2f0143, device=spicevmc, type=CHANNEL, bootOrder=0, specParams={}, address={port=3, bus=0, controller=0, type=virtio-serial}, managed=false, plugged=true, readOnly=false, deviceAlias=channel2, customProperties={}, snapshotId=null}', 'device_5d6fbbae-0e2c-4af7-a34d-24cf1fd393e4device_5de3edb3-d4f4-4e0e-92cf-9ad5e6c556af': 'VmDevice {vmId=a766ed65-ac2e-4862-8ff0-0352480cf6f1, deviceId=5de3edb3-d4f4-4e0e-92cf-9ad5e6c556af, device=ide, type=CONTROLLER, bootOrder=0, specParams={}, address={bus=0x00, domain=0x0000, type=pci, slot=0x01, function=0x1}, managed=false, plugged=true, readOnly=false, deviceAlias=ide0, customProperties={}, snapshotId=null}', 'device_5d6fbbae-0e2c-4af7-a34d-24cf1fd393e4device_5de3edb3-d4f4-4e0e-92cf-9ad5e6c556afdevice_636632cb-12d7-4044-b22f-9b276a2f0143device_6731c79f-ad6b-4002-8709-74f4d6d48818': 'VmDevice {vmId=a766ed65-ac2e-4862-8ff0-0352480cf6f1, deviceId=6731c79f-ad6b-4002-8709-74f4d6d48818, device=unix, type=CHANNEL, bootOrder=0, specParams={}, address={port=1, bus=0, controller=0, type=virtio-serial}, managed=false, plugged=true, readOnly=false, deviceAlias=channel0, customProperties={}, snapshotId=null}', 'device_5d6fbbae-0e2c-4af7-a34d-24cf1fd393e4device_5de3edb3-d4f4-4e0e-92cf-9ad5e6c556afdevice_636632cb-12d7-4044-b22f-9b276a2f0143device_6731c79f-ad6b-4002-8709-74f4d6d48818device_def6edf6-3f91-4b63-b2f7-7b0479fef24a': 'VmDevice {vmId=a766ed65-ac2e-4862-8ff0-0352480cf6f1, deviceId=def6edf6-3f91-4b63-b2f7-7b0479fef24a, device=unix, type=CHANNEL, bootOrder=0, specParams={}, address={port=2, bus=0, controller=0, type=virtio-serial}, managed=false, plugged=true, readOnly=false, deviceAlias=channel1, customProperties={}, snapshotId=null}', 'device_5d6fbbae-0e2c-4af7-a34d-24cf1fd393e4': 'VmDevice {vmId=a766ed65-ac2e-4862-8ff0-0352480cf6f1, deviceId=5d6fbbae-0e2c-4af7-a34d-24cf1fd393e4, device=virtio-serial, type=CONTROLLER, bootOrder=0, specParams={}, address={bus=0x00, domain=0x0000, type=pci, slot=0x05, function=0x0}, managed=false, plugged=true, readOnly=false, deviceAlias=virtio-serial0, customProperties={}, snapshotId=null}'}, 'smp': '2', 'vmType': 'kvm', 'memSize': 1024, 'smpCoresPerSocket': '2', 'vmName': 'scale_7', 'nice': '0', 'smartcardEnable': 'false', 'keyboardLayout': 'en-us', 'kvmEnable': 'true', 'pitReinjection': 'false', 'transparentHugePages': 'true', 'devices': [{'index': '3', 'iface': 'ide', 'specParams': {'vmPayload': {'volId': 'config-2', 'file': {'openstack/latest/meta_data.json': 'ewogICJsYXVuY2hfaW5kZXgiIDogIjAiLAogICJhdmFpbGFiaWxpdHlfem9uZSIgOiAibm92YSIs\nCiAgInV1aWQiIDogIjJiYjExZDA4LTZjNWEtNDc1Zi1hOTRhLWVjYTE4NDJhYjQwMyIsCiAgIm1l\ndGEiIDogewogICAgImVzc2VudGlhbCIgOiAiZmFsc2UiLAogICAgInJvbGUiIDogInNlcnZlciIs\nCiAgICAiZHNtb2RlIiA6ICJsb2NhbCIKICB9Cn0=\n', 'openstack/latest/user_data': 'I2Nsb3VkLWNvbmZpZwpzc2hfcHdhdXRoOiB0cnVlCmRpc2FibGVfcm9vdDogMApvdXRwdXQ6CiAg\nYWxsOiAnPj4gL3Zhci9sb2cvY2xvdWQtaW5pdC1vdXRwdXQubG9nJwp1c2VyOiByb290CmNocGFz\nc3dkOgogIGV4cGlyZTogZmFsc2UKcnVuY21kOgotICdzZWQgLWkgJycvXmRhdGFzb3VyY2VfbGlz\ndDogL2QnJyAvZXRjL2Nsb3VkL2Nsb3VkLmNmZzsgZWNobyAnJ2RhdGFzb3VyY2VfbGlzdDoKICBb\nIk5vQ2xvdWQiLCAiQ29uZmlnRHJpdmUiXScnID4+IC9ldGMvY2xvdWQvY2xvdWQuY2ZnJwo=\n'}}}, 'readonly': 'true', 'deviceId': 'da8e2b7e-c618-4e3c-adf3-045b6fcde9ce', 'path': '', 'device': 'cdrom', 'shared': 'false', 'type': 'disk'}, {'device': 'qxl', 'specParams': {'vram': '32768', 'ram': '65536', 'heads': '1'}, 'type': 'video', 'deviceId': 'dbde1b0e-0ea8-4780-b618-4dac6adb6582'}, {'index': '2', 'iface': 'ide', 'specParams': {'path': ''}, 'readonly': 'true', 'deviceId': 'bce1e2b6-80e9-432e-a79b-641b4632ec27', 'path': '', 'device': 'cdrom', 'shared': 'false', 'type': 'disk'}, {'index': 0, 'iface': 'virtio', 'format': 'cow', 'bootOrder': '1', 'poolID': '4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', 'volumeID': 'b0fbb3c9-55af-4a3a-95ad-fc56a80b9cf5', 'imageID': 'f30c2cb7-a43a-4bf5-82b5-cfe07336f65c', 'specParams': {}, 'readonly': 'false', 'domainID': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'optional': 'false', 'deviceId': 'f30c2cb7-a43a-4bf5-82b5-cfe07336f65c', 'address': {'slot': '0x06', 'bus': '0x00', 'domain': '0x0000', 'type': 'pci', 'function': '0x0'}, 'device': 'disk', 'shared': 'false', 'propagateErrors': 'off', 'type': 'disk'}, {'nicModel': 'pv', 'macAddr': '00:1a:4a:de:6d:88', 'linkActive': 'true', 'network': 'rhevm', 'filter': 'vdsm-no-mac-spoofing', 'specParams': {'inbound': {}, 'outbound': {}}, 'deviceId': '9aad6e0d-00f0-411d-8c91-c4a387f13d81', 'device': 'bridge', 'type': 'interface'}, {'device': 'memballoon', 'specParams': {'model': 'virtio'}, 'type': 'balloon', 'deviceId': '07ce0be8-0938-4864-a125-a53c8ef4c654'}, {'index': '0', 'specParams': {}, 'deviceId': 'd0db6984-1aaa-4e92-9327-3b87b4d8cbb0', 'address': {'slot': '0x04', 'bus': '0x00', 'domain': '0x0000', 'type': 'pci', 'function': '0x0'}, 'device': 'scsi', 'model': 'virtio-scsi', 'type': 'controller'}], 'maxVCpus': '160', 'spiceSecureChannels': 'smain,sinputs,scursor,splayback,srecord,sdisplay,susbredir,ssmartcard', 'display': 'qxl'},) {} flowID [79a2d5f9] >Thread-13::INFO::2014-07-10 09:03:06,895::API::667::vds::(_getNetworkIp) network None: using 0 >Thread-13::INFO::2014-07-10 09:03:06,895::clientIF::366::vds::(createVm) vmContainerLock acquired by vm a766ed65-ac2e-4862-8ff0-0352480cf6f1 >Thread-13::DEBUG::2014-07-10 09:03:06,903::clientIF::379::vds::(createVm) Total desktops after creation of a766ed65-ac2e-4862-8ff0-0352480cf6f1 is 7 >Thread-65::DEBUG::2014-07-10 09:03:06,904::vm::2270::vm.Vm::(_startUnderlyingVm) vmId=`a766ed65-ac2e-4862-8ff0-0352480cf6f1`::Start >Thread-13::DEBUG::2014-07-10 09:03:06,906::BindingXMLRPC::1074::vds::(wrapper) return vmCreate with {'status': {'message': 'Done', 'code': 0}, 'vmList': {'status': 'WaitForLaunch', 'acpiEnable': 'true', 'emulatedMachine': 'rhel6.5.0', 'vmId': 'a766ed65-ac2e-4862-8ff0-0352480cf6f1', 'pid': '0', 'memGuaranteedSize': 1024, 'timeOffset': '0', 'keyboardLayout': 'en-us', 'displayPort': '-1', 'displaySecurePort': '-1', 'spiceSslCipherSuite': 'DEFAULT', 'cpuType': 'Conroe', 'smp': '2', 'clientIp': '', 'nicModel': 'rtl8139,pv', 'smartcardEnable': 'false', 'kvmEnable': 'true', 'pitReinjection': 'false', 'transparentHugePages': 'true', 'devices': [{'index': '3', 'iface': 'ide', 'specParams': {'vmPayload': {'volId': 'config-2', 'file': {'openstack/latest/meta_data.json': 'ewogICJsYXVuY2hfaW5kZXgiIDogIjAiLAogICJhdmFpbGFiaWxpdHlfem9uZSIgOiAibm92YSIs\nCiAgInV1aWQiIDogIjJiYjExZDA4LTZjNWEtNDc1Zi1hOTRhLWVjYTE4NDJhYjQwMyIsCiAgIm1l\ndGEiIDogewogICAgImVzc2VudGlhbCIgOiAiZmFsc2UiLAogICAgInJvbGUiIDogInNlcnZlciIs\nCiAgICAiZHNtb2RlIiA6ICJsb2NhbCIKICB9Cn0=\n', 'openstack/latest/user_data': 'I2Nsb3VkLWNvbmZpZwpzc2hfcHdhdXRoOiB0cnVlCmRpc2FibGVfcm9vdDogMApvdXRwdXQ6CiAg\nYWxsOiAnPj4gL3Zhci9sb2cvY2xvdWQtaW5pdC1vdXRwdXQubG9nJwp1c2VyOiByb290CmNocGFz\nc3dkOgogIGV4cGlyZTogZmFsc2UKcnVuY21kOgotICdzZWQgLWkgJycvXmRhdGFzb3VyY2VfbGlz\ndDogL2QnJyAvZXRjL2Nsb3VkL2Nsb3VkLmNmZzsgZWNobyAnJ2RhdGFzb3VyY2VfbGlzdDoKICBb\nIk5vQ2xvdWQiLCAiQ29uZmlnRHJpdmUiXScnID4+IC9ldGMvY2xvdWQvY2xvdWQuY2ZnJwo=\n'}}}, 'readonly': 'true', 'deviceId': 'da8e2b7e-c618-4e3c-adf3-045b6fcde9ce', 'path': '', 'device': 'cdrom', 'shared': 'false', 'type': 'disk'}, {'device': 'qxl', 'specParams': {'vram': '32768', 'ram': '65536', 'heads': '1'}, 'type': 'video', 'deviceId': 'dbde1b0e-0ea8-4780-b618-4dac6adb6582'}, {'index': '2', 'iface': 'ide', 'specParams': {'path': ''}, 'readonly': 'true', 'deviceId': 'bce1e2b6-80e9-432e-a79b-641b4632ec27', 'path': '', 'device': 'cdrom', 'shared': 'false', 'type': 'disk'}, {'index': 0, 'iface': 'virtio', 'format': 'cow', 'bootOrder': '1', 'poolID': '4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', 'volumeID': 'b0fbb3c9-55af-4a3a-95ad-fc56a80b9cf5', 'imageID': 'f30c2cb7-a43a-4bf5-82b5-cfe07336f65c', 'specParams': {}, 'readonly': 'false', 'domainID': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'optional': 'false', 'deviceId': 'f30c2cb7-a43a-4bf5-82b5-cfe07336f65c', 'address': {'slot': '0x06', 'bus': '0x00', 'domain': '0x0000', 'type': 'pci', 'function': '0x0'}, 'device': 'disk', 'shared': 'false', 'propagateErrors': 'off', 'type': 'disk'}, {'nicModel': 'pv', 'macAddr': '00:1a:4a:de:6d:88', 'linkActive': 'true', 'network': 'rhevm', 'filter': 'vdsm-no-mac-spoofing', 'specParams': {'inbound': {}, 'outbound': {}}, 'deviceId': '9aad6e0d-00f0-411d-8c91-c4a387f13d81', 'device': 'bridge', 'type': 'interface'}, {'device': 'memballoon', 'specParams': {'model': 'virtio'}, 'type': 'balloon', 'deviceId': '07ce0be8-0938-4864-a125-a53c8ef4c654'}, {'index': '0', 'specParams': {}, 'deviceId': 'd0db6984-1aaa-4e92-9327-3b87b4d8cbb0', 'address': {'slot': '0x04', 'bus': '0x00', 'domain': '0x0000', 'type': 'pci', 'function': '0x0'}, 'device': 'scsi', 'model': 'virtio-scsi', 'type': 'controller'}], 'custom': {'device_5d6fbbae-0e2c-4af7-a34d-24cf1fd393e4device_5de3edb3-d4f4-4e0e-92cf-9ad5e6c556afdevice_636632cb-12d7-4044-b22f-9b276a2f0143': 'VmDevice {vmId=a766ed65-ac2e-4862-8ff0-0352480cf6f1, deviceId=636632cb-12d7-4044-b22f-9b276a2f0143, device=spicevmc, type=CHANNEL, bootOrder=0, specParams={}, address={port=3, bus=0, controller=0, type=virtio-serial}, managed=false, plugged=true, readOnly=false, deviceAlias=channel2, customProperties={}, snapshotId=null}', 'device_5d6fbbae-0e2c-4af7-a34d-24cf1fd393e4device_5de3edb3-d4f4-4e0e-92cf-9ad5e6c556af': 'VmDevice {vmId=a766ed65-ac2e-4862-8ff0-0352480cf6f1, deviceId=5de3edb3-d4f4-4e0e-92cf-9ad5e6c556af, device=ide, type=CONTROLLER, bootOrder=0, specParams={}, address={bus=0x00, domain=0x0000, type=pci, slot=0x01, function=0x1}, managed=false, plugged=true, readOnly=false, deviceAlias=ide0, customProperties={}, snapshotId=null}', 'device_5d6fbbae-0e2c-4af7-a34d-24cf1fd393e4device_5de3edb3-d4f4-4e0e-92cf-9ad5e6c556afdevice_636632cb-12d7-4044-b22f-9b276a2f0143device_6731c79f-ad6b-4002-8709-74f4d6d48818': 'VmDevice {vmId=a766ed65-ac2e-4862-8ff0-0352480cf6f1, deviceId=6731c79f-ad6b-4002-8709-74f4d6d48818, device=unix, type=CHANNEL, bootOrder=0, specParams={}, address={port=1, bus=0, controller=0, type=virtio-serial}, managed=false, plugged=true, readOnly=false, deviceAlias=channel0, customProperties={}, snapshotId=null}', 'device_5d6fbbae-0e2c-4af7-a34d-24cf1fd393e4device_5de3edb3-d4f4-4e0e-92cf-9ad5e6c556afdevice_636632cb-12d7-4044-b22f-9b276a2f0143device_6731c79f-ad6b-4002-8709-74f4d6d48818device_def6edf6-3f91-4b63-b2f7-7b0479fef24a': 'VmDevice {vmId=a766ed65-ac2e-4862-8ff0-0352480cf6f1, deviceId=def6edf6-3f91-4b63-b2f7-7b0479fef24a, device=unix, type=CHANNEL, bootOrder=0, specParams={}, address={port=2, bus=0, controller=0, type=virtio-serial}, managed=false, plugged=true, readOnly=false, deviceAlias=channel1, customProperties={}, snapshotId=null}', 'device_5d6fbbae-0e2c-4af7-a34d-24cf1fd393e4': 'VmDevice {vmId=a766ed65-ac2e-4862-8ff0-0352480cf6f1, deviceId=5d6fbbae-0e2c-4af7-a34d-24cf1fd393e4, device=virtio-serial, type=CONTROLLER, bootOrder=0, specParams={}, address={bus=0x00, domain=0x0000, type=pci, slot=0x05, function=0x0}, managed=false, plugged=true, readOnly=false, deviceAlias=virtio-serial0, customProperties={}, snapshotId=null}'}, 'vmType': 'kvm', 'memSize': 1024, 'displayIp': '0', 'maxVCpus': '160', 'spiceSecureChannels': 'smain,sinputs,scursor,splayback,srecord,sdisplay,susbredir,ssmartcard', 'smpCoresPerSocket': '2', 'vmName': 'scale_7', 'display': 'qxl', 'nice': '0'}} >Thread-65::DEBUG::2014-07-10 09:03:06,907::vm::2274::vm.Vm::(_startUnderlyingVm) vmId=`a766ed65-ac2e-4862-8ff0-0352480cf6f1`::_ongoingCreations acquired >Thread-65::INFO::2014-07-10 09:03:06,910::vm::3151::vm.Vm::(_run) vmId=`a766ed65-ac2e-4862-8ff0-0352480cf6f1`::VM wrapper has started >Thread-65::DEBUG::2014-07-10 09:03:06,915::task::595::TaskManager.Task::(_updateState) Task=`25778823-7ba6-4e7d-aa3c-3b558b12ab39`::moving from state init -> state preparing >Thread-65::INFO::2014-07-10 09:03:06,919::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='f30c2cb7-a43a-4bf5-82b5-cfe07336f65c', volUUID='b0fbb3c9-55af-4a3a-95ad-fc56a80b9cf5', options=None) >Thread-65::INFO::2014-07-10 09:03:06,923::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-65::DEBUG::2014-07-10 09:03:06,925::task::1185::TaskManager.Task::(prepare) Task=`25778823-7ba6-4e7d-aa3c-3b558b12ab39`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-65::DEBUG::2014-07-10 09:03:06,927::task::595::TaskManager.Task::(_updateState) Task=`25778823-7ba6-4e7d-aa3c-3b558b12ab39`::moving from state preparing -> state finished >Thread-65::DEBUG::2014-07-10 09:03:06,929::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-65::DEBUG::2014-07-10 09:03:06,931::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-65::DEBUG::2014-07-10 09:03:06,934::task::990::TaskManager.Task::(_decref) Task=`25778823-7ba6-4e7d-aa3c-3b558b12ab39`::ref 0 aborting False >Thread-65::INFO::2014-07-10 09:03:06,996::clientIF::324::vds::(prepareVolumePath) prepared volume path: /var/run/vdsm/payload/a766ed65-ac2e-4862-8ff0-0352480cf6f1.462c08a3318aa0af794cb5224d1a79d6.img >Thread-65::INFO::2014-07-10 09:03:06,996::clientIF::324::vds::(prepareVolumePath) prepared volume path: >Thread-65::DEBUG::2014-07-10 09:03:06,996::task::595::TaskManager.Task::(_updateState) Task=`64ffb640-25e1-4a31-a027-a0e3d34d0441`::moving from state init -> state preparing >Thread-65::INFO::2014-07-10 09:03:06,997::logUtils::44::dispatcher::(wrapper) Run and protect: prepareImage(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='f30c2cb7-a43a-4bf5-82b5-cfe07336f65c', leafUUID='b0fbb3c9-55af-4a3a-95ad-fc56a80b9cf5') >Thread-65::DEBUG::2014-07-10 09:03:06,997::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.9e1aa540-1f4e-4ee3-a152-be381ef6c3bd`ReqID=`7ef6ea7e-519b-4e79-a624-34c9996bd20c`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '3248' at 'prepareImage' >Thread-65::DEBUG::2014-07-10 09:03:06,997::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.9e1aa540-1f4e-4ee3-a152-be381ef6c3bd' for lock type 'shared' >Thread-65::DEBUG::2014-07-10 09:03:06,998::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.9e1aa540-1f4e-4ee3-a152-be381ef6c3bd' is free. Now locking as 'shared' (1 active user) >Thread-65::DEBUG::2014-07-10 09:03:06,998::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.9e1aa540-1f4e-4ee3-a152-be381ef6c3bd`ReqID=`7ef6ea7e-519b-4e79-a624-34c9996bd20c`::Granted request >Thread-65::DEBUG::2014-07-10 09:03:06,999::task::827::TaskManager.Task::(resourceAcquired) Task=`64ffb640-25e1-4a31-a027-a0e3d34d0441`::_resourcesAcquired: Storage.9e1aa540-1f4e-4ee3-a152-be381ef6c3bd (shared) >Thread-65::DEBUG::2014-07-10 09:03:06,999::task::990::TaskManager.Task::(_decref) Task=`64ffb640-25e1-4a31-a027-a0e3d34d0441`::ref 1 aborting False >Thread-65::DEBUG::2014-07-10 09:03:06,999::lvm::427::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' got the operation mutex >Thread-65::DEBUG::2014-07-10 09:03:07,000::lvm::296::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm lvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/3600601601282300032826addbbdae311|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,vg_name,attr,size,seg_start_pe,devices,tags 9e1aa540-1f4e-4ee3-a152-be381ef6c3bd' (cwd None) >Thread-65::DEBUG::2014-07-10 09:03:07,208::lvm::296::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-18::DEBUG::2014-07-10 09:03:07,219::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/metadata bs=4096 count=1' (cwd None) >Thread-65::DEBUG::2014-07-10 09:03:07,288::lvm::462::Storage.LVM::(_reloadlvs) lvs reloaded >Thread-65::DEBUG::2014-07-10 09:03:07,292::lvm::462::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' released the operation mutex >Thread-18::DEBUG::2014-07-10 09:03:07,305::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000530696 s, 7.7 MB/s\n'; <rc> = 0 >Thread-65::DEBUG::2014-07-10 09:03:07,310::lvm::296::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm lvchange --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/3600601601282300032826addbbdae311|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } " --autobackup n --available y 9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/b0fbb3c9-55af-4a3a-95ad-fc56a80b9cf5' (cwd None) >Thread-13::DEBUG::2014-07-10 09:03:07,350::BindingXMLRPC::1067::vds::(wrapper) client [10.35.3.13]::call vmGetStats with ('2386fa8c-f537-495c-ae07-e178171d77f2',) {} >Thread-13::DEBUG::2014-07-10 09:03:07,356::vm::676::vm.Vm::(_getDiskStats) vmId=`2386fa8c-f537-495c-ae07-e178171d77f2`::Disk hdd stats not available >Thread-13::DEBUG::2014-07-10 09:03:07,359::vm::676::vm.Vm::(_getDiskStats) vmId=`2386fa8c-f537-495c-ae07-e178171d77f2`::Disk hdc stats not available >Thread-13::DEBUG::2014-07-10 09:03:07,364::vm::676::vm.Vm::(_getDiskStats) vmId=`2386fa8c-f537-495c-ae07-e178171d77f2`::Disk vda stats not available >Thread-13::DEBUG::2014-07-10 09:03:07,367::vm::715::vm.Vm::(_getDiskLatency) vmId=`2386fa8c-f537-495c-ae07-e178171d77f2`::Disk hdd latency not available >Thread-13::DEBUG::2014-07-10 09:03:07,371::vm::715::vm.Vm::(_getDiskLatency) vmId=`2386fa8c-f537-495c-ae07-e178171d77f2`::Disk hdc latency not available >Thread-13::DEBUG::2014-07-10 09:03:07,374::vm::715::vm.Vm::(_getDiskLatency) vmId=`2386fa8c-f537-495c-ae07-e178171d77f2`::Disk vda latency not available >Thread-13::DEBUG::2014-07-10 09:03:07,379::BindingXMLRPC::1074::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Powering up', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '14143', 'displayIp': '0', 'displayPort': u'5908', 'session': 'Unknown', 'displaySecurePort': u'5909', 'timeOffset': '0', 'hash': '-2423634698834682900', 'balloonInfo': {'balloon_max': '1048576', 'balloon_target': '1048576', 'balloon_cur': '1048576', 'balloon_min': '1048576'}, 'pauseCode': 'NOERR', 'clientIp': '', 'kvmEnable': 'true', 'network': {u'vnet4': {'macAddr': '00:1a:4a:de:6d:7c', 'rxDropped': '0', 'rxErrors': '0', 'txDropped': '0', 'txRate': '0.0', 'rxRate': '0.0', 'txErrors': '0', 'state': 'unknown', 'speed': '1000', 'name': u'vnet4'}}, 'vmId': '2386fa8c-f537-495c-ae07-e178171d77f2', 'displayType': 'qxl', 'cpuUser': '43.14', 'disks': {u'vda': {'truesize': '1073741824', 'apparentsize': '1073741824', 'imageID': 'b034d5b0-e1e0-4011-b49b-4d45ddb11556'}, u'hdd': {'truesize': '0', 'apparentsize': '0'}, u'hdc': {'truesize': '0', 'apparentsize': '0'}}, 'monitorResponse': '0', 'statsAge': '0.22', 'elapsedTime': '40', 'vmType': 'kvm', 'cpuSys': '6.77', 'guestCPUCount': -1, 'appsList': [], 'guestIPs': ''}]} >Thread-13::DEBUG::2014-07-10 09:03:07,409::BindingXMLRPC::1067::vds::(wrapper) client [10.35.3.13]::call vmGetStats with ('7fc21bb8-bd92-4924-acef-8360998e92a1',) {} >Thread-13::DEBUG::2014-07-10 09:03:07,414::vm::676::vm.Vm::(_getDiskStats) vmId=`7fc21bb8-bd92-4924-acef-8360998e92a1`::Disk hdd stats not available >Thread-13::DEBUG::2014-07-10 09:03:07,417::vm::676::vm.Vm::(_getDiskStats) vmId=`7fc21bb8-bd92-4924-acef-8360998e92a1`::Disk hdc stats not available >Thread-13::DEBUG::2014-07-10 09:03:07,420::vm::676::vm.Vm::(_getDiskStats) vmId=`7fc21bb8-bd92-4924-acef-8360998e92a1`::Disk vda stats not available >Thread-13::DEBUG::2014-07-10 09:03:07,422::vm::715::vm.Vm::(_getDiskLatency) vmId=`7fc21bb8-bd92-4924-acef-8360998e92a1`::Disk hdd latency not available >Thread-13::DEBUG::2014-07-10 09:03:07,425::vm::715::vm.Vm::(_getDiskLatency) vmId=`7fc21bb8-bd92-4924-acef-8360998e92a1`::Disk hdc latency not available >Thread-13::DEBUG::2014-07-10 09:03:07,429::vm::715::vm.Vm::(_getDiskLatency) vmId=`7fc21bb8-bd92-4924-acef-8360998e92a1`::Disk vda latency not available >Thread-13::DEBUG::2014-07-10 09:03:07,433::BindingXMLRPC::1074::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Powering up', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '14800', 'displayIp': '0', 'displayPort': u'5910', 'session': 'Unknown', 'displaySecurePort': u'5911', 'timeOffset': '0', 'hash': '-831008492253830849', 'balloonInfo': {'balloon_max': '1048576', 'balloon_target': '1048576', 'balloon_cur': '1048576', 'balloon_min': '1048576'}, 'pauseCode': 'NOERR', 'clientIp': '', 'kvmEnable': 'true', 'network': {u'vnet5': {'macAddr': '00:1a:4a:de:6d:7d', 'rxDropped': '0', 'rxErrors': '0', 'txDropped': '0', 'txRate': '0.0', 'rxRate': '0.0', 'txErrors': '0', 'state': 'unknown', 'speed': '1000', 'name': u'vnet5'}}, 'vmId': '7fc21bb8-bd92-4924-acef-8360998e92a1', 'displayType': 'qxl', 'cpuUser': '46.56', 'disks': {u'vda': {'truesize': '1073741824', 'apparentsize': '1073741824', 'imageID': 'aa20346a-4d3a-4e07-b8e1-52c0ebe4168c'}, u'hdd': {'truesize': '0', 'apparentsize': '0'}, u'hdc': {'truesize': '0', 'apparentsize': '0'}}, 'monitorResponse': '0', 'statsAge': '0.79', 'elapsedTime': '21', 'vmType': 'kvm', 'cpuSys': '21.04', 'guestCPUCount': -1, 'appsList': [], 'guestIPs': ''}]} >Thread-65::DEBUG::2014-07-10 09:03:07,910::lvm::296::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-65::DEBUG::2014-07-10 09:03:07,911::lvm::513::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-65::DEBUG::2014-07-10 09:03:07,911::lvm::525::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-65::DEBUG::2014-07-10 09:03:07,912::blockSD::1057::Storage.StorageDomain::(linkBCImage) path to image directory already exists: /rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/images/f30c2cb7-a43a-4bf5-82b5-cfe07336f65c >Thread-65::DEBUG::2014-07-10 09:03:07,913::lvm::427::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' got the operation mutex >Thread-65::DEBUG::2014-07-10 09:03:07,914::lvm::296::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm lvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/3600601601282300032826addbbdae311|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,vg_name,attr,size,seg_start_pe,devices,tags 9e1aa540-1f4e-4ee3-a152-be381ef6c3bd' (cwd None) >GuestMonitor-scale_6::DEBUG::2014-07-10 09:03:07,932::vm::676::vm.Vm::(_getDiskStats) vmId=`7fc21bb8-bd92-4924-acef-8360998e92a1`::Disk hdd stats not available >GuestMonitor-scale_6::DEBUG::2014-07-10 09:03:07,934::vm::676::vm.Vm::(_getDiskStats) vmId=`7fc21bb8-bd92-4924-acef-8360998e92a1`::Disk hdc stats not available >GuestMonitor-scale_6::DEBUG::2014-07-10 09:03:07,934::vm::676::vm.Vm::(_getDiskStats) vmId=`7fc21bb8-bd92-4924-acef-8360998e92a1`::Disk vda stats not available >GuestMonitor-scale_6::DEBUG::2014-07-10 09:03:07,935::vm::715::vm.Vm::(_getDiskLatency) vmId=`7fc21bb8-bd92-4924-acef-8360998e92a1`::Disk hdd latency not available >GuestMonitor-scale_6::DEBUG::2014-07-10 09:03:07,935::vm::715::vm.Vm::(_getDiskLatency) vmId=`7fc21bb8-bd92-4924-acef-8360998e92a1`::Disk hdc latency not available >GuestMonitor-scale_6::DEBUG::2014-07-10 09:03:07,935::vm::715::vm.Vm::(_getDiskLatency) vmId=`7fc21bb8-bd92-4924-acef-8360998e92a1`::Disk vda latency not available >GuestMonitor-scale_6::DEBUG::2014-07-10 09:03:07,936::vm::676::vm.Vm::(_getDiskStats) vmId=`7fc21bb8-bd92-4924-acef-8360998e92a1`::Disk hdd stats not available >GuestMonitor-scale_6::DEBUG::2014-07-10 09:03:07,936::vm::676::vm.Vm::(_getDiskStats) vmId=`7fc21bb8-bd92-4924-acef-8360998e92a1`::Disk hdc stats not available >GuestMonitor-scale_6::DEBUG::2014-07-10 09:03:07,936::vm::676::vm.Vm::(_getDiskStats) vmId=`7fc21bb8-bd92-4924-acef-8360998e92a1`::Disk vda stats not available >GuestMonitor-scale_6::DEBUG::2014-07-10 09:03:07,936::vm::715::vm.Vm::(_getDiskLatency) vmId=`7fc21bb8-bd92-4924-acef-8360998e92a1`::Disk hdd latency not available >GuestMonitor-scale_6::DEBUG::2014-07-10 09:03:07,937::vm::715::vm.Vm::(_getDiskLatency) vmId=`7fc21bb8-bd92-4924-acef-8360998e92a1`::Disk hdc latency not available >GuestMonitor-scale_6::DEBUG::2014-07-10 09:03:07,937::vm::715::vm.Vm::(_getDiskLatency) vmId=`7fc21bb8-bd92-4924-acef-8360998e92a1`::Disk vda latency not available >GuestMonitor-scale_5::DEBUG::2014-07-10 09:03:07,955::vm::676::vm.Vm::(_getDiskStats) vmId=`2386fa8c-f537-495c-ae07-e178171d77f2`::Disk hdd stats not available >GuestMonitor-scale_5::DEBUG::2014-07-10 09:03:07,955::vm::676::vm.Vm::(_getDiskStats) vmId=`2386fa8c-f537-495c-ae07-e178171d77f2`::Disk hdc stats not available >GuestMonitor-scale_5::DEBUG::2014-07-10 09:03:07,955::vm::676::vm.Vm::(_getDiskStats) vmId=`2386fa8c-f537-495c-ae07-e178171d77f2`::Disk vda stats not available >GuestMonitor-scale_5::DEBUG::2014-07-10 09:03:07,955::vm::715::vm.Vm::(_getDiskLatency) vmId=`2386fa8c-f537-495c-ae07-e178171d77f2`::Disk hdd latency not available >GuestMonitor-scale_5::DEBUG::2014-07-10 09:03:07,956::vm::715::vm.Vm::(_getDiskLatency) vmId=`2386fa8c-f537-495c-ae07-e178171d77f2`::Disk hdc latency not available >GuestMonitor-scale_5::DEBUG::2014-07-10 09:03:07,956::vm::715::vm.Vm::(_getDiskLatency) vmId=`2386fa8c-f537-495c-ae07-e178171d77f2`::Disk vda latency not available >GuestMonitor-scale_5::DEBUG::2014-07-10 09:03:07,956::vm::676::vm.Vm::(_getDiskStats) vmId=`2386fa8c-f537-495c-ae07-e178171d77f2`::Disk hdd stats not available >GuestMonitor-scale_5::DEBUG::2014-07-10 09:03:07,956::vm::676::vm.Vm::(_getDiskStats) vmId=`2386fa8c-f537-495c-ae07-e178171d77f2`::Disk hdc stats not available >GuestMonitor-scale_5::DEBUG::2014-07-10 09:03:07,957::vm::676::vm.Vm::(_getDiskStats) vmId=`2386fa8c-f537-495c-ae07-e178171d77f2`::Disk vda stats not available >GuestMonitor-scale_5::DEBUG::2014-07-10 09:03:07,957::vm::715::vm.Vm::(_getDiskLatency) vmId=`2386fa8c-f537-495c-ae07-e178171d77f2`::Disk hdd latency not available >GuestMonitor-scale_5::DEBUG::2014-07-10 09:03:07,957::vm::715::vm.Vm::(_getDiskLatency) vmId=`2386fa8c-f537-495c-ae07-e178171d77f2`::Disk hdc latency not available >GuestMonitor-scale_5::DEBUG::2014-07-10 09:03:07,957::vm::715::vm.Vm::(_getDiskLatency) vmId=`2386fa8c-f537-495c-ae07-e178171d77f2`::Disk vda latency not available >GuestMonitor-scale_4::DEBUG::2014-07-10 09:03:08,010::vm::676::vm.Vm::(_getDiskStats) vmId=`0e968db5-5d49-467f-9ff3-afc37b64364f`::Disk hdd stats not available >GuestMonitor-scale_4::DEBUG::2014-07-10 09:03:08,010::vm::676::vm.Vm::(_getDiskStats) vmId=`0e968db5-5d49-467f-9ff3-afc37b64364f`::Disk hdc stats not available >GuestMonitor-scale_4::DEBUG::2014-07-10 09:03:08,010::vm::676::vm.Vm::(_getDiskStats) vmId=`0e968db5-5d49-467f-9ff3-afc37b64364f`::Disk vda stats not available >GuestMonitor-scale_4::DEBUG::2014-07-10 09:03:08,011::vm::715::vm.Vm::(_getDiskLatency) vmId=`0e968db5-5d49-467f-9ff3-afc37b64364f`::Disk hdd latency not available >GuestMonitor-scale_4::DEBUG::2014-07-10 09:03:08,011::vm::715::vm.Vm::(_getDiskLatency) vmId=`0e968db5-5d49-467f-9ff3-afc37b64364f`::Disk hdc latency not available >GuestMonitor-scale_4::DEBUG::2014-07-10 09:03:08,011::vm::715::vm.Vm::(_getDiskLatency) vmId=`0e968db5-5d49-467f-9ff3-afc37b64364f`::Disk vda latency not available >GuestMonitor-scale_4::DEBUG::2014-07-10 09:03:08,012::vm::676::vm.Vm::(_getDiskStats) vmId=`0e968db5-5d49-467f-9ff3-afc37b64364f`::Disk hdd stats not available >GuestMonitor-scale_4::DEBUG::2014-07-10 09:03:08,012::vm::676::vm.Vm::(_getDiskStats) vmId=`0e968db5-5d49-467f-9ff3-afc37b64364f`::Disk hdc stats not available >GuestMonitor-scale_4::DEBUG::2014-07-10 09:03:08,012::vm::676::vm.Vm::(_getDiskStats) vmId=`0e968db5-5d49-467f-9ff3-afc37b64364f`::Disk vda stats not available >GuestMonitor-scale_4::DEBUG::2014-07-10 09:03:08,012::vm::715::vm.Vm::(_getDiskLatency) vmId=`0e968db5-5d49-467f-9ff3-afc37b64364f`::Disk hdd latency not available >GuestMonitor-scale_4::DEBUG::2014-07-10 09:03:08,012::vm::715::vm.Vm::(_getDiskLatency) vmId=`0e968db5-5d49-467f-9ff3-afc37b64364f`::Disk hdc latency not available >GuestMonitor-scale_4::DEBUG::2014-07-10 09:03:08,013::vm::715::vm.Vm::(_getDiskLatency) vmId=`0e968db5-5d49-467f-9ff3-afc37b64364f`::Disk vda latency not available >Thread-65::DEBUG::2014-07-10 09:03:08,139::lvm::296::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-65::DEBUG::2014-07-10 09:03:08,154::lvm::462::Storage.LVM::(_reloadlvs) lvs reloaded >Thread-65::DEBUG::2014-07-10 09:03:08,154::lvm::462::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' released the operation mutex >Thread-65::INFO::2014-07-10 09:03:08,155::logUtils::47::dispatcher::(wrapper) Run and protect: prepareImage, Return response: {'info': {'domainID': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'volType': 'path', 'leaseOffset': 116391936, 'path': '/rhev/data-center/mnt/blockSD/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/images/f30c2cb7-a43a-4bf5-82b5-cfe07336f65c/b0fbb3c9-55af-4a3a-95ad-fc56a80b9cf5', 'volumeID': 'b0fbb3c9-55af-4a3a-95ad-fc56a80b9cf5', 'leasePath': '/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/leases', 'imageID': 'f30c2cb7-a43a-4bf5-82b5-cfe07336f65c'}, 'path': '/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/images/f30c2cb7-a43a-4bf5-82b5-cfe07336f65c/b0fbb3c9-55af-4a3a-95ad-fc56a80b9cf5', 'imgVolumesInfo': [{'domainID': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'volType': 'path', 'leaseOffset': 109051904, 'path': '/rhev/data-center/mnt/blockSD/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/images/f30c2cb7-a43a-4bf5-82b5-cfe07336f65c/47592965-e853-4e59-9728-d11cca6a7a8a', 'volumeID': '47592965-e853-4e59-9728-d11cca6a7a8a', 'leasePath': '/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/leases', 'imageID': 'f30c2cb7-a43a-4bf5-82b5-cfe07336f65c'}, {'domainID': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'volType': 'path', 'leaseOffset': 116391936, 'path': '/rhev/data-center/mnt/blockSD/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/images/f30c2cb7-a43a-4bf5-82b5-cfe07336f65c/b0fbb3c9-55af-4a3a-95ad-fc56a80b9cf5', 'volumeID': 'b0fbb3c9-55af-4a3a-95ad-fc56a80b9cf5', 'leasePath': '/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/leases', 'imageID': 'f30c2cb7-a43a-4bf5-82b5-cfe07336f65c'}]} >Thread-65::DEBUG::2014-07-10 09:03:08,156::task::1185::TaskManager.Task::(prepare) Task=`64ffb640-25e1-4a31-a027-a0e3d34d0441`::finished: {'info': {'domainID': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'volType': 'path', 'leaseOffset': 116391936, 'path': '/rhev/data-center/mnt/blockSD/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/images/f30c2cb7-a43a-4bf5-82b5-cfe07336f65c/b0fbb3c9-55af-4a3a-95ad-fc56a80b9cf5', 'volumeID': 'b0fbb3c9-55af-4a3a-95ad-fc56a80b9cf5', 'leasePath': '/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/leases', 'imageID': 'f30c2cb7-a43a-4bf5-82b5-cfe07336f65c'}, 'path': '/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/images/f30c2cb7-a43a-4bf5-82b5-cfe07336f65c/b0fbb3c9-55af-4a3a-95ad-fc56a80b9cf5', 'imgVolumesInfo': [{'domainID': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'volType': 'path', 'leaseOffset': 109051904, 'path': '/rhev/data-center/mnt/blockSD/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/images/f30c2cb7-a43a-4bf5-82b5-cfe07336f65c/47592965-e853-4e59-9728-d11cca6a7a8a', 'volumeID': '47592965-e853-4e59-9728-d11cca6a7a8a', 'leasePath': '/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/leases', 'imageID': 'f30c2cb7-a43a-4bf5-82b5-cfe07336f65c'}, {'domainID': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'volType': 'path', 'leaseOffset': 116391936, 'path': '/rhev/data-center/mnt/blockSD/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/images/f30c2cb7-a43a-4bf5-82b5-cfe07336f65c/b0fbb3c9-55af-4a3a-95ad-fc56a80b9cf5', 'volumeID': 'b0fbb3c9-55af-4a3a-95ad-fc56a80b9cf5', 'leasePath': '/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/leases', 'imageID': 'f30c2cb7-a43a-4bf5-82b5-cfe07336f65c'}]} >Thread-65::DEBUG::2014-07-10 09:03:08,156::task::595::TaskManager.Task::(_updateState) Task=`64ffb640-25e1-4a31-a027-a0e3d34d0441`::moving from state preparing -> state finished >Thread-65::DEBUG::2014-07-10 09:03:08,156::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': < ResourceRef 'Storage.9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', isValid: 'True' obj: 'None'>} >Thread-65::DEBUG::2014-07-10 09:03:08,156::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-65::DEBUG::2014-07-10 09:03:08,157::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.9e1aa540-1f4e-4ee3-a152-be381ef6c3bd' >Thread-65::DEBUG::2014-07-10 09:03:08,157::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.9e1aa540-1f4e-4ee3-a152-be381ef6c3bd' (0 active users) >Thread-65::DEBUG::2014-07-10 09:03:08,157::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.9e1aa540-1f4e-4ee3-a152-be381ef6c3bd' is free, finding out if anyone is waiting for it. >Thread-65::DEBUG::2014-07-10 09:03:08,158::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', Clearing records. >Thread-65::DEBUG::2014-07-10 09:03:08,158::task::990::TaskManager.Task::(_decref) Task=`64ffb640-25e1-4a31-a027-a0e3d34d0441`::ref 0 aborting False >Thread-65::INFO::2014-07-10 09:03:08,158::clientIF::324::vds::(prepareVolumePath) prepared volume path: /rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/images/f30c2cb7-a43a-4bf5-82b5-cfe07336f65c/b0fbb3c9-55af-4a3a-95ad-fc56a80b9cf5 >Thread-65::DEBUG::2014-07-10 09:03:08,339::utils::642::root::(execCmd) '/usr/libexec/vdsm/hooks/before_vm_start/50_vhostmd' (cwd None) >Thread-65::DEBUG::2014-07-10 09:03:08,447::utils::662::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-65::INFO::2014-07-10 09:03:08,448::hooks::100::root::(_runHooksDir) >Thread-65::DEBUG::2014-07-10 09:03:08,449::vm::3190::vm.Vm::(_run) vmId=`a766ed65-ac2e-4862-8ff0-0352480cf6f1`::<?xml version="1.0" encoding="utf-8"?> ><domain type="kvm"> > <name>scale_7</name> > <uuid>a766ed65-ac2e-4862-8ff0-0352480cf6f1</uuid> > <memory>1048576</memory> > <currentMemory>1048576</currentMemory> > <vcpu current="2">160</vcpu> > <memtune> > <min_guarantee>1048576</min_guarantee> > </memtune> > <devices> > <channel type="unix"> > <target name="com.redhat.rhevm.vdsm" type="virtio"/> > <source mode="bind" path="/var/lib/libvirt/qemu/channels/a766ed65-ac2e-4862-8ff0-0352480cf6f1.com.redhat.rhevm.vdsm"/> > </channel> > <channel type="unix"> > <target name="org.qemu.guest_agent.0" type="virtio"/> > <source mode="bind" path="/var/lib/libvirt/qemu/channels/a766ed65-ac2e-4862-8ff0-0352480cf6f1.org.qemu.guest_agent.0"/> > </channel> > <input bus="ps2" type="mouse"/> > <channel type="spicevmc"> > <target name="com.redhat.spice.0" type="virtio"/> > </channel> > <graphics autoport="yes" keymap="en-us" listen="0" passwd="*****" passwdValidTo="1970-01-01T00:00:01" port="-1" tlsPort="-1" type="spice"> > <channel mode="secure" name="main"/> > <channel mode="secure" name="inputs"/> > <channel mode="secure" name="cursor"/> > <channel mode="secure" name="playback"/> > <channel mode="secure" name="record"/> > <channel mode="secure" name="display"/> > <channel mode="secure" name="usbredir"/> > <channel mode="secure" name="smartcard"/> > </graphics> > <memballoon model="virtio"/> > <controller index="0" model="virtio-scsi" type="scsi"> > <address bus="0x00" domain="0x0000" function="0x0" slot="0x04" type="pci"/> > </controller> > <video> > <model heads="1" ram="65536" type="qxl" vram="32768"/> > </video> > <interface type="bridge"> > <mac address="00:1a:4a:de:6d:88"/> > <model type="virtio"/> > <source bridge="rhevm"/> > <filterref filter="vdsm-no-mac-spoofing"/> > <link state="up"/> > <bandwidth/> > </interface> > <disk device="cdrom" snapshot="no" type="file"> > <source file="/var/run/vdsm/payload/a766ed65-ac2e-4862-8ff0-0352480cf6f1.462c08a3318aa0af794cb5224d1a79d6.img" startupPolicy="optional"/> > <target bus="ide" dev="hdd"/> > <readonly/> > <serial/> > </disk> > <disk device="cdrom" snapshot="no" type="file"> > <source file="" startupPolicy="optional"/> > <target bus="ide" dev="hdc"/> > <readonly/> > <serial/> > </disk> > <disk device="disk" snapshot="no" type="block"> > <address bus="0x00" domain="0x0000" function="0x0" slot="0x06" type="pci"/> > <source dev="/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/images/f30c2cb7-a43a-4bf5-82b5-cfe07336f65c/b0fbb3c9-55af-4a3a-95ad-fc56a80b9cf5"/> > <target bus="virtio" dev="vda"/> > <serial>f30c2cb7-a43a-4bf5-82b5-cfe07336f65c</serial> > <boot order="1"/> > <driver cache="none" error_policy="stop" io="native" name="qemu" type="qcow2"/> > </disk> > </devices> > <os> > <type arch="x86_64" machine="rhel6.5.0">hvm</type> > <smbios mode="sysinfo"/> > </os> > <sysinfo type="smbios"> > <system> > <entry name="manufacturer">Red Hat</entry> > <entry name="product">RHEV Hypervisor</entry> > <entry name="version">6.5-20140707.0.el6ev</entry> > <entry name="serial">52BAF97B-FF2F-E311-0000-100000000005</entry> > <entry name="uuid">a766ed65-ac2e-4862-8ff0-0352480cf6f1</entry> > </system> > </sysinfo> > <clock adjustment="0" offset="variable"> > <timer name="rtc" tickpolicy="catchup"/> > </clock> > <features> > <acpi/> > </features> > <cpu match="exact"> > <model>Conroe</model> > <topology cores="2" sockets="80" threads="1"/> > </cpu> ></domain> > >Dummy-33::DEBUG::2014-07-10 09:03:08,806::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Thread-57::DEBUG::2014-07-10 09:03:08,860::task::595::TaskManager.Task::(_updateState) Task=`25f23cd9-776b-4169-82fe-2e0dcb3b2055`::moving from state init -> state preparing >Thread-57::INFO::2014-07-10 09:03:08,865::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='b6f6c0da-e67f-4902-b9ac-3069571a42fe', volUUID='c4cd1da8-05b7-45e0-80b1-1183d21443d9', options=None) >Thread-57::INFO::2014-07-10 09:03:08,869::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-57::DEBUG::2014-07-10 09:03:08,871::task::1185::TaskManager.Task::(prepare) Task=`25f23cd9-776b-4169-82fe-2e0dcb3b2055`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-57::DEBUG::2014-07-10 09:03:08,874::task::595::TaskManager.Task::(_updateState) Task=`25f23cd9-776b-4169-82fe-2e0dcb3b2055`::moving from state preparing -> state finished >Thread-57::DEBUG::2014-07-10 09:03:08,876::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-57::DEBUG::2014-07-10 09:03:08,878::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-57::DEBUG::2014-07-10 09:03:08,882::task::990::TaskManager.Task::(_decref) Task=`25f23cd9-776b-4169-82fe-2e0dcb3b2055`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 09:03:08,920::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0275459 s, 37.2 MB/s\n'; <rc> = 0 >libvirtEventLoop::DEBUG::2014-07-10 09:03:09,376::vm::5176::vm.Vm::(_onLibvirtLifecycleEvent) vmId=`a766ed65-ac2e-4862-8ff0-0352480cf6f1`::event Started detail 0 opaque None >Thread-65::DEBUG::2014-07-10 09:03:09,407::vm::5032::vm.Vm::(_getUnderlyingDriveInfo) vmId=`a766ed65-ac2e-4862-8ff0-0352480cf6f1`::Looking for drive with attributes {'name': u'hdc', 'bootOrder': '', 'boot': [], 'readonly': True, 'address': {u'bus': u'1', u'controller': u'0', u'type': u'drive', u'target': u'0', u'unit': u'0'}, 'path': '', 'type': u'cdrom'} >Thread-65::DEBUG::2014-07-10 09:03:09,408::vm::5053::vm.Vm::(_getUnderlyingDriveInfo) vmId=`a766ed65-ac2e-4862-8ff0-0352480cf6f1`::Matched {'name': (u'hdc', u'hdc'), 'bootOrder': ('', None), 'boot': ([], None), 'readonly': (True, True), 'address': ({u'bus': u'1', u'controller': u'0', u'type': u'drive', u'target': u'0', u'unit': u'0'}, {u'bus': u'1', u'controller': u'0', u'type': u'drive', u'target': u'0', u'unit': u'0'}), 'path': ('', ''), 'type': (u'cdrom', u'cdrom')} >Thread-65::DEBUG::2014-07-10 09:03:09,408::vm::5072::vm.Vm::(_getUnderlyingDriveInfo) vmId=`a766ed65-ac2e-4862-8ff0-0352480cf6f1`::Matched {'name': (u'hdc', u'hdc'), 'bootOrder': ('', None), 'boot': ([], None), 'readonly': (True, 'True'), 'address': ({u'bus': u'1', u'controller': u'0', u'type': u'drive', u'target': u'0', u'unit': u'0'}, {u'bus': u'1', u'controller': u'0', u'type': u'drive', u'target': u'0', u'unit': u'0'}), 'path': ('', ''), 'type': (u'cdrom', 'disk')} >Thread-65::DEBUG::2014-07-10 09:03:09,409::vm::5032::vm.Vm::(_getUnderlyingDriveInfo) vmId=`a766ed65-ac2e-4862-8ff0-0352480cf6f1`::Looking for drive with attributes {'name': u'hdd', 'bootOrder': '', 'boot': [], 'readonly': True, 'address': {u'bus': u'1', u'controller': u'0', u'type': u'drive', u'target': u'0', u'unit': u'1'}, 'path': u'/var/run/vdsm/payload/a766ed65-ac2e-4862-8ff0-0352480cf6f1.462c08a3318aa0af794cb5224d1a79d6.img', 'type': u'cdrom'} >Thread-65::DEBUG::2014-07-10 09:03:09,409::vm::5053::vm.Vm::(_getUnderlyingDriveInfo) vmId=`a766ed65-ac2e-4862-8ff0-0352480cf6f1`::Matched {'name': (u'hdd', u'hdd'), 'bootOrder': ('', None), 'boot': ([], None), 'readonly': (True, True), 'address': ({u'bus': u'1', u'controller': u'0', u'type': u'drive', u'target': u'0', u'unit': u'1'}, {u'bus': u'1', u'controller': u'0', u'type': u'drive', u'target': u'0', u'unit': u'1'}), 'path': (u'/var/run/vdsm/payload/a766ed65-ac2e-4862-8ff0-0352480cf6f1.462c08a3318aa0af794cb5224d1a79d6.img', '/var/run/vdsm/payload/a766ed65-ac2e-4862-8ff0-0352480cf6f1.462c08a3318aa0af794cb5224d1a79d6.img'), 'type': (u'cdrom', u'cdrom')} >Thread-65::DEBUG::2014-07-10 09:03:09,409::vm::5072::vm.Vm::(_getUnderlyingDriveInfo) vmId=`a766ed65-ac2e-4862-8ff0-0352480cf6f1`::Matched {'name': (u'hdd', u'hdd'), 'bootOrder': ('', None), 'boot': ([], None), 'readonly': (True, 'True'), 'address': ({u'bus': u'1', u'controller': u'0', u'type': u'drive', u'target': u'0', u'unit': u'1'}, {u'bus': u'1', u'controller': u'0', u'type': u'drive', u'target': u'0', u'unit': u'1'}), 'path': (u'/var/run/vdsm/payload/a766ed65-ac2e-4862-8ff0-0352480cf6f1.462c08a3318aa0af794cb5224d1a79d6.img', '/var/run/vdsm/payload/a766ed65-ac2e-4862-8ff0-0352480cf6f1.462c08a3318aa0af794cb5224d1a79d6.img'), 'type': (u'cdrom', 'disk')} >Thread-65::DEBUG::2014-07-10 09:03:09,410::vm::5032::vm.Vm::(_getUnderlyingDriveInfo) vmId=`a766ed65-ac2e-4862-8ff0-0352480cf6f1`::Looking for drive with attributes {'name': u'vda', 'bootOrder': u'1', 'boot': [<DOM Element: boot at 0x7f620c078170>], 'readonly': False, 'address': {u'slot': u'0x06', u'bus': u'0x00', u'domain': u'0x0000', u'type': u'pci', u'function': u'0x0'}, 'path': u'/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/images/f30c2cb7-a43a-4bf5-82b5-cfe07336f65c/b0fbb3c9-55af-4a3a-95ad-fc56a80b9cf5', 'type': u'disk'} >Thread-65::DEBUG::2014-07-10 09:03:09,410::vm::5053::vm.Vm::(_getUnderlyingDriveInfo) vmId=`a766ed65-ac2e-4862-8ff0-0352480cf6f1`::Matched {'name': (u'vda', u'vda'), 'bootOrder': (u'1', u'1'), 'boot': ([<DOM Element: boot at 0x7f620c078170>], None), 'readonly': (False, False), 'address': ({u'slot': u'0x06', u'bus': u'0x00', u'domain': u'0x0000', u'type': u'pci', u'function': u'0x0'}, {u'slot': u'0x06', u'bus': u'0x00', u'domain': u'0x0000', u'type': u'pci', u'function': u'0x0'}), 'path': (u'/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/images/f30c2cb7-a43a-4bf5-82b5-cfe07336f65c/b0fbb3c9-55af-4a3a-95ad-fc56a80b9cf5', '/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/images/f30c2cb7-a43a-4bf5-82b5-cfe07336f65c/b0fbb3c9-55af-4a3a-95ad-fc56a80b9cf5'), 'type': (u'disk', u'disk')} >Thread-65::DEBUG::2014-07-10 09:03:09,410::vm::5072::vm.Vm::(_getUnderlyingDriveInfo) vmId=`a766ed65-ac2e-4862-8ff0-0352480cf6f1`::Matched {'name': (u'vda', u'vda'), 'bootOrder': (u'1', u'1'), 'boot': ([<DOM Element: boot at 0x7f620c078170>], None), 'readonly': (False, 'False'), 'address': ({u'slot': u'0x06', u'bus': u'0x00', u'domain': u'0x0000', u'type': u'pci', u'function': u'0x0'}, {u'slot': u'0x06', u'bus': u'0x00', u'domain': u'0x0000', u'type': u'pci', u'function': u'0x0'}), 'path': (u'/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/images/f30c2cb7-a43a-4bf5-82b5-cfe07336f65c/b0fbb3c9-55af-4a3a-95ad-fc56a80b9cf5', '/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/images/f30c2cb7-a43a-4bf5-82b5-cfe07336f65c/b0fbb3c9-55af-4a3a-95ad-fc56a80b9cf5'), 'type': (u'disk', 'disk')} >Thread-65::DEBUG::2014-07-10 09:03:09,482::sampling::285::vm.Vm::(start) vmId=`a766ed65-ac2e-4862-8ff0-0352480cf6f1`::Start statistics collection >Thread-67::DEBUG::2014-07-10 09:03:09,484::sampling::314::vm.Vm::(run) vmId=`a766ed65-ac2e-4862-8ff0-0352480cf6f1`::Stats thread started >Thread-67::DEBUG::2014-07-10 09:03:09,491::task::595::TaskManager.Task::(_updateState) Task=`b04374ce-8c61-465d-a25a-4a374d4116a7`::moving from state init -> state preparing >Thread-67::INFO::2014-07-10 09:03:09,491::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='f30c2cb7-a43a-4bf5-82b5-cfe07336f65c', volUUID='b0fbb3c9-55af-4a3a-95ad-fc56a80b9cf5', options=None) >Thread-67::INFO::2014-07-10 09:03:09,492::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-67::DEBUG::2014-07-10 09:03:09,492::task::1185::TaskManager.Task::(prepare) Task=`b04374ce-8c61-465d-a25a-4a374d4116a7`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-67::DEBUG::2014-07-10 09:03:09,492::task::595::TaskManager.Task::(_updateState) Task=`b04374ce-8c61-465d-a25a-4a374d4116a7`::moving from state preparing -> state finished >Thread-67::DEBUG::2014-07-10 09:03:09,492::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-67::DEBUG::2014-07-10 09:03:09,493::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-67::DEBUG::2014-07-10 09:03:09,493::task::990::TaskManager.Task::(_decref) Task=`b04374ce-8c61-465d-a25a-4a374d4116a7`::ref 0 aborting False >Thread-65::DEBUG::2014-07-10 09:03:09,502::vmChannels::198::vds::(register) Add fileno 67 to listener's channels. >Thread-65::WARNING::2014-07-10 09:03:09,505::vm::3715::vm.Vm::(_readPauseCode) vmId=`a766ed65-ac2e-4862-8ff0-0352480cf6f1`::_readPauseCode unsupported by libvirt vm >Thread-65::DEBUG::2014-07-10 09:03:09,522::vm::2291::vm.Vm::(_startUnderlyingVm) vmId=`a766ed65-ac2e-4862-8ff0-0352480cf6f1`::_ongoingCreations released >Thread-48::DEBUG::2014-07-10 09:03:09,985::task::595::TaskManager.Task::(_updateState) Task=`85790a93-a9a5-40ba-a755-9eeb34c855c8`::moving from state init -> state preparing >Thread-48::INFO::2014-07-10 09:03:09,986::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='0cd7d6ce-f497-4243-a690-c57744861eea', volUUID='10b6a7dd-dc6c-43fa-ba17-92e4331b0e0b', options=None) >Thread-48::INFO::2014-07-10 09:03:09,986::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-48::DEBUG::2014-07-10 09:03:09,987::task::1185::TaskManager.Task::(prepare) Task=`85790a93-a9a5-40ba-a755-9eeb34c855c8`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-48::DEBUG::2014-07-10 09:03:09,987::task::595::TaskManager.Task::(_updateState) Task=`85790a93-a9a5-40ba-a755-9eeb34c855c8`::moving from state preparing -> state finished >Thread-48::DEBUG::2014-07-10 09:03:09,987::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-48::DEBUG::2014-07-10 09:03:09,987::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-48::DEBUG::2014-07-10 09:03:09,988::task::990::TaskManager.Task::(_decref) Task=`85790a93-a9a5-40ba-a755-9eeb34c855c8`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-07-10 09:03:10,303::vmChannels::106::vds::(_do_add_channels) fileno 67 was added to unconnected channels. >VM Channels Listener::DEBUG::2014-07-10 09:03:10,304::vmChannels::132::vds::(_handle_unconnected) Trying to connect fileno 67. >VM Channels Listener::DEBUG::2014-07-10 09:03:10,304::guestIF::194::vm.Vm::(_connect) vmId=`a766ed65-ac2e-4862-8ff0-0352480cf6f1`::Attempting connection to /var/lib/libvirt/qemu/channels/a766ed65-ac2e-4862-8ff0-0352480cf6f1.com.redhat.rhevm.vdsm >VM Channels Listener::DEBUG::2014-07-10 09:03:10,304::guestIF::197::vm.Vm::(_connect) vmId=`a766ed65-ac2e-4862-8ff0-0352480cf6f1`::Connected to /var/lib/libvirt/qemu/channels/a766ed65-ac2e-4862-8ff0-0352480cf6f1.com.redhat.rhevm.vdsm >VM Channels Listener::DEBUG::2014-07-10 09:03:10,305::vmChannels::148::vds::(_handle_unconnected) Connecting to fileno 67 succeeded. >Thread-13::DEBUG::2014-07-10 09:03:10,470::BindingXMLRPC::1067::vds::(wrapper) client [10.35.3.13]::call vmGetStats with ('2386fa8c-f537-495c-ae07-e178171d77f2',) {} >Thread-13::DEBUG::2014-07-10 09:03:10,470::vm::676::vm.Vm::(_getDiskStats) vmId=`2386fa8c-f537-495c-ae07-e178171d77f2`::Disk hdd stats not available >Thread-13::DEBUG::2014-07-10 09:03:10,471::vm::676::vm.Vm::(_getDiskStats) vmId=`2386fa8c-f537-495c-ae07-e178171d77f2`::Disk hdc stats not available >Thread-13::DEBUG::2014-07-10 09:03:10,471::vm::676::vm.Vm::(_getDiskStats) vmId=`2386fa8c-f537-495c-ae07-e178171d77f2`::Disk vda stats not available >Thread-13::DEBUG::2014-07-10 09:03:10,471::vm::715::vm.Vm::(_getDiskLatency) vmId=`2386fa8c-f537-495c-ae07-e178171d77f2`::Disk hdd latency not available >Thread-13::DEBUG::2014-07-10 09:03:10,471::vm::715::vm.Vm::(_getDiskLatency) vmId=`2386fa8c-f537-495c-ae07-e178171d77f2`::Disk hdc latency not available >Thread-13::DEBUG::2014-07-10 09:03:10,472::vm::715::vm.Vm::(_getDiskLatency) vmId=`2386fa8c-f537-495c-ae07-e178171d77f2`::Disk vda latency not available >Thread-13::DEBUG::2014-07-10 09:03:10,472::BindingXMLRPC::1074::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Powering up', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '14143', 'displayIp': '0', 'displayPort': u'5908', 'session': 'Unknown', 'displaySecurePort': u'5909', 'timeOffset': '0', 'hash': '-2423634698834682900', 'balloonInfo': {'balloon_max': '1048576', 'balloon_target': '1048576', 'balloon_cur': '1048576', 'balloon_min': '1048576'}, 'pauseCode': 'NOERR', 'clientIp': '', 'kvmEnable': 'true', 'network': {u'vnet4': {'macAddr': '00:1a:4a:de:6d:7c', 'rxDropped': '0', 'rxErrors': '0', 'txDropped': '0', 'txRate': '0.0', 'rxRate': '0.0', 'txErrors': '0', 'state': 'unknown', 'speed': '1000', 'name': u'vnet4'}}, 'vmId': '2386fa8c-f537-495c-ae07-e178171d77f2', 'displayType': 'qxl', 'cpuUser': '43.14', 'disks': {u'vda': {'truesize': '1073741824', 'apparentsize': '1073741824', 'imageID': 'b034d5b0-e1e0-4011-b49b-4d45ddb11556'}, u'hdd': {'truesize': '0', 'apparentsize': '0'}, u'hdc': {'truesize': '0', 'apparentsize': '0'}}, 'monitorResponse': '0', 'statsAge': '1.33', 'elapsedTime': '43', 'vmType': 'kvm', 'cpuSys': '6.77', 'guestCPUCount': -1, 'appsList': [], 'guestIPs': ''}]} >Thread-13::DEBUG::2014-07-10 09:03:10,476::BindingXMLRPC::1067::vds::(wrapper) client [10.35.3.13]::call vmGetStats with ('a766ed65-ac2e-4862-8ff0-0352480cf6f1',) {} >Thread-13::DEBUG::2014-07-10 09:03:10,477::vm::598::vm.Vm::(_getCpuStats) vmId=`a766ed65-ac2e-4862-8ff0-0352480cf6f1`::CPU stats not available: 'NoneType' object is unsubscriptable >Thread-13::DEBUG::2014-07-10 09:03:10,477::vm::654::vm.Vm::(_getNetworkStats) vmId=`a766ed65-ac2e-4862-8ff0-0352480cf6f1`::Network stats not available >Thread-13::DEBUG::2014-07-10 09:03:10,477::vm::676::vm.Vm::(_getDiskStats) vmId=`a766ed65-ac2e-4862-8ff0-0352480cf6f1`::Disk hdd stats not available >Thread-13::DEBUG::2014-07-10 09:03:10,477::vm::676::vm.Vm::(_getDiskStats) vmId=`a766ed65-ac2e-4862-8ff0-0352480cf6f1`::Disk hdc stats not available >Thread-13::DEBUG::2014-07-10 09:03:10,478::vm::676::vm.Vm::(_getDiskStats) vmId=`a766ed65-ac2e-4862-8ff0-0352480cf6f1`::Disk vda stats not available >Thread-13::DEBUG::2014-07-10 09:03:10,478::vm::715::vm.Vm::(_getDiskLatency) vmId=`a766ed65-ac2e-4862-8ff0-0352480cf6f1`::Disk hdd latency not available >Thread-13::DEBUG::2014-07-10 09:03:10,478::vm::715::vm.Vm::(_getDiskLatency) vmId=`a766ed65-ac2e-4862-8ff0-0352480cf6f1`::Disk hdc latency not available >Thread-13::DEBUG::2014-07-10 09:03:10,478::vm::715::vm.Vm::(_getDiskLatency) vmId=`a766ed65-ac2e-4862-8ff0-0352480cf6f1`::Disk vda latency not available >Thread-13::DEBUG::2014-07-10 09:03:10,478::BindingXMLRPC::1074::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Powering up', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '15456', 'displayIp': '0', 'displayPort': u'5912', 'session': 'Unknown', 'displaySecurePort': u'5913', 'timeOffset': '0', 'hash': '1078195817470092527', 'balloonInfo': {'balloon_max': '1048576', 'balloon_target': '1048576', 'balloon_cur': '0', 'balloon_min': '1048576'}, 'pauseCode': 'NOERR', 'clientIp': '', 'kvmEnable': 'true', 'network': {u'vnet6': {'state': 'unknown', 'macAddr': '00:1a:4a:de:6d:88', 'speed': '1000', 'name': u'vnet6'}}, 'vmId': 'a766ed65-ac2e-4862-8ff0-0352480cf6f1', 'displayType': 'qxl', 'cpuUser': '0.00', 'disks': {u'vda': {'truesize': '1073741824', 'apparentsize': '1073741824', 'imageID': 'f30c2cb7-a43a-4bf5-82b5-cfe07336f65c'}, u'hdd': {'truesize': '0', 'apparentsize': '0'}, u'hdc': {'truesize': '0', 'apparentsize': '0'}}, 'monitorResponse': '0', 'statsAge': '0.99', 'elapsedTime': '3', 'vmType': 'kvm', 'cpuSys': '0.00', 'guestCPUCount': -1, 'appsList': [], 'guestIPs': ''}]} >Thread-13::DEBUG::2014-07-10 09:03:10,483::BindingXMLRPC::1067::vds::(wrapper) client [10.35.3.13]::call vmGetStats with ('7fc21bb8-bd92-4924-acef-8360998e92a1',) {} >Thread-13::DEBUG::2014-07-10 09:03:10,483::vm::676::vm.Vm::(_getDiskStats) vmId=`7fc21bb8-bd92-4924-acef-8360998e92a1`::Disk hdd stats not available >Thread-13::DEBUG::2014-07-10 09:03:10,483::vm::676::vm.Vm::(_getDiskStats) vmId=`7fc21bb8-bd92-4924-acef-8360998e92a1`::Disk hdc stats not available >Thread-13::DEBUG::2014-07-10 09:03:10,484::vm::676::vm.Vm::(_getDiskStats) vmId=`7fc21bb8-bd92-4924-acef-8360998e92a1`::Disk vda stats not available >Thread-13::DEBUG::2014-07-10 09:03:10,484::vm::715::vm.Vm::(_getDiskLatency) vmId=`7fc21bb8-bd92-4924-acef-8360998e92a1`::Disk hdd latency not available >Thread-13::DEBUG::2014-07-10 09:03:10,484::vm::715::vm.Vm::(_getDiskLatency) vmId=`7fc21bb8-bd92-4924-acef-8360998e92a1`::Disk hdc latency not available >Thread-13::DEBUG::2014-07-10 09:03:10,484::vm::715::vm.Vm::(_getDiskLatency) vmId=`7fc21bb8-bd92-4924-acef-8360998e92a1`::Disk vda latency not available >Thread-13::DEBUG::2014-07-10 09:03:10,485::BindingXMLRPC::1074::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Powering up', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '14800', 'displayIp': '0', 'displayPort': u'5910', 'session': 'Unknown', 'displaySecurePort': u'5911', 'timeOffset': '0', 'hash': '-831008492253830849', 'balloonInfo': {'balloon_max': '1048576', 'balloon_target': '1048576', 'balloon_cur': '1048576', 'balloon_min': '1048576'}, 'pauseCode': 'NOERR', 'clientIp': '', 'kvmEnable': 'true', 'network': {u'vnet5': {'macAddr': '00:1a:4a:de:6d:7d', 'rxDropped': '0', 'rxErrors': '0', 'txDropped': '0', 'txRate': '0.0', 'rxRate': '0.0', 'txErrors': '0', 'state': 'unknown', 'speed': '1000', 'name': u'vnet5'}}, 'vmId': '7fc21bb8-bd92-4924-acef-8360998e92a1', 'displayType': 'qxl', 'cpuUser': '46.56', 'disks': {u'vda': {'truesize': '1073741824', 'apparentsize': '1073741824', 'imageID': 'aa20346a-4d3a-4e07-b8e1-52c0ebe4168c'}, u'hdd': {'truesize': '0', 'apparentsize': '0'}, u'hdc': {'truesize': '0', 'apparentsize': '0'}}, 'monitorResponse': '0', 'statsAge': '1.86', 'elapsedTime': '24', 'vmType': 'kvm', 'cpuSys': '21.04', 'guestCPUCount': -1, 'appsList': [], 'guestIPs': ''}]} >VM Channels Listener::DEBUG::2014-07-10 09:03:10,709::guestIF::274::vm.Vm::(_handleMessage) vmId=`2386fa8c-f537-495c-ae07-e178171d77f2`::username: u'None' >Dummy-33::DEBUG::2014-07-10 09:03:10,936::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:03:11,068::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0522189 s, 19.6 MB/s\n'; <rc> = 0 >Thread-34::DEBUG::2014-07-10 09:03:11,350::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [20cd1e94] >Thread-34::DEBUG::2014-07-10 09:03:11,351::task::595::TaskManager.Task::(_updateState) Task=`2a0f4c11-f90d-4c78-a996-83fad5f8814f`::moving from state init -> state preparing >Thread-34::INFO::2014-07-10 09:03:11,352::logUtils::44::dispatcher::(wrapper) Run and protect: createVolume(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='cfaeead2-7caa-467c-b389-c89840ae6605', size='10737418240', volFormat=4, preallocate=2, diskType=2, volUUID='567fe32d-31a6-4ff6-90f3-fd6a656fbecc', desc='', srcImgUUID='9cf413b7-7f14-4a61-8c71-913e5b0ea9c0', srcVolUUID='47592965-e853-4e59-9728-d11cca6a7a8a') >Thread-34::DEBUG::2014-07-10 09:03:11,353::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.9e1aa540-1f4e-4ee3-a152-be381ef6c3bd`ReqID=`8b219b36-4b1f-4b7c-8567-1a47282a864c`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '1464' at 'createVolume' >Thread-34::DEBUG::2014-07-10 09:03:11,353::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.9e1aa540-1f4e-4ee3-a152-be381ef6c3bd' for lock type 'shared' >Thread-34::DEBUG::2014-07-10 09:03:11,353::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.9e1aa540-1f4e-4ee3-a152-be381ef6c3bd' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-10 09:03:11,354::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.9e1aa540-1f4e-4ee3-a152-be381ef6c3bd`ReqID=`8b219b36-4b1f-4b7c-8567-1a47282a864c`::Granted request >Thread-34::DEBUG::2014-07-10 09:03:11,354::task::827::TaskManager.Task::(resourceAcquired) Task=`2a0f4c11-f90d-4c78-a996-83fad5f8814f`::_resourcesAcquired: Storage.9e1aa540-1f4e-4ee3-a152-be381ef6c3bd (shared) >Thread-34::DEBUG::2014-07-10 09:03:11,354::task::990::TaskManager.Task::(_decref) Task=`2a0f4c11-f90d-4c78-a996-83fad5f8814f`::ref 1 aborting False >Thread-34::DEBUG::2014-07-10 09:03:11,356::task::752::TaskManager.Task::(_save) Task=`2a0f4c11-f90d-4c78-a996-83fad5f8814f`::_save: orig /rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/master/tasks/2a0f4c11-f90d-4c78-a996-83fad5f8814f temp /rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/master/tasks/2a0f4c11-f90d-4c78-a996-83fad5f8814f.temp >Thread-34::DEBUG::2014-07-10 09:03:11,362::taskManager::68::TaskManager::(scheduleJob) scheduled job createVolume for task 2a0f4c11-f90d-4c78-a996-83fad5f8814f >Thread-34::INFO::2014-07-10 09:03:11,362::logUtils::47::dispatcher::(wrapper) Run and protect: createVolume, Return response: None >Thread-34::DEBUG::2014-07-10 09:03:11,362::task::1180::TaskManager.Task::(prepare) Task=`2a0f4c11-f90d-4c78-a996-83fad5f8814f`::Prepare: 1 jobs exist, move to acquiring >Thread-34::DEBUG::2014-07-10 09:03:11,363::task::595::TaskManager.Task::(_updateState) Task=`2a0f4c11-f90d-4c78-a996-83fad5f8814f`::moving from state preparing -> state acquiring >Thread-34::DEBUG::2014-07-10 09:03:11,363::task::752::TaskManager.Task::(_save) Task=`2a0f4c11-f90d-4c78-a996-83fad5f8814f`::_save: orig /rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/master/tasks/2a0f4c11-f90d-4c78-a996-83fad5f8814f temp /rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/master/tasks/2a0f4c11-f90d-4c78-a996-83fad5f8814f.temp >Thread-34::DEBUG::2014-07-10 09:03:11,376::task::595::TaskManager.Task::(_updateState) Task=`2a0f4c11-f90d-4c78-a996-83fad5f8814f`::moving from state acquiring -> state queued >Thread-34::DEBUG::2014-07-10 09:03:11,377::task::752::TaskManager.Task::(_save) Task=`2a0f4c11-f90d-4c78-a996-83fad5f8814f`::_save: orig /rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/master/tasks/2a0f4c11-f90d-4c78-a996-83fad5f8814f temp /rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/master/tasks/2a0f4c11-f90d-4c78-a996-83fad5f8814f.temp >Thread-34::DEBUG::2014-07-10 09:03:11,384::taskManager::50::TaskManager::(_queueTask) queuing task: 2a0f4c11-f90d-4c78-a996-83fad5f8814f >Thread-34::DEBUG::2014-07-10 09:03:11,384::taskManager::56::TaskManager::(_queueTask) task queued: 2a0f4c11-f90d-4c78-a996-83fad5f8814f >834c3ccd-bc24-4cc0-aa77-3298bd8de161::DEBUG::2014-07-10 09:03:11,384::threadPool::57::Misc.ThreadPool::(setRunningTask) Number of running tasks: 1 >Thread-34::DEBUG::2014-07-10 09:03:11,385::task::1182::TaskManager.Task::(prepare) Task=`2a0f4c11-f90d-4c78-a996-83fad5f8814f`::returning >2a0f4c11-f90d-4c78-a996-83fad5f8814f::DEBUG::2014-07-10 09:03:11,386::threadPool::200::Misc.ThreadPool.WorkerThread::(_processNextTask) Task: 2a0f4c11-f90d-4c78-a996-83fad5f8814f running: <bound method Task.commit of <storage.task.Task instance at 0x7f6198411ea8>> with: None >Thread-34::DEBUG::2014-07-10 09:03:11,387::task::990::TaskManager.Task::(_decref) Task=`2a0f4c11-f90d-4c78-a996-83fad5f8814f`::ref 0 aborting False >2a0f4c11-f90d-4c78-a996-83fad5f8814f::DEBUG::2014-07-10 09:03:11,387::task::1194::TaskManager.Task::(commit) Task=`2a0f4c11-f90d-4c78-a996-83fad5f8814f`::committing task: 2a0f4c11-f90d-4c78-a996-83fad5f8814f >2a0f4c11-f90d-4c78-a996-83fad5f8814f::DEBUG::2014-07-10 09:03:11,389::task::595::TaskManager.Task::(_updateState) Task=`2a0f4c11-f90d-4c78-a996-83fad5f8814f`::moving from state queued -> state running >2a0f4c11-f90d-4c78-a996-83fad5f8814f::DEBUG::2014-07-10 09:03:11,390::task::752::TaskManager.Task::(_save) Task=`2a0f4c11-f90d-4c78-a996-83fad5f8814f`::_save: orig /rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/master/tasks/2a0f4c11-f90d-4c78-a996-83fad5f8814f temp /rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/master/tasks/2a0f4c11-f90d-4c78-a996-83fad5f8814f.temp >2a0f4c11-f90d-4c78-a996-83fad5f8814f::DEBUG::2014-07-10 09:03:11,408::task::905::TaskManager.Task::(_runJobs) Task=`2a0f4c11-f90d-4c78-a996-83fad5f8814f`::Task.run: running job 0: createVolume: <bound method StoragePool.createVolume of <storage.sp.StoragePool object at 0x7f62180b9dd0>> (args: ('9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'cfaeead2-7caa-467c-b389-c89840ae6605', 20971520, 4, 2, 2, '567fe32d-31a6-4ff6-90f3-fd6a656fbecc', '', '9cf413b7-7f14-4a61-8c71-913e5b0ea9c0', '47592965-e853-4e59-9728-d11cca6a7a8a') kwargs: {}) >2a0f4c11-f90d-4c78-a996-83fad5f8814f::DEBUG::2014-07-10 09:03:11,410::task::331::TaskManager.Task::(run) Task=`2a0f4c11-f90d-4c78-a996-83fad5f8814f`::Job.run: running createVolume: <bound method StoragePool.createVolume of <storage.sp.StoragePool object at 0x7f62180b9dd0>> (args: ('9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'cfaeead2-7caa-467c-b389-c89840ae6605', 20971520, 4, 2, 2, '567fe32d-31a6-4ff6-90f3-fd6a656fbecc', '', '9cf413b7-7f14-4a61-8c71-913e5b0ea9c0', '47592965-e853-4e59-9728-d11cca6a7a8a') kwargs: {}) callback None >2a0f4c11-f90d-4c78-a996-83fad5f8814f::DEBUG::2014-07-10 09:03:11,412::blockVolume::572::Storage.Misc.excCmd::(getMetadata) '/bin/dd iflag=direct skip=4 bs=512 if=/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/metadata count=1' (cwd None) >2a0f4c11-f90d-4c78-a996-83fad5f8814f::DEBUG::2014-07-10 09:03:11,429::blockVolume::572::Storage.Misc.excCmd::(getMetadata) SUCCESS: <err> = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.000541725 s, 945 kB/s\n'; <rc> = 0 >2a0f4c11-f90d-4c78-a996-83fad5f8814f::DEBUG::2014-07-10 09:03:11,430::misc::282::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.000541725 s, 945 kB/s'], size: 512 >2a0f4c11-f90d-4c78-a996-83fad5f8814f::DEBUG::2014-07-10 09:03:11,430::resourceManager::198::ResourceManager.Request::(__init__) ResName=`9e1aa540-1f4e-4ee3-a152-be381ef6c3bd_imageNS.cfaeead2-7caa-467c-b389-c89840ae6605`ReqID=`cd5c74d8-486e-4642-bdb7-9564cd405214`::Request was made in '/usr/share/vdsm/storage/sp.py' line '1767' at 'createVolume' >2a0f4c11-f90d-4c78-a996-83fad5f8814f::DEBUG::2014-07-10 09:03:11,431::resourceManager::542::ResourceManager::(registerResource) Trying to register resource '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd_imageNS.cfaeead2-7caa-467c-b389-c89840ae6605' for lock type 'exclusive' >2a0f4c11-f90d-4c78-a996-83fad5f8814f::DEBUG::2014-07-10 09:03:11,432::lvm::427::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' got the operation mutex >2a0f4c11-f90d-4c78-a996-83fad5f8814f::DEBUG::2014-07-10 09:03:11,432::lvm::296::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm lvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/3600601601282300032826addbbdae311|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,vg_name,attr,size,seg_start_pe,devices,tags 9e1aa540-1f4e-4ee3-a152-be381ef6c3bd' (cwd None) >2a0f4c11-f90d-4c78-a996-83fad5f8814f::DEBUG::2014-07-10 09:03:11,669::lvm::296::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >2a0f4c11-f90d-4c78-a996-83fad5f8814f::DEBUG::2014-07-10 09:03:11,683::lvm::462::Storage.LVM::(_reloadlvs) lvs reloaded >2a0f4c11-f90d-4c78-a996-83fad5f8814f::DEBUG::2014-07-10 09:03:11,683::lvm::462::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' released the operation mutex >2a0f4c11-f90d-4c78-a996-83fad5f8814f::DEBUG::2014-07-10 09:03:11,683::resourceFactories::125::Storage.ResourcesFactories::(__getResourceCandidatesList) Image cfaeead2-7caa-467c-b389-c89840ae6605 does not exist in domain 9e1aa540-1f4e-4ee3-a152-be381ef6c3bd >2a0f4c11-f90d-4c78-a996-83fad5f8814f::DEBUG::2014-07-10 09:03:11,684::resourceManager::601::ResourceManager::(registerResource) Resource '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd_imageNS.cfaeead2-7caa-467c-b389-c89840ae6605' is free. Now locking as 'exclusive' (1 active user) >2a0f4c11-f90d-4c78-a996-83fad5f8814f::DEBUG::2014-07-10 09:03:11,684::resourceManager::238::ResourceManager.Request::(grant) ResName=`9e1aa540-1f4e-4ee3-a152-be381ef6c3bd_imageNS.cfaeead2-7caa-467c-b389-c89840ae6605`ReqID=`cd5c74d8-486e-4642-bdb7-9564cd405214`::Granted request >2a0f4c11-f90d-4c78-a996-83fad5f8814f::INFO::2014-07-10 09:03:11,685::image::123::Storage.Image::(create) Create placeholder /rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/images/cfaeead2-7caa-467c-b389-c89840ae6605 for image's volumes >2a0f4c11-f90d-4c78-a996-83fad5f8814f::DEBUG::2014-07-10 09:03:11,686::task::752::TaskManager.Task::(_save) Task=`2a0f4c11-f90d-4c78-a996-83fad5f8814f`::_save: orig /rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/master/tasks/2a0f4c11-f90d-4c78-a996-83fad5f8814f temp /rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/master/tasks/2a0f4c11-f90d-4c78-a996-83fad5f8814f.temp >2a0f4c11-f90d-4c78-a996-83fad5f8814f::DEBUG::2014-07-10 09:03:11,694::blockVolume::572::Storage.Misc.excCmd::(getMetadata) '/bin/dd iflag=direct skip=4 bs=512 if=/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/metadata count=1' (cwd None) >2a0f4c11-f90d-4c78-a996-83fad5f8814f::DEBUG::2014-07-10 09:03:11,708::blockVolume::572::Storage.Misc.excCmd::(getMetadata) SUCCESS: <err> = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.000487763 s, 1.0 MB/s\n'; <rc> = 0 >2a0f4c11-f90d-4c78-a996-83fad5f8814f::DEBUG::2014-07-10 09:03:11,708::misc::282::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.000487763 s, 1.0 MB/s'], size: 512 >2a0f4c11-f90d-4c78-a996-83fad5f8814f::DEBUG::2014-07-10 09:03:11,708::volume::300::Storage.Volume::(share) Share volume 47592965-e853-4e59-9728-d11cca6a7a8a to /rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/images/cfaeead2-7caa-467c-b389-c89840ae6605 >2a0f4c11-f90d-4c78-a996-83fad5f8814f::DEBUG::2014-07-10 09:03:11,709::blockVolume::572::Storage.Misc.excCmd::(getMetadata) '/bin/dd iflag=direct skip=4 bs=512 if=/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/metadata count=1' (cwd None) >2a0f4c11-f90d-4c78-a996-83fad5f8814f::DEBUG::2014-07-10 09:03:11,747::blockVolume::572::Storage.Misc.excCmd::(getMetadata) SUCCESS: <err> = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.0275753 s, 18.6 kB/s\n'; <rc> = 0 >2a0f4c11-f90d-4c78-a996-83fad5f8814f::DEBUG::2014-07-10 09:03:11,748::misc::282::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.0275753 s, 18.6 kB/s'], size: 512 >2a0f4c11-f90d-4c78-a996-83fad5f8814f::DEBUG::2014-07-10 09:03:11,749::task::752::TaskManager.Task::(_save) Task=`2a0f4c11-f90d-4c78-a996-83fad5f8814f`::_save: orig /rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/master/tasks/2a0f4c11-f90d-4c78-a996-83fad5f8814f temp /rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/master/tasks/2a0f4c11-f90d-4c78-a996-83fad5f8814f.temp >2a0f4c11-f90d-4c78-a996-83fad5f8814f::DEBUG::2014-07-10 09:03:11,757::blockVolume::353::Storage.Volume::(_share) Share volume 47592965-e853-4e59-9728-d11cca6a7a8a to /rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/images/cfaeead2-7caa-467c-b389-c89840ae6605 >2a0f4c11-f90d-4c78-a996-83fad5f8814f::DEBUG::2014-07-10 09:03:11,757::blockVolume::572::Storage.Misc.excCmd::(getMetadata) '/bin/dd iflag=direct skip=4 bs=512 if=/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/metadata count=1' (cwd None) >2a0f4c11-f90d-4c78-a996-83fad5f8814f::DEBUG::2014-07-10 09:03:11,773::blockVolume::572::Storage.Misc.excCmd::(getMetadata) SUCCESS: <err> = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.000629639 s, 813 kB/s\n'; <rc> = 0 >2a0f4c11-f90d-4c78-a996-83fad5f8814f::DEBUG::2014-07-10 09:03:11,774::misc::282::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.000629639 s, 813 kB/s'], size: 512 >2a0f4c11-f90d-4c78-a996-83fad5f8814f::INFO::2014-07-10 09:03:11,774::volume::443::Storage.Volume::(create) Creating volume 567fe32d-31a6-4ff6-90f3-fd6a656fbecc >2a0f4c11-f90d-4c78-a996-83fad5f8814f::DEBUG::2014-07-10 09:03:11,776::task::752::TaskManager.Task::(_save) Task=`2a0f4c11-f90d-4c78-a996-83fad5f8814f`::_save: orig /rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/master/tasks/2a0f4c11-f90d-4c78-a996-83fad5f8814f temp /rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/master/tasks/2a0f4c11-f90d-4c78-a996-83fad5f8814f.temp >2a0f4c11-f90d-4c78-a996-83fad5f8814f::DEBUG::2014-07-10 09:03:11,785::task::752::TaskManager.Task::(_save) Task=`2a0f4c11-f90d-4c78-a996-83fad5f8814f`::_save: orig /rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/master/tasks/2a0f4c11-f90d-4c78-a996-83fad5f8814f temp /rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/master/tasks/2a0f4c11-f90d-4c78-a996-83fad5f8814f.temp >2a0f4c11-f90d-4c78-a996-83fad5f8814f::DEBUG::2014-07-10 09:03:11,793::lvm::296::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm lvcreate --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/3600601601282300032826addbbdae311|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } " --autobackup n --contiguous n --size 1024m --addtag OVIRT_VOL_INITIALIZING --name 567fe32d-31a6-4ff6-90f3-fd6a656fbecc 9e1aa540-1f4e-4ee3-a152-be381ef6c3bd' (cwd None) >2a0f4c11-f90d-4c78-a996-83fad5f8814f::DEBUG::2014-07-10 09:03:12,325::lvm::296::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ' WARNING: This metadata update is NOT backed up\n WARNING: This metadata update is NOT backed up\n'; <rc> = 0 >2a0f4c11-f90d-4c78-a996-83fad5f8814f::DEBUG::2014-07-10 09:03:12,327::lvm::503::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >2a0f4c11-f90d-4c78-a996-83fad5f8814f::DEBUG::2014-07-10 09:03:12,338::lvm::505::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >2a0f4c11-f90d-4c78-a996-83fad5f8814f::DEBUG::2014-07-10 09:03:12,338::lvm::513::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >2a0f4c11-f90d-4c78-a996-83fad5f8814f::DEBUG::2014-07-10 09:03:12,339::lvm::525::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >2a0f4c11-f90d-4c78-a996-83fad5f8814f::WARNING::2014-07-10 09:03:12,339::utils::129::root::(rmFile) File: /rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/images/cfaeead2-7caa-467c-b389-c89840ae6605/567fe32d-31a6-4ff6-90f3-fd6a656fbecc already removed >2a0f4c11-f90d-4c78-a996-83fad5f8814f::INFO::2014-07-10 09:03:12,340::blockVolume::169::Storage.Volume::(_create) Request to create snapshot cfaeead2-7caa-467c-b389-c89840ae6605/567fe32d-31a6-4ff6-90f3-fd6a656fbecc of volume 9cf413b7-7f14-4a61-8c71-913e5b0ea9c0/47592965-e853-4e59-9728-d11cca6a7a8a >2a0f4c11-f90d-4c78-a996-83fad5f8814f::DEBUG::2014-07-10 09:03:12,341::task::752::TaskManager.Task::(_save) Task=`2a0f4c11-f90d-4c78-a996-83fad5f8814f`::_save: orig /rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/master/tasks/2a0f4c11-f90d-4c78-a996-83fad5f8814f temp /rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/master/tasks/2a0f4c11-f90d-4c78-a996-83fad5f8814f.temp >2a0f4c11-f90d-4c78-a996-83fad5f8814f::DEBUG::2014-07-10 09:03:12,353::blockVolume::572::Storage.Misc.excCmd::(getMetadata) '/bin/dd iflag=direct skip=4 bs=512 if=/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/metadata count=1' (cwd None) >2a0f4c11-f90d-4c78-a996-83fad5f8814f::DEBUG::2014-07-10 09:03:12,373::blockVolume::572::Storage.Misc.excCmd::(getMetadata) SUCCESS: <err> = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.000689714 s, 742 kB/s\n'; <rc> = 0 >2a0f4c11-f90d-4c78-a996-83fad5f8814f::DEBUG::2014-07-10 09:03:12,374::misc::282::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.000689714 s, 742 kB/s'], size: 512 >2a0f4c11-f90d-4c78-a996-83fad5f8814f::INFO::2014-07-10 09:03:12,375::volume::789::Storage.Volume::(prepare) Volume: preparing volume 9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/47592965-e853-4e59-9728-d11cca6a7a8a >2a0f4c11-f90d-4c78-a996-83fad5f8814f::DEBUG::2014-07-10 09:03:12,375::blockVolume::572::Storage.Misc.excCmd::(getMetadata) '/bin/dd iflag=direct skip=4 bs=512 if=/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/metadata count=1' (cwd None) >2a0f4c11-f90d-4c78-a996-83fad5f8814f::DEBUG::2014-07-10 09:03:12,391::blockVolume::572::Storage.Misc.excCmd::(getMetadata) SUCCESS: <err> = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.000437332 s, 1.2 MB/s\n'; <rc> = 0 >2a0f4c11-f90d-4c78-a996-83fad5f8814f::DEBUG::2014-07-10 09:03:12,392::misc::282::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.000437332 s, 1.2 MB/s'], size: 512 >2a0f4c11-f90d-4c78-a996-83fad5f8814f::DEBUG::2014-07-10 09:03:12,393::resourceManager::198::ResourceManager.Request::(__init__) ResName=`9e1aa540-1f4e-4ee3-a152-be381ef6c3bd_lvmActivationNS.47592965-e853-4e59-9728-d11cca6a7a8a`ReqID=`df3aaf71-934c-4df5-9030-0a2ac21269e6`::Request was made in '/usr/share/vdsm/storage/volume.py' line '806' at 'prepare' >2a0f4c11-f90d-4c78-a996-83fad5f8814f::DEBUG::2014-07-10 09:03:12,393::resourceManager::542::ResourceManager::(registerResource) Trying to register resource '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd_lvmActivationNS.47592965-e853-4e59-9728-d11cca6a7a8a' for lock type 'shared' >2a0f4c11-f90d-4c78-a996-83fad5f8814f::DEBUG::2014-07-10 09:03:12,393::resourceManager::601::ResourceManager::(registerResource) Resource '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd_lvmActivationNS.47592965-e853-4e59-9728-d11cca6a7a8a' is free. Now locking as 'shared' (1 active user) >2a0f4c11-f90d-4c78-a996-83fad5f8814f::DEBUG::2014-07-10 09:03:12,394::resourceManager::238::ResourceManager.Request::(grant) ResName=`9e1aa540-1f4e-4ee3-a152-be381ef6c3bd_lvmActivationNS.47592965-e853-4e59-9728-d11cca6a7a8a`ReqID=`df3aaf71-934c-4df5-9030-0a2ac21269e6`::Granted request >2a0f4c11-f90d-4c78-a996-83fad5f8814f::DEBUG::2014-07-10 09:03:12,394::blockVolume::572::Storage.Misc.excCmd::(getMetadata) '/bin/dd iflag=direct skip=4 bs=512 if=/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/metadata count=1' (cwd None) >2a0f4c11-f90d-4c78-a996-83fad5f8814f::DEBUG::2014-07-10 09:03:12,412::blockVolume::572::Storage.Misc.excCmd::(getMetadata) SUCCESS: <err> = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.00142188 s, 360 kB/s\n'; <rc> = 0 >2a0f4c11-f90d-4c78-a996-83fad5f8814f::DEBUG::2014-07-10 09:03:12,412::misc::282::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.00142188 s, 360 kB/s'], size: 512 >2a0f4c11-f90d-4c78-a996-83fad5f8814f::DEBUG::2014-07-10 09:03:12,413::volume::270::Storage.Volume::(clone) Volume.clone: /rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/images/cfaeead2-7caa-467c-b389-c89840ae6605/47592965-e853-4e59-9728-d11cca6a7a8a to /rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/images/cfaeead2-7caa-467c-b389-c89840ae6605/567fe32d-31a6-4ff6-90f3-fd6a656fbecc >2a0f4c11-f90d-4c78-a996-83fad5f8814f::DEBUG::2014-07-10 09:03:12,413::blockVolume::572::Storage.Misc.excCmd::(getMetadata) '/bin/dd iflag=direct skip=4 bs=512 if=/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/metadata count=1' (cwd None) >2a0f4c11-f90d-4c78-a996-83fad5f8814f::DEBUG::2014-07-10 09:03:12,437::blockVolume::572::Storage.Misc.excCmd::(getMetadata) SUCCESS: <err> = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.00997394 s, 51.3 kB/s\n'; <rc> = 0 >2a0f4c11-f90d-4c78-a996-83fad5f8814f::DEBUG::2014-07-10 09:03:12,438::misc::282::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.00997394 s, 51.3 kB/s'], size: 512 >2a0f4c11-f90d-4c78-a996-83fad5f8814f::DEBUG::2014-07-10 09:03:12,438::blockVolume::572::Storage.Misc.excCmd::(getMetadata) '/bin/dd iflag=direct skip=4 bs=512 if=/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/metadata count=1' (cwd None) >2a0f4c11-f90d-4c78-a996-83fad5f8814f::DEBUG::2014-07-10 09:03:12,456::blockVolume::572::Storage.Misc.excCmd::(getMetadata) SUCCESS: <err> = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.000751947 s, 681 kB/s\n'; <rc> = 0 >2a0f4c11-f90d-4c78-a996-83fad5f8814f::DEBUG::2014-07-10 09:03:12,457::misc::282::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.000751947 s, 681 kB/s'], size: 512 >2a0f4c11-f90d-4c78-a996-83fad5f8814f::DEBUG::2014-07-10 09:03:12,458::volume::1042::Storage.Misc.excCmd::(createVolume) '/usr/bin/qemu-img create -f qcow2 -F raw -b ../cfaeead2-7caa-467c-b389-c89840ae6605/47592965-e853-4e59-9728-d11cca6a7a8a /rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/images/cfaeead2-7caa-467c-b389-c89840ae6605/567fe32d-31a6-4ff6-90f3-fd6a656fbecc' (cwd /rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/images/cfaeead2-7caa-467c-b389-c89840ae6605) >2a0f4c11-f90d-4c78-a996-83fad5f8814f::DEBUG::2014-07-10 09:03:12,518::volume::1042::Storage.Misc.excCmd::(createVolume) SUCCESS: <err> = ''; <rc> = 0 >2a0f4c11-f90d-4c78-a996-83fad5f8814f::INFO::2014-07-10 09:03:12,519::blockVolume::393::Storage.Volume::(teardown) Tearing down volume 9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/47592965-e853-4e59-9728-d11cca6a7a8a justme False >2a0f4c11-f90d-4c78-a996-83fad5f8814f::DEBUG::2014-07-10 09:03:12,519::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd_lvmActivationNS.47592965-e853-4e59-9728-d11cca6a7a8a' >2a0f4c11-f90d-4c78-a996-83fad5f8814f::DEBUG::2014-07-10 09:03:12,520::resourceManager::635::ResourceManager::(releaseResource) Released resource '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd_lvmActivationNS.47592965-e853-4e59-9728-d11cca6a7a8a' (0 active users) >2a0f4c11-f90d-4c78-a996-83fad5f8814f::DEBUG::2014-07-10 09:03:12,520::resourceManager::641::ResourceManager::(releaseResource) Resource '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd_lvmActivationNS.47592965-e853-4e59-9728-d11cca6a7a8a' is free, finding out if anyone is waiting for it. >2a0f4c11-f90d-4c78-a996-83fad5f8814f::DEBUG::2014-07-10 09:03:12,521::lvm::296::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm lvchange --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/3600601601282300032826addbbdae311|/dev/mapper/360060160f4a030003840ec867ddee311|/dev/mapper/367cad74c2fcba00019e6afd20c781e67|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } " --autobackup n --available n 9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/47592965-e853-4e59-9728-d11cca6a7a8a' (cwd None) >GuestMonitor-scale_7::DEBUG::2014-07-10 09:03:12,920::vm::598::vm.Vm::(_getCpuStats) vmId=`a766ed65-ac2e-4862-8ff0-0352480cf6f1`::CPU stats not available: 'NoneType' object is unsubscriptable >GuestMonitor-scale_7::DEBUG::2014-07-10 09:03:12,921::vm::654::vm.Vm::(_getNetworkStats) vmId=`a766ed65-ac2e-4862-8ff0-0352480cf6f1`::Network stats not available >GuestMonitor-scale_7::DEBUG::2014-07-10 09:03:12,921::vm::676::vm.Vm::(_getDiskStats) vmId=`a766ed65-ac2e-4862-8ff0-0352480cf6f1`::Disk hdd stats not available >GuestMonitor-scale_7::DEBUG::2014-07-10 09:03:12,922::vm::676::vm.Vm::(_getDiskStats) vmId=`a766ed65-ac2e-4862-8ff0-0352480cf6f1`::Disk hdc stats not available >GuestMonitor-scale_7::DEBUG::2014-07-10 09:03:12,922::vm::676::vm.Vm::(_getDiskStats) vmId=`a766ed65-ac2e-4862-8ff0-0352480cf6f1`::Disk vda stats not available >GuestMonitor-scale_7::DEBUG::2014-07-10 09:03:12,922::vm::715::vm.Vm::(_getDiskLatency) vmId=`a766ed65-ac2e-4862-8ff0-0352480cf6f1`::Disk hdd latency not available >GuestMonitor-scale_7::DEBUG::2014-07-10 09:03:12,922::vm::715::vm.Vm::(_getDiskLatency) vmId=`a766ed65-ac2e-4862-8ff0-0352480cf6f1`::Disk hdc latency not available >GuestMonitor-scale_7::DEBUG::2014-07-10 09:03:12,923::vm::715::vm.Vm::(_getDiskLatency) vmId=`a766ed65-ac2e-4862-8ff0-0352480cf6f1`::Disk vda latency not available >GuestMonitor-scale_7::DEBUG::2014-07-10 09:03:12,923::vm::598::vm.Vm::(_getCpuStats) vmId=`a766ed65-ac2e-4862-8ff0-0352480cf6f1`::CPU stats not available: 'NoneType' object is unsubscriptable >GuestMonitor-scale_7::DEBUG::2014-07-10 09:03:12,924::vm::654::vm.Vm::(_getNetworkStats) vmId=`a766ed65-ac2e-4862-8ff0-0352480cf6f1`::Network stats not available >GuestMonitor-scale_7::DEBUG::2014-07-10 09:03:12,924::vm::676::vm.Vm::(_getDiskStats) vmId=`a766ed65-ac2e-4862-8ff0-0352480cf6f1`::Disk hdd stats not available >GuestMonitor-scale_7::DEBUG::2014-07-10 09:03:12,924::vm::676::vm.Vm::(_getDiskStats) vmId=`a766ed65-ac2e-4862-8ff0-0352480cf6f1`::Disk hdc stats not available >GuestMonitor-scale_7::DEBUG::2014-07-10 09:03:12,924::vm::676::vm.Vm::(_getDiskStats) vmId=`a766ed65-ac2e-4862-8ff0-0352480cf6f1`::Disk vda stats not available >GuestMonitor-scale_7::DEBUG::2014-07-10 09:03:12,924::vm::715::vm.Vm::(_getDiskLatency) vmId=`a766ed65-ac2e-4862-8ff0-0352480cf6f1`::Disk hdd latency not available >GuestMonitor-scale_7::DEBUG::2014-07-10 09:03:12,925::vm::715::vm.Vm::(_getDiskLatency) vmId=`a766ed65-ac2e-4862-8ff0-0352480cf6f1`::Disk hdc latency not available >GuestMonitor-scale_7::DEBUG::2014-07-10 09:03:12,925::vm::715::vm.Vm::(_getDiskLatency) vmId=`a766ed65-ac2e-4862-8ff0-0352480cf6f1`::Disk vda latency not available >GuestMonitor-scale_6::DEBUG::2014-07-10 09:03:12,943::vm::676::vm.Vm::(_getDiskStats) vmId=`7fc21bb8-bd92-4924-acef-8360998e92a1`::Disk hdd stats not available >GuestMonitor-scale_6::DEBUG::2014-07-10 09:03:12,943::vm::676::vm.Vm::(_getDiskStats) vmId=`7fc21bb8-bd92-4924-acef-8360998e92a1`::Disk hdc stats not available >GuestMonitor-scale_6::DEBUG::2014-07-10 09:03:12,943::vm::676::vm.Vm::(_getDiskStats) vmId=`7fc21bb8-bd92-4924-acef-8360998e92a1`::Disk vda stats not available >GuestMonitor-scale_6::DEBUG::2014-07-10 09:03:12,944::vm::715::vm.Vm::(_getDiskLatency) vmId=`7fc21bb8-bd92-4924-acef-8360998e92a1`::Disk hdd latency not available >GuestMonitor-scale_6::DEBUG::2014-07-10 09:03:12,944::vm::715::vm.Vm::(_getDiskLatency) vmId=`7fc21bb8-bd92-4924-acef-8360998e92a1`::Disk hdc latency not available >GuestMonitor-scale_6::DEBUG::2014-07-10 09:03:12,944::vm::715::vm.Vm::(_getDiskLatency) vmId=`7fc21bb8-bd92-4924-acef-8360998e92a1`::Disk vda latency not available >GuestMonitor-scale_6::DEBUG::2014-07-10 09:03:12,944::vm::676::vm.Vm::(_getDiskStats) vmId=`7fc21bb8-bd92-4924-acef-8360998e92a1`::Disk hdd stats not available >GuestMonitor-scale_6::DEBUG::2014-07-10 09:03:12,945::vm::676::vm.Vm::(_getDiskStats) vmId=`7fc21bb8-bd92-4924-acef-8360998e92a1`::Disk hdc stats not available >GuestMonitor-scale_6::DEBUG::2014-07-10 09:03:12,945::vm::676::vm.Vm::(_getDiskStats) vmId=`7fc21bb8-bd92-4924-acef-8360998e92a1`::Disk vda stats not available >GuestMonitor-scale_6::DEBUG::2014-07-10 09:03:12,945::vm::715::vm.Vm::(_getDiskLatency) vmId=`7fc21bb8-bd92-4924-acef-8360998e92a1`::Disk hdd latency not available >GuestMonitor-scale_6::DEBUG::2014-07-10 09:03:12,945::vm::715::vm.Vm::(_getDiskLatency) vmId=`7fc21bb8-bd92-4924-acef-8360998e92a1`::Disk hdc latency not available >GuestMonitor-scale_6::DEBUG::2014-07-10 09:03:12,945::vm::715::vm.Vm::(_getDiskLatency) vmId=`7fc21bb8-bd92-4924-acef-8360998e92a1`::Disk vda latency not available >GuestMonitor-scale_5::DEBUG::2014-07-10 09:03:12,963::vm::676::vm.Vm::(_getDiskStats) vmId=`2386fa8c-f537-495c-ae07-e178171d77f2`::Disk hdd stats not available >GuestMonitor-scale_5::DEBUG::2014-07-10 09:03:12,964::vm::676::vm.Vm::(_getDiskStats) vmId=`2386fa8c-f537-495c-ae07-e178171d77f2`::Disk hdc stats not available >GuestMonitor-scale_5::DEBUG::2014-07-10 09:03:12,964::vm::676::vm.Vm::(_getDiskStats) vmId=`2386fa8c-f537-495c-ae07-e178171d77f2`::Disk vda stats not available >GuestMonitor-scale_5::DEBUG::2014-07-10 09:03:12,964::vm::715::vm.Vm::(_getDiskLatency) vmId=`2386fa8c-f537-495c-ae07-e178171d77f2`::Disk hdd latency not available >GuestMonitor-scale_5::DEBUG::2014-07-10 09:03:12,964::vm::715::vm.Vm::(_getDiskLatency) vmId=`2386fa8c-f537-495c-ae07-e178171d77f2`::Disk hdc latency not available >GuestMonitor-scale_5::DEBUG::2014-07-10 09:03:12,964::vm::715::vm.Vm::(_getDiskLatency) vmId=`2386fa8c-f537-495c-ae07-e178171d77f2`::Disk vda latency not available >GuestMonitor-scale_5::DEBUG::2014-07-10 09:03:12,965::vm::676::vm.Vm::(_getDiskStats) vmId=`2386fa8c-f537-495c-ae07-e178171d77f2`::Disk hdd stats not available >GuestMonitor-scale_5::DEBUG::2014-07-10 09:03:12,965::vm::676::vm.Vm::(_getDiskStats) vmId=`2386fa8c-f537-495c-ae07-e178171d77f2`::Disk hdc stats not available >GuestMonitor-scale_5::DEBUG::2014-07-10 09:03:12,965::vm::676::vm.Vm::(_getDiskStats) vmId=`2386fa8c-f537-495c-ae07-e178171d77f2`::Disk vda stats not available >GuestMonitor-scale_5::DEBUG::2014-07-10 09:03:12,966::vm::715::vm.Vm::(_getDiskLatency) vmId=`2386fa8c-f537-495c-ae07-e178171d77f2`::Disk hdd latency not available >GuestMonitor-scale_5::DEBUG::2014-07-10 09:03:12,966::vm::715::vm.Vm::(_getDiskLatency) vmId=`2386fa8c-f537-495c-ae07-e178171d77f2`::Disk hdc latency not available >GuestMonitor-scale_5::DEBUG::2014-07-10 09:03:12,966::vm::715::vm.Vm::(_getDiskLatency) vmId=`2386fa8c-f537-495c-ae07-e178171d77f2`::Disk vda latency not available >Thread-13::DEBUG::2014-07-10 09:03:12,998::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-13::DEBUG::2014-07-10 09:03:12,999::task::595::TaskManager.Task::(_updateState) Task=`7f2b3df9-de5e-49c1-9035-34913aa07d9b`::moving from state init -> state preparing >Thread-13::INFO::2014-07-10 09:03:12,999::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-13::INFO::2014-07-10 09:03:13,000::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-13::DEBUG::2014-07-10 09:03:13,000::task::1185::TaskManager.Task::(prepare) Task=`7f2b3df9-de5e-49c1-9035-34913aa07d9b`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-13::DEBUG::2014-07-10 09:03:13,000::task::595::TaskManager.Task::(_updateState) Task=`7f2b3df9-de5e-49c1-9035-34913aa07d9b`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-07-10 09:03:13,001::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-07-10 09:03:13,001::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-07-10 09:03:13,001::task::990::TaskManager.Task::(_decref) Task=`7f2b3df9-de5e-49c1-9035-34913aa07d9b`::ref 0 aborting False >Thread-34::DEBUG::2014-07-10 09:03:13,045::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-34::DEBUG::2014-07-10 09:03:13,046::task::595::TaskManager.Task::(_updateState) Task=`9088508b-e56f-4b88-8638-6b54408db9ca`::moving from state init -> state preparing >Thread-34::INFO::2014-07-10 09:03:13,046::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-34::DEBUG::2014-07-10 09:03:13,047::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`e4f8227f-5c73-419f-b25f-abde0d5e2ab4`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-10 09:03:13,047::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' for lock type 'shared' >Thread-34::DEBUG::2014-07-10 09:03:13,047::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-10 09:03:13,047::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`e4f8227f-5c73-419f-b25f-abde0d5e2ab4`::Granted request >Thread-34::DEBUG::2014-07-10 09:03:13,048::task::827::TaskManager.Task::(resourceAcquired) Task=`9088508b-e56f-4b88-8638-6b54408db9ca`::_resourcesAcquired: Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee (shared) >Thread-34::DEBUG::2014-07-10 09:03:13,048::task::990::TaskManager.Task::(_decref) Task=`9088508b-e56f-4b88-8638-6b54408db9ca`::ref 1 aborting False >Thread-34::DEBUG::2014-07-10 09:03:13,049::lvm::373::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-34::DEBUG::2014-07-10 09:03:13,050::lvm::296::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/3600601601282300032826addbbdae311|/dev/mapper/360060160f4a030003840ec867ddee311|/dev/mapper/367cad74c2fcba00019e6afd20c781e67|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name 9e1aa540-1f4e-4ee3-a152-be381ef6c3bd' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:03:13,083::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:03:13,170::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0328051 s, 31.2 MB/s\n'; <rc> = 0 >Thread-34::DEBUG::2014-07-10 09:03:13,252::lvm::296::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-34::DEBUG::2014-07-10 09:03:13,254::lvm::415::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-34::INFO::2014-07-10 09:03:13,256::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1076694614016', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532069482496', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:03:13,256::task::1185::TaskManager.Task::(prepare) Task=`9088508b-e56f-4b88-8638-6b54408db9ca`::finished: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1076694614016', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532069482496', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:03:13,256::task::595::TaskManager.Task::(_updateState) Task=`9088508b-e56f-4b88-8638-6b54408db9ca`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-10 09:03:13,256::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee': < ResourceRef 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-10 09:03:13,257::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-10 09:03:13,257::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' >Thread-34::DEBUG::2014-07-10 09:03:13,257::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' (0 active users) >Thread-34::DEBUG::2014-07-10 09:03:13,257::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-10 09:03:13,258::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', Clearing records. >Thread-34::DEBUG::2014-07-10 09:03:13,258::task::990::TaskManager.Task::(_decref) Task=`9088508b-e56f-4b88-8638-6b54408db9ca`::ref 0 aborting False >Thread-13::DEBUG::2014-07-10 09:03:13,561::BindingXMLRPC::1067::vds::(wrapper) client [10.35.3.13]::call vmGetStats with ('2386fa8c-f537-495c-ae07-e178171d77f2',) {} >Thread-13::DEBUG::2014-07-10 09:03:13,561::vm::676::vm.Vm::(_getDiskStats) vmId=`2386fa8c-f537-495c-ae07-e178171d77f2`::Disk hdd stats not available >Thread-13::DEBUG::2014-07-10 09:03:13,562::vm::676::vm.Vm::(_getDiskStats) vmId=`2386fa8c-f537-495c-ae07-e178171d77f2`::Disk hdc stats not available >Thread-13::DEBUG::2014-07-10 09:03:13,562::vm::676::vm.Vm::(_getDiskStats) vmId=`2386fa8c-f537-495c-ae07-e178171d77f2`::Disk vda stats not available >Thread-13::DEBUG::2014-07-10 09:03:13,562::vm::715::vm.Vm::(_getDiskLatency) vmId=`2386fa8c-f537-495c-ae07-e178171d77f2`::Disk hdd latency not available >Thread-13::DEBUG::2014-07-10 09:03:13,562::vm::715::vm.Vm::(_getDiskLatency) vmId=`2386fa8c-f537-495c-ae07-e178171d77f2`::Disk hdc latency not available >Thread-13::DEBUG::2014-07-10 09:03:13,563::vm::715::vm.Vm::(_getDiskLatency) vmId=`2386fa8c-f537-495c-ae07-e178171d77f2`::Disk vda latency not available >Thread-13::DEBUG::2014-07-10 09:03:13,563::BindingXMLRPC::1074::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'username': u'None', 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': u'vm-18-201.eng.lab.tlv.redhat.com', 'pid': '14143', 'session': 'Unknown', 'displaySecurePort': u'5909', 'timeOffset': '0', 'balloonInfo': {'balloon_max': '1048576', 'balloon_target': '1048576', 'balloon_cur': '1048576', 'balloon_min': '1048576'}, 'pauseCode': 'NOERR', 'disksUsage': [{u'path': u'/', u'total': '4792987648', u'used': '1843060736', u'fs': u'ext4'}, {u'path': u'/boot', u'total': '507744256', u'used': '40272896', u'fs': u'ext4'}, {u'path': u'/home', u'total': '458985472', u'used': '10766336', u'fs': u'ext4'}], 'network': {u'vnet4': {'macAddr': '00:1a:4a:de:6d:7c', 'rxDropped': '0', 'rxErrors': '0', 'txDropped': '0', 'txRate': '0.0', 'rxRate': '0.0', 'txErrors': '0', 'state': 'unknown', 'speed': '1000', 'name': u'vnet4'}}, 'vmType': 'kvm', 'guestName': u'vm-18-201.eng.lab.tlv.redhat.com', 'elapsedTime': '46', 'memoryStats': {}, 'cpuSys': '6.77', 'appsList': [u'kernel-2.6.32-431.el6', u'rhevm-guest-agent-common-1.0.9-1.el6ev'], 'guestOs': u'2.6.32-431.el6.x86_64', 'displayType': 'qxl', 'status': 'Up', 'hash': '-2423634698834682900', 'lastLogin': 1404982990.7094021, 'vmId': '2386fa8c-f537-495c-ae07-e178171d77f2', 'displayIp': '0', 'displayPort': u'5908', 'clientIp': '', 'kvmEnable': 'true', 'disks': {u'vda': {'truesize': '1073741824', 'apparentsize': '1073741824', 'imageID': 'b034d5b0-e1e0-4011-b49b-4d45ddb11556'}, u'hdd': {'truesize': '0', 'apparentsize': '0'}, u'hdc': {'truesize': '0', 'apparentsize': '0'}}, 'monitorResponse': '0', 'statsAge': '0.18', 'cpuUser': '43.14', 'guestCPUCount': -1, 'guestIPs': u'10.35.18.201', 'netIfaces': [{u'hw': u'00:1a:4a:de:6d:7c', u'name': u'eth0', u'inet': [u'10.35.18.201'], u'inet6': [u'fe80::21a:4aff:fede:6d7c']}]}]} >Thread-13::DEBUG::2014-07-10 09:03:13,581::BindingXMLRPC::1067::vds::(wrapper) client [10.35.3.13]::call vmGetStats with ('a766ed65-ac2e-4862-8ff0-0352480cf6f1',) {} >Thread-13::DEBUG::2014-07-10 09:03:13,582::vm::598::vm.Vm::(_getCpuStats) vmId=`a766ed65-ac2e-4862-8ff0-0352480cf6f1`::CPU stats not available: 'NoneType' object is unsubscriptable >Thread-13::DEBUG::2014-07-10 09:03:13,582::vm::654::vm.Vm::(_getNetworkStats) vmId=`a766ed65-ac2e-4862-8ff0-0352480cf6f1`::Network stats not available >Thread-13::DEBUG::2014-07-10 09:03:13,582::vm::676::vm.Vm::(_getDiskStats) vmId=`a766ed65-ac2e-4862-8ff0-0352480cf6f1`::Disk hdd stats not available >Thread-13::DEBUG::2014-07-10 09:03:13,582::vm::676::vm.Vm::(_getDiskStats) vmId=`a766ed65-ac2e-4862-8ff0-0352480cf6f1`::Disk hdc stats not available >Thread-13::DEBUG::2014-07-10 09:03:13,583::vm::676::vm.Vm::(_getDiskStats) vmId=`a766ed65-ac2e-4862-8ff0-0352480cf6f1`::Disk vda stats not available >Thread-13::DEBUG::2014-07-10 09:03:13,583::vm::715::vm.Vm::(_getDiskLatency) vmId=`a766ed65-ac2e-4862-8ff0-0352480cf6f1`::Disk hdd latency not available >Thread-13::DEBUG::2014-07-10 09:03:13,583::vm::715::vm.Vm::(_getDiskLatency) vmId=`a766ed65-ac2e-4862-8ff0-0352480cf6f1`::Disk hdc latency not available >Thread-13::DEBUG::2014-07-10 09:03:13,583::vm::715::vm.Vm::(_getDiskLatency) vmId=`a766ed65-ac2e-4862-8ff0-0352480cf6f1`::Disk vda latency not available >Thread-13::DEBUG::2014-07-10 09:03:13,584::BindingXMLRPC::1074::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Powering up', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '15456', 'displayIp': '0', 'displayPort': u'5912', 'session': 'Unknown', 'displaySecurePort': u'5913', 'timeOffset': '0', 'hash': '1078195817470092527', 'balloonInfo': {'balloon_max': '1048576', 'balloon_target': '1048576', 'balloon_cur': '0', 'balloon_min': '1048576'}, 'pauseCode': 'NOERR', 'clientIp': '', 'kvmEnable': 'true', 'network': {u'vnet6': {'state': 'unknown', 'macAddr': '00:1a:4a:de:6d:88', 'speed': '1000', 'name': u'vnet6'}}, 'vmId': 'a766ed65-ac2e-4862-8ff0-0352480cf6f1', 'displayType': 'qxl', 'cpuUser': '0.00', 'disks': {u'vda': {'truesize': '1073741824', 'apparentsize': '1073741824', 'imageID': 'f30c2cb7-a43a-4bf5-82b5-cfe07336f65c'}, u'hdd': {'truesize': '0', 'apparentsize': '0'}, u'hdc': {'truesize': '0', 'apparentsize': '0'}}, 'monitorResponse': '0', 'statsAge': '0.02', 'elapsedTime': '6', 'vmType': 'kvm', 'cpuSys': '0.00', 'guestCPUCount': -1, 'appsList': [], 'guestIPs': ''}]} >Thread-13::DEBUG::2014-07-10 09:03:13,588::BindingXMLRPC::1067::vds::(wrapper) client [10.35.3.13]::call vmGetStats with ('7fc21bb8-bd92-4924-acef-8360998e92a1',) {} >Thread-13::DEBUG::2014-07-10 09:03:13,589::vm::676::vm.Vm::(_getDiskStats) vmId=`7fc21bb8-bd92-4924-acef-8360998e92a1`::Disk hdd stats not available >Thread-13::DEBUG::2014-07-10 09:03:13,589::vm::676::vm.Vm::(_getDiskStats) vmId=`7fc21bb8-bd92-4924-acef-8360998e92a1`::Disk hdc stats not available >Thread-13::DEBUG::2014-07-10 09:03:13,589::vm::676::vm.Vm::(_getDiskStats) vmId=`7fc21bb8-bd92-4924-acef-8360998e92a1`::Disk vda stats not available >Thread-13::DEBUG::2014-07-10 09:03:13,590::vm::715::vm.Vm::(_getDiskLatency) vmId=`7fc21bb8-bd92-4924-acef-8360998e92a1`::Disk hdd latency not available >Thread-13::DEBUG::2014-07-10 09:03:13,590::vm::715::vm.Vm::(_getDiskLatency) vmId=`7fc21bb8-bd92-4924-acef-8360998e92a1`::Disk hdc latency not available >Thread-13::DEBUG::2014-07-10 09:03:13,590::vm::715::vm.Vm::(_getDiskLatency) vmId=`7fc21bb8-bd92-4924-acef-8360998e92a1`::Disk vda latency not available >Thread-13::DEBUG::2014-07-10 09:03:13,590::BindingXMLRPC::1074::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Powering up', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '14800', 'displayIp': '0', 'displayPort': u'5910', 'session': 'Unknown', 'displaySecurePort': u'5911', 'timeOffset': '0', 'hash': '-831008492253830849', 'balloonInfo': {'balloon_max': '1048576', 'balloon_target': '1048576', 'balloon_cur': '1048576', 'balloon_min': '1048576'}, 'pauseCode': 'NOERR', 'clientIp': '', 'kvmEnable': 'true', 'network': {u'vnet5': {'macAddr': '00:1a:4a:de:6d:7d', 'rxDropped': '0', 'rxErrors': '0', 'txDropped': '0', 'txRate': '0.0', 'rxRate': '0.0', 'txErrors': '0', 'state': 'unknown', 'speed': '1000', 'name': u'vnet5'}}, 'vmId': '7fc21bb8-bd92-4924-acef-8360998e92a1', 'displayType': 'qxl', 'cpuUser': '46.56', 'disks': {u'vda': {'truesize': '1073741824', 'apparentsize': '1073741824', 'imageID': 'aa20346a-4d3a-4e07-b8e1-52c0ebe4168c'}, u'hdd': {'truesize': '0', 'apparentsize': '0'}, u'hdc': {'truesize': '0', 'apparentsize': '0'}}, 'monitorResponse': '0', 'statsAge': '0.73', 'elapsedTime': '27', 'vmType': 'kvm', 'cpuSys': '21.04', 'guestCPUCount': -1, 'appsList': [], 'guestIPs': ''}]} >Thread-40::DEBUG::2014-07-10 09:03:14,559::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lion.qa.lab.tlv.redhat.com:_export_yuri2_backup2/6a70504d-00df-4869-8695-0f442053f6b6/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-40::DEBUG::2014-07-10 09:03:14,578::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n369 bytes (369 B) copied, 0.000496507 s, 743 kB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:03:15,185::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:03:15,269::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0285479 s, 35.9 MB/s\n'; <rc> = 0 >Thread-13::DEBUG::2014-07-10 09:03:15,438::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-13::DEBUG::2014-07-10 09:03:15,439::task::595::TaskManager.Task::(_updateState) Task=`7c5e5dd4-9821-418f-96ce-f621dbfad022`::moving from state init -> state preparing >Thread-13::INFO::2014-07-10 09:03:15,440::logUtils::44::dispatcher::(wrapper) Run and protect: getAllTasksStatuses(spUUID=None, options=None) >Thread-13::DEBUG::2014-07-10 09:03:15,440::taskManager::102::TaskManager::(getAllTasksStatuses) Entry. >Thread-13::DEBUG::2014-07-10 09:03:15,440::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 2a0f4c11-f90d-4c78-a996-83fad5f8814f >Thread-13::DEBUG::2014-07-10 09:03:15,440::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '2a0f4c11-f90d-4c78-a996-83fad5f8814f'} >Thread-13::DEBUG::2014-07-10 09:03:15,441::taskManager::113::TaskManager::(getAllTasksStatuses) Return: {'2a0f4c11-f90d-4c78-a996-83fad5f8814f': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '2a0f4c11-f90d-4c78-a996-83fad5f8814f'}} >Thread-13::INFO::2014-07-10 09:03:15,441::logUtils::47::dispatcher::(wrapper) Run and protect: getAllTasksStatuses, Return response: {'allTasksStatus': {'2a0f4c11-f90d-4c78-a996-83fad5f8814f': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '2a0f4c11-f90d-4c78-a996-83fad5f8814f'}}} >Thread-13::DEBUG::2014-07-10 09:03:15,442::task::1185::TaskManager.Task::(prepare) Task=`7c5e5dd4-9821-418f-96ce-f621dbfad022`::finished: {'allTasksStatus': {'2a0f4c11-f90d-4c78-a996-83fad5f8814f': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '2a0f4c11-f90d-4c78-a996-83fad5f8814f'}}} >Thread-13::DEBUG::2014-07-10 09:03:15,442::task::595::TaskManager.Task::(_updateState) Task=`7c5e5dd4-9821-418f-96ce-f621dbfad022`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-07-10 09:03:15,442::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-07-10 09:03:15,442::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-07-10 09:03:15,443::task::990::TaskManager.Task::(_decref) Task=`7c5e5dd4-9821-418f-96ce-f621dbfad022`::ref 0 aborting False >Thread-13::DEBUG::2014-07-10 09:03:16,634::task::595::TaskManager.Task::(_updateState) Task=`0a30ee11-6765-41f0-b70c-3729d85e9c7d`::moving from state init -> state preparing >Thread-13::INFO::2014-07-10 09:03:16,634::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-13::INFO::2014-07-10 09:03:16,635::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000530696', 'lastCheck': '9.2', 'valid': True}, '6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000496507', 'lastCheck': '2.1', 'valid': True}} >Thread-13::DEBUG::2014-07-10 09:03:16,635::task::1185::TaskManager.Task::(prepare) Task=`0a30ee11-6765-41f0-b70c-3729d85e9c7d`::finished: {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000530696', 'lastCheck': '9.2', 'valid': True}, '6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000496507', 'lastCheck': '2.1', 'valid': True}} >Thread-13::DEBUG::2014-07-10 09:03:16,635::task::595::TaskManager.Task::(_updateState) Task=`0a30ee11-6765-41f0-b70c-3729d85e9c7d`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-07-10 09:03:16,635::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-07-10 09:03:16,636::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-07-10 09:03:16,636::task::990::TaskManager.Task::(_decref) Task=`0a30ee11-6765-41f0-b70c-3729d85e9c7d`::ref 0 aborting False >Thread-13::DEBUG::2014-07-10 09:03:16,650::vm::676::vm.Vm::(_getDiskStats) vmId=`7fc21bb8-bd92-4924-acef-8360998e92a1`::Disk hdd stats not available >Thread-13::DEBUG::2014-07-10 09:03:16,650::vm::676::vm.Vm::(_getDiskStats) vmId=`7fc21bb8-bd92-4924-acef-8360998e92a1`::Disk hdc stats not available >Thread-13::DEBUG::2014-07-10 09:03:16,650::vm::676::vm.Vm::(_getDiskStats) vmId=`7fc21bb8-bd92-4924-acef-8360998e92a1`::Disk vda stats not available >Thread-13::DEBUG::2014-07-10 09:03:16,651::vm::715::vm.Vm::(_getDiskLatency) vmId=`7fc21bb8-bd92-4924-acef-8360998e92a1`::Disk hdd latency not available >Thread-13::DEBUG::2014-07-10 09:03:16,651::vm::715::vm.Vm::(_getDiskLatency) vmId=`7fc21bb8-bd92-4924-acef-8360998e92a1`::Disk hdc latency not available >Thread-13::DEBUG::2014-07-10 09:03:16,651::vm::715::vm.Vm::(_getDiskLatency) vmId=`7fc21bb8-bd92-4924-acef-8360998e92a1`::Disk vda latency not available >Thread-13::DEBUG::2014-07-10 09:03:16,651::vm::598::vm.Vm::(_getCpuStats) vmId=`a766ed65-ac2e-4862-8ff0-0352480cf6f1`::CPU stats not available: 'NoneType' object is unsubscriptable >Thread-13::DEBUG::2014-07-10 09:03:16,652::vm::654::vm.Vm::(_getNetworkStats) vmId=`a766ed65-ac2e-4862-8ff0-0352480cf6f1`::Network stats not available >Thread-13::DEBUG::2014-07-10 09:03:16,652::vm::676::vm.Vm::(_getDiskStats) vmId=`a766ed65-ac2e-4862-8ff0-0352480cf6f1`::Disk hdd stats not available >Thread-13::DEBUG::2014-07-10 09:03:16,652::vm::676::vm.Vm::(_getDiskStats) vmId=`a766ed65-ac2e-4862-8ff0-0352480cf6f1`::Disk hdc stats not available >Thread-13::DEBUG::2014-07-10 09:03:16,652::vm::676::vm.Vm::(_getDiskStats) vmId=`a766ed65-ac2e-4862-8ff0-0352480cf6f1`::Disk vda stats not available >Thread-13::DEBUG::2014-07-10 09:03:16,652::vm::715::vm.Vm::(_getDiskLatency) vmId=`a766ed65-ac2e-4862-8ff0-0352480cf6f1`::Disk hdd latency not available >Thread-13::DEBUG::2014-07-10 09:03:16,653::vm::715::vm.Vm::(_getDiskLatency) vmId=`a766ed65-ac2e-4862-8ff0-0352480cf6f1`::Disk hdc latency not available >Thread-13::DEBUG::2014-07-10 09:03:16,653::vm::715::vm.Vm::(_getDiskLatency) vmId=`a766ed65-ac2e-4862-8ff0-0352480cf6f1`::Disk vda latency not available >Thread-13::DEBUG::2014-07-10 09:03:16,655::vm::676::vm.Vm::(_getDiskStats) vmId=`2386fa8c-f537-495c-ae07-e178171d77f2`::Disk hdd stats not available >Thread-13::DEBUG::2014-07-10 09:03:16,655::vm::676::vm.Vm::(_getDiskStats) vmId=`2386fa8c-f537-495c-ae07-e178171d77f2`::Disk hdc stats not available >Thread-13::DEBUG::2014-07-10 09:03:16,656::vm::676::vm.Vm::(_getDiskStats) vmId=`2386fa8c-f537-495c-ae07-e178171d77f2`::Disk vda stats not available >Thread-13::DEBUG::2014-07-10 09:03:16,656::vm::715::vm.Vm::(_getDiskLatency) vmId=`2386fa8c-f537-495c-ae07-e178171d77f2`::Disk hdd latency not available >Thread-13::DEBUG::2014-07-10 09:03:16,656::vm::715::vm.Vm::(_getDiskLatency) vmId=`2386fa8c-f537-495c-ae07-e178171d77f2`::Disk hdc latency not available >Thread-13::DEBUG::2014-07-10 09:03:16,656::vm::715::vm.Vm::(_getDiskLatency) vmId=`2386fa8c-f537-495c-ae07-e178171d77f2`::Disk vda latency not available >Dummy-33::DEBUG::2014-07-10 09:03:17,285::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:03:17,390::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0486451 s, 21.1 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-10 09:03:17,473::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/metadata bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-10 09:03:17,506::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.0120259 s, 341 kB/s\n'; <rc> = 0 >2a0f4c11-f90d-4c78-a996-83fad5f8814f::DEBUG::2014-07-10 09:03:17,620::lvm::296::Storage.Misc.excCmd::(cmd) FAILED: <err> = ' Logical volume 9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/47592965-e853-4e59-9728-d11cca6a7a8a in use.\n'; <rc> = 5 >2a0f4c11-f90d-4c78-a996-83fad5f8814f::DEBUG::2014-07-10 09:03:17,629::lvm::513::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >2a0f4c11-f90d-4c78-a996-83fad5f8814f::DEBUG::2014-07-10 09:03:17,635::lvm::525::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >2a0f4c11-f90d-4c78-a996-83fad5f8814f::WARNING::2014-07-10 09:03:17,639::resourceFactories::61::Storage.ResourcesFactories::(close) Failure deactivate LV 9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/47592965-e853-4e59-9728-d11cca6a7a8a (Cannot deactivate Logical Volume: ('General Storage Exception: ("5 [] [\' Logical volume 9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/47592965-e853-4e59-9728-d11cca6a7a8a in use.\']\\n9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/[\'47592965-e853-4e59-9728-d11cca6a7a8a\']",)',)) >2a0f4c11-f90d-4c78-a996-83fad5f8814f::DEBUG::2014-07-10 09:03:17,641::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd_lvmActivationNS.47592965-e853-4e59-9728-d11cca6a7a8a', Clearing records. >2a0f4c11-f90d-4c78-a996-83fad5f8814f::DEBUG::2014-07-10 09:03:17,646::lvm::427::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' got the operation mutex >2a0f4c11-f90d-4c78-a996-83fad5f8814f::DEBUG::2014-07-10 09:03:17,657::lvm::296::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm lvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/3600601601282300032826addbbdae311|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,vg_name,attr,size,seg_start_pe,devices,tags 9e1aa540-1f4e-4ee3-a152-be381ef6c3bd' (cwd None) >2a0f4c11-f90d-4c78-a996-83fad5f8814f::DEBUG::2014-07-10 09:03:17,860::lvm::296::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >2a0f4c11-f90d-4c78-a996-83fad5f8814f::DEBUG::2014-07-10 09:03:17,874::lvm::462::Storage.LVM::(_reloadlvs) lvs reloaded >2a0f4c11-f90d-4c78-a996-83fad5f8814f::DEBUG::2014-07-10 09:03:17,874::lvm::462::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' released the operation mutex >2a0f4c11-f90d-4c78-a996-83fad5f8814f::DEBUG::2014-07-10 09:03:17,875::lvm::427::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' got the operation mutex >2a0f4c11-f90d-4c78-a996-83fad5f8814f::DEBUG::2014-07-10 09:03:17,875::lvm::296::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm lvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/3600601601282300032826addbbdae311|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,vg_name,attr,size,seg_start_pe,devices,tags 9e1aa540-1f4e-4ee3-a152-be381ef6c3bd' (cwd None) >GuestMonitor-scale_7::DEBUG::2014-07-10 09:03:17,931::vm::598::vm.Vm::(_getCpuStats) vmId=`a766ed65-ac2e-4862-8ff0-0352480cf6f1`::CPU stats not available: 'NoneType' object is unsubscriptable >GuestMonitor-scale_7::DEBUG::2014-07-10 09:03:17,933::vm::654::vm.Vm::(_getNetworkStats) vmId=`a766ed65-ac2e-4862-8ff0-0352480cf6f1`::Network stats not available >GuestMonitor-scale_7::DEBUG::2014-07-10 09:03:17,933::vm::676::vm.Vm::(_getDiskStats) vmId=`a766ed65-ac2e-4862-8ff0-0352480cf6f1`::Disk hdd stats not available >GuestMonitor-scale_7::DEBUG::2014-07-10 09:03:17,934::vm::676::vm.Vm::(_getDiskStats) vmId=`a766ed65-ac2e-4862-8ff0-0352480cf6f1`::Disk hdc stats not available >GuestMonitor-scale_7::DEBUG::2014-07-10 09:03:17,934::vm::676::vm.Vm::(_getDiskStats) vmId=`a766ed65-ac2e-4862-8ff0-0352480cf6f1`::Disk vda stats not available >GuestMonitor-scale_7::DEBUG::2014-07-10 09:03:17,934::vm::715::vm.Vm::(_getDiskLatency) vmId=`a766ed65-ac2e-4862-8ff0-0352480cf6f1`::Disk hdd latency not available >GuestMonitor-scale_7::DEBUG::2014-07-10 09:03:17,934::vm::715::vm.Vm::(_getDiskLatency) vmId=`a766ed65-ac2e-4862-8ff0-0352480cf6f1`::Disk hdc latency not available >GuestMonitor-scale_7::DEBUG::2014-07-10 09:03:17,935::vm::715::vm.Vm::(_getDiskLatency) vmId=`a766ed65-ac2e-4862-8ff0-0352480cf6f1`::Disk vda latency not available >GuestMonitor-scale_7::DEBUG::2014-07-10 09:03:17,935::vm::598::vm.Vm::(_getCpuStats) vmId=`a766ed65-ac2e-4862-8ff0-0352480cf6f1`::CPU stats not available: 'NoneType' object is unsubscriptable >GuestMonitor-scale_7::DEBUG::2014-07-10 09:03:17,935::vm::654::vm.Vm::(_getNetworkStats) vmId=`a766ed65-ac2e-4862-8ff0-0352480cf6f1`::Network stats not available >GuestMonitor-scale_7::DEBUG::2014-07-10 09:03:17,936::vm::676::vm.Vm::(_getDiskStats) vmId=`a766ed65-ac2e-4862-8ff0-0352480cf6f1`::Disk hdd stats not available >GuestMonitor-scale_7::DEBUG::2014-07-10 09:03:17,936::vm::676::vm.Vm::(_getDiskStats) vmId=`a766ed65-ac2e-4862-8ff0-0352480cf6f1`::Disk hdc stats not available >GuestMonitor-scale_7::DEBUG::2014-07-10 09:03:17,936::vm::676::vm.Vm::(_getDiskStats) vmId=`a766ed65-ac2e-4862-8ff0-0352480cf6f1`::Disk vda stats not available >GuestMonitor-scale_7::DEBUG::2014-07-10 09:03:17,936::vm::715::vm.Vm::(_getDiskLatency) vmId=`a766ed65-ac2e-4862-8ff0-0352480cf6f1`::Disk hdd latency not available >GuestMonitor-scale_7::DEBUG::2014-07-10 09:03:17,936::vm::715::vm.Vm::(_getDiskLatency) vmId=`a766ed65-ac2e-4862-8ff0-0352480cf6f1`::Disk hdc latency not available >GuestMonitor-scale_7::DEBUG::2014-07-10 09:03:17,937::vm::715::vm.Vm::(_getDiskLatency) vmId=`a766ed65-ac2e-4862-8ff0-0352480cf6f1`::Disk vda latency not available >GuestMonitor-scale_6::DEBUG::2014-07-10 09:03:17,951::vm::676::vm.Vm::(_getDiskStats) vmId=`7fc21bb8-bd92-4924-acef-8360998e92a1`::Disk hdd stats not available >GuestMonitor-scale_6::DEBUG::2014-07-10 09:03:17,951::vm::676::vm.Vm::(_getDiskStats) vmId=`7fc21bb8-bd92-4924-acef-8360998e92a1`::Disk hdc stats not available >GuestMonitor-scale_6::DEBUG::2014-07-10 09:03:17,952::vm::676::vm.Vm::(_getDiskStats) vmId=`7fc21bb8-bd92-4924-acef-8360998e92a1`::Disk vda stats not available >GuestMonitor-scale_6::DEBUG::2014-07-10 09:03:17,952::vm::715::vm.Vm::(_getDiskLatency) vmId=`7fc21bb8-bd92-4924-acef-8360998e92a1`::Disk hdd latency not available >GuestMonitor-scale_6::DEBUG::2014-07-10 09:03:17,952::vm::715::vm.Vm::(_getDiskLatency) vmId=`7fc21bb8-bd92-4924-acef-8360998e92a1`::Disk hdc latency not available >GuestMonitor-scale_6::DEBUG::2014-07-10 09:03:17,952::vm::715::vm.Vm::(_getDiskLatency) vmId=`7fc21bb8-bd92-4924-acef-8360998e92a1`::Disk vda latency not available >GuestMonitor-scale_6::DEBUG::2014-07-10 09:03:17,953::vm::676::vm.Vm::(_getDiskStats) vmId=`7fc21bb8-bd92-4924-acef-8360998e92a1`::Disk hdd stats not available >GuestMonitor-scale_6::DEBUG::2014-07-10 09:03:17,953::vm::676::vm.Vm::(_getDiskStats) vmId=`7fc21bb8-bd92-4924-acef-8360998e92a1`::Disk hdc stats not available >GuestMonitor-scale_6::DEBUG::2014-07-10 09:03:17,953::vm::676::vm.Vm::(_getDiskStats) vmId=`7fc21bb8-bd92-4924-acef-8360998e92a1`::Disk vda stats not available >GuestMonitor-scale_6::DEBUG::2014-07-10 09:03:17,953::vm::715::vm.Vm::(_getDiskLatency) vmId=`7fc21bb8-bd92-4924-acef-8360998e92a1`::Disk hdd latency not available >GuestMonitor-scale_6::DEBUG::2014-07-10 09:03:17,953::vm::715::vm.Vm::(_getDiskLatency) vmId=`7fc21bb8-bd92-4924-acef-8360998e92a1`::Disk hdc latency not available >GuestMonitor-scale_6::DEBUG::2014-07-10 09:03:17,954::vm::715::vm.Vm::(_getDiskLatency) vmId=`7fc21bb8-bd92-4924-acef-8360998e92a1`::Disk vda latency not available >GuestMonitor-scale_5::DEBUG::2014-07-10 09:03:17,972::vm::676::vm.Vm::(_getDiskStats) vmId=`2386fa8c-f537-495c-ae07-e178171d77f2`::Disk hdd stats not available >GuestMonitor-scale_5::DEBUG::2014-07-10 09:03:17,972::vm::676::vm.Vm::(_getDiskStats) vmId=`2386fa8c-f537-495c-ae07-e178171d77f2`::Disk hdc stats not available >GuestMonitor-scale_5::DEBUG::2014-07-10 09:03:17,972::vm::676::vm.Vm::(_getDiskStats) vmId=`2386fa8c-f537-495c-ae07-e178171d77f2`::Disk vda stats not available >GuestMonitor-scale_5::DEBUG::2014-07-10 09:03:17,972::vm::715::vm.Vm::(_getDiskLatency) vmId=`2386fa8c-f537-495c-ae07-e178171d77f2`::Disk hdd latency not available >GuestMonitor-scale_5::DEBUG::2014-07-10 09:03:17,973::vm::715::vm.Vm::(_getDiskLatency) vmId=`2386fa8c-f537-495c-ae07-e178171d77f2`::Disk hdc latency not available >GuestMonitor-scale_5::DEBUG::2014-07-10 09:03:17,973::vm::715::vm.Vm::(_getDiskLatency) vmId=`2386fa8c-f537-495c-ae07-e178171d77f2`::Disk vda latency not available >GuestMonitor-scale_5::DEBUG::2014-07-10 09:03:17,973::vm::676::vm.Vm::(_getDiskStats) vmId=`2386fa8c-f537-495c-ae07-e178171d77f2`::Disk hdd stats not available >GuestMonitor-scale_5::DEBUG::2014-07-10 09:03:17,974::vm::676::vm.Vm::(_getDiskStats) vmId=`2386fa8c-f537-495c-ae07-e178171d77f2`::Disk hdc stats not available >GuestMonitor-scale_5::DEBUG::2014-07-10 09:03:17,974::vm::676::vm.Vm::(_getDiskStats) vmId=`2386fa8c-f537-495c-ae07-e178171d77f2`::Disk vda stats not available >GuestMonitor-scale_5::DEBUG::2014-07-10 09:03:17,974::vm::715::vm.Vm::(_getDiskLatency) vmId=`2386fa8c-f537-495c-ae07-e178171d77f2`::Disk hdd latency not available >GuestMonitor-scale_5::DEBUG::2014-07-10 09:03:17,974::vm::715::vm.Vm::(_getDiskLatency) vmId=`2386fa8c-f537-495c-ae07-e178171d77f2`::Disk hdc latency not available >GuestMonitor-scale_5::DEBUG::2014-07-10 09:03:17,974::vm::715::vm.Vm::(_getDiskLatency) vmId=`2386fa8c-f537-495c-ae07-e178171d77f2`::Disk vda latency not available >2a0f4c11-f90d-4c78-a996-83fad5f8814f::DEBUG::2014-07-10 09:03:18,064::lvm::296::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >2a0f4c11-f90d-4c78-a996-83fad5f8814f::DEBUG::2014-07-10 09:03:18,087::lvm::462::Storage.LVM::(_reloadlvs) lvs reloaded >2a0f4c11-f90d-4c78-a996-83fad5f8814f::DEBUG::2014-07-10 09:03:18,087::lvm::462::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' released the operation mutex >2a0f4c11-f90d-4c78-a996-83fad5f8814f::WARNING::2014-07-10 09:03:18,087::blockSD::761::Storage.StorageDomain::(_getOccupiedMetadataSlots) Could not find mapping for lv 9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/567fe32d-31a6-4ff6-90f3-fd6a656fbecc >2a0f4c11-f90d-4c78-a996-83fad5f8814f::DEBUG::2014-07-10 09:03:18,087::blockSD::784::Storage.StorageDomain::(getFreeMetadataSlot) Found freeSlot 12 in VG 9e1aa540-1f4e-4ee3-a152-be381ef6c3bd >2a0f4c11-f90d-4c78-a996-83fad5f8814f::DEBUG::2014-07-10 09:03:18,088::lvm::296::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm lvchange --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/3600601601282300032826addbbdae311|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } " --autobackup n --deltag OVIRT_VOL_INITIALIZING --addtag PU_47592965-e853-4e59-9728-d11cca6a7a8a --addtag IU_cfaeead2-7caa-467c-b389-c89840ae6605 --addtag MD_12 9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/567fe32d-31a6-4ff6-90f3-fd6a656fbecc' (cwd None) >2a0f4c11-f90d-4c78-a996-83fad5f8814f::DEBUG::2014-07-10 09:03:18,325::lvm::296::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ' WARNING: This metadata update is NOT backed up\n WARNING: This metadata update is NOT backed up\n'; <rc> = 0 >2a0f4c11-f90d-4c78-a996-83fad5f8814f::DEBUG::2014-07-10 09:03:18,328::lvm::513::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >2a0f4c11-f90d-4c78-a996-83fad5f8814f::DEBUG::2014-07-10 09:03:18,334::lvm::525::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >2a0f4c11-f90d-4c78-a996-83fad5f8814f::DEBUG::2014-07-10 09:03:18,338::lvm::296::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm lvchange --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/3600601601282300032826addbbdae311|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } " --autobackup n --available n 9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/567fe32d-31a6-4ff6-90f3-fd6a656fbecc' (cwd None) >2a0f4c11-f90d-4c78-a996-83fad5f8814f::DEBUG::2014-07-10 09:03:18,754::lvm::296::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >2a0f4c11-f90d-4c78-a996-83fad5f8814f::DEBUG::2014-07-10 09:03:18,755::lvm::513::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >2a0f4c11-f90d-4c78-a996-83fad5f8814f::DEBUG::2014-07-10 09:03:18,755::lvm::525::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >2a0f4c11-f90d-4c78-a996-83fad5f8814f::DEBUG::2014-07-10 09:03:18,757::task::752::TaskManager.Task::(_save) Task=`2a0f4c11-f90d-4c78-a996-83fad5f8814f`::_save: orig /rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/master/tasks/2a0f4c11-f90d-4c78-a996-83fad5f8814f temp /rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/master/tasks/2a0f4c11-f90d-4c78-a996-83fad5f8814f.temp >2a0f4c11-f90d-4c78-a996-83fad5f8814f::DEBUG::2014-07-10 09:03:18,770::blockVolume::604::Storage.Volume::(newVolumeLease) Initializing volume lease volUUID=567fe32d-31a6-4ff6-90f3-fd6a656fbecc sdUUID=9e1aa540-1f4e-4ee3-a152-be381ef6c3bd, metaId=('9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 12) >2a0f4c11-f90d-4c78-a996-83fad5f8814f::DEBUG::2014-07-10 09:03:18,777::task::752::TaskManager.Task::(_save) Task=`2a0f4c11-f90d-4c78-a996-83fad5f8814f`::_save: orig /rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/master/tasks/2a0f4c11-f90d-4c78-a996-83fad5f8814f temp /rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/master/tasks/2a0f4c11-f90d-4c78-a996-83fad5f8814f.temp >2a0f4c11-f90d-4c78-a996-83fad5f8814f::DEBUG::2014-07-10 09:03:18,786::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd_imageNS.cfaeead2-7caa-467c-b389-c89840ae6605' >2a0f4c11-f90d-4c78-a996-83fad5f8814f::DEBUG::2014-07-10 09:03:18,786::resourceManager::635::ResourceManager::(releaseResource) Released resource '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd_imageNS.cfaeead2-7caa-467c-b389-c89840ae6605' (0 active users) >2a0f4c11-f90d-4c78-a996-83fad5f8814f::DEBUG::2014-07-10 09:03:18,786::resourceManager::641::ResourceManager::(releaseResource) Resource '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd_imageNS.cfaeead2-7caa-467c-b389-c89840ae6605' is free, finding out if anyone is waiting for it. >2a0f4c11-f90d-4c78-a996-83fad5f8814f::DEBUG::2014-07-10 09:03:18,786::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd_imageNS.cfaeead2-7caa-467c-b389-c89840ae6605', Clearing records. >2a0f4c11-f90d-4c78-a996-83fad5f8814f::DEBUG::2014-07-10 09:03:18,787::task::595::TaskManager.Task::(_updateState) Task=`2a0f4c11-f90d-4c78-a996-83fad5f8814f`::moving from state running -> state finished >2a0f4c11-f90d-4c78-a996-83fad5f8814f::DEBUG::2014-07-10 09:03:18,787::task::752::TaskManager.Task::(_save) Task=`2a0f4c11-f90d-4c78-a996-83fad5f8814f`::_save: orig /rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/master/tasks/2a0f4c11-f90d-4c78-a996-83fad5f8814f temp /rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/master/tasks/2a0f4c11-f90d-4c78-a996-83fad5f8814f.temp >2a0f4c11-f90d-4c78-a996-83fad5f8814f::DEBUG::2014-07-10 09:03:18,796::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': < ResourceRef 'Storage.9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', isValid: 'True' obj: 'None'>} >2a0f4c11-f90d-4c78-a996-83fad5f8814f::DEBUG::2014-07-10 09:03:18,796::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >2a0f4c11-f90d-4c78-a996-83fad5f8814f::DEBUG::2014-07-10 09:03:18,796::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.9e1aa540-1f4e-4ee3-a152-be381ef6c3bd' >2a0f4c11-f90d-4c78-a996-83fad5f8814f::DEBUG::2014-07-10 09:03:18,797::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.9e1aa540-1f4e-4ee3-a152-be381ef6c3bd' (0 active users) >2a0f4c11-f90d-4c78-a996-83fad5f8814f::DEBUG::2014-07-10 09:03:18,797::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.9e1aa540-1f4e-4ee3-a152-be381ef6c3bd' is free, finding out if anyone is waiting for it. >2a0f4c11-f90d-4c78-a996-83fad5f8814f::DEBUG::2014-07-10 09:03:18,797::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', Clearing records. >2a0f4c11-f90d-4c78-a996-83fad5f8814f::DEBUG::2014-07-10 09:03:18,797::task::913::TaskManager.Task::(_runJobs) Task=`2a0f4c11-f90d-4c78-a996-83fad5f8814f`::Task.run: exit - success: result {'uuid': '567fe32d-31a6-4ff6-90f3-fd6a656fbecc'} >2a0f4c11-f90d-4c78-a996-83fad5f8814f::DEBUG::2014-07-10 09:03:18,797::task::990::TaskManager.Task::(_decref) Task=`2a0f4c11-f90d-4c78-a996-83fad5f8814f`::ref 0 aborting False >2a0f4c11-f90d-4c78-a996-83fad5f8814f::DEBUG::2014-07-10 09:03:18,798::threadPool::57::Misc.ThreadPool::(setRunningTask) Number of running tasks: 0 >VM Channels Listener::DEBUG::2014-07-10 09:03:19,247::vmChannels::95::vds::(_handle_timeouts) Timeout on fileno 66. >Dummy-33::DEBUG::2014-07-10 09:03:19,408::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:03:19,536::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0613127 s, 16.7 MB/s\n'; <rc> = 0 >Thread-13::DEBUG::2014-07-10 09:03:19,773::BindingXMLRPC::1067::vds::(wrapper) client [10.35.3.13]::call vmGetStats with ('a766ed65-ac2e-4862-8ff0-0352480cf6f1',) {} >Thread-13::DEBUG::2014-07-10 09:03:19,774::vm::598::vm.Vm::(_getCpuStats) vmId=`a766ed65-ac2e-4862-8ff0-0352480cf6f1`::CPU stats not available: 'NoneType' object is unsubscriptable >Thread-13::DEBUG::2014-07-10 09:03:19,775::vm::654::vm.Vm::(_getNetworkStats) vmId=`a766ed65-ac2e-4862-8ff0-0352480cf6f1`::Network stats not available >Thread-13::DEBUG::2014-07-10 09:03:19,775::vm::676::vm.Vm::(_getDiskStats) vmId=`a766ed65-ac2e-4862-8ff0-0352480cf6f1`::Disk hdd stats not available >Thread-13::DEBUG::2014-07-10 09:03:19,775::vm::676::vm.Vm::(_getDiskStats) vmId=`a766ed65-ac2e-4862-8ff0-0352480cf6f1`::Disk hdc stats not available >Thread-13::DEBUG::2014-07-10 09:03:19,776::vm::676::vm.Vm::(_getDiskStats) vmId=`a766ed65-ac2e-4862-8ff0-0352480cf6f1`::Disk vda stats not available >Thread-13::DEBUG::2014-07-10 09:03:19,776::vm::715::vm.Vm::(_getDiskLatency) vmId=`a766ed65-ac2e-4862-8ff0-0352480cf6f1`::Disk hdd latency not available >Thread-13::DEBUG::2014-07-10 09:03:19,777::vm::715::vm.Vm::(_getDiskLatency) vmId=`a766ed65-ac2e-4862-8ff0-0352480cf6f1`::Disk hdc latency not available >Thread-13::DEBUG::2014-07-10 09:03:19,777::vm::715::vm.Vm::(_getDiskLatency) vmId=`a766ed65-ac2e-4862-8ff0-0352480cf6f1`::Disk vda latency not available >Thread-13::DEBUG::2014-07-10 09:03:19,778::BindingXMLRPC::1074::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Powering up', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '15456', 'displayIp': '0', 'displayPort': u'5912', 'session': 'Unknown', 'displaySecurePort': u'5913', 'timeOffset': '0', 'hash': '1078195817470092527', 'balloonInfo': {'balloon_max': '1048576', 'balloon_target': '1048576', 'balloon_cur': '0', 'balloon_min': '1048576'}, 'pauseCode': 'NOERR', 'clientIp': '', 'kvmEnable': 'true', 'network': {u'vnet6': {'state': 'unknown', 'macAddr': '00:1a:4a:de:6d:88', 'speed': '1000', 'name': u'vnet6'}}, 'vmId': 'a766ed65-ac2e-4862-8ff0-0352480cf6f1', 'displayType': 'qxl', 'cpuUser': '0.00', 'disks': {u'vda': {'truesize': '1073741824', 'apparentsize': '1073741824', 'imageID': 'f30c2cb7-a43a-4bf5-82b5-cfe07336f65c'}, u'hdd': {'truesize': '0', 'apparentsize': '0'}, u'hdc': {'truesize': '0', 'apparentsize': '0'}}, 'monitorResponse': '0', 'statsAge': '0.18', 'elapsedTime': '12', 'vmType': 'kvm', 'cpuSys': '0.00', 'guestCPUCount': -1, 'appsList': [], 'guestIPs': ''}]} >Thread-13::DEBUG::2014-07-10 09:03:19,783::BindingXMLRPC::1067::vds::(wrapper) client [10.35.3.13]::call vmGetStats with ('7fc21bb8-bd92-4924-acef-8360998e92a1',) {} >Thread-13::DEBUG::2014-07-10 09:03:19,784::vm::676::vm.Vm::(_getDiskStats) vmId=`7fc21bb8-bd92-4924-acef-8360998e92a1`::Disk hdd stats not available >Thread-13::DEBUG::2014-07-10 09:03:19,784::vm::676::vm.Vm::(_getDiskStats) vmId=`7fc21bb8-bd92-4924-acef-8360998e92a1`::Disk hdc stats not available >Thread-13::DEBUG::2014-07-10 09:03:19,785::vm::676::vm.Vm::(_getDiskStats) vmId=`7fc21bb8-bd92-4924-acef-8360998e92a1`::Disk vda stats not available >Thread-13::DEBUG::2014-07-10 09:03:19,785::vm::715::vm.Vm::(_getDiskLatency) vmId=`7fc21bb8-bd92-4924-acef-8360998e92a1`::Disk hdd latency not available >Thread-13::DEBUG::2014-07-10 09:03:19,786::vm::715::vm.Vm::(_getDiskLatency) vmId=`7fc21bb8-bd92-4924-acef-8360998e92a1`::Disk hdc latency not available >Thread-13::DEBUG::2014-07-10 09:03:19,786::vm::715::vm.Vm::(_getDiskLatency) vmId=`7fc21bb8-bd92-4924-acef-8360998e92a1`::Disk vda latency not available >Thread-13::DEBUG::2014-07-10 09:03:19,786::BindingXMLRPC::1074::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Powering up', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '14800', 'displayIp': '0', 'displayPort': u'5910', 'session': 'Unknown', 'displaySecurePort': u'5911', 'timeOffset': '0', 'hash': '-831008492253830849', 'balloonInfo': {'balloon_max': '1048576', 'balloon_target': '1048576', 'balloon_cur': '1048576', 'balloon_min': '1048576'}, 'pauseCode': 'NOERR', 'clientIp': '', 'kvmEnable': 'true', 'network': {u'vnet5': {'macAddr': '00:1a:4a:de:6d:7d', 'rxDropped': '0', 'rxErrors': '0', 'txDropped': '0', 'txRate': '0.0', 'rxRate': '0.0', 'txErrors': '0', 'state': 'unknown', 'speed': '1000', 'name': u'vnet5'}}, 'vmId': '7fc21bb8-bd92-4924-acef-8360998e92a1', 'displayType': 'qxl', 'cpuUser': '34.49', 'disks': {u'vda': {'truesize': '1073741824', 'apparentsize': '1073741824', 'imageID': 'aa20346a-4d3a-4e07-b8e1-52c0ebe4168c'}, u'hdd': {'truesize': '0', 'apparentsize': '0'}, u'hdc': {'truesize': '0', 'apparentsize': '0'}}, 'monitorResponse': '0', 'statsAge': '0.89', 'elapsedTime': '33', 'vmType': 'kvm', 'cpuSys': '4.18', 'guestCPUCount': -1, 'appsList': [], 'guestIPs': ''}]} >Dummy-33::DEBUG::2014-07-10 09:03:21,551::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:03:21,652::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0479597 s, 21.4 MB/s\n'; <rc> = 0 >Thread-13::DEBUG::2014-07-10 09:03:22,806::BindingXMLRPC::1067::vds::(wrapper) client [10.35.3.13]::call vmGetStats with ('a766ed65-ac2e-4862-8ff0-0352480cf6f1',) {} >Thread-13::DEBUG::2014-07-10 09:03:22,806::vm::598::vm.Vm::(_getCpuStats) vmId=`a766ed65-ac2e-4862-8ff0-0352480cf6f1`::CPU stats not available: 'NoneType' object is unsubscriptable >Thread-13::DEBUG::2014-07-10 09:03:22,807::vm::654::vm.Vm::(_getNetworkStats) vmId=`a766ed65-ac2e-4862-8ff0-0352480cf6f1`::Network stats not available >Thread-13::DEBUG::2014-07-10 09:03:22,807::vm::676::vm.Vm::(_getDiskStats) vmId=`a766ed65-ac2e-4862-8ff0-0352480cf6f1`::Disk hdd stats not available >Thread-13::DEBUG::2014-07-10 09:03:22,807::vm::676::vm.Vm::(_getDiskStats) vmId=`a766ed65-ac2e-4862-8ff0-0352480cf6f1`::Disk hdc stats not available >Thread-13::DEBUG::2014-07-10 09:03:22,807::vm::676::vm.Vm::(_getDiskStats) vmId=`a766ed65-ac2e-4862-8ff0-0352480cf6f1`::Disk vda stats not available >Thread-13::DEBUG::2014-07-10 09:03:22,808::vm::715::vm.Vm::(_getDiskLatency) vmId=`a766ed65-ac2e-4862-8ff0-0352480cf6f1`::Disk hdd latency not available >Thread-13::DEBUG::2014-07-10 09:03:22,808::vm::715::vm.Vm::(_getDiskLatency) vmId=`a766ed65-ac2e-4862-8ff0-0352480cf6f1`::Disk hdc latency not available >Thread-13::DEBUG::2014-07-10 09:03:22,808::vm::715::vm.Vm::(_getDiskLatency) vmId=`a766ed65-ac2e-4862-8ff0-0352480cf6f1`::Disk vda latency not available >Thread-13::DEBUG::2014-07-10 09:03:22,808::BindingXMLRPC::1074::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Powering up', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '15456', 'displayIp': '0', 'displayPort': u'5912', 'session': 'Unknown', 'displaySecurePort': u'5913', 'timeOffset': '0', 'hash': '1078195817470092527', 'balloonInfo': {'balloon_max': '1048576', 'balloon_target': '1048576', 'balloon_cur': '0', 'balloon_min': '1048576'}, 'pauseCode': 'NOERR', 'clientIp': '', 'kvmEnable': 'true', 'network': {u'vnet6': {'state': 'unknown', 'macAddr': '00:1a:4a:de:6d:88', 'speed': '1000', 'name': u'vnet6'}}, 'vmId': 'a766ed65-ac2e-4862-8ff0-0352480cf6f1', 'displayType': 'qxl', 'cpuUser': '0.00', 'disks': {u'vda': {'truesize': '1073741824', 'apparentsize': '1073741824', 'imageID': 'f30c2cb7-a43a-4bf5-82b5-cfe07336f65c'}, u'hdd': {'truesize': '0', 'apparentsize': '0'}, u'hdc': {'truesize': '0', 'apparentsize': '0'}}, 'monitorResponse': '0', 'statsAge': '1.21', 'elapsedTime': '15', 'vmType': 'kvm', 'cpuSys': '0.00', 'guestCPUCount': -1, 'appsList': [], 'guestIPs': ''}]} >Thread-13::DEBUG::2014-07-10 09:03:22,813::BindingXMLRPC::1067::vds::(wrapper) client [10.35.3.13]::call vmGetStats with ('7fc21bb8-bd92-4924-acef-8360998e92a1',) {} >Thread-13::DEBUG::2014-07-10 09:03:22,813::vm::676::vm.Vm::(_getDiskStats) vmId=`7fc21bb8-bd92-4924-acef-8360998e92a1`::Disk hdd stats not available >Thread-13::DEBUG::2014-07-10 09:03:22,813::vm::676::vm.Vm::(_getDiskStats) vmId=`7fc21bb8-bd92-4924-acef-8360998e92a1`::Disk hdc stats not available >Thread-13::DEBUG::2014-07-10 09:03:22,814::vm::676::vm.Vm::(_getDiskStats) vmId=`7fc21bb8-bd92-4924-acef-8360998e92a1`::Disk vda stats not available >Thread-13::DEBUG::2014-07-10 09:03:22,814::vm::715::vm.Vm::(_getDiskLatency) vmId=`7fc21bb8-bd92-4924-acef-8360998e92a1`::Disk hdd latency not available >Thread-13::DEBUG::2014-07-10 09:03:22,814::vm::715::vm.Vm::(_getDiskLatency) vmId=`7fc21bb8-bd92-4924-acef-8360998e92a1`::Disk hdc latency not available >Thread-13::DEBUG::2014-07-10 09:03:22,814::vm::715::vm.Vm::(_getDiskLatency) vmId=`7fc21bb8-bd92-4924-acef-8360998e92a1`::Disk vda latency not available >Thread-13::DEBUG::2014-07-10 09:03:22,815::BindingXMLRPC::1074::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Powering up', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '14800', 'displayIp': '0', 'displayPort': u'5910', 'session': 'Unknown', 'displaySecurePort': u'5911', 'timeOffset': '0', 'hash': '-831008492253830849', 'balloonInfo': {'balloon_max': '1048576', 'balloon_target': '1048576', 'balloon_cur': '1048576', 'balloon_min': '1048576'}, 'pauseCode': 'NOERR', 'clientIp': '', 'kvmEnable': 'true', 'network': {u'vnet5': {'macAddr': '00:1a:4a:de:6d:7d', 'rxDropped': '0', 'rxErrors': '0', 'txDropped': '0', 'txRate': '0.0', 'rxRate': '0.0', 'txErrors': '0', 'state': 'unknown', 'speed': '1000', 'name': u'vnet5'}}, 'vmId': '7fc21bb8-bd92-4924-acef-8360998e92a1', 'displayType': 'qxl', 'cpuUser': '34.49', 'disks': {u'vda': {'truesize': '1073741824', 'apparentsize': '1073741824', 'imageID': 'aa20346a-4d3a-4e07-b8e1-52c0ebe4168c'}, u'hdd': {'truesize': '0', 'apparentsize': '0'}, u'hdc': {'truesize': '0', 'apparentsize': '0'}}, 'monitorResponse': '0', 'statsAge': '1.90', 'elapsedTime': '36', 'vmType': 'kvm', 'cpuSys': '4.18', 'guestCPUCount': -1, 'appsList': [], 'guestIPs': ''}]} >GuestMonitor-scale_7::DEBUG::2014-07-10 09:03:22,944::vm::598::vm.Vm::(_getCpuStats) vmId=`a766ed65-ac2e-4862-8ff0-0352480cf6f1`::CPU stats not available: 'NoneType' object is unsubscriptable >GuestMonitor-scale_7::DEBUG::2014-07-10 09:03:22,944::vm::654::vm.Vm::(_getNetworkStats) vmId=`a766ed65-ac2e-4862-8ff0-0352480cf6f1`::Network stats not available >GuestMonitor-scale_7::DEBUG::2014-07-10 09:03:22,945::vm::676::vm.Vm::(_getDiskStats) vmId=`a766ed65-ac2e-4862-8ff0-0352480cf6f1`::Disk hdd stats not available >GuestMonitor-scale_7::DEBUG::2014-07-10 09:03:22,945::vm::676::vm.Vm::(_getDiskStats) vmId=`a766ed65-ac2e-4862-8ff0-0352480cf6f1`::Disk hdc stats not available >GuestMonitor-scale_7::DEBUG::2014-07-10 09:03:22,945::vm::676::vm.Vm::(_getDiskStats) vmId=`a766ed65-ac2e-4862-8ff0-0352480cf6f1`::Disk vda stats not available >GuestMonitor-scale_7::DEBUG::2014-07-10 09:03:22,945::vm::715::vm.Vm::(_getDiskLatency) vmId=`a766ed65-ac2e-4862-8ff0-0352480cf6f1`::Disk hdd latency not available >GuestMonitor-scale_7::DEBUG::2014-07-10 09:03:22,945::vm::715::vm.Vm::(_getDiskLatency) vmId=`a766ed65-ac2e-4862-8ff0-0352480cf6f1`::Disk hdc latency not available >GuestMonitor-scale_7::DEBUG::2014-07-10 09:03:22,946::vm::715::vm.Vm::(_getDiskLatency) vmId=`a766ed65-ac2e-4862-8ff0-0352480cf6f1`::Disk vda latency not available >GuestMonitor-scale_7::DEBUG::2014-07-10 09:03:22,946::vm::598::vm.Vm::(_getCpuStats) vmId=`a766ed65-ac2e-4862-8ff0-0352480cf6f1`::CPU stats not available: 'NoneType' object is unsubscriptable >GuestMonitor-scale_7::DEBUG::2014-07-10 09:03:22,946::vm::654::vm.Vm::(_getNetworkStats) vmId=`a766ed65-ac2e-4862-8ff0-0352480cf6f1`::Network stats not available >GuestMonitor-scale_7::DEBUG::2014-07-10 09:03:22,947::vm::676::vm.Vm::(_getDiskStats) vmId=`a766ed65-ac2e-4862-8ff0-0352480cf6f1`::Disk hdd stats not available >GuestMonitor-scale_7::DEBUG::2014-07-10 09:03:22,947::vm::676::vm.Vm::(_getDiskStats) vmId=`a766ed65-ac2e-4862-8ff0-0352480cf6f1`::Disk hdc stats not available >GuestMonitor-scale_7::DEBUG::2014-07-10 09:03:22,947::vm::676::vm.Vm::(_getDiskStats) vmId=`a766ed65-ac2e-4862-8ff0-0352480cf6f1`::Disk vda stats not available >GuestMonitor-scale_7::DEBUG::2014-07-10 09:03:22,947::vm::715::vm.Vm::(_getDiskLatency) vmId=`a766ed65-ac2e-4862-8ff0-0352480cf6f1`::Disk hdd latency not available >GuestMonitor-scale_7::DEBUG::2014-07-10 09:03:22,947::vm::715::vm.Vm::(_getDiskLatency) vmId=`a766ed65-ac2e-4862-8ff0-0352480cf6f1`::Disk hdc latency not available >GuestMonitor-scale_7::DEBUG::2014-07-10 09:03:22,948::vm::715::vm.Vm::(_getDiskLatency) vmId=`a766ed65-ac2e-4862-8ff0-0352480cf6f1`::Disk vda latency not available >GuestMonitor-scale_6::DEBUG::2014-07-10 09:03:22,959::vm::676::vm.Vm::(_getDiskStats) vmId=`7fc21bb8-bd92-4924-acef-8360998e92a1`::Disk hdd stats not available >GuestMonitor-scale_6::DEBUG::2014-07-10 09:03:22,960::vm::676::vm.Vm::(_getDiskStats) vmId=`7fc21bb8-bd92-4924-acef-8360998e92a1`::Disk hdc stats not available >GuestMonitor-scale_6::DEBUG::2014-07-10 09:03:22,960::vm::676::vm.Vm::(_getDiskStats) vmId=`7fc21bb8-bd92-4924-acef-8360998e92a1`::Disk vda stats not available >GuestMonitor-scale_6::DEBUG::2014-07-10 09:03:22,960::vm::715::vm.Vm::(_getDiskLatency) vmId=`7fc21bb8-bd92-4924-acef-8360998e92a1`::Disk hdd latency not available >GuestMonitor-scale_6::DEBUG::2014-07-10 09:03:22,960::vm::715::vm.Vm::(_getDiskLatency) vmId=`7fc21bb8-bd92-4924-acef-8360998e92a1`::Disk hdc latency not available >GuestMonitor-scale_6::DEBUG::2014-07-10 09:03:22,961::vm::715::vm.Vm::(_getDiskLatency) vmId=`7fc21bb8-bd92-4924-acef-8360998e92a1`::Disk vda latency not available >GuestMonitor-scale_6::DEBUG::2014-07-10 09:03:22,961::vm::676::vm.Vm::(_getDiskStats) vmId=`7fc21bb8-bd92-4924-acef-8360998e92a1`::Disk hdd stats not available >GuestMonitor-scale_6::DEBUG::2014-07-10 09:03:22,961::vm::676::vm.Vm::(_getDiskStats) vmId=`7fc21bb8-bd92-4924-acef-8360998e92a1`::Disk hdc stats not available >GuestMonitor-scale_6::DEBUG::2014-07-10 09:03:22,961::vm::676::vm.Vm::(_getDiskStats) vmId=`7fc21bb8-bd92-4924-acef-8360998e92a1`::Disk vda stats not available >GuestMonitor-scale_6::DEBUG::2014-07-10 09:03:22,962::vm::715::vm.Vm::(_getDiskLatency) vmId=`7fc21bb8-bd92-4924-acef-8360998e92a1`::Disk hdd latency not available >GuestMonitor-scale_6::DEBUG::2014-07-10 09:03:22,962::vm::715::vm.Vm::(_getDiskLatency) vmId=`7fc21bb8-bd92-4924-acef-8360998e92a1`::Disk hdc latency not available >GuestMonitor-scale_6::DEBUG::2014-07-10 09:03:22,962::vm::715::vm.Vm::(_getDiskLatency) vmId=`7fc21bb8-bd92-4924-acef-8360998e92a1`::Disk vda latency not available >GuestMonitor-scale_5::DEBUG::2014-07-10 09:03:22,980::vm::676::vm.Vm::(_getDiskStats) vmId=`2386fa8c-f537-495c-ae07-e178171d77f2`::Disk hdd stats not available >GuestMonitor-scale_5::DEBUG::2014-07-10 09:03:22,980::vm::676::vm.Vm::(_getDiskStats) vmId=`2386fa8c-f537-495c-ae07-e178171d77f2`::Disk hdc stats not available >GuestMonitor-scale_5::DEBUG::2014-07-10 09:03:22,981::vm::676::vm.Vm::(_getDiskStats) vmId=`2386fa8c-f537-495c-ae07-e178171d77f2`::Disk vda stats not available >GuestMonitor-scale_5::DEBUG::2014-07-10 09:03:22,981::vm::715::vm.Vm::(_getDiskLatency) vmId=`2386fa8c-f537-495c-ae07-e178171d77f2`::Disk hdd latency not available >GuestMonitor-scale_5::DEBUG::2014-07-10 09:03:22,981::vm::715::vm.Vm::(_getDiskLatency) vmId=`2386fa8c-f537-495c-ae07-e178171d77f2`::Disk hdc latency not available >GuestMonitor-scale_5::DEBUG::2014-07-10 09:03:22,981::vm::715::vm.Vm::(_getDiskLatency) vmId=`2386fa8c-f537-495c-ae07-e178171d77f2`::Disk vda latency not available >GuestMonitor-scale_5::DEBUG::2014-07-10 09:03:22,982::vm::676::vm.Vm::(_getDiskStats) vmId=`2386fa8c-f537-495c-ae07-e178171d77f2`::Disk hdd stats not available >GuestMonitor-scale_5::DEBUG::2014-07-10 09:03:22,982::vm::676::vm.Vm::(_getDiskStats) vmId=`2386fa8c-f537-495c-ae07-e178171d77f2`::Disk hdc stats not available >GuestMonitor-scale_5::DEBUG::2014-07-10 09:03:22,982::vm::676::vm.Vm::(_getDiskStats) vmId=`2386fa8c-f537-495c-ae07-e178171d77f2`::Disk vda stats not available >GuestMonitor-scale_5::DEBUG::2014-07-10 09:03:22,982::vm::715::vm.Vm::(_getDiskLatency) vmId=`2386fa8c-f537-495c-ae07-e178171d77f2`::Disk hdd latency not available >GuestMonitor-scale_5::DEBUG::2014-07-10 09:03:22,983::vm::715::vm.Vm::(_getDiskLatency) vmId=`2386fa8c-f537-495c-ae07-e178171d77f2`::Disk hdc latency not available >GuestMonitor-scale_5::DEBUG::2014-07-10 09:03:22,983::vm::715::vm.Vm::(_getDiskLatency) vmId=`2386fa8c-f537-495c-ae07-e178171d77f2`::Disk vda latency not available >Thread-13::DEBUG::2014-07-10 09:03:23,318::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-13::DEBUG::2014-07-10 09:03:23,319::task::595::TaskManager.Task::(_updateState) Task=`a734ee0f-3cfa-4fea-8a65-09cd5b512679`::moving from state init -> state preparing >Thread-13::INFO::2014-07-10 09:03:23,319::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-13::INFO::2014-07-10 09:03:23,320::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-13::DEBUG::2014-07-10 09:03:23,320::task::1185::TaskManager.Task::(prepare) Task=`a734ee0f-3cfa-4fea-8a65-09cd5b512679`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-13::DEBUG::2014-07-10 09:03:23,320::task::595::TaskManager.Task::(_updateState) Task=`a734ee0f-3cfa-4fea-8a65-09cd5b512679`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-07-10 09:03:23,321::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-07-10 09:03:23,321::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-07-10 09:03:23,321::task::990::TaskManager.Task::(_decref) Task=`a734ee0f-3cfa-4fea-8a65-09cd5b512679`::ref 0 aborting False >Thread-34::DEBUG::2014-07-10 09:03:23,325::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-34::DEBUG::2014-07-10 09:03:23,326::task::595::TaskManager.Task::(_updateState) Task=`d894c85b-d418-452c-ac92-1631d5d217fd`::moving from state init -> state preparing >Thread-34::INFO::2014-07-10 09:03:23,326::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-34::DEBUG::2014-07-10 09:03:23,327::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`db8bc2a2-323b-4011-b6e1-c2f14407f62c`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-10 09:03:23,327::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' for lock type 'shared' >Thread-34::DEBUG::2014-07-10 09:03:23,328::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-10 09:03:23,328::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`db8bc2a2-323b-4011-b6e1-c2f14407f62c`::Granted request >Thread-34::DEBUG::2014-07-10 09:03:23,328::task::827::TaskManager.Task::(resourceAcquired) Task=`d894c85b-d418-452c-ac92-1631d5d217fd`::_resourcesAcquired: Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee (shared) >Thread-34::DEBUG::2014-07-10 09:03:23,329::task::990::TaskManager.Task::(_decref) Task=`d894c85b-d418-452c-ac92-1631d5d217fd`::ref 1 aborting False >Thread-34::INFO::2014-07-10 09:03:23,330::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1075620872192', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532069482496', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:03:23,331::task::1185::TaskManager.Task::(prepare) Task=`d894c85b-d418-452c-ac92-1631d5d217fd`::finished: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1075620872192', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532069482496', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:03:23,331::task::595::TaskManager.Task::(_updateState) Task=`d894c85b-d418-452c-ac92-1631d5d217fd`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-10 09:03:23,331::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee': < ResourceRef 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-10 09:03:23,331::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-10 09:03:23,332::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' >Thread-34::DEBUG::2014-07-10 09:03:23,332::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' (0 active users) >Thread-34::DEBUG::2014-07-10 09:03:23,332::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-10 09:03:23,332::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', Clearing records. >Thread-34::DEBUG::2014-07-10 09:03:23,333::task::990::TaskManager.Task::(_decref) Task=`d894c85b-d418-452c-ac92-1631d5d217fd`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 09:03:23,668::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:03:23,803::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0679382 s, 15.1 MB/s\n'; <rc> = 0 >Thread-40::DEBUG::2014-07-10 09:03:24,605::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lion.qa.lab.tlv.redhat.com:_export_yuri2_backup2/6a70504d-00df-4869-8695-0f442053f6b6/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-40::DEBUG::2014-07-10 09:03:24,623::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n369 bytes (369 B) copied, 0.000372784 s, 990 kB/s\n'; <rc> = 0 >Thread-13::DEBUG::2014-07-10 09:03:25,449::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-13::DEBUG::2014-07-10 09:03:25,450::task::595::TaskManager.Task::(_updateState) Task=`2eb05846-ad50-4ef1-95a6-0a3615cb57cf`::moving from state init -> state preparing >Thread-13::INFO::2014-07-10 09:03:25,450::logUtils::44::dispatcher::(wrapper) Run and protect: getAllTasksStatuses(spUUID=None, options=None) >Thread-13::DEBUG::2014-07-10 09:03:25,451::taskManager::102::TaskManager::(getAllTasksStatuses) Entry. >Thread-13::DEBUG::2014-07-10 09:03:25,451::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 2a0f4c11-f90d-4c78-a996-83fad5f8814f >Thread-13::DEBUG::2014-07-10 09:03:25,451::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': '1 jobs completed successfully', 'taskState': 'finished', 'taskResult': 'success', 'taskID': '2a0f4c11-f90d-4c78-a996-83fad5f8814f'} >Thread-13::DEBUG::2014-07-10 09:03:25,452::taskManager::113::TaskManager::(getAllTasksStatuses) Return: {'2a0f4c11-f90d-4c78-a996-83fad5f8814f': {'code': 0, 'message': '1 jobs completed successfully', 'taskState': 'finished', 'taskResult': 'success', 'taskID': '2a0f4c11-f90d-4c78-a996-83fad5f8814f'}} >Thread-13::INFO::2014-07-10 09:03:25,452::logUtils::47::dispatcher::(wrapper) Run and protect: getAllTasksStatuses, Return response: {'allTasksStatus': {'2a0f4c11-f90d-4c78-a996-83fad5f8814f': {'code': 0, 'message': '1 jobs completed successfully', 'taskState': 'finished', 'taskResult': 'success', 'taskID': '2a0f4c11-f90d-4c78-a996-83fad5f8814f'}}} >Thread-13::DEBUG::2014-07-10 09:03:25,453::task::1185::TaskManager.Task::(prepare) Task=`2eb05846-ad50-4ef1-95a6-0a3615cb57cf`::finished: {'allTasksStatus': {'2a0f4c11-f90d-4c78-a996-83fad5f8814f': {'code': 0, 'message': '1 jobs completed successfully', 'taskState': 'finished', 'taskResult': 'success', 'taskID': '2a0f4c11-f90d-4c78-a996-83fad5f8814f'}}} >Thread-13::DEBUG::2014-07-10 09:03:25,453::task::595::TaskManager.Task::(_updateState) Task=`2eb05846-ad50-4ef1-95a6-0a3615cb57cf`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-07-10 09:03:25,453::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-07-10 09:03:25,453::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-07-10 09:03:25,454::task::990::TaskManager.Task::(_decref) Task=`2eb05846-ad50-4ef1-95a6-0a3615cb57cf`::ref 0 aborting False >Thread-34::DEBUG::2014-07-10 09:03:25,499::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [20cd1e94] >Thread-34::DEBUG::2014-07-10 09:03:25,500::task::595::TaskManager.Task::(_updateState) Task=`f10e65a3-952d-48c1-8987-249645c89c33`::moving from state init -> state preparing >Thread-34::INFO::2014-07-10 09:03:25,500::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeInfo(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='cfaeead2-7caa-467c-b389-c89840ae6605', volUUID='567fe32d-31a6-4ff6-90f3-fd6a656fbecc', options=None) >Thread-34::DEBUG::2014-07-10 09:03:25,501::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.9e1aa540-1f4e-4ee3-a152-be381ef6c3bd`ReqID=`3c59ede9-59fb-4544-949b-c504abca8636`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '3089' at 'getVolumeInfo' >Thread-34::DEBUG::2014-07-10 09:03:25,501::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.9e1aa540-1f4e-4ee3-a152-be381ef6c3bd' for lock type 'shared' >Thread-34::DEBUG::2014-07-10 09:03:25,501::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.9e1aa540-1f4e-4ee3-a152-be381ef6c3bd' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-10 09:03:25,502::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.9e1aa540-1f4e-4ee3-a152-be381ef6c3bd`ReqID=`3c59ede9-59fb-4544-949b-c504abca8636`::Granted request >Thread-34::DEBUG::2014-07-10 09:03:25,502::task::827::TaskManager.Task::(resourceAcquired) Task=`f10e65a3-952d-48c1-8987-249645c89c33`::_resourcesAcquired: Storage.9e1aa540-1f4e-4ee3-a152-be381ef6c3bd (shared) >Thread-34::DEBUG::2014-07-10 09:03:25,502::task::990::TaskManager.Task::(_decref) Task=`f10e65a3-952d-48c1-8987-249645c89c33`::ref 1 aborting False >Thread-34::DEBUG::2014-07-10 09:03:25,503::lvm::427::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' got the operation mutex >Thread-34::DEBUG::2014-07-10 09:03:25,504::lvm::296::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm lvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/3600601601282300032826addbbdae311|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,vg_name,attr,size,seg_start_pe,devices,tags 9e1aa540-1f4e-4ee3-a152-be381ef6c3bd' (cwd None) >Thread-34::DEBUG::2014-07-10 09:03:25,739::lvm::296::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-34::DEBUG::2014-07-10 09:03:25,757::lvm::462::Storage.LVM::(_reloadlvs) lvs reloaded >Thread-34::DEBUG::2014-07-10 09:03:25,758::lvm::462::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' released the operation mutex >Thread-34::INFO::2014-07-10 09:03:25,758::volume::879::Storage.Volume::(getInfo) Info request: sdUUID=9e1aa540-1f4e-4ee3-a152-be381ef6c3bd imgUUID=cfaeead2-7caa-467c-b389-c89840ae6605 volUUID = 567fe32d-31a6-4ff6-90f3-fd6a656fbecc >Thread-34::DEBUG::2014-07-10 09:03:25,759::blockVolume::572::Storage.Misc.excCmd::(getMetadata) '/bin/dd iflag=direct skip=12 bs=512 if=/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/metadata count=1' (cwd None) >Thread-34::DEBUG::2014-07-10 09:03:25,774::blockVolume::572::Storage.Misc.excCmd::(getMetadata) SUCCESS: <err> = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.000647046 s, 791 kB/s\n'; <rc> = 0 >Thread-34::DEBUG::2014-07-10 09:03:25,775::misc::282::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.000647046 s, 791 kB/s'], size: 512 >Thread-34::DEBUG::2014-07-10 09:03:25,775::blockVolume::572::Storage.Misc.excCmd::(getMetadata) '/bin/dd iflag=direct skip=12 bs=512 if=/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/metadata count=1' (cwd None) >Thread-34::DEBUG::2014-07-10 09:03:25,792::blockVolume::572::Storage.Misc.excCmd::(getMetadata) SUCCESS: <err> = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.000704492 s, 727 kB/s\n'; <rc> = 0 >Thread-34::DEBUG::2014-07-10 09:03:25,793::misc::282::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.000704492 s, 727 kB/s'], size: 512 >Thread-34::INFO::2014-07-10 09:03:25,793::volume::909::Storage.Volume::(getInfo) 9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/cfaeead2-7caa-467c-b389-c89840ae6605/567fe32d-31a6-4ff6-90f3-fd6a656fbecc info is {'status': 'OK', 'domain': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'voltype': 'LEAF', 'description': '', 'parent': '47592965-e853-4e59-9728-d11cca6a7a8a', 'format': 'COW', 'image': 'cfaeead2-7caa-467c-b389-c89840ae6605', 'ctime': '1404982998', 'disktype': '2', 'legality': 'LEGAL', 'mtime': '1404982998', 'apparentsize': '1073741824', 'children': [], 'pool': '', 'capacity': '10737418240', 'uuid': '567fe32d-31a6-4ff6-90f3-fd6a656fbecc', 'truesize': '1073741824', 'type': 'SPARSE'} >Thread-34::INFO::2014-07-10 09:03:25,794::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeInfo, Return response: {'info': {'status': 'OK', 'domain': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'voltype': 'LEAF', 'description': '', 'parent': '47592965-e853-4e59-9728-d11cca6a7a8a', 'format': 'COW', 'image': 'cfaeead2-7caa-467c-b389-c89840ae6605', 'ctime': '1404982998', 'disktype': '2', 'legality': 'LEGAL', 'mtime': '1404982998', 'apparentsize': '1073741824', 'children': [], 'pool': '', 'capacity': '10737418240', 'uuid': '567fe32d-31a6-4ff6-90f3-fd6a656fbecc', 'truesize': '1073741824', 'type': 'SPARSE'}} >Thread-34::DEBUG::2014-07-10 09:03:25,794::task::1185::TaskManager.Task::(prepare) Task=`f10e65a3-952d-48c1-8987-249645c89c33`::finished: {'info': {'status': 'OK', 'domain': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'voltype': 'LEAF', 'description': '', 'parent': '47592965-e853-4e59-9728-d11cca6a7a8a', 'format': 'COW', 'image': 'cfaeead2-7caa-467c-b389-c89840ae6605', 'ctime': '1404982998', 'disktype': '2', 'legality': 'LEGAL', 'mtime': '1404982998', 'apparentsize': '1073741824', 'children': [], 'pool': '', 'capacity': '10737418240', 'uuid': '567fe32d-31a6-4ff6-90f3-fd6a656fbecc', 'truesize': '1073741824', 'type': 'SPARSE'}} >Thread-34::DEBUG::2014-07-10 09:03:25,794::task::595::TaskManager.Task::(_updateState) Task=`f10e65a3-952d-48c1-8987-249645c89c33`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-10 09:03:25,794::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': < ResourceRef 'Storage.9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-10 09:03:25,795::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-10 09:03:25,795::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.9e1aa540-1f4e-4ee3-a152-be381ef6c3bd' >Thread-34::DEBUG::2014-07-10 09:03:25,795::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.9e1aa540-1f4e-4ee3-a152-be381ef6c3bd' (0 active users) >Thread-34::DEBUG::2014-07-10 09:03:25,796::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.9e1aa540-1f4e-4ee3-a152-be381ef6c3bd' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-10 09:03:25,796::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', Clearing records. >Thread-34::DEBUG::2014-07-10 09:03:25,796::task::990::TaskManager.Task::(_decref) Task=`f10e65a3-952d-48c1-8987-249645c89c33`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 09:03:25,813::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Thread-13::DEBUG::2014-07-10 09:03:25,834::BindingXMLRPC::1067::vds::(wrapper) client [10.35.3.13]::call vmGetStats with ('a766ed65-ac2e-4862-8ff0-0352480cf6f1',) {} >Thread-13::DEBUG::2014-07-10 09:03:25,835::vm::676::vm.Vm::(_getDiskStats) vmId=`a766ed65-ac2e-4862-8ff0-0352480cf6f1`::Disk hdd stats not available >Thread-13::DEBUG::2014-07-10 09:03:25,835::vm::676::vm.Vm::(_getDiskStats) vmId=`a766ed65-ac2e-4862-8ff0-0352480cf6f1`::Disk hdc stats not available >Thread-13::DEBUG::2014-07-10 09:03:25,835::vm::676::vm.Vm::(_getDiskStats) vmId=`a766ed65-ac2e-4862-8ff0-0352480cf6f1`::Disk vda stats not available >Thread-13::DEBUG::2014-07-10 09:03:25,836::vm::715::vm.Vm::(_getDiskLatency) vmId=`a766ed65-ac2e-4862-8ff0-0352480cf6f1`::Disk hdd latency not available >Thread-13::DEBUG::2014-07-10 09:03:25,836::vm::715::vm.Vm::(_getDiskLatency) vmId=`a766ed65-ac2e-4862-8ff0-0352480cf6f1`::Disk hdc latency not available >Thread-13::DEBUG::2014-07-10 09:03:25,836::vm::715::vm.Vm::(_getDiskLatency) vmId=`a766ed65-ac2e-4862-8ff0-0352480cf6f1`::Disk vda latency not available >Thread-13::DEBUG::2014-07-10 09:03:25,837::BindingXMLRPC::1074::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Powering up', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '15456', 'displayIp': '0', 'displayPort': u'5912', 'session': 'Unknown', 'displaySecurePort': u'5913', 'timeOffset': '0', 'hash': '1078195817470092527', 'balloonInfo': {'balloon_max': '1048576', 'balloon_target': '1048576', 'balloon_cur': '1048576', 'balloon_min': '1048576'}, 'pauseCode': 'NOERR', 'clientIp': '', 'kvmEnable': 'true', 'network': {u'vnet6': {'macAddr': '00:1a:4a:de:6d:88', 'rxDropped': '0', 'rxErrors': '0', 'txDropped': '0', 'txRate': '0.0', 'rxRate': '0.0', 'txErrors': '0', 'state': 'unknown', 'speed': '1000', 'name': u'vnet6'}}, 'vmId': 'a766ed65-ac2e-4862-8ff0-0352480cf6f1', 'displayType': 'qxl', 'cpuUser': '42.70', 'disks': {u'vda': {'truesize': '1073741824', 'apparentsize': '1073741824', 'imageID': 'f30c2cb7-a43a-4bf5-82b5-cfe07336f65c'}, u'hdd': {'truesize': '0', 'apparentsize': '0'}, u'hdc': {'truesize': '0', 'apparentsize': '0'}}, 'monitorResponse': '0', 'statsAge': '0.20', 'elapsedTime': '18', 'vmType': 'kvm', 'cpuSys': '26.97', 'guestCPUCount': -1, 'appsList': [], 'guestIPs': ''}]} >Thread-14::DEBUG::2014-07-10 09:03:25,840::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-14::DEBUG::2014-07-10 09:03:25,843::task::595::TaskManager.Task::(_updateState) Task=`7ef59ed5-bb1a-473b-b5cc-2295fb86f7ce`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 09:03:25,846::logUtils::44::dispatcher::(wrapper) Run and protect: clearTask(taskID='2a0f4c11-f90d-4c78-a996-83fad5f8814f', spUUID=None, options=None) >Thread-14::DEBUG::2014-07-10 09:03:25,847::taskManager::161::TaskManager::(clearTask) Entry. taskID: 2a0f4c11-f90d-4c78-a996-83fad5f8814f >Thread-14::DEBUG::2014-07-10 09:03:25,850::taskManager::166::TaskManager::(clearTask) Return. >Thread-14::INFO::2014-07-10 09:03:25,850::logUtils::47::dispatcher::(wrapper) Run and protect: clearTask, Return response: None >Thread-14::DEBUG::2014-07-10 09:03:25,851::task::1185::TaskManager.Task::(prepare) Task=`7ef59ed5-bb1a-473b-b5cc-2295fb86f7ce`::finished: None >Thread-14::DEBUG::2014-07-10 09:03:25,851::task::595::TaskManager.Task::(_updateState) Task=`7ef59ed5-bb1a-473b-b5cc-2295fb86f7ce`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 09:03:25,851::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 09:03:25,851::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 09:03:25,851::task::990::TaskManager.Task::(_decref) Task=`7ef59ed5-bb1a-473b-b5cc-2295fb86f7ce`::ref 0 aborting False >Thread-13::DEBUG::2014-07-10 09:03:25,852::BindingXMLRPC::1067::vds::(wrapper) client [10.35.3.13]::call vmGetStats with ('7fc21bb8-bd92-4924-acef-8360998e92a1',) {} >Thread-13::DEBUG::2014-07-10 09:03:25,855::vm::676::vm.Vm::(_getDiskStats) vmId=`7fc21bb8-bd92-4924-acef-8360998e92a1`::Disk hdd stats not available >Thread-13::DEBUG::2014-07-10 09:03:25,859::vm::676::vm.Vm::(_getDiskStats) vmId=`7fc21bb8-bd92-4924-acef-8360998e92a1`::Disk hdc stats not available >Thread-13::DEBUG::2014-07-10 09:03:25,862::vm::676::vm.Vm::(_getDiskStats) vmId=`7fc21bb8-bd92-4924-acef-8360998e92a1`::Disk vda stats not available >Thread-13::DEBUG::2014-07-10 09:03:25,864::vm::715::vm.Vm::(_getDiskLatency) vmId=`7fc21bb8-bd92-4924-acef-8360998e92a1`::Disk hdd latency not available >Thread-13::DEBUG::2014-07-10 09:03:25,866::vm::715::vm.Vm::(_getDiskLatency) vmId=`7fc21bb8-bd92-4924-acef-8360998e92a1`::Disk hdc latency not available >Thread-13::DEBUG::2014-07-10 09:03:25,868::vm::715::vm.Vm::(_getDiskLatency) vmId=`7fc21bb8-bd92-4924-acef-8360998e92a1`::Disk vda latency not available >Thread-13::DEBUG::2014-07-10 09:03:25,873::BindingXMLRPC::1074::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Powering up', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '14800', 'displayIp': '0', 'displayPort': u'5910', 'session': 'Unknown', 'displaySecurePort': u'5911', 'timeOffset': '0', 'hash': '-831008492253830849', 'balloonInfo': {'balloon_max': '1048576', 'balloon_target': '1048576', 'balloon_cur': '1048576', 'balloon_min': '1048576'}, 'pauseCode': 'NOERR', 'clientIp': '', 'kvmEnable': 'true', 'network': {u'vnet5': {'macAddr': '00:1a:4a:de:6d:7d', 'rxDropped': '0', 'rxErrors': '0', 'txDropped': '0', 'txRate': '0.0', 'rxRate': '0.0', 'txErrors': '0', 'state': 'unknown', 'speed': '1000', 'name': u'vnet5'}}, 'vmId': '7fc21bb8-bd92-4924-acef-8360998e92a1', 'displayType': 'qxl', 'cpuUser': '34.49', 'disks': {u'vda': {'truesize': '1073741824', 'apparentsize': '1073741824', 'imageID': 'aa20346a-4d3a-4e07-b8e1-52c0ebe4168c'}, u'hdd': {'truesize': '0', 'apparentsize': '0'}, u'hdc': {'truesize': '0', 'apparentsize': '0'}}, 'monitorResponse': '0', 'statsAge': '0.92', 'elapsedTime': '39', 'vmType': 'kvm', 'cpuSys': '4.18', 'guestCPUCount': -1, 'appsList': [], 'guestIPs': ''}]} >Dummy-33::DEBUG::2014-07-10 09:03:25,953::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0886359 s, 11.6 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 09:03:26,393::BindingXMLRPC::1067::vds::(wrapper) client [10.35.3.13]::call vmCreate with ({'acpiEnable': 'true', 'emulatedMachine': 'rhel6.5.0', 'vmId': '5d49ebac-3f0d-4688-aed0-b3f5fe364000', 'memGuaranteedSize': 1024, 'spiceSslCipherSuite': 'DEFAULT', 'timeOffset': '0', 'cpuType': 'Conroe', 'custom': {'device_432eebf8-c6f9-4f02-b3c4-372ac2f7639bdevice_f4a2acfa-7242-4fdf-a2b4-6c1202e79289device_0816c55b-b9f2-447d-b66f-a32e13db5dd6device_1c37a3dd-96a3-48a7-b833-4fd0653790b1device_47599aaf-5858-4c1f-8f76-67094b4204be': 'VmDevice {vmId=5d49ebac-3f0d-4688-aed0-b3f5fe364000, deviceId=47599aaf-5858-4c1f-8f76-67094b4204be, device=virtio-serial, type=CONTROLLER, bootOrder=0, specParams={}, address={bus=0x00, domain=0x0000, type=pci, slot=0x05, function=0x0}, managed=false, plugged=true, readOnly=false, deviceAlias=virtio-serial0, customProperties={}, snapshotId=null}', 'device_432eebf8-c6f9-4f02-b3c4-372ac2f7639bdevice_f4a2acfa-7242-4fdf-a2b4-6c1202e79289': 'VmDevice {vmId=5d49ebac-3f0d-4688-aed0-b3f5fe364000, deviceId=f4a2acfa-7242-4fdf-a2b4-6c1202e79289, device=ide, type=CONTROLLER, bootOrder=0, specParams={}, address={bus=0x00, domain=0x0000, type=pci, slot=0x01, function=0x1}, managed=false, plugged=true, readOnly=false, deviceAlias=ide0, customProperties={}, snapshotId=null}', 'device_432eebf8-c6f9-4f02-b3c4-372ac2f7639b': 'VmDevice {vmId=5d49ebac-3f0d-4688-aed0-b3f5fe364000, deviceId=432eebf8-c6f9-4f02-b3c4-372ac2f7639b, device=unix, type=CHANNEL, bootOrder=0, specParams={}, address={port=2, bus=0, controller=0, type=virtio-serial}, managed=false, plugged=true, readOnly=false, deviceAlias=channel1, customProperties={}, snapshotId=null}', 'device_432eebf8-c6f9-4f02-b3c4-372ac2f7639bdevice_f4a2acfa-7242-4fdf-a2b4-6c1202e79289device_0816c55b-b9f2-447d-b66f-a32e13db5dd6': 'VmDevice {vmId=5d49ebac-3f0d-4688-aed0-b3f5fe364000, deviceId=0816c55b-b9f2-447d-b66f-a32e13db5dd6, device=spicevmc, type=CHANNEL, bootOrder=0, specParams={}, address={port=3, bus=0, controller=0, type=virtio-serial}, managed=false, plugged=true, readOnly=false, deviceAlias=channel2, customProperties={}, snapshotId=null}', 'device_432eebf8-c6f9-4f02-b3c4-372ac2f7639bdevice_f4a2acfa-7242-4fdf-a2b4-6c1202e79289device_0816c55b-b9f2-447d-b66f-a32e13db5dd6device_1c37a3dd-96a3-48a7-b833-4fd0653790b1': 'VmDevice {vmId=5d49ebac-3f0d-4688-aed0-b3f5fe364000, deviceId=1c37a3dd-96a3-48a7-b833-4fd0653790b1, device=unix, type=CHANNEL, bootOrder=0, specParams={}, address={port=1, bus=0, controller=0, type=virtio-serial}, managed=false, plugged=true, readOnly=false, deviceAlias=channel0, customProperties={}, snapshotId=null}'}, 'smp': '2', 'vmType': 'kvm', 'memSize': 1024, 'smpCoresPerSocket': '2', 'vmName': 'scale_8', 'nice': '0', 'smartcardEnable': 'false', 'keyboardLayout': 'en-us', 'kvmEnable': 'true', 'pitReinjection': 'false', 'transparentHugePages': 'true', 'devices': [{'index': '3', 'iface': 'ide', 'specParams': {'vmPayload': {'volId': 'config-2', 'file': {'openstack/latest/meta_data.json': 'ewogICJsYXVuY2hfaW5kZXgiIDogIjAiLAogICJhdmFpbGFiaWxpdHlfem9uZSIgOiAibm92YSIs\nCiAgInV1aWQiIDogIjYwNjAzMTkwLThkZGEtNDk1YS05MDEyLTFiZDM3NmViODhmZCIsCiAgIm1l\ndGEiIDogewogICAgImVzc2VudGlhbCIgOiAiZmFsc2UiLAogICAgInJvbGUiIDogInNlcnZlciIs\nCiAgICAiZHNtb2RlIiA6ICJsb2NhbCIKICB9Cn0=\n', 'openstack/latest/user_data': 'I2Nsb3VkLWNvbmZpZwpzc2hfcHdhdXRoOiB0cnVlCmRpc2FibGVfcm9vdDogMApvdXRwdXQ6CiAg\nYWxsOiAnPj4gL3Zhci9sb2cvY2xvdWQtaW5pdC1vdXRwdXQubG9nJwp1c2VyOiByb290CmNocGFz\nc3dkOgogIGV4cGlyZTogZmFsc2UKcnVuY21kOgotICdzZWQgLWkgJycvXmRhdGFzb3VyY2VfbGlz\ndDogL2QnJyAvZXRjL2Nsb3VkL2Nsb3VkLmNmZzsgZWNobyAnJ2RhdGFzb3VyY2VfbGlzdDoKICBb\nIk5vQ2xvdWQiLCAiQ29uZmlnRHJpdmUiXScnID4+IC9ldGMvY2xvdWQvY2xvdWQuY2ZnJwo=\n'}}}, 'readonly': 'true', 'deviceId': 'ed51d373-b69d-4839-8e4d-1955d69ababe', 'path': '', 'device': 'cdrom', 'shared': 'false', 'type': 'disk'}, {'device': 'qxl', 'specParams': {'vram': '32768', 'ram': '65536', 'heads': '1'}, 'type': 'video', 'deviceId': '5a99361a-5cca-49ec-a6cf-e31280bd3f55'}, {'index': '2', 'iface': 'ide', 'specParams': {'path': ''}, 'readonly': 'true', 'deviceId': '31b2227a-3341-4455-9924-8c6a58744573', 'path': '', 'device': 'cdrom', 'shared': 'false', 'type': 'disk'}, {'index': 0, 'iface': 'virtio', 'format': 'cow', 'bootOrder': '1', 'poolID': '4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', 'volumeID': '567fe32d-31a6-4ff6-90f3-fd6a656fbecc', 'imageID': 'cfaeead2-7caa-467c-b389-c89840ae6605', 'specParams': {}, 'readonly': 'false', 'domainID': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'optional': 'false', 'deviceId': 'cfaeead2-7caa-467c-b389-c89840ae6605', 'address': {'slot': '0x06', 'bus': '0x00', 'domain': '0x0000', 'type': 'pci', 'function': '0x0'}, 'device': 'disk', 'shared': 'false', 'propagateErrors': 'off', 'type': 'disk'}, {'nicModel': 'pv', 'macAddr': '00:1a:4a:de:6d:89', 'linkActive': 'true', 'network': 'rhevm', 'filter': 'vdsm-no-mac-spoofing', 'specParams': {'inbound': {}, 'outbound': {}}, 'deviceId': '4b0dcb08-2250-460b-87d5-6b9cd0808970', 'device': 'bridge', 'type': 'interface'}, {'device': 'memballoon', 'specParams': {'model': 'virtio'}, 'type': 'balloon', 'deviceId': '7b927413-4350-41d6-87ec-24a055b550fe'}, {'index': '0', 'specParams': {}, 'deviceId': 'c4e6d617-15c8-4700-984d-e35f55e495dc', 'address': {'slot': '0x04', 'bus': '0x00', 'domain': '0x0000', 'type': 'pci', 'function': '0x0'}, 'device': 'scsi', 'model': 'virtio-scsi', 'type': 'controller'}], 'maxVCpus': '160', 'spiceSecureChannels': 'smain,sinputs,scursor,splayback,srecord,sdisplay,susbredir,ssmartcard', 'display': 'qxl'},) {} flowID [55db6aa2] >Thread-14::INFO::2014-07-10 09:03:26,397::API::667::vds::(_getNetworkIp) network None: using 0 >Thread-14::INFO::2014-07-10 09:03:26,397::clientIF::366::vds::(createVm) vmContainerLock acquired by vm 5d49ebac-3f0d-4688-aed0-b3f5fe364000 >Thread-14::DEBUG::2014-07-10 09:03:26,403::clientIF::379::vds::(createVm) Total desktops after creation of 5d49ebac-3f0d-4688-aed0-b3f5fe364000 is 8 >Thread-68::DEBUG::2014-07-10 09:03:26,403::vm::2270::vm.Vm::(_startUnderlyingVm) vmId=`5d49ebac-3f0d-4688-aed0-b3f5fe364000`::Start >Thread-14::DEBUG::2014-07-10 09:03:26,405::BindingXMLRPC::1074::vds::(wrapper) return vmCreate with {'status': {'message': 'Done', 'code': 0}, 'vmList': {'status': 'WaitForLaunch', 'acpiEnable': 'true', 'emulatedMachine': 'rhel6.5.0', 'vmId': '5d49ebac-3f0d-4688-aed0-b3f5fe364000', 'pid': '0', 'memGuaranteedSize': 1024, 'timeOffset': '0', 'keyboardLayout': 'en-us', 'displayPort': '-1', 'displaySecurePort': '-1', 'spiceSslCipherSuite': 'DEFAULT', 'cpuType': 'Conroe', 'smp': '2', 'clientIp': '', 'nicModel': 'rtl8139,pv', 'smartcardEnable': 'false', 'kvmEnable': 'true', 'pitReinjection': 'false', 'transparentHugePages': 'true', 'devices': [{'index': '3', 'iface': 'ide', 'specParams': {'vmPayload': {'volId': 'config-2', 'file': {'openstack/latest/meta_data.json': 'ewogICJsYXVuY2hfaW5kZXgiIDogIjAiLAogICJhdmFpbGFiaWxpdHlfem9uZSIgOiAibm92YSIs\nCiAgInV1aWQiIDogIjYwNjAzMTkwLThkZGEtNDk1YS05MDEyLTFiZDM3NmViODhmZCIsCiAgIm1l\ndGEiIDogewogICAgImVzc2VudGlhbCIgOiAiZmFsc2UiLAogICAgInJvbGUiIDogInNlcnZlciIs\nCiAgICAiZHNtb2RlIiA6ICJsb2NhbCIKICB9Cn0=\n', 'openstack/latest/user_data': 'I2Nsb3VkLWNvbmZpZwpzc2hfcHdhdXRoOiB0cnVlCmRpc2FibGVfcm9vdDogMApvdXRwdXQ6CiAg\nYWxsOiAnPj4gL3Zhci9sb2cvY2xvdWQtaW5pdC1vdXRwdXQubG9nJwp1c2VyOiByb290CmNocGFz\nc3dkOgogIGV4cGlyZTogZmFsc2UKcnVuY21kOgotICdzZWQgLWkgJycvXmRhdGFzb3VyY2VfbGlz\ndDogL2QnJyAvZXRjL2Nsb3VkL2Nsb3VkLmNmZzsgZWNobyAnJ2RhdGFzb3VyY2VfbGlzdDoKICBb\nIk5vQ2xvdWQiLCAiQ29uZmlnRHJpdmUiXScnID4+IC9ldGMvY2xvdWQvY2xvdWQuY2ZnJwo=\n'}}}, 'readonly': 'true', 'deviceId': 'ed51d373-b69d-4839-8e4d-1955d69ababe', 'path': '', 'device': 'cdrom', 'shared': 'false', 'type': 'disk'}, {'device': 'qxl', 'specParams': {'vram': '32768', 'ram': '65536', 'heads': '1'}, 'type': 'video', 'deviceId': '5a99361a-5cca-49ec-a6cf-e31280bd3f55'}, {'index': '2', 'iface': 'ide', 'specParams': {'path': ''}, 'readonly': 'true', 'deviceId': '31b2227a-3341-4455-9924-8c6a58744573', 'path': '', 'device': 'cdrom', 'shared': 'false', 'type': 'disk'}, {'index': 0, 'iface': 'virtio', 'format': 'cow', 'bootOrder': '1', 'poolID': '4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', 'volumeID': '567fe32d-31a6-4ff6-90f3-fd6a656fbecc', 'imageID': 'cfaeead2-7caa-467c-b389-c89840ae6605', 'specParams': {}, 'readonly': 'false', 'domainID': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'optional': 'false', 'deviceId': 'cfaeead2-7caa-467c-b389-c89840ae6605', 'address': {'slot': '0x06', 'bus': '0x00', 'domain': '0x0000', 'type': 'pci', 'function': '0x0'}, 'device': 'disk', 'shared': 'false', 'propagateErrors': 'off', 'type': 'disk'}, {'nicModel': 'pv', 'macAddr': '00:1a:4a:de:6d:89', 'linkActive': 'true', 'network': 'rhevm', 'filter': 'vdsm-no-mac-spoofing', 'specParams': {'inbound': {}, 'outbound': {}}, 'deviceId': '4b0dcb08-2250-460b-87d5-6b9cd0808970', 'device': 'bridge', 'type': 'interface'}, {'device': 'memballoon', 'specParams': {'model': 'virtio'}, 'type': 'balloon', 'deviceId': '7b927413-4350-41d6-87ec-24a055b550fe'}, {'index': '0', 'specParams': {}, 'deviceId': 'c4e6d617-15c8-4700-984d-e35f55e495dc', 'address': {'slot': '0x04', 'bus': '0x00', 'domain': '0x0000', 'type': 'pci', 'function': '0x0'}, 'device': 'scsi', 'model': 'virtio-scsi', 'type': 'controller'}], 'custom': {'device_432eebf8-c6f9-4f02-b3c4-372ac2f7639bdevice_f4a2acfa-7242-4fdf-a2b4-6c1202e79289device_0816c55b-b9f2-447d-b66f-a32e13db5dd6device_1c37a3dd-96a3-48a7-b833-4fd0653790b1device_47599aaf-5858-4c1f-8f76-67094b4204be': 'VmDevice {vmId=5d49ebac-3f0d-4688-aed0-b3f5fe364000, deviceId=47599aaf-5858-4c1f-8f76-67094b4204be, device=virtio-serial, type=CONTROLLER, bootOrder=0, specParams={}, address={bus=0x00, domain=0x0000, type=pci, slot=0x05, function=0x0}, managed=false, plugged=true, readOnly=false, deviceAlias=virtio-serial0, customProperties={}, snapshotId=null}', 'device_432eebf8-c6f9-4f02-b3c4-372ac2f7639bdevice_f4a2acfa-7242-4fdf-a2b4-6c1202e79289': 'VmDevice {vmId=5d49ebac-3f0d-4688-aed0-b3f5fe364000, deviceId=f4a2acfa-7242-4fdf-a2b4-6c1202e79289, device=ide, type=CONTROLLER, bootOrder=0, specParams={}, address={bus=0x00, domain=0x0000, type=pci, slot=0x01, function=0x1}, managed=false, plugged=true, readOnly=false, deviceAlias=ide0, customProperties={}, snapshotId=null}', 'device_432eebf8-c6f9-4f02-b3c4-372ac2f7639b': 'VmDevice {vmId=5d49ebac-3f0d-4688-aed0-b3f5fe364000, deviceId=432eebf8-c6f9-4f02-b3c4-372ac2f7639b, device=unix, type=CHANNEL, bootOrder=0, specParams={}, address={port=2, bus=0, controller=0, type=virtio-serial}, managed=false, plugged=true, readOnly=false, deviceAlias=channel1, customProperties={}, snapshotId=null}', 'device_432eebf8-c6f9-4f02-b3c4-372ac2f7639bdevice_f4a2acfa-7242-4fdf-a2b4-6c1202e79289device_0816c55b-b9f2-447d-b66f-a32e13db5dd6': 'VmDevice {vmId=5d49ebac-3f0d-4688-aed0-b3f5fe364000, deviceId=0816c55b-b9f2-447d-b66f-a32e13db5dd6, device=spicevmc, type=CHANNEL, bootOrder=0, specParams={}, address={port=3, bus=0, controller=0, type=virtio-serial}, managed=false, plugged=true, readOnly=false, deviceAlias=channel2, customProperties={}, snapshotId=null}', 'device_432eebf8-c6f9-4f02-b3c4-372ac2f7639bdevice_f4a2acfa-7242-4fdf-a2b4-6c1202e79289device_0816c55b-b9f2-447d-b66f-a32e13db5dd6device_1c37a3dd-96a3-48a7-b833-4fd0653790b1': 'VmDevice {vmId=5d49ebac-3f0d-4688-aed0-b3f5fe364000, deviceId=1c37a3dd-96a3-48a7-b833-4fd0653790b1, device=unix, type=CHANNEL, bootOrder=0, specParams={}, address={port=1, bus=0, controller=0, type=virtio-serial}, managed=false, plugged=true, readOnly=false, deviceAlias=channel0, customProperties={}, snapshotId=null}'}, 'vmType': 'kvm', 'memSize': 1024, 'displayIp': '0', 'maxVCpus': '160', 'spiceSecureChannels': 'smain,sinputs,scursor,splayback,srecord,sdisplay,susbredir,ssmartcard', 'smpCoresPerSocket': '2', 'vmName': 'scale_8', 'display': 'qxl', 'nice': '0'}} >Thread-68::DEBUG::2014-07-10 09:03:26,406::vm::2274::vm.Vm::(_startUnderlyingVm) vmId=`5d49ebac-3f0d-4688-aed0-b3f5fe364000`::_ongoingCreations acquired >Thread-68::INFO::2014-07-10 09:03:26,409::vm::3151::vm.Vm::(_run) vmId=`5d49ebac-3f0d-4688-aed0-b3f5fe364000`::VM wrapper has started >Thread-68::DEBUG::2014-07-10 09:03:26,413::task::595::TaskManager.Task::(_updateState) Task=`604a81eb-ecd5-419d-917f-d398edb4ffa2`::moving from state init -> state preparing >Thread-68::INFO::2014-07-10 09:03:26,416::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='cfaeead2-7caa-467c-b389-c89840ae6605', volUUID='567fe32d-31a6-4ff6-90f3-fd6a656fbecc', options=None) >Thread-68::INFO::2014-07-10 09:03:26,419::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-68::DEBUG::2014-07-10 09:03:26,421::task::1185::TaskManager.Task::(prepare) Task=`604a81eb-ecd5-419d-917f-d398edb4ffa2`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-68::DEBUG::2014-07-10 09:03:26,423::task::595::TaskManager.Task::(_updateState) Task=`604a81eb-ecd5-419d-917f-d398edb4ffa2`::moving from state preparing -> state finished >Thread-68::DEBUG::2014-07-10 09:03:26,425::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-68::DEBUG::2014-07-10 09:03:26,427::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-68::DEBUG::2014-07-10 09:03:26,429::task::990::TaskManager.Task::(_decref) Task=`604a81eb-ecd5-419d-917f-d398edb4ffa2`::ref 0 aborting False >Thread-68::INFO::2014-07-10 09:03:26,490::clientIF::324::vds::(prepareVolumePath) prepared volume path: /var/run/vdsm/payload/5d49ebac-3f0d-4688-aed0-b3f5fe364000.62fcaa2c201f6dc60f46d7fab36affcd.img >Thread-68::INFO::2014-07-10 09:03:26,490::clientIF::324::vds::(prepareVolumePath) prepared volume path: >Thread-68::DEBUG::2014-07-10 09:03:26,491::task::595::TaskManager.Task::(_updateState) Task=`ab3eee06-629e-49c1-a4c4-1507de847592`::moving from state init -> state preparing >Thread-68::INFO::2014-07-10 09:03:26,491::logUtils::44::dispatcher::(wrapper) Run and protect: prepareImage(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='cfaeead2-7caa-467c-b389-c89840ae6605', leafUUID='567fe32d-31a6-4ff6-90f3-fd6a656fbecc') >Thread-68::DEBUG::2014-07-10 09:03:26,492::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.9e1aa540-1f4e-4ee3-a152-be381ef6c3bd`ReqID=`0e54e0cc-0e49-423c-bfdc-01f37e3e131d`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '3248' at 'prepareImage' >Thread-68::DEBUG::2014-07-10 09:03:26,492::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.9e1aa540-1f4e-4ee3-a152-be381ef6c3bd' for lock type 'shared' >Thread-68::DEBUG::2014-07-10 09:03:26,492::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.9e1aa540-1f4e-4ee3-a152-be381ef6c3bd' is free. Now locking as 'shared' (1 active user) >Thread-68::DEBUG::2014-07-10 09:03:26,492::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.9e1aa540-1f4e-4ee3-a152-be381ef6c3bd`ReqID=`0e54e0cc-0e49-423c-bfdc-01f37e3e131d`::Granted request >Thread-68::DEBUG::2014-07-10 09:03:26,493::task::827::TaskManager.Task::(resourceAcquired) Task=`ab3eee06-629e-49c1-a4c4-1507de847592`::_resourcesAcquired: Storage.9e1aa540-1f4e-4ee3-a152-be381ef6c3bd (shared) >Thread-68::DEBUG::2014-07-10 09:03:26,493::task::990::TaskManager.Task::(_decref) Task=`ab3eee06-629e-49c1-a4c4-1507de847592`::ref 1 aborting False >Thread-68::DEBUG::2014-07-10 09:03:26,493::lvm::427::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' got the operation mutex >Thread-68::DEBUG::2014-07-10 09:03:26,494::lvm::296::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm lvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/3600601601282300032826addbbdae311|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,vg_name,attr,size,seg_start_pe,devices,tags 9e1aa540-1f4e-4ee3-a152-be381ef6c3bd' (cwd None) >Thread-68::DEBUG::2014-07-10 09:03:26,701::lvm::296::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-68::DEBUG::2014-07-10 09:03:26,717::lvm::462::Storage.LVM::(_reloadlvs) lvs reloaded >Thread-68::DEBUG::2014-07-10 09:03:26,717::lvm::462::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' released the operation mutex >Thread-68::DEBUG::2014-07-10 09:03:26,718::lvm::296::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm lvchange --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/3600601601282300032826addbbdae311|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } " --autobackup n --available y 9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/567fe32d-31a6-4ff6-90f3-fd6a656fbecc' (cwd None) >Thread-68::DEBUG::2014-07-10 09:03:27,402::lvm::296::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-68::DEBUG::2014-07-10 09:03:27,403::lvm::513::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-68::DEBUG::2014-07-10 09:03:27,404::lvm::525::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-68::DEBUG::2014-07-10 09:03:27,405::blockSD::1057::Storage.StorageDomain::(linkBCImage) path to image directory already exists: /rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/images/cfaeead2-7caa-467c-b389-c89840ae6605 >Thread-68::DEBUG::2014-07-10 09:03:27,406::lvm::427::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' got the operation mutex >Thread-68::DEBUG::2014-07-10 09:03:27,407::lvm::296::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm lvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/3600601601282300032826addbbdae311|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,vg_name,attr,size,seg_start_pe,devices,tags 9e1aa540-1f4e-4ee3-a152-be381ef6c3bd' (cwd None) >Thread-18::DEBUG::2014-07-10 09:03:27,537::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/metadata bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-10 09:03:27,555::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000591304 s, 6.9 MB/s\n'; <rc> = 0 >Thread-68::DEBUG::2014-07-10 09:03:27,614::lvm::296::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-68::DEBUG::2014-07-10 09:03:27,629::lvm::462::Storage.LVM::(_reloadlvs) lvs reloaded >Thread-68::DEBUG::2014-07-10 09:03:27,629::lvm::462::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' released the operation mutex >Thread-68::INFO::2014-07-10 09:03:27,630::logUtils::47::dispatcher::(wrapper) Run and protect: prepareImage, Return response: {'info': {'domainID': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'volType': 'path', 'leaseOffset': 117440512, 'path': '/rhev/data-center/mnt/blockSD/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/images/cfaeead2-7caa-467c-b389-c89840ae6605/567fe32d-31a6-4ff6-90f3-fd6a656fbecc', 'volumeID': '567fe32d-31a6-4ff6-90f3-fd6a656fbecc', 'leasePath': '/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/leases', 'imageID': 'cfaeead2-7caa-467c-b389-c89840ae6605'}, 'path': '/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/images/cfaeead2-7caa-467c-b389-c89840ae6605/567fe32d-31a6-4ff6-90f3-fd6a656fbecc', 'imgVolumesInfo': [{'domainID': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'volType': 'path', 'leaseOffset': 109051904, 'path': '/rhev/data-center/mnt/blockSD/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/images/cfaeead2-7caa-467c-b389-c89840ae6605/47592965-e853-4e59-9728-d11cca6a7a8a', 'volumeID': '47592965-e853-4e59-9728-d11cca6a7a8a', 'leasePath': '/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/leases', 'imageID': 'cfaeead2-7caa-467c-b389-c89840ae6605'}, {'domainID': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'volType': 'path', 'leaseOffset': 117440512, 'path': '/rhev/data-center/mnt/blockSD/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/images/cfaeead2-7caa-467c-b389-c89840ae6605/567fe32d-31a6-4ff6-90f3-fd6a656fbecc', 'volumeID': '567fe32d-31a6-4ff6-90f3-fd6a656fbecc', 'leasePath': '/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/leases', 'imageID': 'cfaeead2-7caa-467c-b389-c89840ae6605'}]} >Thread-68::DEBUG::2014-07-10 09:03:27,630::task::1185::TaskManager.Task::(prepare) Task=`ab3eee06-629e-49c1-a4c4-1507de847592`::finished: {'info': {'domainID': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'volType': 'path', 'leaseOffset': 117440512, 'path': '/rhev/data-center/mnt/blockSD/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/images/cfaeead2-7caa-467c-b389-c89840ae6605/567fe32d-31a6-4ff6-90f3-fd6a656fbecc', 'volumeID': '567fe32d-31a6-4ff6-90f3-fd6a656fbecc', 'leasePath': '/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/leases', 'imageID': 'cfaeead2-7caa-467c-b389-c89840ae6605'}, 'path': '/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/images/cfaeead2-7caa-467c-b389-c89840ae6605/567fe32d-31a6-4ff6-90f3-fd6a656fbecc', 'imgVolumesInfo': [{'domainID': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'volType': 'path', 'leaseOffset': 109051904, 'path': '/rhev/data-center/mnt/blockSD/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/images/cfaeead2-7caa-467c-b389-c89840ae6605/47592965-e853-4e59-9728-d11cca6a7a8a', 'volumeID': '47592965-e853-4e59-9728-d11cca6a7a8a', 'leasePath': '/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/leases', 'imageID': 'cfaeead2-7caa-467c-b389-c89840ae6605'}, {'domainID': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'volType': 'path', 'leaseOffset': 117440512, 'path': '/rhev/data-center/mnt/blockSD/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/images/cfaeead2-7caa-467c-b389-c89840ae6605/567fe32d-31a6-4ff6-90f3-fd6a656fbecc', 'volumeID': '567fe32d-31a6-4ff6-90f3-fd6a656fbecc', 'leasePath': '/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/leases', 'imageID': 'cfaeead2-7caa-467c-b389-c89840ae6605'}]} >Thread-68::DEBUG::2014-07-10 09:03:27,630::task::595::TaskManager.Task::(_updateState) Task=`ab3eee06-629e-49c1-a4c4-1507de847592`::moving from state preparing -> state finished >Thread-68::DEBUG::2014-07-10 09:03:27,631::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': < ResourceRef 'Storage.9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', isValid: 'True' obj: 'None'>} >Thread-68::DEBUG::2014-07-10 09:03:27,631::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-68::DEBUG::2014-07-10 09:03:27,631::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.9e1aa540-1f4e-4ee3-a152-be381ef6c3bd' >Thread-68::DEBUG::2014-07-10 09:03:27,632::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.9e1aa540-1f4e-4ee3-a152-be381ef6c3bd' (0 active users) >Thread-68::DEBUG::2014-07-10 09:03:27,632::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.9e1aa540-1f4e-4ee3-a152-be381ef6c3bd' is free, finding out if anyone is waiting for it. >Thread-68::DEBUG::2014-07-10 09:03:27,632::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', Clearing records. >Thread-68::DEBUG::2014-07-10 09:03:27,632::task::990::TaskManager.Task::(_decref) Task=`ab3eee06-629e-49c1-a4c4-1507de847592`::ref 0 aborting False >Thread-68::INFO::2014-07-10 09:03:27,633::clientIF::324::vds::(prepareVolumePath) prepared volume path: /rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/images/cfaeead2-7caa-467c-b389-c89840ae6605/567fe32d-31a6-4ff6-90f3-fd6a656fbecc >Thread-68::DEBUG::2014-07-10 09:03:27,658::utils::642::root::(execCmd) '/usr/libexec/vdsm/hooks/before_vm_start/50_vhostmd' (cwd None) >Thread-68::DEBUG::2014-07-10 09:03:27,775::utils::662::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-68::INFO::2014-07-10 09:03:27,778::hooks::100::root::(_runHooksDir) >Thread-68::DEBUG::2014-07-10 09:03:27,781::vm::3190::vm.Vm::(_run) vmId=`5d49ebac-3f0d-4688-aed0-b3f5fe364000`::<?xml version="1.0" encoding="utf-8"?> ><domain type="kvm"> > <name>scale_8</name> > <uuid>5d49ebac-3f0d-4688-aed0-b3f5fe364000</uuid> > <memory>1048576</memory> > <currentMemory>1048576</currentMemory> > <vcpu current="2">160</vcpu> > <memtune> > <min_guarantee>1048576</min_guarantee> > </memtune> > <devices> > <channel type="unix"> > <target name="com.redhat.rhevm.vdsm" type="virtio"/> > <source mode="bind" path="/var/lib/libvirt/qemu/channels/5d49ebac-3f0d-4688-aed0-b3f5fe364000.com.redhat.rhevm.vdsm"/> > </channel> > <channel type="unix"> > <target name="org.qemu.guest_agent.0" type="virtio"/> > <source mode="bind" path="/var/lib/libvirt/qemu/channels/5d49ebac-3f0d-4688-aed0-b3f5fe364000.org.qemu.guest_agent.0"/> > </channel> > <input bus="ps2" type="mouse"/> > <channel type="spicevmc"> > <target name="com.redhat.spice.0" type="virtio"/> > </channel> > <graphics autoport="yes" keymap="en-us" listen="0" passwd="*****" passwdValidTo="1970-01-01T00:00:01" port="-1" tlsPort="-1" type="spice"> > <channel mode="secure" name="main"/> > <channel mode="secure" name="inputs"/> > <channel mode="secure" name="cursor"/> > <channel mode="secure" name="playback"/> > <channel mode="secure" name="record"/> > <channel mode="secure" name="display"/> > <channel mode="secure" name="usbredir"/> > <channel mode="secure" name="smartcard"/> > </graphics> > <memballoon model="virtio"/> > <controller index="0" model="virtio-scsi" type="scsi"> > <address bus="0x00" domain="0x0000" function="0x0" slot="0x04" type="pci"/> > </controller> > <video> > <model heads="1" ram="65536" type="qxl" vram="32768"/> > </video> > <interface type="bridge"> > <mac address="00:1a:4a:de:6d:89"/> > <model type="virtio"/> > <source bridge="rhevm"/> > <filterref filter="vdsm-no-mac-spoofing"/> > <link state="up"/> > <bandwidth/> > </interface> > <disk device="cdrom" snapshot="no" type="file"> > <source file="/var/run/vdsm/payload/5d49ebac-3f0d-4688-aed0-b3f5fe364000.62fcaa2c201f6dc60f46d7fab36affcd.img" startupPolicy="optional"/> > <target bus="ide" dev="hdd"/> > <readonly/> > <serial/> > </disk> > <disk device="cdrom" snapshot="no" type="file"> > <source file="" startupPolicy="optional"/> > <target bus="ide" dev="hdc"/> > <readonly/> > <serial/> > </disk> > <disk device="disk" snapshot="no" type="block"> > <address bus="0x00" domain="0x0000" function="0x0" slot="0x06" type="pci"/> > <source dev="/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/images/cfaeead2-7caa-467c-b389-c89840ae6605/567fe32d-31a6-4ff6-90f3-fd6a656fbecc"/> > <target bus="virtio" dev="vda"/> > <serial>cfaeead2-7caa-467c-b389-c89840ae6605</serial> > <boot order="1"/> > <driver cache="none" error_policy="stop" io="native" name="qemu" type="qcow2"/> > </disk> > </devices> > <os> > <type arch="x86_64" machine="rhel6.5.0">hvm</type> > <smbios mode="sysinfo"/> > </os> > <sysinfo type="smbios"> > <system> > <entry name="manufacturer">Red Hat</entry> > <entry name="product">RHEV Hypervisor</entry> > <entry name="version">6.5-20140707.0.el6ev</entry> > <entry name="serial">52BAF97B-FF2F-E311-0000-100000000005</entry> > <entry name="uuid">5d49ebac-3f0d-4688-aed0-b3f5fe364000</entry> > </system> > </sysinfo> > <clock adjustment="0" offset="variable"> > <timer name="rtc" tickpolicy="catchup"/> > </clock> > <features> > <acpi/> > </features> > <cpu match="exact"> > <model>Conroe</model> > <topology cores="2" sockets="80" threads="1"/> > </cpu> ></domain> > >GuestMonitor-scale_7::DEBUG::2014-07-10 09:03:27,954::vm::676::vm.Vm::(_getDiskStats) vmId=`a766ed65-ac2e-4862-8ff0-0352480cf6f1`::Disk hdd stats not available >GuestMonitor-scale_7::DEBUG::2014-07-10 09:03:27,966::vm::676::vm.Vm::(_getDiskStats) vmId=`a766ed65-ac2e-4862-8ff0-0352480cf6f1`::Disk hdc stats not available >GuestMonitor-scale_7::DEBUG::2014-07-10 09:03:27,966::vm::676::vm.Vm::(_getDiskStats) vmId=`a766ed65-ac2e-4862-8ff0-0352480cf6f1`::Disk vda stats not available >GuestMonitor-scale_7::DEBUG::2014-07-10 09:03:27,971::vm::715::vm.Vm::(_getDiskLatency) vmId=`a766ed65-ac2e-4862-8ff0-0352480cf6f1`::Disk hdd latency not available >GuestMonitor-scale_6::DEBUG::2014-07-10 09:03:27,972::vm::676::vm.Vm::(_getDiskStats) vmId=`7fc21bb8-bd92-4924-acef-8360998e92a1`::Disk hdd stats not available >GuestMonitor-scale_7::DEBUG::2014-07-10 09:03:27,977::vm::715::vm.Vm::(_getDiskLatency) vmId=`a766ed65-ac2e-4862-8ff0-0352480cf6f1`::Disk hdc latency not available >GuestMonitor-scale_6::DEBUG::2014-07-10 09:03:27,979::vm::676::vm.Vm::(_getDiskStats) vmId=`7fc21bb8-bd92-4924-acef-8360998e92a1`::Disk hdc stats not available >Dummy-33::DEBUG::2014-07-10 09:03:27,979::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >GuestMonitor-scale_7::DEBUG::2014-07-10 09:03:27,982::vm::715::vm.Vm::(_getDiskLatency) vmId=`a766ed65-ac2e-4862-8ff0-0352480cf6f1`::Disk vda latency not available >GuestMonitor-scale_6::DEBUG::2014-07-10 09:03:28,000::vm::676::vm.Vm::(_getDiskStats) vmId=`7fc21bb8-bd92-4924-acef-8360998e92a1`::Disk vda stats not available >GuestMonitor-scale_5::DEBUG::2014-07-10 09:03:28,010::vm::676::vm.Vm::(_getDiskStats) vmId=`2386fa8c-f537-495c-ae07-e178171d77f2`::Disk hdd stats not available >GuestMonitor-scale_6::DEBUG::2014-07-10 09:03:28,013::vm::715::vm.Vm::(_getDiskLatency) vmId=`7fc21bb8-bd92-4924-acef-8360998e92a1`::Disk hdd latency not available >GuestMonitor-scale_5::DEBUG::2014-07-10 09:03:28,015::vm::676::vm.Vm::(_getDiskStats) vmId=`2386fa8c-f537-495c-ae07-e178171d77f2`::Disk hdc stats not available >GuestMonitor-scale_7::DEBUG::2014-07-10 09:03:28,015::vm::676::vm.Vm::(_getDiskStats) vmId=`a766ed65-ac2e-4862-8ff0-0352480cf6f1`::Disk hdd stats not available >GuestMonitor-scale_6::DEBUG::2014-07-10 09:03:28,016::vm::715::vm.Vm::(_getDiskLatency) vmId=`7fc21bb8-bd92-4924-acef-8360998e92a1`::Disk hdc latency not available >GuestMonitor-scale_5::DEBUG::2014-07-10 09:03:28,017::vm::676::vm.Vm::(_getDiskStats) vmId=`2386fa8c-f537-495c-ae07-e178171d77f2`::Disk vda stats not available >GuestMonitor-scale_7::DEBUG::2014-07-10 09:03:28,018::vm::676::vm.Vm::(_getDiskStats) vmId=`a766ed65-ac2e-4862-8ff0-0352480cf6f1`::Disk hdc stats not available >GuestMonitor-scale_6::DEBUG::2014-07-10 09:03:28,018::vm::715::vm.Vm::(_getDiskLatency) vmId=`7fc21bb8-bd92-4924-acef-8360998e92a1`::Disk vda latency not available >GuestMonitor-scale_5::DEBUG::2014-07-10 09:03:28,019::vm::715::vm.Vm::(_getDiskLatency) vmId=`2386fa8c-f537-495c-ae07-e178171d77f2`::Disk hdd latency not available >GuestMonitor-scale_7::DEBUG::2014-07-10 09:03:28,021::vm::676::vm.Vm::(_getDiskStats) vmId=`a766ed65-ac2e-4862-8ff0-0352480cf6f1`::Disk vda stats not available >GuestMonitor-scale_5::DEBUG::2014-07-10 09:03:28,022::vm::715::vm.Vm::(_getDiskLatency) vmId=`2386fa8c-f537-495c-ae07-e178171d77f2`::Disk hdc latency not available >GuestMonitor-scale_7::DEBUG::2014-07-10 09:03:28,024::vm::715::vm.Vm::(_getDiskLatency) vmId=`a766ed65-ac2e-4862-8ff0-0352480cf6f1`::Disk hdd latency not available >GuestMonitor-scale_5::DEBUG::2014-07-10 09:03:28,024::vm::715::vm.Vm::(_getDiskLatency) vmId=`2386fa8c-f537-495c-ae07-e178171d77f2`::Disk vda latency not available >GuestMonitor-scale_6::DEBUG::2014-07-10 09:03:28,025::vm::676::vm.Vm::(_getDiskStats) vmId=`7fc21bb8-bd92-4924-acef-8360998e92a1`::Disk hdd stats not available >GuestMonitor-scale_7::DEBUG::2014-07-10 09:03:28,032::vm::715::vm.Vm::(_getDiskLatency) vmId=`a766ed65-ac2e-4862-8ff0-0352480cf6f1`::Disk hdc latency not available >GuestMonitor-scale_6::DEBUG::2014-07-10 09:03:28,037::vm::676::vm.Vm::(_getDiskStats) vmId=`7fc21bb8-bd92-4924-acef-8360998e92a1`::Disk hdc stats not available >GuestMonitor-scale_7::DEBUG::2014-07-10 09:03:28,041::vm::715::vm.Vm::(_getDiskLatency) vmId=`a766ed65-ac2e-4862-8ff0-0352480cf6f1`::Disk vda latency not available >GuestMonitor-scale_5::DEBUG::2014-07-10 09:03:28,046::vm::676::vm.Vm::(_getDiskStats) vmId=`2386fa8c-f537-495c-ae07-e178171d77f2`::Disk hdd stats not available >GuestMonitor-scale_6::DEBUG::2014-07-10 09:03:28,046::vm::676::vm.Vm::(_getDiskStats) vmId=`7fc21bb8-bd92-4924-acef-8360998e92a1`::Disk vda stats not available >GuestMonitor-scale_5::DEBUG::2014-07-10 09:03:28,054::vm::676::vm.Vm::(_getDiskStats) vmId=`2386fa8c-f537-495c-ae07-e178171d77f2`::Disk hdc stats not available >GuestMonitor-scale_6::DEBUG::2014-07-10 09:03:28,056::vm::715::vm.Vm::(_getDiskLatency) vmId=`7fc21bb8-bd92-4924-acef-8360998e92a1`::Disk hdd latency not available >GuestMonitor-scale_5::DEBUG::2014-07-10 09:03:28,061::vm::676::vm.Vm::(_getDiskStats) vmId=`2386fa8c-f537-495c-ae07-e178171d77f2`::Disk vda stats not available >GuestMonitor-scale_6::DEBUG::2014-07-10 09:03:28,062::vm::715::vm.Vm::(_getDiskLatency) vmId=`7fc21bb8-bd92-4924-acef-8360998e92a1`::Disk hdc latency not available >GuestMonitor-scale_5::DEBUG::2014-07-10 09:03:28,068::vm::715::vm.Vm::(_getDiskLatency) vmId=`2386fa8c-f537-495c-ae07-e178171d77f2`::Disk hdd latency not available >GuestMonitor-scale_6::DEBUG::2014-07-10 09:03:28,070::vm::715::vm.Vm::(_getDiskLatency) vmId=`7fc21bb8-bd92-4924-acef-8360998e92a1`::Disk vda latency not available >GuestMonitor-scale_5::DEBUG::2014-07-10 09:03:28,074::vm::715::vm.Vm::(_getDiskLatency) vmId=`2386fa8c-f537-495c-ae07-e178171d77f2`::Disk hdc latency not available >GuestMonitor-scale_5::DEBUG::2014-07-10 09:03:28,078::vm::715::vm.Vm::(_getDiskLatency) vmId=`2386fa8c-f537-495c-ae07-e178171d77f2`::Disk vda latency not available >Dummy-33::DEBUG::2014-07-10 09:03:28,151::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.10861 s, 9.4 MB/s\n'; <rc> = 0 >libvirtEventLoop::DEBUG::2014-07-10 09:03:28,680::vm::5176::vm.Vm::(_onLibvirtLifecycleEvent) vmId=`5d49ebac-3f0d-4688-aed0-b3f5fe364000`::event Started detail 0 opaque None >Thread-68::DEBUG::2014-07-10 09:03:28,716::vm::5032::vm.Vm::(_getUnderlyingDriveInfo) vmId=`5d49ebac-3f0d-4688-aed0-b3f5fe364000`::Looking for drive with attributes {'name': u'hdc', 'bootOrder': '', 'boot': [], 'readonly': True, 'address': {u'bus': u'1', u'controller': u'0', u'type': u'drive', u'target': u'0', u'unit': u'0'}, 'path': '', 'type': u'cdrom'} >Thread-68::DEBUG::2014-07-10 09:03:28,717::vm::5053::vm.Vm::(_getUnderlyingDriveInfo) vmId=`5d49ebac-3f0d-4688-aed0-b3f5fe364000`::Matched {'name': (u'hdc', u'hdc'), 'bootOrder': ('', None), 'boot': ([], None), 'readonly': (True, True), 'address': ({u'bus': u'1', u'controller': u'0', u'type': u'drive', u'target': u'0', u'unit': u'0'}, {u'bus': u'1', u'controller': u'0', u'type': u'drive', u'target': u'0', u'unit': u'0'}), 'path': ('', ''), 'type': (u'cdrom', u'cdrom')} >Thread-68::DEBUG::2014-07-10 09:03:28,717::vm::5072::vm.Vm::(_getUnderlyingDriveInfo) vmId=`5d49ebac-3f0d-4688-aed0-b3f5fe364000`::Matched {'name': (u'hdc', u'hdc'), 'bootOrder': ('', None), 'boot': ([], None), 'readonly': (True, 'True'), 'address': ({u'bus': u'1', u'controller': u'0', u'type': u'drive', u'target': u'0', u'unit': u'0'}, {u'bus': u'1', u'controller': u'0', u'type': u'drive', u'target': u'0', u'unit': u'0'}), 'path': ('', ''), 'type': (u'cdrom', 'disk')} >Thread-68::DEBUG::2014-07-10 09:03:28,717::vm::5032::vm.Vm::(_getUnderlyingDriveInfo) vmId=`5d49ebac-3f0d-4688-aed0-b3f5fe364000`::Looking for drive with attributes {'name': u'hdd', 'bootOrder': '', 'boot': [], 'readonly': True, 'address': {u'bus': u'1', u'controller': u'0', u'type': u'drive', u'target': u'0', u'unit': u'1'}, 'path': u'/var/run/vdsm/payload/5d49ebac-3f0d-4688-aed0-b3f5fe364000.62fcaa2c201f6dc60f46d7fab36affcd.img', 'type': u'cdrom'} >Thread-68::DEBUG::2014-07-10 09:03:28,718::vm::5053::vm.Vm::(_getUnderlyingDriveInfo) vmId=`5d49ebac-3f0d-4688-aed0-b3f5fe364000`::Matched {'name': (u'hdd', u'hdd'), 'bootOrder': ('', None), 'boot': ([], None), 'readonly': (True, True), 'address': ({u'bus': u'1', u'controller': u'0', u'type': u'drive', u'target': u'0', u'unit': u'1'}, {u'bus': u'1', u'controller': u'0', u'type': u'drive', u'target': u'0', u'unit': u'1'}), 'path': (u'/var/run/vdsm/payload/5d49ebac-3f0d-4688-aed0-b3f5fe364000.62fcaa2c201f6dc60f46d7fab36affcd.img', '/var/run/vdsm/payload/5d49ebac-3f0d-4688-aed0-b3f5fe364000.62fcaa2c201f6dc60f46d7fab36affcd.img'), 'type': (u'cdrom', u'cdrom')} >Thread-68::DEBUG::2014-07-10 09:03:28,718::vm::5072::vm.Vm::(_getUnderlyingDriveInfo) vmId=`5d49ebac-3f0d-4688-aed0-b3f5fe364000`::Matched {'name': (u'hdd', u'hdd'), 'bootOrder': ('', None), 'boot': ([], None), 'readonly': (True, 'True'), 'address': ({u'bus': u'1', u'controller': u'0', u'type': u'drive', u'target': u'0', u'unit': u'1'}, {u'bus': u'1', u'controller': u'0', u'type': u'drive', u'target': u'0', u'unit': u'1'}), 'path': (u'/var/run/vdsm/payload/5d49ebac-3f0d-4688-aed0-b3f5fe364000.62fcaa2c201f6dc60f46d7fab36affcd.img', '/var/run/vdsm/payload/5d49ebac-3f0d-4688-aed0-b3f5fe364000.62fcaa2c201f6dc60f46d7fab36affcd.img'), 'type': (u'cdrom', 'disk')} >Thread-68::DEBUG::2014-07-10 09:03:28,718::vm::5032::vm.Vm::(_getUnderlyingDriveInfo) vmId=`5d49ebac-3f0d-4688-aed0-b3f5fe364000`::Looking for drive with attributes {'name': u'vda', 'bootOrder': u'1', 'boot': [<DOM Element: boot at 0x7f61982ebdd0>], 'readonly': False, 'address': {u'slot': u'0x06', u'bus': u'0x00', u'domain': u'0x0000', u'type': u'pci', u'function': u'0x0'}, 'path': u'/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/images/cfaeead2-7caa-467c-b389-c89840ae6605/567fe32d-31a6-4ff6-90f3-fd6a656fbecc', 'type': u'disk'} >Thread-68::DEBUG::2014-07-10 09:03:28,719::vm::5053::vm.Vm::(_getUnderlyingDriveInfo) vmId=`5d49ebac-3f0d-4688-aed0-b3f5fe364000`::Matched {'name': (u'vda', u'vda'), 'bootOrder': (u'1', u'1'), 'boot': ([<DOM Element: boot at 0x7f61982ebdd0>], None), 'readonly': (False, False), 'address': ({u'slot': u'0x06', u'bus': u'0x00', u'domain': u'0x0000', u'type': u'pci', u'function': u'0x0'}, {u'slot': u'0x06', u'bus': u'0x00', u'domain': u'0x0000', u'type': u'pci', u'function': u'0x0'}), 'path': (u'/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/images/cfaeead2-7caa-467c-b389-c89840ae6605/567fe32d-31a6-4ff6-90f3-fd6a656fbecc', '/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/images/cfaeead2-7caa-467c-b389-c89840ae6605/567fe32d-31a6-4ff6-90f3-fd6a656fbecc'), 'type': (u'disk', u'disk')} >Thread-68::DEBUG::2014-07-10 09:03:28,719::vm::5072::vm.Vm::(_getUnderlyingDriveInfo) vmId=`5d49ebac-3f0d-4688-aed0-b3f5fe364000`::Matched {'name': (u'vda', u'vda'), 'bootOrder': (u'1', u'1'), 'boot': ([<DOM Element: boot at 0x7f61982ebdd0>], None), 'readonly': (False, 'False'), 'address': ({u'slot': u'0x06', u'bus': u'0x00', u'domain': u'0x0000', u'type': u'pci', u'function': u'0x0'}, {u'slot': u'0x06', u'bus': u'0x00', u'domain': u'0x0000', u'type': u'pci', u'function': u'0x0'}), 'path': (u'/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/images/cfaeead2-7caa-467c-b389-c89840ae6605/567fe32d-31a6-4ff6-90f3-fd6a656fbecc', '/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/images/cfaeead2-7caa-467c-b389-c89840ae6605/567fe32d-31a6-4ff6-90f3-fd6a656fbecc'), 'type': (u'disk', 'disk')} >Thread-68::DEBUG::2014-07-10 09:03:28,783::sampling::285::vm.Vm::(start) vmId=`5d49ebac-3f0d-4688-aed0-b3f5fe364000`::Start statistics collection >Thread-70::DEBUG::2014-07-10 09:03:28,784::sampling::314::vm.Vm::(run) vmId=`5d49ebac-3f0d-4688-aed0-b3f5fe364000`::Stats thread started >Thread-70::DEBUG::2014-07-10 09:03:28,793::task::595::TaskManager.Task::(_updateState) Task=`7ebf83e0-913c-458e-811c-b057975ca415`::moving from state init -> state preparing >Thread-70::INFO::2014-07-10 09:03:28,793::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='cfaeead2-7caa-467c-b389-c89840ae6605', volUUID='567fe32d-31a6-4ff6-90f3-fd6a656fbecc', options=None) >Thread-70::INFO::2014-07-10 09:03:28,794::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-70::DEBUG::2014-07-10 09:03:28,794::task::1185::TaskManager.Task::(prepare) Task=`7ebf83e0-913c-458e-811c-b057975ca415`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-70::DEBUG::2014-07-10 09:03:28,794::task::595::TaskManager.Task::(_updateState) Task=`7ebf83e0-913c-458e-811c-b057975ca415`::moving from state preparing -> state finished >Thread-70::DEBUG::2014-07-10 09:03:28,795::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-70::DEBUG::2014-07-10 09:03:28,795::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-70::DEBUG::2014-07-10 09:03:28,795::task::990::TaskManager.Task::(_decref) Task=`7ebf83e0-913c-458e-811c-b057975ca415`::ref 0 aborting False >Thread-68::DEBUG::2014-07-10 09:03:28,800::vmChannels::198::vds::(register) Add fileno 70 to listener's channels. >Thread-68::WARNING::2014-07-10 09:03:28,803::vm::3715::vm.Vm::(_readPauseCode) vmId=`5d49ebac-3f0d-4688-aed0-b3f5fe364000`::_readPauseCode unsupported by libvirt vm >Thread-68::DEBUG::2014-07-10 09:03:28,815::vm::2291::vm.Vm::(_startUnderlyingVm) vmId=`5d49ebac-3f0d-4688-aed0-b3f5fe364000`::_ongoingCreations released >Thread-14::DEBUG::2014-07-10 09:03:28,910::BindingXMLRPC::1067::vds::(wrapper) client [10.35.3.13]::call vmGetStats with ('a766ed65-ac2e-4862-8ff0-0352480cf6f1',) {} >Thread-14::DEBUG::2014-07-10 09:03:28,910::vm::676::vm.Vm::(_getDiskStats) vmId=`a766ed65-ac2e-4862-8ff0-0352480cf6f1`::Disk hdd stats not available >Thread-14::DEBUG::2014-07-10 09:03:28,911::vm::676::vm.Vm::(_getDiskStats) vmId=`a766ed65-ac2e-4862-8ff0-0352480cf6f1`::Disk hdc stats not available >Thread-14::DEBUG::2014-07-10 09:03:28,911::vm::676::vm.Vm::(_getDiskStats) vmId=`a766ed65-ac2e-4862-8ff0-0352480cf6f1`::Disk vda stats not available >Thread-14::DEBUG::2014-07-10 09:03:28,911::vm::715::vm.Vm::(_getDiskLatency) vmId=`a766ed65-ac2e-4862-8ff0-0352480cf6f1`::Disk hdd latency not available >Thread-14::DEBUG::2014-07-10 09:03:28,911::vm::715::vm.Vm::(_getDiskLatency) vmId=`a766ed65-ac2e-4862-8ff0-0352480cf6f1`::Disk hdc latency not available >Thread-14::DEBUG::2014-07-10 09:03:28,912::vm::715::vm.Vm::(_getDiskLatency) vmId=`a766ed65-ac2e-4862-8ff0-0352480cf6f1`::Disk vda latency not available >Thread-14::DEBUG::2014-07-10 09:03:28,912::BindingXMLRPC::1074::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Powering up', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '15456', 'displayIp': '0', 'displayPort': u'5912', 'session': 'Unknown', 'displaySecurePort': u'5913', 'timeOffset': '0', 'hash': '1078195817470092527', 'balloonInfo': {'balloon_max': '1048576', 'balloon_target': '1048576', 'balloon_cur': '1048576', 'balloon_min': '1048576'}, 'pauseCode': 'NOERR', 'clientIp': '', 'kvmEnable': 'true', 'network': {u'vnet6': {'macAddr': '00:1a:4a:de:6d:88', 'rxDropped': '0', 'rxErrors': '0', 'txDropped': '0', 'txRate': '0.0', 'rxRate': '0.0', 'txErrors': '0', 'state': 'unknown', 'speed': '1000', 'name': u'vnet6'}}, 'vmId': 'a766ed65-ac2e-4862-8ff0-0352480cf6f1', 'displayType': 'qxl', 'cpuUser': '42.70', 'disks': {u'vda': {'truesize': '1073741824', 'apparentsize': '1073741824', 'imageID': 'f30c2cb7-a43a-4bf5-82b5-cfe07336f65c'}, u'hdd': {'truesize': '0', 'apparentsize': '0'}, u'hdc': {'truesize': '0', 'apparentsize': '0'}}, 'monitorResponse': '0', 'statsAge': '1.27', 'elapsedTime': '22', 'vmType': 'kvm', 'cpuSys': '26.97', 'guestCPUCount': -1, 'appsList': [], 'guestIPs': ''}]} >Thread-14::DEBUG::2014-07-10 09:03:28,916::BindingXMLRPC::1067::vds::(wrapper) client [10.35.3.13]::call vmGetStats with ('7fc21bb8-bd92-4924-acef-8360998e92a1',) {} >Thread-14::DEBUG::2014-07-10 09:03:28,917::vm::676::vm.Vm::(_getDiskStats) vmId=`7fc21bb8-bd92-4924-acef-8360998e92a1`::Disk hdd stats not available >Thread-14::DEBUG::2014-07-10 09:03:28,917::vm::676::vm.Vm::(_getDiskStats) vmId=`7fc21bb8-bd92-4924-acef-8360998e92a1`::Disk hdc stats not available >Thread-14::DEBUG::2014-07-10 09:03:28,917::vm::676::vm.Vm::(_getDiskStats) vmId=`7fc21bb8-bd92-4924-acef-8360998e92a1`::Disk vda stats not available >Thread-14::DEBUG::2014-07-10 09:03:28,918::vm::715::vm.Vm::(_getDiskLatency) vmId=`7fc21bb8-bd92-4924-acef-8360998e92a1`::Disk hdd latency not available >Thread-14::DEBUG::2014-07-10 09:03:28,918::vm::715::vm.Vm::(_getDiskLatency) vmId=`7fc21bb8-bd92-4924-acef-8360998e92a1`::Disk hdc latency not available >Thread-14::DEBUG::2014-07-10 09:03:28,918::vm::715::vm.Vm::(_getDiskLatency) vmId=`7fc21bb8-bd92-4924-acef-8360998e92a1`::Disk vda latency not available >Thread-14::DEBUG::2014-07-10 09:03:28,918::BindingXMLRPC::1074::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Powering up', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '14800', 'displayIp': '0', 'displayPort': u'5910', 'session': 'Unknown', 'displaySecurePort': u'5911', 'timeOffset': '0', 'hash': '-831008492253830849', 'balloonInfo': {'balloon_max': '1048576', 'balloon_target': '1048576', 'balloon_cur': '1048576', 'balloon_min': '1048576'}, 'pauseCode': 'NOERR', 'clientIp': '', 'kvmEnable': 'true', 'network': {u'vnet5': {'macAddr': '00:1a:4a:de:6d:7d', 'rxDropped': '0', 'rxErrors': '0', 'txDropped': '0', 'txRate': '0.0', 'rxRate': '0.0', 'txErrors': '0', 'state': 'unknown', 'speed': '1000', 'name': u'vnet5'}}, 'vmId': '7fc21bb8-bd92-4924-acef-8360998e92a1', 'displayType': 'qxl', 'cpuUser': '34.49', 'disks': {u'vda': {'truesize': '1073741824', 'apparentsize': '1073741824', 'imageID': 'aa20346a-4d3a-4e07-b8e1-52c0ebe4168c'}, u'hdd': {'truesize': '0', 'apparentsize': '0'}, u'hdc': {'truesize': '0', 'apparentsize': '0'}}, 'monitorResponse': '0', 'statsAge': '1.98', 'elapsedTime': '42', 'vmType': 'kvm', 'cpuSys': '4.18', 'guestCPUCount': -1, 'appsList': [], 'guestIPs': ''}]} >Thread-14::DEBUG::2014-07-10 09:03:28,923::BindingXMLRPC::1067::vds::(wrapper) client [10.35.3.13]::call vmGetStats with ('5d49ebac-3f0d-4688-aed0-b3f5fe364000',) {} >Thread-14::DEBUG::2014-07-10 09:03:28,923::vm::598::vm.Vm::(_getCpuStats) vmId=`5d49ebac-3f0d-4688-aed0-b3f5fe364000`::CPU stats not available: 'NoneType' object is unsubscriptable >Thread-14::DEBUG::2014-07-10 09:03:28,923::vm::654::vm.Vm::(_getNetworkStats) vmId=`5d49ebac-3f0d-4688-aed0-b3f5fe364000`::Network stats not available >Thread-14::DEBUG::2014-07-10 09:03:28,923::vm::676::vm.Vm::(_getDiskStats) vmId=`5d49ebac-3f0d-4688-aed0-b3f5fe364000`::Disk hdd stats not available >Thread-14::DEBUG::2014-07-10 09:03:28,923::vm::676::vm.Vm::(_getDiskStats) vmId=`5d49ebac-3f0d-4688-aed0-b3f5fe364000`::Disk hdc stats not available >Thread-14::DEBUG::2014-07-10 09:03:28,924::vm::676::vm.Vm::(_getDiskStats) vmId=`5d49ebac-3f0d-4688-aed0-b3f5fe364000`::Disk vda stats not available >Thread-14::DEBUG::2014-07-10 09:03:28,924::vm::715::vm.Vm::(_getDiskLatency) vmId=`5d49ebac-3f0d-4688-aed0-b3f5fe364000`::Disk hdd latency not available >Thread-14::DEBUG::2014-07-10 09:03:28,924::vm::715::vm.Vm::(_getDiskLatency) vmId=`5d49ebac-3f0d-4688-aed0-b3f5fe364000`::Disk hdc latency not available >Thread-14::DEBUG::2014-07-10 09:03:28,924::vm::715::vm.Vm::(_getDiskLatency) vmId=`5d49ebac-3f0d-4688-aed0-b3f5fe364000`::Disk vda latency not available >Thread-14::DEBUG::2014-07-10 09:03:28,925::BindingXMLRPC::1074::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Powering up', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '16122', 'displayIp': '0', 'displayPort': u'5914', 'session': 'Unknown', 'displaySecurePort': u'5915', 'timeOffset': '0', 'hash': '8384665493346130205', 'balloonInfo': {'balloon_max': '1048576', 'balloon_target': '1048576', 'balloon_cur': '0', 'balloon_min': '1048576'}, 'pauseCode': 'NOERR', 'clientIp': '', 'kvmEnable': 'true', 'network': {u'vnet7': {'state': 'unknown', 'macAddr': '00:1a:4a:de:6d:89', 'speed': '1000', 'name': u'vnet7'}}, 'vmId': '5d49ebac-3f0d-4688-aed0-b3f5fe364000', 'displayType': 'qxl', 'cpuUser': '0.00', 'disks': {u'vda': {'truesize': '1073741824', 'apparentsize': '1073741824', 'imageID': 'cfaeead2-7caa-467c-b389-c89840ae6605'}, u'hdd': {'truesize': '0', 'apparentsize': '0'}, u'hdc': {'truesize': '0', 'apparentsize': '0'}}, 'monitorResponse': '0', 'statsAge': '0.14', 'elapsedTime': '2', 'vmType': 'kvm', 'cpuSys': '0.00', 'guestCPUCount': -1, 'appsList': [], 'guestIPs': ''}]} >VM Channels Listener::DEBUG::2014-07-10 09:03:29,273::vmChannels::106::vds::(_do_add_channels) fileno 70 was added to unconnected channels. >VM Channels Listener::DEBUG::2014-07-10 09:03:29,273::vmChannels::132::vds::(_handle_unconnected) Trying to connect fileno 70. >VM Channels Listener::DEBUG::2014-07-10 09:03:29,273::guestIF::194::vm.Vm::(_connect) vmId=`5d49ebac-3f0d-4688-aed0-b3f5fe364000`::Attempting connection to /var/lib/libvirt/qemu/channels/5d49ebac-3f0d-4688-aed0-b3f5fe364000.com.redhat.rhevm.vdsm >VM Channels Listener::DEBUG::2014-07-10 09:03:29,274::guestIF::197::vm.Vm::(_connect) vmId=`5d49ebac-3f0d-4688-aed0-b3f5fe364000`::Connected to /var/lib/libvirt/qemu/channels/5d49ebac-3f0d-4688-aed0-b3f5fe364000.com.redhat.rhevm.vdsm >VM Channels Listener::DEBUG::2014-07-10 09:03:29,274::vmChannels::148::vds::(_handle_unconnected) Connecting to fileno 70 succeeded. >Thread-60::DEBUG::2014-07-10 09:03:29,473::task::595::TaskManager.Task::(_updateState) Task=`e3b54fbc-27c7-4dea-a3bc-5110d9193a79`::moving from state init -> state preparing >Thread-60::INFO::2014-07-10 09:03:29,474::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='b034d5b0-e1e0-4011-b49b-4d45ddb11556', volUUID='3d7f62b5-328f-4d8e-8b69-873cfb5ae14d', options=None) >Thread-60::INFO::2014-07-10 09:03:29,474::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-60::DEBUG::2014-07-10 09:03:29,474::task::1185::TaskManager.Task::(prepare) Task=`e3b54fbc-27c7-4dea-a3bc-5110d9193a79`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-60::DEBUG::2014-07-10 09:03:29,475::task::595::TaskManager.Task::(_updateState) Task=`e3b54fbc-27c7-4dea-a3bc-5110d9193a79`::moving from state preparing -> state finished >Thread-60::DEBUG::2014-07-10 09:03:29,475::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-60::DEBUG::2014-07-10 09:03:29,475::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-60::DEBUG::2014-07-10 09:03:29,475::task::990::TaskManager.Task::(_decref) Task=`e3b54fbc-27c7-4dea-a3bc-5110d9193a79`::ref 0 aborting False >Thread-34::DEBUG::2014-07-10 09:03:29,791::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [2e5379cf] >Thread-34::DEBUG::2014-07-10 09:03:29,792::task::595::TaskManager.Task::(_updateState) Task=`a7c00320-f8fd-4896-b42d-77dfb009c02a`::moving from state init -> state preparing >Thread-34::INFO::2014-07-10 09:03:29,793::logUtils::44::dispatcher::(wrapper) Run and protect: createVolume(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='c01d693b-cba0-4fed-9ad7-0aaa28912a19', size='10737418240', volFormat=4, preallocate=2, diskType=2, volUUID='4bb5d954-2a50-4028-b299-0b43c261270c', desc='', srcImgUUID='9cf413b7-7f14-4a61-8c71-913e5b0ea9c0', srcVolUUID='47592965-e853-4e59-9728-d11cca6a7a8a') >Thread-34::DEBUG::2014-07-10 09:03:29,794::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.9e1aa540-1f4e-4ee3-a152-be381ef6c3bd`ReqID=`5d6bc068-424c-4b36-a48d-879ab7eb1bfc`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '1464' at 'createVolume' >Thread-34::DEBUG::2014-07-10 09:03:29,794::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.9e1aa540-1f4e-4ee3-a152-be381ef6c3bd' for lock type 'shared' >Thread-34::DEBUG::2014-07-10 09:03:29,794::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.9e1aa540-1f4e-4ee3-a152-be381ef6c3bd' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-10 09:03:29,795::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.9e1aa540-1f4e-4ee3-a152-be381ef6c3bd`ReqID=`5d6bc068-424c-4b36-a48d-879ab7eb1bfc`::Granted request >Thread-34::DEBUG::2014-07-10 09:03:29,795::task::827::TaskManager.Task::(resourceAcquired) Task=`a7c00320-f8fd-4896-b42d-77dfb009c02a`::_resourcesAcquired: Storage.9e1aa540-1f4e-4ee3-a152-be381ef6c3bd (shared) >Thread-34::DEBUG::2014-07-10 09:03:29,795::task::990::TaskManager.Task::(_decref) Task=`a7c00320-f8fd-4896-b42d-77dfb009c02a`::ref 1 aborting False >Thread-34::DEBUG::2014-07-10 09:03:29,797::task::752::TaskManager.Task::(_save) Task=`a7c00320-f8fd-4896-b42d-77dfb009c02a`::_save: orig /rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/master/tasks/a7c00320-f8fd-4896-b42d-77dfb009c02a temp /rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/master/tasks/a7c00320-f8fd-4896-b42d-77dfb009c02a.temp >Thread-34::DEBUG::2014-07-10 09:03:29,804::taskManager::68::TaskManager::(scheduleJob) scheduled job createVolume for task a7c00320-f8fd-4896-b42d-77dfb009c02a >Thread-34::INFO::2014-07-10 09:03:29,805::logUtils::47::dispatcher::(wrapper) Run and protect: createVolume, Return response: None >Thread-34::DEBUG::2014-07-10 09:03:29,805::task::1180::TaskManager.Task::(prepare) Task=`a7c00320-f8fd-4896-b42d-77dfb009c02a`::Prepare: 1 jobs exist, move to acquiring >Thread-34::DEBUG::2014-07-10 09:03:29,805::task::595::TaskManager.Task::(_updateState) Task=`a7c00320-f8fd-4896-b42d-77dfb009c02a`::moving from state preparing -> state acquiring >Thread-34::DEBUG::2014-07-10 09:03:29,805::task::752::TaskManager.Task::(_save) Task=`a7c00320-f8fd-4896-b42d-77dfb009c02a`::_save: orig /rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/master/tasks/a7c00320-f8fd-4896-b42d-77dfb009c02a temp /rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/master/tasks/a7c00320-f8fd-4896-b42d-77dfb009c02a.temp >Thread-34::DEBUG::2014-07-10 09:03:29,811::task::595::TaskManager.Task::(_updateState) Task=`a7c00320-f8fd-4896-b42d-77dfb009c02a`::moving from state acquiring -> state queued >Thread-34::DEBUG::2014-07-10 09:03:29,811::task::752::TaskManager.Task::(_save) Task=`a7c00320-f8fd-4896-b42d-77dfb009c02a`::_save: orig /rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/master/tasks/a7c00320-f8fd-4896-b42d-77dfb009c02a temp /rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/master/tasks/a7c00320-f8fd-4896-b42d-77dfb009c02a.temp >Thread-34::DEBUG::2014-07-10 09:03:29,817::taskManager::50::TaskManager::(_queueTask) queuing task: a7c00320-f8fd-4896-b42d-77dfb009c02a >Thread-34::DEBUG::2014-07-10 09:03:29,818::taskManager::56::TaskManager::(_queueTask) task queued: a7c00320-f8fd-4896-b42d-77dfb009c02a >2a0f4c11-f90d-4c78-a996-83fad5f8814f::DEBUG::2014-07-10 09:03:29,818::threadPool::57::Misc.ThreadPool::(setRunningTask) Number of running tasks: 1 >Thread-34::DEBUG::2014-07-10 09:03:29,818::task::1182::TaskManager.Task::(prepare) Task=`a7c00320-f8fd-4896-b42d-77dfb009c02a`::returning >a7c00320-f8fd-4896-b42d-77dfb009c02a::DEBUG::2014-07-10 09:03:29,819::threadPool::200::Misc.ThreadPool.WorkerThread::(_processNextTask) Task: a7c00320-f8fd-4896-b42d-77dfb009c02a running: <bound method Task.commit of <storage.task.Task instance at 0x28fed40>> with: None >Thread-34::DEBUG::2014-07-10 09:03:29,819::task::990::TaskManager.Task::(_decref) Task=`a7c00320-f8fd-4896-b42d-77dfb009c02a`::ref 0 aborting False >a7c00320-f8fd-4896-b42d-77dfb009c02a::DEBUG::2014-07-10 09:03:29,820::task::1194::TaskManager.Task::(commit) Task=`a7c00320-f8fd-4896-b42d-77dfb009c02a`::committing task: a7c00320-f8fd-4896-b42d-77dfb009c02a >a7c00320-f8fd-4896-b42d-77dfb009c02a::DEBUG::2014-07-10 09:03:29,820::task::595::TaskManager.Task::(_updateState) Task=`a7c00320-f8fd-4896-b42d-77dfb009c02a`::moving from state queued -> state running >a7c00320-f8fd-4896-b42d-77dfb009c02a::DEBUG::2014-07-10 09:03:29,821::task::752::TaskManager.Task::(_save) Task=`a7c00320-f8fd-4896-b42d-77dfb009c02a`::_save: orig /rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/master/tasks/a7c00320-f8fd-4896-b42d-77dfb009c02a temp /rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/master/tasks/a7c00320-f8fd-4896-b42d-77dfb009c02a.temp >a7c00320-f8fd-4896-b42d-77dfb009c02a::DEBUG::2014-07-10 09:03:29,827::task::905::TaskManager.Task::(_runJobs) Task=`a7c00320-f8fd-4896-b42d-77dfb009c02a`::Task.run: running job 0: createVolume: <bound method StoragePool.createVolume of <storage.sp.StoragePool object at 0x7f62180b9dd0>> (args: ('9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'c01d693b-cba0-4fed-9ad7-0aaa28912a19', 20971520, 4, 2, 2, '4bb5d954-2a50-4028-b299-0b43c261270c', '', '9cf413b7-7f14-4a61-8c71-913e5b0ea9c0', '47592965-e853-4e59-9728-d11cca6a7a8a') kwargs: {}) >a7c00320-f8fd-4896-b42d-77dfb009c02a::DEBUG::2014-07-10 09:03:29,827::task::331::TaskManager.Task::(run) Task=`a7c00320-f8fd-4896-b42d-77dfb009c02a`::Job.run: running createVolume: <bound method StoragePool.createVolume of <storage.sp.StoragePool object at 0x7f62180b9dd0>> (args: ('9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'c01d693b-cba0-4fed-9ad7-0aaa28912a19', 20971520, 4, 2, 2, '4bb5d954-2a50-4028-b299-0b43c261270c', '', '9cf413b7-7f14-4a61-8c71-913e5b0ea9c0', '47592965-e853-4e59-9728-d11cca6a7a8a') kwargs: {}) callback None >a7c00320-f8fd-4896-b42d-77dfb009c02a::DEBUG::2014-07-10 09:03:29,828::blockVolume::572::Storage.Misc.excCmd::(getMetadata) '/bin/dd iflag=direct skip=4 bs=512 if=/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/metadata count=1' (cwd None) >a7c00320-f8fd-4896-b42d-77dfb009c02a::DEBUG::2014-07-10 09:03:29,847::blockVolume::572::Storage.Misc.excCmd::(getMetadata) SUCCESS: <err> = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.000568594 s, 900 kB/s\n'; <rc> = 0 >a7c00320-f8fd-4896-b42d-77dfb009c02a::DEBUG::2014-07-10 09:03:29,848::misc::282::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.000568594 s, 900 kB/s'], size: 512 >a7c00320-f8fd-4896-b42d-77dfb009c02a::DEBUG::2014-07-10 09:03:29,848::resourceManager::198::ResourceManager.Request::(__init__) ResName=`9e1aa540-1f4e-4ee3-a152-be381ef6c3bd_imageNS.c01d693b-cba0-4fed-9ad7-0aaa28912a19`ReqID=`7856e2c9-34d4-49f2-88e1-d32b08d375b6`::Request was made in '/usr/share/vdsm/storage/sp.py' line '1767' at 'createVolume' >a7c00320-f8fd-4896-b42d-77dfb009c02a::DEBUG::2014-07-10 09:03:29,849::resourceManager::542::ResourceManager::(registerResource) Trying to register resource '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd_imageNS.c01d693b-cba0-4fed-9ad7-0aaa28912a19' for lock type 'exclusive' >a7c00320-f8fd-4896-b42d-77dfb009c02a::DEBUG::2014-07-10 09:03:29,850::lvm::427::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' got the operation mutex >a7c00320-f8fd-4896-b42d-77dfb009c02a::DEBUG::2014-07-10 09:03:29,850::lvm::296::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm lvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/3600601601282300032826addbbdae311|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,vg_name,attr,size,seg_start_pe,devices,tags 9e1aa540-1f4e-4ee3-a152-be381ef6c3bd' (cwd None) >a7c00320-f8fd-4896-b42d-77dfb009c02a::DEBUG::2014-07-10 09:03:30,105::lvm::296::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >a7c00320-f8fd-4896-b42d-77dfb009c02a::DEBUG::2014-07-10 09:03:30,121::lvm::462::Storage.LVM::(_reloadlvs) lvs reloaded >a7c00320-f8fd-4896-b42d-77dfb009c02a::DEBUG::2014-07-10 09:03:30,121::lvm::462::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' released the operation mutex >a7c00320-f8fd-4896-b42d-77dfb009c02a::DEBUG::2014-07-10 09:03:30,122::resourceFactories::125::Storage.ResourcesFactories::(__getResourceCandidatesList) Image c01d693b-cba0-4fed-9ad7-0aaa28912a19 does not exist in domain 9e1aa540-1f4e-4ee3-a152-be381ef6c3bd >a7c00320-f8fd-4896-b42d-77dfb009c02a::DEBUG::2014-07-10 09:03:30,122::resourceManager::601::ResourceManager::(registerResource) Resource '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd_imageNS.c01d693b-cba0-4fed-9ad7-0aaa28912a19' is free. Now locking as 'exclusive' (1 active user) >a7c00320-f8fd-4896-b42d-77dfb009c02a::DEBUG::2014-07-10 09:03:30,122::resourceManager::238::ResourceManager.Request::(grant) ResName=`9e1aa540-1f4e-4ee3-a152-be381ef6c3bd_imageNS.c01d693b-cba0-4fed-9ad7-0aaa28912a19`ReqID=`7856e2c9-34d4-49f2-88e1-d32b08d375b6`::Granted request >a7c00320-f8fd-4896-b42d-77dfb009c02a::INFO::2014-07-10 09:03:30,123::image::123::Storage.Image::(create) Create placeholder /rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/images/c01d693b-cba0-4fed-9ad7-0aaa28912a19 for image's volumes >a7c00320-f8fd-4896-b42d-77dfb009c02a::DEBUG::2014-07-10 09:03:30,124::task::752::TaskManager.Task::(_save) Task=`a7c00320-f8fd-4896-b42d-77dfb009c02a`::_save: orig /rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/master/tasks/a7c00320-f8fd-4896-b42d-77dfb009c02a temp /rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/master/tasks/a7c00320-f8fd-4896-b42d-77dfb009c02a.temp >a7c00320-f8fd-4896-b42d-77dfb009c02a::DEBUG::2014-07-10 09:03:30,133::blockVolume::572::Storage.Misc.excCmd::(getMetadata) '/bin/dd iflag=direct skip=4 bs=512 if=/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/metadata count=1' (cwd None) >a7c00320-f8fd-4896-b42d-77dfb009c02a::DEBUG::2014-07-10 09:03:30,151::blockVolume::572::Storage.Misc.excCmd::(getMetadata) SUCCESS: <err> = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.000699677 s, 732 kB/s\n'; <rc> = 0 >a7c00320-f8fd-4896-b42d-77dfb009c02a::DEBUG::2014-07-10 09:03:30,152::misc::282::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.000699677 s, 732 kB/s'], size: 512 >a7c00320-f8fd-4896-b42d-77dfb009c02a::DEBUG::2014-07-10 09:03:30,152::volume::300::Storage.Volume::(share) Share volume 47592965-e853-4e59-9728-d11cca6a7a8a to /rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/images/c01d693b-cba0-4fed-9ad7-0aaa28912a19 >a7c00320-f8fd-4896-b42d-77dfb009c02a::DEBUG::2014-07-10 09:03:30,152::blockVolume::572::Storage.Misc.excCmd::(getMetadata) '/bin/dd iflag=direct skip=4 bs=512 if=/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/metadata count=1' (cwd None) >a7c00320-f8fd-4896-b42d-77dfb009c02a::DEBUG::2014-07-10 09:03:30,168::blockVolume::572::Storage.Misc.excCmd::(getMetadata) SUCCESS: <err> = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.000450717 s, 1.1 MB/s\n'; <rc> = 0 >a7c00320-f8fd-4896-b42d-77dfb009c02a::DEBUG::2014-07-10 09:03:30,171::misc::282::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.000450717 s, 1.1 MB/s'], size: 512 >Dummy-33::DEBUG::2014-07-10 09:03:30,171::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Thread-51::DEBUG::2014-07-10 09:03:30,211::task::595::TaskManager.Task::(_updateState) Task=`5144f663-a63a-4f6a-a853-973167197e86`::moving from state init -> state preparing >a7c00320-f8fd-4896-b42d-77dfb009c02a::DEBUG::2014-07-10 09:03:30,221::task::752::TaskManager.Task::(_save) Task=`a7c00320-f8fd-4896-b42d-77dfb009c02a`::_save: orig /rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/master/tasks/a7c00320-f8fd-4896-b42d-77dfb009c02a temp /rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/master/tasks/a7c00320-f8fd-4896-b42d-77dfb009c02a.temp >Thread-51::INFO::2014-07-10 09:03:30,224::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='76fdb054-02cd-42ed-9721-b3e65b34c3a4', volUUID='022dfe46-2cf7-4915-80b3-883158e3ca83', options=None) >Thread-51::INFO::2014-07-10 09:03:30,238::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-51::DEBUG::2014-07-10 09:03:30,246::task::1185::TaskManager.Task::(prepare) Task=`5144f663-a63a-4f6a-a853-973167197e86`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-51::DEBUG::2014-07-10 09:03:30,255::task::595::TaskManager.Task::(_updateState) Task=`5144f663-a63a-4f6a-a853-973167197e86`::moving from state preparing -> state finished >Thread-51::DEBUG::2014-07-10 09:03:30,265::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-51::DEBUG::2014-07-10 09:03:30,273::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-51::DEBUG::2014-07-10 09:03:30,281::task::990::TaskManager.Task::(_decref) Task=`5144f663-a63a-4f6a-a853-973167197e86`::ref 0 aborting False >a7c00320-f8fd-4896-b42d-77dfb009c02a::DEBUG::2014-07-10 09:03:30,367::blockVolume::353::Storage.Volume::(_share) Share volume 47592965-e853-4e59-9728-d11cca6a7a8a to /rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/images/c01d693b-cba0-4fed-9ad7-0aaa28912a19 >a7c00320-f8fd-4896-b42d-77dfb009c02a::DEBUG::2014-07-10 09:03:30,388::blockVolume::572::Storage.Misc.excCmd::(getMetadata) '/bin/dd iflag=direct skip=4 bs=512 if=/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/metadata count=1' (cwd None) >a7c00320-f8fd-4896-b42d-77dfb009c02a::DEBUG::2014-07-10 09:03:30,438::blockVolume::572::Storage.Misc.excCmd::(getMetadata) SUCCESS: <err> = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.000506218 s, 1.0 MB/s\n'; <rc> = 0 >a7c00320-f8fd-4896-b42d-77dfb009c02a::DEBUG::2014-07-10 09:03:30,439::misc::282::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.000506218 s, 1.0 MB/s'], size: 512 >a7c00320-f8fd-4896-b42d-77dfb009c02a::INFO::2014-07-10 09:03:30,440::volume::443::Storage.Volume::(create) Creating volume 4bb5d954-2a50-4028-b299-0b43c261270c >a7c00320-f8fd-4896-b42d-77dfb009c02a::DEBUG::2014-07-10 09:03:30,444::task::752::TaskManager.Task::(_save) Task=`a7c00320-f8fd-4896-b42d-77dfb009c02a`::_save: orig /rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/master/tasks/a7c00320-f8fd-4896-b42d-77dfb009c02a temp /rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/master/tasks/a7c00320-f8fd-4896-b42d-77dfb009c02a.temp >a7c00320-f8fd-4896-b42d-77dfb009c02a::DEBUG::2014-07-10 09:03:30,474::task::752::TaskManager.Task::(_save) Task=`a7c00320-f8fd-4896-b42d-77dfb009c02a`::_save: orig /rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/master/tasks/a7c00320-f8fd-4896-b42d-77dfb009c02a temp /rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/master/tasks/a7c00320-f8fd-4896-b42d-77dfb009c02a.temp >a7c00320-f8fd-4896-b42d-77dfb009c02a::DEBUG::2014-07-10 09:03:30,509::lvm::296::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm lvcreate --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/3600601601282300032826addbbdae311|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } " --autobackup n --contiguous n --size 1024m --addtag OVIRT_VOL_INITIALIZING --name 4bb5d954-2a50-4028-b299-0b43c261270c 9e1aa540-1f4e-4ee3-a152-be381ef6c3bd' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:03:30,573::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.342705 s, 3.0 MB/s\n'; <rc> = 0 >a7c00320-f8fd-4896-b42d-77dfb009c02a::DEBUG::2014-07-10 09:03:31,084::lvm::296::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ' WARNING: This metadata update is NOT backed up\n WARNING: This metadata update is NOT backed up\n'; <rc> = 0 >a7c00320-f8fd-4896-b42d-77dfb009c02a::DEBUG::2014-07-10 09:03:31,084::lvm::503::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >a7c00320-f8fd-4896-b42d-77dfb009c02a::DEBUG::2014-07-10 09:03:31,085::lvm::505::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >a7c00320-f8fd-4896-b42d-77dfb009c02a::DEBUG::2014-07-10 09:03:31,085::lvm::513::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >a7c00320-f8fd-4896-b42d-77dfb009c02a::DEBUG::2014-07-10 09:03:31,085::lvm::525::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >a7c00320-f8fd-4896-b42d-77dfb009c02a::WARNING::2014-07-10 09:03:31,086::utils::129::root::(rmFile) File: /rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/images/c01d693b-cba0-4fed-9ad7-0aaa28912a19/4bb5d954-2a50-4028-b299-0b43c261270c already removed >a7c00320-f8fd-4896-b42d-77dfb009c02a::INFO::2014-07-10 09:03:31,086::blockVolume::169::Storage.Volume::(_create) Request to create snapshot c01d693b-cba0-4fed-9ad7-0aaa28912a19/4bb5d954-2a50-4028-b299-0b43c261270c of volume 9cf413b7-7f14-4a61-8c71-913e5b0ea9c0/47592965-e853-4e59-9728-d11cca6a7a8a >a7c00320-f8fd-4896-b42d-77dfb009c02a::DEBUG::2014-07-10 09:03:31,087::task::752::TaskManager.Task::(_save) Task=`a7c00320-f8fd-4896-b42d-77dfb009c02a`::_save: orig /rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/master/tasks/a7c00320-f8fd-4896-b42d-77dfb009c02a temp /rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/master/tasks/a7c00320-f8fd-4896-b42d-77dfb009c02a.temp >a7c00320-f8fd-4896-b42d-77dfb009c02a::DEBUG::2014-07-10 09:03:31,099::blockVolume::572::Storage.Misc.excCmd::(getMetadata) '/bin/dd iflag=direct skip=4 bs=512 if=/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/metadata count=1' (cwd None) >a7c00320-f8fd-4896-b42d-77dfb009c02a::DEBUG::2014-07-10 09:03:31,119::blockVolume::572::Storage.Misc.excCmd::(getMetadata) SUCCESS: <err> = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.000520362 s, 984 kB/s\n'; <rc> = 0 >a7c00320-f8fd-4896-b42d-77dfb009c02a::DEBUG::2014-07-10 09:03:31,120::misc::282::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.000520362 s, 984 kB/s'], size: 512 >a7c00320-f8fd-4896-b42d-77dfb009c02a::INFO::2014-07-10 09:03:31,120::volume::789::Storage.Volume::(prepare) Volume: preparing volume 9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/47592965-e853-4e59-9728-d11cca6a7a8a >a7c00320-f8fd-4896-b42d-77dfb009c02a::DEBUG::2014-07-10 09:03:31,120::blockVolume::572::Storage.Misc.excCmd::(getMetadata) '/bin/dd iflag=direct skip=4 bs=512 if=/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/metadata count=1' (cwd None) >a7c00320-f8fd-4896-b42d-77dfb009c02a::DEBUG::2014-07-10 09:03:31,136::blockVolume::572::Storage.Misc.excCmd::(getMetadata) SUCCESS: <err> = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.000404306 s, 1.3 MB/s\n'; <rc> = 0 >a7c00320-f8fd-4896-b42d-77dfb009c02a::DEBUG::2014-07-10 09:03:31,136::misc::282::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.000404306 s, 1.3 MB/s'], size: 512 >a7c00320-f8fd-4896-b42d-77dfb009c02a::DEBUG::2014-07-10 09:03:31,138::resourceManager::198::ResourceManager.Request::(__init__) ResName=`9e1aa540-1f4e-4ee3-a152-be381ef6c3bd_lvmActivationNS.47592965-e853-4e59-9728-d11cca6a7a8a`ReqID=`11e80ccd-d777-469a-ba55-4502a098f358`::Request was made in '/usr/share/vdsm/storage/volume.py' line '806' at 'prepare' >a7c00320-f8fd-4896-b42d-77dfb009c02a::DEBUG::2014-07-10 09:03:31,138::resourceManager::542::ResourceManager::(registerResource) Trying to register resource '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd_lvmActivationNS.47592965-e853-4e59-9728-d11cca6a7a8a' for lock type 'shared' >a7c00320-f8fd-4896-b42d-77dfb009c02a::DEBUG::2014-07-10 09:03:31,138::resourceManager::601::ResourceManager::(registerResource) Resource '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd_lvmActivationNS.47592965-e853-4e59-9728-d11cca6a7a8a' is free. Now locking as 'shared' (1 active user) >a7c00320-f8fd-4896-b42d-77dfb009c02a::DEBUG::2014-07-10 09:03:31,139::resourceManager::238::ResourceManager.Request::(grant) ResName=`9e1aa540-1f4e-4ee3-a152-be381ef6c3bd_lvmActivationNS.47592965-e853-4e59-9728-d11cca6a7a8a`ReqID=`11e80ccd-d777-469a-ba55-4502a098f358`::Granted request >a7c00320-f8fd-4896-b42d-77dfb009c02a::DEBUG::2014-07-10 09:03:31,139::blockVolume::572::Storage.Misc.excCmd::(getMetadata) '/bin/dd iflag=direct skip=4 bs=512 if=/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/metadata count=1' (cwd None) >a7c00320-f8fd-4896-b42d-77dfb009c02a::DEBUG::2014-07-10 09:03:31,155::blockVolume::572::Storage.Misc.excCmd::(getMetadata) SUCCESS: <err> = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.000663958 s, 771 kB/s\n'; <rc> = 0 >a7c00320-f8fd-4896-b42d-77dfb009c02a::DEBUG::2014-07-10 09:03:31,156::misc::282::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.000663958 s, 771 kB/s'], size: 512 >a7c00320-f8fd-4896-b42d-77dfb009c02a::DEBUG::2014-07-10 09:03:31,157::volume::270::Storage.Volume::(clone) Volume.clone: /rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/images/c01d693b-cba0-4fed-9ad7-0aaa28912a19/47592965-e853-4e59-9728-d11cca6a7a8a to /rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/images/c01d693b-cba0-4fed-9ad7-0aaa28912a19/4bb5d954-2a50-4028-b299-0b43c261270c >a7c00320-f8fd-4896-b42d-77dfb009c02a::DEBUG::2014-07-10 09:03:31,157::blockVolume::572::Storage.Misc.excCmd::(getMetadata) '/bin/dd iflag=direct skip=4 bs=512 if=/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/metadata count=1' (cwd None) >a7c00320-f8fd-4896-b42d-77dfb009c02a::DEBUG::2014-07-10 09:03:31,171::blockVolume::572::Storage.Misc.excCmd::(getMetadata) SUCCESS: <err> = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.000463406 s, 1.1 MB/s\n'; <rc> = 0 >a7c00320-f8fd-4896-b42d-77dfb009c02a::DEBUG::2014-07-10 09:03:31,171::misc::282::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.000463406 s, 1.1 MB/s'], size: 512 >a7c00320-f8fd-4896-b42d-77dfb009c02a::DEBUG::2014-07-10 09:03:31,172::blockVolume::572::Storage.Misc.excCmd::(getMetadata) '/bin/dd iflag=direct skip=4 bs=512 if=/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/metadata count=1' (cwd None) >a7c00320-f8fd-4896-b42d-77dfb009c02a::DEBUG::2014-07-10 09:03:31,188::blockVolume::572::Storage.Misc.excCmd::(getMetadata) SUCCESS: <err> = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.000625336 s, 819 kB/s\n'; <rc> = 0 >a7c00320-f8fd-4896-b42d-77dfb009c02a::DEBUG::2014-07-10 09:03:31,189::misc::282::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.000625336 s, 819 kB/s'], size: 512 >a7c00320-f8fd-4896-b42d-77dfb009c02a::DEBUG::2014-07-10 09:03:31,189::volume::1042::Storage.Misc.excCmd::(createVolume) '/usr/bin/qemu-img create -f qcow2 -F raw -b ../c01d693b-cba0-4fed-9ad7-0aaa28912a19/47592965-e853-4e59-9728-d11cca6a7a8a /rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/images/c01d693b-cba0-4fed-9ad7-0aaa28912a19/4bb5d954-2a50-4028-b299-0b43c261270c' (cwd /rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/images/c01d693b-cba0-4fed-9ad7-0aaa28912a19) >a7c00320-f8fd-4896-b42d-77dfb009c02a::DEBUG::2014-07-10 09:03:31,261::volume::1042::Storage.Misc.excCmd::(createVolume) SUCCESS: <err> = ''; <rc> = 0 >a7c00320-f8fd-4896-b42d-77dfb009c02a::INFO::2014-07-10 09:03:31,262::blockVolume::393::Storage.Volume::(teardown) Tearing down volume 9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/47592965-e853-4e59-9728-d11cca6a7a8a justme False >a7c00320-f8fd-4896-b42d-77dfb009c02a::DEBUG::2014-07-10 09:03:31,262::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd_lvmActivationNS.47592965-e853-4e59-9728-d11cca6a7a8a' >a7c00320-f8fd-4896-b42d-77dfb009c02a::DEBUG::2014-07-10 09:03:31,262::resourceManager::635::ResourceManager::(releaseResource) Released resource '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd_lvmActivationNS.47592965-e853-4e59-9728-d11cca6a7a8a' (0 active users) >a7c00320-f8fd-4896-b42d-77dfb009c02a::DEBUG::2014-07-10 09:03:31,262::resourceManager::641::ResourceManager::(releaseResource) Resource '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd_lvmActivationNS.47592965-e853-4e59-9728-d11cca6a7a8a' is free, finding out if anyone is waiting for it. >a7c00320-f8fd-4896-b42d-77dfb009c02a::DEBUG::2014-07-10 09:03:31,263::lvm::296::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm lvchange --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/3600601601282300032826addbbdae311|/dev/mapper/360060160f4a030003840ec867ddee311|/dev/mapper/367cad74c2fcba00019e6afd20c781e67|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } " --autobackup n --available n 9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/47592965-e853-4e59-9728-d11cca6a7a8a' (cwd None) >Thread-14::DEBUG::2014-07-10 09:03:32,029::task::595::TaskManager.Task::(_updateState) Task=`07f43b11-ce9b-4eb0-8999-d96e2fae475c`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 09:03:32,030::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::INFO::2014-07-10 09:03:32,031::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000591304', 'lastCheck': '4.4', 'valid': True}, '6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000372784', 'lastCheck': '7.4', 'valid': True}} >Thread-14::DEBUG::2014-07-10 09:03:32,031::task::1185::TaskManager.Task::(prepare) Task=`07f43b11-ce9b-4eb0-8999-d96e2fae475c`::finished: {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000591304', 'lastCheck': '4.4', 'valid': True}, '6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000372784', 'lastCheck': '7.4', 'valid': True}} >Thread-14::DEBUG::2014-07-10 09:03:32,031::task::595::TaskManager.Task::(_updateState) Task=`07f43b11-ce9b-4eb0-8999-d96e2fae475c`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 09:03:32,031::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 09:03:32,032::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 09:03:32,032::task::990::TaskManager.Task::(_decref) Task=`07f43b11-ce9b-4eb0-8999-d96e2fae475c`::ref 0 aborting False >Thread-14::DEBUG::2014-07-10 09:03:32,054::vm::598::vm.Vm::(_getCpuStats) vmId=`5d49ebac-3f0d-4688-aed0-b3f5fe364000`::CPU stats not available: 'NoneType' object is unsubscriptable >Thread-14::DEBUG::2014-07-10 09:03:32,055::vm::654::vm.Vm::(_getNetworkStats) vmId=`5d49ebac-3f0d-4688-aed0-b3f5fe364000`::Network stats not available >Thread-14::DEBUG::2014-07-10 09:03:32,055::vm::676::vm.Vm::(_getDiskStats) vmId=`5d49ebac-3f0d-4688-aed0-b3f5fe364000`::Disk hdd stats not available >Thread-14::DEBUG::2014-07-10 09:03:32,055::vm::676::vm.Vm::(_getDiskStats) vmId=`5d49ebac-3f0d-4688-aed0-b3f5fe364000`::Disk hdc stats not available >Thread-14::DEBUG::2014-07-10 09:03:32,056::vm::676::vm.Vm::(_getDiskStats) vmId=`5d49ebac-3f0d-4688-aed0-b3f5fe364000`::Disk vda stats not available >Thread-14::DEBUG::2014-07-10 09:03:32,056::vm::715::vm.Vm::(_getDiskLatency) vmId=`5d49ebac-3f0d-4688-aed0-b3f5fe364000`::Disk hdd latency not available >Thread-14::DEBUG::2014-07-10 09:03:32,056::vm::715::vm.Vm::(_getDiskLatency) vmId=`5d49ebac-3f0d-4688-aed0-b3f5fe364000`::Disk hdc latency not available >Thread-14::DEBUG::2014-07-10 09:03:32,056::vm::715::vm.Vm::(_getDiskLatency) vmId=`5d49ebac-3f0d-4688-aed0-b3f5fe364000`::Disk vda latency not available >Thread-14::DEBUG::2014-07-10 09:03:32,057::vm::676::vm.Vm::(_getDiskStats) vmId=`7fc21bb8-bd92-4924-acef-8360998e92a1`::Disk hdd stats not available >Thread-14::DEBUG::2014-07-10 09:03:32,057::vm::676::vm.Vm::(_getDiskStats) vmId=`7fc21bb8-bd92-4924-acef-8360998e92a1`::Disk hdc stats not available >Thread-14::DEBUG::2014-07-10 09:03:32,057::vm::676::vm.Vm::(_getDiskStats) vmId=`7fc21bb8-bd92-4924-acef-8360998e92a1`::Disk vda stats not available >Thread-14::DEBUG::2014-07-10 09:03:32,057::vm::715::vm.Vm::(_getDiskLatency) vmId=`7fc21bb8-bd92-4924-acef-8360998e92a1`::Disk hdd latency not available >Thread-14::DEBUG::2014-07-10 09:03:32,058::vm::715::vm.Vm::(_getDiskLatency) vmId=`7fc21bb8-bd92-4924-acef-8360998e92a1`::Disk hdc latency not available >Thread-14::DEBUG::2014-07-10 09:03:32,058::vm::715::vm.Vm::(_getDiskLatency) vmId=`7fc21bb8-bd92-4924-acef-8360998e92a1`::Disk vda latency not available >Thread-14::DEBUG::2014-07-10 09:03:32,058::vm::676::vm.Vm::(_getDiskStats) vmId=`a766ed65-ac2e-4862-8ff0-0352480cf6f1`::Disk hdd stats not available >Thread-14::DEBUG::2014-07-10 09:03:32,059::vm::676::vm.Vm::(_getDiskStats) vmId=`a766ed65-ac2e-4862-8ff0-0352480cf6f1`::Disk hdc stats not available >Thread-14::DEBUG::2014-07-10 09:03:32,059::vm::676::vm.Vm::(_getDiskStats) vmId=`a766ed65-ac2e-4862-8ff0-0352480cf6f1`::Disk vda stats not available >Thread-14::DEBUG::2014-07-10 09:03:32,059::vm::715::vm.Vm::(_getDiskLatency) vmId=`a766ed65-ac2e-4862-8ff0-0352480cf6f1`::Disk hdd latency not available >Thread-14::DEBUG::2014-07-10 09:03:32,060::vm::715::vm.Vm::(_getDiskLatency) vmId=`a766ed65-ac2e-4862-8ff0-0352480cf6f1`::Disk hdc latency not available >Thread-14::DEBUG::2014-07-10 09:03:32,060::vm::715::vm.Vm::(_getDiskLatency) vmId=`a766ed65-ac2e-4862-8ff0-0352480cf6f1`::Disk vda latency not available >Dummy-33::DEBUG::2014-07-10 09:03:32,588::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:03:32,684::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0394727 s, 25.9 MB/s\n'; <rc> = 0 >GuestMonitor-scale_8::DEBUG::2014-07-10 09:03:32,944::vm::598::vm.Vm::(_getCpuStats) vmId=`5d49ebac-3f0d-4688-aed0-b3f5fe364000`::CPU stats not available: 'NoneType' object is unsubscriptable >GuestMonitor-scale_8::DEBUG::2014-07-10 09:03:32,944::vm::654::vm.Vm::(_getNetworkStats) vmId=`5d49ebac-3f0d-4688-aed0-b3f5fe364000`::Network stats not available >GuestMonitor-scale_8::DEBUG::2014-07-10 09:03:32,945::vm::676::vm.Vm::(_getDiskStats) vmId=`5d49ebac-3f0d-4688-aed0-b3f5fe364000`::Disk hdd stats not available >GuestMonitor-scale_8::DEBUG::2014-07-10 09:03:32,945::vm::676::vm.Vm::(_getDiskStats) vmId=`5d49ebac-3f0d-4688-aed0-b3f5fe364000`::Disk hdc stats not available >GuestMonitor-scale_8::DEBUG::2014-07-10 09:03:32,945::vm::676::vm.Vm::(_getDiskStats) vmId=`5d49ebac-3f0d-4688-aed0-b3f5fe364000`::Disk vda stats not available >GuestMonitor-scale_8::DEBUG::2014-07-10 09:03:32,945::vm::715::vm.Vm::(_getDiskLatency) vmId=`5d49ebac-3f0d-4688-aed0-b3f5fe364000`::Disk hdd latency not available >GuestMonitor-scale_8::DEBUG::2014-07-10 09:03:32,946::vm::715::vm.Vm::(_getDiskLatency) vmId=`5d49ebac-3f0d-4688-aed0-b3f5fe364000`::Disk hdc latency not available >GuestMonitor-scale_8::DEBUG::2014-07-10 09:03:32,946::vm::715::vm.Vm::(_getDiskLatency) vmId=`5d49ebac-3f0d-4688-aed0-b3f5fe364000`::Disk vda latency not available >GuestMonitor-scale_8::DEBUG::2014-07-10 09:03:32,946::vm::598::vm.Vm::(_getCpuStats) vmId=`5d49ebac-3f0d-4688-aed0-b3f5fe364000`::CPU stats not available: 'NoneType' object is unsubscriptable >GuestMonitor-scale_8::DEBUG::2014-07-10 09:03:32,947::vm::654::vm.Vm::(_getNetworkStats) vmId=`5d49ebac-3f0d-4688-aed0-b3f5fe364000`::Network stats not available >GuestMonitor-scale_8::DEBUG::2014-07-10 09:03:32,947::vm::676::vm.Vm::(_getDiskStats) vmId=`5d49ebac-3f0d-4688-aed0-b3f5fe364000`::Disk hdd stats not available >GuestMonitor-scale_8::DEBUG::2014-07-10 09:03:32,947::vm::676::vm.Vm::(_getDiskStats) vmId=`5d49ebac-3f0d-4688-aed0-b3f5fe364000`::Disk hdc stats not available >GuestMonitor-scale_8::DEBUG::2014-07-10 09:03:32,947::vm::676::vm.Vm::(_getDiskStats) vmId=`5d49ebac-3f0d-4688-aed0-b3f5fe364000`::Disk vda stats not available >GuestMonitor-scale_8::DEBUG::2014-07-10 09:03:32,947::vm::715::vm.Vm::(_getDiskLatency) vmId=`5d49ebac-3f0d-4688-aed0-b3f5fe364000`::Disk hdd latency not available >GuestMonitor-scale_8::DEBUG::2014-07-10 09:03:32,948::vm::715::vm.Vm::(_getDiskLatency) vmId=`5d49ebac-3f0d-4688-aed0-b3f5fe364000`::Disk hdc latency not available >GuestMonitor-scale_8::DEBUG::2014-07-10 09:03:32,948::vm::715::vm.Vm::(_getDiskLatency) vmId=`5d49ebac-3f0d-4688-aed0-b3f5fe364000`::Disk vda latency not available >GuestMonitor-scale_7::DEBUG::2014-07-10 09:03:33,061::vm::676::vm.Vm::(_getDiskStats) vmId=`a766ed65-ac2e-4862-8ff0-0352480cf6f1`::Disk hdd stats not available >GuestMonitor-scale_7::DEBUG::2014-07-10 09:03:33,061::vm::676::vm.Vm::(_getDiskStats) vmId=`a766ed65-ac2e-4862-8ff0-0352480cf6f1`::Disk hdc stats not available >GuestMonitor-scale_7::DEBUG::2014-07-10 09:03:33,061::vm::676::vm.Vm::(_getDiskStats) vmId=`a766ed65-ac2e-4862-8ff0-0352480cf6f1`::Disk vda stats not available >GuestMonitor-scale_7::DEBUG::2014-07-10 09:03:33,061::vm::715::vm.Vm::(_getDiskLatency) vmId=`a766ed65-ac2e-4862-8ff0-0352480cf6f1`::Disk hdd latency not available >GuestMonitor-scale_7::DEBUG::2014-07-10 09:03:33,061::vm::715::vm.Vm::(_getDiskLatency) vmId=`a766ed65-ac2e-4862-8ff0-0352480cf6f1`::Disk hdc latency not available >GuestMonitor-scale_7::DEBUG::2014-07-10 09:03:33,062::vm::715::vm.Vm::(_getDiskLatency) vmId=`a766ed65-ac2e-4862-8ff0-0352480cf6f1`::Disk vda latency not available >GuestMonitor-scale_7::DEBUG::2014-07-10 09:03:33,062::vm::676::vm.Vm::(_getDiskStats) vmId=`a766ed65-ac2e-4862-8ff0-0352480cf6f1`::Disk hdd stats not available >GuestMonitor-scale_7::DEBUG::2014-07-10 09:03:33,062::vm::676::vm.Vm::(_getDiskStats) vmId=`a766ed65-ac2e-4862-8ff0-0352480cf6f1`::Disk hdc stats not available >GuestMonitor-scale_7::DEBUG::2014-07-10 09:03:33,063::vm::676::vm.Vm::(_getDiskStats) vmId=`a766ed65-ac2e-4862-8ff0-0352480cf6f1`::Disk vda stats not available >GuestMonitor-scale_7::DEBUG::2014-07-10 09:03:33,063::vm::715::vm.Vm::(_getDiskLatency) vmId=`a766ed65-ac2e-4862-8ff0-0352480cf6f1`::Disk hdd latency not available >GuestMonitor-scale_7::DEBUG::2014-07-10 09:03:33,064::vm::715::vm.Vm::(_getDiskLatency) vmId=`a766ed65-ac2e-4862-8ff0-0352480cf6f1`::Disk hdc latency not available >GuestMonitor-scale_7::DEBUG::2014-07-10 09:03:33,064::vm::715::vm.Vm::(_getDiskLatency) vmId=`a766ed65-ac2e-4862-8ff0-0352480cf6f1`::Disk vda latency not available >GuestMonitor-scale_6::DEBUG::2014-07-10 09:03:33,084::vm::676::vm.Vm::(_getDiskStats) vmId=`7fc21bb8-bd92-4924-acef-8360998e92a1`::Disk hdd stats not available >GuestMonitor-scale_6::DEBUG::2014-07-10 09:03:33,084::vm::676::vm.Vm::(_getDiskStats) vmId=`7fc21bb8-bd92-4924-acef-8360998e92a1`::Disk hdc stats not available >GuestMonitor-scale_6::DEBUG::2014-07-10 09:03:33,084::vm::676::vm.Vm::(_getDiskStats) vmId=`7fc21bb8-bd92-4924-acef-8360998e92a1`::Disk vda stats not available >GuestMonitor-scale_6::DEBUG::2014-07-10 09:03:33,084::vm::715::vm.Vm::(_getDiskLatency) vmId=`7fc21bb8-bd92-4924-acef-8360998e92a1`::Disk hdd latency not available >GuestMonitor-scale_6::DEBUG::2014-07-10 09:03:33,085::vm::715::vm.Vm::(_getDiskLatency) vmId=`7fc21bb8-bd92-4924-acef-8360998e92a1`::Disk hdc latency not available >GuestMonitor-scale_6::DEBUG::2014-07-10 09:03:33,085::vm::715::vm.Vm::(_getDiskLatency) vmId=`7fc21bb8-bd92-4924-acef-8360998e92a1`::Disk vda latency not available >GuestMonitor-scale_6::DEBUG::2014-07-10 09:03:33,085::vm::676::vm.Vm::(_getDiskStats) vmId=`7fc21bb8-bd92-4924-acef-8360998e92a1`::Disk hdd stats not available >GuestMonitor-scale_6::DEBUG::2014-07-10 09:03:33,085::vm::676::vm.Vm::(_getDiskStats) vmId=`7fc21bb8-bd92-4924-acef-8360998e92a1`::Disk hdc stats not available >GuestMonitor-scale_6::DEBUG::2014-07-10 09:03:33,085::vm::676::vm.Vm::(_getDiskStats) vmId=`7fc21bb8-bd92-4924-acef-8360998e92a1`::Disk vda stats not available >GuestMonitor-scale_6::DEBUG::2014-07-10 09:03:33,086::vm::715::vm.Vm::(_getDiskLatency) vmId=`7fc21bb8-bd92-4924-acef-8360998e92a1`::Disk hdd latency not available >GuestMonitor-scale_6::DEBUG::2014-07-10 09:03:33,086::vm::715::vm.Vm::(_getDiskLatency) vmId=`7fc21bb8-bd92-4924-acef-8360998e92a1`::Disk hdc latency not available >GuestMonitor-scale_6::DEBUG::2014-07-10 09:03:33,086::vm::715::vm.Vm::(_getDiskLatency) vmId=`7fc21bb8-bd92-4924-acef-8360998e92a1`::Disk vda latency not available >Thread-14::DEBUG::2014-07-10 09:03:33,365::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-14::DEBUG::2014-07-10 09:03:33,366::task::595::TaskManager.Task::(_updateState) Task=`40e8149e-e582-4d5d-ab1a-717458eb8992`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 09:03:33,366::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-14::INFO::2014-07-10 09:03:33,367::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:03:33,367::task::1185::TaskManager.Task::(prepare) Task=`40e8149e-e582-4d5d-ab1a-717458eb8992`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:03:33,367::task::595::TaskManager.Task::(_updateState) Task=`40e8149e-e582-4d5d-ab1a-717458eb8992`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 09:03:33,367::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 09:03:33,367::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 09:03:33,368::task::990::TaskManager.Task::(_decref) Task=`40e8149e-e582-4d5d-ab1a-717458eb8992`::ref 0 aborting False >Thread-34::DEBUG::2014-07-10 09:03:33,411::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-34::DEBUG::2014-07-10 09:03:33,412::task::595::TaskManager.Task::(_updateState) Task=`a6c8effb-796a-40b2-82fb-a843a1b6bcae`::moving from state init -> state preparing >Thread-34::INFO::2014-07-10 09:03:33,412::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-34::DEBUG::2014-07-10 09:03:33,413::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`01c5ce7a-ad9c-4526-8f5a-8baade14f6e8`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-10 09:03:33,413::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' for lock type 'shared' >Thread-34::DEBUG::2014-07-10 09:03:33,413::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-10 09:03:33,413::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`01c5ce7a-ad9c-4526-8f5a-8baade14f6e8`::Granted request >Thread-34::DEBUG::2014-07-10 09:03:33,414::task::827::TaskManager.Task::(resourceAcquired) Task=`a6c8effb-796a-40b2-82fb-a843a1b6bcae`::_resourcesAcquired: Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee (shared) >Thread-34::DEBUG::2014-07-10 09:03:33,414::task::990::TaskManager.Task::(_decref) Task=`a6c8effb-796a-40b2-82fb-a843a1b6bcae`::ref 1 aborting False >Thread-34::DEBUG::2014-07-10 09:03:33,415::lvm::373::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-34::DEBUG::2014-07-10 09:03:33,415::lvm::296::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/3600601601282300032826addbbdae311|/dev/mapper/360060160f4a030003840ec867ddee311|/dev/mapper/367cad74c2fcba00019e6afd20c781e67|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name 9e1aa540-1f4e-4ee3-a152-be381ef6c3bd' (cwd None) >Thread-34::DEBUG::2014-07-10 09:03:33,648::lvm::296::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-34::DEBUG::2014-07-10 09:03:33,650::lvm::415::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-34::INFO::2014-07-10 09:03:33,652::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1075620872192', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532069482496', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:03:33,652::task::1185::TaskManager.Task::(prepare) Task=`a6c8effb-796a-40b2-82fb-a843a1b6bcae`::finished: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1075620872192', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532069482496', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:03:33,652::task::595::TaskManager.Task::(_updateState) Task=`a6c8effb-796a-40b2-82fb-a843a1b6bcae`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-10 09:03:33,652::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee': < ResourceRef 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-10 09:03:33,653::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-10 09:03:33,653::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' >Thread-34::DEBUG::2014-07-10 09:03:33,653::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' (0 active users) >Thread-34::DEBUG::2014-07-10 09:03:33,653::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-10 09:03:33,654::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', Clearing records. >Thread-34::DEBUG::2014-07-10 09:03:33,654::task::990::TaskManager.Task::(_decref) Task=`a6c8effb-796a-40b2-82fb-a843a1b6bcae`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-07-10 09:03:33,782::guestIF::274::vm.Vm::(_handleMessage) vmId=`7fc21bb8-bd92-4924-acef-8360998e92a1`::username: u'None' >Thread-40::DEBUG::2014-07-10 09:03:34,659::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lion.qa.lab.tlv.redhat.com:_export_yuri2_backup2/6a70504d-00df-4869-8695-0f442053f6b6/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-40::DEBUG::2014-07-10 09:03:34,674::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n369 bytes (369 B) copied, 0.000370607 s, 996 kB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:03:34,699::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:03:34,799::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0473674 s, 21.6 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 09:03:35,182::BindingXMLRPC::1067::vds::(wrapper) client [10.35.3.13]::call vmGetStats with ('a766ed65-ac2e-4862-8ff0-0352480cf6f1',) {} >Thread-14::DEBUG::2014-07-10 09:03:35,183::vm::676::vm.Vm::(_getDiskStats) vmId=`a766ed65-ac2e-4862-8ff0-0352480cf6f1`::Disk hdd stats not available >Thread-14::DEBUG::2014-07-10 09:03:35,183::vm::676::vm.Vm::(_getDiskStats) vmId=`a766ed65-ac2e-4862-8ff0-0352480cf6f1`::Disk hdc stats not available >Thread-14::DEBUG::2014-07-10 09:03:35,183::vm::676::vm.Vm::(_getDiskStats) vmId=`a766ed65-ac2e-4862-8ff0-0352480cf6f1`::Disk vda stats not available >Thread-14::DEBUG::2014-07-10 09:03:35,183::vm::715::vm.Vm::(_getDiskLatency) vmId=`a766ed65-ac2e-4862-8ff0-0352480cf6f1`::Disk hdd latency not available >Thread-14::DEBUG::2014-07-10 09:03:35,184::vm::715::vm.Vm::(_getDiskLatency) vmId=`a766ed65-ac2e-4862-8ff0-0352480cf6f1`::Disk hdc latency not available >Thread-14::DEBUG::2014-07-10 09:03:35,184::vm::715::vm.Vm::(_getDiskLatency) vmId=`a766ed65-ac2e-4862-8ff0-0352480cf6f1`::Disk vda latency not available >Thread-14::DEBUG::2014-07-10 09:03:35,184::BindingXMLRPC::1074::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Powering up', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '15456', 'displayIp': '0', 'displayPort': u'5912', 'session': 'Unknown', 'displaySecurePort': u'5913', 'timeOffset': '0', 'hash': '1078195817470092527', 'balloonInfo': {'balloon_max': '1048576', 'balloon_target': '1048576', 'balloon_cur': '1048576', 'balloon_min': '1048576'}, 'pauseCode': 'NOERR', 'clientIp': '', 'kvmEnable': 'true', 'network': {u'vnet6': {'macAddr': '00:1a:4a:de:6d:88', 'rxDropped': '0', 'rxErrors': '0', 'txDropped': '0', 'txRate': '0.0', 'rxRate': '0.0', 'txErrors': '0', 'state': 'unknown', 'speed': '1000', 'name': u'vnet6'}}, 'vmId': 'a766ed65-ac2e-4862-8ff0-0352480cf6f1', 'displayType': 'qxl', 'cpuUser': '42.70', 'disks': {u'vda': {'truesize': '1073741824', 'apparentsize': '1073741824', 'imageID': 'f30c2cb7-a43a-4bf5-82b5-cfe07336f65c'}, u'hdd': {'truesize': '0', 'apparentsize': '0'}, u'hdc': {'truesize': '0', 'apparentsize': '0'}}, 'monitorResponse': '0', 'statsAge': '1.52', 'elapsedTime': '28', 'vmType': 'kvm', 'cpuSys': '26.97', 'guestCPUCount': -1, 'appsList': [], 'guestIPs': ''}]} >Thread-14::DEBUG::2014-07-10 09:03:35,189::BindingXMLRPC::1067::vds::(wrapper) client [10.35.3.13]::call vmGetStats with ('7fc21bb8-bd92-4924-acef-8360998e92a1',) {} >Thread-14::DEBUG::2014-07-10 09:03:35,190::vm::676::vm.Vm::(_getDiskStats) vmId=`7fc21bb8-bd92-4924-acef-8360998e92a1`::Disk hdd stats not available >Thread-14::DEBUG::2014-07-10 09:03:35,191::vm::676::vm.Vm::(_getDiskStats) vmId=`7fc21bb8-bd92-4924-acef-8360998e92a1`::Disk hdc stats not available >Thread-14::DEBUG::2014-07-10 09:03:35,192::vm::676::vm.Vm::(_getDiskStats) vmId=`7fc21bb8-bd92-4924-acef-8360998e92a1`::Disk vda stats not available >Thread-14::DEBUG::2014-07-10 09:03:35,194::vm::715::vm.Vm::(_getDiskLatency) vmId=`7fc21bb8-bd92-4924-acef-8360998e92a1`::Disk hdd latency not available >Thread-14::DEBUG::2014-07-10 09:03:35,195::vm::715::vm.Vm::(_getDiskLatency) vmId=`7fc21bb8-bd92-4924-acef-8360998e92a1`::Disk hdc latency not available >Thread-14::DEBUG::2014-07-10 09:03:35,196::vm::715::vm.Vm::(_getDiskLatency) vmId=`7fc21bb8-bd92-4924-acef-8360998e92a1`::Disk vda latency not available >Thread-14::DEBUG::2014-07-10 09:03:35,198::BindingXMLRPC::1074::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'username': u'None', 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': u'vm-18-241.eng.lab.tlv.redhat.com', 'pid': '14800', 'session': 'Unknown', 'displaySecurePort': u'5911', 'timeOffset': '0', 'balloonInfo': {'balloon_max': '1048576', 'balloon_target': '1048576', 'balloon_cur': '1048576', 'balloon_min': '1048576'}, 'pauseCode': 'NOERR', 'disksUsage': [{u'path': u'/', u'total': '4792987648', u'used': '1843060736', u'fs': u'ext4'}, {u'path': u'/boot', u'total': '507744256', u'used': '40272896', u'fs': u'ext4'}, {u'path': u'/home', u'total': '458985472', u'used': '10766336', u'fs': u'ext4'}], 'network': {u'vnet5': {'macAddr': '00:1a:4a:de:6d:7d', 'rxDropped': '0', 'rxErrors': '0', 'txDropped': '0', 'txRate': '0.0', 'rxRate': '0.0', 'txErrors': '0', 'state': 'unknown', 'speed': '1000', 'name': u'vnet5'}}, 'vmType': 'kvm', 'guestName': u'vm-18-241.eng.lab.tlv.redhat.com', 'elapsedTime': '49', 'memoryStats': {}, 'cpuSys': '4.25', 'appsList': [u'kernel-2.6.32-431.el6', u'rhevm-guest-agent-common-1.0.9-1.el6ev'], 'guestOs': u'2.6.32-431.el6.x86_64', 'displayType': 'qxl', 'status': 'Up', 'hash': '-831008492253830849', 'lastLogin': 1404983013.782023, 'vmId': '7fc21bb8-bd92-4924-acef-8360998e92a1', 'displayIp': '0', 'displayPort': u'5910', 'clientIp': '', 'kvmEnable': 'true', 'disks': {u'vda': {'truesize': '1073741824', 'apparentsize': '1073741824', 'imageID': 'aa20346a-4d3a-4e07-b8e1-52c0ebe4168c'}, u'hdd': {'truesize': '0', 'apparentsize': '0'}, u'hdc': {'truesize': '0', 'apparentsize': '0'}}, 'monitorResponse': '0', 'statsAge': '0.21', 'cpuUser': '41.59', 'guestCPUCount': -1, 'guestIPs': u'10.35.18.241', 'netIfaces': [{u'hw': u'00:1a:4a:de:6d:7d', u'name': u'eth0', u'inet': [u'10.35.18.241'], u'inet6': [u'fe80::21a:4aff:fede:6d7d']}]}]} >Thread-14::DEBUG::2014-07-10 09:03:35,204::BindingXMLRPC::1067::vds::(wrapper) client [10.35.3.13]::call vmGetStats with ('5d49ebac-3f0d-4688-aed0-b3f5fe364000',) {} >Thread-14::DEBUG::2014-07-10 09:03:35,204::vm::598::vm.Vm::(_getCpuStats) vmId=`5d49ebac-3f0d-4688-aed0-b3f5fe364000`::CPU stats not available: 'NoneType' object is unsubscriptable >Thread-14::DEBUG::2014-07-10 09:03:35,204::vm::654::vm.Vm::(_getNetworkStats) vmId=`5d49ebac-3f0d-4688-aed0-b3f5fe364000`::Network stats not available >Thread-14::DEBUG::2014-07-10 09:03:35,204::vm::676::vm.Vm::(_getDiskStats) vmId=`5d49ebac-3f0d-4688-aed0-b3f5fe364000`::Disk hdd stats not available >Thread-14::DEBUG::2014-07-10 09:03:35,205::vm::676::vm.Vm::(_getDiskStats) vmId=`5d49ebac-3f0d-4688-aed0-b3f5fe364000`::Disk hdc stats not available >Thread-14::DEBUG::2014-07-10 09:03:35,205::vm::676::vm.Vm::(_getDiskStats) vmId=`5d49ebac-3f0d-4688-aed0-b3f5fe364000`::Disk vda stats not available >Thread-14::DEBUG::2014-07-10 09:03:35,205::vm::715::vm.Vm::(_getDiskLatency) vmId=`5d49ebac-3f0d-4688-aed0-b3f5fe364000`::Disk hdd latency not available >Thread-14::DEBUG::2014-07-10 09:03:35,205::vm::715::vm.Vm::(_getDiskLatency) vmId=`5d49ebac-3f0d-4688-aed0-b3f5fe364000`::Disk hdc latency not available >Thread-14::DEBUG::2014-07-10 09:03:35,205::vm::715::vm.Vm::(_getDiskLatency) vmId=`5d49ebac-3f0d-4688-aed0-b3f5fe364000`::Disk vda latency not available >Thread-14::DEBUG::2014-07-10 09:03:35,206::BindingXMLRPC::1074::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Powering up', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '16122', 'displayIp': '0', 'displayPort': u'5914', 'session': 'Unknown', 'displaySecurePort': u'5915', 'timeOffset': '0', 'hash': '8384665493346130205', 'balloonInfo': {'balloon_max': '1048576', 'balloon_target': '1048576', 'balloon_cur': '0', 'balloon_min': '1048576'}, 'pauseCode': 'NOERR', 'clientIp': '', 'kvmEnable': 'true', 'network': {u'vnet7': {'state': 'unknown', 'macAddr': '00:1a:4a:de:6d:89', 'speed': '1000', 'name': u'vnet7'}}, 'vmId': '5d49ebac-3f0d-4688-aed0-b3f5fe364000', 'displayType': 'qxl', 'cpuUser': '0.00', 'disks': {u'vda': {'truesize': '1073741824', 'apparentsize': '1073741824', 'imageID': 'cfaeead2-7caa-467c-b389-c89840ae6605'}, u'hdd': {'truesize': '0', 'apparentsize': '0'}, u'hdc': {'truesize': '0', 'apparentsize': '0'}}, 'monitorResponse': '0', 'statsAge': '0.32', 'elapsedTime': '8', 'vmType': 'kvm', 'cpuSys': '0.00', 'guestCPUCount': -1, 'appsList': [], 'guestIPs': ''}]} >Thread-14::DEBUG::2014-07-10 09:03:35,478::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-14::DEBUG::2014-07-10 09:03:35,478::task::595::TaskManager.Task::(_updateState) Task=`385e1fe2-ae3f-49c5-9c27-92588dbb779f`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 09:03:35,479::logUtils::44::dispatcher::(wrapper) Run and protect: getAllTasksStatuses(spUUID=None, options=None) >Thread-14::DEBUG::2014-07-10 09:03:35,479::taskManager::102::TaskManager::(getAllTasksStatuses) Entry. >Thread-14::DEBUG::2014-07-10 09:03:35,479::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: a7c00320-f8fd-4896-b42d-77dfb009c02a >Thread-14::DEBUG::2014-07-10 09:03:35,479::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'a7c00320-f8fd-4896-b42d-77dfb009c02a'} >Thread-14::DEBUG::2014-07-10 09:03:35,479::taskManager::113::TaskManager::(getAllTasksStatuses) Return: {'a7c00320-f8fd-4896-b42d-77dfb009c02a': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'a7c00320-f8fd-4896-b42d-77dfb009c02a'}} >Thread-14::INFO::2014-07-10 09:03:35,480::logUtils::47::dispatcher::(wrapper) Run and protect: getAllTasksStatuses, Return response: {'allTasksStatus': {'a7c00320-f8fd-4896-b42d-77dfb009c02a': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'a7c00320-f8fd-4896-b42d-77dfb009c02a'}}} >Thread-14::DEBUG::2014-07-10 09:03:35,480::task::1185::TaskManager.Task::(prepare) Task=`385e1fe2-ae3f-49c5-9c27-92588dbb779f`::finished: {'allTasksStatus': {'a7c00320-f8fd-4896-b42d-77dfb009c02a': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'a7c00320-f8fd-4896-b42d-77dfb009c02a'}}} >Thread-14::DEBUG::2014-07-10 09:03:35,480::task::595::TaskManager.Task::(_updateState) Task=`385e1fe2-ae3f-49c5-9c27-92588dbb779f`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 09:03:35,480::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 09:03:35,480::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 09:03:35,481::task::990::TaskManager.Task::(_decref) Task=`385e1fe2-ae3f-49c5-9c27-92588dbb779f`::ref 0 aborting False >a7c00320-f8fd-4896-b42d-77dfb009c02a::DEBUG::2014-07-10 09:03:36,331::lvm::296::Storage.Misc.excCmd::(cmd) FAILED: <err> = ' Logical volume 9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/47592965-e853-4e59-9728-d11cca6a7a8a in use.\n'; <rc> = 5 >a7c00320-f8fd-4896-b42d-77dfb009c02a::DEBUG::2014-07-10 09:03:36,335::lvm::513::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >a7c00320-f8fd-4896-b42d-77dfb009c02a::DEBUG::2014-07-10 09:03:36,336::lvm::525::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >a7c00320-f8fd-4896-b42d-77dfb009c02a::WARNING::2014-07-10 09:03:36,336::resourceFactories::61::Storage.ResourcesFactories::(close) Failure deactivate LV 9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/47592965-e853-4e59-9728-d11cca6a7a8a (Cannot deactivate Logical Volume: ('General Storage Exception: ("5 [] [\' Logical volume 9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/47592965-e853-4e59-9728-d11cca6a7a8a in use.\']\\n9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/[\'47592965-e853-4e59-9728-d11cca6a7a8a\']",)',)) >a7c00320-f8fd-4896-b42d-77dfb009c02a::DEBUG::2014-07-10 09:03:36,336::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd_lvmActivationNS.47592965-e853-4e59-9728-d11cca6a7a8a', Clearing records. >a7c00320-f8fd-4896-b42d-77dfb009c02a::DEBUG::2014-07-10 09:03:36,336::lvm::427::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' got the operation mutex >a7c00320-f8fd-4896-b42d-77dfb009c02a::DEBUG::2014-07-10 09:03:36,337::lvm::296::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm lvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/3600601601282300032826addbbdae311|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,vg_name,attr,size,seg_start_pe,devices,tags 9e1aa540-1f4e-4ee3-a152-be381ef6c3bd' (cwd None) >a7c00320-f8fd-4896-b42d-77dfb009c02a::DEBUG::2014-07-10 09:03:36,534::lvm::296::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >a7c00320-f8fd-4896-b42d-77dfb009c02a::DEBUG::2014-07-10 09:03:36,549::lvm::462::Storage.LVM::(_reloadlvs) lvs reloaded >a7c00320-f8fd-4896-b42d-77dfb009c02a::DEBUG::2014-07-10 09:03:36,549::lvm::462::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' released the operation mutex >a7c00320-f8fd-4896-b42d-77dfb009c02a::DEBUG::2014-07-10 09:03:36,550::lvm::427::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' got the operation mutex >a7c00320-f8fd-4896-b42d-77dfb009c02a::DEBUG::2014-07-10 09:03:36,550::lvm::296::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm lvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/3600601601282300032826addbbdae311|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,vg_name,attr,size,seg_start_pe,devices,tags 9e1aa540-1f4e-4ee3-a152-be381ef6c3bd' (cwd None) >a7c00320-f8fd-4896-b42d-77dfb009c02a::DEBUG::2014-07-10 09:03:36,738::lvm::296::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >a7c00320-f8fd-4896-b42d-77dfb009c02a::DEBUG::2014-07-10 09:03:36,755::lvm::462::Storage.LVM::(_reloadlvs) lvs reloaded >a7c00320-f8fd-4896-b42d-77dfb009c02a::DEBUG::2014-07-10 09:03:36,755::lvm::462::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' released the operation mutex >a7c00320-f8fd-4896-b42d-77dfb009c02a::WARNING::2014-07-10 09:03:36,755::blockSD::761::Storage.StorageDomain::(_getOccupiedMetadataSlots) Could not find mapping for lv 9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/4bb5d954-2a50-4028-b299-0b43c261270c >a7c00320-f8fd-4896-b42d-77dfb009c02a::DEBUG::2014-07-10 09:03:36,755::blockSD::784::Storage.StorageDomain::(getFreeMetadataSlot) Found freeSlot 13 in VG 9e1aa540-1f4e-4ee3-a152-be381ef6c3bd >a7c00320-f8fd-4896-b42d-77dfb009c02a::DEBUG::2014-07-10 09:03:36,756::lvm::296::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm lvchange --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/3600601601282300032826addbbdae311|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } " --autobackup n --deltag OVIRT_VOL_INITIALIZING --addtag IU_c01d693b-cba0-4fed-9ad7-0aaa28912a19 --addtag PU_47592965-e853-4e59-9728-d11cca6a7a8a --addtag MD_13 9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/4bb5d954-2a50-4028-b299-0b43c261270c' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:03:36,816::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:03:36,907::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0358534 s, 28.6 MB/s\n'; <rc> = 0 >a7c00320-f8fd-4896-b42d-77dfb009c02a::DEBUG::2014-07-10 09:03:37,002::lvm::296::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ' WARNING: This metadata update is NOT backed up\n WARNING: This metadata update is NOT backed up\n'; <rc> = 0 >a7c00320-f8fd-4896-b42d-77dfb009c02a::DEBUG::2014-07-10 09:03:37,003::lvm::513::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >a7c00320-f8fd-4896-b42d-77dfb009c02a::DEBUG::2014-07-10 09:03:37,003::lvm::525::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >a7c00320-f8fd-4896-b42d-77dfb009c02a::DEBUG::2014-07-10 09:03:37,004::lvm::296::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm lvchange --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/3600601601282300032826addbbdae311|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } " --autobackup n --available n 9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/4bb5d954-2a50-4028-b299-0b43c261270c' (cwd None) >a7c00320-f8fd-4896-b42d-77dfb009c02a::DEBUG::2014-07-10 09:03:37,407::lvm::296::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >a7c00320-f8fd-4896-b42d-77dfb009c02a::DEBUG::2014-07-10 09:03:37,408::lvm::513::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >a7c00320-f8fd-4896-b42d-77dfb009c02a::DEBUG::2014-07-10 09:03:37,409::lvm::525::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >a7c00320-f8fd-4896-b42d-77dfb009c02a::DEBUG::2014-07-10 09:03:37,411::task::752::TaskManager.Task::(_save) Task=`a7c00320-f8fd-4896-b42d-77dfb009c02a`::_save: orig /rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/master/tasks/a7c00320-f8fd-4896-b42d-77dfb009c02a temp /rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/master/tasks/a7c00320-f8fd-4896-b42d-77dfb009c02a.temp >a7c00320-f8fd-4896-b42d-77dfb009c02a::DEBUG::2014-07-10 09:03:37,425::blockVolume::604::Storage.Volume::(newVolumeLease) Initializing volume lease volUUID=4bb5d954-2a50-4028-b299-0b43c261270c sdUUID=9e1aa540-1f4e-4ee3-a152-be381ef6c3bd, metaId=('9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 13) >a7c00320-f8fd-4896-b42d-77dfb009c02a::DEBUG::2014-07-10 09:03:37,440::task::752::TaskManager.Task::(_save) Task=`a7c00320-f8fd-4896-b42d-77dfb009c02a`::_save: orig /rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/master/tasks/a7c00320-f8fd-4896-b42d-77dfb009c02a temp /rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/master/tasks/a7c00320-f8fd-4896-b42d-77dfb009c02a.temp >a7c00320-f8fd-4896-b42d-77dfb009c02a::DEBUG::2014-07-10 09:03:37,451::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd_imageNS.c01d693b-cba0-4fed-9ad7-0aaa28912a19' >a7c00320-f8fd-4896-b42d-77dfb009c02a::DEBUG::2014-07-10 09:03:37,451::resourceManager::635::ResourceManager::(releaseResource) Released resource '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd_imageNS.c01d693b-cba0-4fed-9ad7-0aaa28912a19' (0 active users) >a7c00320-f8fd-4896-b42d-77dfb009c02a::DEBUG::2014-07-10 09:03:37,452::resourceManager::641::ResourceManager::(releaseResource) Resource '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd_imageNS.c01d693b-cba0-4fed-9ad7-0aaa28912a19' is free, finding out if anyone is waiting for it. >a7c00320-f8fd-4896-b42d-77dfb009c02a::DEBUG::2014-07-10 09:03:37,452::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd_imageNS.c01d693b-cba0-4fed-9ad7-0aaa28912a19', Clearing records. >a7c00320-f8fd-4896-b42d-77dfb009c02a::DEBUG::2014-07-10 09:03:37,452::task::595::TaskManager.Task::(_updateState) Task=`a7c00320-f8fd-4896-b42d-77dfb009c02a`::moving from state running -> state finished >a7c00320-f8fd-4896-b42d-77dfb009c02a::DEBUG::2014-07-10 09:03:37,453::task::752::TaskManager.Task::(_save) Task=`a7c00320-f8fd-4896-b42d-77dfb009c02a`::_save: orig /rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/master/tasks/a7c00320-f8fd-4896-b42d-77dfb009c02a temp /rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/master/tasks/a7c00320-f8fd-4896-b42d-77dfb009c02a.temp >a7c00320-f8fd-4896-b42d-77dfb009c02a::DEBUG::2014-07-10 09:03:37,462::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': < ResourceRef 'Storage.9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', isValid: 'True' obj: 'None'>} >a7c00320-f8fd-4896-b42d-77dfb009c02a::DEBUG::2014-07-10 09:03:37,462::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >a7c00320-f8fd-4896-b42d-77dfb009c02a::DEBUG::2014-07-10 09:03:37,462::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.9e1aa540-1f4e-4ee3-a152-be381ef6c3bd' >a7c00320-f8fd-4896-b42d-77dfb009c02a::DEBUG::2014-07-10 09:03:37,463::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.9e1aa540-1f4e-4ee3-a152-be381ef6c3bd' (0 active users) >a7c00320-f8fd-4896-b42d-77dfb009c02a::DEBUG::2014-07-10 09:03:37,463::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.9e1aa540-1f4e-4ee3-a152-be381ef6c3bd' is free, finding out if anyone is waiting for it. >a7c00320-f8fd-4896-b42d-77dfb009c02a::DEBUG::2014-07-10 09:03:37,463::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', Clearing records. >a7c00320-f8fd-4896-b42d-77dfb009c02a::DEBUG::2014-07-10 09:03:37,463::task::913::TaskManager.Task::(_runJobs) Task=`a7c00320-f8fd-4896-b42d-77dfb009c02a`::Task.run: exit - success: result {'uuid': '4bb5d954-2a50-4028-b299-0b43c261270c'} >a7c00320-f8fd-4896-b42d-77dfb009c02a::DEBUG::2014-07-10 09:03:37,463::task::990::TaskManager.Task::(_decref) Task=`a7c00320-f8fd-4896-b42d-77dfb009c02a`::ref 0 aborting False >a7c00320-f8fd-4896-b42d-77dfb009c02a::DEBUG::2014-07-10 09:03:37,464::threadPool::57::Misc.ThreadPool::(setRunningTask) Number of running tasks: 0 >Thread-18::DEBUG::2014-07-10 09:03:37,596::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/metadata bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-10 09:03:37,615::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000493788 s, 8.3 MB/s\n'; <rc> = 0 >GuestMonitor-scale_8::DEBUG::2014-07-10 09:03:37,954::vm::598::vm.Vm::(_getCpuStats) vmId=`5d49ebac-3f0d-4688-aed0-b3f5fe364000`::CPU stats not available: 'NoneType' object is unsubscriptable >GuestMonitor-scale_8::DEBUG::2014-07-10 09:03:37,955::vm::654::vm.Vm::(_getNetworkStats) vmId=`5d49ebac-3f0d-4688-aed0-b3f5fe364000`::Network stats not available >GuestMonitor-scale_8::DEBUG::2014-07-10 09:03:37,955::vm::676::vm.Vm::(_getDiskStats) vmId=`5d49ebac-3f0d-4688-aed0-b3f5fe364000`::Disk hdd stats not available >GuestMonitor-scale_8::DEBUG::2014-07-10 09:03:37,955::vm::676::vm.Vm::(_getDiskStats) vmId=`5d49ebac-3f0d-4688-aed0-b3f5fe364000`::Disk hdc stats not available >GuestMonitor-scale_8::DEBUG::2014-07-10 09:03:37,956::vm::676::vm.Vm::(_getDiskStats) vmId=`5d49ebac-3f0d-4688-aed0-b3f5fe364000`::Disk vda stats not available >GuestMonitor-scale_8::DEBUG::2014-07-10 09:03:37,956::vm::715::vm.Vm::(_getDiskLatency) vmId=`5d49ebac-3f0d-4688-aed0-b3f5fe364000`::Disk hdd latency not available >GuestMonitor-scale_8::DEBUG::2014-07-10 09:03:37,956::vm::715::vm.Vm::(_getDiskLatency) vmId=`5d49ebac-3f0d-4688-aed0-b3f5fe364000`::Disk hdc latency not available >GuestMonitor-scale_8::DEBUG::2014-07-10 09:03:37,956::vm::715::vm.Vm::(_getDiskLatency) vmId=`5d49ebac-3f0d-4688-aed0-b3f5fe364000`::Disk vda latency not available >GuestMonitor-scale_8::DEBUG::2014-07-10 09:03:37,957::vm::598::vm.Vm::(_getCpuStats) vmId=`5d49ebac-3f0d-4688-aed0-b3f5fe364000`::CPU stats not available: 'NoneType' object is unsubscriptable >GuestMonitor-scale_8::DEBUG::2014-07-10 09:03:37,957::vm::654::vm.Vm::(_getNetworkStats) vmId=`5d49ebac-3f0d-4688-aed0-b3f5fe364000`::Network stats not available >GuestMonitor-scale_8::DEBUG::2014-07-10 09:03:37,957::vm::676::vm.Vm::(_getDiskStats) vmId=`5d49ebac-3f0d-4688-aed0-b3f5fe364000`::Disk hdd stats not available >GuestMonitor-scale_8::DEBUG::2014-07-10 09:03:37,958::vm::676::vm.Vm::(_getDiskStats) vmId=`5d49ebac-3f0d-4688-aed0-b3f5fe364000`::Disk hdc stats not available >GuestMonitor-scale_8::DEBUG::2014-07-10 09:03:37,958::vm::676::vm.Vm::(_getDiskStats) vmId=`5d49ebac-3f0d-4688-aed0-b3f5fe364000`::Disk vda stats not available >GuestMonitor-scale_8::DEBUG::2014-07-10 09:03:37,958::vm::715::vm.Vm::(_getDiskLatency) vmId=`5d49ebac-3f0d-4688-aed0-b3f5fe364000`::Disk hdd latency not available >GuestMonitor-scale_8::DEBUG::2014-07-10 09:03:37,958::vm::715::vm.Vm::(_getDiskLatency) vmId=`5d49ebac-3f0d-4688-aed0-b3f5fe364000`::Disk hdc latency not available >GuestMonitor-scale_8::DEBUG::2014-07-10 09:03:37,958::vm::715::vm.Vm::(_getDiskLatency) vmId=`5d49ebac-3f0d-4688-aed0-b3f5fe364000`::Disk vda latency not available >GuestMonitor-scale_7::DEBUG::2014-07-10 09:03:38,067::vm::676::vm.Vm::(_getDiskStats) vmId=`a766ed65-ac2e-4862-8ff0-0352480cf6f1`::Disk hdd stats not available >GuestMonitor-scale_7::DEBUG::2014-07-10 09:03:38,068::vm::676::vm.Vm::(_getDiskStats) vmId=`a766ed65-ac2e-4862-8ff0-0352480cf6f1`::Disk hdc stats not available >GuestMonitor-scale_7::DEBUG::2014-07-10 09:03:38,068::vm::676::vm.Vm::(_getDiskStats) vmId=`a766ed65-ac2e-4862-8ff0-0352480cf6f1`::Disk vda stats not available >GuestMonitor-scale_7::DEBUG::2014-07-10 09:03:38,068::vm::715::vm.Vm::(_getDiskLatency) vmId=`a766ed65-ac2e-4862-8ff0-0352480cf6f1`::Disk hdd latency not available >GuestMonitor-scale_7::DEBUG::2014-07-10 09:03:38,069::vm::715::vm.Vm::(_getDiskLatency) vmId=`a766ed65-ac2e-4862-8ff0-0352480cf6f1`::Disk hdc latency not available >GuestMonitor-scale_7::DEBUG::2014-07-10 09:03:38,069::vm::715::vm.Vm::(_getDiskLatency) vmId=`a766ed65-ac2e-4862-8ff0-0352480cf6f1`::Disk vda latency not available >GuestMonitor-scale_7::DEBUG::2014-07-10 09:03:38,069::vm::676::vm.Vm::(_getDiskStats) vmId=`a766ed65-ac2e-4862-8ff0-0352480cf6f1`::Disk hdd stats not available >GuestMonitor-scale_7::DEBUG::2014-07-10 09:03:38,070::vm::676::vm.Vm::(_getDiskStats) vmId=`a766ed65-ac2e-4862-8ff0-0352480cf6f1`::Disk hdc stats not available >GuestMonitor-scale_7::DEBUG::2014-07-10 09:03:38,070::vm::676::vm.Vm::(_getDiskStats) vmId=`a766ed65-ac2e-4862-8ff0-0352480cf6f1`::Disk vda stats not available >GuestMonitor-scale_7::DEBUG::2014-07-10 09:03:38,070::vm::715::vm.Vm::(_getDiskLatency) vmId=`a766ed65-ac2e-4862-8ff0-0352480cf6f1`::Disk hdd latency not available >GuestMonitor-scale_7::DEBUG::2014-07-10 09:03:38,070::vm::715::vm.Vm::(_getDiskLatency) vmId=`a766ed65-ac2e-4862-8ff0-0352480cf6f1`::Disk hdc latency not available >GuestMonitor-scale_7::DEBUG::2014-07-10 09:03:38,070::vm::715::vm.Vm::(_getDiskLatency) vmId=`a766ed65-ac2e-4862-8ff0-0352480cf6f1`::Disk vda latency not available >GuestMonitor-scale_6::DEBUG::2014-07-10 09:03:38,092::vm::676::vm.Vm::(_getDiskStats) vmId=`7fc21bb8-bd92-4924-acef-8360998e92a1`::Disk hdd stats not available >GuestMonitor-scale_6::DEBUG::2014-07-10 09:03:38,092::vm::676::vm.Vm::(_getDiskStats) vmId=`7fc21bb8-bd92-4924-acef-8360998e92a1`::Disk hdc stats not available >GuestMonitor-scale_6::DEBUG::2014-07-10 09:03:38,092::vm::676::vm.Vm::(_getDiskStats) vmId=`7fc21bb8-bd92-4924-acef-8360998e92a1`::Disk vda stats not available >GuestMonitor-scale_6::DEBUG::2014-07-10 09:03:38,093::vm::715::vm.Vm::(_getDiskLatency) vmId=`7fc21bb8-bd92-4924-acef-8360998e92a1`::Disk hdd latency not available >GuestMonitor-scale_6::DEBUG::2014-07-10 09:03:38,093::vm::715::vm.Vm::(_getDiskLatency) vmId=`7fc21bb8-bd92-4924-acef-8360998e92a1`::Disk hdc latency not available >GuestMonitor-scale_6::DEBUG::2014-07-10 09:03:38,093::vm::715::vm.Vm::(_getDiskLatency) vmId=`7fc21bb8-bd92-4924-acef-8360998e92a1`::Disk vda latency not available >GuestMonitor-scale_6::DEBUG::2014-07-10 09:03:38,094::vm::676::vm.Vm::(_getDiskStats) vmId=`7fc21bb8-bd92-4924-acef-8360998e92a1`::Disk hdd stats not available >GuestMonitor-scale_6::DEBUG::2014-07-10 09:03:38,095::vm::676::vm.Vm::(_getDiskStats) vmId=`7fc21bb8-bd92-4924-acef-8360998e92a1`::Disk hdc stats not available >GuestMonitor-scale_6::DEBUG::2014-07-10 09:03:38,097::vm::676::vm.Vm::(_getDiskStats) vmId=`7fc21bb8-bd92-4924-acef-8360998e92a1`::Disk vda stats not available >GuestMonitor-scale_6::DEBUG::2014-07-10 09:03:38,098::vm::715::vm.Vm::(_getDiskLatency) vmId=`7fc21bb8-bd92-4924-acef-8360998e92a1`::Disk hdd latency not available >GuestMonitor-scale_6::DEBUG::2014-07-10 09:03:38,099::vm::715::vm.Vm::(_getDiskLatency) vmId=`7fc21bb8-bd92-4924-acef-8360998e92a1`::Disk hdc latency not available >GuestMonitor-scale_6::DEBUG::2014-07-10 09:03:38,100::vm::715::vm.Vm::(_getDiskLatency) vmId=`7fc21bb8-bd92-4924-acef-8360998e92a1`::Disk vda latency not available >Thread-14::DEBUG::2014-07-10 09:03:38,255::BindingXMLRPC::1067::vds::(wrapper) client [10.35.3.13]::call vmGetStats with ('a766ed65-ac2e-4862-8ff0-0352480cf6f1',) {} >Thread-14::DEBUG::2014-07-10 09:03:38,255::vm::676::vm.Vm::(_getDiskStats) vmId=`a766ed65-ac2e-4862-8ff0-0352480cf6f1`::Disk hdd stats not available >Thread-14::DEBUG::2014-07-10 09:03:38,256::vm::676::vm.Vm::(_getDiskStats) vmId=`a766ed65-ac2e-4862-8ff0-0352480cf6f1`::Disk hdc stats not available >Thread-14::DEBUG::2014-07-10 09:03:38,256::vm::676::vm.Vm::(_getDiskStats) vmId=`a766ed65-ac2e-4862-8ff0-0352480cf6f1`::Disk vda stats not available >Thread-14::DEBUG::2014-07-10 09:03:38,256::vm::715::vm.Vm::(_getDiskLatency) vmId=`a766ed65-ac2e-4862-8ff0-0352480cf6f1`::Disk hdd latency not available >Thread-14::DEBUG::2014-07-10 09:03:38,256::vm::715::vm.Vm::(_getDiskLatency) vmId=`a766ed65-ac2e-4862-8ff0-0352480cf6f1`::Disk hdc latency not available >Thread-14::DEBUG::2014-07-10 09:03:38,257::vm::715::vm.Vm::(_getDiskLatency) vmId=`a766ed65-ac2e-4862-8ff0-0352480cf6f1`::Disk vda latency not available >Thread-14::DEBUG::2014-07-10 09:03:38,257::BindingXMLRPC::1074::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Powering up', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '15456', 'displayIp': '0', 'displayPort': u'5912', 'session': 'Unknown', 'displaySecurePort': u'5913', 'timeOffset': '0', 'hash': '1078195817470092527', 'balloonInfo': {'balloon_max': '1048576', 'balloon_target': '1048576', 'balloon_cur': '1048576', 'balloon_min': '1048576'}, 'pauseCode': 'NOERR', 'clientIp': '', 'kvmEnable': 'true', 'network': {u'vnet6': {'macAddr': '00:1a:4a:de:6d:88', 'rxDropped': '0', 'rxErrors': '0', 'txDropped': '0', 'txRate': '0.0', 'rxRate': '0.0', 'txErrors': '0', 'state': 'unknown', 'speed': '1000', 'name': u'vnet6'}}, 'vmId': 'a766ed65-ac2e-4862-8ff0-0352480cf6f1', 'displayType': 'qxl', 'cpuUser': '42.70', 'disks': {u'vda': {'truesize': '1073741824', 'apparentsize': '1073741824', 'imageID': 'f30c2cb7-a43a-4bf5-82b5-cfe07336f65c'}, u'hdd': {'truesize': '0', 'apparentsize': '0'}, u'hdc': {'truesize': '0', 'apparentsize': '0'}}, 'monitorResponse': '0', 'statsAge': '0.58', 'elapsedTime': '31', 'vmType': 'kvm', 'cpuSys': '26.97', 'guestCPUCount': -1, 'appsList': [], 'guestIPs': ''}]} >Thread-14::DEBUG::2014-07-10 09:03:38,261::BindingXMLRPC::1067::vds::(wrapper) client [10.35.3.13]::call vmGetStats with ('5d49ebac-3f0d-4688-aed0-b3f5fe364000',) {} >Thread-14::DEBUG::2014-07-10 09:03:38,262::vm::598::vm.Vm::(_getCpuStats) vmId=`5d49ebac-3f0d-4688-aed0-b3f5fe364000`::CPU stats not available: 'NoneType' object is unsubscriptable >Thread-14::DEBUG::2014-07-10 09:03:38,262::vm::654::vm.Vm::(_getNetworkStats) vmId=`5d49ebac-3f0d-4688-aed0-b3f5fe364000`::Network stats not available >Thread-14::DEBUG::2014-07-10 09:03:38,262::vm::676::vm.Vm::(_getDiskStats) vmId=`5d49ebac-3f0d-4688-aed0-b3f5fe364000`::Disk hdd stats not available >Thread-14::DEBUG::2014-07-10 09:03:38,262::vm::676::vm.Vm::(_getDiskStats) vmId=`5d49ebac-3f0d-4688-aed0-b3f5fe364000`::Disk hdc stats not available >Thread-14::DEBUG::2014-07-10 09:03:38,263::vm::676::vm.Vm::(_getDiskStats) vmId=`5d49ebac-3f0d-4688-aed0-b3f5fe364000`::Disk vda stats not available >Thread-14::DEBUG::2014-07-10 09:03:38,263::vm::715::vm.Vm::(_getDiskLatency) vmId=`5d49ebac-3f0d-4688-aed0-b3f5fe364000`::Disk hdd latency not available >Thread-14::DEBUG::2014-07-10 09:03:38,263::vm::715::vm.Vm::(_getDiskLatency) vmId=`5d49ebac-3f0d-4688-aed0-b3f5fe364000`::Disk hdc latency not available >Thread-14::DEBUG::2014-07-10 09:03:38,263::vm::715::vm.Vm::(_getDiskLatency) vmId=`5d49ebac-3f0d-4688-aed0-b3f5fe364000`::Disk vda latency not available >Thread-14::DEBUG::2014-07-10 09:03:38,263::BindingXMLRPC::1074::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Powering up', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '16122', 'displayIp': '0', 'displayPort': u'5914', 'session': 'Unknown', 'displaySecurePort': u'5915', 'timeOffset': '0', 'hash': '8384665493346130205', 'balloonInfo': {'balloon_max': '1048576', 'balloon_target': '1048576', 'balloon_cur': '0', 'balloon_min': '1048576'}, 'pauseCode': 'NOERR', 'clientIp': '', 'kvmEnable': 'true', 'network': {u'vnet7': {'state': 'unknown', 'macAddr': '00:1a:4a:de:6d:89', 'speed': '1000', 'name': u'vnet7'}}, 'vmId': '5d49ebac-3f0d-4688-aed0-b3f5fe364000', 'displayType': 'qxl', 'cpuUser': '0.00', 'disks': {u'vda': {'truesize': '1073741824', 'apparentsize': '1073741824', 'imageID': 'cfaeead2-7caa-467c-b389-c89840ae6605'}, u'hdd': {'truesize': '0', 'apparentsize': '0'}, u'hdc': {'truesize': '0', 'apparentsize': '0'}}, 'monitorResponse': '0', 'statsAge': '1.37', 'elapsedTime': '11', 'vmType': 'kvm', 'cpuSys': '0.00', 'guestCPUCount': -1, 'appsList': [], 'guestIPs': ''}]} >Dummy-33::DEBUG::2014-07-10 09:03:38,922::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:03:39,025::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0485203 s, 21.1 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-07-10 09:03:40,368::vmChannels::95::vds::(_handle_timeouts) Timeout on fileno 67. >Dummy-33::DEBUG::2014-07-10 09:03:41,040::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:03:41,140::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0480548 s, 21.3 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 09:03:41,277::BindingXMLRPC::1067::vds::(wrapper) client [10.35.3.13]::call vmGetStats with ('a766ed65-ac2e-4862-8ff0-0352480cf6f1',) {} >Thread-14::DEBUG::2014-07-10 09:03:41,278::vm::676::vm.Vm::(_getDiskStats) vmId=`a766ed65-ac2e-4862-8ff0-0352480cf6f1`::Disk hdd stats not available >Thread-14::DEBUG::2014-07-10 09:03:41,278::vm::676::vm.Vm::(_getDiskStats) vmId=`a766ed65-ac2e-4862-8ff0-0352480cf6f1`::Disk hdc stats not available >Thread-14::DEBUG::2014-07-10 09:03:41,279::vm::676::vm.Vm::(_getDiskStats) vmId=`a766ed65-ac2e-4862-8ff0-0352480cf6f1`::Disk vda stats not available >Thread-14::DEBUG::2014-07-10 09:03:41,279::vm::715::vm.Vm::(_getDiskLatency) vmId=`a766ed65-ac2e-4862-8ff0-0352480cf6f1`::Disk hdd latency not available >Thread-14::DEBUG::2014-07-10 09:03:41,279::vm::715::vm.Vm::(_getDiskLatency) vmId=`a766ed65-ac2e-4862-8ff0-0352480cf6f1`::Disk hdc latency not available >Thread-14::DEBUG::2014-07-10 09:03:41,279::vm::715::vm.Vm::(_getDiskLatency) vmId=`a766ed65-ac2e-4862-8ff0-0352480cf6f1`::Disk vda latency not available >Thread-14::DEBUG::2014-07-10 09:03:41,280::BindingXMLRPC::1074::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Powering up', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '15456', 'displayIp': '0', 'displayPort': u'5912', 'session': 'Unknown', 'displaySecurePort': u'5913', 'timeOffset': '0', 'hash': '1078195817470092527', 'balloonInfo': {'balloon_max': '1048576', 'balloon_target': '1048576', 'balloon_cur': '1048576', 'balloon_min': '1048576'}, 'pauseCode': 'NOERR', 'clientIp': '', 'kvmEnable': 'true', 'network': {u'vnet6': {'macAddr': '00:1a:4a:de:6d:88', 'rxDropped': '0', 'rxErrors': '0', 'txDropped': '0', 'txRate': '0.0', 'rxRate': '0.0', 'txErrors': '0', 'state': 'unknown', 'speed': '1000', 'name': u'vnet6'}}, 'vmId': 'a766ed65-ac2e-4862-8ff0-0352480cf6f1', 'displayType': 'qxl', 'cpuUser': '36.84', 'disks': {u'vda': {'truesize': '1073741824', 'apparentsize': '1073741824', 'imageID': 'f30c2cb7-a43a-4bf5-82b5-cfe07336f65c'}, u'hdd': {'truesize': '0', 'apparentsize': '0'}, u'hdc': {'truesize': '0', 'apparentsize': '0'}}, 'monitorResponse': '0', 'statsAge': '1.60', 'elapsedTime': '34', 'vmType': 'kvm', 'cpuSys': '4.25', 'guestCPUCount': -1, 'appsList': [], 'guestIPs': ''}]} >Thread-14::DEBUG::2014-07-10 09:03:41,285::BindingXMLRPC::1067::vds::(wrapper) client [10.35.3.13]::call vmGetStats with ('5d49ebac-3f0d-4688-aed0-b3f5fe364000',) {} >Thread-14::DEBUG::2014-07-10 09:03:41,285::vm::598::vm.Vm::(_getCpuStats) vmId=`5d49ebac-3f0d-4688-aed0-b3f5fe364000`::CPU stats not available: 'NoneType' object is unsubscriptable >Thread-14::DEBUG::2014-07-10 09:03:41,285::vm::654::vm.Vm::(_getNetworkStats) vmId=`5d49ebac-3f0d-4688-aed0-b3f5fe364000`::Network stats not available >Thread-14::DEBUG::2014-07-10 09:03:41,286::vm::676::vm.Vm::(_getDiskStats) vmId=`5d49ebac-3f0d-4688-aed0-b3f5fe364000`::Disk hdd stats not available >Thread-14::DEBUG::2014-07-10 09:03:41,286::vm::676::vm.Vm::(_getDiskStats) vmId=`5d49ebac-3f0d-4688-aed0-b3f5fe364000`::Disk hdc stats not available >Thread-14::DEBUG::2014-07-10 09:03:41,286::vm::676::vm.Vm::(_getDiskStats) vmId=`5d49ebac-3f0d-4688-aed0-b3f5fe364000`::Disk vda stats not available >Thread-14::DEBUG::2014-07-10 09:03:41,286::vm::715::vm.Vm::(_getDiskLatency) vmId=`5d49ebac-3f0d-4688-aed0-b3f5fe364000`::Disk hdd latency not available >Thread-14::DEBUG::2014-07-10 09:03:41,287::vm::715::vm.Vm::(_getDiskLatency) vmId=`5d49ebac-3f0d-4688-aed0-b3f5fe364000`::Disk hdc latency not available >Thread-14::DEBUG::2014-07-10 09:03:41,287::vm::715::vm.Vm::(_getDiskLatency) vmId=`5d49ebac-3f0d-4688-aed0-b3f5fe364000`::Disk vda latency not available >Thread-14::DEBUG::2014-07-10 09:03:41,287::BindingXMLRPC::1074::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Powering up', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '16122', 'displayIp': '0', 'displayPort': u'5914', 'session': 'Unknown', 'displaySecurePort': u'5915', 'timeOffset': '0', 'hash': '8384665493346130205', 'balloonInfo': {'balloon_max': '1048576', 'balloon_target': '1048576', 'balloon_cur': '0', 'balloon_min': '1048576'}, 'pauseCode': 'NOERR', 'clientIp': '', 'kvmEnable': 'true', 'network': {u'vnet7': {'state': 'unknown', 'macAddr': '00:1a:4a:de:6d:89', 'speed': '1000', 'name': u'vnet7'}}, 'vmId': '5d49ebac-3f0d-4688-aed0-b3f5fe364000', 'displayType': 'qxl', 'cpuUser': '0.00', 'disks': {u'vda': {'truesize': '1073741824', 'apparentsize': '1073741824', 'imageID': 'cfaeead2-7caa-467c-b389-c89840ae6605'}, u'hdd': {'truesize': '0', 'apparentsize': '0'}, u'hdc': {'truesize': '0', 'apparentsize': '0'}}, 'monitorResponse': '0', 'statsAge': '0.38', 'elapsedTime': '14', 'vmType': 'kvm', 'cpuSys': '0.00', 'guestCPUCount': -1, 'appsList': [], 'guestIPs': ''}]} >GuestMonitor-scale_8::DEBUG::2014-07-10 09:03:42,965::vm::598::vm.Vm::(_getCpuStats) vmId=`5d49ebac-3f0d-4688-aed0-b3f5fe364000`::CPU stats not available: 'NoneType' object is unsubscriptable >GuestMonitor-scale_8::DEBUG::2014-07-10 09:03:42,965::vm::654::vm.Vm::(_getNetworkStats) vmId=`5d49ebac-3f0d-4688-aed0-b3f5fe364000`::Network stats not available >GuestMonitor-scale_8::DEBUG::2014-07-10 09:03:42,965::vm::676::vm.Vm::(_getDiskStats) vmId=`5d49ebac-3f0d-4688-aed0-b3f5fe364000`::Disk hdd stats not available >GuestMonitor-scale_8::DEBUG::2014-07-10 09:03:42,966::vm::676::vm.Vm::(_getDiskStats) vmId=`5d49ebac-3f0d-4688-aed0-b3f5fe364000`::Disk hdc stats not available >GuestMonitor-scale_8::DEBUG::2014-07-10 09:03:42,966::vm::676::vm.Vm::(_getDiskStats) vmId=`5d49ebac-3f0d-4688-aed0-b3f5fe364000`::Disk vda stats not available >GuestMonitor-scale_8::DEBUG::2014-07-10 09:03:42,966::vm::715::vm.Vm::(_getDiskLatency) vmId=`5d49ebac-3f0d-4688-aed0-b3f5fe364000`::Disk hdd latency not available >GuestMonitor-scale_8::DEBUG::2014-07-10 09:03:42,966::vm::715::vm.Vm::(_getDiskLatency) vmId=`5d49ebac-3f0d-4688-aed0-b3f5fe364000`::Disk hdc latency not available >GuestMonitor-scale_8::DEBUG::2014-07-10 09:03:42,967::vm::715::vm.Vm::(_getDiskLatency) vmId=`5d49ebac-3f0d-4688-aed0-b3f5fe364000`::Disk vda latency not available >GuestMonitor-scale_8::DEBUG::2014-07-10 09:03:42,967::vm::598::vm.Vm::(_getCpuStats) vmId=`5d49ebac-3f0d-4688-aed0-b3f5fe364000`::CPU stats not available: 'NoneType' object is unsubscriptable >GuestMonitor-scale_8::DEBUG::2014-07-10 09:03:42,967::vm::654::vm.Vm::(_getNetworkStats) vmId=`5d49ebac-3f0d-4688-aed0-b3f5fe364000`::Network stats not available >GuestMonitor-scale_8::DEBUG::2014-07-10 09:03:42,968::vm::676::vm.Vm::(_getDiskStats) vmId=`5d49ebac-3f0d-4688-aed0-b3f5fe364000`::Disk hdd stats not available >GuestMonitor-scale_8::DEBUG::2014-07-10 09:03:42,968::vm::676::vm.Vm::(_getDiskStats) vmId=`5d49ebac-3f0d-4688-aed0-b3f5fe364000`::Disk hdc stats not available >GuestMonitor-scale_8::DEBUG::2014-07-10 09:03:42,968::vm::676::vm.Vm::(_getDiskStats) vmId=`5d49ebac-3f0d-4688-aed0-b3f5fe364000`::Disk vda stats not available >GuestMonitor-scale_8::DEBUG::2014-07-10 09:03:42,968::vm::715::vm.Vm::(_getDiskLatency) vmId=`5d49ebac-3f0d-4688-aed0-b3f5fe364000`::Disk hdd latency not available >GuestMonitor-scale_8::DEBUG::2014-07-10 09:03:42,968::vm::715::vm.Vm::(_getDiskLatency) vmId=`5d49ebac-3f0d-4688-aed0-b3f5fe364000`::Disk hdc latency not available >GuestMonitor-scale_8::DEBUG::2014-07-10 09:03:42,969::vm::715::vm.Vm::(_getDiskLatency) vmId=`5d49ebac-3f0d-4688-aed0-b3f5fe364000`::Disk vda latency not available >GuestMonitor-scale_7::DEBUG::2014-07-10 09:03:43,071::vm::676::vm.Vm::(_getDiskStats) vmId=`a766ed65-ac2e-4862-8ff0-0352480cf6f1`::Disk hdd stats not available >GuestMonitor-scale_7::DEBUG::2014-07-10 09:03:43,072::vm::676::vm.Vm::(_getDiskStats) vmId=`a766ed65-ac2e-4862-8ff0-0352480cf6f1`::Disk hdc stats not available >GuestMonitor-scale_7::DEBUG::2014-07-10 09:03:43,072::vm::676::vm.Vm::(_getDiskStats) vmId=`a766ed65-ac2e-4862-8ff0-0352480cf6f1`::Disk vda stats not available >GuestMonitor-scale_7::DEBUG::2014-07-10 09:03:43,072::vm::715::vm.Vm::(_getDiskLatency) vmId=`a766ed65-ac2e-4862-8ff0-0352480cf6f1`::Disk hdd latency not available >GuestMonitor-scale_7::DEBUG::2014-07-10 09:03:43,072::vm::715::vm.Vm::(_getDiskLatency) vmId=`a766ed65-ac2e-4862-8ff0-0352480cf6f1`::Disk hdc latency not available >GuestMonitor-scale_7::DEBUG::2014-07-10 09:03:43,072::vm::715::vm.Vm::(_getDiskLatency) vmId=`a766ed65-ac2e-4862-8ff0-0352480cf6f1`::Disk vda latency not available >GuestMonitor-scale_7::DEBUG::2014-07-10 09:03:43,073::vm::676::vm.Vm::(_getDiskStats) vmId=`a766ed65-ac2e-4862-8ff0-0352480cf6f1`::Disk hdd stats not available >GuestMonitor-scale_7::DEBUG::2014-07-10 09:03:43,073::vm::676::vm.Vm::(_getDiskStats) vmId=`a766ed65-ac2e-4862-8ff0-0352480cf6f1`::Disk hdc stats not available >GuestMonitor-scale_7::DEBUG::2014-07-10 09:03:43,073::vm::676::vm.Vm::(_getDiskStats) vmId=`a766ed65-ac2e-4862-8ff0-0352480cf6f1`::Disk vda stats not available >GuestMonitor-scale_7::DEBUG::2014-07-10 09:03:43,074::vm::715::vm.Vm::(_getDiskLatency) vmId=`a766ed65-ac2e-4862-8ff0-0352480cf6f1`::Disk hdd latency not available >GuestMonitor-scale_7::DEBUG::2014-07-10 09:03:43,074::vm::715::vm.Vm::(_getDiskLatency) vmId=`a766ed65-ac2e-4862-8ff0-0352480cf6f1`::Disk hdc latency not available >GuestMonitor-scale_7::DEBUG::2014-07-10 09:03:43,074::vm::715::vm.Vm::(_getDiskLatency) vmId=`a766ed65-ac2e-4862-8ff0-0352480cf6f1`::Disk vda latency not available >GuestMonitor-scale_6::DEBUG::2014-07-10 09:03:43,107::vm::676::vm.Vm::(_getDiskStats) vmId=`7fc21bb8-bd92-4924-acef-8360998e92a1`::Disk hdd stats not available >GuestMonitor-scale_6::DEBUG::2014-07-10 09:03:43,111::vm::676::vm.Vm::(_getDiskStats) vmId=`7fc21bb8-bd92-4924-acef-8360998e92a1`::Disk hdc stats not available >GuestMonitor-scale_6::DEBUG::2014-07-10 09:03:43,112::vm::676::vm.Vm::(_getDiskStats) vmId=`7fc21bb8-bd92-4924-acef-8360998e92a1`::Disk vda stats not available >GuestMonitor-scale_6::DEBUG::2014-07-10 09:03:43,113::vm::715::vm.Vm::(_getDiskLatency) vmId=`7fc21bb8-bd92-4924-acef-8360998e92a1`::Disk hdd latency not available >GuestMonitor-scale_6::DEBUG::2014-07-10 09:03:43,113::vm::715::vm.Vm::(_getDiskLatency) vmId=`7fc21bb8-bd92-4924-acef-8360998e92a1`::Disk hdc latency not available >GuestMonitor-scale_6::DEBUG::2014-07-10 09:03:43,113::vm::715::vm.Vm::(_getDiskLatency) vmId=`7fc21bb8-bd92-4924-acef-8360998e92a1`::Disk vda latency not available >GuestMonitor-scale_6::DEBUG::2014-07-10 09:03:43,114::vm::676::vm.Vm::(_getDiskStats) vmId=`7fc21bb8-bd92-4924-acef-8360998e92a1`::Disk hdd stats not available >GuestMonitor-scale_6::DEBUG::2014-07-10 09:03:43,114::vm::676::vm.Vm::(_getDiskStats) vmId=`7fc21bb8-bd92-4924-acef-8360998e92a1`::Disk hdc stats not available >GuestMonitor-scale_6::DEBUG::2014-07-10 09:03:43,115::vm::676::vm.Vm::(_getDiskStats) vmId=`7fc21bb8-bd92-4924-acef-8360998e92a1`::Disk vda stats not available >GuestMonitor-scale_6::DEBUG::2014-07-10 09:03:43,115::vm::715::vm.Vm::(_getDiskLatency) vmId=`7fc21bb8-bd92-4924-acef-8360998e92a1`::Disk hdd latency not available >GuestMonitor-scale_6::DEBUG::2014-07-10 09:03:43,115::vm::715::vm.Vm::(_getDiskLatency) vmId=`7fc21bb8-bd92-4924-acef-8360998e92a1`::Disk hdc latency not available >GuestMonitor-scale_6::DEBUG::2014-07-10 09:03:43,116::vm::715::vm.Vm::(_getDiskLatency) vmId=`7fc21bb8-bd92-4924-acef-8360998e92a1`::Disk vda latency not available >Dummy-33::DEBUG::2014-07-10 09:03:43,156::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:03:43,311::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0914489 s, 11.2 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 09:03:43,694::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-14::DEBUG::2014-07-10 09:03:43,695::task::595::TaskManager.Task::(_updateState) Task=`4239b030-d680-4df7-aa21-10dd1bb0442c`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 09:03:43,695::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-14::INFO::2014-07-10 09:03:43,696::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:03:43,696::task::1185::TaskManager.Task::(prepare) Task=`4239b030-d680-4df7-aa21-10dd1bb0442c`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:03:43,696::task::595::TaskManager.Task::(_updateState) Task=`4239b030-d680-4df7-aa21-10dd1bb0442c`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 09:03:43,697::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 09:03:43,697::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 09:03:43,697::task::990::TaskManager.Task::(_decref) Task=`4239b030-d680-4df7-aa21-10dd1bb0442c`::ref 0 aborting False >Thread-34::DEBUG::2014-07-10 09:03:43,703::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-34::DEBUG::2014-07-10 09:03:43,703::task::595::TaskManager.Task::(_updateState) Task=`e531d380-9107-4935-b49d-40112d3e47ca`::moving from state init -> state preparing >Thread-34::INFO::2014-07-10 09:03:43,704::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-34::DEBUG::2014-07-10 09:03:43,706::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`cee9b578-a106-4127-8488-cf3ec711546b`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-10 09:03:43,706::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' for lock type 'shared' >Thread-34::DEBUG::2014-07-10 09:03:43,706::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-10 09:03:43,706::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`cee9b578-a106-4127-8488-cf3ec711546b`::Granted request >Thread-34::DEBUG::2014-07-10 09:03:43,707::task::827::TaskManager.Task::(resourceAcquired) Task=`e531d380-9107-4935-b49d-40112d3e47ca`::_resourcesAcquired: Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee (shared) >Thread-34::DEBUG::2014-07-10 09:03:43,707::task::990::TaskManager.Task::(_decref) Task=`e531d380-9107-4935-b49d-40112d3e47ca`::ref 1 aborting False >Thread-34::INFO::2014-07-10 09:03:43,708::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1074547130368', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532068433920', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:03:43,708::task::1185::TaskManager.Task::(prepare) Task=`e531d380-9107-4935-b49d-40112d3e47ca`::finished: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1074547130368', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532068433920', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:03:43,709::task::595::TaskManager.Task::(_updateState) Task=`e531d380-9107-4935-b49d-40112d3e47ca`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-10 09:03:43,709::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee': < ResourceRef 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-10 09:03:43,709::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-10 09:03:43,709::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' >Thread-34::DEBUG::2014-07-10 09:03:43,710::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' (0 active users) >Thread-34::DEBUG::2014-07-10 09:03:43,710::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-10 09:03:43,710::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', Clearing records. >Thread-34::DEBUG::2014-07-10 09:03:43,710::task::990::TaskManager.Task::(_decref) Task=`e531d380-9107-4935-b49d-40112d3e47ca`::ref 0 aborting False >Thread-14::DEBUG::2014-07-10 09:03:44,301::BindingXMLRPC::1067::vds::(wrapper) client [10.35.3.13]::call vmGetStats with ('a766ed65-ac2e-4862-8ff0-0352480cf6f1',) {} >Thread-14::DEBUG::2014-07-10 09:03:44,302::vm::676::vm.Vm::(_getDiskStats) vmId=`a766ed65-ac2e-4862-8ff0-0352480cf6f1`::Disk hdd stats not available >Thread-14::DEBUG::2014-07-10 09:03:44,302::vm::676::vm.Vm::(_getDiskStats) vmId=`a766ed65-ac2e-4862-8ff0-0352480cf6f1`::Disk hdc stats not available >Thread-14::DEBUG::2014-07-10 09:03:44,302::vm::676::vm.Vm::(_getDiskStats) vmId=`a766ed65-ac2e-4862-8ff0-0352480cf6f1`::Disk vda stats not available >Thread-14::DEBUG::2014-07-10 09:03:44,302::vm::715::vm.Vm::(_getDiskLatency) vmId=`a766ed65-ac2e-4862-8ff0-0352480cf6f1`::Disk hdd latency not available >Thread-14::DEBUG::2014-07-10 09:03:44,302::vm::715::vm.Vm::(_getDiskLatency) vmId=`a766ed65-ac2e-4862-8ff0-0352480cf6f1`::Disk hdc latency not available >Thread-14::DEBUG::2014-07-10 09:03:44,303::vm::715::vm.Vm::(_getDiskLatency) vmId=`a766ed65-ac2e-4862-8ff0-0352480cf6f1`::Disk vda latency not available >Thread-14::DEBUG::2014-07-10 09:03:44,303::BindingXMLRPC::1074::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Powering up', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '15456', 'displayIp': '0', 'displayPort': u'5912', 'session': 'Unknown', 'displaySecurePort': u'5913', 'timeOffset': '0', 'hash': '1078195817470092527', 'balloonInfo': {'balloon_max': '1048576', 'balloon_target': '1048576', 'balloon_cur': '1048576', 'balloon_min': '1048576'}, 'pauseCode': 'NOERR', 'clientIp': '', 'kvmEnable': 'true', 'network': {u'vnet6': {'macAddr': '00:1a:4a:de:6d:88', 'rxDropped': '0', 'rxErrors': '0', 'txDropped': '0', 'txRate': '0.0', 'rxRate': '0.0', 'txErrors': '0', 'state': 'unknown', 'speed': '1000', 'name': u'vnet6'}}, 'vmId': 'a766ed65-ac2e-4862-8ff0-0352480cf6f1', 'displayType': 'qxl', 'cpuUser': '36.84', 'disks': {u'vda': {'truesize': '1073741824', 'apparentsize': '1073741824', 'imageID': 'f30c2cb7-a43a-4bf5-82b5-cfe07336f65c'}, u'hdd': {'truesize': '0', 'apparentsize': '0'}, u'hdc': {'truesize': '0', 'apparentsize': '0'}}, 'monitorResponse': '0', 'statsAge': '0.60', 'elapsedTime': '37', 'vmType': 'kvm', 'cpuSys': '4.25', 'guestCPUCount': -1, 'appsList': [], 'guestIPs': ''}]} >Thread-14::DEBUG::2014-07-10 09:03:44,308::BindingXMLRPC::1067::vds::(wrapper) client [10.35.3.13]::call vmGetStats with ('5d49ebac-3f0d-4688-aed0-b3f5fe364000',) {} >Thread-14::DEBUG::2014-07-10 09:03:44,308::vm::676::vm.Vm::(_getDiskStats) vmId=`5d49ebac-3f0d-4688-aed0-b3f5fe364000`::Disk hdd stats not available >Thread-14::DEBUG::2014-07-10 09:03:44,308::vm::676::vm.Vm::(_getDiskStats) vmId=`5d49ebac-3f0d-4688-aed0-b3f5fe364000`::Disk hdc stats not available >Thread-14::DEBUG::2014-07-10 09:03:44,308::vm::676::vm.Vm::(_getDiskStats) vmId=`5d49ebac-3f0d-4688-aed0-b3f5fe364000`::Disk vda stats not available >Thread-14::DEBUG::2014-07-10 09:03:44,309::vm::715::vm.Vm::(_getDiskLatency) vmId=`5d49ebac-3f0d-4688-aed0-b3f5fe364000`::Disk hdd latency not available >Thread-14::DEBUG::2014-07-10 09:03:44,309::vm::715::vm.Vm::(_getDiskLatency) vmId=`5d49ebac-3f0d-4688-aed0-b3f5fe364000`::Disk hdc latency not available >Thread-14::DEBUG::2014-07-10 09:03:44,310::vm::715::vm.Vm::(_getDiskLatency) vmId=`5d49ebac-3f0d-4688-aed0-b3f5fe364000`::Disk vda latency not available >Thread-14::DEBUG::2014-07-10 09:03:44,310::BindingXMLRPC::1074::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Powering up', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '16122', 'displayIp': '0', 'displayPort': u'5914', 'session': 'Unknown', 'displaySecurePort': u'5915', 'timeOffset': '0', 'hash': '8384665493346130205', 'balloonInfo': {'balloon_max': '1048576', 'balloon_target': '1048576', 'balloon_cur': '1048576', 'balloon_min': '1048576'}, 'pauseCode': 'NOERR', 'clientIp': '', 'kvmEnable': 'true', 'network': {u'vnet7': {'macAddr': '00:1a:4a:de:6d:89', 'rxDropped': '0', 'rxErrors': '0', 'txDropped': '0', 'txRate': '0.0', 'rxRate': '0.0', 'txErrors': '0', 'state': 'unknown', 'speed': '1000', 'name': u'vnet7'}}, 'vmId': '5d49ebac-3f0d-4688-aed0-b3f5fe364000', 'displayType': 'qxl', 'cpuUser': '40.62', 'disks': {u'vda': {'truesize': '1073741824', 'apparentsize': '1073741824', 'imageID': 'cfaeead2-7caa-467c-b389-c89840ae6605'}, u'hdd': {'truesize': '0', 'apparentsize': '0'}, u'hdc': {'truesize': '0', 'apparentsize': '0'}}, 'monitorResponse': '0', 'statsAge': '0.39', 'elapsedTime': '17', 'vmType': 'kvm', 'cpuSys': '25.33', 'guestCPUCount': -1, 'appsList': [], 'guestIPs': ''}]} >Thread-40::DEBUG::2014-07-10 09:03:44,704::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lion.qa.lab.tlv.redhat.com:_export_yuri2_backup2/6a70504d-00df-4869-8695-0f442053f6b6/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-40::DEBUG::2014-07-10 09:03:44,725::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n369 bytes (369 B) copied, 0.00051727 s, 713 kB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:03:45,326::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:03:45,465::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0808422 s, 12.7 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 09:03:45,486::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-14::DEBUG::2014-07-10 09:03:45,487::task::595::TaskManager.Task::(_updateState) Task=`e2448bfb-cbe3-425f-9e95-1bb6b556e724`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 09:03:45,487::logUtils::44::dispatcher::(wrapper) Run and protect: getAllTasksStatuses(spUUID=None, options=None) >Thread-14::DEBUG::2014-07-10 09:03:45,488::taskManager::102::TaskManager::(getAllTasksStatuses) Entry. >Thread-14::DEBUG::2014-07-10 09:03:45,488::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: a7c00320-f8fd-4896-b42d-77dfb009c02a >Thread-14::DEBUG::2014-07-10 09:03:45,488::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': '1 jobs completed successfully', 'taskState': 'finished', 'taskResult': 'success', 'taskID': 'a7c00320-f8fd-4896-b42d-77dfb009c02a'} >Thread-14::DEBUG::2014-07-10 09:03:45,488::taskManager::113::TaskManager::(getAllTasksStatuses) Return: {'a7c00320-f8fd-4896-b42d-77dfb009c02a': {'code': 0, 'message': '1 jobs completed successfully', 'taskState': 'finished', 'taskResult': 'success', 'taskID': 'a7c00320-f8fd-4896-b42d-77dfb009c02a'}} >Thread-14::INFO::2014-07-10 09:03:45,488::logUtils::47::dispatcher::(wrapper) Run and protect: getAllTasksStatuses, Return response: {'allTasksStatus': {'a7c00320-f8fd-4896-b42d-77dfb009c02a': {'code': 0, 'message': '1 jobs completed successfully', 'taskState': 'finished', 'taskResult': 'success', 'taskID': 'a7c00320-f8fd-4896-b42d-77dfb009c02a'}}} >Thread-14::DEBUG::2014-07-10 09:03:45,489::task::1185::TaskManager.Task::(prepare) Task=`e2448bfb-cbe3-425f-9e95-1bb6b556e724`::finished: {'allTasksStatus': {'a7c00320-f8fd-4896-b42d-77dfb009c02a': {'code': 0, 'message': '1 jobs completed successfully', 'taskState': 'finished', 'taskResult': 'success', 'taskID': 'a7c00320-f8fd-4896-b42d-77dfb009c02a'}}} >Thread-14::DEBUG::2014-07-10 09:03:45,489::task::595::TaskManager.Task::(_updateState) Task=`e2448bfb-cbe3-425f-9e95-1bb6b556e724`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 09:03:45,489::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 09:03:45,489::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 09:03:45,489::task::990::TaskManager.Task::(_decref) Task=`e2448bfb-cbe3-425f-9e95-1bb6b556e724`::ref 0 aborting False >Thread-34::DEBUG::2014-07-10 09:03:45,526::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [2e5379cf] >Thread-34::DEBUG::2014-07-10 09:03:45,526::task::595::TaskManager.Task::(_updateState) Task=`fb9a96d0-210a-4b30-8e73-a86b4505b248`::moving from state init -> state preparing >Thread-34::INFO::2014-07-10 09:03:45,527::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeInfo(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='c01d693b-cba0-4fed-9ad7-0aaa28912a19', volUUID='4bb5d954-2a50-4028-b299-0b43c261270c', options=None) >Thread-34::DEBUG::2014-07-10 09:03:45,527::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.9e1aa540-1f4e-4ee3-a152-be381ef6c3bd`ReqID=`29d2f50f-0c67-4d97-8440-91f295bf8391`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '3089' at 'getVolumeInfo' >Thread-34::DEBUG::2014-07-10 09:03:45,528::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.9e1aa540-1f4e-4ee3-a152-be381ef6c3bd' for lock type 'shared' >Thread-34::DEBUG::2014-07-10 09:03:45,528::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.9e1aa540-1f4e-4ee3-a152-be381ef6c3bd' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-10 09:03:45,528::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.9e1aa540-1f4e-4ee3-a152-be381ef6c3bd`ReqID=`29d2f50f-0c67-4d97-8440-91f295bf8391`::Granted request >Thread-34::DEBUG::2014-07-10 09:03:45,529::task::827::TaskManager.Task::(resourceAcquired) Task=`fb9a96d0-210a-4b30-8e73-a86b4505b248`::_resourcesAcquired: Storage.9e1aa540-1f4e-4ee3-a152-be381ef6c3bd (shared) >Thread-34::DEBUG::2014-07-10 09:03:45,529::task::990::TaskManager.Task::(_decref) Task=`fb9a96d0-210a-4b30-8e73-a86b4505b248`::ref 1 aborting False >Thread-34::DEBUG::2014-07-10 09:03:45,529::lvm::427::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' got the operation mutex >Thread-34::DEBUG::2014-07-10 09:03:45,530::lvm::296::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm lvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/3600601601282300032826addbbdae311|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,vg_name,attr,size,seg_start_pe,devices,tags 9e1aa540-1f4e-4ee3-a152-be381ef6c3bd' (cwd None) >Thread-34::DEBUG::2014-07-10 09:03:45,751::lvm::296::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-34::DEBUG::2014-07-10 09:03:45,767::lvm::462::Storage.LVM::(_reloadlvs) lvs reloaded >Thread-34::DEBUG::2014-07-10 09:03:45,768::lvm::462::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' released the operation mutex >Thread-34::INFO::2014-07-10 09:03:45,768::volume::879::Storage.Volume::(getInfo) Info request: sdUUID=9e1aa540-1f4e-4ee3-a152-be381ef6c3bd imgUUID=c01d693b-cba0-4fed-9ad7-0aaa28912a19 volUUID = 4bb5d954-2a50-4028-b299-0b43c261270c >Thread-34::DEBUG::2014-07-10 09:03:45,769::blockVolume::572::Storage.Misc.excCmd::(getMetadata) '/bin/dd iflag=direct skip=13 bs=512 if=/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/metadata count=1' (cwd None) >Thread-34::DEBUG::2014-07-10 09:03:45,786::blockVolume::572::Storage.Misc.excCmd::(getMetadata) SUCCESS: <err> = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.000529052 s, 968 kB/s\n'; <rc> = 0 >Thread-34::DEBUG::2014-07-10 09:03:45,786::misc::282::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.000529052 s, 968 kB/s'], size: 512 >Thread-34::DEBUG::2014-07-10 09:03:45,787::blockVolume::572::Storage.Misc.excCmd::(getMetadata) '/bin/dd iflag=direct skip=13 bs=512 if=/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/metadata count=1' (cwd None) >Thread-34::DEBUG::2014-07-10 09:03:45,807::blockVolume::572::Storage.Misc.excCmd::(getMetadata) SUCCESS: <err> = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.000505269 s, 1.0 MB/s\n'; <rc> = 0 >Thread-34::DEBUG::2014-07-10 09:03:45,808::misc::282::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.000505269 s, 1.0 MB/s'], size: 512 >Thread-34::INFO::2014-07-10 09:03:45,809::volume::909::Storage.Volume::(getInfo) 9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/c01d693b-cba0-4fed-9ad7-0aaa28912a19/4bb5d954-2a50-4028-b299-0b43c261270c info is {'status': 'OK', 'domain': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'voltype': 'LEAF', 'description': '', 'parent': '47592965-e853-4e59-9728-d11cca6a7a8a', 'format': 'COW', 'image': 'c01d693b-cba0-4fed-9ad7-0aaa28912a19', 'ctime': '1404983017', 'disktype': '2', 'legality': 'LEGAL', 'mtime': '1404983017', 'apparentsize': '1073741824', 'children': [], 'pool': '', 'capacity': '10737418240', 'uuid': '4bb5d954-2a50-4028-b299-0b43c261270c', 'truesize': '1073741824', 'type': 'SPARSE'} >Thread-34::INFO::2014-07-10 09:03:45,809::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeInfo, Return response: {'info': {'status': 'OK', 'domain': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'voltype': 'LEAF', 'description': '', 'parent': '47592965-e853-4e59-9728-d11cca6a7a8a', 'format': 'COW', 'image': 'c01d693b-cba0-4fed-9ad7-0aaa28912a19', 'ctime': '1404983017', 'disktype': '2', 'legality': 'LEGAL', 'mtime': '1404983017', 'apparentsize': '1073741824', 'children': [], 'pool': '', 'capacity': '10737418240', 'uuid': '4bb5d954-2a50-4028-b299-0b43c261270c', 'truesize': '1073741824', 'type': 'SPARSE'}} >Thread-34::DEBUG::2014-07-10 09:03:45,809::task::1185::TaskManager.Task::(prepare) Task=`fb9a96d0-210a-4b30-8e73-a86b4505b248`::finished: {'info': {'status': 'OK', 'domain': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'voltype': 'LEAF', 'description': '', 'parent': '47592965-e853-4e59-9728-d11cca6a7a8a', 'format': 'COW', 'image': 'c01d693b-cba0-4fed-9ad7-0aaa28912a19', 'ctime': '1404983017', 'disktype': '2', 'legality': 'LEGAL', 'mtime': '1404983017', 'apparentsize': '1073741824', 'children': [], 'pool': '', 'capacity': '10737418240', 'uuid': '4bb5d954-2a50-4028-b299-0b43c261270c', 'truesize': '1073741824', 'type': 'SPARSE'}} >Thread-34::DEBUG::2014-07-10 09:03:45,810::task::595::TaskManager.Task::(_updateState) Task=`fb9a96d0-210a-4b30-8e73-a86b4505b248`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-10 09:03:45,810::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': < ResourceRef 'Storage.9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-10 09:03:45,810::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-10 09:03:45,811::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.9e1aa540-1f4e-4ee3-a152-be381ef6c3bd' >Thread-34::DEBUG::2014-07-10 09:03:45,811::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.9e1aa540-1f4e-4ee3-a152-be381ef6c3bd' (0 active users) >Thread-34::DEBUG::2014-07-10 09:03:45,811::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.9e1aa540-1f4e-4ee3-a152-be381ef6c3bd' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-10 09:03:45,812::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', Clearing records. >Thread-34::DEBUG::2014-07-10 09:03:45,812::task::990::TaskManager.Task::(_decref) Task=`fb9a96d0-210a-4b30-8e73-a86b4505b248`::ref 0 aborting False >Thread-14::DEBUG::2014-07-10 09:03:45,858::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-14::DEBUG::2014-07-10 09:03:45,859::task::595::TaskManager.Task::(_updateState) Task=`7a83f9c5-983a-404a-a6a1-11999494b4ba`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 09:03:45,860::logUtils::44::dispatcher::(wrapper) Run and protect: clearTask(taskID='a7c00320-f8fd-4896-b42d-77dfb009c02a', spUUID=None, options=None) >Thread-14::DEBUG::2014-07-10 09:03:45,860::taskManager::161::TaskManager::(clearTask) Entry. taskID: a7c00320-f8fd-4896-b42d-77dfb009c02a >Thread-14::DEBUG::2014-07-10 09:03:45,862::taskManager::166::TaskManager::(clearTask) Return. >Thread-14::INFO::2014-07-10 09:03:45,862::logUtils::47::dispatcher::(wrapper) Run and protect: clearTask, Return response: None >Thread-14::DEBUG::2014-07-10 09:03:45,862::task::1185::TaskManager.Task::(prepare) Task=`7a83f9c5-983a-404a-a6a1-11999494b4ba`::finished: None >Thread-14::DEBUG::2014-07-10 09:03:45,862::task::595::TaskManager.Task::(_updateState) Task=`7a83f9c5-983a-404a-a6a1-11999494b4ba`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 09:03:45,863::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 09:03:45,863::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 09:03:45,863::task::990::TaskManager.Task::(_decref) Task=`7a83f9c5-983a-404a-a6a1-11999494b4ba`::ref 0 aborting False >Thread-14::DEBUG::2014-07-10 09:03:46,883::BindingXMLRPC::1067::vds::(wrapper) client [10.35.3.13]::call vmCreate with ({'acpiEnable': 'true', 'emulatedMachine': 'rhel6.5.0', 'vmId': '62e7aad5-ff72-4fe3-830f-e7726ed4bfba', 'memGuaranteedSize': 1024, 'spiceSslCipherSuite': 'DEFAULT', 'timeOffset': '0', 'cpuType': 'Conroe', 'custom': {'device_52318f43-0ad5-437d-a160-755af310990adevice_7624e64f-6432-457e-9e04-a8c8f13d17fddevice_874c983b-ba12-48fc-b7f6-f11cbdd043b0device_8d8f9ba7-0396-4b43-9730-8361fd404708': 'VmDevice {vmId=62e7aad5-ff72-4fe3-830f-e7726ed4bfba, deviceId=8d8f9ba7-0396-4b43-9730-8361fd404708, device=ide, type=CONTROLLER, bootOrder=0, specParams={}, address={bus=0x00, domain=0x0000, type=pci, slot=0x01, function=0x1}, managed=false, plugged=true, readOnly=false, deviceAlias=ide0, customProperties={}, snapshotId=null}', 'device_52318f43-0ad5-437d-a160-755af310990adevice_7624e64f-6432-457e-9e04-a8c8f13d17fd': 'VmDevice {vmId=62e7aad5-ff72-4fe3-830f-e7726ed4bfba, deviceId=7624e64f-6432-457e-9e04-a8c8f13d17fd, device=virtio-serial, type=CONTROLLER, bootOrder=0, specParams={}, address={bus=0x00, domain=0x0000, type=pci, slot=0x05, function=0x0}, managed=false, plugged=true, readOnly=false, deviceAlias=virtio-serial0, customProperties={}, snapshotId=null}', 'device_52318f43-0ad5-437d-a160-755af310990adevice_7624e64f-6432-457e-9e04-a8c8f13d17fddevice_874c983b-ba12-48fc-b7f6-f11cbdd043b0': 'VmDevice {vmId=62e7aad5-ff72-4fe3-830f-e7726ed4bfba, deviceId=874c983b-ba12-48fc-b7f6-f11cbdd043b0, device=unix, type=CHANNEL, bootOrder=0, specParams={}, address={port=2, bus=0, controller=0, type=virtio-serial}, managed=false, plugged=true, readOnly=false, deviceAlias=channel1, customProperties={}, snapshotId=null}', 'device_52318f43-0ad5-437d-a160-755af310990a': 'VmDevice {vmId=62e7aad5-ff72-4fe3-830f-e7726ed4bfba, deviceId=52318f43-0ad5-437d-a160-755af310990a, device=unix, type=CHANNEL, bootOrder=0, specParams={}, address={port=1, bus=0, controller=0, type=virtio-serial}, managed=false, plugged=true, readOnly=false, deviceAlias=channel0, customProperties={}, snapshotId=null}', 'device_52318f43-0ad5-437d-a160-755af310990adevice_7624e64f-6432-457e-9e04-a8c8f13d17fddevice_874c983b-ba12-48fc-b7f6-f11cbdd043b0device_8d8f9ba7-0396-4b43-9730-8361fd404708device_ab454efb-6492-4faa-85e7-2ee34a574483': 'VmDevice {vmId=62e7aad5-ff72-4fe3-830f-e7726ed4bfba, deviceId=ab454efb-6492-4faa-85e7-2ee34a574483, device=spicevmc, type=CHANNEL, bootOrder=0, specParams={}, address={port=3, bus=0, controller=0, type=virtio-serial}, managed=false, plugged=true, readOnly=false, deviceAlias=channel2, customProperties={}, snapshotId=null}'}, 'smp': '2', 'vmType': 'kvm', 'memSize': 1024, 'smpCoresPerSocket': '2', 'vmName': 'scale_9', 'nice': '0', 'smartcardEnable': 'false', 'keyboardLayout': 'en-us', 'kvmEnable': 'true', 'pitReinjection': 'false', 'transparentHugePages': 'true', 'devices': [{'index': '3', 'iface': 'ide', 'specParams': {'vmPayload': {'volId': 'config-2', 'file': {'openstack/latest/meta_data.json': 'ewogICJsYXVuY2hfaW5kZXgiIDogIjAiLAogICJhdmFpbGFiaWxpdHlfem9uZSIgOiAibm92YSIs\nCiAgInV1aWQiIDogIjMxYjI4NGMzLWNlYmMtNDk2OS04YTNhLTk1NDFmMjRiMDc0MSIsCiAgIm1l\ndGEiIDogewogICAgImVzc2VudGlhbCIgOiAiZmFsc2UiLAogICAgInJvbGUiIDogInNlcnZlciIs\nCiAgICAiZHNtb2RlIiA6ICJsb2NhbCIKICB9Cn0=\n', 'openstack/latest/user_data': 'I2Nsb3VkLWNvbmZpZwpzc2hfcHdhdXRoOiB0cnVlCmRpc2FibGVfcm9vdDogMApvdXRwdXQ6CiAg\nYWxsOiAnPj4gL3Zhci9sb2cvY2xvdWQtaW5pdC1vdXRwdXQubG9nJwp1c2VyOiByb290CmNocGFz\nc3dkOgogIGV4cGlyZTogZmFsc2UKcnVuY21kOgotICdzZWQgLWkgJycvXmRhdGFzb3VyY2VfbGlz\ndDogL2QnJyAvZXRjL2Nsb3VkL2Nsb3VkLmNmZzsgZWNobyAnJ2RhdGFzb3VyY2VfbGlzdDoKICBb\nIk5vQ2xvdWQiLCAiQ29uZmlnRHJpdmUiXScnID4+IC9ldGMvY2xvdWQvY2xvdWQuY2ZnJwo=\n'}}}, 'readonly': 'true', 'deviceId': '75ca49c2-0e48-493f-af50-1141e671fd35', 'path': '', 'device': 'cdrom', 'shared': 'false', 'type': 'disk'}, {'device': 'qxl', 'specParams': {'vram': '32768', 'ram': '65536', 'heads': '1'}, 'type': 'video', 'deviceId': '06cd48ad-257e-4a93-ba31-955d6a1ba005'}, {'index': '2', 'iface': 'ide', 'specParams': {'path': ''}, 'readonly': 'true', 'deviceId': '50dc8e8d-a318-48bf-8484-0eee6fc9a107', 'path': '', 'device': 'cdrom', 'shared': 'false', 'type': 'disk'}, {'index': 0, 'iface': 'virtio', 'format': 'cow', 'bootOrder': '1', 'poolID': '4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', 'volumeID': '4bb5d954-2a50-4028-b299-0b43c261270c', 'imageID': 'c01d693b-cba0-4fed-9ad7-0aaa28912a19', 'specParams': {}, 'readonly': 'false', 'domainID': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'optional': 'false', 'deviceId': 'c01d693b-cba0-4fed-9ad7-0aaa28912a19', 'address': {'slot': '0x06', 'bus': '0x00', 'domain': '0x0000', 'type': 'pci', 'function': '0x0'}, 'device': 'disk', 'shared': 'false', 'propagateErrors': 'off', 'type': 'disk'}, {'nicModel': 'pv', 'macAddr': '00:1a:4a:de:6d:83', 'linkActive': 'true', 'network': 'rhevm', 'filter': 'vdsm-no-mac-spoofing', 'specParams': {'inbound': {}, 'outbound': {}}, 'deviceId': '4f57f078-b2cc-4e19-8cf0-ddc1c8181814', 'device': 'bridge', 'type': 'interface'}, {'device': 'memballoon', 'specParams': {'model': 'virtio'}, 'type': 'balloon', 'deviceId': '4c67be64-96ae-4ac8-afdc-2da58a06aa42'}, {'index': '0', 'specParams': {}, 'deviceId': '8e755b93-45d7-4f8a-9b88-c7f0117b2b6e', 'address': {'slot': '0x04', 'bus': '0x00', 'domain': '0x0000', 'type': 'pci', 'function': '0x0'}, 'device': 'scsi', 'model': 'virtio-scsi', 'type': 'controller'}], 'maxVCpus': '160', 'spiceSecureChannels': 'smain,sinputs,scursor,splayback,srecord,sdisplay,susbredir,ssmartcard', 'display': 'qxl'},) {} flowID [128eb6ca] >Thread-14::INFO::2014-07-10 09:03:46,888::API::667::vds::(_getNetworkIp) network None: using 0 >Thread-14::INFO::2014-07-10 09:03:46,889::clientIF::366::vds::(createVm) vmContainerLock acquired by vm 62e7aad5-ff72-4fe3-830f-e7726ed4bfba >Thread-14::DEBUG::2014-07-10 09:03:46,895::clientIF::379::vds::(createVm) Total desktops after creation of 62e7aad5-ff72-4fe3-830f-e7726ed4bfba is 9 >Thread-71::DEBUG::2014-07-10 09:03:46,896::vm::2270::vm.Vm::(_startUnderlyingVm) vmId=`62e7aad5-ff72-4fe3-830f-e7726ed4bfba`::Start >Thread-14::DEBUG::2014-07-10 09:03:46,897::BindingXMLRPC::1074::vds::(wrapper) return vmCreate with {'status': {'message': 'Done', 'code': 0}, 'vmList': {'status': 'WaitForLaunch', 'acpiEnable': 'true', 'emulatedMachine': 'rhel6.5.0', 'vmId': '62e7aad5-ff72-4fe3-830f-e7726ed4bfba', 'pid': '0', 'memGuaranteedSize': 1024, 'timeOffset': '0', 'keyboardLayout': 'en-us', 'displayPort': '-1', 'displaySecurePort': '-1', 'spiceSslCipherSuite': 'DEFAULT', 'cpuType': 'Conroe', 'smp': '2', 'clientIp': '', 'nicModel': 'rtl8139,pv', 'smartcardEnable': 'false', 'kvmEnable': 'true', 'pitReinjection': 'false', 'transparentHugePages': 'true', 'devices': [{'index': '3', 'iface': 'ide', 'specParams': {'vmPayload': {'volId': 'config-2', 'file': {'openstack/latest/meta_data.json': 'ewogICJsYXVuY2hfaW5kZXgiIDogIjAiLAogICJhdmFpbGFiaWxpdHlfem9uZSIgOiAibm92YSIs\nCiAgInV1aWQiIDogIjMxYjI4NGMzLWNlYmMtNDk2OS04YTNhLTk1NDFmMjRiMDc0MSIsCiAgIm1l\ndGEiIDogewogICAgImVzc2VudGlhbCIgOiAiZmFsc2UiLAogICAgInJvbGUiIDogInNlcnZlciIs\nCiAgICAiZHNtb2RlIiA6ICJsb2NhbCIKICB9Cn0=\n', 'openstack/latest/user_data': 'I2Nsb3VkLWNvbmZpZwpzc2hfcHdhdXRoOiB0cnVlCmRpc2FibGVfcm9vdDogMApvdXRwdXQ6CiAg\nYWxsOiAnPj4gL3Zhci9sb2cvY2xvdWQtaW5pdC1vdXRwdXQubG9nJwp1c2VyOiByb290CmNocGFz\nc3dkOgogIGV4cGlyZTogZmFsc2UKcnVuY21kOgotICdzZWQgLWkgJycvXmRhdGFzb3VyY2VfbGlz\ndDogL2QnJyAvZXRjL2Nsb3VkL2Nsb3VkLmNmZzsgZWNobyAnJ2RhdGFzb3VyY2VfbGlzdDoKICBb\nIk5vQ2xvdWQiLCAiQ29uZmlnRHJpdmUiXScnID4+IC9ldGMvY2xvdWQvY2xvdWQuY2ZnJwo=\n'}}}, 'readonly': 'true', 'deviceId': '75ca49c2-0e48-493f-af50-1141e671fd35', 'path': '', 'device': 'cdrom', 'shared': 'false', 'type': 'disk'}, {'device': 'qxl', 'specParams': {'vram': '32768', 'ram': '65536', 'heads': '1'}, 'type': 'video', 'deviceId': '06cd48ad-257e-4a93-ba31-955d6a1ba005'}, {'index': '2', 'iface': 'ide', 'specParams': {'path': ''}, 'readonly': 'true', 'deviceId': '50dc8e8d-a318-48bf-8484-0eee6fc9a107', 'path': '', 'device': 'cdrom', 'shared': 'false', 'type': 'disk'}, {'index': 0, 'iface': 'virtio', 'format': 'cow', 'bootOrder': '1', 'poolID': '4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', 'volumeID': '4bb5d954-2a50-4028-b299-0b43c261270c', 'imageID': 'c01d693b-cba0-4fed-9ad7-0aaa28912a19', 'specParams': {}, 'readonly': 'false', 'domainID': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'optional': 'false', 'deviceId': 'c01d693b-cba0-4fed-9ad7-0aaa28912a19', 'address': {'slot': '0x06', 'bus': '0x00', 'domain': '0x0000', 'type': 'pci', 'function': '0x0'}, 'device': 'disk', 'shared': 'false', 'propagateErrors': 'off', 'type': 'disk'}, {'nicModel': 'pv', 'macAddr': '00:1a:4a:de:6d:83', 'linkActive': 'true', 'network': 'rhevm', 'filter': 'vdsm-no-mac-spoofing', 'specParams': {'inbound': {}, 'outbound': {}}, 'deviceId': '4f57f078-b2cc-4e19-8cf0-ddc1c8181814', 'device': 'bridge', 'type': 'interface'}, {'device': 'memballoon', 'specParams': {'model': 'virtio'}, 'type': 'balloon', 'deviceId': '4c67be64-96ae-4ac8-afdc-2da58a06aa42'}, {'index': '0', 'specParams': {}, 'deviceId': '8e755b93-45d7-4f8a-9b88-c7f0117b2b6e', 'address': {'slot': '0x04', 'bus': '0x00', 'domain': '0x0000', 'type': 'pci', 'function': '0x0'}, 'device': 'scsi', 'model': 'virtio-scsi', 'type': 'controller'}], 'custom': {'device_52318f43-0ad5-437d-a160-755af310990adevice_7624e64f-6432-457e-9e04-a8c8f13d17fddevice_874c983b-ba12-48fc-b7f6-f11cbdd043b0device_8d8f9ba7-0396-4b43-9730-8361fd404708': 'VmDevice {vmId=62e7aad5-ff72-4fe3-830f-e7726ed4bfba, deviceId=8d8f9ba7-0396-4b43-9730-8361fd404708, device=ide, type=CONTROLLER, bootOrder=0, specParams={}, address={bus=0x00, domain=0x0000, type=pci, slot=0x01, function=0x1}, managed=false, plugged=true, readOnly=false, deviceAlias=ide0, customProperties={}, snapshotId=null}', 'device_52318f43-0ad5-437d-a160-755af310990adevice_7624e64f-6432-457e-9e04-a8c8f13d17fd': 'VmDevice {vmId=62e7aad5-ff72-4fe3-830f-e7726ed4bfba, deviceId=7624e64f-6432-457e-9e04-a8c8f13d17fd, device=virtio-serial, type=CONTROLLER, bootOrder=0, specParams={}, address={bus=0x00, domain=0x0000, type=pci, slot=0x05, function=0x0}, managed=false, plugged=true, readOnly=false, deviceAlias=virtio-serial0, customProperties={}, snapshotId=null}', 'device_52318f43-0ad5-437d-a160-755af310990adevice_7624e64f-6432-457e-9e04-a8c8f13d17fddevice_874c983b-ba12-48fc-b7f6-f11cbdd043b0': 'VmDevice {vmId=62e7aad5-ff72-4fe3-830f-e7726ed4bfba, deviceId=874c983b-ba12-48fc-b7f6-f11cbdd043b0, device=unix, type=CHANNEL, bootOrder=0, specParams={}, address={port=2, bus=0, controller=0, type=virtio-serial}, managed=false, plugged=true, readOnly=false, deviceAlias=channel1, customProperties={}, snapshotId=null}', 'device_52318f43-0ad5-437d-a160-755af310990a': 'VmDevice {vmId=62e7aad5-ff72-4fe3-830f-e7726ed4bfba, deviceId=52318f43-0ad5-437d-a160-755af310990a, device=unix, type=CHANNEL, bootOrder=0, specParams={}, address={port=1, bus=0, controller=0, type=virtio-serial}, managed=false, plugged=true, readOnly=false, deviceAlias=channel0, customProperties={}, snapshotId=null}', 'device_52318f43-0ad5-437d-a160-755af310990adevice_7624e64f-6432-457e-9e04-a8c8f13d17fddevice_874c983b-ba12-48fc-b7f6-f11cbdd043b0device_8d8f9ba7-0396-4b43-9730-8361fd404708device_ab454efb-6492-4faa-85e7-2ee34a574483': 'VmDevice {vmId=62e7aad5-ff72-4fe3-830f-e7726ed4bfba, deviceId=ab454efb-6492-4faa-85e7-2ee34a574483, device=spicevmc, type=CHANNEL, bootOrder=0, specParams={}, address={port=3, bus=0, controller=0, type=virtio-serial}, managed=false, plugged=true, readOnly=false, deviceAlias=channel2, customProperties={}, snapshotId=null}'}, 'vmType': 'kvm', 'memSize': 1024, 'displayIp': '0', 'maxVCpus': '160', 'spiceSecureChannels': 'smain,sinputs,scursor,splayback,srecord,sdisplay,susbredir,ssmartcard', 'smpCoresPerSocket': '2', 'vmName': 'scale_9', 'display': 'qxl', 'nice': '0'}} >Thread-71::DEBUG::2014-07-10 09:03:46,901::vm::2274::vm.Vm::(_startUnderlyingVm) vmId=`62e7aad5-ff72-4fe3-830f-e7726ed4bfba`::_ongoingCreations acquired >Thread-71::INFO::2014-07-10 09:03:46,904::vm::3151::vm.Vm::(_run) vmId=`62e7aad5-ff72-4fe3-830f-e7726ed4bfba`::VM wrapper has started >Thread-71::DEBUG::2014-07-10 09:03:46,909::task::595::TaskManager.Task::(_updateState) Task=`14203823-f25d-46fd-946a-ee919eab89e6`::moving from state init -> state preparing >Thread-71::INFO::2014-07-10 09:03:46,913::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='c01d693b-cba0-4fed-9ad7-0aaa28912a19', volUUID='4bb5d954-2a50-4028-b299-0b43c261270c', options=None) >Thread-71::INFO::2014-07-10 09:03:46,917::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-71::DEBUG::2014-07-10 09:03:46,920::task::1185::TaskManager.Task::(prepare) Task=`14203823-f25d-46fd-946a-ee919eab89e6`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-71::DEBUG::2014-07-10 09:03:46,923::task::595::TaskManager.Task::(_updateState) Task=`14203823-f25d-46fd-946a-ee919eab89e6`::moving from state preparing -> state finished >Thread-71::DEBUG::2014-07-10 09:03:46,925::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-71::DEBUG::2014-07-10 09:03:46,928::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-71::DEBUG::2014-07-10 09:03:46,928::task::990::TaskManager.Task::(_decref) Task=`14203823-f25d-46fd-946a-ee919eab89e6`::ref 0 aborting False >Thread-71::INFO::2014-07-10 09:03:47,001::clientIF::324::vds::(prepareVolumePath) prepared volume path: /var/run/vdsm/payload/62e7aad5-ff72-4fe3-830f-e7726ed4bfba.62d3906fd5fb24e5c37cabfbb18d3e62.img >Thread-71::INFO::2014-07-10 09:03:47,001::clientIF::324::vds::(prepareVolumePath) prepared volume path: >Thread-71::DEBUG::2014-07-10 09:03:47,002::task::595::TaskManager.Task::(_updateState) Task=`77f09aba-86fb-4f0f-9b92-7db360a1fdb4`::moving from state init -> state preparing >Thread-71::INFO::2014-07-10 09:03:47,002::logUtils::44::dispatcher::(wrapper) Run and protect: prepareImage(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='c01d693b-cba0-4fed-9ad7-0aaa28912a19', leafUUID='4bb5d954-2a50-4028-b299-0b43c261270c') >Thread-71::DEBUG::2014-07-10 09:03:47,003::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.9e1aa540-1f4e-4ee3-a152-be381ef6c3bd`ReqID=`c48d3e00-457e-4082-9e26-1e52c4e068ea`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '3248' at 'prepareImage' >Thread-71::DEBUG::2014-07-10 09:03:47,003::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.9e1aa540-1f4e-4ee3-a152-be381ef6c3bd' for lock type 'shared' >Thread-71::DEBUG::2014-07-10 09:03:47,003::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.9e1aa540-1f4e-4ee3-a152-be381ef6c3bd' is free. Now locking as 'shared' (1 active user) >Thread-71::DEBUG::2014-07-10 09:03:47,003::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.9e1aa540-1f4e-4ee3-a152-be381ef6c3bd`ReqID=`c48d3e00-457e-4082-9e26-1e52c4e068ea`::Granted request >Thread-71::DEBUG::2014-07-10 09:03:47,004::task::827::TaskManager.Task::(resourceAcquired) Task=`77f09aba-86fb-4f0f-9b92-7db360a1fdb4`::_resourcesAcquired: Storage.9e1aa540-1f4e-4ee3-a152-be381ef6c3bd (shared) >Thread-71::DEBUG::2014-07-10 09:03:47,004::task::990::TaskManager.Task::(_decref) Task=`77f09aba-86fb-4f0f-9b92-7db360a1fdb4`::ref 1 aborting False >Thread-71::DEBUG::2014-07-10 09:03:47,004::lvm::427::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' got the operation mutex >Thread-71::DEBUG::2014-07-10 09:03:47,005::lvm::296::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm lvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/3600601601282300032826addbbdae311|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,vg_name,attr,size,seg_start_pe,devices,tags 9e1aa540-1f4e-4ee3-a152-be381ef6c3bd' (cwd None) >Thread-71::DEBUG::2014-07-10 09:03:47,231::lvm::296::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-71::DEBUG::2014-07-10 09:03:47,247::lvm::462::Storage.LVM::(_reloadlvs) lvs reloaded >Thread-71::DEBUG::2014-07-10 09:03:47,247::lvm::462::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' released the operation mutex >Thread-71::DEBUG::2014-07-10 09:03:47,249::lvm::296::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm lvchange --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/3600601601282300032826addbbdae311|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } " --autobackup n --available y 9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/4bb5d954-2a50-4028-b299-0b43c261270c' (cwd None) >Thread-14::DEBUG::2014-07-10 09:03:47,321::task::595::TaskManager.Task::(_updateState) Task=`9b2d0cb4-8559-4b4d-8b19-56a3ba02ff5b`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 09:03:47,322::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::INFO::2014-07-10 09:03:47,322::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000493788', 'lastCheck': '9.7', 'valid': True}, '6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00051727', 'lastCheck': '2.6', 'valid': True}} >Thread-14::DEBUG::2014-07-10 09:03:47,323::task::1185::TaskManager.Task::(prepare) Task=`9b2d0cb4-8559-4b4d-8b19-56a3ba02ff5b`::finished: {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000493788', 'lastCheck': '9.7', 'valid': True}, '6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00051727', 'lastCheck': '2.6', 'valid': True}} >Thread-14::DEBUG::2014-07-10 09:03:47,323::task::595::TaskManager.Task::(_updateState) Task=`9b2d0cb4-8559-4b4d-8b19-56a3ba02ff5b`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 09:03:47,323::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 09:03:47,323::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 09:03:47,323::task::990::TaskManager.Task::(_decref) Task=`9b2d0cb4-8559-4b4d-8b19-56a3ba02ff5b`::ref 0 aborting False >Thread-14::DEBUG::2014-07-10 09:03:47,338::vm::676::vm.Vm::(_getDiskStats) vmId=`5d49ebac-3f0d-4688-aed0-b3f5fe364000`::Disk hdd stats not available >Thread-14::DEBUG::2014-07-10 09:03:47,338::vm::676::vm.Vm::(_getDiskStats) vmId=`5d49ebac-3f0d-4688-aed0-b3f5fe364000`::Disk hdc stats not available >Thread-14::DEBUG::2014-07-10 09:03:47,339::vm::676::vm.Vm::(_getDiskStats) vmId=`5d49ebac-3f0d-4688-aed0-b3f5fe364000`::Disk vda stats not available >Thread-14::DEBUG::2014-07-10 09:03:47,339::vm::715::vm.Vm::(_getDiskLatency) vmId=`5d49ebac-3f0d-4688-aed0-b3f5fe364000`::Disk hdd latency not available >Thread-14::DEBUG::2014-07-10 09:03:47,339::vm::715::vm.Vm::(_getDiskLatency) vmId=`5d49ebac-3f0d-4688-aed0-b3f5fe364000`::Disk hdc latency not available >Thread-14::DEBUG::2014-07-10 09:03:47,339::vm::715::vm.Vm::(_getDiskLatency) vmId=`5d49ebac-3f0d-4688-aed0-b3f5fe364000`::Disk vda latency not available >Thread-14::DEBUG::2014-07-10 09:03:47,340::vm::676::vm.Vm::(_getDiskStats) vmId=`7fc21bb8-bd92-4924-acef-8360998e92a1`::Disk hdd stats not available >Thread-14::DEBUG::2014-07-10 09:03:47,340::vm::676::vm.Vm::(_getDiskStats) vmId=`7fc21bb8-bd92-4924-acef-8360998e92a1`::Disk hdc stats not available >Thread-14::DEBUG::2014-07-10 09:03:47,340::vm::676::vm.Vm::(_getDiskStats) vmId=`7fc21bb8-bd92-4924-acef-8360998e92a1`::Disk vda stats not available >Thread-14::DEBUG::2014-07-10 09:03:47,341::vm::715::vm.Vm::(_getDiskLatency) vmId=`7fc21bb8-bd92-4924-acef-8360998e92a1`::Disk hdd latency not available >Thread-14::DEBUG::2014-07-10 09:03:47,341::vm::715::vm.Vm::(_getDiskLatency) vmId=`7fc21bb8-bd92-4924-acef-8360998e92a1`::Disk hdc latency not available >Thread-14::DEBUG::2014-07-10 09:03:47,341::vm::715::vm.Vm::(_getDiskLatency) vmId=`7fc21bb8-bd92-4924-acef-8360998e92a1`::Disk vda latency not available >Thread-14::DEBUG::2014-07-10 09:03:47,343::vm::676::vm.Vm::(_getDiskStats) vmId=`a766ed65-ac2e-4862-8ff0-0352480cf6f1`::Disk hdd stats not available >Thread-14::DEBUG::2014-07-10 09:03:47,343::vm::676::vm.Vm::(_getDiskStats) vmId=`a766ed65-ac2e-4862-8ff0-0352480cf6f1`::Disk hdc stats not available >Thread-14::DEBUG::2014-07-10 09:03:47,343::vm::676::vm.Vm::(_getDiskStats) vmId=`a766ed65-ac2e-4862-8ff0-0352480cf6f1`::Disk vda stats not available >Thread-14::DEBUG::2014-07-10 09:03:47,344::vm::715::vm.Vm::(_getDiskLatency) vmId=`a766ed65-ac2e-4862-8ff0-0352480cf6f1`::Disk hdd latency not available >Thread-14::DEBUG::2014-07-10 09:03:47,344::vm::715::vm.Vm::(_getDiskLatency) vmId=`a766ed65-ac2e-4862-8ff0-0352480cf6f1`::Disk hdc latency not available >Thread-14::DEBUG::2014-07-10 09:03:47,344::vm::715::vm.Vm::(_getDiskLatency) vmId=`a766ed65-ac2e-4862-8ff0-0352480cf6f1`::Disk vda latency not available >Dummy-33::DEBUG::2014-07-10 09:03:47,481::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:03:47,598::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0578838 s, 17.7 MB/s\n'; <rc> = 0 >Thread-71::DEBUG::2014-07-10 09:03:47,642::lvm::296::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-71::DEBUG::2014-07-10 09:03:47,643::lvm::513::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-71::DEBUG::2014-07-10 09:03:47,643::lvm::525::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-71::DEBUG::2014-07-10 09:03:47,649::blockSD::1057::Storage.StorageDomain::(linkBCImage) path to image directory already exists: /rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/images/c01d693b-cba0-4fed-9ad7-0aaa28912a19 >Thread-18::DEBUG::2014-07-10 09:03:47,654::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/metadata bs=4096 count=1' (cwd None) >Thread-71::DEBUG::2014-07-10 09:03:47,676::lvm::427::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' got the operation mutex >Thread-71::DEBUG::2014-07-10 09:03:47,683::lvm::296::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm lvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/3600601601282300032826addbbdae311|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,vg_name,attr,size,seg_start_pe,devices,tags 9e1aa540-1f4e-4ee3-a152-be381ef6c3bd' (cwd None) >Thread-18::DEBUG::2014-07-10 09:03:47,703::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000557111 s, 7.4 MB/s\n'; <rc> = 0 >Thread-71::DEBUG::2014-07-10 09:03:47,918::lvm::296::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >GuestMonitor-scale_8::DEBUG::2014-07-10 09:03:47,980::vm::676::vm.Vm::(_getDiskStats) vmId=`5d49ebac-3f0d-4688-aed0-b3f5fe364000`::Disk hdd stats not available >GuestMonitor-scale_8::DEBUG::2014-07-10 09:03:47,986::vm::676::vm.Vm::(_getDiskStats) vmId=`5d49ebac-3f0d-4688-aed0-b3f5fe364000`::Disk hdc stats not available >GuestMonitor-scale_8::DEBUG::2014-07-10 09:03:47,993::vm::676::vm.Vm::(_getDiskStats) vmId=`5d49ebac-3f0d-4688-aed0-b3f5fe364000`::Disk vda stats not available >GuestMonitor-scale_8::DEBUG::2014-07-10 09:03:47,997::vm::715::vm.Vm::(_getDiskLatency) vmId=`5d49ebac-3f0d-4688-aed0-b3f5fe364000`::Disk hdd latency not available >GuestMonitor-scale_8::DEBUG::2014-07-10 09:03:48,003::vm::715::vm.Vm::(_getDiskLatency) vmId=`5d49ebac-3f0d-4688-aed0-b3f5fe364000`::Disk hdc latency not available >GuestMonitor-scale_8::DEBUG::2014-07-10 09:03:48,008::vm::715::vm.Vm::(_getDiskLatency) vmId=`5d49ebac-3f0d-4688-aed0-b3f5fe364000`::Disk vda latency not available >GuestMonitor-scale_8::DEBUG::2014-07-10 09:03:48,027::vm::676::vm.Vm::(_getDiskStats) vmId=`5d49ebac-3f0d-4688-aed0-b3f5fe364000`::Disk hdd stats not available >GuestMonitor-scale_8::DEBUG::2014-07-10 09:03:48,033::vm::676::vm.Vm::(_getDiskStats) vmId=`5d49ebac-3f0d-4688-aed0-b3f5fe364000`::Disk hdc stats not available >GuestMonitor-scale_8::DEBUG::2014-07-10 09:03:48,040::vm::676::vm.Vm::(_getDiskStats) vmId=`5d49ebac-3f0d-4688-aed0-b3f5fe364000`::Disk vda stats not available >GuestMonitor-scale_8::DEBUG::2014-07-10 09:03:48,046::vm::715::vm.Vm::(_getDiskLatency) vmId=`5d49ebac-3f0d-4688-aed0-b3f5fe364000`::Disk hdd latency not available >GuestMonitor-scale_8::DEBUG::2014-07-10 09:03:48,051::vm::715::vm.Vm::(_getDiskLatency) vmId=`5d49ebac-3f0d-4688-aed0-b3f5fe364000`::Disk hdc latency not available >GuestMonitor-scale_8::DEBUG::2014-07-10 09:03:48,057::vm::715::vm.Vm::(_getDiskLatency) vmId=`5d49ebac-3f0d-4688-aed0-b3f5fe364000`::Disk vda latency not available >Thread-71::DEBUG::2014-07-10 09:03:48,063::lvm::462::Storage.LVM::(_reloadlvs) lvs reloaded >Thread-71::DEBUG::2014-07-10 09:03:48,068::lvm::462::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' released the operation mutex >Thread-71::INFO::2014-07-10 09:03:48,073::logUtils::47::dispatcher::(wrapper) Run and protect: prepareImage, Return response: {'info': {'domainID': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'volType': 'path', 'leaseOffset': 118489088, 'path': '/rhev/data-center/mnt/blockSD/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/images/c01d693b-cba0-4fed-9ad7-0aaa28912a19/4bb5d954-2a50-4028-b299-0b43c261270c', 'volumeID': '4bb5d954-2a50-4028-b299-0b43c261270c', 'leasePath': '/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/leases', 'imageID': 'c01d693b-cba0-4fed-9ad7-0aaa28912a19'}, 'path': '/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/images/c01d693b-cba0-4fed-9ad7-0aaa28912a19/4bb5d954-2a50-4028-b299-0b43c261270c', 'imgVolumesInfo': [{'domainID': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'volType': 'path', 'leaseOffset': 109051904, 'path': '/rhev/data-center/mnt/blockSD/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/images/c01d693b-cba0-4fed-9ad7-0aaa28912a19/47592965-e853-4e59-9728-d11cca6a7a8a', 'volumeID': '47592965-e853-4e59-9728-d11cca6a7a8a', 'leasePath': '/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/leases', 'imageID': 'c01d693b-cba0-4fed-9ad7-0aaa28912a19'}, {'domainID': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'volType': 'path', 'leaseOffset': 118489088, 'path': '/rhev/data-center/mnt/blockSD/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/images/c01d693b-cba0-4fed-9ad7-0aaa28912a19/4bb5d954-2a50-4028-b299-0b43c261270c', 'volumeID': '4bb5d954-2a50-4028-b299-0b43c261270c', 'leasePath': '/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/leases', 'imageID': 'c01d693b-cba0-4fed-9ad7-0aaa28912a19'}]} >Thread-71::DEBUG::2014-07-10 09:03:48,075::task::1185::TaskManager.Task::(prepare) Task=`77f09aba-86fb-4f0f-9b92-7db360a1fdb4`::finished: {'info': {'domainID': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'volType': 'path', 'leaseOffset': 118489088, 'path': '/rhev/data-center/mnt/blockSD/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/images/c01d693b-cba0-4fed-9ad7-0aaa28912a19/4bb5d954-2a50-4028-b299-0b43c261270c', 'volumeID': '4bb5d954-2a50-4028-b299-0b43c261270c', 'leasePath': '/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/leases', 'imageID': 'c01d693b-cba0-4fed-9ad7-0aaa28912a19'}, 'path': '/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/images/c01d693b-cba0-4fed-9ad7-0aaa28912a19/4bb5d954-2a50-4028-b299-0b43c261270c', 'imgVolumesInfo': [{'domainID': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'volType': 'path', 'leaseOffset': 109051904, 'path': '/rhev/data-center/mnt/blockSD/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/images/c01d693b-cba0-4fed-9ad7-0aaa28912a19/47592965-e853-4e59-9728-d11cca6a7a8a', 'volumeID': '47592965-e853-4e59-9728-d11cca6a7a8a', 'leasePath': '/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/leases', 'imageID': 'c01d693b-cba0-4fed-9ad7-0aaa28912a19'}, {'domainID': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'volType': 'path', 'leaseOffset': 118489088, 'path': '/rhev/data-center/mnt/blockSD/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/images/c01d693b-cba0-4fed-9ad7-0aaa28912a19/4bb5d954-2a50-4028-b299-0b43c261270c', 'volumeID': '4bb5d954-2a50-4028-b299-0b43c261270c', 'leasePath': '/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/leases', 'imageID': 'c01d693b-cba0-4fed-9ad7-0aaa28912a19'}]} >Thread-71::DEBUG::2014-07-10 09:03:48,077::task::595::TaskManager.Task::(_updateState) Task=`77f09aba-86fb-4f0f-9b92-7db360a1fdb4`::moving from state preparing -> state finished >Thread-71::DEBUG::2014-07-10 09:03:48,080::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': < ResourceRef 'Storage.9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', isValid: 'True' obj: 'None'>} >GuestMonitor-scale_7::DEBUG::2014-07-10 09:03:48,085::vm::676::vm.Vm::(_getDiskStats) vmId=`a766ed65-ac2e-4862-8ff0-0352480cf6f1`::Disk hdd stats not available >Thread-71::DEBUG::2014-07-10 09:03:48,086::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >GuestMonitor-scale_7::DEBUG::2014-07-10 09:03:48,091::vm::676::vm.Vm::(_getDiskStats) vmId=`a766ed65-ac2e-4862-8ff0-0352480cf6f1`::Disk hdc stats not available >Thread-71::DEBUG::2014-07-10 09:03:48,096::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.9e1aa540-1f4e-4ee3-a152-be381ef6c3bd' >GuestMonitor-scale_7::DEBUG::2014-07-10 09:03:48,100::vm::676::vm.Vm::(_getDiskStats) vmId=`a766ed65-ac2e-4862-8ff0-0352480cf6f1`::Disk vda stats not available >GuestMonitor-scale_7::DEBUG::2014-07-10 09:03:48,108::vm::715::vm.Vm::(_getDiskLatency) vmId=`a766ed65-ac2e-4862-8ff0-0352480cf6f1`::Disk hdd latency not available >Thread-71::DEBUG::2014-07-10 09:03:48,108::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.9e1aa540-1f4e-4ee3-a152-be381ef6c3bd' (0 active users) >GuestMonitor-scale_7::DEBUG::2014-07-10 09:03:48,114::vm::715::vm.Vm::(_getDiskLatency) vmId=`a766ed65-ac2e-4862-8ff0-0352480cf6f1`::Disk hdc latency not available >Thread-71::DEBUG::2014-07-10 09:03:48,116::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.9e1aa540-1f4e-4ee3-a152-be381ef6c3bd' is free, finding out if anyone is waiting for it. >GuestMonitor-scale_7::DEBUG::2014-07-10 09:03:48,123::vm::715::vm.Vm::(_getDiskLatency) vmId=`a766ed65-ac2e-4862-8ff0-0352480cf6f1`::Disk vda latency not available >Thread-71::DEBUG::2014-07-10 09:03:48,124::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', Clearing records. >GuestMonitor-scale_6::DEBUG::2014-07-10 09:03:48,135::vm::676::vm.Vm::(_getDiskStats) vmId=`7fc21bb8-bd92-4924-acef-8360998e92a1`::Disk hdd stats not available >Thread-71::DEBUG::2014-07-10 09:03:48,151::task::990::TaskManager.Task::(_decref) Task=`77f09aba-86fb-4f0f-9b92-7db360a1fdb4`::ref 0 aborting False >GuestMonitor-scale_6::DEBUG::2014-07-10 09:03:48,151::vm::676::vm.Vm::(_getDiskStats) vmId=`7fc21bb8-bd92-4924-acef-8360998e92a1`::Disk hdc stats not available >GuestMonitor-scale_7::DEBUG::2014-07-10 09:03:48,153::vm::676::vm.Vm::(_getDiskStats) vmId=`a766ed65-ac2e-4862-8ff0-0352480cf6f1`::Disk hdd stats not available >Thread-71::INFO::2014-07-10 09:03:48,162::clientIF::324::vds::(prepareVolumePath) prepared volume path: /rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/images/c01d693b-cba0-4fed-9ad7-0aaa28912a19/4bb5d954-2a50-4028-b299-0b43c261270c >GuestMonitor-scale_6::DEBUG::2014-07-10 09:03:48,166::vm::676::vm.Vm::(_getDiskStats) vmId=`7fc21bb8-bd92-4924-acef-8360998e92a1`::Disk vda stats not available >GuestMonitor-scale_7::DEBUG::2014-07-10 09:03:48,168::vm::676::vm.Vm::(_getDiskStats) vmId=`a766ed65-ac2e-4862-8ff0-0352480cf6f1`::Disk hdc stats not available >GuestMonitor-scale_6::DEBUG::2014-07-10 09:03:48,176::vm::715::vm.Vm::(_getDiskLatency) vmId=`7fc21bb8-bd92-4924-acef-8360998e92a1`::Disk hdd latency not available >GuestMonitor-scale_7::DEBUG::2014-07-10 09:03:48,177::vm::676::vm.Vm::(_getDiskStats) vmId=`a766ed65-ac2e-4862-8ff0-0352480cf6f1`::Disk vda stats not available >GuestMonitor-scale_6::DEBUG::2014-07-10 09:03:48,183::vm::715::vm.Vm::(_getDiskLatency) vmId=`7fc21bb8-bd92-4924-acef-8360998e92a1`::Disk hdc latency not available >GuestMonitor-scale_7::DEBUG::2014-07-10 09:03:48,184::vm::715::vm.Vm::(_getDiskLatency) vmId=`a766ed65-ac2e-4862-8ff0-0352480cf6f1`::Disk hdd latency not available >GuestMonitor-scale_6::DEBUG::2014-07-10 09:03:48,189::vm::715::vm.Vm::(_getDiskLatency) vmId=`7fc21bb8-bd92-4924-acef-8360998e92a1`::Disk vda latency not available >GuestMonitor-scale_7::DEBUG::2014-07-10 09:03:48,191::vm::715::vm.Vm::(_getDiskLatency) vmId=`a766ed65-ac2e-4862-8ff0-0352480cf6f1`::Disk hdc latency not available >GuestMonitor-scale_7::DEBUG::2014-07-10 09:03:48,198::vm::715::vm.Vm::(_getDiskLatency) vmId=`a766ed65-ac2e-4862-8ff0-0352480cf6f1`::Disk vda latency not available >GuestMonitor-scale_6::DEBUG::2014-07-10 09:03:48,206::vm::676::vm.Vm::(_getDiskStats) vmId=`7fc21bb8-bd92-4924-acef-8360998e92a1`::Disk hdd stats not available >GuestMonitor-scale_6::DEBUG::2014-07-10 09:03:48,212::vm::676::vm.Vm::(_getDiskStats) vmId=`7fc21bb8-bd92-4924-acef-8360998e92a1`::Disk hdc stats not available >GuestMonitor-scale_6::DEBUG::2014-07-10 09:03:48,218::vm::676::vm.Vm::(_getDiskStats) vmId=`7fc21bb8-bd92-4924-acef-8360998e92a1`::Disk vda stats not available >GuestMonitor-scale_6::DEBUG::2014-07-10 09:03:48,223::vm::715::vm.Vm::(_getDiskLatency) vmId=`7fc21bb8-bd92-4924-acef-8360998e92a1`::Disk hdd latency not available >GuestMonitor-scale_6::DEBUG::2014-07-10 09:03:48,227::vm::715::vm.Vm::(_getDiskLatency) vmId=`7fc21bb8-bd92-4924-acef-8360998e92a1`::Disk hdc latency not available >GuestMonitor-scale_6::DEBUG::2014-07-10 09:03:48,232::vm::715::vm.Vm::(_getDiskLatency) vmId=`7fc21bb8-bd92-4924-acef-8360998e92a1`::Disk vda latency not available >Thread-71::DEBUG::2014-07-10 09:03:48,743::utils::642::root::(execCmd) '/usr/libexec/vdsm/hooks/before_vm_start/50_vhostmd' (cwd None) >Thread-71::DEBUG::2014-07-10 09:03:48,859::utils::662::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-71::INFO::2014-07-10 09:03:48,859::hooks::100::root::(_runHooksDir) >Thread-71::DEBUG::2014-07-10 09:03:48,860::vm::3190::vm.Vm::(_run) vmId=`62e7aad5-ff72-4fe3-830f-e7726ed4bfba`::<?xml version="1.0" encoding="utf-8"?> ><domain type="kvm"> > <name>scale_9</name> > <uuid>62e7aad5-ff72-4fe3-830f-e7726ed4bfba</uuid> > <memory>1048576</memory> > <currentMemory>1048576</currentMemory> > <vcpu current="2">160</vcpu> > <memtune> > <min_guarantee>1048576</min_guarantee> > </memtune> > <devices> > <channel type="unix"> > <target name="com.redhat.rhevm.vdsm" type="virtio"/> > <source mode="bind" path="/var/lib/libvirt/qemu/channels/62e7aad5-ff72-4fe3-830f-e7726ed4bfba.com.redhat.rhevm.vdsm"/> > </channel> > <channel type="unix"> > <target name="org.qemu.guest_agent.0" type="virtio"/> > <source mode="bind" path="/var/lib/libvirt/qemu/channels/62e7aad5-ff72-4fe3-830f-e7726ed4bfba.org.qemu.guest_agent.0"/> > </channel> > <input bus="ps2" type="mouse"/> > <channel type="spicevmc"> > <target name="com.redhat.spice.0" type="virtio"/> > </channel> > <graphics autoport="yes" keymap="en-us" listen="0" passwd="*****" passwdValidTo="1970-01-01T00:00:01" port="-1" tlsPort="-1" type="spice"> > <channel mode="secure" name="main"/> > <channel mode="secure" name="inputs"/> > <channel mode="secure" name="cursor"/> > <channel mode="secure" name="playback"/> > <channel mode="secure" name="record"/> > <channel mode="secure" name="display"/> > <channel mode="secure" name="usbredir"/> > <channel mode="secure" name="smartcard"/> > </graphics> > <memballoon model="virtio"/> > <controller index="0" model="virtio-scsi" type="scsi"> > <address bus="0x00" domain="0x0000" function="0x0" slot="0x04" type="pci"/> > </controller> > <video> > <model heads="1" ram="65536" type="qxl" vram="32768"/> > </video> > <interface type="bridge"> > <mac address="00:1a:4a:de:6d:83"/> > <model type="virtio"/> > <source bridge="rhevm"/> > <filterref filter="vdsm-no-mac-spoofing"/> > <link state="up"/> > <bandwidth/> > </interface> > <disk device="cdrom" snapshot="no" type="file"> > <source file="/var/run/vdsm/payload/62e7aad5-ff72-4fe3-830f-e7726ed4bfba.62d3906fd5fb24e5c37cabfbb18d3e62.img" startupPolicy="optional"/> > <target bus="ide" dev="hdd"/> > <readonly/> > <serial/> > </disk> > <disk device="cdrom" snapshot="no" type="file"> > <source file="" startupPolicy="optional"/> > <target bus="ide" dev="hdc"/> > <readonly/> > <serial/> > </disk> > <disk device="disk" snapshot="no" type="block"> > <address bus="0x00" domain="0x0000" function="0x0" slot="0x06" type="pci"/> > <source dev="/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/images/c01d693b-cba0-4fed-9ad7-0aaa28912a19/4bb5d954-2a50-4028-b299-0b43c261270c"/> > <target bus="virtio" dev="vda"/> > <serial>c01d693b-cba0-4fed-9ad7-0aaa28912a19</serial> > <boot order="1"/> > <driver cache="none" error_policy="stop" io="native" name="qemu" type="qcow2"/> > </disk> > </devices> > <os> > <type arch="x86_64" machine="rhel6.5.0">hvm</type> > <smbios mode="sysinfo"/> > </os> > <sysinfo type="smbios"> > <system> > <entry name="manufacturer">Red Hat</entry> > <entry name="product">RHEV Hypervisor</entry> > <entry name="version">6.5-20140707.0.el6ev</entry> > <entry name="serial">52BAF97B-FF2F-E311-0000-100000000005</entry> > <entry name="uuid">62e7aad5-ff72-4fe3-830f-e7726ed4bfba</entry> > </system> > </sysinfo> > <clock adjustment="0" offset="variable"> > <timer name="rtc" tickpolicy="catchup"/> > </clock> > <features> > <acpi/> > </features> > <cpu match="exact"> > <model>Conroe</model> > <topology cores="2" sockets="80" threads="1"/> > </cpu> ></domain> > >Thread-64::DEBUG::2014-07-10 09:03:49,313::task::595::TaskManager.Task::(_updateState) Task=`09ced39b-4900-48a0-8d93-1f89375abf04`::moving from state init -> state preparing >Thread-64::INFO::2014-07-10 09:03:49,314::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='aa20346a-4d3a-4e07-b8e1-52c0ebe4168c', volUUID='58fefce2-9bce-4bff-8949-8c6ce8122b27', options=None) >Thread-64::INFO::2014-07-10 09:03:49,315::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-64::DEBUG::2014-07-10 09:03:49,315::task::1185::TaskManager.Task::(prepare) Task=`09ced39b-4900-48a0-8d93-1f89375abf04`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-64::DEBUG::2014-07-10 09:03:49,315::task::595::TaskManager.Task::(_updateState) Task=`09ced39b-4900-48a0-8d93-1f89375abf04`::moving from state preparing -> state finished >Thread-64::DEBUG::2014-07-10 09:03:49,315::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-64::DEBUG::2014-07-10 09:03:49,316::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-64::DEBUG::2014-07-10 09:03:49,316::task::990::TaskManager.Task::(_decref) Task=`09ced39b-4900-48a0-8d93-1f89375abf04`::ref 0 aborting False >Thread-54::DEBUG::2014-07-10 09:03:49,567::task::595::TaskManager.Task::(_updateState) Task=`59a0e09b-75b4-46dd-8639-e8d970984b04`::moving from state init -> state preparing >Thread-54::INFO::2014-07-10 09:03:49,568::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='28408446-e5fd-4565-a976-e760951593fe', volUUID='776303a2-5585-451e-826e-0e338d4a1e98', options=None) >Thread-54::INFO::2014-07-10 09:03:49,568::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-54::DEBUG::2014-07-10 09:03:49,568::task::1185::TaskManager.Task::(prepare) Task=`59a0e09b-75b4-46dd-8639-e8d970984b04`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-54::DEBUG::2014-07-10 09:03:49,569::task::595::TaskManager.Task::(_updateState) Task=`59a0e09b-75b4-46dd-8639-e8d970984b04`::moving from state preparing -> state finished >Thread-54::DEBUG::2014-07-10 09:03:49,569::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-54::DEBUG::2014-07-10 09:03:49,569::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-54::DEBUG::2014-07-10 09:03:49,569::task::990::TaskManager.Task::(_decref) Task=`59a0e09b-75b4-46dd-8639-e8d970984b04`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 09:03:49,613::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:03:49,707::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0343727 s, 29.8 MB/s\n'; <rc> = 0 >libvirtEventLoop::DEBUG::2014-07-10 09:03:49,892::vm::5176::vm.Vm::(_onLibvirtLifecycleEvent) vmId=`62e7aad5-ff72-4fe3-830f-e7726ed4bfba`::event Started detail 0 opaque None >Thread-71::DEBUG::2014-07-10 09:03:49,927::vm::5032::vm.Vm::(_getUnderlyingDriveInfo) vmId=`62e7aad5-ff72-4fe3-830f-e7726ed4bfba`::Looking for drive with attributes {'name': u'hdc', 'bootOrder': '', 'boot': [], 'readonly': True, 'address': {u'bus': u'1', u'controller': u'0', u'type': u'drive', u'target': u'0', u'unit': u'0'}, 'path': '', 'type': u'cdrom'} >Thread-71::DEBUG::2014-07-10 09:03:49,928::vm::5053::vm.Vm::(_getUnderlyingDriveInfo) vmId=`62e7aad5-ff72-4fe3-830f-e7726ed4bfba`::Matched {'name': (u'hdc', u'hdc'), 'bootOrder': ('', None), 'boot': ([], None), 'readonly': (True, True), 'address': ({u'bus': u'1', u'controller': u'0', u'type': u'drive', u'target': u'0', u'unit': u'0'}, {u'bus': u'1', u'controller': u'0', u'type': u'drive', u'target': u'0', u'unit': u'0'}), 'path': ('', ''), 'type': (u'cdrom', u'cdrom')} >Thread-71::DEBUG::2014-07-10 09:03:49,928::vm::5072::vm.Vm::(_getUnderlyingDriveInfo) vmId=`62e7aad5-ff72-4fe3-830f-e7726ed4bfba`::Matched {'name': (u'hdc', u'hdc'), 'bootOrder': ('', None), 'boot': ([], None), 'readonly': (True, 'True'), 'address': ({u'bus': u'1', u'controller': u'0', u'type': u'drive', u'target': u'0', u'unit': u'0'}, {u'bus': u'1', u'controller': u'0', u'type': u'drive', u'target': u'0', u'unit': u'0'}), 'path': ('', ''), 'type': (u'cdrom', 'disk')} >Thread-71::DEBUG::2014-07-10 09:03:49,928::vm::5032::vm.Vm::(_getUnderlyingDriveInfo) vmId=`62e7aad5-ff72-4fe3-830f-e7726ed4bfba`::Looking for drive with attributes {'name': u'hdd', 'bootOrder': '', 'boot': [], 'readonly': True, 'address': {u'bus': u'1', u'controller': u'0', u'type': u'drive', u'target': u'0', u'unit': u'1'}, 'path': u'/var/run/vdsm/payload/62e7aad5-ff72-4fe3-830f-e7726ed4bfba.62d3906fd5fb24e5c37cabfbb18d3e62.img', 'type': u'cdrom'} >Thread-71::DEBUG::2014-07-10 09:03:49,929::vm::5053::vm.Vm::(_getUnderlyingDriveInfo) vmId=`62e7aad5-ff72-4fe3-830f-e7726ed4bfba`::Matched {'name': (u'hdd', u'hdd'), 'bootOrder': ('', None), 'boot': ([], None), 'readonly': (True, True), 'address': ({u'bus': u'1', u'controller': u'0', u'type': u'drive', u'target': u'0', u'unit': u'1'}, {u'bus': u'1', u'controller': u'0', u'type': u'drive', u'target': u'0', u'unit': u'1'}), 'path': (u'/var/run/vdsm/payload/62e7aad5-ff72-4fe3-830f-e7726ed4bfba.62d3906fd5fb24e5c37cabfbb18d3e62.img', '/var/run/vdsm/payload/62e7aad5-ff72-4fe3-830f-e7726ed4bfba.62d3906fd5fb24e5c37cabfbb18d3e62.img'), 'type': (u'cdrom', u'cdrom')} >Thread-71::DEBUG::2014-07-10 09:03:49,929::vm::5072::vm.Vm::(_getUnderlyingDriveInfo) vmId=`62e7aad5-ff72-4fe3-830f-e7726ed4bfba`::Matched {'name': (u'hdd', u'hdd'), 'bootOrder': ('', None), 'boot': ([], None), 'readonly': (True, 'True'), 'address': ({u'bus': u'1', u'controller': u'0', u'type': u'drive', u'target': u'0', u'unit': u'1'}, {u'bus': u'1', u'controller': u'0', u'type': u'drive', u'target': u'0', u'unit': u'1'}), 'path': (u'/var/run/vdsm/payload/62e7aad5-ff72-4fe3-830f-e7726ed4bfba.62d3906fd5fb24e5c37cabfbb18d3e62.img', '/var/run/vdsm/payload/62e7aad5-ff72-4fe3-830f-e7726ed4bfba.62d3906fd5fb24e5c37cabfbb18d3e62.img'), 'type': (u'cdrom', 'disk')} >Thread-71::DEBUG::2014-07-10 09:03:49,929::vm::5032::vm.Vm::(_getUnderlyingDriveInfo) vmId=`62e7aad5-ff72-4fe3-830f-e7726ed4bfba`::Looking for drive with attributes {'name': u'vda', 'bootOrder': u'1', 'boot': [<DOM Element: boot at 0x7f6170058f80>], 'readonly': False, 'address': {u'slot': u'0x06', u'bus': u'0x00', u'domain': u'0x0000', u'type': u'pci', u'function': u'0x0'}, 'path': u'/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/images/c01d693b-cba0-4fed-9ad7-0aaa28912a19/4bb5d954-2a50-4028-b299-0b43c261270c', 'type': u'disk'} >Thread-71::DEBUG::2014-07-10 09:03:49,930::vm::5053::vm.Vm::(_getUnderlyingDriveInfo) vmId=`62e7aad5-ff72-4fe3-830f-e7726ed4bfba`::Matched {'name': (u'vda', u'vda'), 'bootOrder': (u'1', u'1'), 'boot': ([<DOM Element: boot at 0x7f6170058f80>], None), 'readonly': (False, False), 'address': ({u'slot': u'0x06', u'bus': u'0x00', u'domain': u'0x0000', u'type': u'pci', u'function': u'0x0'}, {u'slot': u'0x06', u'bus': u'0x00', u'domain': u'0x0000', u'type': u'pci', u'function': u'0x0'}), 'path': (u'/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/images/c01d693b-cba0-4fed-9ad7-0aaa28912a19/4bb5d954-2a50-4028-b299-0b43c261270c', '/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/images/c01d693b-cba0-4fed-9ad7-0aaa28912a19/4bb5d954-2a50-4028-b299-0b43c261270c'), 'type': (u'disk', u'disk')} >Thread-71::DEBUG::2014-07-10 09:03:49,930::vm::5072::vm.Vm::(_getUnderlyingDriveInfo) vmId=`62e7aad5-ff72-4fe3-830f-e7726ed4bfba`::Matched {'name': (u'vda', u'vda'), 'bootOrder': (u'1', u'1'), 'boot': ([<DOM Element: boot at 0x7f6170058f80>], None), 'readonly': (False, 'False'), 'address': ({u'slot': u'0x06', u'bus': u'0x00', u'domain': u'0x0000', u'type': u'pci', u'function': u'0x0'}, {u'slot': u'0x06', u'bus': u'0x00', u'domain': u'0x0000', u'type': u'pci', u'function': u'0x0'}), 'path': (u'/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/images/c01d693b-cba0-4fed-9ad7-0aaa28912a19/4bb5d954-2a50-4028-b299-0b43c261270c', '/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/images/c01d693b-cba0-4fed-9ad7-0aaa28912a19/4bb5d954-2a50-4028-b299-0b43c261270c'), 'type': (u'disk', 'disk')} >Thread-71::DEBUG::2014-07-10 09:03:50,064::sampling::285::vm.Vm::(start) vmId=`62e7aad5-ff72-4fe3-830f-e7726ed4bfba`::Start statistics collection >Thread-73::DEBUG::2014-07-10 09:03:50,067::sampling::314::vm.Vm::(run) vmId=`62e7aad5-ff72-4fe3-830f-e7726ed4bfba`::Stats thread started >Thread-73::DEBUG::2014-07-10 09:03:50,075::task::595::TaskManager.Task::(_updateState) Task=`39851358-0fd1-4571-bb06-53bb7a5bc519`::moving from state init -> state preparing >Thread-73::INFO::2014-07-10 09:03:50,075::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='c01d693b-cba0-4fed-9ad7-0aaa28912a19', volUUID='4bb5d954-2a50-4028-b299-0b43c261270c', options=None) >Thread-73::INFO::2014-07-10 09:03:50,076::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-73::DEBUG::2014-07-10 09:03:50,076::task::1185::TaskManager.Task::(prepare) Task=`39851358-0fd1-4571-bb06-53bb7a5bc519`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-73::DEBUG::2014-07-10 09:03:50,076::task::595::TaskManager.Task::(_updateState) Task=`39851358-0fd1-4571-bb06-53bb7a5bc519`::moving from state preparing -> state finished >Thread-73::DEBUG::2014-07-10 09:03:50,077::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-73::DEBUG::2014-07-10 09:03:50,077::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-73::DEBUG::2014-07-10 09:03:50,077::task::990::TaskManager.Task::(_decref) Task=`39851358-0fd1-4571-bb06-53bb7a5bc519`::ref 0 aborting False >Thread-71::DEBUG::2014-07-10 09:03:50,084::vmChannels::198::vds::(register) Add fileno 73 to listener's channels. >Thread-71::WARNING::2014-07-10 09:03:50,087::vm::3715::vm.Vm::(_readPauseCode) vmId=`62e7aad5-ff72-4fe3-830f-e7726ed4bfba`::_readPauseCode unsupported by libvirt vm >Thread-71::DEBUG::2014-07-10 09:03:50,097::vm::2291::vm.Vm::(_startUnderlyingVm) vmId=`62e7aad5-ff72-4fe3-830f-e7726ed4bfba`::_ongoingCreations released >VM Channels Listener::DEBUG::2014-07-10 09:03:50,222::vmChannels::106::vds::(_do_add_channels) fileno 73 was added to unconnected channels. >VM Channels Listener::DEBUG::2014-07-10 09:03:50,222::vmChannels::132::vds::(_handle_unconnected) Trying to connect fileno 73. >VM Channels Listener::DEBUG::2014-07-10 09:03:50,223::guestIF::194::vm.Vm::(_connect) vmId=`62e7aad5-ff72-4fe3-830f-e7726ed4bfba`::Attempting connection to /var/lib/libvirt/qemu/channels/62e7aad5-ff72-4fe3-830f-e7726ed4bfba.com.redhat.rhevm.vdsm >VM Channels Listener::DEBUG::2014-07-10 09:03:50,224::guestIF::197::vm.Vm::(_connect) vmId=`62e7aad5-ff72-4fe3-830f-e7726ed4bfba`::Connected to /var/lib/libvirt/qemu/channels/62e7aad5-ff72-4fe3-830f-e7726ed4bfba.com.redhat.rhevm.vdsm >VM Channels Listener::DEBUG::2014-07-10 09:03:50,225::vmChannels::148::vds::(_handle_unconnected) Connecting to fileno 73 succeeded. >Thread-14::DEBUG::2014-07-10 09:03:50,480::BindingXMLRPC::1067::vds::(wrapper) client [10.35.3.13]::call vmGetStats with ('a766ed65-ac2e-4862-8ff0-0352480cf6f1',) {} >Thread-14::DEBUG::2014-07-10 09:03:50,481::vm::676::vm.Vm::(_getDiskStats) vmId=`a766ed65-ac2e-4862-8ff0-0352480cf6f1`::Disk hdd stats not available >Thread-14::DEBUG::2014-07-10 09:03:50,481::vm::676::vm.Vm::(_getDiskStats) vmId=`a766ed65-ac2e-4862-8ff0-0352480cf6f1`::Disk hdc stats not available >Thread-14::DEBUG::2014-07-10 09:03:50,481::vm::676::vm.Vm::(_getDiskStats) vmId=`a766ed65-ac2e-4862-8ff0-0352480cf6f1`::Disk vda stats not available >Thread-14::DEBUG::2014-07-10 09:03:50,481::vm::715::vm.Vm::(_getDiskLatency) vmId=`a766ed65-ac2e-4862-8ff0-0352480cf6f1`::Disk hdd latency not available >Thread-14::DEBUG::2014-07-10 09:03:50,482::vm::715::vm.Vm::(_getDiskLatency) vmId=`a766ed65-ac2e-4862-8ff0-0352480cf6f1`::Disk hdc latency not available >Thread-14::DEBUG::2014-07-10 09:03:50,482::vm::715::vm.Vm::(_getDiskLatency) vmId=`a766ed65-ac2e-4862-8ff0-0352480cf6f1`::Disk vda latency not available >Thread-14::DEBUG::2014-07-10 09:03:50,482::BindingXMLRPC::1074::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Powering up', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '15456', 'displayIp': '0', 'displayPort': u'5912', 'session': 'Unknown', 'displaySecurePort': u'5913', 'timeOffset': '0', 'hash': '1078195817470092527', 'balloonInfo': {'balloon_max': '1048576', 'balloon_target': '1048576', 'balloon_cur': '1048576', 'balloon_min': '1048576'}, 'pauseCode': 'NOERR', 'clientIp': '', 'kvmEnable': 'true', 'network': {u'vnet6': {'macAddr': '00:1a:4a:de:6d:88', 'rxDropped': '0', 'rxErrors': '0', 'txDropped': '0', 'txRate': '0.0', 'rxRate': '0.0', 'txErrors': '0', 'state': 'unknown', 'speed': '1000', 'name': u'vnet6'}}, 'vmId': 'a766ed65-ac2e-4862-8ff0-0352480cf6f1', 'displayType': 'qxl', 'cpuUser': '36.84', 'disks': {u'vda': {'truesize': '1073741824', 'apparentsize': '1073741824', 'imageID': 'f30c2cb7-a43a-4bf5-82b5-cfe07336f65c'}, u'hdd': {'truesize': '0', 'apparentsize': '0'}, u'hdc': {'truesize': '0', 'apparentsize': '0'}}, 'monitorResponse': '0', 'statsAge': '0.75', 'elapsedTime': '43', 'vmType': 'kvm', 'cpuSys': '4.25', 'guestCPUCount': -1, 'appsList': [], 'guestIPs': ''}]} >Thread-14::DEBUG::2014-07-10 09:03:50,487::BindingXMLRPC::1067::vds::(wrapper) client [10.35.3.13]::call vmGetStats with ('62e7aad5-ff72-4fe3-830f-e7726ed4bfba',) {} >Thread-14::DEBUG::2014-07-10 09:03:50,487::vm::598::vm.Vm::(_getCpuStats) vmId=`62e7aad5-ff72-4fe3-830f-e7726ed4bfba`::CPU stats not available: 'NoneType' object is unsubscriptable >Thread-14::DEBUG::2014-07-10 09:03:50,487::vm::654::vm.Vm::(_getNetworkStats) vmId=`62e7aad5-ff72-4fe3-830f-e7726ed4bfba`::Network stats not available >Thread-14::DEBUG::2014-07-10 09:03:50,487::vm::676::vm.Vm::(_getDiskStats) vmId=`62e7aad5-ff72-4fe3-830f-e7726ed4bfba`::Disk hdd stats not available >Thread-14::DEBUG::2014-07-10 09:03:50,488::vm::676::vm.Vm::(_getDiskStats) vmId=`62e7aad5-ff72-4fe3-830f-e7726ed4bfba`::Disk hdc stats not available >Thread-14::DEBUG::2014-07-10 09:03:50,488::vm::676::vm.Vm::(_getDiskStats) vmId=`62e7aad5-ff72-4fe3-830f-e7726ed4bfba`::Disk vda stats not available >Thread-14::DEBUG::2014-07-10 09:03:50,488::vm::715::vm.Vm::(_getDiskLatency) vmId=`62e7aad5-ff72-4fe3-830f-e7726ed4bfba`::Disk hdd latency not available >Thread-14::DEBUG::2014-07-10 09:03:50,488::vm::715::vm.Vm::(_getDiskLatency) vmId=`62e7aad5-ff72-4fe3-830f-e7726ed4bfba`::Disk hdc latency not available >Thread-14::DEBUG::2014-07-10 09:03:50,488::vm::715::vm.Vm::(_getDiskLatency) vmId=`62e7aad5-ff72-4fe3-830f-e7726ed4bfba`::Disk vda latency not available >Thread-14::DEBUG::2014-07-10 09:03:50,489::BindingXMLRPC::1074::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Powering up', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '16791', 'displayIp': '0', 'displayPort': u'5916', 'session': 'Unknown', 'displaySecurePort': u'5917', 'timeOffset': '0', 'hash': '773530886922036478', 'balloonInfo': {'balloon_max': '1048576', 'balloon_target': '1048576', 'balloon_cur': '0', 'balloon_min': '1048576'}, 'pauseCode': 'NOERR', 'clientIp': '', 'kvmEnable': 'true', 'network': {u'vnet8': {'state': 'unknown', 'macAddr': '00:1a:4a:de:6d:83', 'speed': '1000', 'name': u'vnet8'}}, 'vmId': '62e7aad5-ff72-4fe3-830f-e7726ed4bfba', 'displayType': 'qxl', 'cpuUser': '0.00', 'disks': {u'vda': {'truesize': '1073741824', 'apparentsize': '1073741824', 'imageID': 'c01d693b-cba0-4fed-9ad7-0aaa28912a19'}, u'hdd': {'truesize': '0', 'apparentsize': '0'}, u'hdc': {'truesize': '0', 'apparentsize': '0'}}, 'monitorResponse': '0', 'statsAge': '0.42', 'elapsedTime': '3', 'vmType': 'kvm', 'cpuSys': '0.00', 'guestCPUCount': -1, 'appsList': [], 'guestIPs': ''}]} >Thread-14::DEBUG::2014-07-10 09:03:50,493::BindingXMLRPC::1067::vds::(wrapper) client [10.35.3.13]::call vmGetStats with ('5d49ebac-3f0d-4688-aed0-b3f5fe364000',) {} >Thread-14::DEBUG::2014-07-10 09:03:50,493::vm::676::vm.Vm::(_getDiskStats) vmId=`5d49ebac-3f0d-4688-aed0-b3f5fe364000`::Disk hdd stats not available >Thread-14::DEBUG::2014-07-10 09:03:50,493::vm::676::vm.Vm::(_getDiskStats) vmId=`5d49ebac-3f0d-4688-aed0-b3f5fe364000`::Disk hdc stats not available >Thread-14::DEBUG::2014-07-10 09:03:50,494::vm::676::vm.Vm::(_getDiskStats) vmId=`5d49ebac-3f0d-4688-aed0-b3f5fe364000`::Disk vda stats not available >Thread-14::DEBUG::2014-07-10 09:03:50,494::vm::715::vm.Vm::(_getDiskLatency) vmId=`5d49ebac-3f0d-4688-aed0-b3f5fe364000`::Disk hdd latency not available >Thread-14::DEBUG::2014-07-10 09:03:50,494::vm::715::vm.Vm::(_getDiskLatency) vmId=`5d49ebac-3f0d-4688-aed0-b3f5fe364000`::Disk hdc latency not available >Thread-14::DEBUG::2014-07-10 09:03:50,494::vm::715::vm.Vm::(_getDiskLatency) vmId=`5d49ebac-3f0d-4688-aed0-b3f5fe364000`::Disk vda latency not available >Thread-14::DEBUG::2014-07-10 09:03:50,495::BindingXMLRPC::1074::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Powering up', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '16122', 'displayIp': '0', 'displayPort': u'5914', 'session': 'Unknown', 'displaySecurePort': u'5915', 'timeOffset': '0', 'hash': '8384665493346130205', 'balloonInfo': {'balloon_max': '1048576', 'balloon_target': '1048576', 'balloon_cur': '1048576', 'balloon_min': '1048576'}, 'pauseCode': 'NOERR', 'clientIp': '', 'kvmEnable': 'true', 'network': {u'vnet7': {'macAddr': '00:1a:4a:de:6d:89', 'rxDropped': '0', 'rxErrors': '0', 'txDropped': '0', 'txRate': '0.0', 'rxRate': '0.0', 'txErrors': '0', 'state': 'unknown', 'speed': '1000', 'name': u'vnet7'}}, 'vmId': '5d49ebac-3f0d-4688-aed0-b3f5fe364000', 'displayType': 'qxl', 'cpuUser': '40.62', 'disks': {u'vda': {'truesize': '1073741824', 'apparentsize': '1073741824', 'imageID': 'cfaeead2-7caa-467c-b389-c89840ae6605'}, u'hdd': {'truesize': '0', 'apparentsize': '0'}, u'hdc': {'truesize': '0', 'apparentsize': '0'}}, 'monitorResponse': '0', 'statsAge': '1.55', 'elapsedTime': '24', 'vmType': 'kvm', 'cpuSys': '25.33', 'guestCPUCount': -1, 'appsList': [], 'guestIPs': ''}]} >Thread-34::DEBUG::2014-07-10 09:03:51,316::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [104a146c] >Thread-34::DEBUG::2014-07-10 09:03:51,317::task::595::TaskManager.Task::(_updateState) Task=`141be3da-90d2-4c29-9282-d4edb2852cac`::moving from state init -> state preparing >Thread-34::INFO::2014-07-10 09:03:51,318::logUtils::44::dispatcher::(wrapper) Run and protect: createVolume(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='e4c65229-4247-4b33-b72a-f1d5ce72ad05', size='10737418240', volFormat=4, preallocate=2, diskType=2, volUUID='cad94284-3ca9-4c30-933d-997f4460309e', desc='', srcImgUUID='9cf413b7-7f14-4a61-8c71-913e5b0ea9c0', srcVolUUID='47592965-e853-4e59-9728-d11cca6a7a8a') >Thread-34::DEBUG::2014-07-10 09:03:51,319::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.9e1aa540-1f4e-4ee3-a152-be381ef6c3bd`ReqID=`c6654645-5cfa-4f8a-b51e-994026184078`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '1464' at 'createVolume' >Thread-34::DEBUG::2014-07-10 09:03:51,319::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.9e1aa540-1f4e-4ee3-a152-be381ef6c3bd' for lock type 'shared' >Thread-34::DEBUG::2014-07-10 09:03:51,319::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.9e1aa540-1f4e-4ee3-a152-be381ef6c3bd' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-10 09:03:51,319::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.9e1aa540-1f4e-4ee3-a152-be381ef6c3bd`ReqID=`c6654645-5cfa-4f8a-b51e-994026184078`::Granted request >Thread-34::DEBUG::2014-07-10 09:03:51,320::task::827::TaskManager.Task::(resourceAcquired) Task=`141be3da-90d2-4c29-9282-d4edb2852cac`::_resourcesAcquired: Storage.9e1aa540-1f4e-4ee3-a152-be381ef6c3bd (shared) >Thread-34::DEBUG::2014-07-10 09:03:51,320::task::990::TaskManager.Task::(_decref) Task=`141be3da-90d2-4c29-9282-d4edb2852cac`::ref 1 aborting False >Thread-34::DEBUG::2014-07-10 09:03:51,323::task::752::TaskManager.Task::(_save) Task=`141be3da-90d2-4c29-9282-d4edb2852cac`::_save: orig /rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/master/tasks/141be3da-90d2-4c29-9282-d4edb2852cac temp /rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/master/tasks/141be3da-90d2-4c29-9282-d4edb2852cac.temp >Thread-34::DEBUG::2014-07-10 09:03:51,329::taskManager::68::TaskManager::(scheduleJob) scheduled job createVolume for task 141be3da-90d2-4c29-9282-d4edb2852cac >Thread-34::INFO::2014-07-10 09:03:51,329::logUtils::47::dispatcher::(wrapper) Run and protect: createVolume, Return response: None >Thread-34::DEBUG::2014-07-10 09:03:51,330::task::1180::TaskManager.Task::(prepare) Task=`141be3da-90d2-4c29-9282-d4edb2852cac`::Prepare: 1 jobs exist, move to acquiring >Thread-34::DEBUG::2014-07-10 09:03:51,330::task::595::TaskManager.Task::(_updateState) Task=`141be3da-90d2-4c29-9282-d4edb2852cac`::moving from state preparing -> state acquiring >Thread-34::DEBUG::2014-07-10 09:03:51,330::task::752::TaskManager.Task::(_save) Task=`141be3da-90d2-4c29-9282-d4edb2852cac`::_save: orig /rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/master/tasks/141be3da-90d2-4c29-9282-d4edb2852cac temp /rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/master/tasks/141be3da-90d2-4c29-9282-d4edb2852cac.temp >Thread-34::DEBUG::2014-07-10 09:03:51,336::task::595::TaskManager.Task::(_updateState) Task=`141be3da-90d2-4c29-9282-d4edb2852cac`::moving from state acquiring -> state queued >Thread-34::DEBUG::2014-07-10 09:03:51,337::task::752::TaskManager.Task::(_save) Task=`141be3da-90d2-4c29-9282-d4edb2852cac`::_save: orig /rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/master/tasks/141be3da-90d2-4c29-9282-d4edb2852cac temp /rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/master/tasks/141be3da-90d2-4c29-9282-d4edb2852cac.temp >Thread-34::DEBUG::2014-07-10 09:03:51,343::taskManager::50::TaskManager::(_queueTask) queuing task: 141be3da-90d2-4c29-9282-d4edb2852cac >Thread-34::DEBUG::2014-07-10 09:03:51,344::taskManager::56::TaskManager::(_queueTask) task queued: 141be3da-90d2-4c29-9282-d4edb2852cac >Thread-7::DEBUG::2014-07-10 09:03:51,344::threadPool::57::Misc.ThreadPool::(setRunningTask) Number of running tasks: 1 >Thread-34::DEBUG::2014-07-10 09:03:51,344::task::1182::TaskManager.Task::(prepare) Task=`141be3da-90d2-4c29-9282-d4edb2852cac`::returning >141be3da-90d2-4c29-9282-d4edb2852cac::DEBUG::2014-07-10 09:03:51,344::threadPool::200::Misc.ThreadPool.WorkerThread::(_processNextTask) Task: 141be3da-90d2-4c29-9282-d4edb2852cac running: <bound method Task.commit of <storage.task.Task instance at 0x7f621c3e3830>> with: None >Thread-34::DEBUG::2014-07-10 09:03:51,344::task::990::TaskManager.Task::(_decref) Task=`141be3da-90d2-4c29-9282-d4edb2852cac`::ref 0 aborting False >141be3da-90d2-4c29-9282-d4edb2852cac::DEBUG::2014-07-10 09:03:51,345::task::1194::TaskManager.Task::(commit) Task=`141be3da-90d2-4c29-9282-d4edb2852cac`::committing task: 141be3da-90d2-4c29-9282-d4edb2852cac >141be3da-90d2-4c29-9282-d4edb2852cac::DEBUG::2014-07-10 09:03:51,345::task::595::TaskManager.Task::(_updateState) Task=`141be3da-90d2-4c29-9282-d4edb2852cac`::moving from state queued -> state running >141be3da-90d2-4c29-9282-d4edb2852cac::DEBUG::2014-07-10 09:03:51,346::task::752::TaskManager.Task::(_save) Task=`141be3da-90d2-4c29-9282-d4edb2852cac`::_save: orig /rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/master/tasks/141be3da-90d2-4c29-9282-d4edb2852cac temp /rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/master/tasks/141be3da-90d2-4c29-9282-d4edb2852cac.temp >141be3da-90d2-4c29-9282-d4edb2852cac::DEBUG::2014-07-10 09:03:51,352::task::905::TaskManager.Task::(_runJobs) Task=`141be3da-90d2-4c29-9282-d4edb2852cac`::Task.run: running job 0: createVolume: <bound method StoragePool.createVolume of <storage.sp.StoragePool object at 0x7f62180b9dd0>> (args: ('9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'e4c65229-4247-4b33-b72a-f1d5ce72ad05', 20971520, 4, 2, 2, 'cad94284-3ca9-4c30-933d-997f4460309e', '', '9cf413b7-7f14-4a61-8c71-913e5b0ea9c0', '47592965-e853-4e59-9728-d11cca6a7a8a') kwargs: {}) >141be3da-90d2-4c29-9282-d4edb2852cac::DEBUG::2014-07-10 09:03:51,352::task::331::TaskManager.Task::(run) Task=`141be3da-90d2-4c29-9282-d4edb2852cac`::Job.run: running createVolume: <bound method StoragePool.createVolume of <storage.sp.StoragePool object at 0x7f62180b9dd0>> (args: ('9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'e4c65229-4247-4b33-b72a-f1d5ce72ad05', 20971520, 4, 2, 2, 'cad94284-3ca9-4c30-933d-997f4460309e', '', '9cf413b7-7f14-4a61-8c71-913e5b0ea9c0', '47592965-e853-4e59-9728-d11cca6a7a8a') kwargs: {}) callback None >141be3da-90d2-4c29-9282-d4edb2852cac::DEBUG::2014-07-10 09:03:51,353::blockVolume::572::Storage.Misc.excCmd::(getMetadata) '/bin/dd iflag=direct skip=4 bs=512 if=/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/metadata count=1' (cwd None) >141be3da-90d2-4c29-9282-d4edb2852cac::DEBUG::2014-07-10 09:03:51,374::blockVolume::572::Storage.Misc.excCmd::(getMetadata) SUCCESS: <err> = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.000526894 s, 972 kB/s\n'; <rc> = 0 >141be3da-90d2-4c29-9282-d4edb2852cac::DEBUG::2014-07-10 09:03:51,375::misc::282::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.000526894 s, 972 kB/s'], size: 512 >141be3da-90d2-4c29-9282-d4edb2852cac::DEBUG::2014-07-10 09:03:51,376::resourceManager::198::ResourceManager.Request::(__init__) ResName=`9e1aa540-1f4e-4ee3-a152-be381ef6c3bd_imageNS.e4c65229-4247-4b33-b72a-f1d5ce72ad05`ReqID=`9f275ab1-faa8-4656-86bf-5e0e35a9ef1c`::Request was made in '/usr/share/vdsm/storage/sp.py' line '1767' at 'createVolume' >141be3da-90d2-4c29-9282-d4edb2852cac::DEBUG::2014-07-10 09:03:51,376::resourceManager::542::ResourceManager::(registerResource) Trying to register resource '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd_imageNS.e4c65229-4247-4b33-b72a-f1d5ce72ad05' for lock type 'exclusive' >141be3da-90d2-4c29-9282-d4edb2852cac::DEBUG::2014-07-10 09:03:51,377::lvm::427::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' got the operation mutex >141be3da-90d2-4c29-9282-d4edb2852cac::DEBUG::2014-07-10 09:03:51,377::lvm::296::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm lvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/3600601601282300032826addbbdae311|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,vg_name,attr,size,seg_start_pe,devices,tags 9e1aa540-1f4e-4ee3-a152-be381ef6c3bd' (cwd None) >141be3da-90d2-4c29-9282-d4edb2852cac::DEBUG::2014-07-10 09:03:51,628::lvm::296::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >141be3da-90d2-4c29-9282-d4edb2852cac::DEBUG::2014-07-10 09:03:51,645::lvm::462::Storage.LVM::(_reloadlvs) lvs reloaded >141be3da-90d2-4c29-9282-d4edb2852cac::DEBUG::2014-07-10 09:03:51,645::lvm::462::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' released the operation mutex >141be3da-90d2-4c29-9282-d4edb2852cac::DEBUG::2014-07-10 09:03:51,645::resourceFactories::125::Storage.ResourcesFactories::(__getResourceCandidatesList) Image e4c65229-4247-4b33-b72a-f1d5ce72ad05 does not exist in domain 9e1aa540-1f4e-4ee3-a152-be381ef6c3bd >141be3da-90d2-4c29-9282-d4edb2852cac::DEBUG::2014-07-10 09:03:51,646::resourceManager::601::ResourceManager::(registerResource) Resource '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd_imageNS.e4c65229-4247-4b33-b72a-f1d5ce72ad05' is free. Now locking as 'exclusive' (1 active user) >141be3da-90d2-4c29-9282-d4edb2852cac::DEBUG::2014-07-10 09:03:51,646::resourceManager::238::ResourceManager.Request::(grant) ResName=`9e1aa540-1f4e-4ee3-a152-be381ef6c3bd_imageNS.e4c65229-4247-4b33-b72a-f1d5ce72ad05`ReqID=`9f275ab1-faa8-4656-86bf-5e0e35a9ef1c`::Granted request >141be3da-90d2-4c29-9282-d4edb2852cac::INFO::2014-07-10 09:03:51,647::image::123::Storage.Image::(create) Create placeholder /rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/images/e4c65229-4247-4b33-b72a-f1d5ce72ad05 for image's volumes >141be3da-90d2-4c29-9282-d4edb2852cac::DEBUG::2014-07-10 09:03:51,648::task::752::TaskManager.Task::(_save) Task=`141be3da-90d2-4c29-9282-d4edb2852cac`::_save: orig /rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/master/tasks/141be3da-90d2-4c29-9282-d4edb2852cac temp /rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/master/tasks/141be3da-90d2-4c29-9282-d4edb2852cac.temp >141be3da-90d2-4c29-9282-d4edb2852cac::DEBUG::2014-07-10 09:03:51,656::blockVolume::572::Storage.Misc.excCmd::(getMetadata) '/bin/dd iflag=direct skip=4 bs=512 if=/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/metadata count=1' (cwd None) >141be3da-90d2-4c29-9282-d4edb2852cac::DEBUG::2014-07-10 09:03:51,674::blockVolume::572::Storage.Misc.excCmd::(getMetadata) SUCCESS: <err> = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.000472217 s, 1.1 MB/s\n'; <rc> = 0 >141be3da-90d2-4c29-9282-d4edb2852cac::DEBUG::2014-07-10 09:03:51,675::misc::282::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.000472217 s, 1.1 MB/s'], size: 512 >141be3da-90d2-4c29-9282-d4edb2852cac::DEBUG::2014-07-10 09:03:51,675::volume::300::Storage.Volume::(share) Share volume 47592965-e853-4e59-9728-d11cca6a7a8a to /rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/images/e4c65229-4247-4b33-b72a-f1d5ce72ad05 >141be3da-90d2-4c29-9282-d4edb2852cac::DEBUG::2014-07-10 09:03:51,676::blockVolume::572::Storage.Misc.excCmd::(getMetadata) '/bin/dd iflag=direct skip=4 bs=512 if=/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/metadata count=1' (cwd None) >141be3da-90d2-4c29-9282-d4edb2852cac::DEBUG::2014-07-10 09:03:51,695::blockVolume::572::Storage.Misc.excCmd::(getMetadata) SUCCESS: <err> = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.000579566 s, 883 kB/s\n'; <rc> = 0 >141be3da-90d2-4c29-9282-d4edb2852cac::DEBUG::2014-07-10 09:03:51,695::misc::282::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.000579566 s, 883 kB/s'], size: 512 >141be3da-90d2-4c29-9282-d4edb2852cac::DEBUG::2014-07-10 09:03:51,697::task::752::TaskManager.Task::(_save) Task=`141be3da-90d2-4c29-9282-d4edb2852cac`::_save: orig /rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/master/tasks/141be3da-90d2-4c29-9282-d4edb2852cac temp /rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/master/tasks/141be3da-90d2-4c29-9282-d4edb2852cac.temp >141be3da-90d2-4c29-9282-d4edb2852cac::DEBUG::2014-07-10 09:03:51,706::blockVolume::353::Storage.Volume::(_share) Share volume 47592965-e853-4e59-9728-d11cca6a7a8a to /rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/images/e4c65229-4247-4b33-b72a-f1d5ce72ad05 >141be3da-90d2-4c29-9282-d4edb2852cac::DEBUG::2014-07-10 09:03:51,707::blockVolume::572::Storage.Misc.excCmd::(getMetadata) '/bin/dd iflag=direct skip=4 bs=512 if=/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/metadata count=1' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:03:51,726::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >141be3da-90d2-4c29-9282-d4edb2852cac::DEBUG::2014-07-10 09:03:51,766::blockVolume::572::Storage.Misc.excCmd::(getMetadata) SUCCESS: <err> = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.000642619 s, 797 kB/s\n'; <rc> = 0 >141be3da-90d2-4c29-9282-d4edb2852cac::DEBUG::2014-07-10 09:03:51,770::misc::282::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.000642619 s, 797 kB/s'], size: 512 >141be3da-90d2-4c29-9282-d4edb2852cac::INFO::2014-07-10 09:03:51,773::volume::443::Storage.Volume::(create) Creating volume cad94284-3ca9-4c30-933d-997f4460309e >141be3da-90d2-4c29-9282-d4edb2852cac::DEBUG::2014-07-10 09:03:51,779::task::752::TaskManager.Task::(_save) Task=`141be3da-90d2-4c29-9282-d4edb2852cac`::_save: orig /rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/master/tasks/141be3da-90d2-4c29-9282-d4edb2852cac temp /rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/master/tasks/141be3da-90d2-4c29-9282-d4edb2852cac.temp >141be3da-90d2-4c29-9282-d4edb2852cac::DEBUG::2014-07-10 09:03:51,856::task::752::TaskManager.Task::(_save) Task=`141be3da-90d2-4c29-9282-d4edb2852cac`::_save: orig /rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/master/tasks/141be3da-90d2-4c29-9282-d4edb2852cac temp /rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/master/tasks/141be3da-90d2-4c29-9282-d4edb2852cac.temp >141be3da-90d2-4c29-9282-d4edb2852cac::DEBUG::2014-07-10 09:03:51,944::lvm::296::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm lvcreate --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/3600601601282300032826addbbdae311|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } " --autobackup n --contiguous n --size 1024m --addtag OVIRT_VOL_INITIALIZING --name cad94284-3ca9-4c30-933d-997f4460309e 9e1aa540-1f4e-4ee3-a152-be381ef6c3bd' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:03:52,020::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.23206 s, 4.4 MB/s\n'; <rc> = 0 >141be3da-90d2-4c29-9282-d4edb2852cac::DEBUG::2014-07-10 09:03:52,278::lvm::296::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ' WARNING: This metadata update is NOT backed up\n WARNING: This metadata update is NOT backed up\n'; <rc> = 0 >141be3da-90d2-4c29-9282-d4edb2852cac::DEBUG::2014-07-10 09:03:52,279::lvm::503::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >141be3da-90d2-4c29-9282-d4edb2852cac::DEBUG::2014-07-10 09:03:52,279::lvm::505::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >141be3da-90d2-4c29-9282-d4edb2852cac::DEBUG::2014-07-10 09:03:52,279::lvm::513::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >141be3da-90d2-4c29-9282-d4edb2852cac::DEBUG::2014-07-10 09:03:52,280::lvm::525::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >141be3da-90d2-4c29-9282-d4edb2852cac::WARNING::2014-07-10 09:03:52,280::utils::129::root::(rmFile) File: /rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/images/e4c65229-4247-4b33-b72a-f1d5ce72ad05/cad94284-3ca9-4c30-933d-997f4460309e already removed >141be3da-90d2-4c29-9282-d4edb2852cac::INFO::2014-07-10 09:03:52,282::blockVolume::169::Storage.Volume::(_create) Request to create snapshot e4c65229-4247-4b33-b72a-f1d5ce72ad05/cad94284-3ca9-4c30-933d-997f4460309e of volume 9cf413b7-7f14-4a61-8c71-913e5b0ea9c0/47592965-e853-4e59-9728-d11cca6a7a8a >141be3da-90d2-4c29-9282-d4edb2852cac::DEBUG::2014-07-10 09:03:52,284::task::752::TaskManager.Task::(_save) Task=`141be3da-90d2-4c29-9282-d4edb2852cac`::_save: orig /rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/master/tasks/141be3da-90d2-4c29-9282-d4edb2852cac temp /rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/master/tasks/141be3da-90d2-4c29-9282-d4edb2852cac.temp >141be3da-90d2-4c29-9282-d4edb2852cac::DEBUG::2014-07-10 09:03:52,295::blockVolume::572::Storage.Misc.excCmd::(getMetadata) '/bin/dd iflag=direct skip=4 bs=512 if=/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/metadata count=1' (cwd None) >141be3da-90d2-4c29-9282-d4edb2852cac::DEBUG::2014-07-10 09:03:52,316::blockVolume::572::Storage.Misc.excCmd::(getMetadata) SUCCESS: <err> = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.000493611 s, 1.0 MB/s\n'; <rc> = 0 >141be3da-90d2-4c29-9282-d4edb2852cac::DEBUG::2014-07-10 09:03:52,317::misc::282::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.000493611 s, 1.0 MB/s'], size: 512 >141be3da-90d2-4c29-9282-d4edb2852cac::INFO::2014-07-10 09:03:52,317::volume::789::Storage.Volume::(prepare) Volume: preparing volume 9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/47592965-e853-4e59-9728-d11cca6a7a8a >141be3da-90d2-4c29-9282-d4edb2852cac::DEBUG::2014-07-10 09:03:52,318::blockVolume::572::Storage.Misc.excCmd::(getMetadata) '/bin/dd iflag=direct skip=4 bs=512 if=/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/metadata count=1' (cwd None) >141be3da-90d2-4c29-9282-d4edb2852cac::DEBUG::2014-07-10 09:03:52,338::blockVolume::572::Storage.Misc.excCmd::(getMetadata) SUCCESS: <err> = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.000513431 s, 997 kB/s\n'; <rc> = 0 >141be3da-90d2-4c29-9282-d4edb2852cac::DEBUG::2014-07-10 09:03:52,338::misc::282::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.000513431 s, 997 kB/s'], size: 512 >141be3da-90d2-4c29-9282-d4edb2852cac::DEBUG::2014-07-10 09:03:52,340::resourceManager::198::ResourceManager.Request::(__init__) ResName=`9e1aa540-1f4e-4ee3-a152-be381ef6c3bd_lvmActivationNS.47592965-e853-4e59-9728-d11cca6a7a8a`ReqID=`622c6ebf-306a-42d7-878f-82e053da1521`::Request was made in '/usr/share/vdsm/storage/volume.py' line '806' at 'prepare' >141be3da-90d2-4c29-9282-d4edb2852cac::DEBUG::2014-07-10 09:03:52,340::resourceManager::542::ResourceManager::(registerResource) Trying to register resource '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd_lvmActivationNS.47592965-e853-4e59-9728-d11cca6a7a8a' for lock type 'shared' >141be3da-90d2-4c29-9282-d4edb2852cac::DEBUG::2014-07-10 09:03:52,340::resourceManager::601::ResourceManager::(registerResource) Resource '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd_lvmActivationNS.47592965-e853-4e59-9728-d11cca6a7a8a' is free. Now locking as 'shared' (1 active user) >141be3da-90d2-4c29-9282-d4edb2852cac::DEBUG::2014-07-10 09:03:52,341::resourceManager::238::ResourceManager.Request::(grant) ResName=`9e1aa540-1f4e-4ee3-a152-be381ef6c3bd_lvmActivationNS.47592965-e853-4e59-9728-d11cca6a7a8a`ReqID=`622c6ebf-306a-42d7-878f-82e053da1521`::Granted request >141be3da-90d2-4c29-9282-d4edb2852cac::DEBUG::2014-07-10 09:03:52,342::blockVolume::572::Storage.Misc.excCmd::(getMetadata) '/bin/dd iflag=direct skip=4 bs=512 if=/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/metadata count=1' (cwd None) >141be3da-90d2-4c29-9282-d4edb2852cac::DEBUG::2014-07-10 09:03:52,362::blockVolume::572::Storage.Misc.excCmd::(getMetadata) SUCCESS: <err> = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.000486177 s, 1.1 MB/s\n'; <rc> = 0 >141be3da-90d2-4c29-9282-d4edb2852cac::DEBUG::2014-07-10 09:03:52,363::misc::282::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.000486177 s, 1.1 MB/s'], size: 512 >141be3da-90d2-4c29-9282-d4edb2852cac::DEBUG::2014-07-10 09:03:52,363::volume::270::Storage.Volume::(clone) Volume.clone: /rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/images/e4c65229-4247-4b33-b72a-f1d5ce72ad05/47592965-e853-4e59-9728-d11cca6a7a8a to /rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/images/e4c65229-4247-4b33-b72a-f1d5ce72ad05/cad94284-3ca9-4c30-933d-997f4460309e >141be3da-90d2-4c29-9282-d4edb2852cac::DEBUG::2014-07-10 09:03:52,364::blockVolume::572::Storage.Misc.excCmd::(getMetadata) '/bin/dd iflag=direct skip=4 bs=512 if=/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/metadata count=1' (cwd None) >141be3da-90d2-4c29-9282-d4edb2852cac::DEBUG::2014-07-10 09:03:52,401::blockVolume::572::Storage.Misc.excCmd::(getMetadata) SUCCESS: <err> = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.0208388 s, 24.6 kB/s\n'; <rc> = 0 >141be3da-90d2-4c29-9282-d4edb2852cac::DEBUG::2014-07-10 09:03:52,402::misc::282::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.0208388 s, 24.6 kB/s'], size: 512 >141be3da-90d2-4c29-9282-d4edb2852cac::DEBUG::2014-07-10 09:03:52,402::blockVolume::572::Storage.Misc.excCmd::(getMetadata) '/bin/dd iflag=direct skip=4 bs=512 if=/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/metadata count=1' (cwd None) >141be3da-90d2-4c29-9282-d4edb2852cac::DEBUG::2014-07-10 09:03:52,441::blockVolume::572::Storage.Misc.excCmd::(getMetadata) SUCCESS: <err> = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.0233854 s, 21.9 kB/s\n'; <rc> = 0 >141be3da-90d2-4c29-9282-d4edb2852cac::DEBUG::2014-07-10 09:03:52,442::misc::282::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.0233854 s, 21.9 kB/s'], size: 512 >141be3da-90d2-4c29-9282-d4edb2852cac::DEBUG::2014-07-10 09:03:52,443::volume::1042::Storage.Misc.excCmd::(createVolume) '/usr/bin/qemu-img create -f qcow2 -F raw -b ../e4c65229-4247-4b33-b72a-f1d5ce72ad05/47592965-e853-4e59-9728-d11cca6a7a8a /rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/images/e4c65229-4247-4b33-b72a-f1d5ce72ad05/cad94284-3ca9-4c30-933d-997f4460309e' (cwd /rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/images/e4c65229-4247-4b33-b72a-f1d5ce72ad05) >141be3da-90d2-4c29-9282-d4edb2852cac::DEBUG::2014-07-10 09:03:52,508::volume::1042::Storage.Misc.excCmd::(createVolume) SUCCESS: <err> = ''; <rc> = 0 >141be3da-90d2-4c29-9282-d4edb2852cac::INFO::2014-07-10 09:03:52,509::blockVolume::393::Storage.Volume::(teardown) Tearing down volume 9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/47592965-e853-4e59-9728-d11cca6a7a8a justme False >141be3da-90d2-4c29-9282-d4edb2852cac::DEBUG::2014-07-10 09:03:52,509::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd_lvmActivationNS.47592965-e853-4e59-9728-d11cca6a7a8a' >141be3da-90d2-4c29-9282-d4edb2852cac::DEBUG::2014-07-10 09:03:52,510::resourceManager::635::ResourceManager::(releaseResource) Released resource '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd_lvmActivationNS.47592965-e853-4e59-9728-d11cca6a7a8a' (0 active users) >141be3da-90d2-4c29-9282-d4edb2852cac::DEBUG::2014-07-10 09:03:52,510::resourceManager::641::ResourceManager::(releaseResource) Resource '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd_lvmActivationNS.47592965-e853-4e59-9728-d11cca6a7a8a' is free, finding out if anyone is waiting for it. >141be3da-90d2-4c29-9282-d4edb2852cac::DEBUG::2014-07-10 09:03:52,511::lvm::296::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm lvchange --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/3600601601282300032826addbbdae311|/dev/mapper/360060160f4a030003840ec867ddee311|/dev/mapper/367cad74c2fcba00019e6afd20c781e67|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } " --autobackup n --available n 9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/47592965-e853-4e59-9728-d11cca6a7a8a' (cwd None) >GuestMonitor-scale_9::DEBUG::2014-07-10 09:03:52,980::vm::598::vm.Vm::(_getCpuStats) vmId=`62e7aad5-ff72-4fe3-830f-e7726ed4bfba`::CPU stats not available: 'NoneType' object is unsubscriptable >GuestMonitor-scale_9::DEBUG::2014-07-10 09:03:52,980::vm::654::vm.Vm::(_getNetworkStats) vmId=`62e7aad5-ff72-4fe3-830f-e7726ed4bfba`::Network stats not available >GuestMonitor-scale_9::DEBUG::2014-07-10 09:03:52,981::vm::676::vm.Vm::(_getDiskStats) vmId=`62e7aad5-ff72-4fe3-830f-e7726ed4bfba`::Disk hdd stats not available >GuestMonitor-scale_9::DEBUG::2014-07-10 09:03:52,981::vm::676::vm.Vm::(_getDiskStats) vmId=`62e7aad5-ff72-4fe3-830f-e7726ed4bfba`::Disk hdc stats not available >GuestMonitor-scale_9::DEBUG::2014-07-10 09:03:52,981::vm::676::vm.Vm::(_getDiskStats) vmId=`62e7aad5-ff72-4fe3-830f-e7726ed4bfba`::Disk vda stats not available >GuestMonitor-scale_9::DEBUG::2014-07-10 09:03:52,981::vm::715::vm.Vm::(_getDiskLatency) vmId=`62e7aad5-ff72-4fe3-830f-e7726ed4bfba`::Disk hdd latency not available >GuestMonitor-scale_9::DEBUG::2014-07-10 09:03:52,981::vm::715::vm.Vm::(_getDiskLatency) vmId=`62e7aad5-ff72-4fe3-830f-e7726ed4bfba`::Disk hdc latency not available >GuestMonitor-scale_9::DEBUG::2014-07-10 09:03:52,982::vm::715::vm.Vm::(_getDiskLatency) vmId=`62e7aad5-ff72-4fe3-830f-e7726ed4bfba`::Disk vda latency not available >GuestMonitor-scale_9::DEBUG::2014-07-10 09:03:52,982::vm::598::vm.Vm::(_getCpuStats) vmId=`62e7aad5-ff72-4fe3-830f-e7726ed4bfba`::CPU stats not available: 'NoneType' object is unsubscriptable >GuestMonitor-scale_9::DEBUG::2014-07-10 09:03:52,983::vm::654::vm.Vm::(_getNetworkStats) vmId=`62e7aad5-ff72-4fe3-830f-e7726ed4bfba`::Network stats not available >GuestMonitor-scale_9::DEBUG::2014-07-10 09:03:52,983::vm::676::vm.Vm::(_getDiskStats) vmId=`62e7aad5-ff72-4fe3-830f-e7726ed4bfba`::Disk hdd stats not available >GuestMonitor-scale_9::DEBUG::2014-07-10 09:03:52,983::vm::676::vm.Vm::(_getDiskStats) vmId=`62e7aad5-ff72-4fe3-830f-e7726ed4bfba`::Disk hdc stats not available >GuestMonitor-scale_9::DEBUG::2014-07-10 09:03:52,983::vm::676::vm.Vm::(_getDiskStats) vmId=`62e7aad5-ff72-4fe3-830f-e7726ed4bfba`::Disk vda stats not available >GuestMonitor-scale_9::DEBUG::2014-07-10 09:03:52,983::vm::715::vm.Vm::(_getDiskLatency) vmId=`62e7aad5-ff72-4fe3-830f-e7726ed4bfba`::Disk hdd latency not available >GuestMonitor-scale_9::DEBUG::2014-07-10 09:03:52,984::vm::715::vm.Vm::(_getDiskLatency) vmId=`62e7aad5-ff72-4fe3-830f-e7726ed4bfba`::Disk hdc latency not available >GuestMonitor-scale_9::DEBUG::2014-07-10 09:03:52,984::vm::715::vm.Vm::(_getDiskLatency) vmId=`62e7aad5-ff72-4fe3-830f-e7726ed4bfba`::Disk vda latency not available >GuestMonitor-scale_8::DEBUG::2014-07-10 09:03:53,074::vm::676::vm.Vm::(_getDiskStats) vmId=`5d49ebac-3f0d-4688-aed0-b3f5fe364000`::Disk hdd stats not available >GuestMonitor-scale_8::DEBUG::2014-07-10 09:03:53,075::vm::676::vm.Vm::(_getDiskStats) vmId=`5d49ebac-3f0d-4688-aed0-b3f5fe364000`::Disk hdc stats not available >GuestMonitor-scale_8::DEBUG::2014-07-10 09:03:53,075::vm::676::vm.Vm::(_getDiskStats) vmId=`5d49ebac-3f0d-4688-aed0-b3f5fe364000`::Disk vda stats not available >GuestMonitor-scale_8::DEBUG::2014-07-10 09:03:53,075::vm::715::vm.Vm::(_getDiskLatency) vmId=`5d49ebac-3f0d-4688-aed0-b3f5fe364000`::Disk hdd latency not available >GuestMonitor-scale_8::DEBUG::2014-07-10 09:03:53,075::vm::715::vm.Vm::(_getDiskLatency) vmId=`5d49ebac-3f0d-4688-aed0-b3f5fe364000`::Disk hdc latency not available >GuestMonitor-scale_8::DEBUG::2014-07-10 09:03:53,075::vm::715::vm.Vm::(_getDiskLatency) vmId=`5d49ebac-3f0d-4688-aed0-b3f5fe364000`::Disk vda latency not available >GuestMonitor-scale_8::DEBUG::2014-07-10 09:03:53,076::vm::676::vm.Vm::(_getDiskStats) vmId=`5d49ebac-3f0d-4688-aed0-b3f5fe364000`::Disk hdd stats not available >GuestMonitor-scale_8::DEBUG::2014-07-10 09:03:53,076::vm::676::vm.Vm::(_getDiskStats) vmId=`5d49ebac-3f0d-4688-aed0-b3f5fe364000`::Disk hdc stats not available >GuestMonitor-scale_8::DEBUG::2014-07-10 09:03:53,076::vm::676::vm.Vm::(_getDiskStats) vmId=`5d49ebac-3f0d-4688-aed0-b3f5fe364000`::Disk vda stats not available >GuestMonitor-scale_8::DEBUG::2014-07-10 09:03:53,077::vm::715::vm.Vm::(_getDiskLatency) vmId=`5d49ebac-3f0d-4688-aed0-b3f5fe364000`::Disk hdd latency not available >GuestMonitor-scale_8::DEBUG::2014-07-10 09:03:53,077::vm::715::vm.Vm::(_getDiskLatency) vmId=`5d49ebac-3f0d-4688-aed0-b3f5fe364000`::Disk hdc latency not available >GuestMonitor-scale_8::DEBUG::2014-07-10 09:03:53,077::vm::715::vm.Vm::(_getDiskLatency) vmId=`5d49ebac-3f0d-4688-aed0-b3f5fe364000`::Disk vda latency not available >GuestMonitor-scale_7::DEBUG::2014-07-10 09:03:53,216::vm::676::vm.Vm::(_getDiskStats) vmId=`a766ed65-ac2e-4862-8ff0-0352480cf6f1`::Disk hdd stats not available >GuestMonitor-scale_7::DEBUG::2014-07-10 09:03:53,217::vm::676::vm.Vm::(_getDiskStats) vmId=`a766ed65-ac2e-4862-8ff0-0352480cf6f1`::Disk hdc stats not available >GuestMonitor-scale_7::DEBUG::2014-07-10 09:03:53,217::vm::676::vm.Vm::(_getDiskStats) vmId=`a766ed65-ac2e-4862-8ff0-0352480cf6f1`::Disk vda stats not available >GuestMonitor-scale_7::DEBUG::2014-07-10 09:03:53,218::vm::715::vm.Vm::(_getDiskLatency) vmId=`a766ed65-ac2e-4862-8ff0-0352480cf6f1`::Disk hdd latency not available >GuestMonitor-scale_7::DEBUG::2014-07-10 09:03:53,218::vm::715::vm.Vm::(_getDiskLatency) vmId=`a766ed65-ac2e-4862-8ff0-0352480cf6f1`::Disk hdc latency not available >GuestMonitor-scale_7::DEBUG::2014-07-10 09:03:53,218::vm::715::vm.Vm::(_getDiskLatency) vmId=`a766ed65-ac2e-4862-8ff0-0352480cf6f1`::Disk vda latency not available >GuestMonitor-scale_7::DEBUG::2014-07-10 09:03:53,218::vm::676::vm.Vm::(_getDiskStats) vmId=`a766ed65-ac2e-4862-8ff0-0352480cf6f1`::Disk hdd stats not available >GuestMonitor-scale_7::DEBUG::2014-07-10 09:03:53,219::vm::676::vm.Vm::(_getDiskStats) vmId=`a766ed65-ac2e-4862-8ff0-0352480cf6f1`::Disk hdc stats not available >GuestMonitor-scale_7::DEBUG::2014-07-10 09:03:53,219::vm::676::vm.Vm::(_getDiskStats) vmId=`a766ed65-ac2e-4862-8ff0-0352480cf6f1`::Disk vda stats not available >GuestMonitor-scale_7::DEBUG::2014-07-10 09:03:53,219::vm::715::vm.Vm::(_getDiskLatency) vmId=`a766ed65-ac2e-4862-8ff0-0352480cf6f1`::Disk hdd latency not available >GuestMonitor-scale_7::DEBUG::2014-07-10 09:03:53,219::vm::715::vm.Vm::(_getDiskLatency) vmId=`a766ed65-ac2e-4862-8ff0-0352480cf6f1`::Disk hdc latency not available >GuestMonitor-scale_7::DEBUG::2014-07-10 09:03:53,219::vm::715::vm.Vm::(_getDiskLatency) vmId=`a766ed65-ac2e-4862-8ff0-0352480cf6f1`::Disk vda latency not available >Thread-14::DEBUG::2014-07-10 09:03:53,575::BindingXMLRPC::1067::vds::(wrapper) client [10.35.3.13]::call vmGetStats with ('a766ed65-ac2e-4862-8ff0-0352480cf6f1',) {} >Thread-14::DEBUG::2014-07-10 09:03:53,576::vm::676::vm.Vm::(_getDiskStats) vmId=`a766ed65-ac2e-4862-8ff0-0352480cf6f1`::Disk hdd stats not available >Thread-14::DEBUG::2014-07-10 09:03:53,576::vm::676::vm.Vm::(_getDiskStats) vmId=`a766ed65-ac2e-4862-8ff0-0352480cf6f1`::Disk hdc stats not available >Thread-14::DEBUG::2014-07-10 09:03:53,576::vm::676::vm.Vm::(_getDiskStats) vmId=`a766ed65-ac2e-4862-8ff0-0352480cf6f1`::Disk vda stats not available >Thread-14::DEBUG::2014-07-10 09:03:53,577::vm::715::vm.Vm::(_getDiskLatency) vmId=`a766ed65-ac2e-4862-8ff0-0352480cf6f1`::Disk hdd latency not available >Thread-14::DEBUG::2014-07-10 09:03:53,577::vm::715::vm.Vm::(_getDiskLatency) vmId=`a766ed65-ac2e-4862-8ff0-0352480cf6f1`::Disk hdc latency not available >Thread-14::DEBUG::2014-07-10 09:03:53,577::vm::715::vm.Vm::(_getDiskLatency) vmId=`a766ed65-ac2e-4862-8ff0-0352480cf6f1`::Disk vda latency not available >Thread-14::DEBUG::2014-07-10 09:03:53,577::BindingXMLRPC::1074::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Powering up', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '15456', 'displayIp': '0', 'displayPort': u'5912', 'session': 'Unknown', 'displaySecurePort': u'5913', 'timeOffset': '0', 'hash': '1078195817470092527', 'balloonInfo': {'balloon_max': '1048576', 'balloon_target': '1048576', 'balloon_cur': '1048576', 'balloon_min': '1048576'}, 'pauseCode': 'NOERR', 'clientIp': '', 'kvmEnable': 'true', 'network': {u'vnet6': {'macAddr': '00:1a:4a:de:6d:88', 'rxDropped': '0', 'rxErrors': '0', 'txDropped': '0', 'txRate': '0.0', 'rxRate': '0.0', 'txErrors': '0', 'state': 'unknown', 'speed': '1000', 'name': u'vnet6'}}, 'vmId': 'a766ed65-ac2e-4862-8ff0-0352480cf6f1', 'displayType': 'qxl', 'cpuUser': '36.84', 'disks': {u'vda': {'truesize': '1073741824', 'apparentsize': '1073741824', 'imageID': 'f30c2cb7-a43a-4bf5-82b5-cfe07336f65c'}, u'hdd': {'truesize': '0', 'apparentsize': '0'}, u'hdc': {'truesize': '0', 'apparentsize': '0'}}, 'monitorResponse': '0', 'statsAge': '1.69', 'elapsedTime': '46', 'vmType': 'kvm', 'cpuSys': '4.25', 'guestCPUCount': -1, 'appsList': [], 'guestIPs': ''}]} >Thread-14::DEBUG::2014-07-10 09:03:53,582::BindingXMLRPC::1067::vds::(wrapper) client [10.35.3.13]::call vmGetStats with ('62e7aad5-ff72-4fe3-830f-e7726ed4bfba',) {} >Thread-14::DEBUG::2014-07-10 09:03:53,582::vm::598::vm.Vm::(_getCpuStats) vmId=`62e7aad5-ff72-4fe3-830f-e7726ed4bfba`::CPU stats not available: 'NoneType' object is unsubscriptable >Thread-14::DEBUG::2014-07-10 09:03:53,582::vm::654::vm.Vm::(_getNetworkStats) vmId=`62e7aad5-ff72-4fe3-830f-e7726ed4bfba`::Network stats not available >Thread-14::DEBUG::2014-07-10 09:03:53,583::vm::676::vm.Vm::(_getDiskStats) vmId=`62e7aad5-ff72-4fe3-830f-e7726ed4bfba`::Disk hdd stats not available >Thread-14::DEBUG::2014-07-10 09:03:53,583::vm::676::vm.Vm::(_getDiskStats) vmId=`62e7aad5-ff72-4fe3-830f-e7726ed4bfba`::Disk hdc stats not available >Thread-14::DEBUG::2014-07-10 09:03:53,583::vm::676::vm.Vm::(_getDiskStats) vmId=`62e7aad5-ff72-4fe3-830f-e7726ed4bfba`::Disk vda stats not available >Thread-14::DEBUG::2014-07-10 09:03:53,583::vm::715::vm.Vm::(_getDiskLatency) vmId=`62e7aad5-ff72-4fe3-830f-e7726ed4bfba`::Disk hdd latency not available >Thread-14::DEBUG::2014-07-10 09:03:53,583::vm::715::vm.Vm::(_getDiskLatency) vmId=`62e7aad5-ff72-4fe3-830f-e7726ed4bfba`::Disk hdc latency not available >Thread-14::DEBUG::2014-07-10 09:03:53,584::vm::715::vm.Vm::(_getDiskLatency) vmId=`62e7aad5-ff72-4fe3-830f-e7726ed4bfba`::Disk vda latency not available >Thread-14::DEBUG::2014-07-10 09:03:53,584::BindingXMLRPC::1074::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Powering up', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '16791', 'displayIp': '0', 'displayPort': u'5916', 'session': 'Unknown', 'displaySecurePort': u'5917', 'timeOffset': '0', 'hash': '773530886922036478', 'balloonInfo': {'balloon_max': '1048576', 'balloon_target': '1048576', 'balloon_cur': '0', 'balloon_min': '1048576'}, 'pauseCode': 'NOERR', 'clientIp': '', 'kvmEnable': 'true', 'network': {u'vnet8': {'state': 'unknown', 'macAddr': '00:1a:4a:de:6d:83', 'speed': '1000', 'name': u'vnet8'}}, 'vmId': '62e7aad5-ff72-4fe3-830f-e7726ed4bfba', 'displayType': 'qxl', 'cpuUser': '0.00', 'disks': {u'vda': {'truesize': '1073741824', 'apparentsize': '1073741824', 'imageID': 'c01d693b-cba0-4fed-9ad7-0aaa28912a19'}, u'hdd': {'truesize': '0', 'apparentsize': '0'}, u'hdc': {'truesize': '0', 'apparentsize': '0'}}, 'monitorResponse': '0', 'statsAge': '1.43', 'elapsedTime': '6', 'vmType': 'kvm', 'cpuSys': '0.00', 'guestCPUCount': -1, 'appsList': [], 'guestIPs': ''}]} >Thread-14::DEBUG::2014-07-10 09:03:53,588::BindingXMLRPC::1067::vds::(wrapper) client [10.35.3.13]::call vmGetStats with ('5d49ebac-3f0d-4688-aed0-b3f5fe364000',) {} >Thread-14::DEBUG::2014-07-10 09:03:53,588::vm::676::vm.Vm::(_getDiskStats) vmId=`5d49ebac-3f0d-4688-aed0-b3f5fe364000`::Disk hdd stats not available >Thread-14::DEBUG::2014-07-10 09:03:53,589::vm::676::vm.Vm::(_getDiskStats) vmId=`5d49ebac-3f0d-4688-aed0-b3f5fe364000`::Disk hdc stats not available >Thread-14::DEBUG::2014-07-10 09:03:53,589::vm::676::vm.Vm::(_getDiskStats) vmId=`5d49ebac-3f0d-4688-aed0-b3f5fe364000`::Disk vda stats not available >Thread-14::DEBUG::2014-07-10 09:03:53,589::vm::715::vm.Vm::(_getDiskLatency) vmId=`5d49ebac-3f0d-4688-aed0-b3f5fe364000`::Disk hdd latency not available >Thread-14::DEBUG::2014-07-10 09:03:53,589::vm::715::vm.Vm::(_getDiskLatency) vmId=`5d49ebac-3f0d-4688-aed0-b3f5fe364000`::Disk hdc latency not available >Thread-14::DEBUG::2014-07-10 09:03:53,589::vm::715::vm.Vm::(_getDiskLatency) vmId=`5d49ebac-3f0d-4688-aed0-b3f5fe364000`::Disk vda latency not available >Thread-14::DEBUG::2014-07-10 09:03:53,590::BindingXMLRPC::1074::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Powering up', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '16122', 'displayIp': '0', 'displayPort': u'5914', 'session': 'Unknown', 'displaySecurePort': u'5915', 'timeOffset': '0', 'hash': '8384665493346130205', 'balloonInfo': {'balloon_max': '1048576', 'balloon_target': '1048576', 'balloon_cur': '1048576', 'balloon_min': '1048576'}, 'pauseCode': 'NOERR', 'clientIp': '', 'kvmEnable': 'true', 'network': {u'vnet7': {'macAddr': '00:1a:4a:de:6d:89', 'rxDropped': '0', 'rxErrors': '0', 'txDropped': '0', 'txRate': '0.0', 'rxRate': '0.0', 'txErrors': '0', 'state': 'unknown', 'speed': '1000', 'name': u'vnet7'}}, 'vmId': '5d49ebac-3f0d-4688-aed0-b3f5fe364000', 'displayType': 'qxl', 'cpuUser': '40.62', 'disks': {u'vda': {'truesize': '1073741824', 'apparentsize': '1073741824', 'imageID': 'cfaeead2-7caa-467c-b389-c89840ae6605'}, u'hdd': {'truesize': '0', 'apparentsize': '0'}, u'hdc': {'truesize': '0', 'apparentsize': '0'}}, 'monitorResponse': '0', 'statsAge': '0.26', 'elapsedTime': '27', 'vmType': 'kvm', 'cpuSys': '25.33', 'guestCPUCount': -1, 'appsList': [], 'guestIPs': ''}]} >Thread-14::DEBUG::2014-07-10 09:03:53,743::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-14::DEBUG::2014-07-10 09:03:53,745::task::595::TaskManager.Task::(_updateState) Task=`027f61e6-f29a-46c6-be76-540a07a93ec2`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 09:03:53,745::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-14::INFO::2014-07-10 09:03:53,746::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:03:53,746::task::1185::TaskManager.Task::(prepare) Task=`027f61e6-f29a-46c6-be76-540a07a93ec2`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:03:53,746::task::595::TaskManager.Task::(_updateState) Task=`027f61e6-f29a-46c6-be76-540a07a93ec2`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 09:03:53,746::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 09:03:53,747::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 09:03:53,747::task::990::TaskManager.Task::(_decref) Task=`027f61e6-f29a-46c6-be76-540a07a93ec2`::ref 0 aborting False >Thread-34::DEBUG::2014-07-10 09:03:53,751::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-34::DEBUG::2014-07-10 09:03:53,752::task::595::TaskManager.Task::(_updateState) Task=`84912d37-2e57-4682-9377-811082b27dc2`::moving from state init -> state preparing >Thread-34::INFO::2014-07-10 09:03:53,752::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-34::DEBUG::2014-07-10 09:03:53,753::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`6cd69357-c60a-4c58-b33c-2bb9440775b7`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-10 09:03:53,753::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' for lock type 'shared' >Thread-34::DEBUG::2014-07-10 09:03:53,753::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-10 09:03:53,753::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`6cd69357-c60a-4c58-b33c-2bb9440775b7`::Granted request >Thread-34::DEBUG::2014-07-10 09:03:53,754::task::827::TaskManager.Task::(resourceAcquired) Task=`84912d37-2e57-4682-9377-811082b27dc2`::_resourcesAcquired: Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee (shared) >Thread-34::DEBUG::2014-07-10 09:03:53,754::task::990::TaskManager.Task::(_decref) Task=`84912d37-2e57-4682-9377-811082b27dc2`::ref 1 aborting False >Thread-34::DEBUG::2014-07-10 09:03:53,755::lvm::373::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-34::DEBUG::2014-07-10 09:03:53,756::lvm::296::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/3600601601282300032826addbbdae311|/dev/mapper/360060160f4a030003840ec867ddee311|/dev/mapper/367cad74c2fcba00019e6afd20c781e67|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name 9e1aa540-1f4e-4ee3-a152-be381ef6c3bd' (cwd None) >Thread-34::DEBUG::2014-07-10 09:03:53,978::lvm::296::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-34::DEBUG::2014-07-10 09:03:53,981::lvm::415::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-34::INFO::2014-07-10 09:03:53,982::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1074547130368', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532067385344', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:03:53,983::task::1185::TaskManager.Task::(prepare) Task=`84912d37-2e57-4682-9377-811082b27dc2`::finished: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1074547130368', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532067385344', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:03:53,983::task::595::TaskManager.Task::(_updateState) Task=`84912d37-2e57-4682-9377-811082b27dc2`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-10 09:03:53,983::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee': < ResourceRef 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-10 09:03:53,983::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-10 09:03:53,984::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' >Thread-34::DEBUG::2014-07-10 09:03:53,984::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' (0 active users) >Thread-34::DEBUG::2014-07-10 09:03:53,984::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-10 09:03:53,985::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', Clearing records. >Thread-34::DEBUG::2014-07-10 09:03:53,985::task::990::TaskManager.Task::(_decref) Task=`84912d37-2e57-4682-9377-811082b27dc2`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 09:03:54,037::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:03:54,129::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0358448 s, 28.6 MB/s\n'; <rc> = 0 >Thread-40::DEBUG::2014-07-10 09:03:54,763::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lion.qa.lab.tlv.redhat.com:_export_yuri2_backup2/6a70504d-00df-4869-8695-0f442053f6b6/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-40::DEBUG::2014-07-10 09:03:54,784::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n369 bytes (369 B) copied, 0.000447372 s, 825 kB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-07-10 09:03:54,871::guestIF::274::vm.Vm::(_handleMessage) vmId=`a766ed65-ac2e-4862-8ff0-0352480cf6f1`::username: u'None' >VM Channels Listener::DEBUG::2014-07-10 09:03:55,093::guestIF::274::vm.Vm::(_handleMessage) vmId=`a766ed65-ac2e-4862-8ff0-0352480cf6f1`::username: u'None' >Thread-14::DEBUG::2014-07-10 09:03:55,506::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-14::DEBUG::2014-07-10 09:03:55,507::task::595::TaskManager.Task::(_updateState) Task=`2ffd24d4-015c-4e4c-8247-2bbada664bb6`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 09:03:55,507::logUtils::44::dispatcher::(wrapper) Run and protect: getAllTasksStatuses(spUUID=None, options=None) >Thread-14::DEBUG::2014-07-10 09:03:55,508::taskManager::102::TaskManager::(getAllTasksStatuses) Entry. >Thread-14::DEBUG::2014-07-10 09:03:55,508::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 141be3da-90d2-4c29-9282-d4edb2852cac >Thread-14::DEBUG::2014-07-10 09:03:55,508::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '141be3da-90d2-4c29-9282-d4edb2852cac'} >Thread-14::DEBUG::2014-07-10 09:03:55,508::taskManager::113::TaskManager::(getAllTasksStatuses) Return: {'141be3da-90d2-4c29-9282-d4edb2852cac': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '141be3da-90d2-4c29-9282-d4edb2852cac'}} >Thread-14::INFO::2014-07-10 09:03:55,508::logUtils::47::dispatcher::(wrapper) Run and protect: getAllTasksStatuses, Return response: {'allTasksStatus': {'141be3da-90d2-4c29-9282-d4edb2852cac': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '141be3da-90d2-4c29-9282-d4edb2852cac'}}} >Thread-14::DEBUG::2014-07-10 09:03:55,509::task::1185::TaskManager.Task::(prepare) Task=`2ffd24d4-015c-4e4c-8247-2bbada664bb6`::finished: {'allTasksStatus': {'141be3da-90d2-4c29-9282-d4edb2852cac': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '141be3da-90d2-4c29-9282-d4edb2852cac'}}} >Thread-14::DEBUG::2014-07-10 09:03:55,509::task::595::TaskManager.Task::(_updateState) Task=`2ffd24d4-015c-4e4c-8247-2bbada664bb6`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 09:03:55,509::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 09:03:55,509::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 09:03:55,510::task::990::TaskManager.Task::(_decref) Task=`2ffd24d4-015c-4e4c-8247-2bbada664bb6`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 09:03:56,145::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:03:56,231::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0332445 s, 30.8 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 09:03:56,604::BindingXMLRPC::1067::vds::(wrapper) client [10.35.3.13]::call vmGetStats with ('a766ed65-ac2e-4862-8ff0-0352480cf6f1',) {} >Thread-14::DEBUG::2014-07-10 09:03:56,605::vm::676::vm.Vm::(_getDiskStats) vmId=`a766ed65-ac2e-4862-8ff0-0352480cf6f1`::Disk hdd stats not available >Thread-14::DEBUG::2014-07-10 09:03:56,605::vm::676::vm.Vm::(_getDiskStats) vmId=`a766ed65-ac2e-4862-8ff0-0352480cf6f1`::Disk hdc stats not available >Thread-14::DEBUG::2014-07-10 09:03:56,606::vm::676::vm.Vm::(_getDiskStats) vmId=`a766ed65-ac2e-4862-8ff0-0352480cf6f1`::Disk vda stats not available >Thread-14::DEBUG::2014-07-10 09:03:56,606::vm::715::vm.Vm::(_getDiskLatency) vmId=`a766ed65-ac2e-4862-8ff0-0352480cf6f1`::Disk hdd latency not available >Thread-14::DEBUG::2014-07-10 09:03:56,606::vm::715::vm.Vm::(_getDiskLatency) vmId=`a766ed65-ac2e-4862-8ff0-0352480cf6f1`::Disk hdc latency not available >Thread-14::DEBUG::2014-07-10 09:03:56,606::vm::715::vm.Vm::(_getDiskLatency) vmId=`a766ed65-ac2e-4862-8ff0-0352480cf6f1`::Disk vda latency not available >Thread-14::DEBUG::2014-07-10 09:03:56,607::BindingXMLRPC::1074::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'username': u'None', 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': u'localhost.localdomain', 'pid': '15456', 'session': 'Unknown', 'displaySecurePort': u'5913', 'timeOffset': '0', 'balloonInfo': {'balloon_max': '1048576', 'balloon_target': '1048576', 'balloon_cur': '1048576', 'balloon_min': '1048576'}, 'pauseCode': 'NOERR', 'disksUsage': [{u'path': u'/', u'total': '4792987648', u'used': '1843060736', u'fs': u'ext4'}, {u'path': u'/boot', u'total': '507744256', u'used': '40272896', u'fs': u'ext4'}, {u'path': u'/home', u'total': '458985472', u'used': '10766336', u'fs': u'ext4'}], 'network': {u'vnet6': {'macAddr': '00:1a:4a:de:6d:88', 'rxDropped': '0', 'rxErrors': '0', 'txDropped': '0', 'txRate': '0.0', 'rxRate': '0.0', 'txErrors': '0', 'state': 'unknown', 'speed': '1000', 'name': u'vnet6'}}, 'vmType': 'kvm', 'guestName': u'localhost.localdomain', 'elapsedTime': '49', 'memoryStats': {}, 'cpuSys': '1.71', 'appsList': [u'kernel-2.6.32-431.el6', u'rhevm-guest-agent-common-1.0.9-1.el6ev'], 'guestOs': u'2.6.32-431.el6.x86_64', 'displayType': 'qxl', 'status': 'Up', 'hash': '1078195817470092527', 'lastLogin': 1404983034.8718791, 'vmId': 'a766ed65-ac2e-4862-8ff0-0352480cf6f1', 'displayIp': '0', 'displayPort': u'5912', 'clientIp': '', 'kvmEnable': 'true', 'disks': {u'vda': {'truesize': '1073741824', 'apparentsize': '1073741824', 'imageID': 'f30c2cb7-a43a-4bf5-82b5-cfe07336f65c'}, u'hdd': {'truesize': '0', 'apparentsize': '0'}, u'hdc': {'truesize': '0', 'apparentsize': '0'}}, 'monitorResponse': '0', 'statsAge': '0.69', 'cpuUser': '39.34', 'guestCPUCount': -1, 'guestIPs': u'10.35.17.159', 'netIfaces': [{u'hw': u'00:1a:4a:de:6d:88', u'name': u'eth0', u'inet': [u'10.35.17.159'], u'inet6': [u'fe80::21a:4aff:fede:6d88']}]}]} >Thread-14::DEBUG::2014-07-10 09:03:56,612::BindingXMLRPC::1067::vds::(wrapper) client [10.35.3.13]::call vmGetStats with ('62e7aad5-ff72-4fe3-830f-e7726ed4bfba',) {} >Thread-14::DEBUG::2014-07-10 09:03:56,612::vm::598::vm.Vm::(_getCpuStats) vmId=`62e7aad5-ff72-4fe3-830f-e7726ed4bfba`::CPU stats not available: 'NoneType' object is unsubscriptable >Thread-14::DEBUG::2014-07-10 09:03:56,613::vm::654::vm.Vm::(_getNetworkStats) vmId=`62e7aad5-ff72-4fe3-830f-e7726ed4bfba`::Network stats not available >Thread-14::DEBUG::2014-07-10 09:03:56,613::vm::676::vm.Vm::(_getDiskStats) vmId=`62e7aad5-ff72-4fe3-830f-e7726ed4bfba`::Disk hdd stats not available >Thread-14::DEBUG::2014-07-10 09:03:56,613::vm::676::vm.Vm::(_getDiskStats) vmId=`62e7aad5-ff72-4fe3-830f-e7726ed4bfba`::Disk hdc stats not available >Thread-14::DEBUG::2014-07-10 09:03:56,613::vm::676::vm.Vm::(_getDiskStats) vmId=`62e7aad5-ff72-4fe3-830f-e7726ed4bfba`::Disk vda stats not available >Thread-14::DEBUG::2014-07-10 09:03:56,613::vm::715::vm.Vm::(_getDiskLatency) vmId=`62e7aad5-ff72-4fe3-830f-e7726ed4bfba`::Disk hdd latency not available >Thread-14::DEBUG::2014-07-10 09:03:56,614::vm::715::vm.Vm::(_getDiskLatency) vmId=`62e7aad5-ff72-4fe3-830f-e7726ed4bfba`::Disk hdc latency not available >Thread-14::DEBUG::2014-07-10 09:03:56,614::vm::715::vm.Vm::(_getDiskLatency) vmId=`62e7aad5-ff72-4fe3-830f-e7726ed4bfba`::Disk vda latency not available >Thread-14::DEBUG::2014-07-10 09:03:56,614::BindingXMLRPC::1074::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Powering up', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '16791', 'displayIp': '0', 'displayPort': u'5916', 'session': 'Unknown', 'displaySecurePort': u'5917', 'timeOffset': '0', 'hash': '773530886922036478', 'balloonInfo': {'balloon_max': '1048576', 'balloon_target': '1048576', 'balloon_cur': '0', 'balloon_min': '1048576'}, 'pauseCode': 'NOERR', 'clientIp': '', 'kvmEnable': 'true', 'network': {u'vnet8': {'state': 'unknown', 'macAddr': '00:1a:4a:de:6d:83', 'speed': '1000', 'name': u'vnet8'}}, 'vmId': '62e7aad5-ff72-4fe3-830f-e7726ed4bfba', 'displayType': 'qxl', 'cpuUser': '0.00', 'disks': {u'vda': {'truesize': '1073741824', 'apparentsize': '1073741824', 'imageID': 'c01d693b-cba0-4fed-9ad7-0aaa28912a19'}, u'hdd': {'truesize': '0', 'apparentsize': '0'}, u'hdc': {'truesize': '0', 'apparentsize': '0'}}, 'monitorResponse': '0', 'statsAge': '0.44', 'elapsedTime': '9', 'vmType': 'kvm', 'cpuSys': '0.00', 'guestCPUCount': -1, 'appsList': [], 'guestIPs': ''}]} >Thread-14::DEBUG::2014-07-10 09:03:56,618::BindingXMLRPC::1067::vds::(wrapper) client [10.35.3.13]::call vmGetStats with ('5d49ebac-3f0d-4688-aed0-b3f5fe364000',) {} >Thread-14::DEBUG::2014-07-10 09:03:56,619::vm::676::vm.Vm::(_getDiskStats) vmId=`5d49ebac-3f0d-4688-aed0-b3f5fe364000`::Disk hdd stats not available >Thread-14::DEBUG::2014-07-10 09:03:56,619::vm::676::vm.Vm::(_getDiskStats) vmId=`5d49ebac-3f0d-4688-aed0-b3f5fe364000`::Disk hdc stats not available >Thread-14::DEBUG::2014-07-10 09:03:56,619::vm::676::vm.Vm::(_getDiskStats) vmId=`5d49ebac-3f0d-4688-aed0-b3f5fe364000`::Disk vda stats not available >Thread-14::DEBUG::2014-07-10 09:03:56,620::vm::715::vm.Vm::(_getDiskLatency) vmId=`5d49ebac-3f0d-4688-aed0-b3f5fe364000`::Disk hdd latency not available >Thread-14::DEBUG::2014-07-10 09:03:56,620::vm::715::vm.Vm::(_getDiskLatency) vmId=`5d49ebac-3f0d-4688-aed0-b3f5fe364000`::Disk hdc latency not available >Thread-14::DEBUG::2014-07-10 09:03:56,620::vm::715::vm.Vm::(_getDiskLatency) vmId=`5d49ebac-3f0d-4688-aed0-b3f5fe364000`::Disk vda latency not available >Thread-14::DEBUG::2014-07-10 09:03:56,620::BindingXMLRPC::1074::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Powering up', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '16122', 'displayIp': '0', 'displayPort': u'5914', 'session': 'Unknown', 'displaySecurePort': u'5915', 'timeOffset': '0', 'hash': '8384665493346130205', 'balloonInfo': {'balloon_max': '1048576', 'balloon_target': '1048576', 'balloon_cur': '1048576', 'balloon_min': '1048576'}, 'pauseCode': 'NOERR', 'clientIp': '', 'kvmEnable': 'true', 'network': {u'vnet7': {'macAddr': '00:1a:4a:de:6d:89', 'rxDropped': '0', 'rxErrors': '0', 'txDropped': '0', 'txRate': '0.0', 'rxRate': '0.0', 'txErrors': '0', 'state': 'unknown', 'speed': '1000', 'name': u'vnet7'}}, 'vmId': '5d49ebac-3f0d-4688-aed0-b3f5fe364000', 'displayType': 'qxl', 'cpuUser': '40.62', 'disks': {u'vda': {'truesize': '1073741824', 'apparentsize': '1073741824', 'imageID': 'cfaeead2-7caa-467c-b389-c89840ae6605'}, u'hdd': {'truesize': '0', 'apparentsize': '0'}, u'hdc': {'truesize': '0', 'apparentsize': '0'}}, 'monitorResponse': '0', 'statsAge': '1.29', 'elapsedTime': '30', 'vmType': 'kvm', 'cpuSys': '25.33', 'guestCPUCount': -1, 'appsList': [], 'guestIPs': ''}]} >141be3da-90d2-4c29-9282-d4edb2852cac::DEBUG::2014-07-10 09:03:57,621::lvm::296::Storage.Misc.excCmd::(cmd) FAILED: <err> = ' Logical volume 9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/47592965-e853-4e59-9728-d11cca6a7a8a in use.\n'; <rc> = 5 >141be3da-90d2-4c29-9282-d4edb2852cac::DEBUG::2014-07-10 09:03:57,625::lvm::513::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >141be3da-90d2-4c29-9282-d4edb2852cac::DEBUG::2014-07-10 09:03:57,625::lvm::525::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >141be3da-90d2-4c29-9282-d4edb2852cac::WARNING::2014-07-10 09:03:57,626::resourceFactories::61::Storage.ResourcesFactories::(close) Failure deactivate LV 9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/47592965-e853-4e59-9728-d11cca6a7a8a (Cannot deactivate Logical Volume: ('General Storage Exception: ("5 [] [\' Logical volume 9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/47592965-e853-4e59-9728-d11cca6a7a8a in use.\']\\n9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/[\'47592965-e853-4e59-9728-d11cca6a7a8a\']",)',)) >141be3da-90d2-4c29-9282-d4edb2852cac::DEBUG::2014-07-10 09:03:57,626::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd_lvmActivationNS.47592965-e853-4e59-9728-d11cca6a7a8a', Clearing records. >141be3da-90d2-4c29-9282-d4edb2852cac::DEBUG::2014-07-10 09:03:57,626::lvm::427::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' got the operation mutex >141be3da-90d2-4c29-9282-d4edb2852cac::DEBUG::2014-07-10 09:03:57,627::lvm::296::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm lvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/3600601601282300032826addbbdae311|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,vg_name,attr,size,seg_start_pe,devices,tags 9e1aa540-1f4e-4ee3-a152-be381ef6c3bd' (cwd None) >Thread-18::DEBUG::2014-07-10 09:03:57,735::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/metadata bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-10 09:03:57,753::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000599762 s, 6.8 MB/s\n'; <rc> = 0 >141be3da-90d2-4c29-9282-d4edb2852cac::DEBUG::2014-07-10 09:03:57,835::lvm::296::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >141be3da-90d2-4c29-9282-d4edb2852cac::DEBUG::2014-07-10 09:03:57,853::lvm::462::Storage.LVM::(_reloadlvs) lvs reloaded >141be3da-90d2-4c29-9282-d4edb2852cac::DEBUG::2014-07-10 09:03:57,855::lvm::462::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' released the operation mutex >141be3da-90d2-4c29-9282-d4edb2852cac::DEBUG::2014-07-10 09:03:57,856::lvm::427::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' got the operation mutex >141be3da-90d2-4c29-9282-d4edb2852cac::DEBUG::2014-07-10 09:03:57,857::lvm::296::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm lvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/3600601601282300032826addbbdae311|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,vg_name,attr,size,seg_start_pe,devices,tags 9e1aa540-1f4e-4ee3-a152-be381ef6c3bd' (cwd None) >GuestMonitor-scale_9::DEBUG::2014-07-10 09:03:57,990::vm::598::vm.Vm::(_getCpuStats) vmId=`62e7aad5-ff72-4fe3-830f-e7726ed4bfba`::CPU stats not available: 'NoneType' object is unsubscriptable >GuestMonitor-scale_9::DEBUG::2014-07-10 09:03:57,991::vm::654::vm.Vm::(_getNetworkStats) vmId=`62e7aad5-ff72-4fe3-830f-e7726ed4bfba`::Network stats not available >GuestMonitor-scale_9::DEBUG::2014-07-10 09:03:57,991::vm::676::vm.Vm::(_getDiskStats) vmId=`62e7aad5-ff72-4fe3-830f-e7726ed4bfba`::Disk hdd stats not available >GuestMonitor-scale_9::DEBUG::2014-07-10 09:03:57,991::vm::676::vm.Vm::(_getDiskStats) vmId=`62e7aad5-ff72-4fe3-830f-e7726ed4bfba`::Disk hdc stats not available >GuestMonitor-scale_9::DEBUG::2014-07-10 09:03:57,992::vm::676::vm.Vm::(_getDiskStats) vmId=`62e7aad5-ff72-4fe3-830f-e7726ed4bfba`::Disk vda stats not available >GuestMonitor-scale_9::DEBUG::2014-07-10 09:03:57,992::vm::715::vm.Vm::(_getDiskLatency) vmId=`62e7aad5-ff72-4fe3-830f-e7726ed4bfba`::Disk hdd latency not available >GuestMonitor-scale_9::DEBUG::2014-07-10 09:03:57,992::vm::715::vm.Vm::(_getDiskLatency) vmId=`62e7aad5-ff72-4fe3-830f-e7726ed4bfba`::Disk hdc latency not available >GuestMonitor-scale_9::DEBUG::2014-07-10 09:03:57,992::vm::715::vm.Vm::(_getDiskLatency) vmId=`62e7aad5-ff72-4fe3-830f-e7726ed4bfba`::Disk vda latency not available >GuestMonitor-scale_9::DEBUG::2014-07-10 09:03:57,993::vm::598::vm.Vm::(_getCpuStats) vmId=`62e7aad5-ff72-4fe3-830f-e7726ed4bfba`::CPU stats not available: 'NoneType' object is unsubscriptable >GuestMonitor-scale_9::DEBUG::2014-07-10 09:03:57,993::vm::654::vm.Vm::(_getNetworkStats) vmId=`62e7aad5-ff72-4fe3-830f-e7726ed4bfba`::Network stats not available >GuestMonitor-scale_9::DEBUG::2014-07-10 09:03:57,993::vm::676::vm.Vm::(_getDiskStats) vmId=`62e7aad5-ff72-4fe3-830f-e7726ed4bfba`::Disk hdd stats not available >GuestMonitor-scale_9::DEBUG::2014-07-10 09:03:57,993::vm::676::vm.Vm::(_getDiskStats) vmId=`62e7aad5-ff72-4fe3-830f-e7726ed4bfba`::Disk hdc stats not available >GuestMonitor-scale_9::DEBUG::2014-07-10 09:03:57,994::vm::676::vm.Vm::(_getDiskStats) vmId=`62e7aad5-ff72-4fe3-830f-e7726ed4bfba`::Disk vda stats not available >GuestMonitor-scale_9::DEBUG::2014-07-10 09:03:57,994::vm::715::vm.Vm::(_getDiskLatency) vmId=`62e7aad5-ff72-4fe3-830f-e7726ed4bfba`::Disk hdd latency not available >GuestMonitor-scale_9::DEBUG::2014-07-10 09:03:57,994::vm::715::vm.Vm::(_getDiskLatency) vmId=`62e7aad5-ff72-4fe3-830f-e7726ed4bfba`::Disk hdc latency not available >GuestMonitor-scale_9::DEBUG::2014-07-10 09:03:57,994::vm::715::vm.Vm::(_getDiskLatency) vmId=`62e7aad5-ff72-4fe3-830f-e7726ed4bfba`::Disk vda latency not available >141be3da-90d2-4c29-9282-d4edb2852cac::DEBUG::2014-07-10 09:03:58,058::lvm::296::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >141be3da-90d2-4c29-9282-d4edb2852cac::DEBUG::2014-07-10 09:03:58,078::lvm::462::Storage.LVM::(_reloadlvs) lvs reloaded >141be3da-90d2-4c29-9282-d4edb2852cac::DEBUG::2014-07-10 09:03:58,078::lvm::462::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' released the operation mutex >141be3da-90d2-4c29-9282-d4edb2852cac::WARNING::2014-07-10 09:03:58,079::blockSD::761::Storage.StorageDomain::(_getOccupiedMetadataSlots) Could not find mapping for lv 9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/cad94284-3ca9-4c30-933d-997f4460309e >141be3da-90d2-4c29-9282-d4edb2852cac::DEBUG::2014-07-10 09:03:58,079::blockSD::784::Storage.StorageDomain::(getFreeMetadataSlot) Found freeSlot 14 in VG 9e1aa540-1f4e-4ee3-a152-be381ef6c3bd >141be3da-90d2-4c29-9282-d4edb2852cac::DEBUG::2014-07-10 09:03:58,080::lvm::296::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm lvchange --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/3600601601282300032826addbbdae311|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } " --autobackup n --deltag OVIRT_VOL_INITIALIZING --addtag MD_14 --addtag PU_47592965-e853-4e59-9728-d11cca6a7a8a --addtag IU_e4c65229-4247-4b33-b72a-f1d5ce72ad05 9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/cad94284-3ca9-4c30-933d-997f4460309e' (cwd None) >GuestMonitor-scale_8::DEBUG::2014-07-10 09:03:58,098::vm::676::vm.Vm::(_getDiskStats) vmId=`5d49ebac-3f0d-4688-aed0-b3f5fe364000`::Disk hdd stats not available >GuestMonitor-scale_8::DEBUG::2014-07-10 09:03:58,100::vm::676::vm.Vm::(_getDiskStats) vmId=`5d49ebac-3f0d-4688-aed0-b3f5fe364000`::Disk hdc stats not available >GuestMonitor-scale_8::DEBUG::2014-07-10 09:03:58,100::vm::676::vm.Vm::(_getDiskStats) vmId=`5d49ebac-3f0d-4688-aed0-b3f5fe364000`::Disk vda stats not available >GuestMonitor-scale_8::DEBUG::2014-07-10 09:03:58,100::vm::715::vm.Vm::(_getDiskLatency) vmId=`5d49ebac-3f0d-4688-aed0-b3f5fe364000`::Disk hdd latency not available >GuestMonitor-scale_8::DEBUG::2014-07-10 09:03:58,100::vm::715::vm.Vm::(_getDiskLatency) vmId=`5d49ebac-3f0d-4688-aed0-b3f5fe364000`::Disk hdc latency not available >GuestMonitor-scale_8::DEBUG::2014-07-10 09:03:58,101::vm::715::vm.Vm::(_getDiskLatency) vmId=`5d49ebac-3f0d-4688-aed0-b3f5fe364000`::Disk vda latency not available >GuestMonitor-scale_8::DEBUG::2014-07-10 09:03:58,101::vm::676::vm.Vm::(_getDiskStats) vmId=`5d49ebac-3f0d-4688-aed0-b3f5fe364000`::Disk hdd stats not available >GuestMonitor-scale_8::DEBUG::2014-07-10 09:03:58,102::vm::676::vm.Vm::(_getDiskStats) vmId=`5d49ebac-3f0d-4688-aed0-b3f5fe364000`::Disk hdc stats not available >GuestMonitor-scale_8::DEBUG::2014-07-10 09:03:58,102::vm::676::vm.Vm::(_getDiskStats) vmId=`5d49ebac-3f0d-4688-aed0-b3f5fe364000`::Disk vda stats not available >GuestMonitor-scale_8::DEBUG::2014-07-10 09:03:58,102::vm::715::vm.Vm::(_getDiskLatency) vmId=`5d49ebac-3f0d-4688-aed0-b3f5fe364000`::Disk hdd latency not available >GuestMonitor-scale_8::DEBUG::2014-07-10 09:03:58,102::vm::715::vm.Vm::(_getDiskLatency) vmId=`5d49ebac-3f0d-4688-aed0-b3f5fe364000`::Disk hdc latency not available >GuestMonitor-scale_8::DEBUG::2014-07-10 09:03:58,103::vm::715::vm.Vm::(_getDiskLatency) vmId=`5d49ebac-3f0d-4688-aed0-b3f5fe364000`::Disk vda latency not available >GuestMonitor-scale_7::DEBUG::2014-07-10 09:03:58,225::vm::676::vm.Vm::(_getDiskStats) vmId=`a766ed65-ac2e-4862-8ff0-0352480cf6f1`::Disk hdd stats not available >GuestMonitor-scale_7::DEBUG::2014-07-10 09:03:58,226::vm::676::vm.Vm::(_getDiskStats) vmId=`a766ed65-ac2e-4862-8ff0-0352480cf6f1`::Disk hdc stats not available >GuestMonitor-scale_7::DEBUG::2014-07-10 09:03:58,226::vm::676::vm.Vm::(_getDiskStats) vmId=`a766ed65-ac2e-4862-8ff0-0352480cf6f1`::Disk vda stats not available >GuestMonitor-scale_7::DEBUG::2014-07-10 09:03:58,226::vm::715::vm.Vm::(_getDiskLatency) vmId=`a766ed65-ac2e-4862-8ff0-0352480cf6f1`::Disk hdd latency not available >GuestMonitor-scale_7::DEBUG::2014-07-10 09:03:58,227::vm::715::vm.Vm::(_getDiskLatency) vmId=`a766ed65-ac2e-4862-8ff0-0352480cf6f1`::Disk hdc latency not available >GuestMonitor-scale_7::DEBUG::2014-07-10 09:03:58,227::vm::715::vm.Vm::(_getDiskLatency) vmId=`a766ed65-ac2e-4862-8ff0-0352480cf6f1`::Disk vda latency not available >GuestMonitor-scale_7::DEBUG::2014-07-10 09:03:58,227::vm::676::vm.Vm::(_getDiskStats) vmId=`a766ed65-ac2e-4862-8ff0-0352480cf6f1`::Disk hdd stats not available >GuestMonitor-scale_7::DEBUG::2014-07-10 09:03:58,227::vm::676::vm.Vm::(_getDiskStats) vmId=`a766ed65-ac2e-4862-8ff0-0352480cf6f1`::Disk hdc stats not available >GuestMonitor-scale_7::DEBUG::2014-07-10 09:03:58,228::vm::676::vm.Vm::(_getDiskStats) vmId=`a766ed65-ac2e-4862-8ff0-0352480cf6f1`::Disk vda stats not available >GuestMonitor-scale_7::DEBUG::2014-07-10 09:03:58,228::vm::715::vm.Vm::(_getDiskLatency) vmId=`a766ed65-ac2e-4862-8ff0-0352480cf6f1`::Disk hdd latency not available >GuestMonitor-scale_7::DEBUG::2014-07-10 09:03:58,228::vm::715::vm.Vm::(_getDiskLatency) vmId=`a766ed65-ac2e-4862-8ff0-0352480cf6f1`::Disk hdc latency not available >GuestMonitor-scale_7::DEBUG::2014-07-10 09:03:58,228::vm::715::vm.Vm::(_getDiskLatency) vmId=`a766ed65-ac2e-4862-8ff0-0352480cf6f1`::Disk vda latency not available >Dummy-33::DEBUG::2014-07-10 09:03:58,246::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >141be3da-90d2-4c29-9282-d4edb2852cac::DEBUG::2014-07-10 09:03:58,336::lvm::296::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ' WARNING: This metadata update is NOT backed up\n WARNING: This metadata update is NOT backed up\n'; <rc> = 0 >141be3da-90d2-4c29-9282-d4edb2852cac::DEBUG::2014-07-10 09:03:58,338::lvm::513::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >141be3da-90d2-4c29-9282-d4edb2852cac::DEBUG::2014-07-10 09:03:58,340::lvm::525::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >141be3da-90d2-4c29-9282-d4edb2852cac::DEBUG::2014-07-10 09:03:58,345::lvm::296::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm lvchange --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/3600601601282300032826addbbdae311|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } " --autobackup n --available n 9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/cad94284-3ca9-4c30-933d-997f4460309e' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:03:58,442::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.111167 s, 9.2 MB/s\n'; <rc> = 0 >141be3da-90d2-4c29-9282-d4edb2852cac::DEBUG::2014-07-10 09:03:58,750::lvm::296::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >141be3da-90d2-4c29-9282-d4edb2852cac::DEBUG::2014-07-10 09:03:58,751::lvm::513::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >141be3da-90d2-4c29-9282-d4edb2852cac::DEBUG::2014-07-10 09:03:58,751::lvm::525::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >141be3da-90d2-4c29-9282-d4edb2852cac::DEBUG::2014-07-10 09:03:58,753::task::752::TaskManager.Task::(_save) Task=`141be3da-90d2-4c29-9282-d4edb2852cac`::_save: orig /rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/master/tasks/141be3da-90d2-4c29-9282-d4edb2852cac temp /rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/master/tasks/141be3da-90d2-4c29-9282-d4edb2852cac.temp >141be3da-90d2-4c29-9282-d4edb2852cac::DEBUG::2014-07-10 09:03:58,766::blockVolume::604::Storage.Volume::(newVolumeLease) Initializing volume lease volUUID=cad94284-3ca9-4c30-933d-997f4460309e sdUUID=9e1aa540-1f4e-4ee3-a152-be381ef6c3bd, metaId=('9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 14) >141be3da-90d2-4c29-9282-d4edb2852cac::DEBUG::2014-07-10 09:03:58,774::task::752::TaskManager.Task::(_save) Task=`141be3da-90d2-4c29-9282-d4edb2852cac`::_save: orig /rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/master/tasks/141be3da-90d2-4c29-9282-d4edb2852cac temp /rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/master/tasks/141be3da-90d2-4c29-9282-d4edb2852cac.temp >141be3da-90d2-4c29-9282-d4edb2852cac::DEBUG::2014-07-10 09:03:58,783::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd_imageNS.e4c65229-4247-4b33-b72a-f1d5ce72ad05' >141be3da-90d2-4c29-9282-d4edb2852cac::DEBUG::2014-07-10 09:03:58,784::resourceManager::635::ResourceManager::(releaseResource) Released resource '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd_imageNS.e4c65229-4247-4b33-b72a-f1d5ce72ad05' (0 active users) >141be3da-90d2-4c29-9282-d4edb2852cac::DEBUG::2014-07-10 09:03:58,784::resourceManager::641::ResourceManager::(releaseResource) Resource '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd_imageNS.e4c65229-4247-4b33-b72a-f1d5ce72ad05' is free, finding out if anyone is waiting for it. >141be3da-90d2-4c29-9282-d4edb2852cac::DEBUG::2014-07-10 09:03:58,784::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd_imageNS.e4c65229-4247-4b33-b72a-f1d5ce72ad05', Clearing records. >141be3da-90d2-4c29-9282-d4edb2852cac::DEBUG::2014-07-10 09:03:58,785::task::595::TaskManager.Task::(_updateState) Task=`141be3da-90d2-4c29-9282-d4edb2852cac`::moving from state running -> state finished >141be3da-90d2-4c29-9282-d4edb2852cac::DEBUG::2014-07-10 09:03:58,785::task::752::TaskManager.Task::(_save) Task=`141be3da-90d2-4c29-9282-d4edb2852cac`::_save: orig /rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/master/tasks/141be3da-90d2-4c29-9282-d4edb2852cac temp /rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/master/tasks/141be3da-90d2-4c29-9282-d4edb2852cac.temp >141be3da-90d2-4c29-9282-d4edb2852cac::DEBUG::2014-07-10 09:03:58,795::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': < ResourceRef 'Storage.9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', isValid: 'True' obj: 'None'>} >141be3da-90d2-4c29-9282-d4edb2852cac::DEBUG::2014-07-10 09:03:58,796::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >141be3da-90d2-4c29-9282-d4edb2852cac::DEBUG::2014-07-10 09:03:58,796::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.9e1aa540-1f4e-4ee3-a152-be381ef6c3bd' >141be3da-90d2-4c29-9282-d4edb2852cac::DEBUG::2014-07-10 09:03:58,796::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.9e1aa540-1f4e-4ee3-a152-be381ef6c3bd' (0 active users) >141be3da-90d2-4c29-9282-d4edb2852cac::DEBUG::2014-07-10 09:03:58,796::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.9e1aa540-1f4e-4ee3-a152-be381ef6c3bd' is free, finding out if anyone is waiting for it. >141be3da-90d2-4c29-9282-d4edb2852cac::DEBUG::2014-07-10 09:03:58,798::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', Clearing records. >141be3da-90d2-4c29-9282-d4edb2852cac::DEBUG::2014-07-10 09:03:58,804::task::913::TaskManager.Task::(_runJobs) Task=`141be3da-90d2-4c29-9282-d4edb2852cac`::Task.run: exit - success: result {'uuid': 'cad94284-3ca9-4c30-933d-997f4460309e'} >141be3da-90d2-4c29-9282-d4edb2852cac::DEBUG::2014-07-10 09:03:58,808::task::990::TaskManager.Task::(_decref) Task=`141be3da-90d2-4c29-9282-d4edb2852cac`::ref 0 aborting False >141be3da-90d2-4c29-9282-d4edb2852cac::DEBUG::2014-07-10 09:03:58,811::threadPool::57::Misc.ThreadPool::(setRunningTask) Number of running tasks: 0 >VM Channels Listener::DEBUG::2014-07-10 09:03:59,577::vmChannels::95::vds::(_handle_timeouts) Timeout on fileno 70. >Thread-14::DEBUG::2014-07-10 09:03:59,664::BindingXMLRPC::1067::vds::(wrapper) client [10.35.3.13]::call vmGetStats with ('62e7aad5-ff72-4fe3-830f-e7726ed4bfba',) {} >Thread-14::DEBUG::2014-07-10 09:03:59,665::vm::598::vm.Vm::(_getCpuStats) vmId=`62e7aad5-ff72-4fe3-830f-e7726ed4bfba`::CPU stats not available: 'NoneType' object is unsubscriptable >Thread-14::DEBUG::2014-07-10 09:03:59,665::vm::654::vm.Vm::(_getNetworkStats) vmId=`62e7aad5-ff72-4fe3-830f-e7726ed4bfba`::Network stats not available >Thread-14::DEBUG::2014-07-10 09:03:59,665::vm::676::vm.Vm::(_getDiskStats) vmId=`62e7aad5-ff72-4fe3-830f-e7726ed4bfba`::Disk hdd stats not available >Thread-14::DEBUG::2014-07-10 09:03:59,666::vm::676::vm.Vm::(_getDiskStats) vmId=`62e7aad5-ff72-4fe3-830f-e7726ed4bfba`::Disk hdc stats not available >Thread-14::DEBUG::2014-07-10 09:03:59,666::vm::676::vm.Vm::(_getDiskStats) vmId=`62e7aad5-ff72-4fe3-830f-e7726ed4bfba`::Disk vda stats not available >Thread-14::DEBUG::2014-07-10 09:03:59,666::vm::715::vm.Vm::(_getDiskLatency) vmId=`62e7aad5-ff72-4fe3-830f-e7726ed4bfba`::Disk hdd latency not available >Thread-14::DEBUG::2014-07-10 09:03:59,666::vm::715::vm.Vm::(_getDiskLatency) vmId=`62e7aad5-ff72-4fe3-830f-e7726ed4bfba`::Disk hdc latency not available >Thread-14::DEBUG::2014-07-10 09:03:59,666::vm::715::vm.Vm::(_getDiskLatency) vmId=`62e7aad5-ff72-4fe3-830f-e7726ed4bfba`::Disk vda latency not available >Thread-14::DEBUG::2014-07-10 09:03:59,667::BindingXMLRPC::1074::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Powering up', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '16791', 'displayIp': '0', 'displayPort': u'5916', 'session': 'Unknown', 'displaySecurePort': u'5917', 'timeOffset': '0', 'hash': '773530886922036478', 'balloonInfo': {'balloon_max': '1048576', 'balloon_target': '1048576', 'balloon_cur': '0', 'balloon_min': '1048576'}, 'pauseCode': 'NOERR', 'clientIp': '', 'kvmEnable': 'true', 'network': {u'vnet8': {'state': 'unknown', 'macAddr': '00:1a:4a:de:6d:83', 'speed': '1000', 'name': u'vnet8'}}, 'vmId': '62e7aad5-ff72-4fe3-830f-e7726ed4bfba', 'displayType': 'qxl', 'cpuUser': '0.00', 'disks': {u'vda': {'truesize': '1073741824', 'apparentsize': '1073741824', 'imageID': 'c01d693b-cba0-4fed-9ad7-0aaa28912a19'}, u'hdd': {'truesize': '0', 'apparentsize': '0'}, u'hdc': {'truesize': '0', 'apparentsize': '0'}}, 'monitorResponse': '0', 'statsAge': '1.49', 'elapsedTime': '12', 'vmType': 'kvm', 'cpuSys': '0.00', 'guestCPUCount': -1, 'appsList': [], 'guestIPs': ''}]} >Thread-14::DEBUG::2014-07-10 09:03:59,671::BindingXMLRPC::1067::vds::(wrapper) client [10.35.3.13]::call vmGetStats with ('5d49ebac-3f0d-4688-aed0-b3f5fe364000',) {} >Thread-14::DEBUG::2014-07-10 09:03:59,672::vm::676::vm.Vm::(_getDiskStats) vmId=`5d49ebac-3f0d-4688-aed0-b3f5fe364000`::Disk hdd stats not available >Thread-14::DEBUG::2014-07-10 09:03:59,672::vm::676::vm.Vm::(_getDiskStats) vmId=`5d49ebac-3f0d-4688-aed0-b3f5fe364000`::Disk hdc stats not available >Thread-14::DEBUG::2014-07-10 09:03:59,672::vm::676::vm.Vm::(_getDiskStats) vmId=`5d49ebac-3f0d-4688-aed0-b3f5fe364000`::Disk vda stats not available >Thread-14::DEBUG::2014-07-10 09:03:59,673::vm::715::vm.Vm::(_getDiskLatency) vmId=`5d49ebac-3f0d-4688-aed0-b3f5fe364000`::Disk hdd latency not available >Thread-14::DEBUG::2014-07-10 09:03:59,673::vm::715::vm.Vm::(_getDiskLatency) vmId=`5d49ebac-3f0d-4688-aed0-b3f5fe364000`::Disk hdc latency not available >Thread-14::DEBUG::2014-07-10 09:03:59,673::vm::715::vm.Vm::(_getDiskLatency) vmId=`5d49ebac-3f0d-4688-aed0-b3f5fe364000`::Disk vda latency not available >Thread-14::DEBUG::2014-07-10 09:03:59,673::BindingXMLRPC::1074::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Powering up', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '16122', 'displayIp': '0', 'displayPort': u'5914', 'session': 'Unknown', 'displaySecurePort': u'5915', 'timeOffset': '0', 'hash': '8384665493346130205', 'balloonInfo': {'balloon_max': '1048576', 'balloon_target': '1048576', 'balloon_cur': '1048576', 'balloon_min': '1048576'}, 'pauseCode': 'NOERR', 'clientIp': '', 'kvmEnable': 'true', 'network': {u'vnet7': {'macAddr': '00:1a:4a:de:6d:89', 'rxDropped': '0', 'rxErrors': '0', 'txDropped': '0', 'txRate': '0.0', 'rxRate': '0.0', 'txErrors': '0', 'state': 'unknown', 'speed': '1000', 'name': u'vnet7'}}, 'vmId': '5d49ebac-3f0d-4688-aed0-b3f5fe364000', 'displayType': 'qxl', 'cpuUser': '39.02', 'disks': {u'vda': {'truesize': '1073741824', 'apparentsize': '1073741824', 'imageID': 'cfaeead2-7caa-467c-b389-c89840ae6605'}, u'hdd': {'truesize': '0', 'apparentsize': '0'}, u'hdc': {'truesize': '0', 'apparentsize': '0'}}, 'monitorResponse': '0', 'statsAge': '0.33', 'elapsedTime': '33', 'vmType': 'kvm', 'cpuSys': '4.14', 'guestCPUCount': -1, 'appsList': [], 'guestIPs': ''}]} >Dummy-33::DEBUG::2014-07-10 09:04:00,468::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:04:00,575::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0518119 s, 19.8 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:04:02,590::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Thread-14::DEBUG::2014-07-10 09:04:02,709::task::595::TaskManager.Task::(_updateState) Task=`d1af1568-2ab5-4c04-bdc1-7b3ea0e87d99`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 09:04:02,712::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::INFO::2014-07-10 09:04:02,714::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000599762', 'lastCheck': '4.9', 'valid': True}, '6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000447372', 'lastCheck': '7.9', 'valid': True}} >Thread-14::DEBUG::2014-07-10 09:04:02,715::task::1185::TaskManager.Task::(prepare) Task=`d1af1568-2ab5-4c04-bdc1-7b3ea0e87d99`::finished: {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000599762', 'lastCheck': '4.9', 'valid': True}, '6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000447372', 'lastCheck': '7.9', 'valid': True}} >Thread-14::DEBUG::2014-07-10 09:04:02,717::task::595::TaskManager.Task::(_updateState) Task=`d1af1568-2ab5-4c04-bdc1-7b3ea0e87d99`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 09:04:02,718::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 09:04:02,719::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 09:04:02,721::task::990::TaskManager.Task::(_decref) Task=`d1af1568-2ab5-4c04-bdc1-7b3ea0e87d99`::ref 0 aborting False >Thread-14::DEBUG::2014-07-10 09:04:02,770::vm::676::vm.Vm::(_getDiskStats) vmId=`5d49ebac-3f0d-4688-aed0-b3f5fe364000`::Disk hdd stats not available >Thread-14::DEBUG::2014-07-10 09:04:02,771::vm::676::vm.Vm::(_getDiskStats) vmId=`5d49ebac-3f0d-4688-aed0-b3f5fe364000`::Disk hdc stats not available >Thread-14::DEBUG::2014-07-10 09:04:02,772::vm::676::vm.Vm::(_getDiskStats) vmId=`5d49ebac-3f0d-4688-aed0-b3f5fe364000`::Disk vda stats not available >Thread-14::DEBUG::2014-07-10 09:04:02,773::vm::715::vm.Vm::(_getDiskLatency) vmId=`5d49ebac-3f0d-4688-aed0-b3f5fe364000`::Disk hdd latency not available >Thread-14::DEBUG::2014-07-10 09:04:02,774::vm::715::vm.Vm::(_getDiskLatency) vmId=`5d49ebac-3f0d-4688-aed0-b3f5fe364000`::Disk hdc latency not available >Thread-14::DEBUG::2014-07-10 09:04:02,775::vm::715::vm.Vm::(_getDiskLatency) vmId=`5d49ebac-3f0d-4688-aed0-b3f5fe364000`::Disk vda latency not available >Thread-14::DEBUG::2014-07-10 09:04:02,778::vm::598::vm.Vm::(_getCpuStats) vmId=`62e7aad5-ff72-4fe3-830f-e7726ed4bfba`::CPU stats not available: 'NoneType' object is unsubscriptable >Thread-14::DEBUG::2014-07-10 09:04:02,779::vm::654::vm.Vm::(_getNetworkStats) vmId=`62e7aad5-ff72-4fe3-830f-e7726ed4bfba`::Network stats not available >Dummy-33::DEBUG::2014-07-10 09:04:02,779::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0490641 s, 20.9 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 09:04:02,780::vm::676::vm.Vm::(_getDiskStats) vmId=`62e7aad5-ff72-4fe3-830f-e7726ed4bfba`::Disk hdd stats not available >Thread-14::DEBUG::2014-07-10 09:04:02,781::vm::676::vm.Vm::(_getDiskStats) vmId=`62e7aad5-ff72-4fe3-830f-e7726ed4bfba`::Disk hdc stats not available >Thread-14::DEBUG::2014-07-10 09:04:02,783::vm::676::vm.Vm::(_getDiskStats) vmId=`62e7aad5-ff72-4fe3-830f-e7726ed4bfba`::Disk vda stats not available >Thread-14::DEBUG::2014-07-10 09:04:02,784::vm::715::vm.Vm::(_getDiskLatency) vmId=`62e7aad5-ff72-4fe3-830f-e7726ed4bfba`::Disk hdd latency not available >Thread-14::DEBUG::2014-07-10 09:04:02,785::vm::715::vm.Vm::(_getDiskLatency) vmId=`62e7aad5-ff72-4fe3-830f-e7726ed4bfba`::Disk hdc latency not available >Thread-14::DEBUG::2014-07-10 09:04:02,786::vm::715::vm.Vm::(_getDiskLatency) vmId=`62e7aad5-ff72-4fe3-830f-e7726ed4bfba`::Disk vda latency not available >Thread-14::DEBUG::2014-07-10 09:04:02,790::vm::676::vm.Vm::(_getDiskStats) vmId=`a766ed65-ac2e-4862-8ff0-0352480cf6f1`::Disk hdd stats not available >Thread-14::DEBUG::2014-07-10 09:04:02,791::vm::676::vm.Vm::(_getDiskStats) vmId=`a766ed65-ac2e-4862-8ff0-0352480cf6f1`::Disk hdc stats not available >Thread-14::DEBUG::2014-07-10 09:04:02,792::vm::676::vm.Vm::(_getDiskStats) vmId=`a766ed65-ac2e-4862-8ff0-0352480cf6f1`::Disk vda stats not available >Thread-14::DEBUG::2014-07-10 09:04:02,793::vm::715::vm.Vm::(_getDiskLatency) vmId=`a766ed65-ac2e-4862-8ff0-0352480cf6f1`::Disk hdd latency not available >Thread-14::DEBUG::2014-07-10 09:04:02,794::vm::715::vm.Vm::(_getDiskLatency) vmId=`a766ed65-ac2e-4862-8ff0-0352480cf6f1`::Disk hdc latency not available >Thread-14::DEBUG::2014-07-10 09:04:02,795::vm::715::vm.Vm::(_getDiskLatency) vmId=`a766ed65-ac2e-4862-8ff0-0352480cf6f1`::Disk vda latency not available >GuestMonitor-scale_9::DEBUG::2014-07-10 09:04:03,000::vm::598::vm.Vm::(_getCpuStats) vmId=`62e7aad5-ff72-4fe3-830f-e7726ed4bfba`::CPU stats not available: 'NoneType' object is unsubscriptable >GuestMonitor-scale_9::DEBUG::2014-07-10 09:04:03,001::vm::654::vm.Vm::(_getNetworkStats) vmId=`62e7aad5-ff72-4fe3-830f-e7726ed4bfba`::Network stats not available >GuestMonitor-scale_9::DEBUG::2014-07-10 09:04:03,001::vm::676::vm.Vm::(_getDiskStats) vmId=`62e7aad5-ff72-4fe3-830f-e7726ed4bfba`::Disk hdd stats not available >GuestMonitor-scale_9::DEBUG::2014-07-10 09:04:03,001::vm::676::vm.Vm::(_getDiskStats) vmId=`62e7aad5-ff72-4fe3-830f-e7726ed4bfba`::Disk hdc stats not available >GuestMonitor-scale_9::DEBUG::2014-07-10 09:04:03,001::vm::676::vm.Vm::(_getDiskStats) vmId=`62e7aad5-ff72-4fe3-830f-e7726ed4bfba`::Disk vda stats not available >GuestMonitor-scale_9::DEBUG::2014-07-10 09:04:03,002::vm::715::vm.Vm::(_getDiskLatency) vmId=`62e7aad5-ff72-4fe3-830f-e7726ed4bfba`::Disk hdd latency not available >GuestMonitor-scale_9::DEBUG::2014-07-10 09:04:03,002::vm::715::vm.Vm::(_getDiskLatency) vmId=`62e7aad5-ff72-4fe3-830f-e7726ed4bfba`::Disk hdc latency not available >GuestMonitor-scale_9::DEBUG::2014-07-10 09:04:03,002::vm::715::vm.Vm::(_getDiskLatency) vmId=`62e7aad5-ff72-4fe3-830f-e7726ed4bfba`::Disk vda latency not available >GuestMonitor-scale_9::DEBUG::2014-07-10 09:04:03,003::vm::598::vm.Vm::(_getCpuStats) vmId=`62e7aad5-ff72-4fe3-830f-e7726ed4bfba`::CPU stats not available: 'NoneType' object is unsubscriptable >GuestMonitor-scale_9::DEBUG::2014-07-10 09:04:03,003::vm::654::vm.Vm::(_getNetworkStats) vmId=`62e7aad5-ff72-4fe3-830f-e7726ed4bfba`::Network stats not available >GuestMonitor-scale_9::DEBUG::2014-07-10 09:04:03,003::vm::676::vm.Vm::(_getDiskStats) vmId=`62e7aad5-ff72-4fe3-830f-e7726ed4bfba`::Disk hdd stats not available >GuestMonitor-scale_9::DEBUG::2014-07-10 09:04:03,003::vm::676::vm.Vm::(_getDiskStats) vmId=`62e7aad5-ff72-4fe3-830f-e7726ed4bfba`::Disk hdc stats not available >GuestMonitor-scale_9::DEBUG::2014-07-10 09:04:03,003::vm::676::vm.Vm::(_getDiskStats) vmId=`62e7aad5-ff72-4fe3-830f-e7726ed4bfba`::Disk vda stats not available >GuestMonitor-scale_9::DEBUG::2014-07-10 09:04:03,004::vm::715::vm.Vm::(_getDiskLatency) vmId=`62e7aad5-ff72-4fe3-830f-e7726ed4bfba`::Disk hdd latency not available >GuestMonitor-scale_9::DEBUG::2014-07-10 09:04:03,004::vm::715::vm.Vm::(_getDiskLatency) vmId=`62e7aad5-ff72-4fe3-830f-e7726ed4bfba`::Disk hdc latency not available >GuestMonitor-scale_9::DEBUG::2014-07-10 09:04:03,004::vm::715::vm.Vm::(_getDiskLatency) vmId=`62e7aad5-ff72-4fe3-830f-e7726ed4bfba`::Disk vda latency not available >GuestMonitor-scale_8::DEBUG::2014-07-10 09:04:03,109::vm::676::vm.Vm::(_getDiskStats) vmId=`5d49ebac-3f0d-4688-aed0-b3f5fe364000`::Disk hdd stats not available >GuestMonitor-scale_8::DEBUG::2014-07-10 09:04:03,109::vm::676::vm.Vm::(_getDiskStats) vmId=`5d49ebac-3f0d-4688-aed0-b3f5fe364000`::Disk hdc stats not available >GuestMonitor-scale_8::DEBUG::2014-07-10 09:04:03,110::vm::676::vm.Vm::(_getDiskStats) vmId=`5d49ebac-3f0d-4688-aed0-b3f5fe364000`::Disk vda stats not available >GuestMonitor-scale_8::DEBUG::2014-07-10 09:04:03,110::vm::715::vm.Vm::(_getDiskLatency) vmId=`5d49ebac-3f0d-4688-aed0-b3f5fe364000`::Disk hdd latency not available >GuestMonitor-scale_8::DEBUG::2014-07-10 09:04:03,110::vm::715::vm.Vm::(_getDiskLatency) vmId=`5d49ebac-3f0d-4688-aed0-b3f5fe364000`::Disk hdc latency not available >GuestMonitor-scale_8::DEBUG::2014-07-10 09:04:03,110::vm::715::vm.Vm::(_getDiskLatency) vmId=`5d49ebac-3f0d-4688-aed0-b3f5fe364000`::Disk vda latency not available >GuestMonitor-scale_8::DEBUG::2014-07-10 09:04:03,111::vm::676::vm.Vm::(_getDiskStats) vmId=`5d49ebac-3f0d-4688-aed0-b3f5fe364000`::Disk hdd stats not available >GuestMonitor-scale_8::DEBUG::2014-07-10 09:04:03,111::vm::676::vm.Vm::(_getDiskStats) vmId=`5d49ebac-3f0d-4688-aed0-b3f5fe364000`::Disk hdc stats not available >GuestMonitor-scale_8::DEBUG::2014-07-10 09:04:03,111::vm::676::vm.Vm::(_getDiskStats) vmId=`5d49ebac-3f0d-4688-aed0-b3f5fe364000`::Disk vda stats not available >GuestMonitor-scale_8::DEBUG::2014-07-10 09:04:03,111::vm::715::vm.Vm::(_getDiskLatency) vmId=`5d49ebac-3f0d-4688-aed0-b3f5fe364000`::Disk hdd latency not available >GuestMonitor-scale_8::DEBUG::2014-07-10 09:04:03,112::vm::715::vm.Vm::(_getDiskLatency) vmId=`5d49ebac-3f0d-4688-aed0-b3f5fe364000`::Disk hdc latency not available >GuestMonitor-scale_8::DEBUG::2014-07-10 09:04:03,112::vm::715::vm.Vm::(_getDiskLatency) vmId=`5d49ebac-3f0d-4688-aed0-b3f5fe364000`::Disk vda latency not available >GuestMonitor-scale_7::DEBUG::2014-07-10 09:04:03,234::vm::676::vm.Vm::(_getDiskStats) vmId=`a766ed65-ac2e-4862-8ff0-0352480cf6f1`::Disk hdd stats not available >GuestMonitor-scale_7::DEBUG::2014-07-10 09:04:03,234::vm::676::vm.Vm::(_getDiskStats) vmId=`a766ed65-ac2e-4862-8ff0-0352480cf6f1`::Disk hdc stats not available >GuestMonitor-scale_7::DEBUG::2014-07-10 09:04:03,235::vm::676::vm.Vm::(_getDiskStats) vmId=`a766ed65-ac2e-4862-8ff0-0352480cf6f1`::Disk vda stats not available >GuestMonitor-scale_7::DEBUG::2014-07-10 09:04:03,235::vm::715::vm.Vm::(_getDiskLatency) vmId=`a766ed65-ac2e-4862-8ff0-0352480cf6f1`::Disk hdd latency not available >GuestMonitor-scale_7::DEBUG::2014-07-10 09:04:03,235::vm::715::vm.Vm::(_getDiskLatency) vmId=`a766ed65-ac2e-4862-8ff0-0352480cf6f1`::Disk hdc latency not available >GuestMonitor-scale_7::DEBUG::2014-07-10 09:04:03,235::vm::715::vm.Vm::(_getDiskLatency) vmId=`a766ed65-ac2e-4862-8ff0-0352480cf6f1`::Disk vda latency not available >GuestMonitor-scale_7::DEBUG::2014-07-10 09:04:03,236::vm::676::vm.Vm::(_getDiskStats) vmId=`a766ed65-ac2e-4862-8ff0-0352480cf6f1`::Disk hdd stats not available >GuestMonitor-scale_7::DEBUG::2014-07-10 09:04:03,236::vm::676::vm.Vm::(_getDiskStats) vmId=`a766ed65-ac2e-4862-8ff0-0352480cf6f1`::Disk hdc stats not available >GuestMonitor-scale_7::DEBUG::2014-07-10 09:04:03,236::vm::676::vm.Vm::(_getDiskStats) vmId=`a766ed65-ac2e-4862-8ff0-0352480cf6f1`::Disk vda stats not available >GuestMonitor-scale_7::DEBUG::2014-07-10 09:04:03,236::vm::715::vm.Vm::(_getDiskLatency) vmId=`a766ed65-ac2e-4862-8ff0-0352480cf6f1`::Disk hdd latency not available >GuestMonitor-scale_7::DEBUG::2014-07-10 09:04:03,236::vm::715::vm.Vm::(_getDiskLatency) vmId=`a766ed65-ac2e-4862-8ff0-0352480cf6f1`::Disk hdc latency not available >GuestMonitor-scale_7::DEBUG::2014-07-10 09:04:03,236::vm::715::vm.Vm::(_getDiskLatency) vmId=`a766ed65-ac2e-4862-8ff0-0352480cf6f1`::Disk vda latency not available >Thread-14::DEBUG::2014-07-10 09:04:04,019::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-14::DEBUG::2014-07-10 09:04:04,021::task::595::TaskManager.Task::(_updateState) Task=`5e1f49b8-f25e-4e48-8b75-9a5f7596ef1e`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 09:04:04,021::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-14::INFO::2014-07-10 09:04:04,022::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:04:04,022::task::1185::TaskManager.Task::(prepare) Task=`5e1f49b8-f25e-4e48-8b75-9a5f7596ef1e`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:04:04,022::task::595::TaskManager.Task::(_updateState) Task=`5e1f49b8-f25e-4e48-8b75-9a5f7596ef1e`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 09:04:04,022::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 09:04:04,023::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 09:04:04,023::task::990::TaskManager.Task::(_decref) Task=`5e1f49b8-f25e-4e48-8b75-9a5f7596ef1e`::ref 0 aborting False >Thread-34::DEBUG::2014-07-10 09:04:04,067::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-34::DEBUG::2014-07-10 09:04:04,067::task::595::TaskManager.Task::(_updateState) Task=`b74b2106-fc40-4d05-98d1-e34407136267`::moving from state init -> state preparing >Thread-34::INFO::2014-07-10 09:04:04,068::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-34::DEBUG::2014-07-10 09:04:04,068::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`f5de495f-d57c-480e-a0c8-2ef6092c3e56`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-10 09:04:04,069::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' for lock type 'shared' >Thread-34::DEBUG::2014-07-10 09:04:04,069::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-10 09:04:04,069::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`f5de495f-d57c-480e-a0c8-2ef6092c3e56`::Granted request >Thread-34::DEBUG::2014-07-10 09:04:04,070::task::827::TaskManager.Task::(resourceAcquired) Task=`b74b2106-fc40-4d05-98d1-e34407136267`::_resourcesAcquired: Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee (shared) >Thread-34::DEBUG::2014-07-10 09:04:04,070::task::990::TaskManager.Task::(_decref) Task=`b74b2106-fc40-4d05-98d1-e34407136267`::ref 1 aborting False >Thread-34::INFO::2014-07-10 09:04:04,071::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532067385344', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:04:04,071::task::1185::TaskManager.Task::(prepare) Task=`b74b2106-fc40-4d05-98d1-e34407136267`::finished: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532067385344', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:04:04,072::task::595::TaskManager.Task::(_updateState) Task=`b74b2106-fc40-4d05-98d1-e34407136267`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-10 09:04:04,072::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee': < ResourceRef 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-10 09:04:04,072::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-10 09:04:04,072::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' >Thread-34::DEBUG::2014-07-10 09:04:04,073::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' (0 active users) >Thread-34::DEBUG::2014-07-10 09:04:04,074::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-10 09:04:04,074::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', Clearing records. >Thread-34::DEBUG::2014-07-10 09:04:04,074::task::990::TaskManager.Task::(_decref) Task=`b74b2106-fc40-4d05-98d1-e34407136267`::ref 0 aborting False >Thread-40::DEBUG::2014-07-10 09:04:04,819::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lion.qa.lab.tlv.redhat.com:_export_yuri2_backup2/6a70504d-00df-4869-8695-0f442053f6b6/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-40::DEBUG::2014-07-10 09:04:04,839::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n369 bytes (369 B) copied, 0.000544569 s, 678 kB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:04:04,848::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:04:04,962::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0552141 s, 18.5 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 09:04:05,515::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-14::DEBUG::2014-07-10 09:04:05,516::task::595::TaskManager.Task::(_updateState) Task=`f6373f38-3a0b-49cb-a45a-09da654a8eea`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 09:04:05,516::logUtils::44::dispatcher::(wrapper) Run and protect: getAllTasksStatuses(spUUID=None, options=None) >Thread-14::DEBUG::2014-07-10 09:04:05,517::taskManager::102::TaskManager::(getAllTasksStatuses) Entry. >Thread-14::DEBUG::2014-07-10 09:04:05,517::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 141be3da-90d2-4c29-9282-d4edb2852cac >Thread-14::DEBUG::2014-07-10 09:04:05,517::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': '1 jobs completed successfully', 'taskState': 'finished', 'taskResult': 'success', 'taskID': '141be3da-90d2-4c29-9282-d4edb2852cac'} >Thread-14::DEBUG::2014-07-10 09:04:05,517::taskManager::113::TaskManager::(getAllTasksStatuses) Return: {'141be3da-90d2-4c29-9282-d4edb2852cac': {'code': 0, 'message': '1 jobs completed successfully', 'taskState': 'finished', 'taskResult': 'success', 'taskID': '141be3da-90d2-4c29-9282-d4edb2852cac'}} >Thread-14::INFO::2014-07-10 09:04:05,517::logUtils::47::dispatcher::(wrapper) Run and protect: getAllTasksStatuses, Return response: {'allTasksStatus': {'141be3da-90d2-4c29-9282-d4edb2852cac': {'code': 0, 'message': '1 jobs completed successfully', 'taskState': 'finished', 'taskResult': 'success', 'taskID': '141be3da-90d2-4c29-9282-d4edb2852cac'}}} >Thread-14::DEBUG::2014-07-10 09:04:05,518::task::1185::TaskManager.Task::(prepare) Task=`f6373f38-3a0b-49cb-a45a-09da654a8eea`::finished: {'allTasksStatus': {'141be3da-90d2-4c29-9282-d4edb2852cac': {'code': 0, 'message': '1 jobs completed successfully', 'taskState': 'finished', 'taskResult': 'success', 'taskID': '141be3da-90d2-4c29-9282-d4edb2852cac'}}} >Thread-14::DEBUG::2014-07-10 09:04:05,518::task::595::TaskManager.Task::(_updateState) Task=`f6373f38-3a0b-49cb-a45a-09da654a8eea`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 09:04:05,518::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 09:04:05,518::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 09:04:05,518::task::990::TaskManager.Task::(_decref) Task=`f6373f38-3a0b-49cb-a45a-09da654a8eea`::ref 0 aborting False >Thread-34::DEBUG::2014-07-10 09:04:05,570::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [104a146c] >Thread-34::DEBUG::2014-07-10 09:04:05,570::task::595::TaskManager.Task::(_updateState) Task=`636341bd-3d01-4170-8eda-31782dc212c0`::moving from state init -> state preparing >Thread-34::INFO::2014-07-10 09:04:05,571::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeInfo(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='e4c65229-4247-4b33-b72a-f1d5ce72ad05', volUUID='cad94284-3ca9-4c30-933d-997f4460309e', options=None) >Thread-34::DEBUG::2014-07-10 09:04:05,572::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.9e1aa540-1f4e-4ee3-a152-be381ef6c3bd`ReqID=`8a6e21c1-7ce8-4840-b073-f638b4af0150`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '3089' at 'getVolumeInfo' >Thread-34::DEBUG::2014-07-10 09:04:05,572::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.9e1aa540-1f4e-4ee3-a152-be381ef6c3bd' for lock type 'shared' >Thread-34::DEBUG::2014-07-10 09:04:05,572::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.9e1aa540-1f4e-4ee3-a152-be381ef6c3bd' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-10 09:04:05,572::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.9e1aa540-1f4e-4ee3-a152-be381ef6c3bd`ReqID=`8a6e21c1-7ce8-4840-b073-f638b4af0150`::Granted request >Thread-34::DEBUG::2014-07-10 09:04:05,573::task::827::TaskManager.Task::(resourceAcquired) Task=`636341bd-3d01-4170-8eda-31782dc212c0`::_resourcesAcquired: Storage.9e1aa540-1f4e-4ee3-a152-be381ef6c3bd (shared) >Thread-34::DEBUG::2014-07-10 09:04:05,573::task::990::TaskManager.Task::(_decref) Task=`636341bd-3d01-4170-8eda-31782dc212c0`::ref 1 aborting False >Thread-34::DEBUG::2014-07-10 09:04:05,574::lvm::427::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' got the operation mutex >Thread-34::DEBUG::2014-07-10 09:04:05,575::lvm::296::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm lvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/3600601601282300032826addbbdae311|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,vg_name,attr,size,seg_start_pe,devices,tags 9e1aa540-1f4e-4ee3-a152-be381ef6c3bd' (cwd None) >Thread-34::DEBUG::2014-07-10 09:04:05,825::lvm::296::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-34::DEBUG::2014-07-10 09:04:05,851::lvm::462::Storage.LVM::(_reloadlvs) lvs reloaded >Thread-34::DEBUG::2014-07-10 09:04:05,852::lvm::462::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' released the operation mutex >Thread-34::INFO::2014-07-10 09:04:05,852::volume::879::Storage.Volume::(getInfo) Info request: sdUUID=9e1aa540-1f4e-4ee3-a152-be381ef6c3bd imgUUID=e4c65229-4247-4b33-b72a-f1d5ce72ad05 volUUID = cad94284-3ca9-4c30-933d-997f4460309e >Thread-34::DEBUG::2014-07-10 09:04:05,853::blockVolume::572::Storage.Misc.excCmd::(getMetadata) '/bin/dd iflag=direct skip=14 bs=512 if=/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/metadata count=1' (cwd None) >Thread-34::DEBUG::2014-07-10 09:04:05,876::blockVolume::572::Storage.Misc.excCmd::(getMetadata) SUCCESS: <err> = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.000447123 s, 1.1 MB/s\n'; <rc> = 0 >Thread-34::DEBUG::2014-07-10 09:04:05,877::misc::282::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.000447123 s, 1.1 MB/s'], size: 512 >Thread-34::DEBUG::2014-07-10 09:04:05,879::blockVolume::572::Storage.Misc.excCmd::(getMetadata) '/bin/dd iflag=direct skip=14 bs=512 if=/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/metadata count=1' (cwd None) >Thread-34::DEBUG::2014-07-10 09:04:05,901::blockVolume::572::Storage.Misc.excCmd::(getMetadata) SUCCESS: <err> = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.000634139 s, 807 kB/s\n'; <rc> = 0 >Thread-34::DEBUG::2014-07-10 09:04:05,902::misc::282::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.000634139 s, 807 kB/s'], size: 512 >Thread-34::INFO::2014-07-10 09:04:05,902::volume::909::Storage.Volume::(getInfo) 9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/e4c65229-4247-4b33-b72a-f1d5ce72ad05/cad94284-3ca9-4c30-933d-997f4460309e info is {'status': 'OK', 'domain': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'voltype': 'LEAF', 'description': '', 'parent': '47592965-e853-4e59-9728-d11cca6a7a8a', 'format': 'COW', 'image': 'e4c65229-4247-4b33-b72a-f1d5ce72ad05', 'ctime': '1404983038', 'disktype': '2', 'legality': 'LEGAL', 'mtime': '1404983038', 'apparentsize': '1073741824', 'children': [], 'pool': '', 'capacity': '10737418240', 'uuid': 'cad94284-3ca9-4c30-933d-997f4460309e', 'truesize': '1073741824', 'type': 'SPARSE'} >Thread-34::INFO::2014-07-10 09:04:05,902::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeInfo, Return response: {'info': {'status': 'OK', 'domain': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'voltype': 'LEAF', 'description': '', 'parent': '47592965-e853-4e59-9728-d11cca6a7a8a', 'format': 'COW', 'image': 'e4c65229-4247-4b33-b72a-f1d5ce72ad05', 'ctime': '1404983038', 'disktype': '2', 'legality': 'LEGAL', 'mtime': '1404983038', 'apparentsize': '1073741824', 'children': [], 'pool': '', 'capacity': '10737418240', 'uuid': 'cad94284-3ca9-4c30-933d-997f4460309e', 'truesize': '1073741824', 'type': 'SPARSE'}} >Thread-34::DEBUG::2014-07-10 09:04:05,903::task::1185::TaskManager.Task::(prepare) Task=`636341bd-3d01-4170-8eda-31782dc212c0`::finished: {'info': {'status': 'OK', 'domain': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'voltype': 'LEAF', 'description': '', 'parent': '47592965-e853-4e59-9728-d11cca6a7a8a', 'format': 'COW', 'image': 'e4c65229-4247-4b33-b72a-f1d5ce72ad05', 'ctime': '1404983038', 'disktype': '2', 'legality': 'LEGAL', 'mtime': '1404983038', 'apparentsize': '1073741824', 'children': [], 'pool': '', 'capacity': '10737418240', 'uuid': 'cad94284-3ca9-4c30-933d-997f4460309e', 'truesize': '1073741824', 'type': 'SPARSE'}} >Thread-34::DEBUG::2014-07-10 09:04:05,903::task::595::TaskManager.Task::(_updateState) Task=`636341bd-3d01-4170-8eda-31782dc212c0`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-10 09:04:05,903::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': < ResourceRef 'Storage.9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-10 09:04:05,904::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-10 09:04:05,904::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.9e1aa540-1f4e-4ee3-a152-be381ef6c3bd' >Thread-34::DEBUG::2014-07-10 09:04:05,904::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.9e1aa540-1f4e-4ee3-a152-be381ef6c3bd' (0 active users) >Thread-34::DEBUG::2014-07-10 09:04:05,905::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.9e1aa540-1f4e-4ee3-a152-be381ef6c3bd' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-10 09:04:05,905::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', Clearing records. >Thread-34::DEBUG::2014-07-10 09:04:05,905::task::990::TaskManager.Task::(_decref) Task=`636341bd-3d01-4170-8eda-31782dc212c0`::ref 0 aborting False >Thread-14::DEBUG::2014-07-10 09:04:05,967::BindingXMLRPC::1067::vds::(wrapper) client [10.35.3.13]::call vmGetStats with ('62e7aad5-ff72-4fe3-830f-e7726ed4bfba',) {} >Thread-14::DEBUG::2014-07-10 09:04:05,967::vm::676::vm.Vm::(_getDiskStats) vmId=`62e7aad5-ff72-4fe3-830f-e7726ed4bfba`::Disk hdd stats not available >Thread-14::DEBUG::2014-07-10 09:04:05,968::vm::676::vm.Vm::(_getDiskStats) vmId=`62e7aad5-ff72-4fe3-830f-e7726ed4bfba`::Disk hdc stats not available >Thread-14::DEBUG::2014-07-10 09:04:05,968::vm::676::vm.Vm::(_getDiskStats) vmId=`62e7aad5-ff72-4fe3-830f-e7726ed4bfba`::Disk vda stats not available >Thread-14::DEBUG::2014-07-10 09:04:05,968::vm::715::vm.Vm::(_getDiskLatency) vmId=`62e7aad5-ff72-4fe3-830f-e7726ed4bfba`::Disk hdd latency not available >Thread-14::DEBUG::2014-07-10 09:04:05,969::vm::715::vm.Vm::(_getDiskLatency) vmId=`62e7aad5-ff72-4fe3-830f-e7726ed4bfba`::Disk hdc latency not available >Thread-14::DEBUG::2014-07-10 09:04:05,969::vm::715::vm.Vm::(_getDiskLatency) vmId=`62e7aad5-ff72-4fe3-830f-e7726ed4bfba`::Disk vda latency not available >Thread-14::DEBUG::2014-07-10 09:04:05,969::BindingXMLRPC::1074::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Powering up', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '16791', 'displayIp': '0', 'displayPort': u'5916', 'session': 'Unknown', 'displaySecurePort': u'5917', 'timeOffset': '0', 'hash': '773530886922036478', 'balloonInfo': {'balloon_max': '1048576', 'balloon_target': '1048576', 'balloon_cur': '1048576', 'balloon_min': '1048576'}, 'pauseCode': 'NOERR', 'clientIp': '', 'kvmEnable': 'true', 'network': {u'vnet8': {'macAddr': '00:1a:4a:de:6d:83', 'rxDropped': '0', 'rxErrors': '0', 'txDropped': '0', 'txRate': '0.0', 'rxRate': '0.0', 'txErrors': '0', 'state': 'unknown', 'speed': '1000', 'name': u'vnet8'}}, 'vmId': '62e7aad5-ff72-4fe3-830f-e7726ed4bfba', 'displayType': 'qxl', 'cpuUser': '44.02', 'disks': {u'vda': {'truesize': '1073741824', 'apparentsize': '1073741824', 'imageID': 'c01d693b-cba0-4fed-9ad7-0aaa28912a19'}, u'hdd': {'truesize': '0', 'apparentsize': '0'}, u'hdc': {'truesize': '0', 'apparentsize': '0'}}, 'monitorResponse': '0', 'statsAge': '0.76', 'elapsedTime': '19', 'vmType': 'kvm', 'cpuSys': '21.88', 'guestCPUCount': -1, 'appsList': [], 'guestIPs': ''}]} >Thread-14::DEBUG::2014-07-10 09:04:05,974::BindingXMLRPC::1067::vds::(wrapper) client [10.35.3.13]::call vmGetStats with ('5d49ebac-3f0d-4688-aed0-b3f5fe364000',) {} >Thread-14::DEBUG::2014-07-10 09:04:05,975::vm::676::vm.Vm::(_getDiskStats) vmId=`5d49ebac-3f0d-4688-aed0-b3f5fe364000`::Disk hdd stats not available >Thread-14::DEBUG::2014-07-10 09:04:05,975::vm::676::vm.Vm::(_getDiskStats) vmId=`5d49ebac-3f0d-4688-aed0-b3f5fe364000`::Disk hdc stats not available >Thread-14::DEBUG::2014-07-10 09:04:05,975::vm::676::vm.Vm::(_getDiskStats) vmId=`5d49ebac-3f0d-4688-aed0-b3f5fe364000`::Disk vda stats not available >Thread-14::DEBUG::2014-07-10 09:04:05,975::vm::715::vm.Vm::(_getDiskLatency) vmId=`5d49ebac-3f0d-4688-aed0-b3f5fe364000`::Disk hdd latency not available >Thread-14::DEBUG::2014-07-10 09:04:05,975::vm::715::vm.Vm::(_getDiskLatency) vmId=`5d49ebac-3f0d-4688-aed0-b3f5fe364000`::Disk hdc latency not available >Thread-14::DEBUG::2014-07-10 09:04:05,976::vm::715::vm.Vm::(_getDiskLatency) vmId=`5d49ebac-3f0d-4688-aed0-b3f5fe364000`::Disk vda latency not available >Thread-14::DEBUG::2014-07-10 09:04:05,976::BindingXMLRPC::1074::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Powering up', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '16122', 'displayIp': '0', 'displayPort': u'5914', 'session': 'Unknown', 'displaySecurePort': u'5915', 'timeOffset': '0', 'hash': '8384665493346130205', 'balloonInfo': {'balloon_max': '1048576', 'balloon_target': '1048576', 'balloon_cur': '1048576', 'balloon_min': '1048576'}, 'pauseCode': 'NOERR', 'clientIp': '', 'kvmEnable': 'true', 'network': {u'vnet7': {'macAddr': '00:1a:4a:de:6d:89', 'rxDropped': '0', 'rxErrors': '0', 'txDropped': '0', 'txRate': '0.0', 'rxRate': '0.0', 'txErrors': '0', 'state': 'unknown', 'speed': '1000', 'name': u'vnet7'}}, 'vmId': '5d49ebac-3f0d-4688-aed0-b3f5fe364000', 'displayType': 'qxl', 'cpuUser': '39.02', 'disks': {u'vda': {'truesize': '1073741824', 'apparentsize': '1073741824', 'imageID': 'cfaeead2-7caa-467c-b389-c89840ae6605'}, u'hdd': {'truesize': '0', 'apparentsize': '0'}, u'hdc': {'truesize': '0', 'apparentsize': '0'}}, 'monitorResponse': '0', 'statsAge': '0.59', 'elapsedTime': '39', 'vmType': 'kvm', 'cpuSys': '4.14', 'guestCPUCount': -1, 'appsList': [], 'guestIPs': ''}]} >Thread-14::DEBUG::2014-07-10 09:04:06,008::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-14::DEBUG::2014-07-10 09:04:06,010::task::595::TaskManager.Task::(_updateState) Task=`9ee7de3c-09fe-4808-8ba3-b855a2e47a2d`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 09:04:06,010::logUtils::44::dispatcher::(wrapper) Run and protect: clearTask(taskID='141be3da-90d2-4c29-9282-d4edb2852cac', spUUID=None, options=None) >Thread-14::DEBUG::2014-07-10 09:04:06,010::taskManager::161::TaskManager::(clearTask) Entry. taskID: 141be3da-90d2-4c29-9282-d4edb2852cac >Thread-14::DEBUG::2014-07-10 09:04:06,014::taskManager::166::TaskManager::(clearTask) Return. >Thread-14::INFO::2014-07-10 09:04:06,015::logUtils::47::dispatcher::(wrapper) Run and protect: clearTask, Return response: None >Thread-14::DEBUG::2014-07-10 09:04:06,015::task::1185::TaskManager.Task::(prepare) Task=`9ee7de3c-09fe-4808-8ba3-b855a2e47a2d`::finished: None >Thread-14::DEBUG::2014-07-10 09:04:06,015::task::595::TaskManager.Task::(_updateState) Task=`9ee7de3c-09fe-4808-8ba3-b855a2e47a2d`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 09:04:06,016::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 09:04:06,016::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 09:04:06,016::task::990::TaskManager.Task::(_decref) Task=`9ee7de3c-09fe-4808-8ba3-b855a2e47a2d`::ref 0 aborting False >Thread-14::DEBUG::2014-07-10 09:04:06,416::BindingXMLRPC::1067::vds::(wrapper) client [10.35.3.13]::call vmCreate with ({'acpiEnable': 'true', 'emulatedMachine': 'rhel6.5.0', 'vmId': 'e2b026e7-b32b-4f60-ae2d-b588066ddfa7', 'memGuaranteedSize': 1024, 'spiceSslCipherSuite': 'DEFAULT', 'timeOffset': '0', 'cpuType': 'Conroe', 'custom': {'device_24f3bc5b-66ef-4a60-854a-5b14d67a6e5bdevice_5b0aeb69-a3e1-4a92-bd06-e86d06cf108fdevice_61c89186-d82d-4e4b-8bfb-d5ed6614a43f': 'VmDevice {vmId=e2b026e7-b32b-4f60-ae2d-b588066ddfa7, deviceId=61c89186-d82d-4e4b-8bfb-d5ed6614a43f, device=ide, type=CONTROLLER, bootOrder=0, specParams={}, address={bus=0x00, domain=0x0000, type=pci, slot=0x01, function=0x1}, managed=false, plugged=true, readOnly=false, deviceAlias=ide0, customProperties={}, snapshotId=null}', 'device_24f3bc5b-66ef-4a60-854a-5b14d67a6e5bdevice_5b0aeb69-a3e1-4a92-bd06-e86d06cf108fdevice_61c89186-d82d-4e4b-8bfb-d5ed6614a43fdevice_7ed485c4-5ec5-4b8d-9d5b-4b694323b834': 'VmDevice {vmId=e2b026e7-b32b-4f60-ae2d-b588066ddfa7, deviceId=7ed485c4-5ec5-4b8d-9d5b-4b694323b834, device=spicevmc, type=CHANNEL, bootOrder=0, specParams={}, address={port=3, bus=0, controller=0, type=virtio-serial}, managed=false, plugged=true, readOnly=false, deviceAlias=channel2, customProperties={}, snapshotId=null}', 'device_24f3bc5b-66ef-4a60-854a-5b14d67a6e5b': 'VmDevice {vmId=e2b026e7-b32b-4f60-ae2d-b588066ddfa7, deviceId=24f3bc5b-66ef-4a60-854a-5b14d67a6e5b, device=unix, type=CHANNEL, bootOrder=0, specParams={}, address={port=2, bus=0, controller=0, type=virtio-serial}, managed=false, plugged=true, readOnly=false, deviceAlias=channel1, customProperties={}, snapshotId=null}', 'device_24f3bc5b-66ef-4a60-854a-5b14d67a6e5bdevice_5b0aeb69-a3e1-4a92-bd06-e86d06cf108f': 'VmDevice {vmId=e2b026e7-b32b-4f60-ae2d-b588066ddfa7, deviceId=5b0aeb69-a3e1-4a92-bd06-e86d06cf108f, device=unix, type=CHANNEL, bootOrder=0, specParams={}, address={port=1, bus=0, controller=0, type=virtio-serial}, managed=false, plugged=true, readOnly=false, deviceAlias=channel0, customProperties={}, snapshotId=null}', 'device_24f3bc5b-66ef-4a60-854a-5b14d67a6e5bdevice_5b0aeb69-a3e1-4a92-bd06-e86d06cf108fdevice_61c89186-d82d-4e4b-8bfb-d5ed6614a43fdevice_7ed485c4-5ec5-4b8d-9d5b-4b694323b834device_6df69c4f-ccad-452f-81f0-48d57a717e5b': 'VmDevice {vmId=e2b026e7-b32b-4f60-ae2d-b588066ddfa7, deviceId=6df69c4f-ccad-452f-81f0-48d57a717e5b, device=virtio-serial, type=CONTROLLER, bootOrder=0, specParams={}, address={bus=0x00, domain=0x0000, type=pci, slot=0x05, function=0x0}, managed=false, plugged=true, readOnly=false, deviceAlias=virtio-serial0, customProperties={}, snapshotId=null}'}, 'smp': '2', 'vmType': 'kvm', 'memSize': 1024, 'smpCoresPerSocket': '2', 'vmName': 'scale_10', 'nice': '0', 'smartcardEnable': 'false', 'keyboardLayout': 'en-us', 'kvmEnable': 'true', 'pitReinjection': 'false', 'transparentHugePages': 'true', 'devices': [{'index': '3', 'iface': 'ide', 'specParams': {'vmPayload': {'volId': 'config-2', 'file': {'openstack/latest/meta_data.json': 'ewogICJsYXVuY2hfaW5kZXgiIDogIjAiLAogICJhdmFpbGFiaWxpdHlfem9uZSIgOiAibm92YSIs\nCiAgInV1aWQiIDogIjAyMjJhY2FkLTEzNDMtNDdjNC1iMGU1LTM1MmUxMjI3NjMwMSIsCiAgIm1l\ndGEiIDogewogICAgImVzc2VudGlhbCIgOiAiZmFsc2UiLAogICAgInJvbGUiIDogInNlcnZlciIs\nCiAgICAiZHNtb2RlIiA6ICJsb2NhbCIKICB9Cn0=\n', 'openstack/latest/user_data': 'I2Nsb3VkLWNvbmZpZwpzc2hfcHdhdXRoOiB0cnVlCmRpc2FibGVfcm9vdDogMApvdXRwdXQ6CiAg\nYWxsOiAnPj4gL3Zhci9sb2cvY2xvdWQtaW5pdC1vdXRwdXQubG9nJwp1c2VyOiByb290CmNocGFz\nc3dkOgogIGV4cGlyZTogZmFsc2UKcnVuY21kOgotICdzZWQgLWkgJycvXmRhdGFzb3VyY2VfbGlz\ndDogL2QnJyAvZXRjL2Nsb3VkL2Nsb3VkLmNmZzsgZWNobyAnJ2RhdGFzb3VyY2VfbGlzdDoKICBb\nIk5vQ2xvdWQiLCAiQ29uZmlnRHJpdmUiXScnID4+IC9ldGMvY2xvdWQvY2xvdWQuY2ZnJwo=\n'}}}, 'readonly': 'true', 'deviceId': '6ae0e82d-c459-4499-be8c-0b10f92f2b58', 'path': '', 'device': 'cdrom', 'shared': 'false', 'type': 'disk'}, {'device': 'qxl', 'specParams': {'vram': '32768', 'ram': '65536', 'heads': '1'}, 'type': 'video', 'deviceId': '5cef7a10-9789-451e-a716-9a36369a5b87'}, {'index': '2', 'iface': 'ide', 'specParams': {'path': ''}, 'readonly': 'true', 'deviceId': '4e89da7a-3d26-4643-b152-65f70a624099', 'path': '', 'device': 'cdrom', 'shared': 'false', 'type': 'disk'}, {'index': 0, 'iface': 'virtio', 'format': 'cow', 'bootOrder': '1', 'poolID': '4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', 'volumeID': 'cad94284-3ca9-4c30-933d-997f4460309e', 'imageID': 'e4c65229-4247-4b33-b72a-f1d5ce72ad05', 'specParams': {}, 'readonly': 'false', 'domainID': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'optional': 'false', 'deviceId': 'e4c65229-4247-4b33-b72a-f1d5ce72ad05', 'address': {'slot': '0x06', 'bus': '0x00', 'domain': '0x0000', 'type': 'pci', 'function': '0x0'}, 'device': 'disk', 'shared': 'false', 'propagateErrors': 'off', 'type': 'disk'}, {'nicModel': 'pv', 'macAddr': '00:1a:4a:de:6d:82', 'linkActive': 'true', 'network': 'rhevm', 'filter': 'vdsm-no-mac-spoofing', 'specParams': {'inbound': {}, 'outbound': {}}, 'deviceId': '0fa4de37-ea6b-4a38-9756-5554f46ef32f', 'device': 'bridge', 'type': 'interface'}, {'device': 'memballoon', 'specParams': {'model': 'virtio'}, 'type': 'balloon', 'deviceId': '6ecbf597-1bc5-4c25-b7e0-de3c92ce96fc'}, {'index': '0', 'specParams': {}, 'deviceId': '7ee513fa-ca3e-4cb2-989e-0887ae027a01', 'address': {'slot': '0x04', 'bus': '0x00', 'domain': '0x0000', 'type': 'pci', 'function': '0x0'}, 'device': 'scsi', 'model': 'virtio-scsi', 'type': 'controller'}], 'maxVCpus': '160', 'spiceSecureChannels': 'smain,sinputs,scursor,splayback,srecord,sdisplay,susbredir,ssmartcard', 'display': 'qxl'},) {} flowID [38460f95] >Thread-14::INFO::2014-07-10 09:04:06,419::API::667::vds::(_getNetworkIp) network None: using 0 >Thread-14::INFO::2014-07-10 09:04:06,419::clientIF::366::vds::(createVm) vmContainerLock acquired by vm e2b026e7-b32b-4f60-ae2d-b588066ddfa7 >Thread-14::DEBUG::2014-07-10 09:04:06,425::clientIF::379::vds::(createVm) Total desktops after creation of e2b026e7-b32b-4f60-ae2d-b588066ddfa7 is 10 >Thread-74::DEBUG::2014-07-10 09:04:06,426::vm::2270::vm.Vm::(_startUnderlyingVm) vmId=`e2b026e7-b32b-4f60-ae2d-b588066ddfa7`::Start >Thread-14::DEBUG::2014-07-10 09:04:06,427::BindingXMLRPC::1074::vds::(wrapper) return vmCreate with {'status': {'message': 'Done', 'code': 0}, 'vmList': {'status': 'WaitForLaunch', 'acpiEnable': 'true', 'emulatedMachine': 'rhel6.5.0', 'vmId': 'e2b026e7-b32b-4f60-ae2d-b588066ddfa7', 'pid': '0', 'memGuaranteedSize': 1024, 'timeOffset': '0', 'keyboardLayout': 'en-us', 'displayPort': '-1', 'displaySecurePort': '-1', 'spiceSslCipherSuite': 'DEFAULT', 'cpuType': 'Conroe', 'smp': '2', 'clientIp': '', 'nicModel': 'rtl8139,pv', 'smartcardEnable': 'false', 'kvmEnable': 'true', 'pitReinjection': 'false', 'transparentHugePages': 'true', 'devices': [{'index': '3', 'iface': 'ide', 'specParams': {'vmPayload': {'volId': 'config-2', 'file': {'openstack/latest/meta_data.json': 'ewogICJsYXVuY2hfaW5kZXgiIDogIjAiLAogICJhdmFpbGFiaWxpdHlfem9uZSIgOiAibm92YSIs\nCiAgInV1aWQiIDogIjAyMjJhY2FkLTEzNDMtNDdjNC1iMGU1LTM1MmUxMjI3NjMwMSIsCiAgIm1l\ndGEiIDogewogICAgImVzc2VudGlhbCIgOiAiZmFsc2UiLAogICAgInJvbGUiIDogInNlcnZlciIs\nCiAgICAiZHNtb2RlIiA6ICJsb2NhbCIKICB9Cn0=\n', 'openstack/latest/user_data': 'I2Nsb3VkLWNvbmZpZwpzc2hfcHdhdXRoOiB0cnVlCmRpc2FibGVfcm9vdDogMApvdXRwdXQ6CiAg\nYWxsOiAnPj4gL3Zhci9sb2cvY2xvdWQtaW5pdC1vdXRwdXQubG9nJwp1c2VyOiByb290CmNocGFz\nc3dkOgogIGV4cGlyZTogZmFsc2UKcnVuY21kOgotICdzZWQgLWkgJycvXmRhdGFzb3VyY2VfbGlz\ndDogL2QnJyAvZXRjL2Nsb3VkL2Nsb3VkLmNmZzsgZWNobyAnJ2RhdGFzb3VyY2VfbGlzdDoKICBb\nIk5vQ2xvdWQiLCAiQ29uZmlnRHJpdmUiXScnID4+IC9ldGMvY2xvdWQvY2xvdWQuY2ZnJwo=\n'}}}, 'readonly': 'true', 'deviceId': '6ae0e82d-c459-4499-be8c-0b10f92f2b58', 'path': '', 'device': 'cdrom', 'shared': 'false', 'type': 'disk'}, {'device': 'qxl', 'specParams': {'vram': '32768', 'ram': '65536', 'heads': '1'}, 'type': 'video', 'deviceId': '5cef7a10-9789-451e-a716-9a36369a5b87'}, {'index': '2', 'iface': 'ide', 'specParams': {'path': ''}, 'readonly': 'true', 'deviceId': '4e89da7a-3d26-4643-b152-65f70a624099', 'path': '', 'device': 'cdrom', 'shared': 'false', 'type': 'disk'}, {'index': 0, 'iface': 'virtio', 'format': 'cow', 'bootOrder': '1', 'poolID': '4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', 'volumeID': 'cad94284-3ca9-4c30-933d-997f4460309e', 'imageID': 'e4c65229-4247-4b33-b72a-f1d5ce72ad05', 'specParams': {}, 'readonly': 'false', 'domainID': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'optional': 'false', 'deviceId': 'e4c65229-4247-4b33-b72a-f1d5ce72ad05', 'address': {'slot': '0x06', 'bus': '0x00', 'domain': '0x0000', 'type': 'pci', 'function': '0x0'}, 'device': 'disk', 'shared': 'false', 'propagateErrors': 'off', 'type': 'disk'}, {'nicModel': 'pv', 'macAddr': '00:1a:4a:de:6d:82', 'linkActive': 'true', 'network': 'rhevm', 'filter': 'vdsm-no-mac-spoofing', 'specParams': {'inbound': {}, 'outbound': {}}, 'deviceId': '0fa4de37-ea6b-4a38-9756-5554f46ef32f', 'device': 'bridge', 'type': 'interface'}, {'device': 'memballoon', 'specParams': {'model': 'virtio'}, 'type': 'balloon', 'deviceId': '6ecbf597-1bc5-4c25-b7e0-de3c92ce96fc'}, {'index': '0', 'specParams': {}, 'deviceId': '7ee513fa-ca3e-4cb2-989e-0887ae027a01', 'address': {'slot': '0x04', 'bus': '0x00', 'domain': '0x0000', 'type': 'pci', 'function': '0x0'}, 'device': 'scsi', 'model': 'virtio-scsi', 'type': 'controller'}], 'custom': {'device_24f3bc5b-66ef-4a60-854a-5b14d67a6e5bdevice_5b0aeb69-a3e1-4a92-bd06-e86d06cf108fdevice_61c89186-d82d-4e4b-8bfb-d5ed6614a43f': 'VmDevice {vmId=e2b026e7-b32b-4f60-ae2d-b588066ddfa7, deviceId=61c89186-d82d-4e4b-8bfb-d5ed6614a43f, device=ide, type=CONTROLLER, bootOrder=0, specParams={}, address={bus=0x00, domain=0x0000, type=pci, slot=0x01, function=0x1}, managed=false, plugged=true, readOnly=false, deviceAlias=ide0, customProperties={}, snapshotId=null}', 'device_24f3bc5b-66ef-4a60-854a-5b14d67a6e5bdevice_5b0aeb69-a3e1-4a92-bd06-e86d06cf108fdevice_61c89186-d82d-4e4b-8bfb-d5ed6614a43fdevice_7ed485c4-5ec5-4b8d-9d5b-4b694323b834': 'VmDevice {vmId=e2b026e7-b32b-4f60-ae2d-b588066ddfa7, deviceId=7ed485c4-5ec5-4b8d-9d5b-4b694323b834, device=spicevmc, type=CHANNEL, bootOrder=0, specParams={}, address={port=3, bus=0, controller=0, type=virtio-serial}, managed=false, plugged=true, readOnly=false, deviceAlias=channel2, customProperties={}, snapshotId=null}', 'device_24f3bc5b-66ef-4a60-854a-5b14d67a6e5b': 'VmDevice {vmId=e2b026e7-b32b-4f60-ae2d-b588066ddfa7, deviceId=24f3bc5b-66ef-4a60-854a-5b14d67a6e5b, device=unix, type=CHANNEL, bootOrder=0, specParams={}, address={port=2, bus=0, controller=0, type=virtio-serial}, managed=false, plugged=true, readOnly=false, deviceAlias=channel1, customProperties={}, snapshotId=null}', 'device_24f3bc5b-66ef-4a60-854a-5b14d67a6e5bdevice_5b0aeb69-a3e1-4a92-bd06-e86d06cf108f': 'VmDevice {vmId=e2b026e7-b32b-4f60-ae2d-b588066ddfa7, deviceId=5b0aeb69-a3e1-4a92-bd06-e86d06cf108f, device=unix, type=CHANNEL, bootOrder=0, specParams={}, address={port=1, bus=0, controller=0, type=virtio-serial}, managed=false, plugged=true, readOnly=false, deviceAlias=channel0, customProperties={}, snapshotId=null}', 'device_24f3bc5b-66ef-4a60-854a-5b14d67a6e5bdevice_5b0aeb69-a3e1-4a92-bd06-e86d06cf108fdevice_61c89186-d82d-4e4b-8bfb-d5ed6614a43fdevice_7ed485c4-5ec5-4b8d-9d5b-4b694323b834device_6df69c4f-ccad-452f-81f0-48d57a717e5b': 'VmDevice {vmId=e2b026e7-b32b-4f60-ae2d-b588066ddfa7, deviceId=6df69c4f-ccad-452f-81f0-48d57a717e5b, device=virtio-serial, type=CONTROLLER, bootOrder=0, specParams={}, address={bus=0x00, domain=0x0000, type=pci, slot=0x05, function=0x0}, managed=false, plugged=true, readOnly=false, deviceAlias=virtio-serial0, customProperties={}, snapshotId=null}'}, 'vmType': 'kvm', 'memSize': 1024, 'displayIp': '0', 'maxVCpus': '160', 'spiceSecureChannels': 'smain,sinputs,scursor,splayback,srecord,sdisplay,susbredir,ssmartcard', 'smpCoresPerSocket': '2', 'vmName': 'scale_10', 'display': 'qxl', 'nice': '0'}} >Thread-74::DEBUG::2014-07-10 09:04:06,429::vm::2274::vm.Vm::(_startUnderlyingVm) vmId=`e2b026e7-b32b-4f60-ae2d-b588066ddfa7`::_ongoingCreations acquired >Thread-74::INFO::2014-07-10 09:04:06,432::vm::3151::vm.Vm::(_run) vmId=`e2b026e7-b32b-4f60-ae2d-b588066ddfa7`::VM wrapper has started >Thread-74::DEBUG::2014-07-10 09:04:06,437::task::595::TaskManager.Task::(_updateState) Task=`01c4201c-4d6b-4e68-a769-c533716eccb5`::moving from state init -> state preparing >Thread-74::INFO::2014-07-10 09:04:06,440::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='e4c65229-4247-4b33-b72a-f1d5ce72ad05', volUUID='cad94284-3ca9-4c30-933d-997f4460309e', options=None) >Thread-74::INFO::2014-07-10 09:04:06,442::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-74::DEBUG::2014-07-10 09:04:06,444::task::1185::TaskManager.Task::(prepare) Task=`01c4201c-4d6b-4e68-a769-c533716eccb5`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-74::DEBUG::2014-07-10 09:04:06,446::task::595::TaskManager.Task::(_updateState) Task=`01c4201c-4d6b-4e68-a769-c533716eccb5`::moving from state preparing -> state finished >Thread-74::DEBUG::2014-07-10 09:04:06,448::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-74::DEBUG::2014-07-10 09:04:06,450::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-74::DEBUG::2014-07-10 09:04:06,452::task::990::TaskManager.Task::(_decref) Task=`01c4201c-4d6b-4e68-a769-c533716eccb5`::ref 0 aborting False >Thread-74::INFO::2014-07-10 09:04:06,514::clientIF::324::vds::(prepareVolumePath) prepared volume path: /var/run/vdsm/payload/e2b026e7-b32b-4f60-ae2d-b588066ddfa7.937ae3f2c4b9ff7bf75fda2a278dad35.img >Thread-74::INFO::2014-07-10 09:04:06,514::clientIF::324::vds::(prepareVolumePath) prepared volume path: >Thread-74::DEBUG::2014-07-10 09:04:06,515::task::595::TaskManager.Task::(_updateState) Task=`219c7a95-abfd-48f5-8c25-022c6230d348`::moving from state init -> state preparing >Thread-74::INFO::2014-07-10 09:04:06,515::logUtils::44::dispatcher::(wrapper) Run and protect: prepareImage(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='e4c65229-4247-4b33-b72a-f1d5ce72ad05', leafUUID='cad94284-3ca9-4c30-933d-997f4460309e') >Thread-74::DEBUG::2014-07-10 09:04:06,516::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.9e1aa540-1f4e-4ee3-a152-be381ef6c3bd`ReqID=`40c0c0a1-0d6e-48bf-a495-024cde1c339e`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '3248' at 'prepareImage' >Thread-74::DEBUG::2014-07-10 09:04:06,516::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.9e1aa540-1f4e-4ee3-a152-be381ef6c3bd' for lock type 'shared' >Thread-74::DEBUG::2014-07-10 09:04:06,517::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.9e1aa540-1f4e-4ee3-a152-be381ef6c3bd' is free. Now locking as 'shared' (1 active user) >Thread-74::DEBUG::2014-07-10 09:04:06,517::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.9e1aa540-1f4e-4ee3-a152-be381ef6c3bd`ReqID=`40c0c0a1-0d6e-48bf-a495-024cde1c339e`::Granted request >Thread-74::DEBUG::2014-07-10 09:04:06,519::task::827::TaskManager.Task::(resourceAcquired) Task=`219c7a95-abfd-48f5-8c25-022c6230d348`::_resourcesAcquired: Storage.9e1aa540-1f4e-4ee3-a152-be381ef6c3bd (shared) >Thread-74::DEBUG::2014-07-10 09:04:06,519::task::990::TaskManager.Task::(_decref) Task=`219c7a95-abfd-48f5-8c25-022c6230d348`::ref 1 aborting False >Thread-74::DEBUG::2014-07-10 09:04:06,520::lvm::427::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' got the operation mutex >Thread-74::DEBUG::2014-07-10 09:04:06,520::lvm::296::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm lvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/3600601601282300032826addbbdae311|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,vg_name,attr,size,seg_start_pe,devices,tags 9e1aa540-1f4e-4ee3-a152-be381ef6c3bd' (cwd None) >Thread-74::DEBUG::2014-07-10 09:04:06,753::lvm::296::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-74::DEBUG::2014-07-10 09:04:06,769::lvm::462::Storage.LVM::(_reloadlvs) lvs reloaded >Thread-74::DEBUG::2014-07-10 09:04:06,769::lvm::462::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' released the operation mutex >Thread-74::DEBUG::2014-07-10 09:04:06,771::lvm::296::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm lvchange --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/3600601601282300032826addbbdae311|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } " --autobackup n --available y 9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/cad94284-3ca9-4c30-933d-997f4460309e' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:04:07,030::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:04:07,143::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0535833 s, 19.1 MB/s\n'; <rc> = 0 >Thread-74::DEBUG::2014-07-10 09:04:07,425::lvm::296::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-74::DEBUG::2014-07-10 09:04:07,426::lvm::513::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-74::DEBUG::2014-07-10 09:04:07,426::lvm::525::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-74::DEBUG::2014-07-10 09:04:07,428::blockSD::1057::Storage.StorageDomain::(linkBCImage) path to image directory already exists: /rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/images/e4c65229-4247-4b33-b72a-f1d5ce72ad05 >Thread-74::DEBUG::2014-07-10 09:04:07,429::lvm::427::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' got the operation mutex >Thread-74::DEBUG::2014-07-10 09:04:07,430::lvm::296::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm lvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/3600601601282300032826addbbdae311|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,vg_name,attr,size,seg_start_pe,devices,tags 9e1aa540-1f4e-4ee3-a152-be381ef6c3bd' (cwd None) >Thread-74::DEBUG::2014-07-10 09:04:07,637::lvm::296::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-74::DEBUG::2014-07-10 09:04:07,654::lvm::462::Storage.LVM::(_reloadlvs) lvs reloaded >Thread-74::DEBUG::2014-07-10 09:04:07,654::lvm::462::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' released the operation mutex >Thread-74::INFO::2014-07-10 09:04:07,655::logUtils::47::dispatcher::(wrapper) Run and protect: prepareImage, Return response: {'info': {'domainID': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'volType': 'path', 'leaseOffset': 119537664, 'path': '/rhev/data-center/mnt/blockSD/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/images/e4c65229-4247-4b33-b72a-f1d5ce72ad05/cad94284-3ca9-4c30-933d-997f4460309e', 'volumeID': 'cad94284-3ca9-4c30-933d-997f4460309e', 'leasePath': '/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/leases', 'imageID': 'e4c65229-4247-4b33-b72a-f1d5ce72ad05'}, 'path': '/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/images/e4c65229-4247-4b33-b72a-f1d5ce72ad05/cad94284-3ca9-4c30-933d-997f4460309e', 'imgVolumesInfo': [{'domainID': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'volType': 'path', 'leaseOffset': 109051904, 'path': '/rhev/data-center/mnt/blockSD/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/images/e4c65229-4247-4b33-b72a-f1d5ce72ad05/47592965-e853-4e59-9728-d11cca6a7a8a', 'volumeID': '47592965-e853-4e59-9728-d11cca6a7a8a', 'leasePath': '/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/leases', 'imageID': 'e4c65229-4247-4b33-b72a-f1d5ce72ad05'}, {'domainID': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'volType': 'path', 'leaseOffset': 119537664, 'path': '/rhev/data-center/mnt/blockSD/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/images/e4c65229-4247-4b33-b72a-f1d5ce72ad05/cad94284-3ca9-4c30-933d-997f4460309e', 'volumeID': 'cad94284-3ca9-4c30-933d-997f4460309e', 'leasePath': '/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/leases', 'imageID': 'e4c65229-4247-4b33-b72a-f1d5ce72ad05'}]} >Thread-74::DEBUG::2014-07-10 09:04:07,656::task::1185::TaskManager.Task::(prepare) Task=`219c7a95-abfd-48f5-8c25-022c6230d348`::finished: {'info': {'domainID': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'volType': 'path', 'leaseOffset': 119537664, 'path': '/rhev/data-center/mnt/blockSD/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/images/e4c65229-4247-4b33-b72a-f1d5ce72ad05/cad94284-3ca9-4c30-933d-997f4460309e', 'volumeID': 'cad94284-3ca9-4c30-933d-997f4460309e', 'leasePath': '/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/leases', 'imageID': 'e4c65229-4247-4b33-b72a-f1d5ce72ad05'}, 'path': '/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/images/e4c65229-4247-4b33-b72a-f1d5ce72ad05/cad94284-3ca9-4c30-933d-997f4460309e', 'imgVolumesInfo': [{'domainID': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'volType': 'path', 'leaseOffset': 109051904, 'path': '/rhev/data-center/mnt/blockSD/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/images/e4c65229-4247-4b33-b72a-f1d5ce72ad05/47592965-e853-4e59-9728-d11cca6a7a8a', 'volumeID': '47592965-e853-4e59-9728-d11cca6a7a8a', 'leasePath': '/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/leases', 'imageID': 'e4c65229-4247-4b33-b72a-f1d5ce72ad05'}, {'domainID': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'volType': 'path', 'leaseOffset': 119537664, 'path': '/rhev/data-center/mnt/blockSD/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/images/e4c65229-4247-4b33-b72a-f1d5ce72ad05/cad94284-3ca9-4c30-933d-997f4460309e', 'volumeID': 'cad94284-3ca9-4c30-933d-997f4460309e', 'leasePath': '/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/leases', 'imageID': 'e4c65229-4247-4b33-b72a-f1d5ce72ad05'}]} >Thread-74::DEBUG::2014-07-10 09:04:07,656::task::595::TaskManager.Task::(_updateState) Task=`219c7a95-abfd-48f5-8c25-022c6230d348`::moving from state preparing -> state finished >Thread-74::DEBUG::2014-07-10 09:04:07,656::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': < ResourceRef 'Storage.9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', isValid: 'True' obj: 'None'>} >Thread-74::DEBUG::2014-07-10 09:04:07,656::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-74::DEBUG::2014-07-10 09:04:07,657::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.9e1aa540-1f4e-4ee3-a152-be381ef6c3bd' >Thread-74::DEBUG::2014-07-10 09:04:07,657::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.9e1aa540-1f4e-4ee3-a152-be381ef6c3bd' (0 active users) >Thread-74::DEBUG::2014-07-10 09:04:07,657::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.9e1aa540-1f4e-4ee3-a152-be381ef6c3bd' is free, finding out if anyone is waiting for it. >Thread-74::DEBUG::2014-07-10 09:04:07,657::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', Clearing records. >Thread-74::DEBUG::2014-07-10 09:04:07,658::task::990::TaskManager.Task::(_decref) Task=`219c7a95-abfd-48f5-8c25-022c6230d348`::ref 0 aborting False >Thread-74::INFO::2014-07-10 09:04:07,658::clientIF::324::vds::(prepareVolumePath) prepared volume path: /rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/images/e4c65229-4247-4b33-b72a-f1d5ce72ad05/cad94284-3ca9-4c30-933d-997f4460309e >Thread-74::DEBUG::2014-07-10 09:04:07,680::utils::642::root::(execCmd) '/usr/libexec/vdsm/hooks/before_vm_start/50_vhostmd' (cwd None) >Thread-18::DEBUG::2014-07-10 09:04:07,782::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/metadata bs=4096 count=1' (cwd None) >Thread-74::DEBUG::2014-07-10 09:04:07,805::utils::662::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-74::INFO::2014-07-10 09:04:07,811::hooks::100::root::(_runHooksDir) >Thread-74::DEBUG::2014-07-10 09:04:07,814::vm::3190::vm.Vm::(_run) vmId=`e2b026e7-b32b-4f60-ae2d-b588066ddfa7`::<?xml version="1.0" encoding="utf-8"?> ><domain type="kvm"> > <name>scale_10</name> > <uuid>e2b026e7-b32b-4f60-ae2d-b588066ddfa7</uuid> > <memory>1048576</memory> > <currentMemory>1048576</currentMemory> > <vcpu current="2">160</vcpu> > <memtune> > <min_guarantee>1048576</min_guarantee> > </memtune> > <devices> > <channel type="unix"> > <target name="com.redhat.rhevm.vdsm" type="virtio"/> > <source mode="bind" path="/var/lib/libvirt/qemu/channels/e2b026e7-b32b-4f60-ae2d-b588066ddfa7.com.redhat.rhevm.vdsm"/> > </channel> > <channel type="unix"> > <target name="org.qemu.guest_agent.0" type="virtio"/> > <source mode="bind" path="/var/lib/libvirt/qemu/channels/e2b026e7-b32b-4f60-ae2d-b588066ddfa7.org.qemu.guest_agent.0"/> > </channel> > <input bus="ps2" type="mouse"/> > <channel type="spicevmc"> > <target name="com.redhat.spice.0" type="virtio"/> > </channel> > <graphics autoport="yes" keymap="en-us" listen="0" passwd="*****" passwdValidTo="1970-01-01T00:00:01" port="-1" tlsPort="-1" type="spice"> > <channel mode="secure" name="main"/> > <channel mode="secure" name="inputs"/> > <channel mode="secure" name="cursor"/> > <channel mode="secure" name="playback"/> > <channel mode="secure" name="record"/> > <channel mode="secure" name="display"/> > <channel mode="secure" name="usbredir"/> > <channel mode="secure" name="smartcard"/> > </graphics> > <memballoon model="virtio"/> > <controller index="0" model="virtio-scsi" type="scsi"> > <address bus="0x00" domain="0x0000" function="0x0" slot="0x04" type="pci"/> > </controller> > <video> > <model heads="1" ram="65536" type="qxl" vram="32768"/> > </video> > <interface type="bridge"> > <mac address="00:1a:4a:de:6d:82"/> > <model type="virtio"/> > <source bridge="rhevm"/> > <filterref filter="vdsm-no-mac-spoofing"/> > <link state="up"/> > <bandwidth/> > </interface> > <disk device="cdrom" snapshot="no" type="file"> > <source file="/var/run/vdsm/payload/e2b026e7-b32b-4f60-ae2d-b588066ddfa7.937ae3f2c4b9ff7bf75fda2a278dad35.img" startupPolicy="optional"/> > <target bus="ide" dev="hdd"/> > <readonly/> > <serial/> > </disk> > <disk device="cdrom" snapshot="no" type="file"> > <source file="" startupPolicy="optional"/> > <target bus="ide" dev="hdc"/> > <readonly/> > <serial/> > </disk> > <disk device="disk" snapshot="no" type="block"> > <address bus="0x00" domain="0x0000" function="0x0" slot="0x06" type="pci"/> > <source dev="/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/images/e4c65229-4247-4b33-b72a-f1d5ce72ad05/cad94284-3ca9-4c30-933d-997f4460309e"/> > <target bus="virtio" dev="vda"/> > <serial>e4c65229-4247-4b33-b72a-f1d5ce72ad05</serial> > <boot order="1"/> > <driver cache="none" error_policy="stop" io="native" name="qemu" type="qcow2"/> > </disk> > </devices> > <os> > <type arch="x86_64" machine="rhel6.5.0">hvm</type> > <smbios mode="sysinfo"/> > </os> > <sysinfo type="smbios"> > <system> > <entry name="manufacturer">Red Hat</entry> > <entry name="product">RHEV Hypervisor</entry> > <entry name="version">6.5-20140707.0.el6ev</entry> > <entry name="serial">52BAF97B-FF2F-E311-0000-100000000005</entry> > <entry name="uuid">e2b026e7-b32b-4f60-ae2d-b588066ddfa7</entry> > </system> > </sysinfo> > <clock adjustment="0" offset="variable"> > <timer name="rtc" tickpolicy="catchup"/> > </clock> > <features> > <acpi/> > </features> > <cpu match="exact"> > <model>Conroe</model> > <topology cores="2" sockets="80" threads="1"/> > </cpu> ></domain> > >Thread-18::DEBUG::2014-07-10 09:04:07,821::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000830929 s, 4.9 MB/s\n'; <rc> = 0 >GuestMonitor-scale_9::DEBUG::2014-07-10 09:04:08,010::vm::676::vm.Vm::(_getDiskStats) vmId=`62e7aad5-ff72-4fe3-830f-e7726ed4bfba`::Disk hdd stats not available >GuestMonitor-scale_9::DEBUG::2014-07-10 09:04:08,011::vm::676::vm.Vm::(_getDiskStats) vmId=`62e7aad5-ff72-4fe3-830f-e7726ed4bfba`::Disk hdc stats not available >GuestMonitor-scale_9::DEBUG::2014-07-10 09:04:08,012::vm::676::vm.Vm::(_getDiskStats) vmId=`62e7aad5-ff72-4fe3-830f-e7726ed4bfba`::Disk vda stats not available >GuestMonitor-scale_9::DEBUG::2014-07-10 09:04:08,012::vm::715::vm.Vm::(_getDiskLatency) vmId=`62e7aad5-ff72-4fe3-830f-e7726ed4bfba`::Disk hdd latency not available >GuestMonitor-scale_9::DEBUG::2014-07-10 09:04:08,012::vm::715::vm.Vm::(_getDiskLatency) vmId=`62e7aad5-ff72-4fe3-830f-e7726ed4bfba`::Disk hdc latency not available >GuestMonitor-scale_9::DEBUG::2014-07-10 09:04:08,013::vm::715::vm.Vm::(_getDiskLatency) vmId=`62e7aad5-ff72-4fe3-830f-e7726ed4bfba`::Disk vda latency not available >GuestMonitor-scale_9::DEBUG::2014-07-10 09:04:08,014::vm::676::vm.Vm::(_getDiskStats) vmId=`62e7aad5-ff72-4fe3-830f-e7726ed4bfba`::Disk hdd stats not available >GuestMonitor-scale_9::DEBUG::2014-07-10 09:04:08,014::vm::676::vm.Vm::(_getDiskStats) vmId=`62e7aad5-ff72-4fe3-830f-e7726ed4bfba`::Disk hdc stats not available >GuestMonitor-scale_9::DEBUG::2014-07-10 09:04:08,015::vm::676::vm.Vm::(_getDiskStats) vmId=`62e7aad5-ff72-4fe3-830f-e7726ed4bfba`::Disk vda stats not available >GuestMonitor-scale_9::DEBUG::2014-07-10 09:04:08,015::vm::715::vm.Vm::(_getDiskLatency) vmId=`62e7aad5-ff72-4fe3-830f-e7726ed4bfba`::Disk hdd latency not available >GuestMonitor-scale_9::DEBUG::2014-07-10 09:04:08,015::vm::715::vm.Vm::(_getDiskLatency) vmId=`62e7aad5-ff72-4fe3-830f-e7726ed4bfba`::Disk hdc latency not available >GuestMonitor-scale_9::DEBUG::2014-07-10 09:04:08,016::vm::715::vm.Vm::(_getDiskLatency) vmId=`62e7aad5-ff72-4fe3-830f-e7726ed4bfba`::Disk vda latency not available >GuestMonitor-scale_8::DEBUG::2014-07-10 09:04:08,117::vm::676::vm.Vm::(_getDiskStats) vmId=`5d49ebac-3f0d-4688-aed0-b3f5fe364000`::Disk hdd stats not available >GuestMonitor-scale_8::DEBUG::2014-07-10 09:04:08,118::vm::676::vm.Vm::(_getDiskStats) vmId=`5d49ebac-3f0d-4688-aed0-b3f5fe364000`::Disk hdc stats not available >GuestMonitor-scale_8::DEBUG::2014-07-10 09:04:08,118::vm::676::vm.Vm::(_getDiskStats) vmId=`5d49ebac-3f0d-4688-aed0-b3f5fe364000`::Disk vda stats not available >GuestMonitor-scale_8::DEBUG::2014-07-10 09:04:08,118::vm::715::vm.Vm::(_getDiskLatency) vmId=`5d49ebac-3f0d-4688-aed0-b3f5fe364000`::Disk hdd latency not available >GuestMonitor-scale_8::DEBUG::2014-07-10 09:04:08,118::vm::715::vm.Vm::(_getDiskLatency) vmId=`5d49ebac-3f0d-4688-aed0-b3f5fe364000`::Disk hdc latency not available >GuestMonitor-scale_8::DEBUG::2014-07-10 09:04:08,119::vm::715::vm.Vm::(_getDiskLatency) vmId=`5d49ebac-3f0d-4688-aed0-b3f5fe364000`::Disk vda latency not available >GuestMonitor-scale_8::DEBUG::2014-07-10 09:04:08,119::vm::676::vm.Vm::(_getDiskStats) vmId=`5d49ebac-3f0d-4688-aed0-b3f5fe364000`::Disk hdd stats not available >GuestMonitor-scale_8::DEBUG::2014-07-10 09:04:08,119::vm::676::vm.Vm::(_getDiskStats) vmId=`5d49ebac-3f0d-4688-aed0-b3f5fe364000`::Disk hdc stats not available >GuestMonitor-scale_8::DEBUG::2014-07-10 09:04:08,120::vm::676::vm.Vm::(_getDiskStats) vmId=`5d49ebac-3f0d-4688-aed0-b3f5fe364000`::Disk vda stats not available >GuestMonitor-scale_8::DEBUG::2014-07-10 09:04:08,120::vm::715::vm.Vm::(_getDiskLatency) vmId=`5d49ebac-3f0d-4688-aed0-b3f5fe364000`::Disk hdd latency not available >GuestMonitor-scale_8::DEBUG::2014-07-10 09:04:08,120::vm::715::vm.Vm::(_getDiskLatency) vmId=`5d49ebac-3f0d-4688-aed0-b3f5fe364000`::Disk hdc latency not available >GuestMonitor-scale_8::DEBUG::2014-07-10 09:04:08,120::vm::715::vm.Vm::(_getDiskLatency) vmId=`5d49ebac-3f0d-4688-aed0-b3f5fe364000`::Disk vda latency not available >GuestMonitor-scale_7::DEBUG::2014-07-10 09:04:08,243::vm::676::vm.Vm::(_getDiskStats) vmId=`a766ed65-ac2e-4862-8ff0-0352480cf6f1`::Disk hdd stats not available >GuestMonitor-scale_7::DEBUG::2014-07-10 09:04:08,244::vm::676::vm.Vm::(_getDiskStats) vmId=`a766ed65-ac2e-4862-8ff0-0352480cf6f1`::Disk hdc stats not available >GuestMonitor-scale_7::DEBUG::2014-07-10 09:04:08,244::vm::676::vm.Vm::(_getDiskStats) vmId=`a766ed65-ac2e-4862-8ff0-0352480cf6f1`::Disk vda stats not available >GuestMonitor-scale_7::DEBUG::2014-07-10 09:04:08,244::vm::715::vm.Vm::(_getDiskLatency) vmId=`a766ed65-ac2e-4862-8ff0-0352480cf6f1`::Disk hdd latency not available >GuestMonitor-scale_7::DEBUG::2014-07-10 09:04:08,245::vm::715::vm.Vm::(_getDiskLatency) vmId=`a766ed65-ac2e-4862-8ff0-0352480cf6f1`::Disk hdc latency not available >GuestMonitor-scale_7::DEBUG::2014-07-10 09:04:08,245::vm::715::vm.Vm::(_getDiskLatency) vmId=`a766ed65-ac2e-4862-8ff0-0352480cf6f1`::Disk vda latency not available >GuestMonitor-scale_7::DEBUG::2014-07-10 09:04:08,245::vm::676::vm.Vm::(_getDiskStats) vmId=`a766ed65-ac2e-4862-8ff0-0352480cf6f1`::Disk hdd stats not available >GuestMonitor-scale_7::DEBUG::2014-07-10 09:04:08,245::vm::676::vm.Vm::(_getDiskStats) vmId=`a766ed65-ac2e-4862-8ff0-0352480cf6f1`::Disk hdc stats not available >GuestMonitor-scale_7::DEBUG::2014-07-10 09:04:08,246::vm::676::vm.Vm::(_getDiskStats) vmId=`a766ed65-ac2e-4862-8ff0-0352480cf6f1`::Disk vda stats not available >GuestMonitor-scale_7::DEBUG::2014-07-10 09:04:08,246::vm::715::vm.Vm::(_getDiskLatency) vmId=`a766ed65-ac2e-4862-8ff0-0352480cf6f1`::Disk hdd latency not available >GuestMonitor-scale_7::DEBUG::2014-07-10 09:04:08,246::vm::715::vm.Vm::(_getDiskLatency) vmId=`a766ed65-ac2e-4862-8ff0-0352480cf6f1`::Disk hdc latency not available >GuestMonitor-scale_7::DEBUG::2014-07-10 09:04:08,246::vm::715::vm.Vm::(_getDiskLatency) vmId=`a766ed65-ac2e-4862-8ff0-0352480cf6f1`::Disk vda latency not available >libvirtEventLoop::DEBUG::2014-07-10 09:04:08,901::vm::5176::vm.Vm::(_onLibvirtLifecycleEvent) vmId=`e2b026e7-b32b-4f60-ae2d-b588066ddfa7`::event Started detail 0 opaque None >Thread-14::DEBUG::2014-07-10 09:04:09,056::BindingXMLRPC::1067::vds::(wrapper) client [10.35.3.13]::call vmGetStats with ('62e7aad5-ff72-4fe3-830f-e7726ed4bfba',) {} >Thread-14::DEBUG::2014-07-10 09:04:09,066::vm::676::vm.Vm::(_getDiskStats) vmId=`62e7aad5-ff72-4fe3-830f-e7726ed4bfba`::Disk hdd stats not available >Thread-14::DEBUG::2014-07-10 09:04:09,072::vm::676::vm.Vm::(_getDiskStats) vmId=`62e7aad5-ff72-4fe3-830f-e7726ed4bfba`::Disk hdc stats not available >Thread-14::DEBUG::2014-07-10 09:04:09,081::vm::676::vm.Vm::(_getDiskStats) vmId=`62e7aad5-ff72-4fe3-830f-e7726ed4bfba`::Disk vda stats not available >Thread-14::DEBUG::2014-07-10 09:04:09,090::vm::715::vm.Vm::(_getDiskLatency) vmId=`62e7aad5-ff72-4fe3-830f-e7726ed4bfba`::Disk hdd latency not available >Thread-14::DEBUG::2014-07-10 09:04:09,100::vm::715::vm.Vm::(_getDiskLatency) vmId=`62e7aad5-ff72-4fe3-830f-e7726ed4bfba`::Disk hdc latency not available >Thread-14::DEBUG::2014-07-10 09:04:09,109::vm::715::vm.Vm::(_getDiskLatency) vmId=`62e7aad5-ff72-4fe3-830f-e7726ed4bfba`::Disk vda latency not available >Thread-74::DEBUG::2014-07-10 09:04:09,110::vm::5032::vm.Vm::(_getUnderlyingDriveInfo) vmId=`e2b026e7-b32b-4f60-ae2d-b588066ddfa7`::Looking for drive with attributes {'name': u'hdc', 'bootOrder': '', 'boot': [], 'readonly': True, 'address': {u'bus': u'1', u'controller': u'0', u'type': u'drive', u'target': u'0', u'unit': u'0'}, 'path': '', 'type': u'cdrom'} >Thread-74::DEBUG::2014-07-10 09:04:09,122::vm::5053::vm.Vm::(_getUnderlyingDriveInfo) vmId=`e2b026e7-b32b-4f60-ae2d-b588066ddfa7`::Matched {'name': (u'hdc', u'hdc'), 'bootOrder': ('', None), 'boot': ([], None), 'readonly': (True, True), 'address': ({u'bus': u'1', u'controller': u'0', u'type': u'drive', u'target': u'0', u'unit': u'0'}, {u'bus': u'1', u'controller': u'0', u'type': u'drive', u'target': u'0', u'unit': u'0'}), 'path': ('', ''), 'type': (u'cdrom', u'cdrom')} >Thread-14::DEBUG::2014-07-10 09:04:09,124::BindingXMLRPC::1074::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Powering up', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '16791', 'displayIp': '0', 'displayPort': u'5916', 'session': 'Unknown', 'displaySecurePort': u'5917', 'timeOffset': '0', 'hash': '773530886922036478', 'balloonInfo': {'balloon_max': '1048576', 'balloon_target': '1048576', 'balloon_cur': '1048576', 'balloon_min': '1048576'}, 'pauseCode': 'NOERR', 'clientIp': '', 'kvmEnable': 'true', 'network': {u'vnet8': {'macAddr': '00:1a:4a:de:6d:83', 'rxDropped': '0', 'rxErrors': '0', 'txDropped': '0', 'txRate': '0.0', 'rxRate': '0.0', 'txErrors': '0', 'state': 'unknown', 'speed': '1000', 'name': u'vnet8'}}, 'vmId': '62e7aad5-ff72-4fe3-830f-e7726ed4bfba', 'displayType': 'qxl', 'cpuUser': '44.02', 'disks': {u'vda': {'truesize': '1073741824', 'apparentsize': '1073741824', 'imageID': 'c01d693b-cba0-4fed-9ad7-0aaa28912a19'}, u'hdd': {'truesize': '0', 'apparentsize': '0'}, u'hdc': {'truesize': '0', 'apparentsize': '0'}}, 'monitorResponse': '0', 'statsAge': '0.84', 'elapsedTime': '22', 'vmType': 'kvm', 'cpuSys': '21.88', 'guestCPUCount': -1, 'appsList': [], 'guestIPs': ''}]} >Thread-74::DEBUG::2014-07-10 09:04:09,133::vm::5072::vm.Vm::(_getUnderlyingDriveInfo) vmId=`e2b026e7-b32b-4f60-ae2d-b588066ddfa7`::Matched {'name': (u'hdc', u'hdc'), 'bootOrder': ('', None), 'boot': ([], None), 'readonly': (True, 'True'), 'address': ({u'bus': u'1', u'controller': u'0', u'type': u'drive', u'target': u'0', u'unit': u'0'}, {u'bus': u'1', u'controller': u'0', u'type': u'drive', u'target': u'0', u'unit': u'0'}), 'path': ('', ''), 'type': (u'cdrom', 'disk')} >Thread-74::DEBUG::2014-07-10 09:04:09,169::vm::5032::vm.Vm::(_getUnderlyingDriveInfo) vmId=`e2b026e7-b32b-4f60-ae2d-b588066ddfa7`::Looking for drive with attributes {'name': u'hdd', 'bootOrder': '', 'boot': [], 'readonly': True, 'address': {u'bus': u'1', u'controller': u'0', u'type': u'drive', u'target': u'0', u'unit': u'1'}, 'path': u'/var/run/vdsm/payload/e2b026e7-b32b-4f60-ae2d-b588066ddfa7.937ae3f2c4b9ff7bf75fda2a278dad35.img', 'type': u'cdrom'} >Dummy-33::DEBUG::2014-07-10 09:04:09,178::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Thread-74::DEBUG::2014-07-10 09:04:09,184::vm::5053::vm.Vm::(_getUnderlyingDriveInfo) vmId=`e2b026e7-b32b-4f60-ae2d-b588066ddfa7`::Matched {'name': (u'hdd', u'hdd'), 'bootOrder': ('', None), 'boot': ([], None), 'readonly': (True, True), 'address': ({u'bus': u'1', u'controller': u'0', u'type': u'drive', u'target': u'0', u'unit': u'1'}, {u'bus': u'1', u'controller': u'0', u'type': u'drive', u'target': u'0', u'unit': u'1'}), 'path': (u'/var/run/vdsm/payload/e2b026e7-b32b-4f60-ae2d-b588066ddfa7.937ae3f2c4b9ff7bf75fda2a278dad35.img', '/var/run/vdsm/payload/e2b026e7-b32b-4f60-ae2d-b588066ddfa7.937ae3f2c4b9ff7bf75fda2a278dad35.img'), 'type': (u'cdrom', u'cdrom')} >Thread-74::DEBUG::2014-07-10 09:04:09,221::vm::5072::vm.Vm::(_getUnderlyingDriveInfo) vmId=`e2b026e7-b32b-4f60-ae2d-b588066ddfa7`::Matched {'name': (u'hdd', u'hdd'), 'bootOrder': ('', None), 'boot': ([], None), 'readonly': (True, 'True'), 'address': ({u'bus': u'1', u'controller': u'0', u'type': u'drive', u'target': u'0', u'unit': u'1'}, {u'bus': u'1', u'controller': u'0', u'type': u'drive', u'target': u'0', u'unit': u'1'}), 'path': (u'/var/run/vdsm/payload/e2b026e7-b32b-4f60-ae2d-b588066ddfa7.937ae3f2c4b9ff7bf75fda2a278dad35.img', '/var/run/vdsm/payload/e2b026e7-b32b-4f60-ae2d-b588066ddfa7.937ae3f2c4b9ff7bf75fda2a278dad35.img'), 'type': (u'cdrom', 'disk')} >Thread-14::DEBUG::2014-07-10 09:04:09,261::BindingXMLRPC::1067::vds::(wrapper) client [10.35.3.13]::call vmGetStats with ('5d49ebac-3f0d-4688-aed0-b3f5fe364000',) {} >Thread-74::DEBUG::2014-07-10 09:04:09,268::vm::5032::vm.Vm::(_getUnderlyingDriveInfo) vmId=`e2b026e7-b32b-4f60-ae2d-b588066ddfa7`::Looking for drive with attributes {'name': u'vda', 'bootOrder': u'1', 'boot': [<DOM Element: boot at 0x7f61982cc680>], 'readonly': False, 'address': {u'slot': u'0x06', u'bus': u'0x00', u'domain': u'0x0000', u'type': u'pci', u'function': u'0x0'}, 'path': u'/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/images/e4c65229-4247-4b33-b72a-f1d5ce72ad05/cad94284-3ca9-4c30-933d-997f4460309e', 'type': u'disk'} >Thread-14::DEBUG::2014-07-10 09:04:09,278::vm::676::vm.Vm::(_getDiskStats) vmId=`5d49ebac-3f0d-4688-aed0-b3f5fe364000`::Disk hdd stats not available >Thread-74::DEBUG::2014-07-10 09:04:09,280::vm::5053::vm.Vm::(_getUnderlyingDriveInfo) vmId=`e2b026e7-b32b-4f60-ae2d-b588066ddfa7`::Matched {'name': (u'vda', u'vda'), 'bootOrder': (u'1', u'1'), 'boot': ([<DOM Element: boot at 0x7f61982cc680>], None), 'readonly': (False, False), 'address': ({u'slot': u'0x06', u'bus': u'0x00', u'domain': u'0x0000', u'type': u'pci', u'function': u'0x0'}, {u'slot': u'0x06', u'bus': u'0x00', u'domain': u'0x0000', u'type': u'pci', u'function': u'0x0'}), 'path': (u'/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/images/e4c65229-4247-4b33-b72a-f1d5ce72ad05/cad94284-3ca9-4c30-933d-997f4460309e', '/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/images/e4c65229-4247-4b33-b72a-f1d5ce72ad05/cad94284-3ca9-4c30-933d-997f4460309e'), 'type': (u'disk', u'disk')} >Thread-14::DEBUG::2014-07-10 09:04:09,288::vm::676::vm.Vm::(_getDiskStats) vmId=`5d49ebac-3f0d-4688-aed0-b3f5fe364000`::Disk hdc stats not available >Thread-74::DEBUG::2014-07-10 09:04:09,293::vm::5072::vm.Vm::(_getUnderlyingDriveInfo) vmId=`e2b026e7-b32b-4f60-ae2d-b588066ddfa7`::Matched {'name': (u'vda', u'vda'), 'bootOrder': (u'1', u'1'), 'boot': ([<DOM Element: boot at 0x7f61982cc680>], None), 'readonly': (False, 'False'), 'address': ({u'slot': u'0x06', u'bus': u'0x00', u'domain': u'0x0000', u'type': u'pci', u'function': u'0x0'}, {u'slot': u'0x06', u'bus': u'0x00', u'domain': u'0x0000', u'type': u'pci', u'function': u'0x0'}), 'path': (u'/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/images/e4c65229-4247-4b33-b72a-f1d5ce72ad05/cad94284-3ca9-4c30-933d-997f4460309e', '/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/images/e4c65229-4247-4b33-b72a-f1d5ce72ad05/cad94284-3ca9-4c30-933d-997f4460309e'), 'type': (u'disk', 'disk')} >Thread-14::DEBUG::2014-07-10 09:04:09,299::vm::676::vm.Vm::(_getDiskStats) vmId=`5d49ebac-3f0d-4688-aed0-b3f5fe364000`::Disk vda stats not available >Thread-14::DEBUG::2014-07-10 09:04:09,312::vm::715::vm.Vm::(_getDiskLatency) vmId=`5d49ebac-3f0d-4688-aed0-b3f5fe364000`::Disk hdd latency not available >Thread-14::DEBUG::2014-07-10 09:04:09,323::vm::715::vm.Vm::(_getDiskLatency) vmId=`5d49ebac-3f0d-4688-aed0-b3f5fe364000`::Disk hdc latency not available >Thread-14::DEBUG::2014-07-10 09:04:09,334::vm::715::vm.Vm::(_getDiskLatency) vmId=`5d49ebac-3f0d-4688-aed0-b3f5fe364000`::Disk vda latency not available >Thread-14::DEBUG::2014-07-10 09:04:09,352::BindingXMLRPC::1074::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Powering up', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '16122', 'displayIp': '0', 'displayPort': u'5914', 'session': 'Unknown', 'displaySecurePort': u'5915', 'timeOffset': '0', 'hash': '8384665493346130205', 'balloonInfo': {'balloon_max': '1048576', 'balloon_target': '1048576', 'balloon_cur': '1048576', 'balloon_min': '1048576'}, 'pauseCode': 'NOERR', 'clientIp': '', 'kvmEnable': 'true', 'network': {u'vnet7': {'macAddr': '00:1a:4a:de:6d:89', 'rxDropped': '0', 'rxErrors': '0', 'txDropped': '0', 'txRate': '0.0', 'rxRate': '0.0', 'txErrors': '0', 'state': 'unknown', 'speed': '1000', 'name': u'vnet7'}}, 'vmId': '5d49ebac-3f0d-4688-aed0-b3f5fe364000', 'displayType': 'qxl', 'cpuUser': '39.02', 'disks': {u'vda': {'truesize': '1073741824', 'apparentsize': '1073741824', 'imageID': 'cfaeead2-7caa-467c-b389-c89840ae6605'}, u'hdd': {'truesize': '0', 'apparentsize': '0'}, u'hdc': {'truesize': '0', 'apparentsize': '0'}}, 'monitorResponse': '0', 'statsAge': '1.88', 'elapsedTime': '42', 'vmType': 'kvm', 'cpuSys': '4.14', 'guestCPUCount': -1, 'appsList': [], 'guestIPs': ''}]} >Thread-57::DEBUG::2014-07-10 09:04:09,431::task::595::TaskManager.Task::(_updateState) Task=`e0f8816e-b751-4438-8772-36c12c0d7d92`::moving from state init -> state preparing >Thread-57::INFO::2014-07-10 09:04:09,442::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='b6f6c0da-e67f-4902-b9ac-3069571a42fe', volUUID='c4cd1da8-05b7-45e0-80b1-1183d21443d9', options=None) >Thread-57::INFO::2014-07-10 09:04:09,455::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-57::DEBUG::2014-07-10 09:04:09,463::task::1185::TaskManager.Task::(prepare) Task=`e0f8816e-b751-4438-8772-36c12c0d7d92`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-57::DEBUG::2014-07-10 09:04:09,472::task::595::TaskManager.Task::(_updateState) Task=`e0f8816e-b751-4438-8772-36c12c0d7d92`::moving from state preparing -> state finished >Thread-57::DEBUG::2014-07-10 09:04:09,481::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-57::DEBUG::2014-07-10 09:04:09,489::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-57::DEBUG::2014-07-10 09:04:09,499::task::990::TaskManager.Task::(_decref) Task=`e0f8816e-b751-4438-8772-36c12c0d7d92`::ref 0 aborting False >Thread-67::DEBUG::2014-07-10 09:04:10,289::task::595::TaskManager.Task::(_updateState) Task=`28e58bd1-9200-45bb-9284-ff20806b917d`::moving from state init -> state preparing >Thread-67::INFO::2014-07-10 09:04:10,303::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='f30c2cb7-a43a-4bf5-82b5-cfe07336f65c', volUUID='b0fbb3c9-55af-4a3a-95ad-fc56a80b9cf5', options=None) >Thread-67::INFO::2014-07-10 09:04:10,317::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-67::DEBUG::2014-07-10 09:04:10,327::task::1185::TaskManager.Task::(prepare) Task=`28e58bd1-9200-45bb-9284-ff20806b917d`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-67::DEBUG::2014-07-10 09:04:10,338::task::595::TaskManager.Task::(_updateState) Task=`28e58bd1-9200-45bb-9284-ff20806b917d`::moving from state preparing -> state finished >Thread-67::DEBUG::2014-07-10 09:04:10,347::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-67::DEBUG::2014-07-10 09:04:10,355::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-67::DEBUG::2014-07-10 09:04:10,364::task::990::TaskManager.Task::(_decref) Task=`28e58bd1-9200-45bb-9284-ff20806b917d`::ref 0 aborting False >Thread-48::DEBUG::2014-07-10 09:04:10,440::task::595::TaskManager.Task::(_updateState) Task=`3724c408-8e2e-49dd-9ed4-6c7930409c15`::moving from state init -> state preparing >Thread-48::INFO::2014-07-10 09:04:10,455::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='0cd7d6ce-f497-4243-a690-c57744861eea', volUUID='10b6a7dd-dc6c-43fa-ba17-92e4331b0e0b', options=None) >Thread-48::INFO::2014-07-10 09:04:10,472::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-48::DEBUG::2014-07-10 09:04:10,483::task::1185::TaskManager.Task::(prepare) Task=`3724c408-8e2e-49dd-9ed4-6c7930409c15`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-48::DEBUG::2014-07-10 09:04:10,493::task::595::TaskManager.Task::(_updateState) Task=`3724c408-8e2e-49dd-9ed4-6c7930409c15`::moving from state preparing -> state finished >Thread-48::DEBUG::2014-07-10 09:04:10,505::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-48::DEBUG::2014-07-10 09:04:10,514::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-48::DEBUG::2014-07-10 09:04:10,528::task::990::TaskManager.Task::(_decref) Task=`3724c408-8e2e-49dd-9ed4-6c7930409c15`::ref 0 aborting False >Thread-74::DEBUG::2014-07-10 09:04:11,842::sampling::285::vm.Vm::(start) vmId=`e2b026e7-b32b-4f60-ae2d-b588066ddfa7`::Start statistics collection >Thread-76::DEBUG::2014-07-10 09:04:11,846::sampling::314::vm.Vm::(run) vmId=`e2b026e7-b32b-4f60-ae2d-b588066ddfa7`::Stats thread started >Thread-76::DEBUG::2014-07-10 09:04:11,859::task::595::TaskManager.Task::(_updateState) Task=`03938478-a01c-4339-afa8-525f39dfe46b`::moving from state init -> state preparing >Thread-76::INFO::2014-07-10 09:04:11,860::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='e4c65229-4247-4b33-b72a-f1d5ce72ad05', volUUID='cad94284-3ca9-4c30-933d-997f4460309e', options=None) >Thread-76::INFO::2014-07-10 09:04:11,861::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-76::DEBUG::2014-07-10 09:04:11,861::task::1185::TaskManager.Task::(prepare) Task=`03938478-a01c-4339-afa8-525f39dfe46b`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-76::DEBUG::2014-07-10 09:04:11,861::task::595::TaskManager.Task::(_updateState) Task=`03938478-a01c-4339-afa8-525f39dfe46b`::moving from state preparing -> state finished >Thread-76::DEBUG::2014-07-10 09:04:11,862::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-74::DEBUG::2014-07-10 09:04:11,862::vmChannels::198::vds::(register) Add fileno 78 to listener's channels. >Thread-76::DEBUG::2014-07-10 09:04:11,863::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-76::DEBUG::2014-07-10 09:04:11,864::task::990::TaskManager.Task::(_decref) Task=`03938478-a01c-4339-afa8-525f39dfe46b`::ref 0 aborting False >Thread-74::WARNING::2014-07-10 09:04:11,866::vm::3715::vm.Vm::(_readPauseCode) vmId=`e2b026e7-b32b-4f60-ae2d-b588066ddfa7`::_readPauseCode unsupported by libvirt vm >Dummy-33::DEBUG::2014-07-10 09:04:11,880::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 1.47732 s, 693 kB/s\n'; <rc> = 0 >Thread-74::DEBUG::2014-07-10 09:04:11,886::vm::2291::vm.Vm::(_startUnderlyingVm) vmId=`e2b026e7-b32b-4f60-ae2d-b588066ddfa7`::_ongoingCreations released >Thread-14::DEBUG::2014-07-10 09:04:12,427::BindingXMLRPC::1067::vds::(wrapper) client [10.35.3.13]::call vmGetStats with ('62e7aad5-ff72-4fe3-830f-e7726ed4bfba',) {} >Thread-14::DEBUG::2014-07-10 09:04:12,428::vm::676::vm.Vm::(_getDiskStats) vmId=`62e7aad5-ff72-4fe3-830f-e7726ed4bfba`::Disk hdd stats not available >Thread-14::DEBUG::2014-07-10 09:04:12,428::vm::676::vm.Vm::(_getDiskStats) vmId=`62e7aad5-ff72-4fe3-830f-e7726ed4bfba`::Disk hdc stats not available >Thread-14::DEBUG::2014-07-10 09:04:12,428::vm::676::vm.Vm::(_getDiskStats) vmId=`62e7aad5-ff72-4fe3-830f-e7726ed4bfba`::Disk vda stats not available >Thread-14::DEBUG::2014-07-10 09:04:12,428::vm::715::vm.Vm::(_getDiskLatency) vmId=`62e7aad5-ff72-4fe3-830f-e7726ed4bfba`::Disk hdd latency not available >Thread-14::DEBUG::2014-07-10 09:04:12,429::vm::715::vm.Vm::(_getDiskLatency) vmId=`62e7aad5-ff72-4fe3-830f-e7726ed4bfba`::Disk hdc latency not available >Thread-14::DEBUG::2014-07-10 09:04:12,429::vm::715::vm.Vm::(_getDiskLatency) vmId=`62e7aad5-ff72-4fe3-830f-e7726ed4bfba`::Disk vda latency not available >Thread-14::DEBUG::2014-07-10 09:04:12,429::BindingXMLRPC::1074::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Powering up', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '16791', 'displayIp': '0', 'displayPort': u'5916', 'session': 'Unknown', 'displaySecurePort': u'5917', 'timeOffset': '0', 'hash': '773530886922036478', 'balloonInfo': {'balloon_max': '1048576', 'balloon_target': '1048576', 'balloon_cur': '1048576', 'balloon_min': '1048576'}, 'pauseCode': 'NOERR', 'clientIp': '', 'kvmEnable': 'true', 'network': {u'vnet8': {'macAddr': '00:1a:4a:de:6d:83', 'rxDropped': '0', 'rxErrors': '0', 'txDropped': '0', 'txRate': '0.0', 'rxRate': '0.0', 'txErrors': '0', 'state': 'unknown', 'speed': '1000', 'name': u'vnet8'}}, 'vmId': '62e7aad5-ff72-4fe3-830f-e7726ed4bfba', 'displayType': 'qxl', 'cpuUser': '44.02', 'disks': {u'vda': {'truesize': '1073741824', 'apparentsize': '1073741824', 'imageID': 'c01d693b-cba0-4fed-9ad7-0aaa28912a19'}, u'hdd': {'truesize': '0', 'apparentsize': '0'}, u'hdc': {'truesize': '0', 'apparentsize': '0'}}, 'monitorResponse': '0', 'statsAge': '0.15', 'elapsedTime': '25', 'vmType': 'kvm', 'cpuSys': '21.88', 'guestCPUCount': -1, 'appsList': [], 'guestIPs': ''}]} >Thread-14::DEBUG::2014-07-10 09:04:12,434::BindingXMLRPC::1067::vds::(wrapper) client [10.35.3.13]::call vmGetStats with ('5d49ebac-3f0d-4688-aed0-b3f5fe364000',) {} >Thread-14::DEBUG::2014-07-10 09:04:12,434::vm::676::vm.Vm::(_getDiskStats) vmId=`5d49ebac-3f0d-4688-aed0-b3f5fe364000`::Disk hdd stats not available >Thread-14::DEBUG::2014-07-10 09:04:12,434::vm::676::vm.Vm::(_getDiskStats) vmId=`5d49ebac-3f0d-4688-aed0-b3f5fe364000`::Disk hdc stats not available >Thread-14::DEBUG::2014-07-10 09:04:12,434::vm::676::vm.Vm::(_getDiskStats) vmId=`5d49ebac-3f0d-4688-aed0-b3f5fe364000`::Disk vda stats not available >Thread-14::DEBUG::2014-07-10 09:04:12,434::vm::715::vm.Vm::(_getDiskLatency) vmId=`5d49ebac-3f0d-4688-aed0-b3f5fe364000`::Disk hdd latency not available >Thread-14::DEBUG::2014-07-10 09:04:12,435::vm::715::vm.Vm::(_getDiskLatency) vmId=`5d49ebac-3f0d-4688-aed0-b3f5fe364000`::Disk hdc latency not available >Thread-14::DEBUG::2014-07-10 09:04:12,435::vm::715::vm.Vm::(_getDiskLatency) vmId=`5d49ebac-3f0d-4688-aed0-b3f5fe364000`::Disk vda latency not available >Thread-14::DEBUG::2014-07-10 09:04:12,435::BindingXMLRPC::1074::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Powering up', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '16122', 'displayIp': '0', 'displayPort': u'5914', 'session': 'Unknown', 'displaySecurePort': u'5915', 'timeOffset': '0', 'hash': '8384665493346130205', 'balloonInfo': {'balloon_max': '1048576', 'balloon_target': '1048576', 'balloon_cur': '1048576', 'balloon_min': '1048576'}, 'pauseCode': 'NOERR', 'clientIp': '', 'kvmEnable': 'true', 'network': {u'vnet7': {'macAddr': '00:1a:4a:de:6d:89', 'rxDropped': '0', 'rxErrors': '0', 'txDropped': '0', 'txRate': '0.0', 'rxRate': '0.0', 'txErrors': '0', 'state': 'unknown', 'speed': '1000', 'name': u'vnet7'}}, 'vmId': '5d49ebac-3f0d-4688-aed0-b3f5fe364000', 'displayType': 'qxl', 'cpuUser': '39.02', 'disks': {u'vda': {'truesize': '1073741824', 'apparentsize': '1073741824', 'imageID': 'cfaeead2-7caa-467c-b389-c89840ae6605'}, u'hdd': {'truesize': '0', 'apparentsize': '0'}, u'hdc': {'truesize': '0', 'apparentsize': '0'}}, 'monitorResponse': '0', 'statsAge': '1.00', 'elapsedTime': '46', 'vmType': 'kvm', 'cpuSys': '4.14', 'guestCPUCount': -1, 'appsList': [], 'guestIPs': ''}]} >Thread-14::DEBUG::2014-07-10 09:04:12,439::BindingXMLRPC::1067::vds::(wrapper) client [10.35.3.13]::call vmGetStats with ('e2b026e7-b32b-4f60-ae2d-b588066ddfa7',) {} >Thread-14::DEBUG::2014-07-10 09:04:12,440::vm::598::vm.Vm::(_getCpuStats) vmId=`e2b026e7-b32b-4f60-ae2d-b588066ddfa7`::CPU stats not available: 'NoneType' object is unsubscriptable >Thread-14::DEBUG::2014-07-10 09:04:12,440::vm::654::vm.Vm::(_getNetworkStats) vmId=`e2b026e7-b32b-4f60-ae2d-b588066ddfa7`::Network stats not available >Thread-14::DEBUG::2014-07-10 09:04:12,440::vm::676::vm.Vm::(_getDiskStats) vmId=`e2b026e7-b32b-4f60-ae2d-b588066ddfa7`::Disk hdd stats not available >Thread-14::DEBUG::2014-07-10 09:04:12,440::vm::676::vm.Vm::(_getDiskStats) vmId=`e2b026e7-b32b-4f60-ae2d-b588066ddfa7`::Disk hdc stats not available >Thread-14::DEBUG::2014-07-10 09:04:12,440::vm::676::vm.Vm::(_getDiskStats) vmId=`e2b026e7-b32b-4f60-ae2d-b588066ddfa7`::Disk vda stats not available >Thread-14::DEBUG::2014-07-10 09:04:12,441::vm::715::vm.Vm::(_getDiskLatency) vmId=`e2b026e7-b32b-4f60-ae2d-b588066ddfa7`::Disk hdd latency not available >Thread-14::DEBUG::2014-07-10 09:04:12,441::vm::715::vm.Vm::(_getDiskLatency) vmId=`e2b026e7-b32b-4f60-ae2d-b588066ddfa7`::Disk hdc latency not available >Thread-14::DEBUG::2014-07-10 09:04:12,441::vm::715::vm.Vm::(_getDiskLatency) vmId=`e2b026e7-b32b-4f60-ae2d-b588066ddfa7`::Disk vda latency not available >Thread-14::DEBUG::2014-07-10 09:04:12,441::BindingXMLRPC::1074::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Powering up', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '17471', 'displayIp': '0', 'displayPort': u'5918', 'session': 'Unknown', 'displaySecurePort': u'5919', 'timeOffset': '0', 'hash': '4538504509314603229', 'balloonInfo': {'balloon_max': '1048576', 'balloon_target': '1048576', 'balloon_cur': '0', 'balloon_min': '1048576'}, 'pauseCode': 'NOERR', 'clientIp': '', 'kvmEnable': 'true', 'network': {u'vnet9': {'state': 'unknown', 'macAddr': '00:1a:4a:de:6d:82', 'speed': '1000', 'name': u'vnet9'}}, 'vmId': 'e2b026e7-b32b-4f60-ae2d-b588066ddfa7', 'displayType': 'qxl', 'cpuUser': '0.00', 'disks': {u'vda': {'truesize': '1073741824', 'apparentsize': '1073741824', 'imageID': 'e4c65229-4247-4b33-b72a-f1d5ce72ad05'}, u'hdd': {'truesize': '0', 'apparentsize': '0'}, u'hdc': {'truesize': '0', 'apparentsize': '0'}}, 'monitorResponse': '0', 'statsAge': '0.59', 'elapsedTime': '6', 'vmType': 'kvm', 'cpuSys': '0.00', 'guestCPUCount': -1, 'appsList': [], 'guestIPs': ''}]} >VM Channels Listener::DEBUG::2014-07-10 09:04:12,626::vmChannels::106::vds::(_do_add_channels) fileno 78 was added to unconnected channels. >VM Channels Listener::DEBUG::2014-07-10 09:04:12,626::vmChannels::132::vds::(_handle_unconnected) Trying to connect fileno 78. >VM Channels Listener::DEBUG::2014-07-10 09:04:12,627::guestIF::194::vm.Vm::(_connect) vmId=`e2b026e7-b32b-4f60-ae2d-b588066ddfa7`::Attempting connection to /var/lib/libvirt/qemu/channels/e2b026e7-b32b-4f60-ae2d-b588066ddfa7.com.redhat.rhevm.vdsm >VM Channels Listener::DEBUG::2014-07-10 09:04:12,627::guestIF::197::vm.Vm::(_connect) vmId=`e2b026e7-b32b-4f60-ae2d-b588066ddfa7`::Connected to /var/lib/libvirt/qemu/channels/e2b026e7-b32b-4f60-ae2d-b588066ddfa7.com.redhat.rhevm.vdsm >VM Channels Listener::DEBUG::2014-07-10 09:04:12,627::vmChannels::148::vds::(_handle_unconnected) Connecting to fileno 78 succeeded. >GuestMonitor-scale_10::DEBUG::2014-07-10 09:04:13,004::vm::598::vm.Vm::(_getCpuStats) vmId=`e2b026e7-b32b-4f60-ae2d-b588066ddfa7`::CPU stats not available: 'NoneType' object is unsubscriptable >GuestMonitor-scale_10::DEBUG::2014-07-10 09:04:13,004::vm::654::vm.Vm::(_getNetworkStats) vmId=`e2b026e7-b32b-4f60-ae2d-b588066ddfa7`::Network stats not available >GuestMonitor-scale_10::DEBUG::2014-07-10 09:04:13,004::vm::676::vm.Vm::(_getDiskStats) vmId=`e2b026e7-b32b-4f60-ae2d-b588066ddfa7`::Disk hdd stats not available >GuestMonitor-scale_10::DEBUG::2014-07-10 09:04:13,004::vm::676::vm.Vm::(_getDiskStats) vmId=`e2b026e7-b32b-4f60-ae2d-b588066ddfa7`::Disk hdc stats not available >GuestMonitor-scale_10::DEBUG::2014-07-10 09:04:13,005::vm::676::vm.Vm::(_getDiskStats) vmId=`e2b026e7-b32b-4f60-ae2d-b588066ddfa7`::Disk vda stats not available >GuestMonitor-scale_10::DEBUG::2014-07-10 09:04:13,005::vm::715::vm.Vm::(_getDiskLatency) vmId=`e2b026e7-b32b-4f60-ae2d-b588066ddfa7`::Disk hdd latency not available >GuestMonitor-scale_10::DEBUG::2014-07-10 09:04:13,005::vm::715::vm.Vm::(_getDiskLatency) vmId=`e2b026e7-b32b-4f60-ae2d-b588066ddfa7`::Disk hdc latency not available >GuestMonitor-scale_10::DEBUG::2014-07-10 09:04:13,005::vm::715::vm.Vm::(_getDiskLatency) vmId=`e2b026e7-b32b-4f60-ae2d-b588066ddfa7`::Disk vda latency not available >GuestMonitor-scale_10::DEBUG::2014-07-10 09:04:13,006::vm::598::vm.Vm::(_getCpuStats) vmId=`e2b026e7-b32b-4f60-ae2d-b588066ddfa7`::CPU stats not available: 'NoneType' object is unsubscriptable >GuestMonitor-scale_10::DEBUG::2014-07-10 09:04:13,006::vm::654::vm.Vm::(_getNetworkStats) vmId=`e2b026e7-b32b-4f60-ae2d-b588066ddfa7`::Network stats not available >GuestMonitor-scale_10::DEBUG::2014-07-10 09:04:13,006::vm::676::vm.Vm::(_getDiskStats) vmId=`e2b026e7-b32b-4f60-ae2d-b588066ddfa7`::Disk hdd stats not available >GuestMonitor-scale_10::DEBUG::2014-07-10 09:04:13,006::vm::676::vm.Vm::(_getDiskStats) vmId=`e2b026e7-b32b-4f60-ae2d-b588066ddfa7`::Disk hdc stats not available >GuestMonitor-scale_10::DEBUG::2014-07-10 09:04:13,006::vm::676::vm.Vm::(_getDiskStats) vmId=`e2b026e7-b32b-4f60-ae2d-b588066ddfa7`::Disk vda stats not available >GuestMonitor-scale_10::DEBUG::2014-07-10 09:04:13,007::vm::715::vm.Vm::(_getDiskLatency) vmId=`e2b026e7-b32b-4f60-ae2d-b588066ddfa7`::Disk hdd latency not available >GuestMonitor-scale_10::DEBUG::2014-07-10 09:04:13,007::vm::715::vm.Vm::(_getDiskLatency) vmId=`e2b026e7-b32b-4f60-ae2d-b588066ddfa7`::Disk hdc latency not available >GuestMonitor-scale_10::DEBUG::2014-07-10 09:04:13,007::vm::715::vm.Vm::(_getDiskLatency) vmId=`e2b026e7-b32b-4f60-ae2d-b588066ddfa7`::Disk vda latency not available >GuestMonitor-scale_9::DEBUG::2014-07-10 09:04:13,022::vm::676::vm.Vm::(_getDiskStats) vmId=`62e7aad5-ff72-4fe3-830f-e7726ed4bfba`::Disk hdd stats not available >GuestMonitor-scale_9::DEBUG::2014-07-10 09:04:13,023::vm::676::vm.Vm::(_getDiskStats) vmId=`62e7aad5-ff72-4fe3-830f-e7726ed4bfba`::Disk hdc stats not available >GuestMonitor-scale_9::DEBUG::2014-07-10 09:04:13,023::vm::676::vm.Vm::(_getDiskStats) vmId=`62e7aad5-ff72-4fe3-830f-e7726ed4bfba`::Disk vda stats not available >GuestMonitor-scale_9::DEBUG::2014-07-10 09:04:13,023::vm::715::vm.Vm::(_getDiskLatency) vmId=`62e7aad5-ff72-4fe3-830f-e7726ed4bfba`::Disk hdd latency not available >GuestMonitor-scale_9::DEBUG::2014-07-10 09:04:13,023::vm::715::vm.Vm::(_getDiskLatency) vmId=`62e7aad5-ff72-4fe3-830f-e7726ed4bfba`::Disk hdc latency not available >GuestMonitor-scale_9::DEBUG::2014-07-10 09:04:13,023::vm::715::vm.Vm::(_getDiskLatency) vmId=`62e7aad5-ff72-4fe3-830f-e7726ed4bfba`::Disk vda latency not available >GuestMonitor-scale_9::DEBUG::2014-07-10 09:04:13,024::vm::676::vm.Vm::(_getDiskStats) vmId=`62e7aad5-ff72-4fe3-830f-e7726ed4bfba`::Disk hdd stats not available >GuestMonitor-scale_9::DEBUG::2014-07-10 09:04:13,024::vm::676::vm.Vm::(_getDiskStats) vmId=`62e7aad5-ff72-4fe3-830f-e7726ed4bfba`::Disk hdc stats not available >GuestMonitor-scale_9::DEBUG::2014-07-10 09:04:13,024::vm::676::vm.Vm::(_getDiskStats) vmId=`62e7aad5-ff72-4fe3-830f-e7726ed4bfba`::Disk vda stats not available >GuestMonitor-scale_9::DEBUG::2014-07-10 09:04:13,024::vm::715::vm.Vm::(_getDiskLatency) vmId=`62e7aad5-ff72-4fe3-830f-e7726ed4bfba`::Disk hdd latency not available >GuestMonitor-scale_9::DEBUG::2014-07-10 09:04:13,025::vm::715::vm.Vm::(_getDiskLatency) vmId=`62e7aad5-ff72-4fe3-830f-e7726ed4bfba`::Disk hdc latency not available >GuestMonitor-scale_9::DEBUG::2014-07-10 09:04:13,025::vm::715::vm.Vm::(_getDiskLatency) vmId=`62e7aad5-ff72-4fe3-830f-e7726ed4bfba`::Disk vda latency not available >GuestMonitor-scale_8::DEBUG::2014-07-10 09:04:13,126::vm::676::vm.Vm::(_getDiskStats) vmId=`5d49ebac-3f0d-4688-aed0-b3f5fe364000`::Disk hdd stats not available >GuestMonitor-scale_8::DEBUG::2014-07-10 09:04:13,126::vm::676::vm.Vm::(_getDiskStats) vmId=`5d49ebac-3f0d-4688-aed0-b3f5fe364000`::Disk hdc stats not available >GuestMonitor-scale_8::DEBUG::2014-07-10 09:04:13,126::vm::676::vm.Vm::(_getDiskStats) vmId=`5d49ebac-3f0d-4688-aed0-b3f5fe364000`::Disk vda stats not available >GuestMonitor-scale_8::DEBUG::2014-07-10 09:04:13,127::vm::715::vm.Vm::(_getDiskLatency) vmId=`5d49ebac-3f0d-4688-aed0-b3f5fe364000`::Disk hdd latency not available >GuestMonitor-scale_8::DEBUG::2014-07-10 09:04:13,127::vm::715::vm.Vm::(_getDiskLatency) vmId=`5d49ebac-3f0d-4688-aed0-b3f5fe364000`::Disk hdc latency not available >GuestMonitor-scale_8::DEBUG::2014-07-10 09:04:13,127::vm::715::vm.Vm::(_getDiskLatency) vmId=`5d49ebac-3f0d-4688-aed0-b3f5fe364000`::Disk vda latency not available >GuestMonitor-scale_8::DEBUG::2014-07-10 09:04:13,127::vm::676::vm.Vm::(_getDiskStats) vmId=`5d49ebac-3f0d-4688-aed0-b3f5fe364000`::Disk hdd stats not available >GuestMonitor-scale_8::DEBUG::2014-07-10 09:04:13,127::vm::676::vm.Vm::(_getDiskStats) vmId=`5d49ebac-3f0d-4688-aed0-b3f5fe364000`::Disk hdc stats not available >GuestMonitor-scale_8::DEBUG::2014-07-10 09:04:13,128::vm::676::vm.Vm::(_getDiskStats) vmId=`5d49ebac-3f0d-4688-aed0-b3f5fe364000`::Disk vda stats not available >GuestMonitor-scale_8::DEBUG::2014-07-10 09:04:13,128::vm::715::vm.Vm::(_getDiskLatency) vmId=`5d49ebac-3f0d-4688-aed0-b3f5fe364000`::Disk hdd latency not available >GuestMonitor-scale_8::DEBUG::2014-07-10 09:04:13,128::vm::715::vm.Vm::(_getDiskLatency) vmId=`5d49ebac-3f0d-4688-aed0-b3f5fe364000`::Disk hdc latency not available >GuestMonitor-scale_8::DEBUG::2014-07-10 09:04:13,128::vm::715::vm.Vm::(_getDiskLatency) vmId=`5d49ebac-3f0d-4688-aed0-b3f5fe364000`::Disk vda latency not available >Dummy-33::DEBUG::2014-07-10 09:04:13,896::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:04:14,075::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.106467 s, 9.6 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 09:04:14,127::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-14::DEBUG::2014-07-10 09:04:14,128::task::595::TaskManager.Task::(_updateState) Task=`9391f3be-4bd3-4dcc-8aad-f34c1e8d7835`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 09:04:14,129::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-14::INFO::2014-07-10 09:04:14,129::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:04:14,130::task::1185::TaskManager.Task::(prepare) Task=`9391f3be-4bd3-4dcc-8aad-f34c1e8d7835`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:04:14,130::task::595::TaskManager.Task::(_updateState) Task=`9391f3be-4bd3-4dcc-8aad-f34c1e8d7835`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 09:04:14,130::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 09:04:14,130::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 09:04:14,131::task::990::TaskManager.Task::(_decref) Task=`9391f3be-4bd3-4dcc-8aad-f34c1e8d7835`::ref 0 aborting False >Thread-34::DEBUG::2014-07-10 09:04:14,175::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-34::DEBUG::2014-07-10 09:04:14,176::task::595::TaskManager.Task::(_updateState) Task=`72aa5125-a0a8-4e07-b340-ac38eded4a81`::moving from state init -> state preparing >Thread-34::INFO::2014-07-10 09:04:14,176::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-34::DEBUG::2014-07-10 09:04:14,177::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`b6077fb8-c6a3-4287-a185-8040ec36d7ba`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-10 09:04:14,177::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' for lock type 'shared' >Thread-34::DEBUG::2014-07-10 09:04:14,178::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-10 09:04:14,178::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`b6077fb8-c6a3-4287-a185-8040ec36d7ba`::Granted request >Thread-34::DEBUG::2014-07-10 09:04:14,178::task::827::TaskManager.Task::(resourceAcquired) Task=`72aa5125-a0a8-4e07-b340-ac38eded4a81`::_resourcesAcquired: Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee (shared) >Thread-34::DEBUG::2014-07-10 09:04:14,179::task::990::TaskManager.Task::(_decref) Task=`72aa5125-a0a8-4e07-b340-ac38eded4a81`::ref 1 aborting False >Thread-34::INFO::2014-07-10 09:04:14,180::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532067385344', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:04:14,180::task::1185::TaskManager.Task::(prepare) Task=`72aa5125-a0a8-4e07-b340-ac38eded4a81`::finished: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532067385344', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:04:14,181::task::595::TaskManager.Task::(_updateState) Task=`72aa5125-a0a8-4e07-b340-ac38eded4a81`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-10 09:04:14,181::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee': < ResourceRef 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-10 09:04:14,181::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-10 09:04:14,181::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' >Thread-34::DEBUG::2014-07-10 09:04:14,181::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' (0 active users) >Thread-34::DEBUG::2014-07-10 09:04:14,182::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-10 09:04:14,182::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', Clearing records. >Thread-34::DEBUG::2014-07-10 09:04:14,182::task::990::TaskManager.Task::(_decref) Task=`72aa5125-a0a8-4e07-b340-ac38eded4a81`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-07-10 09:04:14,524::guestIF::274::vm.Vm::(_handleMessage) vmId=`5d49ebac-3f0d-4688-aed0-b3f5fe364000`::username: u'None' >Thread-40::DEBUG::2014-07-10 09:04:14,867::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lion.qa.lab.tlv.redhat.com:_export_yuri2_backup2/6a70504d-00df-4869-8695-0f442053f6b6/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-40::DEBUG::2014-07-10 09:04:14,884::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n369 bytes (369 B) copied, 0.000409425 s, 901 kB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 09:04:15,523::BindingXMLRPC::1067::vds::(wrapper) client [10.35.3.13]::call vmGetStats with ('62e7aad5-ff72-4fe3-830f-e7726ed4bfba',) {} >Thread-14::DEBUG::2014-07-10 09:04:15,524::vm::676::vm.Vm::(_getDiskStats) vmId=`62e7aad5-ff72-4fe3-830f-e7726ed4bfba`::Disk hdd stats not available >Thread-14::DEBUG::2014-07-10 09:04:15,524::vm::676::vm.Vm::(_getDiskStats) vmId=`62e7aad5-ff72-4fe3-830f-e7726ed4bfba`::Disk hdc stats not available >Thread-14::DEBUG::2014-07-10 09:04:15,524::vm::676::vm.Vm::(_getDiskStats) vmId=`62e7aad5-ff72-4fe3-830f-e7726ed4bfba`::Disk vda stats not available >Thread-14::DEBUG::2014-07-10 09:04:15,524::vm::715::vm.Vm::(_getDiskLatency) vmId=`62e7aad5-ff72-4fe3-830f-e7726ed4bfba`::Disk hdd latency not available >Thread-14::DEBUG::2014-07-10 09:04:15,525::vm::715::vm.Vm::(_getDiskLatency) vmId=`62e7aad5-ff72-4fe3-830f-e7726ed4bfba`::Disk hdc latency not available >Thread-14::DEBUG::2014-07-10 09:04:15,525::vm::715::vm.Vm::(_getDiskLatency) vmId=`62e7aad5-ff72-4fe3-830f-e7726ed4bfba`::Disk vda latency not available >Thread-14::DEBUG::2014-07-10 09:04:15,525::BindingXMLRPC::1074::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Powering up', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '16791', 'displayIp': '0', 'displayPort': u'5916', 'session': 'Unknown', 'displaySecurePort': u'5917', 'timeOffset': '0', 'hash': '773530886922036478', 'balloonInfo': {'balloon_max': '1048576', 'balloon_target': '1048576', 'balloon_cur': '1048576', 'balloon_min': '1048576'}, 'pauseCode': 'NOERR', 'clientIp': '', 'kvmEnable': 'true', 'network': {u'vnet8': {'macAddr': '00:1a:4a:de:6d:83', 'rxDropped': '0', 'rxErrors': '0', 'txDropped': '0', 'txRate': '0.0', 'rxRate': '0.0', 'txErrors': '0', 'state': 'unknown', 'speed': '1000', 'name': u'vnet8'}}, 'vmId': '62e7aad5-ff72-4fe3-830f-e7726ed4bfba', 'displayType': 'qxl', 'cpuUser': '44.02', 'disks': {u'vda': {'truesize': '1073741824', 'apparentsize': '1073741824', 'imageID': 'c01d693b-cba0-4fed-9ad7-0aaa28912a19'}, u'hdd': {'truesize': '0', 'apparentsize': '0'}, u'hdc': {'truesize': '0', 'apparentsize': '0'}}, 'monitorResponse': '0', 'statsAge': '1.24', 'elapsedTime': '28', 'vmType': 'kvm', 'cpuSys': '21.88', 'guestCPUCount': -1, 'appsList': [], 'guestIPs': ''}]} >Thread-14::DEBUG::2014-07-10 09:04:15,530::BindingXMLRPC::1067::vds::(wrapper) client [10.35.3.13]::call vmGetStats with ('5d49ebac-3f0d-4688-aed0-b3f5fe364000',) {} >Thread-14::DEBUG::2014-07-10 09:04:15,530::vm::676::vm.Vm::(_getDiskStats) vmId=`5d49ebac-3f0d-4688-aed0-b3f5fe364000`::Disk hdd stats not available >Thread-14::DEBUG::2014-07-10 09:04:15,531::vm::676::vm.Vm::(_getDiskStats) vmId=`5d49ebac-3f0d-4688-aed0-b3f5fe364000`::Disk hdc stats not available >Thread-14::DEBUG::2014-07-10 09:04:15,531::vm::676::vm.Vm::(_getDiskStats) vmId=`5d49ebac-3f0d-4688-aed0-b3f5fe364000`::Disk vda stats not available >Thread-14::DEBUG::2014-07-10 09:04:15,531::vm::715::vm.Vm::(_getDiskLatency) vmId=`5d49ebac-3f0d-4688-aed0-b3f5fe364000`::Disk hdd latency not available >Thread-14::DEBUG::2014-07-10 09:04:15,531::vm::715::vm.Vm::(_getDiskLatency) vmId=`5d49ebac-3f0d-4688-aed0-b3f5fe364000`::Disk hdc latency not available >Thread-14::DEBUG::2014-07-10 09:04:15,531::vm::715::vm.Vm::(_getDiskLatency) vmId=`5d49ebac-3f0d-4688-aed0-b3f5fe364000`::Disk vda latency not available >Thread-14::DEBUG::2014-07-10 09:04:15,532::BindingXMLRPC::1074::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'username': u'None', 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': u'vm-18-116.eng.lab.tlv.redhat.com', 'pid': '16122', 'session': 'Unknown', 'displaySecurePort': u'5915', 'timeOffset': '0', 'balloonInfo': {'balloon_max': '1048576', 'balloon_target': '1048576', 'balloon_cur': '1048576', 'balloon_min': '1048576'}, 'pauseCode': 'NOERR', 'disksUsage': [{u'path': u'/', u'total': '4792987648', u'used': '1843060736', u'fs': u'ext4'}, {u'path': u'/boot', u'total': '507744256', u'used': '40272896', u'fs': u'ext4'}, {u'path': u'/home', u'total': '458985472', u'used': '10766336', u'fs': u'ext4'}], 'network': {u'vnet7': {'macAddr': '00:1a:4a:de:6d:89', 'rxDropped': '0', 'rxErrors': '0', 'txDropped': '0', 'txRate': '0.0', 'rxRate': '0.0', 'txErrors': '0', 'state': 'unknown', 'speed': '1000', 'name': u'vnet7'}}, 'vmType': 'kvm', 'guestName': u'vm-18-116.eng.lab.tlv.redhat.com', 'elapsedTime': '49', 'memoryStats': {}, 'cpuSys': '7.62', 'appsList': [u'kernel-2.6.32-431.el6', u'rhevm-guest-agent-common-1.0.9-1.el6ev'], 'guestOs': u'2.6.32-431.el6.x86_64', 'displayType': 'qxl', 'status': 'Up', 'hash': '8384665493346130205', 'lastLogin': 1404983054.5246689, 'vmId': '5d49ebac-3f0d-4688-aed0-b3f5fe364000', 'displayIp': '0', 'displayPort': u'5914', 'clientIp': '', 'kvmEnable': 'true', 'disks': {u'vda': {'truesize': '1073741824', 'apparentsize': '1073741824', 'imageID': 'cfaeead2-7caa-467c-b389-c89840ae6605'}, u'hdd': {'truesize': '0', 'apparentsize': '0'}, u'hdc': {'truesize': '0', 'apparentsize': '0'}}, 'monitorResponse': '0', 'statsAge': '0.08', 'cpuUser': '33.22', 'guestCPUCount': -1, 'guestIPs': u'10.35.18.116', 'netIfaces': [{u'hw': u'00:1a:4a:de:6d:89', u'name': u'eth0', u'inet': [u'10.35.18.116'], u'inet6': [u'fe80::21a:4aff:fede:6d89']}]}]} >Thread-14::DEBUG::2014-07-10 09:04:15,538::BindingXMLRPC::1067::vds::(wrapper) client [10.35.3.13]::call vmGetStats with ('e2b026e7-b32b-4f60-ae2d-b588066ddfa7',) {} >Thread-14::DEBUG::2014-07-10 09:04:15,539::vm::598::vm.Vm::(_getCpuStats) vmId=`e2b026e7-b32b-4f60-ae2d-b588066ddfa7`::CPU stats not available: 'NoneType' object is unsubscriptable >Thread-14::DEBUG::2014-07-10 09:04:15,539::vm::654::vm.Vm::(_getNetworkStats) vmId=`e2b026e7-b32b-4f60-ae2d-b588066ddfa7`::Network stats not available >Thread-14::DEBUG::2014-07-10 09:04:15,539::vm::676::vm.Vm::(_getDiskStats) vmId=`e2b026e7-b32b-4f60-ae2d-b588066ddfa7`::Disk hdd stats not available >Thread-14::DEBUG::2014-07-10 09:04:15,539::vm::676::vm.Vm::(_getDiskStats) vmId=`e2b026e7-b32b-4f60-ae2d-b588066ddfa7`::Disk hdc stats not available >Thread-14::DEBUG::2014-07-10 09:04:15,539::vm::676::vm.Vm::(_getDiskStats) vmId=`e2b026e7-b32b-4f60-ae2d-b588066ddfa7`::Disk vda stats not available >Thread-14::DEBUG::2014-07-10 09:04:15,540::vm::715::vm.Vm::(_getDiskLatency) vmId=`e2b026e7-b32b-4f60-ae2d-b588066ddfa7`::Disk hdd latency not available >Thread-14::DEBUG::2014-07-10 09:04:15,540::vm::715::vm.Vm::(_getDiskLatency) vmId=`e2b026e7-b32b-4f60-ae2d-b588066ddfa7`::Disk hdc latency not available >Thread-14::DEBUG::2014-07-10 09:04:15,540::vm::715::vm.Vm::(_getDiskLatency) vmId=`e2b026e7-b32b-4f60-ae2d-b588066ddfa7`::Disk vda latency not available >Thread-14::DEBUG::2014-07-10 09:04:15,540::BindingXMLRPC::1074::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Powering up', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '17471', 'displayIp': '0', 'displayPort': u'5918', 'session': 'Unknown', 'displaySecurePort': u'5919', 'timeOffset': '0', 'hash': '4538504509314603229', 'balloonInfo': {'balloon_max': '1048576', 'balloon_target': '1048576', 'balloon_cur': '0', 'balloon_min': '1048576'}, 'pauseCode': 'NOERR', 'clientIp': '', 'kvmEnable': 'true', 'network': {u'vnet9': {'state': 'unknown', 'macAddr': '00:1a:4a:de:6d:82', 'speed': '1000', 'name': u'vnet9'}}, 'vmId': 'e2b026e7-b32b-4f60-ae2d-b588066ddfa7', 'displayType': 'qxl', 'cpuUser': '0.00', 'disks': {u'vda': {'truesize': '1073741824', 'apparentsize': '1073741824', 'imageID': 'e4c65229-4247-4b33-b72a-f1d5ce72ad05'}, u'hdd': {'truesize': '0', 'apparentsize': '0'}, u'hdc': {'truesize': '0', 'apparentsize': '0'}}, 'monitorResponse': '0', 'statsAge': '1.59', 'elapsedTime': '9', 'vmType': 'kvm', 'cpuSys': '0.00', 'guestCPUCount': -1, 'appsList': [], 'guestIPs': ''}]} >Dummy-33::DEBUG::2014-07-10 09:04:16,090::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:04:16,180::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.033899 s, 30.2 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-10 09:04:17,854::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/metadata bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-10 09:04:17,884::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00120674 s, 3.4 MB/s\n'; <rc> = 0 >GuestMonitor-scale_10::DEBUG::2014-07-10 09:04:18,013::vm::598::vm.Vm::(_getCpuStats) vmId=`e2b026e7-b32b-4f60-ae2d-b588066ddfa7`::CPU stats not available: 'NoneType' object is unsubscriptable >GuestMonitor-scale_10::DEBUG::2014-07-10 09:04:18,014::vm::654::vm.Vm::(_getNetworkStats) vmId=`e2b026e7-b32b-4f60-ae2d-b588066ddfa7`::Network stats not available >GuestMonitor-scale_10::DEBUG::2014-07-10 09:04:18,014::vm::676::vm.Vm::(_getDiskStats) vmId=`e2b026e7-b32b-4f60-ae2d-b588066ddfa7`::Disk hdd stats not available >GuestMonitor-scale_10::DEBUG::2014-07-10 09:04:18,014::vm::676::vm.Vm::(_getDiskStats) vmId=`e2b026e7-b32b-4f60-ae2d-b588066ddfa7`::Disk hdc stats not available >GuestMonitor-scale_10::DEBUG::2014-07-10 09:04:18,014::vm::676::vm.Vm::(_getDiskStats) vmId=`e2b026e7-b32b-4f60-ae2d-b588066ddfa7`::Disk vda stats not available >GuestMonitor-scale_10::DEBUG::2014-07-10 09:04:18,015::vm::715::vm.Vm::(_getDiskLatency) vmId=`e2b026e7-b32b-4f60-ae2d-b588066ddfa7`::Disk hdd latency not available >GuestMonitor-scale_10::DEBUG::2014-07-10 09:04:18,015::vm::715::vm.Vm::(_getDiskLatency) vmId=`e2b026e7-b32b-4f60-ae2d-b588066ddfa7`::Disk hdc latency not available >GuestMonitor-scale_10::DEBUG::2014-07-10 09:04:18,015::vm::715::vm.Vm::(_getDiskLatency) vmId=`e2b026e7-b32b-4f60-ae2d-b588066ddfa7`::Disk vda latency not available >GuestMonitor-scale_10::DEBUG::2014-07-10 09:04:18,015::vm::598::vm.Vm::(_getCpuStats) vmId=`e2b026e7-b32b-4f60-ae2d-b588066ddfa7`::CPU stats not available: 'NoneType' object is unsubscriptable >GuestMonitor-scale_10::DEBUG::2014-07-10 09:04:18,016::vm::654::vm.Vm::(_getNetworkStats) vmId=`e2b026e7-b32b-4f60-ae2d-b588066ddfa7`::Network stats not available >GuestMonitor-scale_10::DEBUG::2014-07-10 09:04:18,016::vm::676::vm.Vm::(_getDiskStats) vmId=`e2b026e7-b32b-4f60-ae2d-b588066ddfa7`::Disk hdd stats not available >GuestMonitor-scale_10::DEBUG::2014-07-10 09:04:18,016::vm::676::vm.Vm::(_getDiskStats) vmId=`e2b026e7-b32b-4f60-ae2d-b588066ddfa7`::Disk hdc stats not available >GuestMonitor-scale_10::DEBUG::2014-07-10 09:04:18,016::vm::676::vm.Vm::(_getDiskStats) vmId=`e2b026e7-b32b-4f60-ae2d-b588066ddfa7`::Disk vda stats not available >GuestMonitor-scale_10::DEBUG::2014-07-10 09:04:18,017::vm::715::vm.Vm::(_getDiskLatency) vmId=`e2b026e7-b32b-4f60-ae2d-b588066ddfa7`::Disk hdd latency not available >GuestMonitor-scale_10::DEBUG::2014-07-10 09:04:18,017::vm::715::vm.Vm::(_getDiskLatency) vmId=`e2b026e7-b32b-4f60-ae2d-b588066ddfa7`::Disk hdc latency not available >GuestMonitor-scale_10::DEBUG::2014-07-10 09:04:18,017::vm::715::vm.Vm::(_getDiskLatency) vmId=`e2b026e7-b32b-4f60-ae2d-b588066ddfa7`::Disk vda latency not available >GuestMonitor-scale_9::DEBUG::2014-07-10 09:04:18,030::vm::676::vm.Vm::(_getDiskStats) vmId=`62e7aad5-ff72-4fe3-830f-e7726ed4bfba`::Disk hdd stats not available >GuestMonitor-scale_9::DEBUG::2014-07-10 09:04:18,031::vm::676::vm.Vm::(_getDiskStats) vmId=`62e7aad5-ff72-4fe3-830f-e7726ed4bfba`::Disk hdc stats not available >GuestMonitor-scale_9::DEBUG::2014-07-10 09:04:18,031::vm::676::vm.Vm::(_getDiskStats) vmId=`62e7aad5-ff72-4fe3-830f-e7726ed4bfba`::Disk vda stats not available >GuestMonitor-scale_9::DEBUG::2014-07-10 09:04:18,031::vm::715::vm.Vm::(_getDiskLatency) vmId=`62e7aad5-ff72-4fe3-830f-e7726ed4bfba`::Disk hdd latency not available >GuestMonitor-scale_9::DEBUG::2014-07-10 09:04:18,031::vm::715::vm.Vm::(_getDiskLatency) vmId=`62e7aad5-ff72-4fe3-830f-e7726ed4bfba`::Disk hdc latency not available >GuestMonitor-scale_9::DEBUG::2014-07-10 09:04:18,032::vm::715::vm.Vm::(_getDiskLatency) vmId=`62e7aad5-ff72-4fe3-830f-e7726ed4bfba`::Disk vda latency not available >GuestMonitor-scale_9::DEBUG::2014-07-10 09:04:18,032::vm::676::vm.Vm::(_getDiskStats) vmId=`62e7aad5-ff72-4fe3-830f-e7726ed4bfba`::Disk hdd stats not available >GuestMonitor-scale_9::DEBUG::2014-07-10 09:04:18,032::vm::676::vm.Vm::(_getDiskStats) vmId=`62e7aad5-ff72-4fe3-830f-e7726ed4bfba`::Disk hdc stats not available >GuestMonitor-scale_9::DEBUG::2014-07-10 09:04:18,033::vm::676::vm.Vm::(_getDiskStats) vmId=`62e7aad5-ff72-4fe3-830f-e7726ed4bfba`::Disk vda stats not available >GuestMonitor-scale_9::DEBUG::2014-07-10 09:04:18,033::vm::715::vm.Vm::(_getDiskLatency) vmId=`62e7aad5-ff72-4fe3-830f-e7726ed4bfba`::Disk hdd latency not available >GuestMonitor-scale_9::DEBUG::2014-07-10 09:04:18,033::vm::715::vm.Vm::(_getDiskLatency) vmId=`62e7aad5-ff72-4fe3-830f-e7726ed4bfba`::Disk hdc latency not available >GuestMonitor-scale_9::DEBUG::2014-07-10 09:04:18,033::vm::715::vm.Vm::(_getDiskLatency) vmId=`62e7aad5-ff72-4fe3-830f-e7726ed4bfba`::Disk vda latency not available >GuestMonitor-scale_8::DEBUG::2014-07-10 09:04:18,134::vm::676::vm.Vm::(_getDiskStats) vmId=`5d49ebac-3f0d-4688-aed0-b3f5fe364000`::Disk hdd stats not available >GuestMonitor-scale_8::DEBUG::2014-07-10 09:04:18,135::vm::676::vm.Vm::(_getDiskStats) vmId=`5d49ebac-3f0d-4688-aed0-b3f5fe364000`::Disk hdc stats not available >GuestMonitor-scale_8::DEBUG::2014-07-10 09:04:18,135::vm::676::vm.Vm::(_getDiskStats) vmId=`5d49ebac-3f0d-4688-aed0-b3f5fe364000`::Disk vda stats not available >GuestMonitor-scale_8::DEBUG::2014-07-10 09:04:18,135::vm::715::vm.Vm::(_getDiskLatency) vmId=`5d49ebac-3f0d-4688-aed0-b3f5fe364000`::Disk hdd latency not available >GuestMonitor-scale_8::DEBUG::2014-07-10 09:04:18,135::vm::715::vm.Vm::(_getDiskLatency) vmId=`5d49ebac-3f0d-4688-aed0-b3f5fe364000`::Disk hdc latency not available >GuestMonitor-scale_8::DEBUG::2014-07-10 09:04:18,136::vm::715::vm.Vm::(_getDiskLatency) vmId=`5d49ebac-3f0d-4688-aed0-b3f5fe364000`::Disk vda latency not available >GuestMonitor-scale_8::DEBUG::2014-07-10 09:04:18,136::vm::676::vm.Vm::(_getDiskStats) vmId=`5d49ebac-3f0d-4688-aed0-b3f5fe364000`::Disk hdd stats not available >GuestMonitor-scale_8::DEBUG::2014-07-10 09:04:18,136::vm::676::vm.Vm::(_getDiskStats) vmId=`5d49ebac-3f0d-4688-aed0-b3f5fe364000`::Disk hdc stats not available >GuestMonitor-scale_8::DEBUG::2014-07-10 09:04:18,136::vm::676::vm.Vm::(_getDiskStats) vmId=`5d49ebac-3f0d-4688-aed0-b3f5fe364000`::Disk vda stats not available >GuestMonitor-scale_8::DEBUG::2014-07-10 09:04:18,137::vm::715::vm.Vm::(_getDiskLatency) vmId=`5d49ebac-3f0d-4688-aed0-b3f5fe364000`::Disk hdd latency not available >GuestMonitor-scale_8::DEBUG::2014-07-10 09:04:18,137::vm::715::vm.Vm::(_getDiskLatency) vmId=`5d49ebac-3f0d-4688-aed0-b3f5fe364000`::Disk hdc latency not available >GuestMonitor-scale_8::DEBUG::2014-07-10 09:04:18,137::vm::715::vm.Vm::(_getDiskLatency) vmId=`5d49ebac-3f0d-4688-aed0-b3f5fe364000`::Disk vda latency not available >Dummy-33::DEBUG::2014-07-10 09:04:18,195::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:04:18,324::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0560476 s, 18.3 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 09:04:18,589::task::595::TaskManager.Task::(_updateState) Task=`049a2350-377c-4b7a-91d0-42142cf8ef31`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 09:04:18,589::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::INFO::2014-07-10 09:04:18,590::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00120674', 'lastCheck': '0.7', 'valid': True}, '6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000409425', 'lastCheck': '3.7', 'valid': True}} >Thread-14::DEBUG::2014-07-10 09:04:18,590::task::1185::TaskManager.Task::(prepare) Task=`049a2350-377c-4b7a-91d0-42142cf8ef31`::finished: {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00120674', 'lastCheck': '0.7', 'valid': True}, '6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000409425', 'lastCheck': '3.7', 'valid': True}} >Thread-14::DEBUG::2014-07-10 09:04:18,590::task::595::TaskManager.Task::(_updateState) Task=`049a2350-377c-4b7a-91d0-42142cf8ef31`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 09:04:18,590::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 09:04:18,591::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 09:04:18,591::task::990::TaskManager.Task::(_decref) Task=`049a2350-377c-4b7a-91d0-42142cf8ef31`::ref 0 aborting False >Thread-14::DEBUG::2014-07-10 09:04:18,609::vm::676::vm.Vm::(_getDiskStats) vmId=`5d49ebac-3f0d-4688-aed0-b3f5fe364000`::Disk hdd stats not available >Thread-14::DEBUG::2014-07-10 09:04:18,610::vm::676::vm.Vm::(_getDiskStats) vmId=`5d49ebac-3f0d-4688-aed0-b3f5fe364000`::Disk hdc stats not available >Thread-14::DEBUG::2014-07-10 09:04:18,610::vm::676::vm.Vm::(_getDiskStats) vmId=`5d49ebac-3f0d-4688-aed0-b3f5fe364000`::Disk vda stats not available >Thread-14::DEBUG::2014-07-10 09:04:18,610::vm::715::vm.Vm::(_getDiskLatency) vmId=`5d49ebac-3f0d-4688-aed0-b3f5fe364000`::Disk hdd latency not available >Thread-14::DEBUG::2014-07-10 09:04:18,610::vm::715::vm.Vm::(_getDiskLatency) vmId=`5d49ebac-3f0d-4688-aed0-b3f5fe364000`::Disk hdc latency not available >Thread-14::DEBUG::2014-07-10 09:04:18,611::vm::715::vm.Vm::(_getDiskLatency) vmId=`5d49ebac-3f0d-4688-aed0-b3f5fe364000`::Disk vda latency not available >Thread-14::DEBUG::2014-07-10 09:04:18,611::vm::676::vm.Vm::(_getDiskStats) vmId=`62e7aad5-ff72-4fe3-830f-e7726ed4bfba`::Disk hdd stats not available >Thread-14::DEBUG::2014-07-10 09:04:18,611::vm::676::vm.Vm::(_getDiskStats) vmId=`62e7aad5-ff72-4fe3-830f-e7726ed4bfba`::Disk hdc stats not available >Thread-14::DEBUG::2014-07-10 09:04:18,611::vm::676::vm.Vm::(_getDiskStats) vmId=`62e7aad5-ff72-4fe3-830f-e7726ed4bfba`::Disk vda stats not available >Thread-14::DEBUG::2014-07-10 09:04:18,612::vm::715::vm.Vm::(_getDiskLatency) vmId=`62e7aad5-ff72-4fe3-830f-e7726ed4bfba`::Disk hdd latency not available >Thread-14::DEBUG::2014-07-10 09:04:18,612::vm::715::vm.Vm::(_getDiskLatency) vmId=`62e7aad5-ff72-4fe3-830f-e7726ed4bfba`::Disk hdc latency not available >Thread-14::DEBUG::2014-07-10 09:04:18,612::vm::715::vm.Vm::(_getDiskLatency) vmId=`62e7aad5-ff72-4fe3-830f-e7726ed4bfba`::Disk vda latency not available >Thread-14::DEBUG::2014-07-10 09:04:18,614::vm::598::vm.Vm::(_getCpuStats) vmId=`e2b026e7-b32b-4f60-ae2d-b588066ddfa7`::CPU stats not available: 'NoneType' object is unsubscriptable >Thread-14::DEBUG::2014-07-10 09:04:18,615::vm::654::vm.Vm::(_getNetworkStats) vmId=`e2b026e7-b32b-4f60-ae2d-b588066ddfa7`::Network stats not available >Thread-14::DEBUG::2014-07-10 09:04:18,615::vm::676::vm.Vm::(_getDiskStats) vmId=`e2b026e7-b32b-4f60-ae2d-b588066ddfa7`::Disk hdd stats not available >Thread-14::DEBUG::2014-07-10 09:04:18,615::vm::676::vm.Vm::(_getDiskStats) vmId=`e2b026e7-b32b-4f60-ae2d-b588066ddfa7`::Disk hdc stats not available >Thread-14::DEBUG::2014-07-10 09:04:18,615::vm::676::vm.Vm::(_getDiskStats) vmId=`e2b026e7-b32b-4f60-ae2d-b588066ddfa7`::Disk vda stats not available >Thread-14::DEBUG::2014-07-10 09:04:18,616::vm::715::vm.Vm::(_getDiskLatency) vmId=`e2b026e7-b32b-4f60-ae2d-b588066ddfa7`::Disk hdd latency not available >Thread-14::DEBUG::2014-07-10 09:04:18,616::vm::715::vm.Vm::(_getDiskLatency) vmId=`e2b026e7-b32b-4f60-ae2d-b588066ddfa7`::Disk hdc latency not available >Thread-14::DEBUG::2014-07-10 09:04:18,616::vm::715::vm.Vm::(_getDiskLatency) vmId=`e2b026e7-b32b-4f60-ae2d-b588066ddfa7`::Disk vda latency not available >VM Channels Listener::DEBUG::2014-07-10 09:04:20,286::vmChannels::95::vds::(_handle_timeouts) Timeout on fileno 73. >Dummy-33::DEBUG::2014-07-10 09:04:20,364::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:04:20,482::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0577278 s, 17.7 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 09:04:21,733::BindingXMLRPC::1067::vds::(wrapper) client [10.35.3.13]::call vmGetStats with ('62e7aad5-ff72-4fe3-830f-e7726ed4bfba',) {} >Thread-14::DEBUG::2014-07-10 09:04:21,733::vm::676::vm.Vm::(_getDiskStats) vmId=`62e7aad5-ff72-4fe3-830f-e7726ed4bfba`::Disk hdd stats not available >Thread-14::DEBUG::2014-07-10 09:04:21,734::vm::676::vm.Vm::(_getDiskStats) vmId=`62e7aad5-ff72-4fe3-830f-e7726ed4bfba`::Disk hdc stats not available >Thread-14::DEBUG::2014-07-10 09:04:21,734::vm::676::vm.Vm::(_getDiskStats) vmId=`62e7aad5-ff72-4fe3-830f-e7726ed4bfba`::Disk vda stats not available >Thread-14::DEBUG::2014-07-10 09:04:21,734::vm::715::vm.Vm::(_getDiskLatency) vmId=`62e7aad5-ff72-4fe3-830f-e7726ed4bfba`::Disk hdd latency not available >Thread-14::DEBUG::2014-07-10 09:04:21,734::vm::715::vm.Vm::(_getDiskLatency) vmId=`62e7aad5-ff72-4fe3-830f-e7726ed4bfba`::Disk hdc latency not available >Thread-14::DEBUG::2014-07-10 09:04:21,734::vm::715::vm.Vm::(_getDiskLatency) vmId=`62e7aad5-ff72-4fe3-830f-e7726ed4bfba`::Disk vda latency not available >Thread-14::DEBUG::2014-07-10 09:04:21,735::BindingXMLRPC::1074::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Powering up', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '16791', 'displayIp': '0', 'displayPort': u'5916', 'session': 'Unknown', 'displaySecurePort': u'5917', 'timeOffset': '0', 'hash': '773530886922036478', 'balloonInfo': {'balloon_max': '1048576', 'balloon_target': '1048576', 'balloon_cur': '1048576', 'balloon_min': '1048576'}, 'pauseCode': 'NOERR', 'clientIp': '', 'kvmEnable': 'true', 'network': {u'vnet8': {'macAddr': '00:1a:4a:de:6d:83', 'rxDropped': '0', 'rxErrors': '0', 'txDropped': '0', 'txRate': '0.0', 'rxRate': '0.0', 'txErrors': '0', 'state': 'unknown', 'speed': '1000', 'name': u'vnet8'}}, 'vmId': '62e7aad5-ff72-4fe3-830f-e7726ed4bfba', 'displayType': 'qxl', 'cpuUser': '42.34', 'disks': {u'vda': {'truesize': '1073741824', 'apparentsize': '1073741824', 'imageID': 'c01d693b-cba0-4fed-9ad7-0aaa28912a19'}, u'hdd': {'truesize': '0', 'apparentsize': '0'}, u'hdc': {'truesize': '0', 'apparentsize': '0'}}, 'monitorResponse': '0', 'statsAge': '1.42', 'elapsedTime': '34', 'vmType': 'kvm', 'cpuSys': '2.58', 'guestCPUCount': -1, 'appsList': [], 'guestIPs': ''}]} >Thread-14::DEBUG::2014-07-10 09:04:21,739::BindingXMLRPC::1067::vds::(wrapper) client [10.35.3.13]::call vmGetStats with ('e2b026e7-b32b-4f60-ae2d-b588066ddfa7',) {} >Thread-14::DEBUG::2014-07-10 09:04:21,739::vm::598::vm.Vm::(_getCpuStats) vmId=`e2b026e7-b32b-4f60-ae2d-b588066ddfa7`::CPU stats not available: 'NoneType' object is unsubscriptable >Thread-14::DEBUG::2014-07-10 09:04:21,739::vm::654::vm.Vm::(_getNetworkStats) vmId=`e2b026e7-b32b-4f60-ae2d-b588066ddfa7`::Network stats not available >Thread-14::DEBUG::2014-07-10 09:04:21,740::vm::676::vm.Vm::(_getDiskStats) vmId=`e2b026e7-b32b-4f60-ae2d-b588066ddfa7`::Disk hdd stats not available >Thread-14::DEBUG::2014-07-10 09:04:21,740::vm::676::vm.Vm::(_getDiskStats) vmId=`e2b026e7-b32b-4f60-ae2d-b588066ddfa7`::Disk hdc stats not available >Thread-14::DEBUG::2014-07-10 09:04:21,740::vm::676::vm.Vm::(_getDiskStats) vmId=`e2b026e7-b32b-4f60-ae2d-b588066ddfa7`::Disk vda stats not available >Thread-14::DEBUG::2014-07-10 09:04:21,740::vm::715::vm.Vm::(_getDiskLatency) vmId=`e2b026e7-b32b-4f60-ae2d-b588066ddfa7`::Disk hdd latency not available >Thread-14::DEBUG::2014-07-10 09:04:21,740::vm::715::vm.Vm::(_getDiskLatency) vmId=`e2b026e7-b32b-4f60-ae2d-b588066ddfa7`::Disk hdc latency not available >Thread-14::DEBUG::2014-07-10 09:04:21,741::vm::715::vm.Vm::(_getDiskLatency) vmId=`e2b026e7-b32b-4f60-ae2d-b588066ddfa7`::Disk vda latency not available >Thread-14::DEBUG::2014-07-10 09:04:21,741::BindingXMLRPC::1074::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Powering up', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '17471', 'displayIp': '0', 'displayPort': u'5918', 'session': 'Unknown', 'displaySecurePort': u'5919', 'timeOffset': '0', 'hash': '4538504509314603229', 'balloonInfo': {'balloon_max': '1048576', 'balloon_target': '1048576', 'balloon_cur': '0', 'balloon_min': '1048576'}, 'pauseCode': 'NOERR', 'clientIp': '', 'kvmEnable': 'true', 'network': {u'vnet9': {'state': 'unknown', 'macAddr': '00:1a:4a:de:6d:82', 'speed': '1000', 'name': u'vnet9'}}, 'vmId': 'e2b026e7-b32b-4f60-ae2d-b588066ddfa7', 'displayType': 'qxl', 'cpuUser': '0.00', 'disks': {u'vda': {'truesize': '1073741824', 'apparentsize': '1073741824', 'imageID': 'e4c65229-4247-4b33-b72a-f1d5ce72ad05'}, u'hdd': {'truesize': '0', 'apparentsize': '0'}, u'hdc': {'truesize': '0', 'apparentsize': '0'}}, 'monitorResponse': '0', 'statsAge': '1.78', 'elapsedTime': '15', 'vmType': 'kvm', 'cpuSys': '0.00', 'guestCPUCount': -1, 'appsList': [], 'guestIPs': ''}]} >Dummy-33::DEBUG::2014-07-10 09:04:22,498::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:04:22,604::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0484519 s, 21.1 MB/s\n'; <rc> = 0 >GuestMonitor-scale_10::DEBUG::2014-07-10 09:04:23,023::vm::598::vm.Vm::(_getCpuStats) vmId=`e2b026e7-b32b-4f60-ae2d-b588066ddfa7`::CPU stats not available: 'NoneType' object is unsubscriptable >GuestMonitor-scale_10::DEBUG::2014-07-10 09:04:23,024::vm::654::vm.Vm::(_getNetworkStats) vmId=`e2b026e7-b32b-4f60-ae2d-b588066ddfa7`::Network stats not available >GuestMonitor-scale_10::DEBUG::2014-07-10 09:04:23,024::vm::676::vm.Vm::(_getDiskStats) vmId=`e2b026e7-b32b-4f60-ae2d-b588066ddfa7`::Disk hdd stats not available >GuestMonitor-scale_10::DEBUG::2014-07-10 09:04:23,024::vm::676::vm.Vm::(_getDiskStats) vmId=`e2b026e7-b32b-4f60-ae2d-b588066ddfa7`::Disk hdc stats not available >GuestMonitor-scale_10::DEBUG::2014-07-10 09:04:23,025::vm::676::vm.Vm::(_getDiskStats) vmId=`e2b026e7-b32b-4f60-ae2d-b588066ddfa7`::Disk vda stats not available >GuestMonitor-scale_10::DEBUG::2014-07-10 09:04:23,025::vm::715::vm.Vm::(_getDiskLatency) vmId=`e2b026e7-b32b-4f60-ae2d-b588066ddfa7`::Disk hdd latency not available >GuestMonitor-scale_10::DEBUG::2014-07-10 09:04:23,025::vm::715::vm.Vm::(_getDiskLatency) vmId=`e2b026e7-b32b-4f60-ae2d-b588066ddfa7`::Disk hdc latency not available >GuestMonitor-scale_10::DEBUG::2014-07-10 09:04:23,026::vm::715::vm.Vm::(_getDiskLatency) vmId=`e2b026e7-b32b-4f60-ae2d-b588066ddfa7`::Disk vda latency not available >GuestMonitor-scale_10::DEBUG::2014-07-10 09:04:23,027::vm::598::vm.Vm::(_getCpuStats) vmId=`e2b026e7-b32b-4f60-ae2d-b588066ddfa7`::CPU stats not available: 'NoneType' object is unsubscriptable >GuestMonitor-scale_10::DEBUG::2014-07-10 09:04:23,027::vm::654::vm.Vm::(_getNetworkStats) vmId=`e2b026e7-b32b-4f60-ae2d-b588066ddfa7`::Network stats not available >GuestMonitor-scale_10::DEBUG::2014-07-10 09:04:23,027::vm::676::vm.Vm::(_getDiskStats) vmId=`e2b026e7-b32b-4f60-ae2d-b588066ddfa7`::Disk hdd stats not available >GuestMonitor-scale_10::DEBUG::2014-07-10 09:04:23,028::vm::676::vm.Vm::(_getDiskStats) vmId=`e2b026e7-b32b-4f60-ae2d-b588066ddfa7`::Disk hdc stats not available >GuestMonitor-scale_10::DEBUG::2014-07-10 09:04:23,028::vm::676::vm.Vm::(_getDiskStats) vmId=`e2b026e7-b32b-4f60-ae2d-b588066ddfa7`::Disk vda stats not available >GuestMonitor-scale_10::DEBUG::2014-07-10 09:04:23,028::vm::715::vm.Vm::(_getDiskLatency) vmId=`e2b026e7-b32b-4f60-ae2d-b588066ddfa7`::Disk hdd latency not available >GuestMonitor-scale_10::DEBUG::2014-07-10 09:04:23,028::vm::715::vm.Vm::(_getDiskLatency) vmId=`e2b026e7-b32b-4f60-ae2d-b588066ddfa7`::Disk hdc latency not available >GuestMonitor-scale_10::DEBUG::2014-07-10 09:04:23,029::vm::715::vm.Vm::(_getDiskLatency) vmId=`e2b026e7-b32b-4f60-ae2d-b588066ddfa7`::Disk vda latency not available >GuestMonitor-scale_9::DEBUG::2014-07-10 09:04:23,039::vm::676::vm.Vm::(_getDiskStats) vmId=`62e7aad5-ff72-4fe3-830f-e7726ed4bfba`::Disk hdd stats not available >GuestMonitor-scale_9::DEBUG::2014-07-10 09:04:23,039::vm::676::vm.Vm::(_getDiskStats) vmId=`62e7aad5-ff72-4fe3-830f-e7726ed4bfba`::Disk hdc stats not available >GuestMonitor-scale_9::DEBUG::2014-07-10 09:04:23,039::vm::676::vm.Vm::(_getDiskStats) vmId=`62e7aad5-ff72-4fe3-830f-e7726ed4bfba`::Disk vda stats not available >GuestMonitor-scale_9::DEBUG::2014-07-10 09:04:23,040::vm::715::vm.Vm::(_getDiskLatency) vmId=`62e7aad5-ff72-4fe3-830f-e7726ed4bfba`::Disk hdd latency not available >GuestMonitor-scale_9::DEBUG::2014-07-10 09:04:23,040::vm::715::vm.Vm::(_getDiskLatency) vmId=`62e7aad5-ff72-4fe3-830f-e7726ed4bfba`::Disk hdc latency not available >GuestMonitor-scale_9::DEBUG::2014-07-10 09:04:23,040::vm::715::vm.Vm::(_getDiskLatency) vmId=`62e7aad5-ff72-4fe3-830f-e7726ed4bfba`::Disk vda latency not available >GuestMonitor-scale_9::DEBUG::2014-07-10 09:04:23,041::vm::676::vm.Vm::(_getDiskStats) vmId=`62e7aad5-ff72-4fe3-830f-e7726ed4bfba`::Disk hdd stats not available >GuestMonitor-scale_9::DEBUG::2014-07-10 09:04:23,041::vm::676::vm.Vm::(_getDiskStats) vmId=`62e7aad5-ff72-4fe3-830f-e7726ed4bfba`::Disk hdc stats not available >GuestMonitor-scale_9::DEBUG::2014-07-10 09:04:23,041::vm::676::vm.Vm::(_getDiskStats) vmId=`62e7aad5-ff72-4fe3-830f-e7726ed4bfba`::Disk vda stats not available >GuestMonitor-scale_9::DEBUG::2014-07-10 09:04:23,041::vm::715::vm.Vm::(_getDiskLatency) vmId=`62e7aad5-ff72-4fe3-830f-e7726ed4bfba`::Disk hdd latency not available >GuestMonitor-scale_9::DEBUG::2014-07-10 09:04:23,042::vm::715::vm.Vm::(_getDiskLatency) vmId=`62e7aad5-ff72-4fe3-830f-e7726ed4bfba`::Disk hdc latency not available >GuestMonitor-scale_9::DEBUG::2014-07-10 09:04:23,042::vm::715::vm.Vm::(_getDiskLatency) vmId=`62e7aad5-ff72-4fe3-830f-e7726ed4bfba`::Disk vda latency not available >GuestMonitor-scale_8::DEBUG::2014-07-10 09:04:23,139::vm::676::vm.Vm::(_getDiskStats) vmId=`5d49ebac-3f0d-4688-aed0-b3f5fe364000`::Disk hdd stats not available >GuestMonitor-scale_8::DEBUG::2014-07-10 09:04:23,139::vm::676::vm.Vm::(_getDiskStats) vmId=`5d49ebac-3f0d-4688-aed0-b3f5fe364000`::Disk hdc stats not available >GuestMonitor-scale_8::DEBUG::2014-07-10 09:04:23,140::vm::676::vm.Vm::(_getDiskStats) vmId=`5d49ebac-3f0d-4688-aed0-b3f5fe364000`::Disk vda stats not available >GuestMonitor-scale_8::DEBUG::2014-07-10 09:04:23,140::vm::715::vm.Vm::(_getDiskLatency) vmId=`5d49ebac-3f0d-4688-aed0-b3f5fe364000`::Disk hdd latency not available >GuestMonitor-scale_8::DEBUG::2014-07-10 09:04:23,140::vm::715::vm.Vm::(_getDiskLatency) vmId=`5d49ebac-3f0d-4688-aed0-b3f5fe364000`::Disk hdc latency not available >GuestMonitor-scale_8::DEBUG::2014-07-10 09:04:23,140::vm::715::vm.Vm::(_getDiskLatency) vmId=`5d49ebac-3f0d-4688-aed0-b3f5fe364000`::Disk vda latency not available >GuestMonitor-scale_8::DEBUG::2014-07-10 09:04:23,141::vm::676::vm.Vm::(_getDiskStats) vmId=`5d49ebac-3f0d-4688-aed0-b3f5fe364000`::Disk hdd stats not available >GuestMonitor-scale_8::DEBUG::2014-07-10 09:04:23,141::vm::676::vm.Vm::(_getDiskStats) vmId=`5d49ebac-3f0d-4688-aed0-b3f5fe364000`::Disk hdc stats not available >GuestMonitor-scale_8::DEBUG::2014-07-10 09:04:23,141::vm::676::vm.Vm::(_getDiskStats) vmId=`5d49ebac-3f0d-4688-aed0-b3f5fe364000`::Disk vda stats not available >GuestMonitor-scale_8::DEBUG::2014-07-10 09:04:23,142::vm::715::vm.Vm::(_getDiskLatency) vmId=`5d49ebac-3f0d-4688-aed0-b3f5fe364000`::Disk hdd latency not available >GuestMonitor-scale_8::DEBUG::2014-07-10 09:04:23,142::vm::715::vm.Vm::(_getDiskLatency) vmId=`5d49ebac-3f0d-4688-aed0-b3f5fe364000`::Disk hdc latency not available >GuestMonitor-scale_8::DEBUG::2014-07-10 09:04:23,142::vm::715::vm.Vm::(_getDiskLatency) vmId=`5d49ebac-3f0d-4688-aed0-b3f5fe364000`::Disk vda latency not available >Thread-14::DEBUG::2014-07-10 09:04:24,227::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-14::DEBUG::2014-07-10 09:04:24,228::task::595::TaskManager.Task::(_updateState) Task=`9fe6f187-e1df-4215-8fb4-1b2454b64836`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 09:04:24,229::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-14::INFO::2014-07-10 09:04:24,229::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:04:24,230::task::1185::TaskManager.Task::(prepare) Task=`9fe6f187-e1df-4215-8fb4-1b2454b64836`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:04:24,230::task::595::TaskManager.Task::(_updateState) Task=`9fe6f187-e1df-4215-8fb4-1b2454b64836`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 09:04:24,230::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 09:04:24,230::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 09:04:24,230::task::990::TaskManager.Task::(_decref) Task=`9fe6f187-e1df-4215-8fb4-1b2454b64836`::ref 0 aborting False >Thread-34::DEBUG::2014-07-10 09:04:24,235::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-34::DEBUG::2014-07-10 09:04:24,235::task::595::TaskManager.Task::(_updateState) Task=`53c8e781-4dd6-4c0e-8216-b3aa7b00709b`::moving from state init -> state preparing >Thread-34::INFO::2014-07-10 09:04:24,235::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-34::DEBUG::2014-07-10 09:04:24,236::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`e81dd33a-93ed-49e3-9d86-0f9712b864fb`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-10 09:04:24,236::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' for lock type 'shared' >Thread-34::DEBUG::2014-07-10 09:04:24,236::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-10 09:04:24,237::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`e81dd33a-93ed-49e3-9d86-0f9712b864fb`::Granted request >Thread-34::DEBUG::2014-07-10 09:04:24,237::task::827::TaskManager.Task::(resourceAcquired) Task=`53c8e781-4dd6-4c0e-8216-b3aa7b00709b`::_resourcesAcquired: Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee (shared) >Thread-34::DEBUG::2014-07-10 09:04:24,237::task::990::TaskManager.Task::(_decref) Task=`53c8e781-4dd6-4c0e-8216-b3aa7b00709b`::ref 1 aborting False >Thread-34::INFO::2014-07-10 09:04:24,238::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532067385344', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:04:24,239::task::1185::TaskManager.Task::(prepare) Task=`53c8e781-4dd6-4c0e-8216-b3aa7b00709b`::finished: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532067385344', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:04:24,239::task::595::TaskManager.Task::(_updateState) Task=`53c8e781-4dd6-4c0e-8216-b3aa7b00709b`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-10 09:04:24,239::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee': < ResourceRef 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-10 09:04:24,239::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-10 09:04:24,239::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' >Thread-34::DEBUG::2014-07-10 09:04:24,240::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' (0 active users) >Thread-34::DEBUG::2014-07-10 09:04:24,240::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-10 09:04:24,240::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', Clearing records. >Thread-34::DEBUG::2014-07-10 09:04:24,240::task::990::TaskManager.Task::(_decref) Task=`53c8e781-4dd6-4c0e-8216-b3aa7b00709b`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 09:04:24,620::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:04:24,735::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0581093 s, 17.6 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 09:04:24,757::BindingXMLRPC::1067::vds::(wrapper) client [10.35.3.13]::call vmGetStats with ('62e7aad5-ff72-4fe3-830f-e7726ed4bfba',) {} >Thread-14::DEBUG::2014-07-10 09:04:24,757::vm::676::vm.Vm::(_getDiskStats) vmId=`62e7aad5-ff72-4fe3-830f-e7726ed4bfba`::Disk hdd stats not available >Thread-14::DEBUG::2014-07-10 09:04:24,758::vm::676::vm.Vm::(_getDiskStats) vmId=`62e7aad5-ff72-4fe3-830f-e7726ed4bfba`::Disk hdc stats not available >Thread-14::DEBUG::2014-07-10 09:04:24,758::vm::676::vm.Vm::(_getDiskStats) vmId=`62e7aad5-ff72-4fe3-830f-e7726ed4bfba`::Disk vda stats not available >Thread-14::DEBUG::2014-07-10 09:04:24,758::vm::715::vm.Vm::(_getDiskLatency) vmId=`62e7aad5-ff72-4fe3-830f-e7726ed4bfba`::Disk hdd latency not available >Thread-14::DEBUG::2014-07-10 09:04:24,758::vm::715::vm.Vm::(_getDiskLatency) vmId=`62e7aad5-ff72-4fe3-830f-e7726ed4bfba`::Disk hdc latency not available >Thread-14::DEBUG::2014-07-10 09:04:24,759::vm::715::vm.Vm::(_getDiskLatency) vmId=`62e7aad5-ff72-4fe3-830f-e7726ed4bfba`::Disk vda latency not available >Thread-14::DEBUG::2014-07-10 09:04:24,759::BindingXMLRPC::1074::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Powering up', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '16791', 'displayIp': '0', 'displayPort': u'5916', 'session': 'Unknown', 'displaySecurePort': u'5917', 'timeOffset': '0', 'hash': '773530886922036478', 'balloonInfo': {'balloon_max': '1048576', 'balloon_target': '1048576', 'balloon_cur': '1048576', 'balloon_min': '1048576'}, 'pauseCode': 'NOERR', 'clientIp': '', 'kvmEnable': 'true', 'network': {u'vnet8': {'macAddr': '00:1a:4a:de:6d:83', 'rxDropped': '0', 'rxErrors': '0', 'txDropped': '0', 'txRate': '0.0', 'rxRate': '0.0', 'txErrors': '0', 'state': 'unknown', 'speed': '1000', 'name': u'vnet8'}}, 'vmId': '62e7aad5-ff72-4fe3-830f-e7726ed4bfba', 'displayType': 'qxl', 'cpuUser': '42.34', 'disks': {u'vda': {'truesize': '1073741824', 'apparentsize': '1073741824', 'imageID': 'c01d693b-cba0-4fed-9ad7-0aaa28912a19'}, u'hdd': {'truesize': '0', 'apparentsize': '0'}, u'hdc': {'truesize': '0', 'apparentsize': '0'}}, 'monitorResponse': '0', 'statsAge': '0.41', 'elapsedTime': '37', 'vmType': 'kvm', 'cpuSys': '2.58', 'guestCPUCount': -1, 'appsList': [], 'guestIPs': ''}]} >Thread-14::DEBUG::2014-07-10 09:04:24,764::BindingXMLRPC::1067::vds::(wrapper) client [10.35.3.13]::call vmGetStats with ('e2b026e7-b32b-4f60-ae2d-b588066ddfa7',) {} >Thread-14::DEBUG::2014-07-10 09:04:24,765::vm::598::vm.Vm::(_getCpuStats) vmId=`e2b026e7-b32b-4f60-ae2d-b588066ddfa7`::CPU stats not available: 'NoneType' object is unsubscriptable >Thread-14::DEBUG::2014-07-10 09:04:24,765::vm::654::vm.Vm::(_getNetworkStats) vmId=`e2b026e7-b32b-4f60-ae2d-b588066ddfa7`::Network stats not available >Thread-14::DEBUG::2014-07-10 09:04:24,765::vm::676::vm.Vm::(_getDiskStats) vmId=`e2b026e7-b32b-4f60-ae2d-b588066ddfa7`::Disk hdd stats not available >Thread-14::DEBUG::2014-07-10 09:04:24,766::vm::676::vm.Vm::(_getDiskStats) vmId=`e2b026e7-b32b-4f60-ae2d-b588066ddfa7`::Disk hdc stats not available >Thread-14::DEBUG::2014-07-10 09:04:24,766::vm::676::vm.Vm::(_getDiskStats) vmId=`e2b026e7-b32b-4f60-ae2d-b588066ddfa7`::Disk vda stats not available >Thread-14::DEBUG::2014-07-10 09:04:24,766::vm::715::vm.Vm::(_getDiskLatency) vmId=`e2b026e7-b32b-4f60-ae2d-b588066ddfa7`::Disk hdd latency not available >Thread-14::DEBUG::2014-07-10 09:04:24,766::vm::715::vm.Vm::(_getDiskLatency) vmId=`e2b026e7-b32b-4f60-ae2d-b588066ddfa7`::Disk hdc latency not available >Thread-14::DEBUG::2014-07-10 09:04:24,767::vm::715::vm.Vm::(_getDiskLatency) vmId=`e2b026e7-b32b-4f60-ae2d-b588066ddfa7`::Disk vda latency not available >Thread-14::DEBUG::2014-07-10 09:04:24,767::BindingXMLRPC::1074::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Powering up', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '17471', 'displayIp': '0', 'displayPort': u'5918', 'session': 'Unknown', 'displaySecurePort': u'5919', 'timeOffset': '0', 'hash': '4538504509314603229', 'balloonInfo': {'balloon_max': '1048576', 'balloon_target': '1048576', 'balloon_cur': '0', 'balloon_min': '1048576'}, 'pauseCode': 'NOERR', 'clientIp': '', 'kvmEnable': 'true', 'network': {u'vnet9': {'state': 'unknown', 'macAddr': '00:1a:4a:de:6d:82', 'speed': '1000', 'name': u'vnet9'}}, 'vmId': 'e2b026e7-b32b-4f60-ae2d-b588066ddfa7', 'displayType': 'qxl', 'cpuUser': '0.00', 'disks': {u'vda': {'truesize': '1073741824', 'apparentsize': '1073741824', 'imageID': 'e4c65229-4247-4b33-b72a-f1d5ce72ad05'}, u'hdd': {'truesize': '0', 'apparentsize': '0'}, u'hdc': {'truesize': '0', 'apparentsize': '0'}}, 'monitorResponse': '0', 'statsAge': '0.79', 'elapsedTime': '18', 'vmType': 'kvm', 'cpuSys': '0.00', 'guestCPUCount': -1, 'appsList': [], 'guestIPs': ''}]} >Thread-40::DEBUG::2014-07-10 09:04:24,914::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lion.qa.lab.tlv.redhat.com:_export_yuri2_backup2/6a70504d-00df-4869-8695-0f442053f6b6/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-40::DEBUG::2014-07-10 09:04:24,933::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n369 bytes (369 B) copied, 0.000503213 s, 733 kB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:04:26,750::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:04:26,858::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0545294 s, 18.8 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 09:04:27,781::BindingXMLRPC::1067::vds::(wrapper) client [10.35.3.13]::call vmGetStats with ('62e7aad5-ff72-4fe3-830f-e7726ed4bfba',) {} >Thread-14::DEBUG::2014-07-10 09:04:27,782::vm::676::vm.Vm::(_getDiskStats) vmId=`62e7aad5-ff72-4fe3-830f-e7726ed4bfba`::Disk hdd stats not available >Thread-14::DEBUG::2014-07-10 09:04:27,782::vm::676::vm.Vm::(_getDiskStats) vmId=`62e7aad5-ff72-4fe3-830f-e7726ed4bfba`::Disk hdc stats not available >Thread-14::DEBUG::2014-07-10 09:04:27,783::vm::676::vm.Vm::(_getDiskStats) vmId=`62e7aad5-ff72-4fe3-830f-e7726ed4bfba`::Disk vda stats not available >Thread-14::DEBUG::2014-07-10 09:04:27,783::vm::715::vm.Vm::(_getDiskLatency) vmId=`62e7aad5-ff72-4fe3-830f-e7726ed4bfba`::Disk hdd latency not available >Thread-14::DEBUG::2014-07-10 09:04:27,783::vm::715::vm.Vm::(_getDiskLatency) vmId=`62e7aad5-ff72-4fe3-830f-e7726ed4bfba`::Disk hdc latency not available >Thread-14::DEBUG::2014-07-10 09:04:27,783::vm::715::vm.Vm::(_getDiskLatency) vmId=`62e7aad5-ff72-4fe3-830f-e7726ed4bfba`::Disk vda latency not available >Thread-14::DEBUG::2014-07-10 09:04:27,784::BindingXMLRPC::1074::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Powering up', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '16791', 'displayIp': '0', 'displayPort': u'5916', 'session': 'Unknown', 'displaySecurePort': u'5917', 'timeOffset': '0', 'hash': '773530886922036478', 'balloonInfo': {'balloon_max': '1048576', 'balloon_target': '1048576', 'balloon_cur': '1048576', 'balloon_min': '1048576'}, 'pauseCode': 'NOERR', 'clientIp': '', 'kvmEnable': 'true', 'network': {u'vnet8': {'macAddr': '00:1a:4a:de:6d:83', 'rxDropped': '0', 'rxErrors': '0', 'txDropped': '0', 'txRate': '0.0', 'rxRate': '0.0', 'txErrors': '0', 'state': 'unknown', 'speed': '1000', 'name': u'vnet8'}}, 'vmId': '62e7aad5-ff72-4fe3-830f-e7726ed4bfba', 'displayType': 'qxl', 'cpuUser': '42.34', 'disks': {u'vda': {'truesize': '1073741824', 'apparentsize': '1073741824', 'imageID': 'c01d693b-cba0-4fed-9ad7-0aaa28912a19'}, u'hdd': {'truesize': '0', 'apparentsize': '0'}, u'hdc': {'truesize': '0', 'apparentsize': '0'}}, 'monitorResponse': '0', 'statsAge': '1.43', 'elapsedTime': '40', 'vmType': 'kvm', 'cpuSys': '2.58', 'guestCPUCount': -1, 'appsList': [], 'guestIPs': ''}]} >Thread-14::DEBUG::2014-07-10 09:04:27,788::BindingXMLRPC::1067::vds::(wrapper) client [10.35.3.13]::call vmGetStats with ('e2b026e7-b32b-4f60-ae2d-b588066ddfa7',) {} >Thread-14::DEBUG::2014-07-10 09:04:27,788::vm::676::vm.Vm::(_getDiskStats) vmId=`e2b026e7-b32b-4f60-ae2d-b588066ddfa7`::Disk hdd stats not available >Thread-14::DEBUG::2014-07-10 09:04:27,789::vm::676::vm.Vm::(_getDiskStats) vmId=`e2b026e7-b32b-4f60-ae2d-b588066ddfa7`::Disk hdc stats not available >Thread-14::DEBUG::2014-07-10 09:04:27,789::vm::676::vm.Vm::(_getDiskStats) vmId=`e2b026e7-b32b-4f60-ae2d-b588066ddfa7`::Disk vda stats not available >Thread-14::DEBUG::2014-07-10 09:04:27,789::vm::715::vm.Vm::(_getDiskLatency) vmId=`e2b026e7-b32b-4f60-ae2d-b588066ddfa7`::Disk hdd latency not available >Thread-14::DEBUG::2014-07-10 09:04:27,789::vm::715::vm.Vm::(_getDiskLatency) vmId=`e2b026e7-b32b-4f60-ae2d-b588066ddfa7`::Disk hdc latency not available >Thread-14::DEBUG::2014-07-10 09:04:27,789::vm::715::vm.Vm::(_getDiskLatency) vmId=`e2b026e7-b32b-4f60-ae2d-b588066ddfa7`::Disk vda latency not available >Thread-14::DEBUG::2014-07-10 09:04:27,790::BindingXMLRPC::1074::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Powering up', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '17471', 'displayIp': '0', 'displayPort': u'5918', 'session': 'Unknown', 'displaySecurePort': u'5919', 'timeOffset': '0', 'hash': '4538504509314603229', 'balloonInfo': {'balloon_max': '1048576', 'balloon_target': '1048576', 'balloon_cur': '1048576', 'balloon_min': '1048576'}, 'pauseCode': 'NOERR', 'clientIp': '', 'kvmEnable': 'true', 'network': {u'vnet9': {'macAddr': '00:1a:4a:de:6d:82', 'rxDropped': '0', 'rxErrors': '0', 'txDropped': '0', 'txRate': '0.0', 'rxRate': '0.0', 'txErrors': '0', 'state': 'unknown', 'speed': '1000', 'name': u'vnet9'}}, 'vmId': 'e2b026e7-b32b-4f60-ae2d-b588066ddfa7', 'displayType': 'qxl', 'cpuUser': '48.86', 'disks': {u'vda': {'truesize': '1073741824', 'apparentsize': '1073741824', 'imageID': 'e4c65229-4247-4b33-b72a-f1d5ce72ad05'}, u'hdd': {'truesize': '0', 'apparentsize': '0'}, u'hdc': {'truesize': '0', 'apparentsize': '0'}}, 'monitorResponse': '0', 'statsAge': '0.80', 'elapsedTime': '21', 'vmType': 'kvm', 'cpuSys': '21.09', 'guestCPUCount': -1, 'appsList': [], 'guestIPs': ''}]} >Thread-18::DEBUG::2014-07-10 09:04:27,917::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/metadata bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-10 09:04:27,939::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000479555 s, 8.5 MB/s\n'; <rc> = 0 >GuestMonitor-scale_10::DEBUG::2014-07-10 09:04:28,035::vm::676::vm.Vm::(_getDiskStats) vmId=`e2b026e7-b32b-4f60-ae2d-b588066ddfa7`::Disk hdd stats not available >GuestMonitor-scale_10::DEBUG::2014-07-10 09:04:28,035::vm::676::vm.Vm::(_getDiskStats) vmId=`e2b026e7-b32b-4f60-ae2d-b588066ddfa7`::Disk hdc stats not available >GuestMonitor-scale_10::DEBUG::2014-07-10 09:04:28,035::vm::676::vm.Vm::(_getDiskStats) vmId=`e2b026e7-b32b-4f60-ae2d-b588066ddfa7`::Disk vda stats not available >GuestMonitor-scale_10::DEBUG::2014-07-10 09:04:28,038::vm::715::vm.Vm::(_getDiskLatency) vmId=`e2b026e7-b32b-4f60-ae2d-b588066ddfa7`::Disk hdd latency not available >GuestMonitor-scale_10::DEBUG::2014-07-10 09:04:28,040::vm::715::vm.Vm::(_getDiskLatency) vmId=`e2b026e7-b32b-4f60-ae2d-b588066ddfa7`::Disk hdc latency not available >GuestMonitor-scale_10::DEBUG::2014-07-10 09:04:28,041::vm::715::vm.Vm::(_getDiskLatency) vmId=`e2b026e7-b32b-4f60-ae2d-b588066ddfa7`::Disk vda latency not available >GuestMonitor-scale_10::DEBUG::2014-07-10 09:04:28,044::vm::676::vm.Vm::(_getDiskStats) vmId=`e2b026e7-b32b-4f60-ae2d-b588066ddfa7`::Disk hdd stats not available >GuestMonitor-scale_10::DEBUG::2014-07-10 09:04:28,045::vm::676::vm.Vm::(_getDiskStats) vmId=`e2b026e7-b32b-4f60-ae2d-b588066ddfa7`::Disk hdc stats not available >GuestMonitor-scale_10::DEBUG::2014-07-10 09:04:28,047::vm::676::vm.Vm::(_getDiskStats) vmId=`e2b026e7-b32b-4f60-ae2d-b588066ddfa7`::Disk vda stats not available >GuestMonitor-scale_10::DEBUG::2014-07-10 09:04:28,050::vm::715::vm.Vm::(_getDiskLatency) vmId=`e2b026e7-b32b-4f60-ae2d-b588066ddfa7`::Disk hdd latency not available >GuestMonitor-scale_9::DEBUG::2014-07-10 09:04:28,050::vm::676::vm.Vm::(_getDiskStats) vmId=`62e7aad5-ff72-4fe3-830f-e7726ed4bfba`::Disk hdd stats not available >GuestMonitor-scale_10::DEBUG::2014-07-10 09:04:28,053::vm::715::vm.Vm::(_getDiskLatency) vmId=`e2b026e7-b32b-4f60-ae2d-b588066ddfa7`::Disk hdc latency not available >GuestMonitor-scale_9::DEBUG::2014-07-10 09:04:28,053::vm::676::vm.Vm::(_getDiskStats) vmId=`62e7aad5-ff72-4fe3-830f-e7726ed4bfba`::Disk hdc stats not available >GuestMonitor-scale_10::DEBUG::2014-07-10 09:04:28,058::vm::715::vm.Vm::(_getDiskLatency) vmId=`e2b026e7-b32b-4f60-ae2d-b588066ddfa7`::Disk vda latency not available >GuestMonitor-scale_9::DEBUG::2014-07-10 09:04:28,059::vm::676::vm.Vm::(_getDiskStats) vmId=`62e7aad5-ff72-4fe3-830f-e7726ed4bfba`::Disk vda stats not available >GuestMonitor-scale_9::DEBUG::2014-07-10 09:04:28,061::vm::715::vm.Vm::(_getDiskLatency) vmId=`62e7aad5-ff72-4fe3-830f-e7726ed4bfba`::Disk hdd latency not available >GuestMonitor-scale_9::DEBUG::2014-07-10 09:04:28,063::vm::715::vm.Vm::(_getDiskLatency) vmId=`62e7aad5-ff72-4fe3-830f-e7726ed4bfba`::Disk hdc latency not available >GuestMonitor-scale_9::DEBUG::2014-07-10 09:04:28,063::vm::715::vm.Vm::(_getDiskLatency) vmId=`62e7aad5-ff72-4fe3-830f-e7726ed4bfba`::Disk vda latency not available >GuestMonitor-scale_9::DEBUG::2014-07-10 09:04:28,064::vm::676::vm.Vm::(_getDiskStats) vmId=`62e7aad5-ff72-4fe3-830f-e7726ed4bfba`::Disk hdd stats not available >GuestMonitor-scale_9::DEBUG::2014-07-10 09:04:28,064::vm::676::vm.Vm::(_getDiskStats) vmId=`62e7aad5-ff72-4fe3-830f-e7726ed4bfba`::Disk hdc stats not available >GuestMonitor-scale_9::DEBUG::2014-07-10 09:04:28,064::vm::676::vm.Vm::(_getDiskStats) vmId=`62e7aad5-ff72-4fe3-830f-e7726ed4bfba`::Disk vda stats not available >GuestMonitor-scale_9::DEBUG::2014-07-10 09:04:28,065::vm::715::vm.Vm::(_getDiskLatency) vmId=`62e7aad5-ff72-4fe3-830f-e7726ed4bfba`::Disk hdd latency not available >GuestMonitor-scale_9::DEBUG::2014-07-10 09:04:28,065::vm::715::vm.Vm::(_getDiskLatency) vmId=`62e7aad5-ff72-4fe3-830f-e7726ed4bfba`::Disk hdc latency not available >GuestMonitor-scale_9::DEBUG::2014-07-10 09:04:28,065::vm::715::vm.Vm::(_getDiskLatency) vmId=`62e7aad5-ff72-4fe3-830f-e7726ed4bfba`::Disk vda latency not available >GuestMonitor-scale_8::DEBUG::2014-07-10 09:04:28,148::vm::676::vm.Vm::(_getDiskStats) vmId=`5d49ebac-3f0d-4688-aed0-b3f5fe364000`::Disk hdd stats not available >GuestMonitor-scale_8::DEBUG::2014-07-10 09:04:28,149::vm::676::vm.Vm::(_getDiskStats) vmId=`5d49ebac-3f0d-4688-aed0-b3f5fe364000`::Disk hdc stats not available >GuestMonitor-scale_8::DEBUG::2014-07-10 09:04:28,149::vm::676::vm.Vm::(_getDiskStats) vmId=`5d49ebac-3f0d-4688-aed0-b3f5fe364000`::Disk vda stats not available >GuestMonitor-scale_8::DEBUG::2014-07-10 09:04:28,149::vm::715::vm.Vm::(_getDiskLatency) vmId=`5d49ebac-3f0d-4688-aed0-b3f5fe364000`::Disk hdd latency not available >GuestMonitor-scale_8::DEBUG::2014-07-10 09:04:28,149::vm::715::vm.Vm::(_getDiskLatency) vmId=`5d49ebac-3f0d-4688-aed0-b3f5fe364000`::Disk hdc latency not available >GuestMonitor-scale_8::DEBUG::2014-07-10 09:04:28,150::vm::715::vm.Vm::(_getDiskLatency) vmId=`5d49ebac-3f0d-4688-aed0-b3f5fe364000`::Disk vda latency not available >GuestMonitor-scale_8::DEBUG::2014-07-10 09:04:28,150::vm::676::vm.Vm::(_getDiskStats) vmId=`5d49ebac-3f0d-4688-aed0-b3f5fe364000`::Disk hdd stats not available >GuestMonitor-scale_8::DEBUG::2014-07-10 09:04:28,150::vm::676::vm.Vm::(_getDiskStats) vmId=`5d49ebac-3f0d-4688-aed0-b3f5fe364000`::Disk hdc stats not available >GuestMonitor-scale_8::DEBUG::2014-07-10 09:04:28,151::vm::676::vm.Vm::(_getDiskStats) vmId=`5d49ebac-3f0d-4688-aed0-b3f5fe364000`::Disk vda stats not available >GuestMonitor-scale_8::DEBUG::2014-07-10 09:04:28,151::vm::715::vm.Vm::(_getDiskLatency) vmId=`5d49ebac-3f0d-4688-aed0-b3f5fe364000`::Disk hdd latency not available >GuestMonitor-scale_8::DEBUG::2014-07-10 09:04:28,151::vm::715::vm.Vm::(_getDiskLatency) vmId=`5d49ebac-3f0d-4688-aed0-b3f5fe364000`::Disk hdc latency not available >GuestMonitor-scale_8::DEBUG::2014-07-10 09:04:28,151::vm::715::vm.Vm::(_getDiskLatency) vmId=`5d49ebac-3f0d-4688-aed0-b3f5fe364000`::Disk vda latency not available >Dummy-33::DEBUG::2014-07-10 09:04:28,868::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:04:28,982::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0430157 s, 23.8 MB/s\n'; <rc> = 0 >Thread-70::DEBUG::2014-07-10 09:04:29,506::task::595::TaskManager.Task::(_updateState) Task=`bb4065fb-ec51-4007-b2e9-b678d060f0aa`::moving from state init -> state preparing >Thread-70::INFO::2014-07-10 09:04:29,507::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='cfaeead2-7caa-467c-b389-c89840ae6605', volUUID='567fe32d-31a6-4ff6-90f3-fd6a656fbecc', options=None) >Thread-70::INFO::2014-07-10 09:04:29,507::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-70::DEBUG::2014-07-10 09:04:29,507::task::1185::TaskManager.Task::(prepare) Task=`bb4065fb-ec51-4007-b2e9-b678d060f0aa`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-70::DEBUG::2014-07-10 09:04:29,508::task::595::TaskManager.Task::(_updateState) Task=`bb4065fb-ec51-4007-b2e9-b678d060f0aa`::moving from state preparing -> state finished >Thread-70::DEBUG::2014-07-10 09:04:29,508::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-70::DEBUG::2014-07-10 09:04:29,508::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-70::DEBUG::2014-07-10 09:04:29,508::task::990::TaskManager.Task::(_decref) Task=`bb4065fb-ec51-4007-b2e9-b678d060f0aa`::ref 0 aborting False >Thread-60::DEBUG::2014-07-10 09:04:30,367::task::595::TaskManager.Task::(_updateState) Task=`a987adc4-18f1-4c98-90bd-e6a9232387a3`::moving from state init -> state preparing >Thread-60::INFO::2014-07-10 09:04:30,368::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='b034d5b0-e1e0-4011-b49b-4d45ddb11556', volUUID='3d7f62b5-328f-4d8e-8b69-873cfb5ae14d', options=None) >Thread-60::INFO::2014-07-10 09:04:30,369::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-60::DEBUG::2014-07-10 09:04:30,369::task::1185::TaskManager.Task::(prepare) Task=`a987adc4-18f1-4c98-90bd-e6a9232387a3`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-60::DEBUG::2014-07-10 09:04:30,369::task::595::TaskManager.Task::(_updateState) Task=`a987adc4-18f1-4c98-90bd-e6a9232387a3`::moving from state preparing -> state finished >Thread-60::DEBUG::2014-07-10 09:04:30,370::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-60::DEBUG::2014-07-10 09:04:30,370::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-60::DEBUG::2014-07-10 09:04:30,370::task::990::TaskManager.Task::(_decref) Task=`a987adc4-18f1-4c98-90bd-e6a9232387a3`::ref 0 aborting False >Thread-51::DEBUG::2014-07-10 09:04:30,667::task::595::TaskManager.Task::(_updateState) Task=`d6544118-5487-4de8-93d7-498a8b0540c2`::moving from state init -> state preparing >Thread-51::INFO::2014-07-10 09:04:30,668::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='76fdb054-02cd-42ed-9721-b3e65b34c3a4', volUUID='022dfe46-2cf7-4915-80b3-883158e3ca83', options=None) >Thread-51::INFO::2014-07-10 09:04:30,668::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-51::DEBUG::2014-07-10 09:04:30,668::task::1185::TaskManager.Task::(prepare) Task=`d6544118-5487-4de8-93d7-498a8b0540c2`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-51::DEBUG::2014-07-10 09:04:30,668::task::595::TaskManager.Task::(_updateState) Task=`d6544118-5487-4de8-93d7-498a8b0540c2`::moving from state preparing -> state finished >Thread-51::DEBUG::2014-07-10 09:04:30,669::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-51::DEBUG::2014-07-10 09:04:30,669::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-51::DEBUG::2014-07-10 09:04:30,669::task::990::TaskManager.Task::(_decref) Task=`d6544118-5487-4de8-93d7-498a8b0540c2`::ref 0 aborting False >Thread-14::DEBUG::2014-07-10 09:04:30,804::BindingXMLRPC::1067::vds::(wrapper) client [10.35.3.13]::call vmGetStats with ('62e7aad5-ff72-4fe3-830f-e7726ed4bfba',) {} >Thread-14::DEBUG::2014-07-10 09:04:30,805::vm::676::vm.Vm::(_getDiskStats) vmId=`62e7aad5-ff72-4fe3-830f-e7726ed4bfba`::Disk hdd stats not available >Thread-14::DEBUG::2014-07-10 09:04:30,805::vm::676::vm.Vm::(_getDiskStats) vmId=`62e7aad5-ff72-4fe3-830f-e7726ed4bfba`::Disk hdc stats not available >Thread-14::DEBUG::2014-07-10 09:04:30,805::vm::676::vm.Vm::(_getDiskStats) vmId=`62e7aad5-ff72-4fe3-830f-e7726ed4bfba`::Disk vda stats not available >Thread-14::DEBUG::2014-07-10 09:04:30,805::vm::715::vm.Vm::(_getDiskLatency) vmId=`62e7aad5-ff72-4fe3-830f-e7726ed4bfba`::Disk hdd latency not available >Thread-14::DEBUG::2014-07-10 09:04:30,806::vm::715::vm.Vm::(_getDiskLatency) vmId=`62e7aad5-ff72-4fe3-830f-e7726ed4bfba`::Disk hdc latency not available >Thread-14::DEBUG::2014-07-10 09:04:30,806::vm::715::vm.Vm::(_getDiskLatency) vmId=`62e7aad5-ff72-4fe3-830f-e7726ed4bfba`::Disk vda latency not available >Thread-14::DEBUG::2014-07-10 09:04:30,806::BindingXMLRPC::1074::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Powering up', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '16791', 'displayIp': '0', 'displayPort': u'5916', 'session': 'Unknown', 'displaySecurePort': u'5917', 'timeOffset': '0', 'hash': '773530886922036478', 'balloonInfo': {'balloon_max': '1048576', 'balloon_target': '1048576', 'balloon_cur': '1048576', 'balloon_min': '1048576'}, 'pauseCode': 'NOERR', 'clientIp': '', 'kvmEnable': 'true', 'network': {u'vnet8': {'macAddr': '00:1a:4a:de:6d:83', 'rxDropped': '0', 'rxErrors': '0', 'txDropped': '0', 'txRate': '0.0', 'rxRate': '0.0', 'txErrors': '0', 'state': 'unknown', 'speed': '1000', 'name': u'vnet8'}}, 'vmId': '62e7aad5-ff72-4fe3-830f-e7726ed4bfba', 'displayType': 'qxl', 'cpuUser': '42.34', 'disks': {u'vda': {'truesize': '1073741824', 'apparentsize': '1073741824', 'imageID': 'c01d693b-cba0-4fed-9ad7-0aaa28912a19'}, u'hdd': {'truesize': '0', 'apparentsize': '0'}, u'hdc': {'truesize': '0', 'apparentsize': '0'}}, 'monitorResponse': '0', 'statsAge': '0.44', 'elapsedTime': '43', 'vmType': 'kvm', 'cpuSys': '2.58', 'guestCPUCount': -1, 'appsList': [], 'guestIPs': ''}]} >Thread-14::DEBUG::2014-07-10 09:04:30,811::BindingXMLRPC::1067::vds::(wrapper) client [10.35.3.13]::call vmGetStats with ('e2b026e7-b32b-4f60-ae2d-b588066ddfa7',) {} >Thread-14::DEBUG::2014-07-10 09:04:30,811::vm::676::vm.Vm::(_getDiskStats) vmId=`e2b026e7-b32b-4f60-ae2d-b588066ddfa7`::Disk hdd stats not available >Thread-14::DEBUG::2014-07-10 09:04:30,811::vm::676::vm.Vm::(_getDiskStats) vmId=`e2b026e7-b32b-4f60-ae2d-b588066ddfa7`::Disk hdc stats not available >Thread-14::DEBUG::2014-07-10 09:04:30,811::vm::676::vm.Vm::(_getDiskStats) vmId=`e2b026e7-b32b-4f60-ae2d-b588066ddfa7`::Disk vda stats not available >Thread-14::DEBUG::2014-07-10 09:04:30,812::vm::715::vm.Vm::(_getDiskLatency) vmId=`e2b026e7-b32b-4f60-ae2d-b588066ddfa7`::Disk hdd latency not available >Thread-14::DEBUG::2014-07-10 09:04:30,812::vm::715::vm.Vm::(_getDiskLatency) vmId=`e2b026e7-b32b-4f60-ae2d-b588066ddfa7`::Disk hdc latency not available >Thread-14::DEBUG::2014-07-10 09:04:30,812::vm::715::vm.Vm::(_getDiskLatency) vmId=`e2b026e7-b32b-4f60-ae2d-b588066ddfa7`::Disk vda latency not available >Thread-14::DEBUG::2014-07-10 09:04:30,812::BindingXMLRPC::1074::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Powering up', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '17471', 'displayIp': '0', 'displayPort': u'5918', 'session': 'Unknown', 'displaySecurePort': u'5919', 'timeOffset': '0', 'hash': '4538504509314603229', 'balloonInfo': {'balloon_max': '1048576', 'balloon_target': '1048576', 'balloon_cur': '1048576', 'balloon_min': '1048576'}, 'pauseCode': 'NOERR', 'clientIp': '', 'kvmEnable': 'true', 'network': {u'vnet9': {'macAddr': '00:1a:4a:de:6d:82', 'rxDropped': '0', 'rxErrors': '0', 'txDropped': '0', 'txRate': '0.0', 'rxRate': '0.0', 'txErrors': '0', 'state': 'unknown', 'speed': '1000', 'name': u'vnet9'}}, 'vmId': 'e2b026e7-b32b-4f60-ae2d-b588066ddfa7', 'displayType': 'qxl', 'cpuUser': '48.86', 'disks': {u'vda': {'truesize': '1073741824', 'apparentsize': '1073741824', 'imageID': 'e4c65229-4247-4b33-b72a-f1d5ce72ad05'}, u'hdd': {'truesize': '0', 'apparentsize': '0'}, u'hdc': {'truesize': '0', 'apparentsize': '0'}}, 'monitorResponse': '0', 'statsAge': '0.81', 'elapsedTime': '24', 'vmType': 'kvm', 'cpuSys': '21.09', 'guestCPUCount': -1, 'appsList': [], 'guestIPs': ''}]} >Dummy-33::DEBUG::2014-07-10 09:04:30,998::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:04:31,081::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.027379 s, 37.4 MB/s\n'; <rc> = 0 >GuestMonitor-scale_9::DEBUG::2014-07-10 09:04:33,067::vm::676::vm.Vm::(_getDiskStats) vmId=`62e7aad5-ff72-4fe3-830f-e7726ed4bfba`::Disk hdd stats not available >GuestMonitor-scale_9::DEBUG::2014-07-10 09:04:33,067::vm::676::vm.Vm::(_getDiskStats) vmId=`62e7aad5-ff72-4fe3-830f-e7726ed4bfba`::Disk hdc stats not available >GuestMonitor-scale_9::DEBUG::2014-07-10 09:04:33,067::vm::676::vm.Vm::(_getDiskStats) vmId=`62e7aad5-ff72-4fe3-830f-e7726ed4bfba`::Disk vda stats not available >GuestMonitor-scale_9::DEBUG::2014-07-10 09:04:33,068::vm::715::vm.Vm::(_getDiskLatency) vmId=`62e7aad5-ff72-4fe3-830f-e7726ed4bfba`::Disk hdd latency not available >GuestMonitor-scale_10::DEBUG::2014-07-10 09:04:33,068::vm::676::vm.Vm::(_getDiskStats) vmId=`e2b026e7-b32b-4f60-ae2d-b588066ddfa7`::Disk hdd stats not available >GuestMonitor-scale_9::DEBUG::2014-07-10 09:04:33,068::vm::715::vm.Vm::(_getDiskLatency) vmId=`62e7aad5-ff72-4fe3-830f-e7726ed4bfba`::Disk hdc latency not available >GuestMonitor-scale_10::DEBUG::2014-07-10 09:04:33,069::vm::676::vm.Vm::(_getDiskStats) vmId=`e2b026e7-b32b-4f60-ae2d-b588066ddfa7`::Disk hdc stats not available >GuestMonitor-scale_9::DEBUG::2014-07-10 09:04:33,069::vm::715::vm.Vm::(_getDiskLatency) vmId=`62e7aad5-ff72-4fe3-830f-e7726ed4bfba`::Disk vda latency not available >GuestMonitor-scale_10::DEBUG::2014-07-10 09:04:33,069::vm::676::vm.Vm::(_getDiskStats) vmId=`e2b026e7-b32b-4f60-ae2d-b588066ddfa7`::Disk vda stats not available >GuestMonitor-scale_9::DEBUG::2014-07-10 09:04:33,070::vm::676::vm.Vm::(_getDiskStats) vmId=`62e7aad5-ff72-4fe3-830f-e7726ed4bfba`::Disk hdd stats not available >GuestMonitor-scale_10::DEBUG::2014-07-10 09:04:33,070::vm::715::vm.Vm::(_getDiskLatency) vmId=`e2b026e7-b32b-4f60-ae2d-b588066ddfa7`::Disk hdd latency not available >GuestMonitor-scale_9::DEBUG::2014-07-10 09:04:33,071::vm::676::vm.Vm::(_getDiskStats) vmId=`62e7aad5-ff72-4fe3-830f-e7726ed4bfba`::Disk hdc stats not available >GuestMonitor-scale_10::DEBUG::2014-07-10 09:04:33,071::vm::715::vm.Vm::(_getDiskLatency) vmId=`e2b026e7-b32b-4f60-ae2d-b588066ddfa7`::Disk hdc latency not available >GuestMonitor-scale_9::DEBUG::2014-07-10 09:04:33,071::vm::676::vm.Vm::(_getDiskStats) vmId=`62e7aad5-ff72-4fe3-830f-e7726ed4bfba`::Disk vda stats not available >GuestMonitor-scale_10::DEBUG::2014-07-10 09:04:33,071::vm::715::vm.Vm::(_getDiskLatency) vmId=`e2b026e7-b32b-4f60-ae2d-b588066ddfa7`::Disk vda latency not available >GuestMonitor-scale_9::DEBUG::2014-07-10 09:04:33,072::vm::715::vm.Vm::(_getDiskLatency) vmId=`62e7aad5-ff72-4fe3-830f-e7726ed4bfba`::Disk hdd latency not available >GuestMonitor-scale_10::DEBUG::2014-07-10 09:04:33,072::vm::676::vm.Vm::(_getDiskStats) vmId=`e2b026e7-b32b-4f60-ae2d-b588066ddfa7`::Disk hdd stats not available >GuestMonitor-scale_9::DEBUG::2014-07-10 09:04:33,073::vm::715::vm.Vm::(_getDiskLatency) vmId=`62e7aad5-ff72-4fe3-830f-e7726ed4bfba`::Disk hdc latency not available >GuestMonitor-scale_10::DEBUG::2014-07-10 09:04:33,073::vm::676::vm.Vm::(_getDiskStats) vmId=`e2b026e7-b32b-4f60-ae2d-b588066ddfa7`::Disk hdc stats not available >GuestMonitor-scale_9::DEBUG::2014-07-10 09:04:33,073::vm::715::vm.Vm::(_getDiskLatency) vmId=`62e7aad5-ff72-4fe3-830f-e7726ed4bfba`::Disk vda latency not available >GuestMonitor-scale_10::DEBUG::2014-07-10 09:04:33,073::vm::676::vm.Vm::(_getDiskStats) vmId=`e2b026e7-b32b-4f60-ae2d-b588066ddfa7`::Disk vda stats not available >GuestMonitor-scale_10::DEBUG::2014-07-10 09:04:33,074::vm::715::vm.Vm::(_getDiskLatency) vmId=`e2b026e7-b32b-4f60-ae2d-b588066ddfa7`::Disk hdd latency not available >GuestMonitor-scale_10::DEBUG::2014-07-10 09:04:33,074::vm::715::vm.Vm::(_getDiskLatency) vmId=`e2b026e7-b32b-4f60-ae2d-b588066ddfa7`::Disk hdc latency not available >GuestMonitor-scale_10::DEBUG::2014-07-10 09:04:33,074::vm::715::vm.Vm::(_getDiskLatency) vmId=`e2b026e7-b32b-4f60-ae2d-b588066ddfa7`::Disk vda latency not available >Dummy-33::DEBUG::2014-07-10 09:04:33,096::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:04:33,211::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.031667 s, 32.3 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 09:04:33,823::task::595::TaskManager.Task::(_updateState) Task=`1a57031d-7dfb-4b25-8052-756a21331a1c`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 09:04:33,824::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::INFO::2014-07-10 09:04:33,824::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000479555', 'lastCheck': '5.9', 'valid': True}, '6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000503213', 'lastCheck': '8.9', 'valid': True}} >Thread-14::DEBUG::2014-07-10 09:04:33,825::task::1185::TaskManager.Task::(prepare) Task=`1a57031d-7dfb-4b25-8052-756a21331a1c`::finished: {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000479555', 'lastCheck': '5.9', 'valid': True}, '6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000503213', 'lastCheck': '8.9', 'valid': True}} >Thread-14::DEBUG::2014-07-10 09:04:33,825::task::595::TaskManager.Task::(_updateState) Task=`1a57031d-7dfb-4b25-8052-756a21331a1c`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 09:04:33,825::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 09:04:33,825::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 09:04:33,825::task::990::TaskManager.Task::(_decref) Task=`1a57031d-7dfb-4b25-8052-756a21331a1c`::ref 0 aborting False >Thread-14::DEBUG::2014-07-10 09:04:33,840::vm::676::vm.Vm::(_getDiskStats) vmId=`62e7aad5-ff72-4fe3-830f-e7726ed4bfba`::Disk hdd stats not available >Thread-14::DEBUG::2014-07-10 09:04:33,841::vm::676::vm.Vm::(_getDiskStats) vmId=`62e7aad5-ff72-4fe3-830f-e7726ed4bfba`::Disk hdc stats not available >Thread-14::DEBUG::2014-07-10 09:04:33,841::vm::676::vm.Vm::(_getDiskStats) vmId=`62e7aad5-ff72-4fe3-830f-e7726ed4bfba`::Disk vda stats not available >Thread-14::DEBUG::2014-07-10 09:04:33,841::vm::715::vm.Vm::(_getDiskLatency) vmId=`62e7aad5-ff72-4fe3-830f-e7726ed4bfba`::Disk hdd latency not available >Thread-14::DEBUG::2014-07-10 09:04:33,841::vm::715::vm.Vm::(_getDiskLatency) vmId=`62e7aad5-ff72-4fe3-830f-e7726ed4bfba`::Disk hdc latency not available >Thread-14::DEBUG::2014-07-10 09:04:33,841::vm::715::vm.Vm::(_getDiskLatency) vmId=`62e7aad5-ff72-4fe3-830f-e7726ed4bfba`::Disk vda latency not available >Thread-14::DEBUG::2014-07-10 09:04:33,844::vm::676::vm.Vm::(_getDiskStats) vmId=`e2b026e7-b32b-4f60-ae2d-b588066ddfa7`::Disk hdd stats not available >Thread-14::DEBUG::2014-07-10 09:04:33,844::vm::676::vm.Vm::(_getDiskStats) vmId=`e2b026e7-b32b-4f60-ae2d-b588066ddfa7`::Disk hdc stats not available >Thread-14::DEBUG::2014-07-10 09:04:33,844::vm::676::vm.Vm::(_getDiskStats) vmId=`e2b026e7-b32b-4f60-ae2d-b588066ddfa7`::Disk vda stats not available >Thread-14::DEBUG::2014-07-10 09:04:33,844::vm::715::vm.Vm::(_getDiskLatency) vmId=`e2b026e7-b32b-4f60-ae2d-b588066ddfa7`::Disk hdd latency not available >Thread-14::DEBUG::2014-07-10 09:04:33,845::vm::715::vm.Vm::(_getDiskLatency) vmId=`e2b026e7-b32b-4f60-ae2d-b588066ddfa7`::Disk hdc latency not available >Thread-14::DEBUG::2014-07-10 09:04:33,845::vm::715::vm.Vm::(_getDiskLatency) vmId=`e2b026e7-b32b-4f60-ae2d-b588066ddfa7`::Disk vda latency not available >VM Channels Listener::DEBUG::2014-07-10 09:04:33,862::guestIF::274::vm.Vm::(_handleMessage) vmId=`62e7aad5-ff72-4fe3-830f-e7726ed4bfba`::username: u'None' >Thread-14::DEBUG::2014-07-10 09:04:34,274::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-14::DEBUG::2014-07-10 09:04:34,275::task::595::TaskManager.Task::(_updateState) Task=`e4a61e28-1d85-4516-b732-6f8ad9e831c5`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 09:04:34,275::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-14::INFO::2014-07-10 09:04:34,276::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:04:34,276::task::1185::TaskManager.Task::(prepare) Task=`e4a61e28-1d85-4516-b732-6f8ad9e831c5`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:04:34,276::task::595::TaskManager.Task::(_updateState) Task=`e4a61e28-1d85-4516-b732-6f8ad9e831c5`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 09:04:34,276::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 09:04:34,276::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 09:04:34,276::task::990::TaskManager.Task::(_decref) Task=`e4a61e28-1d85-4516-b732-6f8ad9e831c5`::ref 0 aborting False >Thread-34::DEBUG::2014-07-10 09:04:34,320::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-34::DEBUG::2014-07-10 09:04:34,320::task::595::TaskManager.Task::(_updateState) Task=`e084edb6-bcbf-4020-90c8-6b55f9ab3f55`::moving from state init -> state preparing >Thread-34::INFO::2014-07-10 09:04:34,320::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-34::DEBUG::2014-07-10 09:04:34,321::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`fff7e5ed-9818-48cb-832e-cb81928f2e82`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-10 09:04:34,321::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' for lock type 'shared' >Thread-34::DEBUG::2014-07-10 09:04:34,322::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-10 09:04:34,322::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`fff7e5ed-9818-48cb-832e-cb81928f2e82`::Granted request >Thread-34::DEBUG::2014-07-10 09:04:34,322::task::827::TaskManager.Task::(resourceAcquired) Task=`e084edb6-bcbf-4020-90c8-6b55f9ab3f55`::_resourcesAcquired: Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee (shared) >Thread-34::DEBUG::2014-07-10 09:04:34,322::task::990::TaskManager.Task::(_decref) Task=`e084edb6-bcbf-4020-90c8-6b55f9ab3f55`::ref 1 aborting False >Thread-34::INFO::2014-07-10 09:04:34,324::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532067385344', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:04:34,324::task::1185::TaskManager.Task::(prepare) Task=`e084edb6-bcbf-4020-90c8-6b55f9ab3f55`::finished: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532067385344', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:04:34,324::task::595::TaskManager.Task::(_updateState) Task=`e084edb6-bcbf-4020-90c8-6b55f9ab3f55`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-10 09:04:34,324::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee': < ResourceRef 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-10 09:04:34,324::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-10 09:04:34,325::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' >Thread-34::DEBUG::2014-07-10 09:04:34,325::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' (0 active users) >Thread-34::DEBUG::2014-07-10 09:04:34,325::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-10 09:04:34,325::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', Clearing records. >Thread-34::DEBUG::2014-07-10 09:04:34,326::task::990::TaskManager.Task::(_decref) Task=`e084edb6-bcbf-4020-90c8-6b55f9ab3f55`::ref 0 aborting False >Thread-40::DEBUG::2014-07-10 09:04:34,964::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lion.qa.lab.tlv.redhat.com:_export_yuri2_backup2/6a70504d-00df-4869-8695-0f442053f6b6/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-40::DEBUG::2014-07-10 09:04:34,982::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n369 bytes (369 B) copied, 0.00048657 s, 758 kB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:04:35,226::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:04:35,340::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0420303 s, 24.4 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 09:04:36,974::BindingXMLRPC::1067::vds::(wrapper) client [10.35.3.13]::call vmGetStats with ('62e7aad5-ff72-4fe3-830f-e7726ed4bfba',) {} >Thread-14::DEBUG::2014-07-10 09:04:36,975::vm::676::vm.Vm::(_getDiskStats) vmId=`62e7aad5-ff72-4fe3-830f-e7726ed4bfba`::Disk hdd stats not available >Thread-14::DEBUG::2014-07-10 09:04:36,975::vm::676::vm.Vm::(_getDiskStats) vmId=`62e7aad5-ff72-4fe3-830f-e7726ed4bfba`::Disk hdc stats not available >Thread-14::DEBUG::2014-07-10 09:04:36,976::vm::676::vm.Vm::(_getDiskStats) vmId=`62e7aad5-ff72-4fe3-830f-e7726ed4bfba`::Disk vda stats not available >Thread-14::DEBUG::2014-07-10 09:04:36,976::vm::715::vm.Vm::(_getDiskLatency) vmId=`62e7aad5-ff72-4fe3-830f-e7726ed4bfba`::Disk hdd latency not available >Thread-14::DEBUG::2014-07-10 09:04:36,976::vm::715::vm.Vm::(_getDiskLatency) vmId=`62e7aad5-ff72-4fe3-830f-e7726ed4bfba`::Disk hdc latency not available >Thread-14::DEBUG::2014-07-10 09:04:36,976::vm::715::vm.Vm::(_getDiskLatency) vmId=`62e7aad5-ff72-4fe3-830f-e7726ed4bfba`::Disk vda latency not available >Thread-14::DEBUG::2014-07-10 09:04:36,977::BindingXMLRPC::1074::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'username': u'None', 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': u'vm-18-123.eng.lab.tlv.redhat.com', 'pid': '16791', 'session': 'Unknown', 'displaySecurePort': u'5917', 'timeOffset': '0', 'balloonInfo': {'balloon_max': '1048576', 'balloon_target': '1048576', 'balloon_cur': '1048576', 'balloon_min': '1048576'}, 'pauseCode': 'NOERR', 'disksUsage': [{u'path': u'/', u'total': '4792987648', u'used': '1843060736', u'fs': u'ext4'}, {u'path': u'/boot', u'total': '507744256', u'used': '40272896', u'fs': u'ext4'}, {u'path': u'/home', u'total': '458985472', u'used': '10766336', u'fs': u'ext4'}], 'network': {u'vnet8': {'macAddr': '00:1a:4a:de:6d:83', 'rxDropped': '0', 'rxErrors': '0', 'txDropped': '0', 'txRate': '0.0', 'rxRate': '0.0', 'txErrors': '0', 'state': 'unknown', 'speed': '1000', 'name': u'vnet8'}}, 'vmType': 'kvm', 'guestName': u'vm-18-123.eng.lab.tlv.redhat.com', 'elapsedTime': '50', 'memoryStats': {}, 'cpuSys': '1.66', 'appsList': [u'kernel-2.6.32-431.el6', u'rhevm-guest-agent-common-1.0.9-1.el6ev'], 'guestOs': u'2.6.32-431.el6.x86_64', 'displayType': 'qxl', 'status': 'Up', 'hash': '773530886922036478', 'lastLogin': 1404983073.8622689, 'vmId': '62e7aad5-ff72-4fe3-830f-e7726ed4bfba', 'displayIp': '0', 'displayPort': u'5916', 'clientIp': '', 'kvmEnable': 'true', 'disks': {u'vda': {'truesize': '1073741824', 'apparentsize': '1073741824', 'imageID': 'c01d693b-cba0-4fed-9ad7-0aaa28912a19'}, u'hdd': {'truesize': '0', 'apparentsize': '0'}, u'hdc': {'truesize': '0', 'apparentsize': '0'}}, 'monitorResponse': '0', 'statsAge': '0.58', 'cpuUser': '53.86', 'guestCPUCount': -1, 'guestIPs': u'10.35.18.123', 'netIfaces': [{u'hw': u'00:1a:4a:de:6d:83', u'name': u'eth0', u'inet': [u'10.35.18.123'], u'inet6': [u'fe80::21a:4aff:fede:6d83']}]}]} >Thread-14::DEBUG::2014-07-10 09:04:36,982::BindingXMLRPC::1067::vds::(wrapper) client [10.35.3.13]::call vmGetStats with ('e2b026e7-b32b-4f60-ae2d-b588066ddfa7',) {} >Thread-14::DEBUG::2014-07-10 09:04:36,982::vm::676::vm.Vm::(_getDiskStats) vmId=`e2b026e7-b32b-4f60-ae2d-b588066ddfa7`::Disk hdd stats not available >Thread-14::DEBUG::2014-07-10 09:04:36,982::vm::676::vm.Vm::(_getDiskStats) vmId=`e2b026e7-b32b-4f60-ae2d-b588066ddfa7`::Disk hdc stats not available >Thread-14::DEBUG::2014-07-10 09:04:36,983::vm::676::vm.Vm::(_getDiskStats) vmId=`e2b026e7-b32b-4f60-ae2d-b588066ddfa7`::Disk vda stats not available >Thread-14::DEBUG::2014-07-10 09:04:36,983::vm::715::vm.Vm::(_getDiskLatency) vmId=`e2b026e7-b32b-4f60-ae2d-b588066ddfa7`::Disk hdd latency not available >Thread-14::DEBUG::2014-07-10 09:04:36,983::vm::715::vm.Vm::(_getDiskLatency) vmId=`e2b026e7-b32b-4f60-ae2d-b588066ddfa7`::Disk hdc latency not available >Thread-14::DEBUG::2014-07-10 09:04:36,983::vm::715::vm.Vm::(_getDiskLatency) vmId=`e2b026e7-b32b-4f60-ae2d-b588066ddfa7`::Disk vda latency not available >Thread-14::DEBUG::2014-07-10 09:04:36,983::BindingXMLRPC::1074::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Powering up', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '17471', 'displayIp': '0', 'displayPort': u'5918', 'session': 'Unknown', 'displaySecurePort': u'5919', 'timeOffset': '0', 'hash': '4538504509314603229', 'balloonInfo': {'balloon_max': '1048576', 'balloon_target': '1048576', 'balloon_cur': '1048576', 'balloon_min': '1048576'}, 'pauseCode': 'NOERR', 'clientIp': '', 'kvmEnable': 'true', 'network': {u'vnet9': {'macAddr': '00:1a:4a:de:6d:82', 'rxDropped': '0', 'rxErrors': '0', 'txDropped': '0', 'txRate': '0.0', 'rxRate': '0.0', 'txErrors': '0', 'state': 'unknown', 'speed': '1000', 'name': u'vnet9'}}, 'vmId': 'e2b026e7-b32b-4f60-ae2d-b588066ddfa7', 'displayType': 'qxl', 'cpuUser': '48.86', 'disks': {u'vda': {'truesize': '1073741824', 'apparentsize': '1073741824', 'imageID': 'e4c65229-4247-4b33-b72a-f1d5ce72ad05'}, u'hdd': {'truesize': '0', 'apparentsize': '0'}, u'hdc': {'truesize': '0', 'apparentsize': '0'}}, 'monitorResponse': '0', 'statsAge': '0.96', 'elapsedTime': '30', 'vmType': 'kvm', 'cpuSys': '21.09', 'guestCPUCount': -1, 'appsList': [], 'guestIPs': ''}]} >Dummy-33::DEBUG::2014-07-10 09:04:37,356::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:04:37,452::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.038911 s, 26.3 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-10 09:04:37,969::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/metadata bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-10 09:04:37,989::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00054713 s, 7.5 MB/s\n'; <rc> = 0 >GuestMonitor-scale_9::DEBUG::2014-07-10 09:04:38,079::vm::676::vm.Vm::(_getDiskStats) vmId=`62e7aad5-ff72-4fe3-830f-e7726ed4bfba`::Disk hdd stats not available >GuestMonitor-scale_9::DEBUG::2014-07-10 09:04:38,081::vm::676::vm.Vm::(_getDiskStats) vmId=`62e7aad5-ff72-4fe3-830f-e7726ed4bfba`::Disk hdc stats not available >GuestMonitor-scale_10::DEBUG::2014-07-10 09:04:38,082::vm::676::vm.Vm::(_getDiskStats) vmId=`e2b026e7-b32b-4f60-ae2d-b588066ddfa7`::Disk hdd stats not available >GuestMonitor-scale_9::DEBUG::2014-07-10 09:04:38,083::vm::676::vm.Vm::(_getDiskStats) vmId=`62e7aad5-ff72-4fe3-830f-e7726ed4bfba`::Disk vda stats not available >GuestMonitor-scale_10::DEBUG::2014-07-10 09:04:38,084::vm::676::vm.Vm::(_getDiskStats) vmId=`e2b026e7-b32b-4f60-ae2d-b588066ddfa7`::Disk hdc stats not available >GuestMonitor-scale_9::DEBUG::2014-07-10 09:04:38,085::vm::715::vm.Vm::(_getDiskLatency) vmId=`62e7aad5-ff72-4fe3-830f-e7726ed4bfba`::Disk hdd latency not available >GuestMonitor-scale_10::DEBUG::2014-07-10 09:04:38,086::vm::676::vm.Vm::(_getDiskStats) vmId=`e2b026e7-b32b-4f60-ae2d-b588066ddfa7`::Disk vda stats not available >GuestMonitor-scale_9::DEBUG::2014-07-10 09:04:38,087::vm::715::vm.Vm::(_getDiskLatency) vmId=`62e7aad5-ff72-4fe3-830f-e7726ed4bfba`::Disk hdc latency not available >GuestMonitor-scale_9::DEBUG::2014-07-10 09:04:38,087::vm::715::vm.Vm::(_getDiskLatency) vmId=`62e7aad5-ff72-4fe3-830f-e7726ed4bfba`::Disk vda latency not available >GuestMonitor-scale_10::DEBUG::2014-07-10 09:04:38,087::vm::715::vm.Vm::(_getDiskLatency) vmId=`e2b026e7-b32b-4f60-ae2d-b588066ddfa7`::Disk hdd latency not available >GuestMonitor-scale_10::DEBUG::2014-07-10 09:04:38,089::vm::715::vm.Vm::(_getDiskLatency) vmId=`e2b026e7-b32b-4f60-ae2d-b588066ddfa7`::Disk hdc latency not available >GuestMonitor-scale_9::DEBUG::2014-07-10 09:04:38,090::vm::676::vm.Vm::(_getDiskStats) vmId=`62e7aad5-ff72-4fe3-830f-e7726ed4bfba`::Disk hdd stats not available >GuestMonitor-scale_10::DEBUG::2014-07-10 09:04:38,090::vm::715::vm.Vm::(_getDiskLatency) vmId=`e2b026e7-b32b-4f60-ae2d-b588066ddfa7`::Disk vda latency not available >GuestMonitor-scale_9::DEBUG::2014-07-10 09:04:38,091::vm::676::vm.Vm::(_getDiskStats) vmId=`62e7aad5-ff72-4fe3-830f-e7726ed4bfba`::Disk hdc stats not available >GuestMonitor-scale_9::DEBUG::2014-07-10 09:04:38,092::vm::676::vm.Vm::(_getDiskStats) vmId=`62e7aad5-ff72-4fe3-830f-e7726ed4bfba`::Disk vda stats not available >GuestMonitor-scale_10::DEBUG::2014-07-10 09:04:38,093::vm::676::vm.Vm::(_getDiskStats) vmId=`e2b026e7-b32b-4f60-ae2d-b588066ddfa7`::Disk hdd stats not available >GuestMonitor-scale_9::DEBUG::2014-07-10 09:04:38,094::vm::715::vm.Vm::(_getDiskLatency) vmId=`62e7aad5-ff72-4fe3-830f-e7726ed4bfba`::Disk hdd latency not available >GuestMonitor-scale_10::DEBUG::2014-07-10 09:04:38,095::vm::676::vm.Vm::(_getDiskStats) vmId=`e2b026e7-b32b-4f60-ae2d-b588066ddfa7`::Disk hdc stats not available >GuestMonitor-scale_9::DEBUG::2014-07-10 09:04:38,095::vm::715::vm.Vm::(_getDiskLatency) vmId=`62e7aad5-ff72-4fe3-830f-e7726ed4bfba`::Disk hdc latency not available >GuestMonitor-scale_10::DEBUG::2014-07-10 09:04:38,096::vm::676::vm.Vm::(_getDiskStats) vmId=`e2b026e7-b32b-4f60-ae2d-b588066ddfa7`::Disk vda stats not available >GuestMonitor-scale_9::DEBUG::2014-07-10 09:04:38,096::vm::715::vm.Vm::(_getDiskLatency) vmId=`62e7aad5-ff72-4fe3-830f-e7726ed4bfba`::Disk vda latency not available >GuestMonitor-scale_10::DEBUG::2014-07-10 09:04:38,097::vm::715::vm.Vm::(_getDiskLatency) vmId=`e2b026e7-b32b-4f60-ae2d-b588066ddfa7`::Disk hdd latency not available >GuestMonitor-scale_10::DEBUG::2014-07-10 09:04:38,098::vm::715::vm.Vm::(_getDiskLatency) vmId=`e2b026e7-b32b-4f60-ae2d-b588066ddfa7`::Disk hdc latency not available >GuestMonitor-scale_10::DEBUG::2014-07-10 09:04:38,098::vm::715::vm.Vm::(_getDiskLatency) vmId=`e2b026e7-b32b-4f60-ae2d-b588066ddfa7`::Disk vda latency not available >Dummy-33::DEBUG::2014-07-10 09:04:39,466::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:04:39,577::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0559408 s, 18.3 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 09:04:40,040::BindingXMLRPC::1067::vds::(wrapper) client [10.35.3.13]::call vmGetStats with ('e2b026e7-b32b-4f60-ae2d-b588066ddfa7',) {} >Thread-14::DEBUG::2014-07-10 09:04:40,041::vm::676::vm.Vm::(_getDiskStats) vmId=`e2b026e7-b32b-4f60-ae2d-b588066ddfa7`::Disk hdd stats not available >Thread-14::DEBUG::2014-07-10 09:04:40,042::vm::676::vm.Vm::(_getDiskStats) vmId=`e2b026e7-b32b-4f60-ae2d-b588066ddfa7`::Disk hdc stats not available >Thread-14::DEBUG::2014-07-10 09:04:40,042::vm::676::vm.Vm::(_getDiskStats) vmId=`e2b026e7-b32b-4f60-ae2d-b588066ddfa7`::Disk vda stats not available >Thread-14::DEBUG::2014-07-10 09:04:40,042::vm::715::vm.Vm::(_getDiskLatency) vmId=`e2b026e7-b32b-4f60-ae2d-b588066ddfa7`::Disk hdd latency not available >Thread-14::DEBUG::2014-07-10 09:04:40,042::vm::715::vm.Vm::(_getDiskLatency) vmId=`e2b026e7-b32b-4f60-ae2d-b588066ddfa7`::Disk hdc latency not available >Thread-14::DEBUG::2014-07-10 09:04:40,043::vm::715::vm.Vm::(_getDiskLatency) vmId=`e2b026e7-b32b-4f60-ae2d-b588066ddfa7`::Disk vda latency not available >Thread-14::DEBUG::2014-07-10 09:04:40,043::BindingXMLRPC::1074::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Powering up', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '17471', 'displayIp': '0', 'displayPort': u'5918', 'session': 'Unknown', 'displaySecurePort': u'5919', 'timeOffset': '0', 'hash': '4538504509314603229', 'balloonInfo': {'balloon_max': '1048576', 'balloon_target': '1048576', 'balloon_cur': '1048576', 'balloon_min': '1048576'}, 'pauseCode': 'NOERR', 'clientIp': '', 'kvmEnable': 'true', 'network': {u'vnet9': {'macAddr': '00:1a:4a:de:6d:82', 'rxDropped': '0', 'rxErrors': '0', 'txDropped': '0', 'txRate': '0.0', 'rxRate': '0.0', 'txErrors': '0', 'state': 'unknown', 'speed': '1000', 'name': u'vnet9'}}, 'vmId': 'e2b026e7-b32b-4f60-ae2d-b588066ddfa7', 'displayType': 'qxl', 'cpuUser': '48.86', 'disks': {u'vda': {'truesize': '1073741824', 'apparentsize': '1073741824', 'imageID': 'e4c65229-4247-4b33-b72a-f1d5ce72ad05'}, u'hdd': {'truesize': '0', 'apparentsize': '0'}, u'hdc': {'truesize': '0', 'apparentsize': '0'}}, 'monitorResponse': '0', 'statsAge': '0.00', 'elapsedTime': '33', 'vmType': 'kvm', 'cpuSys': '21.09', 'guestCPUCount': -1, 'appsList': [], 'guestIPs': ''}]} >Dummy-33::DEBUG::2014-07-10 09:04:41,593::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:04:41,696::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0437617 s, 23.4 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 09:04:43,059::BindingXMLRPC::1067::vds::(wrapper) client [10.35.3.13]::call vmGetStats with ('e2b026e7-b32b-4f60-ae2d-b588066ddfa7',) {} >Thread-14::DEBUG::2014-07-10 09:04:43,060::vm::676::vm.Vm::(_getDiskStats) vmId=`e2b026e7-b32b-4f60-ae2d-b588066ddfa7`::Disk hdd stats not available >Thread-14::DEBUG::2014-07-10 09:04:43,060::vm::676::vm.Vm::(_getDiskStats) vmId=`e2b026e7-b32b-4f60-ae2d-b588066ddfa7`::Disk hdc stats not available >Thread-14::DEBUG::2014-07-10 09:04:43,060::vm::676::vm.Vm::(_getDiskStats) vmId=`e2b026e7-b32b-4f60-ae2d-b588066ddfa7`::Disk vda stats not available >Thread-14::DEBUG::2014-07-10 09:04:43,060::vm::715::vm.Vm::(_getDiskLatency) vmId=`e2b026e7-b32b-4f60-ae2d-b588066ddfa7`::Disk hdd latency not available >Thread-14::DEBUG::2014-07-10 09:04:43,061::vm::715::vm.Vm::(_getDiskLatency) vmId=`e2b026e7-b32b-4f60-ae2d-b588066ddfa7`::Disk hdc latency not available >Thread-14::DEBUG::2014-07-10 09:04:43,061::vm::715::vm.Vm::(_getDiskLatency) vmId=`e2b026e7-b32b-4f60-ae2d-b588066ddfa7`::Disk vda latency not available >Thread-14::DEBUG::2014-07-10 09:04:43,061::BindingXMLRPC::1074::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Powering up', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '17471', 'displayIp': '0', 'displayPort': u'5918', 'session': 'Unknown', 'displaySecurePort': u'5919', 'timeOffset': '0', 'hash': '4538504509314603229', 'balloonInfo': {'balloon_max': '1048576', 'balloon_target': '1048576', 'balloon_cur': '1048576', 'balloon_min': '1048576'}, 'pauseCode': 'NOERR', 'clientIp': '', 'kvmEnable': 'true', 'network': {u'vnet9': {'macAddr': '00:1a:4a:de:6d:82', 'rxDropped': '0', 'rxErrors': '0', 'txDropped': '0', 'txRate': '0.0', 'rxRate': '0.0', 'txErrors': '0', 'state': 'unknown', 'speed': '1000', 'name': u'vnet9'}}, 'vmId': 'e2b026e7-b32b-4f60-ae2d-b588066ddfa7', 'displayType': 'qxl', 'cpuUser': '41.07', 'disks': {u'vda': {'truesize': '1073741824', 'apparentsize': '1073741824', 'imageID': 'e4c65229-4247-4b33-b72a-f1d5ce72ad05'}, u'hdd': {'truesize': '0', 'apparentsize': '0'}, u'hdc': {'truesize': '0', 'apparentsize': '0'}}, 'monitorResponse': '0', 'statsAge': '1.01', 'elapsedTime': '36', 'vmType': 'kvm', 'cpuSys': '5.97', 'guestCPUCount': -1, 'appsList': [], 'guestIPs': ''}]} >VM Channels Listener::DEBUG::2014-07-10 09:04:43,077::vmChannels::95::vds::(_handle_timeouts) Timeout on fileno 78. >GuestMonitor-scale_9::DEBUG::2014-07-10 09:04:43,104::vm::676::vm.Vm::(_getDiskStats) vmId=`62e7aad5-ff72-4fe3-830f-e7726ed4bfba`::Disk hdd stats not available >GuestMonitor-scale_9::DEBUG::2014-07-10 09:04:43,104::vm::676::vm.Vm::(_getDiskStats) vmId=`62e7aad5-ff72-4fe3-830f-e7726ed4bfba`::Disk hdc stats not available >GuestMonitor-scale_10::DEBUG::2014-07-10 09:04:43,105::vm::676::vm.Vm::(_getDiskStats) vmId=`e2b026e7-b32b-4f60-ae2d-b588066ddfa7`::Disk hdd stats not available >GuestMonitor-scale_9::DEBUG::2014-07-10 09:04:43,105::vm::676::vm.Vm::(_getDiskStats) vmId=`62e7aad5-ff72-4fe3-830f-e7726ed4bfba`::Disk vda stats not available >GuestMonitor-scale_10::DEBUG::2014-07-10 09:04:43,105::vm::676::vm.Vm::(_getDiskStats) vmId=`e2b026e7-b32b-4f60-ae2d-b588066ddfa7`::Disk hdc stats not available >GuestMonitor-scale_9::DEBUG::2014-07-10 09:04:43,106::vm::715::vm.Vm::(_getDiskLatency) vmId=`62e7aad5-ff72-4fe3-830f-e7726ed4bfba`::Disk hdd latency not available >GuestMonitor-scale_10::DEBUG::2014-07-10 09:04:43,106::vm::676::vm.Vm::(_getDiskStats) vmId=`e2b026e7-b32b-4f60-ae2d-b588066ddfa7`::Disk vda stats not available >GuestMonitor-scale_9::DEBUG::2014-07-10 09:04:43,106::vm::715::vm.Vm::(_getDiskLatency) vmId=`62e7aad5-ff72-4fe3-830f-e7726ed4bfba`::Disk hdc latency not available >GuestMonitor-scale_10::DEBUG::2014-07-10 09:04:43,106::vm::715::vm.Vm::(_getDiskLatency) vmId=`e2b026e7-b32b-4f60-ae2d-b588066ddfa7`::Disk hdd latency not available >GuestMonitor-scale_9::DEBUG::2014-07-10 09:04:43,106::vm::715::vm.Vm::(_getDiskLatency) vmId=`62e7aad5-ff72-4fe3-830f-e7726ed4bfba`::Disk vda latency not available >GuestMonitor-scale_10::DEBUG::2014-07-10 09:04:43,107::vm::715::vm.Vm::(_getDiskLatency) vmId=`e2b026e7-b32b-4f60-ae2d-b588066ddfa7`::Disk hdc latency not available >GuestMonitor-scale_9::DEBUG::2014-07-10 09:04:43,107::vm::676::vm.Vm::(_getDiskStats) vmId=`62e7aad5-ff72-4fe3-830f-e7726ed4bfba`::Disk hdd stats not available >GuestMonitor-scale_10::DEBUG::2014-07-10 09:04:43,108::vm::715::vm.Vm::(_getDiskLatency) vmId=`e2b026e7-b32b-4f60-ae2d-b588066ddfa7`::Disk vda latency not available >GuestMonitor-scale_9::DEBUG::2014-07-10 09:04:43,108::vm::676::vm.Vm::(_getDiskStats) vmId=`62e7aad5-ff72-4fe3-830f-e7726ed4bfba`::Disk hdc stats not available >GuestMonitor-scale_10::DEBUG::2014-07-10 09:04:43,108::vm::676::vm.Vm::(_getDiskStats) vmId=`e2b026e7-b32b-4f60-ae2d-b588066ddfa7`::Disk hdd stats not available >GuestMonitor-scale_9::DEBUG::2014-07-10 09:04:43,108::vm::676::vm.Vm::(_getDiskStats) vmId=`62e7aad5-ff72-4fe3-830f-e7726ed4bfba`::Disk vda stats not available >GuestMonitor-scale_10::DEBUG::2014-07-10 09:04:43,109::vm::676::vm.Vm::(_getDiskStats) vmId=`e2b026e7-b32b-4f60-ae2d-b588066ddfa7`::Disk hdc stats not available >GuestMonitor-scale_9::DEBUG::2014-07-10 09:04:43,109::vm::715::vm.Vm::(_getDiskLatency) vmId=`62e7aad5-ff72-4fe3-830f-e7726ed4bfba`::Disk hdd latency not available >GuestMonitor-scale_10::DEBUG::2014-07-10 09:04:43,109::vm::676::vm.Vm::(_getDiskStats) vmId=`e2b026e7-b32b-4f60-ae2d-b588066ddfa7`::Disk vda stats not available >GuestMonitor-scale_9::DEBUG::2014-07-10 09:04:43,109::vm::715::vm.Vm::(_getDiskLatency) vmId=`62e7aad5-ff72-4fe3-830f-e7726ed4bfba`::Disk hdc latency not available >GuestMonitor-scale_10::DEBUG::2014-07-10 09:04:43,110::vm::715::vm.Vm::(_getDiskLatency) vmId=`e2b026e7-b32b-4f60-ae2d-b588066ddfa7`::Disk hdd latency not available >GuestMonitor-scale_9::DEBUG::2014-07-10 09:04:43,110::vm::715::vm.Vm::(_getDiskLatency) vmId=`62e7aad5-ff72-4fe3-830f-e7726ed4bfba`::Disk vda latency not available >GuestMonitor-scale_10::DEBUG::2014-07-10 09:04:43,110::vm::715::vm.Vm::(_getDiskLatency) vmId=`e2b026e7-b32b-4f60-ae2d-b588066ddfa7`::Disk hdc latency not available >GuestMonitor-scale_10::DEBUG::2014-07-10 09:04:43,111::vm::715::vm.Vm::(_getDiskLatency) vmId=`e2b026e7-b32b-4f60-ae2d-b588066ddfa7`::Disk vda latency not available >Dummy-33::DEBUG::2014-07-10 09:04:43,714::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:04:43,815::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0464108 s, 22.1 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 09:04:44,353::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-14::DEBUG::2014-07-10 09:04:44,354::task::595::TaskManager.Task::(_updateState) Task=`c9bfc395-68b6-4391-b0ae-8855ff3e861a`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 09:04:44,355::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-14::INFO::2014-07-10 09:04:44,355::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:04:44,355::task::1185::TaskManager.Task::(prepare) Task=`c9bfc395-68b6-4391-b0ae-8855ff3e861a`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:04:44,356::task::595::TaskManager.Task::(_updateState) Task=`c9bfc395-68b6-4391-b0ae-8855ff3e861a`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 09:04:44,356::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 09:04:44,356::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 09:04:44,356::task::990::TaskManager.Task::(_decref) Task=`c9bfc395-68b6-4391-b0ae-8855ff3e861a`::ref 0 aborting False >Thread-34::DEBUG::2014-07-10 09:04:44,360::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-34::DEBUG::2014-07-10 09:04:44,361::task::595::TaskManager.Task::(_updateState) Task=`7391cf4a-647b-4d76-ae8b-42e8331d900a`::moving from state init -> state preparing >Thread-34::INFO::2014-07-10 09:04:44,361::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-34::DEBUG::2014-07-10 09:04:44,362::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`697fc3b2-d1c9-4810-b23e-3ca80f45b400`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-10 09:04:44,362::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' for lock type 'shared' >Thread-34::DEBUG::2014-07-10 09:04:44,362::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-10 09:04:44,363::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`697fc3b2-d1c9-4810-b23e-3ca80f45b400`::Granted request >Thread-34::DEBUG::2014-07-10 09:04:44,363::task::827::TaskManager.Task::(resourceAcquired) Task=`7391cf4a-647b-4d76-ae8b-42e8331d900a`::_resourcesAcquired: Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee (shared) >Thread-34::DEBUG::2014-07-10 09:04:44,363::task::990::TaskManager.Task::(_decref) Task=`7391cf4a-647b-4d76-ae8b-42e8331d900a`::ref 1 aborting False >Thread-34::INFO::2014-07-10 09:04:44,364::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532067385344', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:04:44,365::task::1185::TaskManager.Task::(prepare) Task=`7391cf4a-647b-4d76-ae8b-42e8331d900a`::finished: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532067385344', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:04:44,365::task::595::TaskManager.Task::(_updateState) Task=`7391cf4a-647b-4d76-ae8b-42e8331d900a`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-10 09:04:44,365::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee': < ResourceRef 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-10 09:04:44,365::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-10 09:04:44,366::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' >Thread-34::DEBUG::2014-07-10 09:04:44,366::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' (0 active users) >Thread-34::DEBUG::2014-07-10 09:04:44,366::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-10 09:04:44,366::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', Clearing records. >Thread-34::DEBUG::2014-07-10 09:04:44,366::task::990::TaskManager.Task::(_decref) Task=`7391cf4a-647b-4d76-ae8b-42e8331d900a`::ref 0 aborting False >Thread-40::DEBUG::2014-07-10 09:04:45,007::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lion.qa.lab.tlv.redhat.com:_export_yuri2_backup2/6a70504d-00df-4869-8695-0f442053f6b6/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-40::DEBUG::2014-07-10 09:04:45,027::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n369 bytes (369 B) copied, 0.000565119 s, 653 kB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:04:45,832::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:04:46,016::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0600005 s, 17.1 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 09:04:46,078::BindingXMLRPC::1067::vds::(wrapper) client [10.35.3.13]::call vmGetStats with ('e2b026e7-b32b-4f60-ae2d-b588066ddfa7',) {} >Thread-14::DEBUG::2014-07-10 09:04:46,079::vm::676::vm.Vm::(_getDiskStats) vmId=`e2b026e7-b32b-4f60-ae2d-b588066ddfa7`::Disk hdd stats not available >Thread-14::DEBUG::2014-07-10 09:04:46,079::vm::676::vm.Vm::(_getDiskStats) vmId=`e2b026e7-b32b-4f60-ae2d-b588066ddfa7`::Disk hdc stats not available >Thread-14::DEBUG::2014-07-10 09:04:46,079::vm::676::vm.Vm::(_getDiskStats) vmId=`e2b026e7-b32b-4f60-ae2d-b588066ddfa7`::Disk vda stats not available >Thread-14::DEBUG::2014-07-10 09:04:46,079::vm::715::vm.Vm::(_getDiskLatency) vmId=`e2b026e7-b32b-4f60-ae2d-b588066ddfa7`::Disk hdd latency not available >Thread-14::DEBUG::2014-07-10 09:04:46,080::vm::715::vm.Vm::(_getDiskLatency) vmId=`e2b026e7-b32b-4f60-ae2d-b588066ddfa7`::Disk hdc latency not available >Thread-14::DEBUG::2014-07-10 09:04:46,080::vm::715::vm.Vm::(_getDiskLatency) vmId=`e2b026e7-b32b-4f60-ae2d-b588066ddfa7`::Disk vda latency not available >Thread-14::DEBUG::2014-07-10 09:04:46,081::BindingXMLRPC::1074::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Powering up', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '17471', 'displayIp': '0', 'displayPort': u'5918', 'session': 'Unknown', 'displaySecurePort': u'5919', 'timeOffset': '0', 'hash': '4538504509314603229', 'balloonInfo': {'balloon_max': '1048576', 'balloon_target': '1048576', 'balloon_cur': '1048576', 'balloon_min': '1048576'}, 'pauseCode': 'NOERR', 'clientIp': '', 'kvmEnable': 'true', 'network': {u'vnet9': {'macAddr': '00:1a:4a:de:6d:82', 'rxDropped': '0', 'rxErrors': '0', 'txDropped': '0', 'txRate': '0.0', 'rxRate': '0.0', 'txErrors': '0', 'state': 'unknown', 'speed': '1000', 'name': u'vnet9'}}, 'vmId': 'e2b026e7-b32b-4f60-ae2d-b588066ddfa7', 'displayType': 'qxl', 'cpuUser': '41.07', 'disks': {u'vda': {'truesize': '1073741824', 'apparentsize': '1073741824', 'imageID': 'e4c65229-4247-4b33-b72a-f1d5ce72ad05'}, u'hdd': {'truesize': '0', 'apparentsize': '0'}, u'hdc': {'truesize': '0', 'apparentsize': '0'}}, 'monitorResponse': '0', 'statsAge': '0.01', 'elapsedTime': '39', 'vmType': 'kvm', 'cpuSys': '5.97', 'guestCPUCount': -1, 'appsList': [], 'guestIPs': ''}]} >Thread-18::DEBUG::2014-07-10 09:04:48,020::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/metadata bs=4096 count=1' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:04:48,039::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >GuestMonitor-scale_10::DEBUG::2014-07-10 09:04:48,125::vm::676::vm.Vm::(_getDiskStats) vmId=`e2b026e7-b32b-4f60-ae2d-b588066ddfa7`::Disk hdd stats not available >GuestMonitor-scale_9::DEBUG::2014-07-10 09:04:48,128::vm::676::vm.Vm::(_getDiskStats) vmId=`62e7aad5-ff72-4fe3-830f-e7726ed4bfba`::Disk hdd stats not available >GuestMonitor-scale_10::DEBUG::2014-07-10 09:04:48,137::vm::676::vm.Vm::(_getDiskStats) vmId=`e2b026e7-b32b-4f60-ae2d-b588066ddfa7`::Disk hdc stats not available >GuestMonitor-scale_9::DEBUG::2014-07-10 09:04:48,139::vm::676::vm.Vm::(_getDiskStats) vmId=`62e7aad5-ff72-4fe3-830f-e7726ed4bfba`::Disk hdc stats not available >GuestMonitor-scale_10::DEBUG::2014-07-10 09:04:48,152::vm::676::vm.Vm::(_getDiskStats) vmId=`e2b026e7-b32b-4f60-ae2d-b588066ddfa7`::Disk vda stats not available >GuestMonitor-scale_9::DEBUG::2014-07-10 09:04:48,154::vm::676::vm.Vm::(_getDiskStats) vmId=`62e7aad5-ff72-4fe3-830f-e7726ed4bfba`::Disk vda stats not available >GuestMonitor-scale_10::DEBUG::2014-07-10 09:04:48,165::vm::715::vm.Vm::(_getDiskLatency) vmId=`e2b026e7-b32b-4f60-ae2d-b588066ddfa7`::Disk hdd latency not available >GuestMonitor-scale_9::DEBUG::2014-07-10 09:04:48,168::vm::715::vm.Vm::(_getDiskLatency) vmId=`62e7aad5-ff72-4fe3-830f-e7726ed4bfba`::Disk hdd latency not available >GuestMonitor-scale_10::DEBUG::2014-07-10 09:04:48,177::vm::715::vm.Vm::(_getDiskLatency) vmId=`e2b026e7-b32b-4f60-ae2d-b588066ddfa7`::Disk hdc latency not available >GuestMonitor-scale_9::DEBUG::2014-07-10 09:04:48,179::vm::715::vm.Vm::(_getDiskLatency) vmId=`62e7aad5-ff72-4fe3-830f-e7726ed4bfba`::Disk hdc latency not available >GuestMonitor-scale_10::DEBUG::2014-07-10 09:04:48,188::vm::715::vm.Vm::(_getDiskLatency) vmId=`e2b026e7-b32b-4f60-ae2d-b588066ddfa7`::Disk vda latency not available >GuestMonitor-scale_9::DEBUG::2014-07-10 09:04:48,191::vm::715::vm.Vm::(_getDiskLatency) vmId=`62e7aad5-ff72-4fe3-830f-e7726ed4bfba`::Disk vda latency not available >GuestMonitor-scale_10::DEBUG::2014-07-10 09:04:48,214::vm::676::vm.Vm::(_getDiskStats) vmId=`e2b026e7-b32b-4f60-ae2d-b588066ddfa7`::Disk hdd stats not available >GuestMonitor-scale_9::DEBUG::2014-07-10 09:04:48,221::vm::676::vm.Vm::(_getDiskStats) vmId=`62e7aad5-ff72-4fe3-830f-e7726ed4bfba`::Disk hdd stats not available >GuestMonitor-scale_10::DEBUG::2014-07-10 09:04:48,231::vm::676::vm.Vm::(_getDiskStats) vmId=`e2b026e7-b32b-4f60-ae2d-b588066ddfa7`::Disk hdc stats not available >GuestMonitor-scale_9::DEBUG::2014-07-10 09:04:48,240::vm::676::vm.Vm::(_getDiskStats) vmId=`62e7aad5-ff72-4fe3-830f-e7726ed4bfba`::Disk hdc stats not available >GuestMonitor-scale_10::DEBUG::2014-07-10 09:04:48,250::vm::676::vm.Vm::(_getDiskStats) vmId=`e2b026e7-b32b-4f60-ae2d-b588066ddfa7`::Disk vda stats not available >GuestMonitor-scale_9::DEBUG::2014-07-10 09:04:48,260::vm::676::vm.Vm::(_getDiskStats) vmId=`62e7aad5-ff72-4fe3-830f-e7726ed4bfba`::Disk vda stats not available >GuestMonitor-scale_10::DEBUG::2014-07-10 09:04:48,270::vm::715::vm.Vm::(_getDiskLatency) vmId=`e2b026e7-b32b-4f60-ae2d-b588066ddfa7`::Disk hdd latency not available >GuestMonitor-scale_9::DEBUG::2014-07-10 09:04:48,281::vm::715::vm.Vm::(_getDiskLatency) vmId=`62e7aad5-ff72-4fe3-830f-e7726ed4bfba`::Disk hdd latency not available >GuestMonitor-scale_10::DEBUG::2014-07-10 09:04:48,288::vm::715::vm.Vm::(_getDiskLatency) vmId=`e2b026e7-b32b-4f60-ae2d-b588066ddfa7`::Disk hdc latency not available >GuestMonitor-scale_9::DEBUG::2014-07-10 09:04:48,299::vm::715::vm.Vm::(_getDiskLatency) vmId=`62e7aad5-ff72-4fe3-830f-e7726ed4bfba`::Disk hdc latency not available >GuestMonitor-scale_10::DEBUG::2014-07-10 09:04:48,306::vm::715::vm.Vm::(_getDiskLatency) vmId=`e2b026e7-b32b-4f60-ae2d-b588066ddfa7`::Disk vda latency not available >GuestMonitor-scale_9::DEBUG::2014-07-10 09:04:48,315::vm::715::vm.Vm::(_getDiskLatency) vmId=`62e7aad5-ff72-4fe3-830f-e7726ed4bfba`::Disk vda latency not available >Thread-18::DEBUG::2014-07-10 09:04:48,341::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000823528 s, 5.0 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:04:48,841::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.733586 s, 1.4 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 09:04:49,093::task::595::TaskManager.Task::(_updateState) Task=`caf30108-de5e-4682-a10f-e746f0c5f8e5`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 09:04:49,093::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::INFO::2014-07-10 09:04:49,094::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000823528', 'lastCheck': '0.3', 'valid': True}, '6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000565119', 'lastCheck': '4.1', 'valid': True}} >Thread-14::DEBUG::2014-07-10 09:04:49,094::task::1185::TaskManager.Task::(prepare) Task=`caf30108-de5e-4682-a10f-e746f0c5f8e5`::finished: {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000823528', 'lastCheck': '0.3', 'valid': True}, '6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000565119', 'lastCheck': '4.1', 'valid': True}} >Thread-14::DEBUG::2014-07-10 09:04:49,094::task::595::TaskManager.Task::(_updateState) Task=`caf30108-de5e-4682-a10f-e746f0c5f8e5`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 09:04:49,094::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 09:04:49,095::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 09:04:49,095::task::990::TaskManager.Task::(_decref) Task=`caf30108-de5e-4682-a10f-e746f0c5f8e5`::ref 0 aborting False >Thread-14::DEBUG::2014-07-10 09:04:49,110::vm::676::vm.Vm::(_getDiskStats) vmId=`62e7aad5-ff72-4fe3-830f-e7726ed4bfba`::Disk hdd stats not available >Thread-14::DEBUG::2014-07-10 09:04:49,110::vm::676::vm.Vm::(_getDiskStats) vmId=`62e7aad5-ff72-4fe3-830f-e7726ed4bfba`::Disk hdc stats not available >Thread-14::DEBUG::2014-07-10 09:04:49,110::vm::676::vm.Vm::(_getDiskStats) vmId=`62e7aad5-ff72-4fe3-830f-e7726ed4bfba`::Disk vda stats not available >Thread-14::DEBUG::2014-07-10 09:04:49,111::vm::715::vm.Vm::(_getDiskLatency) vmId=`62e7aad5-ff72-4fe3-830f-e7726ed4bfba`::Disk hdd latency not available >Thread-14::DEBUG::2014-07-10 09:04:49,111::vm::715::vm.Vm::(_getDiskLatency) vmId=`62e7aad5-ff72-4fe3-830f-e7726ed4bfba`::Disk hdc latency not available >Thread-14::DEBUG::2014-07-10 09:04:49,111::vm::715::vm.Vm::(_getDiskLatency) vmId=`62e7aad5-ff72-4fe3-830f-e7726ed4bfba`::Disk vda latency not available >Thread-14::DEBUG::2014-07-10 09:04:49,113::vm::676::vm.Vm::(_getDiskStats) vmId=`e2b026e7-b32b-4f60-ae2d-b588066ddfa7`::Disk hdd stats not available >Thread-14::DEBUG::2014-07-10 09:04:49,113::vm::676::vm.Vm::(_getDiskStats) vmId=`e2b026e7-b32b-4f60-ae2d-b588066ddfa7`::Disk hdc stats not available >Thread-14::DEBUG::2014-07-10 09:04:49,114::vm::676::vm.Vm::(_getDiskStats) vmId=`e2b026e7-b32b-4f60-ae2d-b588066ddfa7`::Disk vda stats not available >Thread-14::DEBUG::2014-07-10 09:04:49,114::vm::715::vm.Vm::(_getDiskLatency) vmId=`e2b026e7-b32b-4f60-ae2d-b588066ddfa7`::Disk hdd latency not available >Thread-14::DEBUG::2014-07-10 09:04:49,114::vm::715::vm.Vm::(_getDiskLatency) vmId=`e2b026e7-b32b-4f60-ae2d-b588066ddfa7`::Disk hdc latency not available >Thread-14::DEBUG::2014-07-10 09:04:49,114::vm::715::vm.Vm::(_getDiskLatency) vmId=`e2b026e7-b32b-4f60-ae2d-b588066ddfa7`::Disk vda latency not available >Thread-64::DEBUG::2014-07-10 09:04:49,649::task::595::TaskManager.Task::(_updateState) Task=`5b3caa29-a17e-4b05-bea3-ba8264d35b74`::moving from state init -> state preparing >Thread-64::INFO::2014-07-10 09:04:49,649::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='aa20346a-4d3a-4e07-b8e1-52c0ebe4168c', volUUID='58fefce2-9bce-4bff-8949-8c6ce8122b27', options=None) >Thread-64::INFO::2014-07-10 09:04:49,650::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-64::DEBUG::2014-07-10 09:04:49,650::task::1185::TaskManager.Task::(prepare) Task=`5b3caa29-a17e-4b05-bea3-ba8264d35b74`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-64::DEBUG::2014-07-10 09:04:49,650::task::595::TaskManager.Task::(_updateState) Task=`5b3caa29-a17e-4b05-bea3-ba8264d35b74`::moving from state preparing -> state finished >Thread-64::DEBUG::2014-07-10 09:04:49,650::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-64::DEBUG::2014-07-10 09:04:49,652::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-64::DEBUG::2014-07-10 09:04:49,652::task::990::TaskManager.Task::(_decref) Task=`5b3caa29-a17e-4b05-bea3-ba8264d35b74`::ref 0 aborting False >Thread-54::DEBUG::2014-07-10 09:04:50,453::task::595::TaskManager.Task::(_updateState) Task=`ac991262-de03-4084-985f-d23c79f3c1f4`::moving from state init -> state preparing >Thread-54::INFO::2014-07-10 09:04:50,470::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='28408446-e5fd-4565-a976-e760951593fe', volUUID='776303a2-5585-451e-826e-0e338d4a1e98', options=None) >Thread-73::DEBUG::2014-07-10 09:04:50,471::task::595::TaskManager.Task::(_updateState) Task=`7d29e783-c71f-4424-a3d5-29c40564fbfa`::moving from state init -> state preparing >Thread-54::INFO::2014-07-10 09:04:50,476::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-73::INFO::2014-07-10 09:04:50,477::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='c01d693b-cba0-4fed-9ad7-0aaa28912a19', volUUID='4bb5d954-2a50-4028-b299-0b43c261270c', options=None) >Thread-54::DEBUG::2014-07-10 09:04:50,479::task::1185::TaskManager.Task::(prepare) Task=`ac991262-de03-4084-985f-d23c79f3c1f4`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-54::DEBUG::2014-07-10 09:04:50,482::task::595::TaskManager.Task::(_updateState) Task=`ac991262-de03-4084-985f-d23c79f3c1f4`::moving from state preparing -> state finished >Thread-73::INFO::2014-07-10 09:04:50,482::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-54::DEBUG::2014-07-10 09:04:50,484::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-73::DEBUG::2014-07-10 09:04:50,486::task::1185::TaskManager.Task::(prepare) Task=`7d29e783-c71f-4424-a3d5-29c40564fbfa`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-54::DEBUG::2014-07-10 09:04:50,486::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-73::DEBUG::2014-07-10 09:04:50,489::task::595::TaskManager.Task::(_updateState) Task=`7d29e783-c71f-4424-a3d5-29c40564fbfa`::moving from state preparing -> state finished >Thread-54::DEBUG::2014-07-10 09:04:50,490::task::990::TaskManager.Task::(_decref) Task=`ac991262-de03-4084-985f-d23c79f3c1f4`::ref 0 aborting False >Thread-73::DEBUG::2014-07-10 09:04:50,493::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-73::DEBUG::2014-07-10 09:04:50,494::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-73::DEBUG::2014-07-10 09:04:50,495::task::990::TaskManager.Task::(_decref) Task=`7d29e783-c71f-4424-a3d5-29c40564fbfa`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 09:04:50,856::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:04:50,961::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0470023 s, 21.8 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-07-10 09:04:51,543::guestIF::274::vm.Vm::(_handleMessage) vmId=`e2b026e7-b32b-4f60-ae2d-b588066ddfa7`::username: u'None' >VM Channels Listener::DEBUG::2014-07-10 09:04:51,780::guestIF::274::vm.Vm::(_handleMessage) vmId=`e2b026e7-b32b-4f60-ae2d-b588066ddfa7`::username: u'None' >Thread-14::DEBUG::2014-07-10 09:04:52,241::BindingXMLRPC::1067::vds::(wrapper) client [10.35.3.13]::call vmGetStats with ('e2b026e7-b32b-4f60-ae2d-b588066ddfa7',) {} >Thread-14::DEBUG::2014-07-10 09:04:52,241::vm::676::vm.Vm::(_getDiskStats) vmId=`e2b026e7-b32b-4f60-ae2d-b588066ddfa7`::Disk hdd stats not available >Thread-14::DEBUG::2014-07-10 09:04:52,242::vm::676::vm.Vm::(_getDiskStats) vmId=`e2b026e7-b32b-4f60-ae2d-b588066ddfa7`::Disk hdc stats not available >Thread-14::DEBUG::2014-07-10 09:04:52,242::vm::676::vm.Vm::(_getDiskStats) vmId=`e2b026e7-b32b-4f60-ae2d-b588066ddfa7`::Disk vda stats not available >Thread-14::DEBUG::2014-07-10 09:04:52,242::vm::715::vm.Vm::(_getDiskLatency) vmId=`e2b026e7-b32b-4f60-ae2d-b588066ddfa7`::Disk hdd latency not available >Thread-14::DEBUG::2014-07-10 09:04:52,242::vm::715::vm.Vm::(_getDiskLatency) vmId=`e2b026e7-b32b-4f60-ae2d-b588066ddfa7`::Disk hdc latency not available >Thread-14::DEBUG::2014-07-10 09:04:52,243::vm::715::vm.Vm::(_getDiskLatency) vmId=`e2b026e7-b32b-4f60-ae2d-b588066ddfa7`::Disk vda latency not available >Thread-14::DEBUG::2014-07-10 09:04:52,243::BindingXMLRPC::1074::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'username': u'None', 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': u'localhost.localdomain', 'pid': '17471', 'session': 'Unknown', 'displaySecurePort': u'5919', 'timeOffset': '0', 'balloonInfo': {'balloon_max': '1048576', 'balloon_target': '1048576', 'balloon_cur': '1048576', 'balloon_min': '1048576'}, 'pauseCode': 'NOERR', 'disksUsage': [{u'path': u'/', u'total': '4792987648', u'used': '1843060736', u'fs': u'ext4'}, {u'path': u'/boot', u'total': '507744256', u'used': '40272896', u'fs': u'ext4'}, {u'path': u'/home', u'total': '458985472', u'used': '10766336', u'fs': u'ext4'}], 'network': {u'vnet9': {'macAddr': '00:1a:4a:de:6d:82', 'rxDropped': '0', 'rxErrors': '0', 'txDropped': '0', 'txRate': '0.0', 'rxRate': '0.0', 'txErrors': '0', 'state': 'unknown', 'speed': '1000', 'name': u'vnet9'}}, 'vmType': 'kvm', 'guestName': u'localhost.localdomain', 'elapsedTime': '45', 'memoryStats': {}, 'cpuSys': '5.97', 'appsList': [u'kernel-2.6.32-431.el6', u'rhevm-guest-agent-common-1.0.9-1.el6ev'], 'guestOs': u'2.6.32-431.el6.x86_64', 'displayType': 'qxl', 'status': 'Up', 'hash': '4538504509314603229', 'lastLogin': 1404983091.542974, 'vmId': 'e2b026e7-b32b-4f60-ae2d-b588066ddfa7', 'displayIp': '0', 'displayPort': u'5918', 'clientIp': '', 'kvmEnable': 'true', 'disks': {u'vda': {'truesize': '1073741824', 'apparentsize': '1073741824', 'imageID': 'e4c65229-4247-4b33-b72a-f1d5ce72ad05'}, u'hdd': {'truesize': '0', 'apparentsize': '0'}, u'hdc': {'truesize': '0', 'apparentsize': '0'}}, 'monitorResponse': '0', 'statsAge': '0.15', 'cpuUser': '41.07', 'guestCPUCount': -1, 'guestIPs': u'10.35.17.8', 'netIfaces': [{u'hw': u'00:1a:4a:de:6d:82', u'name': u'eth0', u'inet': [u'10.35.17.8'], u'inet6': [u'fe80::21a:4aff:fede:6d82']}]}]} >Dummy-33::DEBUG::2014-07-10 09:04:52,976::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:04:53,078::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0461984 s, 22.2 MB/s\n'; <rc> = 0 >GuestMonitor-scale_10::DEBUG::2014-07-10 09:04:53,337::vm::676::vm.Vm::(_getDiskStats) vmId=`e2b026e7-b32b-4f60-ae2d-b588066ddfa7`::Disk hdd stats not available >GuestMonitor-scale_10::DEBUG::2014-07-10 09:04:53,341::vm::676::vm.Vm::(_getDiskStats) vmId=`e2b026e7-b32b-4f60-ae2d-b588066ddfa7`::Disk hdc stats not available >GuestMonitor-scale_10::DEBUG::2014-07-10 09:04:53,346::vm::676::vm.Vm::(_getDiskStats) vmId=`e2b026e7-b32b-4f60-ae2d-b588066ddfa7`::Disk vda stats not available >GuestMonitor-scale_10::DEBUG::2014-07-10 09:04:53,353::vm::715::vm.Vm::(_getDiskLatency) vmId=`e2b026e7-b32b-4f60-ae2d-b588066ddfa7`::Disk hdd latency not available >GuestMonitor-scale_10::DEBUG::2014-07-10 09:04:53,358::vm::715::vm.Vm::(_getDiskLatency) vmId=`e2b026e7-b32b-4f60-ae2d-b588066ddfa7`::Disk hdc latency not available >GuestMonitor-scale_10::DEBUG::2014-07-10 09:04:53,364::vm::715::vm.Vm::(_getDiskLatency) vmId=`e2b026e7-b32b-4f60-ae2d-b588066ddfa7`::Disk vda latency not available >GuestMonitor-scale_10::DEBUG::2014-07-10 09:04:53,368::vm::676::vm.Vm::(_getDiskStats) vmId=`e2b026e7-b32b-4f60-ae2d-b588066ddfa7`::Disk hdd stats not available >GuestMonitor-scale_10::DEBUG::2014-07-10 09:04:53,369::vm::676::vm.Vm::(_getDiskStats) vmId=`e2b026e7-b32b-4f60-ae2d-b588066ddfa7`::Disk hdc stats not available >GuestMonitor-scale_10::DEBUG::2014-07-10 09:04:53,370::vm::676::vm.Vm::(_getDiskStats) vmId=`e2b026e7-b32b-4f60-ae2d-b588066ddfa7`::Disk vda stats not available >GuestMonitor-scale_10::DEBUG::2014-07-10 09:04:53,370::vm::715::vm.Vm::(_getDiskLatency) vmId=`e2b026e7-b32b-4f60-ae2d-b588066ddfa7`::Disk hdd latency not available >GuestMonitor-scale_10::DEBUG::2014-07-10 09:04:53,370::vm::715::vm.Vm::(_getDiskLatency) vmId=`e2b026e7-b32b-4f60-ae2d-b588066ddfa7`::Disk hdc latency not available >GuestMonitor-scale_10::DEBUG::2014-07-10 09:04:53,370::vm::715::vm.Vm::(_getDiskLatency) vmId=`e2b026e7-b32b-4f60-ae2d-b588066ddfa7`::Disk vda latency not available >Thread-14::DEBUG::2014-07-10 09:04:54,394::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-14::DEBUG::2014-07-10 09:04:54,396::task::595::TaskManager.Task::(_updateState) Task=`b81bc2ce-32e9-4bab-afad-5402e5dd3189`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 09:04:54,397::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-14::INFO::2014-07-10 09:04:54,397::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:04:54,398::task::1185::TaskManager.Task::(prepare) Task=`b81bc2ce-32e9-4bab-afad-5402e5dd3189`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:04:54,398::task::595::TaskManager.Task::(_updateState) Task=`b81bc2ce-32e9-4bab-afad-5402e5dd3189`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 09:04:54,398::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 09:04:54,399::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 09:04:54,399::task::990::TaskManager.Task::(_decref) Task=`b81bc2ce-32e9-4bab-afad-5402e5dd3189`::ref 0 aborting False >Thread-34::DEBUG::2014-07-10 09:04:54,403::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-34::DEBUG::2014-07-10 09:04:54,404::task::595::TaskManager.Task::(_updateState) Task=`70f6f558-357f-4524-989b-0ea2038dd937`::moving from state init -> state preparing >Thread-34::INFO::2014-07-10 09:04:54,404::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-34::DEBUG::2014-07-10 09:04:54,405::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`59f21cda-a0b7-4936-8e09-e163300e5d52`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-10 09:04:54,405::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' for lock type 'shared' >Thread-34::DEBUG::2014-07-10 09:04:54,405::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-10 09:04:54,405::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`59f21cda-a0b7-4936-8e09-e163300e5d52`::Granted request >Thread-34::DEBUG::2014-07-10 09:04:54,406::task::827::TaskManager.Task::(resourceAcquired) Task=`70f6f558-357f-4524-989b-0ea2038dd937`::_resourcesAcquired: Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee (shared) >Thread-34::DEBUG::2014-07-10 09:04:54,406::task::990::TaskManager.Task::(_decref) Task=`70f6f558-357f-4524-989b-0ea2038dd937`::ref 1 aborting False >Thread-34::INFO::2014-07-10 09:04:54,407::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532067385344', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:04:54,407::task::1185::TaskManager.Task::(prepare) Task=`70f6f558-357f-4524-989b-0ea2038dd937`::finished: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532067385344', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:04:54,407::task::595::TaskManager.Task::(_updateState) Task=`70f6f558-357f-4524-989b-0ea2038dd937`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-10 09:04:54,407::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee': < ResourceRef 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-10 09:04:54,408::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-10 09:04:54,408::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' >Thread-34::DEBUG::2014-07-10 09:04:54,408::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' (0 active users) >Thread-34::DEBUG::2014-07-10 09:04:54,408::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-10 09:04:54,408::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', Clearing records. >Thread-34::DEBUG::2014-07-10 09:04:54,408::task::990::TaskManager.Task::(_decref) Task=`70f6f558-357f-4524-989b-0ea2038dd937`::ref 0 aborting False >Thread-40::DEBUG::2014-07-10 09:04:55,053::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lion.qa.lab.tlv.redhat.com:_export_yuri2_backup2/6a70504d-00df-4869-8695-0f442053f6b6/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-40::DEBUG::2014-07-10 09:04:55,072::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n369 bytes (369 B) copied, 0.000474671 s, 777 kB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:04:55,097::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:04:55,215::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0617437 s, 16.6 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:04:57,230::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:04:57,357::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0630951 s, 16.2 MB/s\n'; <rc> = 0 >GuestMonitor-scale_10::DEBUG::2014-07-10 09:04:58,376::vm::676::vm.Vm::(_getDiskStats) vmId=`e2b026e7-b32b-4f60-ae2d-b588066ddfa7`::Disk hdd stats not available >GuestMonitor-scale_10::DEBUG::2014-07-10 09:04:58,377::vm::676::vm.Vm::(_getDiskStats) vmId=`e2b026e7-b32b-4f60-ae2d-b588066ddfa7`::Disk hdc stats not available >GuestMonitor-scale_10::DEBUG::2014-07-10 09:04:58,377::vm::676::vm.Vm::(_getDiskStats) vmId=`e2b026e7-b32b-4f60-ae2d-b588066ddfa7`::Disk vda stats not available >GuestMonitor-scale_10::DEBUG::2014-07-10 09:04:58,377::vm::715::vm.Vm::(_getDiskLatency) vmId=`e2b026e7-b32b-4f60-ae2d-b588066ddfa7`::Disk hdd latency not available >GuestMonitor-scale_10::DEBUG::2014-07-10 09:04:58,377::vm::715::vm.Vm::(_getDiskLatency) vmId=`e2b026e7-b32b-4f60-ae2d-b588066ddfa7`::Disk hdc latency not available >GuestMonitor-scale_10::DEBUG::2014-07-10 09:04:58,378::vm::715::vm.Vm::(_getDiskLatency) vmId=`e2b026e7-b32b-4f60-ae2d-b588066ddfa7`::Disk vda latency not available >GuestMonitor-scale_10::DEBUG::2014-07-10 09:04:58,380::vm::676::vm.Vm::(_getDiskStats) vmId=`e2b026e7-b32b-4f60-ae2d-b588066ddfa7`::Disk hdd stats not available >GuestMonitor-scale_10::DEBUG::2014-07-10 09:04:58,382::vm::676::vm.Vm::(_getDiskStats) vmId=`e2b026e7-b32b-4f60-ae2d-b588066ddfa7`::Disk hdc stats not available >GuestMonitor-scale_10::DEBUG::2014-07-10 09:04:58,383::vm::676::vm.Vm::(_getDiskStats) vmId=`e2b026e7-b32b-4f60-ae2d-b588066ddfa7`::Disk vda stats not available >GuestMonitor-scale_10::DEBUG::2014-07-10 09:04:58,383::vm::715::vm.Vm::(_getDiskLatency) vmId=`e2b026e7-b32b-4f60-ae2d-b588066ddfa7`::Disk hdd latency not available >GuestMonitor-scale_10::DEBUG::2014-07-10 09:04:58,384::vm::715::vm.Vm::(_getDiskLatency) vmId=`e2b026e7-b32b-4f60-ae2d-b588066ddfa7`::Disk hdc latency not available >GuestMonitor-scale_10::DEBUG::2014-07-10 09:04:58,384::vm::715::vm.Vm::(_getDiskLatency) vmId=`e2b026e7-b32b-4f60-ae2d-b588066ddfa7`::Disk vda latency not available >Thread-18::DEBUG::2014-07-10 09:04:58,786::domainMonitor::192::Storage.DomainMonitorThread::(_monitorDomain) Refreshing domain 9e1aa540-1f4e-4ee3-a152-be381ef6c3bd >Thread-18::DEBUG::2014-07-10 09:04:58,787::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with LvMetadataRW backend >Thread-18::DEBUG::2014-07-10 09:04:58,788::blockSD::336::Storage.Misc.excCmd::(readlines) '/bin/dd iflag=direct skip=0 bs=2048 if=/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/metadata count=1' (cwd None) >Thread-18::DEBUG::2014-07-10 09:04:58,806::blockSD::336::Storage.Misc.excCmd::(readlines) SUCCESS: <err> = '1+0 records in\n1+0 records out\n2048 bytes (2.0 kB) copied, 0.000523802 s, 3.9 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-10 09:04:58,807::misc::282::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '2048 bytes (2.0 kB) copied, 0.000523802 s, 3.9 MB/s'], size: 2048 >Thread-18::DEBUG::2014-07-10 09:04:58,807::persistentDict::234::Storage.PersistentDict::(refresh) read lines (LvMetadataRW)=[] >Thread-18::WARNING::2014-07-10 09:04:58,807::persistentDict::256::Storage.PersistentDict::(refresh) data has no embedded checksum - trust it as it is >Thread-18::DEBUG::2014-07-10 09:04:58,807::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with VGTagMetadataRW backend >Thread-18::DEBUG::2014-07-10 09:04:58,808::lvm::503::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-18::DEBUG::2014-07-10 09:04:58,808::lvm::505::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-18::DEBUG::2014-07-10 09:04:58,809::lvm::513::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-18::DEBUG::2014-07-10 09:04:58,809::lvm::525::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-18::DEBUG::2014-07-10 09:04:58,810::lvm::373::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-18::DEBUG::2014-07-10 09:04:58,811::lvm::296::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/3600601601282300032826addbbdae311|/dev/mapper/360060160f4a030003840ec867ddee311|/dev/mapper/367cad74c2fcba00019e6afd20c781e67|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name 9e1aa540-1f4e-4ee3-a152-be381ef6c3bd' (cwd None) >Thread-18::DEBUG::2014-07-10 09:04:59,155::lvm::296::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-18::DEBUG::2014-07-10 09:04:59,158::lvm::415::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-18::DEBUG::2014-07-10 09:04:59,158::persistentDict::234::Storage.PersistentDict::(refresh) read lines (VGTagMetadataRW)=['LEASETIMESEC=60', 'VGUUID=9CsMxb-YbRc-yRG7-cQKD-xY3G-GLi5-YxUyPC', 'VERSION=3', 'TYPE=ISCSI', 'LOGBLKSIZE=512', u'PV0=pv:3600601601282300032826addbbdae311,uuid:7qEb8v-jk2X-3CPk-k4XB-eIBk-onYD-807hcV,pestart:0,pecount:8189,mapoffset:0', 'LEASERETRIES=3', 'IOOPTIMEOUTSEC=10', 'LOCKRENEWALINTERVALSEC=5', 'PHYBLKSIZE=512', 'SDUUID=9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'CLASS=Data', 'LOCKPOLICY=', 'DESCRIPTION=SD_REAL', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=DC_REAL', 'ROLE=Master', 'POOL_UUID=4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', 'POOL_SPM_ID=1', 'POOL_SPM_LVER=0', '_SHA_CKSUM=013b5a7910962201c4cceab31b9c6d9c79f7316f', u'POOL_DOMAINS=9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active'] >Thread-18::INFO::2014-07-10 09:04:59,160::sd::384::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 9e1aa540-1f4e-4ee3-a152-be381ef6c3bd_imageNS already registered >Thread-18::INFO::2014-07-10 09:04:59,160::sd::392::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 9e1aa540-1f4e-4ee3-a152-be381ef6c3bd_volumeNS already registered >Thread-18::INFO::2014-07-10 09:04:59,160::blockSD::452::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 9e1aa540-1f4e-4ee3-a152-be381ef6c3bd_lvmActivationNS already registered >Thread-18::DEBUG::2014-07-10 09:04:59,161::lvm::296::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgck --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/3600601601282300032826addbbdae311|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } " 9e1aa540-1f4e-4ee3-a152-be381ef6c3bd' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:04:59,373::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Thread-18::DEBUG::2014-07-10 09:04:59,396::lvm::296::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-18::DEBUG::2014-07-10 09:04:59,400::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/metadata bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-10 09:04:59,477::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000580618 s, 7.1 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:04:59,907::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.48135 s, 2.1 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:05:01,918::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:05:02,023::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0455446 s, 22.5 MB/s\n'; <rc> = 0 >GuestMonitor-scale_10::DEBUG::2014-07-10 09:05:03,390::vm::676::vm.Vm::(_getDiskStats) vmId=`e2b026e7-b32b-4f60-ae2d-b588066ddfa7`::Disk hdd stats not available >GuestMonitor-scale_10::DEBUG::2014-07-10 09:05:03,391::vm::676::vm.Vm::(_getDiskStats) vmId=`e2b026e7-b32b-4f60-ae2d-b588066ddfa7`::Disk hdc stats not available >GuestMonitor-scale_10::DEBUG::2014-07-10 09:05:03,391::vm::676::vm.Vm::(_getDiskStats) vmId=`e2b026e7-b32b-4f60-ae2d-b588066ddfa7`::Disk vda stats not available >GuestMonitor-scale_10::DEBUG::2014-07-10 09:05:03,391::vm::715::vm.Vm::(_getDiskLatency) vmId=`e2b026e7-b32b-4f60-ae2d-b588066ddfa7`::Disk hdd latency not available >GuestMonitor-scale_10::DEBUG::2014-07-10 09:05:03,391::vm::715::vm.Vm::(_getDiskLatency) vmId=`e2b026e7-b32b-4f60-ae2d-b588066ddfa7`::Disk hdc latency not available >GuestMonitor-scale_10::DEBUG::2014-07-10 09:05:03,391::vm::715::vm.Vm::(_getDiskLatency) vmId=`e2b026e7-b32b-4f60-ae2d-b588066ddfa7`::Disk vda latency not available >GuestMonitor-scale_10::DEBUG::2014-07-10 09:05:03,392::vm::676::vm.Vm::(_getDiskStats) vmId=`e2b026e7-b32b-4f60-ae2d-b588066ddfa7`::Disk hdd stats not available >GuestMonitor-scale_10::DEBUG::2014-07-10 09:05:03,392::vm::676::vm.Vm::(_getDiskStats) vmId=`e2b026e7-b32b-4f60-ae2d-b588066ddfa7`::Disk hdc stats not available >GuestMonitor-scale_10::DEBUG::2014-07-10 09:05:03,392::vm::676::vm.Vm::(_getDiskStats) vmId=`e2b026e7-b32b-4f60-ae2d-b588066ddfa7`::Disk vda stats not available >GuestMonitor-scale_10::DEBUG::2014-07-10 09:05:03,392::vm::715::vm.Vm::(_getDiskLatency) vmId=`e2b026e7-b32b-4f60-ae2d-b588066ddfa7`::Disk hdd latency not available >GuestMonitor-scale_10::DEBUG::2014-07-10 09:05:03,392::vm::715::vm.Vm::(_getDiskLatency) vmId=`e2b026e7-b32b-4f60-ae2d-b588066ddfa7`::Disk hdc latency not available >GuestMonitor-scale_10::DEBUG::2014-07-10 09:05:03,393::vm::715::vm.Vm::(_getDiskLatency) vmId=`e2b026e7-b32b-4f60-ae2d-b588066ddfa7`::Disk vda latency not available >Dummy-33::DEBUG::2014-07-10 09:05:04,038::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:05:04,131::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0323598 s, 31.6 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 09:05:04,369::task::595::TaskManager.Task::(_updateState) Task=`7128e048-5523-429c-a8f5-db201086032e`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 09:05:04,370::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::INFO::2014-07-10 09:05:04,370::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000580618', 'lastCheck': '4.5', 'valid': True}, '6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000474671', 'lastCheck': '9.3', 'valid': True}} >Thread-14::DEBUG::2014-07-10 09:05:04,371::task::1185::TaskManager.Task::(prepare) Task=`7128e048-5523-429c-a8f5-db201086032e`::finished: {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000580618', 'lastCheck': '4.5', 'valid': True}, '6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000474671', 'lastCheck': '9.3', 'valid': True}} >Thread-14::DEBUG::2014-07-10 09:05:04,371::task::595::TaskManager.Task::(_updateState) Task=`7128e048-5523-429c-a8f5-db201086032e`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 09:05:04,371::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 09:05:04,371::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 09:05:04,372::task::990::TaskManager.Task::(_decref) Task=`7128e048-5523-429c-a8f5-db201086032e`::ref 0 aborting False >Thread-14::DEBUG::2014-07-10 09:05:04,390::vm::676::vm.Vm::(_getDiskStats) vmId=`e2b026e7-b32b-4f60-ae2d-b588066ddfa7`::Disk hdd stats not available >Thread-14::DEBUG::2014-07-10 09:05:04,390::vm::676::vm.Vm::(_getDiskStats) vmId=`e2b026e7-b32b-4f60-ae2d-b588066ddfa7`::Disk hdc stats not available >Thread-14::DEBUG::2014-07-10 09:05:04,390::vm::676::vm.Vm::(_getDiskStats) vmId=`e2b026e7-b32b-4f60-ae2d-b588066ddfa7`::Disk vda stats not available >Thread-14::DEBUG::2014-07-10 09:05:04,390::vm::715::vm.Vm::(_getDiskLatency) vmId=`e2b026e7-b32b-4f60-ae2d-b588066ddfa7`::Disk hdd latency not available >Thread-14::DEBUG::2014-07-10 09:05:04,391::vm::715::vm.Vm::(_getDiskLatency) vmId=`e2b026e7-b32b-4f60-ae2d-b588066ddfa7`::Disk hdc latency not available >Thread-14::DEBUG::2014-07-10 09:05:04,391::vm::715::vm.Vm::(_getDiskLatency) vmId=`e2b026e7-b32b-4f60-ae2d-b588066ddfa7`::Disk vda latency not available >Thread-14::DEBUG::2014-07-10 09:05:04,493::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-14::DEBUG::2014-07-10 09:05:04,494::task::595::TaskManager.Task::(_updateState) Task=`d4f4b86b-5aec-4a8c-82bb-fb03bb82acf7`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 09:05:04,494::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-14::INFO::2014-07-10 09:05:04,495::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:05:04,495::task::1185::TaskManager.Task::(prepare) Task=`d4f4b86b-5aec-4a8c-82bb-fb03bb82acf7`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:05:04,495::task::595::TaskManager.Task::(_updateState) Task=`d4f4b86b-5aec-4a8c-82bb-fb03bb82acf7`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 09:05:04,495::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 09:05:04,495::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 09:05:04,496::task::990::TaskManager.Task::(_decref) Task=`d4f4b86b-5aec-4a8c-82bb-fb03bb82acf7`::ref 0 aborting False >Thread-34::DEBUG::2014-07-10 09:05:04,539::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-34::DEBUG::2014-07-10 09:05:04,540::task::595::TaskManager.Task::(_updateState) Task=`17cdf8f4-edfc-4981-af74-baa9fcaad6f9`::moving from state init -> state preparing >Thread-34::INFO::2014-07-10 09:05:04,540::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-34::DEBUG::2014-07-10 09:05:04,541::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`63cbf8dc-eb2b-45ec-b2ec-05724922b9b5`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-10 09:05:04,541::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' for lock type 'shared' >Thread-34::DEBUG::2014-07-10 09:05:04,541::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-10 09:05:04,541::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`63cbf8dc-eb2b-45ec-b2ec-05724922b9b5`::Granted request >Thread-34::DEBUG::2014-07-10 09:05:04,542::task::827::TaskManager.Task::(resourceAcquired) Task=`17cdf8f4-edfc-4981-af74-baa9fcaad6f9`::_resourcesAcquired: Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee (shared) >Thread-34::DEBUG::2014-07-10 09:05:04,542::task::990::TaskManager.Task::(_decref) Task=`17cdf8f4-edfc-4981-af74-baa9fcaad6f9`::ref 1 aborting False >Thread-34::INFO::2014-07-10 09:05:04,543::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532067385344', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:05:04,544::task::1185::TaskManager.Task::(prepare) Task=`17cdf8f4-edfc-4981-af74-baa9fcaad6f9`::finished: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532067385344', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:05:04,544::task::595::TaskManager.Task::(_updateState) Task=`17cdf8f4-edfc-4981-af74-baa9fcaad6f9`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-10 09:05:04,544::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee': < ResourceRef 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-10 09:05:04,544::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-10 09:05:04,544::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' >Thread-34::DEBUG::2014-07-10 09:05:04,545::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' (0 active users) >Thread-34::DEBUG::2014-07-10 09:05:04,545::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-10 09:05:04,545::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', Clearing records. >Thread-34::DEBUG::2014-07-10 09:05:04,545::task::990::TaskManager.Task::(_decref) Task=`17cdf8f4-edfc-4981-af74-baa9fcaad6f9`::ref 0 aborting False >Thread-40::DEBUG::2014-07-10 09:05:05,108::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lion.qa.lab.tlv.redhat.com:_export_yuri2_backup2/6a70504d-00df-4869-8695-0f442053f6b6/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-40::DEBUG::2014-07-10 09:05:05,133::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n369 bytes (369 B) copied, 0.000520297 s, 709 kB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:05:06,146::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:05:06,237::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.033742 s, 30.3 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:05:08,253::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:05:08,411::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0717868 s, 14.3 MB/s\n'; <rc> = 0 >GuestMonitor-scale_10::DEBUG::2014-07-10 09:05:08,412::vm::676::vm.Vm::(_getDiskStats) vmId=`e2b026e7-b32b-4f60-ae2d-b588066ddfa7`::Disk hdd stats not available >GuestMonitor-scale_10::DEBUG::2014-07-10 09:05:08,428::vm::676::vm.Vm::(_getDiskStats) vmId=`e2b026e7-b32b-4f60-ae2d-b588066ddfa7`::Disk hdc stats not available >GuestMonitor-scale_10::DEBUG::2014-07-10 09:05:08,440::vm::676::vm.Vm::(_getDiskStats) vmId=`e2b026e7-b32b-4f60-ae2d-b588066ddfa7`::Disk vda stats not available >GuestMonitor-scale_10::DEBUG::2014-07-10 09:05:08,448::vm::715::vm.Vm::(_getDiskLatency) vmId=`e2b026e7-b32b-4f60-ae2d-b588066ddfa7`::Disk hdd latency not available >GuestMonitor-scale_10::DEBUG::2014-07-10 09:05:08,459::vm::715::vm.Vm::(_getDiskLatency) vmId=`e2b026e7-b32b-4f60-ae2d-b588066ddfa7`::Disk hdc latency not available >GuestMonitor-scale_10::DEBUG::2014-07-10 09:05:08,469::vm::715::vm.Vm::(_getDiskLatency) vmId=`e2b026e7-b32b-4f60-ae2d-b588066ddfa7`::Disk vda latency not available >GuestMonitor-scale_10::DEBUG::2014-07-10 09:05:08,493::vm::676::vm.Vm::(_getDiskStats) vmId=`e2b026e7-b32b-4f60-ae2d-b588066ddfa7`::Disk hdd stats not available >GuestMonitor-scale_10::DEBUG::2014-07-10 09:05:08,503::vm::676::vm.Vm::(_getDiskStats) vmId=`e2b026e7-b32b-4f60-ae2d-b588066ddfa7`::Disk hdc stats not available >GuestMonitor-scale_10::DEBUG::2014-07-10 09:05:08,510::vm::676::vm.Vm::(_getDiskStats) vmId=`e2b026e7-b32b-4f60-ae2d-b588066ddfa7`::Disk vda stats not available >GuestMonitor-scale_10::DEBUG::2014-07-10 09:05:08,518::vm::715::vm.Vm::(_getDiskLatency) vmId=`e2b026e7-b32b-4f60-ae2d-b588066ddfa7`::Disk hdd latency not available >GuestMonitor-scale_10::DEBUG::2014-07-10 09:05:08,521::vm::715::vm.Vm::(_getDiskLatency) vmId=`e2b026e7-b32b-4f60-ae2d-b588066ddfa7`::Disk hdc latency not available >GuestMonitor-scale_10::DEBUG::2014-07-10 09:05:08,534::vm::715::vm.Vm::(_getDiskLatency) vmId=`e2b026e7-b32b-4f60-ae2d-b588066ddfa7`::Disk vda latency not available >Thread-57::DEBUG::2014-07-10 09:05:09,817::task::595::TaskManager.Task::(_updateState) Task=`98cc6578-9450-480d-8e12-d2120d73e60b`::moving from state init -> state preparing >Thread-57::INFO::2014-07-10 09:05:09,818::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='b6f6c0da-e67f-4902-b9ac-3069571a42fe', volUUID='c4cd1da8-05b7-45e0-80b1-1183d21443d9', options=None) >Thread-57::INFO::2014-07-10 09:05:09,818::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-57::DEBUG::2014-07-10 09:05:09,819::task::1185::TaskManager.Task::(prepare) Task=`98cc6578-9450-480d-8e12-d2120d73e60b`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-57::DEBUG::2014-07-10 09:05:09,819::task::595::TaskManager.Task::(_updateState) Task=`98cc6578-9450-480d-8e12-d2120d73e60b`::moving from state preparing -> state finished >Thread-57::DEBUG::2014-07-10 09:05:09,819::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-57::DEBUG::2014-07-10 09:05:09,819::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-57::DEBUG::2014-07-10 09:05:09,819::task::990::TaskManager.Task::(_decref) Task=`98cc6578-9450-480d-8e12-d2120d73e60b`::ref 0 aborting False >Thread-18::DEBUG::2014-07-10 09:05:09,870::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/metadata bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-10 09:05:09,892::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000466368 s, 8.8 MB/s\n'; <rc> = 0 >Thread-67::DEBUG::2014-07-10 09:05:10,666::task::595::TaskManager.Task::(_updateState) Task=`a27de443-8db7-4bd9-9005-8168eb8dac78`::moving from state init -> state preparing >Thread-67::INFO::2014-07-10 09:05:10,669::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='f30c2cb7-a43a-4bf5-82b5-cfe07336f65c', volUUID='b0fbb3c9-55af-4a3a-95ad-fc56a80b9cf5', options=None) >Thread-67::INFO::2014-07-10 09:05:10,669::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-67::DEBUG::2014-07-10 09:05:10,669::task::1185::TaskManager.Task::(prepare) Task=`a27de443-8db7-4bd9-9005-8168eb8dac78`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-67::DEBUG::2014-07-10 09:05:10,670::task::595::TaskManager.Task::(_updateState) Task=`a27de443-8db7-4bd9-9005-8168eb8dac78`::moving from state preparing -> state finished >Thread-67::DEBUG::2014-07-10 09:05:10,670::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-67::DEBUG::2014-07-10 09:05:10,670::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-67::DEBUG::2014-07-10 09:05:10,670::task::990::TaskManager.Task::(_decref) Task=`a27de443-8db7-4bd9-9005-8168eb8dac78`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 09:05:10,680::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:05:10,814::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0706374 s, 14.5 MB/s\n'; <rc> = 0 >Thread-48::DEBUG::2014-07-10 09:05:10,842::task::595::TaskManager.Task::(_updateState) Task=`18aa0ecc-0dcb-42a0-9041-8a83cf498b92`::moving from state init -> state preparing >Thread-48::INFO::2014-07-10 09:05:10,842::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='0cd7d6ce-f497-4243-a690-c57744861eea', volUUID='10b6a7dd-dc6c-43fa-ba17-92e4331b0e0b', options=None) >Thread-48::INFO::2014-07-10 09:05:10,843::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-48::DEBUG::2014-07-10 09:05:10,843::task::1185::TaskManager.Task::(prepare) Task=`18aa0ecc-0dcb-42a0-9041-8a83cf498b92`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-48::DEBUG::2014-07-10 09:05:10,843::task::595::TaskManager.Task::(_updateState) Task=`18aa0ecc-0dcb-42a0-9041-8a83cf498b92`::moving from state preparing -> state finished >Thread-48::DEBUG::2014-07-10 09:05:10,843::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-48::DEBUG::2014-07-10 09:05:10,844::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-48::DEBUG::2014-07-10 09:05:10,844::task::990::TaskManager.Task::(_decref) Task=`18aa0ecc-0dcb-42a0-9041-8a83cf498b92`::ref 0 aborting False >Thread-76::DEBUG::2014-07-10 09:05:12,191::task::595::TaskManager.Task::(_updateState) Task=`dd24854a-d325-44ef-9248-132d7c8c0153`::moving from state init -> state preparing >Thread-76::INFO::2014-07-10 09:05:12,191::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='e4c65229-4247-4b33-b72a-f1d5ce72ad05', volUUID='cad94284-3ca9-4c30-933d-997f4460309e', options=None) >Thread-76::INFO::2014-07-10 09:05:12,192::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-76::DEBUG::2014-07-10 09:05:12,192::task::1185::TaskManager.Task::(prepare) Task=`dd24854a-d325-44ef-9248-132d7c8c0153`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-76::DEBUG::2014-07-10 09:05:12,192::task::595::TaskManager.Task::(_updateState) Task=`dd24854a-d325-44ef-9248-132d7c8c0153`::moving from state preparing -> state finished >Thread-76::DEBUG::2014-07-10 09:05:12,192::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-76::DEBUG::2014-07-10 09:05:12,193::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-76::DEBUG::2014-07-10 09:05:12,193::task::990::TaskManager.Task::(_decref) Task=`dd24854a-d325-44ef-9248-132d7c8c0153`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 09:05:12,829::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:05:12,923::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0321927 s, 31.8 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 09:05:14,602::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-14::DEBUG::2014-07-10 09:05:14,603::task::595::TaskManager.Task::(_updateState) Task=`07b23880-a1f6-4702-94ba-30b218672cdf`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 09:05:14,603::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-14::INFO::2014-07-10 09:05:14,604::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:05:14,604::task::1185::TaskManager.Task::(prepare) Task=`07b23880-a1f6-4702-94ba-30b218672cdf`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:05:14,604::task::595::TaskManager.Task::(_updateState) Task=`07b23880-a1f6-4702-94ba-30b218672cdf`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 09:05:14,605::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 09:05:14,605::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 09:05:14,605::task::990::TaskManager.Task::(_decref) Task=`07b23880-a1f6-4702-94ba-30b218672cdf`::ref 0 aborting False >Thread-34::DEBUG::2014-07-10 09:05:14,609::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-34::DEBUG::2014-07-10 09:05:14,610::task::595::TaskManager.Task::(_updateState) Task=`4ebc4ad5-9282-412e-acf5-9a8ef91bd75c`::moving from state init -> state preparing >Thread-34::INFO::2014-07-10 09:05:14,610::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-34::DEBUG::2014-07-10 09:05:14,611::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`38cc0491-51ef-4fd8-acb5-9042b3703f52`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-10 09:05:14,611::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' for lock type 'shared' >Thread-34::DEBUG::2014-07-10 09:05:14,611::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-10 09:05:14,611::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`38cc0491-51ef-4fd8-acb5-9042b3703f52`::Granted request >Thread-34::DEBUG::2014-07-10 09:05:14,612::task::827::TaskManager.Task::(resourceAcquired) Task=`4ebc4ad5-9282-412e-acf5-9a8ef91bd75c`::_resourcesAcquired: Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee (shared) >Thread-34::DEBUG::2014-07-10 09:05:14,612::task::990::TaskManager.Task::(_decref) Task=`4ebc4ad5-9282-412e-acf5-9a8ef91bd75c`::ref 1 aborting False >Thread-34::INFO::2014-07-10 09:05:14,613::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532067385344', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:05:14,614::task::1185::TaskManager.Task::(prepare) Task=`4ebc4ad5-9282-412e-acf5-9a8ef91bd75c`::finished: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532067385344', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:05:14,614::task::595::TaskManager.Task::(_updateState) Task=`4ebc4ad5-9282-412e-acf5-9a8ef91bd75c`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-10 09:05:14,614::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee': < ResourceRef 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-10 09:05:14,614::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-10 09:05:14,614::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' >Thread-34::DEBUG::2014-07-10 09:05:14,615::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' (0 active users) >Thread-34::DEBUG::2014-07-10 09:05:14,615::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-10 09:05:14,615::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', Clearing records. >Thread-34::DEBUG::2014-07-10 09:05:14,615::task::990::TaskManager.Task::(_decref) Task=`4ebc4ad5-9282-412e-acf5-9a8ef91bd75c`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 09:05:14,938::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:05:15,025::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0266535 s, 38.4 MB/s\n'; <rc> = 0 >Thread-40::DEBUG::2014-07-10 09:05:15,167::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lion.qa.lab.tlv.redhat.com:_export_yuri2_backup2/6a70504d-00df-4869-8695-0f442053f6b6/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-40::DEBUG::2014-07-10 09:05:15,186::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n369 bytes (369 B) copied, 0.000521094 s, 708 kB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:05:17,041::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:05:17,137::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0359155 s, 28.5 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:05:19,152::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:05:19,240::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0273772 s, 37.4 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 09:05:19,589::task::595::TaskManager.Task::(_updateState) Task=`6abf405a-7258-4f5c-9d64-9dc6b0abaebf`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 09:05:19,590::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::INFO::2014-07-10 09:05:19,590::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000466368', 'lastCheck': '9.7', 'valid': True}, '6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000521094', 'lastCheck': '4.4', 'valid': True}} >Thread-14::DEBUG::2014-07-10 09:05:19,590::task::1185::TaskManager.Task::(prepare) Task=`6abf405a-7258-4f5c-9d64-9dc6b0abaebf`::finished: {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000466368', 'lastCheck': '9.7', 'valid': True}, '6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000521094', 'lastCheck': '4.4', 'valid': True}} >Thread-14::DEBUG::2014-07-10 09:05:19,591::task::595::TaskManager.Task::(_updateState) Task=`6abf405a-7258-4f5c-9d64-9dc6b0abaebf`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 09:05:19,591::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 09:05:19,591::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 09:05:19,591::task::990::TaskManager.Task::(_decref) Task=`6abf405a-7258-4f5c-9d64-9dc6b0abaebf`::ref 0 aborting False >Thread-18::DEBUG::2014-07-10 09:05:19,924::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/metadata bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-10 09:05:19,947::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000714151 s, 5.7 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:05:21,256::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:05:21,343::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0297062 s, 34.5 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:05:23,359::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:05:23,450::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0321891 s, 31.8 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 09:05:24,671::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-14::DEBUG::2014-07-10 09:05:24,673::task::595::TaskManager.Task::(_updateState) Task=`8969c369-824d-4bbb-b0f8-8750578d832c`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 09:05:24,673::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-14::INFO::2014-07-10 09:05:24,674::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:05:24,674::task::1185::TaskManager.Task::(prepare) Task=`8969c369-824d-4bbb-b0f8-8750578d832c`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:05:24,674::task::595::TaskManager.Task::(_updateState) Task=`8969c369-824d-4bbb-b0f8-8750578d832c`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 09:05:24,674::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 09:05:24,674::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 09:05:24,674::task::990::TaskManager.Task::(_decref) Task=`8969c369-824d-4bbb-b0f8-8750578d832c`::ref 0 aborting False >Thread-34::DEBUG::2014-07-10 09:05:24,679::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-34::DEBUG::2014-07-10 09:05:24,679::task::595::TaskManager.Task::(_updateState) Task=`1ddbb579-b8ce-4163-994a-225cf7cbd693`::moving from state init -> state preparing >Thread-34::INFO::2014-07-10 09:05:24,679::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-34::DEBUG::2014-07-10 09:05:24,680::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`3f463dd2-7473-48d6-99b2-a8399429d500`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-10 09:05:24,680::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' for lock type 'shared' >Thread-34::DEBUG::2014-07-10 09:05:24,680::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-10 09:05:24,680::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`3f463dd2-7473-48d6-99b2-a8399429d500`::Granted request >Thread-34::DEBUG::2014-07-10 09:05:24,681::task::827::TaskManager.Task::(resourceAcquired) Task=`1ddbb579-b8ce-4163-994a-225cf7cbd693`::_resourcesAcquired: Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee (shared) >Thread-34::DEBUG::2014-07-10 09:05:24,681::task::990::TaskManager.Task::(_decref) Task=`1ddbb579-b8ce-4163-994a-225cf7cbd693`::ref 1 aborting False >Thread-34::INFO::2014-07-10 09:05:24,682::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532067385344', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:05:24,682::task::1185::TaskManager.Task::(prepare) Task=`1ddbb579-b8ce-4163-994a-225cf7cbd693`::finished: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532067385344', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:05:24,683::task::595::TaskManager.Task::(_updateState) Task=`1ddbb579-b8ce-4163-994a-225cf7cbd693`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-10 09:05:24,683::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee': < ResourceRef 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-10 09:05:24,683::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-10 09:05:24,683::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' >Thread-34::DEBUG::2014-07-10 09:05:24,683::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' (0 active users) >Thread-34::DEBUG::2014-07-10 09:05:24,683::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-10 09:05:24,684::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', Clearing records. >Thread-34::DEBUG::2014-07-10 09:05:24,684::task::990::TaskManager.Task::(_decref) Task=`1ddbb579-b8ce-4163-994a-225cf7cbd693`::ref 0 aborting False >Thread-40::DEBUG::2014-07-10 09:05:25,213::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lion.qa.lab.tlv.redhat.com:_export_yuri2_backup2/6a70504d-00df-4869-8695-0f442053f6b6/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-40::DEBUG::2014-07-10 09:05:25,233::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n369 bytes (369 B) copied, 0.000548743 s, 672 kB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:05:25,551::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:05:25,649::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0352349 s, 29.1 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:05:27,675::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:05:27,767::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0304563 s, 33.6 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:05:29,782::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Thread-70::DEBUG::2014-07-10 09:05:29,823::task::595::TaskManager.Task::(_updateState) Task=`9793486f-e5b2-423e-bc14-bae70e4df134`::moving from state init -> state preparing >Thread-70::INFO::2014-07-10 09:05:29,827::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='cfaeead2-7caa-467c-b389-c89840ae6605', volUUID='567fe32d-31a6-4ff6-90f3-fd6a656fbecc', options=None) >Thread-70::INFO::2014-07-10 09:05:29,832::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-70::DEBUG::2014-07-10 09:05:29,839::task::1185::TaskManager.Task::(prepare) Task=`9793486f-e5b2-423e-bc14-bae70e4df134`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-70::DEBUG::2014-07-10 09:05:29,847::task::595::TaskManager.Task::(_updateState) Task=`9793486f-e5b2-423e-bc14-bae70e4df134`::moving from state preparing -> state finished >Thread-70::DEBUG::2014-07-10 09:05:29,853::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-70::DEBUG::2014-07-10 09:05:29,861::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-70::DEBUG::2014-07-10 09:05:29,869::task::990::TaskManager.Task::(_decref) Task=`9793486f-e5b2-423e-bc14-bae70e4df134`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 09:05:29,930::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0952657 s, 10.7 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-10 09:05:29,975::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/metadata bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-10 09:05:29,997::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000606566 s, 6.8 MB/s\n'; <rc> = 0 >Thread-60::DEBUG::2014-07-10 09:05:30,646::task::595::TaskManager.Task::(_updateState) Task=`a8194806-107f-46ea-a0cb-38d6bc9e99f6`::moving from state init -> state preparing >Thread-60::INFO::2014-07-10 09:05:30,647::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='b034d5b0-e1e0-4011-b49b-4d45ddb11556', volUUID='3d7f62b5-328f-4d8e-8b69-873cfb5ae14d', options=None) >Thread-60::INFO::2014-07-10 09:05:30,647::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-60::DEBUG::2014-07-10 09:05:30,647::task::1185::TaskManager.Task::(prepare) Task=`a8194806-107f-46ea-a0cb-38d6bc9e99f6`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-60::DEBUG::2014-07-10 09:05:30,648::task::595::TaskManager.Task::(_updateState) Task=`a8194806-107f-46ea-a0cb-38d6bc9e99f6`::moving from state preparing -> state finished >Thread-60::DEBUG::2014-07-10 09:05:30,648::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-60::DEBUG::2014-07-10 09:05:30,648::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-60::DEBUG::2014-07-10 09:05:30,648::task::990::TaskManager.Task::(_decref) Task=`a8194806-107f-46ea-a0cb-38d6bc9e99f6`::ref 0 aborting False >Thread-51::DEBUG::2014-07-10 09:05:30,940::task::595::TaskManager.Task::(_updateState) Task=`f58c452b-4a93-46b6-a298-96e179bc99f0`::moving from state init -> state preparing >Thread-51::INFO::2014-07-10 09:05:30,940::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='76fdb054-02cd-42ed-9721-b3e65b34c3a4', volUUID='022dfe46-2cf7-4915-80b3-883158e3ca83', options=None) >Thread-51::INFO::2014-07-10 09:05:30,941::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-51::DEBUG::2014-07-10 09:05:30,941::task::1185::TaskManager.Task::(prepare) Task=`f58c452b-4a93-46b6-a298-96e179bc99f0`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-51::DEBUG::2014-07-10 09:05:30,941::task::595::TaskManager.Task::(_updateState) Task=`f58c452b-4a93-46b6-a298-96e179bc99f0`::moving from state preparing -> state finished >Thread-51::DEBUG::2014-07-10 09:05:30,941::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-51::DEBUG::2014-07-10 09:05:30,941::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-51::DEBUG::2014-07-10 09:05:30,942::task::990::TaskManager.Task::(_decref) Task=`f58c452b-4a93-46b6-a298-96e179bc99f0`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 09:05:31,951::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:05:32,050::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0378807 s, 27.0 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:05:34,065::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:05:34,155::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0311468 s, 32.9 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 09:05:34,712::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-14::DEBUG::2014-07-10 09:05:34,713::task::595::TaskManager.Task::(_updateState) Task=`dc0d433d-c134-4625-9410-554a15cc6823`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 09:05:34,714::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-14::INFO::2014-07-10 09:05:34,714::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:05:34,714::task::1185::TaskManager.Task::(prepare) Task=`dc0d433d-c134-4625-9410-554a15cc6823`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:05:34,715::task::595::TaskManager.Task::(_updateState) Task=`dc0d433d-c134-4625-9410-554a15cc6823`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 09:05:34,715::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 09:05:34,715::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 09:05:34,715::task::990::TaskManager.Task::(_decref) Task=`dc0d433d-c134-4625-9410-554a15cc6823`::ref 0 aborting False >Thread-34::DEBUG::2014-07-10 09:05:34,720::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-34::DEBUG::2014-07-10 09:05:34,720::task::595::TaskManager.Task::(_updateState) Task=`cb053662-b2b0-4e6f-86d1-b5a4d62b6105`::moving from state init -> state preparing >Thread-34::INFO::2014-07-10 09:05:34,720::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-34::DEBUG::2014-07-10 09:05:34,721::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`f0a3155a-0f5f-4a5b-a088-30cee7c3ac15`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-10 09:05:34,721::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' for lock type 'shared' >Thread-34::DEBUG::2014-07-10 09:05:34,722::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-10 09:05:34,722::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`f0a3155a-0f5f-4a5b-a088-30cee7c3ac15`::Granted request >Thread-34::DEBUG::2014-07-10 09:05:34,722::task::827::TaskManager.Task::(resourceAcquired) Task=`cb053662-b2b0-4e6f-86d1-b5a4d62b6105`::_resourcesAcquired: Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee (shared) >Thread-34::DEBUG::2014-07-10 09:05:34,722::task::990::TaskManager.Task::(_decref) Task=`cb053662-b2b0-4e6f-86d1-b5a4d62b6105`::ref 1 aborting False >Thread-34::INFO::2014-07-10 09:05:34,724::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532067385344', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:05:34,725::task::1185::TaskManager.Task::(prepare) Task=`cb053662-b2b0-4e6f-86d1-b5a4d62b6105`::finished: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532067385344', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:05:34,725::task::595::TaskManager.Task::(_updateState) Task=`cb053662-b2b0-4e6f-86d1-b5a4d62b6105`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-10 09:05:34,725::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee': < ResourceRef 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-10 09:05:34,725::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-10 09:05:34,726::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' >Thread-34::DEBUG::2014-07-10 09:05:34,726::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' (0 active users) >Thread-34::DEBUG::2014-07-10 09:05:34,726::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-10 09:05:34,726::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', Clearing records. >Thread-34::DEBUG::2014-07-10 09:05:34,726::task::990::TaskManager.Task::(_decref) Task=`cb053662-b2b0-4e6f-86d1-b5a4d62b6105`::ref 0 aborting False >Thread-14::DEBUG::2014-07-10 09:05:34,862::task::595::TaskManager.Task::(_updateState) Task=`647f2016-8756-49b8-a05c-cf22e0d60b69`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 09:05:34,862::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::INFO::2014-07-10 09:05:34,863::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000606566', 'lastCheck': '4.8', 'valid': True}, '6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000548743', 'lastCheck': '9.6', 'valid': True}} >Thread-14::DEBUG::2014-07-10 09:05:34,863::task::1185::TaskManager.Task::(prepare) Task=`647f2016-8756-49b8-a05c-cf22e0d60b69`::finished: {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000606566', 'lastCheck': '4.8', 'valid': True}, '6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000548743', 'lastCheck': '9.6', 'valid': True}} >Thread-14::DEBUG::2014-07-10 09:05:34,863::task::595::TaskManager.Task::(_updateState) Task=`647f2016-8756-49b8-a05c-cf22e0d60b69`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 09:05:34,863::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 09:05:34,864::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 09:05:34,864::task::990::TaskManager.Task::(_decref) Task=`647f2016-8756-49b8-a05c-cf22e0d60b69`::ref 0 aborting False >Thread-40::DEBUG::2014-07-10 09:05:35,267::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lion.qa.lab.tlv.redhat.com:_export_yuri2_backup2/6a70504d-00df-4869-8695-0f442053f6b6/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-40::DEBUG::2014-07-10 09:05:35,285::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n369 bytes (369 B) copied, 0.000420545 s, 877 kB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:05:36,171::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:05:36,266::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0352067 s, 29.1 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:05:38,280::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:05:38,442::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0366231 s, 28.0 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-10 09:05:40,026::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/metadata bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-10 09:05:40,048::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000577706 s, 7.1 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:05:40,458::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:05:40,568::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0515227 s, 19.9 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:05:42,587::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:05:42,716::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0685445 s, 14.9 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:05:44,731::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Thread-14::DEBUG::2014-07-10 09:05:44,781::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-14::DEBUG::2014-07-10 09:05:44,787::task::595::TaskManager.Task::(_updateState) Task=`c6686461-46c6-4302-8eea-8ae7d368b0a8`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 09:05:44,790::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-14::INFO::2014-07-10 09:05:44,794::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:05:44,796::task::1185::TaskManager.Task::(prepare) Task=`c6686461-46c6-4302-8eea-8ae7d368b0a8`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:05:44,798::task::595::TaskManager.Task::(_updateState) Task=`c6686461-46c6-4302-8eea-8ae7d368b0a8`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 09:05:44,800::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 09:05:44,803::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 09:05:44,805::task::990::TaskManager.Task::(_decref) Task=`c6686461-46c6-4302-8eea-8ae7d368b0a8`::ref 0 aborting False >Thread-34::DEBUG::2014-07-10 09:05:44,818::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-34::DEBUG::2014-07-10 09:05:44,821::task::595::TaskManager.Task::(_updateState) Task=`c125a3ed-b2af-4c1b-90f0-e6ebc8de500e`::moving from state init -> state preparing >Thread-34::INFO::2014-07-10 09:05:44,824::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-34::DEBUG::2014-07-10 09:05:44,830::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`08e566f3-d3b5-414a-8e7a-99fb492ac27b`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-10 09:05:44,832::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' for lock type 'shared' >Thread-34::DEBUG::2014-07-10 09:05:44,835::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-10 09:05:44,837::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`08e566f3-d3b5-414a-8e7a-99fb492ac27b`::Granted request >Thread-34::DEBUG::2014-07-10 09:05:44,842::task::827::TaskManager.Task::(resourceAcquired) Task=`c125a3ed-b2af-4c1b-90f0-e6ebc8de500e`::_resourcesAcquired: Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee (shared) >Thread-34::DEBUG::2014-07-10 09:05:44,844::task::990::TaskManager.Task::(_decref) Task=`c125a3ed-b2af-4c1b-90f0-e6ebc8de500e`::ref 1 aborting False >Thread-34::INFO::2014-07-10 09:05:44,855::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532067385344', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:05:44,857::task::1185::TaskManager.Task::(prepare) Task=`c125a3ed-b2af-4c1b-90f0-e6ebc8de500e`::finished: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532067385344', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:05:44,862::task::595::TaskManager.Task::(_updateState) Task=`c125a3ed-b2af-4c1b-90f0-e6ebc8de500e`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-10 09:05:44,864::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee': < ResourceRef 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-10 09:05:44,869::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-10 09:05:44,878::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' >Thread-34::DEBUG::2014-07-10 09:05:44,885::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' (0 active users) >Thread-34::DEBUG::2014-07-10 09:05:44,889::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-10 09:05:44,893::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', Clearing records. >Thread-34::DEBUG::2014-07-10 09:05:44,901::task::990::TaskManager.Task::(_decref) Task=`c125a3ed-b2af-4c1b-90f0-e6ebc8de500e`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 09:05:44,949::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.168936 s, 6.1 MB/s\n'; <rc> = 0 >Thread-40::DEBUG::2014-07-10 09:05:45,316::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lion.qa.lab.tlv.redhat.com:_export_yuri2_backup2/6a70504d-00df-4869-8695-0f442053f6b6/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-40::DEBUG::2014-07-10 09:05:45,337::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n369 bytes (369 B) copied, 0.000366081 s, 1.0 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:05:46,959::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:05:47,078::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0348567 s, 29.4 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:05:49,094::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:05:49,247::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0311317 s, 32.9 MB/s\n'; <rc> = 0 >Thread-64::DEBUG::2014-07-10 09:05:49,934::task::595::TaskManager.Task::(_updateState) Task=`e2ac32f8-5c2a-41d2-8452-0678141c8b4d`::moving from state init -> state preparing >Thread-64::INFO::2014-07-10 09:05:49,935::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='aa20346a-4d3a-4e07-b8e1-52c0ebe4168c', volUUID='58fefce2-9bce-4bff-8949-8c6ce8122b27', options=None) >Thread-64::INFO::2014-07-10 09:05:49,935::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-64::DEBUG::2014-07-10 09:05:49,935::task::1185::TaskManager.Task::(prepare) Task=`e2ac32f8-5c2a-41d2-8452-0678141c8b4d`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-64::DEBUG::2014-07-10 09:05:49,936::task::595::TaskManager.Task::(_updateState) Task=`e2ac32f8-5c2a-41d2-8452-0678141c8b4d`::moving from state preparing -> state finished >Thread-64::DEBUG::2014-07-10 09:05:49,936::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-64::DEBUG::2014-07-10 09:05:49,936::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-64::DEBUG::2014-07-10 09:05:49,936::task::990::TaskManager.Task::(_decref) Task=`e2ac32f8-5c2a-41d2-8452-0678141c8b4d`::ref 0 aborting False >Thread-14::DEBUG::2014-07-10 09:05:50,068::task::595::TaskManager.Task::(_updateState) Task=`e20fdd9f-b65f-4767-9cd4-9b3fc33ee2f2`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 09:05:50,068::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::INFO::2014-07-10 09:05:50,069::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000577706', 'lastCheck': '10.0', 'valid': True}, '6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000366081', 'lastCheck': '4.7', 'valid': True}} >Thread-14::DEBUG::2014-07-10 09:05:50,069::task::1185::TaskManager.Task::(prepare) Task=`e20fdd9f-b65f-4767-9cd4-9b3fc33ee2f2`::finished: {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000577706', 'lastCheck': '10.0', 'valid': True}, '6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000366081', 'lastCheck': '4.7', 'valid': True}} >Thread-14::DEBUG::2014-07-10 09:05:50,069::task::595::TaskManager.Task::(_updateState) Task=`e20fdd9f-b65f-4767-9cd4-9b3fc33ee2f2`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 09:05:50,069::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 09:05:50,070::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 09:05:50,070::task::990::TaskManager.Task::(_decref) Task=`e20fdd9f-b65f-4767-9cd4-9b3fc33ee2f2`::ref 0 aborting False >Thread-18::DEBUG::2014-07-10 09:05:50,080::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/metadata bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-10 09:05:50,120::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000626786 s, 6.5 MB/s\n'; <rc> = 0 >Thread-73::DEBUG::2014-07-10 09:05:50,791::task::595::TaskManager.Task::(_updateState) Task=`1122fe31-ae40-4bb7-a9aa-b08ba6987a13`::moving from state init -> state preparing >Thread-73::INFO::2014-07-10 09:05:50,791::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='c01d693b-cba0-4fed-9ad7-0aaa28912a19', volUUID='4bb5d954-2a50-4028-b299-0b43c261270c', options=None) >Thread-73::INFO::2014-07-10 09:05:50,792::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-73::DEBUG::2014-07-10 09:05:50,792::task::1185::TaskManager.Task::(prepare) Task=`1122fe31-ae40-4bb7-a9aa-b08ba6987a13`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-73::DEBUG::2014-07-10 09:05:50,793::task::595::TaskManager.Task::(_updateState) Task=`1122fe31-ae40-4bb7-a9aa-b08ba6987a13`::moving from state preparing -> state finished >Thread-73::DEBUG::2014-07-10 09:05:50,793::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-73::DEBUG::2014-07-10 09:05:50,793::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-73::DEBUG::2014-07-10 09:05:50,794::task::990::TaskManager.Task::(_decref) Task=`1122fe31-ae40-4bb7-a9aa-b08ba6987a13`::ref 0 aborting False >Thread-54::DEBUG::2014-07-10 09:05:50,798::task::595::TaskManager.Task::(_updateState) Task=`81e53994-a86b-4efc-871d-271f45db0235`::moving from state init -> state preparing >Thread-54::INFO::2014-07-10 09:05:50,799::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='28408446-e5fd-4565-a976-e760951593fe', volUUID='776303a2-5585-451e-826e-0e338d4a1e98', options=None) >Thread-54::INFO::2014-07-10 09:05:50,799::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-54::DEBUG::2014-07-10 09:05:50,799::task::1185::TaskManager.Task::(prepare) Task=`81e53994-a86b-4efc-871d-271f45db0235`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-54::DEBUG::2014-07-10 09:05:50,800::task::595::TaskManager.Task::(_updateState) Task=`81e53994-a86b-4efc-871d-271f45db0235`::moving from state preparing -> state finished >Thread-54::DEBUG::2014-07-10 09:05:50,801::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-54::DEBUG::2014-07-10 09:05:50,801::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-54::DEBUG::2014-07-10 09:05:50,801::task::990::TaskManager.Task::(_decref) Task=`81e53994-a86b-4efc-871d-271f45db0235`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 09:05:51,263::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:05:51,344::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0252479 s, 40.6 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:05:53,359::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:05:53,488::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0714575 s, 14.3 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 09:05:54,944::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-14::DEBUG::2014-07-10 09:05:54,945::task::595::TaskManager.Task::(_updateState) Task=`046ef871-d439-45be-b74d-3098637dde0a`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 09:05:54,945::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-14::INFO::2014-07-10 09:05:54,946::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:05:54,946::task::1185::TaskManager.Task::(prepare) Task=`046ef871-d439-45be-b74d-3098637dde0a`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:05:54,946::task::595::TaskManager.Task::(_updateState) Task=`046ef871-d439-45be-b74d-3098637dde0a`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 09:05:54,946::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 09:05:54,946::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 09:05:54,946::task::990::TaskManager.Task::(_decref) Task=`046ef871-d439-45be-b74d-3098637dde0a`::ref 0 aborting False >Thread-34::DEBUG::2014-07-10 09:05:54,951::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-34::DEBUG::2014-07-10 09:05:54,951::task::595::TaskManager.Task::(_updateState) Task=`d612de8d-aaf6-4c91-9dba-f1c850b6000b`::moving from state init -> state preparing >Thread-34::INFO::2014-07-10 09:05:54,951::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-34::DEBUG::2014-07-10 09:05:54,952::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`86e2007f-4160-4208-b87a-66a7045cb7ed`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-10 09:05:54,952::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' for lock type 'shared' >Thread-34::DEBUG::2014-07-10 09:05:54,952::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-10 09:05:54,952::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`86e2007f-4160-4208-b87a-66a7045cb7ed`::Granted request >Thread-34::DEBUG::2014-07-10 09:05:54,953::task::827::TaskManager.Task::(resourceAcquired) Task=`d612de8d-aaf6-4c91-9dba-f1c850b6000b`::_resourcesAcquired: Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee (shared) >Thread-34::DEBUG::2014-07-10 09:05:54,953::task::990::TaskManager.Task::(_decref) Task=`d612de8d-aaf6-4c91-9dba-f1c850b6000b`::ref 1 aborting False >Thread-34::INFO::2014-07-10 09:05:54,954::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532067385344', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:05:54,954::task::1185::TaskManager.Task::(prepare) Task=`d612de8d-aaf6-4c91-9dba-f1c850b6000b`::finished: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532067385344', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:05:54,954::task::595::TaskManager.Task::(_updateState) Task=`d612de8d-aaf6-4c91-9dba-f1c850b6000b`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-10 09:05:54,955::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee': < ResourceRef 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-10 09:05:54,955::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-10 09:05:54,955::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' >Thread-34::DEBUG::2014-07-10 09:05:54,955::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' (0 active users) >Thread-34::DEBUG::2014-07-10 09:05:54,955::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-10 09:05:54,956::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', Clearing records. >Thread-34::DEBUG::2014-07-10 09:05:54,956::task::990::TaskManager.Task::(_decref) Task=`d612de8d-aaf6-4c91-9dba-f1c850b6000b`::ref 0 aborting False >Thread-40::DEBUG::2014-07-10 09:05:55,363::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lion.qa.lab.tlv.redhat.com:_export_yuri2_backup2/6a70504d-00df-4869-8695-0f442053f6b6/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-40::DEBUG::2014-07-10 09:05:55,384::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n369 bytes (369 B) copied, 0.000524879 s, 703 kB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:05:55,504::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:05:55,611::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.049925 s, 20.5 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:05:57,626::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:05:57,705::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0247918 s, 41.3 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:05:59,720::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:05:59,808::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0309979 s, 33.0 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-10 09:06:00,411::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/metadata bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-10 09:06:00,434::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00077871 s, 5.3 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:06:01,823::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:06:01,919::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0386308 s, 26.5 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:06:03,934::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:06:04,036::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0370582 s, 27.6 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 09:06:05,028::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-14::DEBUG::2014-07-10 09:06:05,029::task::595::TaskManager.Task::(_updateState) Task=`a1891aca-fd72-478c-afac-664a0a3ff690`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 09:06:05,030::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-14::INFO::2014-07-10 09:06:05,030::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:06:05,030::task::1185::TaskManager.Task::(prepare) Task=`a1891aca-fd72-478c-afac-664a0a3ff690`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:06:05,031::task::595::TaskManager.Task::(_updateState) Task=`a1891aca-fd72-478c-afac-664a0a3ff690`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 09:06:05,031::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 09:06:05,031::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 09:06:05,031::task::990::TaskManager.Task::(_decref) Task=`a1891aca-fd72-478c-afac-664a0a3ff690`::ref 0 aborting False >Thread-34::DEBUG::2014-07-10 09:06:05,036::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-34::DEBUG::2014-07-10 09:06:05,036::task::595::TaskManager.Task::(_updateState) Task=`a89637c0-5a89-4a54-bae0-6aaf6048470e`::moving from state init -> state preparing >Thread-34::INFO::2014-07-10 09:06:05,036::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-34::DEBUG::2014-07-10 09:06:05,037::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`e4d3aa3b-c403-47a6-876b-eca535d64a74`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-10 09:06:05,037::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' for lock type 'shared' >Thread-34::DEBUG::2014-07-10 09:06:05,037::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-10 09:06:05,038::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`e4d3aa3b-c403-47a6-876b-eca535d64a74`::Granted request >Thread-34::DEBUG::2014-07-10 09:06:05,038::task::827::TaskManager.Task::(resourceAcquired) Task=`a89637c0-5a89-4a54-bae0-6aaf6048470e`::_resourcesAcquired: Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee (shared) >Thread-34::DEBUG::2014-07-10 09:06:05,038::task::990::TaskManager.Task::(_decref) Task=`a89637c0-5a89-4a54-bae0-6aaf6048470e`::ref 1 aborting False >Thread-34::INFO::2014-07-10 09:06:05,040::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532067385344', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:06:05,040::task::1185::TaskManager.Task::(prepare) Task=`a89637c0-5a89-4a54-bae0-6aaf6048470e`::finished: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532067385344', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:06:05,040::task::595::TaskManager.Task::(_updateState) Task=`a89637c0-5a89-4a54-bae0-6aaf6048470e`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-10 09:06:05,040::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee': < ResourceRef 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-10 09:06:05,040::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-10 09:06:05,041::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' >Thread-34::DEBUG::2014-07-10 09:06:05,041::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' (0 active users) >Thread-34::DEBUG::2014-07-10 09:06:05,041::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-10 09:06:05,041::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', Clearing records. >Thread-34::DEBUG::2014-07-10 09:06:05,042::task::990::TaskManager.Task::(_decref) Task=`a89637c0-5a89-4a54-bae0-6aaf6048470e`::ref 0 aborting False >Thread-40::DEBUG::2014-07-10 09:06:05,416::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lion.qa.lab.tlv.redhat.com:_export_yuri2_backup2/6a70504d-00df-4869-8695-0f442053f6b6/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-40::DEBUG::2014-07-10 09:06:05,437::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n369 bytes (369 B) copied, 0.000461337 s, 800 kB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 09:06:05,579::task::595::TaskManager.Task::(_updateState) Task=`dccfad1a-2cc4-4b1c-8468-95dc66717646`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 09:06:05,580::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::INFO::2014-07-10 09:06:05,580::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00077871', 'lastCheck': '5.1', 'valid': True}, '6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000461337', 'lastCheck': '0.1', 'valid': True}} >Thread-14::DEBUG::2014-07-10 09:06:05,580::task::1185::TaskManager.Task::(prepare) Task=`dccfad1a-2cc4-4b1c-8468-95dc66717646`::finished: {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00077871', 'lastCheck': '5.1', 'valid': True}, '6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000461337', 'lastCheck': '0.1', 'valid': True}} >Thread-14::DEBUG::2014-07-10 09:06:05,581::task::595::TaskManager.Task::(_updateState) Task=`dccfad1a-2cc4-4b1c-8468-95dc66717646`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 09:06:05,581::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 09:06:05,581::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 09:06:05,581::task::990::TaskManager.Task::(_decref) Task=`dccfad1a-2cc4-4b1c-8468-95dc66717646`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 09:06:06,053::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:06:06,155::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.041999 s, 24.4 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:06:08,171::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:06:08,302::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0489846 s, 20.9 MB/s\n'; <rc> = 0 >Thread-57::DEBUG::2014-07-10 09:06:10,142::task::595::TaskManager.Task::(_updateState) Task=`2d701b03-ffdd-44a3-a634-41336ae4db31`::moving from state init -> state preparing >Thread-57::INFO::2014-07-10 09:06:10,143::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='b6f6c0da-e67f-4902-b9ac-3069571a42fe', volUUID='c4cd1da8-05b7-45e0-80b1-1183d21443d9', options=None) >Thread-57::INFO::2014-07-10 09:06:10,144::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-57::DEBUG::2014-07-10 09:06:10,144::task::1185::TaskManager.Task::(prepare) Task=`2d701b03-ffdd-44a3-a634-41336ae4db31`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-57::DEBUG::2014-07-10 09:06:10,144::task::595::TaskManager.Task::(_updateState) Task=`2d701b03-ffdd-44a3-a634-41336ae4db31`::moving from state preparing -> state finished >Thread-57::DEBUG::2014-07-10 09:06:10,144::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-57::DEBUG::2014-07-10 09:06:10,145::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-57::DEBUG::2014-07-10 09:06:10,145::task::990::TaskManager.Task::(_decref) Task=`2d701b03-ffdd-44a3-a634-41336ae4db31`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 09:06:10,318::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:06:10,406::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0271655 s, 37.7 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-10 09:06:10,466::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/metadata bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-10 09:06:10,491::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000624304 s, 6.6 MB/s\n'; <rc> = 0 >Thread-67::DEBUG::2014-07-10 09:06:10,955::task::595::TaskManager.Task::(_updateState) Task=`84758573-0f6b-4804-9876-cf9d8af9a750`::moving from state init -> state preparing >Thread-67::INFO::2014-07-10 09:06:10,956::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='f30c2cb7-a43a-4bf5-82b5-cfe07336f65c', volUUID='b0fbb3c9-55af-4a3a-95ad-fc56a80b9cf5', options=None) >Thread-67::INFO::2014-07-10 09:06:10,957::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-67::DEBUG::2014-07-10 09:06:10,957::task::1185::TaskManager.Task::(prepare) Task=`84758573-0f6b-4804-9876-cf9d8af9a750`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-67::DEBUG::2014-07-10 09:06:10,957::task::595::TaskManager.Task::(_updateState) Task=`84758573-0f6b-4804-9876-cf9d8af9a750`::moving from state preparing -> state finished >Thread-67::DEBUG::2014-07-10 09:06:10,957::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-67::DEBUG::2014-07-10 09:06:10,958::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-67::DEBUG::2014-07-10 09:06:10,958::task::990::TaskManager.Task::(_decref) Task=`84758573-0f6b-4804-9876-cf9d8af9a750`::ref 0 aborting False >Thread-48::DEBUG::2014-07-10 09:06:11,111::task::595::TaskManager.Task::(_updateState) Task=`b5fa2d21-dfe7-4db4-9c17-1cf6d62bd76c`::moving from state init -> state preparing >Thread-48::INFO::2014-07-10 09:06:11,111::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='0cd7d6ce-f497-4243-a690-c57744861eea', volUUID='10b6a7dd-dc6c-43fa-ba17-92e4331b0e0b', options=None) >Thread-48::INFO::2014-07-10 09:06:11,112::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-48::DEBUG::2014-07-10 09:06:11,112::task::1185::TaskManager.Task::(prepare) Task=`b5fa2d21-dfe7-4db4-9c17-1cf6d62bd76c`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-48::DEBUG::2014-07-10 09:06:11,112::task::595::TaskManager.Task::(_updateState) Task=`b5fa2d21-dfe7-4db4-9c17-1cf6d62bd76c`::moving from state preparing -> state finished >Thread-48::DEBUG::2014-07-10 09:06:11,112::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-48::DEBUG::2014-07-10 09:06:11,113::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-48::DEBUG::2014-07-10 09:06:11,113::task::990::TaskManager.Task::(_decref) Task=`b5fa2d21-dfe7-4db4-9c17-1cf6d62bd76c`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 09:06:12,422::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Thread-76::DEBUG::2014-07-10 09:06:12,498::task::595::TaskManager.Task::(_updateState) Task=`3284e6e4-77b9-4423-b438-79e30270e215`::moving from state init -> state preparing >Thread-76::INFO::2014-07-10 09:06:12,502::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='e4c65229-4247-4b33-b72a-f1d5ce72ad05', volUUID='cad94284-3ca9-4c30-933d-997f4460309e', options=None) >Thread-76::INFO::2014-07-10 09:06:12,505::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-76::DEBUG::2014-07-10 09:06:12,508::task::1185::TaskManager.Task::(prepare) Task=`3284e6e4-77b9-4423-b438-79e30270e215`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-76::DEBUG::2014-07-10 09:06:12,511::task::595::TaskManager.Task::(_updateState) Task=`3284e6e4-77b9-4423-b438-79e30270e215`::moving from state preparing -> state finished >Thread-76::DEBUG::2014-07-10 09:06:12,513::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-76::DEBUG::2014-07-10 09:06:12,515::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-76::DEBUG::2014-07-10 09:06:12,518::task::990::TaskManager.Task::(_decref) Task=`3284e6e4-77b9-4423-b438-79e30270e215`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 09:06:12,539::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0297843 s, 34.4 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:06:14,554::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:06:14,651::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0403994 s, 25.3 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 09:06:15,094::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-14::DEBUG::2014-07-10 09:06:15,095::task::595::TaskManager.Task::(_updateState) Task=`24835d46-597d-48dc-b5cf-925f8084b74f`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 09:06:15,096::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-14::INFO::2014-07-10 09:06:15,096::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:06:15,097::task::1185::TaskManager.Task::(prepare) Task=`24835d46-597d-48dc-b5cf-925f8084b74f`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:06:15,097::task::595::TaskManager.Task::(_updateState) Task=`24835d46-597d-48dc-b5cf-925f8084b74f`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 09:06:15,097::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 09:06:15,097::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 09:06:15,097::task::990::TaskManager.Task::(_decref) Task=`24835d46-597d-48dc-b5cf-925f8084b74f`::ref 0 aborting False >Thread-34::DEBUG::2014-07-10 09:06:15,101::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-34::DEBUG::2014-07-10 09:06:15,102::task::595::TaskManager.Task::(_updateState) Task=`5c996b03-41d0-445c-af35-0b10b75a1de0`::moving from state init -> state preparing >Thread-34::INFO::2014-07-10 09:06:15,102::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-34::DEBUG::2014-07-10 09:06:15,103::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`0bb8803a-9142-4cd4-8d53-6a57694895a6`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-10 09:06:15,103::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' for lock type 'shared' >Thread-34::DEBUG::2014-07-10 09:06:15,103::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-10 09:06:15,103::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`0bb8803a-9142-4cd4-8d53-6a57694895a6`::Granted request >Thread-34::DEBUG::2014-07-10 09:06:15,104::task::827::TaskManager.Task::(resourceAcquired) Task=`5c996b03-41d0-445c-af35-0b10b75a1de0`::_resourcesAcquired: Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee (shared) >Thread-34::DEBUG::2014-07-10 09:06:15,104::task::990::TaskManager.Task::(_decref) Task=`5c996b03-41d0-445c-af35-0b10b75a1de0`::ref 1 aborting False >Thread-34::INFO::2014-07-10 09:06:15,106::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532067385344', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:06:15,106::task::1185::TaskManager.Task::(prepare) Task=`5c996b03-41d0-445c-af35-0b10b75a1de0`::finished: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532067385344', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:06:15,107::task::595::TaskManager.Task::(_updateState) Task=`5c996b03-41d0-445c-af35-0b10b75a1de0`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-10 09:06:15,107::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee': < ResourceRef 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-10 09:06:15,107::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-10 09:06:15,107::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' >Thread-34::DEBUG::2014-07-10 09:06:15,108::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' (0 active users) >Thread-34::DEBUG::2014-07-10 09:06:15,108::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-10 09:06:15,108::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', Clearing records. >Thread-34::DEBUG::2014-07-10 09:06:15,108::task::990::TaskManager.Task::(_decref) Task=`5c996b03-41d0-445c-af35-0b10b75a1de0`::ref 0 aborting False >Thread-40::DEBUG::2014-07-10 09:06:15,463::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lion.qa.lab.tlv.redhat.com:_export_yuri2_backup2/6a70504d-00df-4869-8695-0f442053f6b6/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-40::DEBUG::2014-07-10 09:06:15,483::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n369 bytes (369 B) copied, 0.000328297 s, 1.1 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:06:16,667::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:06:16,760::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0354491 s, 28.9 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:06:18,777::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:06:18,871::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0363667 s, 28.2 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-10 09:06:20,525::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/metadata bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-10 09:06:20,547::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000765946 s, 5.3 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 09:06:20,776::task::595::TaskManager.Task::(_updateState) Task=`bd688371-9191-448c-b579-94b08a279373`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 09:06:20,776::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::INFO::2014-07-10 09:06:20,777::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000765946', 'lastCheck': '0.2', 'valid': True}, '6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000328297', 'lastCheck': '5.3', 'valid': True}} >Thread-14::DEBUG::2014-07-10 09:06:20,777::task::1185::TaskManager.Task::(prepare) Task=`bd688371-9191-448c-b579-94b08a279373`::finished: {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000765946', 'lastCheck': '0.2', 'valid': True}, '6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000328297', 'lastCheck': '5.3', 'valid': True}} >Thread-14::DEBUG::2014-07-10 09:06:20,777::task::595::TaskManager.Task::(_updateState) Task=`bd688371-9191-448c-b579-94b08a279373`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 09:06:20,777::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 09:06:20,778::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 09:06:20,778::task::990::TaskManager.Task::(_decref) Task=`bd688371-9191-448c-b579-94b08a279373`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 09:06:20,895::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:06:20,984::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0322516 s, 31.8 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:06:22,996::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:06:23,142::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.070751 s, 14.5 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:06:25,157::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Thread-14::DEBUG::2014-07-10 09:06:25,178::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [20826f36] >Thread-14::DEBUG::2014-07-10 09:06:25,179::task::595::TaskManager.Task::(_updateState) Task=`06391ed9-0a10-41a7-8cee-6be8f08ab7bf`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 09:06:25,180::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-14::INFO::2014-07-10 09:06:25,181::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:06:25,182::task::1185::TaskManager.Task::(prepare) Task=`06391ed9-0a10-41a7-8cee-6be8f08ab7bf`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:06:25,182::task::595::TaskManager.Task::(_updateState) Task=`06391ed9-0a10-41a7-8cee-6be8f08ab7bf`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 09:06:25,182::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 09:06:25,183::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 09:06:25,183::task::990::TaskManager.Task::(_decref) Task=`06391ed9-0a10-41a7-8cee-6be8f08ab7bf`::ref 0 aborting False >Thread-34::DEBUG::2014-07-10 09:06:25,188::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [20826f36] >Thread-34::DEBUG::2014-07-10 09:06:25,188::task::595::TaskManager.Task::(_updateState) Task=`b76aaa22-28b3-45e1-b1f9-fb96326c2731`::moving from state init -> state preparing >Thread-34::INFO::2014-07-10 09:06:25,189::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-34::DEBUG::2014-07-10 09:06:25,190::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`8e8b341e-1e64-4469-a96c-4f31437591da`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-10 09:06:25,190::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' for lock type 'shared' >Thread-34::DEBUG::2014-07-10 09:06:25,190::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-10 09:06:25,191::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`8e8b341e-1e64-4469-a96c-4f31437591da`::Granted request >Thread-34::DEBUG::2014-07-10 09:06:25,191::task::827::TaskManager.Task::(resourceAcquired) Task=`b76aaa22-28b3-45e1-b1f9-fb96326c2731`::_resourcesAcquired: Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee (shared) >Thread-34::DEBUG::2014-07-10 09:06:25,192::task::990::TaskManager.Task::(_decref) Task=`b76aaa22-28b3-45e1-b1f9-fb96326c2731`::ref 1 aborting False >Thread-34::INFO::2014-07-10 09:06:25,193::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532067385344', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:06:25,193::task::1185::TaskManager.Task::(prepare) Task=`b76aaa22-28b3-45e1-b1f9-fb96326c2731`::finished: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532067385344', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:06:25,194::task::595::TaskManager.Task::(_updateState) Task=`b76aaa22-28b3-45e1-b1f9-fb96326c2731`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-10 09:06:25,194::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee': < ResourceRef 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-10 09:06:25,194::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-10 09:06:25,194::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' >Thread-34::DEBUG::2014-07-10 09:06:25,195::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' (0 active users) >Thread-34::DEBUG::2014-07-10 09:06:25,195::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-10 09:06:25,195::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', Clearing records. >Thread-34::DEBUG::2014-07-10 09:06:25,195::task::990::TaskManager.Task::(_decref) Task=`b76aaa22-28b3-45e1-b1f9-fb96326c2731`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 09:06:25,261::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0414766 s, 24.7 MB/s\n'; <rc> = 0 >Thread-40::DEBUG::2014-07-10 09:06:25,513::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lion.qa.lab.tlv.redhat.com:_export_yuri2_backup2/6a70504d-00df-4869-8695-0f442053f6b6/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-40::DEBUG::2014-07-10 09:06:25,534::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n369 bytes (369 B) copied, 0.000459324 s, 803 kB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:06:27,277::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:06:27,366::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0304799 s, 33.6 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:06:29,380::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:06:29,471::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0328337 s, 31.2 MB/s\n'; <rc> = 0 >Thread-70::DEBUG::2014-07-10 09:06:30,168::task::595::TaskManager.Task::(_updateState) Task=`4077fddc-b359-4067-8afd-bfb3a033532a`::moving from state init -> state preparing >Thread-70::INFO::2014-07-10 09:06:30,169::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='cfaeead2-7caa-467c-b389-c89840ae6605', volUUID='567fe32d-31a6-4ff6-90f3-fd6a656fbecc', options=None) >Thread-70::INFO::2014-07-10 09:06:30,170::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-70::DEBUG::2014-07-10 09:06:30,170::task::1185::TaskManager.Task::(prepare) Task=`4077fddc-b359-4067-8afd-bfb3a033532a`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-70::DEBUG::2014-07-10 09:06:30,170::task::595::TaskManager.Task::(_updateState) Task=`4077fddc-b359-4067-8afd-bfb3a033532a`::moving from state preparing -> state finished >Thread-70::DEBUG::2014-07-10 09:06:30,170::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-70::DEBUG::2014-07-10 09:06:30,170::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-70::DEBUG::2014-07-10 09:06:30,170::task::990::TaskManager.Task::(_decref) Task=`4077fddc-b359-4067-8afd-bfb3a033532a`::ref 0 aborting False >Thread-18::DEBUG::2014-07-10 09:06:30,576::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/metadata bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-10 09:06:30,598::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000788495 s, 5.2 MB/s\n'; <rc> = 0 >Thread-60::DEBUG::2014-07-10 09:06:30,945::task::595::TaskManager.Task::(_updateState) Task=`70d61323-1212-4676-9fa0-77e746708bd4`::moving from state init -> state preparing >Thread-60::INFO::2014-07-10 09:06:30,945::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='b034d5b0-e1e0-4011-b49b-4d45ddb11556', volUUID='3d7f62b5-328f-4d8e-8b69-873cfb5ae14d', options=None) >Thread-60::INFO::2014-07-10 09:06:30,946::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-60::DEBUG::2014-07-10 09:06:30,946::task::1185::TaskManager.Task::(prepare) Task=`70d61323-1212-4676-9fa0-77e746708bd4`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-60::DEBUG::2014-07-10 09:06:30,946::task::595::TaskManager.Task::(_updateState) Task=`70d61323-1212-4676-9fa0-77e746708bd4`::moving from state preparing -> state finished >Thread-60::DEBUG::2014-07-10 09:06:30,946::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-60::DEBUG::2014-07-10 09:06:30,947::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-60::DEBUG::2014-07-10 09:06:30,947::task::990::TaskManager.Task::(_decref) Task=`70d61323-1212-4676-9fa0-77e746708bd4`::ref 0 aborting False >Thread-51::DEBUG::2014-07-10 09:06:31,198::task::595::TaskManager.Task::(_updateState) Task=`8cd20920-aa07-4ec3-86d0-b3c610a86352`::moving from state init -> state preparing >Thread-51::INFO::2014-07-10 09:06:31,199::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='76fdb054-02cd-42ed-9721-b3e65b34c3a4', volUUID='022dfe46-2cf7-4915-80b3-883158e3ca83', options=None) >Thread-51::INFO::2014-07-10 09:06:31,199::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-51::DEBUG::2014-07-10 09:06:31,200::task::1185::TaskManager.Task::(prepare) Task=`8cd20920-aa07-4ec3-86d0-b3c610a86352`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-51::DEBUG::2014-07-10 09:06:31,200::task::595::TaskManager.Task::(_updateState) Task=`8cd20920-aa07-4ec3-86d0-b3c610a86352`::moving from state preparing -> state finished >Thread-51::DEBUG::2014-07-10 09:06:31,200::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-51::DEBUG::2014-07-10 09:06:31,200::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-51::DEBUG::2014-07-10 09:06:31,201::task::990::TaskManager.Task::(_decref) Task=`8cd20920-aa07-4ec3-86d0-b3c610a86352`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 09:06:31,486::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:06:31,577::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0335364 s, 30.5 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:06:33,592::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:06:33,899::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0271969 s, 37.7 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 09:06:35,242::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-14::DEBUG::2014-07-10 09:06:35,244::task::595::TaskManager.Task::(_updateState) Task=`a4e22e26-6cbd-4002-8bff-5f1fa311fef7`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 09:06:35,244::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-14::INFO::2014-07-10 09:06:35,245::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:06:35,245::task::1185::TaskManager.Task::(prepare) Task=`a4e22e26-6cbd-4002-8bff-5f1fa311fef7`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:06:35,245::task::595::TaskManager.Task::(_updateState) Task=`a4e22e26-6cbd-4002-8bff-5f1fa311fef7`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 09:06:35,245::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 09:06:35,245::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 09:06:35,246::task::990::TaskManager.Task::(_decref) Task=`a4e22e26-6cbd-4002-8bff-5f1fa311fef7`::ref 0 aborting False >Thread-34::DEBUG::2014-07-10 09:06:35,250::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-34::DEBUG::2014-07-10 09:06:35,251::task::595::TaskManager.Task::(_updateState) Task=`4fc7129d-bf37-41d6-9053-ec511feeb1ee`::moving from state init -> state preparing >Thread-34::INFO::2014-07-10 09:06:35,251::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-34::DEBUG::2014-07-10 09:06:35,252::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`cd4bcfa2-b949-46fc-a4bd-462fdfc26bff`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-10 09:06:35,252::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' for lock type 'shared' >Thread-34::DEBUG::2014-07-10 09:06:35,252::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-10 09:06:35,253::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`cd4bcfa2-b949-46fc-a4bd-462fdfc26bff`::Granted request >Thread-34::DEBUG::2014-07-10 09:06:35,254::task::827::TaskManager.Task::(resourceAcquired) Task=`4fc7129d-bf37-41d6-9053-ec511feeb1ee`::_resourcesAcquired: Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee (shared) >Thread-34::DEBUG::2014-07-10 09:06:35,255::task::990::TaskManager.Task::(_decref) Task=`4fc7129d-bf37-41d6-9053-ec511feeb1ee`::ref 1 aborting False >Thread-34::INFO::2014-07-10 09:06:35,256::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532067385344', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:06:35,256::task::1185::TaskManager.Task::(prepare) Task=`4fc7129d-bf37-41d6-9053-ec511feeb1ee`::finished: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532067385344', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:06:35,256::task::595::TaskManager.Task::(_updateState) Task=`4fc7129d-bf37-41d6-9053-ec511feeb1ee`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-10 09:06:35,257::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee': < ResourceRef 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-10 09:06:35,257::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-10 09:06:35,257::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' >Thread-34::DEBUG::2014-07-10 09:06:35,257::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' (0 active users) >Thread-34::DEBUG::2014-07-10 09:06:35,258::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-10 09:06:35,258::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', Clearing records. >Thread-34::DEBUG::2014-07-10 09:06:35,258::task::990::TaskManager.Task::(_decref) Task=`4fc7129d-bf37-41d6-9053-ec511feeb1ee`::ref 0 aborting False >Thread-40::DEBUG::2014-07-10 09:06:35,566::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lion.qa.lab.tlv.redhat.com:_export_yuri2_backup2/6a70504d-00df-4869-8695-0f442053f6b6/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-40::DEBUG::2014-07-10 09:06:35,586::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n369 bytes (369 B) copied, 0.000518249 s, 712 kB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:06:35,915::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Thread-14::DEBUG::2014-07-10 09:06:35,977::task::595::TaskManager.Task::(_updateState) Task=`4acf4dfe-36de-43a0-b538-1dc9c443b702`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 09:06:35,980::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::INFO::2014-07-10 09:06:35,984::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000788495', 'lastCheck': '5.3', 'valid': True}, '6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000518249', 'lastCheck': '0.4', 'valid': True}} >Thread-14::DEBUG::2014-07-10 09:06:35,986::task::1185::TaskManager.Task::(prepare) Task=`4acf4dfe-36de-43a0-b538-1dc9c443b702`::finished: {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000788495', 'lastCheck': '5.3', 'valid': True}, '6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000518249', 'lastCheck': '0.4', 'valid': True}} >Thread-14::DEBUG::2014-07-10 09:06:35,986::task::595::TaskManager.Task::(_updateState) Task=`4acf4dfe-36de-43a0-b538-1dc9c443b702`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 09:06:35,987::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 09:06:35,987::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 09:06:35,988::task::990::TaskManager.Task::(_decref) Task=`4acf4dfe-36de-43a0-b538-1dc9c443b702`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 09:06:36,283::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0706697 s, 14.5 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:06:38,299::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:06:38,405::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0342499 s, 29.9 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:06:40,419::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:06:40,513::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0356954 s, 28.7 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-10 09:06:40,645::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/metadata bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-10 09:06:40,666::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000630962 s, 6.5 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:06:42,529::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:06:42,616::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.028762 s, 35.6 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:06:44,631::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:06:44,728::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0316079 s, 32.4 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 09:06:45,309::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-14::DEBUG::2014-07-10 09:06:45,310::task::595::TaskManager.Task::(_updateState) Task=`118e48de-68d9-4c2b-8570-2586e1c95adb`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 09:06:45,311::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-14::INFO::2014-07-10 09:06:45,311::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:06:45,312::task::1185::TaskManager.Task::(prepare) Task=`118e48de-68d9-4c2b-8570-2586e1c95adb`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:06:45,312::task::595::TaskManager.Task::(_updateState) Task=`118e48de-68d9-4c2b-8570-2586e1c95adb`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 09:06:45,312::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 09:06:45,312::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 09:06:45,312::task::990::TaskManager.Task::(_decref) Task=`118e48de-68d9-4c2b-8570-2586e1c95adb`::ref 0 aborting False >Thread-34::DEBUG::2014-07-10 09:06:45,316::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-34::DEBUG::2014-07-10 09:06:45,317::task::595::TaskManager.Task::(_updateState) Task=`d3817e06-c9cf-44e5-b9f3-fbdfbd5fb5cf`::moving from state init -> state preparing >Thread-34::INFO::2014-07-10 09:06:45,317::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-34::DEBUG::2014-07-10 09:06:45,318::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`ea4be836-e5c1-4713-a740-bed4d0b211f6`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-10 09:06:45,318::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' for lock type 'shared' >Thread-34::DEBUG::2014-07-10 09:06:45,318::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-10 09:06:45,318::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`ea4be836-e5c1-4713-a740-bed4d0b211f6`::Granted request >Thread-34::DEBUG::2014-07-10 09:06:45,319::task::827::TaskManager.Task::(resourceAcquired) Task=`d3817e06-c9cf-44e5-b9f3-fbdfbd5fb5cf`::_resourcesAcquired: Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee (shared) >Thread-34::DEBUG::2014-07-10 09:06:45,319::task::990::TaskManager.Task::(_decref) Task=`d3817e06-c9cf-44e5-b9f3-fbdfbd5fb5cf`::ref 1 aborting False >Thread-34::INFO::2014-07-10 09:06:45,320::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532067385344', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:06:45,320::task::1185::TaskManager.Task::(prepare) Task=`d3817e06-c9cf-44e5-b9f3-fbdfbd5fb5cf`::finished: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532067385344', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:06:45,320::task::595::TaskManager.Task::(_updateState) Task=`d3817e06-c9cf-44e5-b9f3-fbdfbd5fb5cf`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-10 09:06:45,321::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee': < ResourceRef 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-10 09:06:45,321::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-10 09:06:45,321::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' >Thread-34::DEBUG::2014-07-10 09:06:45,321::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' (0 active users) >Thread-34::DEBUG::2014-07-10 09:06:45,321::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-10 09:06:45,321::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', Clearing records. >Thread-34::DEBUG::2014-07-10 09:06:45,322::task::990::TaskManager.Task::(_decref) Task=`d3817e06-c9cf-44e5-b9f3-fbdfbd5fb5cf`::ref 0 aborting False >Thread-40::DEBUG::2014-07-10 09:06:45,612::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lion.qa.lab.tlv.redhat.com:_export_yuri2_backup2/6a70504d-00df-4869-8695-0f442053f6b6/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-40::DEBUG::2014-07-10 09:06:45,632::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n369 bytes (369 B) copied, 0.000430771 s, 857 kB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:06:46,745::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:06:46,840::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0353391 s, 29.0 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:06:48,857::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:06:48,943::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.029561 s, 34.6 MB/s\n'; <rc> = 0 >Thread-64::DEBUG::2014-07-10 09:06:50,239::task::595::TaskManager.Task::(_updateState) Task=`68f0e3fb-4dbc-4d4b-a495-1adfb5a54d7f`::moving from state init -> state preparing >Thread-64::INFO::2014-07-10 09:06:50,240::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='aa20346a-4d3a-4e07-b8e1-52c0ebe4168c', volUUID='58fefce2-9bce-4bff-8949-8c6ce8122b27', options=None) >Thread-64::INFO::2014-07-10 09:06:50,240::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-64::DEBUG::2014-07-10 09:06:50,241::task::1185::TaskManager.Task::(prepare) Task=`68f0e3fb-4dbc-4d4b-a495-1adfb5a54d7f`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-64::DEBUG::2014-07-10 09:06:50,241::task::595::TaskManager.Task::(_updateState) Task=`68f0e3fb-4dbc-4d4b-a495-1adfb5a54d7f`::moving from state preparing -> state finished >Thread-64::DEBUG::2014-07-10 09:06:50,241::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-64::DEBUG::2014-07-10 09:06:50,241::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-64::DEBUG::2014-07-10 09:06:50,241::task::990::TaskManager.Task::(_decref) Task=`68f0e3fb-4dbc-4d4b-a495-1adfb5a54d7f`::ref 0 aborting False >Thread-18::DEBUG::2014-07-10 09:06:50,700::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/metadata bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-10 09:06:50,724::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000848632 s, 4.8 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:06:50,958::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:06:51,050::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0338354 s, 30.3 MB/s\n'; <rc> = 0 >Thread-54::DEBUG::2014-07-10 09:06:51,098::task::595::TaskManager.Task::(_updateState) Task=`61ecff3a-1a5f-4fb6-a15f-bb7712c6d087`::moving from state init -> state preparing >Thread-73::DEBUG::2014-07-10 09:06:51,102::task::595::TaskManager.Task::(_updateState) Task=`347fbca8-2f64-429c-a5bf-b75d0bd8fd20`::moving from state init -> state preparing >Thread-54::INFO::2014-07-10 09:06:51,104::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='28408446-e5fd-4565-a976-e760951593fe', volUUID='776303a2-5585-451e-826e-0e338d4a1e98', options=None) >Thread-73::INFO::2014-07-10 09:06:51,108::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='c01d693b-cba0-4fed-9ad7-0aaa28912a19', volUUID='4bb5d954-2a50-4028-b299-0b43c261270c', options=None) >Thread-54::INFO::2014-07-10 09:06:51,112::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-54::DEBUG::2014-07-10 09:06:51,119::task::1185::TaskManager.Task::(prepare) Task=`61ecff3a-1a5f-4fb6-a15f-bb7712c6d087`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-73::INFO::2014-07-10 09:06:51,120::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-54::DEBUG::2014-07-10 09:06:51,124::task::595::TaskManager.Task::(_updateState) Task=`61ecff3a-1a5f-4fb6-a15f-bb7712c6d087`::moving from state preparing -> state finished >Thread-73::DEBUG::2014-07-10 09:06:51,126::task::1185::TaskManager.Task::(prepare) Task=`347fbca8-2f64-429c-a5bf-b75d0bd8fd20`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-54::DEBUG::2014-07-10 09:06:51,129::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-73::DEBUG::2014-07-10 09:06:51,133::task::595::TaskManager.Task::(_updateState) Task=`347fbca8-2f64-429c-a5bf-b75d0bd8fd20`::moving from state preparing -> state finished >Thread-54::DEBUG::2014-07-10 09:06:51,135::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-73::DEBUG::2014-07-10 09:06:51,139::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-54::DEBUG::2014-07-10 09:06:51,141::task::990::TaskManager.Task::(_decref) Task=`61ecff3a-1a5f-4fb6-a15f-bb7712c6d087`::ref 0 aborting False >Thread-73::DEBUG::2014-07-10 09:06:51,146::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-73::DEBUG::2014-07-10 09:06:51,147::task::990::TaskManager.Task::(_decref) Task=`347fbca8-2f64-429c-a5bf-b75d0bd8fd20`::ref 0 aborting False >Thread-14::DEBUG::2014-07-10 09:06:51,454::task::595::TaskManager.Task::(_updateState) Task=`8e01db87-ab12-4970-b8e2-87b46e7ec7fc`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 09:06:51,455::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::INFO::2014-07-10 09:06:51,455::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000848632', 'lastCheck': '0.7', 'valid': True}, '6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000430771', 'lastCheck': '5.8', 'valid': True}} >Thread-14::DEBUG::2014-07-10 09:06:51,455::task::1185::TaskManager.Task::(prepare) Task=`8e01db87-ab12-4970-b8e2-87b46e7ec7fc`::finished: {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000848632', 'lastCheck': '0.7', 'valid': True}, '6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000430771', 'lastCheck': '5.8', 'valid': True}} >Thread-14::DEBUG::2014-07-10 09:06:51,455::task::595::TaskManager.Task::(_updateState) Task=`8e01db87-ab12-4970-b8e2-87b46e7ec7fc`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 09:06:51,456::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 09:06:51,456::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 09:06:51,456::task::990::TaskManager.Task::(_decref) Task=`8e01db87-ab12-4970-b8e2-87b46e7ec7fc`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 09:06:53,066::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:06:53,159::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0350812 s, 29.2 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:06:55,176::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:06:55,273::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0351532 s, 29.1 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 09:06:55,355::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-14::DEBUG::2014-07-10 09:06:55,358::task::595::TaskManager.Task::(_updateState) Task=`d7300ace-e24c-4293-a8f7-b61fc90be636`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 09:06:55,358::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-14::INFO::2014-07-10 09:06:55,359::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:06:55,359::task::1185::TaskManager.Task::(prepare) Task=`d7300ace-e24c-4293-a8f7-b61fc90be636`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:06:55,359::task::595::TaskManager.Task::(_updateState) Task=`d7300ace-e24c-4293-a8f7-b61fc90be636`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 09:06:55,359::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 09:06:55,360::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 09:06:55,360::task::990::TaskManager.Task::(_decref) Task=`d7300ace-e24c-4293-a8f7-b61fc90be636`::ref 0 aborting False >Thread-34::DEBUG::2014-07-10 09:06:55,368::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-34::DEBUG::2014-07-10 09:06:55,369::task::595::TaskManager.Task::(_updateState) Task=`6255751e-544e-4123-8b46-3bd4bd19fcd3`::moving from state init -> state preparing >Thread-34::INFO::2014-07-10 09:06:55,369::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-34::DEBUG::2014-07-10 09:06:55,370::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`f88d2253-f43e-4f77-9f74-cb1ab6620290`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-10 09:06:55,370::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' for lock type 'shared' >Thread-34::DEBUG::2014-07-10 09:06:55,370::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-10 09:06:55,370::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`f88d2253-f43e-4f77-9f74-cb1ab6620290`::Granted request >Thread-34::DEBUG::2014-07-10 09:06:55,371::task::827::TaskManager.Task::(resourceAcquired) Task=`6255751e-544e-4123-8b46-3bd4bd19fcd3`::_resourcesAcquired: Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee (shared) >Thread-34::DEBUG::2014-07-10 09:06:55,371::task::990::TaskManager.Task::(_decref) Task=`6255751e-544e-4123-8b46-3bd4bd19fcd3`::ref 1 aborting False >Thread-34::INFO::2014-07-10 09:06:55,372::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532067385344', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:06:55,372::task::1185::TaskManager.Task::(prepare) Task=`6255751e-544e-4123-8b46-3bd4bd19fcd3`::finished: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532067385344', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:06:55,373::task::595::TaskManager.Task::(_updateState) Task=`6255751e-544e-4123-8b46-3bd4bd19fcd3`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-10 09:06:55,373::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee': < ResourceRef 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-10 09:06:55,373::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-10 09:06:55,373::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' >Thread-34::DEBUG::2014-07-10 09:06:55,374::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' (0 active users) >Thread-34::DEBUG::2014-07-10 09:06:55,374::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-10 09:06:55,374::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', Clearing records. >Thread-34::DEBUG::2014-07-10 09:06:55,374::task::990::TaskManager.Task::(_decref) Task=`6255751e-544e-4123-8b46-3bd4bd19fcd3`::ref 0 aborting False >Thread-40::DEBUG::2014-07-10 09:06:55,663::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lion.qa.lab.tlv.redhat.com:_export_yuri2_backup2/6a70504d-00df-4869-8695-0f442053f6b6/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-40::DEBUG::2014-07-10 09:06:55,701::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n369 bytes (369 B) copied, 0.00041426 s, 891 kB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:06:57,288::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:06:57,377::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0267393 s, 38.3 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:06:59,393::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:06:59,486::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0352639 s, 29.0 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-10 09:07:00,754::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/metadata bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-10 09:07:00,777::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000682866 s, 6.0 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:07:01,502::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:07:01,590::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0307477 s, 33.3 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:07:03,605::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:07:03,707::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0263148 s, 38.9 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 09:07:05,401::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-14::DEBUG::2014-07-10 09:07:05,403::task::595::TaskManager.Task::(_updateState) Task=`adb336b9-106e-4b64-8d0b-ef198aae5518`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 09:07:05,403::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-14::INFO::2014-07-10 09:07:05,404::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:07:05,404::task::1185::TaskManager.Task::(prepare) Task=`adb336b9-106e-4b64-8d0b-ef198aae5518`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:07:05,404::task::595::TaskManager.Task::(_updateState) Task=`adb336b9-106e-4b64-8d0b-ef198aae5518`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 09:07:05,404::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 09:07:05,405::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 09:07:05,405::task::990::TaskManager.Task::(_decref) Task=`adb336b9-106e-4b64-8d0b-ef198aae5518`::ref 0 aborting False >Thread-34::DEBUG::2014-07-10 09:07:05,413::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-34::DEBUG::2014-07-10 09:07:05,416::task::595::TaskManager.Task::(_updateState) Task=`3b86296c-bdce-4259-bdaf-a5ce3e399eac`::moving from state init -> state preparing >Thread-34::INFO::2014-07-10 09:07:05,416::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-34::DEBUG::2014-07-10 09:07:05,417::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`b6db420a-a074-48a9-9e9e-1c4b017c5955`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-10 09:07:05,417::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' for lock type 'shared' >Thread-34::DEBUG::2014-07-10 09:07:05,418::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-10 09:07:05,418::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`b6db420a-a074-48a9-9e9e-1c4b017c5955`::Granted request >Thread-34::DEBUG::2014-07-10 09:07:05,418::task::827::TaskManager.Task::(resourceAcquired) Task=`3b86296c-bdce-4259-bdaf-a5ce3e399eac`::_resourcesAcquired: Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee (shared) >Thread-34::DEBUG::2014-07-10 09:07:05,418::task::990::TaskManager.Task::(_decref) Task=`3b86296c-bdce-4259-bdaf-a5ce3e399eac`::ref 1 aborting False >Thread-34::INFO::2014-07-10 09:07:05,420::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532067385344', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:07:05,420::task::1185::TaskManager.Task::(prepare) Task=`3b86296c-bdce-4259-bdaf-a5ce3e399eac`::finished: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532067385344', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:07:05,420::task::595::TaskManager.Task::(_updateState) Task=`3b86296c-bdce-4259-bdaf-a5ce3e399eac`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-10 09:07:05,420::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee': < ResourceRef 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-10 09:07:05,421::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-10 09:07:05,421::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' >Thread-34::DEBUG::2014-07-10 09:07:05,421::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' (0 active users) >Thread-34::DEBUG::2014-07-10 09:07:05,421::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-10 09:07:05,421::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', Clearing records. >Thread-34::DEBUG::2014-07-10 09:07:05,422::task::990::TaskManager.Task::(_decref) Task=`3b86296c-bdce-4259-bdaf-a5ce3e399eac`::ref 0 aborting False >Thread-40::DEBUG::2014-07-10 09:07:05,732::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lion.qa.lab.tlv.redhat.com:_export_yuri2_backup2/6a70504d-00df-4869-8695-0f442053f6b6/dom_md/metadata bs=4096 count=1' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:07:05,753::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Thread-40::DEBUG::2014-07-10 09:07:05,793::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n369 bytes (369 B) copied, 0.000401882 s, 918 kB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:07:05,875::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0641623 s, 16.0 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 09:07:06,680::task::595::TaskManager.Task::(_updateState) Task=`2e695644-43ff-4c34-89e8-14ceeea696db`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 09:07:06,681::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::INFO::2014-07-10 09:07:06,681::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000682866', 'lastCheck': '5.9', 'valid': True}, '6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000401882', 'lastCheck': '0.9', 'valid': True}} >Thread-14::DEBUG::2014-07-10 09:07:06,682::task::1185::TaskManager.Task::(prepare) Task=`2e695644-43ff-4c34-89e8-14ceeea696db`::finished: {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000682866', 'lastCheck': '5.9', 'valid': True}, '6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000401882', 'lastCheck': '0.9', 'valid': True}} >Thread-14::DEBUG::2014-07-10 09:07:06,682::task::595::TaskManager.Task::(_updateState) Task=`2e695644-43ff-4c34-89e8-14ceeea696db`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 09:07:06,682::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 09:07:06,682::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 09:07:06,682::task::990::TaskManager.Task::(_decref) Task=`2e695644-43ff-4c34-89e8-14ceeea696db`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 09:07:07,890::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:07:07,971::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0254079 s, 40.3 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:07:09,987::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:07:10,073::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.029825 s, 34.3 MB/s\n'; <rc> = 0 >Thread-57::DEBUG::2014-07-10 09:07:10,407::task::595::TaskManager.Task::(_updateState) Task=`56d8f465-9b44-4ab2-9e0c-82b8b653518b`::moving from state init -> state preparing >Thread-57::INFO::2014-07-10 09:07:10,407::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='b6f6c0da-e67f-4902-b9ac-3069571a42fe', volUUID='c4cd1da8-05b7-45e0-80b1-1183d21443d9', options=None) >Thread-57::INFO::2014-07-10 09:07:10,408::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-57::DEBUG::2014-07-10 09:07:10,408::task::1185::TaskManager.Task::(prepare) Task=`56d8f465-9b44-4ab2-9e0c-82b8b653518b`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-57::DEBUG::2014-07-10 09:07:10,408::task::595::TaskManager.Task::(_updateState) Task=`56d8f465-9b44-4ab2-9e0c-82b8b653518b`::moving from state preparing -> state finished >Thread-57::DEBUG::2014-07-10 09:07:10,409::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-57::DEBUG::2014-07-10 09:07:10,409::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-57::DEBUG::2014-07-10 09:07:10,409::task::990::TaskManager.Task::(_decref) Task=`56d8f465-9b44-4ab2-9e0c-82b8b653518b`::ref 0 aborting False >Thread-18::DEBUG::2014-07-10 09:07:10,807::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/metadata bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-10 09:07:10,831::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000569481 s, 7.2 MB/s\n'; <rc> = 0 >Thread-67::DEBUG::2014-07-10 09:07:11,227::task::595::TaskManager.Task::(_updateState) Task=`e01a7373-9bad-4ce3-b519-ed65681187b7`::moving from state init -> state preparing >Thread-67::INFO::2014-07-10 09:07:11,228::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='f30c2cb7-a43a-4bf5-82b5-cfe07336f65c', volUUID='b0fbb3c9-55af-4a3a-95ad-fc56a80b9cf5', options=None) >Thread-67::INFO::2014-07-10 09:07:11,229::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-67::DEBUG::2014-07-10 09:07:11,229::task::1185::TaskManager.Task::(prepare) Task=`e01a7373-9bad-4ce3-b519-ed65681187b7`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-67::DEBUG::2014-07-10 09:07:11,229::task::595::TaskManager.Task::(_updateState) Task=`e01a7373-9bad-4ce3-b519-ed65681187b7`::moving from state preparing -> state finished >Thread-67::DEBUG::2014-07-10 09:07:11,229::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-67::DEBUG::2014-07-10 09:07:11,230::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-67::DEBUG::2014-07-10 09:07:11,230::task::990::TaskManager.Task::(_decref) Task=`e01a7373-9bad-4ce3-b519-ed65681187b7`::ref 0 aborting False >Thread-48::DEBUG::2014-07-10 09:07:11,425::task::595::TaskManager.Task::(_updateState) Task=`13429962-aa31-472a-bb63-fc5e86da65e8`::moving from state init -> state preparing >Thread-48::INFO::2014-07-10 09:07:11,426::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='0cd7d6ce-f497-4243-a690-c57744861eea', volUUID='10b6a7dd-dc6c-43fa-ba17-92e4331b0e0b', options=None) >Thread-48::INFO::2014-07-10 09:07:11,427::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-48::DEBUG::2014-07-10 09:07:11,427::task::1185::TaskManager.Task::(prepare) Task=`13429962-aa31-472a-bb63-fc5e86da65e8`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-48::DEBUG::2014-07-10 09:07:11,427::task::595::TaskManager.Task::(_updateState) Task=`13429962-aa31-472a-bb63-fc5e86da65e8`::moving from state preparing -> state finished >Thread-48::DEBUG::2014-07-10 09:07:11,427::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-48::DEBUG::2014-07-10 09:07:11,427::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-48::DEBUG::2014-07-10 09:07:11,428::task::990::TaskManager.Task::(_decref) Task=`13429962-aa31-472a-bb63-fc5e86da65e8`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 09:07:12,103::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:07:12,188::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0271526 s, 37.7 MB/s\n'; <rc> = 0 >Thread-76::DEBUG::2014-07-10 09:07:12,834::task::595::TaskManager.Task::(_updateState) Task=`4c3dfa89-667f-42c7-9c71-ab281d2c90b1`::moving from state init -> state preparing >Thread-76::INFO::2014-07-10 09:07:12,834::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='e4c65229-4247-4b33-b72a-f1d5ce72ad05', volUUID='cad94284-3ca9-4c30-933d-997f4460309e', options=None) >Thread-76::INFO::2014-07-10 09:07:12,835::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-76::DEBUG::2014-07-10 09:07:12,835::task::1185::TaskManager.Task::(prepare) Task=`4c3dfa89-667f-42c7-9c71-ab281d2c90b1`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-76::DEBUG::2014-07-10 09:07:12,835::task::595::TaskManager.Task::(_updateState) Task=`4c3dfa89-667f-42c7-9c71-ab281d2c90b1`::moving from state preparing -> state finished >Thread-76::DEBUG::2014-07-10 09:07:12,836::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-76::DEBUG::2014-07-10 09:07:12,836::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-76::DEBUG::2014-07-10 09:07:12,836::task::990::TaskManager.Task::(_decref) Task=`4c3dfa89-667f-42c7-9c71-ab281d2c90b1`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 09:07:14,204::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:07:14,295::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0348471 s, 29.4 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 09:07:15,494::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-14::DEBUG::2014-07-10 09:07:15,496::task::595::TaskManager.Task::(_updateState) Task=`2ef57a77-6aef-4c63-b381-8e59fb6504f5`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 09:07:15,496::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-14::INFO::2014-07-10 09:07:15,497::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:07:15,497::task::1185::TaskManager.Task::(prepare) Task=`2ef57a77-6aef-4c63-b381-8e59fb6504f5`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:07:15,497::task::595::TaskManager.Task::(_updateState) Task=`2ef57a77-6aef-4c63-b381-8e59fb6504f5`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 09:07:15,497::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 09:07:15,497::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 09:07:15,498::task::990::TaskManager.Task::(_decref) Task=`2ef57a77-6aef-4c63-b381-8e59fb6504f5`::ref 0 aborting False >Thread-34::DEBUG::2014-07-10 09:07:15,502::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-34::DEBUG::2014-07-10 09:07:15,502::task::595::TaskManager.Task::(_updateState) Task=`e5107eaa-45c6-4fd6-98fa-c055fd7d2ba1`::moving from state init -> state preparing >Thread-34::INFO::2014-07-10 09:07:15,503::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-34::DEBUG::2014-07-10 09:07:15,503::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`86da4e70-4bf3-474d-8603-4c243f94e18c`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-10 09:07:15,503::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' for lock type 'shared' >Thread-34::DEBUG::2014-07-10 09:07:15,504::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-10 09:07:15,504::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`86da4e70-4bf3-474d-8603-4c243f94e18c`::Granted request >Thread-34::DEBUG::2014-07-10 09:07:15,505::task::827::TaskManager.Task::(resourceAcquired) Task=`e5107eaa-45c6-4fd6-98fa-c055fd7d2ba1`::_resourcesAcquired: Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee (shared) >Thread-34::DEBUG::2014-07-10 09:07:15,505::task::990::TaskManager.Task::(_decref) Task=`e5107eaa-45c6-4fd6-98fa-c055fd7d2ba1`::ref 1 aborting False >Thread-34::INFO::2014-07-10 09:07:15,506::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532067385344', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:07:15,506::task::1185::TaskManager.Task::(prepare) Task=`e5107eaa-45c6-4fd6-98fa-c055fd7d2ba1`::finished: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532067385344', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:07:15,506::task::595::TaskManager.Task::(_updateState) Task=`e5107eaa-45c6-4fd6-98fa-c055fd7d2ba1`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-10 09:07:15,506::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee': < ResourceRef 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-10 09:07:15,507::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-10 09:07:15,507::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' >Thread-34::DEBUG::2014-07-10 09:07:15,507::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' (0 active users) >Thread-34::DEBUG::2014-07-10 09:07:15,507::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-10 09:07:15,507::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', Clearing records. >Thread-34::DEBUG::2014-07-10 09:07:15,508::task::990::TaskManager.Task::(_decref) Task=`e5107eaa-45c6-4fd6-98fa-c055fd7d2ba1`::ref 0 aborting False >Thread-40::DEBUG::2014-07-10 09:07:15,842::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lion.qa.lab.tlv.redhat.com:_export_yuri2_backup2/6a70504d-00df-4869-8695-0f442053f6b6/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-40::DEBUG::2014-07-10 09:07:15,867::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n369 bytes (369 B) copied, 0.000428044 s, 862 kB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:07:16,312::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:07:16,484::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.109976 s, 9.3 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:07:18,500::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:07:18,601::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0327224 s, 31.3 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:07:20,615::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:07:20,708::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0356029 s, 28.8 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-10 09:07:20,862::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/metadata bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-10 09:07:20,890::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000685588 s, 6.0 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 09:07:21,885::task::595::TaskManager.Task::(_updateState) Task=`b9c42a54-6f1f-49bd-af2b-854abf9bf2ce`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 09:07:21,885::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::INFO::2014-07-10 09:07:21,885::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000685588', 'lastCheck': '1.0', 'valid': True}, '6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000428044', 'lastCheck': '6.0', 'valid': True}} >Thread-14::DEBUG::2014-07-10 09:07:21,886::task::1185::TaskManager.Task::(prepare) Task=`b9c42a54-6f1f-49bd-af2b-854abf9bf2ce`::finished: {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000685588', 'lastCheck': '1.0', 'valid': True}, '6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000428044', 'lastCheck': '6.0', 'valid': True}} >Thread-14::DEBUG::2014-07-10 09:07:21,886::task::595::TaskManager.Task::(_updateState) Task=`b9c42a54-6f1f-49bd-af2b-854abf9bf2ce`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 09:07:21,886::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 09:07:21,886::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 09:07:21,886::task::990::TaskManager.Task::(_decref) Task=`b9c42a54-6f1f-49bd-af2b-854abf9bf2ce`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 09:07:22,724::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:07:22,812::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0297031 s, 34.5 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:07:24,827::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:07:24,919::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0306848 s, 33.4 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 09:07:25,536::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-14::DEBUG::2014-07-10 09:07:25,537::task::595::TaskManager.Task::(_updateState) Task=`6f36b518-0d2d-4812-a043-0fb2c0727cf2`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 09:07:25,538::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-14::INFO::2014-07-10 09:07:25,538::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:07:25,539::task::1185::TaskManager.Task::(prepare) Task=`6f36b518-0d2d-4812-a043-0fb2c0727cf2`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:07:25,539::task::595::TaskManager.Task::(_updateState) Task=`6f36b518-0d2d-4812-a043-0fb2c0727cf2`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 09:07:25,539::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 09:07:25,539::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 09:07:25,539::task::990::TaskManager.Task::(_decref) Task=`6f36b518-0d2d-4812-a043-0fb2c0727cf2`::ref 0 aborting False >Thread-34::DEBUG::2014-07-10 09:07:25,544::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-34::DEBUG::2014-07-10 09:07:25,544::task::595::TaskManager.Task::(_updateState) Task=`8efa1628-3e92-4bc7-afa0-c6fae3f9e87f`::moving from state init -> state preparing >Thread-34::INFO::2014-07-10 09:07:25,545::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-34::DEBUG::2014-07-10 09:07:25,546::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`fac25037-3556-45f1-a3bd-4b894dbc750a`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-10 09:07:25,546::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' for lock type 'shared' >Thread-34::DEBUG::2014-07-10 09:07:25,546::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-10 09:07:25,547::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`fac25037-3556-45f1-a3bd-4b894dbc750a`::Granted request >Thread-34::DEBUG::2014-07-10 09:07:25,547::task::827::TaskManager.Task::(resourceAcquired) Task=`8efa1628-3e92-4bc7-afa0-c6fae3f9e87f`::_resourcesAcquired: Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee (shared) >Thread-34::DEBUG::2014-07-10 09:07:25,548::task::990::TaskManager.Task::(_decref) Task=`8efa1628-3e92-4bc7-afa0-c6fae3f9e87f`::ref 1 aborting False >Thread-34::INFO::2014-07-10 09:07:25,549::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532067385344', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:07:25,549::task::1185::TaskManager.Task::(prepare) Task=`8efa1628-3e92-4bc7-afa0-c6fae3f9e87f`::finished: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532067385344', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:07:25,549::task::595::TaskManager.Task::(_updateState) Task=`8efa1628-3e92-4bc7-afa0-c6fae3f9e87f`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-10 09:07:25,549::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee': < ResourceRef 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-10 09:07:25,550::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-10 09:07:25,550::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' >Thread-34::DEBUG::2014-07-10 09:07:25,550::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' (0 active users) >Thread-34::DEBUG::2014-07-10 09:07:25,550::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-10 09:07:25,550::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', Clearing records. >Thread-34::DEBUG::2014-07-10 09:07:25,551::task::990::TaskManager.Task::(_decref) Task=`8efa1628-3e92-4bc7-afa0-c6fae3f9e87f`::ref 0 aborting False >Thread-40::DEBUG::2014-07-10 09:07:25,897::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lion.qa.lab.tlv.redhat.com:_export_yuri2_backup2/6a70504d-00df-4869-8695-0f442053f6b6/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-40::DEBUG::2014-07-10 09:07:25,918::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n369 bytes (369 B) copied, 0.000441244 s, 836 kB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:07:26,936::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:07:27,030::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.036258 s, 28.2 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:07:29,045::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:07:29,130::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0284361 s, 36.0 MB/s\n'; <rc> = 0 >Thread-70::DEBUG::2014-07-10 09:07:30,449::task::595::TaskManager.Task::(_updateState) Task=`b3feb980-9a84-4045-9bf2-49ab9f7d07b2`::moving from state init -> state preparing >Thread-70::INFO::2014-07-10 09:07:30,450::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='cfaeead2-7caa-467c-b389-c89840ae6605', volUUID='567fe32d-31a6-4ff6-90f3-fd6a656fbecc', options=None) >Thread-70::INFO::2014-07-10 09:07:30,451::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-70::DEBUG::2014-07-10 09:07:30,451::task::1185::TaskManager.Task::(prepare) Task=`b3feb980-9a84-4045-9bf2-49ab9f7d07b2`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-70::DEBUG::2014-07-10 09:07:30,451::task::595::TaskManager.Task::(_updateState) Task=`b3feb980-9a84-4045-9bf2-49ab9f7d07b2`::moving from state preparing -> state finished >Thread-70::DEBUG::2014-07-10 09:07:30,452::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-70::DEBUG::2014-07-10 09:07:30,452::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-70::DEBUG::2014-07-10 09:07:30,452::task::990::TaskManager.Task::(_decref) Task=`b3feb980-9a84-4045-9bf2-49ab9f7d07b2`::ref 0 aborting False >Thread-18::DEBUG::2014-07-10 09:07:30,922::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/metadata bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-10 09:07:30,944::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00057008 s, 7.2 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:07:31,146::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Thread-60::DEBUG::2014-07-10 09:07:31,233::task::595::TaskManager.Task::(_updateState) Task=`e52e50a3-a9fd-4a5c-b5fb-654ccee0ebcd`::moving from state init -> state preparing >Thread-60::INFO::2014-07-10 09:07:31,237::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='b034d5b0-e1e0-4011-b49b-4d45ddb11556', volUUID='3d7f62b5-328f-4d8e-8b69-873cfb5ae14d', options=None) >Thread-60::INFO::2014-07-10 09:07:31,241::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-60::DEBUG::2014-07-10 09:07:31,243::task::1185::TaskManager.Task::(prepare) Task=`e52e50a3-a9fd-4a5c-b5fb-654ccee0ebcd`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-60::DEBUG::2014-07-10 09:07:31,246::task::595::TaskManager.Task::(_updateState) Task=`e52e50a3-a9fd-4a5c-b5fb-654ccee0ebcd`::moving from state preparing -> state finished >Thread-60::DEBUG::2014-07-10 09:07:31,260::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-60::DEBUG::2014-07-10 09:07:31,266::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-60::DEBUG::2014-07-10 09:07:31,273::task::990::TaskManager.Task::(_decref) Task=`e52e50a3-a9fd-4a5c-b5fb-654ccee0ebcd`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 09:07:31,303::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0397892 s, 25.7 MB/s\n'; <rc> = 0 >Thread-51::DEBUG::2014-07-10 09:07:31,489::task::595::TaskManager.Task::(_updateState) Task=`64c01be6-57b7-49d6-83b0-73e5ed2487c2`::moving from state init -> state preparing >Thread-51::INFO::2014-07-10 09:07:31,490::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='76fdb054-02cd-42ed-9721-b3e65b34c3a4', volUUID='022dfe46-2cf7-4915-80b3-883158e3ca83', options=None) >Thread-51::INFO::2014-07-10 09:07:31,490::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-51::DEBUG::2014-07-10 09:07:31,491::task::1185::TaskManager.Task::(prepare) Task=`64c01be6-57b7-49d6-83b0-73e5ed2487c2`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-51::DEBUG::2014-07-10 09:07:31,491::task::595::TaskManager.Task::(_updateState) Task=`64c01be6-57b7-49d6-83b0-73e5ed2487c2`::moving from state preparing -> state finished >Thread-51::DEBUG::2014-07-10 09:07:31,491::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-51::DEBUG::2014-07-10 09:07:31,491::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-51::DEBUG::2014-07-10 09:07:31,491::task::990::TaskManager.Task::(_decref) Task=`64c01be6-57b7-49d6-83b0-73e5ed2487c2`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 09:07:33,319::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:07:33,407::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0266783 s, 38.4 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:07:35,422::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:07:35,512::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0320948 s, 31.9 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 09:07:35,571::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-14::DEBUG::2014-07-10 09:07:35,573::task::595::TaskManager.Task::(_updateState) Task=`227ed3d3-5cea-4a8a-950e-b2729715117b`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 09:07:35,573::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-14::INFO::2014-07-10 09:07:35,574::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:07:35,574::task::1185::TaskManager.Task::(prepare) Task=`227ed3d3-5cea-4a8a-950e-b2729715117b`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:07:35,574::task::595::TaskManager.Task::(_updateState) Task=`227ed3d3-5cea-4a8a-950e-b2729715117b`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 09:07:35,574::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 09:07:35,574::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 09:07:35,575::task::990::TaskManager.Task::(_decref) Task=`227ed3d3-5cea-4a8a-950e-b2729715117b`::ref 0 aborting False >Thread-34::DEBUG::2014-07-10 09:07:35,579::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-34::DEBUG::2014-07-10 09:07:35,579::task::595::TaskManager.Task::(_updateState) Task=`77c6970d-9e5c-4338-acf3-ecb4ce5ee7b5`::moving from state init -> state preparing >Thread-34::INFO::2014-07-10 09:07:35,580::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-34::DEBUG::2014-07-10 09:07:35,580::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`e99eef1b-de2f-43b1-ba5a-9bebb015ebf8`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-10 09:07:35,581::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' for lock type 'shared' >Thread-34::DEBUG::2014-07-10 09:07:35,581::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-10 09:07:35,581::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`e99eef1b-de2f-43b1-ba5a-9bebb015ebf8`::Granted request >Thread-34::DEBUG::2014-07-10 09:07:35,582::task::827::TaskManager.Task::(resourceAcquired) Task=`77c6970d-9e5c-4338-acf3-ecb4ce5ee7b5`::_resourcesAcquired: Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee (shared) >Thread-34::DEBUG::2014-07-10 09:07:35,582::task::990::TaskManager.Task::(_decref) Task=`77c6970d-9e5c-4338-acf3-ecb4ce5ee7b5`::ref 1 aborting False >Thread-34::INFO::2014-07-10 09:07:35,583::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532067385344', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:07:35,583::task::1185::TaskManager.Task::(prepare) Task=`77c6970d-9e5c-4338-acf3-ecb4ce5ee7b5`::finished: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532067385344', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:07:35,584::task::595::TaskManager.Task::(_updateState) Task=`77c6970d-9e5c-4338-acf3-ecb4ce5ee7b5`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-10 09:07:35,584::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee': < ResourceRef 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-10 09:07:35,584::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-10 09:07:35,584::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' >Thread-34::DEBUG::2014-07-10 09:07:35,585::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' (0 active users) >Thread-34::DEBUG::2014-07-10 09:07:35,585::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-10 09:07:35,585::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', Clearing records. >Thread-34::DEBUG::2014-07-10 09:07:35,585::task::990::TaskManager.Task::(_decref) Task=`77c6970d-9e5c-4338-acf3-ecb4ce5ee7b5`::ref 0 aborting False >Thread-40::DEBUG::2014-07-10 09:07:35,948::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lion.qa.lab.tlv.redhat.com:_export_yuri2_backup2/6a70504d-00df-4869-8695-0f442053f6b6/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-40::DEBUG::2014-07-10 09:07:35,974::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n369 bytes (369 B) copied, 0.00771645 s, 47.8 kB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 09:07:37,068::task::595::TaskManager.Task::(_updateState) Task=`0164d4d1-62d9-4560-b0df-80d068189919`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 09:07:37,068::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::INFO::2014-07-10 09:07:37,069::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00057008', 'lastCheck': '6.1', 'valid': True}, '6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00771645', 'lastCheck': '1.1', 'valid': True}} >Thread-14::DEBUG::2014-07-10 09:07:37,069::task::1185::TaskManager.Task::(prepare) Task=`0164d4d1-62d9-4560-b0df-80d068189919`::finished: {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00057008', 'lastCheck': '6.1', 'valid': True}, '6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00771645', 'lastCheck': '1.1', 'valid': True}} >Thread-14::DEBUG::2014-07-10 09:07:37,069::task::595::TaskManager.Task::(_updateState) Task=`0164d4d1-62d9-4560-b0df-80d068189919`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 09:07:37,070::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 09:07:37,070::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 09:07:37,070::task::990::TaskManager.Task::(_decref) Task=`0164d4d1-62d9-4560-b0df-80d068189919`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 09:07:37,528::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:07:37,621::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0367597 s, 27.9 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:07:39,637::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:07:39,739::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0453346 s, 22.6 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-10 09:07:40,994::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/metadata bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-10 09:07:41,017::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000704554 s, 5.8 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:07:41,754::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:07:41,849::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0357352 s, 28.7 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:07:43,864::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:07:44,017::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0334547 s, 30.6 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 09:07:45,631::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-14::DEBUG::2014-07-10 09:07:45,632::task::595::TaskManager.Task::(_updateState) Task=`39ed36c7-47c4-4efa-a43e-bd462780a7f8`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 09:07:45,632::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-14::INFO::2014-07-10 09:07:45,633::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:07:45,633::task::1185::TaskManager.Task::(prepare) Task=`39ed36c7-47c4-4efa-a43e-bd462780a7f8`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:07:45,633::task::595::TaskManager.Task::(_updateState) Task=`39ed36c7-47c4-4efa-a43e-bd462780a7f8`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 09:07:45,633::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 09:07:45,633::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 09:07:45,634::task::990::TaskManager.Task::(_decref) Task=`39ed36c7-47c4-4efa-a43e-bd462780a7f8`::ref 0 aborting False >Thread-34::DEBUG::2014-07-10 09:07:45,637::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-34::DEBUG::2014-07-10 09:07:45,638::task::595::TaskManager.Task::(_updateState) Task=`40983d9a-66ac-41c6-91f5-4b17a188131d`::moving from state init -> state preparing >Thread-34::INFO::2014-07-10 09:07:45,638::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-34::DEBUG::2014-07-10 09:07:45,639::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`308c09dc-2711-41d1-b614-d2aeb1b958d9`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-10 09:07:45,639::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' for lock type 'shared' >Thread-34::DEBUG::2014-07-10 09:07:45,639::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-10 09:07:45,640::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`308c09dc-2711-41d1-b614-d2aeb1b958d9`::Granted request >Thread-34::DEBUG::2014-07-10 09:07:45,640::task::827::TaskManager.Task::(resourceAcquired) Task=`40983d9a-66ac-41c6-91f5-4b17a188131d`::_resourcesAcquired: Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee (shared) >Thread-34::DEBUG::2014-07-10 09:07:45,640::task::990::TaskManager.Task::(_decref) Task=`40983d9a-66ac-41c6-91f5-4b17a188131d`::ref 1 aborting False >Thread-34::INFO::2014-07-10 09:07:45,641::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532067385344', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:07:45,641::task::1185::TaskManager.Task::(prepare) Task=`40983d9a-66ac-41c6-91f5-4b17a188131d`::finished: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532067385344', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:07:45,642::task::595::TaskManager.Task::(_updateState) Task=`40983d9a-66ac-41c6-91f5-4b17a188131d`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-10 09:07:45,642::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee': < ResourceRef 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-10 09:07:45,642::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-10 09:07:45,642::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' >Thread-34::DEBUG::2014-07-10 09:07:45,642::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' (0 active users) >Thread-34::DEBUG::2014-07-10 09:07:45,643::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-10 09:07:45,643::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', Clearing records. >Thread-34::DEBUG::2014-07-10 09:07:45,643::task::990::TaskManager.Task::(_decref) Task=`40983d9a-66ac-41c6-91f5-4b17a188131d`::ref 0 aborting False >Thread-40::DEBUG::2014-07-10 09:07:45,977::domainMonitor::192::Storage.DomainMonitorThread::(_monitorDomain) Refreshing domain 6a70504d-00df-4869-8695-0f442053f6b6 >Thread-40::DEBUG::2014-07-10 09:07:46,004::fileSD::150::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/lion.qa.lab.tlv.redhat.com:_export_yuri2_backup2/6a70504d-00df-4869-8695-0f442053f6b6 >Thread-40::DEBUG::2014-07-10 09:07:46,006::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend >Thread-40::DEBUG::2014-07-10 09:07:46,010::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Backup', 'DESCRIPTION=test', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=0', 'POOL_UUID=4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', 'REMOTE_PATH=lion.qa.lab.tlv.redhat.com:/export/yuri2/backup2', 'ROLE=Regular', 'SDUUID=6a70504d-00df-4869-8695-0f442053f6b6', 'TYPE=NFS', 'VERSION=0', '_SHA_CKSUM=aab6b8e901ec435cd5f9de3c9e3f8b45dca569e0'] >Thread-40::DEBUG::2014-07-10 09:07:46,011::fileSD::609::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images [] >Thread-40::INFO::2014-07-10 09:07:46,011::sd::384::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 6a70504d-00df-4869-8695-0f442053f6b6_imageNS already registered >Thread-40::INFO::2014-07-10 09:07:46,011::sd::392::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 6a70504d-00df-4869-8695-0f442053f6b6_volumeNS already registered >Thread-40::DEBUG::2014-07-10 09:07:46,037::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lion.qa.lab.tlv.redhat.com:_export_yuri2_backup2/6a70504d-00df-4869-8695-0f442053f6b6/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-40::DEBUG::2014-07-10 09:07:46,057::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n369 bytes (369 B) copied, 0.000534397 s, 690 kB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:07:46,169::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:07:46,274::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0345326 s, 29.7 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:07:48,289::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:07:48,379::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.030272 s, 33.8 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:07:50,394::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:07:50,486::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0354337 s, 28.9 MB/s\n'; <rc> = 0 >Thread-64::DEBUG::2014-07-10 09:07:50,528::task::595::TaskManager.Task::(_updateState) Task=`2b350d27-103a-4b53-8006-bf24df92f94d`::moving from state init -> state preparing >Thread-64::INFO::2014-07-10 09:07:50,528::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='aa20346a-4d3a-4e07-b8e1-52c0ebe4168c', volUUID='58fefce2-9bce-4bff-8949-8c6ce8122b27', options=None) >Thread-64::INFO::2014-07-10 09:07:50,529::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-64::DEBUG::2014-07-10 09:07:50,529::task::1185::TaskManager.Task::(prepare) Task=`2b350d27-103a-4b53-8006-bf24df92f94d`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-64::DEBUG::2014-07-10 09:07:50,529::task::595::TaskManager.Task::(_updateState) Task=`2b350d27-103a-4b53-8006-bf24df92f94d`::moving from state preparing -> state finished >Thread-64::DEBUG::2014-07-10 09:07:50,530::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-64::DEBUG::2014-07-10 09:07:50,530::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-64::DEBUG::2014-07-10 09:07:50,530::task::990::TaskManager.Task::(_decref) Task=`2b350d27-103a-4b53-8006-bf24df92f94d`::ref 0 aborting False >Thread-18::DEBUG::2014-07-10 09:07:51,047::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/metadata bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-10 09:07:51,080::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.0141932 s, 289 kB/s\n'; <rc> = 0 >Thread-54::DEBUG::2014-07-10 09:07:51,452::task::595::TaskManager.Task::(_updateState) Task=`1c566600-c570-470f-96db-078d53aa4b22`::moving from state init -> state preparing >Thread-54::INFO::2014-07-10 09:07:51,453::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='28408446-e5fd-4565-a976-e760951593fe', volUUID='776303a2-5585-451e-826e-0e338d4a1e98', options=None) >Thread-73::DEBUG::2014-07-10 09:07:51,453::task::595::TaskManager.Task::(_updateState) Task=`906ce8fb-1e3c-4271-8861-70611fae13b3`::moving from state init -> state preparing >Thread-73::INFO::2014-07-10 09:07:51,455::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='c01d693b-cba0-4fed-9ad7-0aaa28912a19', volUUID='4bb5d954-2a50-4028-b299-0b43c261270c', options=None) >Thread-54::INFO::2014-07-10 09:07:51,455::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-54::DEBUG::2014-07-10 09:07:51,456::task::1185::TaskManager.Task::(prepare) Task=`1c566600-c570-470f-96db-078d53aa4b22`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-73::INFO::2014-07-10 09:07:51,457::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-54::DEBUG::2014-07-10 09:07:51,458::task::595::TaskManager.Task::(_updateState) Task=`1c566600-c570-470f-96db-078d53aa4b22`::moving from state preparing -> state finished >Thread-73::DEBUG::2014-07-10 09:07:51,458::task::1185::TaskManager.Task::(prepare) Task=`906ce8fb-1e3c-4271-8861-70611fae13b3`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-54::DEBUG::2014-07-10 09:07:51,459::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-73::DEBUG::2014-07-10 09:07:51,460::task::595::TaskManager.Task::(_updateState) Task=`906ce8fb-1e3c-4271-8861-70611fae13b3`::moving from state preparing -> state finished >Thread-54::DEBUG::2014-07-10 09:07:51,460::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-73::DEBUG::2014-07-10 09:07:51,461::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-54::DEBUG::2014-07-10 09:07:51,462::task::990::TaskManager.Task::(_decref) Task=`1c566600-c570-470f-96db-078d53aa4b22`::ref 0 aborting False >Thread-73::DEBUG::2014-07-10 09:07:51,462::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-73::DEBUG::2014-07-10 09:07:51,463::task::990::TaskManager.Task::(_decref) Task=`906ce8fb-1e3c-4271-8861-70611fae13b3`::ref 0 aborting False >Thread-14::DEBUG::2014-07-10 09:07:52,265::task::595::TaskManager.Task::(_updateState) Task=`fe209670-4bb5-4098-b16f-e773d448b6c2`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 09:07:52,265::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::INFO::2014-07-10 09:07:52,266::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0141932', 'lastCheck': '1.2', 'valid': True}, '6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000534397', 'lastCheck': '6.2', 'valid': True}} >Thread-14::DEBUG::2014-07-10 09:07:52,266::task::1185::TaskManager.Task::(prepare) Task=`fe209670-4bb5-4098-b16f-e773d448b6c2`::finished: {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0141932', 'lastCheck': '1.2', 'valid': True}, '6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000534397', 'lastCheck': '6.2', 'valid': True}} >Thread-14::DEBUG::2014-07-10 09:07:52,266::task::595::TaskManager.Task::(_updateState) Task=`fe209670-4bb5-4098-b16f-e773d448b6c2`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 09:07:52,267::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 09:07:52,267::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 09:07:52,267::task::990::TaskManager.Task::(_decref) Task=`fe209670-4bb5-4098-b16f-e773d448b6c2`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 09:07:52,501::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:07:52,601::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0364263 s, 28.1 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:07:54,617::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:07:54,716::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0301358 s, 34.0 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 09:07:55,673::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-14::DEBUG::2014-07-10 09:07:55,675::task::595::TaskManager.Task::(_updateState) Task=`bd96218a-2f22-43a1-b0a5-f240af1ec8eb`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 09:07:55,675::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-14::INFO::2014-07-10 09:07:55,675::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:07:55,676::task::1185::TaskManager.Task::(prepare) Task=`bd96218a-2f22-43a1-b0a5-f240af1ec8eb`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:07:55,676::task::595::TaskManager.Task::(_updateState) Task=`bd96218a-2f22-43a1-b0a5-f240af1ec8eb`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 09:07:55,676::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 09:07:55,676::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 09:07:55,676::task::990::TaskManager.Task::(_decref) Task=`bd96218a-2f22-43a1-b0a5-f240af1ec8eb`::ref 0 aborting False >Thread-34::DEBUG::2014-07-10 09:07:55,680::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-34::DEBUG::2014-07-10 09:07:55,681::task::595::TaskManager.Task::(_updateState) Task=`c835cb25-e204-4f9a-9f73-c27ad1d0e677`::moving from state init -> state preparing >Thread-34::INFO::2014-07-10 09:07:55,681::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-34::DEBUG::2014-07-10 09:07:55,682::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`92795362-d7ff-4fb6-b918-e43b82bc5bd4`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-10 09:07:55,682::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' for lock type 'shared' >Thread-34::DEBUG::2014-07-10 09:07:55,682::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-10 09:07:55,683::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`92795362-d7ff-4fb6-b918-e43b82bc5bd4`::Granted request >Thread-34::DEBUG::2014-07-10 09:07:55,683::task::827::TaskManager.Task::(resourceAcquired) Task=`c835cb25-e204-4f9a-9f73-c27ad1d0e677`::_resourcesAcquired: Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee (shared) >Thread-34::DEBUG::2014-07-10 09:07:55,683::task::990::TaskManager.Task::(_decref) Task=`c835cb25-e204-4f9a-9f73-c27ad1d0e677`::ref 1 aborting False >Thread-34::INFO::2014-07-10 09:07:55,685::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532067385344', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:07:55,685::task::1185::TaskManager.Task::(prepare) Task=`c835cb25-e204-4f9a-9f73-c27ad1d0e677`::finished: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532067385344', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:07:55,685::task::595::TaskManager.Task::(_updateState) Task=`c835cb25-e204-4f9a-9f73-c27ad1d0e677`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-10 09:07:55,685::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee': < ResourceRef 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-10 09:07:55,685::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-10 09:07:55,686::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' >Thread-34::DEBUG::2014-07-10 09:07:55,686::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' (0 active users) >Thread-34::DEBUG::2014-07-10 09:07:55,686::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-10 09:07:55,686::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', Clearing records. >Thread-34::DEBUG::2014-07-10 09:07:55,686::task::990::TaskManager.Task::(_decref) Task=`c835cb25-e204-4f9a-9f73-c27ad1d0e677`::ref 0 aborting False >Thread-40::DEBUG::2014-07-10 09:07:56,094::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lion.qa.lab.tlv.redhat.com:_export_yuri2_backup2/6a70504d-00df-4869-8695-0f442053f6b6/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-40::DEBUG::2014-07-10 09:07:56,123::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n369 bytes (369 B) copied, 0.00951193 s, 38.8 kB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:07:56,748::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:07:56,892::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0355351 s, 28.8 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:07:58,920::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:07:59,105::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.125808 s, 8.1 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-10 09:08:01,109::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/metadata bs=4096 count=1' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:08:01,128::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Thread-18::DEBUG::2014-07-10 09:08:01,211::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000602897 s, 6.8 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:08:01,676::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.478824 s, 2.1 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:08:03,692::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:08:03,782::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0308783 s, 33.2 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 09:08:05,710::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-14::DEBUG::2014-07-10 09:08:05,711::task::595::TaskManager.Task::(_updateState) Task=`23580402-9b2c-4e3a-9b91-bca4c2922245`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 09:08:05,711::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-14::INFO::2014-07-10 09:08:05,712::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:08:05,712::task::1185::TaskManager.Task::(prepare) Task=`23580402-9b2c-4e3a-9b91-bca4c2922245`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:08:05,712::task::595::TaskManager.Task::(_updateState) Task=`23580402-9b2c-4e3a-9b91-bca4c2922245`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 09:08:05,712::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 09:08:05,713::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 09:08:05,713::task::990::TaskManager.Task::(_decref) Task=`23580402-9b2c-4e3a-9b91-bca4c2922245`::ref 0 aborting False >Thread-34::DEBUG::2014-07-10 09:08:05,717::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-34::DEBUG::2014-07-10 09:08:05,717::task::595::TaskManager.Task::(_updateState) Task=`7b748055-1bc7-4bd4-939b-210b1cd7a77e`::moving from state init -> state preparing >Thread-34::INFO::2014-07-10 09:08:05,718::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-34::DEBUG::2014-07-10 09:08:05,718::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`f8ab2b1d-a084-42f4-bcb8-6eb76fdfdae8`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-10 09:08:05,718::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' for lock type 'shared' >Thread-34::DEBUG::2014-07-10 09:08:05,719::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-10 09:08:05,719::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`f8ab2b1d-a084-42f4-bcb8-6eb76fdfdae8`::Granted request >Thread-34::DEBUG::2014-07-10 09:08:05,719::task::827::TaskManager.Task::(resourceAcquired) Task=`7b748055-1bc7-4bd4-939b-210b1cd7a77e`::_resourcesAcquired: Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee (shared) >Thread-34::DEBUG::2014-07-10 09:08:05,720::task::990::TaskManager.Task::(_decref) Task=`7b748055-1bc7-4bd4-939b-210b1cd7a77e`::ref 1 aborting False >Thread-34::INFO::2014-07-10 09:08:05,721::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532067385344', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:08:05,721::task::1185::TaskManager.Task::(prepare) Task=`7b748055-1bc7-4bd4-939b-210b1cd7a77e`::finished: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532067385344', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:08:05,721::task::595::TaskManager.Task::(_updateState) Task=`7b748055-1bc7-4bd4-939b-210b1cd7a77e`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-10 09:08:05,722::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee': < ResourceRef 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-10 09:08:05,722::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-10 09:08:05,722::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' >Thread-34::DEBUG::2014-07-10 09:08:05,722::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' (0 active users) >Thread-34::DEBUG::2014-07-10 09:08:05,722::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-10 09:08:05,723::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', Clearing records. >Thread-34::DEBUG::2014-07-10 09:08:05,723::task::990::TaskManager.Task::(_decref) Task=`7b748055-1bc7-4bd4-939b-210b1cd7a77e`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 09:08:05,797::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:08:05,907::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0360271 s, 28.4 MB/s\n'; <rc> = 0 >Thread-40::DEBUG::2014-07-10 09:08:06,150::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lion.qa.lab.tlv.redhat.com:_export_yuri2_backup2/6a70504d-00df-4869-8695-0f442053f6b6/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-40::DEBUG::2014-07-10 09:08:06,169::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n369 bytes (369 B) copied, 0.000380815 s, 969 kB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 09:08:07,526::task::595::TaskManager.Task::(_updateState) Task=`2d0a3311-a593-4ba6-bfa7-b3a6230640a2`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 09:08:07,529::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::INFO::2014-07-10 09:08:07,530::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000602897', 'lastCheck': '5.9', 'valid': True}, '6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000380815', 'lastCheck': '1.4', 'valid': True}} >Thread-14::DEBUG::2014-07-10 09:08:07,530::task::1185::TaskManager.Task::(prepare) Task=`2d0a3311-a593-4ba6-bfa7-b3a6230640a2`::finished: {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000602897', 'lastCheck': '5.9', 'valid': True}, '6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000380815', 'lastCheck': '1.4', 'valid': True}} >Thread-14::DEBUG::2014-07-10 09:08:07,531::task::595::TaskManager.Task::(_updateState) Task=`2d0a3311-a593-4ba6-bfa7-b3a6230640a2`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 09:08:07,531::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 09:08:07,531::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 09:08:07,531::task::990::TaskManager.Task::(_decref) Task=`2d0a3311-a593-4ba6-bfa7-b3a6230640a2`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 09:08:07,922::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:08:08,015::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0331995 s, 30.8 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:08:10,030::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:08:10,122::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0299495 s, 34.2 MB/s\n'; <rc> = 0 >Thread-57::DEBUG::2014-07-10 09:08:10,692::task::595::TaskManager.Task::(_updateState) Task=`5dc36db7-85c0-4b4b-be76-85dea6ac8030`::moving from state init -> state preparing >Thread-57::INFO::2014-07-10 09:08:10,693::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='b6f6c0da-e67f-4902-b9ac-3069571a42fe', volUUID='c4cd1da8-05b7-45e0-80b1-1183d21443d9', options=None) >Thread-57::INFO::2014-07-10 09:08:10,693::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-57::DEBUG::2014-07-10 09:08:10,693::task::1185::TaskManager.Task::(prepare) Task=`5dc36db7-85c0-4b4b-be76-85dea6ac8030`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-57::DEBUG::2014-07-10 09:08:10,694::task::595::TaskManager.Task::(_updateState) Task=`5dc36db7-85c0-4b4b-be76-85dea6ac8030`::moving from state preparing -> state finished >Thread-57::DEBUG::2014-07-10 09:08:10,694::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-57::DEBUG::2014-07-10 09:08:10,694::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-57::DEBUG::2014-07-10 09:08:10,694::task::990::TaskManager.Task::(_decref) Task=`5dc36db7-85c0-4b4b-be76-85dea6ac8030`::ref 0 aborting False >Thread-67::DEBUG::2014-07-10 09:08:11,497::task::595::TaskManager.Task::(_updateState) Task=`af3d5c8f-c3c4-49c3-9f9a-ce28843421e8`::moving from state init -> state preparing >Thread-67::INFO::2014-07-10 09:08:11,498::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='f30c2cb7-a43a-4bf5-82b5-cfe07336f65c', volUUID='b0fbb3c9-55af-4a3a-95ad-fc56a80b9cf5', options=None) >Thread-67::INFO::2014-07-10 09:08:11,498::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-67::DEBUG::2014-07-10 09:08:11,498::task::1185::TaskManager.Task::(prepare) Task=`af3d5c8f-c3c4-49c3-9f9a-ce28843421e8`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-67::DEBUG::2014-07-10 09:08:11,498::task::595::TaskManager.Task::(_updateState) Task=`af3d5c8f-c3c4-49c3-9f9a-ce28843421e8`::moving from state preparing -> state finished >Thread-67::DEBUG::2014-07-10 09:08:11,499::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-67::DEBUG::2014-07-10 09:08:11,499::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-67::DEBUG::2014-07-10 09:08:11,499::task::990::TaskManager.Task::(_decref) Task=`af3d5c8f-c3c4-49c3-9f9a-ce28843421e8`::ref 0 aborting False >Thread-18::DEBUG::2014-07-10 09:08:11,622::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/metadata bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-10 09:08:11,644::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000547672 s, 7.5 MB/s\n'; <rc> = 0 >Thread-48::DEBUG::2014-07-10 09:08:11,703::task::595::TaskManager.Task::(_updateState) Task=`7a7d0b96-f999-471b-9ca6-c332033bd64d`::moving from state init -> state preparing >Thread-48::INFO::2014-07-10 09:08:11,704::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='0cd7d6ce-f497-4243-a690-c57744861eea', volUUID='10b6a7dd-dc6c-43fa-ba17-92e4331b0e0b', options=None) >Thread-48::INFO::2014-07-10 09:08:11,704::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-48::DEBUG::2014-07-10 09:08:11,704::task::1185::TaskManager.Task::(prepare) Task=`7a7d0b96-f999-471b-9ca6-c332033bd64d`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-48::DEBUG::2014-07-10 09:08:11,705::task::595::TaskManager.Task::(_updateState) Task=`7a7d0b96-f999-471b-9ca6-c332033bd64d`::moving from state preparing -> state finished >Thread-48::DEBUG::2014-07-10 09:08:11,705::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-48::DEBUG::2014-07-10 09:08:11,705::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-48::DEBUG::2014-07-10 09:08:11,705::task::990::TaskManager.Task::(_decref) Task=`7a7d0b96-f999-471b-9ca6-c332033bd64d`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 09:08:12,137::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:08:12,222::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0268872 s, 38.1 MB/s\n'; <rc> = 0 >Thread-76::DEBUG::2014-07-10 09:08:13,167::task::595::TaskManager.Task::(_updateState) Task=`c9ab820d-9221-4e48-8c52-e25a37a85c49`::moving from state init -> state preparing >Thread-76::INFO::2014-07-10 09:08:13,168::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='e4c65229-4247-4b33-b72a-f1d5ce72ad05', volUUID='cad94284-3ca9-4c30-933d-997f4460309e', options=None) >Thread-76::INFO::2014-07-10 09:08:13,168::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-76::DEBUG::2014-07-10 09:08:13,168::task::1185::TaskManager.Task::(prepare) Task=`c9ab820d-9221-4e48-8c52-e25a37a85c49`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-76::DEBUG::2014-07-10 09:08:13,169::task::595::TaskManager.Task::(_updateState) Task=`c9ab820d-9221-4e48-8c52-e25a37a85c49`::moving from state preparing -> state finished >Thread-76::DEBUG::2014-07-10 09:08:13,169::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-76::DEBUG::2014-07-10 09:08:13,169::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-76::DEBUG::2014-07-10 09:08:13,169::task::990::TaskManager.Task::(_decref) Task=`c9ab820d-9221-4e48-8c52-e25a37a85c49`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 09:08:14,237::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:08:14,330::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0358199 s, 28.6 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 09:08:15,752::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-14::DEBUG::2014-07-10 09:08:15,753::task::595::TaskManager.Task::(_updateState) Task=`2e515d53-9454-44a9-a965-bb04dca085dd`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 09:08:15,753::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-14::INFO::2014-07-10 09:08:15,754::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:08:15,754::task::1185::TaskManager.Task::(prepare) Task=`2e515d53-9454-44a9-a965-bb04dca085dd`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:08:15,754::task::595::TaskManager.Task::(_updateState) Task=`2e515d53-9454-44a9-a965-bb04dca085dd`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 09:08:15,754::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 09:08:15,754::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 09:08:15,754::task::990::TaskManager.Task::(_decref) Task=`2e515d53-9454-44a9-a965-bb04dca085dd`::ref 0 aborting False >Thread-34::DEBUG::2014-07-10 09:08:15,759::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-34::DEBUG::2014-07-10 09:08:15,759::task::595::TaskManager.Task::(_updateState) Task=`acd3f971-ef37-4831-99e2-33d92cde9230`::moving from state init -> state preparing >Thread-34::INFO::2014-07-10 09:08:15,759::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-34::DEBUG::2014-07-10 09:08:15,760::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`f4d35898-d177-47e4-9bad-a688a84e23c6`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-10 09:08:15,760::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' for lock type 'shared' >Thread-34::DEBUG::2014-07-10 09:08:15,760::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-10 09:08:15,760::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`f4d35898-d177-47e4-9bad-a688a84e23c6`::Granted request >Thread-34::DEBUG::2014-07-10 09:08:15,761::task::827::TaskManager.Task::(resourceAcquired) Task=`acd3f971-ef37-4831-99e2-33d92cde9230`::_resourcesAcquired: Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee (shared) >Thread-34::DEBUG::2014-07-10 09:08:15,761::task::990::TaskManager.Task::(_decref) Task=`acd3f971-ef37-4831-99e2-33d92cde9230`::ref 1 aborting False >Thread-34::INFO::2014-07-10 09:08:15,762::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532067385344', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:08:15,762::task::1185::TaskManager.Task::(prepare) Task=`acd3f971-ef37-4831-99e2-33d92cde9230`::finished: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532067385344', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:08:15,762::task::595::TaskManager.Task::(_updateState) Task=`acd3f971-ef37-4831-99e2-33d92cde9230`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-10 09:08:15,763::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee': < ResourceRef 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-10 09:08:15,763::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-10 09:08:15,763::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' >Thread-34::DEBUG::2014-07-10 09:08:15,763::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' (0 active users) >Thread-34::DEBUG::2014-07-10 09:08:15,763::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-10 09:08:15,764::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', Clearing records. >Thread-34::DEBUG::2014-07-10 09:08:15,764::task::990::TaskManager.Task::(_decref) Task=`acd3f971-ef37-4831-99e2-33d92cde9230`::ref 0 aborting False >Thread-40::DEBUG::2014-07-10 09:08:16,196::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lion.qa.lab.tlv.redhat.com:_export_yuri2_backup2/6a70504d-00df-4869-8695-0f442053f6b6/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-40::DEBUG::2014-07-10 09:08:16,216::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n369 bytes (369 B) copied, 0.000426047 s, 866 kB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:08:16,344::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:08:16,445::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0444371 s, 23.0 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:08:18,461::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:08:18,548::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0275227 s, 37.2 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:08:20,563::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:08:20,657::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0355252 s, 28.8 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-10 09:08:21,675::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/metadata bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-10 09:08:21,697::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000818917 s, 5.0 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:08:22,672::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Thread-14::DEBUG::2014-07-10 09:08:22,721::task::595::TaskManager.Task::(_updateState) Task=`f022d4b7-9843-48a3-ba65-99456872729b`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 09:08:22,724::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::INFO::2014-07-10 09:08:22,726::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000818917', 'lastCheck': '1.0', 'valid': True}, '6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000426047', 'lastCheck': '6.5', 'valid': True}} >Thread-14::DEBUG::2014-07-10 09:08:22,727::task::1185::TaskManager.Task::(prepare) Task=`f022d4b7-9843-48a3-ba65-99456872729b`::finished: {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000818917', 'lastCheck': '1.0', 'valid': True}, '6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000426047', 'lastCheck': '6.5', 'valid': True}} >Thread-14::DEBUG::2014-07-10 09:08:22,728::task::595::TaskManager.Task::(_updateState) Task=`f022d4b7-9843-48a3-ba65-99456872729b`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 09:08:22,729::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 09:08:22,730::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 09:08:22,731::task::990::TaskManager.Task::(_decref) Task=`f022d4b7-9843-48a3-ba65-99456872729b`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 09:08:22,932::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.105952 s, 9.7 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:08:24,947::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:08:25,040::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0295297 s, 34.7 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 09:08:25,858::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-14::DEBUG::2014-07-10 09:08:25,859::task::595::TaskManager.Task::(_updateState) Task=`e4875076-4b0f-4501-8911-044475e708d6`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 09:08:25,860::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-14::INFO::2014-07-10 09:08:25,860::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:08:25,860::task::1185::TaskManager.Task::(prepare) Task=`e4875076-4b0f-4501-8911-044475e708d6`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:08:25,861::task::595::TaskManager.Task::(_updateState) Task=`e4875076-4b0f-4501-8911-044475e708d6`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 09:08:25,861::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 09:08:25,861::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 09:08:25,861::task::990::TaskManager.Task::(_decref) Task=`e4875076-4b0f-4501-8911-044475e708d6`::ref 0 aborting False >Thread-34::DEBUG::2014-07-10 09:08:25,905::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-34::DEBUG::2014-07-10 09:08:25,906::task::595::TaskManager.Task::(_updateState) Task=`99f7e067-3baf-48bd-a4af-99e6ab7f0176`::moving from state init -> state preparing >Thread-34::INFO::2014-07-10 09:08:25,906::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-34::DEBUG::2014-07-10 09:08:25,907::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`dd9d8bb1-0d08-4b72-aa2d-e5205d87277d`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-10 09:08:25,907::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' for lock type 'shared' >Thread-34::DEBUG::2014-07-10 09:08:25,907::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-10 09:08:25,907::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`dd9d8bb1-0d08-4b72-aa2d-e5205d87277d`::Granted request >Thread-34::DEBUG::2014-07-10 09:08:25,908::task::827::TaskManager.Task::(resourceAcquired) Task=`99f7e067-3baf-48bd-a4af-99e6ab7f0176`::_resourcesAcquired: Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee (shared) >Thread-34::DEBUG::2014-07-10 09:08:25,908::task::990::TaskManager.Task::(_decref) Task=`99f7e067-3baf-48bd-a4af-99e6ab7f0176`::ref 1 aborting False >Thread-34::INFO::2014-07-10 09:08:25,911::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532067385344', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:08:25,912::task::1185::TaskManager.Task::(prepare) Task=`99f7e067-3baf-48bd-a4af-99e6ab7f0176`::finished: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532067385344', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:08:25,913::task::595::TaskManager.Task::(_updateState) Task=`99f7e067-3baf-48bd-a4af-99e6ab7f0176`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-10 09:08:25,914::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee': < ResourceRef 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-10 09:08:25,915::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-10 09:08:25,917::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' >Thread-34::DEBUG::2014-07-10 09:08:25,917::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' (0 active users) >Thread-34::DEBUG::2014-07-10 09:08:25,918::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-10 09:08:25,918::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', Clearing records. >Thread-34::DEBUG::2014-07-10 09:08:25,918::task::990::TaskManager.Task::(_decref) Task=`99f7e067-3baf-48bd-a4af-99e6ab7f0176`::ref 0 aborting False >Thread-40::DEBUG::2014-07-10 09:08:26,247::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lion.qa.lab.tlv.redhat.com:_export_yuri2_backup2/6a70504d-00df-4869-8695-0f442053f6b6/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-40::DEBUG::2014-07-10 09:08:26,267::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n369 bytes (369 B) copied, 0.000482958 s, 764 kB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:08:27,055::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:08:27,144::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0316265 s, 32.4 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:08:29,159::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:08:29,246::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0316662 s, 32.3 MB/s\n'; <rc> = 0 >Thread-70::DEBUG::2014-07-10 09:08:30,721::task::595::TaskManager.Task::(_updateState) Task=`f93c6c2f-99f1-4406-9a50-d84b06df5cfa`::moving from state init -> state preparing >Thread-70::INFO::2014-07-10 09:08:30,722::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='cfaeead2-7caa-467c-b389-c89840ae6605', volUUID='567fe32d-31a6-4ff6-90f3-fd6a656fbecc', options=None) >Thread-70::INFO::2014-07-10 09:08:30,723::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-70::DEBUG::2014-07-10 09:08:30,723::task::1185::TaskManager.Task::(prepare) Task=`f93c6c2f-99f1-4406-9a50-d84b06df5cfa`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-70::DEBUG::2014-07-10 09:08:30,723::task::595::TaskManager.Task::(_updateState) Task=`f93c6c2f-99f1-4406-9a50-d84b06df5cfa`::moving from state preparing -> state finished >Thread-70::DEBUG::2014-07-10 09:08:30,723::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-70::DEBUG::2014-07-10 09:08:30,723::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-70::DEBUG::2014-07-10 09:08:30,723::task::990::TaskManager.Task::(_decref) Task=`f93c6c2f-99f1-4406-9a50-d84b06df5cfa`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 09:08:31,262::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:08:31,479::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0318872 s, 32.1 MB/s\n'; <rc> = 0 >Thread-60::DEBUG::2014-07-10 09:08:31,560::task::595::TaskManager.Task::(_updateState) Task=`074a9e44-5124-4b75-bd7b-39d814b73a00`::moving from state init -> state preparing >Thread-60::INFO::2014-07-10 09:08:31,560::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='b034d5b0-e1e0-4011-b49b-4d45ddb11556', volUUID='3d7f62b5-328f-4d8e-8b69-873cfb5ae14d', options=None) >Thread-60::INFO::2014-07-10 09:08:31,561::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-60::DEBUG::2014-07-10 09:08:31,561::task::1185::TaskManager.Task::(prepare) Task=`074a9e44-5124-4b75-bd7b-39d814b73a00`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-60::DEBUG::2014-07-10 09:08:31,561::task::595::TaskManager.Task::(_updateState) Task=`074a9e44-5124-4b75-bd7b-39d814b73a00`::moving from state preparing -> state finished >Thread-60::DEBUG::2014-07-10 09:08:31,561::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-60::DEBUG::2014-07-10 09:08:31,561::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-60::DEBUG::2014-07-10 09:08:31,562::task::990::TaskManager.Task::(_decref) Task=`074a9e44-5124-4b75-bd7b-39d814b73a00`::ref 0 aborting False >Thread-18::DEBUG::2014-07-10 09:08:31,725::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/metadata bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-10 09:08:31,747::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000644147 s, 6.4 MB/s\n'; <rc> = 0 >Thread-51::DEBUG::2014-07-10 09:08:31,769::task::595::TaskManager.Task::(_updateState) Task=`ca1f51c3-015c-4c82-b69d-da4cce4a587b`::moving from state init -> state preparing >Thread-51::INFO::2014-07-10 09:08:31,772::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='76fdb054-02cd-42ed-9721-b3e65b34c3a4', volUUID='022dfe46-2cf7-4915-80b3-883158e3ca83', options=None) >Thread-51::INFO::2014-07-10 09:08:31,775::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-51::DEBUG::2014-07-10 09:08:31,777::task::1185::TaskManager.Task::(prepare) Task=`ca1f51c3-015c-4c82-b69d-da4cce4a587b`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-51::DEBUG::2014-07-10 09:08:31,779::task::595::TaskManager.Task::(_updateState) Task=`ca1f51c3-015c-4c82-b69d-da4cce4a587b`::moving from state preparing -> state finished >Thread-51::DEBUG::2014-07-10 09:08:31,782::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-51::DEBUG::2014-07-10 09:08:31,784::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-51::DEBUG::2014-07-10 09:08:31,785::task::990::TaskManager.Task::(_decref) Task=`ca1f51c3-015c-4c82-b69d-da4cce4a587b`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 09:08:33,494::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:08:33,590::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0384132 s, 26.7 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:08:35,605::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:08:35,709::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0428262 s, 23.9 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 09:08:35,946::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-14::DEBUG::2014-07-10 09:08:35,947::task::595::TaskManager.Task::(_updateState) Task=`679ae068-7a54-4b0f-933c-df6873a15283`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 09:08:35,947::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-14::INFO::2014-07-10 09:08:35,948::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:08:35,948::task::1185::TaskManager.Task::(prepare) Task=`679ae068-7a54-4b0f-933c-df6873a15283`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:08:35,948::task::595::TaskManager.Task::(_updateState) Task=`679ae068-7a54-4b0f-933c-df6873a15283`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 09:08:35,948::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 09:08:35,949::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 09:08:35,949::task::990::TaskManager.Task::(_decref) Task=`679ae068-7a54-4b0f-933c-df6873a15283`::ref 0 aborting False >Thread-34::DEBUG::2014-07-10 09:08:35,953::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-34::DEBUG::2014-07-10 09:08:35,953::task::595::TaskManager.Task::(_updateState) Task=`c4d31490-2909-48c3-9f5f-fc99059b11f0`::moving from state init -> state preparing >Thread-34::INFO::2014-07-10 09:08:35,954::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-34::DEBUG::2014-07-10 09:08:35,954::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`3535c974-056e-48a4-8f01-45bed85789c8`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-10 09:08:35,955::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' for lock type 'shared' >Thread-34::DEBUG::2014-07-10 09:08:35,955::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-10 09:08:35,955::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`3535c974-056e-48a4-8f01-45bed85789c8`::Granted request >Thread-34::DEBUG::2014-07-10 09:08:35,956::task::827::TaskManager.Task::(resourceAcquired) Task=`c4d31490-2909-48c3-9f5f-fc99059b11f0`::_resourcesAcquired: Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee (shared) >Thread-34::DEBUG::2014-07-10 09:08:35,956::task::990::TaskManager.Task::(_decref) Task=`c4d31490-2909-48c3-9f5f-fc99059b11f0`::ref 1 aborting False >Thread-34::INFO::2014-07-10 09:08:35,957::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532067385344', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:08:35,957::task::1185::TaskManager.Task::(prepare) Task=`c4d31490-2909-48c3-9f5f-fc99059b11f0`::finished: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532067385344', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:08:35,958::task::595::TaskManager.Task::(_updateState) Task=`c4d31490-2909-48c3-9f5f-fc99059b11f0`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-10 09:08:35,958::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee': < ResourceRef 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-10 09:08:35,958::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-10 09:08:35,958::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' >Thread-34::DEBUG::2014-07-10 09:08:35,958::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' (0 active users) >Thread-34::DEBUG::2014-07-10 09:08:35,959::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-10 09:08:35,959::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', Clearing records. >Thread-34::DEBUG::2014-07-10 09:08:35,959::task::990::TaskManager.Task::(_decref) Task=`c4d31490-2909-48c3-9f5f-fc99059b11f0`::ref 0 aborting False >Thread-40::DEBUG::2014-07-10 09:08:36,293::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lion.qa.lab.tlv.redhat.com:_export_yuri2_backup2/6a70504d-00df-4869-8695-0f442053f6b6/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-40::DEBUG::2014-07-10 09:08:36,312::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n369 bytes (369 B) copied, 0.00050593 s, 729 kB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:08:37,725::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:08:37,813::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0335947 s, 30.5 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 09:08:38,056::task::595::TaskManager.Task::(_updateState) Task=`e8e11475-4c72-40c2-a5e2-0b5e5d0a864f`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 09:08:38,057::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::INFO::2014-07-10 09:08:38,057::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000644147', 'lastCheck': '6.3', 'valid': True}, '6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00050593', 'lastCheck': '1.7', 'valid': True}} >Thread-14::DEBUG::2014-07-10 09:08:38,058::task::1185::TaskManager.Task::(prepare) Task=`e8e11475-4c72-40c2-a5e2-0b5e5d0a864f`::finished: {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000644147', 'lastCheck': '6.3', 'valid': True}, '6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00050593', 'lastCheck': '1.7', 'valid': True}} >Thread-14::DEBUG::2014-07-10 09:08:38,058::task::595::TaskManager.Task::(_updateState) Task=`e8e11475-4c72-40c2-a5e2-0b5e5d0a864f`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 09:08:38,058::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 09:08:38,058::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 09:08:38,058::task::990::TaskManager.Task::(_decref) Task=`e8e11475-4c72-40c2-a5e2-0b5e5d0a864f`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 09:08:39,828::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:08:39,921::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0314494 s, 32.6 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-10 09:08:41,798::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/metadata bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-10 09:08:41,821::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000770713 s, 5.3 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:08:41,934::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:08:42,025::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0346071 s, 29.6 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:08:44,040::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:08:44,191::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0932683 s, 11.0 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 09:08:45,989::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-14::DEBUG::2014-07-10 09:08:45,990::task::595::TaskManager.Task::(_updateState) Task=`7de0cc73-eaa1-450c-971c-7d98162cbabf`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 09:08:45,990::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-14::INFO::2014-07-10 09:08:45,991::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:08:45,991::task::1185::TaskManager.Task::(prepare) Task=`7de0cc73-eaa1-450c-971c-7d98162cbabf`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:08:45,991::task::595::TaskManager.Task::(_updateState) Task=`7de0cc73-eaa1-450c-971c-7d98162cbabf`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 09:08:45,991::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 09:08:45,992::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 09:08:45,992::task::990::TaskManager.Task::(_decref) Task=`7de0cc73-eaa1-450c-971c-7d98162cbabf`::ref 0 aborting False >Thread-34::DEBUG::2014-07-10 09:08:45,996::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-34::DEBUG::2014-07-10 09:08:45,996::task::595::TaskManager.Task::(_updateState) Task=`ac6b8087-4ca5-4161-a2e8-b11f1ad1a892`::moving from state init -> state preparing >Thread-34::INFO::2014-07-10 09:08:45,996::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-34::DEBUG::2014-07-10 09:08:45,997::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`cfd219f0-d921-44bc-8d6b-7eeebdebd28e`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-10 09:08:45,997::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' for lock type 'shared' >Thread-34::DEBUG::2014-07-10 09:08:45,997::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-10 09:08:45,998::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`cfd219f0-d921-44bc-8d6b-7eeebdebd28e`::Granted request >Thread-34::DEBUG::2014-07-10 09:08:45,998::task::827::TaskManager.Task::(resourceAcquired) Task=`ac6b8087-4ca5-4161-a2e8-b11f1ad1a892`::_resourcesAcquired: Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee (shared) >Thread-34::DEBUG::2014-07-10 09:08:45,998::task::990::TaskManager.Task::(_decref) Task=`ac6b8087-4ca5-4161-a2e8-b11f1ad1a892`::ref 1 aborting False >Thread-34::INFO::2014-07-10 09:08:45,999::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532067385344', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:08:45,999::task::1185::TaskManager.Task::(prepare) Task=`ac6b8087-4ca5-4161-a2e8-b11f1ad1a892`::finished: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532067385344', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:08:46,000::task::595::TaskManager.Task::(_updateState) Task=`ac6b8087-4ca5-4161-a2e8-b11f1ad1a892`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-10 09:08:46,000::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee': < ResourceRef 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-10 09:08:46,000::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-10 09:08:46,000::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' >Thread-34::DEBUG::2014-07-10 09:08:46,000::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' (0 active users) >Thread-34::DEBUG::2014-07-10 09:08:46,001::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-10 09:08:46,001::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', Clearing records. >Thread-34::DEBUG::2014-07-10 09:08:46,001::task::990::TaskManager.Task::(_decref) Task=`ac6b8087-4ca5-4161-a2e8-b11f1ad1a892`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 09:08:46,205::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:08:46,292::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0300977 s, 34.0 MB/s\n'; <rc> = 0 >Thread-40::DEBUG::2014-07-10 09:08:46,343::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lion.qa.lab.tlv.redhat.com:_export_yuri2_backup2/6a70504d-00df-4869-8695-0f442053f6b6/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-40::DEBUG::2014-07-10 09:08:46,364::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n369 bytes (369 B) copied, 0.000459599 s, 803 kB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:08:48,307::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:08:48,401::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0298212 s, 34.3 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:08:50,417::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:08:50,509::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0352203 s, 29.1 MB/s\n'; <rc> = 0 >Thread-64::DEBUG::2014-07-10 09:08:50,806::task::595::TaskManager.Task::(_updateState) Task=`831cc0b9-d79d-44ba-891b-35881c1a6e42`::moving from state init -> state preparing >Thread-64::INFO::2014-07-10 09:08:50,807::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='aa20346a-4d3a-4e07-b8e1-52c0ebe4168c', volUUID='58fefce2-9bce-4bff-8949-8c6ce8122b27', options=None) >Thread-64::INFO::2014-07-10 09:08:50,807::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-64::DEBUG::2014-07-10 09:08:50,808::task::1185::TaskManager.Task::(prepare) Task=`831cc0b9-d79d-44ba-891b-35881c1a6e42`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-64::DEBUG::2014-07-10 09:08:50,808::task::595::TaskManager.Task::(_updateState) Task=`831cc0b9-d79d-44ba-891b-35881c1a6e42`::moving from state preparing -> state finished >Thread-64::DEBUG::2014-07-10 09:08:50,808::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-64::DEBUG::2014-07-10 09:08:50,808::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-64::DEBUG::2014-07-10 09:08:50,808::task::990::TaskManager.Task::(_decref) Task=`831cc0b9-d79d-44ba-891b-35881c1a6e42`::ref 0 aborting False >Thread-73::DEBUG::2014-07-10 09:08:51,768::task::595::TaskManager.Task::(_updateState) Task=`71f92f56-c8a5-433e-bf1e-dbc1c9cb7eba`::moving from state init -> state preparing >Thread-73::INFO::2014-07-10 09:08:51,769::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='c01d693b-cba0-4fed-9ad7-0aaa28912a19', volUUID='4bb5d954-2a50-4028-b299-0b43c261270c', options=None) >Thread-54::DEBUG::2014-07-10 09:08:51,769::task::595::TaskManager.Task::(_updateState) Task=`3d0bc1fd-6d42-4bc9-aa97-f25f932c705b`::moving from state init -> state preparing >Thread-54::INFO::2014-07-10 09:08:51,769::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='28408446-e5fd-4565-a976-e760951593fe', volUUID='776303a2-5585-451e-826e-0e338d4a1e98', options=None) >Thread-73::INFO::2014-07-10 09:08:51,770::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-73::DEBUG::2014-07-10 09:08:51,770::task::1185::TaskManager.Task::(prepare) Task=`71f92f56-c8a5-433e-bf1e-dbc1c9cb7eba`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-54::INFO::2014-07-10 09:08:51,770::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-73::DEBUG::2014-07-10 09:08:51,770::task::595::TaskManager.Task::(_updateState) Task=`71f92f56-c8a5-433e-bf1e-dbc1c9cb7eba`::moving from state preparing -> state finished >Thread-54::DEBUG::2014-07-10 09:08:51,771::task::1185::TaskManager.Task::(prepare) Task=`3d0bc1fd-6d42-4bc9-aa97-f25f932c705b`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-73::DEBUG::2014-07-10 09:08:51,771::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-54::DEBUG::2014-07-10 09:08:51,771::task::595::TaskManager.Task::(_updateState) Task=`3d0bc1fd-6d42-4bc9-aa97-f25f932c705b`::moving from state preparing -> state finished >Thread-73::DEBUG::2014-07-10 09:08:51,771::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-54::DEBUG::2014-07-10 09:08:51,771::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-73::DEBUG::2014-07-10 09:08:51,772::task::990::TaskManager.Task::(_decref) Task=`71f92f56-c8a5-433e-bf1e-dbc1c9cb7eba`::ref 0 aborting False >Thread-54::DEBUG::2014-07-10 09:08:51,772::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-54::DEBUG::2014-07-10 09:08:51,772::task::990::TaskManager.Task::(_decref) Task=`3d0bc1fd-6d42-4bc9-aa97-f25f932c705b`::ref 0 aborting False >Thread-18::DEBUG::2014-07-10 09:08:51,850::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/metadata bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-10 09:08:51,871::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000893319 s, 4.6 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:08:52,525::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:08:52,616::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0345059 s, 29.7 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 09:08:53,252::task::595::TaskManager.Task::(_updateState) Task=`870703d4-dfbb-4aad-b35f-f20a7de727da`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 09:08:53,252::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::INFO::2014-07-10 09:08:53,253::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000893319', 'lastCheck': '1.4', 'valid': True}, '6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000459599', 'lastCheck': '6.9', 'valid': True}} >Thread-14::DEBUG::2014-07-10 09:08:53,253::task::1185::TaskManager.Task::(prepare) Task=`870703d4-dfbb-4aad-b35f-f20a7de727da`::finished: {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000893319', 'lastCheck': '1.4', 'valid': True}, '6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000459599', 'lastCheck': '6.9', 'valid': True}} >Thread-14::DEBUG::2014-07-10 09:08:53,253::task::595::TaskManager.Task::(_updateState) Task=`870703d4-dfbb-4aad-b35f-f20a7de727da`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 09:08:53,254::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 09:08:53,254::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 09:08:53,254::task::990::TaskManager.Task::(_decref) Task=`870703d4-dfbb-4aad-b35f-f20a7de727da`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 09:08:54,632::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:08:54,740::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0476093 s, 21.5 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 09:08:56,032::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-14::DEBUG::2014-07-10 09:08:56,033::task::595::TaskManager.Task::(_updateState) Task=`8b5f1977-0e04-40c0-9671-b51920a8b6c2`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 09:08:56,033::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-14::INFO::2014-07-10 09:08:56,034::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:08:56,034::task::1185::TaskManager.Task::(prepare) Task=`8b5f1977-0e04-40c0-9671-b51920a8b6c2`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:08:56,034::task::595::TaskManager.Task::(_updateState) Task=`8b5f1977-0e04-40c0-9671-b51920a8b6c2`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 09:08:56,034::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 09:08:56,034::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 09:08:56,035::task::990::TaskManager.Task::(_decref) Task=`8b5f1977-0e04-40c0-9671-b51920a8b6c2`::ref 0 aborting False >Thread-34::DEBUG::2014-07-10 09:08:56,078::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-34::DEBUG::2014-07-10 09:08:56,079::task::595::TaskManager.Task::(_updateState) Task=`17ad94c5-7a9b-4c03-b4c5-e1879c75e634`::moving from state init -> state preparing >Thread-34::INFO::2014-07-10 09:08:56,079::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-34::DEBUG::2014-07-10 09:08:56,080::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`1d3f7a24-ea60-460d-8658-721f83a96ebf`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-10 09:08:56,080::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' for lock type 'shared' >Thread-34::DEBUG::2014-07-10 09:08:56,080::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-10 09:08:56,081::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`1d3f7a24-ea60-460d-8658-721f83a96ebf`::Granted request >Thread-34::DEBUG::2014-07-10 09:08:56,081::task::827::TaskManager.Task::(resourceAcquired) Task=`17ad94c5-7a9b-4c03-b4c5-e1879c75e634`::_resourcesAcquired: Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee (shared) >Thread-34::DEBUG::2014-07-10 09:08:56,081::task::990::TaskManager.Task::(_decref) Task=`17ad94c5-7a9b-4c03-b4c5-e1879c75e634`::ref 1 aborting False >Thread-34::INFO::2014-07-10 09:08:56,083::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532067385344', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:08:56,083::task::1185::TaskManager.Task::(prepare) Task=`17ad94c5-7a9b-4c03-b4c5-e1879c75e634`::finished: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532067385344', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:08:56,083::task::595::TaskManager.Task::(_updateState) Task=`17ad94c5-7a9b-4c03-b4c5-e1879c75e634`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-10 09:08:56,083::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee': < ResourceRef 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-10 09:08:56,083::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-10 09:08:56,084::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' >Thread-34::DEBUG::2014-07-10 09:08:56,084::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' (0 active users) >Thread-34::DEBUG::2014-07-10 09:08:56,084::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-10 09:08:56,084::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', Clearing records. >Thread-34::DEBUG::2014-07-10 09:08:56,084::task::990::TaskManager.Task::(_decref) Task=`17ad94c5-7a9b-4c03-b4c5-e1879c75e634`::ref 0 aborting False >Thread-40::DEBUG::2014-07-10 09:08:56,396::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lion.qa.lab.tlv.redhat.com:_export_yuri2_backup2/6a70504d-00df-4869-8695-0f442053f6b6/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-40::DEBUG::2014-07-10 09:08:56,454::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n369 bytes (369 B) copied, 0.000544821 s, 677 kB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:08:57,095::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:08:57,184::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0317112 s, 32.3 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:08:59,200::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:08:59,303::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0353533 s, 29.0 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:09:01,318::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:09:01,415::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0272968 s, 37.5 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-10 09:09:01,901::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/metadata bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-10 09:09:01,927::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000684685 s, 6.0 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:09:03,437::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:09:03,527::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0303191 s, 33.8 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:09:05,542::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:09:05,635::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0343282 s, 29.8 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 09:09:06,109::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-14::DEBUG::2014-07-10 09:09:06,110::task::595::TaskManager.Task::(_updateState) Task=`e8b30fa7-ea36-4c59-967c-f491779844d0`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 09:09:06,111::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-14::INFO::2014-07-10 09:09:06,111::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:09:06,112::task::1185::TaskManager.Task::(prepare) Task=`e8b30fa7-ea36-4c59-967c-f491779844d0`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:09:06,112::task::595::TaskManager.Task::(_updateState) Task=`e8b30fa7-ea36-4c59-967c-f491779844d0`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 09:09:06,112::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 09:09:06,112::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 09:09:06,112::task::990::TaskManager.Task::(_decref) Task=`e8b30fa7-ea36-4c59-967c-f491779844d0`::ref 0 aborting False >Thread-34::DEBUG::2014-07-10 09:09:06,117::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-34::DEBUG::2014-07-10 09:09:06,117::task::595::TaskManager.Task::(_updateState) Task=`0568fa84-7b2a-4750-9d1b-09ed8e7240f6`::moving from state init -> state preparing >Thread-34::INFO::2014-07-10 09:09:06,117::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-34::DEBUG::2014-07-10 09:09:06,118::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`ac59178b-3f62-475e-a09d-d5e5a3f14ba0`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-10 09:09:06,118::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' for lock type 'shared' >Thread-34::DEBUG::2014-07-10 09:09:06,119::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-10 09:09:06,119::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`ac59178b-3f62-475e-a09d-d5e5a3f14ba0`::Granted request >Thread-34::DEBUG::2014-07-10 09:09:06,119::task::827::TaskManager.Task::(resourceAcquired) Task=`0568fa84-7b2a-4750-9d1b-09ed8e7240f6`::_resourcesAcquired: Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee (shared) >Thread-34::DEBUG::2014-07-10 09:09:06,120::task::990::TaskManager.Task::(_decref) Task=`0568fa84-7b2a-4750-9d1b-09ed8e7240f6`::ref 1 aborting False >Thread-34::INFO::2014-07-10 09:09:06,121::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532067385344', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:09:06,121::task::1185::TaskManager.Task::(prepare) Task=`0568fa84-7b2a-4750-9d1b-09ed8e7240f6`::finished: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532067385344', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:09:06,121::task::595::TaskManager.Task::(_updateState) Task=`0568fa84-7b2a-4750-9d1b-09ed8e7240f6`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-10 09:09:06,121::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee': < ResourceRef 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-10 09:09:06,122::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-10 09:09:06,122::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' >Thread-34::DEBUG::2014-07-10 09:09:06,122::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' (0 active users) >Thread-34::DEBUG::2014-07-10 09:09:06,122::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-10 09:09:06,122::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', Clearing records. >Thread-34::DEBUG::2014-07-10 09:09:06,123::task::990::TaskManager.Task::(_decref) Task=`0568fa84-7b2a-4750-9d1b-09ed8e7240f6`::ref 0 aborting False >Thread-40::DEBUG::2014-07-10 09:09:06,481::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lion.qa.lab.tlv.redhat.com:_export_yuri2_backup2/6a70504d-00df-4869-8695-0f442053f6b6/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-40::DEBUG::2014-07-10 09:09:06,502::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n369 bytes (369 B) copied, 0.000428344 s, 861 kB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:09:07,650::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:09:07,742::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0332636 s, 30.8 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 09:09:08,549::task::595::TaskManager.Task::(_updateState) Task=`106f2f54-3c79-4f6a-9db4-a31430b0c6ff`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 09:09:08,550::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::INFO::2014-07-10 09:09:08,550::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000684685', 'lastCheck': '6.6', 'valid': True}, '6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000428344', 'lastCheck': '2.0', 'valid': True}} >Thread-14::DEBUG::2014-07-10 09:09:08,550::task::1185::TaskManager.Task::(prepare) Task=`106f2f54-3c79-4f6a-9db4-a31430b0c6ff`::finished: {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000684685', 'lastCheck': '6.6', 'valid': True}, '6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000428344', 'lastCheck': '2.0', 'valid': True}} >Thread-14::DEBUG::2014-07-10 09:09:08,551::task::595::TaskManager.Task::(_updateState) Task=`106f2f54-3c79-4f6a-9db4-a31430b0c6ff`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 09:09:08,551::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 09:09:08,551::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 09:09:08,551::task::990::TaskManager.Task::(_decref) Task=`106f2f54-3c79-4f6a-9db4-a31430b0c6ff`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 09:09:09,759::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:09:09,853::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0364275 s, 28.1 MB/s\n'; <rc> = 0 >Thread-57::DEBUG::2014-07-10 09:09:10,975::task::595::TaskManager.Task::(_updateState) Task=`c5965d49-83ac-4381-9215-58cc8a45b924`::moving from state init -> state preparing >Thread-57::INFO::2014-07-10 09:09:10,976::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='b6f6c0da-e67f-4902-b9ac-3069571a42fe', volUUID='c4cd1da8-05b7-45e0-80b1-1183d21443d9', options=None) >Thread-57::INFO::2014-07-10 09:09:10,976::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-57::DEBUG::2014-07-10 09:09:10,977::task::1185::TaskManager.Task::(prepare) Task=`c5965d49-83ac-4381-9215-58cc8a45b924`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-57::DEBUG::2014-07-10 09:09:10,977::task::595::TaskManager.Task::(_updateState) Task=`c5965d49-83ac-4381-9215-58cc8a45b924`::moving from state preparing -> state finished >Thread-57::DEBUG::2014-07-10 09:09:10,977::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-57::DEBUG::2014-07-10 09:09:10,977::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-57::DEBUG::2014-07-10 09:09:10,977::task::990::TaskManager.Task::(_decref) Task=`c5965d49-83ac-4381-9215-58cc8a45b924`::ref 0 aborting False >Thread-67::DEBUG::2014-07-10 09:09:11,790::task::595::TaskManager.Task::(_updateState) Task=`bbfb44c3-7b3e-4b02-b55c-2cc11ba33913`::moving from state init -> state preparing >Thread-67::INFO::2014-07-10 09:09:11,790::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='f30c2cb7-a43a-4bf5-82b5-cfe07336f65c', volUUID='b0fbb3c9-55af-4a3a-95ad-fc56a80b9cf5', options=None) >Thread-67::INFO::2014-07-10 09:09:11,792::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-67::DEBUG::2014-07-10 09:09:11,792::task::1185::TaskManager.Task::(prepare) Task=`bbfb44c3-7b3e-4b02-b55c-2cc11ba33913`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-67::DEBUG::2014-07-10 09:09:11,792::task::595::TaskManager.Task::(_updateState) Task=`bbfb44c3-7b3e-4b02-b55c-2cc11ba33913`::moving from state preparing -> state finished >Thread-67::DEBUG::2014-07-10 09:09:11,792::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-67::DEBUG::2014-07-10 09:09:11,792::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-67::DEBUG::2014-07-10 09:09:11,793::task::990::TaskManager.Task::(_decref) Task=`bbfb44c3-7b3e-4b02-b55c-2cc11ba33913`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 09:09:11,868::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Thread-18::DEBUG::2014-07-10 09:09:11,991::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/metadata bs=4096 count=1' (cwd None) >Thread-48::DEBUG::2014-07-10 09:09:11,991::task::595::TaskManager.Task::(_updateState) Task=`27876aa5-b1ac-4a13-9faa-1020273ffa53`::moving from state init -> state preparing >Thread-48::INFO::2014-07-10 09:09:12,037::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='0cd7d6ce-f497-4243-a690-c57744861eea', volUUID='10b6a7dd-dc6c-43fa-ba17-92e4331b0e0b', options=None) >Thread-48::INFO::2014-07-10 09:09:12,056::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-48::DEBUG::2014-07-10 09:09:12,063::task::1185::TaskManager.Task::(prepare) Task=`27876aa5-b1ac-4a13-9faa-1020273ffa53`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-48::DEBUG::2014-07-10 09:09:12,069::task::595::TaskManager.Task::(_updateState) Task=`27876aa5-b1ac-4a13-9faa-1020273ffa53`::moving from state preparing -> state finished >Thread-48::DEBUG::2014-07-10 09:09:12,075::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-48::DEBUG::2014-07-10 09:09:12,082::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-48::DEBUG::2014-07-10 09:09:12,090::task::990::TaskManager.Task::(_decref) Task=`27876aa5-b1ac-4a13-9faa-1020273ffa53`::ref 0 aborting False >Thread-18::DEBUG::2014-07-10 09:09:12,145::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000704322 s, 5.8 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:09:12,495::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.26775 s, 3.8 MB/s\n'; <rc> = 0 >Thread-76::DEBUG::2014-07-10 09:09:13,437::task::595::TaskManager.Task::(_updateState) Task=`d41c61b6-f7f0-4578-8d8d-439d9bc09df3`::moving from state init -> state preparing >Thread-76::INFO::2014-07-10 09:09:13,438::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='e4c65229-4247-4b33-b72a-f1d5ce72ad05', volUUID='cad94284-3ca9-4c30-933d-997f4460309e', options=None) >Thread-76::INFO::2014-07-10 09:09:13,439::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-76::DEBUG::2014-07-10 09:09:13,439::task::1185::TaskManager.Task::(prepare) Task=`d41c61b6-f7f0-4578-8d8d-439d9bc09df3`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-76::DEBUG::2014-07-10 09:09:13,439::task::595::TaskManager.Task::(_updateState) Task=`d41c61b6-f7f0-4578-8d8d-439d9bc09df3`::moving from state preparing -> state finished >Thread-76::DEBUG::2014-07-10 09:09:13,439::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-76::DEBUG::2014-07-10 09:09:13,439::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-76::DEBUG::2014-07-10 09:09:13,440::task::990::TaskManager.Task::(_decref) Task=`d41c61b6-f7f0-4578-8d8d-439d9bc09df3`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 09:09:14,511::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:09:14,604::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0355126 s, 28.8 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 09:09:16,152::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-14::DEBUG::2014-07-10 09:09:16,153::task::595::TaskManager.Task::(_updateState) Task=`8bece37a-419b-4000-b5d7-81087450322a`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 09:09:16,154::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-14::INFO::2014-07-10 09:09:16,154::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:09:16,154::task::1185::TaskManager.Task::(prepare) Task=`8bece37a-419b-4000-b5d7-81087450322a`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:09:16,154::task::595::TaskManager.Task::(_updateState) Task=`8bece37a-419b-4000-b5d7-81087450322a`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 09:09:16,155::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 09:09:16,155::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 09:09:16,155::task::990::TaskManager.Task::(_decref) Task=`8bece37a-419b-4000-b5d7-81087450322a`::ref 0 aborting False >Thread-34::DEBUG::2014-07-10 09:09:16,159::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-34::DEBUG::2014-07-10 09:09:16,159::task::595::TaskManager.Task::(_updateState) Task=`2ebb5d6f-32bc-4162-9f3b-fa3bef378160`::moving from state init -> state preparing >Thread-34::INFO::2014-07-10 09:09:16,160::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-34::DEBUG::2014-07-10 09:09:16,160::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`7c9fdf19-2be5-46e7-9db0-afc8a168321e`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-10 09:09:16,161::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' for lock type 'shared' >Thread-34::DEBUG::2014-07-10 09:09:16,161::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-10 09:09:16,161::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`7c9fdf19-2be5-46e7-9db0-afc8a168321e`::Granted request >Thread-34::DEBUG::2014-07-10 09:09:16,161::task::827::TaskManager.Task::(resourceAcquired) Task=`2ebb5d6f-32bc-4162-9f3b-fa3bef378160`::_resourcesAcquired: Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee (shared) >Thread-34::DEBUG::2014-07-10 09:09:16,162::task::990::TaskManager.Task::(_decref) Task=`2ebb5d6f-32bc-4162-9f3b-fa3bef378160`::ref 1 aborting False >Thread-34::INFO::2014-07-10 09:09:16,163::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532067385344', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:09:16,163::task::1185::TaskManager.Task::(prepare) Task=`2ebb5d6f-32bc-4162-9f3b-fa3bef378160`::finished: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532067385344', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:09:16,163::task::595::TaskManager.Task::(_updateState) Task=`2ebb5d6f-32bc-4162-9f3b-fa3bef378160`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-10 09:09:16,163::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee': < ResourceRef 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-10 09:09:16,163::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-10 09:09:16,164::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' >Thread-34::DEBUG::2014-07-10 09:09:16,164::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' (0 active users) >Thread-34::DEBUG::2014-07-10 09:09:16,164::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-10 09:09:16,164::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', Clearing records. >Thread-34::DEBUG::2014-07-10 09:09:16,164::task::990::TaskManager.Task::(_decref) Task=`2ebb5d6f-32bc-4162-9f3b-fa3bef378160`::ref 0 aborting False >Thread-40::DEBUG::2014-07-10 09:09:16,530::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lion.qa.lab.tlv.redhat.com:_export_yuri2_backup2/6a70504d-00df-4869-8695-0f442053f6b6/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-40::DEBUG::2014-07-10 09:09:16,554::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n369 bytes (369 B) copied, 0.00530785 s, 69.5 kB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:09:16,620::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:09:16,711::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0345397 s, 29.6 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:09:18,725::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:09:18,816::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0314859 s, 32.5 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:09:20,831::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:09:20,923::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0350622 s, 29.2 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-10 09:09:22,468::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/metadata bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-10 09:09:22,490::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000729869 s, 5.6 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:09:22,938::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:09:23,034::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0351654 s, 29.1 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 09:09:23,749::task::595::TaskManager.Task::(_updateState) Task=`7846bbf4-0d1c-44ab-86a1-688b934dd464`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 09:09:23,750::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::INFO::2014-07-10 09:09:23,750::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000729869', 'lastCheck': '1.2', 'valid': True}, '6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00530785', 'lastCheck': '7.2', 'valid': True}} >Thread-14::DEBUG::2014-07-10 09:09:23,751::task::1185::TaskManager.Task::(prepare) Task=`7846bbf4-0d1c-44ab-86a1-688b934dd464`::finished: {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000729869', 'lastCheck': '1.2', 'valid': True}, '6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00530785', 'lastCheck': '7.2', 'valid': True}} >Thread-14::DEBUG::2014-07-10 09:09:23,751::task::595::TaskManager.Task::(_updateState) Task=`7846bbf4-0d1c-44ab-86a1-688b934dd464`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 09:09:23,751::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 09:09:23,751::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 09:09:23,751::task::990::TaskManager.Task::(_decref) Task=`7846bbf4-0d1c-44ab-86a1-688b934dd464`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 09:09:25,049::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:09:25,143::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.031504 s, 32.5 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 09:09:26,196::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-14::DEBUG::2014-07-10 09:09:26,198::task::595::TaskManager.Task::(_updateState) Task=`c5ad4983-61a8-4932-bdfc-684233990bb8`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 09:09:26,199::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-14::INFO::2014-07-10 09:09:26,200::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:09:26,200::task::1185::TaskManager.Task::(prepare) Task=`c5ad4983-61a8-4932-bdfc-684233990bb8`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:09:26,201::task::595::TaskManager.Task::(_updateState) Task=`c5ad4983-61a8-4932-bdfc-684233990bb8`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 09:09:26,201::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 09:09:26,201::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 09:09:26,202::task::990::TaskManager.Task::(_decref) Task=`c5ad4983-61a8-4932-bdfc-684233990bb8`::ref 0 aborting False >Thread-34::DEBUG::2014-07-10 09:09:26,250::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-34::DEBUG::2014-07-10 09:09:26,251::task::595::TaskManager.Task::(_updateState) Task=`49a1d7f1-e8c7-41ef-a331-0f84f821fe2e`::moving from state init -> state preparing >Thread-34::INFO::2014-07-10 09:09:26,251::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-34::DEBUG::2014-07-10 09:09:26,252::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`ca8092ad-5292-4071-931d-13c05aa99635`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-10 09:09:26,252::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' for lock type 'shared' >Thread-34::DEBUG::2014-07-10 09:09:26,252::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-10 09:09:26,253::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`ca8092ad-5292-4071-931d-13c05aa99635`::Granted request >Thread-34::DEBUG::2014-07-10 09:09:26,253::task::827::TaskManager.Task::(resourceAcquired) Task=`49a1d7f1-e8c7-41ef-a331-0f84f821fe2e`::_resourcesAcquired: Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee (shared) >Thread-34::DEBUG::2014-07-10 09:09:26,253::task::990::TaskManager.Task::(_decref) Task=`49a1d7f1-e8c7-41ef-a331-0f84f821fe2e`::ref 1 aborting False >Thread-34::INFO::2014-07-10 09:09:26,254::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532067385344', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:09:26,255::task::1185::TaskManager.Task::(prepare) Task=`49a1d7f1-e8c7-41ef-a331-0f84f821fe2e`::finished: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532067385344', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:09:26,255::task::595::TaskManager.Task::(_updateState) Task=`49a1d7f1-e8c7-41ef-a331-0f84f821fe2e`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-10 09:09:26,255::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee': < ResourceRef 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-10 09:09:26,255::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-10 09:09:26,256::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' >Thread-34::DEBUG::2014-07-10 09:09:26,256::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' (0 active users) >Thread-34::DEBUG::2014-07-10 09:09:26,256::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-10 09:09:26,256::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', Clearing records. >Thread-34::DEBUG::2014-07-10 09:09:26,256::task::990::TaskManager.Task::(_decref) Task=`49a1d7f1-e8c7-41ef-a331-0f84f821fe2e`::ref 0 aborting False >Thread-40::DEBUG::2014-07-10 09:09:26,593::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lion.qa.lab.tlv.redhat.com:_export_yuri2_backup2/6a70504d-00df-4869-8695-0f442053f6b6/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-40::DEBUG::2014-07-10 09:09:26,614::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n369 bytes (369 B) copied, 0.000435705 s, 847 kB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:09:27,158::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:09:27,245::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0268525 s, 38.1 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:09:29,261::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:09:29,354::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0355119 s, 28.8 MB/s\n'; <rc> = 0 >Thread-70::DEBUG::2014-07-10 09:09:31,012::task::595::TaskManager.Task::(_updateState) Task=`fb24634f-12dd-4954-be28-f086c201cf9f`::moving from state init -> state preparing >Thread-70::INFO::2014-07-10 09:09:31,013::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='cfaeead2-7caa-467c-b389-c89840ae6605', volUUID='567fe32d-31a6-4ff6-90f3-fd6a656fbecc', options=None) >Thread-70::INFO::2014-07-10 09:09:31,014::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-70::DEBUG::2014-07-10 09:09:31,014::task::1185::TaskManager.Task::(prepare) Task=`fb24634f-12dd-4954-be28-f086c201cf9f`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-70::DEBUG::2014-07-10 09:09:31,014::task::595::TaskManager.Task::(_updateState) Task=`fb24634f-12dd-4954-be28-f086c201cf9f`::moving from state preparing -> state finished >Thread-70::DEBUG::2014-07-10 09:09:31,014::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-70::DEBUG::2014-07-10 09:09:31,014::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-70::DEBUG::2014-07-10 09:09:31,015::task::990::TaskManager.Task::(_decref) Task=`fb24634f-12dd-4954-be28-f086c201cf9f`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 09:09:31,369::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:09:31,461::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0324338 s, 31.6 MB/s\n'; <rc> = 0 >Thread-60::DEBUG::2014-07-10 09:09:31,860::task::595::TaskManager.Task::(_updateState) Task=`52e39ed5-45ec-4091-bfeb-86e9db3b332e`::moving from state init -> state preparing >Thread-60::INFO::2014-07-10 09:09:31,861::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='b034d5b0-e1e0-4011-b49b-4d45ddb11556', volUUID='3d7f62b5-328f-4d8e-8b69-873cfb5ae14d', options=None) >Thread-60::INFO::2014-07-10 09:09:31,862::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-60::DEBUG::2014-07-10 09:09:31,862::task::1185::TaskManager.Task::(prepare) Task=`52e39ed5-45ec-4091-bfeb-86e9db3b332e`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-60::DEBUG::2014-07-10 09:09:31,863::task::595::TaskManager.Task::(_updateState) Task=`52e39ed5-45ec-4091-bfeb-86e9db3b332e`::moving from state preparing -> state finished >Thread-60::DEBUG::2014-07-10 09:09:31,863::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-60::DEBUG::2014-07-10 09:09:31,863::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-60::DEBUG::2014-07-10 09:09:31,864::task::990::TaskManager.Task::(_decref) Task=`52e39ed5-45ec-4091-bfeb-86e9db3b332e`::ref 0 aborting False >Thread-51::DEBUG::2014-07-10 09:09:32,089::task::595::TaskManager.Task::(_updateState) Task=`a67bb5cf-2e39-4425-8be8-2d2b5e0b8f43`::moving from state init -> state preparing >Thread-51::INFO::2014-07-10 09:09:32,089::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='76fdb054-02cd-42ed-9721-b3e65b34c3a4', volUUID='022dfe46-2cf7-4915-80b3-883158e3ca83', options=None) >Thread-51::INFO::2014-07-10 09:09:32,090::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-51::DEBUG::2014-07-10 09:09:32,090::task::1185::TaskManager.Task::(prepare) Task=`a67bb5cf-2e39-4425-8be8-2d2b5e0b8f43`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-51::DEBUG::2014-07-10 09:09:32,090::task::595::TaskManager.Task::(_updateState) Task=`a67bb5cf-2e39-4425-8be8-2d2b5e0b8f43`::moving from state preparing -> state finished >Thread-51::DEBUG::2014-07-10 09:09:32,091::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-51::DEBUG::2014-07-10 09:09:32,091::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-51::DEBUG::2014-07-10 09:09:32,091::task::990::TaskManager.Task::(_decref) Task=`a67bb5cf-2e39-4425-8be8-2d2b5e0b8f43`::ref 0 aborting False >Thread-18::DEBUG::2014-07-10 09:09:32,520::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/metadata bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-10 09:09:32,542::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000860149 s, 4.8 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:09:33,475::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:09:33,562::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0297789 s, 34.4 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:09:35,579::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:09:35,680::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0331908 s, 30.9 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 09:09:36,287::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-14::DEBUG::2014-07-10 09:09:36,289::task::595::TaskManager.Task::(_updateState) Task=`d628797b-4203-4bed-9a63-66f544a1d532`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 09:09:36,289::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-14::INFO::2014-07-10 09:09:36,289::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:09:36,290::task::1185::TaskManager.Task::(prepare) Task=`d628797b-4203-4bed-9a63-66f544a1d532`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:09:36,290::task::595::TaskManager.Task::(_updateState) Task=`d628797b-4203-4bed-9a63-66f544a1d532`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 09:09:36,290::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 09:09:36,290::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 09:09:36,290::task::990::TaskManager.Task::(_decref) Task=`d628797b-4203-4bed-9a63-66f544a1d532`::ref 0 aborting False >Thread-34::DEBUG::2014-07-10 09:09:36,294::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-34::DEBUG::2014-07-10 09:09:36,295::task::595::TaskManager.Task::(_updateState) Task=`0e23a40f-f6bd-43f6-b62e-35cbe5d8e3c1`::moving from state init -> state preparing >Thread-34::INFO::2014-07-10 09:09:36,295::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-34::DEBUG::2014-07-10 09:09:36,296::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`0a208083-cbfb-4aef-b6b1-78ead553db97`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-10 09:09:36,296::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' for lock type 'shared' >Thread-34::DEBUG::2014-07-10 09:09:36,296::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-10 09:09:36,296::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`0a208083-cbfb-4aef-b6b1-78ead553db97`::Granted request >Thread-34::DEBUG::2014-07-10 09:09:36,297::task::827::TaskManager.Task::(resourceAcquired) Task=`0e23a40f-f6bd-43f6-b62e-35cbe5d8e3c1`::_resourcesAcquired: Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee (shared) >Thread-34::DEBUG::2014-07-10 09:09:36,297::task::990::TaskManager.Task::(_decref) Task=`0e23a40f-f6bd-43f6-b62e-35cbe5d8e3c1`::ref 1 aborting False >Thread-34::INFO::2014-07-10 09:09:36,298::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532067385344', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:09:36,298::task::1185::TaskManager.Task::(prepare) Task=`0e23a40f-f6bd-43f6-b62e-35cbe5d8e3c1`::finished: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532067385344', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:09:36,298::task::595::TaskManager.Task::(_updateState) Task=`0e23a40f-f6bd-43f6-b62e-35cbe5d8e3c1`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-10 09:09:36,299::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee': < ResourceRef 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-10 09:09:36,299::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-10 09:09:36,299::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' >Thread-34::DEBUG::2014-07-10 09:09:36,299::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' (0 active users) >Thread-34::DEBUG::2014-07-10 09:09:36,299::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-10 09:09:36,299::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', Clearing records. >Thread-34::DEBUG::2014-07-10 09:09:36,300::task::990::TaskManager.Task::(_decref) Task=`0e23a40f-f6bd-43f6-b62e-35cbe5d8e3c1`::ref 0 aborting False >Thread-40::DEBUG::2014-07-10 09:09:36,639::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lion.qa.lab.tlv.redhat.com:_export_yuri2_backup2/6a70504d-00df-4869-8695-0f442053f6b6/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-40::DEBUG::2014-07-10 09:09:36,660::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n369 bytes (369 B) copied, 0.000563415 s, 655 kB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:09:37,696::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:09:37,789::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0352034 s, 29.1 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 09:09:38,945::task::595::TaskManager.Task::(_updateState) Task=`3074bfda-67d0-4dfd-9a0a-fb67963b2a96`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 09:09:38,945::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::INFO::2014-07-10 09:09:38,946::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000860149', 'lastCheck': '6.4', 'valid': True}, '6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000563415', 'lastCheck': '2.3', 'valid': True}} >Thread-14::DEBUG::2014-07-10 09:09:38,946::task::1185::TaskManager.Task::(prepare) Task=`3074bfda-67d0-4dfd-9a0a-fb67963b2a96`::finished: {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000860149', 'lastCheck': '6.4', 'valid': True}, '6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000563415', 'lastCheck': '2.3', 'valid': True}} >Thread-14::DEBUG::2014-07-10 09:09:38,946::task::595::TaskManager.Task::(_updateState) Task=`3074bfda-67d0-4dfd-9a0a-fb67963b2a96`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 09:09:38,946::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 09:09:38,947::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 09:09:38,947::task::990::TaskManager.Task::(_decref) Task=`3074bfda-67d0-4dfd-9a0a-fb67963b2a96`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 09:09:39,806::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:09:39,893::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0269556 s, 38.0 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:09:41,909::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:09:42,011::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0423082 s, 24.2 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-10 09:09:42,571::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/metadata bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-10 09:09:42,593::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00083854 s, 4.9 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:09:44,026::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:09:44,181::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0970553 s, 10.6 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:09:46,204::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:09:46,302::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0358156 s, 28.6 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 09:09:46,331::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-14::DEBUG::2014-07-10 09:09:46,332::task::595::TaskManager.Task::(_updateState) Task=`c01eb78f-0ba8-4d64-a180-ccb6f4edad97`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 09:09:46,332::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-14::INFO::2014-07-10 09:09:46,333::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:09:46,333::task::1185::TaskManager.Task::(prepare) Task=`c01eb78f-0ba8-4d64-a180-ccb6f4edad97`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:09:46,333::task::595::TaskManager.Task::(_updateState) Task=`c01eb78f-0ba8-4d64-a180-ccb6f4edad97`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 09:09:46,334::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 09:09:46,334::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 09:09:46,334::task::990::TaskManager.Task::(_decref) Task=`c01eb78f-0ba8-4d64-a180-ccb6f4edad97`::ref 0 aborting False >Thread-34::DEBUG::2014-07-10 09:09:46,338::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-34::DEBUG::2014-07-10 09:09:46,339::task::595::TaskManager.Task::(_updateState) Task=`181797c6-4694-4fef-b1f0-e77d2499b60a`::moving from state init -> state preparing >Thread-34::INFO::2014-07-10 09:09:46,339::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-34::DEBUG::2014-07-10 09:09:46,340::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`0557a1f8-376b-4450-8396-903ff9ba1360`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-10 09:09:46,340::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' for lock type 'shared' >Thread-34::DEBUG::2014-07-10 09:09:46,340::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-10 09:09:46,340::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`0557a1f8-376b-4450-8396-903ff9ba1360`::Granted request >Thread-34::DEBUG::2014-07-10 09:09:46,341::task::827::TaskManager.Task::(resourceAcquired) Task=`181797c6-4694-4fef-b1f0-e77d2499b60a`::_resourcesAcquired: Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee (shared) >Thread-34::DEBUG::2014-07-10 09:09:46,341::task::990::TaskManager.Task::(_decref) Task=`181797c6-4694-4fef-b1f0-e77d2499b60a`::ref 1 aborting False >Thread-34::INFO::2014-07-10 09:09:46,342::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532067385344', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:09:46,343::task::1185::TaskManager.Task::(prepare) Task=`181797c6-4694-4fef-b1f0-e77d2499b60a`::finished: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532067385344', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:09:46,343::task::595::TaskManager.Task::(_updateState) Task=`181797c6-4694-4fef-b1f0-e77d2499b60a`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-10 09:09:46,343::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee': < ResourceRef 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-10 09:09:46,343::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-10 09:09:46,344::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' >Thread-34::DEBUG::2014-07-10 09:09:46,344::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' (0 active users) >Thread-34::DEBUG::2014-07-10 09:09:46,344::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-10 09:09:46,344::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', Clearing records. >Thread-34::DEBUG::2014-07-10 09:09:46,345::task::990::TaskManager.Task::(_decref) Task=`181797c6-4694-4fef-b1f0-e77d2499b60a`::ref 0 aborting False >Thread-40::DEBUG::2014-07-10 09:09:46,690::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lion.qa.lab.tlv.redhat.com:_export_yuri2_backup2/6a70504d-00df-4869-8695-0f442053f6b6/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-40::DEBUG::2014-07-10 09:09:46,711::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n369 bytes (369 B) copied, 0.000524624 s, 703 kB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:09:48,317::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:09:48,404::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0284689 s, 36.0 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:09:50,420::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:09:50,575::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0963161 s, 10.6 MB/s\n'; <rc> = 0 >Thread-64::DEBUG::2014-07-10 09:09:51,099::task::595::TaskManager.Task::(_updateState) Task=`8cb4a577-f321-4d1b-8443-60eec279eace`::moving from state init -> state preparing >Thread-64::INFO::2014-07-10 09:09:51,100::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='aa20346a-4d3a-4e07-b8e1-52c0ebe4168c', volUUID='58fefce2-9bce-4bff-8949-8c6ce8122b27', options=None) >Thread-64::INFO::2014-07-10 09:09:51,101::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-64::DEBUG::2014-07-10 09:09:51,101::task::1185::TaskManager.Task::(prepare) Task=`8cb4a577-f321-4d1b-8443-60eec279eace`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-64::DEBUG::2014-07-10 09:09:51,101::task::595::TaskManager.Task::(_updateState) Task=`8cb4a577-f321-4d1b-8443-60eec279eace`::moving from state preparing -> state finished >Thread-64::DEBUG::2014-07-10 09:09:51,101::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-64::DEBUG::2014-07-10 09:09:51,101::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-64::DEBUG::2014-07-10 09:09:51,102::task::990::TaskManager.Task::(_decref) Task=`8cb4a577-f321-4d1b-8443-60eec279eace`::ref 0 aborting False >Thread-54::DEBUG::2014-07-10 09:09:52,141::task::595::TaskManager.Task::(_updateState) Task=`e7834c39-98bd-42a0-b837-b151c1972c96`::moving from state init -> state preparing >Thread-54::INFO::2014-07-10 09:09:52,142::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='28408446-e5fd-4565-a976-e760951593fe', volUUID='776303a2-5585-451e-826e-0e338d4a1e98', options=None) >Thread-73::DEBUG::2014-07-10 09:09:52,144::task::595::TaskManager.Task::(_updateState) Task=`81dc48d1-8b27-4e68-a95e-a299a6160228`::moving from state init -> state preparing >Thread-54::INFO::2014-07-10 09:09:52,144::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-73::INFO::2014-07-10 09:09:52,145::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='c01d693b-cba0-4fed-9ad7-0aaa28912a19', volUUID='4bb5d954-2a50-4028-b299-0b43c261270c', options=None) >Thread-54::DEBUG::2014-07-10 09:09:52,146::task::1185::TaskManager.Task::(prepare) Task=`e7834c39-98bd-42a0-b837-b151c1972c96`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-54::DEBUG::2014-07-10 09:09:52,147::task::595::TaskManager.Task::(_updateState) Task=`e7834c39-98bd-42a0-b837-b151c1972c96`::moving from state preparing -> state finished >Thread-73::INFO::2014-07-10 09:09:52,147::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-54::DEBUG::2014-07-10 09:09:52,148::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-73::DEBUG::2014-07-10 09:09:52,148::task::1185::TaskManager.Task::(prepare) Task=`81dc48d1-8b27-4e68-a95e-a299a6160228`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-54::DEBUG::2014-07-10 09:09:52,149::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-73::DEBUG::2014-07-10 09:09:52,150::task::595::TaskManager.Task::(_updateState) Task=`81dc48d1-8b27-4e68-a95e-a299a6160228`::moving from state preparing -> state finished >Thread-54::DEBUG::2014-07-10 09:09:52,151::task::990::TaskManager.Task::(_decref) Task=`e7834c39-98bd-42a0-b837-b151c1972c96`::ref 0 aborting False >Thread-73::DEBUG::2014-07-10 09:09:52,151::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-73::DEBUG::2014-07-10 09:09:52,152::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-73::DEBUG::2014-07-10 09:09:52,152::task::990::TaskManager.Task::(_decref) Task=`81dc48d1-8b27-4e68-a95e-a299a6160228`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 09:09:52,591::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Thread-18::DEBUG::2014-07-10 09:09:52,629::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/metadata bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-10 09:09:52,714::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000613293 s, 6.7 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:09:53,095::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.409589 s, 2.5 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 09:09:54,181::task::595::TaskManager.Task::(_updateState) Task=`73c2f1d0-b2bb-461a-a1bc-bbe452590321`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 09:09:54,182::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::INFO::2014-07-10 09:09:54,182::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000613293', 'lastCheck': '1.1', 'valid': True}, '6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000524624', 'lastCheck': '7.5', 'valid': True}} >Thread-14::DEBUG::2014-07-10 09:09:54,182::task::1185::TaskManager.Task::(prepare) Task=`73c2f1d0-b2bb-461a-a1bc-bbe452590321`::finished: {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000613293', 'lastCheck': '1.1', 'valid': True}, '6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000524624', 'lastCheck': '7.5', 'valid': True}} >Thread-14::DEBUG::2014-07-10 09:09:54,183::task::595::TaskManager.Task::(_updateState) Task=`73c2f1d0-b2bb-461a-a1bc-bbe452590321`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 09:09:54,183::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 09:09:54,183::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 09:09:54,183::task::990::TaskManager.Task::(_decref) Task=`73c2f1d0-b2bb-461a-a1bc-bbe452590321`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 09:09:55,110::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:09:55,197::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.02528 s, 40.5 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 09:09:56,396::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-14::DEBUG::2014-07-10 09:09:56,398::task::595::TaskManager.Task::(_updateState) Task=`0e6ac279-6477-4624-8b24-71b3e6216d6a`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 09:09:56,398::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-14::INFO::2014-07-10 09:09:56,399::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:09:56,399::task::1185::TaskManager.Task::(prepare) Task=`0e6ac279-6477-4624-8b24-71b3e6216d6a`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:09:56,399::task::595::TaskManager.Task::(_updateState) Task=`0e6ac279-6477-4624-8b24-71b3e6216d6a`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 09:09:56,399::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 09:09:56,400::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 09:09:56,400::task::990::TaskManager.Task::(_decref) Task=`0e6ac279-6477-4624-8b24-71b3e6216d6a`::ref 0 aborting False >Thread-34::DEBUG::2014-07-10 09:09:56,444::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-34::DEBUG::2014-07-10 09:09:56,444::task::595::TaskManager.Task::(_updateState) Task=`e7b61f41-8c3b-4232-8967-c62e1472ba95`::moving from state init -> state preparing >Thread-34::INFO::2014-07-10 09:09:56,444::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-34::DEBUG::2014-07-10 09:09:56,445::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`91a07ee4-3b96-4ef9-801e-8d4f54565e03`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-10 09:09:56,445::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' for lock type 'shared' >Thread-34::DEBUG::2014-07-10 09:09:56,445::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-10 09:09:56,446::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`91a07ee4-3b96-4ef9-801e-8d4f54565e03`::Granted request >Thread-34::DEBUG::2014-07-10 09:09:56,446::task::827::TaskManager.Task::(resourceAcquired) Task=`e7b61f41-8c3b-4232-8967-c62e1472ba95`::_resourcesAcquired: Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee (shared) >Thread-34::DEBUG::2014-07-10 09:09:56,446::task::990::TaskManager.Task::(_decref) Task=`e7b61f41-8c3b-4232-8967-c62e1472ba95`::ref 1 aborting False >Thread-34::INFO::2014-07-10 09:09:56,448::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532067385344', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:09:56,448::task::1185::TaskManager.Task::(prepare) Task=`e7b61f41-8c3b-4232-8967-c62e1472ba95`::finished: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532067385344', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:09:56,448::task::595::TaskManager.Task::(_updateState) Task=`e7b61f41-8c3b-4232-8967-c62e1472ba95`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-10 09:09:56,448::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee': < ResourceRef 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-10 09:09:56,448::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-10 09:09:56,449::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' >Thread-34::DEBUG::2014-07-10 09:09:56,449::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' (0 active users) >Thread-34::DEBUG::2014-07-10 09:09:56,449::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-10 09:09:56,449::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', Clearing records. >Thread-34::DEBUG::2014-07-10 09:09:56,450::task::990::TaskManager.Task::(_decref) Task=`e7b61f41-8c3b-4232-8967-c62e1472ba95`::ref 0 aborting False >Thread-40::DEBUG::2014-07-10 09:09:56,742::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lion.qa.lab.tlv.redhat.com:_export_yuri2_backup2/6a70504d-00df-4869-8695-0f442053f6b6/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-40::DEBUG::2014-07-10 09:09:56,762::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n369 bytes (369 B) copied, 0.000563391 s, 655 kB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:09:57,212::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:09:57,300::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0298674 s, 34.3 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:09:59,315::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:09:59,408::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0355635 s, 28.8 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:10:01,424::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:10:01,523::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0283773 s, 36.1 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-10 09:10:03,057::domainMonitor::192::Storage.DomainMonitorThread::(_monitorDomain) Refreshing domain 9e1aa540-1f4e-4ee3-a152-be381ef6c3bd >Thread-18::DEBUG::2014-07-10 09:10:03,059::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with LvMetadataRW backend >Thread-18::DEBUG::2014-07-10 09:10:03,060::blockSD::336::Storage.Misc.excCmd::(readlines) '/bin/dd iflag=direct skip=0 bs=2048 if=/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/metadata count=1' (cwd None) >Thread-18::DEBUG::2014-07-10 09:10:03,078::blockSD::336::Storage.Misc.excCmd::(readlines) SUCCESS: <err> = '1+0 records in\n1+0 records out\n2048 bytes (2.0 kB) copied, 0.000710054 s, 2.9 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-10 09:10:03,079::misc::282::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '2048 bytes (2.0 kB) copied, 0.000710054 s, 2.9 MB/s'], size: 2048 >Thread-18::DEBUG::2014-07-10 09:10:03,079::persistentDict::234::Storage.PersistentDict::(refresh) read lines (LvMetadataRW)=[] >Thread-18::WARNING::2014-07-10 09:10:03,080::persistentDict::256::Storage.PersistentDict::(refresh) data has no embedded checksum - trust it as it is >Thread-18::DEBUG::2014-07-10 09:10:03,080::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with VGTagMetadataRW backend >Thread-18::DEBUG::2014-07-10 09:10:03,080::lvm::503::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-18::DEBUG::2014-07-10 09:10:03,081::lvm::505::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-18::DEBUG::2014-07-10 09:10:03,081::lvm::513::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-18::DEBUG::2014-07-10 09:10:03,081::lvm::525::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-18::DEBUG::2014-07-10 09:10:03,082::lvm::373::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-18::DEBUG::2014-07-10 09:10:03,082::lvm::296::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/3600601601282300032826addbbdae311|/dev/mapper/360060160f4a030003840ec867ddee311|/dev/mapper/367cad74c2fcba00019e6afd20c781e67|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name 9e1aa540-1f4e-4ee3-a152-be381ef6c3bd' (cwd None) >Thread-18::DEBUG::2014-07-10 09:10:03,438::lvm::296::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-18::DEBUG::2014-07-10 09:10:03,440::lvm::415::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-18::DEBUG::2014-07-10 09:10:03,441::persistentDict::234::Storage.PersistentDict::(refresh) read lines (VGTagMetadataRW)=['LEASETIMESEC=60', 'VGUUID=9CsMxb-YbRc-yRG7-cQKD-xY3G-GLi5-YxUyPC', 'VERSION=3', 'TYPE=ISCSI', 'LOGBLKSIZE=512', u'PV0=pv:3600601601282300032826addbbdae311,uuid:7qEb8v-jk2X-3CPk-k4XB-eIBk-onYD-807hcV,pestart:0,pecount:8189,mapoffset:0', 'LEASERETRIES=3', 'IOOPTIMEOUTSEC=10', 'LOCKRENEWALINTERVALSEC=5', 'PHYBLKSIZE=512', 'SDUUID=9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'CLASS=Data', 'LOCKPOLICY=', 'DESCRIPTION=SD_REAL', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=DC_REAL', 'ROLE=Master', 'POOL_UUID=4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', 'POOL_SPM_ID=1', 'POOL_SPM_LVER=0', '_SHA_CKSUM=013b5a7910962201c4cceab31b9c6d9c79f7316f', u'POOL_DOMAINS=9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active'] >Thread-18::INFO::2014-07-10 09:10:03,442::sd::384::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 9e1aa540-1f4e-4ee3-a152-be381ef6c3bd_imageNS already registered >Thread-18::INFO::2014-07-10 09:10:03,442::sd::392::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 9e1aa540-1f4e-4ee3-a152-be381ef6c3bd_volumeNS already registered >Thread-18::INFO::2014-07-10 09:10:03,443::blockSD::452::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 9e1aa540-1f4e-4ee3-a152-be381ef6c3bd_lvmActivationNS already registered >Thread-18::DEBUG::2014-07-10 09:10:03,443::lvm::296::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgck --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/3600601601282300032826addbbdae311|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } " 9e1aa540-1f4e-4ee3-a152-be381ef6c3bd' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:10:03,539::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:10:03,628::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0315625 s, 32.4 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-10 09:10:03,654::lvm::296::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-18::DEBUG::2014-07-10 09:10:03,656::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/metadata bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-10 09:10:03,677::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000505925 s, 8.1 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:10:05,642::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:10:06,309::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.510539 s, 2.0 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 09:10:06,473::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-14::DEBUG::2014-07-10 09:10:06,474::task::595::TaskManager.Task::(_updateState) Task=`f2403614-dd16-4783-b18e-4a3f653dd422`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 09:10:06,474::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-14::INFO::2014-07-10 09:10:06,475::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:10:06,475::task::1185::TaskManager.Task::(prepare) Task=`f2403614-dd16-4783-b18e-4a3f653dd422`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:10:06,475::task::595::TaskManager.Task::(_updateState) Task=`f2403614-dd16-4783-b18e-4a3f653dd422`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 09:10:06,475::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 09:10:06,475::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 09:10:06,476::task::990::TaskManager.Task::(_decref) Task=`f2403614-dd16-4783-b18e-4a3f653dd422`::ref 0 aborting False >Thread-34::DEBUG::2014-07-10 09:10:06,479::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-34::DEBUG::2014-07-10 09:10:06,480::task::595::TaskManager.Task::(_updateState) Task=`06d502b6-7626-45e6-88c9-f6869e50ffa4`::moving from state init -> state preparing >Thread-34::INFO::2014-07-10 09:10:06,480::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-34::DEBUG::2014-07-10 09:10:06,480::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`93999793-3034-46e6-bffa-a85b1a2b8495`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-10 09:10:06,481::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' for lock type 'shared' >Thread-34::DEBUG::2014-07-10 09:10:06,481::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-10 09:10:06,481::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`93999793-3034-46e6-bffa-a85b1a2b8495`::Granted request >Thread-34::DEBUG::2014-07-10 09:10:06,482::task::827::TaskManager.Task::(resourceAcquired) Task=`06d502b6-7626-45e6-88c9-f6869e50ffa4`::_resourcesAcquired: Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee (shared) >Thread-34::DEBUG::2014-07-10 09:10:06,482::task::990::TaskManager.Task::(_decref) Task=`06d502b6-7626-45e6-88c9-f6869e50ffa4`::ref 1 aborting False >Thread-34::INFO::2014-07-10 09:10:06,483::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532067385344', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:10:06,483::task::1185::TaskManager.Task::(prepare) Task=`06d502b6-7626-45e6-88c9-f6869e50ffa4`::finished: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532067385344', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:10:06,483::task::595::TaskManager.Task::(_updateState) Task=`06d502b6-7626-45e6-88c9-f6869e50ffa4`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-10 09:10:06,483::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee': < ResourceRef 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-10 09:10:06,484::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-10 09:10:06,484::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' >Thread-34::DEBUG::2014-07-10 09:10:06,484::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' (0 active users) >Thread-34::DEBUG::2014-07-10 09:10:06,484::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-10 09:10:06,484::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', Clearing records. >Thread-34::DEBUG::2014-07-10 09:10:06,484::task::990::TaskManager.Task::(_decref) Task=`06d502b6-7626-45e6-88c9-f6869e50ffa4`::ref 0 aborting False >Thread-40::DEBUG::2014-07-10 09:10:06,790::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lion.qa.lab.tlv.redhat.com:_export_yuri2_backup2/6a70504d-00df-4869-8695-0f442053f6b6/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-40::DEBUG::2014-07-10 09:10:06,810::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n369 bytes (369 B) copied, 0.000482301 s, 765 kB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:10:08,319::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:10:08,413::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0350039 s, 29.3 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 09:10:09,361::task::595::TaskManager.Task::(_updateState) Task=`3c673354-7089-4f4d-9948-13e37b51dd52`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 09:10:09,361::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::INFO::2014-07-10 09:10:09,361::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000505925', 'lastCheck': '5.7', 'valid': True}, '6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000482301', 'lastCheck': '2.5', 'valid': True}} >Thread-14::DEBUG::2014-07-10 09:10:09,362::task::1185::TaskManager.Task::(prepare) Task=`3c673354-7089-4f4d-9948-13e37b51dd52`::finished: {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000505925', 'lastCheck': '5.7', 'valid': True}, '6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000482301', 'lastCheck': '2.5', 'valid': True}} >Thread-14::DEBUG::2014-07-10 09:10:09,362::task::595::TaskManager.Task::(_updateState) Task=`3c673354-7089-4f4d-9948-13e37b51dd52`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 09:10:09,362::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 09:10:09,362::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 09:10:09,362::task::990::TaskManager.Task::(_decref) Task=`3c673354-7089-4f4d-9948-13e37b51dd52`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 09:10:10,429::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:10:10,530::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0297578 s, 34.4 MB/s\n'; <rc> = 0 >Thread-57::DEBUG::2014-07-10 09:10:11,256::task::595::TaskManager.Task::(_updateState) Task=`1116494f-2c71-4d0e-b717-012f0c69c3c5`::moving from state init -> state preparing >Thread-57::INFO::2014-07-10 09:10:11,256::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='b6f6c0da-e67f-4902-b9ac-3069571a42fe', volUUID='c4cd1da8-05b7-45e0-80b1-1183d21443d9', options=None) >Thread-57::INFO::2014-07-10 09:10:11,257::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-57::DEBUG::2014-07-10 09:10:11,257::task::1185::TaskManager.Task::(prepare) Task=`1116494f-2c71-4d0e-b717-012f0c69c3c5`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-57::DEBUG::2014-07-10 09:10:11,257::task::595::TaskManager.Task::(_updateState) Task=`1116494f-2c71-4d0e-b717-012f0c69c3c5`::moving from state preparing -> state finished >Thread-57::DEBUG::2014-07-10 09:10:11,258::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-57::DEBUG::2014-07-10 09:10:11,258::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-57::DEBUG::2014-07-10 09:10:11,258::task::990::TaskManager.Task::(_decref) Task=`1116494f-2c71-4d0e-b717-012f0c69c3c5`::ref 0 aborting False >Thread-67::DEBUG::2014-07-10 09:10:12,099::task::595::TaskManager.Task::(_updateState) Task=`b46578ea-4fd2-4348-bc4c-5f037f2f1b1e`::moving from state init -> state preparing >Thread-67::INFO::2014-07-10 09:10:12,100::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='f30c2cb7-a43a-4bf5-82b5-cfe07336f65c', volUUID='b0fbb3c9-55af-4a3a-95ad-fc56a80b9cf5', options=None) >Thread-67::INFO::2014-07-10 09:10:12,100::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-67::DEBUG::2014-07-10 09:10:12,100::task::1185::TaskManager.Task::(prepare) Task=`b46578ea-4fd2-4348-bc4c-5f037f2f1b1e`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-67::DEBUG::2014-07-10 09:10:12,101::task::595::TaskManager.Task::(_updateState) Task=`b46578ea-4fd2-4348-bc4c-5f037f2f1b1e`::moving from state preparing -> state finished >Thread-67::DEBUG::2014-07-10 09:10:12,101::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-67::DEBUG::2014-07-10 09:10:12,101::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-67::DEBUG::2014-07-10 09:10:12,101::task::990::TaskManager.Task::(_decref) Task=`b46578ea-4fd2-4348-bc4c-5f037f2f1b1e`::ref 0 aborting False >Thread-48::DEBUG::2014-07-10 09:10:12,380::task::595::TaskManager.Task::(_updateState) Task=`b1a029aa-2a2c-4341-a3ea-09a938af84a8`::moving from state init -> state preparing >Thread-48::INFO::2014-07-10 09:10:12,380::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='0cd7d6ce-f497-4243-a690-c57744861eea', volUUID='10b6a7dd-dc6c-43fa-ba17-92e4331b0e0b', options=None) >Thread-48::INFO::2014-07-10 09:10:12,380::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-48::DEBUG::2014-07-10 09:10:12,381::task::1185::TaskManager.Task::(prepare) Task=`b1a029aa-2a2c-4341-a3ea-09a938af84a8`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-48::DEBUG::2014-07-10 09:10:12,381::task::595::TaskManager.Task::(_updateState) Task=`b1a029aa-2a2c-4341-a3ea-09a938af84a8`::moving from state preparing -> state finished >Thread-48::DEBUG::2014-07-10 09:10:12,381::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-48::DEBUG::2014-07-10 09:10:12,381::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-48::DEBUG::2014-07-10 09:10:12,381::task::990::TaskManager.Task::(_decref) Task=`b1a029aa-2a2c-4341-a3ea-09a938af84a8`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 09:10:12,545::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:10:12,634::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0288469 s, 35.5 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-10 09:10:13,708::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/metadata bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-10 09:10:13,730::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000815297 s, 5.0 MB/s\n'; <rc> = 0 >Thread-76::DEBUG::2014-07-10 09:10:13,760::task::595::TaskManager.Task::(_updateState) Task=`2f678579-7eeb-43d5-b12c-8b3b503d3b10`::moving from state init -> state preparing >Thread-76::INFO::2014-07-10 09:10:13,765::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='e4c65229-4247-4b33-b72a-f1d5ce72ad05', volUUID='cad94284-3ca9-4c30-933d-997f4460309e', options=None) >Thread-76::INFO::2014-07-10 09:10:13,771::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-76::DEBUG::2014-07-10 09:10:13,777::task::1185::TaskManager.Task::(prepare) Task=`2f678579-7eeb-43d5-b12c-8b3b503d3b10`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-76::DEBUG::2014-07-10 09:10:13,785::task::595::TaskManager.Task::(_updateState) Task=`2f678579-7eeb-43d5-b12c-8b3b503d3b10`::moving from state preparing -> state finished >Thread-76::DEBUG::2014-07-10 09:10:13,793::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-76::DEBUG::2014-07-10 09:10:13,802::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-76::DEBUG::2014-07-10 09:10:13,806::task::990::TaskManager.Task::(_decref) Task=`2f678579-7eeb-43d5-b12c-8b3b503d3b10`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 09:10:14,649::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:10:14,744::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0357057 s, 28.7 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 09:10:16,508::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-14::DEBUG::2014-07-10 09:10:16,509::task::595::TaskManager.Task::(_updateState) Task=`df63e3ab-9611-4453-89df-014225af7f86`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 09:10:16,509::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-14::INFO::2014-07-10 09:10:16,509::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:10:16,510::task::1185::TaskManager.Task::(prepare) Task=`df63e3ab-9611-4453-89df-014225af7f86`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:10:16,510::task::595::TaskManager.Task::(_updateState) Task=`df63e3ab-9611-4453-89df-014225af7f86`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 09:10:16,510::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 09:10:16,510::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 09:10:16,510::task::990::TaskManager.Task::(_decref) Task=`df63e3ab-9611-4453-89df-014225af7f86`::ref 0 aborting False >Thread-34::DEBUG::2014-07-10 09:10:16,514::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-34::DEBUG::2014-07-10 09:10:16,515::task::595::TaskManager.Task::(_updateState) Task=`05a74f86-6931-43b6-9a44-33a7d7cdfbb2`::moving from state init -> state preparing >Thread-34::INFO::2014-07-10 09:10:16,515::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-34::DEBUG::2014-07-10 09:10:16,516::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`4541d11f-738b-456d-b513-3b46a10b3246`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-10 09:10:16,516::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' for lock type 'shared' >Thread-34::DEBUG::2014-07-10 09:10:16,516::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-10 09:10:16,516::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`4541d11f-738b-456d-b513-3b46a10b3246`::Granted request >Thread-34::DEBUG::2014-07-10 09:10:16,517::task::827::TaskManager.Task::(resourceAcquired) Task=`05a74f86-6931-43b6-9a44-33a7d7cdfbb2`::_resourcesAcquired: Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee (shared) >Thread-34::DEBUG::2014-07-10 09:10:16,517::task::990::TaskManager.Task::(_decref) Task=`05a74f86-6931-43b6-9a44-33a7d7cdfbb2`::ref 1 aborting False >Thread-34::INFO::2014-07-10 09:10:16,518::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532067385344', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:10:16,518::task::1185::TaskManager.Task::(prepare) Task=`05a74f86-6931-43b6-9a44-33a7d7cdfbb2`::finished: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532067385344', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:10:16,518::task::595::TaskManager.Task::(_updateState) Task=`05a74f86-6931-43b6-9a44-33a7d7cdfbb2`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-10 09:10:16,518::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee': < ResourceRef 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-10 09:10:16,519::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-10 09:10:16,519::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' >Thread-34::DEBUG::2014-07-10 09:10:16,519::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' (0 active users) >Thread-34::DEBUG::2014-07-10 09:10:16,519::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-10 09:10:16,519::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', Clearing records. >Thread-34::DEBUG::2014-07-10 09:10:16,519::task::990::TaskManager.Task::(_decref) Task=`05a74f86-6931-43b6-9a44-33a7d7cdfbb2`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 09:10:16,759::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Thread-40::DEBUG::2014-07-10 09:10:17,086::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lion.qa.lab.tlv.redhat.com:_export_yuri2_backup2/6a70504d-00df-4869-8695-0f442053f6b6/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-40::DEBUG::2014-07-10 09:10:17,153::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n369 bytes (369 B) copied, 0.000409781 s, 900 kB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:10:17,180::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0283645 s, 36.1 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:10:19,195::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:10:19,354::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0795119 s, 12.9 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:10:21,369::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:10:21,472::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0268966 s, 38.1 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:10:23,490::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:10:23,593::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0438886 s, 23.3 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-10 09:10:23,821::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/metadata bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-10 09:10:23,846::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000503081 s, 8.1 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 09:10:24,548::task::595::TaskManager.Task::(_updateState) Task=`a8269d42-bf99-4d25-a160-fdde846cb6b8`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 09:10:24,549::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::INFO::2014-07-10 09:10:24,549::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000503081', 'lastCheck': '0.7', 'valid': True}, '6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000409781', 'lastCheck': '7.4', 'valid': True}} >Thread-14::DEBUG::2014-07-10 09:10:24,549::task::1185::TaskManager.Task::(prepare) Task=`a8269d42-bf99-4d25-a160-fdde846cb6b8`::finished: {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000503081', 'lastCheck': '0.7', 'valid': True}, '6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000409781', 'lastCheck': '7.4', 'valid': True}} >Thread-14::DEBUG::2014-07-10 09:10:24,549::task::595::TaskManager.Task::(_updateState) Task=`a8269d42-bf99-4d25-a160-fdde846cb6b8`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 09:10:24,549::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 09:10:24,550::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 09:10:24,550::task::990::TaskManager.Task::(_decref) Task=`a8269d42-bf99-4d25-a160-fdde846cb6b8`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 09:10:25,609::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:10:25,693::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0271716 s, 37.7 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 09:10:26,550::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-14::DEBUG::2014-07-10 09:10:26,551::task::595::TaskManager.Task::(_updateState) Task=`bf5618c4-c972-414f-b0f5-8653217ee3e6`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 09:10:26,551::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-14::INFO::2014-07-10 09:10:26,552::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:10:26,552::task::1185::TaskManager.Task::(prepare) Task=`bf5618c4-c972-414f-b0f5-8653217ee3e6`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:10:26,552::task::595::TaskManager.Task::(_updateState) Task=`bf5618c4-c972-414f-b0f5-8653217ee3e6`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 09:10:26,552::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 09:10:26,553::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 09:10:26,553::task::990::TaskManager.Task::(_decref) Task=`bf5618c4-c972-414f-b0f5-8653217ee3e6`::ref 0 aborting False >Thread-34::DEBUG::2014-07-10 09:10:26,597::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-34::DEBUG::2014-07-10 09:10:26,597::task::595::TaskManager.Task::(_updateState) Task=`1281bf0f-4383-488c-b787-332eab928a74`::moving from state init -> state preparing >Thread-34::INFO::2014-07-10 09:10:26,597::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-34::DEBUG::2014-07-10 09:10:26,598::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`6b950268-0730-4120-9def-588738cf59fa`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-10 09:10:26,598::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' for lock type 'shared' >Thread-34::DEBUG::2014-07-10 09:10:26,599::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-10 09:10:26,599::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`6b950268-0730-4120-9def-588738cf59fa`::Granted request >Thread-34::DEBUG::2014-07-10 09:10:26,599::task::827::TaskManager.Task::(resourceAcquired) Task=`1281bf0f-4383-488c-b787-332eab928a74`::_resourcesAcquired: Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee (shared) >Thread-34::DEBUG::2014-07-10 09:10:26,599::task::990::TaskManager.Task::(_decref) Task=`1281bf0f-4383-488c-b787-332eab928a74`::ref 1 aborting False >Thread-34::INFO::2014-07-10 09:10:26,601::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532067385344', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:10:26,601::task::1185::TaskManager.Task::(prepare) Task=`1281bf0f-4383-488c-b787-332eab928a74`::finished: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532067385344', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:10:26,601::task::595::TaskManager.Task::(_updateState) Task=`1281bf0f-4383-488c-b787-332eab928a74`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-10 09:10:26,601::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee': < ResourceRef 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-10 09:10:26,602::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-10 09:10:26,602::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' >Thread-34::DEBUG::2014-07-10 09:10:26,602::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' (0 active users) >Thread-34::DEBUG::2014-07-10 09:10:26,602::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-10 09:10:26,603::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', Clearing records. >Thread-34::DEBUG::2014-07-10 09:10:26,603::task::990::TaskManager.Task::(_decref) Task=`1281bf0f-4383-488c-b787-332eab928a74`::ref 0 aborting False >Thread-40::DEBUG::2014-07-10 09:10:27,193::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lion.qa.lab.tlv.redhat.com:_export_yuri2_backup2/6a70504d-00df-4869-8695-0f442053f6b6/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-40::DEBUG::2014-07-10 09:10:27,215::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n369 bytes (369 B) copied, 0.000973774 s, 379 kB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:10:27,714::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:10:27,820::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0477325 s, 21.5 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:10:29,835::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:10:29,951::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0559214 s, 18.3 MB/s\n'; <rc> = 0 >Thread-70::DEBUG::2014-07-10 09:10:31,311::task::595::TaskManager.Task::(_updateState) Task=`ee14f5b9-b3cd-41cf-a556-82cb35849f4f`::moving from state init -> state preparing >Thread-70::INFO::2014-07-10 09:10:31,312::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='cfaeead2-7caa-467c-b389-c89840ae6605', volUUID='567fe32d-31a6-4ff6-90f3-fd6a656fbecc', options=None) >Thread-70::INFO::2014-07-10 09:10:31,313::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-70::DEBUG::2014-07-10 09:10:31,313::task::1185::TaskManager.Task::(prepare) Task=`ee14f5b9-b3cd-41cf-a556-82cb35849f4f`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-70::DEBUG::2014-07-10 09:10:31,313::task::595::TaskManager.Task::(_updateState) Task=`ee14f5b9-b3cd-41cf-a556-82cb35849f4f`::moving from state preparing -> state finished >Thread-70::DEBUG::2014-07-10 09:10:31,313::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-70::DEBUG::2014-07-10 09:10:31,313::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-70::DEBUG::2014-07-10 09:10:31,314::task::990::TaskManager.Task::(_decref) Task=`ee14f5b9-b3cd-41cf-a556-82cb35849f4f`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 09:10:31,967::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:10:32,055::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0304433 s, 33.6 MB/s\n'; <rc> = 0 >Thread-60::DEBUG::2014-07-10 09:10:32,182::task::595::TaskManager.Task::(_updateState) Task=`a83a6564-875f-4bcd-9d37-4bdffb7cd634`::moving from state init -> state preparing >Thread-60::INFO::2014-07-10 09:10:32,183::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='b034d5b0-e1e0-4011-b49b-4d45ddb11556', volUUID='3d7f62b5-328f-4d8e-8b69-873cfb5ae14d', options=None) >Thread-60::INFO::2014-07-10 09:10:32,183::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-60::DEBUG::2014-07-10 09:10:32,184::task::1185::TaskManager.Task::(prepare) Task=`a83a6564-875f-4bcd-9d37-4bdffb7cd634`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-60::DEBUG::2014-07-10 09:10:32,184::task::595::TaskManager.Task::(_updateState) Task=`a83a6564-875f-4bcd-9d37-4bdffb7cd634`::moving from state preparing -> state finished >Thread-60::DEBUG::2014-07-10 09:10:32,184::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-60::DEBUG::2014-07-10 09:10:32,184::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-60::DEBUG::2014-07-10 09:10:32,184::task::990::TaskManager.Task::(_decref) Task=`a83a6564-875f-4bcd-9d37-4bdffb7cd634`::ref 0 aborting False >Thread-51::DEBUG::2014-07-10 09:10:32,380::task::595::TaskManager.Task::(_updateState) Task=`235c09c8-484b-482a-a2bb-793b26fe4724`::moving from state init -> state preparing >Thread-51::INFO::2014-07-10 09:10:32,381::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='76fdb054-02cd-42ed-9721-b3e65b34c3a4', volUUID='022dfe46-2cf7-4915-80b3-883158e3ca83', options=None) >Thread-51::INFO::2014-07-10 09:10:32,381::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-51::DEBUG::2014-07-10 09:10:32,381::task::1185::TaskManager.Task::(prepare) Task=`235c09c8-484b-482a-a2bb-793b26fe4724`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-51::DEBUG::2014-07-10 09:10:32,382::task::595::TaskManager.Task::(_updateState) Task=`235c09c8-484b-482a-a2bb-793b26fe4724`::moving from state preparing -> state finished >Thread-51::DEBUG::2014-07-10 09:10:32,382::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-51::DEBUG::2014-07-10 09:10:32,382::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-51::DEBUG::2014-07-10 09:10:32,382::task::990::TaskManager.Task::(_decref) Task=`235c09c8-484b-482a-a2bb-793b26fe4724`::ref 0 aborting False >Thread-18::DEBUG::2014-07-10 09:10:33,886::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/metadata bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-10 09:10:33,908::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000705596 s, 5.8 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:10:34,070::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:10:34,202::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.071056 s, 14.4 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:10:36,218::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:10:36,308::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0329146 s, 31.1 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 09:10:36,635::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-14::DEBUG::2014-07-10 09:10:36,636::task::595::TaskManager.Task::(_updateState) Task=`979e083d-6ee1-4a86-8fd8-a60844a782b6`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 09:10:36,636::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-14::INFO::2014-07-10 09:10:36,637::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:10:36,637::task::1185::TaskManager.Task::(prepare) Task=`979e083d-6ee1-4a86-8fd8-a60844a782b6`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:10:36,637::task::595::TaskManager.Task::(_updateState) Task=`979e083d-6ee1-4a86-8fd8-a60844a782b6`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 09:10:36,637::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 09:10:36,637::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 09:10:36,638::task::990::TaskManager.Task::(_decref) Task=`979e083d-6ee1-4a86-8fd8-a60844a782b6`::ref 0 aborting False >Thread-34::DEBUG::2014-07-10 09:10:36,642::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-34::DEBUG::2014-07-10 09:10:36,642::task::595::TaskManager.Task::(_updateState) Task=`7ed9632b-4569-4433-a8f3-728e016ca6e7`::moving from state init -> state preparing >Thread-34::INFO::2014-07-10 09:10:36,643::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-34::DEBUG::2014-07-10 09:10:36,643::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`ad2f28c9-6f7f-41ba-8a7f-246603bc2bd7`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-10 09:10:36,644::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' for lock type 'shared' >Thread-34::DEBUG::2014-07-10 09:10:36,644::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-10 09:10:36,644::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`ad2f28c9-6f7f-41ba-8a7f-246603bc2bd7`::Granted request >Thread-34::DEBUG::2014-07-10 09:10:36,645::task::827::TaskManager.Task::(resourceAcquired) Task=`7ed9632b-4569-4433-a8f3-728e016ca6e7`::_resourcesAcquired: Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee (shared) >Thread-34::DEBUG::2014-07-10 09:10:36,645::task::990::TaskManager.Task::(_decref) Task=`7ed9632b-4569-4433-a8f3-728e016ca6e7`::ref 1 aborting False >Thread-34::INFO::2014-07-10 09:10:36,646::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532067385344', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:10:36,646::task::1185::TaskManager.Task::(prepare) Task=`7ed9632b-4569-4433-a8f3-728e016ca6e7`::finished: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532067385344', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:10:36,646::task::595::TaskManager.Task::(_updateState) Task=`7ed9632b-4569-4433-a8f3-728e016ca6e7`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-10 09:10:36,647::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee': < ResourceRef 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-10 09:10:36,647::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-10 09:10:36,647::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' >Thread-34::DEBUG::2014-07-10 09:10:36,647::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' (0 active users) >Thread-34::DEBUG::2014-07-10 09:10:36,647::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-10 09:10:36,648::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', Clearing records. >Thread-34::DEBUG::2014-07-10 09:10:36,648::task::990::TaskManager.Task::(_decref) Task=`7ed9632b-4569-4433-a8f3-728e016ca6e7`::ref 0 aborting False >Thread-40::DEBUG::2014-07-10 09:10:37,269::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lion.qa.lab.tlv.redhat.com:_export_yuri2_backup2/6a70504d-00df-4869-8695-0f442053f6b6/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-40::DEBUG::2014-07-10 09:10:37,288::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n369 bytes (369 B) copied, 0.000438089 s, 842 kB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:10:38,324::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:10:38,418::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.033016 s, 31.0 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 09:10:39,778::task::595::TaskManager.Task::(_updateState) Task=`4d53f199-2003-4ce3-be57-3fde25a68a22`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 09:10:39,778::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::INFO::2014-07-10 09:10:39,779::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000705596', 'lastCheck': '5.8', 'valid': True}, '6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000438089', 'lastCheck': '2.5', 'valid': True}} >Thread-14::DEBUG::2014-07-10 09:10:39,779::task::1185::TaskManager.Task::(prepare) Task=`4d53f199-2003-4ce3-be57-3fde25a68a22`::finished: {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000705596', 'lastCheck': '5.8', 'valid': True}, '6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000438089', 'lastCheck': '2.5', 'valid': True}} >Thread-14::DEBUG::2014-07-10 09:10:39,779::task::595::TaskManager.Task::(_updateState) Task=`4d53f199-2003-4ce3-be57-3fde25a68a22`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 09:10:39,779::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 09:10:39,779::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 09:10:39,779::task::990::TaskManager.Task::(_decref) Task=`4d53f199-2003-4ce3-be57-3fde25a68a22`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 09:10:40,433::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:10:40,543::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0500523 s, 20.5 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:10:42,558::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:10:42,653::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0380742 s, 26.9 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-10 09:10:43,946::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/metadata bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-10 09:10:43,971::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000697989 s, 5.9 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:10:44,669::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:10:44,762::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0346722 s, 29.5 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 09:10:46,676::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-14::DEBUG::2014-07-10 09:10:46,677::task::595::TaskManager.Task::(_updateState) Task=`6cfcad51-a4d8-4593-b688-85e723167eb6`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 09:10:46,678::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-14::INFO::2014-07-10 09:10:46,678::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:10:46,678::task::1185::TaskManager.Task::(prepare) Task=`6cfcad51-a4d8-4593-b688-85e723167eb6`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:10:46,679::task::595::TaskManager.Task::(_updateState) Task=`6cfcad51-a4d8-4593-b688-85e723167eb6`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 09:10:46,679::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 09:10:46,679::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 09:10:46,679::task::990::TaskManager.Task::(_decref) Task=`6cfcad51-a4d8-4593-b688-85e723167eb6`::ref 0 aborting False >Thread-34::DEBUG::2014-07-10 09:10:46,683::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-34::DEBUG::2014-07-10 09:10:46,683::task::595::TaskManager.Task::(_updateState) Task=`84ce07fd-1b94-4570-b644-785c07d07d86`::moving from state init -> state preparing >Thread-34::INFO::2014-07-10 09:10:46,684::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-34::DEBUG::2014-07-10 09:10:46,684::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`7f304bf6-688e-4bbd-a2fa-0e44fe9aa0d0`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-10 09:10:46,684::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' for lock type 'shared' >Thread-34::DEBUG::2014-07-10 09:10:46,685::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-10 09:10:46,685::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`7f304bf6-688e-4bbd-a2fa-0e44fe9aa0d0`::Granted request >Thread-34::DEBUG::2014-07-10 09:10:46,685::task::827::TaskManager.Task::(resourceAcquired) Task=`84ce07fd-1b94-4570-b644-785c07d07d86`::_resourcesAcquired: Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee (shared) >Thread-34::DEBUG::2014-07-10 09:10:46,686::task::990::TaskManager.Task::(_decref) Task=`84ce07fd-1b94-4570-b644-785c07d07d86`::ref 1 aborting False >Thread-34::INFO::2014-07-10 09:10:46,687::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532067385344', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:10:46,687::task::1185::TaskManager.Task::(prepare) Task=`84ce07fd-1b94-4570-b644-785c07d07d86`::finished: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532067385344', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:10:46,687::task::595::TaskManager.Task::(_updateState) Task=`84ce07fd-1b94-4570-b644-785c07d07d86`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-10 09:10:46,687::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee': < ResourceRef 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-10 09:10:46,687::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-10 09:10:46,688::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' >Thread-34::DEBUG::2014-07-10 09:10:46,688::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' (0 active users) >Thread-34::DEBUG::2014-07-10 09:10:46,688::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-10 09:10:46,688::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', Clearing records. >Thread-34::DEBUG::2014-07-10 09:10:46,689::task::990::TaskManager.Task::(_decref) Task=`84ce07fd-1b94-4570-b644-785c07d07d86`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 09:10:46,777::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:10:46,863::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.027804 s, 36.8 MB/s\n'; <rc> = 0 >Thread-40::DEBUG::2014-07-10 09:10:47,322::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lion.qa.lab.tlv.redhat.com:_export_yuri2_backup2/6a70504d-00df-4869-8695-0f442053f6b6/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-40::DEBUG::2014-07-10 09:10:47,344::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n369 bytes (369 B) copied, 0.000458258 s, 805 kB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:10:48,880::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:10:49,014::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0628496 s, 16.3 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:10:51,030::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:10:51,193::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.1036 s, 9.9 MB/s\n'; <rc> = 0 >Thread-64::DEBUG::2014-07-10 09:10:51,408::task::595::TaskManager.Task::(_updateState) Task=`e543febc-3fc9-4a80-830a-680ca8d5ac9f`::moving from state init -> state preparing >Thread-64::INFO::2014-07-10 09:10:51,409::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='aa20346a-4d3a-4e07-b8e1-52c0ebe4168c', volUUID='58fefce2-9bce-4bff-8949-8c6ce8122b27', options=None) >Thread-64::INFO::2014-07-10 09:10:51,409::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-64::DEBUG::2014-07-10 09:10:51,410::task::1185::TaskManager.Task::(prepare) Task=`e543febc-3fc9-4a80-830a-680ca8d5ac9f`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-64::DEBUG::2014-07-10 09:10:51,410::task::595::TaskManager.Task::(_updateState) Task=`e543febc-3fc9-4a80-830a-680ca8d5ac9f`::moving from state preparing -> state finished >Thread-64::DEBUG::2014-07-10 09:10:51,410::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-64::DEBUG::2014-07-10 09:10:51,410::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-64::DEBUG::2014-07-10 09:10:51,410::task::990::TaskManager.Task::(_decref) Task=`e543febc-3fc9-4a80-830a-680ca8d5ac9f`::ref 0 aborting False >Thread-73::DEBUG::2014-07-10 09:10:52,495::task::595::TaskManager.Task::(_updateState) Task=`935712a5-baec-43f8-ab1f-489d3037f2c1`::moving from state init -> state preparing >Thread-54::DEBUG::2014-07-10 09:10:52,495::task::595::TaskManager.Task::(_updateState) Task=`66d57812-3951-4b25-bda2-d14cb9b33a22`::moving from state init -> state preparing >Thread-73::INFO::2014-07-10 09:10:52,496::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='c01d693b-cba0-4fed-9ad7-0aaa28912a19', volUUID='4bb5d954-2a50-4028-b299-0b43c261270c', options=None) >Thread-54::INFO::2014-07-10 09:10:52,496::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='28408446-e5fd-4565-a976-e760951593fe', volUUID='776303a2-5585-451e-826e-0e338d4a1e98', options=None) >Thread-73::INFO::2014-07-10 09:10:52,497::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-73::DEBUG::2014-07-10 09:10:52,497::task::1185::TaskManager.Task::(prepare) Task=`935712a5-baec-43f8-ab1f-489d3037f2c1`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-54::INFO::2014-07-10 09:10:52,497::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-73::DEBUG::2014-07-10 09:10:52,497::task::595::TaskManager.Task::(_updateState) Task=`935712a5-baec-43f8-ab1f-489d3037f2c1`::moving from state preparing -> state finished >Thread-54::DEBUG::2014-07-10 09:10:52,497::task::1185::TaskManager.Task::(prepare) Task=`66d57812-3951-4b25-bda2-d14cb9b33a22`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-73::DEBUG::2014-07-10 09:10:52,498::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-54::DEBUG::2014-07-10 09:10:52,498::task::595::TaskManager.Task::(_updateState) Task=`66d57812-3951-4b25-bda2-d14cb9b33a22`::moving from state preparing -> state finished >Thread-73::DEBUG::2014-07-10 09:10:52,498::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-54::DEBUG::2014-07-10 09:10:52,498::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-73::DEBUG::2014-07-10 09:10:52,498::task::990::TaskManager.Task::(_decref) Task=`935712a5-baec-43f8-ab1f-489d3037f2c1`::ref 0 aborting False >Thread-54::DEBUG::2014-07-10 09:10:52,499::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-54::DEBUG::2014-07-10 09:10:52,499::task::990::TaskManager.Task::(_decref) Task=`66d57812-3951-4b25-bda2-d14cb9b33a22`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 09:10:53,209::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:10:53,296::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0297591 s, 34.4 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-10 09:10:54,026::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/metadata bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-10 09:10:54,047::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000766581 s, 5.3 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 09:10:54,979::task::595::TaskManager.Task::(_updateState) Task=`bd1042db-bd62-44a5-9871-90141ed18731`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 09:10:54,979::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::INFO::2014-07-10 09:10:54,980::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000766581', 'lastCheck': '0.9', 'valid': True}, '6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000458258', 'lastCheck': '7.6', 'valid': True}} >Thread-14::DEBUG::2014-07-10 09:10:54,980::task::1185::TaskManager.Task::(prepare) Task=`bd1042db-bd62-44a5-9871-90141ed18731`::finished: {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000766581', 'lastCheck': '0.9', 'valid': True}, '6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000458258', 'lastCheck': '7.6', 'valid': True}} >Thread-14::DEBUG::2014-07-10 09:10:54,980::task::595::TaskManager.Task::(_updateState) Task=`bd1042db-bd62-44a5-9871-90141ed18731`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 09:10:54,980::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 09:10:54,980::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 09:10:54,981::task::990::TaskManager.Task::(_decref) Task=`bd1042db-bd62-44a5-9871-90141ed18731`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 09:10:55,312::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:10:55,398::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0267192 s, 38.3 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 09:10:56,718::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-14::DEBUG::2014-07-10 09:10:56,719::task::595::TaskManager.Task::(_updateState) Task=`b9612418-1349-4974-b653-e0e86656941f`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 09:10:56,720::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-14::INFO::2014-07-10 09:10:56,720::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:10:56,721::task::1185::TaskManager.Task::(prepare) Task=`b9612418-1349-4974-b653-e0e86656941f`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:10:56,721::task::595::TaskManager.Task::(_updateState) Task=`b9612418-1349-4974-b653-e0e86656941f`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 09:10:56,721::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 09:10:56,721::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 09:10:56,721::task::990::TaskManager.Task::(_decref) Task=`b9612418-1349-4974-b653-e0e86656941f`::ref 0 aborting False >Thread-34::DEBUG::2014-07-10 09:10:56,765::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-34::DEBUG::2014-07-10 09:10:56,766::task::595::TaskManager.Task::(_updateState) Task=`52eb8e50-dc58-4453-9f39-f4df04c87381`::moving from state init -> state preparing >Thread-34::INFO::2014-07-10 09:10:56,766::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-34::DEBUG::2014-07-10 09:10:56,767::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`d7346022-da29-47b7-8e98-7e1989924867`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-10 09:10:56,767::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' for lock type 'shared' >Thread-34::DEBUG::2014-07-10 09:10:56,767::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-10 09:10:56,767::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`d7346022-da29-47b7-8e98-7e1989924867`::Granted request >Thread-34::DEBUG::2014-07-10 09:10:56,768::task::827::TaskManager.Task::(resourceAcquired) Task=`52eb8e50-dc58-4453-9f39-f4df04c87381`::_resourcesAcquired: Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee (shared) >Thread-34::DEBUG::2014-07-10 09:10:56,768::task::990::TaskManager.Task::(_decref) Task=`52eb8e50-dc58-4453-9f39-f4df04c87381`::ref 1 aborting False >Thread-34::INFO::2014-07-10 09:10:56,769::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532067385344', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:10:56,769::task::1185::TaskManager.Task::(prepare) Task=`52eb8e50-dc58-4453-9f39-f4df04c87381`::finished: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532067385344', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:10:56,770::task::595::TaskManager.Task::(_updateState) Task=`52eb8e50-dc58-4453-9f39-f4df04c87381`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-10 09:10:56,770::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee': < ResourceRef 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-10 09:10:56,770::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-10 09:10:56,770::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' >Thread-34::DEBUG::2014-07-10 09:10:56,771::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' (0 active users) >Thread-34::DEBUG::2014-07-10 09:10:56,771::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-10 09:10:56,771::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', Clearing records. >Thread-34::DEBUG::2014-07-10 09:10:56,771::task::990::TaskManager.Task::(_decref) Task=`52eb8e50-dc58-4453-9f39-f4df04c87381`::ref 0 aborting False >Thread-40::DEBUG::2014-07-10 09:10:57,376::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lion.qa.lab.tlv.redhat.com:_export_yuri2_backup2/6a70504d-00df-4869-8695-0f442053f6b6/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-40::DEBUG::2014-07-10 09:10:57,396::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n369 bytes (369 B) copied, 0.000484767 s, 761 kB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:10:57,414::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:10:57,577::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0379127 s, 27.0 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:10:59,596::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:10:59,692::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0339758 s, 30.1 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:11:01,707::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:11:01,801::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0353072 s, 29.0 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:11:03,817::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:11:03,955::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0349861 s, 29.3 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-10 09:11:04,086::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/metadata bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-10 09:11:04,109::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00080424 s, 5.1 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:11:05,971::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:11:06,067::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0352527 s, 29.0 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 09:11:06,796::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-14::DEBUG::2014-07-10 09:11:06,797::task::595::TaskManager.Task::(_updateState) Task=`9ee45f06-124c-4f9e-89ba-c7b08e4c09b9`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 09:11:06,798::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-14::INFO::2014-07-10 09:11:06,801::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:11:06,801::task::1185::TaskManager.Task::(prepare) Task=`9ee45f06-124c-4f9e-89ba-c7b08e4c09b9`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:11:06,801::task::595::TaskManager.Task::(_updateState) Task=`9ee45f06-124c-4f9e-89ba-c7b08e4c09b9`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 09:11:06,801::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 09:11:06,802::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 09:11:06,802::task::990::TaskManager.Task::(_decref) Task=`9ee45f06-124c-4f9e-89ba-c7b08e4c09b9`::ref 0 aborting False >Thread-34::DEBUG::2014-07-10 09:11:06,806::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-34::DEBUG::2014-07-10 09:11:06,806::task::595::TaskManager.Task::(_updateState) Task=`1b978606-de42-4671-9d8a-63fee55f9acd`::moving from state init -> state preparing >Thread-34::INFO::2014-07-10 09:11:06,806::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-34::DEBUG::2014-07-10 09:11:06,807::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`37f487ae-c945-4e96-ba34-6c95ead9842b`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-10 09:11:06,807::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' for lock type 'shared' >Thread-34::DEBUG::2014-07-10 09:11:06,808::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-10 09:11:06,808::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`37f487ae-c945-4e96-ba34-6c95ead9842b`::Granted request >Thread-34::DEBUG::2014-07-10 09:11:06,808::task::827::TaskManager.Task::(resourceAcquired) Task=`1b978606-de42-4671-9d8a-63fee55f9acd`::_resourcesAcquired: Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee (shared) >Thread-34::DEBUG::2014-07-10 09:11:06,808::task::990::TaskManager.Task::(_decref) Task=`1b978606-de42-4671-9d8a-63fee55f9acd`::ref 1 aborting False >Thread-34::INFO::2014-07-10 09:11:06,809::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532067385344', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:11:06,810::task::1185::TaskManager.Task::(prepare) Task=`1b978606-de42-4671-9d8a-63fee55f9acd`::finished: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532067385344', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:11:06,810::task::595::TaskManager.Task::(_updateState) Task=`1b978606-de42-4671-9d8a-63fee55f9acd`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-10 09:11:06,810::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee': < ResourceRef 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-10 09:11:06,810::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-10 09:11:06,810::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' >Thread-34::DEBUG::2014-07-10 09:11:06,811::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' (0 active users) >Thread-34::DEBUG::2014-07-10 09:11:06,811::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-10 09:11:06,811::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', Clearing records. >Thread-34::DEBUG::2014-07-10 09:11:06,811::task::990::TaskManager.Task::(_decref) Task=`1b978606-de42-4671-9d8a-63fee55f9acd`::ref 0 aborting False >Thread-40::DEBUG::2014-07-10 09:11:07,436::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lion.qa.lab.tlv.redhat.com:_export_yuri2_backup2/6a70504d-00df-4869-8695-0f442053f6b6/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-40::DEBUG::2014-07-10 09:11:07,457::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n369 bytes (369 B) copied, 0.000492783 s, 749 kB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:11:08,083::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:11:08,172::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0322788 s, 31.7 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:11:10,188::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Thread-14::DEBUG::2014-07-10 09:11:10,232::task::595::TaskManager.Task::(_updateState) Task=`9177f19d-111f-4d78-befb-4702c969f875`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 09:11:10,233::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::INFO::2014-07-10 09:11:10,234::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00080424', 'lastCheck': '6.1', 'valid': True}, '6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000492783', 'lastCheck': '2.8', 'valid': True}} >Thread-14::DEBUG::2014-07-10 09:11:10,235::task::1185::TaskManager.Task::(prepare) Task=`9177f19d-111f-4d78-befb-4702c969f875`::finished: {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00080424', 'lastCheck': '6.1', 'valid': True}, '6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000492783', 'lastCheck': '2.8', 'valid': True}} >Thread-14::DEBUG::2014-07-10 09:11:10,235::task::595::TaskManager.Task::(_updateState) Task=`9177f19d-111f-4d78-befb-4702c969f875`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 09:11:10,236::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 09:11:10,237::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 09:11:10,237::task::990::TaskManager.Task::(_decref) Task=`9177f19d-111f-4d78-befb-4702c969f875`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 09:11:10,542::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0515406 s, 19.9 MB/s\n'; <rc> = 0 >Thread-57::DEBUG::2014-07-10 09:11:11,518::task::595::TaskManager.Task::(_updateState) Task=`cae7174b-7f62-444c-bf55-d1eeb99c0b34`::moving from state init -> state preparing >Thread-57::INFO::2014-07-10 09:11:11,518::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='b6f6c0da-e67f-4902-b9ac-3069571a42fe', volUUID='c4cd1da8-05b7-45e0-80b1-1183d21443d9', options=None) >Thread-57::INFO::2014-07-10 09:11:11,519::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-57::DEBUG::2014-07-10 09:11:11,519::task::1185::TaskManager.Task::(prepare) Task=`cae7174b-7f62-444c-bf55-d1eeb99c0b34`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-57::DEBUG::2014-07-10 09:11:11,519::task::595::TaskManager.Task::(_updateState) Task=`cae7174b-7f62-444c-bf55-d1eeb99c0b34`::moving from state preparing -> state finished >Thread-57::DEBUG::2014-07-10 09:11:11,520::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-57::DEBUG::2014-07-10 09:11:11,520::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-57::DEBUG::2014-07-10 09:11:11,520::task::990::TaskManager.Task::(_decref) Task=`cae7174b-7f62-444c-bf55-d1eeb99c0b34`::ref 0 aborting False >Thread-67::DEBUG::2014-07-10 09:11:12,397::task::595::TaskManager.Task::(_updateState) Task=`a414c7e9-3783-468f-8c56-fc53475a69a7`::moving from state init -> state preparing >Thread-67::INFO::2014-07-10 09:11:12,398::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='f30c2cb7-a43a-4bf5-82b5-cfe07336f65c', volUUID='b0fbb3c9-55af-4a3a-95ad-fc56a80b9cf5', options=None) >Thread-67::INFO::2014-07-10 09:11:12,398::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-67::DEBUG::2014-07-10 09:11:12,398::task::1185::TaskManager.Task::(prepare) Task=`a414c7e9-3783-468f-8c56-fc53475a69a7`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-67::DEBUG::2014-07-10 09:11:12,398::task::595::TaskManager.Task::(_updateState) Task=`a414c7e9-3783-468f-8c56-fc53475a69a7`::moving from state preparing -> state finished >Thread-67::DEBUG::2014-07-10 09:11:12,399::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-67::DEBUG::2014-07-10 09:11:12,399::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-67::DEBUG::2014-07-10 09:11:12,399::task::990::TaskManager.Task::(_decref) Task=`a414c7e9-3783-468f-8c56-fc53475a69a7`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 09:11:12,557::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Thread-48::DEBUG::2014-07-10 09:11:12,642::task::595::TaskManager.Task::(_updateState) Task=`a4e71490-b461-4fa8-94b4-f975cce10402`::moving from state init -> state preparing >Thread-48::INFO::2014-07-10 09:11:12,645::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='0cd7d6ce-f497-4243-a690-c57744861eea', volUUID='10b6a7dd-dc6c-43fa-ba17-92e4331b0e0b', options=None) >Thread-48::INFO::2014-07-10 09:11:12,647::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-48::DEBUG::2014-07-10 09:11:12,648::task::1185::TaskManager.Task::(prepare) Task=`a4e71490-b461-4fa8-94b4-f975cce10402`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-48::DEBUG::2014-07-10 09:11:12,653::task::595::TaskManager.Task::(_updateState) Task=`a4e71490-b461-4fa8-94b4-f975cce10402`::moving from state preparing -> state finished >Thread-48::DEBUG::2014-07-10 09:11:12,654::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-48::DEBUG::2014-07-10 09:11:12,655::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-48::DEBUG::2014-07-10 09:11:12,656::task::990::TaskManager.Task::(_decref) Task=`a4e71490-b461-4fa8-94b4-f975cce10402`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 09:11:12,660::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0264743 s, 38.7 MB/s\n'; <rc> = 0 >Thread-76::DEBUG::2014-07-10 09:11:14,086::task::595::TaskManager.Task::(_updateState) Task=`53ff17d4-6beb-4f27-a5cf-65f80ed2ed9c`::moving from state init -> state preparing >Thread-76::INFO::2014-07-10 09:11:14,087::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='e4c65229-4247-4b33-b72a-f1d5ce72ad05', volUUID='cad94284-3ca9-4c30-933d-997f4460309e', options=None) >Thread-76::INFO::2014-07-10 09:11:14,087::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-76::DEBUG::2014-07-10 09:11:14,087::task::1185::TaskManager.Task::(prepare) Task=`53ff17d4-6beb-4f27-a5cf-65f80ed2ed9c`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-76::DEBUG::2014-07-10 09:11:14,088::task::595::TaskManager.Task::(_updateState) Task=`53ff17d4-6beb-4f27-a5cf-65f80ed2ed9c`::moving from state preparing -> state finished >Thread-76::DEBUG::2014-07-10 09:11:14,090::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-76::DEBUG::2014-07-10 09:11:14,093::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-76::DEBUG::2014-07-10 09:11:14,097::task::990::TaskManager.Task::(_decref) Task=`53ff17d4-6beb-4f27-a5cf-65f80ed2ed9c`::ref 0 aborting False >Thread-18::DEBUG::2014-07-10 09:11:14,138::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/metadata bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-10 09:11:14,159::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00064671 s, 6.3 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:11:14,677::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:11:14,774::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0388073 s, 26.4 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:11:16,790::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Thread-14::DEBUG::2014-07-10 09:11:16,842::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-14::DEBUG::2014-07-10 09:11:16,858::task::595::TaskManager.Task::(_updateState) Task=`8d2b2d59-4259-4ab1-b6d1-4445fda8e5ec`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 09:11:16,861::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-14::INFO::2014-07-10 09:11:16,870::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:11:16,884::task::1185::TaskManager.Task::(prepare) Task=`8d2b2d59-4259-4ab1-b6d1-4445fda8e5ec`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:11:16,887::task::595::TaskManager.Task::(_updateState) Task=`8d2b2d59-4259-4ab1-b6d1-4445fda8e5ec`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 09:11:16,891::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 09:11:16,892::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 09:11:16,893::task::990::TaskManager.Task::(_decref) Task=`8d2b2d59-4259-4ab1-b6d1-4445fda8e5ec`::ref 0 aborting False >Thread-34::DEBUG::2014-07-10 09:11:16,900::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-34::DEBUG::2014-07-10 09:11:16,901::task::595::TaskManager.Task::(_updateState) Task=`ecd2c66c-f454-4d67-a303-d4b58650e999`::moving from state init -> state preparing >Thread-34::INFO::2014-07-10 09:11:16,902::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-34::DEBUG::2014-07-10 09:11:16,903::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`ac8a276d-cbf1-481a-b53c-dc9d6bd1f0db`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-10 09:11:16,904::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' for lock type 'shared' >Thread-34::DEBUG::2014-07-10 09:11:16,905::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-10 09:11:16,906::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`ac8a276d-cbf1-481a-b53c-dc9d6bd1f0db`::Granted request >Thread-34::DEBUG::2014-07-10 09:11:16,907::task::827::TaskManager.Task::(resourceAcquired) Task=`ecd2c66c-f454-4d67-a303-d4b58650e999`::_resourcesAcquired: Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee (shared) >Thread-34::DEBUG::2014-07-10 09:11:16,908::task::990::TaskManager.Task::(_decref) Task=`ecd2c66c-f454-4d67-a303-d4b58650e999`::ref 1 aborting False >Thread-34::INFO::2014-07-10 09:11:16,910::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532067385344', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:11:16,911::task::1185::TaskManager.Task::(prepare) Task=`ecd2c66c-f454-4d67-a303-d4b58650e999`::finished: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532067385344', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:11:16,911::task::595::TaskManager.Task::(_updateState) Task=`ecd2c66c-f454-4d67-a303-d4b58650e999`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-10 09:11:16,913::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee': < ResourceRef 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-10 09:11:16,913::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-10 09:11:16,914::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' >Thread-34::DEBUG::2014-07-10 09:11:16,915::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' (0 active users) >Thread-34::DEBUG::2014-07-10 09:11:16,916::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-10 09:11:16,917::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', Clearing records. >Thread-34::DEBUG::2014-07-10 09:11:16,918::task::990::TaskManager.Task::(_decref) Task=`ecd2c66c-f454-4d67-a303-d4b58650e999`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 09:11:16,980::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.133678 s, 7.7 MB/s\n'; <rc> = 0 >Thread-40::DEBUG::2014-07-10 09:11:17,490::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lion.qa.lab.tlv.redhat.com:_export_yuri2_backup2/6a70504d-00df-4869-8695-0f442053f6b6/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-40::DEBUG::2014-07-10 09:11:17,510::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n369 bytes (369 B) copied, 0.000569413 s, 648 kB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:11:18,996::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:11:19,101::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0324139 s, 31.6 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:11:21,126::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:11:21,220::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0356907 s, 28.7 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:11:23,236::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:11:23,316::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0247207 s, 41.4 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-10 09:11:24,204::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/metadata bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-10 09:11:24,234::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000953854 s, 4.3 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:11:25,332::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:11:25,421::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0309178 s, 33.1 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 09:11:25,668::task::595::TaskManager.Task::(_updateState) Task=`856990da-25ac-42b2-9a37-47cb58fe07b1`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 09:11:25,668::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::INFO::2014-07-10 09:11:25,669::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000953854', 'lastCheck': '1.4', 'valid': True}, '6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000569413', 'lastCheck': '8.2', 'valid': True}} >Thread-14::DEBUG::2014-07-10 09:11:25,669::task::1185::TaskManager.Task::(prepare) Task=`856990da-25ac-42b2-9a37-47cb58fe07b1`::finished: {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000953854', 'lastCheck': '1.4', 'valid': True}, '6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000569413', 'lastCheck': '8.2', 'valid': True}} >Thread-14::DEBUG::2014-07-10 09:11:25,669::task::595::TaskManager.Task::(_updateState) Task=`856990da-25ac-42b2-9a37-47cb58fe07b1`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 09:11:25,669::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 09:11:25,669::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 09:11:25,670::task::990::TaskManager.Task::(_decref) Task=`856990da-25ac-42b2-9a37-47cb58fe07b1`::ref 0 aborting False >Thread-14::DEBUG::2014-07-10 09:11:26,962::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-14::DEBUG::2014-07-10 09:11:26,966::task::595::TaskManager.Task::(_updateState) Task=`edeedddd-c770-4e36-8485-15a6abe89526`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 09:11:26,968::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-14::INFO::2014-07-10 09:11:26,972::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:11:26,974::task::1185::TaskManager.Task::(prepare) Task=`edeedddd-c770-4e36-8485-15a6abe89526`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:11:26,975::task::595::TaskManager.Task::(_updateState) Task=`edeedddd-c770-4e36-8485-15a6abe89526`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 09:11:26,977::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 09:11:26,979::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 09:11:26,981::task::990::TaskManager.Task::(_decref) Task=`edeedddd-c770-4e36-8485-15a6abe89526`::ref 0 aborting False >Thread-34::DEBUG::2014-07-10 09:11:27,029::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-34::DEBUG::2014-07-10 09:11:27,030::task::595::TaskManager.Task::(_updateState) Task=`29916cdb-bd81-453c-9913-5cb748751591`::moving from state init -> state preparing >Thread-34::INFO::2014-07-10 09:11:27,030::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-34::DEBUG::2014-07-10 09:11:27,031::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`71fb8b06-ca64-4337-a836-464c0fbcf8ec`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-10 09:11:27,031::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' for lock type 'shared' >Thread-34::DEBUG::2014-07-10 09:11:27,031::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-10 09:11:27,031::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`71fb8b06-ca64-4337-a836-464c0fbcf8ec`::Granted request >Thread-34::DEBUG::2014-07-10 09:11:27,032::task::827::TaskManager.Task::(resourceAcquired) Task=`29916cdb-bd81-453c-9913-5cb748751591`::_resourcesAcquired: Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee (shared) >Thread-34::DEBUG::2014-07-10 09:11:27,032::task::990::TaskManager.Task::(_decref) Task=`29916cdb-bd81-453c-9913-5cb748751591`::ref 1 aborting False >Thread-34::INFO::2014-07-10 09:11:27,033::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532067385344', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:11:27,033::task::1185::TaskManager.Task::(prepare) Task=`29916cdb-bd81-453c-9913-5cb748751591`::finished: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532067385344', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:11:27,034::task::595::TaskManager.Task::(_updateState) Task=`29916cdb-bd81-453c-9913-5cb748751591`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-10 09:11:27,034::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee': < ResourceRef 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-10 09:11:27,034::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-10 09:11:27,034::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' >Thread-34::DEBUG::2014-07-10 09:11:27,035::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' (0 active users) >Thread-34::DEBUG::2014-07-10 09:11:27,035::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-10 09:11:27,035::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', Clearing records. >Thread-34::DEBUG::2014-07-10 09:11:27,035::task::990::TaskManager.Task::(_decref) Task=`29916cdb-bd81-453c-9913-5cb748751591`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 09:11:27,436::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:11:27,691::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0250156 s, 40.9 MB/s\n'; <rc> = 0 >Thread-40::DEBUG::2014-07-10 09:11:27,763::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lion.qa.lab.tlv.redhat.com:_export_yuri2_backup2/6a70504d-00df-4869-8695-0f442053f6b6/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-40::DEBUG::2014-07-10 09:11:27,802::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n369 bytes (369 B) copied, 0.000396776 s, 930 kB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:11:29,824::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:11:29,958::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0448419 s, 22.8 MB/s\n'; <rc> = 0 >Thread-70::DEBUG::2014-07-10 09:11:31,585::task::595::TaskManager.Task::(_updateState) Task=`e6b1f544-5714-47ad-b0af-fd93120202e8`::moving from state init -> state preparing >Thread-70::INFO::2014-07-10 09:11:31,585::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='cfaeead2-7caa-467c-b389-c89840ae6605', volUUID='567fe32d-31a6-4ff6-90f3-fd6a656fbecc', options=None) >Thread-70::INFO::2014-07-10 09:11:31,586::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-70::DEBUG::2014-07-10 09:11:31,586::task::1185::TaskManager.Task::(prepare) Task=`e6b1f544-5714-47ad-b0af-fd93120202e8`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-70::DEBUG::2014-07-10 09:11:31,586::task::595::TaskManager.Task::(_updateState) Task=`e6b1f544-5714-47ad-b0af-fd93120202e8`::moving from state preparing -> state finished >Thread-70::DEBUG::2014-07-10 09:11:31,587::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-70::DEBUG::2014-07-10 09:11:31,587::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-70::DEBUG::2014-07-10 09:11:31,587::task::990::TaskManager.Task::(_decref) Task=`e6b1f544-5714-47ad-b0af-fd93120202e8`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 09:11:31,973::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:11:32,061::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.029517 s, 34.7 MB/s\n'; <rc> = 0 >Thread-60::DEBUG::2014-07-10 09:11:32,462::task::595::TaskManager.Task::(_updateState) Task=`f7307750-63ce-4c3a-bb84-93c9a3615694`::moving from state init -> state preparing >Thread-60::INFO::2014-07-10 09:11:32,463::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='b034d5b0-e1e0-4011-b49b-4d45ddb11556', volUUID='3d7f62b5-328f-4d8e-8b69-873cfb5ae14d', options=None) >Thread-60::INFO::2014-07-10 09:11:32,464::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-60::DEBUG::2014-07-10 09:11:32,464::task::1185::TaskManager.Task::(prepare) Task=`f7307750-63ce-4c3a-bb84-93c9a3615694`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-60::DEBUG::2014-07-10 09:11:32,464::task::595::TaskManager.Task::(_updateState) Task=`f7307750-63ce-4c3a-bb84-93c9a3615694`::moving from state preparing -> state finished >Thread-60::DEBUG::2014-07-10 09:11:32,464::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-60::DEBUG::2014-07-10 09:11:32,465::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-60::DEBUG::2014-07-10 09:11:32,465::task::990::TaskManager.Task::(_decref) Task=`f7307750-63ce-4c3a-bb84-93c9a3615694`::ref 0 aborting False >Thread-51::DEBUG::2014-07-10 09:11:32,649::task::595::TaskManager.Task::(_updateState) Task=`c9b514b9-abe8-46d0-9d16-617ba0312156`::moving from state init -> state preparing >Thread-51::INFO::2014-07-10 09:11:32,649::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='76fdb054-02cd-42ed-9721-b3e65b34c3a4', volUUID='022dfe46-2cf7-4915-80b3-883158e3ca83', options=None) >Thread-51::INFO::2014-07-10 09:11:32,650::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-51::DEBUG::2014-07-10 09:11:32,650::task::1185::TaskManager.Task::(prepare) Task=`c9b514b9-abe8-46d0-9d16-617ba0312156`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-51::DEBUG::2014-07-10 09:11:32,650::task::595::TaskManager.Task::(_updateState) Task=`c9b514b9-abe8-46d0-9d16-617ba0312156`::moving from state preparing -> state finished >Thread-51::DEBUG::2014-07-10 09:11:32,650::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-51::DEBUG::2014-07-10 09:11:32,650::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-51::DEBUG::2014-07-10 09:11:32,650::task::990::TaskManager.Task::(_decref) Task=`c9b514b9-abe8-46d0-9d16-617ba0312156`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 09:11:34,076::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:11:34,182::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0304594 s, 33.6 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-10 09:11:34,265::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/metadata bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-10 09:11:34,286::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000549209 s, 7.5 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:11:36,198::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:11:36,298::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0384929 s, 26.6 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 09:11:37,069::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-14::DEBUG::2014-07-10 09:11:37,076::task::595::TaskManager.Task::(_updateState) Task=`840bf3f3-b030-406c-a614-a2cb33173f67`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 09:11:37,080::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-14::INFO::2014-07-10 09:11:37,081::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:11:37,085::task::1185::TaskManager.Task::(prepare) Task=`840bf3f3-b030-406c-a614-a2cb33173f67`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:11:37,088::task::595::TaskManager.Task::(_updateState) Task=`840bf3f3-b030-406c-a614-a2cb33173f67`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 09:11:37,094::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 09:11:37,095::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 09:11:37,101::task::990::TaskManager.Task::(_decref) Task=`840bf3f3-b030-406c-a614-a2cb33173f67`::ref 0 aborting False >Thread-34::DEBUG::2014-07-10 09:11:37,109::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-34::DEBUG::2014-07-10 09:11:37,109::task::595::TaskManager.Task::(_updateState) Task=`52153152-0c76-4bc2-a990-49201142d2ff`::moving from state init -> state preparing >Thread-34::INFO::2014-07-10 09:11:37,110::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-34::DEBUG::2014-07-10 09:11:37,110::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`89ad2d7c-aca4-4fbb-94ca-e28b427943ae`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-10 09:11:37,110::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' for lock type 'shared' >Thread-34::DEBUG::2014-07-10 09:11:37,111::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-10 09:11:37,111::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`89ad2d7c-aca4-4fbb-94ca-e28b427943ae`::Granted request >Thread-34::DEBUG::2014-07-10 09:11:37,111::task::827::TaskManager.Task::(resourceAcquired) Task=`52153152-0c76-4bc2-a990-49201142d2ff`::_resourcesAcquired: Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee (shared) >Thread-34::DEBUG::2014-07-10 09:11:37,112::task::990::TaskManager.Task::(_decref) Task=`52153152-0c76-4bc2-a990-49201142d2ff`::ref 1 aborting False >Thread-34::INFO::2014-07-10 09:11:37,113::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532067385344', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:11:37,113::task::1185::TaskManager.Task::(prepare) Task=`52153152-0c76-4bc2-a990-49201142d2ff`::finished: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532067385344', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:11:37,113::task::595::TaskManager.Task::(_updateState) Task=`52153152-0c76-4bc2-a990-49201142d2ff`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-10 09:11:37,113::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee': < ResourceRef 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-10 09:11:37,113::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-10 09:11:37,114::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' >Thread-34::DEBUG::2014-07-10 09:11:37,114::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' (0 active users) >Thread-34::DEBUG::2014-07-10 09:11:37,114::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-10 09:11:37,114::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', Clearing records. >Thread-34::DEBUG::2014-07-10 09:11:37,115::task::990::TaskManager.Task::(_decref) Task=`52153152-0c76-4bc2-a990-49201142d2ff`::ref 0 aborting False >Thread-40::DEBUG::2014-07-10 09:11:37,842::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lion.qa.lab.tlv.redhat.com:_export_yuri2_backup2/6a70504d-00df-4869-8695-0f442053f6b6/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-40::DEBUG::2014-07-10 09:11:37,873::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n369 bytes (369 B) copied, 0.000444599 s, 830 kB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:11:38,309::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:11:38,402::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0350391 s, 29.2 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:11:40,418::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:11:40,512::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0355393 s, 28.8 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 09:11:40,881::task::595::TaskManager.Task::(_updateState) Task=`3abb8700-5f2f-48c7-ba33-74f53c014ebe`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 09:11:40,882::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::INFO::2014-07-10 09:11:40,882::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000549209', 'lastCheck': '6.6', 'valid': True}, '6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000444599', 'lastCheck': '3.0', 'valid': True}} >Thread-14::DEBUG::2014-07-10 09:11:40,882::task::1185::TaskManager.Task::(prepare) Task=`3abb8700-5f2f-48c7-ba33-74f53c014ebe`::finished: {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000549209', 'lastCheck': '6.6', 'valid': True}, '6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000444599', 'lastCheck': '3.0', 'valid': True}} >Thread-14::DEBUG::2014-07-10 09:11:40,882::task::595::TaskManager.Task::(_updateState) Task=`3abb8700-5f2f-48c7-ba33-74f53c014ebe`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 09:11:40,883::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 09:11:40,883::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 09:11:40,883::task::990::TaskManager.Task::(_decref) Task=`3abb8700-5f2f-48c7-ba33-74f53c014ebe`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 09:11:42,526::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:11:42,617::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0318468 s, 32.2 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-10 09:11:44,315::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/metadata bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-10 09:11:44,336::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000689605 s, 5.9 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:11:44,633::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:11:44,724::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0344172 s, 29.8 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:11:46,740::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:11:46,839::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0401981 s, 25.5 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 09:11:47,140::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-14::DEBUG::2014-07-10 09:11:47,145::task::595::TaskManager.Task::(_updateState) Task=`a119f9bd-b21b-4d5f-a28b-a05fbe397778`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 09:11:47,148::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-14::INFO::2014-07-10 09:11:47,151::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:11:47,153::task::1185::TaskManager.Task::(prepare) Task=`a119f9bd-b21b-4d5f-a28b-a05fbe397778`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:11:47,154::task::595::TaskManager.Task::(_updateState) Task=`a119f9bd-b21b-4d5f-a28b-a05fbe397778`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 09:11:47,157::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 09:11:47,158::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 09:11:47,160::task::990::TaskManager.Task::(_decref) Task=`a119f9bd-b21b-4d5f-a28b-a05fbe397778`::ref 0 aborting False >Thread-34::DEBUG::2014-07-10 09:11:47,172::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-34::DEBUG::2014-07-10 09:11:47,175::task::595::TaskManager.Task::(_updateState) Task=`287bae43-8b9c-4911-b394-5e26d71dc5c8`::moving from state init -> state preparing >Thread-34::INFO::2014-07-10 09:11:47,177::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-34::DEBUG::2014-07-10 09:11:47,182::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`64d50fff-2549-448a-9176-f580395f36f4`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-10 09:11:47,184::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' for lock type 'shared' >Thread-34::DEBUG::2014-07-10 09:11:47,187::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-10 09:11:47,188::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`64d50fff-2549-448a-9176-f580395f36f4`::Granted request >Thread-34::DEBUG::2014-07-10 09:11:47,192::task::827::TaskManager.Task::(resourceAcquired) Task=`287bae43-8b9c-4911-b394-5e26d71dc5c8`::_resourcesAcquired: Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee (shared) >Thread-34::DEBUG::2014-07-10 09:11:47,194::task::990::TaskManager.Task::(_decref) Task=`287bae43-8b9c-4911-b394-5e26d71dc5c8`::ref 1 aborting False >Thread-34::INFO::2014-07-10 09:11:47,203::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532067385344', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:11:47,205::task::1185::TaskManager.Task::(prepare) Task=`287bae43-8b9c-4911-b394-5e26d71dc5c8`::finished: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532067385344', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:11:47,207::task::595::TaskManager.Task::(_updateState) Task=`287bae43-8b9c-4911-b394-5e26d71dc5c8`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-10 09:11:47,208::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee': < ResourceRef 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-10 09:11:47,210::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-10 09:11:47,213::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' >Thread-34::DEBUG::2014-07-10 09:11:47,215::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' (0 active users) >Thread-34::DEBUG::2014-07-10 09:11:47,216::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-10 09:11:47,218::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', Clearing records. >Thread-34::DEBUG::2014-07-10 09:11:47,220::task::990::TaskManager.Task::(_decref) Task=`287bae43-8b9c-4911-b394-5e26d71dc5c8`::ref 0 aborting False >Thread-40::DEBUG::2014-07-10 09:11:47,907::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lion.qa.lab.tlv.redhat.com:_export_yuri2_backup2/6a70504d-00df-4869-8695-0f442053f6b6/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-40::DEBUG::2014-07-10 09:11:47,928::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n369 bytes (369 B) copied, 0.000369187 s, 999 kB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:11:48,868::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:11:48,960::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0292434 s, 35.0 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:11:50,984::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:11:51,076::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.032386 s, 31.6 MB/s\n'; <rc> = 0 >Thread-64::DEBUG::2014-07-10 09:11:51,683::task::595::TaskManager.Task::(_updateState) Task=`bf3ae5cb-acb8-4087-984d-edeeffde4904`::moving from state init -> state preparing >Thread-64::INFO::2014-07-10 09:11:51,684::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='aa20346a-4d3a-4e07-b8e1-52c0ebe4168c', volUUID='58fefce2-9bce-4bff-8949-8c6ce8122b27', options=None) >Thread-64::INFO::2014-07-10 09:11:51,684::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-64::DEBUG::2014-07-10 09:11:51,684::task::1185::TaskManager.Task::(prepare) Task=`bf3ae5cb-acb8-4087-984d-edeeffde4904`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-64::DEBUG::2014-07-10 09:11:51,685::task::595::TaskManager.Task::(_updateState) Task=`bf3ae5cb-acb8-4087-984d-edeeffde4904`::moving from state preparing -> state finished >Thread-64::DEBUG::2014-07-10 09:11:51,685::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-64::DEBUG::2014-07-10 09:11:51,685::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-64::DEBUG::2014-07-10 09:11:51,685::task::990::TaskManager.Task::(_decref) Task=`bf3ae5cb-acb8-4087-984d-edeeffde4904`::ref 0 aborting False >Thread-54::DEBUG::2014-07-10 09:11:52,798::task::595::TaskManager.Task::(_updateState) Task=`09e39e64-81dc-4960-9e43-d83f57e23269`::moving from state init -> state preparing >Thread-73::DEBUG::2014-07-10 09:11:52,800::task::595::TaskManager.Task::(_updateState) Task=`97630db7-682d-42b1-ac59-c2beebec3e7d`::moving from state init -> state preparing >Thread-54::INFO::2014-07-10 09:11:52,800::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='28408446-e5fd-4565-a976-e760951593fe', volUUID='776303a2-5585-451e-826e-0e338d4a1e98', options=None) >Thread-73::INFO::2014-07-10 09:11:52,801::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='c01d693b-cba0-4fed-9ad7-0aaa28912a19', volUUID='4bb5d954-2a50-4028-b299-0b43c261270c', options=None) >Thread-73::INFO::2014-07-10 09:11:52,802::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-73::DEBUG::2014-07-10 09:11:52,803::task::1185::TaskManager.Task::(prepare) Task=`97630db7-682d-42b1-ac59-c2beebec3e7d`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-54::INFO::2014-07-10 09:11:52,803::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-73::DEBUG::2014-07-10 09:11:52,804::task::595::TaskManager.Task::(_updateState) Task=`97630db7-682d-42b1-ac59-c2beebec3e7d`::moving from state preparing -> state finished >Thread-54::DEBUG::2014-07-10 09:11:52,804::task::1185::TaskManager.Task::(prepare) Task=`09e39e64-81dc-4960-9e43-d83f57e23269`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-73::DEBUG::2014-07-10 09:11:52,805::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-54::DEBUG::2014-07-10 09:11:52,805::task::595::TaskManager.Task::(_updateState) Task=`09e39e64-81dc-4960-9e43-d83f57e23269`::moving from state preparing -> state finished >Thread-73::DEBUG::2014-07-10 09:11:52,805::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-54::DEBUG::2014-07-10 09:11:52,806::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-73::DEBUG::2014-07-10 09:11:52,806::task::990::TaskManager.Task::(_decref) Task=`97630db7-682d-42b1-ac59-c2beebec3e7d`::ref 0 aborting False >Thread-54::DEBUG::2014-07-10 09:11:52,807::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-54::DEBUG::2014-07-10 09:11:52,807::task::990::TaskManager.Task::(_decref) Task=`09e39e64-81dc-4960-9e43-d83f57e23269`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 09:11:53,090::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:11:53,177::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0298247 s, 34.3 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-10 09:11:54,365::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/metadata bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-10 09:11:54,386::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000669727 s, 6.1 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:11:55,192::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:11:55,282::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.032686 s, 31.3 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 09:11:56,068::task::595::TaskManager.Task::(_updateState) Task=`8cd68730-38dc-44db-a62e-6b6aca57fe91`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 09:11:56,069::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::INFO::2014-07-10 09:11:56,069::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000669727', 'lastCheck': '1.7', 'valid': True}, '6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000369187', 'lastCheck': '8.1', 'valid': True}} >Thread-14::DEBUG::2014-07-10 09:11:56,069::task::1185::TaskManager.Task::(prepare) Task=`8cd68730-38dc-44db-a62e-6b6aca57fe91`::finished: {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000669727', 'lastCheck': '1.7', 'valid': True}, '6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000369187', 'lastCheck': '8.1', 'valid': True}} >Thread-14::DEBUG::2014-07-10 09:11:56,070::task::595::TaskManager.Task::(_updateState) Task=`8cd68730-38dc-44db-a62e-6b6aca57fe91`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 09:11:56,070::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 09:11:56,070::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 09:11:56,070::task::990::TaskManager.Task::(_decref) Task=`8cd68730-38dc-44db-a62e-6b6aca57fe91`::ref 0 aborting False >Thread-14::DEBUG::2014-07-10 09:11:57,249::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-14::DEBUG::2014-07-10 09:11:57,250::task::595::TaskManager.Task::(_updateState) Task=`089e172a-9412-4ad9-9f85-05059e9119d3`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 09:11:57,250::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-14::INFO::2014-07-10 09:11:57,250::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:11:57,251::task::1185::TaskManager.Task::(prepare) Task=`089e172a-9412-4ad9-9f85-05059e9119d3`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:11:57,251::task::595::TaskManager.Task::(_updateState) Task=`089e172a-9412-4ad9-9f85-05059e9119d3`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 09:11:57,251::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 09:11:57,251::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 09:11:57,251::task::990::TaskManager.Task::(_decref) Task=`089e172a-9412-4ad9-9f85-05059e9119d3`::ref 0 aborting False >Thread-34::DEBUG::2014-07-10 09:11:57,295::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-34::DEBUG::2014-07-10 09:11:57,296::task::595::TaskManager.Task::(_updateState) Task=`77f29870-cdbd-4072-8676-4e5265966e9f`::moving from state init -> state preparing >Thread-34::INFO::2014-07-10 09:11:57,296::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-34::DEBUG::2014-07-10 09:11:57,304::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`e8f7140c-c5f4-4a93-83fd-c259b5f95fa6`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Dummy-33::DEBUG::2014-07-10 09:11:57,305::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Thread-34::DEBUG::2014-07-10 09:11:57,308::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' for lock type 'shared' >Thread-34::DEBUG::2014-07-10 09:11:57,329::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-10 09:11:57,330::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`e8f7140c-c5f4-4a93-83fd-c259b5f95fa6`::Granted request >Thread-34::DEBUG::2014-07-10 09:11:57,333::task::827::TaskManager.Task::(resourceAcquired) Task=`77f29870-cdbd-4072-8676-4e5265966e9f`::_resourcesAcquired: Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee (shared) >Thread-34::DEBUG::2014-07-10 09:11:57,339::task::990::TaskManager.Task::(_decref) Task=`77f29870-cdbd-4072-8676-4e5265966e9f`::ref 1 aborting False >Thread-34::INFO::2014-07-10 09:11:57,354::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532067385344', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:11:57,360::task::1185::TaskManager.Task::(prepare) Task=`77f29870-cdbd-4072-8676-4e5265966e9f`::finished: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532067385344', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:11:57,365::task::595::TaskManager.Task::(_updateState) Task=`77f29870-cdbd-4072-8676-4e5265966e9f`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-10 09:11:57,366::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee': < ResourceRef 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-10 09:11:57,367::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-10 09:11:57,375::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' >Thread-34::DEBUG::2014-07-10 09:11:57,384::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' (0 active users) >Thread-34::DEBUG::2014-07-10 09:11:57,385::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-10 09:11:57,389::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', Clearing records. >Thread-34::DEBUG::2014-07-10 09:11:57,391::task::990::TaskManager.Task::(_decref) Task=`77f29870-cdbd-4072-8676-4e5265966e9f`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 09:11:57,506::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.140998 s, 7.3 MB/s\n'; <rc> = 0 >Thread-40::DEBUG::2014-07-10 09:11:57,969::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lion.qa.lab.tlv.redhat.com:_export_yuri2_backup2/6a70504d-00df-4869-8695-0f442053f6b6/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-40::DEBUG::2014-07-10 09:11:57,989::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n369 bytes (369 B) copied, 0.000497356 s, 742 kB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:11:59,521::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:11:59,645::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0648408 s, 15.8 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:12:01,661::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:12:01,778::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0511182 s, 20.0 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:12:03,795::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:12:03,882::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0293375 s, 34.9 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-10 09:12:04,417::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/metadata bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-10 09:12:04,443::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000810851 s, 5.1 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:12:05,897::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:12:05,993::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0367158 s, 27.9 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 09:12:07,425::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-14::DEBUG::2014-07-10 09:12:07,426::task::595::TaskManager.Task::(_updateState) Task=`d0eb5cd4-586c-4f1e-b7b5-f4146db1e337`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 09:12:07,426::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-14::INFO::2014-07-10 09:12:07,427::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:12:07,427::task::1185::TaskManager.Task::(prepare) Task=`d0eb5cd4-586c-4f1e-b7b5-f4146db1e337`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:12:07,427::task::595::TaskManager.Task::(_updateState) Task=`d0eb5cd4-586c-4f1e-b7b5-f4146db1e337`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 09:12:07,427::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 09:12:07,427::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 09:12:07,427::task::990::TaskManager.Task::(_decref) Task=`d0eb5cd4-586c-4f1e-b7b5-f4146db1e337`::ref 0 aborting False >Thread-34::DEBUG::2014-07-10 09:12:07,432::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-34::DEBUG::2014-07-10 09:12:07,432::task::595::TaskManager.Task::(_updateState) Task=`bfb80a90-a6cb-4d16-b642-9a48e2a8fbc7`::moving from state init -> state preparing >Thread-34::INFO::2014-07-10 09:12:07,432::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-34::DEBUG::2014-07-10 09:12:07,433::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`473e2b90-5ef9-46f0-b0da-41dbb798098b`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-10 09:12:07,433::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' for lock type 'shared' >Thread-34::DEBUG::2014-07-10 09:12:07,434::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-10 09:12:07,434::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`473e2b90-5ef9-46f0-b0da-41dbb798098b`::Granted request >Thread-34::DEBUG::2014-07-10 09:12:07,434::task::827::TaskManager.Task::(resourceAcquired) Task=`bfb80a90-a6cb-4d16-b642-9a48e2a8fbc7`::_resourcesAcquired: Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee (shared) >Thread-34::DEBUG::2014-07-10 09:12:07,434::task::990::TaskManager.Task::(_decref) Task=`bfb80a90-a6cb-4d16-b642-9a48e2a8fbc7`::ref 1 aborting False >Thread-34::INFO::2014-07-10 09:12:07,435::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532067385344', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:12:07,436::task::1185::TaskManager.Task::(prepare) Task=`bfb80a90-a6cb-4d16-b642-9a48e2a8fbc7`::finished: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532067385344', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:12:07,436::task::595::TaskManager.Task::(_updateState) Task=`bfb80a90-a6cb-4d16-b642-9a48e2a8fbc7`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-10 09:12:07,436::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee': < ResourceRef 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-10 09:12:07,436::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-10 09:12:07,436::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' >Thread-34::DEBUG::2014-07-10 09:12:07,437::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' (0 active users) >Thread-34::DEBUG::2014-07-10 09:12:07,437::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-10 09:12:07,437::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', Clearing records. >Thread-34::DEBUG::2014-07-10 09:12:07,437::task::990::TaskManager.Task::(_decref) Task=`bfb80a90-a6cb-4d16-b642-9a48e2a8fbc7`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 09:12:08,010::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Thread-40::DEBUG::2014-07-10 09:12:08,037::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lion.qa.lab.tlv.redhat.com:_export_yuri2_backup2/6a70504d-00df-4869-8695-0f442053f6b6/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-40::DEBUG::2014-07-10 09:12:08,083::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n369 bytes (369 B) copied, 0.000443999 s, 831 kB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:12:08,165::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0962207 s, 10.6 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:12:10,180::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:12:10,268::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0295828 s, 34.6 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 09:12:11,272::task::595::TaskManager.Task::(_updateState) Task=`13a1116c-4b56-4189-a2ca-b25fcf21116f`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 09:12:11,273::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::INFO::2014-07-10 09:12:11,273::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000810851', 'lastCheck': '6.8', 'valid': True}, '6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000443999', 'lastCheck': '3.2', 'valid': True}} >Thread-14::DEBUG::2014-07-10 09:12:11,273::task::1185::TaskManager.Task::(prepare) Task=`13a1116c-4b56-4189-a2ca-b25fcf21116f`::finished: {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000810851', 'lastCheck': '6.8', 'valid': True}, '6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000443999', 'lastCheck': '3.2', 'valid': True}} >Thread-14::DEBUG::2014-07-10 09:12:11,274::task::595::TaskManager.Task::(_updateState) Task=`13a1116c-4b56-4189-a2ca-b25fcf21116f`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 09:12:11,274::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 09:12:11,274::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 09:12:11,274::task::990::TaskManager.Task::(_decref) Task=`13a1116c-4b56-4189-a2ca-b25fcf21116f`::ref 0 aborting False >Thread-57::DEBUG::2014-07-10 09:12:11,797::task::595::TaskManager.Task::(_updateState) Task=`3d30961c-6ee3-4bee-a0e6-b2cfe02db08b`::moving from state init -> state preparing >Thread-57::INFO::2014-07-10 09:12:11,798::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='b6f6c0da-e67f-4902-b9ac-3069571a42fe', volUUID='c4cd1da8-05b7-45e0-80b1-1183d21443d9', options=None) >Thread-57::INFO::2014-07-10 09:12:11,798::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-57::DEBUG::2014-07-10 09:12:11,798::task::1185::TaskManager.Task::(prepare) Task=`3d30961c-6ee3-4bee-a0e6-b2cfe02db08b`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-57::DEBUG::2014-07-10 09:12:11,799::task::595::TaskManager.Task::(_updateState) Task=`3d30961c-6ee3-4bee-a0e6-b2cfe02db08b`::moving from state preparing -> state finished >Thread-57::DEBUG::2014-07-10 09:12:11,799::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-57::DEBUG::2014-07-10 09:12:11,799::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-57::DEBUG::2014-07-10 09:12:11,799::task::990::TaskManager.Task::(_decref) Task=`3d30961c-6ee3-4bee-a0e6-b2cfe02db08b`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 09:12:12,283::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:12:12,368::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0356406 s, 28.7 MB/s\n'; <rc> = 0 >Thread-67::DEBUG::2014-07-10 09:12:12,686::task::595::TaskManager.Task::(_updateState) Task=`45bea1d6-9837-40c5-be20-65697c4d6793`::moving from state init -> state preparing >Thread-67::INFO::2014-07-10 09:12:12,687::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='f30c2cb7-a43a-4bf5-82b5-cfe07336f65c', volUUID='b0fbb3c9-55af-4a3a-95ad-fc56a80b9cf5', options=None) >Thread-67::INFO::2014-07-10 09:12:12,687::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-67::DEBUG::2014-07-10 09:12:12,688::task::1185::TaskManager.Task::(prepare) Task=`45bea1d6-9837-40c5-be20-65697c4d6793`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-67::DEBUG::2014-07-10 09:12:12,688::task::595::TaskManager.Task::(_updateState) Task=`45bea1d6-9837-40c5-be20-65697c4d6793`::moving from state preparing -> state finished >Thread-67::DEBUG::2014-07-10 09:12:12,688::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-67::DEBUG::2014-07-10 09:12:12,688::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-67::DEBUG::2014-07-10 09:12:12,688::task::990::TaskManager.Task::(_decref) Task=`45bea1d6-9837-40c5-be20-65697c4d6793`::ref 0 aborting False >Thread-48::DEBUG::2014-07-10 09:12:12,945::task::595::TaskManager.Task::(_updateState) Task=`a8eba0d9-d165-4f86-a9d4-d34b62938a2a`::moving from state init -> state preparing >Thread-48::INFO::2014-07-10 09:12:12,946::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='0cd7d6ce-f497-4243-a690-c57744861eea', volUUID='10b6a7dd-dc6c-43fa-ba17-92e4331b0e0b', options=None) >Thread-48::INFO::2014-07-10 09:12:12,946::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-48::DEBUG::2014-07-10 09:12:12,946::task::1185::TaskManager.Task::(prepare) Task=`a8eba0d9-d165-4f86-a9d4-d34b62938a2a`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-48::DEBUG::2014-07-10 09:12:12,946::task::595::TaskManager.Task::(_updateState) Task=`a8eba0d9-d165-4f86-a9d4-d34b62938a2a`::moving from state preparing -> state finished >Thread-48::DEBUG::2014-07-10 09:12:12,947::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-48::DEBUG::2014-07-10 09:12:12,947::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-48::DEBUG::2014-07-10 09:12:12,947::task::990::TaskManager.Task::(_decref) Task=`a8eba0d9-d165-4f86-a9d4-d34b62938a2a`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 09:12:14,379::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Thread-76::DEBUG::2014-07-10 09:12:14,397::task::595::TaskManager.Task::(_updateState) Task=`c3cc8eba-c59c-4208-a519-de5a09ab60c7`::moving from state init -> state preparing >Thread-76::INFO::2014-07-10 09:12:14,398::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='e4c65229-4247-4b33-b72a-f1d5ce72ad05', volUUID='cad94284-3ca9-4c30-933d-997f4460309e', options=None) >Thread-76::INFO::2014-07-10 09:12:14,399::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-76::DEBUG::2014-07-10 09:12:14,400::task::1185::TaskManager.Task::(prepare) Task=`c3cc8eba-c59c-4208-a519-de5a09ab60c7`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-76::DEBUG::2014-07-10 09:12:14,400::task::595::TaskManager.Task::(_updateState) Task=`c3cc8eba-c59c-4208-a519-de5a09ab60c7`::moving from state preparing -> state finished >Thread-76::DEBUG::2014-07-10 09:12:14,401::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-76::DEBUG::2014-07-10 09:12:14,401::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-76::DEBUG::2014-07-10 09:12:14,401::task::990::TaskManager.Task::(_decref) Task=`c3cc8eba-c59c-4208-a519-de5a09ab60c7`::ref 0 aborting False >Thread-18::DEBUG::2014-07-10 09:12:14,475::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/metadata bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-10 09:12:14,660::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000700493 s, 5.8 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:12:15,041::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0765513 s, 13.4 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:12:17,056::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:12:17,150::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.035333 s, 29.0 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 09:12:17,465::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-14::DEBUG::2014-07-10 09:12:17,466::task::595::TaskManager.Task::(_updateState) Task=`cc1fc069-d6a4-4d1c-8419-403ad84cdf9e`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 09:12:17,466::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-14::INFO::2014-07-10 09:12:17,467::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:12:17,467::task::1185::TaskManager.Task::(prepare) Task=`cc1fc069-d6a4-4d1c-8419-403ad84cdf9e`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:12:17,467::task::595::TaskManager.Task::(_updateState) Task=`cc1fc069-d6a4-4d1c-8419-403ad84cdf9e`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 09:12:17,468::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 09:12:17,468::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 09:12:17,468::task::990::TaskManager.Task::(_decref) Task=`cc1fc069-d6a4-4d1c-8419-403ad84cdf9e`::ref 0 aborting False >Thread-34::DEBUG::2014-07-10 09:12:17,511::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-34::DEBUG::2014-07-10 09:12:17,511::task::595::TaskManager.Task::(_updateState) Task=`6d7f7549-e4d2-4083-9fc1-398efb6385dc`::moving from state init -> state preparing >Thread-34::INFO::2014-07-10 09:12:17,512::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-34::DEBUG::2014-07-10 09:12:17,512::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`d1b4d16c-cb13-4231-9d09-c0fa9d8b3fae`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-10 09:12:17,513::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' for lock type 'shared' >Thread-34::DEBUG::2014-07-10 09:12:17,513::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-10 09:12:17,513::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`d1b4d16c-cb13-4231-9d09-c0fa9d8b3fae`::Granted request >Thread-34::DEBUG::2014-07-10 09:12:17,514::task::827::TaskManager.Task::(resourceAcquired) Task=`6d7f7549-e4d2-4083-9fc1-398efb6385dc`::_resourcesAcquired: Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee (shared) >Thread-34::DEBUG::2014-07-10 09:12:17,514::task::990::TaskManager.Task::(_decref) Task=`6d7f7549-e4d2-4083-9fc1-398efb6385dc`::ref 1 aborting False >Thread-34::INFO::2014-07-10 09:12:17,515::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532067385344', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:12:17,515::task::1185::TaskManager.Task::(prepare) Task=`6d7f7549-e4d2-4083-9fc1-398efb6385dc`::finished: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532067385344', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:12:17,516::task::595::TaskManager.Task::(_updateState) Task=`6d7f7549-e4d2-4083-9fc1-398efb6385dc`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-10 09:12:17,516::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee': < ResourceRef 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-10 09:12:17,516::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-10 09:12:17,517::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' >Thread-34::DEBUG::2014-07-10 09:12:17,517::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' (0 active users) >Thread-34::DEBUG::2014-07-10 09:12:17,517::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-10 09:12:17,517::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', Clearing records. >Thread-34::DEBUG::2014-07-10 09:12:17,518::task::990::TaskManager.Task::(_decref) Task=`6d7f7549-e4d2-4083-9fc1-398efb6385dc`::ref 0 aborting False >Thread-40::DEBUG::2014-07-10 09:12:18,140::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lion.qa.lab.tlv.redhat.com:_export_yuri2_backup2/6a70504d-00df-4869-8695-0f442053f6b6/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-40::DEBUG::2014-07-10 09:12:18,160::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n369 bytes (369 B) copied, 0.000493528 s, 748 kB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:12:19,166::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:12:19,249::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0272435 s, 37.6 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:12:21,264::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:12:21,353::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0344639 s, 29.7 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:12:23,364::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:12:23,468::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0357024 s, 28.7 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-10 09:12:25,017::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/metadata bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-10 09:12:25,042::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000737191 s, 5.6 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:12:25,489::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:12:25,585::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0359792 s, 28.5 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 09:12:26,485::task::595::TaskManager.Task::(_updateState) Task=`427ad229-7316-424b-8fa1-0974851906d5`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 09:12:26,485::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::INFO::2014-07-10 09:12:26,486::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000737191', 'lastCheck': '1.4', 'valid': True}, '6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000493528', 'lastCheck': '8.3', 'valid': True}} >Thread-14::DEBUG::2014-07-10 09:12:26,486::task::1185::TaskManager.Task::(prepare) Task=`427ad229-7316-424b-8fa1-0974851906d5`::finished: {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000737191', 'lastCheck': '1.4', 'valid': True}, '6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000493528', 'lastCheck': '8.3', 'valid': True}} >Thread-14::DEBUG::2014-07-10 09:12:26,486::task::595::TaskManager.Task::(_updateState) Task=`427ad229-7316-424b-8fa1-0974851906d5`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 09:12:26,486::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 09:12:26,486::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 09:12:26,487::task::990::TaskManager.Task::(_decref) Task=`427ad229-7316-424b-8fa1-0974851906d5`::ref 0 aborting False >Thread-14::DEBUG::2014-07-10 09:12:27,541::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-14::DEBUG::2014-07-10 09:12:27,542::task::595::TaskManager.Task::(_updateState) Task=`327a918a-129d-4f0a-94dd-5b96af5605b8`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 09:12:27,543::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-14::INFO::2014-07-10 09:12:27,543::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:12:27,543::task::1185::TaskManager.Task::(prepare) Task=`327a918a-129d-4f0a-94dd-5b96af5605b8`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:12:27,544::task::595::TaskManager.Task::(_updateState) Task=`327a918a-129d-4f0a-94dd-5b96af5605b8`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 09:12:27,544::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 09:12:27,544::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 09:12:27,544::task::990::TaskManager.Task::(_decref) Task=`327a918a-129d-4f0a-94dd-5b96af5605b8`::ref 0 aborting False >Thread-34::DEBUG::2014-07-10 09:12:27,588::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-34::DEBUG::2014-07-10 09:12:27,588::task::595::TaskManager.Task::(_updateState) Task=`41ef9d7c-1034-4315-8be5-46a4c85dcbaf`::moving from state init -> state preparing >Thread-34::INFO::2014-07-10 09:12:27,588::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-34::DEBUG::2014-07-10 09:12:27,589::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`3d59fa59-9f31-4872-8309-b00f12a98019`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-10 09:12:27,589::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' for lock type 'shared' >Thread-34::DEBUG::2014-07-10 09:12:27,589::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-10 09:12:27,589::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`3d59fa59-9f31-4872-8309-b00f12a98019`::Granted request >Thread-34::DEBUG::2014-07-10 09:12:27,590::task::827::TaskManager.Task::(resourceAcquired) Task=`41ef9d7c-1034-4315-8be5-46a4c85dcbaf`::_resourcesAcquired: Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee (shared) >Thread-34::DEBUG::2014-07-10 09:12:27,590::task::990::TaskManager.Task::(_decref) Task=`41ef9d7c-1034-4315-8be5-46a4c85dcbaf`::ref 1 aborting False >Thread-34::INFO::2014-07-10 09:12:27,591::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532067385344', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:12:27,591::task::1185::TaskManager.Task::(prepare) Task=`41ef9d7c-1034-4315-8be5-46a4c85dcbaf`::finished: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532067385344', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:12:27,592::task::595::TaskManager.Task::(_updateState) Task=`41ef9d7c-1034-4315-8be5-46a4c85dcbaf`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-10 09:12:27,592::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee': < ResourceRef 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-10 09:12:27,592::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-10 09:12:27,592::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' >Thread-34::DEBUG::2014-07-10 09:12:27,592::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' (0 active users) >Thread-34::DEBUG::2014-07-10 09:12:27,593::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-10 09:12:27,593::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', Clearing records. >Thread-34::DEBUG::2014-07-10 09:12:27,593::task::990::TaskManager.Task::(_decref) Task=`41ef9d7c-1034-4315-8be5-46a4c85dcbaf`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 09:12:27,600::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:12:27,804::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.141193 s, 7.3 MB/s\n'; <rc> = 0 >Thread-40::DEBUG::2014-07-10 09:12:28,206::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lion.qa.lab.tlv.redhat.com:_export_yuri2_backup2/6a70504d-00df-4869-8695-0f442053f6b6/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-40::DEBUG::2014-07-10 09:12:28,227::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n369 bytes (369 B) copied, 0.000522207 s, 707 kB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:12:29,820::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:12:29,931::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.051845 s, 19.8 MB/s\n'; <rc> = 0 >Thread-70::DEBUG::2014-07-10 09:12:31,875::task::595::TaskManager.Task::(_updateState) Task=`82a653e0-10bc-41ac-89d1-4bbae2891ed5`::moving from state init -> state preparing >Thread-70::INFO::2014-07-10 09:12:31,876::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='cfaeead2-7caa-467c-b389-c89840ae6605', volUUID='567fe32d-31a6-4ff6-90f3-fd6a656fbecc', options=None) >Thread-70::INFO::2014-07-10 09:12:31,876::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-70::DEBUG::2014-07-10 09:12:31,877::task::1185::TaskManager.Task::(prepare) Task=`82a653e0-10bc-41ac-89d1-4bbae2891ed5`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-70::DEBUG::2014-07-10 09:12:31,877::task::595::TaskManager.Task::(_updateState) Task=`82a653e0-10bc-41ac-89d1-4bbae2891ed5`::moving from state preparing -> state finished >Thread-70::DEBUG::2014-07-10 09:12:31,877::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-70::DEBUG::2014-07-10 09:12:31,877::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-70::DEBUG::2014-07-10 09:12:31,877::task::990::TaskManager.Task::(_decref) Task=`82a653e0-10bc-41ac-89d1-4bbae2891ed5`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 09:12:31,946::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:12:32,078::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0297351 s, 34.4 MB/s\n'; <rc> = 0 >Thread-60::DEBUG::2014-07-10 09:12:32,756::task::595::TaskManager.Task::(_updateState) Task=`11e23d9b-74f7-413d-9ddb-5975767e896a`::moving from state init -> state preparing >Thread-60::INFO::2014-07-10 09:12:32,757::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='b034d5b0-e1e0-4011-b49b-4d45ddb11556', volUUID='3d7f62b5-328f-4d8e-8b69-873cfb5ae14d', options=None) >Thread-60::INFO::2014-07-10 09:12:32,757::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-60::DEBUG::2014-07-10 09:12:32,757::task::1185::TaskManager.Task::(prepare) Task=`11e23d9b-74f7-413d-9ddb-5975767e896a`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-60::DEBUG::2014-07-10 09:12:32,758::task::595::TaskManager.Task::(_updateState) Task=`11e23d9b-74f7-413d-9ddb-5975767e896a`::moving from state preparing -> state finished >Thread-60::DEBUG::2014-07-10 09:12:32,758::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-60::DEBUG::2014-07-10 09:12:32,758::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-60::DEBUG::2014-07-10 09:12:32,758::task::990::TaskManager.Task::(_decref) Task=`11e23d9b-74f7-413d-9ddb-5975767e896a`::ref 0 aborting False >Thread-51::DEBUG::2014-07-10 09:12:32,938::task::595::TaskManager.Task::(_updateState) Task=`deb46156-fddc-4c76-bbcb-4717ce63088c`::moving from state init -> state preparing >Thread-51::INFO::2014-07-10 09:12:32,938::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='76fdb054-02cd-42ed-9721-b3e65b34c3a4', volUUID='022dfe46-2cf7-4915-80b3-883158e3ca83', options=None) >Thread-51::INFO::2014-07-10 09:12:32,938::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-51::DEBUG::2014-07-10 09:12:32,939::task::1185::TaskManager.Task::(prepare) Task=`deb46156-fddc-4c76-bbcb-4717ce63088c`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-51::DEBUG::2014-07-10 09:12:32,939::task::595::TaskManager.Task::(_updateState) Task=`deb46156-fddc-4c76-bbcb-4717ce63088c`::moving from state preparing -> state finished >Thread-51::DEBUG::2014-07-10 09:12:32,939::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-51::DEBUG::2014-07-10 09:12:32,939::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-51::DEBUG::2014-07-10 09:12:32,939::task::990::TaskManager.Task::(_decref) Task=`deb46156-fddc-4c76-bbcb-4717ce63088c`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 09:12:34,093::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:12:34,186::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0284786 s, 36.0 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-10 09:12:35,076::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/metadata bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-10 09:12:35,098::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000510791 s, 8.0 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:12:36,201::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:12:36,295::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0354792 s, 28.9 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 09:12:37,617::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-14::DEBUG::2014-07-10 09:12:37,618::task::595::TaskManager.Task::(_updateState) Task=`c93afdae-b7d4-4ffc-a666-5ad75a45433f`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 09:12:37,619::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-14::INFO::2014-07-10 09:12:37,619::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:12:37,619::task::1185::TaskManager.Task::(prepare) Task=`c93afdae-b7d4-4ffc-a666-5ad75a45433f`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:12:37,620::task::595::TaskManager.Task::(_updateState) Task=`c93afdae-b7d4-4ffc-a666-5ad75a45433f`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 09:12:37,620::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 09:12:37,620::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 09:12:37,620::task::990::TaskManager.Task::(_decref) Task=`c93afdae-b7d4-4ffc-a666-5ad75a45433f`::ref 0 aborting False >Thread-34::DEBUG::2014-07-10 09:12:37,625::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-34::DEBUG::2014-07-10 09:12:37,625::task::595::TaskManager.Task::(_updateState) Task=`60433032-97e5-421f-9b87-25e8120a3040`::moving from state init -> state preparing >Thread-34::INFO::2014-07-10 09:12:37,625::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-34::DEBUG::2014-07-10 09:12:37,626::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`e0e06c11-ca74-4282-8afc-ede94777f4c8`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-10 09:12:37,626::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' for lock type 'shared' >Thread-34::DEBUG::2014-07-10 09:12:37,627::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-10 09:12:37,627::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`e0e06c11-ca74-4282-8afc-ede94777f4c8`::Granted request >Thread-34::DEBUG::2014-07-10 09:12:37,628::task::827::TaskManager.Task::(resourceAcquired) Task=`60433032-97e5-421f-9b87-25e8120a3040`::_resourcesAcquired: Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee (shared) >Thread-34::DEBUG::2014-07-10 09:12:37,628::task::990::TaskManager.Task::(_decref) Task=`60433032-97e5-421f-9b87-25e8120a3040`::ref 1 aborting False >Thread-34::INFO::2014-07-10 09:12:37,629::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532067385344', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:12:37,629::task::1185::TaskManager.Task::(prepare) Task=`60433032-97e5-421f-9b87-25e8120a3040`::finished: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532067385344', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:12:37,629::task::595::TaskManager.Task::(_updateState) Task=`60433032-97e5-421f-9b87-25e8120a3040`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-10 09:12:37,630::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee': < ResourceRef 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-10 09:12:37,630::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-10 09:12:37,630::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' >Thread-34::DEBUG::2014-07-10 09:12:37,630::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' (0 active users) >Thread-34::DEBUG::2014-07-10 09:12:37,631::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-10 09:12:37,631::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', Clearing records. >Thread-34::DEBUG::2014-07-10 09:12:37,631::task::990::TaskManager.Task::(_decref) Task=`60433032-97e5-421f-9b87-25e8120a3040`::ref 0 aborting False >Thread-40::DEBUG::2014-07-10 09:12:38,259::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lion.qa.lab.tlv.redhat.com:_export_yuri2_backup2/6a70504d-00df-4869-8695-0f442053f6b6/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-40::DEBUG::2014-07-10 09:12:38,279::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n369 bytes (369 B) copied, 0.00054365 s, 679 kB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:12:38,310::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:12:38,402::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0351025 s, 29.2 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:12:40,418::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:12:40,522::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0287624 s, 35.6 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 09:12:41,711::task::595::TaskManager.Task::(_updateState) Task=`e78ace12-c6c9-4bf7-9384-1ee5f0204b52`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 09:12:41,712::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::INFO::2014-07-10 09:12:41,712::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000510791', 'lastCheck': '6.6', 'valid': True}, '6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00054365', 'lastCheck': '3.4', 'valid': True}} >Thread-14::DEBUG::2014-07-10 09:12:41,712::task::1185::TaskManager.Task::(prepare) Task=`e78ace12-c6c9-4bf7-9384-1ee5f0204b52`::finished: {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000510791', 'lastCheck': '6.6', 'valid': True}, '6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00054365', 'lastCheck': '3.4', 'valid': True}} >Thread-14::DEBUG::2014-07-10 09:12:41,713::task::595::TaskManager.Task::(_updateState) Task=`e78ace12-c6c9-4bf7-9384-1ee5f0204b52`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 09:12:41,713::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 09:12:41,713::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 09:12:41,713::task::990::TaskManager.Task::(_decref) Task=`e78ace12-c6c9-4bf7-9384-1ee5f0204b52`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 09:12:42,538::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:12:42,632::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0374877 s, 27.3 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:12:44,648::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:12:44,783::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0477783 s, 21.4 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-10 09:12:45,127::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/metadata bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-10 09:12:45,150::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000657222 s, 6.2 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:12:46,799::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:12:46,918::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0292574 s, 35.0 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 09:12:47,662::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-14::DEBUG::2014-07-10 09:12:47,664::task::595::TaskManager.Task::(_updateState) Task=`706085d0-fbbe-4e3e-91e2-bd196a55960f`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 09:12:47,665::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-14::INFO::2014-07-10 09:12:47,665::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:12:47,666::task::1185::TaskManager.Task::(prepare) Task=`706085d0-fbbe-4e3e-91e2-bd196a55960f`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:12:47,666::task::595::TaskManager.Task::(_updateState) Task=`706085d0-fbbe-4e3e-91e2-bd196a55960f`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 09:12:47,666::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 09:12:47,666::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 09:12:47,666::task::990::TaskManager.Task::(_decref) Task=`706085d0-fbbe-4e3e-91e2-bd196a55960f`::ref 0 aborting False >Thread-34::DEBUG::2014-07-10 09:12:47,671::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-34::DEBUG::2014-07-10 09:12:47,671::task::595::TaskManager.Task::(_updateState) Task=`42357a8e-d700-470d-a31e-a2bd1c90e76b`::moving from state init -> state preparing >Thread-34::INFO::2014-07-10 09:12:47,671::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-34::DEBUG::2014-07-10 09:12:47,672::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`77bab093-a3a4-42a4-b917-8b2625fc6d45`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-10 09:12:47,672::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' for lock type 'shared' >Thread-34::DEBUG::2014-07-10 09:12:47,673::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-10 09:12:47,673::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`77bab093-a3a4-42a4-b917-8b2625fc6d45`::Granted request >Thread-34::DEBUG::2014-07-10 09:12:47,673::task::827::TaskManager.Task::(resourceAcquired) Task=`42357a8e-d700-470d-a31e-a2bd1c90e76b`::_resourcesAcquired: Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee (shared) >Thread-34::DEBUG::2014-07-10 09:12:47,674::task::990::TaskManager.Task::(_decref) Task=`42357a8e-d700-470d-a31e-a2bd1c90e76b`::ref 1 aborting False >Thread-34::INFO::2014-07-10 09:12:47,675::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532067385344', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:12:47,675::task::1185::TaskManager.Task::(prepare) Task=`42357a8e-d700-470d-a31e-a2bd1c90e76b`::finished: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532067385344', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:12:47,675::task::595::TaskManager.Task::(_updateState) Task=`42357a8e-d700-470d-a31e-a2bd1c90e76b`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-10 09:12:47,675::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee': < ResourceRef 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-10 09:12:47,676::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-10 09:12:47,676::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' >Thread-34::DEBUG::2014-07-10 09:12:47,676::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' (0 active users) >Thread-34::DEBUG::2014-07-10 09:12:47,676::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-10 09:12:47,677::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', Clearing records. >Thread-34::DEBUG::2014-07-10 09:12:47,677::task::990::TaskManager.Task::(_decref) Task=`42357a8e-d700-470d-a31e-a2bd1c90e76b`::ref 0 aborting False >Thread-40::DEBUG::2014-07-10 09:12:48,283::domainMonitor::192::Storage.DomainMonitorThread::(_monitorDomain) Refreshing domain 6a70504d-00df-4869-8695-0f442053f6b6 >Thread-40::DEBUG::2014-07-10 09:12:48,316::fileSD::150::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/lion.qa.lab.tlv.redhat.com:_export_yuri2_backup2/6a70504d-00df-4869-8695-0f442053f6b6 >Thread-40::DEBUG::2014-07-10 09:12:48,318::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend >Thread-40::DEBUG::2014-07-10 09:12:48,321::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Backup', 'DESCRIPTION=test', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=0', 'POOL_UUID=4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', 'REMOTE_PATH=lion.qa.lab.tlv.redhat.com:/export/yuri2/backup2', 'ROLE=Regular', 'SDUUID=6a70504d-00df-4869-8695-0f442053f6b6', 'TYPE=NFS', 'VERSION=0', '_SHA_CKSUM=aab6b8e901ec435cd5f9de3c9e3f8b45dca569e0'] >Thread-40::DEBUG::2014-07-10 09:12:48,323::fileSD::609::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images [] >Thread-40::INFO::2014-07-10 09:12:48,323::sd::384::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 6a70504d-00df-4869-8695-0f442053f6b6_imageNS already registered >Thread-40::INFO::2014-07-10 09:12:48,323::sd::392::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 6a70504d-00df-4869-8695-0f442053f6b6_volumeNS already registered >Thread-40::DEBUG::2014-07-10 09:12:48,352::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lion.qa.lab.tlv.redhat.com:_export_yuri2_backup2/6a70504d-00df-4869-8695-0f442053f6b6/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-40::DEBUG::2014-07-10 09:12:48,374::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n369 bytes (369 B) copied, 0.00164355 s, 225 kB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:12:48,933::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:12:49,033::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0413174 s, 24.8 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:12:51,048::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:12:51,142::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.036607 s, 28.0 MB/s\n'; <rc> = 0 >Thread-64::DEBUG::2014-07-10 09:12:51,950::task::595::TaskManager.Task::(_updateState) Task=`3679881c-f7c6-4184-aa6b-a9d8e9a59443`::moving from state init -> state preparing >Thread-64::INFO::2014-07-10 09:12:51,950::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='aa20346a-4d3a-4e07-b8e1-52c0ebe4168c', volUUID='58fefce2-9bce-4bff-8949-8c6ce8122b27', options=None) >Thread-64::INFO::2014-07-10 09:12:51,951::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-64::DEBUG::2014-07-10 09:12:51,951::task::1185::TaskManager.Task::(prepare) Task=`3679881c-f7c6-4184-aa6b-a9d8e9a59443`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-64::DEBUG::2014-07-10 09:12:51,951::task::595::TaskManager.Task::(_updateState) Task=`3679881c-f7c6-4184-aa6b-a9d8e9a59443`::moving from state preparing -> state finished >Thread-64::DEBUG::2014-07-10 09:12:51,951::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-64::DEBUG::2014-07-10 09:12:51,951::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-64::DEBUG::2014-07-10 09:12:51,951::task::990::TaskManager.Task::(_decref) Task=`3679881c-f7c6-4184-aa6b-a9d8e9a59443`::ref 0 aborting False >Thread-54::DEBUG::2014-07-10 09:12:53,107::task::595::TaskManager.Task::(_updateState) Task=`d7194abc-f326-4517-b53f-33cfa415fb5d`::moving from state init -> state preparing >Thread-54::INFO::2014-07-10 09:12:53,110::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='28408446-e5fd-4565-a976-e760951593fe', volUUID='776303a2-5585-451e-826e-0e338d4a1e98', options=None) >Thread-73::DEBUG::2014-07-10 09:12:53,110::task::595::TaskManager.Task::(_updateState) Task=`3775cff6-6223-4970-9285-7453c121a1a9`::moving from state init -> state preparing >Thread-54::INFO::2014-07-10 09:12:53,111::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-73::INFO::2014-07-10 09:12:53,112::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='c01d693b-cba0-4fed-9ad7-0aaa28912a19', volUUID='4bb5d954-2a50-4028-b299-0b43c261270c', options=None) >Thread-54::DEBUG::2014-07-10 09:12:53,113::task::1185::TaskManager.Task::(prepare) Task=`d7194abc-f326-4517-b53f-33cfa415fb5d`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-54::DEBUG::2014-07-10 09:12:53,114::task::595::TaskManager.Task::(_updateState) Task=`d7194abc-f326-4517-b53f-33cfa415fb5d`::moving from state preparing -> state finished >Thread-73::INFO::2014-07-10 09:12:53,114::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-54::DEBUG::2014-07-10 09:12:53,115::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-73::DEBUG::2014-07-10 09:12:53,115::task::1185::TaskManager.Task::(prepare) Task=`3775cff6-6223-4970-9285-7453c121a1a9`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-73::DEBUG::2014-07-10 09:12:53,116::task::595::TaskManager.Task::(_updateState) Task=`3775cff6-6223-4970-9285-7453c121a1a9`::moving from state preparing -> state finished >Thread-54::DEBUG::2014-07-10 09:12:53,116::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-73::DEBUG::2014-07-10 09:12:53,117::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-73::DEBUG::2014-07-10 09:12:53,119::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-54::DEBUG::2014-07-10 09:12:53,119::task::990::TaskManager.Task::(_decref) Task=`d7194abc-f326-4517-b53f-33cfa415fb5d`::ref 0 aborting False >Thread-73::DEBUG::2014-07-10 09:12:53,120::task::990::TaskManager.Task::(_decref) Task=`3775cff6-6223-4970-9285-7453c121a1a9`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 09:12:53,157::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:12:53,253::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0369846 s, 27.7 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-10 09:12:55,178::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/metadata bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-10 09:12:55,200::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000472464 s, 8.7 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:12:55,269::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:12:55,359::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0327589 s, 31.3 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 09:12:56,911::task::595::TaskManager.Task::(_updateState) Task=`d06c079e-e9d3-4049-9a21-c1e27a2cca8f`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 09:12:56,912::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::INFO::2014-07-10 09:12:56,912::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000472464', 'lastCheck': '1.7', 'valid': True}, '6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00164355', 'lastCheck': '8.5', 'valid': True}} >Thread-14::DEBUG::2014-07-10 09:12:56,913::task::1185::TaskManager.Task::(prepare) Task=`d06c079e-e9d3-4049-9a21-c1e27a2cca8f`::finished: {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000472464', 'lastCheck': '1.7', 'valid': True}, '6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00164355', 'lastCheck': '8.5', 'valid': True}} >Thread-14::DEBUG::2014-07-10 09:12:56,913::task::595::TaskManager.Task::(_updateState) Task=`d06c079e-e9d3-4049-9a21-c1e27a2cca8f`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 09:12:56,913::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 09:12:56,913::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 09:12:56,913::task::990::TaskManager.Task::(_decref) Task=`d06c079e-e9d3-4049-9a21-c1e27a2cca8f`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 09:12:57,374::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:12:57,461::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0302237 s, 33.9 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 09:12:57,723::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-14::DEBUG::2014-07-10 09:12:57,724::task::595::TaskManager.Task::(_updateState) Task=`a00489ab-62d6-45e8-906d-38ee2f59a2a7`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 09:12:57,725::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-14::INFO::2014-07-10 09:12:57,725::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:12:57,726::task::1185::TaskManager.Task::(prepare) Task=`a00489ab-62d6-45e8-906d-38ee2f59a2a7`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:12:57,726::task::595::TaskManager.Task::(_updateState) Task=`a00489ab-62d6-45e8-906d-38ee2f59a2a7`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 09:12:57,726::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 09:12:57,726::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 09:12:57,726::task::990::TaskManager.Task::(_decref) Task=`a00489ab-62d6-45e8-906d-38ee2f59a2a7`::ref 0 aborting False >Thread-34::DEBUG::2014-07-10 09:12:57,770::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-34::DEBUG::2014-07-10 09:12:57,771::task::595::TaskManager.Task::(_updateState) Task=`a8782ac2-15d3-41a4-b087-d9c3b571239b`::moving from state init -> state preparing >Thread-34::INFO::2014-07-10 09:12:57,771::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-34::DEBUG::2014-07-10 09:12:57,772::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`24e07949-3141-4755-8402-33058de0133c`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-10 09:12:57,772::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' for lock type 'shared' >Thread-34::DEBUG::2014-07-10 09:12:57,772::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-10 09:12:57,773::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`24e07949-3141-4755-8402-33058de0133c`::Granted request >Thread-34::DEBUG::2014-07-10 09:12:57,773::task::827::TaskManager.Task::(resourceAcquired) Task=`a8782ac2-15d3-41a4-b087-d9c3b571239b`::_resourcesAcquired: Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee (shared) >Thread-34::DEBUG::2014-07-10 09:12:57,773::task::990::TaskManager.Task::(_decref) Task=`a8782ac2-15d3-41a4-b087-d9c3b571239b`::ref 1 aborting False >Thread-34::INFO::2014-07-10 09:12:57,775::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532067385344', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:12:57,775::task::1185::TaskManager.Task::(prepare) Task=`a8782ac2-15d3-41a4-b087-d9c3b571239b`::finished: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532067385344', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:12:57,775::task::595::TaskManager.Task::(_updateState) Task=`a8782ac2-15d3-41a4-b087-d9c3b571239b`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-10 09:12:57,775::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee': < ResourceRef 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-10 09:12:57,775::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-10 09:12:57,776::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' >Thread-34::DEBUG::2014-07-10 09:12:57,776::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' (0 active users) >Thread-34::DEBUG::2014-07-10 09:12:57,776::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-10 09:12:57,776::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', Clearing records. >Thread-34::DEBUG::2014-07-10 09:12:57,777::task::990::TaskManager.Task::(_decref) Task=`a8782ac2-15d3-41a4-b087-d9c3b571239b`::ref 0 aborting False >Thread-40::DEBUG::2014-07-10 09:12:58,410::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lion.qa.lab.tlv.redhat.com:_export_yuri2_backup2/6a70504d-00df-4869-8695-0f442053f6b6/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-40::DEBUG::2014-07-10 09:12:58,432::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n369 bytes (369 B) copied, 0.000432526 s, 853 kB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:12:59,477::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:12:59,586::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.048471 s, 21.1 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:13:01,601::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:13:01,691::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0302641 s, 33.8 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:13:03,706::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:13:03,801::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0285405 s, 35.9 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-10 09:13:05,236::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/metadata bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-10 09:13:05,260::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000765498 s, 5.4 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:13:05,818::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:13:05,925::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0494797 s, 20.7 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 09:13:07,802::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-14::DEBUG::2014-07-10 09:13:07,803::task::595::TaskManager.Task::(_updateState) Task=`587b4e14-c104-42c4-9aef-e458062a0438`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 09:13:07,804::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-14::INFO::2014-07-10 09:13:07,804::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:13:07,804::task::1185::TaskManager.Task::(prepare) Task=`587b4e14-c104-42c4-9aef-e458062a0438`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:13:07,805::task::595::TaskManager.Task::(_updateState) Task=`587b4e14-c104-42c4-9aef-e458062a0438`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 09:13:07,805::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 09:13:07,805::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 09:13:07,805::task::990::TaskManager.Task::(_decref) Task=`587b4e14-c104-42c4-9aef-e458062a0438`::ref 0 aborting False >Thread-34::DEBUG::2014-07-10 09:13:07,809::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-34::DEBUG::2014-07-10 09:13:07,809::task::595::TaskManager.Task::(_updateState) Task=`fbc378c5-397a-491c-b1ff-6f4931cb4972`::moving from state init -> state preparing >Thread-34::INFO::2014-07-10 09:13:07,810::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-34::DEBUG::2014-07-10 09:13:07,810::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`546b076c-5dd1-43f7-ba48-373ac0146ede`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-10 09:13:07,810::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' for lock type 'shared' >Thread-34::DEBUG::2014-07-10 09:13:07,811::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-10 09:13:07,811::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`546b076c-5dd1-43f7-ba48-373ac0146ede`::Granted request >Thread-34::DEBUG::2014-07-10 09:13:07,811::task::827::TaskManager.Task::(resourceAcquired) Task=`fbc378c5-397a-491c-b1ff-6f4931cb4972`::_resourcesAcquired: Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee (shared) >Thread-34::DEBUG::2014-07-10 09:13:07,812::task::990::TaskManager.Task::(_decref) Task=`fbc378c5-397a-491c-b1ff-6f4931cb4972`::ref 1 aborting False >Thread-34::INFO::2014-07-10 09:13:07,813::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532067385344', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:13:07,813::task::1185::TaskManager.Task::(prepare) Task=`fbc378c5-397a-491c-b1ff-6f4931cb4972`::finished: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532067385344', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:13:07,813::task::595::TaskManager.Task::(_updateState) Task=`fbc378c5-397a-491c-b1ff-6f4931cb4972`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-10 09:13:07,813::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee': < ResourceRef 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-10 09:13:07,813::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-10 09:13:07,813::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' >Thread-34::DEBUG::2014-07-10 09:13:07,814::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' (0 active users) >Thread-34::DEBUG::2014-07-10 09:13:07,814::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-10 09:13:07,814::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', Clearing records. >Thread-34::DEBUG::2014-07-10 09:13:07,814::task::990::TaskManager.Task::(_decref) Task=`fbc378c5-397a-491c-b1ff-6f4931cb4972`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 09:13:07,940::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:13:08,033::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0337222 s, 30.4 MB/s\n'; <rc> = 0 >Thread-40::DEBUG::2014-07-10 09:13:08,463::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lion.qa.lab.tlv.redhat.com:_export_yuri2_backup2/6a70504d-00df-4869-8695-0f442053f6b6/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-40::DEBUG::2014-07-10 09:13:08,484::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n369 bytes (369 B) copied, 0.000384358 s, 960 kB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:13:10,048::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:13:10,135::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0282084 s, 36.3 MB/s\n'; <rc> = 0 >Thread-57::DEBUG::2014-07-10 09:13:12,082::task::595::TaskManager.Task::(_updateState) Task=`579d4734-42f2-45e2-88e1-7ec49a976912`::moving from state init -> state preparing >Thread-57::INFO::2014-07-10 09:13:12,082::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='b6f6c0da-e67f-4902-b9ac-3069571a42fe', volUUID='c4cd1da8-05b7-45e0-80b1-1183d21443d9', options=None) >Thread-57::INFO::2014-07-10 09:13:12,083::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-57::DEBUG::2014-07-10 09:13:12,083::task::1185::TaskManager.Task::(prepare) Task=`579d4734-42f2-45e2-88e1-7ec49a976912`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-57::DEBUG::2014-07-10 09:13:12,083::task::595::TaskManager.Task::(_updateState) Task=`579d4734-42f2-45e2-88e1-7ec49a976912`::moving from state preparing -> state finished >Thread-57::DEBUG::2014-07-10 09:13:12,083::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-57::DEBUG::2014-07-10 09:13:12,084::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-57::DEBUG::2014-07-10 09:13:12,084::task::990::TaskManager.Task::(_decref) Task=`579d4734-42f2-45e2-88e1-7ec49a976912`::ref 0 aborting False >Thread-14::DEBUG::2014-07-10 09:13:12,108::task::595::TaskManager.Task::(_updateState) Task=`7cb59e5c-f8cb-4cbb-96b3-7107940e2cba`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 09:13:12,109::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::INFO::2014-07-10 09:13:12,109::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000765498', 'lastCheck': '6.8', 'valid': True}, '6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000384358', 'lastCheck': '3.6', 'valid': True}} >Thread-14::DEBUG::2014-07-10 09:13:12,109::task::1185::TaskManager.Task::(prepare) Task=`7cb59e5c-f8cb-4cbb-96b3-7107940e2cba`::finished: {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000765498', 'lastCheck': '6.8', 'valid': True}, '6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000384358', 'lastCheck': '3.6', 'valid': True}} >Thread-14::DEBUG::2014-07-10 09:13:12,110::task::595::TaskManager.Task::(_updateState) Task=`7cb59e5c-f8cb-4cbb-96b3-7107940e2cba`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 09:13:12,110::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 09:13:12,110::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 09:13:12,110::task::990::TaskManager.Task::(_decref) Task=`7cb59e5c-f8cb-4cbb-96b3-7107940e2cba`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 09:13:12,150::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:13:12,258::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0494927 s, 20.7 MB/s\n'; <rc> = 0 >Thread-67::DEBUG::2014-07-10 09:13:12,953::task::595::TaskManager.Task::(_updateState) Task=`44fd9087-8cc2-42d8-b370-b646c13d5649`::moving from state init -> state preparing >Thread-67::INFO::2014-07-10 09:13:12,953::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='f30c2cb7-a43a-4bf5-82b5-cfe07336f65c', volUUID='b0fbb3c9-55af-4a3a-95ad-fc56a80b9cf5', options=None) >Thread-67::INFO::2014-07-10 09:13:12,954::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-67::DEBUG::2014-07-10 09:13:12,954::task::1185::TaskManager.Task::(prepare) Task=`44fd9087-8cc2-42d8-b370-b646c13d5649`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-67::DEBUG::2014-07-10 09:13:12,954::task::595::TaskManager.Task::(_updateState) Task=`44fd9087-8cc2-42d8-b370-b646c13d5649`::moving from state preparing -> state finished >Thread-67::DEBUG::2014-07-10 09:13:12,955::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-67::DEBUG::2014-07-10 09:13:12,955::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-67::DEBUG::2014-07-10 09:13:12,955::task::990::TaskManager.Task::(_decref) Task=`44fd9087-8cc2-42d8-b370-b646c13d5649`::ref 0 aborting False >Thread-48::DEBUG::2014-07-10 09:13:13,287::task::595::TaskManager.Task::(_updateState) Task=`a7ab630f-056f-4496-91c6-d9eacaf58732`::moving from state init -> state preparing >Thread-48::INFO::2014-07-10 09:13:13,287::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='0cd7d6ce-f497-4243-a690-c57744861eea', volUUID='10b6a7dd-dc6c-43fa-ba17-92e4331b0e0b', options=None) >Thread-48::INFO::2014-07-10 09:13:13,288::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-48::DEBUG::2014-07-10 09:13:13,288::task::1185::TaskManager.Task::(prepare) Task=`a7ab630f-056f-4496-91c6-d9eacaf58732`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-48::DEBUG::2014-07-10 09:13:13,288::task::595::TaskManager.Task::(_updateState) Task=`a7ab630f-056f-4496-91c6-d9eacaf58732`::moving from state preparing -> state finished >Thread-48::DEBUG::2014-07-10 09:13:13,288::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-48::DEBUG::2014-07-10 09:13:13,289::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-48::DEBUG::2014-07-10 09:13:13,289::task::990::TaskManager.Task::(_decref) Task=`a7ab630f-056f-4496-91c6-d9eacaf58732`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 09:13:14,276::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:13:14,381::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0322747 s, 31.7 MB/s\n'; <rc> = 0 >Thread-76::DEBUG::2014-07-10 09:13:14,675::task::595::TaskManager.Task::(_updateState) Task=`b61b945d-3daf-42e7-88c8-8fee1954dc51`::moving from state init -> state preparing >Thread-76::INFO::2014-07-10 09:13:14,676::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='e4c65229-4247-4b33-b72a-f1d5ce72ad05', volUUID='cad94284-3ca9-4c30-933d-997f4460309e', options=None) >Thread-76::INFO::2014-07-10 09:13:14,676::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-76::DEBUG::2014-07-10 09:13:14,676::task::1185::TaskManager.Task::(prepare) Task=`b61b945d-3daf-42e7-88c8-8fee1954dc51`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-76::DEBUG::2014-07-10 09:13:14,676::task::595::TaskManager.Task::(_updateState) Task=`b61b945d-3daf-42e7-88c8-8fee1954dc51`::moving from state preparing -> state finished >Thread-76::DEBUG::2014-07-10 09:13:14,677::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-76::DEBUG::2014-07-10 09:13:14,677::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-76::DEBUG::2014-07-10 09:13:14,677::task::990::TaskManager.Task::(_decref) Task=`b61b945d-3daf-42e7-88c8-8fee1954dc51`::ref 0 aborting False >Thread-18::DEBUG::2014-07-10 09:13:15,292::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/metadata bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-10 09:13:15,315::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000817327 s, 5.0 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:13:16,404::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:13:16,493::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0303323 s, 33.8 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 09:13:17,844::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-14::DEBUG::2014-07-10 09:13:17,845::task::595::TaskManager.Task::(_updateState) Task=`138bf944-a7e4-4ce3-b458-efccaad300cf`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 09:13:17,845::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-14::INFO::2014-07-10 09:13:17,846::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:13:17,846::task::1185::TaskManager.Task::(prepare) Task=`138bf944-a7e4-4ce3-b458-efccaad300cf`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:13:17,846::task::595::TaskManager.Task::(_updateState) Task=`138bf944-a7e4-4ce3-b458-efccaad300cf`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 09:13:17,847::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 09:13:17,847::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 09:13:17,847::task::990::TaskManager.Task::(_decref) Task=`138bf944-a7e4-4ce3-b458-efccaad300cf`::ref 0 aborting False >Thread-34::DEBUG::2014-07-10 09:13:17,851::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-34::DEBUG::2014-07-10 09:13:17,852::task::595::TaskManager.Task::(_updateState) Task=`726cb5ac-df4e-4047-86b4-23d3bf575248`::moving from state init -> state preparing >Thread-34::INFO::2014-07-10 09:13:17,852::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-34::DEBUG::2014-07-10 09:13:17,853::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`b915a725-937b-4205-a7a6-e980332d0fdc`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-10 09:13:17,853::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' for lock type 'shared' >Thread-34::DEBUG::2014-07-10 09:13:17,853::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-10 09:13:17,853::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`b915a725-937b-4205-a7a6-e980332d0fdc`::Granted request >Thread-34::DEBUG::2014-07-10 09:13:17,854::task::827::TaskManager.Task::(resourceAcquired) Task=`726cb5ac-df4e-4047-86b4-23d3bf575248`::_resourcesAcquired: Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee (shared) >Thread-34::DEBUG::2014-07-10 09:13:17,854::task::990::TaskManager.Task::(_decref) Task=`726cb5ac-df4e-4047-86b4-23d3bf575248`::ref 1 aborting False >Thread-34::INFO::2014-07-10 09:13:17,855::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532067385344', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:13:17,855::task::1185::TaskManager.Task::(prepare) Task=`726cb5ac-df4e-4047-86b4-23d3bf575248`::finished: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532067385344', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:13:17,856::task::595::TaskManager.Task::(_updateState) Task=`726cb5ac-df4e-4047-86b4-23d3bf575248`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-10 09:13:17,856::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee': < ResourceRef 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-10 09:13:17,856::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-10 09:13:17,856::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' >Thread-34::DEBUG::2014-07-10 09:13:17,857::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' (0 active users) >Thread-34::DEBUG::2014-07-10 09:13:17,857::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-10 09:13:17,857::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', Clearing records. >Thread-34::DEBUG::2014-07-10 09:13:17,857::task::990::TaskManager.Task::(_decref) Task=`726cb5ac-df4e-4047-86b4-23d3bf575248`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 09:13:18,508::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Thread-40::DEBUG::2014-07-10 09:13:18,525::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lion.qa.lab.tlv.redhat.com:_export_yuri2_backup2/6a70504d-00df-4869-8695-0f442053f6b6/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-40::DEBUG::2014-07-10 09:13:18,571::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n369 bytes (369 B) copied, 0.000549686 s, 671 kB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:13:18,659::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0907904 s, 11.3 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:13:20,675::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:13:20,773::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0365484 s, 28.0 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:13:22,789::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:13:22,875::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0299521 s, 34.2 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:13:24,890::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:13:24,991::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0299232 s, 34.2 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-10 09:13:25,351::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/metadata bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-10 09:13:25,388::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000781331 s, 5.2 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:13:27,017::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:13:27,119::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0431665 s, 23.7 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 09:13:27,324::task::595::TaskManager.Task::(_updateState) Task=`c6197a62-b862-49d7-a962-a9a5b458edae`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 09:13:27,325::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::INFO::2014-07-10 09:13:27,325::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000781331', 'lastCheck': '1.9', 'valid': True}, '6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000549686', 'lastCheck': '8.7', 'valid': True}} >Thread-14::DEBUG::2014-07-10 09:13:27,325::task::1185::TaskManager.Task::(prepare) Task=`c6197a62-b862-49d7-a962-a9a5b458edae`::finished: {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000781331', 'lastCheck': '1.9', 'valid': True}, '6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000549686', 'lastCheck': '8.7', 'valid': True}} >Thread-14::DEBUG::2014-07-10 09:13:27,325::task::595::TaskManager.Task::(_updateState) Task=`c6197a62-b862-49d7-a962-a9a5b458edae`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 09:13:27,326::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 09:13:27,326::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 09:13:27,326::task::990::TaskManager.Task::(_decref) Task=`c6197a62-b862-49d7-a962-a9a5b458edae`::ref 0 aborting False >Thread-14::DEBUG::2014-07-10 09:13:27,886::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-14::DEBUG::2014-07-10 09:13:27,887::task::595::TaskManager.Task::(_updateState) Task=`ade17cf4-ce13-41d0-be0c-f10c5ac8e507`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 09:13:27,888::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-14::INFO::2014-07-10 09:13:27,888::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:13:27,888::task::1185::TaskManager.Task::(prepare) Task=`ade17cf4-ce13-41d0-be0c-f10c5ac8e507`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:13:27,888::task::595::TaskManager.Task::(_updateState) Task=`ade17cf4-ce13-41d0-be0c-f10c5ac8e507`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 09:13:27,889::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 09:13:27,889::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 09:13:27,889::task::990::TaskManager.Task::(_decref) Task=`ade17cf4-ce13-41d0-be0c-f10c5ac8e507`::ref 0 aborting False >Thread-34::DEBUG::2014-07-10 09:13:27,932::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-34::DEBUG::2014-07-10 09:13:27,933::task::595::TaskManager.Task::(_updateState) Task=`73a47397-649f-40ca-b74c-5889b226cf4f`::moving from state init -> state preparing >Thread-34::INFO::2014-07-10 09:13:27,933::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-34::DEBUG::2014-07-10 09:13:27,934::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`a3676cd9-a23d-4dcf-bd5c-322b03e93a71`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-10 09:13:27,934::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' for lock type 'shared' >Thread-34::DEBUG::2014-07-10 09:13:27,934::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-10 09:13:27,934::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`a3676cd9-a23d-4dcf-bd5c-322b03e93a71`::Granted request >Thread-34::DEBUG::2014-07-10 09:13:27,935::task::827::TaskManager.Task::(resourceAcquired) Task=`73a47397-649f-40ca-b74c-5889b226cf4f`::_resourcesAcquired: Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee (shared) >Thread-34::DEBUG::2014-07-10 09:13:27,935::task::990::TaskManager.Task::(_decref) Task=`73a47397-649f-40ca-b74c-5889b226cf4f`::ref 1 aborting False >Thread-34::INFO::2014-07-10 09:13:27,936::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532067385344', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:13:27,936::task::1185::TaskManager.Task::(prepare) Task=`73a47397-649f-40ca-b74c-5889b226cf4f`::finished: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532067385344', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:13:27,936::task::595::TaskManager.Task::(_updateState) Task=`73a47397-649f-40ca-b74c-5889b226cf4f`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-10 09:13:27,936::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee': < ResourceRef 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-10 09:13:27,937::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-10 09:13:27,937::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' >Thread-34::DEBUG::2014-07-10 09:13:27,937::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' (0 active users) >Thread-34::DEBUG::2014-07-10 09:13:27,937::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-10 09:13:27,937::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', Clearing records. >Thread-34::DEBUG::2014-07-10 09:13:27,938::task::990::TaskManager.Task::(_decref) Task=`73a47397-649f-40ca-b74c-5889b226cf4f`::ref 0 aborting False >Thread-40::DEBUG::2014-07-10 09:13:28,612::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lion.qa.lab.tlv.redhat.com:_export_yuri2_backup2/6a70504d-00df-4869-8695-0f442053f6b6/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-40::DEBUG::2014-07-10 09:13:28,633::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n369 bytes (369 B) copied, 0.000416826 s, 885 kB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:13:29,145::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:13:29,244::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0396311 s, 25.8 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:13:31,259::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:13:31,341::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0251303 s, 40.7 MB/s\n'; <rc> = 0 >Thread-70::DEBUG::2014-07-10 09:13:32,155::task::595::TaskManager.Task::(_updateState) Task=`8a294774-63f3-43b4-946d-afcfc983f6a7`::moving from state init -> state preparing >Thread-70::INFO::2014-07-10 09:13:32,156::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='cfaeead2-7caa-467c-b389-c89840ae6605', volUUID='567fe32d-31a6-4ff6-90f3-fd6a656fbecc', options=None) >Thread-70::INFO::2014-07-10 09:13:32,157::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-70::DEBUG::2014-07-10 09:13:32,157::task::1185::TaskManager.Task::(prepare) Task=`8a294774-63f3-43b4-946d-afcfc983f6a7`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-70::DEBUG::2014-07-10 09:13:32,157::task::595::TaskManager.Task::(_updateState) Task=`8a294774-63f3-43b4-946d-afcfc983f6a7`::moving from state preparing -> state finished >Thread-70::DEBUG::2014-07-10 09:13:32,157::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-70::DEBUG::2014-07-10 09:13:32,157::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-70::DEBUG::2014-07-10 09:13:32,158::task::990::TaskManager.Task::(_decref) Task=`8a294774-63f3-43b4-946d-afcfc983f6a7`::ref 0 aborting False >Thread-60::DEBUG::2014-07-10 09:13:33,026::task::595::TaskManager.Task::(_updateState) Task=`34ec0f32-5a9b-4f39-aea5-ca1bbed1291d`::moving from state init -> state preparing >Thread-60::INFO::2014-07-10 09:13:33,027::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='b034d5b0-e1e0-4011-b49b-4d45ddb11556', volUUID='3d7f62b5-328f-4d8e-8b69-873cfb5ae14d', options=None) >Thread-60::INFO::2014-07-10 09:13:33,027::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-60::DEBUG::2014-07-10 09:13:33,027::task::1185::TaskManager.Task::(prepare) Task=`34ec0f32-5a9b-4f39-aea5-ca1bbed1291d`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-60::DEBUG::2014-07-10 09:13:33,028::task::595::TaskManager.Task::(_updateState) Task=`34ec0f32-5a9b-4f39-aea5-ca1bbed1291d`::moving from state preparing -> state finished >Thread-60::DEBUG::2014-07-10 09:13:33,028::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-60::DEBUG::2014-07-10 09:13:33,028::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-60::DEBUG::2014-07-10 09:13:33,028::task::990::TaskManager.Task::(_decref) Task=`34ec0f32-5a9b-4f39-aea5-ca1bbed1291d`::ref 0 aborting False >Thread-51::DEBUG::2014-07-10 09:13:33,216::task::595::TaskManager.Task::(_updateState) Task=`26c2f71f-7a8c-46af-b592-8fa830e2934c`::moving from state init -> state preparing >Thread-51::INFO::2014-07-10 09:13:33,216::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='76fdb054-02cd-42ed-9721-b3e65b34c3a4', volUUID='022dfe46-2cf7-4915-80b3-883158e3ca83', options=None) >Thread-51::INFO::2014-07-10 09:13:33,216::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-51::DEBUG::2014-07-10 09:13:33,216::task::1185::TaskManager.Task::(prepare) Task=`26c2f71f-7a8c-46af-b592-8fa830e2934c`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-51::DEBUG::2014-07-10 09:13:33,217::task::595::TaskManager.Task::(_updateState) Task=`26c2f71f-7a8c-46af-b592-8fa830e2934c`::moving from state preparing -> state finished >Thread-51::DEBUG::2014-07-10 09:13:33,217::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-51::DEBUG::2014-07-10 09:13:33,217::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-51::DEBUG::2014-07-10 09:13:33,217::task::990::TaskManager.Task::(_decref) Task=`26c2f71f-7a8c-46af-b592-8fa830e2934c`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 09:13:33,356::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:13:33,445::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0310857 s, 32.9 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-10 09:13:35,417::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/metadata bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-10 09:13:35,442::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000726296 s, 5.6 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:13:35,460::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:13:35,921::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.400551 s, 2.6 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:13:37,948::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Thread-14::DEBUG::2014-07-10 09:13:37,970::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-14::DEBUG::2014-07-10 09:13:37,972::task::595::TaskManager.Task::(_updateState) Task=`3d412ea2-b2cf-469a-828a-04b7188c46f8`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 09:13:37,972::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-14::INFO::2014-07-10 09:13:37,974::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:13:37,974::task::1185::TaskManager.Task::(prepare) Task=`3d412ea2-b2cf-469a-828a-04b7188c46f8`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:13:37,975::task::595::TaskManager.Task::(_updateState) Task=`3d412ea2-b2cf-469a-828a-04b7188c46f8`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 09:13:37,975::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 09:13:37,976::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 09:13:37,977::task::990::TaskManager.Task::(_decref) Task=`3d412ea2-b2cf-469a-828a-04b7188c46f8`::ref 0 aborting False >Thread-34::DEBUG::2014-07-10 09:13:37,983::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-34::DEBUG::2014-07-10 09:13:37,984::task::595::TaskManager.Task::(_updateState) Task=`c71a396e-41ce-46f8-aded-d3b125ba4315`::moving from state init -> state preparing >Thread-34::INFO::2014-07-10 09:13:37,985::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-34::DEBUG::2014-07-10 09:13:37,987::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`8f348e68-d3d4-40fc-b364-64a94c59e4b9`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-10 09:13:37,988::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' for lock type 'shared' >Thread-34::DEBUG::2014-07-10 09:13:37,989::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-10 09:13:37,989::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`8f348e68-d3d4-40fc-b364-64a94c59e4b9`::Granted request >Thread-34::DEBUG::2014-07-10 09:13:37,991::task::827::TaskManager.Task::(resourceAcquired) Task=`c71a396e-41ce-46f8-aded-d3b125ba4315`::_resourcesAcquired: Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee (shared) >Thread-34::DEBUG::2014-07-10 09:13:37,991::task::990::TaskManager.Task::(_decref) Task=`c71a396e-41ce-46f8-aded-d3b125ba4315`::ref 1 aborting False >Thread-34::INFO::2014-07-10 09:13:37,993::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532067385344', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:13:37,993::task::1185::TaskManager.Task::(prepare) Task=`c71a396e-41ce-46f8-aded-d3b125ba4315`::finished: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532067385344', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:13:37,994::task::595::TaskManager.Task::(_updateState) Task=`c71a396e-41ce-46f8-aded-d3b125ba4315`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-10 09:13:37,995::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee': < ResourceRef 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-10 09:13:37,995::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-10 09:13:37,996::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' >Thread-34::DEBUG::2014-07-10 09:13:37,997::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' (0 active users) >Thread-34::DEBUG::2014-07-10 09:13:37,997::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-10 09:13:37,998::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', Clearing records. >Thread-34::DEBUG::2014-07-10 09:13:37,999::task::990::TaskManager.Task::(_decref) Task=`c71a396e-41ce-46f8-aded-d3b125ba4315`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 09:13:38,062::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0554965 s, 18.5 MB/s\n'; <rc> = 0 >Thread-40::DEBUG::2014-07-10 09:13:38,668::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lion.qa.lab.tlv.redhat.com:_export_yuri2_backup2/6a70504d-00df-4869-8695-0f442053f6b6/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-40::DEBUG::2014-07-10 09:13:38,694::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n369 bytes (369 B) copied, 0.000430109 s, 858 kB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:13:40,077::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:13:40,173::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0332445 s, 30.8 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:13:42,191::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:13:42,300::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0511589 s, 20.0 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 09:13:42,514::task::595::TaskManager.Task::(_updateState) Task=`06d1e189-10d9-4a35-a6bc-f6846a640035`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 09:13:42,514::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::INFO::2014-07-10 09:13:42,515::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000726296', 'lastCheck': '6.6', 'valid': True}, '6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000430109', 'lastCheck': '3.8', 'valid': True}} >Thread-14::DEBUG::2014-07-10 09:13:42,515::task::1185::TaskManager.Task::(prepare) Task=`06d1e189-10d9-4a35-a6bc-f6846a640035`::finished: {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000726296', 'lastCheck': '6.6', 'valid': True}, '6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000430109', 'lastCheck': '3.8', 'valid': True}} >Thread-14::DEBUG::2014-07-10 09:13:42,515::task::595::TaskManager.Task::(_updateState) Task=`06d1e189-10d9-4a35-a6bc-f6846a640035`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 09:13:42,515::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 09:13:42,515::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 09:13:42,516::task::990::TaskManager.Task::(_decref) Task=`06d1e189-10d9-4a35-a6bc-f6846a640035`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 09:13:44,315::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:13:44,406::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0328102 s, 31.2 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-10 09:13:45,868::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/metadata bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-10 09:13:45,890::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000958895 s, 4.3 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:13:46,431::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:13:46,526::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0386708 s, 26.5 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 09:13:48,029::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-14::DEBUG::2014-07-10 09:13:48,030::task::595::TaskManager.Task::(_updateState) Task=`7c5ac7d4-cc9f-4e13-b842-ee503fe6d8f0`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 09:13:48,030::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-14::INFO::2014-07-10 09:13:48,031::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:13:48,031::task::1185::TaskManager.Task::(prepare) Task=`7c5ac7d4-cc9f-4e13-b842-ee503fe6d8f0`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:13:48,031::task::595::TaskManager.Task::(_updateState) Task=`7c5ac7d4-cc9f-4e13-b842-ee503fe6d8f0`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 09:13:48,032::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 09:13:48,032::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 09:13:48,032::task::990::TaskManager.Task::(_decref) Task=`7c5ac7d4-cc9f-4e13-b842-ee503fe6d8f0`::ref 0 aborting False >Thread-34::DEBUG::2014-07-10 09:13:48,036::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-34::DEBUG::2014-07-10 09:13:48,037::task::595::TaskManager.Task::(_updateState) Task=`1126830e-7aab-4918-bb0d-945ab3eaf691`::moving from state init -> state preparing >Thread-34::INFO::2014-07-10 09:13:48,037::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-34::DEBUG::2014-07-10 09:13:48,037::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`86c37e9f-7406-497f-bf37-766189d987a0`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-10 09:13:48,038::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' for lock type 'shared' >Thread-34::DEBUG::2014-07-10 09:13:48,038::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-10 09:13:48,038::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`86c37e9f-7406-497f-bf37-766189d987a0`::Granted request >Thread-34::DEBUG::2014-07-10 09:13:48,039::task::827::TaskManager.Task::(resourceAcquired) Task=`1126830e-7aab-4918-bb0d-945ab3eaf691`::_resourcesAcquired: Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee (shared) >Thread-34::DEBUG::2014-07-10 09:13:48,039::task::990::TaskManager.Task::(_decref) Task=`1126830e-7aab-4918-bb0d-945ab3eaf691`::ref 1 aborting False >Thread-34::INFO::2014-07-10 09:13:48,040::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532067385344', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:13:48,040::task::1185::TaskManager.Task::(prepare) Task=`1126830e-7aab-4918-bb0d-945ab3eaf691`::finished: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532067385344', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:13:48,041::task::595::TaskManager.Task::(_updateState) Task=`1126830e-7aab-4918-bb0d-945ab3eaf691`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-10 09:13:48,041::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee': < ResourceRef 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-10 09:13:48,041::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-10 09:13:48,041::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' >Thread-34::DEBUG::2014-07-10 09:13:48,042::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' (0 active users) >Thread-34::DEBUG::2014-07-10 09:13:48,042::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-10 09:13:48,042::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', Clearing records. >Thread-34::DEBUG::2014-07-10 09:13:48,042::task::990::TaskManager.Task::(_decref) Task=`1126830e-7aab-4918-bb0d-945ab3eaf691`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 09:13:48,541::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:13:48,640::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0426955 s, 24.0 MB/s\n'; <rc> = 0 >Thread-40::DEBUG::2014-07-10 09:13:48,728::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lion.qa.lab.tlv.redhat.com:_export_yuri2_backup2/6a70504d-00df-4869-8695-0f442053f6b6/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-40::DEBUG::2014-07-10 09:13:48,750::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n369 bytes (369 B) copied, 0.000464839 s, 794 kB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:13:50,656::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:13:50,748::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0348362 s, 29.4 MB/s\n'; <rc> = 0 >Thread-64::DEBUG::2014-07-10 09:13:52,237::task::595::TaskManager.Task::(_updateState) Task=`59835b87-153d-4e2c-9398-45b81925c06d`::moving from state init -> state preparing >Thread-64::INFO::2014-07-10 09:13:52,237::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='aa20346a-4d3a-4e07-b8e1-52c0ebe4168c', volUUID='58fefce2-9bce-4bff-8949-8c6ce8122b27', options=None) >Thread-64::INFO::2014-07-10 09:13:52,238::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-64::DEBUG::2014-07-10 09:13:52,238::task::1185::TaskManager.Task::(prepare) Task=`59835b87-153d-4e2c-9398-45b81925c06d`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-64::DEBUG::2014-07-10 09:13:52,238::task::595::TaskManager.Task::(_updateState) Task=`59835b87-153d-4e2c-9398-45b81925c06d`::moving from state preparing -> state finished >Thread-64::DEBUG::2014-07-10 09:13:52,238::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-64::DEBUG::2014-07-10 09:13:52,238::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-64::DEBUG::2014-07-10 09:13:52,239::task::990::TaskManager.Task::(_decref) Task=`59835b87-153d-4e2c-9398-45b81925c06d`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 09:13:52,763::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:13:52,851::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0308969 s, 33.1 MB/s\n'; <rc> = 0 >Thread-54::DEBUG::2014-07-10 09:13:53,508::task::595::TaskManager.Task::(_updateState) Task=`52b82f7a-0697-4d73-8596-7ef593941b71`::moving from state init -> state preparing >Thread-73::DEBUG::2014-07-10 09:13:53,508::task::595::TaskManager.Task::(_updateState) Task=`98859f5b-d2fb-4960-9430-918f1841209d`::moving from state init -> state preparing >Thread-54::INFO::2014-07-10 09:13:53,510::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='28408446-e5fd-4565-a976-e760951593fe', volUUID='776303a2-5585-451e-826e-0e338d4a1e98', options=None) >Thread-73::INFO::2014-07-10 09:13:53,510::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='c01d693b-cba0-4fed-9ad7-0aaa28912a19', volUUID='4bb5d954-2a50-4028-b299-0b43c261270c', options=None) >Thread-54::INFO::2014-07-10 09:13:53,512::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-73::INFO::2014-07-10 09:13:53,512::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-54::DEBUG::2014-07-10 09:13:53,513::task::1185::TaskManager.Task::(prepare) Task=`52b82f7a-0697-4d73-8596-7ef593941b71`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-73::DEBUG::2014-07-10 09:13:53,513::task::1185::TaskManager.Task::(prepare) Task=`98859f5b-d2fb-4960-9430-918f1841209d`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-54::DEBUG::2014-07-10 09:13:53,515::task::595::TaskManager.Task::(_updateState) Task=`52b82f7a-0697-4d73-8596-7ef593941b71`::moving from state preparing -> state finished >Thread-73::DEBUG::2014-07-10 09:13:53,515::task::595::TaskManager.Task::(_updateState) Task=`98859f5b-d2fb-4960-9430-918f1841209d`::moving from state preparing -> state finished >Thread-54::DEBUG::2014-07-10 09:13:53,516::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-73::DEBUG::2014-07-10 09:13:53,516::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-54::DEBUG::2014-07-10 09:13:53,518::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-73::DEBUG::2014-07-10 09:13:53,518::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-54::DEBUG::2014-07-10 09:13:53,519::task::990::TaskManager.Task::(_decref) Task=`52b82f7a-0697-4d73-8596-7ef593941b71`::ref 0 aborting False >Thread-73::DEBUG::2014-07-10 09:13:53,520::task::990::TaskManager.Task::(_decref) Task=`98859f5b-d2fb-4960-9430-918f1841209d`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 09:13:54,866::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:13:54,954::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0310666 s, 33.0 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-10 09:13:55,920::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/metadata bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-10 09:13:55,942::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00079562 s, 5.1 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:13:56,974::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:13:57,083::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0517692 s, 19.8 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 09:13:57,686::task::595::TaskManager.Task::(_updateState) Task=`2cb5e7ef-53f5-4be2-9af3-478446a65c32`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 09:13:57,687::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::INFO::2014-07-10 09:13:57,687::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00079562', 'lastCheck': '1.7', 'valid': True}, '6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000464839', 'lastCheck': '8.9', 'valid': True}} >Thread-14::DEBUG::2014-07-10 09:13:57,687::task::1185::TaskManager.Task::(prepare) Task=`2cb5e7ef-53f5-4be2-9af3-478446a65c32`::finished: {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00079562', 'lastCheck': '1.7', 'valid': True}, '6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000464839', 'lastCheck': '8.9', 'valid': True}} >Thread-14::DEBUG::2014-07-10 09:13:57,688::task::595::TaskManager.Task::(_updateState) Task=`2cb5e7ef-53f5-4be2-9af3-478446a65c32`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 09:13:57,688::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 09:13:57,688::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 09:13:57,688::task::990::TaskManager.Task::(_decref) Task=`2cb5e7ef-53f5-4be2-9af3-478446a65c32`::ref 0 aborting False >Thread-14::DEBUG::2014-07-10 09:13:58,071::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-14::DEBUG::2014-07-10 09:13:58,072::task::595::TaskManager.Task::(_updateState) Task=`73c632dd-8a76-45f3-901e-3be48c548fbf`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 09:13:58,072::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-14::INFO::2014-07-10 09:13:58,072::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:13:58,073::task::1185::TaskManager.Task::(prepare) Task=`73c632dd-8a76-45f3-901e-3be48c548fbf`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:13:58,073::task::595::TaskManager.Task::(_updateState) Task=`73c632dd-8a76-45f3-901e-3be48c548fbf`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 09:13:58,073::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 09:13:58,073::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 09:13:58,073::task::990::TaskManager.Task::(_decref) Task=`73c632dd-8a76-45f3-901e-3be48c548fbf`::ref 0 aborting False >Thread-34::DEBUG::2014-07-10 09:13:58,116::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-34::DEBUG::2014-07-10 09:13:58,117::task::595::TaskManager.Task::(_updateState) Task=`3eb350b7-9749-4536-982c-a087a62a766a`::moving from state init -> state preparing >Thread-34::INFO::2014-07-10 09:13:58,117::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-34::DEBUG::2014-07-10 09:13:58,118::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`6a80a07c-5dd8-4e66-9a2f-be9ae54e6d20`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-10 09:13:58,118::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' for lock type 'shared' >Thread-34::DEBUG::2014-07-10 09:13:58,118::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-10 09:13:58,118::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`6a80a07c-5dd8-4e66-9a2f-be9ae54e6d20`::Granted request >Thread-34::DEBUG::2014-07-10 09:13:58,119::task::827::TaskManager.Task::(resourceAcquired) Task=`3eb350b7-9749-4536-982c-a087a62a766a`::_resourcesAcquired: Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee (shared) >Thread-34::DEBUG::2014-07-10 09:13:58,119::task::990::TaskManager.Task::(_decref) Task=`3eb350b7-9749-4536-982c-a087a62a766a`::ref 1 aborting False >Thread-34::INFO::2014-07-10 09:13:58,120::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532067385344', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:13:58,120::task::1185::TaskManager.Task::(prepare) Task=`3eb350b7-9749-4536-982c-a087a62a766a`::finished: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532067385344', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:13:58,120::task::595::TaskManager.Task::(_updateState) Task=`3eb350b7-9749-4536-982c-a087a62a766a`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-10 09:13:58,120::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee': < ResourceRef 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-10 09:13:58,121::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-10 09:13:58,121::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' >Thread-34::DEBUG::2014-07-10 09:13:58,121::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' (0 active users) >Thread-34::DEBUG::2014-07-10 09:13:58,121::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-10 09:13:58,121::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', Clearing records. >Thread-34::DEBUG::2014-07-10 09:13:58,122::task::990::TaskManager.Task::(_decref) Task=`3eb350b7-9749-4536-982c-a087a62a766a`::ref 0 aborting False >Thread-40::DEBUG::2014-07-10 09:13:58,776::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lion.qa.lab.tlv.redhat.com:_export_yuri2_backup2/6a70504d-00df-4869-8695-0f442053f6b6/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-40::DEBUG::2014-07-10 09:13:58,803::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n369 bytes (369 B) copied, 0.00864911 s, 42.7 kB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:13:59,098::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:13:59,219::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0363724 s, 28.2 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:14:01,235::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:14:01,324::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0303571 s, 33.7 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:14:03,339::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:14:03,438::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.039002 s, 26.3 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:14:05,455::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:14:05,554::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0339146 s, 30.2 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-10 09:14:05,978::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/metadata bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-10 09:14:06,076::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00083277 s, 4.9 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:14:07,569::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:14:07,662::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0295707 s, 34.6 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 09:14:08,147::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-14::DEBUG::2014-07-10 09:14:08,148::task::595::TaskManager.Task::(_updateState) Task=`ac313af7-741a-476b-abee-fd4eeb00b864`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 09:14:08,149::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-14::INFO::2014-07-10 09:14:08,149::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:14:08,150::task::1185::TaskManager.Task::(prepare) Task=`ac313af7-741a-476b-abee-fd4eeb00b864`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:14:08,150::task::595::TaskManager.Task::(_updateState) Task=`ac313af7-741a-476b-abee-fd4eeb00b864`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 09:14:08,150::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 09:14:08,150::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 09:14:08,150::task::990::TaskManager.Task::(_decref) Task=`ac313af7-741a-476b-abee-fd4eeb00b864`::ref 0 aborting False >Thread-34::DEBUG::2014-07-10 09:14:08,155::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-34::DEBUG::2014-07-10 09:14:08,155::task::595::TaskManager.Task::(_updateState) Task=`60fdfb47-5495-40e3-b64f-32e31ae6fccc`::moving from state init -> state preparing >Thread-34::INFO::2014-07-10 09:14:08,155::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-34::DEBUG::2014-07-10 09:14:08,156::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`6d42de81-866b-4e50-a7da-7910ca6c1bb3`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-10 09:14:08,156::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' for lock type 'shared' >Thread-34::DEBUG::2014-07-10 09:14:08,157::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-10 09:14:08,157::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`6d42de81-866b-4e50-a7da-7910ca6c1bb3`::Granted request >Thread-34::DEBUG::2014-07-10 09:14:08,157::task::827::TaskManager.Task::(resourceAcquired) Task=`60fdfb47-5495-40e3-b64f-32e31ae6fccc`::_resourcesAcquired: Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee (shared) >Thread-34::DEBUG::2014-07-10 09:14:08,158::task::990::TaskManager.Task::(_decref) Task=`60fdfb47-5495-40e3-b64f-32e31ae6fccc`::ref 1 aborting False >Thread-34::INFO::2014-07-10 09:14:08,159::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532067385344', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:14:08,159::task::1185::TaskManager.Task::(prepare) Task=`60fdfb47-5495-40e3-b64f-32e31ae6fccc`::finished: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532067385344', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:14:08,159::task::595::TaskManager.Task::(_updateState) Task=`60fdfb47-5495-40e3-b64f-32e31ae6fccc`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-10 09:14:08,160::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee': < ResourceRef 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-10 09:14:08,160::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-10 09:14:08,160::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' >Thread-34::DEBUG::2014-07-10 09:14:08,160::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' (0 active users) >Thread-34::DEBUG::2014-07-10 09:14:08,161::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-10 09:14:08,161::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', Clearing records. >Thread-34::DEBUG::2014-07-10 09:14:08,161::task::990::TaskManager.Task::(_decref) Task=`60fdfb47-5495-40e3-b64f-32e31ae6fccc`::ref 0 aborting False >Thread-40::DEBUG::2014-07-10 09:14:08,833::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lion.qa.lab.tlv.redhat.com:_export_yuri2_backup2/6a70504d-00df-4869-8695-0f442053f6b6/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-40::DEBUG::2014-07-10 09:14:08,852::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n369 bytes (369 B) copied, 0.000496318 s, 743 kB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:14:09,677::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:14:09,777::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0309784 s, 33.1 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:14:11,793::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:14:11,887::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0355813 s, 28.8 MB/s\n'; <rc> = 0 >Thread-57::DEBUG::2014-07-10 09:14:12,341::task::595::TaskManager.Task::(_updateState) Task=`390353c2-8bfc-4262-ba62-4634933422bc`::moving from state init -> state preparing >Thread-57::INFO::2014-07-10 09:14:12,341::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='b6f6c0da-e67f-4902-b9ac-3069571a42fe', volUUID='c4cd1da8-05b7-45e0-80b1-1183d21443d9', options=None) >Thread-57::INFO::2014-07-10 09:14:12,342::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-57::DEBUG::2014-07-10 09:14:12,342::task::1185::TaskManager.Task::(prepare) Task=`390353c2-8bfc-4262-ba62-4634933422bc`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-57::DEBUG::2014-07-10 09:14:12,342::task::595::TaskManager.Task::(_updateState) Task=`390353c2-8bfc-4262-ba62-4634933422bc`::moving from state preparing -> state finished >Thread-57::DEBUG::2014-07-10 09:14:12,343::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-57::DEBUG::2014-07-10 09:14:12,343::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-57::DEBUG::2014-07-10 09:14:12,343::task::990::TaskManager.Task::(_decref) Task=`390353c2-8bfc-4262-ba62-4634933422bc`::ref 0 aborting False >Thread-14::DEBUG::2014-07-10 09:14:12,869::task::595::TaskManager.Task::(_updateState) Task=`ce4b4375-b145-44b0-8d7e-6972136355ac`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 09:14:12,870::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::INFO::2014-07-10 09:14:12,870::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00083277', 'lastCheck': '6.7', 'valid': True}, '6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000496318', 'lastCheck': '4.0', 'valid': True}} >Thread-14::DEBUG::2014-07-10 09:14:12,871::task::1185::TaskManager.Task::(prepare) Task=`ce4b4375-b145-44b0-8d7e-6972136355ac`::finished: {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00083277', 'lastCheck': '6.7', 'valid': True}, '6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000496318', 'lastCheck': '4.0', 'valid': True}} >Thread-14::DEBUG::2014-07-10 09:14:12,871::task::595::TaskManager.Task::(_updateState) Task=`ce4b4375-b145-44b0-8d7e-6972136355ac`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 09:14:12,871::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 09:14:12,871::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 09:14:12,871::task::990::TaskManager.Task::(_decref) Task=`ce4b4375-b145-44b0-8d7e-6972136355ac`::ref 0 aborting False >Thread-67::DEBUG::2014-07-10 09:14:13,224::task::595::TaskManager.Task::(_updateState) Task=`0315155d-c603-4327-b501-7893115ebb1f`::moving from state init -> state preparing >Thread-67::INFO::2014-07-10 09:14:13,224::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='f30c2cb7-a43a-4bf5-82b5-cfe07336f65c', volUUID='b0fbb3c9-55af-4a3a-95ad-fc56a80b9cf5', options=None) >Thread-67::INFO::2014-07-10 09:14:13,225::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-67::DEBUG::2014-07-10 09:14:13,225::task::1185::TaskManager.Task::(prepare) Task=`0315155d-c603-4327-b501-7893115ebb1f`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-67::DEBUG::2014-07-10 09:14:13,225::task::595::TaskManager.Task::(_updateState) Task=`0315155d-c603-4327-b501-7893115ebb1f`::moving from state preparing -> state finished >Thread-67::DEBUG::2014-07-10 09:14:13,225::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-67::DEBUG::2014-07-10 09:14:13,226::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-67::DEBUG::2014-07-10 09:14:13,226::task::990::TaskManager.Task::(_decref) Task=`0315155d-c603-4327-b501-7893115ebb1f`::ref 0 aborting False >Thread-48::DEBUG::2014-07-10 09:14:13,573::task::595::TaskManager.Task::(_updateState) Task=`9c244d1a-4ee0-4f3a-ace3-af56ddfc5ddf`::moving from state init -> state preparing >Thread-48::INFO::2014-07-10 09:14:13,574::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='0cd7d6ce-f497-4243-a690-c57744861eea', volUUID='10b6a7dd-dc6c-43fa-ba17-92e4331b0e0b', options=None) >Thread-48::INFO::2014-07-10 09:14:13,574::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-48::DEBUG::2014-07-10 09:14:13,574::task::1185::TaskManager.Task::(prepare) Task=`9c244d1a-4ee0-4f3a-ace3-af56ddfc5ddf`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-48::DEBUG::2014-07-10 09:14:13,575::task::595::TaskManager.Task::(_updateState) Task=`9c244d1a-4ee0-4f3a-ace3-af56ddfc5ddf`::moving from state preparing -> state finished >Thread-48::DEBUG::2014-07-10 09:14:13,575::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-48::DEBUG::2014-07-10 09:14:13,575::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-48::DEBUG::2014-07-10 09:14:13,575::task::990::TaskManager.Task::(_decref) Task=`9c244d1a-4ee0-4f3a-ace3-af56ddfc5ddf`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 09:14:13,903::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:14:13,987::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0272795 s, 37.5 MB/s\n'; <rc> = 0 >Thread-76::DEBUG::2014-07-10 09:14:14,971::task::595::TaskManager.Task::(_updateState) Task=`9cce59f5-5938-43a9-b4df-181df904c25e`::moving from state init -> state preparing >Thread-76::INFO::2014-07-10 09:14:14,972::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='e4c65229-4247-4b33-b72a-f1d5ce72ad05', volUUID='cad94284-3ca9-4c30-933d-997f4460309e', options=None) >Thread-76::INFO::2014-07-10 09:14:14,972::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-76::DEBUG::2014-07-10 09:14:14,973::task::1185::TaskManager.Task::(prepare) Task=`9cce59f5-5938-43a9-b4df-181df904c25e`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-76::DEBUG::2014-07-10 09:14:14,973::task::595::TaskManager.Task::(_updateState) Task=`9cce59f5-5938-43a9-b4df-181df904c25e`::moving from state preparing -> state finished >Thread-76::DEBUG::2014-07-10 09:14:14,973::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-76::DEBUG::2014-07-10 09:14:14,973::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-76::DEBUG::2014-07-10 09:14:14,973::task::990::TaskManager.Task::(_decref) Task=`9cce59f5-5938-43a9-b4df-181df904c25e`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 09:14:16,003::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Thread-18::DEBUG::2014-07-10 09:14:16,157::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/metadata bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-10 09:14:16,261::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00049183 s, 8.3 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:14:16,617::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.107196 s, 9.6 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 09:14:18,239::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-14::DEBUG::2014-07-10 09:14:18,241::task::595::TaskManager.Task::(_updateState) Task=`c8da5398-0f51-4df7-9cf3-4fca44d76728`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 09:14:18,241::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-14::INFO::2014-07-10 09:14:18,242::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:14:18,242::task::1185::TaskManager.Task::(prepare) Task=`c8da5398-0f51-4df7-9cf3-4fca44d76728`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:14:18,242::task::595::TaskManager.Task::(_updateState) Task=`c8da5398-0f51-4df7-9cf3-4fca44d76728`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 09:14:18,243::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 09:14:18,243::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 09:14:18,243::task::990::TaskManager.Task::(_decref) Task=`c8da5398-0f51-4df7-9cf3-4fca44d76728`::ref 0 aborting False >Thread-34::DEBUG::2014-07-10 09:14:18,248::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-34::DEBUG::2014-07-10 09:14:18,248::task::595::TaskManager.Task::(_updateState) Task=`8bac4a59-d0b2-47d7-bc57-28bfeecafe07`::moving from state init -> state preparing >Thread-34::INFO::2014-07-10 09:14:18,248::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-34::DEBUG::2014-07-10 09:14:18,249::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`d1ae7ba5-47ea-4499-8dea-bd23d56470e1`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-10 09:14:18,250::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' for lock type 'shared' >Thread-34::DEBUG::2014-07-10 09:14:18,250::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-10 09:14:18,250::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`d1ae7ba5-47ea-4499-8dea-bd23d56470e1`::Granted request >Thread-34::DEBUG::2014-07-10 09:14:18,251::task::827::TaskManager.Task::(resourceAcquired) Task=`8bac4a59-d0b2-47d7-bc57-28bfeecafe07`::_resourcesAcquired: Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee (shared) >Thread-34::DEBUG::2014-07-10 09:14:18,251::task::990::TaskManager.Task::(_decref) Task=`8bac4a59-d0b2-47d7-bc57-28bfeecafe07`::ref 1 aborting False >Thread-34::INFO::2014-07-10 09:14:18,253::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532067385344', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:14:18,253::task::1185::TaskManager.Task::(prepare) Task=`8bac4a59-d0b2-47d7-bc57-28bfeecafe07`::finished: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532067385344', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:14:18,253::task::595::TaskManager.Task::(_updateState) Task=`8bac4a59-d0b2-47d7-bc57-28bfeecafe07`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-10 09:14:18,253::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee': < ResourceRef 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-10 09:14:18,253::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-10 09:14:18,254::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' >Thread-34::DEBUG::2014-07-10 09:14:18,254::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' (0 active users) >Thread-34::DEBUG::2014-07-10 09:14:18,254::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-10 09:14:18,254::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', Clearing records. >Thread-34::DEBUG::2014-07-10 09:14:18,254::task::990::TaskManager.Task::(_decref) Task=`8bac4a59-d0b2-47d7-bc57-28bfeecafe07`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 09:14:18,631::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:14:18,810::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.120941 s, 8.5 MB/s\n'; <rc> = 0 >Thread-40::DEBUG::2014-07-10 09:14:18,883::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lion.qa.lab.tlv.redhat.com:_export_yuri2_backup2/6a70504d-00df-4869-8695-0f442053f6b6/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-40::DEBUG::2014-07-10 09:14:18,906::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n369 bytes (369 B) copied, 0.000428864 s, 860 kB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:14:20,825::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:14:20,932::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0352206 s, 29.1 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:14:22,948::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:14:23,034::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0264932 s, 38.7 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:14:25,049::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:14:25,142::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0358127 s, 28.6 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-10 09:14:26,600::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/metadata bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-10 09:14:26,622::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000830713 s, 4.9 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:14:27,157::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:14:27,250::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0329463 s, 31.1 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 09:14:28,105::task::595::TaskManager.Task::(_updateState) Task=`47fedbed-eebb-4714-b439-70a88bbfb8f4`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 09:14:28,106::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::INFO::2014-07-10 09:14:28,106::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000830713', 'lastCheck': '1.5', 'valid': True}, '6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000428864', 'lastCheck': '9.2', 'valid': True}} >Thread-14::DEBUG::2014-07-10 09:14:28,107::task::1185::TaskManager.Task::(prepare) Task=`47fedbed-eebb-4714-b439-70a88bbfb8f4`::finished: {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000830713', 'lastCheck': '1.5', 'valid': True}, '6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000428864', 'lastCheck': '9.2', 'valid': True}} >Thread-14::DEBUG::2014-07-10 09:14:28,107::task::595::TaskManager.Task::(_updateState) Task=`47fedbed-eebb-4714-b439-70a88bbfb8f4`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 09:14:28,107::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 09:14:28,107::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 09:14:28,107::task::990::TaskManager.Task::(_decref) Task=`47fedbed-eebb-4714-b439-70a88bbfb8f4`::ref 0 aborting False >Thread-14::DEBUG::2014-07-10 09:14:28,284::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-14::DEBUG::2014-07-10 09:14:28,285::task::595::TaskManager.Task::(_updateState) Task=`8c17382c-7768-483f-b699-dd0283dc3bf4`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 09:14:28,285::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-14::INFO::2014-07-10 09:14:28,286::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:14:28,286::task::1185::TaskManager.Task::(prepare) Task=`8c17382c-7768-483f-b699-dd0283dc3bf4`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:14:28,286::task::595::TaskManager.Task::(_updateState) Task=`8c17382c-7768-483f-b699-dd0283dc3bf4`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 09:14:28,286::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 09:14:28,286::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 09:14:28,286::task::990::TaskManager.Task::(_decref) Task=`8c17382c-7768-483f-b699-dd0283dc3bf4`::ref 0 aborting False >Thread-34::DEBUG::2014-07-10 09:14:28,329::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-34::DEBUG::2014-07-10 09:14:28,330::task::595::TaskManager.Task::(_updateState) Task=`e9beccfe-1df3-4c29-9a2b-a46ba0a597f9`::moving from state init -> state preparing >Thread-34::INFO::2014-07-10 09:14:28,330::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-34::DEBUG::2014-07-10 09:14:28,330::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`00a170bb-ea13-450c-b11e-00a373e5867c`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-10 09:14:28,331::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' for lock type 'shared' >Thread-34::DEBUG::2014-07-10 09:14:28,331::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-10 09:14:28,331::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`00a170bb-ea13-450c-b11e-00a373e5867c`::Granted request >Thread-34::DEBUG::2014-07-10 09:14:28,332::task::827::TaskManager.Task::(resourceAcquired) Task=`e9beccfe-1df3-4c29-9a2b-a46ba0a597f9`::_resourcesAcquired: Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee (shared) >Thread-34::DEBUG::2014-07-10 09:14:28,332::task::990::TaskManager.Task::(_decref) Task=`e9beccfe-1df3-4c29-9a2b-a46ba0a597f9`::ref 1 aborting False >Thread-34::INFO::2014-07-10 09:14:28,333::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532067385344', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:14:28,333::task::1185::TaskManager.Task::(prepare) Task=`e9beccfe-1df3-4c29-9a2b-a46ba0a597f9`::finished: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532067385344', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:14:28,333::task::595::TaskManager.Task::(_updateState) Task=`e9beccfe-1df3-4c29-9a2b-a46ba0a597f9`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-10 09:14:28,333::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee': < ResourceRef 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-10 09:14:28,333::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-10 09:14:28,334::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' >Thread-34::DEBUG::2014-07-10 09:14:28,334::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' (0 active users) >Thread-34::DEBUG::2014-07-10 09:14:28,334::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-10 09:14:28,334::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', Clearing records. >Thread-34::DEBUG::2014-07-10 09:14:28,334::task::990::TaskManager.Task::(_decref) Task=`e9beccfe-1df3-4c29-9a2b-a46ba0a597f9`::ref 0 aborting False >Thread-40::DEBUG::2014-07-10 09:14:28,933::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lion.qa.lab.tlv.redhat.com:_export_yuri2_backup2/6a70504d-00df-4869-8695-0f442053f6b6/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-40::DEBUG::2014-07-10 09:14:28,954::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n369 bytes (369 B) copied, 0.000515994 s, 715 kB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:14:29,264::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:14:29,361::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0370961 s, 27.6 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:14:31,378::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:14:31,477::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0341892 s, 30.0 MB/s\n'; <rc> = 0 >Thread-70::DEBUG::2014-07-10 09:14:32,418::task::595::TaskManager.Task::(_updateState) Task=`5191e320-3ef8-48a7-be8b-4b843117d0bf`::moving from state init -> state preparing >Thread-70::INFO::2014-07-10 09:14:32,419::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='cfaeead2-7caa-467c-b389-c89840ae6605', volUUID='567fe32d-31a6-4ff6-90f3-fd6a656fbecc', options=None) >Thread-70::INFO::2014-07-10 09:14:32,419::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-70::DEBUG::2014-07-10 09:14:32,419::task::1185::TaskManager.Task::(prepare) Task=`5191e320-3ef8-48a7-be8b-4b843117d0bf`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-70::DEBUG::2014-07-10 09:14:32,420::task::595::TaskManager.Task::(_updateState) Task=`5191e320-3ef8-48a7-be8b-4b843117d0bf`::moving from state preparing -> state finished >Thread-70::DEBUG::2014-07-10 09:14:32,420::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-70::DEBUG::2014-07-10 09:14:32,421::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-70::DEBUG::2014-07-10 09:14:32,421::task::990::TaskManager.Task::(_decref) Task=`5191e320-3ef8-48a7-be8b-4b843117d0bf`::ref 0 aborting False >Thread-60::DEBUG::2014-07-10 09:14:33,305::task::595::TaskManager.Task::(_updateState) Task=`8df3cdee-4301-4efb-ba7d-539ef294248c`::moving from state init -> state preparing >Thread-60::INFO::2014-07-10 09:14:33,306::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='b034d5b0-e1e0-4011-b49b-4d45ddb11556', volUUID='3d7f62b5-328f-4d8e-8b69-873cfb5ae14d', options=None) >Thread-60::INFO::2014-07-10 09:14:33,307::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-60::DEBUG::2014-07-10 09:14:33,307::task::1185::TaskManager.Task::(prepare) Task=`8df3cdee-4301-4efb-ba7d-539ef294248c`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-60::DEBUG::2014-07-10 09:14:33,307::task::595::TaskManager.Task::(_updateState) Task=`8df3cdee-4301-4efb-ba7d-539ef294248c`::moving from state preparing -> state finished >Thread-60::DEBUG::2014-07-10 09:14:33,307::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-60::DEBUG::2014-07-10 09:14:33,307::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-60::DEBUG::2014-07-10 09:14:33,308::task::990::TaskManager.Task::(_decref) Task=`8df3cdee-4301-4efb-ba7d-539ef294248c`::ref 0 aborting False >Thread-51::DEBUG::2014-07-10 09:14:33,469::task::595::TaskManager.Task::(_updateState) Task=`5c4a6907-6597-4802-b746-907834a95d01`::moving from state init -> state preparing >Thread-51::INFO::2014-07-10 09:14:33,469::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='76fdb054-02cd-42ed-9721-b3e65b34c3a4', volUUID='022dfe46-2cf7-4915-80b3-883158e3ca83', options=None) >Thread-51::INFO::2014-07-10 09:14:33,470::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-51::DEBUG::2014-07-10 09:14:33,470::task::1185::TaskManager.Task::(prepare) Task=`5c4a6907-6597-4802-b746-907834a95d01`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-51::DEBUG::2014-07-10 09:14:33,470::task::595::TaskManager.Task::(_updateState) Task=`5c4a6907-6597-4802-b746-907834a95d01`::moving from state preparing -> state finished >Thread-51::DEBUG::2014-07-10 09:14:33,470::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-51::DEBUG::2014-07-10 09:14:33,470::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-51::DEBUG::2014-07-10 09:14:33,471::task::990::TaskManager.Task::(_decref) Task=`5c4a6907-6597-4802-b746-907834a95d01`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 09:14:33,493::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:14:33,581::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0318111 s, 32.2 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:14:35,596::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:14:35,689::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0358404 s, 28.6 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-10 09:14:36,652::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/metadata bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-10 09:14:36,674::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000994687 s, 4.1 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:14:37,706::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:14:37,804::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.038832 s, 26.4 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 09:14:38,356::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-14::DEBUG::2014-07-10 09:14:38,358::task::595::TaskManager.Task::(_updateState) Task=`c4fa6c88-07e7-4ae3-8781-20d3f1a8efe9`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 09:14:38,358::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-14::INFO::2014-07-10 09:14:38,359::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:14:38,359::task::1185::TaskManager.Task::(prepare) Task=`c4fa6c88-07e7-4ae3-8781-20d3f1a8efe9`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:14:38,359::task::595::TaskManager.Task::(_updateState) Task=`c4fa6c88-07e7-4ae3-8781-20d3f1a8efe9`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 09:14:38,359::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 09:14:38,359::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 09:14:38,360::task::990::TaskManager.Task::(_decref) Task=`c4fa6c88-07e7-4ae3-8781-20d3f1a8efe9`::ref 0 aborting False >Thread-34::DEBUG::2014-07-10 09:14:38,364::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-34::DEBUG::2014-07-10 09:14:38,364::task::595::TaskManager.Task::(_updateState) Task=`bdf860f8-ce2f-4c4b-b29b-2159326b54c4`::moving from state init -> state preparing >Thread-34::INFO::2014-07-10 09:14:38,365::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-34::DEBUG::2014-07-10 09:14:38,365::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`dc28bf6f-b56e-4a6d-9466-68e4e6e32e60`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-10 09:14:38,366::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' for lock type 'shared' >Thread-34::DEBUG::2014-07-10 09:14:38,366::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-10 09:14:38,366::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`dc28bf6f-b56e-4a6d-9466-68e4e6e32e60`::Granted request >Thread-34::DEBUG::2014-07-10 09:14:38,367::task::827::TaskManager.Task::(resourceAcquired) Task=`bdf860f8-ce2f-4c4b-b29b-2159326b54c4`::_resourcesAcquired: Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee (shared) >Thread-34::DEBUG::2014-07-10 09:14:38,367::task::990::TaskManager.Task::(_decref) Task=`bdf860f8-ce2f-4c4b-b29b-2159326b54c4`::ref 1 aborting False >Thread-34::INFO::2014-07-10 09:14:38,368::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532067385344', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:14:38,368::task::1185::TaskManager.Task::(prepare) Task=`bdf860f8-ce2f-4c4b-b29b-2159326b54c4`::finished: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532067385344', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:14:38,369::task::595::TaskManager.Task::(_updateState) Task=`bdf860f8-ce2f-4c4b-b29b-2159326b54c4`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-10 09:14:38,369::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee': < ResourceRef 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-10 09:14:38,369::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-10 09:14:38,369::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' >Thread-34::DEBUG::2014-07-10 09:14:38,370::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' (0 active users) >Thread-34::DEBUG::2014-07-10 09:14:38,370::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-10 09:14:38,370::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', Clearing records. >Thread-34::DEBUG::2014-07-10 09:14:38,370::task::990::TaskManager.Task::(_decref) Task=`bdf860f8-ce2f-4c4b-b29b-2159326b54c4`::ref 0 aborting False >Thread-40::DEBUG::2014-07-10 09:14:38,987::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lion.qa.lab.tlv.redhat.com:_export_yuri2_backup2/6a70504d-00df-4869-8695-0f442053f6b6/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-40::DEBUG::2014-07-10 09:14:39,007::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n369 bytes (369 B) copied, 0.000487445 s, 757 kB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:14:39,820::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:14:39,907::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0293097 s, 34.9 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:14:41,922::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:14:42,019::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0366974 s, 27.9 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 09:14:43,285::task::595::TaskManager.Task::(_updateState) Task=`bf27d629-1427-48d6-b308-dd9920d95504`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 09:14:43,285::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::INFO::2014-07-10 09:14:43,286::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000994687', 'lastCheck': '6.6', 'valid': True}, '6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000487445', 'lastCheck': '4.3', 'valid': True}} >Thread-14::DEBUG::2014-07-10 09:14:43,286::task::1185::TaskManager.Task::(prepare) Task=`bf27d629-1427-48d6-b308-dd9920d95504`::finished: {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000994687', 'lastCheck': '6.6', 'valid': True}, '6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000487445', 'lastCheck': '4.3', 'valid': True}} >Thread-14::DEBUG::2014-07-10 09:14:43,286::task::595::TaskManager.Task::(_updateState) Task=`bf27d629-1427-48d6-b308-dd9920d95504`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 09:14:43,286::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 09:14:43,287::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 09:14:43,287::task::990::TaskManager.Task::(_decref) Task=`bf27d629-1427-48d6-b308-dd9920d95504`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 09:14:44,035::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:14:44,121::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0294612 s, 34.8 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:14:46,137::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:14:46,241::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0328865 s, 31.1 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-10 09:14:46,705::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/metadata bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-10 09:14:46,771::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000692627 s, 5.9 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:14:48,256::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:14:48,348::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0350255 s, 29.2 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 09:14:48,406::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-14::DEBUG::2014-07-10 09:14:48,409::task::595::TaskManager.Task::(_updateState) Task=`14792e1a-be90-4ce5-9bf9-0a7f599cb271`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 09:14:48,410::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-14::INFO::2014-07-10 09:14:48,410::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:14:48,411::task::1185::TaskManager.Task::(prepare) Task=`14792e1a-be90-4ce5-9bf9-0a7f599cb271`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:14:48,411::task::595::TaskManager.Task::(_updateState) Task=`14792e1a-be90-4ce5-9bf9-0a7f599cb271`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 09:14:48,411::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 09:14:48,411::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 09:14:48,411::task::990::TaskManager.Task::(_decref) Task=`14792e1a-be90-4ce5-9bf9-0a7f599cb271`::ref 0 aborting False >Thread-34::DEBUG::2014-07-10 09:14:48,416::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-34::DEBUG::2014-07-10 09:14:48,416::task::595::TaskManager.Task::(_updateState) Task=`da649fba-f852-475a-aedb-83aa1e19e60a`::moving from state init -> state preparing >Thread-34::INFO::2014-07-10 09:14:48,416::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-34::DEBUG::2014-07-10 09:14:48,417::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`0604d4d7-2d03-4428-8a4a-65228709100d`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-10 09:14:48,418::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' for lock type 'shared' >Thread-34::DEBUG::2014-07-10 09:14:48,418::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-10 09:14:48,418::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`0604d4d7-2d03-4428-8a4a-65228709100d`::Granted request >Thread-34::DEBUG::2014-07-10 09:14:48,419::task::827::TaskManager.Task::(resourceAcquired) Task=`da649fba-f852-475a-aedb-83aa1e19e60a`::_resourcesAcquired: Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee (shared) >Thread-34::DEBUG::2014-07-10 09:14:48,419::task::990::TaskManager.Task::(_decref) Task=`da649fba-f852-475a-aedb-83aa1e19e60a`::ref 1 aborting False >Thread-34::INFO::2014-07-10 09:14:48,420::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532067385344', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:14:48,421::task::1185::TaskManager.Task::(prepare) Task=`da649fba-f852-475a-aedb-83aa1e19e60a`::finished: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532067385344', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:14:48,421::task::595::TaskManager.Task::(_updateState) Task=`da649fba-f852-475a-aedb-83aa1e19e60a`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-10 09:14:48,421::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee': < ResourceRef 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-10 09:14:48,421::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-10 09:14:48,422::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' >Thread-34::DEBUG::2014-07-10 09:14:48,422::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' (0 active users) >Thread-34::DEBUG::2014-07-10 09:14:48,422::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-10 09:14:48,422::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', Clearing records. >Thread-34::DEBUG::2014-07-10 09:14:48,422::task::990::TaskManager.Task::(_decref) Task=`da649fba-f852-475a-aedb-83aa1e19e60a`::ref 0 aborting False >Thread-40::DEBUG::2014-07-10 09:14:49,033::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lion.qa.lab.tlv.redhat.com:_export_yuri2_backup2/6a70504d-00df-4869-8695-0f442053f6b6/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-40::DEBUG::2014-07-10 09:14:49,053::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n369 bytes (369 B) copied, 0.000454973 s, 811 kB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:14:50,364::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:14:50,468::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0440657 s, 23.2 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:14:52,483::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Thread-64::DEBUG::2014-07-10 09:14:52,512::task::595::TaskManager.Task::(_updateState) Task=`02ccc268-fd90-4bc3-a768-f13514600c99`::moving from state init -> state preparing >Thread-64::INFO::2014-07-10 09:14:52,516::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='aa20346a-4d3a-4e07-b8e1-52c0ebe4168c', volUUID='58fefce2-9bce-4bff-8949-8c6ce8122b27', options=None) >Thread-64::INFO::2014-07-10 09:14:52,520::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-64::DEBUG::2014-07-10 09:14:52,522::task::1185::TaskManager.Task::(prepare) Task=`02ccc268-fd90-4bc3-a768-f13514600c99`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-64::DEBUG::2014-07-10 09:14:52,524::task::595::TaskManager.Task::(_updateState) Task=`02ccc268-fd90-4bc3-a768-f13514600c99`::moving from state preparing -> state finished >Thread-64::DEBUG::2014-07-10 09:14:52,526::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-64::DEBUG::2014-07-10 09:14:52,528::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-64::DEBUG::2014-07-10 09:14:52,532::task::990::TaskManager.Task::(_decref) Task=`02ccc268-fd90-4bc3-a768-f13514600c99`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 09:14:52,611::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0667654 s, 15.3 MB/s\n'; <rc> = 0 >Thread-54::DEBUG::2014-07-10 09:14:53,813::task::595::TaskManager.Task::(_updateState) Task=`1a96287d-431a-4b69-90de-d1759a8c0093`::moving from state init -> state preparing >Thread-54::INFO::2014-07-10 09:14:53,815::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='28408446-e5fd-4565-a976-e760951593fe', volUUID='776303a2-5585-451e-826e-0e338d4a1e98', options=None) >Thread-73::DEBUG::2014-07-10 09:14:53,815::task::595::TaskManager.Task::(_updateState) Task=`017ffc46-d1f6-4b0e-8677-0bb932623e9b`::moving from state init -> state preparing >Thread-54::INFO::2014-07-10 09:14:53,817::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-73::INFO::2014-07-10 09:14:53,817::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='c01d693b-cba0-4fed-9ad7-0aaa28912a19', volUUID='4bb5d954-2a50-4028-b299-0b43c261270c', options=None) >Thread-54::DEBUG::2014-07-10 09:14:53,818::task::1185::TaskManager.Task::(prepare) Task=`1a96287d-431a-4b69-90de-d1759a8c0093`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-54::DEBUG::2014-07-10 09:14:53,819::task::595::TaskManager.Task::(_updateState) Task=`1a96287d-431a-4b69-90de-d1759a8c0093`::moving from state preparing -> state finished >Thread-73::INFO::2014-07-10 09:14:53,819::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-54::DEBUG::2014-07-10 09:14:53,820::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-73::DEBUG::2014-07-10 09:14:53,820::task::1185::TaskManager.Task::(prepare) Task=`017ffc46-d1f6-4b0e-8677-0bb932623e9b`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-54::DEBUG::2014-07-10 09:14:53,821::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-73::DEBUG::2014-07-10 09:14:53,822::task::595::TaskManager.Task::(_updateState) Task=`017ffc46-d1f6-4b0e-8677-0bb932623e9b`::moving from state preparing -> state finished >Thread-54::DEBUG::2014-07-10 09:14:53,822::task::990::TaskManager.Task::(_decref) Task=`1a96287d-431a-4b69-90de-d1759a8c0093`::ref 0 aborting False >Thread-73::DEBUG::2014-07-10 09:14:53,823::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-73::DEBUG::2014-07-10 09:14:53,824::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-73::DEBUG::2014-07-10 09:14:53,824::task::990::TaskManager.Task::(_decref) Task=`017ffc46-d1f6-4b0e-8677-0bb932623e9b`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 09:14:54,626::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:14:54,725::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0263904 s, 38.8 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:14:56,741::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Thread-18::DEBUG::2014-07-10 09:14:56,832::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/metadata bs=4096 count=1' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:14:56,866::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0357446 s, 28.6 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-10 09:14:56,890::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00789913 s, 519 kB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 09:14:58,460::task::595::TaskManager.Task::(_updateState) Task=`f50c9064-6e7c-48a9-bbdc-ffe8278fcb2f`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 09:14:58,461::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::INFO::2014-07-10 09:14:58,461::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00789913', 'lastCheck': '1.3', 'valid': True}, '6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000454973', 'lastCheck': '9.4', 'valid': True}} >Thread-14::DEBUG::2014-07-10 09:14:58,461::task::1185::TaskManager.Task::(prepare) Task=`f50c9064-6e7c-48a9-bbdc-ffe8278fcb2f`::finished: {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00789913', 'lastCheck': '1.3', 'valid': True}, '6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000454973', 'lastCheck': '9.4', 'valid': True}} >Thread-14::DEBUG::2014-07-10 09:14:58,462::task::595::TaskManager.Task::(_updateState) Task=`f50c9064-6e7c-48a9-bbdc-ffe8278fcb2f`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 09:14:58,462::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 09:14:58,462::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 09:14:58,462::task::990::TaskManager.Task::(_decref) Task=`f50c9064-6e7c-48a9-bbdc-ffe8278fcb2f`::ref 0 aborting False >Thread-13::DEBUG::2014-07-10 09:14:58,489::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-13::DEBUG::2014-07-10 09:14:58,490::task::595::TaskManager.Task::(_updateState) Task=`e34b01d0-2eb6-40b6-bb9e-b0140066a81a`::moving from state init -> state preparing >Thread-13::INFO::2014-07-10 09:14:58,490::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-13::INFO::2014-07-10 09:14:58,491::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-13::DEBUG::2014-07-10 09:14:58,492::task::1185::TaskManager.Task::(prepare) Task=`e34b01d0-2eb6-40b6-bb9e-b0140066a81a`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-13::DEBUG::2014-07-10 09:14:58,492::task::595::TaskManager.Task::(_updateState) Task=`e34b01d0-2eb6-40b6-bb9e-b0140066a81a`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-07-10 09:14:58,492::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-07-10 09:14:58,492::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-07-10 09:14:58,493::task::990::TaskManager.Task::(_decref) Task=`e34b01d0-2eb6-40b6-bb9e-b0140066a81a`::ref 0 aborting False >Thread-34::DEBUG::2014-07-10 09:14:58,496::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-34::DEBUG::2014-07-10 09:14:58,497::task::595::TaskManager.Task::(_updateState) Task=`804391d6-d160-4c57-b6df-82245ac86931`::moving from state init -> state preparing >Thread-34::INFO::2014-07-10 09:14:58,497::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-34::DEBUG::2014-07-10 09:14:58,497::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`b8b3704c-3202-4f8e-b15b-77e7138f6715`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-10 09:14:58,498::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' for lock type 'shared' >Thread-34::DEBUG::2014-07-10 09:14:58,498::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-10 09:14:58,498::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`b8b3704c-3202-4f8e-b15b-77e7138f6715`::Granted request >Thread-34::DEBUG::2014-07-10 09:14:58,499::task::827::TaskManager.Task::(resourceAcquired) Task=`804391d6-d160-4c57-b6df-82245ac86931`::_resourcesAcquired: Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee (shared) >Thread-34::DEBUG::2014-07-10 09:14:58,499::task::990::TaskManager.Task::(_decref) Task=`804391d6-d160-4c57-b6df-82245ac86931`::ref 1 aborting False >Thread-34::INFO::2014-07-10 09:14:58,500::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532067385344', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:14:58,500::task::1185::TaskManager.Task::(prepare) Task=`804391d6-d160-4c57-b6df-82245ac86931`::finished: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532067385344', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:14:58,500::task::595::TaskManager.Task::(_updateState) Task=`804391d6-d160-4c57-b6df-82245ac86931`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-10 09:14:58,500::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee': < ResourceRef 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-10 09:14:58,500::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-10 09:14:58,501::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' >Thread-34::DEBUG::2014-07-10 09:14:58,501::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' (0 active users) >Thread-34::DEBUG::2014-07-10 09:14:58,501::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-10 09:14:58,501::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', Clearing records. >Thread-34::DEBUG::2014-07-10 09:14:58,501::task::990::TaskManager.Task::(_decref) Task=`804391d6-d160-4c57-b6df-82245ac86931`::ref 0 aborting False >Thread-40::DEBUG::2014-07-10 09:14:59,079::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lion.qa.lab.tlv.redhat.com:_export_yuri2_backup2/6a70504d-00df-4869-8695-0f442053f6b6/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-40::DEBUG::2014-07-10 09:14:59,101::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n369 bytes (369 B) copied, 0.000441257 s, 836 kB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:14:59,201::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:14:59,329::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.032684 s, 31.3 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:15:01,345::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:15:01,456::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0302725 s, 33.8 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:15:03,480::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:15:03,569::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0307919 s, 33.3 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:15:05,585::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:15:05,682::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.037747 s, 27.1 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-10 09:15:07,196::domainMonitor::192::Storage.DomainMonitorThread::(_monitorDomain) Refreshing domain 9e1aa540-1f4e-4ee3-a152-be381ef6c3bd >Thread-18::DEBUG::2014-07-10 09:15:07,197::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with LvMetadataRW backend >Thread-18::DEBUG::2014-07-10 09:15:07,197::blockSD::336::Storage.Misc.excCmd::(readlines) '/bin/dd iflag=direct skip=0 bs=2048 if=/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/metadata count=1' (cwd None) >Thread-18::DEBUG::2014-07-10 09:15:07,218::blockSD::336::Storage.Misc.excCmd::(readlines) SUCCESS: <err> = '1+0 records in\n1+0 records out\n2048 bytes (2.0 kB) copied, 0.000545844 s, 3.8 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-10 09:15:07,219::misc::282::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '2048 bytes (2.0 kB) copied, 0.000545844 s, 3.8 MB/s'], size: 2048 >Thread-18::DEBUG::2014-07-10 09:15:07,219::persistentDict::234::Storage.PersistentDict::(refresh) read lines (LvMetadataRW)=[] >Thread-18::WARNING::2014-07-10 09:15:07,219::persistentDict::256::Storage.PersistentDict::(refresh) data has no embedded checksum - trust it as it is >Thread-18::DEBUG::2014-07-10 09:15:07,220::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with VGTagMetadataRW backend >Thread-18::DEBUG::2014-07-10 09:15:07,220::lvm::503::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-18::DEBUG::2014-07-10 09:15:07,221::lvm::505::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-18::DEBUG::2014-07-10 09:15:07,227::lvm::513::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-18::DEBUG::2014-07-10 09:15:07,235::lvm::525::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-18::DEBUG::2014-07-10 09:15:07,245::lvm::373::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-18::DEBUG::2014-07-10 09:15:07,261::lvm::296::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/3600601601282300032826addbbdae311|/dev/mapper/360060160f4a030003840ec867ddee311|/dev/mapper/367cad74c2fcba00019e6afd20c781e67|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name 9e1aa540-1f4e-4ee3-a152-be381ef6c3bd' (cwd None) >Thread-18::DEBUG::2014-07-10 09:15:07,596::lvm::296::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-18::DEBUG::2014-07-10 09:15:07,599::lvm::415::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-18::DEBUG::2014-07-10 09:15:07,600::persistentDict::234::Storage.PersistentDict::(refresh) read lines (VGTagMetadataRW)=['LEASETIMESEC=60', 'VGUUID=9CsMxb-YbRc-yRG7-cQKD-xY3G-GLi5-YxUyPC', 'VERSION=3', 'TYPE=ISCSI', 'LOGBLKSIZE=512', u'PV0=pv:3600601601282300032826addbbdae311,uuid:7qEb8v-jk2X-3CPk-k4XB-eIBk-onYD-807hcV,pestart:0,pecount:8189,mapoffset:0', 'LEASERETRIES=3', 'IOOPTIMEOUTSEC=10', 'LOCKRENEWALINTERVALSEC=5', 'PHYBLKSIZE=512', 'SDUUID=9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'CLASS=Data', 'LOCKPOLICY=', 'DESCRIPTION=SD_REAL', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=DC_REAL', 'ROLE=Master', 'POOL_UUID=4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', 'POOL_SPM_ID=1', 'POOL_SPM_LVER=0', '_SHA_CKSUM=013b5a7910962201c4cceab31b9c6d9c79f7316f', u'POOL_DOMAINS=9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active'] >Thread-18::INFO::2014-07-10 09:15:07,601::sd::384::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 9e1aa540-1f4e-4ee3-a152-be381ef6c3bd_imageNS already registered >Thread-18::INFO::2014-07-10 09:15:07,601::sd::392::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 9e1aa540-1f4e-4ee3-a152-be381ef6c3bd_volumeNS already registered >Thread-18::INFO::2014-07-10 09:15:07,601::blockSD::452::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 9e1aa540-1f4e-4ee3-a152-be381ef6c3bd_lvmActivationNS already registered >Thread-18::DEBUG::2014-07-10 09:15:07,602::lvm::296::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgck --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/3600601601282300032826addbbdae311|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } " 9e1aa540-1f4e-4ee3-a152-be381ef6c3bd' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:15:07,698::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:15:07,797::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0401253 s, 25.5 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-10 09:15:07,813::lvm::296::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-18::DEBUG::2014-07-10 09:15:07,814::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/metadata bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-10 09:15:07,837::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000462127 s, 8.9 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 09:15:08,542::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-14::DEBUG::2014-07-10 09:15:08,543::task::595::TaskManager.Task::(_updateState) Task=`2bc91c39-d69a-4505-b5f4-ea0d127f6699`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 09:15:08,544::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-14::INFO::2014-07-10 09:15:08,544::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:15:08,544::task::1185::TaskManager.Task::(prepare) Task=`2bc91c39-d69a-4505-b5f4-ea0d127f6699`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:15:08,545::task::595::TaskManager.Task::(_updateState) Task=`2bc91c39-d69a-4505-b5f4-ea0d127f6699`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 09:15:08,545::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 09:15:08,545::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 09:15:08,545::task::990::TaskManager.Task::(_decref) Task=`2bc91c39-d69a-4505-b5f4-ea0d127f6699`::ref 0 aborting False >Thread-34::DEBUG::2014-07-10 09:15:08,550::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-34::DEBUG::2014-07-10 09:15:08,550::task::595::TaskManager.Task::(_updateState) Task=`9d7b6910-87ca-414a-ab41-e16ba8c89439`::moving from state init -> state preparing >Thread-34::INFO::2014-07-10 09:15:08,551::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-34::DEBUG::2014-07-10 09:15:08,552::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`210af997-fbcc-46b9-8ab4-c77160e391f4`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-10 09:15:08,552::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' for lock type 'shared' >Thread-34::DEBUG::2014-07-10 09:15:08,552::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-10 09:15:08,552::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`210af997-fbcc-46b9-8ab4-c77160e391f4`::Granted request >Thread-34::DEBUG::2014-07-10 09:15:08,553::task::827::TaskManager.Task::(resourceAcquired) Task=`9d7b6910-87ca-414a-ab41-e16ba8c89439`::_resourcesAcquired: Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee (shared) >Thread-34::DEBUG::2014-07-10 09:15:08,553::task::990::TaskManager.Task::(_decref) Task=`9d7b6910-87ca-414a-ab41-e16ba8c89439`::ref 1 aborting False >Thread-34::INFO::2014-07-10 09:15:08,554::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532067385344', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:15:08,555::task::1185::TaskManager.Task::(prepare) Task=`9d7b6910-87ca-414a-ab41-e16ba8c89439`::finished: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532067385344', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:15:08,555::task::595::TaskManager.Task::(_updateState) Task=`9d7b6910-87ca-414a-ab41-e16ba8c89439`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-10 09:15:08,555::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee': < ResourceRef 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-10 09:15:08,555::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-10 09:15:08,555::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' >Thread-34::DEBUG::2014-07-10 09:15:08,556::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' (0 active users) >Thread-34::DEBUG::2014-07-10 09:15:08,556::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-10 09:15:08,556::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', Clearing records. >Thread-34::DEBUG::2014-07-10 09:15:08,556::task::990::TaskManager.Task::(_decref) Task=`9d7b6910-87ca-414a-ab41-e16ba8c89439`::ref 0 aborting False >Thread-40::DEBUG::2014-07-10 09:15:09,542::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lion.qa.lab.tlv.redhat.com:_export_yuri2_backup2/6a70504d-00df-4869-8695-0f442053f6b6/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-40::DEBUG::2014-07-10 09:15:09,563::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n369 bytes (369 B) copied, 0.000403612 s, 914 kB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:15:09,812::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:15:09,912::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0450842 s, 22.7 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:15:11,928::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:15:12,025::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0387374 s, 26.4 MB/s\n'; <rc> = 0 >Thread-57::DEBUG::2014-07-10 09:15:12,603::task::595::TaskManager.Task::(_updateState) Task=`f16d1703-a2ad-48fa-89df-917658825141`::moving from state init -> state preparing >Thread-57::INFO::2014-07-10 09:15:12,604::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='b6f6c0da-e67f-4902-b9ac-3069571a42fe', volUUID='c4cd1da8-05b7-45e0-80b1-1183d21443d9', options=None) >Thread-57::INFO::2014-07-10 09:15:12,604::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-57::DEBUG::2014-07-10 09:15:12,604::task::1185::TaskManager.Task::(prepare) Task=`f16d1703-a2ad-48fa-89df-917658825141`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-57::DEBUG::2014-07-10 09:15:12,604::task::595::TaskManager.Task::(_updateState) Task=`f16d1703-a2ad-48fa-89df-917658825141`::moving from state preparing -> state finished >Thread-57::DEBUG::2014-07-10 09:15:12,605::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-57::DEBUG::2014-07-10 09:15:12,605::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-57::DEBUG::2014-07-10 09:15:12,605::task::990::TaskManager.Task::(_decref) Task=`f16d1703-a2ad-48fa-89df-917658825141`::ref 0 aborting False >Thread-67::DEBUG::2014-07-10 09:15:13,489::task::595::TaskManager.Task::(_updateState) Task=`feb018e5-5ff8-44ed-9d5d-f7ad260472eb`::moving from state init -> state preparing >Thread-67::INFO::2014-07-10 09:15:13,490::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='f30c2cb7-a43a-4bf5-82b5-cfe07336f65c', volUUID='b0fbb3c9-55af-4a3a-95ad-fc56a80b9cf5', options=None) >Thread-67::INFO::2014-07-10 09:15:13,490::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-67::DEBUG::2014-07-10 09:15:13,491::task::1185::TaskManager.Task::(prepare) Task=`feb018e5-5ff8-44ed-9d5d-f7ad260472eb`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-67::DEBUG::2014-07-10 09:15:13,491::task::595::TaskManager.Task::(_updateState) Task=`feb018e5-5ff8-44ed-9d5d-f7ad260472eb`::moving from state preparing -> state finished >Thread-67::DEBUG::2014-07-10 09:15:13,491::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-67::DEBUG::2014-07-10 09:15:13,491::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-67::DEBUG::2014-07-10 09:15:13,492::task::990::TaskManager.Task::(_decref) Task=`feb018e5-5ff8-44ed-9d5d-f7ad260472eb`::ref 0 aborting False >Thread-14::DEBUG::2014-07-10 09:15:13,653::task::595::TaskManager.Task::(_updateState) Task=`f47936d3-8ef8-4032-b01d-9a0095b4434c`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 09:15:13,654::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::INFO::2014-07-10 09:15:13,654::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000462127', 'lastCheck': '5.8', 'valid': True}, '6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000403612', 'lastCheck': '4.1', 'valid': True}} >Thread-14::DEBUG::2014-07-10 09:15:13,655::task::1185::TaskManager.Task::(prepare) Task=`f47936d3-8ef8-4032-b01d-9a0095b4434c`::finished: {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000462127', 'lastCheck': '5.8', 'valid': True}, '6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000403612', 'lastCheck': '4.1', 'valid': True}} >Thread-14::DEBUG::2014-07-10 09:15:13,655::task::595::TaskManager.Task::(_updateState) Task=`f47936d3-8ef8-4032-b01d-9a0095b4434c`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 09:15:13,655::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 09:15:13,655::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 09:15:13,655::task::990::TaskManager.Task::(_decref) Task=`f47936d3-8ef8-4032-b01d-9a0095b4434c`::ref 0 aborting False >Thread-48::DEBUG::2014-07-10 09:15:13,857::task::595::TaskManager.Task::(_updateState) Task=`53b32baf-84d1-4d61-9179-37b459b07487`::moving from state init -> state preparing >Thread-48::INFO::2014-07-10 09:15:13,858::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='0cd7d6ce-f497-4243-a690-c57744861eea', volUUID='10b6a7dd-dc6c-43fa-ba17-92e4331b0e0b', options=None) >Thread-48::INFO::2014-07-10 09:15:13,858::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-48::DEBUG::2014-07-10 09:15:13,858::task::1185::TaskManager.Task::(prepare) Task=`53b32baf-84d1-4d61-9179-37b459b07487`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-48::DEBUG::2014-07-10 09:15:13,859::task::595::TaskManager.Task::(_updateState) Task=`53b32baf-84d1-4d61-9179-37b459b07487`::moving from state preparing -> state finished >Thread-48::DEBUG::2014-07-10 09:15:13,859::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-48::DEBUG::2014-07-10 09:15:13,859::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-48::DEBUG::2014-07-10 09:15:13,859::task::990::TaskManager.Task::(_decref) Task=`53b32baf-84d1-4d61-9179-37b459b07487`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 09:15:14,040::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:15:14,137::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0358592 s, 28.6 MB/s\n'; <rc> = 0 >Thread-76::DEBUG::2014-07-10 09:15:15,266::task::595::TaskManager.Task::(_updateState) Task=`9e5a67ab-deae-43b5-8442-6ac769ae72c2`::moving from state init -> state preparing >Thread-76::INFO::2014-07-10 09:15:15,267::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='e4c65229-4247-4b33-b72a-f1d5ce72ad05', volUUID='cad94284-3ca9-4c30-933d-997f4460309e', options=None) >Thread-76::INFO::2014-07-10 09:15:15,268::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-76::DEBUG::2014-07-10 09:15:15,268::task::1185::TaskManager.Task::(prepare) Task=`9e5a67ab-deae-43b5-8442-6ac769ae72c2`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-76::DEBUG::2014-07-10 09:15:15,268::task::595::TaskManager.Task::(_updateState) Task=`9e5a67ab-deae-43b5-8442-6ac769ae72c2`::moving from state preparing -> state finished >Thread-76::DEBUG::2014-07-10 09:15:15,268::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-76::DEBUG::2014-07-10 09:15:15,268::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-76::DEBUG::2014-07-10 09:15:15,269::task::990::TaskManager.Task::(_decref) Task=`9e5a67ab-deae-43b5-8442-6ac769ae72c2`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 09:15:16,152::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:15:16,260::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0330151 s, 31.0 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-10 09:15:17,870::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/metadata bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-10 09:15:17,892::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00091064 s, 4.5 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:15:18,275::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:15:18,368::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.035108 s, 29.2 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 09:15:18,592::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-14::DEBUG::2014-07-10 09:15:18,593::task::595::TaskManager.Task::(_updateState) Task=`7cba3ee6-8baf-4119-a844-b914fc717d39`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 09:15:18,593::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-14::INFO::2014-07-10 09:15:18,594::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:15:18,594::task::1185::TaskManager.Task::(prepare) Task=`7cba3ee6-8baf-4119-a844-b914fc717d39`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:15:18,594::task::595::TaskManager.Task::(_updateState) Task=`7cba3ee6-8baf-4119-a844-b914fc717d39`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 09:15:18,594::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 09:15:18,594::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 09:15:18,594::task::990::TaskManager.Task::(_decref) Task=`7cba3ee6-8baf-4119-a844-b914fc717d39`::ref 0 aborting False >Thread-34::DEBUG::2014-07-10 09:15:18,599::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-34::DEBUG::2014-07-10 09:15:18,599::task::595::TaskManager.Task::(_updateState) Task=`b262f98f-bf46-4549-acd7-3c4d417ddf2b`::moving from state init -> state preparing >Thread-34::INFO::2014-07-10 09:15:18,599::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-34::DEBUG::2014-07-10 09:15:18,600::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`bdc31590-35cc-4ae8-98b1-eda2ad5b7d1a`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-10 09:15:18,600::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' for lock type 'shared' >Thread-34::DEBUG::2014-07-10 09:15:18,600::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-10 09:15:18,601::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`bdc31590-35cc-4ae8-98b1-eda2ad5b7d1a`::Granted request >Thread-34::DEBUG::2014-07-10 09:15:18,601::task::827::TaskManager.Task::(resourceAcquired) Task=`b262f98f-bf46-4549-acd7-3c4d417ddf2b`::_resourcesAcquired: Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee (shared) >Thread-34::DEBUG::2014-07-10 09:15:18,601::task::990::TaskManager.Task::(_decref) Task=`b262f98f-bf46-4549-acd7-3c4d417ddf2b`::ref 1 aborting False >Thread-34::INFO::2014-07-10 09:15:18,602::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532067385344', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:15:18,602::task::1185::TaskManager.Task::(prepare) Task=`b262f98f-bf46-4549-acd7-3c4d417ddf2b`::finished: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532067385344', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:15:18,603::task::595::TaskManager.Task::(_updateState) Task=`b262f98f-bf46-4549-acd7-3c4d417ddf2b`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-10 09:15:18,603::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee': < ResourceRef 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-10 09:15:18,603::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-10 09:15:18,603::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' >Thread-34::DEBUG::2014-07-10 09:15:18,604::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' (0 active users) >Thread-34::DEBUG::2014-07-10 09:15:18,604::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-10 09:15:18,604::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', Clearing records. >Thread-34::DEBUG::2014-07-10 09:15:18,604::task::990::TaskManager.Task::(_decref) Task=`b262f98f-bf46-4549-acd7-3c4d417ddf2b`::ref 0 aborting False >Thread-40::DEBUG::2014-07-10 09:15:19,683::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lion.qa.lab.tlv.redhat.com:_export_yuri2_backup2/6a70504d-00df-4869-8695-0f442053f6b6/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-40::DEBUG::2014-07-10 09:15:19,709::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n369 bytes (369 B) copied, 0.000964166 s, 383 kB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:15:20,384::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:15:20,479::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0360675 s, 28.4 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:15:22,494::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:15:22,584::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0308547 s, 33.2 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:15:24,601::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:15:24,716::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0300764 s, 34.0 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:15:26,730::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:15:26,820::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0323459 s, 31.7 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-10 09:15:27,922::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/metadata bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-10 09:15:27,943::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000806576 s, 5.1 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 09:15:28,634::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-14::DEBUG::2014-07-10 09:15:28,635::task::595::TaskManager.Task::(_updateState) Task=`078e356a-7a6b-480c-aeff-6612f26483f7`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 09:15:28,636::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-14::INFO::2014-07-10 09:15:28,636::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:15:28,636::task::1185::TaskManager.Task::(prepare) Task=`078e356a-7a6b-480c-aeff-6612f26483f7`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:15:28,637::task::595::TaskManager.Task::(_updateState) Task=`078e356a-7a6b-480c-aeff-6612f26483f7`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 09:15:28,637::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 09:15:28,637::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 09:15:28,637::task::990::TaskManager.Task::(_decref) Task=`078e356a-7a6b-480c-aeff-6612f26483f7`::ref 0 aborting False >Thread-34::DEBUG::2014-07-10 09:15:28,641::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-34::DEBUG::2014-07-10 09:15:28,642::task::595::TaskManager.Task::(_updateState) Task=`10b10a5f-aec0-449a-acc4-69bf5bf6e20a`::moving from state init -> state preparing >Thread-34::INFO::2014-07-10 09:15:28,642::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-34::DEBUG::2014-07-10 09:15:28,643::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`3748207e-e4b9-480f-bc55-f8c0949bb266`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-10 09:15:28,643::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' for lock type 'shared' >Thread-34::DEBUG::2014-07-10 09:15:28,643::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-10 09:15:28,644::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`3748207e-e4b9-480f-bc55-f8c0949bb266`::Granted request >Thread-34::DEBUG::2014-07-10 09:15:28,644::task::827::TaskManager.Task::(resourceAcquired) Task=`10b10a5f-aec0-449a-acc4-69bf5bf6e20a`::_resourcesAcquired: Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee (shared) >Thread-34::DEBUG::2014-07-10 09:15:28,644::task::990::TaskManager.Task::(_decref) Task=`10b10a5f-aec0-449a-acc4-69bf5bf6e20a`::ref 1 aborting False >Thread-34::INFO::2014-07-10 09:15:28,646::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532067385344', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:15:28,646::task::1185::TaskManager.Task::(prepare) Task=`10b10a5f-aec0-449a-acc4-69bf5bf6e20a`::finished: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532067385344', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:15:28,646::task::595::TaskManager.Task::(_updateState) Task=`10b10a5f-aec0-449a-acc4-69bf5bf6e20a`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-10 09:15:28,646::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee': < ResourceRef 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-10 09:15:28,646::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-10 09:15:28,647::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' >Thread-34::DEBUG::2014-07-10 09:15:28,647::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' (0 active users) >Thread-34::DEBUG::2014-07-10 09:15:28,647::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-10 09:15:28,647::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', Clearing records. >Thread-34::DEBUG::2014-07-10 09:15:28,648::task::990::TaskManager.Task::(_decref) Task=`10b10a5f-aec0-449a-acc4-69bf5bf6e20a`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 09:15:28,836::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Thread-14::DEBUG::2014-07-10 09:15:28,870::task::595::TaskManager.Task::(_updateState) Task=`f868cbca-cbd2-40bc-9f19-e730c0029904`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 09:15:28,874::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::INFO::2014-07-10 09:15:28,878::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000806576', 'lastCheck': '0.9', 'valid': True}, '6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000964166', 'lastCheck': '9.2', 'valid': True}} >Thread-14::DEBUG::2014-07-10 09:15:28,880::task::1185::TaskManager.Task::(prepare) Task=`f868cbca-cbd2-40bc-9f19-e730c0029904`::finished: {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000806576', 'lastCheck': '0.9', 'valid': True}, '6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000964166', 'lastCheck': '9.2', 'valid': True}} >Thread-14::DEBUG::2014-07-10 09:15:28,882::task::595::TaskManager.Task::(_updateState) Task=`f868cbca-cbd2-40bc-9f19-e730c0029904`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 09:15:28,884::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 09:15:28,886::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 09:15:28,889::task::990::TaskManager.Task::(_decref) Task=`f868cbca-cbd2-40bc-9f19-e730c0029904`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 09:15:29,238::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.345958 s, 3.0 MB/s\n'; <rc> = 0 >Thread-40::DEBUG::2014-07-10 09:15:30,372::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lion.qa.lab.tlv.redhat.com:_export_yuri2_backup2/6a70504d-00df-4869-8695-0f442053f6b6/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-40::DEBUG::2014-07-10 09:15:30,423::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n369 bytes (369 B) copied, 0.00042588 s, 866 kB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:15:31,253::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:15:31,334::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0253815 s, 40.3 MB/s\n'; <rc> = 0 >Thread-70::DEBUG::2014-07-10 09:15:32,684::task::595::TaskManager.Task::(_updateState) Task=`bb995cc2-86a4-47ba-ae10-8bf5a099c777`::moving from state init -> state preparing >Thread-70::INFO::2014-07-10 09:15:32,684::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='cfaeead2-7caa-467c-b389-c89840ae6605', volUUID='567fe32d-31a6-4ff6-90f3-fd6a656fbecc', options=None) >Thread-70::INFO::2014-07-10 09:15:32,685::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-70::DEBUG::2014-07-10 09:15:32,685::task::1185::TaskManager.Task::(prepare) Task=`bb995cc2-86a4-47ba-ae10-8bf5a099c777`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-70::DEBUG::2014-07-10 09:15:32,685::task::595::TaskManager.Task::(_updateState) Task=`bb995cc2-86a4-47ba-ae10-8bf5a099c777`::moving from state preparing -> state finished >Thread-70::DEBUG::2014-07-10 09:15:32,686::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-70::DEBUG::2014-07-10 09:15:32,686::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-70::DEBUG::2014-07-10 09:15:32,686::task::990::TaskManager.Task::(_decref) Task=`bb995cc2-86a4-47ba-ae10-8bf5a099c777`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 09:15:33,360::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:15:33,458::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0327877 s, 31.2 MB/s\n'; <rc> = 0 >Thread-60::DEBUG::2014-07-10 09:15:33,590::task::595::TaskManager.Task::(_updateState) Task=`6afe1378-b6d6-4b21-91aa-feb64a8e176a`::moving from state init -> state preparing >Thread-60::INFO::2014-07-10 09:15:33,591::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='b034d5b0-e1e0-4011-b49b-4d45ddb11556', volUUID='3d7f62b5-328f-4d8e-8b69-873cfb5ae14d', options=None) >Thread-60::INFO::2014-07-10 09:15:33,591::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-60::DEBUG::2014-07-10 09:15:33,592::task::1185::TaskManager.Task::(prepare) Task=`6afe1378-b6d6-4b21-91aa-feb64a8e176a`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-60::DEBUG::2014-07-10 09:15:33,592::task::595::TaskManager.Task::(_updateState) Task=`6afe1378-b6d6-4b21-91aa-feb64a8e176a`::moving from state preparing -> state finished >Thread-60::DEBUG::2014-07-10 09:15:33,592::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-60::DEBUG::2014-07-10 09:15:33,592::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-60::DEBUG::2014-07-10 09:15:33,592::task::990::TaskManager.Task::(_decref) Task=`6afe1378-b6d6-4b21-91aa-feb64a8e176a`::ref 0 aborting False >Thread-51::DEBUG::2014-07-10 09:15:33,747::task::595::TaskManager.Task::(_updateState) Task=`fbd0c3f9-481d-4a25-9f10-1803e6e0513b`::moving from state init -> state preparing >Thread-51::INFO::2014-07-10 09:15:33,747::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='76fdb054-02cd-42ed-9721-b3e65b34c3a4', volUUID='022dfe46-2cf7-4915-80b3-883158e3ca83', options=None) >Thread-51::INFO::2014-07-10 09:15:33,748::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-51::DEBUG::2014-07-10 09:15:33,748::task::1185::TaskManager.Task::(prepare) Task=`fbd0c3f9-481d-4a25-9f10-1803e6e0513b`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-51::DEBUG::2014-07-10 09:15:33,748::task::595::TaskManager.Task::(_updateState) Task=`fbd0c3f9-481d-4a25-9f10-1803e6e0513b`::moving from state preparing -> state finished >Thread-51::DEBUG::2014-07-10 09:15:33,748::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-51::DEBUG::2014-07-10 09:15:33,749::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-51::DEBUG::2014-07-10 09:15:33,749::task::990::TaskManager.Task::(_decref) Task=`fbd0c3f9-481d-4a25-9f10-1803e6e0513b`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 09:15:35,474::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:15:35,568::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.034983 s, 29.3 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:15:37,583::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:15:37,672::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0277537 s, 36.9 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-10 09:15:37,975::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/metadata bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-10 09:15:37,997::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000682603 s, 6.0 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 09:15:38,684::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-14::DEBUG::2014-07-10 09:15:38,685::task::595::TaskManager.Task::(_updateState) Task=`39ab4ced-8dee-4f5a-9e46-0d2a20947a87`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 09:15:38,685::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-14::INFO::2014-07-10 09:15:38,686::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:15:38,686::task::1185::TaskManager.Task::(prepare) Task=`39ab4ced-8dee-4f5a-9e46-0d2a20947a87`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:15:38,686::task::595::TaskManager.Task::(_updateState) Task=`39ab4ced-8dee-4f5a-9e46-0d2a20947a87`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 09:15:38,686::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 09:15:38,687::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 09:15:38,687::task::990::TaskManager.Task::(_decref) Task=`39ab4ced-8dee-4f5a-9e46-0d2a20947a87`::ref 0 aborting False >Thread-34::DEBUG::2014-07-10 09:15:38,691::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-34::DEBUG::2014-07-10 09:15:38,691::task::595::TaskManager.Task::(_updateState) Task=`7a9fb213-095b-44b3-93a1-5e1efd1dcdfc`::moving from state init -> state preparing >Thread-34::INFO::2014-07-10 09:15:38,692::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-34::DEBUG::2014-07-10 09:15:38,692::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`a66758bf-a692-4ab6-8c56-fd5c79a576a2`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-10 09:15:38,692::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' for lock type 'shared' >Thread-34::DEBUG::2014-07-10 09:15:38,693::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-10 09:15:38,693::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`a66758bf-a692-4ab6-8c56-fd5c79a576a2`::Granted request >Thread-34::DEBUG::2014-07-10 09:15:38,694::task::827::TaskManager.Task::(resourceAcquired) Task=`7a9fb213-095b-44b3-93a1-5e1efd1dcdfc`::_resourcesAcquired: Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee (shared) >Thread-34::DEBUG::2014-07-10 09:15:38,694::task::990::TaskManager.Task::(_decref) Task=`7a9fb213-095b-44b3-93a1-5e1efd1dcdfc`::ref 1 aborting False >Thread-34::INFO::2014-07-10 09:15:38,695::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532067385344', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:15:38,695::task::1185::TaskManager.Task::(prepare) Task=`7a9fb213-095b-44b3-93a1-5e1efd1dcdfc`::finished: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532067385344', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:15:38,695::task::595::TaskManager.Task::(_updateState) Task=`7a9fb213-095b-44b3-93a1-5e1efd1dcdfc`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-10 09:15:38,696::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee': < ResourceRef 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-10 09:15:38,696::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-10 09:15:38,696::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' >Thread-34::DEBUG::2014-07-10 09:15:38,696::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' (0 active users) >Thread-34::DEBUG::2014-07-10 09:15:38,696::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-10 09:15:38,697::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', Clearing records. >Thread-34::DEBUG::2014-07-10 09:15:38,697::task::990::TaskManager.Task::(_decref) Task=`7a9fb213-095b-44b3-93a1-5e1efd1dcdfc`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 09:15:39,687::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:15:39,777::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0324025 s, 31.6 MB/s\n'; <rc> = 0 >Thread-40::DEBUG::2014-07-10 09:15:40,666::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lion.qa.lab.tlv.redhat.com:_export_yuri2_backup2/6a70504d-00df-4869-8695-0f442053f6b6/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-40::DEBUG::2014-07-10 09:15:40,714::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n369 bytes (369 B) copied, 0.000418959 s, 881 kB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:15:41,801::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:15:41,898::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0368777 s, 27.8 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:15:43,915::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:15:44,016::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0275464 s, 37.2 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 09:15:44,347::task::595::TaskManager.Task::(_updateState) Task=`936c93b8-4e9a-464b-bf67-25ff4641f743`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 09:15:44,347::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::INFO::2014-07-10 09:15:44,348::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000682603', 'lastCheck': '6.3', 'valid': True}, '6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000418959', 'lastCheck': '3.6', 'valid': True}} >Thread-14::DEBUG::2014-07-10 09:15:44,348::task::1185::TaskManager.Task::(prepare) Task=`936c93b8-4e9a-464b-bf67-25ff4641f743`::finished: {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000682603', 'lastCheck': '6.3', 'valid': True}, '6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000418959', 'lastCheck': '3.6', 'valid': True}} >Thread-14::DEBUG::2014-07-10 09:15:44,348::task::595::TaskManager.Task::(_updateState) Task=`936c93b8-4e9a-464b-bf67-25ff4641f743`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 09:15:44,349::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 09:15:44,349::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 09:15:44,349::task::990::TaskManager.Task::(_decref) Task=`936c93b8-4e9a-464b-bf67-25ff4641f743`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 09:15:46,034::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:15:46,122::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0280654 s, 36.5 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-10 09:15:48,029::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/metadata bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-10 09:15:48,051::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000726257 s, 5.6 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:15:48,137::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:15:48,275::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.035508 s, 28.8 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 09:15:48,725::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-14::DEBUG::2014-07-10 09:15:48,727::task::595::TaskManager.Task::(_updateState) Task=`87b188c1-200b-453f-a5ed-3d235ea8508a`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 09:15:48,727::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-14::INFO::2014-07-10 09:15:48,727::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:15:48,728::task::1185::TaskManager.Task::(prepare) Task=`87b188c1-200b-453f-a5ed-3d235ea8508a`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:15:48,728::task::595::TaskManager.Task::(_updateState) Task=`87b188c1-200b-453f-a5ed-3d235ea8508a`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 09:15:48,728::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 09:15:48,728::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 09:15:48,728::task::990::TaskManager.Task::(_decref) Task=`87b188c1-200b-453f-a5ed-3d235ea8508a`::ref 0 aborting False >Thread-34::DEBUG::2014-07-10 09:15:48,732::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-34::DEBUG::2014-07-10 09:15:48,733::task::595::TaskManager.Task::(_updateState) Task=`3b06ee6c-3450-4263-b233-147cb31b4682`::moving from state init -> state preparing >Thread-34::INFO::2014-07-10 09:15:48,733::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-34::DEBUG::2014-07-10 09:15:48,734::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`031e129e-5bcb-4c02-aff5-df773467f623`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-10 09:15:48,734::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' for lock type 'shared' >Thread-34::DEBUG::2014-07-10 09:15:48,734::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-10 09:15:48,735::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`031e129e-5bcb-4c02-aff5-df773467f623`::Granted request >Thread-34::DEBUG::2014-07-10 09:15:48,735::task::827::TaskManager.Task::(resourceAcquired) Task=`3b06ee6c-3450-4263-b233-147cb31b4682`::_resourcesAcquired: Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee (shared) >Thread-34::DEBUG::2014-07-10 09:15:48,735::task::990::TaskManager.Task::(_decref) Task=`3b06ee6c-3450-4263-b233-147cb31b4682`::ref 1 aborting False >Thread-34::INFO::2014-07-10 09:15:48,736::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532067385344', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:15:48,736::task::1185::TaskManager.Task::(prepare) Task=`3b06ee6c-3450-4263-b233-147cb31b4682`::finished: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532067385344', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:15:48,737::task::595::TaskManager.Task::(_updateState) Task=`3b06ee6c-3450-4263-b233-147cb31b4682`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-10 09:15:48,737::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee': < ResourceRef 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-10 09:15:48,737::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-10 09:15:48,737::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' >Thread-34::DEBUG::2014-07-10 09:15:48,737::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' (0 active users) >Thread-34::DEBUG::2014-07-10 09:15:48,738::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-10 09:15:48,738::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', Clearing records. >Thread-34::DEBUG::2014-07-10 09:15:48,738::task::990::TaskManager.Task::(_decref) Task=`3b06ee6c-3450-4263-b233-147cb31b4682`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 09:15:50,307::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:15:50,421::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0544722 s, 18.8 MB/s\n'; <rc> = 0 >Thread-40::DEBUG::2014-07-10 09:15:50,754::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lion.qa.lab.tlv.redhat.com:_export_yuri2_backup2/6a70504d-00df-4869-8695-0f442053f6b6/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-40::DEBUG::2014-07-10 09:15:50,775::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n369 bytes (369 B) copied, 0.000436145 s, 846 kB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:15:52,436::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:15:52,525::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0303121 s, 33.8 MB/s\n'; <rc> = 0 >Thread-64::DEBUG::2014-07-10 09:15:52,800::task::595::TaskManager.Task::(_updateState) Task=`b3a51688-65cc-417c-b85a-56cb1e2aed5e`::moving from state init -> state preparing >Thread-64::INFO::2014-07-10 09:15:52,801::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='aa20346a-4d3a-4e07-b8e1-52c0ebe4168c', volUUID='58fefce2-9bce-4bff-8949-8c6ce8122b27', options=None) >Thread-64::INFO::2014-07-10 09:15:52,802::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-64::DEBUG::2014-07-10 09:15:52,802::task::1185::TaskManager.Task::(prepare) Task=`b3a51688-65cc-417c-b85a-56cb1e2aed5e`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-64::DEBUG::2014-07-10 09:15:52,802::task::595::TaskManager.Task::(_updateState) Task=`b3a51688-65cc-417c-b85a-56cb1e2aed5e`::moving from state preparing -> state finished >Thread-64::DEBUG::2014-07-10 09:15:52,802::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-64::DEBUG::2014-07-10 09:15:52,802::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-64::DEBUG::2014-07-10 09:15:52,803::task::990::TaskManager.Task::(_decref) Task=`b3a51688-65cc-417c-b85a-56cb1e2aed5e`::ref 0 aborting False >Thread-54::DEBUG::2014-07-10 09:15:54,093::task::595::TaskManager.Task::(_updateState) Task=`b72b9482-08ac-4cf0-acf1-e7168ace2a09`::moving from state init -> state preparing >Thread-54::INFO::2014-07-10 09:15:54,094::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='28408446-e5fd-4565-a976-e760951593fe', volUUID='776303a2-5585-451e-826e-0e338d4a1e98', options=None) >Thread-54::INFO::2014-07-10 09:15:54,094::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-54::DEBUG::2014-07-10 09:15:54,094::task::1185::TaskManager.Task::(prepare) Task=`b72b9482-08ac-4cf0-acf1-e7168ace2a09`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-54::DEBUG::2014-07-10 09:15:54,094::task::595::TaskManager.Task::(_updateState) Task=`b72b9482-08ac-4cf0-acf1-e7168ace2a09`::moving from state preparing -> state finished >Thread-54::DEBUG::2014-07-10 09:15:54,095::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-54::DEBUG::2014-07-10 09:15:54,095::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-54::DEBUG::2014-07-10 09:15:54,095::task::990::TaskManager.Task::(_decref) Task=`b72b9482-08ac-4cf0-acf1-e7168ace2a09`::ref 0 aborting False >Thread-73::DEBUG::2014-07-10 09:15:54,102::task::595::TaskManager.Task::(_updateState) Task=`bf65b3dd-e7a8-4697-a448-ba4d1d019479`::moving from state init -> state preparing >Thread-73::INFO::2014-07-10 09:15:54,103::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='c01d693b-cba0-4fed-9ad7-0aaa28912a19', volUUID='4bb5d954-2a50-4028-b299-0b43c261270c', options=None) >Thread-73::INFO::2014-07-10 09:15:54,103::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-73::DEBUG::2014-07-10 09:15:54,104::task::1185::TaskManager.Task::(prepare) Task=`bf65b3dd-e7a8-4697-a448-ba4d1d019479`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-73::DEBUG::2014-07-10 09:15:54,104::task::595::TaskManager.Task::(_updateState) Task=`bf65b3dd-e7a8-4697-a448-ba4d1d019479`::moving from state preparing -> state finished >Thread-73::DEBUG::2014-07-10 09:15:54,104::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-73::DEBUG::2014-07-10 09:15:54,105::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-73::DEBUG::2014-07-10 09:15:54,105::task::990::TaskManager.Task::(_decref) Task=`bf65b3dd-e7a8-4697-a448-ba4d1d019479`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 09:15:54,540::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:15:54,652::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0387305 s, 26.4 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:15:56,668::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:15:56,759::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0353226 s, 29.0 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-10 09:15:58,089::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/metadata bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-10 09:15:58,130::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000752768 s, 5.4 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 09:15:58,759::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-14::DEBUG::2014-07-10 09:15:58,760::task::595::TaskManager.Task::(_updateState) Task=`5d921e9f-ab7a-430a-a19a-fe06309d87d6`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 09:15:58,761::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-14::INFO::2014-07-10 09:15:58,761::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:15:58,761::task::1185::TaskManager.Task::(prepare) Task=`5d921e9f-ab7a-430a-a19a-fe06309d87d6`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:15:58,761::task::595::TaskManager.Task::(_updateState) Task=`5d921e9f-ab7a-430a-a19a-fe06309d87d6`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 09:15:58,762::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 09:15:58,762::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 09:15:58,762::task::990::TaskManager.Task::(_decref) Task=`5d921e9f-ab7a-430a-a19a-fe06309d87d6`::ref 0 aborting False >Thread-34::DEBUG::2014-07-10 09:15:58,766::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-34::DEBUG::2014-07-10 09:15:58,767::task::595::TaskManager.Task::(_updateState) Task=`18df8a1c-88ba-4d48-9294-7544eb8e72c5`::moving from state init -> state preparing >Thread-34::INFO::2014-07-10 09:15:58,767::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-34::DEBUG::2014-07-10 09:15:58,768::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`c0da71ea-47c2-4800-91d7-b1c6119c9785`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-10 09:15:58,768::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' for lock type 'shared' >Thread-34::DEBUG::2014-07-10 09:15:58,768::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-10 09:15:58,769::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`c0da71ea-47c2-4800-91d7-b1c6119c9785`::Granted request >Thread-34::DEBUG::2014-07-10 09:15:58,769::task::827::TaskManager.Task::(resourceAcquired) Task=`18df8a1c-88ba-4d48-9294-7544eb8e72c5`::_resourcesAcquired: Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee (shared) >Thread-34::DEBUG::2014-07-10 09:15:58,769::task::990::TaskManager.Task::(_decref) Task=`18df8a1c-88ba-4d48-9294-7544eb8e72c5`::ref 1 aborting False >Thread-34::INFO::2014-07-10 09:15:58,770::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532067385344', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:15:58,771::task::1185::TaskManager.Task::(prepare) Task=`18df8a1c-88ba-4d48-9294-7544eb8e72c5`::finished: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532067385344', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:15:58,771::task::595::TaskManager.Task::(_updateState) Task=`18df8a1c-88ba-4d48-9294-7544eb8e72c5`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-10 09:15:58,771::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee': < ResourceRef 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-10 09:15:58,771::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-10 09:15:58,771::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' >Thread-34::DEBUG::2014-07-10 09:15:58,772::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' (0 active users) >Thread-34::DEBUG::2014-07-10 09:15:58,772::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-10 09:15:58,772::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', Clearing records. >Thread-34::DEBUG::2014-07-10 09:15:58,772::task::990::TaskManager.Task::(_decref) Task=`18df8a1c-88ba-4d48-9294-7544eb8e72c5`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 09:15:58,775::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:15:58,880::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0447268 s, 22.9 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 09:15:59,524::task::595::TaskManager.Task::(_updateState) Task=`bc1c31e3-a6ab-4790-b7c5-a284a31ccce0`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 09:15:59,525::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::INFO::2014-07-10 09:15:59,525::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000752768', 'lastCheck': '1.4', 'valid': True}, '6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000436145', 'lastCheck': '8.7', 'valid': True}} >Thread-14::DEBUG::2014-07-10 09:15:59,526::task::1185::TaskManager.Task::(prepare) Task=`bc1c31e3-a6ab-4790-b7c5-a284a31ccce0`::finished: {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000752768', 'lastCheck': '1.4', 'valid': True}, '6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000436145', 'lastCheck': '8.7', 'valid': True}} >Thread-14::DEBUG::2014-07-10 09:15:59,526::task::595::TaskManager.Task::(_updateState) Task=`bc1c31e3-a6ab-4790-b7c5-a284a31ccce0`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 09:15:59,526::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 09:15:59,526::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 09:15:59,526::task::990::TaskManager.Task::(_decref) Task=`bc1c31e3-a6ab-4790-b7c5-a284a31ccce0`::ref 0 aborting False >Thread-40::DEBUG::2014-07-10 09:16:00,801::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lion.qa.lab.tlv.redhat.com:_export_yuri2_backup2/6a70504d-00df-4869-8695-0f442053f6b6/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-40::DEBUG::2014-07-10 09:16:00,822::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n369 bytes (369 B) copied, 0.000560815 s, 658 kB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:16:00,897::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:16:02,333::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.76109 s, 1.3 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:16:04,348::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:16:04,436::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0291985 s, 35.1 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:16:06,451::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:16:06,568::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0354272 s, 28.9 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-10 09:16:08,158::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/metadata bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-10 09:16:08,180::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000649979 s, 6.3 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:16:08,583::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:16:08,678::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0355078 s, 28.8 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 09:16:08,800::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-14::DEBUG::2014-07-10 09:16:08,801::task::595::TaskManager.Task::(_updateState) Task=`142c4fdb-f003-4352-b25e-3fd8053106a7`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 09:16:08,801::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-14::INFO::2014-07-10 09:16:08,802::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:16:08,802::task::1185::TaskManager.Task::(prepare) Task=`142c4fdb-f003-4352-b25e-3fd8053106a7`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:16:08,802::task::595::TaskManager.Task::(_updateState) Task=`142c4fdb-f003-4352-b25e-3fd8053106a7`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 09:16:08,802::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 09:16:08,802::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 09:16:08,803::task::990::TaskManager.Task::(_decref) Task=`142c4fdb-f003-4352-b25e-3fd8053106a7`::ref 0 aborting False >Thread-34::DEBUG::2014-07-10 09:16:08,807::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-34::DEBUG::2014-07-10 09:16:08,807::task::595::TaskManager.Task::(_updateState) Task=`fcaab1af-3416-4975-9ad3-c31b36f29318`::moving from state init -> state preparing >Thread-34::INFO::2014-07-10 09:16:08,807::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-34::DEBUG::2014-07-10 09:16:08,808::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`4b0e072c-6eb3-41b7-b39e-fc5c09e2e041`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-10 09:16:08,808::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' for lock type 'shared' >Thread-34::DEBUG::2014-07-10 09:16:08,809::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-10 09:16:08,809::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`4b0e072c-6eb3-41b7-b39e-fc5c09e2e041`::Granted request >Thread-34::DEBUG::2014-07-10 09:16:08,809::task::827::TaskManager.Task::(resourceAcquired) Task=`fcaab1af-3416-4975-9ad3-c31b36f29318`::_resourcesAcquired: Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee (shared) >Thread-34::DEBUG::2014-07-10 09:16:08,810::task::990::TaskManager.Task::(_decref) Task=`fcaab1af-3416-4975-9ad3-c31b36f29318`::ref 1 aborting False >Thread-34::INFO::2014-07-10 09:16:08,811::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532067385344', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:16:08,811::task::1185::TaskManager.Task::(prepare) Task=`fcaab1af-3416-4975-9ad3-c31b36f29318`::finished: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532067385344', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:16:08,811::task::595::TaskManager.Task::(_updateState) Task=`fcaab1af-3416-4975-9ad3-c31b36f29318`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-10 09:16:08,811::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee': < ResourceRef 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-10 09:16:08,812::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-10 09:16:08,812::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' >Thread-34::DEBUG::2014-07-10 09:16:08,812::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' (0 active users) >Thread-34::DEBUG::2014-07-10 09:16:08,812::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-10 09:16:08,812::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', Clearing records. >Thread-34::DEBUG::2014-07-10 09:16:08,813::task::990::TaskManager.Task::(_decref) Task=`fcaab1af-3416-4975-9ad3-c31b36f29318`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 09:16:10,693::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:16:10,795::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0453059 s, 22.6 MB/s\n'; <rc> = 0 >Thread-40::DEBUG::2014-07-10 09:16:10,854::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lion.qa.lab.tlv.redhat.com:_export_yuri2_backup2/6a70504d-00df-4869-8695-0f442053f6b6/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-40::DEBUG::2014-07-10 09:16:10,880::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n369 bytes (369 B) copied, 0.000426508 s, 865 kB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:16:12,809::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Thread-57::DEBUG::2014-07-10 09:16:12,897::task::595::TaskManager.Task::(_updateState) Task=`4fdf299a-3454-4b42-87fb-797e471f93cc`::moving from state init -> state preparing >Thread-57::INFO::2014-07-10 09:16:12,902::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='b6f6c0da-e67f-4902-b9ac-3069571a42fe', volUUID='c4cd1da8-05b7-45e0-80b1-1183d21443d9', options=None) >Thread-57::INFO::2014-07-10 09:16:12,906::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-57::DEBUG::2014-07-10 09:16:12,909::task::1185::TaskManager.Task::(prepare) Task=`4fdf299a-3454-4b42-87fb-797e471f93cc`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-57::DEBUG::2014-07-10 09:16:12,911::task::595::TaskManager.Task::(_updateState) Task=`4fdf299a-3454-4b42-87fb-797e471f93cc`::moving from state preparing -> state finished >Thread-57::DEBUG::2014-07-10 09:16:12,914::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-57::DEBUG::2014-07-10 09:16:12,916::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-57::DEBUG::2014-07-10 09:16:12,920::task::990::TaskManager.Task::(_decref) Task=`4fdf299a-3454-4b42-87fb-797e471f93cc`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 09:16:12,935::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0333604 s, 30.7 MB/s\n'; <rc> = 0 >Thread-67::DEBUG::2014-07-10 09:16:13,761::task::595::TaskManager.Task::(_updateState) Task=`9c17bea9-4934-4e32-a029-098e9ac5ef36`::moving from state init -> state preparing >Thread-67::INFO::2014-07-10 09:16:13,761::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='f30c2cb7-a43a-4bf5-82b5-cfe07336f65c', volUUID='b0fbb3c9-55af-4a3a-95ad-fc56a80b9cf5', options=None) >Thread-67::INFO::2014-07-10 09:16:13,762::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-67::DEBUG::2014-07-10 09:16:13,762::task::1185::TaskManager.Task::(prepare) Task=`9c17bea9-4934-4e32-a029-098e9ac5ef36`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-67::DEBUG::2014-07-10 09:16:13,762::task::595::TaskManager.Task::(_updateState) Task=`9c17bea9-4934-4e32-a029-098e9ac5ef36`::moving from state preparing -> state finished >Thread-67::DEBUG::2014-07-10 09:16:13,763::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-67::DEBUG::2014-07-10 09:16:13,763::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-67::DEBUG::2014-07-10 09:16:13,763::task::990::TaskManager.Task::(_decref) Task=`9c17bea9-4934-4e32-a029-098e9ac5ef36`::ref 0 aborting False >Thread-48::DEBUG::2014-07-10 09:16:14,193::task::595::TaskManager.Task::(_updateState) Task=`dbc94b78-2663-413f-a35c-40c6c101e0dc`::moving from state init -> state preparing >Thread-48::INFO::2014-07-10 09:16:14,194::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='0cd7d6ce-f497-4243-a690-c57744861eea', volUUID='10b6a7dd-dc6c-43fa-ba17-92e4331b0e0b', options=None) >Thread-48::INFO::2014-07-10 09:16:14,194::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-48::DEBUG::2014-07-10 09:16:14,194::task::1185::TaskManager.Task::(prepare) Task=`dbc94b78-2663-413f-a35c-40c6c101e0dc`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-48::DEBUG::2014-07-10 09:16:14,194::task::595::TaskManager.Task::(_updateState) Task=`dbc94b78-2663-413f-a35c-40c6c101e0dc`::moving from state preparing -> state finished >Thread-48::DEBUG::2014-07-10 09:16:14,195::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-48::DEBUG::2014-07-10 09:16:14,195::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-48::DEBUG::2014-07-10 09:16:14,195::task::990::TaskManager.Task::(_decref) Task=`dbc94b78-2663-413f-a35c-40c6c101e0dc`::ref 0 aborting False >Thread-14::DEBUG::2014-07-10 09:16:14,715::task::595::TaskManager.Task::(_updateState) Task=`e5508309-7bf4-4e69-8b5c-40baee04c93d`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 09:16:14,715::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::INFO::2014-07-10 09:16:14,716::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000649979', 'lastCheck': '6.5', 'valid': True}, '6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000426508', 'lastCheck': '3.8', 'valid': True}} >Thread-14::DEBUG::2014-07-10 09:16:14,716::task::1185::TaskManager.Task::(prepare) Task=`e5508309-7bf4-4e69-8b5c-40baee04c93d`::finished: {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000649979', 'lastCheck': '6.5', 'valid': True}, '6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000426508', 'lastCheck': '3.8', 'valid': True}} >Thread-14::DEBUG::2014-07-10 09:16:14,716::task::595::TaskManager.Task::(_updateState) Task=`e5508309-7bf4-4e69-8b5c-40baee04c93d`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 09:16:14,716::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 09:16:14,716::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 09:16:14,717::task::990::TaskManager.Task::(_decref) Task=`e5508309-7bf4-4e69-8b5c-40baee04c93d`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 09:16:14,952::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:16:15,072::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.063305 s, 16.2 MB/s\n'; <rc> = 0 >Thread-76::DEBUG::2014-07-10 09:16:15,567::task::595::TaskManager.Task::(_updateState) Task=`473a439a-7303-4ac9-87a1-6f423a8f5ceb`::moving from state init -> state preparing >Thread-76::INFO::2014-07-10 09:16:15,568::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='e4c65229-4247-4b33-b72a-f1d5ce72ad05', volUUID='cad94284-3ca9-4c30-933d-997f4460309e', options=None) >Thread-76::INFO::2014-07-10 09:16:15,568::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-76::DEBUG::2014-07-10 09:16:15,568::task::1185::TaskManager.Task::(prepare) Task=`473a439a-7303-4ac9-87a1-6f423a8f5ceb`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-76::DEBUG::2014-07-10 09:16:15,568::task::595::TaskManager.Task::(_updateState) Task=`473a439a-7303-4ac9-87a1-6f423a8f5ceb`::moving from state preparing -> state finished >Thread-76::DEBUG::2014-07-10 09:16:15,569::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-76::DEBUG::2014-07-10 09:16:15,569::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-76::DEBUG::2014-07-10 09:16:15,569::task::990::TaskManager.Task::(_decref) Task=`473a439a-7303-4ac9-87a1-6f423a8f5ceb`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 09:16:17,087::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:16:17,175::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0304335 s, 33.6 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-10 09:16:18,214::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/metadata bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-10 09:16:18,245::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.0069628 s, 588 kB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 09:16:18,843::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-14::DEBUG::2014-07-10 09:16:18,844::task::595::TaskManager.Task::(_updateState) Task=`9bbd420f-0a53-40f5-863c-9fdfece0fc35`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 09:16:18,844::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-14::INFO::2014-07-10 09:16:18,845::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:16:18,845::task::1185::TaskManager.Task::(prepare) Task=`9bbd420f-0a53-40f5-863c-9fdfece0fc35`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:16:18,846::task::595::TaskManager.Task::(_updateState) Task=`9bbd420f-0a53-40f5-863c-9fdfece0fc35`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 09:16:18,846::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 09:16:18,846::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 09:16:18,846::task::990::TaskManager.Task::(_decref) Task=`9bbd420f-0a53-40f5-863c-9fdfece0fc35`::ref 0 aborting False >Thread-34::DEBUG::2014-07-10 09:16:18,850::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-34::DEBUG::2014-07-10 09:16:18,851::task::595::TaskManager.Task::(_updateState) Task=`ae7c15a8-1392-4a9d-8896-195df3d7e0d2`::moving from state init -> state preparing >Thread-34::INFO::2014-07-10 09:16:18,851::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-34::DEBUG::2014-07-10 09:16:18,851::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`4c30ab48-9936-49b0-82f0-76ffad039928`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-10 09:16:18,852::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' for lock type 'shared' >Thread-34::DEBUG::2014-07-10 09:16:18,852::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-10 09:16:18,852::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`4c30ab48-9936-49b0-82f0-76ffad039928`::Granted request >Thread-34::DEBUG::2014-07-10 09:16:18,853::task::827::TaskManager.Task::(resourceAcquired) Task=`ae7c15a8-1392-4a9d-8896-195df3d7e0d2`::_resourcesAcquired: Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee (shared) >Thread-34::DEBUG::2014-07-10 09:16:18,853::task::990::TaskManager.Task::(_decref) Task=`ae7c15a8-1392-4a9d-8896-195df3d7e0d2`::ref 1 aborting False >Thread-34::INFO::2014-07-10 09:16:18,854::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532067385344', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:16:18,854::task::1185::TaskManager.Task::(prepare) Task=`ae7c15a8-1392-4a9d-8896-195df3d7e0d2`::finished: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532067385344', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:16:18,854::task::595::TaskManager.Task::(_updateState) Task=`ae7c15a8-1392-4a9d-8896-195df3d7e0d2`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-10 09:16:18,854::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee': < ResourceRef 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-10 09:16:18,854::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-10 09:16:18,855::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' >Thread-34::DEBUG::2014-07-10 09:16:18,855::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' (0 active users) >Thread-34::DEBUG::2014-07-10 09:16:18,855::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-10 09:16:18,855::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', Clearing records. >Thread-34::DEBUG::2014-07-10 09:16:18,855::task::990::TaskManager.Task::(_decref) Task=`ae7c15a8-1392-4a9d-8896-195df3d7e0d2`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 09:16:19,191::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:16:19,279::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0298706 s, 34.3 MB/s\n'; <rc> = 0 >Thread-40::DEBUG::2014-07-10 09:16:20,911::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lion.qa.lab.tlv.redhat.com:_export_yuri2_backup2/6a70504d-00df-4869-8695-0f442053f6b6/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-40::DEBUG::2014-07-10 09:16:20,933::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n369 bytes (369 B) copied, 0.00044537 s, 829 kB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:16:21,294::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:16:21,388::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0353175 s, 29.0 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:16:23,404::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:16:23,486::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0253786 s, 40.3 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:16:25,502::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:16:25,597::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0386033 s, 26.5 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:16:27,614::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:16:27,720::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0308121 s, 33.2 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-10 09:16:28,279::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/metadata bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-10 09:16:28,305::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00063562 s, 6.4 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 09:16:28,876::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-14::DEBUG::2014-07-10 09:16:28,877::task::595::TaskManager.Task::(_updateState) Task=`b8249c33-ee27-4c17-8fd7-cd7b7e15bdcd`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 09:16:28,877::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-14::INFO::2014-07-10 09:16:28,878::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:16:28,879::task::1185::TaskManager.Task::(prepare) Task=`b8249c33-ee27-4c17-8fd7-cd7b7e15bdcd`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:16:28,879::task::595::TaskManager.Task::(_updateState) Task=`b8249c33-ee27-4c17-8fd7-cd7b7e15bdcd`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 09:16:28,879::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 09:16:28,880::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 09:16:28,880::task::990::TaskManager.Task::(_decref) Task=`b8249c33-ee27-4c17-8fd7-cd7b7e15bdcd`::ref 0 aborting False >Thread-34::DEBUG::2014-07-10 09:16:28,884::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-34::DEBUG::2014-07-10 09:16:28,884::task::595::TaskManager.Task::(_updateState) Task=`94fa2d44-a306-4510-a4e5-ca83af192fbf`::moving from state init -> state preparing >Thread-34::INFO::2014-07-10 09:16:28,885::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-34::DEBUG::2014-07-10 09:16:28,885::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`a318256f-9172-4d47-a072-14284ada1290`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-10 09:16:28,886::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' for lock type 'shared' >Thread-34::DEBUG::2014-07-10 09:16:28,886::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-10 09:16:28,886::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`a318256f-9172-4d47-a072-14284ada1290`::Granted request >Thread-34::DEBUG::2014-07-10 09:16:28,887::task::827::TaskManager.Task::(resourceAcquired) Task=`94fa2d44-a306-4510-a4e5-ca83af192fbf`::_resourcesAcquired: Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee (shared) >Thread-34::DEBUG::2014-07-10 09:16:28,887::task::990::TaskManager.Task::(_decref) Task=`94fa2d44-a306-4510-a4e5-ca83af192fbf`::ref 1 aborting False >Thread-34::INFO::2014-07-10 09:16:28,888::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532067385344', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:16:28,888::task::1185::TaskManager.Task::(prepare) Task=`94fa2d44-a306-4510-a4e5-ca83af192fbf`::finished: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532067385344', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:16:28,888::task::595::TaskManager.Task::(_updateState) Task=`94fa2d44-a306-4510-a4e5-ca83af192fbf`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-10 09:16:28,889::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee': < ResourceRef 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-10 09:16:28,889::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-10 09:16:28,889::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' >Thread-34::DEBUG::2014-07-10 09:16:28,889::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' (0 active users) >Thread-34::DEBUG::2014-07-10 09:16:28,890::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-10 09:16:28,890::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', Clearing records. >Thread-34::DEBUG::2014-07-10 09:16:28,890::task::990::TaskManager.Task::(_decref) Task=`94fa2d44-a306-4510-a4e5-ca83af192fbf`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 09:16:29,736::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:16:29,846::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0311681 s, 32.9 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 09:16:29,893::task::595::TaskManager.Task::(_updateState) Task=`de6e79b3-0289-4c76-88f3-ecbab1ae5349`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 09:16:29,894::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::INFO::2014-07-10 09:16:29,894::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00063562', 'lastCheck': '1.6', 'valid': True}, '6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00044537', 'lastCheck': '9.0', 'valid': True}} >Thread-14::DEBUG::2014-07-10 09:16:29,895::task::1185::TaskManager.Task::(prepare) Task=`de6e79b3-0289-4c76-88f3-ecbab1ae5349`::finished: {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00063562', 'lastCheck': '1.6', 'valid': True}, '6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00044537', 'lastCheck': '9.0', 'valid': True}} >Thread-14::DEBUG::2014-07-10 09:16:29,895::task::595::TaskManager.Task::(_updateState) Task=`de6e79b3-0289-4c76-88f3-ecbab1ae5349`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 09:16:29,895::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 09:16:29,895::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 09:16:29,895::task::990::TaskManager.Task::(_decref) Task=`de6e79b3-0289-4c76-88f3-ecbab1ae5349`::ref 0 aborting False >Thread-40::DEBUG::2014-07-10 09:16:30,966::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lion.qa.lab.tlv.redhat.com:_export_yuri2_backup2/6a70504d-00df-4869-8695-0f442053f6b6/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-40::DEBUG::2014-07-10 09:16:30,989::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n369 bytes (369 B) copied, 0.000393474 s, 938 kB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:16:31,862::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:16:31,964::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.04218 s, 24.3 MB/s\n'; <rc> = 0 >Thread-70::DEBUG::2014-07-10 09:16:32,994::task::595::TaskManager.Task::(_updateState) Task=`40a83a3c-86e2-4aca-8c18-4ce35422ee3c`::moving from state init -> state preparing >Thread-70::INFO::2014-07-10 09:16:32,994::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='cfaeead2-7caa-467c-b389-c89840ae6605', volUUID='567fe32d-31a6-4ff6-90f3-fd6a656fbecc', options=None) >Thread-70::INFO::2014-07-10 09:16:32,995::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-70::DEBUG::2014-07-10 09:16:32,995::task::1185::TaskManager.Task::(prepare) Task=`40a83a3c-86e2-4aca-8c18-4ce35422ee3c`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-70::DEBUG::2014-07-10 09:16:32,995::task::595::TaskManager.Task::(_updateState) Task=`40a83a3c-86e2-4aca-8c18-4ce35422ee3c`::moving from state preparing -> state finished >Thread-70::DEBUG::2014-07-10 09:16:32,996::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-70::DEBUG::2014-07-10 09:16:32,996::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-70::DEBUG::2014-07-10 09:16:32,996::task::990::TaskManager.Task::(_decref) Task=`40a83a3c-86e2-4aca-8c18-4ce35422ee3c`::ref 0 aborting False >Thread-60::DEBUG::2014-07-10 09:16:33,854::task::595::TaskManager.Task::(_updateState) Task=`32ea3ce4-61cd-4118-a86b-96fbfd0a6b89`::moving from state init -> state preparing >Thread-60::INFO::2014-07-10 09:16:33,854::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='b034d5b0-e1e0-4011-b49b-4d45ddb11556', volUUID='3d7f62b5-328f-4d8e-8b69-873cfb5ae14d', options=None) >Thread-60::INFO::2014-07-10 09:16:33,855::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-60::DEBUG::2014-07-10 09:16:33,855::task::1185::TaskManager.Task::(prepare) Task=`32ea3ce4-61cd-4118-a86b-96fbfd0a6b89`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-60::DEBUG::2014-07-10 09:16:33,855::task::595::TaskManager.Task::(_updateState) Task=`32ea3ce4-61cd-4118-a86b-96fbfd0a6b89`::moving from state preparing -> state finished >Thread-60::DEBUG::2014-07-10 09:16:33,855::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-60::DEBUG::2014-07-10 09:16:33,855::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-60::DEBUG::2014-07-10 09:16:33,855::task::990::TaskManager.Task::(_decref) Task=`32ea3ce4-61cd-4118-a86b-96fbfd0a6b89`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 09:16:33,979::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Thread-51::DEBUG::2014-07-10 09:16:34,013::task::595::TaskManager.Task::(_updateState) Task=`eb85a785-4e7f-4cef-a5e5-f46b75fa0a75`::moving from state init -> state preparing >Thread-51::INFO::2014-07-10 09:16:34,015::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='76fdb054-02cd-42ed-9721-b3e65b34c3a4', volUUID='022dfe46-2cf7-4915-80b3-883158e3ca83', options=None) >Thread-51::INFO::2014-07-10 09:16:34,016::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-51::DEBUG::2014-07-10 09:16:34,017::task::1185::TaskManager.Task::(prepare) Task=`eb85a785-4e7f-4cef-a5e5-f46b75fa0a75`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-51::DEBUG::2014-07-10 09:16:34,017::task::595::TaskManager.Task::(_updateState) Task=`eb85a785-4e7f-4cef-a5e5-f46b75fa0a75`::moving from state preparing -> state finished >Thread-51::DEBUG::2014-07-10 09:16:34,018::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-51::DEBUG::2014-07-10 09:16:34,018::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-51::DEBUG::2014-07-10 09:16:34,019::task::990::TaskManager.Task::(_decref) Task=`eb85a785-4e7f-4cef-a5e5-f46b75fa0a75`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 09:16:34,074::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0344211 s, 29.7 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:16:36,090::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:16:36,214::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0667849 s, 15.3 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:16:38,229::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:16:38,320::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0332922 s, 30.8 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-10 09:16:38,340::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/metadata bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-10 09:16:38,385::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000869313 s, 4.7 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 09:16:38,918::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-14::DEBUG::2014-07-10 09:16:38,919::task::595::TaskManager.Task::(_updateState) Task=`bae0656c-a189-4ca0-a726-244348b387ae`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 09:16:38,920::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-14::INFO::2014-07-10 09:16:38,920::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:16:38,921::task::1185::TaskManager.Task::(prepare) Task=`bae0656c-a189-4ca0-a726-244348b387ae`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:16:38,921::task::595::TaskManager.Task::(_updateState) Task=`bae0656c-a189-4ca0-a726-244348b387ae`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 09:16:38,921::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 09:16:38,921::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 09:16:38,922::task::990::TaskManager.Task::(_decref) Task=`bae0656c-a189-4ca0-a726-244348b387ae`::ref 0 aborting False >Thread-34::DEBUG::2014-07-10 09:16:38,926::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-34::DEBUG::2014-07-10 09:16:38,927::task::595::TaskManager.Task::(_updateState) Task=`e9fc0cf6-a634-4a06-bc3f-c3838ef875c3`::moving from state init -> state preparing >Thread-34::INFO::2014-07-10 09:16:38,927::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-34::DEBUG::2014-07-10 09:16:38,928::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`dfabf660-4436-4ebd-9fe7-f30bd77944e9`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-10 09:16:38,928::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' for lock type 'shared' >Thread-34::DEBUG::2014-07-10 09:16:38,928::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-10 09:16:38,929::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`dfabf660-4436-4ebd-9fe7-f30bd77944e9`::Granted request >Thread-34::DEBUG::2014-07-10 09:16:38,929::task::827::TaskManager.Task::(resourceAcquired) Task=`e9fc0cf6-a634-4a06-bc3f-c3838ef875c3`::_resourcesAcquired: Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee (shared) >Thread-34::DEBUG::2014-07-10 09:16:38,929::task::990::TaskManager.Task::(_decref) Task=`e9fc0cf6-a634-4a06-bc3f-c3838ef875c3`::ref 1 aborting False >Thread-34::INFO::2014-07-10 09:16:38,930::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532067385344', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:16:38,931::task::1185::TaskManager.Task::(prepare) Task=`e9fc0cf6-a634-4a06-bc3f-c3838ef875c3`::finished: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532067385344', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:16:38,931::task::595::TaskManager.Task::(_updateState) Task=`e9fc0cf6-a634-4a06-bc3f-c3838ef875c3`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-10 09:16:38,931::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee': < ResourceRef 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-10 09:16:38,931::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-10 09:16:38,932::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' >Thread-34::DEBUG::2014-07-10 09:16:38,932::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' (0 active users) >Thread-34::DEBUG::2014-07-10 09:16:38,932::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-10 09:16:38,932::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', Clearing records. >Thread-34::DEBUG::2014-07-10 09:16:38,932::task::990::TaskManager.Task::(_decref) Task=`e9fc0cf6-a634-4a06-bc3f-c3838ef875c3`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 09:16:40,385::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:16:40,502::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0289564 s, 35.4 MB/s\n'; <rc> = 0 >Thread-40::DEBUG::2014-07-10 09:16:41,032::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lion.qa.lab.tlv.redhat.com:_export_yuri2_backup2/6a70504d-00df-4869-8695-0f442053f6b6/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-40::DEBUG::2014-07-10 09:16:41,051::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n369 bytes (369 B) copied, 0.000493775 s, 747 kB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:16:42,518::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:16:42,742::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0333786 s, 30.7 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:16:44,752::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:16:44,841::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0300966 s, 34.0 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 09:16:45,170::task::595::TaskManager.Task::(_updateState) Task=`840ede64-4231-4ba5-a394-fb8256e419d7`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 09:16:45,170::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::INFO::2014-07-10 09:16:45,171::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000869313', 'lastCheck': '6.8', 'valid': True}, '6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000493775', 'lastCheck': '4.1', 'valid': True}} >Thread-14::DEBUG::2014-07-10 09:16:45,171::task::1185::TaskManager.Task::(prepare) Task=`840ede64-4231-4ba5-a394-fb8256e419d7`::finished: {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000869313', 'lastCheck': '6.8', 'valid': True}, '6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000493775', 'lastCheck': '4.1', 'valid': True}} >Thread-14::DEBUG::2014-07-10 09:16:45,171::task::595::TaskManager.Task::(_updateState) Task=`840ede64-4231-4ba5-a394-fb8256e419d7`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 09:16:45,171::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 09:16:45,171::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 09:16:45,172::task::990::TaskManager.Task::(_decref) Task=`840ede64-4231-4ba5-a394-fb8256e419d7`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 09:16:46,857::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:16:46,953::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0356754 s, 28.7 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-10 09:16:48,413::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/metadata bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-10 09:16:48,435::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000834375 s, 4.9 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 09:16:48,960::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-14::DEBUG::2014-07-10 09:16:48,961::task::595::TaskManager.Task::(_updateState) Task=`76d12993-b83e-47f6-b38c-456721c9c399`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 09:16:48,961::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-14::INFO::2014-07-10 09:16:48,962::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:16:48,962::task::1185::TaskManager.Task::(prepare) Task=`76d12993-b83e-47f6-b38c-456721c9c399`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:16:48,962::task::595::TaskManager.Task::(_updateState) Task=`76d12993-b83e-47f6-b38c-456721c9c399`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 09:16:48,962::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 09:16:48,962::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 09:16:48,963::task::990::TaskManager.Task::(_decref) Task=`76d12993-b83e-47f6-b38c-456721c9c399`::ref 0 aborting False >Thread-34::DEBUG::2014-07-10 09:16:48,967::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-34::DEBUG::2014-07-10 09:16:48,967::task::595::TaskManager.Task::(_updateState) Task=`0dbc3cf0-6390-4148-a723-d4b0c35be9cf`::moving from state init -> state preparing >Thread-34::INFO::2014-07-10 09:16:48,968::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-34::DEBUG::2014-07-10 09:16:48,969::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`853f73f3-e10f-4cdb-8a68-34145b0404d3`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-10 09:16:48,969::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' for lock type 'shared' >Thread-34::DEBUG::2014-07-10 09:16:48,969::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-10 09:16:48,970::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`853f73f3-e10f-4cdb-8a68-34145b0404d3`::Granted request >Thread-34::DEBUG::2014-07-10 09:16:48,970::task::827::TaskManager.Task::(resourceAcquired) Task=`0dbc3cf0-6390-4148-a723-d4b0c35be9cf`::_resourcesAcquired: Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee (shared) >Thread-34::DEBUG::2014-07-10 09:16:48,970::task::990::TaskManager.Task::(_decref) Task=`0dbc3cf0-6390-4148-a723-d4b0c35be9cf`::ref 1 aborting False >Thread-34::INFO::2014-07-10 09:16:48,971::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532067385344', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:16:48,971::task::1185::TaskManager.Task::(prepare) Task=`0dbc3cf0-6390-4148-a723-d4b0c35be9cf`::finished: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532067385344', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:16:48,971::task::595::TaskManager.Task::(_updateState) Task=`0dbc3cf0-6390-4148-a723-d4b0c35be9cf`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-10 09:16:48,972::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee': < ResourceRef 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-10 09:16:48,972::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-10 09:16:48,972::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' >Thread-34::DEBUG::2014-07-10 09:16:48,972::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' (0 active users) >Thread-34::DEBUG::2014-07-10 09:16:48,972::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-10 09:16:48,973::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', Clearing records. >Thread-34::DEBUG::2014-07-10 09:16:48,973::task::990::TaskManager.Task::(_decref) Task=`0dbc3cf0-6390-4148-a723-d4b0c35be9cf`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 09:16:48,998::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:16:49,102::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0424498 s, 24.1 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:16:51,124::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Thread-40::DEBUG::2014-07-10 09:16:51,339::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lion.qa.lab.tlv.redhat.com:_export_yuri2_backup2/6a70504d-00df-4869-8695-0f442053f6b6/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-40::DEBUG::2014-07-10 09:16:51,421::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n369 bytes (369 B) copied, 0.000413081 s, 893 kB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:16:51,494::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.307007 s, 3.3 MB/s\n'; <rc> = 0 >Thread-64::DEBUG::2014-07-10 09:16:53,067::task::595::TaskManager.Task::(_updateState) Task=`3a76331a-2b5d-4d47-8274-02e0e43abf8e`::moving from state init -> state preparing >Thread-64::INFO::2014-07-10 09:16:53,068::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='aa20346a-4d3a-4e07-b8e1-52c0ebe4168c', volUUID='58fefce2-9bce-4bff-8949-8c6ce8122b27', options=None) >Thread-64::INFO::2014-07-10 09:16:53,068::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-64::DEBUG::2014-07-10 09:16:53,068::task::1185::TaskManager.Task::(prepare) Task=`3a76331a-2b5d-4d47-8274-02e0e43abf8e`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-64::DEBUG::2014-07-10 09:16:53,069::task::595::TaskManager.Task::(_updateState) Task=`3a76331a-2b5d-4d47-8274-02e0e43abf8e`::moving from state preparing -> state finished >Thread-64::DEBUG::2014-07-10 09:16:53,069::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-64::DEBUG::2014-07-10 09:16:53,069::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-64::DEBUG::2014-07-10 09:16:53,069::task::990::TaskManager.Task::(_decref) Task=`3a76331a-2b5d-4d47-8274-02e0e43abf8e`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 09:16:53,520::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:16:53,603::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0279014 s, 36.7 MB/s\n'; <rc> = 0 >Thread-54::DEBUG::2014-07-10 09:16:54,387::task::595::TaskManager.Task::(_updateState) Task=`4ad854bb-788c-409f-bafd-ee636fb2b976`::moving from state init -> state preparing >Thread-73::DEBUG::2014-07-10 09:16:54,389::task::595::TaskManager.Task::(_updateState) Task=`cecc1597-88c0-438b-867b-0576acfaa0fc`::moving from state init -> state preparing >Thread-54::INFO::2014-07-10 09:16:54,389::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='28408446-e5fd-4565-a976-e760951593fe', volUUID='776303a2-5585-451e-826e-0e338d4a1e98', options=None) >Thread-73::INFO::2014-07-10 09:16:54,391::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='c01d693b-cba0-4fed-9ad7-0aaa28912a19', volUUID='4bb5d954-2a50-4028-b299-0b43c261270c', options=None) >Thread-54::INFO::2014-07-10 09:16:54,392::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-73::INFO::2014-07-10 09:16:54,393::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-54::DEBUG::2014-07-10 09:16:54,393::task::1185::TaskManager.Task::(prepare) Task=`4ad854bb-788c-409f-bafd-ee636fb2b976`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-73::DEBUG::2014-07-10 09:16:54,394::task::1185::TaskManager.Task::(prepare) Task=`cecc1597-88c0-438b-867b-0576acfaa0fc`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-54::DEBUG::2014-07-10 09:16:54,394::task::595::TaskManager.Task::(_updateState) Task=`4ad854bb-788c-409f-bafd-ee636fb2b976`::moving from state preparing -> state finished >Thread-73::DEBUG::2014-07-10 09:16:54,395::task::595::TaskManager.Task::(_updateState) Task=`cecc1597-88c0-438b-867b-0576acfaa0fc`::moving from state preparing -> state finished >Thread-54::DEBUG::2014-07-10 09:16:54,395::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-73::DEBUG::2014-07-10 09:16:54,396::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-54::DEBUG::2014-07-10 09:16:54,397::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-73::DEBUG::2014-07-10 09:16:54,397::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-54::DEBUG::2014-07-10 09:16:54,398::task::990::TaskManager.Task::(_decref) Task=`4ad854bb-788c-409f-bafd-ee636fb2b976`::ref 0 aborting False >Thread-73::DEBUG::2014-07-10 09:16:54,399::task::990::TaskManager.Task::(_decref) Task=`cecc1597-88c0-438b-867b-0576acfaa0fc`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 09:16:55,618::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:16:55,705::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0273438 s, 37.4 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:16:57,720::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:16:57,824::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0309517 s, 33.1 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-10 09:16:58,464::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/metadata bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-10 09:16:58,490::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000647863 s, 6.3 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 09:16:58,994::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-14::DEBUG::2014-07-10 09:16:58,995::task::595::TaskManager.Task::(_updateState) Task=`068314b5-a992-4048-b02d-ab8b7f42a234`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 09:16:58,996::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-14::INFO::2014-07-10 09:16:58,996::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:16:58,996::task::1185::TaskManager.Task::(prepare) Task=`068314b5-a992-4048-b02d-ab8b7f42a234`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:16:58,997::task::595::TaskManager.Task::(_updateState) Task=`068314b5-a992-4048-b02d-ab8b7f42a234`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 09:16:58,997::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 09:16:58,997::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 09:16:58,997::task::990::TaskManager.Task::(_decref) Task=`068314b5-a992-4048-b02d-ab8b7f42a234`::ref 0 aborting False >Thread-34::DEBUG::2014-07-10 09:16:59,002::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-34::DEBUG::2014-07-10 09:16:59,002::task::595::TaskManager.Task::(_updateState) Task=`0b4f0ae4-d875-4072-a912-f79ec1dc687a`::moving from state init -> state preparing >Thread-34::INFO::2014-07-10 09:16:59,002::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-34::DEBUG::2014-07-10 09:16:59,003::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`94d08d81-95ec-42a6-ac33-bac9ec556d7f`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-10 09:16:59,003::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' for lock type 'shared' >Thread-34::DEBUG::2014-07-10 09:16:59,004::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-10 09:16:59,004::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`94d08d81-95ec-42a6-ac33-bac9ec556d7f`::Granted request >Thread-34::DEBUG::2014-07-10 09:16:59,004::task::827::TaskManager.Task::(resourceAcquired) Task=`0b4f0ae4-d875-4072-a912-f79ec1dc687a`::_resourcesAcquired: Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee (shared) >Thread-34::DEBUG::2014-07-10 09:16:59,004::task::990::TaskManager.Task::(_decref) Task=`0b4f0ae4-d875-4072-a912-f79ec1dc687a`::ref 1 aborting False >Thread-34::INFO::2014-07-10 09:16:59,006::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532067385344', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:16:59,006::task::1185::TaskManager.Task::(prepare) Task=`0b4f0ae4-d875-4072-a912-f79ec1dc687a`::finished: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532067385344', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:16:59,006::task::595::TaskManager.Task::(_updateState) Task=`0b4f0ae4-d875-4072-a912-f79ec1dc687a`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-10 09:16:59,006::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee': < ResourceRef 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-10 09:16:59,006::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-10 09:16:59,007::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' >Thread-34::DEBUG::2014-07-10 09:16:59,007::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' (0 active users) >Thread-34::DEBUG::2014-07-10 09:16:59,007::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-10 09:16:59,007::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', Clearing records. >Thread-34::DEBUG::2014-07-10 09:16:59,007::task::990::TaskManager.Task::(_decref) Task=`0b4f0ae4-d875-4072-a912-f79ec1dc687a`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 09:16:59,839::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:16:59,954::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0334453 s, 30.6 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 09:17:00,447::task::595::TaskManager.Task::(_updateState) Task=`91b6f9cb-3527-4d0f-8bca-2c7a42a8b1e9`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 09:17:00,448::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::INFO::2014-07-10 09:17:00,449::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000647863', 'lastCheck': '1.9', 'valid': True}, '6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000413081', 'lastCheck': '9.0', 'valid': True}} >Thread-14::DEBUG::2014-07-10 09:17:00,449::task::1185::TaskManager.Task::(prepare) Task=`91b6f9cb-3527-4d0f-8bca-2c7a42a8b1e9`::finished: {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000647863', 'lastCheck': '1.9', 'valid': True}, '6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000413081', 'lastCheck': '9.0', 'valid': True}} >Thread-14::DEBUG::2014-07-10 09:17:00,449::task::595::TaskManager.Task::(_updateState) Task=`91b6f9cb-3527-4d0f-8bca-2c7a42a8b1e9`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 09:17:00,449::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 09:17:00,449::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 09:17:00,450::task::990::TaskManager.Task::(_decref) Task=`91b6f9cb-3527-4d0f-8bca-2c7a42a8b1e9`::ref 0 aborting False >Thread-40::DEBUG::2014-07-10 09:17:01,452::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lion.qa.lab.tlv.redhat.com:_export_yuri2_backup2/6a70504d-00df-4869-8695-0f442053f6b6/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-40::DEBUG::2014-07-10 09:17:01,473::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n369 bytes (369 B) copied, 0.000489927 s, 753 kB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:17:01,970::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:17:02,065::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0357673 s, 28.6 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:17:04,080::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:17:04,169::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0312388 s, 32.8 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:17:06,187::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:17:06,279::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0345324 s, 29.7 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:17:08,294::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:17:08,400::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0484448 s, 21.1 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-10 09:17:08,523::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/metadata bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-10 09:17:08,545::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000813582 s, 5.0 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 09:17:09,037::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-14::DEBUG::2014-07-10 09:17:09,038::task::595::TaskManager.Task::(_updateState) Task=`7a33ccb3-3785-4320-a865-be7caa7cdb14`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 09:17:09,038::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-14::INFO::2014-07-10 09:17:09,039::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:17:09,039::task::1185::TaskManager.Task::(prepare) Task=`7a33ccb3-3785-4320-a865-be7caa7cdb14`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:17:09,039::task::595::TaskManager.Task::(_updateState) Task=`7a33ccb3-3785-4320-a865-be7caa7cdb14`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 09:17:09,039::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 09:17:09,040::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 09:17:09,040::task::990::TaskManager.Task::(_decref) Task=`7a33ccb3-3785-4320-a865-be7caa7cdb14`::ref 0 aborting False >Thread-34::DEBUG::2014-07-10 09:17:09,044::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-34::DEBUG::2014-07-10 09:17:09,044::task::595::TaskManager.Task::(_updateState) Task=`fc97fa0b-9863-470e-a2ec-af3095450d4c`::moving from state init -> state preparing >Thread-34::INFO::2014-07-10 09:17:09,045::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-34::DEBUG::2014-07-10 09:17:09,045::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`d64208eb-e993-4f27-930c-1b481aa76853`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-10 09:17:09,046::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' for lock type 'shared' >Thread-34::DEBUG::2014-07-10 09:17:09,046::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-10 09:17:09,046::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`d64208eb-e993-4f27-930c-1b481aa76853`::Granted request >Thread-34::DEBUG::2014-07-10 09:17:09,047::task::827::TaskManager.Task::(resourceAcquired) Task=`fc97fa0b-9863-470e-a2ec-af3095450d4c`::_resourcesAcquired: Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee (shared) >Thread-34::DEBUG::2014-07-10 09:17:09,047::task::990::TaskManager.Task::(_decref) Task=`fc97fa0b-9863-470e-a2ec-af3095450d4c`::ref 1 aborting False >Thread-34::INFO::2014-07-10 09:17:09,048::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532067385344', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:17:09,049::task::1185::TaskManager.Task::(prepare) Task=`fc97fa0b-9863-470e-a2ec-af3095450d4c`::finished: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532067385344', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:17:09,049::task::595::TaskManager.Task::(_updateState) Task=`fc97fa0b-9863-470e-a2ec-af3095450d4c`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-10 09:17:09,049::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee': < ResourceRef 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-10 09:17:09,049::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-10 09:17:09,049::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' >Thread-34::DEBUG::2014-07-10 09:17:09,050::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' (0 active users) >Thread-34::DEBUG::2014-07-10 09:17:09,050::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-10 09:17:09,050::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', Clearing records. >Thread-34::DEBUG::2014-07-10 09:17:09,050::task::990::TaskManager.Task::(_decref) Task=`fc97fa0b-9863-470e-a2ec-af3095450d4c`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 09:17:10,416::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:17:10,548::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0304376 s, 33.6 MB/s\n'; <rc> = 0 >Thread-40::DEBUG::2014-07-10 09:17:11,510::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lion.qa.lab.tlv.redhat.com:_export_yuri2_backup2/6a70504d-00df-4869-8695-0f442053f6b6/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-40::DEBUG::2014-07-10 09:17:11,531::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n369 bytes (369 B) copied, 0.000635843 s, 580 kB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:17:12,565::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:17:12,677::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0600701 s, 17.0 MB/s\n'; <rc> = 0 >Thread-57::DEBUG::2014-07-10 09:17:13,177::task::595::TaskManager.Task::(_updateState) Task=`b24bf8bb-67ca-4032-8e3b-36c21dcc58a2`::moving from state init -> state preparing >Thread-57::INFO::2014-07-10 09:17:13,178::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='b6f6c0da-e67f-4902-b9ac-3069571a42fe', volUUID='c4cd1da8-05b7-45e0-80b1-1183d21443d9', options=None) >Thread-57::INFO::2014-07-10 09:17:13,178::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-57::DEBUG::2014-07-10 09:17:13,178::task::1185::TaskManager.Task::(prepare) Task=`b24bf8bb-67ca-4032-8e3b-36c21dcc58a2`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-57::DEBUG::2014-07-10 09:17:13,179::task::595::TaskManager.Task::(_updateState) Task=`b24bf8bb-67ca-4032-8e3b-36c21dcc58a2`::moving from state preparing -> state finished >Thread-57::DEBUG::2014-07-10 09:17:13,179::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-57::DEBUG::2014-07-10 09:17:13,179::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-57::DEBUG::2014-07-10 09:17:13,179::task::990::TaskManager.Task::(_decref) Task=`b24bf8bb-67ca-4032-8e3b-36c21dcc58a2`::ref 0 aborting False >Thread-67::DEBUG::2014-07-10 09:17:14,034::task::595::TaskManager.Task::(_updateState) Task=`a46b004f-dcac-4b9f-9179-65c2c392fbbc`::moving from state init -> state preparing >Thread-67::INFO::2014-07-10 09:17:14,034::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='f30c2cb7-a43a-4bf5-82b5-cfe07336f65c', volUUID='b0fbb3c9-55af-4a3a-95ad-fc56a80b9cf5', options=None) >Thread-67::INFO::2014-07-10 09:17:14,035::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-67::DEBUG::2014-07-10 09:17:14,035::task::1185::TaskManager.Task::(prepare) Task=`a46b004f-dcac-4b9f-9179-65c2c392fbbc`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-67::DEBUG::2014-07-10 09:17:14,035::task::595::TaskManager.Task::(_updateState) Task=`a46b004f-dcac-4b9f-9179-65c2c392fbbc`::moving from state preparing -> state finished >Thread-67::DEBUG::2014-07-10 09:17:14,035::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-67::DEBUG::2014-07-10 09:17:14,035::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-67::DEBUG::2014-07-10 09:17:14,036::task::990::TaskManager.Task::(_decref) Task=`a46b004f-dcac-4b9f-9179-65c2c392fbbc`::ref 0 aborting False >Thread-48::DEBUG::2014-07-10 09:17:14,478::task::595::TaskManager.Task::(_updateState) Task=`019eb569-2e36-4524-b229-d1d67961cf0c`::moving from state init -> state preparing >Thread-48::INFO::2014-07-10 09:17:14,479::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='0cd7d6ce-f497-4243-a690-c57744861eea', volUUID='10b6a7dd-dc6c-43fa-ba17-92e4331b0e0b', options=None) >Thread-48::INFO::2014-07-10 09:17:14,479::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-48::DEBUG::2014-07-10 09:17:14,479::task::1185::TaskManager.Task::(prepare) Task=`019eb569-2e36-4524-b229-d1d67961cf0c`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-48::DEBUG::2014-07-10 09:17:14,480::task::595::TaskManager.Task::(_updateState) Task=`019eb569-2e36-4524-b229-d1d67961cf0c`::moving from state preparing -> state finished >Thread-48::DEBUG::2014-07-10 09:17:14,480::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-48::DEBUG::2014-07-10 09:17:14,480::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-48::DEBUG::2014-07-10 09:17:14,480::task::990::TaskManager.Task::(_decref) Task=`019eb569-2e36-4524-b229-d1d67961cf0c`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 09:17:14,688::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:17:14,787::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0327843 s, 31.2 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 09:17:15,638::task::595::TaskManager.Task::(_updateState) Task=`1ab45c3d-3e0b-4831-aa28-bfcffb319089`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 09:17:15,639::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::INFO::2014-07-10 09:17:15,640::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000813582', 'lastCheck': '7.1', 'valid': True}, '6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000635843', 'lastCheck': '4.1', 'valid': True}} >Thread-14::DEBUG::2014-07-10 09:17:15,640::task::1185::TaskManager.Task::(prepare) Task=`1ab45c3d-3e0b-4831-aa28-bfcffb319089`::finished: {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000813582', 'lastCheck': '7.1', 'valid': True}, '6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000635843', 'lastCheck': '4.1', 'valid': True}} >Thread-14::DEBUG::2014-07-10 09:17:15,640::task::595::TaskManager.Task::(_updateState) Task=`1ab45c3d-3e0b-4831-aa28-bfcffb319089`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 09:17:15,641::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 09:17:15,641::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 09:17:15,642::task::990::TaskManager.Task::(_decref) Task=`1ab45c3d-3e0b-4831-aa28-bfcffb319089`::ref 0 aborting False >Thread-76::DEBUG::2014-07-10 09:17:15,835::task::595::TaskManager.Task::(_updateState) Task=`dc358063-87e7-4dc8-9912-89cba86aa9b5`::moving from state init -> state preparing >Thread-76::INFO::2014-07-10 09:17:15,836::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='e4c65229-4247-4b33-b72a-f1d5ce72ad05', volUUID='cad94284-3ca9-4c30-933d-997f4460309e', options=None) >Thread-76::INFO::2014-07-10 09:17:15,836::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-76::DEBUG::2014-07-10 09:17:15,836::task::1185::TaskManager.Task::(prepare) Task=`dc358063-87e7-4dc8-9912-89cba86aa9b5`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-76::DEBUG::2014-07-10 09:17:15,836::task::595::TaskManager.Task::(_updateState) Task=`dc358063-87e7-4dc8-9912-89cba86aa9b5`::moving from state preparing -> state finished >Thread-76::DEBUG::2014-07-10 09:17:15,837::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-76::DEBUG::2014-07-10 09:17:15,837::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-76::DEBUG::2014-07-10 09:17:15,837::task::990::TaskManager.Task::(_decref) Task=`dc358063-87e7-4dc8-9912-89cba86aa9b5`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 09:17:16,803::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:17:16,892::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.032778 s, 31.2 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-10 09:17:18,574::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/metadata bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-10 09:17:18,597::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000680477 s, 6.0 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:17:18,907::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:17:18,995::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0295392 s, 34.7 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 09:17:19,079::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-14::DEBUG::2014-07-10 09:17:19,080::task::595::TaskManager.Task::(_updateState) Task=`5038d460-65cb-4da4-a02c-0aa6d0ff7e7c`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 09:17:19,080::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-14::INFO::2014-07-10 09:17:19,081::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:17:19,081::task::1185::TaskManager.Task::(prepare) Task=`5038d460-65cb-4da4-a02c-0aa6d0ff7e7c`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:17:19,081::task::595::TaskManager.Task::(_updateState) Task=`5038d460-65cb-4da4-a02c-0aa6d0ff7e7c`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 09:17:19,082::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 09:17:19,082::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 09:17:19,082::task::990::TaskManager.Task::(_decref) Task=`5038d460-65cb-4da4-a02c-0aa6d0ff7e7c`::ref 0 aborting False >Thread-34::DEBUG::2014-07-10 09:17:19,086::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-34::DEBUG::2014-07-10 09:17:19,087::task::595::TaskManager.Task::(_updateState) Task=`6cfb029c-91d8-4904-8ef3-4bc090024af8`::moving from state init -> state preparing >Thread-34::INFO::2014-07-10 09:17:19,087::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-34::DEBUG::2014-07-10 09:17:19,088::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`38782833-8d3b-4fb5-9094-594a9b23db09`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-10 09:17:19,088::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' for lock type 'shared' >Thread-34::DEBUG::2014-07-10 09:17:19,088::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-10 09:17:19,089::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`38782833-8d3b-4fb5-9094-594a9b23db09`::Granted request >Thread-34::DEBUG::2014-07-10 09:17:19,089::task::827::TaskManager.Task::(resourceAcquired) Task=`6cfb029c-91d8-4904-8ef3-4bc090024af8`::_resourcesAcquired: Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee (shared) >Thread-34::DEBUG::2014-07-10 09:17:19,089::task::990::TaskManager.Task::(_decref) Task=`6cfb029c-91d8-4904-8ef3-4bc090024af8`::ref 1 aborting False >Thread-34::INFO::2014-07-10 09:17:19,090::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532067385344', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:17:19,091::task::1185::TaskManager.Task::(prepare) Task=`6cfb029c-91d8-4904-8ef3-4bc090024af8`::finished: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532067385344', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:17:19,091::task::595::TaskManager.Task::(_updateState) Task=`6cfb029c-91d8-4904-8ef3-4bc090024af8`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-10 09:17:19,091::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee': < ResourceRef 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-10 09:17:19,091::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-10 09:17:19,091::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' >Thread-34::DEBUG::2014-07-10 09:17:19,092::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' (0 active users) >Thread-34::DEBUG::2014-07-10 09:17:19,092::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-10 09:17:19,092::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', Clearing records. >Thread-34::DEBUG::2014-07-10 09:17:19,092::task::990::TaskManager.Task::(_decref) Task=`6cfb029c-91d8-4904-8ef3-4bc090024af8`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 09:17:21,010::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:17:21,102::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0354868 s, 28.9 MB/s\n'; <rc> = 0 >Thread-40::DEBUG::2014-07-10 09:17:21,563::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lion.qa.lab.tlv.redhat.com:_export_yuri2_backup2/6a70504d-00df-4869-8695-0f442053f6b6/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-40::DEBUG::2014-07-10 09:17:21,584::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n369 bytes (369 B) copied, 0.000587785 s, 628 kB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:17:23,118::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:17:23,211::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0352858 s, 29.0 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:17:25,233::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:17:25,322::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0311423 s, 32.9 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:17:27,337::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:17:27,422::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0309668 s, 33.1 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-10 09:17:28,626::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/metadata bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-10 09:17:28,648::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00079695 s, 5.1 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 09:17:29,120::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-14::DEBUG::2014-07-10 09:17:29,121::task::595::TaskManager.Task::(_updateState) Task=`d5fd2d52-10c1-4e5c-9938-89e8fbe16676`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 09:17:29,122::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-14::INFO::2014-07-10 09:17:29,122::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:17:29,122::task::1185::TaskManager.Task::(prepare) Task=`d5fd2d52-10c1-4e5c-9938-89e8fbe16676`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:17:29,123::task::595::TaskManager.Task::(_updateState) Task=`d5fd2d52-10c1-4e5c-9938-89e8fbe16676`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 09:17:29,123::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 09:17:29,123::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 09:17:29,123::task::990::TaskManager.Task::(_decref) Task=`d5fd2d52-10c1-4e5c-9938-89e8fbe16676`::ref 0 aborting False >Thread-34::DEBUG::2014-07-10 09:17:29,128::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-34::DEBUG::2014-07-10 09:17:29,130::task::595::TaskManager.Task::(_updateState) Task=`e11f6dbc-8cb7-40a3-b392-516cc4507a8a`::moving from state init -> state preparing >Thread-34::INFO::2014-07-10 09:17:29,130::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-34::DEBUG::2014-07-10 09:17:29,131::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`41073e19-6bf0-400a-b726-f8d8e6f85e8b`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-10 09:17:29,131::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' for lock type 'shared' >Thread-34::DEBUG::2014-07-10 09:17:29,132::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-10 09:17:29,132::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`41073e19-6bf0-400a-b726-f8d8e6f85e8b`::Granted request >Thread-34::DEBUG::2014-07-10 09:17:29,132::task::827::TaskManager.Task::(resourceAcquired) Task=`e11f6dbc-8cb7-40a3-b392-516cc4507a8a`::_resourcesAcquired: Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee (shared) >Thread-34::DEBUG::2014-07-10 09:17:29,133::task::990::TaskManager.Task::(_decref) Task=`e11f6dbc-8cb7-40a3-b392-516cc4507a8a`::ref 1 aborting False >Thread-34::INFO::2014-07-10 09:17:29,134::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532067385344', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:17:29,134::task::1185::TaskManager.Task::(prepare) Task=`e11f6dbc-8cb7-40a3-b392-516cc4507a8a`::finished: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532067385344', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:17:29,135::task::595::TaskManager.Task::(_updateState) Task=`e11f6dbc-8cb7-40a3-b392-516cc4507a8a`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-10 09:17:29,135::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee': < ResourceRef 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-10 09:17:29,135::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-10 09:17:29,135::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' >Thread-34::DEBUG::2014-07-10 09:17:29,135::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' (0 active users) >Thread-34::DEBUG::2014-07-10 09:17:29,136::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-10 09:17:29,136::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', Clearing records. >Thread-34::DEBUG::2014-07-10 09:17:29,136::task::990::TaskManager.Task::(_decref) Task=`e11f6dbc-8cb7-40a3-b392-516cc4507a8a`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 09:17:29,437::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:17:29,529::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0336811 s, 30.4 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 09:17:30,811::task::595::TaskManager.Task::(_updateState) Task=`2adac64f-1a9f-41e9-b159-1229e7ac6601`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 09:17:30,812::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::INFO::2014-07-10 09:17:30,812::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00079695', 'lastCheck': '2.1', 'valid': True}, '6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000587785', 'lastCheck': '9.2', 'valid': True}} >Thread-14::DEBUG::2014-07-10 09:17:30,812::task::1185::TaskManager.Task::(prepare) Task=`2adac64f-1a9f-41e9-b159-1229e7ac6601`::finished: {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00079695', 'lastCheck': '2.1', 'valid': True}, '6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000587785', 'lastCheck': '9.2', 'valid': True}} >Thread-14::DEBUG::2014-07-10 09:17:30,812::task::595::TaskManager.Task::(_updateState) Task=`2adac64f-1a9f-41e9-b159-1229e7ac6601`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 09:17:30,813::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 09:17:30,813::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 09:17:30,813::task::990::TaskManager.Task::(_decref) Task=`2adac64f-1a9f-41e9-b159-1229e7ac6601`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 09:17:31,544::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Thread-40::DEBUG::2014-07-10 09:17:31,610::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lion.qa.lab.tlv.redhat.com:_export_yuri2_backup2/6a70504d-00df-4869-8695-0f442053f6b6/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-40::DEBUG::2014-07-10 09:17:31,687::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n369 bytes (369 B) copied, 0.000488169 s, 756 kB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:17:31,779::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.176148 s, 5.8 MB/s\n'; <rc> = 0 >Thread-70::DEBUG::2014-07-10 09:17:33,249::task::595::TaskManager.Task::(_updateState) Task=`0bf3bcfc-a9e8-449c-9a9b-3b5095e83fff`::moving from state init -> state preparing >Thread-70::INFO::2014-07-10 09:17:33,252::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='cfaeead2-7caa-467c-b389-c89840ae6605', volUUID='567fe32d-31a6-4ff6-90f3-fd6a656fbecc', options=None) >Thread-70::INFO::2014-07-10 09:17:33,252::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-70::DEBUG::2014-07-10 09:17:33,253::task::1185::TaskManager.Task::(prepare) Task=`0bf3bcfc-a9e8-449c-9a9b-3b5095e83fff`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-70::DEBUG::2014-07-10 09:17:33,253::task::595::TaskManager.Task::(_updateState) Task=`0bf3bcfc-a9e8-449c-9a9b-3b5095e83fff`::moving from state preparing -> state finished >Thread-70::DEBUG::2014-07-10 09:17:33,253::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-70::DEBUG::2014-07-10 09:17:33,254::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-70::DEBUG::2014-07-10 09:17:33,254::task::990::TaskManager.Task::(_decref) Task=`0bf3bcfc-a9e8-449c-9a9b-3b5095e83fff`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 09:17:33,795::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:17:33,881::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.028476 s, 36.0 MB/s\n'; <rc> = 0 >Thread-60::DEBUG::2014-07-10 09:17:34,103::task::595::TaskManager.Task::(_updateState) Task=`b57fbb17-daec-4a1d-a416-7ef61bf3ce95`::moving from state init -> state preparing >Thread-60::INFO::2014-07-10 09:17:34,104::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='b034d5b0-e1e0-4011-b49b-4d45ddb11556', volUUID='3d7f62b5-328f-4d8e-8b69-873cfb5ae14d', options=None) >Thread-60::INFO::2014-07-10 09:17:34,105::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-60::DEBUG::2014-07-10 09:17:34,105::task::1185::TaskManager.Task::(prepare) Task=`b57fbb17-daec-4a1d-a416-7ef61bf3ce95`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-60::DEBUG::2014-07-10 09:17:34,105::task::595::TaskManager.Task::(_updateState) Task=`b57fbb17-daec-4a1d-a416-7ef61bf3ce95`::moving from state preparing -> state finished >Thread-60::DEBUG::2014-07-10 09:17:34,105::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-60::DEBUG::2014-07-10 09:17:34,105::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-60::DEBUG::2014-07-10 09:17:34,106::task::990::TaskManager.Task::(_decref) Task=`b57fbb17-daec-4a1d-a416-7ef61bf3ce95`::ref 0 aborting False >Thread-51::DEBUG::2014-07-10 09:17:34,290::task::595::TaskManager.Task::(_updateState) Task=`31685a6d-b0b7-4045-aa8f-88602ebcc070`::moving from state init -> state preparing >Thread-51::INFO::2014-07-10 09:17:34,291::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='76fdb054-02cd-42ed-9721-b3e65b34c3a4', volUUID='022dfe46-2cf7-4915-80b3-883158e3ca83', options=None) >Thread-51::INFO::2014-07-10 09:17:34,291::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-51::DEBUG::2014-07-10 09:17:34,291::task::1185::TaskManager.Task::(prepare) Task=`31685a6d-b0b7-4045-aa8f-88602ebcc070`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-51::DEBUG::2014-07-10 09:17:34,291::task::595::TaskManager.Task::(_updateState) Task=`31685a6d-b0b7-4045-aa8f-88602ebcc070`::moving from state preparing -> state finished >Thread-51::DEBUG::2014-07-10 09:17:34,292::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-51::DEBUG::2014-07-10 09:17:34,292::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-51::DEBUG::2014-07-10 09:17:34,292::task::990::TaskManager.Task::(_decref) Task=`31685a6d-b0b7-4045-aa8f-88602ebcc070`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 09:17:35,896::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:17:36,017::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0645455 s, 15.9 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:17:38,032::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:17:38,140::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0511107 s, 20.0 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-10 09:17:38,678::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/metadata bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-10 09:17:38,700::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00078646 s, 5.2 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 09:17:39,170::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-14::DEBUG::2014-07-10 09:17:39,172::task::595::TaskManager.Task::(_updateState) Task=`25a25aed-35ee-4e65-a300-3b899a556c33`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 09:17:39,172::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-14::INFO::2014-07-10 09:17:39,173::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:17:39,173::task::1185::TaskManager.Task::(prepare) Task=`25a25aed-35ee-4e65-a300-3b899a556c33`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:17:39,173::task::595::TaskManager.Task::(_updateState) Task=`25a25aed-35ee-4e65-a300-3b899a556c33`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 09:17:39,173::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 09:17:39,173::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 09:17:39,174::task::990::TaskManager.Task::(_decref) Task=`25a25aed-35ee-4e65-a300-3b899a556c33`::ref 0 aborting False >Thread-34::DEBUG::2014-07-10 09:17:39,178::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-34::DEBUG::2014-07-10 09:17:39,178::task::595::TaskManager.Task::(_updateState) Task=`bcb3ce98-1f3b-4b52-a135-250fc31c9ce7`::moving from state init -> state preparing >Thread-34::INFO::2014-07-10 09:17:39,178::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-34::DEBUG::2014-07-10 09:17:39,179::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`ac785e1f-74ca-4e41-b109-93a8c9280114`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-10 09:17:39,179::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' for lock type 'shared' >Thread-34::DEBUG::2014-07-10 09:17:39,180::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-10 09:17:39,180::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`ac785e1f-74ca-4e41-b109-93a8c9280114`::Granted request >Thread-34::DEBUG::2014-07-10 09:17:39,181::task::827::TaskManager.Task::(resourceAcquired) Task=`bcb3ce98-1f3b-4b52-a135-250fc31c9ce7`::_resourcesAcquired: Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee (shared) >Thread-34::DEBUG::2014-07-10 09:17:39,181::task::990::TaskManager.Task::(_decref) Task=`bcb3ce98-1f3b-4b52-a135-250fc31c9ce7`::ref 1 aborting False >Thread-34::INFO::2014-07-10 09:17:39,182::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532067385344', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:17:39,182::task::1185::TaskManager.Task::(prepare) Task=`bcb3ce98-1f3b-4b52-a135-250fc31c9ce7`::finished: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532067385344', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:17:39,182::task::595::TaskManager.Task::(_updateState) Task=`bcb3ce98-1f3b-4b52-a135-250fc31c9ce7`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-10 09:17:39,182::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee': < ResourceRef 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-10 09:17:39,183::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-10 09:17:39,183::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' >Thread-34::DEBUG::2014-07-10 09:17:39,183::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' (0 active users) >Thread-34::DEBUG::2014-07-10 09:17:39,183::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-10 09:17:39,184::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', Clearing records. >Thread-34::DEBUG::2014-07-10 09:17:39,184::task::990::TaskManager.Task::(_decref) Task=`bcb3ce98-1f3b-4b52-a135-250fc31c9ce7`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 09:17:40,158::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:17:40,250::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0300383 s, 34.1 MB/s\n'; <rc> = 0 >Thread-40::DEBUG::2014-07-10 09:17:41,737::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lion.qa.lab.tlv.redhat.com:_export_yuri2_backup2/6a70504d-00df-4869-8695-0f442053f6b6/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-40::DEBUG::2014-07-10 09:17:41,758::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n369 bytes (369 B) copied, 0.000513075 s, 719 kB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:17:42,265::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:17:42,355::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0325258 s, 31.5 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:17:44,372::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:17:44,468::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0381588 s, 26.8 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 09:17:45,998::task::595::TaskManager.Task::(_updateState) Task=`712ee58d-745b-49ab-b556-402bfa56d4e2`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 09:17:45,999::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::INFO::2014-07-10 09:17:45,999::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00078646', 'lastCheck': '7.3', 'valid': True}, '6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000513075', 'lastCheck': '4.2', 'valid': True}} >Thread-14::DEBUG::2014-07-10 09:17:46,000::task::1185::TaskManager.Task::(prepare) Task=`712ee58d-745b-49ab-b556-402bfa56d4e2`::finished: {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00078646', 'lastCheck': '7.3', 'valid': True}, '6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000513075', 'lastCheck': '4.2', 'valid': True}} >Thread-14::DEBUG::2014-07-10 09:17:46,000::task::595::TaskManager.Task::(_updateState) Task=`712ee58d-745b-49ab-b556-402bfa56d4e2`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 09:17:46,000::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 09:17:46,000::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 09:17:46,000::task::990::TaskManager.Task::(_decref) Task=`712ee58d-745b-49ab-b556-402bfa56d4e2`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 09:17:46,483::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:17:46,566::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.026424 s, 38.8 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:17:48,581::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:17:48,680::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.035862 s, 28.6 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-10 09:17:48,729::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/metadata bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-10 09:17:48,751::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00074618 s, 5.5 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 09:17:49,261::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-14::DEBUG::2014-07-10 09:17:49,262::task::595::TaskManager.Task::(_updateState) Task=`f938295a-d346-4008-a748-35d80c43ce53`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 09:17:49,263::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-14::INFO::2014-07-10 09:17:49,263::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:17:49,263::task::1185::TaskManager.Task::(prepare) Task=`f938295a-d346-4008-a748-35d80c43ce53`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:17:49,264::task::595::TaskManager.Task::(_updateState) Task=`f938295a-d346-4008-a748-35d80c43ce53`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 09:17:49,264::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 09:17:49,264::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 09:17:49,264::task::990::TaskManager.Task::(_decref) Task=`f938295a-d346-4008-a748-35d80c43ce53`::ref 0 aborting False >Thread-34::DEBUG::2014-07-10 09:17:49,268::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-34::DEBUG::2014-07-10 09:17:49,269::task::595::TaskManager.Task::(_updateState) Task=`38ae71db-b850-4afe-b4ea-fca551cd1efd`::moving from state init -> state preparing >Thread-34::INFO::2014-07-10 09:17:49,269::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-34::DEBUG::2014-07-10 09:17:49,270::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`4bce7f6a-a4e0-4b51-90fd-c7e32f64381a`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-10 09:17:49,270::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' for lock type 'shared' >Thread-34::DEBUG::2014-07-10 09:17:49,270::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-10 09:17:49,270::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`4bce7f6a-a4e0-4b51-90fd-c7e32f64381a`::Granted request >Thread-34::DEBUG::2014-07-10 09:17:49,271::task::827::TaskManager.Task::(resourceAcquired) Task=`38ae71db-b850-4afe-b4ea-fca551cd1efd`::_resourcesAcquired: Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee (shared) >Thread-34::DEBUG::2014-07-10 09:17:49,271::task::990::TaskManager.Task::(_decref) Task=`38ae71db-b850-4afe-b4ea-fca551cd1efd`::ref 1 aborting False >Thread-34::INFO::2014-07-10 09:17:49,272::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532067385344', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:17:49,273::task::1185::TaskManager.Task::(prepare) Task=`38ae71db-b850-4afe-b4ea-fca551cd1efd`::finished: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532067385344', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:17:49,273::task::595::TaskManager.Task::(_updateState) Task=`38ae71db-b850-4afe-b4ea-fca551cd1efd`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-10 09:17:49,273::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee': < ResourceRef 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-10 09:17:49,273::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-10 09:17:49,273::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' >Thread-34::DEBUG::2014-07-10 09:17:49,274::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' (0 active users) >Thread-34::DEBUG::2014-07-10 09:17:49,274::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-10 09:17:49,274::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', Clearing records. >Thread-34::DEBUG::2014-07-10 09:17:49,274::task::990::TaskManager.Task::(_decref) Task=`38ae71db-b850-4afe-b4ea-fca551cd1efd`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 09:17:50,698::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:17:50,792::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0355724 s, 28.8 MB/s\n'; <rc> = 0 >Thread-40::DEBUG::2014-07-10 09:17:51,761::domainMonitor::192::Storage.DomainMonitorThread::(_monitorDomain) Refreshing domain 6a70504d-00df-4869-8695-0f442053f6b6 >Thread-40::DEBUG::2014-07-10 09:17:51,789::fileSD::150::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/lion.qa.lab.tlv.redhat.com:_export_yuri2_backup2/6a70504d-00df-4869-8695-0f442053f6b6 >Thread-40::DEBUG::2014-07-10 09:17:51,792::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend >Thread-40::DEBUG::2014-07-10 09:17:51,795::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Backup', 'DESCRIPTION=test', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=0', 'POOL_UUID=4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', 'REMOTE_PATH=lion.qa.lab.tlv.redhat.com:/export/yuri2/backup2', 'ROLE=Regular', 'SDUUID=6a70504d-00df-4869-8695-0f442053f6b6', 'TYPE=NFS', 'VERSION=0', '_SHA_CKSUM=aab6b8e901ec435cd5f9de3c9e3f8b45dca569e0'] >Thread-40::DEBUG::2014-07-10 09:17:51,798::fileSD::609::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images [] >Thread-40::INFO::2014-07-10 09:17:51,798::sd::384::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 6a70504d-00df-4869-8695-0f442053f6b6_imageNS already registered >Thread-40::INFO::2014-07-10 09:17:51,798::sd::392::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 6a70504d-00df-4869-8695-0f442053f6b6_volumeNS already registered >Thread-40::DEBUG::2014-07-10 09:17:51,835::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lion.qa.lab.tlv.redhat.com:_export_yuri2_backup2/6a70504d-00df-4869-8695-0f442053f6b6/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-40::DEBUG::2014-07-10 09:17:51,864::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n369 bytes (369 B) copied, 0.000460521 s, 801 kB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:17:52,807::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:17:52,904::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0356111 s, 28.8 MB/s\n'; <rc> = 0 >Thread-64::DEBUG::2014-07-10 09:17:53,323::task::595::TaskManager.Task::(_updateState) Task=`cf121466-5731-4a97-9212-937359bc1a73`::moving from state init -> state preparing >Thread-64::INFO::2014-07-10 09:17:53,324::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='aa20346a-4d3a-4e07-b8e1-52c0ebe4168c', volUUID='58fefce2-9bce-4bff-8949-8c6ce8122b27', options=None) >Thread-64::INFO::2014-07-10 09:17:53,324::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-64::DEBUG::2014-07-10 09:17:53,325::task::1185::TaskManager.Task::(prepare) Task=`cf121466-5731-4a97-9212-937359bc1a73`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-64::DEBUG::2014-07-10 09:17:53,325::task::595::TaskManager.Task::(_updateState) Task=`cf121466-5731-4a97-9212-937359bc1a73`::moving from state preparing -> state finished >Thread-64::DEBUG::2014-07-10 09:17:53,325::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-64::DEBUG::2014-07-10 09:17:53,325::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-64::DEBUG::2014-07-10 09:17:53,325::task::990::TaskManager.Task::(_decref) Task=`cf121466-5731-4a97-9212-937359bc1a73`::ref 0 aborting False >Thread-54::DEBUG::2014-07-10 09:17:54,674::task::595::TaskManager.Task::(_updateState) Task=`cb648562-a6aa-4263-985e-a4adee288d07`::moving from state init -> state preparing >Thread-54::INFO::2014-07-10 09:17:54,675::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='28408446-e5fd-4565-a976-e760951593fe', volUUID='776303a2-5585-451e-826e-0e338d4a1e98', options=None) >Thread-54::INFO::2014-07-10 09:17:54,675::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-54::DEBUG::2014-07-10 09:17:54,676::task::1185::TaskManager.Task::(prepare) Task=`cb648562-a6aa-4263-985e-a4adee288d07`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-54::DEBUG::2014-07-10 09:17:54,676::task::595::TaskManager.Task::(_updateState) Task=`cb648562-a6aa-4263-985e-a4adee288d07`::moving from state preparing -> state finished >Thread-54::DEBUG::2014-07-10 09:17:54,676::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-54::DEBUG::2014-07-10 09:17:54,676::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-54::DEBUG::2014-07-10 09:17:54,676::task::990::TaskManager.Task::(_decref) Task=`cb648562-a6aa-4263-985e-a4adee288d07`::ref 0 aborting False >Thread-73::DEBUG::2014-07-10 09:17:54,705::task::595::TaskManager.Task::(_updateState) Task=`43512811-13b8-4a00-aeb8-79bb4d4ba2a2`::moving from state init -> state preparing >Thread-73::INFO::2014-07-10 09:17:54,705::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='c01d693b-cba0-4fed-9ad7-0aaa28912a19', volUUID='4bb5d954-2a50-4028-b299-0b43c261270c', options=None) >Thread-73::INFO::2014-07-10 09:17:54,705::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-73::DEBUG::2014-07-10 09:17:54,705::task::1185::TaskManager.Task::(prepare) Task=`43512811-13b8-4a00-aeb8-79bb4d4ba2a2`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-73::DEBUG::2014-07-10 09:17:54,706::task::595::TaskManager.Task::(_updateState) Task=`43512811-13b8-4a00-aeb8-79bb4d4ba2a2`::moving from state preparing -> state finished >Thread-73::DEBUG::2014-07-10 09:17:54,706::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-73::DEBUG::2014-07-10 09:17:54,706::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-73::DEBUG::2014-07-10 09:17:54,706::task::990::TaskManager.Task::(_decref) Task=`43512811-13b8-4a00-aeb8-79bb4d4ba2a2`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 09:17:54,931::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:17:55,037::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0300999 s, 34.0 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:17:57,110::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:17:57,203::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0358338 s, 28.6 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-10 09:17:58,787::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/metadata bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-10 09:17:58,813::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000685374 s, 6.0 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:17:59,218::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Thread-14::DEBUG::2014-07-10 09:17:59,300::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-14::DEBUG::2014-07-10 09:17:59,306::task::595::TaskManager.Task::(_updateState) Task=`ee9c4505-4531-44da-afec-79011312b0fa`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 09:17:59,310::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-14::INFO::2014-07-10 09:17:59,314::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:17:59,317::task::1185::TaskManager.Task::(prepare) Task=`ee9c4505-4531-44da-afec-79011312b0fa`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:17:59,319::task::595::TaskManager.Task::(_updateState) Task=`ee9c4505-4531-44da-afec-79011312b0fa`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 09:17:59,321::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 09:17:59,324::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 09:17:59,327::task::990::TaskManager.Task::(_decref) Task=`ee9c4505-4531-44da-afec-79011312b0fa`::ref 0 aborting False >Thread-34::DEBUG::2014-07-10 09:17:59,343::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-34::DEBUG::2014-07-10 09:17:59,347::task::595::TaskManager.Task::(_updateState) Task=`5a0a54a2-b8b7-454a-a126-f88949a4f9a5`::moving from state init -> state preparing >Thread-34::INFO::2014-07-10 09:17:59,350::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-34::DEBUG::2014-07-10 09:17:59,357::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`2585fe11-4100-4647-8e42-8f979dd76f8c`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-10 09:17:59,359::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' for lock type 'shared' >Thread-34::DEBUG::2014-07-10 09:17:59,364::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-10 09:17:59,366::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`2585fe11-4100-4647-8e42-8f979dd76f8c`::Granted request >Thread-34::DEBUG::2014-07-10 09:17:59,373::task::827::TaskManager.Task::(resourceAcquired) Task=`5a0a54a2-b8b7-454a-a126-f88949a4f9a5`::_resourcesAcquired: Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee (shared) >Thread-34::DEBUG::2014-07-10 09:17:59,375::task::990::TaskManager.Task::(_decref) Task=`5a0a54a2-b8b7-454a-a126-f88949a4f9a5`::ref 1 aborting False >Thread-34::INFO::2014-07-10 09:17:59,393::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532067385344', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:17:59,396::task::1185::TaskManager.Task::(prepare) Task=`5a0a54a2-b8b7-454a-a126-f88949a4f9a5`::finished: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532067385344', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:17:59,399::task::595::TaskManager.Task::(_updateState) Task=`5a0a54a2-b8b7-454a-a126-f88949a4f9a5`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-10 09:17:59,403::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee': < ResourceRef 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-10 09:17:59,405::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-10 09:17:59,410::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' >Thread-34::DEBUG::2014-07-10 09:17:59,413::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' (0 active users) >Thread-34::DEBUG::2014-07-10 09:17:59,415::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-10 09:17:59,418::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', Clearing records. >Thread-34::DEBUG::2014-07-10 09:17:59,423::task::990::TaskManager.Task::(_decref) Task=`5a0a54a2-b8b7-454a-a126-f88949a4f9a5`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 09:17:59,448::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.039831 s, 25.7 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 09:18:01,172::task::595::TaskManager.Task::(_updateState) Task=`9c6bb0c7-f75f-428b-bfa1-852caaa9dd67`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 09:18:01,172::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::INFO::2014-07-10 09:18:01,173::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000685374', 'lastCheck': '2.3', 'valid': True}, '6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000460521', 'lastCheck': '9.3', 'valid': True}} >Thread-14::DEBUG::2014-07-10 09:18:01,173::task::1185::TaskManager.Task::(prepare) Task=`9c6bb0c7-f75f-428b-bfa1-852caaa9dd67`::finished: {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000685374', 'lastCheck': '2.3', 'valid': True}, '6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000460521', 'lastCheck': '9.3', 'valid': True}} >Thread-14::DEBUG::2014-07-10 09:18:01,173::task::595::TaskManager.Task::(_updateState) Task=`9c6bb0c7-f75f-428b-bfa1-852caaa9dd67`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 09:18:01,173::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 09:18:01,173::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 09:18:01,174::task::990::TaskManager.Task::(_decref) Task=`9c6bb0c7-f75f-428b-bfa1-852caaa9dd67`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 09:18:01,463::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:18:01,549::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0302131 s, 33.9 MB/s\n'; <rc> = 0 >Thread-40::DEBUG::2014-07-10 09:18:01,898::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lion.qa.lab.tlv.redhat.com:_export_yuri2_backup2/6a70504d-00df-4869-8695-0f442053f6b6/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-40::DEBUG::2014-07-10 09:18:01,920::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n369 bytes (369 B) copied, 0.000489901 s, 753 kB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:18:03,564::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:18:03,657::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0357728 s, 28.6 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:18:05,673::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:18:05,773::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0413274 s, 24.8 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:18:07,789::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:18:07,873::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0278658 s, 36.7 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-10 09:18:08,841::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/metadata bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-10 09:18:08,864::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000911953 s, 4.5 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 09:18:09,462::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-14::DEBUG::2014-07-10 09:18:09,464::task::595::TaskManager.Task::(_updateState) Task=`d50f85d9-9df4-4030-ba74-3007529f4e34`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 09:18:09,464::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-14::INFO::2014-07-10 09:18:09,465::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:18:09,465::task::1185::TaskManager.Task::(prepare) Task=`d50f85d9-9df4-4030-ba74-3007529f4e34`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:18:09,465::task::595::TaskManager.Task::(_updateState) Task=`d50f85d9-9df4-4030-ba74-3007529f4e34`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 09:18:09,465::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 09:18:09,465::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 09:18:09,466::task::990::TaskManager.Task::(_decref) Task=`d50f85d9-9df4-4030-ba74-3007529f4e34`::ref 0 aborting False >Thread-34::DEBUG::2014-07-10 09:18:09,470::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-34::DEBUG::2014-07-10 09:18:09,471::task::595::TaskManager.Task::(_updateState) Task=`2a628786-78dd-417d-9be3-defd564539ab`::moving from state init -> state preparing >Thread-34::INFO::2014-07-10 09:18:09,471::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-34::DEBUG::2014-07-10 09:18:09,472::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`cde77ade-663a-4c52-b217-9ac3a36847ce`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-10 09:18:09,472::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' for lock type 'shared' >Thread-34::DEBUG::2014-07-10 09:18:09,472::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-10 09:18:09,472::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`cde77ade-663a-4c52-b217-9ac3a36847ce`::Granted request >Thread-34::DEBUG::2014-07-10 09:18:09,473::task::827::TaskManager.Task::(resourceAcquired) Task=`2a628786-78dd-417d-9be3-defd564539ab`::_resourcesAcquired: Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee (shared) >Thread-34::DEBUG::2014-07-10 09:18:09,473::task::990::TaskManager.Task::(_decref) Task=`2a628786-78dd-417d-9be3-defd564539ab`::ref 1 aborting False >Thread-34::INFO::2014-07-10 09:18:09,474::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532067385344', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:18:09,475::task::1185::TaskManager.Task::(prepare) Task=`2a628786-78dd-417d-9be3-defd564539ab`::finished: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532067385344', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:18:09,475::task::595::TaskManager.Task::(_updateState) Task=`2a628786-78dd-417d-9be3-defd564539ab`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-10 09:18:09,475::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee': < ResourceRef 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-10 09:18:09,475::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-10 09:18:09,475::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' >Thread-34::DEBUG::2014-07-10 09:18:09,476::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' (0 active users) >Thread-34::DEBUG::2014-07-10 09:18:09,476::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-10 09:18:09,476::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', Clearing records. >Thread-34::DEBUG::2014-07-10 09:18:09,476::task::990::TaskManager.Task::(_decref) Task=`2a628786-78dd-417d-9be3-defd564539ab`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 09:18:09,888::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:18:09,974::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0295028 s, 34.7 MB/s\n'; <rc> = 0 >Thread-40::DEBUG::2014-07-10 09:18:11,951::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lion.qa.lab.tlv.redhat.com:_export_yuri2_backup2/6a70504d-00df-4869-8695-0f442053f6b6/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-40::DEBUG::2014-07-10 09:18:11,988::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n369 bytes (369 B) copied, 0.000365769 s, 1.0 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:18:11,991::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:18:12,147::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0357974 s, 28.6 MB/s\n'; <rc> = 0 >Thread-57::DEBUG::2014-07-10 09:18:13,429::task::595::TaskManager.Task::(_updateState) Task=`41456c17-6019-40c1-8432-d076a794187b`::moving from state init -> state preparing >Thread-57::INFO::2014-07-10 09:18:13,430::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='b6f6c0da-e67f-4902-b9ac-3069571a42fe', volUUID='c4cd1da8-05b7-45e0-80b1-1183d21443d9', options=None) >Thread-57::INFO::2014-07-10 09:18:13,430::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-57::DEBUG::2014-07-10 09:18:13,430::task::1185::TaskManager.Task::(prepare) Task=`41456c17-6019-40c1-8432-d076a794187b`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-57::DEBUG::2014-07-10 09:18:13,431::task::595::TaskManager.Task::(_updateState) Task=`41456c17-6019-40c1-8432-d076a794187b`::moving from state preparing -> state finished >Thread-57::DEBUG::2014-07-10 09:18:13,431::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-57::DEBUG::2014-07-10 09:18:13,431::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-57::DEBUG::2014-07-10 09:18:13,431::task::990::TaskManager.Task::(_decref) Task=`41456c17-6019-40c1-8432-d076a794187b`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 09:18:14,166::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:18:14,281::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0417 s, 24.6 MB/s\n'; <rc> = 0 >Thread-67::DEBUG::2014-07-10 09:18:14,305::task::595::TaskManager.Task::(_updateState) Task=`9fbcfd55-187b-4c92-b476-c757f0b3f35b`::moving from state init -> state preparing >Thread-67::INFO::2014-07-10 09:18:14,306::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='f30c2cb7-a43a-4bf5-82b5-cfe07336f65c', volUUID='b0fbb3c9-55af-4a3a-95ad-fc56a80b9cf5', options=None) >Thread-67::INFO::2014-07-10 09:18:14,307::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-67::DEBUG::2014-07-10 09:18:14,307::task::1185::TaskManager.Task::(prepare) Task=`9fbcfd55-187b-4c92-b476-c757f0b3f35b`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-67::DEBUG::2014-07-10 09:18:14,307::task::595::TaskManager.Task::(_updateState) Task=`9fbcfd55-187b-4c92-b476-c757f0b3f35b`::moving from state preparing -> state finished >Thread-67::DEBUG::2014-07-10 09:18:14,307::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-67::DEBUG::2014-07-10 09:18:14,307::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-67::DEBUG::2014-07-10 09:18:14,308::task::990::TaskManager.Task::(_decref) Task=`9fbcfd55-187b-4c92-b476-c757f0b3f35b`::ref 0 aborting False >Thread-48::DEBUG::2014-07-10 09:18:14,738::task::595::TaskManager.Task::(_updateState) Task=`e55caac8-b986-4366-9964-a05db61a6603`::moving from state init -> state preparing >Thread-48::INFO::2014-07-10 09:18:14,738::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='0cd7d6ce-f497-4243-a690-c57744861eea', volUUID='10b6a7dd-dc6c-43fa-ba17-92e4331b0e0b', options=None) >Thread-48::INFO::2014-07-10 09:18:14,739::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-48::DEBUG::2014-07-10 09:18:14,739::task::1185::TaskManager.Task::(prepare) Task=`e55caac8-b986-4366-9964-a05db61a6603`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-48::DEBUG::2014-07-10 09:18:14,739::task::595::TaskManager.Task::(_updateState) Task=`e55caac8-b986-4366-9964-a05db61a6603`::moving from state preparing -> state finished >Thread-48::DEBUG::2014-07-10 09:18:14,739::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-48::DEBUG::2014-07-10 09:18:14,740::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-48::DEBUG::2014-07-10 09:18:14,740::task::990::TaskManager.Task::(_decref) Task=`e55caac8-b986-4366-9964-a05db61a6603`::ref 0 aborting False >Thread-76::DEBUG::2014-07-10 09:18:16,109::task::595::TaskManager.Task::(_updateState) Task=`0f7bebb6-4d2c-4525-a55c-7a20feff5ee3`::moving from state init -> state preparing >Thread-76::INFO::2014-07-10 09:18:16,109::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='e4c65229-4247-4b33-b72a-f1d5ce72ad05', volUUID='cad94284-3ca9-4c30-933d-997f4460309e', options=None) >Thread-76::INFO::2014-07-10 09:18:16,110::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-76::DEBUG::2014-07-10 09:18:16,110::task::1185::TaskManager.Task::(prepare) Task=`0f7bebb6-4d2c-4525-a55c-7a20feff5ee3`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-76::DEBUG::2014-07-10 09:18:16,110::task::595::TaskManager.Task::(_updateState) Task=`0f7bebb6-4d2c-4525-a55c-7a20feff5ee3`::moving from state preparing -> state finished >Thread-76::DEBUG::2014-07-10 09:18:16,110::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-76::DEBUG::2014-07-10 09:18:16,110::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-76::DEBUG::2014-07-10 09:18:16,111::task::990::TaskManager.Task::(_decref) Task=`0f7bebb6-4d2c-4525-a55c-7a20feff5ee3`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 09:18:16,296::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Thread-14::DEBUG::2014-07-10 09:18:16,379::task::595::TaskManager.Task::(_updateState) Task=`aeadc3e7-e6e7-4e19-9451-48ead80f2e5c`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 09:18:16,387::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::INFO::2014-07-10 09:18:16,395::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000911953', 'lastCheck': '7.5', 'valid': True}, '6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000365769', 'lastCheck': '4.4', 'valid': True}} >Thread-14::DEBUG::2014-07-10 09:18:16,399::task::1185::TaskManager.Task::(prepare) Task=`aeadc3e7-e6e7-4e19-9451-48ead80f2e5c`::finished: {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000911953', 'lastCheck': '7.5', 'valid': True}, '6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000365769', 'lastCheck': '4.4', 'valid': True}} >Thread-14::DEBUG::2014-07-10 09:18:16,404::task::595::TaskManager.Task::(_updateState) Task=`aeadc3e7-e6e7-4e19-9451-48ead80f2e5c`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 09:18:16,408::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 09:18:16,413::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 09:18:16,415::task::990::TaskManager.Task::(_decref) Task=`aeadc3e7-e6e7-4e19-9451-48ead80f2e5c`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 09:18:16,685::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0300839 s, 34.0 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:18:18,705::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:18:18,792::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0307098 s, 33.3 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-10 09:18:18,893::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/metadata bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-10 09:18:18,916::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000901494 s, 4.5 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 09:18:19,529::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-14::DEBUG::2014-07-10 09:18:19,531::task::595::TaskManager.Task::(_updateState) Task=`a1f4751f-2246-4c19-b97b-c8338997ced6`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 09:18:19,531::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-14::INFO::2014-07-10 09:18:19,532::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:18:19,532::task::1185::TaskManager.Task::(prepare) Task=`a1f4751f-2246-4c19-b97b-c8338997ced6`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:18:19,532::task::595::TaskManager.Task::(_updateState) Task=`a1f4751f-2246-4c19-b97b-c8338997ced6`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 09:18:19,533::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 09:18:19,533::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 09:18:19,533::task::990::TaskManager.Task::(_decref) Task=`a1f4751f-2246-4c19-b97b-c8338997ced6`::ref 0 aborting False >Thread-34::DEBUG::2014-07-10 09:18:19,577::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-34::DEBUG::2014-07-10 09:18:19,577::task::595::TaskManager.Task::(_updateState) Task=`6dadeb6a-7e1b-4859-ae58-223c11c83273`::moving from state init -> state preparing >Thread-34::INFO::2014-07-10 09:18:19,577::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-34::DEBUG::2014-07-10 09:18:19,578::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`b554885e-2530-4ee7-99bb-0fb0005e37f5`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-10 09:18:19,578::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' for lock type 'shared' >Thread-34::DEBUG::2014-07-10 09:18:19,579::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-10 09:18:19,579::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`b554885e-2530-4ee7-99bb-0fb0005e37f5`::Granted request >Thread-34::DEBUG::2014-07-10 09:18:19,579::task::827::TaskManager.Task::(resourceAcquired) Task=`6dadeb6a-7e1b-4859-ae58-223c11c83273`::_resourcesAcquired: Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee (shared) >Thread-34::DEBUG::2014-07-10 09:18:19,579::task::990::TaskManager.Task::(_decref) Task=`6dadeb6a-7e1b-4859-ae58-223c11c83273`::ref 1 aborting False >Thread-34::INFO::2014-07-10 09:18:19,581::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532067385344', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:18:19,581::task::1185::TaskManager.Task::(prepare) Task=`6dadeb6a-7e1b-4859-ae58-223c11c83273`::finished: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532067385344', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:18:19,581::task::595::TaskManager.Task::(_updateState) Task=`6dadeb6a-7e1b-4859-ae58-223c11c83273`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-10 09:18:19,581::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee': < ResourceRef 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-10 09:18:19,581::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-10 09:18:19,582::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' >Thread-34::DEBUG::2014-07-10 09:18:19,582::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' (0 active users) >Thread-34::DEBUG::2014-07-10 09:18:19,582::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-10 09:18:19,582::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', Clearing records. >Thread-34::DEBUG::2014-07-10 09:18:19,582::task::990::TaskManager.Task::(_decref) Task=`6dadeb6a-7e1b-4859-ae58-223c11c83273`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 09:18:20,809::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:18:20,908::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.037427 s, 27.4 MB/s\n'; <rc> = 0 >Thread-40::DEBUG::2014-07-10 09:18:22,041::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lion.qa.lab.tlv.redhat.com:_export_yuri2_backup2/6a70504d-00df-4869-8695-0f442053f6b6/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-40::DEBUG::2014-07-10 09:18:22,062::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n369 bytes (369 B) copied, 0.000437042 s, 844 kB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:18:22,924::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:18:23,029::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0444788 s, 23.0 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:18:25,047::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:18:25,196::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0353945 s, 28.9 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:18:27,211::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:18:27,302::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0324576 s, 31.5 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-10 09:18:28,945::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/metadata bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-10 09:18:28,972::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000739989 s, 5.5 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:18:29,319::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:18:29,412::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0358638 s, 28.6 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 09:18:29,604::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-14::DEBUG::2014-07-10 09:18:29,605::task::595::TaskManager.Task::(_updateState) Task=`48128da8-bf1a-4be5-a117-7b65b6e2d888`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 09:18:29,605::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-14::INFO::2014-07-10 09:18:29,606::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:18:29,606::task::1185::TaskManager.Task::(prepare) Task=`48128da8-bf1a-4be5-a117-7b65b6e2d888`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:18:29,606::task::595::TaskManager.Task::(_updateState) Task=`48128da8-bf1a-4be5-a117-7b65b6e2d888`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 09:18:29,607::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 09:18:29,607::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 09:18:29,607::task::990::TaskManager.Task::(_decref) Task=`48128da8-bf1a-4be5-a117-7b65b6e2d888`::ref 0 aborting False >Thread-34::DEBUG::2014-07-10 09:18:29,611::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-34::DEBUG::2014-07-10 09:18:29,611::task::595::TaskManager.Task::(_updateState) Task=`32db5624-6bcf-4358-864d-7cb7a4b1f8be`::moving from state init -> state preparing >Thread-34::INFO::2014-07-10 09:18:29,612::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-34::DEBUG::2014-07-10 09:18:29,612::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`e81d98bd-f353-47c5-8c58-1d848a6d7736`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-10 09:18:29,613::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' for lock type 'shared' >Thread-34::DEBUG::2014-07-10 09:18:29,613::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-10 09:18:29,613::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`e81d98bd-f353-47c5-8c58-1d848a6d7736`::Granted request >Thread-34::DEBUG::2014-07-10 09:18:29,614::task::827::TaskManager.Task::(resourceAcquired) Task=`32db5624-6bcf-4358-864d-7cb7a4b1f8be`::_resourcesAcquired: Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee (shared) >Thread-34::DEBUG::2014-07-10 09:18:29,614::task::990::TaskManager.Task::(_decref) Task=`32db5624-6bcf-4358-864d-7cb7a4b1f8be`::ref 1 aborting False >Thread-34::INFO::2014-07-10 09:18:29,615::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532067385344', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:18:29,615::task::1185::TaskManager.Task::(prepare) Task=`32db5624-6bcf-4358-864d-7cb7a4b1f8be`::finished: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532067385344', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:18:29,616::task::595::TaskManager.Task::(_updateState) Task=`32db5624-6bcf-4358-864d-7cb7a4b1f8be`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-10 09:18:29,616::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee': < ResourceRef 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-10 09:18:29,616::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-10 09:18:29,616::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' >Thread-34::DEBUG::2014-07-10 09:18:29,617::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' (0 active users) >Thread-34::DEBUG::2014-07-10 09:18:29,617::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-10 09:18:29,617::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', Clearing records. >Thread-34::DEBUG::2014-07-10 09:18:29,617::task::990::TaskManager.Task::(_decref) Task=`32db5624-6bcf-4358-864d-7cb7a4b1f8be`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 09:18:31,427::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:18:31,516::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0268736 s, 38.1 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 09:18:31,833::task::595::TaskManager.Task::(_updateState) Task=`aa3e240d-4c00-42ff-a535-32130e5fcb46`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 09:18:31,834::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::INFO::2014-07-10 09:18:31,834::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000739989', 'lastCheck': '2.8', 'valid': True}, '6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000437042', 'lastCheck': '9.8', 'valid': True}} >Thread-14::DEBUG::2014-07-10 09:18:31,834::task::1185::TaskManager.Task::(prepare) Task=`aa3e240d-4c00-42ff-a535-32130e5fcb46`::finished: {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000739989', 'lastCheck': '2.8', 'valid': True}, '6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000437042', 'lastCheck': '9.8', 'valid': True}} >Thread-14::DEBUG::2014-07-10 09:18:31,835::task::595::TaskManager.Task::(_updateState) Task=`aa3e240d-4c00-42ff-a535-32130e5fcb46`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 09:18:31,835::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 09:18:31,835::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 09:18:31,835::task::990::TaskManager.Task::(_decref) Task=`aa3e240d-4c00-42ff-a535-32130e5fcb46`::ref 0 aborting False >Thread-40::DEBUG::2014-07-10 09:18:32,092::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lion.qa.lab.tlv.redhat.com:_export_yuri2_backup2/6a70504d-00df-4869-8695-0f442053f6b6/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-40::DEBUG::2014-07-10 09:18:32,112::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n369 bytes (369 B) copied, 0.000463398 s, 796 kB/s\n'; <rc> = 0 >Thread-70::DEBUG::2014-07-10 09:18:33,507::task::595::TaskManager.Task::(_updateState) Task=`44a8d969-1160-495d-b7f0-f4ae5a9150ac`::moving from state init -> state preparing >Thread-70::INFO::2014-07-10 09:18:33,508::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='cfaeead2-7caa-467c-b389-c89840ae6605', volUUID='567fe32d-31a6-4ff6-90f3-fd6a656fbecc', options=None) >Thread-70::INFO::2014-07-10 09:18:33,508::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-70::DEBUG::2014-07-10 09:18:33,508::task::1185::TaskManager.Task::(prepare) Task=`44a8d969-1160-495d-b7f0-f4ae5a9150ac`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-70::DEBUG::2014-07-10 09:18:33,509::task::595::TaskManager.Task::(_updateState) Task=`44a8d969-1160-495d-b7f0-f4ae5a9150ac`::moving from state preparing -> state finished >Thread-70::DEBUG::2014-07-10 09:18:33,509::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-70::DEBUG::2014-07-10 09:18:33,509::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-70::DEBUG::2014-07-10 09:18:33,509::task::990::TaskManager.Task::(_decref) Task=`44a8d969-1160-495d-b7f0-f4ae5a9150ac`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 09:18:33,531::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:18:33,645::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0563759 s, 18.2 MB/s\n'; <rc> = 0 >Thread-60::DEBUG::2014-07-10 09:18:34,381::task::595::TaskManager.Task::(_updateState) Task=`a5801197-643c-47e9-87be-24500fcd0a08`::moving from state init -> state preparing >Thread-60::INFO::2014-07-10 09:18:34,382::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='b034d5b0-e1e0-4011-b49b-4d45ddb11556', volUUID='3d7f62b5-328f-4d8e-8b69-873cfb5ae14d', options=None) >Thread-60::INFO::2014-07-10 09:18:34,382::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-60::DEBUG::2014-07-10 09:18:34,382::task::1185::TaskManager.Task::(prepare) Task=`a5801197-643c-47e9-87be-24500fcd0a08`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-60::DEBUG::2014-07-10 09:18:34,383::task::595::TaskManager.Task::(_updateState) Task=`a5801197-643c-47e9-87be-24500fcd0a08`::moving from state preparing -> state finished >Thread-60::DEBUG::2014-07-10 09:18:34,383::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-60::DEBUG::2014-07-10 09:18:34,383::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-60::DEBUG::2014-07-10 09:18:34,383::task::990::TaskManager.Task::(_decref) Task=`a5801197-643c-47e9-87be-24500fcd0a08`::ref 0 aborting False >Thread-51::DEBUG::2014-07-10 09:18:34,573::task::595::TaskManager.Task::(_updateState) Task=`3597b96a-9d57-4bab-8764-716631e7bd83`::moving from state init -> state preparing >Thread-51::INFO::2014-07-10 09:18:34,573::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='76fdb054-02cd-42ed-9721-b3e65b34c3a4', volUUID='022dfe46-2cf7-4915-80b3-883158e3ca83', options=None) >Thread-51::INFO::2014-07-10 09:18:34,573::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-51::DEBUG::2014-07-10 09:18:34,574::task::1185::TaskManager.Task::(prepare) Task=`3597b96a-9d57-4bab-8764-716631e7bd83`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-51::DEBUG::2014-07-10 09:18:34,574::task::595::TaskManager.Task::(_updateState) Task=`3597b96a-9d57-4bab-8764-716631e7bd83`::moving from state preparing -> state finished >Thread-51::DEBUG::2014-07-10 09:18:34,574::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-51::DEBUG::2014-07-10 09:18:34,574::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-51::DEBUG::2014-07-10 09:18:34,574::task::990::TaskManager.Task::(_decref) Task=`3597b96a-9d57-4bab-8764-716631e7bd83`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 09:18:35,660::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:18:35,751::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0327105 s, 31.3 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:18:37,767::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:18:37,855::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0301219 s, 34.0 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-10 09:18:39,001::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/metadata bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-10 09:18:39,024::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000695956 s, 5.9 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 09:18:39,646::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-14::DEBUG::2014-07-10 09:18:39,647::task::595::TaskManager.Task::(_updateState) Task=`bc0c84d9-bea7-483f-8bcd-f19b6d244f29`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 09:18:39,647::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-14::INFO::2014-07-10 09:18:39,648::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:18:39,648::task::1185::TaskManager.Task::(prepare) Task=`bc0c84d9-bea7-483f-8bcd-f19b6d244f29`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:18:39,648::task::595::TaskManager.Task::(_updateState) Task=`bc0c84d9-bea7-483f-8bcd-f19b6d244f29`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 09:18:39,649::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 09:18:39,649::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 09:18:39,649::task::990::TaskManager.Task::(_decref) Task=`bc0c84d9-bea7-483f-8bcd-f19b6d244f29`::ref 0 aborting False >Thread-34::DEBUG::2014-07-10 09:18:39,653::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-34::DEBUG::2014-07-10 09:18:39,654::task::595::TaskManager.Task::(_updateState) Task=`45bb8cc3-f626-4495-b609-fdf1c3c61fa9`::moving from state init -> state preparing >Thread-34::INFO::2014-07-10 09:18:39,654::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-34::DEBUG::2014-07-10 09:18:39,654::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`a95179af-41c9-4e80-a95f-0c37b8efd47a`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-10 09:18:39,655::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' for lock type 'shared' >Thread-34::DEBUG::2014-07-10 09:18:39,655::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-10 09:18:39,655::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`a95179af-41c9-4e80-a95f-0c37b8efd47a`::Granted request >Thread-34::DEBUG::2014-07-10 09:18:39,656::task::827::TaskManager.Task::(resourceAcquired) Task=`45bb8cc3-f626-4495-b609-fdf1c3c61fa9`::_resourcesAcquired: Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee (shared) >Thread-34::DEBUG::2014-07-10 09:18:39,656::task::990::TaskManager.Task::(_decref) Task=`45bb8cc3-f626-4495-b609-fdf1c3c61fa9`::ref 1 aborting False >Thread-34::INFO::2014-07-10 09:18:39,657::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532067385344', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:18:39,657::task::1185::TaskManager.Task::(prepare) Task=`45bb8cc3-f626-4495-b609-fdf1c3c61fa9`::finished: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532067385344', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:18:39,658::task::595::TaskManager.Task::(_updateState) Task=`45bb8cc3-f626-4495-b609-fdf1c3c61fa9`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-10 09:18:39,658::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee': < ResourceRef 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-10 09:18:39,658::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-10 09:18:39,658::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' >Thread-34::DEBUG::2014-07-10 09:18:39,658::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' (0 active users) >Thread-34::DEBUG::2014-07-10 09:18:39,659::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-10 09:18:39,659::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', Clearing records. >Thread-34::DEBUG::2014-07-10 09:18:39,659::task::990::TaskManager.Task::(_decref) Task=`45bb8cc3-f626-4495-b609-fdf1c3c61fa9`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 09:18:39,871::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:18:39,959::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0298014 s, 34.4 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:18:41,974::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:18:42,067::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0359054 s, 28.5 MB/s\n'; <rc> = 0 >Thread-40::DEBUG::2014-07-10 09:18:42,143::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lion.qa.lab.tlv.redhat.com:_export_yuri2_backup2/6a70504d-00df-4869-8695-0f442053f6b6/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-40::DEBUG::2014-07-10 09:18:42,163::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n369 bytes (369 B) copied, 0.00048937 s, 754 kB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:18:44,095::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:18:44,181::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0293901 s, 34.8 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:18:46,197::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:18:46,295::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0350692 s, 29.2 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 09:18:47,022::task::595::TaskManager.Task::(_updateState) Task=`5f262af1-be0e-456f-a14a-079bf2821cf1`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 09:18:47,023::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::INFO::2014-07-10 09:18:47,023::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000695956', 'lastCheck': '8.0', 'valid': True}, '6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00048937', 'lastCheck': '4.9', 'valid': True}} >Thread-14::DEBUG::2014-07-10 09:18:47,023::task::1185::TaskManager.Task::(prepare) Task=`5f262af1-be0e-456f-a14a-079bf2821cf1`::finished: {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000695956', 'lastCheck': '8.0', 'valid': True}, '6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00048937', 'lastCheck': '4.9', 'valid': True}} >Thread-14::DEBUG::2014-07-10 09:18:47,023::task::595::TaskManager.Task::(_updateState) Task=`5f262af1-be0e-456f-a14a-079bf2821cf1`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 09:18:47,024::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 09:18:47,024::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 09:18:47,024::task::990::TaskManager.Task::(_decref) Task=`5f262af1-be0e-456f-a14a-079bf2821cf1`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 09:18:48,310::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:18:48,402::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0348436 s, 29.4 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-10 09:18:49,053::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/metadata bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-10 09:18:49,074::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000692074 s, 5.9 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 09:18:49,704::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-14::DEBUG::2014-07-10 09:18:49,705::task::595::TaskManager.Task::(_updateState) Task=`88721f10-0495-4d22-b965-f8cb501845b4`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 09:18:49,706::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-14::INFO::2014-07-10 09:18:49,706::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:18:49,706::task::1185::TaskManager.Task::(prepare) Task=`88721f10-0495-4d22-b965-f8cb501845b4`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:18:49,707::task::595::TaskManager.Task::(_updateState) Task=`88721f10-0495-4d22-b965-f8cb501845b4`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 09:18:49,707::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 09:18:49,707::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 09:18:49,707::task::990::TaskManager.Task::(_decref) Task=`88721f10-0495-4d22-b965-f8cb501845b4`::ref 0 aborting False >Thread-34::DEBUG::2014-07-10 09:18:49,751::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-34::DEBUG::2014-07-10 09:18:49,751::task::595::TaskManager.Task::(_updateState) Task=`c4bde535-850b-4d22-9654-41a906c1b8da`::moving from state init -> state preparing >Thread-34::INFO::2014-07-10 09:18:49,752::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-34::DEBUG::2014-07-10 09:18:49,752::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`48cd31aa-f3ae-4820-afac-6cc7612d2bb2`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-10 09:18:49,753::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' for lock type 'shared' >Thread-34::DEBUG::2014-07-10 09:18:49,753::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-10 09:18:49,753::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`48cd31aa-f3ae-4820-afac-6cc7612d2bb2`::Granted request >Thread-34::DEBUG::2014-07-10 09:18:49,754::task::827::TaskManager.Task::(resourceAcquired) Task=`c4bde535-850b-4d22-9654-41a906c1b8da`::_resourcesAcquired: Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee (shared) >Thread-34::DEBUG::2014-07-10 09:18:49,754::task::990::TaskManager.Task::(_decref) Task=`c4bde535-850b-4d22-9654-41a906c1b8da`::ref 1 aborting False >Thread-34::INFO::2014-07-10 09:18:49,755::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532067385344', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:18:49,755::task::1185::TaskManager.Task::(prepare) Task=`c4bde535-850b-4d22-9654-41a906c1b8da`::finished: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532067385344', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:18:49,755::task::595::TaskManager.Task::(_updateState) Task=`c4bde535-850b-4d22-9654-41a906c1b8da`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-10 09:18:49,756::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee': < ResourceRef 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-10 09:18:49,756::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-10 09:18:49,756::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' >Thread-34::DEBUG::2014-07-10 09:18:49,756::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' (0 active users) >Thread-34::DEBUG::2014-07-10 09:18:49,756::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-10 09:18:49,757::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', Clearing records. >Thread-34::DEBUG::2014-07-10 09:18:49,757::task::990::TaskManager.Task::(_decref) Task=`c4bde535-850b-4d22-9654-41a906c1b8da`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 09:18:50,417::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:18:50,518::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.036325 s, 28.2 MB/s\n'; <rc> = 0 >Thread-40::DEBUG::2014-07-10 09:18:52,189::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lion.qa.lab.tlv.redhat.com:_export_yuri2_backup2/6a70504d-00df-4869-8695-0f442053f6b6/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-40::DEBUG::2014-07-10 09:18:52,210::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n369 bytes (369 B) copied, 0.000631529 s, 584 kB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:18:52,533::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:18:52,695::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0346374 s, 29.6 MB/s\n'; <rc> = 0 >Thread-64::DEBUG::2014-07-10 09:18:53,578::task::595::TaskManager.Task::(_updateState) Task=`b85c5d0b-5a11-41d5-9d0a-ef3951f34740`::moving from state init -> state preparing >Thread-64::INFO::2014-07-10 09:18:53,578::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='aa20346a-4d3a-4e07-b8e1-52c0ebe4168c', volUUID='58fefce2-9bce-4bff-8949-8c6ce8122b27', options=None) >Thread-64::INFO::2014-07-10 09:18:53,579::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-64::DEBUG::2014-07-10 09:18:53,579::task::1185::TaskManager.Task::(prepare) Task=`b85c5d0b-5a11-41d5-9d0a-ef3951f34740`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-64::DEBUG::2014-07-10 09:18:53,579::task::595::TaskManager.Task::(_updateState) Task=`b85c5d0b-5a11-41d5-9d0a-ef3951f34740`::moving from state preparing -> state finished >Thread-64::DEBUG::2014-07-10 09:18:53,579::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-64::DEBUG::2014-07-10 09:18:53,580::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-64::DEBUG::2014-07-10 09:18:53,580::task::990::TaskManager.Task::(_decref) Task=`b85c5d0b-5a11-41d5-9d0a-ef3951f34740`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 09:18:54,710::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:18:54,794::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0351882 s, 29.1 MB/s\n'; <rc> = 0 >Thread-54::DEBUG::2014-07-10 09:18:54,957::task::595::TaskManager.Task::(_updateState) Task=`847833de-ebdb-4142-8b31-5c16f0dd990a`::moving from state init -> state preparing >Thread-54::INFO::2014-07-10 09:18:54,958::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='28408446-e5fd-4565-a976-e760951593fe', volUUID='776303a2-5585-451e-826e-0e338d4a1e98', options=None) >Thread-54::INFO::2014-07-10 09:18:54,958::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-54::DEBUG::2014-07-10 09:18:54,958::task::1185::TaskManager.Task::(prepare) Task=`847833de-ebdb-4142-8b31-5c16f0dd990a`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-54::DEBUG::2014-07-10 09:18:54,959::task::595::TaskManager.Task::(_updateState) Task=`847833de-ebdb-4142-8b31-5c16f0dd990a`::moving from state preparing -> state finished >Thread-54::DEBUG::2014-07-10 09:18:54,959::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-54::DEBUG::2014-07-10 09:18:54,959::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-54::DEBUG::2014-07-10 09:18:54,959::task::990::TaskManager.Task::(_decref) Task=`847833de-ebdb-4142-8b31-5c16f0dd990a`::ref 0 aborting False >Thread-73::DEBUG::2014-07-10 09:18:54,983::task::595::TaskManager.Task::(_updateState) Task=`f939548d-9517-49e9-84c5-eb1c4734d50b`::moving from state init -> state preparing >Thread-73::INFO::2014-07-10 09:18:54,983::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='c01d693b-cba0-4fed-9ad7-0aaa28912a19', volUUID='4bb5d954-2a50-4028-b299-0b43c261270c', options=None) >Thread-73::INFO::2014-07-10 09:18:54,983::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-73::DEBUG::2014-07-10 09:18:54,983::task::1185::TaskManager.Task::(prepare) Task=`f939548d-9517-49e9-84c5-eb1c4734d50b`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-73::DEBUG::2014-07-10 09:18:54,984::task::595::TaskManager.Task::(_updateState) Task=`f939548d-9517-49e9-84c5-eb1c4734d50b`::moving from state preparing -> state finished >Thread-73::DEBUG::2014-07-10 09:18:54,984::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-73::DEBUG::2014-07-10 09:18:54,984::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-73::DEBUG::2014-07-10 09:18:54,984::task::990::TaskManager.Task::(_decref) Task=`f939548d-9517-49e9-84c5-eb1c4734d50b`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 09:18:56,803::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:18:56,912::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0358411 s, 28.6 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:18:58,927::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:18:59,020::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0315665 s, 32.4 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-10 09:18:59,104::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/metadata bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-10 09:18:59,126::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000659008 s, 6.2 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 09:18:59,796::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-14::DEBUG::2014-07-10 09:18:59,797::task::595::TaskManager.Task::(_updateState) Task=`f8dc9218-28c6-4499-880a-2a4ae1d2501c`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 09:18:59,798::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-14::INFO::2014-07-10 09:18:59,798::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:18:59,799::task::1185::TaskManager.Task::(prepare) Task=`f8dc9218-28c6-4499-880a-2a4ae1d2501c`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:18:59,799::task::595::TaskManager.Task::(_updateState) Task=`f8dc9218-28c6-4499-880a-2a4ae1d2501c`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 09:18:59,799::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 09:18:59,799::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 09:18:59,799::task::990::TaskManager.Task::(_decref) Task=`f8dc9218-28c6-4499-880a-2a4ae1d2501c`::ref 0 aborting False >Thread-34::DEBUG::2014-07-10 09:18:59,803::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-34::DEBUG::2014-07-10 09:18:59,804::task::595::TaskManager.Task::(_updateState) Task=`b5325f81-2711-4dcf-ad79-0f7bbd3bbdfe`::moving from state init -> state preparing >Thread-34::INFO::2014-07-10 09:18:59,804::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-34::DEBUG::2014-07-10 09:18:59,805::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`51da20c9-40db-4b5b-babe-23beaad313c7`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-10 09:18:59,805::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' for lock type 'shared' >Thread-34::DEBUG::2014-07-10 09:18:59,806::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-10 09:18:59,806::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`51da20c9-40db-4b5b-babe-23beaad313c7`::Granted request >Thread-34::DEBUG::2014-07-10 09:18:59,806::task::827::TaskManager.Task::(resourceAcquired) Task=`b5325f81-2711-4dcf-ad79-0f7bbd3bbdfe`::_resourcesAcquired: Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee (shared) >Thread-34::DEBUG::2014-07-10 09:18:59,807::task::990::TaskManager.Task::(_decref) Task=`b5325f81-2711-4dcf-ad79-0f7bbd3bbdfe`::ref 1 aborting False >Thread-34::INFO::2014-07-10 09:18:59,808::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532067385344', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:18:59,808::task::1185::TaskManager.Task::(prepare) Task=`b5325f81-2711-4dcf-ad79-0f7bbd3bbdfe`::finished: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532067385344', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:18:59,808::task::595::TaskManager.Task::(_updateState) Task=`b5325f81-2711-4dcf-ad79-0f7bbd3bbdfe`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-10 09:18:59,808::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee': < ResourceRef 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-10 09:18:59,808::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-10 09:18:59,809::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' >Thread-34::DEBUG::2014-07-10 09:18:59,809::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' (0 active users) >Thread-34::DEBUG::2014-07-10 09:18:59,809::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-10 09:18:59,809::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', Clearing records. >Thread-34::DEBUG::2014-07-10 09:18:59,810::task::990::TaskManager.Task::(_decref) Task=`b5325f81-2711-4dcf-ad79-0f7bbd3bbdfe`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 09:19:01,037::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:19:01,128::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0353942 s, 28.9 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 09:19:02,207::task::595::TaskManager.Task::(_updateState) Task=`4b5702d1-ade8-4053-bf12-f3eef6ee65e5`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 09:19:02,208::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::INFO::2014-07-10 09:19:02,208::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000659008', 'lastCheck': '3.1', 'valid': True}, '6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000631529', 'lastCheck': '10.0', 'valid': True}} >Thread-14::DEBUG::2014-07-10 09:19:02,208::task::1185::TaskManager.Task::(prepare) Task=`4b5702d1-ade8-4053-bf12-f3eef6ee65e5`::finished: {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000659008', 'lastCheck': '3.1', 'valid': True}, '6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000631529', 'lastCheck': '10.0', 'valid': True}} >Thread-14::DEBUG::2014-07-10 09:19:02,208::task::595::TaskManager.Task::(_updateState) Task=`4b5702d1-ade8-4053-bf12-f3eef6ee65e5`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 09:19:02,209::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 09:19:02,209::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 09:19:02,209::task::990::TaskManager.Task::(_decref) Task=`4b5702d1-ade8-4053-bf12-f3eef6ee65e5`::ref 0 aborting False >Thread-40::DEBUG::2014-07-10 09:19:02,345::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lion.qa.lab.tlv.redhat.com:_export_yuri2_backup2/6a70504d-00df-4869-8695-0f442053f6b6/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-40::DEBUG::2014-07-10 09:19:02,388::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n369 bytes (369 B) copied, 0.000413858 s, 892 kB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:19:03,146::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:19:03,236::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0350953 s, 29.2 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:19:05,264::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:19:05,348::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0275909 s, 37.1 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:19:07,363::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:19:07,444::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0253187 s, 40.4 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-10 09:19:09,155::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/metadata bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-10 09:19:09,176::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000610986 s, 6.7 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:19:09,459::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:19:09,552::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0339628 s, 30.2 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 09:19:09,857::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-14::DEBUG::2014-07-10 09:19:09,860::task::595::TaskManager.Task::(_updateState) Task=`0476b498-1751-487b-a61b-86bb3e69fe0a`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 09:19:09,861::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-14::INFO::2014-07-10 09:19:09,861::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:19:09,861::task::1185::TaskManager.Task::(prepare) Task=`0476b498-1751-487b-a61b-86bb3e69fe0a`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:19:09,862::task::595::TaskManager.Task::(_updateState) Task=`0476b498-1751-487b-a61b-86bb3e69fe0a`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 09:19:09,862::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 09:19:09,862::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 09:19:09,862::task::990::TaskManager.Task::(_decref) Task=`0476b498-1751-487b-a61b-86bb3e69fe0a`::ref 0 aborting False >Thread-34::DEBUG::2014-07-10 09:19:09,866::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-34::DEBUG::2014-07-10 09:19:09,867::task::595::TaskManager.Task::(_updateState) Task=`2f1cec97-bec8-4662-a4dc-07aeaaa1d1d6`::moving from state init -> state preparing >Thread-34::INFO::2014-07-10 09:19:09,867::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-34::DEBUG::2014-07-10 09:19:09,868::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`801b8369-e752-473f-b131-0263877fdbe4`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-10 09:19:09,868::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' for lock type 'shared' >Thread-34::DEBUG::2014-07-10 09:19:09,868::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-10 09:19:09,868::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`801b8369-e752-473f-b131-0263877fdbe4`::Granted request >Thread-34::DEBUG::2014-07-10 09:19:09,869::task::827::TaskManager.Task::(resourceAcquired) Task=`2f1cec97-bec8-4662-a4dc-07aeaaa1d1d6`::_resourcesAcquired: Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee (shared) >Thread-34::DEBUG::2014-07-10 09:19:09,869::task::990::TaskManager.Task::(_decref) Task=`2f1cec97-bec8-4662-a4dc-07aeaaa1d1d6`::ref 1 aborting False >Thread-34::INFO::2014-07-10 09:19:09,870::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532067385344', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:19:09,870::task::1185::TaskManager.Task::(prepare) Task=`2f1cec97-bec8-4662-a4dc-07aeaaa1d1d6`::finished: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532067385344', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:19:09,870::task::595::TaskManager.Task::(_updateState) Task=`2f1cec97-bec8-4662-a4dc-07aeaaa1d1d6`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-10 09:19:09,871::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee': < ResourceRef 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-10 09:19:09,871::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-10 09:19:09,871::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' >Thread-34::DEBUG::2014-07-10 09:19:09,871::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' (0 active users) >Thread-34::DEBUG::2014-07-10 09:19:09,871::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-10 09:19:09,871::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', Clearing records. >Thread-34::DEBUG::2014-07-10 09:19:09,872::task::990::TaskManager.Task::(_decref) Task=`2f1cec97-bec8-4662-a4dc-07aeaaa1d1d6`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 09:19:11,567::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:19:11,660::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0355585 s, 28.8 MB/s\n'; <rc> = 0 >Thread-40::DEBUG::2014-07-10 09:19:12,431::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lion.qa.lab.tlv.redhat.com:_export_yuri2_backup2/6a70504d-00df-4869-8695-0f442053f6b6/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-40::DEBUG::2014-07-10 09:19:12,453::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n369 bytes (369 B) copied, 0.000467656 s, 789 kB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:19:13,675::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Thread-57::DEBUG::2014-07-10 09:19:13,702::task::595::TaskManager.Task::(_updateState) Task=`f172c4a1-cd77-4486-b008-54b360daadd1`::moving from state init -> state preparing >Thread-57::INFO::2014-07-10 09:19:13,704::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='b6f6c0da-e67f-4902-b9ac-3069571a42fe', volUUID='c4cd1da8-05b7-45e0-80b1-1183d21443d9', options=None) >Thread-57::INFO::2014-07-10 09:19:13,705::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-57::DEBUG::2014-07-10 09:19:13,706::task::1185::TaskManager.Task::(prepare) Task=`f172c4a1-cd77-4486-b008-54b360daadd1`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-57::DEBUG::2014-07-10 09:19:13,707::task::595::TaskManager.Task::(_updateState) Task=`f172c4a1-cd77-4486-b008-54b360daadd1`::moving from state preparing -> state finished >Thread-57::DEBUG::2014-07-10 09:19:13,708::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-57::DEBUG::2014-07-10 09:19:13,708::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-57::DEBUG::2014-07-10 09:19:13,709::task::990::TaskManager.Task::(_decref) Task=`f172c4a1-cd77-4486-b008-54b360daadd1`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 09:19:13,772::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0362242 s, 28.3 MB/s\n'; <rc> = 0 >Thread-67::DEBUG::2014-07-10 09:19:14,587::task::595::TaskManager.Task::(_updateState) Task=`880ecfe2-e606-41ca-b1d3-801db31edcb0`::moving from state init -> state preparing >Thread-67::INFO::2014-07-10 09:19:14,587::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='f30c2cb7-a43a-4bf5-82b5-cfe07336f65c', volUUID='b0fbb3c9-55af-4a3a-95ad-fc56a80b9cf5', options=None) >Thread-67::INFO::2014-07-10 09:19:14,588::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-67::DEBUG::2014-07-10 09:19:14,588::task::1185::TaskManager.Task::(prepare) Task=`880ecfe2-e606-41ca-b1d3-801db31edcb0`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-67::DEBUG::2014-07-10 09:19:14,588::task::595::TaskManager.Task::(_updateState) Task=`880ecfe2-e606-41ca-b1d3-801db31edcb0`::moving from state preparing -> state finished >Thread-67::DEBUG::2014-07-10 09:19:14,588::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-67::DEBUG::2014-07-10 09:19:14,589::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-67::DEBUG::2014-07-10 09:19:14,589::task::990::TaskManager.Task::(_decref) Task=`880ecfe2-e606-41ca-b1d3-801db31edcb0`::ref 0 aborting False >Thread-48::DEBUG::2014-07-10 09:19:15,026::task::595::TaskManager.Task::(_updateState) Task=`3266c755-5b01-48b2-91c1-79cde8003035`::moving from state init -> state preparing >Thread-48::INFO::2014-07-10 09:19:15,027::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='0cd7d6ce-f497-4243-a690-c57744861eea', volUUID='10b6a7dd-dc6c-43fa-ba17-92e4331b0e0b', options=None) >Thread-48::INFO::2014-07-10 09:19:15,027::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-48::DEBUG::2014-07-10 09:19:15,028::task::1185::TaskManager.Task::(prepare) Task=`3266c755-5b01-48b2-91c1-79cde8003035`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-48::DEBUG::2014-07-10 09:19:15,028::task::595::TaskManager.Task::(_updateState) Task=`3266c755-5b01-48b2-91c1-79cde8003035`::moving from state preparing -> state finished >Thread-48::DEBUG::2014-07-10 09:19:15,028::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-48::DEBUG::2014-07-10 09:19:15,028::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-48::DEBUG::2014-07-10 09:19:15,028::task::990::TaskManager.Task::(_decref) Task=`3266c755-5b01-48b2-91c1-79cde8003035`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 09:19:15,788::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:19:15,877::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0290629 s, 35.2 MB/s\n'; <rc> = 0 >Thread-76::DEBUG::2014-07-10 09:19:16,377::task::595::TaskManager.Task::(_updateState) Task=`9bb538a3-aae4-4d15-9bf2-f43dc5d28a19`::moving from state init -> state preparing >Thread-76::INFO::2014-07-10 09:19:16,378::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='e4c65229-4247-4b33-b72a-f1d5ce72ad05', volUUID='cad94284-3ca9-4c30-933d-997f4460309e', options=None) >Thread-76::INFO::2014-07-10 09:19:16,378::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-76::DEBUG::2014-07-10 09:19:16,379::task::1185::TaskManager.Task::(prepare) Task=`9bb538a3-aae4-4d15-9bf2-f43dc5d28a19`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-76::DEBUG::2014-07-10 09:19:16,379::task::595::TaskManager.Task::(_updateState) Task=`9bb538a3-aae4-4d15-9bf2-f43dc5d28a19`::moving from state preparing -> state finished >Thread-76::DEBUG::2014-07-10 09:19:16,379::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-76::DEBUG::2014-07-10 09:19:16,379::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-76::DEBUG::2014-07-10 09:19:16,380::task::990::TaskManager.Task::(_decref) Task=`9bb538a3-aae4-4d15-9bf2-f43dc5d28a19`::ref 0 aborting False >Thread-14::DEBUG::2014-07-10 09:19:17,570::task::595::TaskManager.Task::(_updateState) Task=`cbeb4e10-6c58-45fe-ae35-bb1a3b63de10`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 09:19:17,570::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::INFO::2014-07-10 09:19:17,571::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000610986', 'lastCheck': '8.4', 'valid': True}, '6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000467656', 'lastCheck': '5.1', 'valid': True}} >Thread-14::DEBUG::2014-07-10 09:19:17,571::task::1185::TaskManager.Task::(prepare) Task=`cbeb4e10-6c58-45fe-ae35-bb1a3b63de10`::finished: {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000610986', 'lastCheck': '8.4', 'valid': True}, '6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000467656', 'lastCheck': '5.1', 'valid': True}} >Thread-14::DEBUG::2014-07-10 09:19:17,571::task::595::TaskManager.Task::(_updateState) Task=`cbeb4e10-6c58-45fe-ae35-bb1a3b63de10`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 09:19:17,571::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 09:19:17,572::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 09:19:17,572::task::990::TaskManager.Task::(_decref) Task=`cbeb4e10-6c58-45fe-ae35-bb1a3b63de10`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 09:19:17,892::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:19:17,987::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0352371 s, 29.1 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-10 09:19:19,205::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/metadata bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-10 09:19:19,225::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000751136 s, 5.5 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 09:19:19,919::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-14::DEBUG::2014-07-10 09:19:19,925::task::595::TaskManager.Task::(_updateState) Task=`761f5340-83f7-411a-8d17-dd257921611a`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 09:19:19,931::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-14::INFO::2014-07-10 09:19:19,936::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:19:19,938::task::1185::TaskManager.Task::(prepare) Task=`761f5340-83f7-411a-8d17-dd257921611a`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:19:19,940::task::595::TaskManager.Task::(_updateState) Task=`761f5340-83f7-411a-8d17-dd257921611a`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 09:19:19,942::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 09:19:19,944::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 09:19:19,944::task::990::TaskManager.Task::(_decref) Task=`761f5340-83f7-411a-8d17-dd257921611a`::ref 0 aborting False >Thread-34::DEBUG::2014-07-10 09:19:19,988::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-34::DEBUG::2014-07-10 09:19:19,989::task::595::TaskManager.Task::(_updateState) Task=`3d899370-bc34-484e-9ef4-e5c20d01340e`::moving from state init -> state preparing >Thread-34::INFO::2014-07-10 09:19:19,989::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-34::DEBUG::2014-07-10 09:19:19,990::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`2f800069-ed4a-4da7-be71-81a798f21a1e`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-10 09:19:19,990::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' for lock type 'shared' >Thread-34::DEBUG::2014-07-10 09:19:19,990::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-10 09:19:19,990::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`2f800069-ed4a-4da7-be71-81a798f21a1e`::Granted request >Thread-34::DEBUG::2014-07-10 09:19:19,991::task::827::TaskManager.Task::(resourceAcquired) Task=`3d899370-bc34-484e-9ef4-e5c20d01340e`::_resourcesAcquired: Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee (shared) >Thread-34::DEBUG::2014-07-10 09:19:19,991::task::990::TaskManager.Task::(_decref) Task=`3d899370-bc34-484e-9ef4-e5c20d01340e`::ref 1 aborting False >Thread-34::INFO::2014-07-10 09:19:19,992::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532067385344', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:19:19,992::task::1185::TaskManager.Task::(prepare) Task=`3d899370-bc34-484e-9ef4-e5c20d01340e`::finished: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532067385344', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:19:19,993::task::595::TaskManager.Task::(_updateState) Task=`3d899370-bc34-484e-9ef4-e5c20d01340e`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-10 09:19:19,993::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee': < ResourceRef 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-10 09:19:19,993::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-10 09:19:19,993::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' >Thread-34::DEBUG::2014-07-10 09:19:19,994::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' (0 active users) >Thread-34::DEBUG::2014-07-10 09:19:19,994::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-10 09:19:19,994::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', Clearing records. >Thread-34::DEBUG::2014-07-10 09:19:19,994::task::990::TaskManager.Task::(_decref) Task=`3d899370-bc34-484e-9ef4-e5c20d01340e`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 09:19:20,003::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:19:20,096::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0350931 s, 29.2 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:19:22,112::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:19:22,221::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0516484 s, 19.8 MB/s\n'; <rc> = 0 >Thread-40::DEBUG::2014-07-10 09:19:22,487::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lion.qa.lab.tlv.redhat.com:_export_yuri2_backup2/6a70504d-00df-4869-8695-0f442053f6b6/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-40::DEBUG::2014-07-10 09:19:22,506::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n369 bytes (369 B) copied, 0.000494658 s, 746 kB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:19:24,237::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:19:24,334::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0354435 s, 28.9 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:19:26,349::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:19:26,438::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0301434 s, 34.0 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:19:28,453::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:19:28,544::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0308703 s, 33.2 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-10 09:19:29,260::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/metadata bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-10 09:19:29,283::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000739216 s, 5.5 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 09:19:30,023::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-14::DEBUG::2014-07-10 09:19:30,024::task::595::TaskManager.Task::(_updateState) Task=`6ef9e244-14cd-404b-89bb-011008fba058`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 09:19:30,024::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-14::INFO::2014-07-10 09:19:30,025::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:19:30,025::task::1185::TaskManager.Task::(prepare) Task=`6ef9e244-14cd-404b-89bb-011008fba058`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:19:30,025::task::595::TaskManager.Task::(_updateState) Task=`6ef9e244-14cd-404b-89bb-011008fba058`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 09:19:30,025::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 09:19:30,026::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 09:19:30,026::task::990::TaskManager.Task::(_decref) Task=`6ef9e244-14cd-404b-89bb-011008fba058`::ref 0 aborting False >Thread-34::DEBUG::2014-07-10 09:19:30,030::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-34::DEBUG::2014-07-10 09:19:30,030::task::595::TaskManager.Task::(_updateState) Task=`e83d6c76-2660-4806-8d97-fe2885de777c`::moving from state init -> state preparing >Thread-34::INFO::2014-07-10 09:19:30,031::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-34::DEBUG::2014-07-10 09:19:30,031::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`59f568aa-2bdc-4007-a2cb-3c7d921566ef`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-10 09:19:30,032::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' for lock type 'shared' >Thread-34::DEBUG::2014-07-10 09:19:30,032::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-10 09:19:30,032::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`59f568aa-2bdc-4007-a2cb-3c7d921566ef`::Granted request >Thread-34::DEBUG::2014-07-10 09:19:30,033::task::827::TaskManager.Task::(resourceAcquired) Task=`e83d6c76-2660-4806-8d97-fe2885de777c`::_resourcesAcquired: Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee (shared) >Thread-34::DEBUG::2014-07-10 09:19:30,033::task::990::TaskManager.Task::(_decref) Task=`e83d6c76-2660-4806-8d97-fe2885de777c`::ref 1 aborting False >Thread-34::INFO::2014-07-10 09:19:30,034::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532067385344', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:19:30,034::task::1185::TaskManager.Task::(prepare) Task=`e83d6c76-2660-4806-8d97-fe2885de777c`::finished: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532067385344', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:19:30,034::task::595::TaskManager.Task::(_updateState) Task=`e83d6c76-2660-4806-8d97-fe2885de777c`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-10 09:19:30,035::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee': < ResourceRef 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-10 09:19:30,035::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-10 09:19:30,035::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' >Thread-34::DEBUG::2014-07-10 09:19:30,035::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' (0 active users) >Thread-34::DEBUG::2014-07-10 09:19:30,035::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-10 09:19:30,036::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', Clearing records. >Thread-34::DEBUG::2014-07-10 09:19:30,036::task::990::TaskManager.Task::(_decref) Task=`e83d6c76-2660-4806-8d97-fe2885de777c`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 09:19:30,559::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:19:30,671::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0355411 s, 28.8 MB/s\n'; <rc> = 0 >Thread-40::DEBUG::2014-07-10 09:19:32,538::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lion.qa.lab.tlv.redhat.com:_export_yuri2_backup2/6a70504d-00df-4869-8695-0f442053f6b6/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-40::DEBUG::2014-07-10 09:19:32,560::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n369 bytes (369 B) copied, 0.000449692 s, 821 kB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:19:32,687::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Thread-14::DEBUG::2014-07-10 09:19:32,793::task::595::TaskManager.Task::(_updateState) Task=`c002d23e-714c-405a-89b1-3c24c4bbd8b9`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 09:19:32,797::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::INFO::2014-07-10 09:19:32,800::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000739216', 'lastCheck': '3.5', 'valid': True}, '6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000449692', 'lastCheck': '0.2', 'valid': True}} >Thread-14::DEBUG::2014-07-10 09:19:32,802::task::1185::TaskManager.Task::(prepare) Task=`c002d23e-714c-405a-89b1-3c24c4bbd8b9`::finished: {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000739216', 'lastCheck': '3.5', 'valid': True}, '6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000449692', 'lastCheck': '0.2', 'valid': True}} >Thread-14::DEBUG::2014-07-10 09:19:32,804::task::595::TaskManager.Task::(_updateState) Task=`c002d23e-714c-405a-89b1-3c24c4bbd8b9`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 09:19:32,807::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 09:19:32,809::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 09:19:32,811::task::990::TaskManager.Task::(_decref) Task=`c002d23e-714c-405a-89b1-3c24c4bbd8b9`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 09:19:32,888::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0387376 s, 26.4 MB/s\n'; <rc> = 0 >Thread-70::DEBUG::2014-07-10 09:19:33,784::task::595::TaskManager.Task::(_updateState) Task=`7e12b630-8548-49ec-98b7-33160ee71366`::moving from state init -> state preparing >Thread-70::INFO::2014-07-10 09:19:33,786::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='cfaeead2-7caa-467c-b389-c89840ae6605', volUUID='567fe32d-31a6-4ff6-90f3-fd6a656fbecc', options=None) >Thread-70::INFO::2014-07-10 09:19:33,786::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-70::DEBUG::2014-07-10 09:19:33,787::task::1185::TaskManager.Task::(prepare) Task=`7e12b630-8548-49ec-98b7-33160ee71366`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-70::DEBUG::2014-07-10 09:19:33,787::task::595::TaskManager.Task::(_updateState) Task=`7e12b630-8548-49ec-98b7-33160ee71366`::moving from state preparing -> state finished >Thread-70::DEBUG::2014-07-10 09:19:33,787::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-70::DEBUG::2014-07-10 09:19:33,787::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-70::DEBUG::2014-07-10 09:19:33,787::task::990::TaskManager.Task::(_decref) Task=`7e12b630-8548-49ec-98b7-33160ee71366`::ref 0 aborting False >Thread-60::DEBUG::2014-07-10 09:19:34,660::task::595::TaskManager.Task::(_updateState) Task=`48f0af7e-d0f7-46ba-bebd-7a32b75542f5`::moving from state init -> state preparing >Thread-60::INFO::2014-07-10 09:19:34,661::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='b034d5b0-e1e0-4011-b49b-4d45ddb11556', volUUID='3d7f62b5-328f-4d8e-8b69-873cfb5ae14d', options=None) >Thread-60::INFO::2014-07-10 09:19:34,661::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-60::DEBUG::2014-07-10 09:19:34,661::task::1185::TaskManager.Task::(prepare) Task=`48f0af7e-d0f7-46ba-bebd-7a32b75542f5`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-60::DEBUG::2014-07-10 09:19:34,662::task::595::TaskManager.Task::(_updateState) Task=`48f0af7e-d0f7-46ba-bebd-7a32b75542f5`::moving from state preparing -> state finished >Thread-60::DEBUG::2014-07-10 09:19:34,662::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-60::DEBUG::2014-07-10 09:19:34,662::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-60::DEBUG::2014-07-10 09:19:34,662::task::990::TaskManager.Task::(_decref) Task=`48f0af7e-d0f7-46ba-bebd-7a32b75542f5`::ref 0 aborting False >Thread-51::DEBUG::2014-07-10 09:19:34,839::task::595::TaskManager.Task::(_updateState) Task=`88fe37f0-6cd2-42e7-9163-710248fcb878`::moving from state init -> state preparing >Thread-51::INFO::2014-07-10 09:19:34,840::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='76fdb054-02cd-42ed-9721-b3e65b34c3a4', volUUID='022dfe46-2cf7-4915-80b3-883158e3ca83', options=None) >Thread-51::INFO::2014-07-10 09:19:34,840::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-51::DEBUG::2014-07-10 09:19:34,842::task::1185::TaskManager.Task::(prepare) Task=`88fe37f0-6cd2-42e7-9163-710248fcb878`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-51::DEBUG::2014-07-10 09:19:34,842::task::595::TaskManager.Task::(_updateState) Task=`88fe37f0-6cd2-42e7-9163-710248fcb878`::moving from state preparing -> state finished >Thread-51::DEBUG::2014-07-10 09:19:34,842::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-51::DEBUG::2014-07-10 09:19:34,842::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-51::DEBUG::2014-07-10 09:19:34,842::task::990::TaskManager.Task::(_decref) Task=`88fe37f0-6cd2-42e7-9163-710248fcb878`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 09:19:35,045::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:19:35,211::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0296594 s, 34.5 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:19:37,274::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:19:37,374::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0432779 s, 23.7 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-10 09:19:39,313::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/metadata bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-10 09:19:39,361::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000762638 s, 5.4 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:19:39,390::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:19:39,482::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0344735 s, 29.7 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 09:19:40,064::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [20826f36] >Thread-14::DEBUG::2014-07-10 09:19:40,066::task::595::TaskManager.Task::(_updateState) Task=`22bf7104-f1f9-45a6-90eb-f7d672798398`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 09:19:40,066::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-14::INFO::2014-07-10 09:19:40,066::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:19:40,067::task::1185::TaskManager.Task::(prepare) Task=`22bf7104-f1f9-45a6-90eb-f7d672798398`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:19:40,067::task::595::TaskManager.Task::(_updateState) Task=`22bf7104-f1f9-45a6-90eb-f7d672798398`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 09:19:40,067::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 09:19:40,067::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 09:19:40,067::task::990::TaskManager.Task::(_decref) Task=`22bf7104-f1f9-45a6-90eb-f7d672798398`::ref 0 aborting False >Thread-34::DEBUG::2014-07-10 09:19:40,071::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [20826f36] >Thread-34::DEBUG::2014-07-10 09:19:40,072::task::595::TaskManager.Task::(_updateState) Task=`f6a6c696-5e48-486d-b432-2ebd1b127007`::moving from state init -> state preparing >Thread-34::INFO::2014-07-10 09:19:40,072::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-34::DEBUG::2014-07-10 09:19:40,073::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`4dfe0255-e261-4d63-85e1-56640cce7b4e`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-10 09:19:40,073::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' for lock type 'shared' >Thread-34::DEBUG::2014-07-10 09:19:40,073::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-10 09:19:40,073::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`4dfe0255-e261-4d63-85e1-56640cce7b4e`::Granted request >Thread-34::DEBUG::2014-07-10 09:19:40,074::task::827::TaskManager.Task::(resourceAcquired) Task=`f6a6c696-5e48-486d-b432-2ebd1b127007`::_resourcesAcquired: Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee (shared) >Thread-34::DEBUG::2014-07-10 09:19:40,074::task::990::TaskManager.Task::(_decref) Task=`f6a6c696-5e48-486d-b432-2ebd1b127007`::ref 1 aborting False >Thread-34::INFO::2014-07-10 09:19:40,075::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532067385344', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:19:40,075::task::1185::TaskManager.Task::(prepare) Task=`f6a6c696-5e48-486d-b432-2ebd1b127007`::finished: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532067385344', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:19:40,075::task::595::TaskManager.Task::(_updateState) Task=`f6a6c696-5e48-486d-b432-2ebd1b127007`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-10 09:19:40,075::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee': < ResourceRef 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-10 09:19:40,076::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-10 09:19:40,076::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' >Thread-34::DEBUG::2014-07-10 09:19:40,076::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' (0 active users) >Thread-34::DEBUG::2014-07-10 09:19:40,076::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-10 09:19:40,076::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', Clearing records. >Thread-34::DEBUG::2014-07-10 09:19:40,077::task::990::TaskManager.Task::(_decref) Task=`f6a6c696-5e48-486d-b432-2ebd1b127007`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 09:19:41,497::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:19:41,593::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0269367 s, 38.0 MB/s\n'; <rc> = 0 >Thread-40::DEBUG::2014-07-10 09:19:42,591::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lion.qa.lab.tlv.redhat.com:_export_yuri2_backup2/6a70504d-00df-4869-8695-0f442053f6b6/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-40::DEBUG::2014-07-10 09:19:42,614::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n369 bytes (369 B) copied, 0.000481381 s, 767 kB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:19:43,609::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:19:43,697::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0305347 s, 33.5 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:19:45,712::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:19:45,830::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0582278 s, 17.6 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:19:47,844::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:19:47,946::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0417922 s, 24.5 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 09:19:48,204::task::595::TaskManager.Task::(_updateState) Task=`f0e04cbf-f4b5-4772-b71e-f8ab3c41fce5`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 09:19:48,204::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::INFO::2014-07-10 09:19:48,205::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000762638', 'lastCheck': '8.8', 'valid': True}, '6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000481381', 'lastCheck': '5.6', 'valid': True}} >Thread-14::DEBUG::2014-07-10 09:19:48,205::task::1185::TaskManager.Task::(prepare) Task=`f0e04cbf-f4b5-4772-b71e-f8ab3c41fce5`::finished: {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000762638', 'lastCheck': '8.8', 'valid': True}, '6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000481381', 'lastCheck': '5.6', 'valid': True}} >Thread-14::DEBUG::2014-07-10 09:19:48,205::task::595::TaskManager.Task::(_updateState) Task=`f0e04cbf-f4b5-4772-b71e-f8ab3c41fce5`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 09:19:48,206::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 09:19:48,206::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 09:19:48,206::task::990::TaskManager.Task::(_decref) Task=`f0e04cbf-f4b5-4772-b71e-f8ab3c41fce5`::ref 0 aborting False >Thread-18::DEBUG::2014-07-10 09:19:49,390::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/metadata bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-10 09:19:49,412::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000813271 s, 5.0 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:19:49,962::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:19:50,086::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0685745 s, 14.9 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 09:19:50,120::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-14::DEBUG::2014-07-10 09:19:50,121::task::595::TaskManager.Task::(_updateState) Task=`c78b6853-cb6b-4e91-a3fb-4b3d6a953fdc`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 09:19:50,121::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-14::INFO::2014-07-10 09:19:50,122::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:19:50,122::task::1185::TaskManager.Task::(prepare) Task=`c78b6853-cb6b-4e91-a3fb-4b3d6a953fdc`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:19:50,123::task::595::TaskManager.Task::(_updateState) Task=`c78b6853-cb6b-4e91-a3fb-4b3d6a953fdc`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 09:19:50,123::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 09:19:50,123::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 09:19:50,123::task::990::TaskManager.Task::(_decref) Task=`c78b6853-cb6b-4e91-a3fb-4b3d6a953fdc`::ref 0 aborting False >Thread-34::DEBUG::2014-07-10 09:19:50,167::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-34::DEBUG::2014-07-10 09:19:50,167::task::595::TaskManager.Task::(_updateState) Task=`68ae07c2-a70b-4f88-9bcf-016169359bd0`::moving from state init -> state preparing >Thread-34::INFO::2014-07-10 09:19:50,168::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-34::DEBUG::2014-07-10 09:19:50,168::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`4629eecd-c640-4185-836c-11bf7014e85a`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-10 09:19:50,168::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' for lock type 'shared' >Thread-34::DEBUG::2014-07-10 09:19:50,169::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-10 09:19:50,169::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`4629eecd-c640-4185-836c-11bf7014e85a`::Granted request >Thread-34::DEBUG::2014-07-10 09:19:50,170::task::827::TaskManager.Task::(resourceAcquired) Task=`68ae07c2-a70b-4f88-9bcf-016169359bd0`::_resourcesAcquired: Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee (shared) >Thread-34::DEBUG::2014-07-10 09:19:50,170::task::990::TaskManager.Task::(_decref) Task=`68ae07c2-a70b-4f88-9bcf-016169359bd0`::ref 1 aborting False >Thread-34::INFO::2014-07-10 09:19:50,171::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532067385344', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:19:50,171::task::1185::TaskManager.Task::(prepare) Task=`68ae07c2-a70b-4f88-9bcf-016169359bd0`::finished: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532067385344', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:19:50,171::task::595::TaskManager.Task::(_updateState) Task=`68ae07c2-a70b-4f88-9bcf-016169359bd0`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-10 09:19:50,172::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee': < ResourceRef 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-10 09:19:50,172::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-10 09:19:50,172::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' >Thread-34::DEBUG::2014-07-10 09:19:50,172::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' (0 active users) >Thread-34::DEBUG::2014-07-10 09:19:50,173::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-10 09:19:50,173::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', Clearing records. >Thread-34::DEBUG::2014-07-10 09:19:50,173::task::990::TaskManager.Task::(_decref) Task=`68ae07c2-a70b-4f88-9bcf-016169359bd0`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 09:19:52,101::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:19:52,193::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0298066 s, 34.4 MB/s\n'; <rc> = 0 >Thread-40::DEBUG::2014-07-10 09:19:52,645::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lion.qa.lab.tlv.redhat.com:_export_yuri2_backup2/6a70504d-00df-4869-8695-0f442053f6b6/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-40::DEBUG::2014-07-10 09:19:52,667::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n369 bytes (369 B) copied, 0.000410631 s, 899 kB/s\n'; <rc> = 0 >Thread-64::DEBUG::2014-07-10 09:19:53,859::task::595::TaskManager.Task::(_updateState) Task=`d3a58ca7-b7b2-435e-a6a4-bd1de27ca46c`::moving from state init -> state preparing >Thread-64::INFO::2014-07-10 09:19:53,860::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='aa20346a-4d3a-4e07-b8e1-52c0ebe4168c', volUUID='58fefce2-9bce-4bff-8949-8c6ce8122b27', options=None) >Thread-64::INFO::2014-07-10 09:19:53,860::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-64::DEBUG::2014-07-10 09:19:53,861::task::1185::TaskManager.Task::(prepare) Task=`d3a58ca7-b7b2-435e-a6a4-bd1de27ca46c`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-64::DEBUG::2014-07-10 09:19:53,861::task::595::TaskManager.Task::(_updateState) Task=`d3a58ca7-b7b2-435e-a6a4-bd1de27ca46c`::moving from state preparing -> state finished >Thread-64::DEBUG::2014-07-10 09:19:53,861::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-64::DEBUG::2014-07-10 09:19:53,861::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-64::DEBUG::2014-07-10 09:19:53,861::task::990::TaskManager.Task::(_decref) Task=`d3a58ca7-b7b2-435e-a6a4-bd1de27ca46c`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 09:19:54,209::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:19:54,302::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0358228 s, 28.6 MB/s\n'; <rc> = 0 >Thread-54::DEBUG::2014-07-10 09:19:55,248::task::595::TaskManager.Task::(_updateState) Task=`19285a22-6d32-42f4-87b1-37644d765cb2`::moving from state init -> state preparing >Thread-54::INFO::2014-07-10 09:19:55,249::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='28408446-e5fd-4565-a976-e760951593fe', volUUID='776303a2-5585-451e-826e-0e338d4a1e98', options=None) >Thread-73::DEBUG::2014-07-10 09:19:55,250::task::595::TaskManager.Task::(_updateState) Task=`4cdda535-e85c-4bb4-a202-4702c0a9cadf`::moving from state init -> state preparing >Thread-73::INFO::2014-07-10 09:19:55,251::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='c01d693b-cba0-4fed-9ad7-0aaa28912a19', volUUID='4bb5d954-2a50-4028-b299-0b43c261270c', options=None) >Thread-54::INFO::2014-07-10 09:19:55,251::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-54::DEBUG::2014-07-10 09:19:55,252::task::1185::TaskManager.Task::(prepare) Task=`19285a22-6d32-42f4-87b1-37644d765cb2`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-54::DEBUG::2014-07-10 09:19:55,253::task::595::TaskManager.Task::(_updateState) Task=`19285a22-6d32-42f4-87b1-37644d765cb2`::moving from state preparing -> state finished >Thread-54::DEBUG::2014-07-10 09:19:55,253::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-73::INFO::2014-07-10 09:19:55,253::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-54::DEBUG::2014-07-10 09:19:55,254::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-73::DEBUG::2014-07-10 09:19:55,254::task::1185::TaskManager.Task::(prepare) Task=`4cdda535-e85c-4bb4-a202-4702c0a9cadf`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-54::DEBUG::2014-07-10 09:19:55,254::task::990::TaskManager.Task::(_decref) Task=`19285a22-6d32-42f4-87b1-37644d765cb2`::ref 0 aborting False >Thread-73::DEBUG::2014-07-10 09:19:55,255::task::595::TaskManager.Task::(_updateState) Task=`4cdda535-e85c-4bb4-a202-4702c0a9cadf`::moving from state preparing -> state finished >Thread-73::DEBUG::2014-07-10 09:19:55,256::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-73::DEBUG::2014-07-10 09:19:55,256::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-73::DEBUG::2014-07-10 09:19:55,256::task::990::TaskManager.Task::(_decref) Task=`4cdda535-e85c-4bb4-a202-4702c0a9cadf`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 09:19:56,426::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:19:56,513::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0300435 s, 34.1 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:19:58,529::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:19:58,624::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0353874 s, 28.9 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-10 09:19:59,441::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/metadata bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-10 09:19:59,464::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00082891 s, 4.9 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 09:20:00,199::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-14::DEBUG::2014-07-10 09:20:00,200::task::595::TaskManager.Task::(_updateState) Task=`c617a68a-1261-4da2-97db-3a6204019cb9`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 09:20:00,201::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-14::INFO::2014-07-10 09:20:00,201::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:20:00,201::task::1185::TaskManager.Task::(prepare) Task=`c617a68a-1261-4da2-97db-3a6204019cb9`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:20:00,202::task::595::TaskManager.Task::(_updateState) Task=`c617a68a-1261-4da2-97db-3a6204019cb9`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 09:20:00,202::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 09:20:00,202::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 09:20:00,202::task::990::TaskManager.Task::(_decref) Task=`c617a68a-1261-4da2-97db-3a6204019cb9`::ref 0 aborting False >Thread-34::DEBUG::2014-07-10 09:20:00,206::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-34::DEBUG::2014-07-10 09:20:00,207::task::595::TaskManager.Task::(_updateState) Task=`465f4036-260a-4769-90c0-6dd07ef90611`::moving from state init -> state preparing >Thread-34::INFO::2014-07-10 09:20:00,207::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-34::DEBUG::2014-07-10 09:20:00,208::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`350306c4-3279-43fe-a827-0f2adf99e8d5`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-10 09:20:00,208::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' for lock type 'shared' >Thread-34::DEBUG::2014-07-10 09:20:00,208::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-10 09:20:00,209::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`350306c4-3279-43fe-a827-0f2adf99e8d5`::Granted request >Thread-34::DEBUG::2014-07-10 09:20:00,209::task::827::TaskManager.Task::(resourceAcquired) Task=`465f4036-260a-4769-90c0-6dd07ef90611`::_resourcesAcquired: Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee (shared) >Thread-34::DEBUG::2014-07-10 09:20:00,209::task::990::TaskManager.Task::(_decref) Task=`465f4036-260a-4769-90c0-6dd07ef90611`::ref 1 aborting False >Thread-34::INFO::2014-07-10 09:20:00,211::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532067385344', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:20:00,211::task::1185::TaskManager.Task::(prepare) Task=`465f4036-260a-4769-90c0-6dd07ef90611`::finished: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532067385344', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:20:00,211::task::595::TaskManager.Task::(_updateState) Task=`465f4036-260a-4769-90c0-6dd07ef90611`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-10 09:20:00,211::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee': < ResourceRef 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-10 09:20:00,211::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-10 09:20:00,212::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' >Thread-34::DEBUG::2014-07-10 09:20:00,212::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' (0 active users) >Thread-34::DEBUG::2014-07-10 09:20:00,212::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-10 09:20:00,212::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', Clearing records. >Thread-34::DEBUG::2014-07-10 09:20:00,213::task::990::TaskManager.Task::(_decref) Task=`465f4036-260a-4769-90c0-6dd07ef90611`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 09:20:00,640::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:20:00,735::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0354349 s, 28.9 MB/s\n'; <rc> = 0 >Thread-40::DEBUG::2014-07-10 09:20:02,695::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lion.qa.lab.tlv.redhat.com:_export_yuri2_backup2/6a70504d-00df-4869-8695-0f442053f6b6/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-40::DEBUG::2014-07-10 09:20:02,717::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n369 bytes (369 B) copied, 0.000408642 s, 903 kB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:20:02,761::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:20:02,863::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0360058 s, 28.4 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 09:20:03,423::task::595::TaskManager.Task::(_updateState) Task=`38f8650f-5735-417d-a2f2-0b869685e4a4`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 09:20:03,427::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::INFO::2014-07-10 09:20:03,427::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00082891', 'lastCheck': '3.9', 'valid': True}, '6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000408642', 'lastCheck': '0.7', 'valid': True}} >Thread-14::DEBUG::2014-07-10 09:20:03,427::task::1185::TaskManager.Task::(prepare) Task=`38f8650f-5735-417d-a2f2-0b869685e4a4`::finished: {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00082891', 'lastCheck': '3.9', 'valid': True}, '6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000408642', 'lastCheck': '0.7', 'valid': True}} >Thread-14::DEBUG::2014-07-10 09:20:03,427::task::595::TaskManager.Task::(_updateState) Task=`38f8650f-5735-417d-a2f2-0b869685e4a4`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 09:20:03,428::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 09:20:03,428::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 09:20:03,428::task::990::TaskManager.Task::(_decref) Task=`38f8650f-5735-417d-a2f2-0b869685e4a4`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 09:20:04,878::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:20:04,995::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0300319 s, 34.1 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:20:07,012::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:20:07,098::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0281163 s, 36.4 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:20:09,113::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:20:09,208::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0354732 s, 28.9 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-10 09:20:09,497::domainMonitor::192::Storage.DomainMonitorThread::(_monitorDomain) Refreshing domain 9e1aa540-1f4e-4ee3-a152-be381ef6c3bd >Thread-18::DEBUG::2014-07-10 09:20:09,498::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with LvMetadataRW backend >Thread-18::DEBUG::2014-07-10 09:20:09,498::blockSD::336::Storage.Misc.excCmd::(readlines) '/bin/dd iflag=direct skip=0 bs=2048 if=/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/metadata count=1' (cwd None) >Thread-18::DEBUG::2014-07-10 09:20:09,516::blockSD::336::Storage.Misc.excCmd::(readlines) SUCCESS: <err> = '1+0 records in\n1+0 records out\n2048 bytes (2.0 kB) copied, 0.000674236 s, 3.0 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-10 09:20:09,517::misc::282::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '2048 bytes (2.0 kB) copied, 0.000674236 s, 3.0 MB/s'], size: 2048 >Thread-18::DEBUG::2014-07-10 09:20:09,517::persistentDict::234::Storage.PersistentDict::(refresh) read lines (LvMetadataRW)=[] >Thread-18::WARNING::2014-07-10 09:20:09,517::persistentDict::256::Storage.PersistentDict::(refresh) data has no embedded checksum - trust it as it is >Thread-18::DEBUG::2014-07-10 09:20:09,518::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with VGTagMetadataRW backend >Thread-18::DEBUG::2014-07-10 09:20:09,518::lvm::503::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-18::DEBUG::2014-07-10 09:20:09,519::lvm::505::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-18::DEBUG::2014-07-10 09:20:09,519::lvm::513::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-18::DEBUG::2014-07-10 09:20:09,519::lvm::525::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-18::DEBUG::2014-07-10 09:20:09,520::lvm::373::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-18::DEBUG::2014-07-10 09:20:09,520::lvm::296::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/3600601601282300032826addbbdae311|/dev/mapper/360060160f4a030003840ec867ddee311|/dev/mapper/367cad74c2fcba00019e6afd20c781e67|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name 9e1aa540-1f4e-4ee3-a152-be381ef6c3bd' (cwd None) >Thread-18::DEBUG::2014-07-10 09:20:09,859::lvm::296::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-18::DEBUG::2014-07-10 09:20:09,862::lvm::415::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-18::DEBUG::2014-07-10 09:20:09,862::persistentDict::234::Storage.PersistentDict::(refresh) read lines (VGTagMetadataRW)=['LEASETIMESEC=60', 'VGUUID=9CsMxb-YbRc-yRG7-cQKD-xY3G-GLi5-YxUyPC', 'VERSION=3', 'TYPE=ISCSI', 'LOGBLKSIZE=512', u'PV0=pv:3600601601282300032826addbbdae311,uuid:7qEb8v-jk2X-3CPk-k4XB-eIBk-onYD-807hcV,pestart:0,pecount:8189,mapoffset:0', 'LEASERETRIES=3', 'IOOPTIMEOUTSEC=10', 'LOCKRENEWALINTERVALSEC=5', 'PHYBLKSIZE=512', 'SDUUID=9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'CLASS=Data', 'LOCKPOLICY=', 'DESCRIPTION=SD_REAL', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=DC_REAL', 'ROLE=Master', 'POOL_UUID=4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', 'POOL_SPM_ID=1', 'POOL_SPM_LVER=0', '_SHA_CKSUM=013b5a7910962201c4cceab31b9c6d9c79f7316f', u'POOL_DOMAINS=9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active'] >Thread-18::INFO::2014-07-10 09:20:09,864::sd::384::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 9e1aa540-1f4e-4ee3-a152-be381ef6c3bd_imageNS already registered >Thread-18::INFO::2014-07-10 09:20:09,864::sd::392::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 9e1aa540-1f4e-4ee3-a152-be381ef6c3bd_volumeNS already registered >Thread-18::INFO::2014-07-10 09:20:09,864::blockSD::452::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 9e1aa540-1f4e-4ee3-a152-be381ef6c3bd_lvmActivationNS already registered >Thread-18::DEBUG::2014-07-10 09:20:09,865::lvm::296::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgck --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/3600601601282300032826addbbdae311|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } " 9e1aa540-1f4e-4ee3-a152-be381ef6c3bd' (cwd None) >Thread-18::DEBUG::2014-07-10 09:20:10,070::lvm::296::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-18::DEBUG::2014-07-10 09:20:10,071::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/metadata bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-10 09:20:10,092::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000603607 s, 6.8 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 09:20:10,257::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-14::DEBUG::2014-07-10 09:20:10,258::task::595::TaskManager.Task::(_updateState) Task=`ca6b1396-18c4-4d70-965a-54bc6d363a56`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 09:20:10,258::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-14::INFO::2014-07-10 09:20:10,259::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:20:10,259::task::1185::TaskManager.Task::(prepare) Task=`ca6b1396-18c4-4d70-965a-54bc6d363a56`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:20:10,259::task::595::TaskManager.Task::(_updateState) Task=`ca6b1396-18c4-4d70-965a-54bc6d363a56`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 09:20:10,259::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 09:20:10,259::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 09:20:10,260::task::990::TaskManager.Task::(_decref) Task=`ca6b1396-18c4-4d70-965a-54bc6d363a56`::ref 0 aborting False >Thread-34::DEBUG::2014-07-10 09:20:10,264::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-34::DEBUG::2014-07-10 09:20:10,264::task::595::TaskManager.Task::(_updateState) Task=`da51c851-5a63-4f65-8bd8-e62aca915f36`::moving from state init -> state preparing >Thread-34::INFO::2014-07-10 09:20:10,265::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-34::DEBUG::2014-07-10 09:20:10,265::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`3435d4d8-8c14-4243-89c5-529cfb4163d4`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-10 09:20:10,266::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' for lock type 'shared' >Thread-34::DEBUG::2014-07-10 09:20:10,266::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-10 09:20:10,266::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`3435d4d8-8c14-4243-89c5-529cfb4163d4`::Granted request >Thread-34::DEBUG::2014-07-10 09:20:10,267::task::827::TaskManager.Task::(resourceAcquired) Task=`da51c851-5a63-4f65-8bd8-e62aca915f36`::_resourcesAcquired: Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee (shared) >Thread-34::DEBUG::2014-07-10 09:20:10,267::task::990::TaskManager.Task::(_decref) Task=`da51c851-5a63-4f65-8bd8-e62aca915f36`::ref 1 aborting False >Thread-34::INFO::2014-07-10 09:20:10,268::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532067385344', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:20:10,268::task::1185::TaskManager.Task::(prepare) Task=`da51c851-5a63-4f65-8bd8-e62aca915f36`::finished: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532067385344', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:20:10,268::task::595::TaskManager.Task::(_updateState) Task=`da51c851-5a63-4f65-8bd8-e62aca915f36`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-10 09:20:10,268::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee': < ResourceRef 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-10 09:20:10,269::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-10 09:20:10,269::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' >Thread-34::DEBUG::2014-07-10 09:20:10,269::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' (0 active users) >Thread-34::DEBUG::2014-07-10 09:20:10,269::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-10 09:20:10,270::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', Clearing records. >Thread-34::DEBUG::2014-07-10 09:20:10,270::task::990::TaskManager.Task::(_decref) Task=`da51c851-5a63-4f65-8bd8-e62aca915f36`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 09:20:11,224::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:20:11,318::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0321042 s, 31.9 MB/s\n'; <rc> = 0 >Thread-40::DEBUG::2014-07-10 09:20:12,748::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lion.qa.lab.tlv.redhat.com:_export_yuri2_backup2/6a70504d-00df-4869-8695-0f442053f6b6/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-40::DEBUG::2014-07-10 09:20:12,769::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n369 bytes (369 B) copied, 0.000500938 s, 737 kB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:20:13,333::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:20:13,427::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0296432 s, 34.5 MB/s\n'; <rc> = 0 >Thread-57::DEBUG::2014-07-10 09:20:13,977::task::595::TaskManager.Task::(_updateState) Task=`318d5eec-93e7-4f1a-b722-dcd2dc6789d5`::moving from state init -> state preparing >Thread-57::INFO::2014-07-10 09:20:13,978::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='b6f6c0da-e67f-4902-b9ac-3069571a42fe', volUUID='c4cd1da8-05b7-45e0-80b1-1183d21443d9', options=None) >Thread-57::INFO::2014-07-10 09:20:13,978::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-57::DEBUG::2014-07-10 09:20:13,978::task::1185::TaskManager.Task::(prepare) Task=`318d5eec-93e7-4f1a-b722-dcd2dc6789d5`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-57::DEBUG::2014-07-10 09:20:13,978::task::595::TaskManager.Task::(_updateState) Task=`318d5eec-93e7-4f1a-b722-dcd2dc6789d5`::moving from state preparing -> state finished >Thread-57::DEBUG::2014-07-10 09:20:13,979::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-57::DEBUG::2014-07-10 09:20:13,979::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-57::DEBUG::2014-07-10 09:20:13,979::task::990::TaskManager.Task::(_decref) Task=`318d5eec-93e7-4f1a-b722-dcd2dc6789d5`::ref 0 aborting False >Thread-67::DEBUG::2014-07-10 09:20:14,891::task::595::TaskManager.Task::(_updateState) Task=`c2745c20-9e33-42fc-b1ac-beebbc2efba6`::moving from state init -> state preparing >Thread-67::INFO::2014-07-10 09:20:14,891::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='f30c2cb7-a43a-4bf5-82b5-cfe07336f65c', volUUID='b0fbb3c9-55af-4a3a-95ad-fc56a80b9cf5', options=None) >Thread-67::INFO::2014-07-10 09:20:14,892::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-67::DEBUG::2014-07-10 09:20:14,892::task::1185::TaskManager.Task::(prepare) Task=`c2745c20-9e33-42fc-b1ac-beebbc2efba6`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-67::DEBUG::2014-07-10 09:20:14,892::task::595::TaskManager.Task::(_updateState) Task=`c2745c20-9e33-42fc-b1ac-beebbc2efba6`::moving from state preparing -> state finished >Thread-67::DEBUG::2014-07-10 09:20:14,892::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-67::DEBUG::2014-07-10 09:20:14,893::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-67::DEBUG::2014-07-10 09:20:14,893::task::990::TaskManager.Task::(_decref) Task=`c2745c20-9e33-42fc-b1ac-beebbc2efba6`::ref 0 aborting False >Thread-48::DEBUG::2014-07-10 09:20:15,320::task::595::TaskManager.Task::(_updateState) Task=`d40095e5-a78e-408e-b45c-35a1413b7bc0`::moving from state init -> state preparing >Thread-48::INFO::2014-07-10 09:20:15,321::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='0cd7d6ce-f497-4243-a690-c57744861eea', volUUID='10b6a7dd-dc6c-43fa-ba17-92e4331b0e0b', options=None) >Thread-48::INFO::2014-07-10 09:20:15,321::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-48::DEBUG::2014-07-10 09:20:15,322::task::1185::TaskManager.Task::(prepare) Task=`d40095e5-a78e-408e-b45c-35a1413b7bc0`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-48::DEBUG::2014-07-10 09:20:15,322::task::595::TaskManager.Task::(_updateState) Task=`d40095e5-a78e-408e-b45c-35a1413b7bc0`::moving from state preparing -> state finished >Thread-48::DEBUG::2014-07-10 09:20:15,322::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-48::DEBUG::2014-07-10 09:20:15,322::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-48::DEBUG::2014-07-10 09:20:15,322::task::990::TaskManager.Task::(_decref) Task=`d40095e5-a78e-408e-b45c-35a1413b7bc0`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 09:20:15,443::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:20:15,536::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0348999 s, 29.3 MB/s\n'; <rc> = 0 >Thread-76::DEBUG::2014-07-10 09:20:16,668::task::595::TaskManager.Task::(_updateState) Task=`9b4a885f-9a45-4592-a64c-6d0093393313`::moving from state init -> state preparing >Thread-76::INFO::2014-07-10 09:20:16,669::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='e4c65229-4247-4b33-b72a-f1d5ce72ad05', volUUID='cad94284-3ca9-4c30-933d-997f4460309e', options=None) >Thread-76::INFO::2014-07-10 09:20:16,670::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-76::DEBUG::2014-07-10 09:20:16,670::task::1185::TaskManager.Task::(prepare) Task=`9b4a885f-9a45-4592-a64c-6d0093393313`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-76::DEBUG::2014-07-10 09:20:16,670::task::595::TaskManager.Task::(_updateState) Task=`9b4a885f-9a45-4592-a64c-6d0093393313`::moving from state preparing -> state finished >Thread-76::DEBUG::2014-07-10 09:20:16,670::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-76::DEBUG::2014-07-10 09:20:16,670::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-76::DEBUG::2014-07-10 09:20:16,670::task::990::TaskManager.Task::(_decref) Task=`9b4a885f-9a45-4592-a64c-6d0093393313`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 09:20:17,552::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:20:17,643::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0340605 s, 30.1 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 09:20:18,651::task::595::TaskManager.Task::(_updateState) Task=`0e871e24-5307-4351-af0f-7a0b68ec5704`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 09:20:18,652::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::INFO::2014-07-10 09:20:18,652::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000603607', 'lastCheck': '8.5', 'valid': True}, '6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000500938', 'lastCheck': '5.9', 'valid': True}} >Thread-14::DEBUG::2014-07-10 09:20:18,652::task::1185::TaskManager.Task::(prepare) Task=`0e871e24-5307-4351-af0f-7a0b68ec5704`::finished: {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000603607', 'lastCheck': '8.5', 'valid': True}, '6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000500938', 'lastCheck': '5.9', 'valid': True}} >Thread-14::DEBUG::2014-07-10 09:20:18,653::task::595::TaskManager.Task::(_updateState) Task=`0e871e24-5307-4351-af0f-7a0b68ec5704`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 09:20:18,653::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 09:20:18,653::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 09:20:18,653::task::990::TaskManager.Task::(_decref) Task=`0e871e24-5307-4351-af0f-7a0b68ec5704`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 09:20:19,658::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:20:19,752::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0356012 s, 28.8 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-10 09:20:20,125::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/metadata bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-10 09:20:20,147::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000681192 s, 6.0 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 09:20:20,299::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-14::DEBUG::2014-07-10 09:20:20,301::task::595::TaskManager.Task::(_updateState) Task=`efbfaf09-f6ba-433f-8a39-cce45b2b8aa7`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 09:20:20,301::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-14::INFO::2014-07-10 09:20:20,302::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:20:20,302::task::1185::TaskManager.Task::(prepare) Task=`efbfaf09-f6ba-433f-8a39-cce45b2b8aa7`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:20:20,302::task::595::TaskManager.Task::(_updateState) Task=`efbfaf09-f6ba-433f-8a39-cce45b2b8aa7`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 09:20:20,302::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 09:20:20,302::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 09:20:20,303::task::990::TaskManager.Task::(_decref) Task=`efbfaf09-f6ba-433f-8a39-cce45b2b8aa7`::ref 0 aborting False >Thread-34::DEBUG::2014-07-10 09:20:20,347::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-34::DEBUG::2014-07-10 09:20:20,347::task::595::TaskManager.Task::(_updateState) Task=`e77ef22c-7c47-4d2f-8d84-d950dbb1f87d`::moving from state init -> state preparing >Thread-34::INFO::2014-07-10 09:20:20,347::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-34::DEBUG::2014-07-10 09:20:20,348::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`461fd92d-2fae-4fec-8a8d-401a290a56cb`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-10 09:20:20,348::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' for lock type 'shared' >Thread-34::DEBUG::2014-07-10 09:20:20,349::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-10 09:20:20,349::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`461fd92d-2fae-4fec-8a8d-401a290a56cb`::Granted request >Thread-34::DEBUG::2014-07-10 09:20:20,349::task::827::TaskManager.Task::(resourceAcquired) Task=`e77ef22c-7c47-4d2f-8d84-d950dbb1f87d`::_resourcesAcquired: Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee (shared) >Thread-34::DEBUG::2014-07-10 09:20:20,350::task::990::TaskManager.Task::(_decref) Task=`e77ef22c-7c47-4d2f-8d84-d950dbb1f87d`::ref 1 aborting False >Thread-34::INFO::2014-07-10 09:20:20,351::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532067385344', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:20:20,351::task::1185::TaskManager.Task::(prepare) Task=`e77ef22c-7c47-4d2f-8d84-d950dbb1f87d`::finished: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532067385344', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:20:20,351::task::595::TaskManager.Task::(_updateState) Task=`e77ef22c-7c47-4d2f-8d84-d950dbb1f87d`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-10 09:20:20,351::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee': < ResourceRef 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-10 09:20:20,351::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-10 09:20:20,352::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' >Thread-34::DEBUG::2014-07-10 09:20:20,352::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' (0 active users) >Thread-34::DEBUG::2014-07-10 09:20:20,352::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-10 09:20:20,352::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', Clearing records. >Thread-34::DEBUG::2014-07-10 09:20:20,353::task::990::TaskManager.Task::(_decref) Task=`e77ef22c-7c47-4d2f-8d84-d950dbb1f87d`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 09:20:21,767::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:20:21,894::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0731812 s, 14.0 MB/s\n'; <rc> = 0 >Thread-40::DEBUG::2014-07-10 09:20:22,808::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lion.qa.lab.tlv.redhat.com:_export_yuri2_backup2/6a70504d-00df-4869-8695-0f442053f6b6/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-40::DEBUG::2014-07-10 09:20:22,829::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n369 bytes (369 B) copied, 0.000530918 s, 695 kB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:20:23,904::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:20:24,012::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.035709 s, 28.7 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:20:26,028::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:20:26,129::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0407206 s, 25.1 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:20:28,147::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:20:28,235::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0293999 s, 34.8 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-10 09:20:30,176::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/metadata bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-10 09:20:30,198::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000901178 s, 4.5 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:20:30,250::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:20:30,380::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0403439 s, 25.4 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 09:20:30,386::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-14::DEBUG::2014-07-10 09:20:30,390::task::595::TaskManager.Task::(_updateState) Task=`3a78225b-e01b-427a-9c6d-992f59047c24`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 09:20:30,392::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-14::INFO::2014-07-10 09:20:30,395::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:20:30,397::task::1185::TaskManager.Task::(prepare) Task=`3a78225b-e01b-427a-9c6d-992f59047c24`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:20:30,398::task::595::TaskManager.Task::(_updateState) Task=`3a78225b-e01b-427a-9c6d-992f59047c24`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 09:20:30,399::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 09:20:30,401::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 09:20:30,402::task::990::TaskManager.Task::(_decref) Task=`3a78225b-e01b-427a-9c6d-992f59047c24`::ref 0 aborting False >Thread-34::DEBUG::2014-07-10 09:20:30,412::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-34::DEBUG::2014-07-10 09:20:30,414::task::595::TaskManager.Task::(_updateState) Task=`6976c1a3-9a2f-4f2f-900d-e4816fd6e7a2`::moving from state init -> state preparing >Thread-34::INFO::2014-07-10 09:20:30,416::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-34::DEBUG::2014-07-10 09:20:30,420::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`36445edb-010e-4979-986e-83dd15036c5b`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-10 09:20:30,421::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' for lock type 'shared' >Thread-34::DEBUG::2014-07-10 09:20:30,424::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-10 09:20:30,425::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`36445edb-010e-4979-986e-83dd15036c5b`::Granted request >Thread-34::DEBUG::2014-07-10 09:20:30,429::task::827::TaskManager.Task::(resourceAcquired) Task=`6976c1a3-9a2f-4f2f-900d-e4816fd6e7a2`::_resourcesAcquired: Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee (shared) >Thread-34::DEBUG::2014-07-10 09:20:30,436::task::990::TaskManager.Task::(_decref) Task=`6976c1a3-9a2f-4f2f-900d-e4816fd6e7a2`::ref 1 aborting False >Thread-34::INFO::2014-07-10 09:20:30,457::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532067385344', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:20:30,461::task::1185::TaskManager.Task::(prepare) Task=`6976c1a3-9a2f-4f2f-900d-e4816fd6e7a2`::finished: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532067385344', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:20:30,463::task::595::TaskManager.Task::(_updateState) Task=`6976c1a3-9a2f-4f2f-900d-e4816fd6e7a2`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-10 09:20:30,464::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee': < ResourceRef 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-10 09:20:30,465::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-10 09:20:30,468::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' >Thread-34::DEBUG::2014-07-10 09:20:30,470::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' (0 active users) >Thread-34::DEBUG::2014-07-10 09:20:30,471::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-10 09:20:30,472::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', Clearing records. >Thread-34::DEBUG::2014-07-10 09:20:30,474::task::990::TaskManager.Task::(_decref) Task=`6976c1a3-9a2f-4f2f-900d-e4816fd6e7a2`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 09:20:32,510::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:20:32,619::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0519501 s, 19.7 MB/s\n'; <rc> = 0 >Thread-40::DEBUG::2014-07-10 09:20:32,861::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lion.qa.lab.tlv.redhat.com:_export_yuri2_backup2/6a70504d-00df-4869-8695-0f442053f6b6/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-40::DEBUG::2014-07-10 09:20:32,883::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n369 bytes (369 B) copied, 0.000478158 s, 772 kB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 09:20:33,848::task::595::TaskManager.Task::(_updateState) Task=`ec57c9ec-a095-47b8-a97b-00eba71ad40b`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 09:20:33,849::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::INFO::2014-07-10 09:20:33,849::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000901178', 'lastCheck': '3.6', 'valid': True}, '6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000478158', 'lastCheck': '1.0', 'valid': True}} >Thread-14::DEBUG::2014-07-10 09:20:33,849::task::1185::TaskManager.Task::(prepare) Task=`ec57c9ec-a095-47b8-a97b-00eba71ad40b`::finished: {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000901178', 'lastCheck': '3.6', 'valid': True}, '6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000478158', 'lastCheck': '1.0', 'valid': True}} >Thread-14::DEBUG::2014-07-10 09:20:33,850::task::595::TaskManager.Task::(_updateState) Task=`ec57c9ec-a095-47b8-a97b-00eba71ad40b`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 09:20:33,850::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 09:20:33,850::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 09:20:33,850::task::990::TaskManager.Task::(_decref) Task=`ec57c9ec-a095-47b8-a97b-00eba71ad40b`::ref 0 aborting False >Thread-70::DEBUG::2014-07-10 09:20:34,081::task::595::TaskManager.Task::(_updateState) Task=`16bcaf9b-1618-4b7e-adcb-6ee0f3fef26a`::moving from state init -> state preparing >Thread-70::INFO::2014-07-10 09:20:34,081::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='cfaeead2-7caa-467c-b389-c89840ae6605', volUUID='567fe32d-31a6-4ff6-90f3-fd6a656fbecc', options=None) >Thread-70::INFO::2014-07-10 09:20:34,082::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-70::DEBUG::2014-07-10 09:20:34,082::task::1185::TaskManager.Task::(prepare) Task=`16bcaf9b-1618-4b7e-adcb-6ee0f3fef26a`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-70::DEBUG::2014-07-10 09:20:34,082::task::595::TaskManager.Task::(_updateState) Task=`16bcaf9b-1618-4b7e-adcb-6ee0f3fef26a`::moving from state preparing -> state finished >Thread-70::DEBUG::2014-07-10 09:20:34,082::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-70::DEBUG::2014-07-10 09:20:34,082::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-70::DEBUG::2014-07-10 09:20:34,083::task::990::TaskManager.Task::(_decref) Task=`16bcaf9b-1618-4b7e-adcb-6ee0f3fef26a`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 09:20:34,634::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:20:34,730::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0369898 s, 27.7 MB/s\n'; <rc> = 0 >Thread-60::DEBUG::2014-07-10 09:20:34,955::task::595::TaskManager.Task::(_updateState) Task=`6847f95a-95eb-4d9a-ab0c-db9492969563`::moving from state init -> state preparing >Thread-60::INFO::2014-07-10 09:20:34,955::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='b034d5b0-e1e0-4011-b49b-4d45ddb11556', volUUID='3d7f62b5-328f-4d8e-8b69-873cfb5ae14d', options=None) >Thread-60::INFO::2014-07-10 09:20:34,955::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-60::DEBUG::2014-07-10 09:20:34,956::task::1185::TaskManager.Task::(prepare) Task=`6847f95a-95eb-4d9a-ab0c-db9492969563`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-60::DEBUG::2014-07-10 09:20:34,956::task::595::TaskManager.Task::(_updateState) Task=`6847f95a-95eb-4d9a-ab0c-db9492969563`::moving from state preparing -> state finished >Thread-60::DEBUG::2014-07-10 09:20:34,956::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-60::DEBUG::2014-07-10 09:20:34,956::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-60::DEBUG::2014-07-10 09:20:34,956::task::990::TaskManager.Task::(_decref) Task=`6847f95a-95eb-4d9a-ab0c-db9492969563`::ref 0 aborting False >Thread-51::DEBUG::2014-07-10 09:20:35,128::task::595::TaskManager.Task::(_updateState) Task=`7c35304d-a85b-4304-b012-18f94c8eed95`::moving from state init -> state preparing >Thread-51::INFO::2014-07-10 09:20:35,129::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='76fdb054-02cd-42ed-9721-b3e65b34c3a4', volUUID='022dfe46-2cf7-4915-80b3-883158e3ca83', options=None) >Thread-51::INFO::2014-07-10 09:20:35,129::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-51::DEBUG::2014-07-10 09:20:35,130::task::1185::TaskManager.Task::(prepare) Task=`7c35304d-a85b-4304-b012-18f94c8eed95`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-51::DEBUG::2014-07-10 09:20:35,130::task::595::TaskManager.Task::(_updateState) Task=`7c35304d-a85b-4304-b012-18f94c8eed95`::moving from state preparing -> state finished >Thread-51::DEBUG::2014-07-10 09:20:35,130::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-51::DEBUG::2014-07-10 09:20:35,130::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-51::DEBUG::2014-07-10 09:20:35,130::task::990::TaskManager.Task::(_decref) Task=`7c35304d-a85b-4304-b012-18f94c8eed95`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 09:20:36,745::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:20:36,842::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0348305 s, 29.4 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:20:38,857::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:20:38,943::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0293501 s, 34.9 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-10 09:20:40,227::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/metadata bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-10 09:20:40,249::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000748686 s, 5.5 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 09:20:40,516::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-14::DEBUG::2014-07-10 09:20:40,517::task::595::TaskManager.Task::(_updateState) Task=`0a054ce1-3309-405b-898f-1aa7538574b4`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 09:20:40,517::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-14::INFO::2014-07-10 09:20:40,518::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:20:40,518::task::1185::TaskManager.Task::(prepare) Task=`0a054ce1-3309-405b-898f-1aa7538574b4`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:20:40,518::task::595::TaskManager.Task::(_updateState) Task=`0a054ce1-3309-405b-898f-1aa7538574b4`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 09:20:40,518::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 09:20:40,518::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 09:20:40,519::task::990::TaskManager.Task::(_decref) Task=`0a054ce1-3309-405b-898f-1aa7538574b4`::ref 0 aborting False >Thread-34::DEBUG::2014-07-10 09:20:40,523::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-34::DEBUG::2014-07-10 09:20:40,523::task::595::TaskManager.Task::(_updateState) Task=`59add761-ce18-421b-b353-6523e2036e03`::moving from state init -> state preparing >Thread-34::INFO::2014-07-10 09:20:40,524::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-34::DEBUG::2014-07-10 09:20:40,524::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`5789e7fc-6c39-404b-af46-2684765edacf`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-10 09:20:40,525::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' for lock type 'shared' >Thread-34::DEBUG::2014-07-10 09:20:40,525::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-10 09:20:40,525::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`5789e7fc-6c39-404b-af46-2684765edacf`::Granted request >Thread-34::DEBUG::2014-07-10 09:20:40,526::task::827::TaskManager.Task::(resourceAcquired) Task=`59add761-ce18-421b-b353-6523e2036e03`::_resourcesAcquired: Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee (shared) >Thread-34::DEBUG::2014-07-10 09:20:40,526::task::990::TaskManager.Task::(_decref) Task=`59add761-ce18-421b-b353-6523e2036e03`::ref 1 aborting False >Thread-34::INFO::2014-07-10 09:20:40,527::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532067385344', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:20:40,527::task::1185::TaskManager.Task::(prepare) Task=`59add761-ce18-421b-b353-6523e2036e03`::finished: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532067385344', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:20:40,527::task::595::TaskManager.Task::(_updateState) Task=`59add761-ce18-421b-b353-6523e2036e03`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-10 09:20:40,528::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee': < ResourceRef 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-10 09:20:40,528::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-10 09:20:40,528::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' >Thread-34::DEBUG::2014-07-10 09:20:40,528::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' (0 active users) >Thread-34::DEBUG::2014-07-10 09:20:40,528::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-10 09:20:40,529::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', Clearing records. >Thread-34::DEBUG::2014-07-10 09:20:40,529::task::990::TaskManager.Task::(_decref) Task=`59add761-ce18-421b-b353-6523e2036e03`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 09:20:40,958::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:20:41,060::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.036296 s, 28.2 MB/s\n'; <rc> = 0 >Thread-40::DEBUG::2014-07-10 09:20:42,912::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lion.qa.lab.tlv.redhat.com:_export_yuri2_backup2/6a70504d-00df-4869-8695-0f442053f6b6/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-40::DEBUG::2014-07-10 09:20:42,934::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n369 bytes (369 B) copied, 0.000677812 s, 544 kB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:20:43,075::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:20:43,198::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0586133 s, 17.5 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:20:45,214::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:20:45,334::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0490087 s, 20.9 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:20:47,357::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:20:47,448::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.033468 s, 30.6 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 09:20:49,058::task::595::TaskManager.Task::(_updateState) Task=`b8d38624-fd1d-424b-9635-0edaa97db263`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 09:20:49,059::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::INFO::2014-07-10 09:20:49,059::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000748686', 'lastCheck': '8.8', 'valid': True}, '6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000677812', 'lastCheck': '6.1', 'valid': True}} >Thread-14::DEBUG::2014-07-10 09:20:49,059::task::1185::TaskManager.Task::(prepare) Task=`b8d38624-fd1d-424b-9635-0edaa97db263`::finished: {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000748686', 'lastCheck': '8.8', 'valid': True}, '6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000677812', 'lastCheck': '6.1', 'valid': True}} >Thread-14::DEBUG::2014-07-10 09:20:49,060::task::595::TaskManager.Task::(_updateState) Task=`b8d38624-fd1d-424b-9635-0edaa97db263`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 09:20:49,060::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 09:20:49,060::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 09:20:49,060::task::990::TaskManager.Task::(_decref) Task=`b8d38624-fd1d-424b-9635-0edaa97db263`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 09:20:49,463::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:20:49,558::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0296771 s, 34.5 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-10 09:20:50,283::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/metadata bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-10 09:20:50,305::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00083152 s, 4.9 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 09:20:50,558::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-14::DEBUG::2014-07-10 09:20:50,559::task::595::TaskManager.Task::(_updateState) Task=`65647a7d-c680-488b-8ff5-3dd0acf5b248`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 09:20:50,560::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-14::INFO::2014-07-10 09:20:50,560::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:20:50,560::task::1185::TaskManager.Task::(prepare) Task=`65647a7d-c680-488b-8ff5-3dd0acf5b248`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:20:50,561::task::595::TaskManager.Task::(_updateState) Task=`65647a7d-c680-488b-8ff5-3dd0acf5b248`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 09:20:50,561::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 09:20:50,561::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 09:20:50,561::task::990::TaskManager.Task::(_decref) Task=`65647a7d-c680-488b-8ff5-3dd0acf5b248`::ref 0 aborting False >Thread-34::DEBUG::2014-07-10 09:20:50,605::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-34::DEBUG::2014-07-10 09:20:50,606::task::595::TaskManager.Task::(_updateState) Task=`ae14d01c-c27e-4bd9-8616-d48052fcc216`::moving from state init -> state preparing >Thread-34::INFO::2014-07-10 09:20:50,606::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-34::DEBUG::2014-07-10 09:20:50,607::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`48ae696a-d3a9-43c6-be38-e5548698bcb1`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-10 09:20:50,607::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' for lock type 'shared' >Thread-34::DEBUG::2014-07-10 09:20:50,607::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-10 09:20:50,607::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`48ae696a-d3a9-43c6-be38-e5548698bcb1`::Granted request >Thread-34::DEBUG::2014-07-10 09:20:50,608::task::827::TaskManager.Task::(resourceAcquired) Task=`ae14d01c-c27e-4bd9-8616-d48052fcc216`::_resourcesAcquired: Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee (shared) >Thread-34::DEBUG::2014-07-10 09:20:50,608::task::990::TaskManager.Task::(_decref) Task=`ae14d01c-c27e-4bd9-8616-d48052fcc216`::ref 1 aborting False >Thread-34::INFO::2014-07-10 09:20:50,609::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532067385344', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:20:50,610::task::1185::TaskManager.Task::(prepare) Task=`ae14d01c-c27e-4bd9-8616-d48052fcc216`::finished: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532067385344', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:20:50,610::task::595::TaskManager.Task::(_updateState) Task=`ae14d01c-c27e-4bd9-8616-d48052fcc216`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-10 09:20:50,610::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee': < ResourceRef 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-10 09:20:50,610::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-10 09:20:50,610::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' >Thread-34::DEBUG::2014-07-10 09:20:50,611::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' (0 active users) >Thread-34::DEBUG::2014-07-10 09:20:50,611::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-10 09:20:50,611::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', Clearing records. >Thread-34::DEBUG::2014-07-10 09:20:50,611::task::990::TaskManager.Task::(_decref) Task=`ae14d01c-c27e-4bd9-8616-d48052fcc216`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 09:20:51,574::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:20:51,680::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0467542 s, 21.9 MB/s\n'; <rc> = 0 >Thread-40::DEBUG::2014-07-10 09:20:52,960::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lion.qa.lab.tlv.redhat.com:_export_yuri2_backup2/6a70504d-00df-4869-8695-0f442053f6b6/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-40::DEBUG::2014-07-10 09:20:52,981::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n369 bytes (369 B) copied, 0.000452391 s, 816 kB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:20:53,695::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:20:53,787::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0340476 s, 30.1 MB/s\n'; <rc> = 0 >Thread-64::DEBUG::2014-07-10 09:20:54,154::task::595::TaskManager.Task::(_updateState) Task=`d05d6896-c9c0-4853-a51f-0adc673b15bf`::moving from state init -> state preparing >Thread-64::INFO::2014-07-10 09:20:54,154::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='aa20346a-4d3a-4e07-b8e1-52c0ebe4168c', volUUID='58fefce2-9bce-4bff-8949-8c6ce8122b27', options=None) >Thread-64::INFO::2014-07-10 09:20:54,155::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-64::DEBUG::2014-07-10 09:20:54,155::task::1185::TaskManager.Task::(prepare) Task=`d05d6896-c9c0-4853-a51f-0adc673b15bf`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-64::DEBUG::2014-07-10 09:20:54,155::task::595::TaskManager.Task::(_updateState) Task=`d05d6896-c9c0-4853-a51f-0adc673b15bf`::moving from state preparing -> state finished >Thread-64::DEBUG::2014-07-10 09:20:54,156::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-64::DEBUG::2014-07-10 09:20:54,156::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-64::DEBUG::2014-07-10 09:20:54,156::task::990::TaskManager.Task::(_decref) Task=`d05d6896-c9c0-4853-a51f-0adc673b15bf`::ref 0 aborting False >Thread-54::DEBUG::2014-07-10 09:20:55,544::task::595::TaskManager.Task::(_updateState) Task=`d3f5a237-5475-475f-891a-fd0902a5945e`::moving from state init -> state preparing >Thread-54::INFO::2014-07-10 09:20:55,548::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='28408446-e5fd-4565-a976-e760951593fe', volUUID='776303a2-5585-451e-826e-0e338d4a1e98', options=None) >Thread-73::DEBUG::2014-07-10 09:20:55,554::task::595::TaskManager.Task::(_updateState) Task=`a5a77683-98b4-44d9-acb1-a0c6c1d5e807`::moving from state init -> state preparing >Thread-54::INFO::2014-07-10 09:20:55,557::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-73::INFO::2014-07-10 09:20:55,562::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='c01d693b-cba0-4fed-9ad7-0aaa28912a19', volUUID='4bb5d954-2a50-4028-b299-0b43c261270c', options=None) >Thread-54::DEBUG::2014-07-10 09:20:55,562::task::1185::TaskManager.Task::(prepare) Task=`d3f5a237-5475-475f-891a-fd0902a5945e`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-54::DEBUG::2014-07-10 09:20:55,568::task::595::TaskManager.Task::(_updateState) Task=`d3f5a237-5475-475f-891a-fd0902a5945e`::moving from state preparing -> state finished >Thread-73::INFO::2014-07-10 09:20:55,570::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-54::DEBUG::2014-07-10 09:20:55,574::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-73::DEBUG::2014-07-10 09:20:55,577::task::1185::TaskManager.Task::(prepare) Task=`a5a77683-98b4-44d9-acb1-a0c6c1d5e807`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-54::DEBUG::2014-07-10 09:20:55,580::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-73::DEBUG::2014-07-10 09:20:55,581::task::595::TaskManager.Task::(_updateState) Task=`a5a77683-98b4-44d9-acb1-a0c6c1d5e807`::moving from state preparing -> state finished >Thread-54::DEBUG::2014-07-10 09:20:55,582::task::990::TaskManager.Task::(_decref) Task=`d3f5a237-5475-475f-891a-fd0902a5945e`::ref 0 aborting False >Thread-73::DEBUG::2014-07-10 09:20:55,584::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-73::DEBUG::2014-07-10 09:20:55,586::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-73::DEBUG::2014-07-10 09:20:55,586::task::990::TaskManager.Task::(_decref) Task=`a5a77683-98b4-44d9-acb1-a0c6c1d5e807`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 09:20:55,804::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:20:55,948::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0846386 s, 12.1 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:20:57,963::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:20:58,056::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0321673 s, 31.8 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:21:00,072::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:21:00,199::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0370086 s, 27.7 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-10 09:21:00,343::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/metadata bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-10 09:21:00,368::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000735215 s, 5.6 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 09:21:00,643::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-14::DEBUG::2014-07-10 09:21:00,644::task::595::TaskManager.Task::(_updateState) Task=`1fcb4c2d-620b-4c79-ac04-f1dbadabee91`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 09:21:00,644::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-14::INFO::2014-07-10 09:21:00,645::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:21:00,645::task::1185::TaskManager.Task::(prepare) Task=`1fcb4c2d-620b-4c79-ac04-f1dbadabee91`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:21:00,646::task::595::TaskManager.Task::(_updateState) Task=`1fcb4c2d-620b-4c79-ac04-f1dbadabee91`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 09:21:00,646::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 09:21:00,646::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 09:21:00,646::task::990::TaskManager.Task::(_decref) Task=`1fcb4c2d-620b-4c79-ac04-f1dbadabee91`::ref 0 aborting False >Thread-34::DEBUG::2014-07-10 09:21:00,650::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-34::DEBUG::2014-07-10 09:21:00,651::task::595::TaskManager.Task::(_updateState) Task=`45502172-2225-4b61-a2cc-e8896dbeea66`::moving from state init -> state preparing >Thread-34::INFO::2014-07-10 09:21:00,651::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-34::DEBUG::2014-07-10 09:21:00,652::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`784f66c6-f538-414d-8486-b4b6bea080f6`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-10 09:21:00,652::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' for lock type 'shared' >Thread-34::DEBUG::2014-07-10 09:21:00,652::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-10 09:21:00,652::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`784f66c6-f538-414d-8486-b4b6bea080f6`::Granted request >Thread-34::DEBUG::2014-07-10 09:21:00,653::task::827::TaskManager.Task::(resourceAcquired) Task=`45502172-2225-4b61-a2cc-e8896dbeea66`::_resourcesAcquired: Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee (shared) >Thread-34::DEBUG::2014-07-10 09:21:00,653::task::990::TaskManager.Task::(_decref) Task=`45502172-2225-4b61-a2cc-e8896dbeea66`::ref 1 aborting False >Thread-34::INFO::2014-07-10 09:21:00,654::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532067385344', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:21:00,655::task::1185::TaskManager.Task::(prepare) Task=`45502172-2225-4b61-a2cc-e8896dbeea66`::finished: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532067385344', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:21:00,655::task::595::TaskManager.Task::(_updateState) Task=`45502172-2225-4b61-a2cc-e8896dbeea66`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-10 09:21:00,655::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee': < ResourceRef 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-10 09:21:00,655::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-10 09:21:00,655::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' >Thread-34::DEBUG::2014-07-10 09:21:00,656::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' (0 active users) >Thread-34::DEBUG::2014-07-10 09:21:00,656::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-10 09:21:00,656::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', Clearing records. >Thread-34::DEBUG::2014-07-10 09:21:00,656::task::990::TaskManager.Task::(_decref) Task=`45502172-2225-4b61-a2cc-e8896dbeea66`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 09:21:02,214::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:21:02,359::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0292793 s, 35.0 MB/s\n'; <rc> = 0 >Thread-40::DEBUG::2014-07-10 09:21:03,014::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lion.qa.lab.tlv.redhat.com:_export_yuri2_backup2/6a70504d-00df-4869-8695-0f442053f6b6/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-40::DEBUG::2014-07-10 09:21:03,035::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n369 bytes (369 B) copied, 0.00043779 s, 843 kB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 09:21:04,232::task::595::TaskManager.Task::(_updateState) Task=`7df64781-1ba1-4a16-99cb-cf9a66874459`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 09:21:04,233::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::INFO::2014-07-10 09:21:04,233::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000735215', 'lastCheck': '3.8', 'valid': True}, '6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00043779', 'lastCheck': '1.2', 'valid': True}} >Thread-14::DEBUG::2014-07-10 09:21:04,233::task::1185::TaskManager.Task::(prepare) Task=`7df64781-1ba1-4a16-99cb-cf9a66874459`::finished: {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000735215', 'lastCheck': '3.8', 'valid': True}, '6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00043779', 'lastCheck': '1.2', 'valid': True}} >Thread-14::DEBUG::2014-07-10 09:21:04,233::task::595::TaskManager.Task::(_updateState) Task=`7df64781-1ba1-4a16-99cb-cf9a66874459`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 09:21:04,234::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 09:21:04,234::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 09:21:04,234::task::990::TaskManager.Task::(_decref) Task=`7df64781-1ba1-4a16-99cb-cf9a66874459`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 09:21:04,372::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:21:04,477::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0288488 s, 35.5 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:21:06,493::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:21:06,588::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0341221 s, 30.0 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:21:08,611::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:21:08,701::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0306309 s, 33.4 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-10 09:21:10,435::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/metadata bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-10 09:21:10,454::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000720382 s, 5.7 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 09:21:10,700::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-14::DEBUG::2014-07-10 09:21:10,702::task::595::TaskManager.Task::(_updateState) Task=`bf1a3c02-c2f4-4cf4-b32e-56a956473287`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 09:21:10,702::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-14::INFO::2014-07-10 09:21:10,703::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:21:10,703::task::1185::TaskManager.Task::(prepare) Task=`bf1a3c02-c2f4-4cf4-b32e-56a956473287`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:21:10,703::task::595::TaskManager.Task::(_updateState) Task=`bf1a3c02-c2f4-4cf4-b32e-56a956473287`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 09:21:10,703::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 09:21:10,703::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 09:21:10,704::task::990::TaskManager.Task::(_decref) Task=`bf1a3c02-c2f4-4cf4-b32e-56a956473287`::ref 0 aborting False >Thread-34::DEBUG::2014-07-10 09:21:10,708::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-34::DEBUG::2014-07-10 09:21:10,708::task::595::TaskManager.Task::(_updateState) Task=`65da07de-8302-4212-ae98-ec8d735d73f4`::moving from state init -> state preparing >Thread-34::INFO::2014-07-10 09:21:10,708::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-34::DEBUG::2014-07-10 09:21:10,709::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`edfd6d7b-3abd-442a-bee5-738e742cba66`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-10 09:21:10,709::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' for lock type 'shared' >Thread-34::DEBUG::2014-07-10 09:21:10,710::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-10 09:21:10,710::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`edfd6d7b-3abd-442a-bee5-738e742cba66`::Granted request >Thread-34::DEBUG::2014-07-10 09:21:10,710::task::827::TaskManager.Task::(resourceAcquired) Task=`65da07de-8302-4212-ae98-ec8d735d73f4`::_resourcesAcquired: Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee (shared) >Thread-34::DEBUG::2014-07-10 09:21:10,711::task::990::TaskManager.Task::(_decref) Task=`65da07de-8302-4212-ae98-ec8d735d73f4`::ref 1 aborting False >Thread-34::INFO::2014-07-10 09:21:10,712::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532067385344', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:21:10,712::task::1185::TaskManager.Task::(prepare) Task=`65da07de-8302-4212-ae98-ec8d735d73f4`::finished: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532067385344', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:21:10,712::task::595::TaskManager.Task::(_updateState) Task=`65da07de-8302-4212-ae98-ec8d735d73f4`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-10 09:21:10,712::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee': < ResourceRef 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-10 09:21:10,713::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-10 09:21:10,713::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' >Thread-34::DEBUG::2014-07-10 09:21:10,713::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' (0 active users) >Thread-34::DEBUG::2014-07-10 09:21:10,713::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-10 09:21:10,713::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', Clearing records. >Thread-34::DEBUG::2014-07-10 09:21:10,714::task::990::TaskManager.Task::(_decref) Task=`65da07de-8302-4212-ae98-ec8d735d73f4`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 09:21:10,718::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:21:10,827::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0503525 s, 20.3 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:21:12,845::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:21:12,938::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0350397 s, 29.2 MB/s\n'; <rc> = 0 >Thread-40::DEBUG::2014-07-10 09:21:13,061::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lion.qa.lab.tlv.redhat.com:_export_yuri2_backup2/6a70504d-00df-4869-8695-0f442053f6b6/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-40::DEBUG::2014-07-10 09:21:13,083::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n369 bytes (369 B) copied, 0.0004531 s, 814 kB/s\n'; <rc> = 0 >Thread-57::DEBUG::2014-07-10 09:21:14,274::task::595::TaskManager.Task::(_updateState) Task=`ef648e30-0b30-43f5-9471-64986c49866a`::moving from state init -> state preparing >Thread-57::INFO::2014-07-10 09:21:14,275::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='b6f6c0da-e67f-4902-b9ac-3069571a42fe', volUUID='c4cd1da8-05b7-45e0-80b1-1183d21443d9', options=None) >Thread-57::INFO::2014-07-10 09:21:14,275::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-57::DEBUG::2014-07-10 09:21:14,275::task::1185::TaskManager.Task::(prepare) Task=`ef648e30-0b30-43f5-9471-64986c49866a`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-57::DEBUG::2014-07-10 09:21:14,276::task::595::TaskManager.Task::(_updateState) Task=`ef648e30-0b30-43f5-9471-64986c49866a`::moving from state preparing -> state finished >Thread-57::DEBUG::2014-07-10 09:21:14,276::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-57::DEBUG::2014-07-10 09:21:14,276::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-57::DEBUG::2014-07-10 09:21:14,276::task::990::TaskManager.Task::(_decref) Task=`ef648e30-0b30-43f5-9471-64986c49866a`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 09:21:14,948::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:21:15,041::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0343016 s, 29.9 MB/s\n'; <rc> = 0 >Thread-67::DEBUG::2014-07-10 09:21:15,182::task::595::TaskManager.Task::(_updateState) Task=`75decb0c-9255-4c08-9817-62affa3b9827`::moving from state init -> state preparing >Thread-67::INFO::2014-07-10 09:21:15,185::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='f30c2cb7-a43a-4bf5-82b5-cfe07336f65c', volUUID='b0fbb3c9-55af-4a3a-95ad-fc56a80b9cf5', options=None) >Thread-67::INFO::2014-07-10 09:21:15,189::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-67::DEBUG::2014-07-10 09:21:15,191::task::1185::TaskManager.Task::(prepare) Task=`75decb0c-9255-4c08-9817-62affa3b9827`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-67::DEBUG::2014-07-10 09:21:15,193::task::595::TaskManager.Task::(_updateState) Task=`75decb0c-9255-4c08-9817-62affa3b9827`::moving from state preparing -> state finished >Thread-67::DEBUG::2014-07-10 09:21:15,196::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-67::DEBUG::2014-07-10 09:21:15,197::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-67::DEBUG::2014-07-10 09:21:15,200::task::990::TaskManager.Task::(_decref) Task=`75decb0c-9255-4c08-9817-62affa3b9827`::ref 0 aborting False >Thread-48::DEBUG::2014-07-10 09:21:15,609::task::595::TaskManager.Task::(_updateState) Task=`5510f8cb-2e46-4600-b837-526d112b2294`::moving from state init -> state preparing >Thread-48::INFO::2014-07-10 09:21:15,609::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='0cd7d6ce-f497-4243-a690-c57744861eea', volUUID='10b6a7dd-dc6c-43fa-ba17-92e4331b0e0b', options=None) >Thread-48::INFO::2014-07-10 09:21:15,610::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-48::DEBUG::2014-07-10 09:21:15,610::task::1185::TaskManager.Task::(prepare) Task=`5510f8cb-2e46-4600-b837-526d112b2294`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-48::DEBUG::2014-07-10 09:21:15,610::task::595::TaskManager.Task::(_updateState) Task=`5510f8cb-2e46-4600-b837-526d112b2294`::moving from state preparing -> state finished >Thread-48::DEBUG::2014-07-10 09:21:15,610::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-48::DEBUG::2014-07-10 09:21:15,611::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-48::DEBUG::2014-07-10 09:21:15,611::task::990::TaskManager.Task::(_decref) Task=`5510f8cb-2e46-4600-b837-526d112b2294`::ref 0 aborting False >Thread-76::DEBUG::2014-07-10 09:21:16,953::task::595::TaskManager.Task::(_updateState) Task=`fdf62ea8-6145-4e99-8d95-3ea4e1d32c59`::moving from state init -> state preparing >Thread-76::INFO::2014-07-10 09:21:16,954::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='e4c65229-4247-4b33-b72a-f1d5ce72ad05', volUUID='cad94284-3ca9-4c30-933d-997f4460309e', options=None) >Thread-76::INFO::2014-07-10 09:21:16,954::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-76::DEBUG::2014-07-10 09:21:16,955::task::1185::TaskManager.Task::(prepare) Task=`fdf62ea8-6145-4e99-8d95-3ea4e1d32c59`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-76::DEBUG::2014-07-10 09:21:16,955::task::595::TaskManager.Task::(_updateState) Task=`fdf62ea8-6145-4e99-8d95-3ea4e1d32c59`::moving from state preparing -> state finished >Thread-76::DEBUG::2014-07-10 09:21:16,955::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-76::DEBUG::2014-07-10 09:21:16,955::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-76::DEBUG::2014-07-10 09:21:16,955::task::990::TaskManager.Task::(_decref) Task=`fdf62ea8-6145-4e99-8d95-3ea4e1d32c59`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 09:21:17,057::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:21:17,156::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0411406 s, 24.9 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:21:19,172::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:21:19,261::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0312043 s, 32.8 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 09:21:19,427::task::595::TaskManager.Task::(_updateState) Task=`13323e51-88db-43b1-90f3-d7f52f19404a`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 09:21:19,428::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::INFO::2014-07-10 09:21:19,428::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000720382', 'lastCheck': '8.9', 'valid': True}, '6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.0004531', 'lastCheck': '6.3', 'valid': True}} >Thread-14::DEBUG::2014-07-10 09:21:19,428::task::1185::TaskManager.Task::(prepare) Task=`13323e51-88db-43b1-90f3-d7f52f19404a`::finished: {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000720382', 'lastCheck': '8.9', 'valid': True}, '6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.0004531', 'lastCheck': '6.3', 'valid': True}} >Thread-14::DEBUG::2014-07-10 09:21:19,429::task::595::TaskManager.Task::(_updateState) Task=`13323e51-88db-43b1-90f3-d7f52f19404a`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 09:21:19,429::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 09:21:19,429::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 09:21:19,429::task::990::TaskManager.Task::(_decref) Task=`13323e51-88db-43b1-90f3-d7f52f19404a`::ref 0 aborting False >Thread-18::DEBUG::2014-07-10 09:21:20,560::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/metadata bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-10 09:21:20,594::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.0114737 s, 357 kB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 09:21:20,797::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-14::DEBUG::2014-07-10 09:21:20,798::task::595::TaskManager.Task::(_updateState) Task=`d83a72d1-7d9e-4988-89af-05c70673e3eb`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 09:21:20,798::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-14::INFO::2014-07-10 09:21:20,798::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:21:20,799::task::1185::TaskManager.Task::(prepare) Task=`d83a72d1-7d9e-4988-89af-05c70673e3eb`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:21:20,799::task::595::TaskManager.Task::(_updateState) Task=`d83a72d1-7d9e-4988-89af-05c70673e3eb`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 09:21:20,799::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 09:21:20,799::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 09:21:20,799::task::990::TaskManager.Task::(_decref) Task=`d83a72d1-7d9e-4988-89af-05c70673e3eb`::ref 0 aborting False >Thread-34::DEBUG::2014-07-10 09:21:20,843::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-34::DEBUG::2014-07-10 09:21:20,843::task::595::TaskManager.Task::(_updateState) Task=`8da3f238-1ee0-4a8a-8186-2b45684b4777`::moving from state init -> state preparing >Thread-34::INFO::2014-07-10 09:21:20,843::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-34::DEBUG::2014-07-10 09:21:20,844::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`0c209577-7f54-4603-ad92-f334cbdd59d1`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-10 09:21:20,844::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' for lock type 'shared' >Thread-34::DEBUG::2014-07-10 09:21:20,845::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-10 09:21:20,845::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`0c209577-7f54-4603-ad92-f334cbdd59d1`::Granted request >Thread-34::DEBUG::2014-07-10 09:21:20,845::task::827::TaskManager.Task::(resourceAcquired) Task=`8da3f238-1ee0-4a8a-8186-2b45684b4777`::_resourcesAcquired: Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee (shared) >Thread-34::DEBUG::2014-07-10 09:21:20,846::task::990::TaskManager.Task::(_decref) Task=`8da3f238-1ee0-4a8a-8186-2b45684b4777`::ref 1 aborting False >Thread-34::INFO::2014-07-10 09:21:20,847::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532067385344', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:21:20,847::task::1185::TaskManager.Task::(prepare) Task=`8da3f238-1ee0-4a8a-8186-2b45684b4777`::finished: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532067385344', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:21:20,847::task::595::TaskManager.Task::(_updateState) Task=`8da3f238-1ee0-4a8a-8186-2b45684b4777`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-10 09:21:20,847::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee': < ResourceRef 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-10 09:21:20,848::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-10 09:21:20,848::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' >Thread-34::DEBUG::2014-07-10 09:21:20,848::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' (0 active users) >Thread-34::DEBUG::2014-07-10 09:21:20,848::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-10 09:21:20,848::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', Clearing records. >Thread-34::DEBUG::2014-07-10 09:21:20,849::task::990::TaskManager.Task::(_decref) Task=`8da3f238-1ee0-4a8a-8186-2b45684b4777`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 09:21:21,281::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:21:21,376::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0339067 s, 30.2 MB/s\n'; <rc> = 0 >Thread-40::DEBUG::2014-07-10 09:21:23,109::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lion.qa.lab.tlv.redhat.com:_export_yuri2_backup2/6a70504d-00df-4869-8695-0f442053f6b6/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-40::DEBUG::2014-07-10 09:21:23,131::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n369 bytes (369 B) copied, 0.000585937 s, 630 kB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:21:23,392::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:21:23,501::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.035567 s, 28.8 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:21:25,515::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:21:25,598::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0268539 s, 38.1 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:21:27,645::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:21:27,740::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0347179 s, 29.5 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:21:29,756::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:21:29,850::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0300009 s, 34.1 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-10 09:21:30,696::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/metadata bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-10 09:21:30,718::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000798563 s, 5.1 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 09:21:30,875::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-14::DEBUG::2014-07-10 09:21:30,876::task::595::TaskManager.Task::(_updateState) Task=`1d270451-cd1f-44a1-8ae2-b1acd66d78e4`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 09:21:30,877::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-14::INFO::2014-07-10 09:21:30,877::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:21:30,877::task::1185::TaskManager.Task::(prepare) Task=`1d270451-cd1f-44a1-8ae2-b1acd66d78e4`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:21:30,878::task::595::TaskManager.Task::(_updateState) Task=`1d270451-cd1f-44a1-8ae2-b1acd66d78e4`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 09:21:30,878::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 09:21:30,878::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 09:21:30,878::task::990::TaskManager.Task::(_decref) Task=`1d270451-cd1f-44a1-8ae2-b1acd66d78e4`::ref 0 aborting False >Thread-34::DEBUG::2014-07-10 09:21:30,888::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-34::DEBUG::2014-07-10 09:21:30,889::task::595::TaskManager.Task::(_updateState) Task=`2c7f84e7-2971-4fc1-81ad-6f42cf0f084a`::moving from state init -> state preparing >Thread-34::INFO::2014-07-10 09:21:30,889::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-34::DEBUG::2014-07-10 09:21:30,890::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`0d62be7a-3ce9-4e55-a536-827b758394b1`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-10 09:21:30,890::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' for lock type 'shared' >Thread-34::DEBUG::2014-07-10 09:21:30,890::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-10 09:21:30,891::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`0d62be7a-3ce9-4e55-a536-827b758394b1`::Granted request >Thread-34::DEBUG::2014-07-10 09:21:30,891::task::827::TaskManager.Task::(resourceAcquired) Task=`2c7f84e7-2971-4fc1-81ad-6f42cf0f084a`::_resourcesAcquired: Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee (shared) >Thread-34::DEBUG::2014-07-10 09:21:30,891::task::990::TaskManager.Task::(_decref) Task=`2c7f84e7-2971-4fc1-81ad-6f42cf0f084a`::ref 1 aborting False >Thread-34::INFO::2014-07-10 09:21:30,893::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532067385344', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:21:30,893::task::1185::TaskManager.Task::(prepare) Task=`2c7f84e7-2971-4fc1-81ad-6f42cf0f084a`::finished: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532067385344', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:21:30,893::task::595::TaskManager.Task::(_updateState) Task=`2c7f84e7-2971-4fc1-81ad-6f42cf0f084a`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-10 09:21:30,893::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee': < ResourceRef 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-10 09:21:30,894::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-10 09:21:30,894::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' >Thread-34::DEBUG::2014-07-10 09:21:30,894::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' (0 active users) >Thread-34::DEBUG::2014-07-10 09:21:30,894::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-10 09:21:30,894::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', Clearing records. >Thread-34::DEBUG::2014-07-10 09:21:30,895::task::990::TaskManager.Task::(_decref) Task=`2c7f84e7-2971-4fc1-81ad-6f42cf0f084a`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 09:21:31,866::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:21:31,959::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0349111 s, 29.3 MB/s\n'; <rc> = 0 >Thread-40::DEBUG::2014-07-10 09:21:33,162::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lion.qa.lab.tlv.redhat.com:_export_yuri2_backup2/6a70504d-00df-4869-8695-0f442053f6b6/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-40::DEBUG::2014-07-10 09:21:33,183::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n369 bytes (369 B) copied, 0.000441427 s, 836 kB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:21:33,974::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:21:34,062::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0287547 s, 35.6 MB/s\n'; <rc> = 0 >Thread-70::DEBUG::2014-07-10 09:21:34,370::task::595::TaskManager.Task::(_updateState) Task=`66355a4e-8ad9-4e2c-864b-689a1ad9eb81`::moving from state init -> state preparing >Thread-70::INFO::2014-07-10 09:21:34,371::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='cfaeead2-7caa-467c-b389-c89840ae6605', volUUID='567fe32d-31a6-4ff6-90f3-fd6a656fbecc', options=None) >Thread-70::INFO::2014-07-10 09:21:34,371::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-70::DEBUG::2014-07-10 09:21:34,371::task::1185::TaskManager.Task::(prepare) Task=`66355a4e-8ad9-4e2c-864b-689a1ad9eb81`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-70::DEBUG::2014-07-10 09:21:34,372::task::595::TaskManager.Task::(_updateState) Task=`66355a4e-8ad9-4e2c-864b-689a1ad9eb81`::moving from state preparing -> state finished >Thread-70::DEBUG::2014-07-10 09:21:34,372::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-70::DEBUG::2014-07-10 09:21:34,372::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-70::DEBUG::2014-07-10 09:21:34,372::task::990::TaskManager.Task::(_decref) Task=`66355a4e-8ad9-4e2c-864b-689a1ad9eb81`::ref 0 aborting False >Thread-14::DEBUG::2014-07-10 09:21:34,669::task::595::TaskManager.Task::(_updateState) Task=`18dc44d1-1da7-499c-a93b-7ddae983783f`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 09:21:34,669::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::INFO::2014-07-10 09:21:34,670::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000798563', 'lastCheck': '3.9', 'valid': True}, '6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000441427', 'lastCheck': '1.5', 'valid': True}} >Thread-14::DEBUG::2014-07-10 09:21:34,670::task::1185::TaskManager.Task::(prepare) Task=`18dc44d1-1da7-499c-a93b-7ddae983783f`::finished: {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000798563', 'lastCheck': '3.9', 'valid': True}, '6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000441427', 'lastCheck': '1.5', 'valid': True}} >Thread-14::DEBUG::2014-07-10 09:21:34,670::task::595::TaskManager.Task::(_updateState) Task=`18dc44d1-1da7-499c-a93b-7ddae983783f`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 09:21:34,670::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 09:21:34,671::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 09:21:34,671::task::990::TaskManager.Task::(_decref) Task=`18dc44d1-1da7-499c-a93b-7ddae983783f`::ref 0 aborting False >Thread-60::DEBUG::2014-07-10 09:21:35,252::task::595::TaskManager.Task::(_updateState) Task=`f96478ea-ac6a-4f6b-9526-d316d932babf`::moving from state init -> state preparing >Thread-60::INFO::2014-07-10 09:21:35,253::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='b034d5b0-e1e0-4011-b49b-4d45ddb11556', volUUID='3d7f62b5-328f-4d8e-8b69-873cfb5ae14d', options=None) >Thread-60::INFO::2014-07-10 09:21:35,253::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-60::DEBUG::2014-07-10 09:21:35,254::task::1185::TaskManager.Task::(prepare) Task=`f96478ea-ac6a-4f6b-9526-d316d932babf`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-60::DEBUG::2014-07-10 09:21:35,254::task::595::TaskManager.Task::(_updateState) Task=`f96478ea-ac6a-4f6b-9526-d316d932babf`::moving from state preparing -> state finished >Thread-60::DEBUG::2014-07-10 09:21:35,254::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-60::DEBUG::2014-07-10 09:21:35,254::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-60::DEBUG::2014-07-10 09:21:35,254::task::990::TaskManager.Task::(_decref) Task=`f96478ea-ac6a-4f6b-9526-d316d932babf`::ref 0 aborting False >Thread-51::DEBUG::2014-07-10 09:21:35,414::task::595::TaskManager.Task::(_updateState) Task=`67d89e27-c3fc-43bc-ac05-f603b9f38ef7`::moving from state init -> state preparing >Thread-51::INFO::2014-07-10 09:21:35,424::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='76fdb054-02cd-42ed-9721-b3e65b34c3a4', volUUID='022dfe46-2cf7-4915-80b3-883158e3ca83', options=None) >Thread-51::INFO::2014-07-10 09:21:35,435::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-51::DEBUG::2014-07-10 09:21:35,441::task::1185::TaskManager.Task::(prepare) Task=`67d89e27-c3fc-43bc-ac05-f603b9f38ef7`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-51::DEBUG::2014-07-10 09:21:35,444::task::595::TaskManager.Task::(_updateState) Task=`67d89e27-c3fc-43bc-ac05-f603b9f38ef7`::moving from state preparing -> state finished >Thread-51::DEBUG::2014-07-10 09:21:35,446::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-51::DEBUG::2014-07-10 09:21:35,449::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-51::DEBUG::2014-07-10 09:21:35,451::task::990::TaskManager.Task::(_decref) Task=`67d89e27-c3fc-43bc-ac05-f603b9f38ef7`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 09:21:36,077::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:21:36,167::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0319708 s, 32.0 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:21:38,183::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:21:38,272::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0296553 s, 34.5 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:21:40,287::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:21:40,375::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0297341 s, 34.4 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-10 09:21:40,753::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/metadata bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-10 09:21:40,775::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000723966 s, 5.7 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 09:21:40,925::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-14::DEBUG::2014-07-10 09:21:40,926::task::595::TaskManager.Task::(_updateState) Task=`35ad2a41-1db5-45a1-83cc-185a4fbef9c2`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 09:21:40,926::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-14::INFO::2014-07-10 09:21:40,927::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:21:40,927::task::1185::TaskManager.Task::(prepare) Task=`35ad2a41-1db5-45a1-83cc-185a4fbef9c2`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:21:40,927::task::595::TaskManager.Task::(_updateState) Task=`35ad2a41-1db5-45a1-83cc-185a4fbef9c2`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 09:21:40,927::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 09:21:40,927::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 09:21:40,928::task::990::TaskManager.Task::(_decref) Task=`35ad2a41-1db5-45a1-83cc-185a4fbef9c2`::ref 0 aborting False >Thread-34::DEBUG::2014-07-10 09:21:40,931::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-34::DEBUG::2014-07-10 09:21:40,932::task::595::TaskManager.Task::(_updateState) Task=`3e15fc7f-085b-487e-b348-11d217a788e0`::moving from state init -> state preparing >Thread-34::INFO::2014-07-10 09:21:40,932::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-34::DEBUG::2014-07-10 09:21:40,933::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`2e4198f0-bb9c-4820-8f13-65b81fdc7acb`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-10 09:21:40,933::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' for lock type 'shared' >Thread-34::DEBUG::2014-07-10 09:21:40,933::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-10 09:21:40,934::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`2e4198f0-bb9c-4820-8f13-65b81fdc7acb`::Granted request >Thread-34::DEBUG::2014-07-10 09:21:40,934::task::827::TaskManager.Task::(resourceAcquired) Task=`3e15fc7f-085b-487e-b348-11d217a788e0`::_resourcesAcquired: Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee (shared) >Thread-34::DEBUG::2014-07-10 09:21:40,934::task::990::TaskManager.Task::(_decref) Task=`3e15fc7f-085b-487e-b348-11d217a788e0`::ref 1 aborting False >Thread-34::INFO::2014-07-10 09:21:40,935::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532067385344', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:21:40,936::task::1185::TaskManager.Task::(prepare) Task=`3e15fc7f-085b-487e-b348-11d217a788e0`::finished: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532067385344', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:21:40,936::task::595::TaskManager.Task::(_updateState) Task=`3e15fc7f-085b-487e-b348-11d217a788e0`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-10 09:21:40,936::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee': < ResourceRef 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-10 09:21:40,936::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-10 09:21:40,937::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' >Thread-34::DEBUG::2014-07-10 09:21:40,937::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' (0 active users) >Thread-34::DEBUG::2014-07-10 09:21:40,937::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-10 09:21:40,937::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', Clearing records. >Thread-34::DEBUG::2014-07-10 09:21:40,937::task::990::TaskManager.Task::(_decref) Task=`3e15fc7f-085b-487e-b348-11d217a788e0`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 09:21:42,391::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:21:42,490::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0394553 s, 26.0 MB/s\n'; <rc> = 0 >Thread-40::DEBUG::2014-07-10 09:21:43,214::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lion.qa.lab.tlv.redhat.com:_export_yuri2_backup2/6a70504d-00df-4869-8695-0f442053f6b6/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-40::DEBUG::2014-07-10 09:21:43,235::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n369 bytes (369 B) copied, 0.000457531 s, 807 kB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:21:44,505::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:21:44,614::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0506266 s, 20.2 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:21:46,629::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:21:46,733::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.02895 s, 35.4 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:21:48,748::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:21:48,842::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0352211 s, 29.1 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 09:21:49,868::task::595::TaskManager.Task::(_updateState) Task=`166f6fdd-55a3-4b69-8e9f-41cb8ae997a5`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 09:21:49,869::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::INFO::2014-07-10 09:21:49,869::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000723966', 'lastCheck': '9.1', 'valid': True}, '6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000457531', 'lastCheck': '6.6', 'valid': True}} >Thread-14::DEBUG::2014-07-10 09:21:49,869::task::1185::TaskManager.Task::(prepare) Task=`166f6fdd-55a3-4b69-8e9f-41cb8ae997a5`::finished: {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000723966', 'lastCheck': '9.1', 'valid': True}, '6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000457531', 'lastCheck': '6.6', 'valid': True}} >Thread-14::DEBUG::2014-07-10 09:21:49,869::task::595::TaskManager.Task::(_updateState) Task=`166f6fdd-55a3-4b69-8e9f-41cb8ae997a5`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 09:21:49,870::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 09:21:49,870::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 09:21:49,870::task::990::TaskManager.Task::(_decref) Task=`166f6fdd-55a3-4b69-8e9f-41cb8ae997a5`::ref 0 aborting False >Thread-18::DEBUG::2014-07-10 09:21:50,804::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/metadata bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-10 09:21:50,826::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00051942 s, 7.9 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:21:50,857::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:21:50,965::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0377988 s, 27.1 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 09:21:50,986::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-14::DEBUG::2014-07-10 09:21:51,001::task::595::TaskManager.Task::(_updateState) Task=`fed68c04-f73b-4d09-8736-a128b615ecfd`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 09:21:51,013::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-14::INFO::2014-07-10 09:21:51,031::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:21:51,040::task::1185::TaskManager.Task::(prepare) Task=`fed68c04-f73b-4d09-8736-a128b615ecfd`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:21:51,048::task::595::TaskManager.Task::(_updateState) Task=`fed68c04-f73b-4d09-8736-a128b615ecfd`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 09:21:51,056::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 09:21:51,064::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 09:21:51,074::task::990::TaskManager.Task::(_decref) Task=`fed68c04-f73b-4d09-8736-a128b615ecfd`::ref 0 aborting False >Thread-34::DEBUG::2014-07-10 09:21:51,148::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-34::DEBUG::2014-07-10 09:21:51,161::task::595::TaskManager.Task::(_updateState) Task=`276347db-256c-47e6-b601-0e39dff7560b`::moving from state init -> state preparing >Thread-34::INFO::2014-07-10 09:21:51,172::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-34::DEBUG::2014-07-10 09:21:51,181::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`cb9657eb-0af0-476b-928f-4966497caf66`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-10 09:21:51,182::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' for lock type 'shared' >Thread-34::DEBUG::2014-07-10 09:21:51,185::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-10 09:21:51,187::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`cb9657eb-0af0-476b-928f-4966497caf66`::Granted request >Thread-34::DEBUG::2014-07-10 09:21:51,190::task::827::TaskManager.Task::(resourceAcquired) Task=`276347db-256c-47e6-b601-0e39dff7560b`::_resourcesAcquired: Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee (shared) >Thread-34::DEBUG::2014-07-10 09:21:51,191::task::990::TaskManager.Task::(_decref) Task=`276347db-256c-47e6-b601-0e39dff7560b`::ref 1 aborting False >Thread-34::INFO::2014-07-10 09:21:51,199::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532067385344', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:21:51,201::task::1185::TaskManager.Task::(prepare) Task=`276347db-256c-47e6-b601-0e39dff7560b`::finished: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532067385344', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:21:51,202::task::595::TaskManager.Task::(_updateState) Task=`276347db-256c-47e6-b601-0e39dff7560b`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-10 09:21:51,204::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee': < ResourceRef 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-10 09:21:51,205::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-10 09:21:51,207::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' >Thread-34::DEBUG::2014-07-10 09:21:51,209::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' (0 active users) >Thread-34::DEBUG::2014-07-10 09:21:51,210::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-10 09:21:51,211::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', Clearing records. >Thread-34::DEBUG::2014-07-10 09:21:51,214::task::990::TaskManager.Task::(_decref) Task=`276347db-256c-47e6-b601-0e39dff7560b`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 09:21:53,227::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Thread-40::DEBUG::2014-07-10 09:21:53,553::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lion.qa.lab.tlv.redhat.com:_export_yuri2_backup2/6a70504d-00df-4869-8695-0f442053f6b6/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-40::DEBUG::2014-07-10 09:21:53,622::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n369 bytes (369 B) copied, 0.000485731 s, 760 kB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:21:53,685::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.401334 s, 2.6 MB/s\n'; <rc> = 0 >Thread-64::DEBUG::2014-07-10 09:21:54,454::task::595::TaskManager.Task::(_updateState) Task=`48707b43-1878-4438-97e9-f288c7e0a44b`::moving from state init -> state preparing >Thread-64::INFO::2014-07-10 09:21:54,454::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='aa20346a-4d3a-4e07-b8e1-52c0ebe4168c', volUUID='58fefce2-9bce-4bff-8949-8c6ce8122b27', options=None) >Thread-64::INFO::2014-07-10 09:21:54,455::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-64::DEBUG::2014-07-10 09:21:54,455::task::1185::TaskManager.Task::(prepare) Task=`48707b43-1878-4438-97e9-f288c7e0a44b`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-64::DEBUG::2014-07-10 09:21:54,455::task::595::TaskManager.Task::(_updateState) Task=`48707b43-1878-4438-97e9-f288c7e0a44b`::moving from state preparing -> state finished >Thread-64::DEBUG::2014-07-10 09:21:54,456::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-64::DEBUG::2014-07-10 09:21:54,456::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-64::DEBUG::2014-07-10 09:21:54,456::task::990::TaskManager.Task::(_decref) Task=`48707b43-1878-4438-97e9-f288c7e0a44b`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 09:21:55,722::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:21:55,806::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0273818 s, 37.4 MB/s\n'; <rc> = 0 >Thread-73::DEBUG::2014-07-10 09:21:55,931::task::595::TaskManager.Task::(_updateState) Task=`107c81ef-7292-4da1-923b-af5a53e1a4f6`::moving from state init -> state preparing >Thread-54::DEBUG::2014-07-10 09:21:55,931::task::595::TaskManager.Task::(_updateState) Task=`6ff6cf55-39e7-40d7-8ed8-47a1b7745c3d`::moving from state init -> state preparing >Thread-73::INFO::2014-07-10 09:21:55,937::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='c01d693b-cba0-4fed-9ad7-0aaa28912a19', volUUID='4bb5d954-2a50-4028-b299-0b43c261270c', options=None) >Thread-54::INFO::2014-07-10 09:21:55,940::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='28408446-e5fd-4565-a976-e760951593fe', volUUID='776303a2-5585-451e-826e-0e338d4a1e98', options=None) >Thread-73::INFO::2014-07-10 09:21:55,946::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-54::INFO::2014-07-10 09:21:55,949::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-73::DEBUG::2014-07-10 09:21:55,952::task::1185::TaskManager.Task::(prepare) Task=`107c81ef-7292-4da1-923b-af5a53e1a4f6`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-54::DEBUG::2014-07-10 09:21:55,955::task::1185::TaskManager.Task::(prepare) Task=`6ff6cf55-39e7-40d7-8ed8-47a1b7745c3d`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-73::DEBUG::2014-07-10 09:21:55,958::task::595::TaskManager.Task::(_updateState) Task=`107c81ef-7292-4da1-923b-af5a53e1a4f6`::moving from state preparing -> state finished >Thread-54::DEBUG::2014-07-10 09:21:55,960::task::595::TaskManager.Task::(_updateState) Task=`6ff6cf55-39e7-40d7-8ed8-47a1b7745c3d`::moving from state preparing -> state finished >Thread-73::DEBUG::2014-07-10 09:21:55,963::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-54::DEBUG::2014-07-10 09:21:55,966::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-73::DEBUG::2014-07-10 09:21:55,967::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-54::DEBUG::2014-07-10 09:21:55,968::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-73::DEBUG::2014-07-10 09:21:55,969::task::990::TaskManager.Task::(_decref) Task=`107c81ef-7292-4da1-923b-af5a53e1a4f6`::ref 0 aborting False >Thread-54::DEBUG::2014-07-10 09:21:55,969::task::990::TaskManager.Task::(_decref) Task=`6ff6cf55-39e7-40d7-8ed8-47a1b7745c3d`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 09:21:57,824::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:21:57,917::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.035421 s, 28.9 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:21:59,933::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:22:00,022::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0331027 s, 30.9 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-10 09:22:00,855::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/metadata bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-10 09:22:00,878::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000571903 s, 7.2 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 09:22:01,243::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-14::DEBUG::2014-07-10 09:22:01,244::task::595::TaskManager.Task::(_updateState) Task=`b4c69a25-5aef-4b4c-9227-8c4d057371f0`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 09:22:01,244::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-14::INFO::2014-07-10 09:22:01,244::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:22:01,245::task::1185::TaskManager.Task::(prepare) Task=`b4c69a25-5aef-4b4c-9227-8c4d057371f0`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:22:01,245::task::595::TaskManager.Task::(_updateState) Task=`b4c69a25-5aef-4b4c-9227-8c4d057371f0`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 09:22:01,245::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 09:22:01,245::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 09:22:01,245::task::990::TaskManager.Task::(_decref) Task=`b4c69a25-5aef-4b4c-9227-8c4d057371f0`::ref 0 aborting False >Thread-34::DEBUG::2014-07-10 09:22:01,249::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-34::DEBUG::2014-07-10 09:22:01,250::task::595::TaskManager.Task::(_updateState) Task=`69162cd5-6179-40fb-8c2e-84e7c17e3b3e`::moving from state init -> state preparing >Thread-34::INFO::2014-07-10 09:22:01,250::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-34::DEBUG::2014-07-10 09:22:01,251::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`f483195e-ca8e-47a0-adf5-9aa7efd6f939`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-10 09:22:01,251::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' for lock type 'shared' >Thread-34::DEBUG::2014-07-10 09:22:01,251::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-10 09:22:01,251::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`f483195e-ca8e-47a0-adf5-9aa7efd6f939`::Granted request >Thread-34::DEBUG::2014-07-10 09:22:01,252::task::827::TaskManager.Task::(resourceAcquired) Task=`69162cd5-6179-40fb-8c2e-84e7c17e3b3e`::_resourcesAcquired: Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee (shared) >Thread-34::DEBUG::2014-07-10 09:22:01,252::task::990::TaskManager.Task::(_decref) Task=`69162cd5-6179-40fb-8c2e-84e7c17e3b3e`::ref 1 aborting False >Thread-34::INFO::2014-07-10 09:22:01,253::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532067385344', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:22:01,253::task::1185::TaskManager.Task::(prepare) Task=`69162cd5-6179-40fb-8c2e-84e7c17e3b3e`::finished: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532067385344', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:22:01,253::task::595::TaskManager.Task::(_updateState) Task=`69162cd5-6179-40fb-8c2e-84e7c17e3b3e`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-10 09:22:01,254::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee': < ResourceRef 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-10 09:22:01,254::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-10 09:22:01,254::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' >Thread-34::DEBUG::2014-07-10 09:22:01,254::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' (0 active users) >Thread-34::DEBUG::2014-07-10 09:22:01,255::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-10 09:22:01,255::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', Clearing records. >Thread-34::DEBUG::2014-07-10 09:22:01,255::task::990::TaskManager.Task::(_decref) Task=`69162cd5-6179-40fb-8c2e-84e7c17e3b3e`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 09:22:02,037::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:22:02,151::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0515633 s, 19.9 MB/s\n'; <rc> = 0 >Thread-40::DEBUG::2014-07-10 09:22:03,661::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lion.qa.lab.tlv.redhat.com:_export_yuri2_backup2/6a70504d-00df-4869-8695-0f442053f6b6/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-40::DEBUG::2014-07-10 09:22:03,681::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n369 bytes (369 B) copied, 0.000447024 s, 825 kB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:22:04,166::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:22:04,268::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.042291 s, 24.2 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 09:22:05,075::task::595::TaskManager.Task::(_updateState) Task=`dc606940-7091-4d2f-abec-bb42ba8d53e3`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 09:22:05,075::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::INFO::2014-07-10 09:22:05,076::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000571903', 'lastCheck': '4.2', 'valid': True}, '6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000447024', 'lastCheck': '1.4', 'valid': True}} >Thread-14::DEBUG::2014-07-10 09:22:05,076::task::1185::TaskManager.Task::(prepare) Task=`dc606940-7091-4d2f-abec-bb42ba8d53e3`::finished: {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000571903', 'lastCheck': '4.2', 'valid': True}, '6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000447024', 'lastCheck': '1.4', 'valid': True}} >Thread-14::DEBUG::2014-07-10 09:22:05,076::task::595::TaskManager.Task::(_updateState) Task=`dc606940-7091-4d2f-abec-bb42ba8d53e3`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 09:22:05,077::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 09:22:05,077::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 09:22:05,077::task::990::TaskManager.Task::(_decref) Task=`dc606940-7091-4d2f-abec-bb42ba8d53e3`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 09:22:06,286::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:22:06,379::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0353375 s, 29.0 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:22:08,394::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:22:08,489::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0358204 s, 28.6 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:22:10,504::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:22:10,599::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0366681 s, 27.9 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-10 09:22:10,907::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/metadata bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-10 09:22:10,930::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000634156 s, 6.5 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 09:22:11,284::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-14::DEBUG::2014-07-10 09:22:11,285::task::595::TaskManager.Task::(_updateState) Task=`6e0dc6bc-4e62-45bb-b134-163616e2dd62`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 09:22:11,285::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-14::INFO::2014-07-10 09:22:11,286::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:22:11,286::task::1185::TaskManager.Task::(prepare) Task=`6e0dc6bc-4e62-45bb-b134-163616e2dd62`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:22:11,286::task::595::TaskManager.Task::(_updateState) Task=`6e0dc6bc-4e62-45bb-b134-163616e2dd62`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 09:22:11,286::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 09:22:11,287::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 09:22:11,287::task::990::TaskManager.Task::(_decref) Task=`6e0dc6bc-4e62-45bb-b134-163616e2dd62`::ref 0 aborting False >Thread-34::DEBUG::2014-07-10 09:22:11,291::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-34::DEBUG::2014-07-10 09:22:11,291::task::595::TaskManager.Task::(_updateState) Task=`6c474871-a6b1-4942-9d67-b85094ce494e`::moving from state init -> state preparing >Thread-34::INFO::2014-07-10 09:22:11,292::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-34::DEBUG::2014-07-10 09:22:11,292::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`e96a4711-d9ce-4435-85ec-374b9efc561e`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-10 09:22:11,293::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' for lock type 'shared' >Thread-34::DEBUG::2014-07-10 09:22:11,293::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-10 09:22:11,293::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`e96a4711-d9ce-4435-85ec-374b9efc561e`::Granted request >Thread-34::DEBUG::2014-07-10 09:22:11,294::task::827::TaskManager.Task::(resourceAcquired) Task=`6c474871-a6b1-4942-9d67-b85094ce494e`::_resourcesAcquired: Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee (shared) >Thread-34::DEBUG::2014-07-10 09:22:11,294::task::990::TaskManager.Task::(_decref) Task=`6c474871-a6b1-4942-9d67-b85094ce494e`::ref 1 aborting False >Thread-34::INFO::2014-07-10 09:22:11,295::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532067385344', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:22:11,295::task::1185::TaskManager.Task::(prepare) Task=`6c474871-a6b1-4942-9d67-b85094ce494e`::finished: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532067385344', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:22:11,295::task::595::TaskManager.Task::(_updateState) Task=`6c474871-a6b1-4942-9d67-b85094ce494e`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-10 09:22:11,296::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee': < ResourceRef 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-10 09:22:11,296::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-10 09:22:11,296::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' >Thread-34::DEBUG::2014-07-10 09:22:11,296::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' (0 active users) >Thread-34::DEBUG::2014-07-10 09:22:11,296::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-10 09:22:11,297::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', Clearing records. >Thread-34::DEBUG::2014-07-10 09:22:11,297::task::990::TaskManager.Task::(_decref) Task=`6c474871-a6b1-4942-9d67-b85094ce494e`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 09:22:12,615::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:22:12,709::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0354387 s, 28.9 MB/s\n'; <rc> = 0 >Thread-40::DEBUG::2014-07-10 09:22:13,716::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lion.qa.lab.tlv.redhat.com:_export_yuri2_backup2/6a70504d-00df-4869-8695-0f442053f6b6/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-40::DEBUG::2014-07-10 09:22:13,737::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n369 bytes (369 B) copied, 0.000437747 s, 843 kB/s\n'; <rc> = 0 >Thread-57::DEBUG::2014-07-10 09:22:14,541::task::595::TaskManager.Task::(_updateState) Task=`7b7a2db8-c50e-4cfd-ac34-b8ad947dd415`::moving from state init -> state preparing >Thread-57::INFO::2014-07-10 09:22:14,542::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='b6f6c0da-e67f-4902-b9ac-3069571a42fe', volUUID='c4cd1da8-05b7-45e0-80b1-1183d21443d9', options=None) >Thread-57::INFO::2014-07-10 09:22:14,542::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-57::DEBUG::2014-07-10 09:22:14,542::task::1185::TaskManager.Task::(prepare) Task=`7b7a2db8-c50e-4cfd-ac34-b8ad947dd415`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-57::DEBUG::2014-07-10 09:22:14,543::task::595::TaskManager.Task::(_updateState) Task=`7b7a2db8-c50e-4cfd-ac34-b8ad947dd415`::moving from state preparing -> state finished >Thread-57::DEBUG::2014-07-10 09:22:14,543::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-57::DEBUG::2014-07-10 09:22:14,543::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-57::DEBUG::2014-07-10 09:22:14,543::task::990::TaskManager.Task::(_decref) Task=`7b7a2db8-c50e-4cfd-ac34-b8ad947dd415`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 09:22:14,725::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:22:14,818::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0349281 s, 29.3 MB/s\n'; <rc> = 0 >Thread-67::DEBUG::2014-07-10 09:22:15,486::task::595::TaskManager.Task::(_updateState) Task=`37f747fb-8db5-409b-9faa-c88513f96f53`::moving from state init -> state preparing >Thread-67::INFO::2014-07-10 09:22:15,487::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='f30c2cb7-a43a-4bf5-82b5-cfe07336f65c', volUUID='b0fbb3c9-55af-4a3a-95ad-fc56a80b9cf5', options=None) >Thread-67::INFO::2014-07-10 09:22:15,487::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-67::DEBUG::2014-07-10 09:22:15,487::task::1185::TaskManager.Task::(prepare) Task=`37f747fb-8db5-409b-9faa-c88513f96f53`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-67::DEBUG::2014-07-10 09:22:15,487::task::595::TaskManager.Task::(_updateState) Task=`37f747fb-8db5-409b-9faa-c88513f96f53`::moving from state preparing -> state finished >Thread-67::DEBUG::2014-07-10 09:22:15,488::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-67::DEBUG::2014-07-10 09:22:15,488::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-67::DEBUG::2014-07-10 09:22:15,488::task::990::TaskManager.Task::(_decref) Task=`37f747fb-8db5-409b-9faa-c88513f96f53`::ref 0 aborting False >Thread-48::DEBUG::2014-07-10 09:22:15,884::task::595::TaskManager.Task::(_updateState) Task=`6071e2f8-b361-426e-9557-2d52d2da5294`::moving from state init -> state preparing >Thread-48::INFO::2014-07-10 09:22:15,888::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='0cd7d6ce-f497-4243-a690-c57744861eea', volUUID='10b6a7dd-dc6c-43fa-ba17-92e4331b0e0b', options=None) >Thread-48::INFO::2014-07-10 09:22:15,893::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-48::DEBUG::2014-07-10 09:22:15,895::task::1185::TaskManager.Task::(prepare) Task=`6071e2f8-b361-426e-9557-2d52d2da5294`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-48::DEBUG::2014-07-10 09:22:15,897::task::595::TaskManager.Task::(_updateState) Task=`6071e2f8-b361-426e-9557-2d52d2da5294`::moving from state preparing -> state finished >Thread-48::DEBUG::2014-07-10 09:22:15,899::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-48::DEBUG::2014-07-10 09:22:15,901::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-48::DEBUG::2014-07-10 09:22:15,903::task::990::TaskManager.Task::(_decref) Task=`6071e2f8-b361-426e-9557-2d52d2da5294`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 09:22:16,834::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:22:16,918::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0267926 s, 38.2 MB/s\n'; <rc> = 0 >Thread-76::DEBUG::2014-07-10 09:22:17,233::task::595::TaskManager.Task::(_updateState) Task=`a68f750b-b96a-48f4-a124-958e14bac11d`::moving from state init -> state preparing >Thread-76::INFO::2014-07-10 09:22:17,233::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='e4c65229-4247-4b33-b72a-f1d5ce72ad05', volUUID='cad94284-3ca9-4c30-933d-997f4460309e', options=None) >Thread-76::INFO::2014-07-10 09:22:17,233::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-76::DEBUG::2014-07-10 09:22:17,234::task::1185::TaskManager.Task::(prepare) Task=`a68f750b-b96a-48f4-a124-958e14bac11d`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-76::DEBUG::2014-07-10 09:22:17,234::task::595::TaskManager.Task::(_updateState) Task=`a68f750b-b96a-48f4-a124-958e14bac11d`::moving from state preparing -> state finished >Thread-76::DEBUG::2014-07-10 09:22:17,234::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-76::DEBUG::2014-07-10 09:22:17,234::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-76::DEBUG::2014-07-10 09:22:17,234::task::990::TaskManager.Task::(_decref) Task=`a68f750b-b96a-48f4-a124-958e14bac11d`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 09:22:18,932::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:22:19,019::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0350574 s, 29.2 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 09:22:20,329::task::595::TaskManager.Task::(_updateState) Task=`63f4f221-93e0-4dde-a0ab-1b21a1a0d3f3`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 09:22:20,330::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::INFO::2014-07-10 09:22:20,330::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000634156', 'lastCheck': '9.4', 'valid': True}, '6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000437747', 'lastCheck': '6.6', 'valid': True}} >Thread-14::DEBUG::2014-07-10 09:22:20,330::task::1185::TaskManager.Task::(prepare) Task=`63f4f221-93e0-4dde-a0ab-1b21a1a0d3f3`::finished: {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000634156', 'lastCheck': '9.4', 'valid': True}, '6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000437747', 'lastCheck': '6.6', 'valid': True}} >Thread-14::DEBUG::2014-07-10 09:22:20,331::task::595::TaskManager.Task::(_updateState) Task=`63f4f221-93e0-4dde-a0ab-1b21a1a0d3f3`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 09:22:20,331::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 09:22:20,331::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 09:22:20,331::task::990::TaskManager.Task::(_decref) Task=`63f4f221-93e0-4dde-a0ab-1b21a1a0d3f3`::ref 0 aborting False >Thread-18::DEBUG::2014-07-10 09:22:20,958::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/metadata bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-10 09:22:20,981::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000840445 s, 4.9 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:22:21,030::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:22:21,145::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0574001 s, 17.8 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 09:22:21,334::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-14::DEBUG::2014-07-10 09:22:21,335::task::595::TaskManager.Task::(_updateState) Task=`8a9b0f98-43f2-4edd-a928-ea7c36791145`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 09:22:21,335::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-14::INFO::2014-07-10 09:22:21,336::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:22:21,336::task::1185::TaskManager.Task::(prepare) Task=`8a9b0f98-43f2-4edd-a928-ea7c36791145`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:22:21,336::task::595::TaskManager.Task::(_updateState) Task=`8a9b0f98-43f2-4edd-a928-ea7c36791145`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 09:22:21,336::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 09:22:21,337::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 09:22:21,337::task::990::TaskManager.Task::(_decref) Task=`8a9b0f98-43f2-4edd-a928-ea7c36791145`::ref 0 aborting False >Thread-34::DEBUG::2014-07-10 09:22:21,381::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-34::DEBUG::2014-07-10 09:22:21,381::task::595::TaskManager.Task::(_updateState) Task=`c1ce7900-58e3-444d-a4b8-b10c98ff2bed`::moving from state init -> state preparing >Thread-34::INFO::2014-07-10 09:22:21,381::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-34::DEBUG::2014-07-10 09:22:21,382::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`5def4fb8-88e7-4a65-95bc-fde8192f2440`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-10 09:22:21,382::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' for lock type 'shared' >Thread-34::DEBUG::2014-07-10 09:22:21,383::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-10 09:22:21,383::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`5def4fb8-88e7-4a65-95bc-fde8192f2440`::Granted request >Thread-34::DEBUG::2014-07-10 09:22:21,383::task::827::TaskManager.Task::(resourceAcquired) Task=`c1ce7900-58e3-444d-a4b8-b10c98ff2bed`::_resourcesAcquired: Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee (shared) >Thread-34::DEBUG::2014-07-10 09:22:21,383::task::990::TaskManager.Task::(_decref) Task=`c1ce7900-58e3-444d-a4b8-b10c98ff2bed`::ref 1 aborting False >Thread-34::INFO::2014-07-10 09:22:21,385::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532067385344', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:22:21,385::task::1185::TaskManager.Task::(prepare) Task=`c1ce7900-58e3-444d-a4b8-b10c98ff2bed`::finished: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532067385344', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:22:21,385::task::595::TaskManager.Task::(_updateState) Task=`c1ce7900-58e3-444d-a4b8-b10c98ff2bed`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-10 09:22:21,385::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee': < ResourceRef 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-10 09:22:21,385::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-10 09:22:21,386::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' >Thread-34::DEBUG::2014-07-10 09:22:21,386::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' (0 active users) >Thread-34::DEBUG::2014-07-10 09:22:21,386::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-10 09:22:21,386::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', Clearing records. >Thread-34::DEBUG::2014-07-10 09:22:21,387::task::990::TaskManager.Task::(_decref) Task=`c1ce7900-58e3-444d-a4b8-b10c98ff2bed`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 09:22:23,160::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:22:23,241::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0252463 s, 40.6 MB/s\n'; <rc> = 0 >Thread-40::DEBUG::2014-07-10 09:22:23,770::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lion.qa.lab.tlv.redhat.com:_export_yuri2_backup2/6a70504d-00df-4869-8695-0f442053f6b6/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-40::DEBUG::2014-07-10 09:22:23,791::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n369 bytes (369 B) copied, 0.000460404 s, 801 kB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:22:25,256::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:22:25,376::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0299508 s, 34.2 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:22:27,392::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:22:27,507::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0349181 s, 29.3 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:22:29,523::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:22:29,680::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0348922 s, 29.3 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-10 09:22:31,016::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/metadata bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-10 09:22:31,046::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000527555 s, 7.8 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 09:22:31,409::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-14::DEBUG::2014-07-10 09:22:31,411::task::595::TaskManager.Task::(_updateState) Task=`3dfa81d0-8dc4-44c8-849a-6f004a2a2fe6`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 09:22:31,411::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-14::INFO::2014-07-10 09:22:31,411::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:22:31,412::task::1185::TaskManager.Task::(prepare) Task=`3dfa81d0-8dc4-44c8-849a-6f004a2a2fe6`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:22:31,412::task::595::TaskManager.Task::(_updateState) Task=`3dfa81d0-8dc4-44c8-849a-6f004a2a2fe6`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 09:22:31,412::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 09:22:31,412::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 09:22:31,413::task::990::TaskManager.Task::(_decref) Task=`3dfa81d0-8dc4-44c8-849a-6f004a2a2fe6`::ref 0 aborting False >Thread-34::DEBUG::2014-07-10 09:22:31,417::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-34::DEBUG::2014-07-10 09:22:31,417::task::595::TaskManager.Task::(_updateState) Task=`af7b9f04-e347-405c-bb98-f39324e12766`::moving from state init -> state preparing >Thread-34::INFO::2014-07-10 09:22:31,417::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-34::DEBUG::2014-07-10 09:22:31,418::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`b9b4d672-ff2a-4b1b-8489-f84b6bd1331c`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-10 09:22:31,418::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' for lock type 'shared' >Thread-34::DEBUG::2014-07-10 09:22:31,419::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-10 09:22:31,419::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`b9b4d672-ff2a-4b1b-8489-f84b6bd1331c`::Granted request >Thread-34::DEBUG::2014-07-10 09:22:31,419::task::827::TaskManager.Task::(resourceAcquired) Task=`af7b9f04-e347-405c-bb98-f39324e12766`::_resourcesAcquired: Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee (shared) >Thread-34::DEBUG::2014-07-10 09:22:31,420::task::990::TaskManager.Task::(_decref) Task=`af7b9f04-e347-405c-bb98-f39324e12766`::ref 1 aborting False >Thread-34::INFO::2014-07-10 09:22:31,421::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532067385344', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:22:31,421::task::1185::TaskManager.Task::(prepare) Task=`af7b9f04-e347-405c-bb98-f39324e12766`::finished: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532067385344', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:22:31,421::task::595::TaskManager.Task::(_updateState) Task=`af7b9f04-e347-405c-bb98-f39324e12766`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-10 09:22:31,421::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee': < ResourceRef 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-10 09:22:31,422::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-10 09:22:31,422::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' >Thread-34::DEBUG::2014-07-10 09:22:31,422::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' (0 active users) >Thread-34::DEBUG::2014-07-10 09:22:31,422::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-10 09:22:31,422::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', Clearing records. >Thread-34::DEBUG::2014-07-10 09:22:31,423::task::990::TaskManager.Task::(_decref) Task=`af7b9f04-e347-405c-bb98-f39324e12766`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 09:22:31,702::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:22:31,829::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0541777 s, 18.9 MB/s\n'; <rc> = 0 >Thread-40::DEBUG::2014-07-10 09:22:33,825::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lion.qa.lab.tlv.redhat.com:_export_yuri2_backup2/6a70504d-00df-4869-8695-0f442053f6b6/dom_md/metadata bs=4096 count=1' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:22:33,849::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Thread-40::DEBUG::2014-07-10 09:22:33,888::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n369 bytes (369 B) copied, 0.000469625 s, 786 kB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:22:33,968::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0591029 s, 17.3 MB/s\n'; <rc> = 0 >Thread-70::DEBUG::2014-07-10 09:22:34,631::task::595::TaskManager.Task::(_updateState) Task=`1b362675-03c8-4461-9d11-0da1e39af475`::moving from state init -> state preparing >Thread-70::INFO::2014-07-10 09:22:34,632::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='cfaeead2-7caa-467c-b389-c89840ae6605', volUUID='567fe32d-31a6-4ff6-90f3-fd6a656fbecc', options=None) >Thread-70::INFO::2014-07-10 09:22:34,633::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-70::DEBUG::2014-07-10 09:22:34,633::task::1185::TaskManager.Task::(prepare) Task=`1b362675-03c8-4461-9d11-0da1e39af475`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-70::DEBUG::2014-07-10 09:22:34,633::task::595::TaskManager.Task::(_updateState) Task=`1b362675-03c8-4461-9d11-0da1e39af475`::moving from state preparing -> state finished >Thread-70::DEBUG::2014-07-10 09:22:34,633::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-70::DEBUG::2014-07-10 09:22:34,633::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-70::DEBUG::2014-07-10 09:22:34,633::task::990::TaskManager.Task::(_decref) Task=`1b362675-03c8-4461-9d11-0da1e39af475`::ref 0 aborting False >Thread-14::DEBUG::2014-07-10 09:22:35,521::task::595::TaskManager.Task::(_updateState) Task=`b0498075-55ba-4e45-9b8a-126055e02ac5`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 09:22:35,522::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::INFO::2014-07-10 09:22:35,522::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000527555', 'lastCheck': '4.4', 'valid': True}, '6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000469625', 'lastCheck': '1.6', 'valid': True}} >Thread-14::DEBUG::2014-07-10 09:22:35,522::task::1185::TaskManager.Task::(prepare) Task=`b0498075-55ba-4e45-9b8a-126055e02ac5`::finished: {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000527555', 'lastCheck': '4.4', 'valid': True}, '6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000469625', 'lastCheck': '1.6', 'valid': True}} >Thread-14::DEBUG::2014-07-10 09:22:35,523::task::595::TaskManager.Task::(_updateState) Task=`b0498075-55ba-4e45-9b8a-126055e02ac5`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 09:22:35,523::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 09:22:35,523::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 09:22:35,523::task::990::TaskManager.Task::(_decref) Task=`b0498075-55ba-4e45-9b8a-126055e02ac5`::ref 0 aborting False >Thread-60::DEBUG::2014-07-10 09:22:35,524::task::595::TaskManager.Task::(_updateState) Task=`32c6d81f-6bf0-4629-8e7f-4dc577184f20`::moving from state init -> state preparing >Thread-60::INFO::2014-07-10 09:22:35,524::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='b034d5b0-e1e0-4011-b49b-4d45ddb11556', volUUID='3d7f62b5-328f-4d8e-8b69-873cfb5ae14d', options=None) >Thread-60::INFO::2014-07-10 09:22:35,525::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-60::DEBUG::2014-07-10 09:22:35,525::task::1185::TaskManager.Task::(prepare) Task=`32c6d81f-6bf0-4629-8e7f-4dc577184f20`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-60::DEBUG::2014-07-10 09:22:35,526::task::595::TaskManager.Task::(_updateState) Task=`32c6d81f-6bf0-4629-8e7f-4dc577184f20`::moving from state preparing -> state finished >Thread-60::DEBUG::2014-07-10 09:22:35,526::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-60::DEBUG::2014-07-10 09:22:35,527::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-60::DEBUG::2014-07-10 09:22:35,529::task::990::TaskManager.Task::(_decref) Task=`32c6d81f-6bf0-4629-8e7f-4dc577184f20`::ref 0 aborting False >Thread-51::DEBUG::2014-07-10 09:22:35,746::task::595::TaskManager.Task::(_updateState) Task=`98329f79-3358-4f7d-ab3f-f5f59d8d5d91`::moving from state init -> state preparing >Thread-51::INFO::2014-07-10 09:22:35,747::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='76fdb054-02cd-42ed-9721-b3e65b34c3a4', volUUID='022dfe46-2cf7-4915-80b3-883158e3ca83', options=None) >Thread-51::INFO::2014-07-10 09:22:35,747::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-51::DEBUG::2014-07-10 09:22:35,747::task::1185::TaskManager.Task::(prepare) Task=`98329f79-3358-4f7d-ab3f-f5f59d8d5d91`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-51::DEBUG::2014-07-10 09:22:35,748::task::595::TaskManager.Task::(_updateState) Task=`98329f79-3358-4f7d-ab3f-f5f59d8d5d91`::moving from state preparing -> state finished >Thread-51::DEBUG::2014-07-10 09:22:35,748::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-51::DEBUG::2014-07-10 09:22:35,748::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-51::DEBUG::2014-07-10 09:22:35,748::task::990::TaskManager.Task::(_decref) Task=`98329f79-3358-4f7d-ab3f-f5f59d8d5d91`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 09:22:35,983::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:22:36,589::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0294923 s, 34.7 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:22:38,875::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:22:38,978::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0467804 s, 21.9 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:22:40,994::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Thread-18::DEBUG::2014-07-10 09:22:41,080::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/metadata bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-10 09:22:41,230::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000775971 s, 5.3 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:22:41,251::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.029536 s, 34.7 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 09:22:41,461::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-14::DEBUG::2014-07-10 09:22:41,473::task::595::TaskManager.Task::(_updateState) Task=`98b125c1-dda8-4866-873a-f2c3a0ff9eef`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 09:22:41,482::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-14::INFO::2014-07-10 09:22:41,493::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:22:41,500::task::1185::TaskManager.Task::(prepare) Task=`98b125c1-dda8-4866-873a-f2c3a0ff9eef`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:22:41,507::task::595::TaskManager.Task::(_updateState) Task=`98b125c1-dda8-4866-873a-f2c3a0ff9eef`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 09:22:41,514::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 09:22:41,521::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 09:22:41,529::task::990::TaskManager.Task::(_decref) Task=`98b125c1-dda8-4866-873a-f2c3a0ff9eef`::ref 0 aborting False >Thread-34::DEBUG::2014-07-10 09:22:41,562::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-34::DEBUG::2014-07-10 09:22:41,573::task::595::TaskManager.Task::(_updateState) Task=`157f96a4-96b1-4b12-8c5f-d4b359c1e0b9`::moving from state init -> state preparing >Thread-34::INFO::2014-07-10 09:22:41,581::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-34::DEBUG::2014-07-10 09:22:41,593::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`bece4169-6db8-4fe2-80a5-ae2f853b323f`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-10 09:22:41,594::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' for lock type 'shared' >Thread-34::DEBUG::2014-07-10 09:22:41,597::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-10 09:22:41,598::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`bece4169-6db8-4fe2-80a5-ae2f853b323f`::Granted request >Thread-34::DEBUG::2014-07-10 09:22:41,601::task::827::TaskManager.Task::(resourceAcquired) Task=`157f96a4-96b1-4b12-8c5f-d4b359c1e0b9`::_resourcesAcquired: Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee (shared) >Thread-34::DEBUG::2014-07-10 09:22:41,603::task::990::TaskManager.Task::(_decref) Task=`157f96a4-96b1-4b12-8c5f-d4b359c1e0b9`::ref 1 aborting False >Thread-34::INFO::2014-07-10 09:22:41,610::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532067385344', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:22:41,611::task::1185::TaskManager.Task::(prepare) Task=`157f96a4-96b1-4b12-8c5f-d4b359c1e0b9`::finished: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532067385344', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:22:41,613::task::595::TaskManager.Task::(_updateState) Task=`157f96a4-96b1-4b12-8c5f-d4b359c1e0b9`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-10 09:22:41,614::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee': < ResourceRef 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-10 09:22:41,616::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-10 09:22:41,618::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' >Thread-34::DEBUG::2014-07-10 09:22:41,622::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' (0 active users) >Thread-34::DEBUG::2014-07-10 09:22:41,623::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-10 09:22:41,625::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', Clearing records. >Thread-34::DEBUG::2014-07-10 09:22:41,627::task::990::TaskManager.Task::(_decref) Task=`157f96a4-96b1-4b12-8c5f-d4b359c1e0b9`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 09:22:43,637::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:22:43,730::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0320434 s, 32.0 MB/s\n'; <rc> = 0 >Thread-40::DEBUG::2014-07-10 09:22:43,930::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lion.qa.lab.tlv.redhat.com:_export_yuri2_backup2/6a70504d-00df-4869-8695-0f442053f6b6/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-40::DEBUG::2014-07-10 09:22:43,951::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n369 bytes (369 B) copied, 0.000442072 s, 835 kB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:22:45,747::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:22:45,858::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0339904 s, 30.1 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:22:47,873::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:22:48,015::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0831485 s, 12.3 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:22:50,031::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:22:50,125::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.032811 s, 31.2 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 09:22:50,710::task::595::TaskManager.Task::(_updateState) Task=`71d16a26-cc81-43a4-9174-08eb12f50584`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 09:22:50,710::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::INFO::2014-07-10 09:22:50,711::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000775971', 'lastCheck': '9.1', 'valid': True}, '6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000442072', 'lastCheck': '6.8', 'valid': True}} >Thread-14::DEBUG::2014-07-10 09:22:50,711::task::1185::TaskManager.Task::(prepare) Task=`71d16a26-cc81-43a4-9174-08eb12f50584`::finished: {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000775971', 'lastCheck': '9.1', 'valid': True}, '6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000442072', 'lastCheck': '6.8', 'valid': True}} >Thread-14::DEBUG::2014-07-10 09:22:50,711::task::595::TaskManager.Task::(_updateState) Task=`71d16a26-cc81-43a4-9174-08eb12f50584`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 09:22:50,711::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 09:22:50,711::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 09:22:50,712::task::990::TaskManager.Task::(_decref) Task=`71d16a26-cc81-43a4-9174-08eb12f50584`::ref 0 aborting False >Thread-18::DEBUG::2014-07-10 09:22:51,592::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/metadata bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-10 09:22:51,614::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000797422 s, 5.1 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 09:22:51,673::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-14::DEBUG::2014-07-10 09:22:51,674::task::595::TaskManager.Task::(_updateState) Task=`12b94e1d-4261-4c45-ae33-35b2b55d73e3`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 09:22:51,674::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-14::INFO::2014-07-10 09:22:51,675::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:22:51,675::task::1185::TaskManager.Task::(prepare) Task=`12b94e1d-4261-4c45-ae33-35b2b55d73e3`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:22:51,675::task::595::TaskManager.Task::(_updateState) Task=`12b94e1d-4261-4c45-ae33-35b2b55d73e3`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 09:22:51,675::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 09:22:51,675::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 09:22:51,676::task::990::TaskManager.Task::(_decref) Task=`12b94e1d-4261-4c45-ae33-35b2b55d73e3`::ref 0 aborting False >Thread-34::DEBUG::2014-07-10 09:22:51,719::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-34::DEBUG::2014-07-10 09:22:51,719::task::595::TaskManager.Task::(_updateState) Task=`1b95d5c4-5a6c-4c0e-b58e-202ffa344d04`::moving from state init -> state preparing >Thread-34::INFO::2014-07-10 09:22:51,720::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-34::DEBUG::2014-07-10 09:22:51,720::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`0c1d8411-3a81-49b2-8607-1d832bc62686`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-10 09:22:51,721::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' for lock type 'shared' >Thread-34::DEBUG::2014-07-10 09:22:51,721::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-10 09:22:51,721::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`0c1d8411-3a81-49b2-8607-1d832bc62686`::Granted request >Thread-34::DEBUG::2014-07-10 09:22:51,722::task::827::TaskManager.Task::(resourceAcquired) Task=`1b95d5c4-5a6c-4c0e-b58e-202ffa344d04`::_resourcesAcquired: Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee (shared) >Thread-34::DEBUG::2014-07-10 09:22:51,722::task::990::TaskManager.Task::(_decref) Task=`1b95d5c4-5a6c-4c0e-b58e-202ffa344d04`::ref 1 aborting False >Thread-34::INFO::2014-07-10 09:22:51,723::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532067385344', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:22:51,723::task::1185::TaskManager.Task::(prepare) Task=`1b95d5c4-5a6c-4c0e-b58e-202ffa344d04`::finished: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532067385344', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:22:51,724::task::595::TaskManager.Task::(_updateState) Task=`1b95d5c4-5a6c-4c0e-b58e-202ffa344d04`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-10 09:22:51,724::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee': < ResourceRef 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-10 09:22:51,724::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-10 09:22:51,724::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' >Thread-34::DEBUG::2014-07-10 09:22:51,725::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' (0 active users) >Thread-34::DEBUG::2014-07-10 09:22:51,725::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-10 09:22:51,725::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', Clearing records. >Thread-34::DEBUG::2014-07-10 09:22:51,725::task::990::TaskManager.Task::(_decref) Task=`1b95d5c4-5a6c-4c0e-b58e-202ffa344d04`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 09:22:52,140::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:22:52,233::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0324022 s, 31.6 MB/s\n'; <rc> = 0 >Thread-40::DEBUG::2014-07-10 09:22:53,954::domainMonitor::192::Storage.DomainMonitorThread::(_monitorDomain) Refreshing domain 6a70504d-00df-4869-8695-0f442053f6b6 >Thread-40::DEBUG::2014-07-10 09:22:53,985::fileSD::150::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/lion.qa.lab.tlv.redhat.com:_export_yuri2_backup2/6a70504d-00df-4869-8695-0f442053f6b6 >Thread-40::DEBUG::2014-07-10 09:22:53,987::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend >Thread-40::DEBUG::2014-07-10 09:22:53,990::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Backup', 'DESCRIPTION=test', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=0', 'POOL_UUID=4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', 'REMOTE_PATH=lion.qa.lab.tlv.redhat.com:/export/yuri2/backup2', 'ROLE=Regular', 'SDUUID=6a70504d-00df-4869-8695-0f442053f6b6', 'TYPE=NFS', 'VERSION=0', '_SHA_CKSUM=aab6b8e901ec435cd5f9de3c9e3f8b45dca569e0'] >Thread-40::DEBUG::2014-07-10 09:22:53,992::fileSD::609::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images [] >Thread-40::INFO::2014-07-10 09:22:53,992::sd::384::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 6a70504d-00df-4869-8695-0f442053f6b6_imageNS already registered >Thread-40::INFO::2014-07-10 09:22:53,992::sd::392::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 6a70504d-00df-4869-8695-0f442053f6b6_volumeNS already registered >Thread-40::DEBUG::2014-07-10 09:22:54,018::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lion.qa.lab.tlv.redhat.com:_export_yuri2_backup2/6a70504d-00df-4869-8695-0f442053f6b6/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-40::DEBUG::2014-07-10 09:22:54,040::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n369 bytes (369 B) copied, 0.000411435 s, 897 kB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:22:54,248::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:22:54,355::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0469461 s, 21.8 MB/s\n'; <rc> = 0 >Thread-64::DEBUG::2014-07-10 09:22:54,716::task::595::TaskManager.Task::(_updateState) Task=`06cebc00-7d27-417c-9caf-087ce2dc0dee`::moving from state init -> state preparing >Thread-64::INFO::2014-07-10 09:22:54,717::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='aa20346a-4d3a-4e07-b8e1-52c0ebe4168c', volUUID='58fefce2-9bce-4bff-8949-8c6ce8122b27', options=None) >Thread-64::INFO::2014-07-10 09:22:54,717::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-64::DEBUG::2014-07-10 09:22:54,718::task::1185::TaskManager.Task::(prepare) Task=`06cebc00-7d27-417c-9caf-087ce2dc0dee`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-64::DEBUG::2014-07-10 09:22:54,718::task::595::TaskManager.Task::(_updateState) Task=`06cebc00-7d27-417c-9caf-087ce2dc0dee`::moving from state preparing -> state finished >Thread-64::DEBUG::2014-07-10 09:22:54,718::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-64::DEBUG::2014-07-10 09:22:54,718::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-64::DEBUG::2014-07-10 09:22:54,718::task::990::TaskManager.Task::(_decref) Task=`06cebc00-7d27-417c-9caf-087ce2dc0dee`::ref 0 aborting False >Thread-73::DEBUG::2014-07-10 09:22:56,304::task::595::TaskManager.Task::(_updateState) Task=`1e1cd450-45f3-46f9-873d-88e0d724c6d1`::moving from state init -> state preparing >Thread-73::INFO::2014-07-10 09:22:56,305::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='c01d693b-cba0-4fed-9ad7-0aaa28912a19', volUUID='4bb5d954-2a50-4028-b299-0b43c261270c', options=None) >Thread-73::INFO::2014-07-10 09:22:56,305::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-73::DEBUG::2014-07-10 09:22:56,305::task::1185::TaskManager.Task::(prepare) Task=`1e1cd450-45f3-46f9-873d-88e0d724c6d1`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-73::DEBUG::2014-07-10 09:22:56,305::task::595::TaskManager.Task::(_updateState) Task=`1e1cd450-45f3-46f9-873d-88e0d724c6d1`::moving from state preparing -> state finished >Thread-73::DEBUG::2014-07-10 09:22:56,306::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-73::DEBUG::2014-07-10 09:22:56,306::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-73::DEBUG::2014-07-10 09:22:56,306::task::990::TaskManager.Task::(_decref) Task=`1e1cd450-45f3-46f9-873d-88e0d724c6d1`::ref 0 aborting False >Thread-54::DEBUG::2014-07-10 09:22:56,307::task::595::TaskManager.Task::(_updateState) Task=`35109702-286b-4cf4-b50c-92af4905307a`::moving from state init -> state preparing >Thread-54::INFO::2014-07-10 09:22:56,308::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='28408446-e5fd-4565-a976-e760951593fe', volUUID='776303a2-5585-451e-826e-0e338d4a1e98', options=None) >Thread-54::INFO::2014-07-10 09:22:56,308::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-54::DEBUG::2014-07-10 09:22:56,308::task::1185::TaskManager.Task::(prepare) Task=`35109702-286b-4cf4-b50c-92af4905307a`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-54::DEBUG::2014-07-10 09:22:56,308::task::595::TaskManager.Task::(_updateState) Task=`35109702-286b-4cf4-b50c-92af4905307a`::moving from state preparing -> state finished >Thread-54::DEBUG::2014-07-10 09:22:56,308::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-54::DEBUG::2014-07-10 09:22:56,308::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-54::DEBUG::2014-07-10 09:22:56,309::task::990::TaskManager.Task::(_decref) Task=`35109702-286b-4cf4-b50c-92af4905307a`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 09:22:56,379::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:22:56,468::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0296818 s, 34.5 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:22:58,483::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:22:58,574::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0307391 s, 33.3 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:23:00,590::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:23:00,705::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0568978 s, 18.0 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-10 09:23:01,643::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/metadata bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-10 09:23:01,666::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000818408 s, 5.0 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 09:23:01,752::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-14::DEBUG::2014-07-10 09:23:01,753::task::595::TaskManager.Task::(_updateState) Task=`2b9de4df-add9-4c98-9035-e604b8a45aeb`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 09:23:01,753::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-14::INFO::2014-07-10 09:23:01,754::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:23:01,754::task::1185::TaskManager.Task::(prepare) Task=`2b9de4df-add9-4c98-9035-e604b8a45aeb`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:23:01,754::task::595::TaskManager.Task::(_updateState) Task=`2b9de4df-add9-4c98-9035-e604b8a45aeb`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 09:23:01,754::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 09:23:01,755::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 09:23:01,755::task::990::TaskManager.Task::(_decref) Task=`2b9de4df-add9-4c98-9035-e604b8a45aeb`::ref 0 aborting False >Thread-34::DEBUG::2014-07-10 09:23:01,759::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-34::DEBUG::2014-07-10 09:23:01,760::task::595::TaskManager.Task::(_updateState) Task=`8b754d0e-16ab-423b-abad-9cf3f659025c`::moving from state init -> state preparing >Thread-34::INFO::2014-07-10 09:23:01,760::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-34::DEBUG::2014-07-10 09:23:01,761::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`9a6cc1c1-dfb7-44ae-850c-2ed04d645bb7`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-10 09:23:01,761::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' for lock type 'shared' >Thread-34::DEBUG::2014-07-10 09:23:01,761::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-10 09:23:01,761::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`9a6cc1c1-dfb7-44ae-850c-2ed04d645bb7`::Granted request >Thread-34::DEBUG::2014-07-10 09:23:01,762::task::827::TaskManager.Task::(resourceAcquired) Task=`8b754d0e-16ab-423b-abad-9cf3f659025c`::_resourcesAcquired: Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee (shared) >Thread-34::DEBUG::2014-07-10 09:23:01,762::task::990::TaskManager.Task::(_decref) Task=`8b754d0e-16ab-423b-abad-9cf3f659025c`::ref 1 aborting False >Thread-34::INFO::2014-07-10 09:23:01,763::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532067385344', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:23:01,763::task::1185::TaskManager.Task::(prepare) Task=`8b754d0e-16ab-423b-abad-9cf3f659025c`::finished: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532067385344', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:23:01,764::task::595::TaskManager.Task::(_updateState) Task=`8b754d0e-16ab-423b-abad-9cf3f659025c`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-10 09:23:01,764::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee': < ResourceRef 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-10 09:23:01,764::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-10 09:23:01,765::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' >Thread-34::DEBUG::2014-07-10 09:23:01,765::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' (0 active users) >Thread-34::DEBUG::2014-07-10 09:23:01,765::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-10 09:23:01,765::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', Clearing records. >Thread-34::DEBUG::2014-07-10 09:23:01,765::task::990::TaskManager.Task::(_decref) Task=`8b754d0e-16ab-423b-abad-9cf3f659025c`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 09:23:02,723::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:23:02,825::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0400479 s, 25.6 MB/s\n'; <rc> = 0 >Thread-40::DEBUG::2014-07-10 09:23:04,076::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lion.qa.lab.tlv.redhat.com:_export_yuri2_backup2/6a70504d-00df-4869-8695-0f442053f6b6/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-40::DEBUG::2014-07-10 09:23:04,096::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n369 bytes (369 B) copied, 0.000559225 s, 660 kB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:23:04,840::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:23:04,934::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.033397 s, 30.7 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 09:23:05,905::task::595::TaskManager.Task::(_updateState) Task=`a8393703-1c6f-4046-92a5-dae37ba32888`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 09:23:05,906::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::INFO::2014-07-10 09:23:05,906::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000818408', 'lastCheck': '4.2', 'valid': True}, '6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000559225', 'lastCheck': '1.8', 'valid': True}} >Thread-14::DEBUG::2014-07-10 09:23:05,907::task::1185::TaskManager.Task::(prepare) Task=`a8393703-1c6f-4046-92a5-dae37ba32888`::finished: {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000818408', 'lastCheck': '4.2', 'valid': True}, '6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000559225', 'lastCheck': '1.8', 'valid': True}} >Thread-14::DEBUG::2014-07-10 09:23:05,907::task::595::TaskManager.Task::(_updateState) Task=`a8393703-1c6f-4046-92a5-dae37ba32888`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 09:23:05,907::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 09:23:05,908::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 09:23:05,908::task::990::TaskManager.Task::(_decref) Task=`a8393703-1c6f-4046-92a5-dae37ba32888`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 09:23:06,949::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:23:07,042::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.035337 s, 29.0 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:23:09,054::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:23:09,138::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0282753 s, 36.2 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:23:11,154::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:23:11,287::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0766724 s, 13.4 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-10 09:23:11,698::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/metadata bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-10 09:23:11,722::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00063642 s, 6.4 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 09:23:11,802::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-14::DEBUG::2014-07-10 09:23:11,803::task::595::TaskManager.Task::(_updateState) Task=`0e3b2fc5-6a90-4a56-8967-bf0c367e76f4`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 09:23:11,803::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-14::INFO::2014-07-10 09:23:11,804::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:23:11,804::task::1185::TaskManager.Task::(prepare) Task=`0e3b2fc5-6a90-4a56-8967-bf0c367e76f4`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:23:11,804::task::595::TaskManager.Task::(_updateState) Task=`0e3b2fc5-6a90-4a56-8967-bf0c367e76f4`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 09:23:11,805::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 09:23:11,805::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 09:23:11,805::task::990::TaskManager.Task::(_decref) Task=`0e3b2fc5-6a90-4a56-8967-bf0c367e76f4`::ref 0 aborting False >Thread-34::DEBUG::2014-07-10 09:23:11,809::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-34::DEBUG::2014-07-10 09:23:11,810::task::595::TaskManager.Task::(_updateState) Task=`ab4c7e0c-7486-4dc3-a2f5-e5e0efa67b47`::moving from state init -> state preparing >Thread-34::INFO::2014-07-10 09:23:11,810::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-34::DEBUG::2014-07-10 09:23:11,810::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`66fb32f4-edd2-422f-8ba7-1800fc9fc43a`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-10 09:23:11,811::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' for lock type 'shared' >Thread-34::DEBUG::2014-07-10 09:23:11,811::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-10 09:23:11,811::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`66fb32f4-edd2-422f-8ba7-1800fc9fc43a`::Granted request >Thread-34::DEBUG::2014-07-10 09:23:11,812::task::827::TaskManager.Task::(resourceAcquired) Task=`ab4c7e0c-7486-4dc3-a2f5-e5e0efa67b47`::_resourcesAcquired: Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee (shared) >Thread-34::DEBUG::2014-07-10 09:23:11,812::task::990::TaskManager.Task::(_decref) Task=`ab4c7e0c-7486-4dc3-a2f5-e5e0efa67b47`::ref 1 aborting False >Thread-34::INFO::2014-07-10 09:23:11,813::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532067385344', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:23:11,813::task::1185::TaskManager.Task::(prepare) Task=`ab4c7e0c-7486-4dc3-a2f5-e5e0efa67b47`::finished: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532067385344', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:23:11,814::task::595::TaskManager.Task::(_updateState) Task=`ab4c7e0c-7486-4dc3-a2f5-e5e0efa67b47`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-10 09:23:11,814::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee': < ResourceRef 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-10 09:23:11,814::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-10 09:23:11,814::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' >Thread-34::DEBUG::2014-07-10 09:23:11,815::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' (0 active users) >Thread-34::DEBUG::2014-07-10 09:23:11,815::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-10 09:23:11,815::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', Clearing records. >Thread-34::DEBUG::2014-07-10 09:23:11,815::task::990::TaskManager.Task::(_decref) Task=`ab4c7e0c-7486-4dc3-a2f5-e5e0efa67b47`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 09:23:13,302::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:23:13,399::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0367504 s, 27.9 MB/s\n'; <rc> = 0 >Thread-40::DEBUG::2014-07-10 09:23:14,133::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lion.qa.lab.tlv.redhat.com:_export_yuri2_backup2/6a70504d-00df-4869-8695-0f442053f6b6/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-40::DEBUG::2014-07-10 09:23:14,154::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n369 bytes (369 B) copied, 0.000450536 s, 819 kB/s\n'; <rc> = 0 >Thread-57::DEBUG::2014-07-10 09:23:14,801::task::595::TaskManager.Task::(_updateState) Task=`0f7656a5-7555-462f-be2c-b5fc3db1587d`::moving from state init -> state preparing >Thread-57::INFO::2014-07-10 09:23:14,801::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='b6f6c0da-e67f-4902-b9ac-3069571a42fe', volUUID='c4cd1da8-05b7-45e0-80b1-1183d21443d9', options=None) >Thread-57::INFO::2014-07-10 09:23:14,802::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-57::DEBUG::2014-07-10 09:23:14,802::task::1185::TaskManager.Task::(prepare) Task=`0f7656a5-7555-462f-be2c-b5fc3db1587d`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-57::DEBUG::2014-07-10 09:23:14,802::task::595::TaskManager.Task::(_updateState) Task=`0f7656a5-7555-462f-be2c-b5fc3db1587d`::moving from state preparing -> state finished >Thread-57::DEBUG::2014-07-10 09:23:14,803::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-57::DEBUG::2014-07-10 09:23:14,803::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-57::DEBUG::2014-07-10 09:23:14,803::task::990::TaskManager.Task::(_decref) Task=`0f7656a5-7555-462f-be2c-b5fc3db1587d`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 09:23:15,415::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:23:15,550::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0367053 s, 27.9 MB/s\n'; <rc> = 0 >Thread-67::DEBUG::2014-07-10 09:23:15,763::task::595::TaskManager.Task::(_updateState) Task=`f19a8eb9-cc74-4048-9683-520b9375bee0`::moving from state init -> state preparing >Thread-67::INFO::2014-07-10 09:23:15,764::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='f30c2cb7-a43a-4bf5-82b5-cfe07336f65c', volUUID='b0fbb3c9-55af-4a3a-95ad-fc56a80b9cf5', options=None) >Thread-67::INFO::2014-07-10 09:23:15,764::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-67::DEBUG::2014-07-10 09:23:15,765::task::1185::TaskManager.Task::(prepare) Task=`f19a8eb9-cc74-4048-9683-520b9375bee0`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-67::DEBUG::2014-07-10 09:23:15,765::task::595::TaskManager.Task::(_updateState) Task=`f19a8eb9-cc74-4048-9683-520b9375bee0`::moving from state preparing -> state finished >Thread-67::DEBUG::2014-07-10 09:23:15,765::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-67::DEBUG::2014-07-10 09:23:15,765::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-67::DEBUG::2014-07-10 09:23:15,766::task::990::TaskManager.Task::(_decref) Task=`f19a8eb9-cc74-4048-9683-520b9375bee0`::ref 0 aborting False >Thread-48::DEBUG::2014-07-10 09:23:16,196::task::595::TaskManager.Task::(_updateState) Task=`917d0a16-568c-4f54-b3cd-973fa1cd4bc0`::moving from state init -> state preparing >Thread-48::INFO::2014-07-10 09:23:16,196::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='0cd7d6ce-f497-4243-a690-c57744861eea', volUUID='10b6a7dd-dc6c-43fa-ba17-92e4331b0e0b', options=None) >Thread-48::INFO::2014-07-10 09:23:16,197::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-48::DEBUG::2014-07-10 09:23:16,197::task::1185::TaskManager.Task::(prepare) Task=`917d0a16-568c-4f54-b3cd-973fa1cd4bc0`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-48::DEBUG::2014-07-10 09:23:16,197::task::595::TaskManager.Task::(_updateState) Task=`917d0a16-568c-4f54-b3cd-973fa1cd4bc0`::moving from state preparing -> state finished >Thread-48::DEBUG::2014-07-10 09:23:16,197::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-48::DEBUG::2014-07-10 09:23:16,197::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-48::DEBUG::2014-07-10 09:23:16,197::task::990::TaskManager.Task::(_decref) Task=`917d0a16-568c-4f54-b3cd-973fa1cd4bc0`::ref 0 aborting False >Thread-76::DEBUG::2014-07-10 09:23:17,508::task::595::TaskManager.Task::(_updateState) Task=`84a3eb2b-4f3c-4648-96ef-bc1191ee102d`::moving from state init -> state preparing >Thread-76::INFO::2014-07-10 09:23:17,509::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='e4c65229-4247-4b33-b72a-f1d5ce72ad05', volUUID='cad94284-3ca9-4c30-933d-997f4460309e', options=None) >Thread-76::INFO::2014-07-10 09:23:17,509::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-76::DEBUG::2014-07-10 09:23:17,509::task::1185::TaskManager.Task::(prepare) Task=`84a3eb2b-4f3c-4648-96ef-bc1191ee102d`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-76::DEBUG::2014-07-10 09:23:17,510::task::595::TaskManager.Task::(_updateState) Task=`84a3eb2b-4f3c-4648-96ef-bc1191ee102d`::moving from state preparing -> state finished >Thread-76::DEBUG::2014-07-10 09:23:17,510::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-76::DEBUG::2014-07-10 09:23:17,510::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-76::DEBUG::2014-07-10 09:23:17,510::task::990::TaskManager.Task::(_decref) Task=`84a3eb2b-4f3c-4648-96ef-bc1191ee102d`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 09:23:17,570::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:23:17,656::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0271121 s, 37.8 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:23:19,672::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:23:19,757::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.025246 s, 40.6 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 09:23:21,120::task::595::TaskManager.Task::(_updateState) Task=`78ad6036-c3ce-45d1-a29d-d944c4cc3970`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 09:23:21,121::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::INFO::2014-07-10 09:23:21,121::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00063642', 'lastCheck': '9.4', 'valid': True}, '6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000450536', 'lastCheck': '7.0', 'valid': True}} >Thread-14::DEBUG::2014-07-10 09:23:21,121::task::1185::TaskManager.Task::(prepare) Task=`78ad6036-c3ce-45d1-a29d-d944c4cc3970`::finished: {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00063642', 'lastCheck': '9.4', 'valid': True}, '6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000450536', 'lastCheck': '7.0', 'valid': True}} >Thread-14::DEBUG::2014-07-10 09:23:21,122::task::595::TaskManager.Task::(_updateState) Task=`78ad6036-c3ce-45d1-a29d-d944c4cc3970`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 09:23:21,122::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 09:23:21,122::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 09:23:21,122::task::990::TaskManager.Task::(_decref) Task=`78ad6036-c3ce-45d1-a29d-d944c4cc3970`::ref 0 aborting False >Thread-18::DEBUG::2014-07-10 09:23:21,754::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/metadata bs=4096 count=1' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:23:21,776::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Thread-14::DEBUG::2014-07-10 09:23:21,850::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-14::DEBUG::2014-07-10 09:23:21,860::task::595::TaskManager.Task::(_updateState) Task=`ebd33fbc-7c3b-4887-b02b-88974fdc6dd1`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 09:23:21,868::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-14::INFO::2014-07-10 09:23:21,877::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:23:21,884::task::1185::TaskManager.Task::(prepare) Task=`ebd33fbc-7c3b-4887-b02b-88974fdc6dd1`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:23:21,890::task::595::TaskManager.Task::(_updateState) Task=`ebd33fbc-7c3b-4887-b02b-88974fdc6dd1`::moving from state preparing -> state finished >Thread-18::DEBUG::2014-07-10 09:23:21,894::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000727028 s, 5.6 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 09:23:21,894::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 09:23:21,901::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 09:23:21,906::task::990::TaskManager.Task::(_decref) Task=`ebd33fbc-7c3b-4887-b02b-88974fdc6dd1`::ref 0 aborting False >Thread-34::DEBUG::2014-07-10 09:23:21,969::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-34::DEBUG::2014-07-10 09:23:21,979::task::595::TaskManager.Task::(_updateState) Task=`dfa96759-2438-4427-af9c-33fda46fcff9`::moving from state init -> state preparing >Thread-34::INFO::2014-07-10 09:23:21,987::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-34::DEBUG::2014-07-10 09:23:22,000::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`773ef84a-bf1d-4630-9ec3-a2df5286c1e7`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-10 09:23:22,006::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' for lock type 'shared' >Thread-34::DEBUG::2014-07-10 09:23:22,015::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-10 09:23:22,021::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`773ef84a-bf1d-4630-9ec3-a2df5286c1e7`::Granted request >Thread-34::DEBUG::2014-07-10 09:23:22,034::task::827::TaskManager.Task::(resourceAcquired) Task=`dfa96759-2438-4427-af9c-33fda46fcff9`::_resourcesAcquired: Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee (shared) >Thread-34::DEBUG::2014-07-10 09:23:22,040::task::990::TaskManager.Task::(_decref) Task=`dfa96759-2438-4427-af9c-33fda46fcff9`::ref 1 aborting False >Thread-34::INFO::2014-07-10 09:23:22,063::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532067385344', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:23:22,063::task::1185::TaskManager.Task::(prepare) Task=`dfa96759-2438-4427-af9c-33fda46fcff9`::finished: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532067385344', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:23:22,064::task::595::TaskManager.Task::(_updateState) Task=`dfa96759-2438-4427-af9c-33fda46fcff9`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-10 09:23:22,065::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee': < ResourceRef 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-10 09:23:22,066::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-10 09:23:22,067::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' >Thread-34::DEBUG::2014-07-10 09:23:22,068::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' (0 active users) >Thread-34::DEBUG::2014-07-10 09:23:22,069::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-10 09:23:22,070::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', Clearing records. >Thread-34::DEBUG::2014-07-10 09:23:22,072::task::990::TaskManager.Task::(_decref) Task=`dfa96759-2438-4427-af9c-33fda46fcff9`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 09:23:22,176::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.333861 s, 3.1 MB/s\n'; <rc> = 0 >Thread-40::DEBUG::2014-07-10 09:23:24,184::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lion.qa.lab.tlv.redhat.com:_export_yuri2_backup2/6a70504d-00df-4869-8695-0f442053f6b6/dom_md/metadata bs=4096 count=1' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:23:24,208::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Thread-40::DEBUG::2014-07-10 09:23:24,233::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n369 bytes (369 B) copied, 0.000404425 s, 912 kB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:23:24,346::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0763307 s, 13.4 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:23:26,361::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:23:26,538::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0511975 s, 20.0 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:23:28,554::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:23:28,640::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0292998 s, 34.9 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:23:30,656::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:23:30,791::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0775707 s, 13.2 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 09:23:32,102::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-14::DEBUG::2014-07-10 09:23:32,103::task::595::TaskManager.Task::(_updateState) Task=`9d2c0259-f1ed-44e4-bfdb-4681bbd0211b`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 09:23:32,103::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-14::INFO::2014-07-10 09:23:32,104::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:23:32,104::task::1185::TaskManager.Task::(prepare) Task=`9d2c0259-f1ed-44e4-bfdb-4681bbd0211b`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:23:32,104::task::595::TaskManager.Task::(_updateState) Task=`9d2c0259-f1ed-44e4-bfdb-4681bbd0211b`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 09:23:32,104::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 09:23:32,104::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 09:23:32,105::task::990::TaskManager.Task::(_decref) Task=`9d2c0259-f1ed-44e4-bfdb-4681bbd0211b`::ref 0 aborting False >Thread-34::DEBUG::2014-07-10 09:23:32,109::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-34::DEBUG::2014-07-10 09:23:32,109::task::595::TaskManager.Task::(_updateState) Task=`f4c25fa2-ae6d-41d8-aed0-d3ea88f2e8e8`::moving from state init -> state preparing >Thread-34::INFO::2014-07-10 09:23:32,109::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-34::DEBUG::2014-07-10 09:23:32,110::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`05b98843-8107-4b58-aece-bf1f2967e7f6`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-10 09:23:32,110::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' for lock type 'shared' >Thread-34::DEBUG::2014-07-10 09:23:32,111::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-10 09:23:32,111::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`05b98843-8107-4b58-aece-bf1f2967e7f6`::Granted request >Thread-34::DEBUG::2014-07-10 09:23:32,111::task::827::TaskManager.Task::(resourceAcquired) Task=`f4c25fa2-ae6d-41d8-aed0-d3ea88f2e8e8`::_resourcesAcquired: Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee (shared) >Thread-34::DEBUG::2014-07-10 09:23:32,111::task::990::TaskManager.Task::(_decref) Task=`f4c25fa2-ae6d-41d8-aed0-d3ea88f2e8e8`::ref 1 aborting False >Thread-34::INFO::2014-07-10 09:23:32,112::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532067385344', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:23:32,113::task::1185::TaskManager.Task::(prepare) Task=`f4c25fa2-ae6d-41d8-aed0-d3ea88f2e8e8`::finished: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532067385344', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:23:32,113::task::595::TaskManager.Task::(_updateState) Task=`f4c25fa2-ae6d-41d8-aed0-d3ea88f2e8e8`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-10 09:23:32,113::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee': < ResourceRef 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-10 09:23:32,113::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-10 09:23:32,113::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' >Thread-34::DEBUG::2014-07-10 09:23:32,114::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' (0 active users) >Thread-34::DEBUG::2014-07-10 09:23:32,114::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-10 09:23:32,114::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', Clearing records. >Thread-34::DEBUG::2014-07-10 09:23:32,114::task::990::TaskManager.Task::(_decref) Task=`f4c25fa2-ae6d-41d8-aed0-d3ea88f2e8e8`::ref 0 aborting False >Thread-18::DEBUG::2014-07-10 09:23:32,116::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/metadata bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-10 09:23:32,138::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000581124 s, 7.0 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:23:32,806::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:23:32,906::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0351954 s, 29.1 MB/s\n'; <rc> = 0 >Thread-40::DEBUG::2014-07-10 09:23:34,259::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lion.qa.lab.tlv.redhat.com:_export_yuri2_backup2/6a70504d-00df-4869-8695-0f442053f6b6/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-40::DEBUG::2014-07-10 09:23:34,280::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n369 bytes (369 B) copied, 0.000601632 s, 613 kB/s\n'; <rc> = 0 >Thread-70::DEBUG::2014-07-10 09:23:34,891::task::595::TaskManager.Task::(_updateState) Task=`44bf6aff-2b19-40de-8fd8-179d40729f01`::moving from state init -> state preparing >Thread-70::INFO::2014-07-10 09:23:34,892::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='cfaeead2-7caa-467c-b389-c89840ae6605', volUUID='567fe32d-31a6-4ff6-90f3-fd6a656fbecc', options=None) >Thread-70::INFO::2014-07-10 09:23:34,892::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-70::DEBUG::2014-07-10 09:23:34,892::task::1185::TaskManager.Task::(prepare) Task=`44bf6aff-2b19-40de-8fd8-179d40729f01`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-70::DEBUG::2014-07-10 09:23:34,893::task::595::TaskManager.Task::(_updateState) Task=`44bf6aff-2b19-40de-8fd8-179d40729f01`::moving from state preparing -> state finished >Thread-70::DEBUG::2014-07-10 09:23:34,893::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-70::DEBUG::2014-07-10 09:23:34,893::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-70::DEBUG::2014-07-10 09:23:34,893::task::990::TaskManager.Task::(_decref) Task=`44bf6aff-2b19-40de-8fd8-179d40729f01`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 09:23:34,924::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:23:35,018::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0359237 s, 28.5 MB/s\n'; <rc> = 0 >Thread-60::DEBUG::2014-07-10 09:23:35,839::task::595::TaskManager.Task::(_updateState) Task=`29eaa900-42d8-42ba-ad2f-4d389e91da56`::moving from state init -> state preparing >Thread-60::INFO::2014-07-10 09:23:35,840::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='b034d5b0-e1e0-4011-b49b-4d45ddb11556', volUUID='3d7f62b5-328f-4d8e-8b69-873cfb5ae14d', options=None) >Thread-60::INFO::2014-07-10 09:23:35,840::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-60::DEBUG::2014-07-10 09:23:35,840::task::1185::TaskManager.Task::(prepare) Task=`29eaa900-42d8-42ba-ad2f-4d389e91da56`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-60::DEBUG::2014-07-10 09:23:35,841::task::595::TaskManager.Task::(_updateState) Task=`29eaa900-42d8-42ba-ad2f-4d389e91da56`::moving from state preparing -> state finished >Thread-60::DEBUG::2014-07-10 09:23:35,841::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-60::DEBUG::2014-07-10 09:23:35,841::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-60::DEBUG::2014-07-10 09:23:35,841::task::990::TaskManager.Task::(_decref) Task=`29eaa900-42d8-42ba-ad2f-4d389e91da56`::ref 0 aborting False >Thread-51::DEBUG::2014-07-10 09:23:36,009::task::595::TaskManager.Task::(_updateState) Task=`9aa9e33b-0397-4af0-935d-3b7d8fa0daa4`::moving from state init -> state preparing >Thread-51::INFO::2014-07-10 09:23:36,010::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='76fdb054-02cd-42ed-9721-b3e65b34c3a4', volUUID='022dfe46-2cf7-4915-80b3-883158e3ca83', options=None) >Thread-51::INFO::2014-07-10 09:23:36,010::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-51::DEBUG::2014-07-10 09:23:36,010::task::1185::TaskManager.Task::(prepare) Task=`9aa9e33b-0397-4af0-935d-3b7d8fa0daa4`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-51::DEBUG::2014-07-10 09:23:36,011::task::595::TaskManager.Task::(_updateState) Task=`9aa9e33b-0397-4af0-935d-3b7d8fa0daa4`::moving from state preparing -> state finished >Thread-51::DEBUG::2014-07-10 09:23:36,011::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-51::DEBUG::2014-07-10 09:23:36,011::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-51::DEBUG::2014-07-10 09:23:36,011::task::990::TaskManager.Task::(_decref) Task=`9aa9e33b-0397-4af0-935d-3b7d8fa0daa4`::ref 0 aborting False >Thread-14::DEBUG::2014-07-10 09:23:36,338::task::595::TaskManager.Task::(_updateState) Task=`9b652da8-39f8-437b-ad8d-6482b8d53387`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 09:23:36,338::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::INFO::2014-07-10 09:23:36,339::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000581124', 'lastCheck': '4.2', 'valid': True}, '6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000601632', 'lastCheck': '2.0', 'valid': True}} >Thread-14::DEBUG::2014-07-10 09:23:36,339::task::1185::TaskManager.Task::(prepare) Task=`9b652da8-39f8-437b-ad8d-6482b8d53387`::finished: {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000581124', 'lastCheck': '4.2', 'valid': True}, '6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000601632', 'lastCheck': '2.0', 'valid': True}} >Thread-14::DEBUG::2014-07-10 09:23:36,339::task::595::TaskManager.Task::(_updateState) Task=`9b652da8-39f8-437b-ad8d-6482b8d53387`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 09:23:36,339::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 09:23:36,340::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 09:23:36,340::task::990::TaskManager.Task::(_decref) Task=`9b652da8-39f8-437b-ad8d-6482b8d53387`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 09:23:37,035::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:23:37,127::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0321078 s, 31.9 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:23:39,142::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:23:39,238::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0355984 s, 28.8 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:23:41,254::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:23:41,377::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0660787 s, 15.5 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 09:23:42,152::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-14::DEBUG::2014-07-10 09:23:42,153::task::595::TaskManager.Task::(_updateState) Task=`cc70d4b6-54c4-4ef8-aefa-d9f9a4f6f82b`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 09:23:42,154::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-14::INFO::2014-07-10 09:23:42,154::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:23:42,154::task::1185::TaskManager.Task::(prepare) Task=`cc70d4b6-54c4-4ef8-aefa-d9f9a4f6f82b`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:23:42,155::task::595::TaskManager.Task::(_updateState) Task=`cc70d4b6-54c4-4ef8-aefa-d9f9a4f6f82b`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 09:23:42,155::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 09:23:42,155::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 09:23:42,155::task::990::TaskManager.Task::(_decref) Task=`cc70d4b6-54c4-4ef8-aefa-d9f9a4f6f82b`::ref 0 aborting False >Thread-34::DEBUG::2014-07-10 09:23:42,159::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-34::DEBUG::2014-07-10 09:23:42,160::task::595::TaskManager.Task::(_updateState) Task=`43a6fdd7-743d-4f96-be30-f3ddb2a6dc01`::moving from state init -> state preparing >Thread-34::INFO::2014-07-10 09:23:42,160::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-34::DEBUG::2014-07-10 09:23:42,161::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`2033a295-40fe-4a5b-9194-d23536796e3c`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-10 09:23:42,161::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' for lock type 'shared' >Thread-34::DEBUG::2014-07-10 09:23:42,161::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-10 09:23:42,162::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`2033a295-40fe-4a5b-9194-d23536796e3c`::Granted request >Thread-34::DEBUG::2014-07-10 09:23:42,162::task::827::TaskManager.Task::(resourceAcquired) Task=`43a6fdd7-743d-4f96-be30-f3ddb2a6dc01`::_resourcesAcquired: Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee (shared) >Thread-34::DEBUG::2014-07-10 09:23:42,162::task::990::TaskManager.Task::(_decref) Task=`43a6fdd7-743d-4f96-be30-f3ddb2a6dc01`::ref 1 aborting False >Thread-34::INFO::2014-07-10 09:23:42,163::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532067385344', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:23:42,164::task::1185::TaskManager.Task::(prepare) Task=`43a6fdd7-743d-4f96-be30-f3ddb2a6dc01`::finished: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532067385344', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:23:42,164::task::595::TaskManager.Task::(_updateState) Task=`43a6fdd7-743d-4f96-be30-f3ddb2a6dc01`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-10 09:23:42,164::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee': < ResourceRef 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-10 09:23:42,164::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-10 09:23:42,165::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' >Thread-34::DEBUG::2014-07-10 09:23:42,165::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' (0 active users) >Thread-34::DEBUG::2014-07-10 09:23:42,165::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-10 09:23:42,165::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', Clearing records. >Thread-34::DEBUG::2014-07-10 09:23:42,165::task::990::TaskManager.Task::(_decref) Task=`43a6fdd7-743d-4f96-be30-f3ddb2a6dc01`::ref 0 aborting False >Thread-18::DEBUG::2014-07-10 09:23:42,167::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/metadata bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-10 09:23:42,190::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000657676 s, 6.2 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:23:43,392::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:23:43,491::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0411455 s, 24.9 MB/s\n'; <rc> = 0 >Thread-40::DEBUG::2014-07-10 09:23:44,321::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lion.qa.lab.tlv.redhat.com:_export_yuri2_backup2/6a70504d-00df-4869-8695-0f442053f6b6/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-40::DEBUG::2014-07-10 09:23:44,343::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n369 bytes (369 B) copied, 0.000539497 s, 684 kB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:23:45,506::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:23:45,644::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0613396 s, 16.7 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:23:47,659::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:23:47,769::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0525114 s, 19.5 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:23:49,784::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:23:49,868::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.027501 s, 37.2 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 09:23:51,555::task::595::TaskManager.Task::(_updateState) Task=`8dacda6a-2ec8-43f8-91a2-d6be05baaab5`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 09:23:51,555::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::INFO::2014-07-10 09:23:51,556::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000657676', 'lastCheck': '9.3', 'valid': True}, '6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000539497', 'lastCheck': '7.2', 'valid': True}} >Thread-14::DEBUG::2014-07-10 09:23:51,556::task::1185::TaskManager.Task::(prepare) Task=`8dacda6a-2ec8-43f8-91a2-d6be05baaab5`::finished: {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000657676', 'lastCheck': '9.3', 'valid': True}, '6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000539497', 'lastCheck': '7.2', 'valid': True}} >Thread-14::DEBUG::2014-07-10 09:23:51,556::task::595::TaskManager.Task::(_updateState) Task=`8dacda6a-2ec8-43f8-91a2-d6be05baaab5`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 09:23:51,556::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 09:23:51,557::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 09:23:51,557::task::990::TaskManager.Task::(_decref) Task=`8dacda6a-2ec8-43f8-91a2-d6be05baaab5`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 09:23:51,884::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:23:51,984::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0369189 s, 27.7 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 09:23:52,219::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-14::DEBUG::2014-07-10 09:23:52,220::task::595::TaskManager.Task::(_updateState) Task=`9cf14d08-bb24-4af5-a82a-f7ce409ae21c`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 09:23:52,221::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-14::INFO::2014-07-10 09:23:52,221::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:23:52,221::task::1185::TaskManager.Task::(prepare) Task=`9cf14d08-bb24-4af5-a82a-f7ce409ae21c`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:23:52,222::task::595::TaskManager.Task::(_updateState) Task=`9cf14d08-bb24-4af5-a82a-f7ce409ae21c`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 09:23:52,222::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 09:23:52,222::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 09:23:52,222::task::990::TaskManager.Task::(_decref) Task=`9cf14d08-bb24-4af5-a82a-f7ce409ae21c`::ref 0 aborting False >Thread-18::DEBUG::2014-07-10 09:23:52,237::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/metadata bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-10 09:23:52,257::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000526813 s, 7.8 MB/s\n'; <rc> = 0 >Thread-34::DEBUG::2014-07-10 09:23:52,271::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-34::DEBUG::2014-07-10 09:23:52,278::task::595::TaskManager.Task::(_updateState) Task=`e1ee2314-b352-4f93-b11f-5eb02b812237`::moving from state init -> state preparing >Thread-34::INFO::2014-07-10 09:23:52,281::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-34::DEBUG::2014-07-10 09:23:52,295::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`611a236e-0a5e-4092-8163-3e01c1eb897e`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-10 09:23:52,297::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' for lock type 'shared' >Thread-34::DEBUG::2014-07-10 09:23:52,302::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-10 09:23:52,304::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`611a236e-0a5e-4092-8163-3e01c1eb897e`::Granted request >Thread-34::DEBUG::2014-07-10 09:23:52,316::task::827::TaskManager.Task::(resourceAcquired) Task=`e1ee2314-b352-4f93-b11f-5eb02b812237`::_resourcesAcquired: Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee (shared) >Thread-34::DEBUG::2014-07-10 09:23:52,323::task::990::TaskManager.Task::(_decref) Task=`e1ee2314-b352-4f93-b11f-5eb02b812237`::ref 1 aborting False >Thread-34::INFO::2014-07-10 09:23:52,349::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532067385344', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:23:52,351::task::1185::TaskManager.Task::(prepare) Task=`e1ee2314-b352-4f93-b11f-5eb02b812237`::finished: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532067385344', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:23:52,354::task::595::TaskManager.Task::(_updateState) Task=`e1ee2314-b352-4f93-b11f-5eb02b812237`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-10 09:23:52,356::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee': < ResourceRef 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-10 09:23:52,359::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-10 09:23:52,364::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' >Thread-34::DEBUG::2014-07-10 09:23:52,368::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' (0 active users) >Thread-34::DEBUG::2014-07-10 09:23:52,370::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-10 09:23:52,372::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', Clearing records. >Thread-34::DEBUG::2014-07-10 09:23:52,377::task::990::TaskManager.Task::(_decref) Task=`e1ee2314-b352-4f93-b11f-5eb02b812237`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 09:23:53,999::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:23:54,130::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0521086 s, 19.7 MB/s\n'; <rc> = 0 >Thread-40::DEBUG::2014-07-10 09:23:54,373::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lion.qa.lab.tlv.redhat.com:_export_yuri2_backup2/6a70504d-00df-4869-8695-0f442053f6b6/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-40::DEBUG::2014-07-10 09:23:54,393::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n369 bytes (369 B) copied, 0.000471048 s, 783 kB/s\n'; <rc> = 0 >Thread-64::DEBUG::2014-07-10 09:23:54,971::task::595::TaskManager.Task::(_updateState) Task=`f4612ae6-aedc-4ad3-b239-a04d35912f10`::moving from state init -> state preparing >Thread-64::INFO::2014-07-10 09:23:54,972::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='aa20346a-4d3a-4e07-b8e1-52c0ebe4168c', volUUID='58fefce2-9bce-4bff-8949-8c6ce8122b27', options=None) >Thread-64::INFO::2014-07-10 09:23:54,972::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-64::DEBUG::2014-07-10 09:23:54,973::task::1185::TaskManager.Task::(prepare) Task=`f4612ae6-aedc-4ad3-b239-a04d35912f10`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-64::DEBUG::2014-07-10 09:23:54,973::task::595::TaskManager.Task::(_updateState) Task=`f4612ae6-aedc-4ad3-b239-a04d35912f10`::moving from state preparing -> state finished >Thread-64::DEBUG::2014-07-10 09:23:54,973::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-64::DEBUG::2014-07-10 09:23:54,973::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-64::DEBUG::2014-07-10 09:23:54,973::task::990::TaskManager.Task::(_decref) Task=`f4612ae6-aedc-4ad3-b239-a04d35912f10`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 09:23:56,146::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:23:56,233::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0294156 s, 34.8 MB/s\n'; <rc> = 0 >Thread-54::DEBUG::2014-07-10 09:23:56,601::task::595::TaskManager.Task::(_updateState) Task=`e06e2dfd-ba42-44fe-b7c4-1f07bac4b79c`::moving from state init -> state preparing >Thread-73::DEBUG::2014-07-10 09:23:56,602::task::595::TaskManager.Task::(_updateState) Task=`8b306951-cf64-401b-8065-c91d8590376a`::moving from state init -> state preparing >Thread-54::INFO::2014-07-10 09:23:56,603::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='28408446-e5fd-4565-a976-e760951593fe', volUUID='776303a2-5585-451e-826e-0e338d4a1e98', options=None) >Thread-73::INFO::2014-07-10 09:23:56,604::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='c01d693b-cba0-4fed-9ad7-0aaa28912a19', volUUID='4bb5d954-2a50-4028-b299-0b43c261270c', options=None) >Thread-54::INFO::2014-07-10 09:23:56,605::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-73::INFO::2014-07-10 09:23:56,606::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-54::DEBUG::2014-07-10 09:23:56,606::task::1185::TaskManager.Task::(prepare) Task=`e06e2dfd-ba42-44fe-b7c4-1f07bac4b79c`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-73::DEBUG::2014-07-10 09:23:56,607::task::1185::TaskManager.Task::(prepare) Task=`8b306951-cf64-401b-8065-c91d8590376a`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-54::DEBUG::2014-07-10 09:23:56,609::task::595::TaskManager.Task::(_updateState) Task=`e06e2dfd-ba42-44fe-b7c4-1f07bac4b79c`::moving from state preparing -> state finished >Thread-73::DEBUG::2014-07-10 09:23:56,619::task::595::TaskManager.Task::(_updateState) Task=`8b306951-cf64-401b-8065-c91d8590376a`::moving from state preparing -> state finished >Thread-54::DEBUG::2014-07-10 09:23:56,620::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-73::DEBUG::2014-07-10 09:23:56,621::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-54::DEBUG::2014-07-10 09:23:56,621::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-73::DEBUG::2014-07-10 09:23:56,622::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-54::DEBUG::2014-07-10 09:23:56,623::task::990::TaskManager.Task::(_decref) Task=`e06e2dfd-ba42-44fe-b7c4-1f07bac4b79c`::ref 0 aborting False >Thread-73::DEBUG::2014-07-10 09:23:56,623::task::990::TaskManager.Task::(_decref) Task=`8b306951-cf64-401b-8065-c91d8590376a`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 09:23:58,248::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:23:58,338::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0307427 s, 33.3 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:24:00,353::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:24:00,450::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0355624 s, 28.8 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-10 09:24:02,407::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/metadata bs=4096 count=1' (cwd None) >Thread-14::DEBUG::2014-07-10 09:24:02,433::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-14::DEBUG::2014-07-10 09:24:02,442::task::595::TaskManager.Task::(_updateState) Task=`5ce88e5d-beae-4d64-b962-3e252060d2e2`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 09:24:02,446::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-14::INFO::2014-07-10 09:24:02,451::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:24:02,454::task::1185::TaskManager.Task::(prepare) Task=`5ce88e5d-beae-4d64-b962-3e252060d2e2`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:24:02,457::task::595::TaskManager.Task::(_updateState) Task=`5ce88e5d-beae-4d64-b962-3e252060d2e2`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 09:24:02,460::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 09:24:02,462::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 09:24:02,465::task::990::TaskManager.Task::(_decref) Task=`5ce88e5d-beae-4d64-b962-3e252060d2e2`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 09:24:02,476::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Thread-18::DEBUG::2014-07-10 09:24:02,501::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000702626 s, 5.8 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:24:02,653::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.116454 s, 8.8 MB/s\n'; <rc> = 0 >Thread-34::DEBUG::2014-07-10 09:24:02,671::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-34::DEBUG::2014-07-10 09:24:02,672::task::595::TaskManager.Task::(_updateState) Task=`234e4f5c-3043-4ab6-9edc-cd2ea08a0677`::moving from state init -> state preparing >Thread-34::INFO::2014-07-10 09:24:02,672::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-34::DEBUG::2014-07-10 09:24:02,673::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`d4e6eff4-3f9e-42a4-8997-e35c927e5005`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-10 09:24:02,673::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' for lock type 'shared' >Thread-34::DEBUG::2014-07-10 09:24:02,674::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-10 09:24:02,674::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`d4e6eff4-3f9e-42a4-8997-e35c927e5005`::Granted request >Thread-34::DEBUG::2014-07-10 09:24:02,675::task::827::TaskManager.Task::(resourceAcquired) Task=`234e4f5c-3043-4ab6-9edc-cd2ea08a0677`::_resourcesAcquired: Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee (shared) >Thread-34::DEBUG::2014-07-10 09:24:02,675::task::990::TaskManager.Task::(_decref) Task=`234e4f5c-3043-4ab6-9edc-cd2ea08a0677`::ref 1 aborting False >Thread-34::INFO::2014-07-10 09:24:02,676::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532067385344', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:24:02,676::task::1185::TaskManager.Task::(prepare) Task=`234e4f5c-3043-4ab6-9edc-cd2ea08a0677`::finished: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532067385344', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:24:02,676::task::595::TaskManager.Task::(_updateState) Task=`234e4f5c-3043-4ab6-9edc-cd2ea08a0677`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-10 09:24:02,677::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee': < ResourceRef 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-10 09:24:02,677::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-10 09:24:02,677::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' >Thread-34::DEBUG::2014-07-10 09:24:02,677::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' (0 active users) >Thread-34::DEBUG::2014-07-10 09:24:02,678::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-10 09:24:02,678::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', Clearing records. >Thread-34::DEBUG::2014-07-10 09:24:02,678::task::990::TaskManager.Task::(_decref) Task=`234e4f5c-3043-4ab6-9edc-cd2ea08a0677`::ref 0 aborting False >Thread-40::DEBUG::2014-07-10 09:24:04,419::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lion.qa.lab.tlv.redhat.com:_export_yuri2_backup2/6a70504d-00df-4869-8695-0f442053f6b6/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-40::DEBUG::2014-07-10 09:24:04,440::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n369 bytes (369 B) copied, 0.000443233 s, 833 kB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:24:04,668::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:24:04,765::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0346646 s, 29.5 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 09:24:06,739::task::595::TaskManager.Task::(_updateState) Task=`7ff42696-4b45-4bd8-a1f3-6e9843a60925`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 09:24:06,739::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::INFO::2014-07-10 09:24:06,740::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000702626', 'lastCheck': '4.2', 'valid': True}, '6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000443233', 'lastCheck': '2.3', 'valid': True}} >Thread-14::DEBUG::2014-07-10 09:24:06,740::task::1185::TaskManager.Task::(prepare) Task=`7ff42696-4b45-4bd8-a1f3-6e9843a60925`::finished: {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000702626', 'lastCheck': '4.2', 'valid': True}, '6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000443233', 'lastCheck': '2.3', 'valid': True}} >Thread-14::DEBUG::2014-07-10 09:24:06,740::task::595::TaskManager.Task::(_updateState) Task=`7ff42696-4b45-4bd8-a1f3-6e9843a60925`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 09:24:06,741::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 09:24:06,741::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 09:24:06,741::task::990::TaskManager.Task::(_decref) Task=`7ff42696-4b45-4bd8-a1f3-6e9843a60925`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 09:24:06,781::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:24:06,883::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0456968 s, 22.4 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:24:08,911::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:24:09,082::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.047168 s, 21.7 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:24:11,097::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:24:11,209::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0526706 s, 19.4 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-10 09:24:12,529::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/metadata bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-10 09:24:12,551::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000990857 s, 4.1 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 09:24:12,729::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-14::DEBUG::2014-07-10 09:24:12,730::task::595::TaskManager.Task::(_updateState) Task=`dc972758-2f7b-48a7-bb38-b86f18373b2f`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 09:24:12,731::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-14::INFO::2014-07-10 09:24:12,731::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:24:12,731::task::1185::TaskManager.Task::(prepare) Task=`dc972758-2f7b-48a7-bb38-b86f18373b2f`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:24:12,731::task::595::TaskManager.Task::(_updateState) Task=`dc972758-2f7b-48a7-bb38-b86f18373b2f`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 09:24:12,732::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 09:24:12,732::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 09:24:12,732::task::990::TaskManager.Task::(_decref) Task=`dc972758-2f7b-48a7-bb38-b86f18373b2f`::ref 0 aborting False >Thread-34::DEBUG::2014-07-10 09:24:12,736::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-34::DEBUG::2014-07-10 09:24:12,737::task::595::TaskManager.Task::(_updateState) Task=`5a7a195a-d8ac-413e-a512-13cb435c51b8`::moving from state init -> state preparing >Thread-34::INFO::2014-07-10 09:24:12,737::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-34::DEBUG::2014-07-10 09:24:12,738::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`5bceb329-aaeb-42bb-803c-96844d45f76e`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-10 09:24:12,738::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' for lock type 'shared' >Thread-34::DEBUG::2014-07-10 09:24:12,738::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-10 09:24:12,739::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`5bceb329-aaeb-42bb-803c-96844d45f76e`::Granted request >Thread-34::DEBUG::2014-07-10 09:24:12,739::task::827::TaskManager.Task::(resourceAcquired) Task=`5a7a195a-d8ac-413e-a512-13cb435c51b8`::_resourcesAcquired: Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee (shared) >Thread-34::DEBUG::2014-07-10 09:24:12,739::task::990::TaskManager.Task::(_decref) Task=`5a7a195a-d8ac-413e-a512-13cb435c51b8`::ref 1 aborting False >Thread-34::INFO::2014-07-10 09:24:12,740::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532067385344', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:24:12,741::task::1185::TaskManager.Task::(prepare) Task=`5a7a195a-d8ac-413e-a512-13cb435c51b8`::finished: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532067385344', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:24:12,741::task::595::TaskManager.Task::(_updateState) Task=`5a7a195a-d8ac-413e-a512-13cb435c51b8`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-10 09:24:12,741::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee': < ResourceRef 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-10 09:24:12,741::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-10 09:24:12,742::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' >Thread-34::DEBUG::2014-07-10 09:24:12,742::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' (0 active users) >Thread-34::DEBUG::2014-07-10 09:24:12,742::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-10 09:24:12,742::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', Clearing records. >Thread-34::DEBUG::2014-07-10 09:24:12,742::task::990::TaskManager.Task::(_decref) Task=`5a7a195a-d8ac-413e-a512-13cb435c51b8`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 09:24:13,225::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:24:13,317::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0268248 s, 38.2 MB/s\n'; <rc> = 0 >Thread-40::DEBUG::2014-07-10 09:24:14,471::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lion.qa.lab.tlv.redhat.com:_export_yuri2_backup2/6a70504d-00df-4869-8695-0f442053f6b6/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-40::DEBUG::2014-07-10 09:24:14,509::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n369 bytes (369 B) copied, 0.000415986 s, 887 kB/s\n'; <rc> = 0 >Thread-57::DEBUG::2014-07-10 09:24:15,069::task::595::TaskManager.Task::(_updateState) Task=`2efc34a8-ec69-40c7-8b55-42ef23ec0924`::moving from state init -> state preparing >Thread-57::INFO::2014-07-10 09:24:15,070::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='b6f6c0da-e67f-4902-b9ac-3069571a42fe', volUUID='c4cd1da8-05b7-45e0-80b1-1183d21443d9', options=None) >Thread-57::INFO::2014-07-10 09:24:15,071::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-57::DEBUG::2014-07-10 09:24:15,071::task::1185::TaskManager.Task::(prepare) Task=`2efc34a8-ec69-40c7-8b55-42ef23ec0924`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-57::DEBUG::2014-07-10 09:24:15,071::task::595::TaskManager.Task::(_updateState) Task=`2efc34a8-ec69-40c7-8b55-42ef23ec0924`::moving from state preparing -> state finished >Thread-57::DEBUG::2014-07-10 09:24:15,071::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-57::DEBUG::2014-07-10 09:24:15,071::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-57::DEBUG::2014-07-10 09:24:15,072::task::990::TaskManager.Task::(_decref) Task=`2efc34a8-ec69-40c7-8b55-42ef23ec0924`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 09:24:15,332::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:24:15,489::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0993546 s, 10.3 MB/s\n'; <rc> = 0 >Thread-67::DEBUG::2014-07-10 09:24:16,020::task::595::TaskManager.Task::(_updateState) Task=`b4c9c527-bf11-43d2-ae6e-5fbe1702321c`::moving from state init -> state preparing >Thread-67::INFO::2014-07-10 09:24:16,023::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='f30c2cb7-a43a-4bf5-82b5-cfe07336f65c', volUUID='b0fbb3c9-55af-4a3a-95ad-fc56a80b9cf5', options=None) >Thread-67::INFO::2014-07-10 09:24:16,025::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-67::DEBUG::2014-07-10 09:24:16,027::task::1185::TaskManager.Task::(prepare) Task=`b4c9c527-bf11-43d2-ae6e-5fbe1702321c`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-67::DEBUG::2014-07-10 09:24:16,028::task::595::TaskManager.Task::(_updateState) Task=`b4c9c527-bf11-43d2-ae6e-5fbe1702321c`::moving from state preparing -> state finished >Thread-67::DEBUG::2014-07-10 09:24:16,029::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-67::DEBUG::2014-07-10 09:24:16,030::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-67::DEBUG::2014-07-10 09:24:16,030::task::990::TaskManager.Task::(_decref) Task=`b4c9c527-bf11-43d2-ae6e-5fbe1702321c`::ref 0 aborting False >Thread-48::DEBUG::2014-07-10 09:24:16,477::task::595::TaskManager.Task::(_updateState) Task=`1d6c5697-7c5e-424e-b314-13bb8a3b25c0`::moving from state init -> state preparing >Thread-48::INFO::2014-07-10 09:24:16,477::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='0cd7d6ce-f497-4243-a690-c57744861eea', volUUID='10b6a7dd-dc6c-43fa-ba17-92e4331b0e0b', options=None) >Thread-48::INFO::2014-07-10 09:24:16,478::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-48::DEBUG::2014-07-10 09:24:16,478::task::1185::TaskManager.Task::(prepare) Task=`1d6c5697-7c5e-424e-b314-13bb8a3b25c0`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-48::DEBUG::2014-07-10 09:24:16,478::task::595::TaskManager.Task::(_updateState) Task=`1d6c5697-7c5e-424e-b314-13bb8a3b25c0`::moving from state preparing -> state finished >Thread-48::DEBUG::2014-07-10 09:24:16,478::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-48::DEBUG::2014-07-10 09:24:16,479::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-48::DEBUG::2014-07-10 09:24:16,479::task::990::TaskManager.Task::(_decref) Task=`1d6c5697-7c5e-424e-b314-13bb8a3b25c0`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 09:24:17,505::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:24:17,601::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0340648 s, 30.1 MB/s\n'; <rc> = 0 >Thread-76::DEBUG::2014-07-10 09:24:17,795::task::595::TaskManager.Task::(_updateState) Task=`8f3b2532-1e05-4a74-8b81-dd2d6c844b69`::moving from state init -> state preparing >Thread-76::INFO::2014-07-10 09:24:17,799::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='e4c65229-4247-4b33-b72a-f1d5ce72ad05', volUUID='cad94284-3ca9-4c30-933d-997f4460309e', options=None) >Thread-76::INFO::2014-07-10 09:24:17,803::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-76::DEBUG::2014-07-10 09:24:17,805::task::1185::TaskManager.Task::(prepare) Task=`8f3b2532-1e05-4a74-8b81-dd2d6c844b69`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-76::DEBUG::2014-07-10 09:24:17,807::task::595::TaskManager.Task::(_updateState) Task=`8f3b2532-1e05-4a74-8b81-dd2d6c844b69`::moving from state preparing -> state finished >Thread-76::DEBUG::2014-07-10 09:24:17,809::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-76::DEBUG::2014-07-10 09:24:17,811::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-76::DEBUG::2014-07-10 09:24:17,814::task::990::TaskManager.Task::(_decref) Task=`8f3b2532-1e05-4a74-8b81-dd2d6c844b69`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 09:24:19,617::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:24:19,705::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0303439 s, 33.7 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:24:21,720::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:24:21,815::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0342974 s, 29.9 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 09:24:21,931::task::595::TaskManager.Task::(_updateState) Task=`1b88a969-9d03-40e1-8f82-04d0e088a596`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 09:24:21,932::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::INFO::2014-07-10 09:24:21,932::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000990857', 'lastCheck': '9.4', 'valid': True}, '6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000415986', 'lastCheck': '7.4', 'valid': True}} >Thread-14::DEBUG::2014-07-10 09:24:21,932::task::1185::TaskManager.Task::(prepare) Task=`1b88a969-9d03-40e1-8f82-04d0e088a596`::finished: {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000990857', 'lastCheck': '9.4', 'valid': True}, '6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000415986', 'lastCheck': '7.4', 'valid': True}} >Thread-14::DEBUG::2014-07-10 09:24:21,932::task::595::TaskManager.Task::(_updateState) Task=`1b88a969-9d03-40e1-8f82-04d0e088a596`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 09:24:21,933::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 09:24:21,933::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 09:24:21,933::task::990::TaskManager.Task::(_decref) Task=`1b88a969-9d03-40e1-8f82-04d0e088a596`::ref 0 aborting False >Thread-18::DEBUG::2014-07-10 09:24:22,580::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/metadata bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-10 09:24:22,600::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000605707 s, 6.8 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 09:24:22,791::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-14::DEBUG::2014-07-10 09:24:22,792::task::595::TaskManager.Task::(_updateState) Task=`8e981d26-3471-4a25-ac4f-a85e53848e15`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 09:24:22,793::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-14::INFO::2014-07-10 09:24:22,793::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:24:22,793::task::1185::TaskManager.Task::(prepare) Task=`8e981d26-3471-4a25-ac4f-a85e53848e15`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:24:22,794::task::595::TaskManager.Task::(_updateState) Task=`8e981d26-3471-4a25-ac4f-a85e53848e15`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 09:24:22,794::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 09:24:22,794::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 09:24:22,794::task::990::TaskManager.Task::(_decref) Task=`8e981d26-3471-4a25-ac4f-a85e53848e15`::ref 0 aborting False >Thread-34::DEBUG::2014-07-10 09:24:22,838::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-34::DEBUG::2014-07-10 09:24:22,838::task::595::TaskManager.Task::(_updateState) Task=`944eef9b-5d0a-4808-966a-60347e2d7ec3`::moving from state init -> state preparing >Thread-34::INFO::2014-07-10 09:24:22,839::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-34::DEBUG::2014-07-10 09:24:22,839::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`a9a26a22-f9a8-44e2-a9dd-d147ef580848`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-10 09:24:22,840::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' for lock type 'shared' >Thread-34::DEBUG::2014-07-10 09:24:22,840::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-10 09:24:22,840::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`a9a26a22-f9a8-44e2-a9dd-d147ef580848`::Granted request >Thread-34::DEBUG::2014-07-10 09:24:22,841::task::827::TaskManager.Task::(resourceAcquired) Task=`944eef9b-5d0a-4808-966a-60347e2d7ec3`::_resourcesAcquired: Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee (shared) >Thread-34::DEBUG::2014-07-10 09:24:22,841::task::990::TaskManager.Task::(_decref) Task=`944eef9b-5d0a-4808-966a-60347e2d7ec3`::ref 1 aborting False >Thread-34::INFO::2014-07-10 09:24:22,842::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532067385344', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:24:22,842::task::1185::TaskManager.Task::(prepare) Task=`944eef9b-5d0a-4808-966a-60347e2d7ec3`::finished: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532067385344', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:24:22,842::task::595::TaskManager.Task::(_updateState) Task=`944eef9b-5d0a-4808-966a-60347e2d7ec3`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-10 09:24:22,843::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee': < ResourceRef 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-10 09:24:22,843::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-10 09:24:22,843::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' >Thread-34::DEBUG::2014-07-10 09:24:22,843::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' (0 active users) >Thread-34::DEBUG::2014-07-10 09:24:22,843::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-10 09:24:22,844::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', Clearing records. >Thread-34::DEBUG::2014-07-10 09:24:22,844::task::990::TaskManager.Task::(_decref) Task=`944eef9b-5d0a-4808-966a-60347e2d7ec3`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 09:24:23,831::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:24:23,944::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0355437 s, 28.8 MB/s\n'; <rc> = 0 >Thread-40::DEBUG::2014-07-10 09:24:24,541::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lion.qa.lab.tlv.redhat.com:_export_yuri2_backup2/6a70504d-00df-4869-8695-0f442053f6b6/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-40::DEBUG::2014-07-10 09:24:24,563::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n369 bytes (369 B) copied, 0.000436995 s, 844 kB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:24:25,959::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:24:26,065::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0286516 s, 35.7 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:24:28,081::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:24:28,183::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0431111 s, 23.8 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:24:30,206::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:24:30,304::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0390245 s, 26.2 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:24:32,320::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:24:32,415::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0285294 s, 35.9 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-10 09:24:32,628::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/metadata bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-10 09:24:32,650::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000642121 s, 6.4 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 09:24:32,871::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-14::DEBUG::2014-07-10 09:24:32,873::task::595::TaskManager.Task::(_updateState) Task=`3be2519d-9763-4f08-9f3c-2331dcca9b47`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 09:24:32,873::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-14::INFO::2014-07-10 09:24:32,873::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:24:32,874::task::1185::TaskManager.Task::(prepare) Task=`3be2519d-9763-4f08-9f3c-2331dcca9b47`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:24:32,874::task::595::TaskManager.Task::(_updateState) Task=`3be2519d-9763-4f08-9f3c-2331dcca9b47`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 09:24:32,874::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 09:24:32,874::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 09:24:32,874::task::990::TaskManager.Task::(_decref) Task=`3be2519d-9763-4f08-9f3c-2331dcca9b47`::ref 0 aborting False >Thread-34::DEBUG::2014-07-10 09:24:32,879::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-34::DEBUG::2014-07-10 09:24:32,879::task::595::TaskManager.Task::(_updateState) Task=`6b9bc400-c560-4b80-9ebe-76f9d8cf7764`::moving from state init -> state preparing >Thread-34::INFO::2014-07-10 09:24:32,879::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-34::DEBUG::2014-07-10 09:24:32,880::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`3081973e-afd1-4017-93ce-129ab79d65c3`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-10 09:24:32,880::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' for lock type 'shared' >Thread-34::DEBUG::2014-07-10 09:24:32,881::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-10 09:24:32,881::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`3081973e-afd1-4017-93ce-129ab79d65c3`::Granted request >Thread-34::DEBUG::2014-07-10 09:24:32,881::task::827::TaskManager.Task::(resourceAcquired) Task=`6b9bc400-c560-4b80-9ebe-76f9d8cf7764`::_resourcesAcquired: Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee (shared) >Thread-34::DEBUG::2014-07-10 09:24:32,881::task::990::TaskManager.Task::(_decref) Task=`6b9bc400-c560-4b80-9ebe-76f9d8cf7764`::ref 1 aborting False >Thread-34::INFO::2014-07-10 09:24:32,883::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532067385344', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:24:32,883::task::1185::TaskManager.Task::(prepare) Task=`6b9bc400-c560-4b80-9ebe-76f9d8cf7764`::finished: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532067385344', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:24:32,883::task::595::TaskManager.Task::(_updateState) Task=`6b9bc400-c560-4b80-9ebe-76f9d8cf7764`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-10 09:24:32,883::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee': < ResourceRef 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-10 09:24:32,884::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-10 09:24:32,884::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' >Thread-34::DEBUG::2014-07-10 09:24:32,884::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' (0 active users) >Thread-34::DEBUG::2014-07-10 09:24:32,884::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-10 09:24:32,884::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', Clearing records. >Thread-34::DEBUG::2014-07-10 09:24:32,885::task::990::TaskManager.Task::(_decref) Task=`6b9bc400-c560-4b80-9ebe-76f9d8cf7764`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 09:24:34,430::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:24:34,517::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.030391 s, 33.7 MB/s\n'; <rc> = 0 >Thread-40::DEBUG::2014-07-10 09:24:34,596::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lion.qa.lab.tlv.redhat.com:_export_yuri2_backup2/6a70504d-00df-4869-8695-0f442053f6b6/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-40::DEBUG::2014-07-10 09:24:34,621::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n369 bytes (369 B) copied, 0.000699863 s, 527 kB/s\n'; <rc> = 0 >Thread-70::DEBUG::2014-07-10 09:24:35,159::task::595::TaskManager.Task::(_updateState) Task=`750ca684-a54c-4bd1-aecf-e0d8dfb13056`::moving from state init -> state preparing >Thread-70::INFO::2014-07-10 09:24:35,159::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='cfaeead2-7caa-467c-b389-c89840ae6605', volUUID='567fe32d-31a6-4ff6-90f3-fd6a656fbecc', options=None) >Thread-70::INFO::2014-07-10 09:24:35,160::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-70::DEBUG::2014-07-10 09:24:35,160::task::1185::TaskManager.Task::(prepare) Task=`750ca684-a54c-4bd1-aecf-e0d8dfb13056`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-70::DEBUG::2014-07-10 09:24:35,160::task::595::TaskManager.Task::(_updateState) Task=`750ca684-a54c-4bd1-aecf-e0d8dfb13056`::moving from state preparing -> state finished >Thread-70::DEBUG::2014-07-10 09:24:35,160::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-70::DEBUG::2014-07-10 09:24:35,161::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-70::DEBUG::2014-07-10 09:24:35,161::task::990::TaskManager.Task::(_decref) Task=`750ca684-a54c-4bd1-aecf-e0d8dfb13056`::ref 0 aborting False >Thread-60::DEBUG::2014-07-10 09:24:36,096::task::595::TaskManager.Task::(_updateState) Task=`17d49c20-812d-40bb-8125-ab1565bed0b4`::moving from state init -> state preparing >Thread-60::INFO::2014-07-10 09:24:36,096::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='b034d5b0-e1e0-4011-b49b-4d45ddb11556', volUUID='3d7f62b5-328f-4d8e-8b69-873cfb5ae14d', options=None) >Thread-60::INFO::2014-07-10 09:24:36,097::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-60::DEBUG::2014-07-10 09:24:36,097::task::1185::TaskManager.Task::(prepare) Task=`17d49c20-812d-40bb-8125-ab1565bed0b4`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-60::DEBUG::2014-07-10 09:24:36,097::task::595::TaskManager.Task::(_updateState) Task=`17d49c20-812d-40bb-8125-ab1565bed0b4`::moving from state preparing -> state finished >Thread-60::DEBUG::2014-07-10 09:24:36,097::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-60::DEBUG::2014-07-10 09:24:36,097::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-60::DEBUG::2014-07-10 09:24:36,098::task::990::TaskManager.Task::(_decref) Task=`17d49c20-812d-40bb-8125-ab1565bed0b4`::ref 0 aborting False >Thread-51::DEBUG::2014-07-10 09:24:36,261::task::595::TaskManager.Task::(_updateState) Task=`1bca77d9-5541-4ad2-9b54-1c1615cd9445`::moving from state init -> state preparing >Thread-51::INFO::2014-07-10 09:24:36,261::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='76fdb054-02cd-42ed-9721-b3e65b34c3a4', volUUID='022dfe46-2cf7-4915-80b3-883158e3ca83', options=None) >Thread-51::INFO::2014-07-10 09:24:36,262::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-51::DEBUG::2014-07-10 09:24:36,262::task::1185::TaskManager.Task::(prepare) Task=`1bca77d9-5541-4ad2-9b54-1c1615cd9445`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-51::DEBUG::2014-07-10 09:24:36,262::task::595::TaskManager.Task::(_updateState) Task=`1bca77d9-5541-4ad2-9b54-1c1615cd9445`::moving from state preparing -> state finished >Thread-51::DEBUG::2014-07-10 09:24:36,262::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-51::DEBUG::2014-07-10 09:24:36,262::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-51::DEBUG::2014-07-10 09:24:36,263::task::990::TaskManager.Task::(_decref) Task=`1bca77d9-5541-4ad2-9b54-1c1615cd9445`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 09:24:36,548::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:24:36,644::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0346776 s, 29.5 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 09:24:37,139::task::595::TaskManager.Task::(_updateState) Task=`6cf07284-7e06-4ca8-ba08-e60970ba9e2e`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 09:24:37,140::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::INFO::2014-07-10 09:24:37,140::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000642121', 'lastCheck': '4.4', 'valid': True}, '6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000699863', 'lastCheck': '2.5', 'valid': True}} >Thread-14::DEBUG::2014-07-10 09:24:37,141::task::1185::TaskManager.Task::(prepare) Task=`6cf07284-7e06-4ca8-ba08-e60970ba9e2e`::finished: {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000642121', 'lastCheck': '4.4', 'valid': True}, '6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000699863', 'lastCheck': '2.5', 'valid': True}} >Thread-14::DEBUG::2014-07-10 09:24:37,141::task::595::TaskManager.Task::(_updateState) Task=`6cf07284-7e06-4ca8-ba08-e60970ba9e2e`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 09:24:37,141::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 09:24:37,141::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 09:24:37,141::task::990::TaskManager.Task::(_decref) Task=`6cf07284-7e06-4ca8-ba08-e60970ba9e2e`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 09:24:38,659::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:24:38,755::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0358982 s, 28.5 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:24:40,770::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:24:40,860::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0332351 s, 30.8 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-10 09:24:42,699::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/metadata bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-10 09:24:42,721::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000740766 s, 5.5 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:24:42,876::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Thread-14::DEBUG::2014-07-10 09:24:42,925::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-14::DEBUG::2014-07-10 09:24:42,931::task::595::TaskManager.Task::(_updateState) Task=`eda6b212-341b-4c1b-b929-7df4fc012d7a`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 09:24:42,934::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-14::INFO::2014-07-10 09:24:42,938::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:24:42,940::task::1185::TaskManager.Task::(prepare) Task=`eda6b212-341b-4c1b-b929-7df4fc012d7a`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:24:42,942::task::595::TaskManager.Task::(_updateState) Task=`eda6b212-341b-4c1b-b929-7df4fc012d7a`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 09:24:42,944::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 09:24:42,946::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 09:24:42,949::task::990::TaskManager.Task::(_decref) Task=`eda6b212-341b-4c1b-b929-7df4fc012d7a`::ref 0 aborting False >Thread-34::DEBUG::2014-07-10 09:24:42,961::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-34::DEBUG::2014-07-10 09:24:42,964::task::595::TaskManager.Task::(_updateState) Task=`ec5a6d46-0524-411e-8ff7-5eb8355762ff`::moving from state init -> state preparing >Thread-34::INFO::2014-07-10 09:24:42,966::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-34::DEBUG::2014-07-10 09:24:42,972::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`56b475eb-8dec-403e-880a-0724b0a0d2b9`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-10 09:24:42,974::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' for lock type 'shared' >Thread-34::DEBUG::2014-07-10 09:24:42,978::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-10 09:24:42,980::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`56b475eb-8dec-403e-880a-0724b0a0d2b9`::Granted request >Thread-34::DEBUG::2014-07-10 09:24:42,985::task::827::TaskManager.Task::(resourceAcquired) Task=`ec5a6d46-0524-411e-8ff7-5eb8355762ff`::_resourcesAcquired: Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee (shared) >Thread-34::DEBUG::2014-07-10 09:24:42,987::task::990::TaskManager.Task::(_decref) Task=`ec5a6d46-0524-411e-8ff7-5eb8355762ff`::ref 1 aborting False >Thread-34::INFO::2014-07-10 09:24:42,998::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532067385344', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:24:43,000::task::1185::TaskManager.Task::(prepare) Task=`ec5a6d46-0524-411e-8ff7-5eb8355762ff`::finished: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532067385344', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:24:43,002::task::595::TaskManager.Task::(_updateState) Task=`ec5a6d46-0524-411e-8ff7-5eb8355762ff`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-10 09:24:43,004::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee': < ResourceRef 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-10 09:24:43,006::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-10 09:24:43,010::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' >Thread-34::DEBUG::2014-07-10 09:24:43,012::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' (0 active users) >Thread-34::DEBUG::2014-07-10 09:24:43,014::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-10 09:24:43,016::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', Clearing records. >Thread-34::DEBUG::2014-07-10 09:24:43,019::task::990::TaskManager.Task::(_decref) Task=`ec5a6d46-0524-411e-8ff7-5eb8355762ff`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 09:24:43,078::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.147207 s, 7.0 MB/s\n'; <rc> = 0 >Thread-40::DEBUG::2014-07-10 09:24:44,653::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lion.qa.lab.tlv.redhat.com:_export_yuri2_backup2/6a70504d-00df-4869-8695-0f442053f6b6/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-40::DEBUG::2014-07-10 09:24:44,675::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n369 bytes (369 B) copied, 0.00036786 s, 1.0 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:24:45,093::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:24:45,190::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.035153 s, 29.1 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:24:47,208::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:24:47,301::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0358152 s, 28.6 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:24:49,317::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:24:49,404::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.028118 s, 36.4 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:24:51,419::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:24:51,587::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0446773 s, 22.9 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 09:24:52,348::task::595::TaskManager.Task::(_updateState) Task=`e10ea0d1-1a90-4238-aea2-f1892503cbc0`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 09:24:52,349::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::INFO::2014-07-10 09:24:52,349::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000740766', 'lastCheck': '9.6', 'valid': True}, '6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00036786', 'lastCheck': '7.7', 'valid': True}} >Thread-14::DEBUG::2014-07-10 09:24:52,349::task::1185::TaskManager.Task::(prepare) Task=`e10ea0d1-1a90-4238-aea2-f1892503cbc0`::finished: {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000740766', 'lastCheck': '9.6', 'valid': True}, '6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00036786', 'lastCheck': '7.7', 'valid': True}} >Thread-14::DEBUG::2014-07-10 09:24:52,350::task::595::TaskManager.Task::(_updateState) Task=`e10ea0d1-1a90-4238-aea2-f1892503cbc0`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 09:24:52,350::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 09:24:52,350::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 09:24:52,350::task::990::TaskManager.Task::(_decref) Task=`e10ea0d1-1a90-4238-aea2-f1892503cbc0`::ref 0 aborting False >Thread-18::DEBUG::2014-07-10 09:24:52,750::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/metadata bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-10 09:24:52,784::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000545878 s, 7.5 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 09:24:53,071::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-14::DEBUG::2014-07-10 09:24:53,072::task::595::TaskManager.Task::(_updateState) Task=`b518a60e-c4f1-4445-ac47-ee0c6080faff`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 09:24:53,072::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-14::INFO::2014-07-10 09:24:53,073::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:24:53,073::task::1185::TaskManager.Task::(prepare) Task=`b518a60e-c4f1-4445-ac47-ee0c6080faff`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:24:53,073::task::595::TaskManager.Task::(_updateState) Task=`b518a60e-c4f1-4445-ac47-ee0c6080faff`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 09:24:53,073::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 09:24:53,074::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 09:24:53,074::task::990::TaskManager.Task::(_decref) Task=`b518a60e-c4f1-4445-ac47-ee0c6080faff`::ref 0 aborting False >Thread-34::DEBUG::2014-07-10 09:24:53,117::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-34::DEBUG::2014-07-10 09:24:53,118::task::595::TaskManager.Task::(_updateState) Task=`1e1c273f-ec49-4825-a3eb-e70a272b4ba1`::moving from state init -> state preparing >Thread-34::INFO::2014-07-10 09:24:53,118::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-34::DEBUG::2014-07-10 09:24:53,119::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`15a4572a-6119-48ce-83ab-cf277505f886`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-10 09:24:53,119::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' for lock type 'shared' >Thread-34::DEBUG::2014-07-10 09:24:53,120::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-10 09:24:53,120::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`15a4572a-6119-48ce-83ab-cf277505f886`::Granted request >Thread-34::DEBUG::2014-07-10 09:24:53,121::task::827::TaskManager.Task::(resourceAcquired) Task=`1e1c273f-ec49-4825-a3eb-e70a272b4ba1`::_resourcesAcquired: Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee (shared) >Thread-34::DEBUG::2014-07-10 09:24:53,121::task::990::TaskManager.Task::(_decref) Task=`1e1c273f-ec49-4825-a3eb-e70a272b4ba1`::ref 1 aborting False >Thread-34::INFO::2014-07-10 09:24:53,122::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532067385344', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:24:53,122::task::1185::TaskManager.Task::(prepare) Task=`1e1c273f-ec49-4825-a3eb-e70a272b4ba1`::finished: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532067385344', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:24:53,122::task::595::TaskManager.Task::(_updateState) Task=`1e1c273f-ec49-4825-a3eb-e70a272b4ba1`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-10 09:24:53,123::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee': < ResourceRef 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-10 09:24:53,123::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-10 09:24:53,123::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' >Thread-34::DEBUG::2014-07-10 09:24:53,123::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' (0 active users) >Thread-34::DEBUG::2014-07-10 09:24:53,123::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-10 09:24:53,124::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', Clearing records. >Thread-34::DEBUG::2014-07-10 09:24:53,124::task::990::TaskManager.Task::(_decref) Task=`1e1c273f-ec49-4825-a3eb-e70a272b4ba1`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 09:24:53,604::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:24:53,710::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0350474 s, 29.2 MB/s\n'; <rc> = 0 >Thread-40::DEBUG::2014-07-10 09:24:54,706::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lion.qa.lab.tlv.redhat.com:_export_yuri2_backup2/6a70504d-00df-4869-8695-0f442053f6b6/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-40::DEBUG::2014-07-10 09:24:54,725::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n369 bytes (369 B) copied, 0.00038234 s, 965 kB/s\n'; <rc> = 0 >Thread-64::DEBUG::2014-07-10 09:24:55,229::task::595::TaskManager.Task::(_updateState) Task=`87ce3e70-f603-46a8-8d76-3a0e184b1e00`::moving from state init -> state preparing >Thread-64::INFO::2014-07-10 09:24:55,229::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='aa20346a-4d3a-4e07-b8e1-52c0ebe4168c', volUUID='58fefce2-9bce-4bff-8949-8c6ce8122b27', options=None) >Thread-64::INFO::2014-07-10 09:24:55,230::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-64::DEBUG::2014-07-10 09:24:55,230::task::1185::TaskManager.Task::(prepare) Task=`87ce3e70-f603-46a8-8d76-3a0e184b1e00`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-64::DEBUG::2014-07-10 09:24:55,230::task::595::TaskManager.Task::(_updateState) Task=`87ce3e70-f603-46a8-8d76-3a0e184b1e00`::moving from state preparing -> state finished >Thread-64::DEBUG::2014-07-10 09:24:55,230::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-64::DEBUG::2014-07-10 09:24:55,230::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-64::DEBUG::2014-07-10 09:24:55,231::task::990::TaskManager.Task::(_decref) Task=`87ce3e70-f603-46a8-8d76-3a0e184b1e00`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 09:24:55,725::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:24:55,834::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0291806 s, 35.1 MB/s\n'; <rc> = 0 >Thread-73::DEBUG::2014-07-10 09:24:56,954::task::595::TaskManager.Task::(_updateState) Task=`16942da1-1341-4e7f-8751-a826b1a21020`::moving from state init -> state preparing >Thread-54::DEBUG::2014-07-10 09:24:56,954::task::595::TaskManager.Task::(_updateState) Task=`1d0e4d3c-44f7-4173-ac65-df04cb81d1fd`::moving from state init -> state preparing >Thread-73::INFO::2014-07-10 09:24:56,956::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='c01d693b-cba0-4fed-9ad7-0aaa28912a19', volUUID='4bb5d954-2a50-4028-b299-0b43c261270c', options=None) >Thread-54::INFO::2014-07-10 09:24:56,956::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='28408446-e5fd-4565-a976-e760951593fe', volUUID='776303a2-5585-451e-826e-0e338d4a1e98', options=None) >Thread-73::INFO::2014-07-10 09:24:56,957::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-54::INFO::2014-07-10 09:24:56,958::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-73::DEBUG::2014-07-10 09:24:56,959::task::1185::TaskManager.Task::(prepare) Task=`16942da1-1341-4e7f-8751-a826b1a21020`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-54::DEBUG::2014-07-10 09:24:56,959::task::1185::TaskManager.Task::(prepare) Task=`1d0e4d3c-44f7-4173-ac65-df04cb81d1fd`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-73::DEBUG::2014-07-10 09:24:56,960::task::595::TaskManager.Task::(_updateState) Task=`16942da1-1341-4e7f-8751-a826b1a21020`::moving from state preparing -> state finished >Thread-54::DEBUG::2014-07-10 09:24:56,960::task::595::TaskManager.Task::(_updateState) Task=`1d0e4d3c-44f7-4173-ac65-df04cb81d1fd`::moving from state preparing -> state finished >Thread-73::DEBUG::2014-07-10 09:24:56,961::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-54::DEBUG::2014-07-10 09:24:56,962::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-73::DEBUG::2014-07-10 09:24:56,962::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-54::DEBUG::2014-07-10 09:24:56,963::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-73::DEBUG::2014-07-10 09:24:56,964::task::990::TaskManager.Task::(_decref) Task=`16942da1-1341-4e7f-8751-a826b1a21020`::ref 0 aborting False >Thread-54::DEBUG::2014-07-10 09:24:56,965::task::990::TaskManager.Task::(_decref) Task=`1d0e4d3c-44f7-4173-ac65-df04cb81d1fd`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 09:24:57,855::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:24:57,949::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0357014 s, 28.7 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:24:59,966::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:25:00,062::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0349831 s, 29.3 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:25:02,077::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:25:02,163::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0267626 s, 38.3 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-10 09:25:02,812::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/metadata bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-10 09:25:02,834::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000905053 s, 4.5 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 09:25:03,154::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-14::DEBUG::2014-07-10 09:25:03,155::task::595::TaskManager.Task::(_updateState) Task=`50a0b0ae-063b-4a27-a992-fb05103a3a1a`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 09:25:03,156::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-14::INFO::2014-07-10 09:25:03,156::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:25:03,157::task::1185::TaskManager.Task::(prepare) Task=`50a0b0ae-063b-4a27-a992-fb05103a3a1a`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:25:03,157::task::595::TaskManager.Task::(_updateState) Task=`50a0b0ae-063b-4a27-a992-fb05103a3a1a`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 09:25:03,157::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 09:25:03,157::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 09:25:03,157::task::990::TaskManager.Task::(_decref) Task=`50a0b0ae-063b-4a27-a992-fb05103a3a1a`::ref 0 aborting False >Thread-34::DEBUG::2014-07-10 09:25:03,163::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-34::DEBUG::2014-07-10 09:25:03,163::task::595::TaskManager.Task::(_updateState) Task=`07dc4ad2-eeec-4fb3-8a7a-5a4780a7035e`::moving from state init -> state preparing >Thread-34::INFO::2014-07-10 09:25:03,163::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-34::DEBUG::2014-07-10 09:25:03,164::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`85cc8558-20cb-4814-9ea8-467c61d6c043`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-10 09:25:03,164::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' for lock type 'shared' >Thread-34::DEBUG::2014-07-10 09:25:03,165::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-10 09:25:03,165::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`85cc8558-20cb-4814-9ea8-467c61d6c043`::Granted request >Thread-34::DEBUG::2014-07-10 09:25:03,165::task::827::TaskManager.Task::(resourceAcquired) Task=`07dc4ad2-eeec-4fb3-8a7a-5a4780a7035e`::_resourcesAcquired: Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee (shared) >Thread-34::DEBUG::2014-07-10 09:25:03,166::task::990::TaskManager.Task::(_decref) Task=`07dc4ad2-eeec-4fb3-8a7a-5a4780a7035e`::ref 1 aborting False >Thread-34::INFO::2014-07-10 09:25:03,167::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532067385344', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:25:03,167::task::1185::TaskManager.Task::(prepare) Task=`07dc4ad2-eeec-4fb3-8a7a-5a4780a7035e`::finished: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532067385344', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:25:03,167::task::595::TaskManager.Task::(_updateState) Task=`07dc4ad2-eeec-4fb3-8a7a-5a4780a7035e`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-10 09:25:03,167::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee': < ResourceRef 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-10 09:25:03,168::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-10 09:25:03,168::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' >Thread-34::DEBUG::2014-07-10 09:25:03,168::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' (0 active users) >Thread-34::DEBUG::2014-07-10 09:25:03,168::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-10 09:25:03,168::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', Clearing records. >Thread-34::DEBUG::2014-07-10 09:25:03,169::task::990::TaskManager.Task::(_decref) Task=`07dc4ad2-eeec-4fb3-8a7a-5a4780a7035e`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 09:25:04,180::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:25:04,276::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0294032 s, 34.8 MB/s\n'; <rc> = 0 >Thread-40::DEBUG::2014-07-10 09:25:04,758::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lion.qa.lab.tlv.redhat.com:_export_yuri2_backup2/6a70504d-00df-4869-8695-0f442053f6b6/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-40::DEBUG::2014-07-10 09:25:04,780::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n369 bytes (369 B) copied, 0.000471543 s, 783 kB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:25:06,291::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:25:06,397::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.033823 s, 30.3 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 09:25:07,548::task::595::TaskManager.Task::(_updateState) Task=`5ffa17eb-f226-4fb8-b3f8-b740c3130473`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 09:25:07,549::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::INFO::2014-07-10 09:25:07,549::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000905053', 'lastCheck': '4.7', 'valid': True}, '6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000471543', 'lastCheck': '2.8', 'valid': True}} >Thread-14::DEBUG::2014-07-10 09:25:07,549::task::1185::TaskManager.Task::(prepare) Task=`5ffa17eb-f226-4fb8-b3f8-b740c3130473`::finished: {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000905053', 'lastCheck': '4.7', 'valid': True}, '6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000471543', 'lastCheck': '2.8', 'valid': True}} >Thread-14::DEBUG::2014-07-10 09:25:07,549::task::595::TaskManager.Task::(_updateState) Task=`5ffa17eb-f226-4fb8-b3f8-b740c3130473`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 09:25:07,550::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 09:25:07,550::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 09:25:07,550::task::990::TaskManager.Task::(_decref) Task=`5ffa17eb-f226-4fb8-b3f8-b740c3130473`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 09:25:08,412::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:25:08,500::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0297191 s, 34.5 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:25:10,516::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:25:10,603::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0270312 s, 37.9 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:25:12,618::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:25:12,713::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0372178 s, 27.5 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-10 09:25:12,863::domainMonitor::192::Storage.DomainMonitorThread::(_monitorDomain) Refreshing domain 9e1aa540-1f4e-4ee3-a152-be381ef6c3bd >Thread-18::DEBUG::2014-07-10 09:25:12,864::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with LvMetadataRW backend >Thread-18::DEBUG::2014-07-10 09:25:12,864::blockSD::336::Storage.Misc.excCmd::(readlines) '/bin/dd iflag=direct skip=0 bs=2048 if=/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/metadata count=1' (cwd None) >Thread-18::DEBUG::2014-07-10 09:25:12,884::blockSD::336::Storage.Misc.excCmd::(readlines) SUCCESS: <err> = '1+0 records in\n1+0 records out\n2048 bytes (2.0 kB) copied, 0.000545626 s, 3.8 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-10 09:25:12,884::misc::282::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '2048 bytes (2.0 kB) copied, 0.000545626 s, 3.8 MB/s'], size: 2048 >Thread-18::DEBUG::2014-07-10 09:25:12,884::persistentDict::234::Storage.PersistentDict::(refresh) read lines (LvMetadataRW)=[] >Thread-18::WARNING::2014-07-10 09:25:12,885::persistentDict::256::Storage.PersistentDict::(refresh) data has no embedded checksum - trust it as it is >Thread-18::DEBUG::2014-07-10 09:25:12,885::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with VGTagMetadataRW backend >Thread-18::DEBUG::2014-07-10 09:25:12,885::lvm::503::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-18::DEBUG::2014-07-10 09:25:12,886::lvm::505::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-18::DEBUG::2014-07-10 09:25:12,886::lvm::513::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-18::DEBUG::2014-07-10 09:25:12,886::lvm::525::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-18::DEBUG::2014-07-10 09:25:12,887::lvm::373::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-18::DEBUG::2014-07-10 09:25:12,887::lvm::296::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/3600601601282300032826addbbdae311|/dev/mapper/360060160f4a030003840ec867ddee311|/dev/mapper/367cad74c2fcba00019e6afd20c781e67|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name 9e1aa540-1f4e-4ee3-a152-be381ef6c3bd' (cwd None) >Thread-14::DEBUG::2014-07-10 09:25:13,200::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-18::DEBUG::2014-07-10 09:25:13,205::lvm::296::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-14::DEBUG::2014-07-10 09:25:13,206::task::595::TaskManager.Task::(_updateState) Task=`ab9a7ae9-0839-4f9b-bb1e-d2a6fccd335b`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 09:25:13,211::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-18::DEBUG::2014-07-10 09:25:13,215::lvm::415::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-18::DEBUG::2014-07-10 09:25:13,216::persistentDict::234::Storage.PersistentDict::(refresh) read lines (VGTagMetadataRW)=['LEASETIMESEC=60', 'VGUUID=9CsMxb-YbRc-yRG7-cQKD-xY3G-GLi5-YxUyPC', 'VERSION=3', 'TYPE=ISCSI', 'LOGBLKSIZE=512', u'PV0=pv:3600601601282300032826addbbdae311,uuid:7qEb8v-jk2X-3CPk-k4XB-eIBk-onYD-807hcV,pestart:0,pecount:8189,mapoffset:0', 'LEASERETRIES=3', 'IOOPTIMEOUTSEC=10', 'LOCKRENEWALINTERVALSEC=5', 'PHYBLKSIZE=512', 'SDUUID=9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'CLASS=Data', 'LOCKPOLICY=', 'DESCRIPTION=SD_REAL', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=DC_REAL', 'ROLE=Master', 'POOL_UUID=4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', 'POOL_SPM_ID=1', 'POOL_SPM_LVER=0', '_SHA_CKSUM=013b5a7910962201c4cceab31b9c6d9c79f7316f', u'POOL_DOMAINS=9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active'] >Thread-18::INFO::2014-07-10 09:25:13,217::sd::384::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 9e1aa540-1f4e-4ee3-a152-be381ef6c3bd_imageNS already registered >Thread-18::INFO::2014-07-10 09:25:13,217::sd::392::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 9e1aa540-1f4e-4ee3-a152-be381ef6c3bd_volumeNS already registered >Thread-18::INFO::2014-07-10 09:25:13,217::blockSD::452::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 9e1aa540-1f4e-4ee3-a152-be381ef6c3bd_lvmActivationNS already registered >Thread-14::INFO::2014-07-10 09:25:13,220::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:25:13,222::task::1185::TaskManager.Task::(prepare) Task=`ab9a7ae9-0839-4f9b-bb1e-d2a6fccd335b`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:25:13,224::task::595::TaskManager.Task::(_updateState) Task=`ab9a7ae9-0839-4f9b-bb1e-d2a6fccd335b`::moving from state preparing -> state finished >Thread-18::DEBUG::2014-07-10 09:25:13,226::lvm::296::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgck --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/3600601601282300032826addbbdae311|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } " 9e1aa540-1f4e-4ee3-a152-be381ef6c3bd' (cwd None) >Thread-14::DEBUG::2014-07-10 09:25:13,226::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 09:25:13,251::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 09:25:13,254::task::990::TaskManager.Task::(_decref) Task=`ab9a7ae9-0839-4f9b-bb1e-d2a6fccd335b`::ref 0 aborting False >Thread-34::DEBUG::2014-07-10 09:25:13,259::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-34::DEBUG::2014-07-10 09:25:13,260::task::595::TaskManager.Task::(_updateState) Task=`bd027273-3223-47c6-90d5-2145a07c42d9`::moving from state init -> state preparing >Thread-34::INFO::2014-07-10 09:25:13,260::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-34::DEBUG::2014-07-10 09:25:13,261::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`180110ce-dbef-4816-98e1-96fd529acb9c`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-10 09:25:13,261::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' for lock type 'shared' >Thread-34::DEBUG::2014-07-10 09:25:13,261::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-10 09:25:13,262::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`180110ce-dbef-4816-98e1-96fd529acb9c`::Granted request >Thread-34::DEBUG::2014-07-10 09:25:13,262::task::827::TaskManager.Task::(resourceAcquired) Task=`bd027273-3223-47c6-90d5-2145a07c42d9`::_resourcesAcquired: Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee (shared) >Thread-34::DEBUG::2014-07-10 09:25:13,262::task::990::TaskManager.Task::(_decref) Task=`bd027273-3223-47c6-90d5-2145a07c42d9`::ref 1 aborting False >Thread-34::INFO::2014-07-10 09:25:13,264::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532067385344', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:25:13,264::task::1185::TaskManager.Task::(prepare) Task=`bd027273-3223-47c6-90d5-2145a07c42d9`::finished: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532067385344', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:25:13,264::task::595::TaskManager.Task::(_updateState) Task=`bd027273-3223-47c6-90d5-2145a07c42d9`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-10 09:25:13,265::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee': < ResourceRef 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-10 09:25:13,265::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-10 09:25:13,265::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' >Thread-34::DEBUG::2014-07-10 09:25:13,266::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' (0 active users) >Thread-34::DEBUG::2014-07-10 09:25:13,266::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-10 09:25:13,266::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', Clearing records. >Thread-34::DEBUG::2014-07-10 09:25:13,266::task::990::TaskManager.Task::(_decref) Task=`bd027273-3223-47c6-90d5-2145a07c42d9`::ref 0 aborting False >Thread-18::DEBUG::2014-07-10 09:25:13,431::lvm::296::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-18::DEBUG::2014-07-10 09:25:13,432::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/metadata bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-10 09:25:13,451::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000651281 s, 6.3 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:25:14,729::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Thread-40::DEBUG::2014-07-10 09:25:15,094::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lion.qa.lab.tlv.redhat.com:_export_yuri2_backup2/6a70504d-00df-4869-8695-0f442053f6b6/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-40::DEBUG::2014-07-10 09:25:15,144::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n369 bytes (369 B) copied, 0.00041508 s, 889 kB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:25:15,193::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0332128 s, 30.8 MB/s\n'; <rc> = 0 >Thread-57::DEBUG::2014-07-10 09:25:15,313::task::595::TaskManager.Task::(_updateState) Task=`3cee2f49-3f84-4de3-ab48-5cc4463287dd`::moving from state init -> state preparing >Thread-57::INFO::2014-07-10 09:25:15,313::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='b6f6c0da-e67f-4902-b9ac-3069571a42fe', volUUID='c4cd1da8-05b7-45e0-80b1-1183d21443d9', options=None) >Thread-57::INFO::2014-07-10 09:25:15,314::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-57::DEBUG::2014-07-10 09:25:15,314::task::1185::TaskManager.Task::(prepare) Task=`3cee2f49-3f84-4de3-ab48-5cc4463287dd`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-57::DEBUG::2014-07-10 09:25:15,314::task::595::TaskManager.Task::(_updateState) Task=`3cee2f49-3f84-4de3-ab48-5cc4463287dd`::moving from state preparing -> state finished >Thread-57::DEBUG::2014-07-10 09:25:15,315::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-57::DEBUG::2014-07-10 09:25:15,315::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-57::DEBUG::2014-07-10 09:25:15,315::task::990::TaskManager.Task::(_decref) Task=`3cee2f49-3f84-4de3-ab48-5cc4463287dd`::ref 0 aborting False >Thread-67::DEBUG::2014-07-10 09:25:16,299::task::595::TaskManager.Task::(_updateState) Task=`abe7c329-8648-41b7-a622-941f2d6ff6c1`::moving from state init -> state preparing >Thread-67::INFO::2014-07-10 09:25:16,300::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='f30c2cb7-a43a-4bf5-82b5-cfe07336f65c', volUUID='b0fbb3c9-55af-4a3a-95ad-fc56a80b9cf5', options=None) >Thread-67::INFO::2014-07-10 09:25:16,301::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-67::DEBUG::2014-07-10 09:25:16,301::task::1185::TaskManager.Task::(prepare) Task=`abe7c329-8648-41b7-a622-941f2d6ff6c1`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-67::DEBUG::2014-07-10 09:25:16,301::task::595::TaskManager.Task::(_updateState) Task=`abe7c329-8648-41b7-a622-941f2d6ff6c1`::moving from state preparing -> state finished >Thread-67::DEBUG::2014-07-10 09:25:16,301::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-67::DEBUG::2014-07-10 09:25:16,301::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-67::DEBUG::2014-07-10 09:25:16,302::task::990::TaskManager.Task::(_decref) Task=`abe7c329-8648-41b7-a622-941f2d6ff6c1`::ref 0 aborting False >Thread-48::DEBUG::2014-07-10 09:25:16,834::task::595::TaskManager.Task::(_updateState) Task=`de77abe2-4d22-45b0-9778-cdc60ebebfc7`::moving from state init -> state preparing >Thread-48::INFO::2014-07-10 09:25:16,835::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='0cd7d6ce-f497-4243-a690-c57744861eea', volUUID='10b6a7dd-dc6c-43fa-ba17-92e4331b0e0b', options=None) >Thread-48::INFO::2014-07-10 09:25:16,835::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-48::DEBUG::2014-07-10 09:25:16,835::task::1185::TaskManager.Task::(prepare) Task=`de77abe2-4d22-45b0-9778-cdc60ebebfc7`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-48::DEBUG::2014-07-10 09:25:16,835::task::595::TaskManager.Task::(_updateState) Task=`de77abe2-4d22-45b0-9778-cdc60ebebfc7`::moving from state preparing -> state finished >Thread-48::DEBUG::2014-07-10 09:25:16,835::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-48::DEBUG::2014-07-10 09:25:16,836::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-48::DEBUG::2014-07-10 09:25:16,836::task::990::TaskManager.Task::(_decref) Task=`de77abe2-4d22-45b0-9778-cdc60ebebfc7`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 09:25:17,209::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:25:17,297::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0298511 s, 34.3 MB/s\n'; <rc> = 0 >Thread-76::DEBUG::2014-07-10 09:25:18,108::task::595::TaskManager.Task::(_updateState) Task=`bbfa7df9-1c3b-4b4b-b0ab-5a2e789d26e2`::moving from state init -> state preparing >Thread-76::INFO::2014-07-10 09:25:18,109::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='e4c65229-4247-4b33-b72a-f1d5ce72ad05', volUUID='cad94284-3ca9-4c30-933d-997f4460309e', options=None) >Thread-76::INFO::2014-07-10 09:25:18,110::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-76::DEBUG::2014-07-10 09:25:18,110::task::1185::TaskManager.Task::(prepare) Task=`bbfa7df9-1c3b-4b4b-b0ab-5a2e789d26e2`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-76::DEBUG::2014-07-10 09:25:18,110::task::595::TaskManager.Task::(_updateState) Task=`bbfa7df9-1c3b-4b4b-b0ab-5a2e789d26e2`::moving from state preparing -> state finished >Thread-76::DEBUG::2014-07-10 09:25:18,110::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-76::DEBUG::2014-07-10 09:25:18,110::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-76::DEBUG::2014-07-10 09:25:18,111::task::990::TaskManager.Task::(_decref) Task=`bbfa7df9-1c3b-4b4b-b0ab-5a2e789d26e2`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 09:25:19,312::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:25:19,409::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0305526 s, 33.5 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:25:21,425::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:25:21,545::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0455517 s, 22.5 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 09:25:22,784::task::595::TaskManager.Task::(_updateState) Task=`4a25ed20-9ded-4496-b521-e3ec8b73e432`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 09:25:22,784::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::INFO::2014-07-10 09:25:22,784::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000651281', 'lastCheck': '9.3', 'valid': True}, '6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00041508', 'lastCheck': '7.6', 'valid': True}} >Thread-14::DEBUG::2014-07-10 09:25:22,785::task::1185::TaskManager.Task::(prepare) Task=`4a25ed20-9ded-4496-b521-e3ec8b73e432`::finished: {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000651281', 'lastCheck': '9.3', 'valid': True}, '6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00041508', 'lastCheck': '7.6', 'valid': True}} >Thread-14::DEBUG::2014-07-10 09:25:22,785::task::595::TaskManager.Task::(_updateState) Task=`4a25ed20-9ded-4496-b521-e3ec8b73e432`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 09:25:22,785::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 09:25:22,785::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 09:25:22,785::task::990::TaskManager.Task::(_decref) Task=`4a25ed20-9ded-4496-b521-e3ec8b73e432`::ref 0 aborting False >Thread-14::DEBUG::2014-07-10 09:25:23,296::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-14::DEBUG::2014-07-10 09:25:23,297::task::595::TaskManager.Task::(_updateState) Task=`4d55ee68-ab96-4978-afd1-a4a25cdc71ae`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 09:25:23,297::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-14::INFO::2014-07-10 09:25:23,298::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:25:23,298::task::1185::TaskManager.Task::(prepare) Task=`4d55ee68-ab96-4978-afd1-a4a25cdc71ae`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:25:23,298::task::595::TaskManager.Task::(_updateState) Task=`4d55ee68-ab96-4978-afd1-a4a25cdc71ae`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 09:25:23,298::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 09:25:23,298::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 09:25:23,298::task::990::TaskManager.Task::(_decref) Task=`4d55ee68-ab96-4978-afd1-a4a25cdc71ae`::ref 0 aborting False >Thread-34::DEBUG::2014-07-10 09:25:23,342::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-34::DEBUG::2014-07-10 09:25:23,343::task::595::TaskManager.Task::(_updateState) Task=`1a0e29b7-b631-4f57-901d-0577043e7903`::moving from state init -> state preparing >Thread-34::INFO::2014-07-10 09:25:23,343::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-34::DEBUG::2014-07-10 09:25:23,344::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`3125bb78-465c-442d-abe1-e13c429c642d`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-10 09:25:23,344::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' for lock type 'shared' >Thread-34::DEBUG::2014-07-10 09:25:23,345::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-10 09:25:23,345::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`3125bb78-465c-442d-abe1-e13c429c642d`::Granted request >Thread-34::DEBUG::2014-07-10 09:25:23,345::task::827::TaskManager.Task::(resourceAcquired) Task=`1a0e29b7-b631-4f57-901d-0577043e7903`::_resourcesAcquired: Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee (shared) >Thread-34::DEBUG::2014-07-10 09:25:23,346::task::990::TaskManager.Task::(_decref) Task=`1a0e29b7-b631-4f57-901d-0577043e7903`::ref 1 aborting False >Thread-34::INFO::2014-07-10 09:25:23,347::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532067385344', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:25:23,347::task::1185::TaskManager.Task::(prepare) Task=`1a0e29b7-b631-4f57-901d-0577043e7903`::finished: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532067385344', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:25:23,347::task::595::TaskManager.Task::(_updateState) Task=`1a0e29b7-b631-4f57-901d-0577043e7903`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-10 09:25:23,347::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee': < ResourceRef 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-10 09:25:23,347::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-10 09:25:23,348::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' >Thread-34::DEBUG::2014-07-10 09:25:23,348::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' (0 active users) >Thread-34::DEBUG::2014-07-10 09:25:23,348::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-10 09:25:23,348::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', Clearing records. >Thread-34::DEBUG::2014-07-10 09:25:23,348::task::990::TaskManager.Task::(_decref) Task=`1a0e29b7-b631-4f57-901d-0577043e7903`::ref 0 aborting False >Thread-18::DEBUG::2014-07-10 09:25:23,480::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/metadata bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-10 09:25:23,501::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000571111 s, 7.2 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:25:23,560::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:25:23,654::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0349625 s, 29.3 MB/s\n'; <rc> = 0 >Thread-40::DEBUG::2014-07-10 09:25:25,212::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lion.qa.lab.tlv.redhat.com:_export_yuri2_backup2/6a70504d-00df-4869-8695-0f442053f6b6/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-40::DEBUG::2014-07-10 09:25:25,233::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n369 bytes (369 B) copied, 0.000468839 s, 787 kB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:25:25,673::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:25:25,809::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0702166 s, 14.6 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:25:27,825::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:25:27,948::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0487646 s, 21.0 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:25:29,965::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:25:30,099::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0778163 s, 13.2 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:25:32,117::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:25:32,200::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0264428 s, 38.7 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 09:25:33,373::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-14::DEBUG::2014-07-10 09:25:33,374::task::595::TaskManager.Task::(_updateState) Task=`1f41fec2-e09d-4907-9e1f-ad10e3225c52`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 09:25:33,374::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-14::INFO::2014-07-10 09:25:33,375::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:25:33,375::task::1185::TaskManager.Task::(prepare) Task=`1f41fec2-e09d-4907-9e1f-ad10e3225c52`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:25:33,375::task::595::TaskManager.Task::(_updateState) Task=`1f41fec2-e09d-4907-9e1f-ad10e3225c52`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 09:25:33,375::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 09:25:33,375::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 09:25:33,376::task::990::TaskManager.Task::(_decref) Task=`1f41fec2-e09d-4907-9e1f-ad10e3225c52`::ref 0 aborting False >Thread-34::DEBUG::2014-07-10 09:25:33,380::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-34::DEBUG::2014-07-10 09:25:33,381::task::595::TaskManager.Task::(_updateState) Task=`ddb022e9-a860-4491-9aea-31981707a154`::moving from state init -> state preparing >Thread-34::INFO::2014-07-10 09:25:33,381::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-34::DEBUG::2014-07-10 09:25:33,381::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`6ce850a6-5dc5-4881-8da5-bc2d524cc2a0`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-10 09:25:33,382::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' for lock type 'shared' >Thread-34::DEBUG::2014-07-10 09:25:33,382::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-10 09:25:33,382::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`6ce850a6-5dc5-4881-8da5-bc2d524cc2a0`::Granted request >Thread-34::DEBUG::2014-07-10 09:25:33,383::task::827::TaskManager.Task::(resourceAcquired) Task=`ddb022e9-a860-4491-9aea-31981707a154`::_resourcesAcquired: Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee (shared) >Thread-34::DEBUG::2014-07-10 09:25:33,383::task::990::TaskManager.Task::(_decref) Task=`ddb022e9-a860-4491-9aea-31981707a154`::ref 1 aborting False >Thread-34::INFO::2014-07-10 09:25:33,384::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532067385344', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:25:33,385::task::1185::TaskManager.Task::(prepare) Task=`ddb022e9-a860-4491-9aea-31981707a154`::finished: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532067385344', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:25:33,385::task::595::TaskManager.Task::(_updateState) Task=`ddb022e9-a860-4491-9aea-31981707a154`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-10 09:25:33,385::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee': < ResourceRef 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-10 09:25:33,385::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-10 09:25:33,386::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' >Thread-34::DEBUG::2014-07-10 09:25:33,386::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' (0 active users) >Thread-34::DEBUG::2014-07-10 09:25:33,386::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-10 09:25:33,386::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', Clearing records. >Thread-34::DEBUG::2014-07-10 09:25:33,387::task::990::TaskManager.Task::(_decref) Task=`ddb022e9-a860-4491-9aea-31981707a154`::ref 0 aborting False >Thread-18::DEBUG::2014-07-10 09:25:33,530::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/metadata bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-10 09:25:33,553::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000670146 s, 6.1 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:25:34,217::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:25:34,308::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0308073 s, 33.2 MB/s\n'; <rc> = 0 >Thread-40::DEBUG::2014-07-10 09:25:35,263::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lion.qa.lab.tlv.redhat.com:_export_yuri2_backup2/6a70504d-00df-4869-8695-0f442053f6b6/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-40::DEBUG::2014-07-10 09:25:35,284::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n369 bytes (369 B) copied, 0.000554252 s, 666 kB/s\n'; <rc> = 0 >Thread-70::DEBUG::2014-07-10 09:25:35,421::task::595::TaskManager.Task::(_updateState) Task=`7bb43cbf-e523-4914-b08a-c698fcbe74d5`::moving from state init -> state preparing >Thread-70::INFO::2014-07-10 09:25:35,422::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='cfaeead2-7caa-467c-b389-c89840ae6605', volUUID='567fe32d-31a6-4ff6-90f3-fd6a656fbecc', options=None) >Thread-70::INFO::2014-07-10 09:25:35,422::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-70::DEBUG::2014-07-10 09:25:35,422::task::1185::TaskManager.Task::(prepare) Task=`7bb43cbf-e523-4914-b08a-c698fcbe74d5`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-70::DEBUG::2014-07-10 09:25:35,422::task::595::TaskManager.Task::(_updateState) Task=`7bb43cbf-e523-4914-b08a-c698fcbe74d5`::moving from state preparing -> state finished >Thread-70::DEBUG::2014-07-10 09:25:35,423::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-70::DEBUG::2014-07-10 09:25:35,423::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-70::DEBUG::2014-07-10 09:25:35,423::task::990::TaskManager.Task::(_decref) Task=`7bb43cbf-e523-4914-b08a-c698fcbe74d5`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 09:25:36,324::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Thread-60::DEBUG::2014-07-10 09:25:36,374::task::595::TaskManager.Task::(_updateState) Task=`76faceec-89c4-4bb5-8bff-387517947642`::moving from state init -> state preparing >Thread-60::INFO::2014-07-10 09:25:36,376::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='b034d5b0-e1e0-4011-b49b-4d45ddb11556', volUUID='3d7f62b5-328f-4d8e-8b69-873cfb5ae14d', options=None) >Thread-60::INFO::2014-07-10 09:25:36,377::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-60::DEBUG::2014-07-10 09:25:36,379::task::1185::TaskManager.Task::(prepare) Task=`76faceec-89c4-4bb5-8bff-387517947642`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-60::DEBUG::2014-07-10 09:25:36,380::task::595::TaskManager.Task::(_updateState) Task=`76faceec-89c4-4bb5-8bff-387517947642`::moving from state preparing -> state finished >Thread-60::DEBUG::2014-07-10 09:25:36,381::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-60::DEBUG::2014-07-10 09:25:36,382::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-60::DEBUG::2014-07-10 09:25:36,383::task::990::TaskManager.Task::(_decref) Task=`76faceec-89c4-4bb5-8bff-387517947642`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 09:25:36,459::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0483237 s, 21.2 MB/s\n'; <rc> = 0 >Thread-51::DEBUG::2014-07-10 09:25:36,533::task::595::TaskManager.Task::(_updateState) Task=`a07e76a8-d0d7-4f37-9fe5-0ae7e39c3fd8`::moving from state init -> state preparing >Thread-51::INFO::2014-07-10 09:25:36,534::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='76fdb054-02cd-42ed-9721-b3e65b34c3a4', volUUID='022dfe46-2cf7-4915-80b3-883158e3ca83', options=None) >Thread-51::INFO::2014-07-10 09:25:36,534::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-51::DEBUG::2014-07-10 09:25:36,534::task::1185::TaskManager.Task::(prepare) Task=`a07e76a8-d0d7-4f37-9fe5-0ae7e39c3fd8`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-51::DEBUG::2014-07-10 09:25:36,534::task::595::TaskManager.Task::(_updateState) Task=`a07e76a8-d0d7-4f37-9fe5-0ae7e39c3fd8`::moving from state preparing -> state finished >Thread-51::DEBUG::2014-07-10 09:25:36,535::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-51::DEBUG::2014-07-10 09:25:36,535::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-51::DEBUG::2014-07-10 09:25:36,535::task::990::TaskManager.Task::(_decref) Task=`a07e76a8-d0d7-4f37-9fe5-0ae7e39c3fd8`::ref 0 aborting False >Thread-14::DEBUG::2014-07-10 09:25:37,992::task::595::TaskManager.Task::(_updateState) Task=`8fc86f91-d4cf-457e-94f2-4d8800d2e0d2`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 09:25:37,992::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::INFO::2014-07-10 09:25:37,993::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000670146', 'lastCheck': '4.4', 'valid': True}, '6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000554252', 'lastCheck': '2.7', 'valid': True}} >Thread-14::DEBUG::2014-07-10 09:25:37,993::task::1185::TaskManager.Task::(prepare) Task=`8fc86f91-d4cf-457e-94f2-4d8800d2e0d2`::finished: {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000670146', 'lastCheck': '4.4', 'valid': True}, '6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000554252', 'lastCheck': '2.7', 'valid': True}} >Thread-14::DEBUG::2014-07-10 09:25:37,993::task::595::TaskManager.Task::(_updateState) Task=`8fc86f91-d4cf-457e-94f2-4d8800d2e0d2`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 09:25:37,993::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 09:25:37,993::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 09:25:37,994::task::990::TaskManager.Task::(_decref) Task=`8fc86f91-d4cf-457e-94f2-4d8800d2e0d2`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 09:25:38,474::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:25:38,651::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.11644 s, 8.8 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:25:40,666::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:25:40,803::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0390222 s, 26.2 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:25:42,817::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:25:42,925::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0507589 s, 20.2 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 09:25:43,422::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-14::DEBUG::2014-07-10 09:25:43,423::task::595::TaskManager.Task::(_updateState) Task=`3b217336-0662-4395-9307-3d774bd8a176`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 09:25:43,424::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-14::INFO::2014-07-10 09:25:43,424::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:25:43,425::task::1185::TaskManager.Task::(prepare) Task=`3b217336-0662-4395-9307-3d774bd8a176`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:25:43,425::task::595::TaskManager.Task::(_updateState) Task=`3b217336-0662-4395-9307-3d774bd8a176`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 09:25:43,425::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 09:25:43,425::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 09:25:43,425::task::990::TaskManager.Task::(_decref) Task=`3b217336-0662-4395-9307-3d774bd8a176`::ref 0 aborting False >Thread-34::DEBUG::2014-07-10 09:25:43,429::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-34::DEBUG::2014-07-10 09:25:43,430::task::595::TaskManager.Task::(_updateState) Task=`1e4b88cf-f7b6-493f-940b-0233ffb4b625`::moving from state init -> state preparing >Thread-34::INFO::2014-07-10 09:25:43,430::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-34::DEBUG::2014-07-10 09:25:43,431::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`90a3c394-fa1e-4471-87fc-94111ae638ed`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-10 09:25:43,431::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' for lock type 'shared' >Thread-34::DEBUG::2014-07-10 09:25:43,431::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-10 09:25:43,431::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`90a3c394-fa1e-4471-87fc-94111ae638ed`::Granted request >Thread-34::DEBUG::2014-07-10 09:25:43,432::task::827::TaskManager.Task::(resourceAcquired) Task=`1e4b88cf-f7b6-493f-940b-0233ffb4b625`::_resourcesAcquired: Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee (shared) >Thread-34::DEBUG::2014-07-10 09:25:43,432::task::990::TaskManager.Task::(_decref) Task=`1e4b88cf-f7b6-493f-940b-0233ffb4b625`::ref 1 aborting False >Thread-34::INFO::2014-07-10 09:25:43,433::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532067385344', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:25:43,433::task::1185::TaskManager.Task::(prepare) Task=`1e4b88cf-f7b6-493f-940b-0233ffb4b625`::finished: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532067385344', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:25:43,433::task::595::TaskManager.Task::(_updateState) Task=`1e4b88cf-f7b6-493f-940b-0233ffb4b625`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-10 09:25:43,434::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee': < ResourceRef 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-10 09:25:43,434::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-10 09:25:43,434::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' >Thread-34::DEBUG::2014-07-10 09:25:43,434::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' (0 active users) >Thread-34::DEBUG::2014-07-10 09:25:43,434::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-10 09:25:43,434::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', Clearing records. >Thread-34::DEBUG::2014-07-10 09:25:43,435::task::990::TaskManager.Task::(_decref) Task=`1e4b88cf-f7b6-493f-940b-0233ffb4b625`::ref 0 aborting False >Thread-18::DEBUG::2014-07-10 09:25:43,582::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/metadata bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-10 09:25:43,603::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000637639 s, 6.4 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:25:44,940::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:25:45,039::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0401432 s, 25.5 MB/s\n'; <rc> = 0 >Thread-40::DEBUG::2014-07-10 09:25:45,314::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lion.qa.lab.tlv.redhat.com:_export_yuri2_backup2/6a70504d-00df-4869-8695-0f442053f6b6/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-40::DEBUG::2014-07-10 09:25:45,335::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n369 bytes (369 B) copied, 0.000530831 s, 695 kB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:25:47,059::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:25:47,144::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.028347 s, 36.1 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:25:49,160::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:25:49,267::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0465662 s, 22.0 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:25:51,283::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:25:51,377::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0354337 s, 28.9 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 09:25:53,185::task::595::TaskManager.Task::(_updateState) Task=`1fd44822-5494-49ca-b18f-266d6b47f95f`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 09:25:53,185::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::INFO::2014-07-10 09:25:53,186::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000637639', 'lastCheck': '9.6', 'valid': True}, '6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000530831', 'lastCheck': '7.8', 'valid': True}} >Thread-14::DEBUG::2014-07-10 09:25:53,186::task::1185::TaskManager.Task::(prepare) Task=`1fd44822-5494-49ca-b18f-266d6b47f95f`::finished: {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000637639', 'lastCheck': '9.6', 'valid': True}, '6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000530831', 'lastCheck': '7.8', 'valid': True}} >Thread-14::DEBUG::2014-07-10 09:25:53,186::task::595::TaskManager.Task::(_updateState) Task=`1fd44822-5494-49ca-b18f-266d6b47f95f`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 09:25:53,186::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 09:25:53,186::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 09:25:53,187::task::990::TaskManager.Task::(_decref) Task=`1fd44822-5494-49ca-b18f-266d6b47f95f`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 09:25:53,393::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Thread-14::DEBUG::2014-07-10 09:25:53,471::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-14::DEBUG::2014-07-10 09:25:53,474::task::595::TaskManager.Task::(_updateState) Task=`6e84f59b-8208-44a0-a791-332cb60e8008`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 09:25:53,475::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-14::INFO::2014-07-10 09:25:53,477::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:25:53,479::task::1185::TaskManager.Task::(prepare) Task=`6e84f59b-8208-44a0-a791-332cb60e8008`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:25:53,480::task::595::TaskManager.Task::(_updateState) Task=`6e84f59b-8208-44a0-a791-332cb60e8008`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 09:25:53,482::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 09:25:53,483::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 09:25:53,484::task::990::TaskManager.Task::(_decref) Task=`6e84f59b-8208-44a0-a791-332cb60e8008`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 09:25:53,497::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0263248 s, 38.9 MB/s\n'; <rc> = 0 >Thread-34::DEBUG::2014-07-10 09:25:53,531::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-34::DEBUG::2014-07-10 09:25:53,532::task::595::TaskManager.Task::(_updateState) Task=`d778e429-a87b-4577-9ece-48d9ea11d2a8`::moving from state init -> state preparing >Thread-34::INFO::2014-07-10 09:25:53,532::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-34::DEBUG::2014-07-10 09:25:53,534::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`38472bec-e4c7-4afe-89f3-83a243d674fa`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-10 09:25:53,534::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' for lock type 'shared' >Thread-34::DEBUG::2014-07-10 09:25:53,535::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-10 09:25:53,535::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`38472bec-e4c7-4afe-89f3-83a243d674fa`::Granted request >Thread-34::DEBUG::2014-07-10 09:25:53,536::task::827::TaskManager.Task::(resourceAcquired) Task=`d778e429-a87b-4577-9ece-48d9ea11d2a8`::_resourcesAcquired: Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee (shared) >Thread-34::DEBUG::2014-07-10 09:25:53,536::task::990::TaskManager.Task::(_decref) Task=`d778e429-a87b-4577-9ece-48d9ea11d2a8`::ref 1 aborting False >Thread-34::INFO::2014-07-10 09:25:53,538::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532067385344', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:25:53,538::task::1185::TaskManager.Task::(prepare) Task=`d778e429-a87b-4577-9ece-48d9ea11d2a8`::finished: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532067385344', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:25:53,538::task::595::TaskManager.Task::(_updateState) Task=`d778e429-a87b-4577-9ece-48d9ea11d2a8`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-10 09:25:53,539::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee': < ResourceRef 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-10 09:25:53,539::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-10 09:25:53,539::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' >Thread-34::DEBUG::2014-07-10 09:25:53,539::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' (0 active users) >Thread-34::DEBUG::2014-07-10 09:25:53,540::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-10 09:25:53,540::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', Clearing records. >Thread-34::DEBUG::2014-07-10 09:25:53,540::task::990::TaskManager.Task::(_decref) Task=`d778e429-a87b-4577-9ece-48d9ea11d2a8`::ref 0 aborting False >Thread-18::DEBUG::2014-07-10 09:25:53,632::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/metadata bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-10 09:25:53,653::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000545731 s, 7.5 MB/s\n'; <rc> = 0 >Thread-40::DEBUG::2014-07-10 09:25:55,360::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lion.qa.lab.tlv.redhat.com:_export_yuri2_backup2/6a70504d-00df-4869-8695-0f442053f6b6/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-40::DEBUG::2014-07-10 09:25:55,381::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n369 bytes (369 B) copied, 0.000445586 s, 828 kB/s\n'; <rc> = 0 >Thread-64::DEBUG::2014-07-10 09:25:55,492::task::595::TaskManager.Task::(_updateState) Task=`563662d9-e659-4c3a-aa4b-8a66dc8a8593`::moving from state init -> state preparing >Thread-64::INFO::2014-07-10 09:25:55,493::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='aa20346a-4d3a-4e07-b8e1-52c0ebe4168c', volUUID='58fefce2-9bce-4bff-8949-8c6ce8122b27', options=None) >Thread-64::INFO::2014-07-10 09:25:55,493::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-64::DEBUG::2014-07-10 09:25:55,493::task::1185::TaskManager.Task::(prepare) Task=`563662d9-e659-4c3a-aa4b-8a66dc8a8593`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-64::DEBUG::2014-07-10 09:25:55,494::task::595::TaskManager.Task::(_updateState) Task=`563662d9-e659-4c3a-aa4b-8a66dc8a8593`::moving from state preparing -> state finished >Thread-64::DEBUG::2014-07-10 09:25:55,494::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-64::DEBUG::2014-07-10 09:25:55,494::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-64::DEBUG::2014-07-10 09:25:55,494::task::990::TaskManager.Task::(_decref) Task=`563662d9-e659-4c3a-aa4b-8a66dc8a8593`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 09:25:55,513::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:25:55,607::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.034406 s, 29.8 MB/s\n'; <rc> = 0 >Thread-54::DEBUG::2014-07-10 09:25:57,300::task::595::TaskManager.Task::(_updateState) Task=`1a8b0bba-312d-4317-9dda-aa912b228a3c`::moving from state init -> state preparing >Thread-73::DEBUG::2014-07-10 09:25:57,300::task::595::TaskManager.Task::(_updateState) Task=`15c5b1cd-a2c8-483c-8c6b-54ba760daef9`::moving from state init -> state preparing >Thread-54::INFO::2014-07-10 09:25:57,302::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='28408446-e5fd-4565-a976-e760951593fe', volUUID='776303a2-5585-451e-826e-0e338d4a1e98', options=None) >Thread-73::INFO::2014-07-10 09:25:57,302::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='c01d693b-cba0-4fed-9ad7-0aaa28912a19', volUUID='4bb5d954-2a50-4028-b299-0b43c261270c', options=None) >Thread-54::INFO::2014-07-10 09:25:57,304::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-73::INFO::2014-07-10 09:25:57,304::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-54::DEBUG::2014-07-10 09:25:57,305::task::1185::TaskManager.Task::(prepare) Task=`1a8b0bba-312d-4317-9dda-aa912b228a3c`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-73::DEBUG::2014-07-10 09:25:57,305::task::1185::TaskManager.Task::(prepare) Task=`15c5b1cd-a2c8-483c-8c6b-54ba760daef9`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-54::DEBUG::2014-07-10 09:25:57,306::task::595::TaskManager.Task::(_updateState) Task=`1a8b0bba-312d-4317-9dda-aa912b228a3c`::moving from state preparing -> state finished >Thread-73::DEBUG::2014-07-10 09:25:57,307::task::595::TaskManager.Task::(_updateState) Task=`15c5b1cd-a2c8-483c-8c6b-54ba760daef9`::moving from state preparing -> state finished >Thread-54::DEBUG::2014-07-10 09:25:57,307::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-73::DEBUG::2014-07-10 09:25:57,308::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-54::DEBUG::2014-07-10 09:25:57,309::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-73::DEBUG::2014-07-10 09:25:57,309::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-54::DEBUG::2014-07-10 09:25:57,310::task::990::TaskManager.Task::(_decref) Task=`1a8b0bba-312d-4317-9dda-aa912b228a3c`::ref 0 aborting False >Thread-73::DEBUG::2014-07-10 09:25:57,311::task::990::TaskManager.Task::(_decref) Task=`15c5b1cd-a2c8-483c-8c6b-54ba760daef9`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 09:25:57,622::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:25:57,734::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.053812 s, 19.0 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:25:59,749::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:25:59,835::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0272351 s, 37.6 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:26:01,851::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:26:01,939::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0294122 s, 34.8 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 09:26:03,565::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-14::DEBUG::2014-07-10 09:26:03,566::task::595::TaskManager.Task::(_updateState) Task=`cd2dce54-42ce-4f89-8144-3fba9b20fc2f`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 09:26:03,567::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-14::INFO::2014-07-10 09:26:03,567::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:26:03,567::task::1185::TaskManager.Task::(prepare) Task=`cd2dce54-42ce-4f89-8144-3fba9b20fc2f`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:26:03,567::task::595::TaskManager.Task::(_updateState) Task=`cd2dce54-42ce-4f89-8144-3fba9b20fc2f`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 09:26:03,568::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 09:26:03,568::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 09:26:03,568::task::990::TaskManager.Task::(_decref) Task=`cd2dce54-42ce-4f89-8144-3fba9b20fc2f`::ref 0 aborting False >Thread-34::DEBUG::2014-07-10 09:26:03,572::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-34::DEBUG::2014-07-10 09:26:03,573::task::595::TaskManager.Task::(_updateState) Task=`4d8266b8-9cbe-4a14-80e2-a3b8467a5e0d`::moving from state init -> state preparing >Thread-34::INFO::2014-07-10 09:26:03,573::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-34::DEBUG::2014-07-10 09:26:03,574::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`58212320-c84e-4cb7-9f19-ba79edb40484`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-10 09:26:03,574::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' for lock type 'shared' >Thread-34::DEBUG::2014-07-10 09:26:03,574::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-10 09:26:03,575::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`58212320-c84e-4cb7-9f19-ba79edb40484`::Granted request >Thread-34::DEBUG::2014-07-10 09:26:03,575::task::827::TaskManager.Task::(resourceAcquired) Task=`4d8266b8-9cbe-4a14-80e2-a3b8467a5e0d`::_resourcesAcquired: Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee (shared) >Thread-34::DEBUG::2014-07-10 09:26:03,575::task::990::TaskManager.Task::(_decref) Task=`4d8266b8-9cbe-4a14-80e2-a3b8467a5e0d`::ref 1 aborting False >Thread-34::INFO::2014-07-10 09:26:03,577::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532067385344', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:26:03,577::task::1185::TaskManager.Task::(prepare) Task=`4d8266b8-9cbe-4a14-80e2-a3b8467a5e0d`::finished: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532067385344', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:26:03,577::task::595::TaskManager.Task::(_updateState) Task=`4d8266b8-9cbe-4a14-80e2-a3b8467a5e0d`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-10 09:26:03,577::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee': < ResourceRef 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-10 09:26:03,577::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-10 09:26:03,578::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' >Thread-34::DEBUG::2014-07-10 09:26:03,578::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' (0 active users) >Thread-34::DEBUG::2014-07-10 09:26:03,578::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-10 09:26:03,578::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', Clearing records. >Thread-34::DEBUG::2014-07-10 09:26:03,579::task::990::TaskManager.Task::(_decref) Task=`4d8266b8-9cbe-4a14-80e2-a3b8467a5e0d`::ref 0 aborting False >Thread-18::DEBUG::2014-07-10 09:26:03,683::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/metadata bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-10 09:26:03,705::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000766788 s, 5.3 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:26:03,954::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:26:04,046::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0347731 s, 29.4 MB/s\n'; <rc> = 0 >Thread-40::DEBUG::2014-07-10 09:26:05,407::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lion.qa.lab.tlv.redhat.com:_export_yuri2_backup2/6a70504d-00df-4869-8695-0f442053f6b6/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-40::DEBUG::2014-07-10 09:26:05,447::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n369 bytes (369 B) copied, 0.000394779 s, 935 kB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:26:06,061::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:26:06,155::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0355238 s, 28.8 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:26:08,170::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:26:08,258::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0295536 s, 34.6 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 09:26:08,462::task::595::TaskManager.Task::(_updateState) Task=`6afbb738-83a9-4bd1-861e-eb8f78e04adf`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 09:26:08,463::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::INFO::2014-07-10 09:26:08,463::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000766788', 'lastCheck': '4.7', 'valid': True}, '6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000394779', 'lastCheck': '3.0', 'valid': True}} >Thread-14::DEBUG::2014-07-10 09:26:08,464::task::1185::TaskManager.Task::(prepare) Task=`6afbb738-83a9-4bd1-861e-eb8f78e04adf`::finished: {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000766788', 'lastCheck': '4.7', 'valid': True}, '6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000394779', 'lastCheck': '3.0', 'valid': True}} >Thread-14::DEBUG::2014-07-10 09:26:08,466::task::595::TaskManager.Task::(_updateState) Task=`6afbb738-83a9-4bd1-861e-eb8f78e04adf`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 09:26:08,468::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 09:26:08,471::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 09:26:08,473::task::990::TaskManager.Task::(_decref) Task=`6afbb738-83a9-4bd1-861e-eb8f78e04adf`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 09:26:10,271::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:26:10,358::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0307351 s, 33.3 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:26:12,376::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:26:12,479::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0358394 s, 28.6 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 09:26:13,615::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-14::DEBUG::2014-07-10 09:26:13,616::task::595::TaskManager.Task::(_updateState) Task=`3e778cde-f686-44c5-8c58-4b01f0d2b4b8`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 09:26:13,616::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-14::INFO::2014-07-10 09:26:13,617::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:26:13,617::task::1185::TaskManager.Task::(prepare) Task=`3e778cde-f686-44c5-8c58-4b01f0d2b4b8`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:26:13,617::task::595::TaskManager.Task::(_updateState) Task=`3e778cde-f686-44c5-8c58-4b01f0d2b4b8`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 09:26:13,617::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 09:26:13,617::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 09:26:13,617::task::990::TaskManager.Task::(_decref) Task=`3e778cde-f686-44c5-8c58-4b01f0d2b4b8`::ref 0 aborting False >Thread-34::DEBUG::2014-07-10 09:26:13,622::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-34::DEBUG::2014-07-10 09:26:13,622::task::595::TaskManager.Task::(_updateState) Task=`4cf2cd52-2bf4-4f98-8162-017a7b0cb1b3`::moving from state init -> state preparing >Thread-34::INFO::2014-07-10 09:26:13,623::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-34::DEBUG::2014-07-10 09:26:13,623::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`cba27bf4-6f88-48b3-87d5-5c817a42d96d`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-10 09:26:13,623::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' for lock type 'shared' >Thread-34::DEBUG::2014-07-10 09:26:13,624::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-10 09:26:13,624::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`cba27bf4-6f88-48b3-87d5-5c817a42d96d`::Granted request >Thread-34::DEBUG::2014-07-10 09:26:13,624::task::827::TaskManager.Task::(resourceAcquired) Task=`4cf2cd52-2bf4-4f98-8162-017a7b0cb1b3`::_resourcesAcquired: Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee (shared) >Thread-34::DEBUG::2014-07-10 09:26:13,625::task::990::TaskManager.Task::(_decref) Task=`4cf2cd52-2bf4-4f98-8162-017a7b0cb1b3`::ref 1 aborting False >Thread-34::INFO::2014-07-10 09:26:13,626::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532067385344', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:26:13,626::task::1185::TaskManager.Task::(prepare) Task=`4cf2cd52-2bf4-4f98-8162-017a7b0cb1b3`::finished: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532067385344', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:26:13,626::task::595::TaskManager.Task::(_updateState) Task=`4cf2cd52-2bf4-4f98-8162-017a7b0cb1b3`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-10 09:26:13,626::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee': < ResourceRef 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-10 09:26:13,626::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-10 09:26:13,627::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' >Thread-34::DEBUG::2014-07-10 09:26:13,627::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' (0 active users) >Thread-34::DEBUG::2014-07-10 09:26:13,627::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-10 09:26:13,627::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', Clearing records. >Thread-34::DEBUG::2014-07-10 09:26:13,627::task::990::TaskManager.Task::(_decref) Task=`4cf2cd52-2bf4-4f98-8162-017a7b0cb1b3`::ref 0 aborting False >Thread-18::DEBUG::2014-07-10 09:26:13,734::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/metadata bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-10 09:26:13,755::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000621649 s, 6.6 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:26:14,494::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:26:14,635::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0805013 s, 12.7 MB/s\n'; <rc> = 0 >Thread-40::DEBUG::2014-07-10 09:26:15,501::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lion.qa.lab.tlv.redhat.com:_export_yuri2_backup2/6a70504d-00df-4869-8695-0f442053f6b6/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-40::DEBUG::2014-07-10 09:26:15,522::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n369 bytes (369 B) copied, 0.000377091 s, 979 kB/s\n'; <rc> = 0 >Thread-57::DEBUG::2014-07-10 09:26:15,566::task::595::TaskManager.Task::(_updateState) Task=`337bd8ce-a3ee-4dcb-9473-234c8aaa5a01`::moving from state init -> state preparing >Thread-57::INFO::2014-07-10 09:26:15,566::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='b6f6c0da-e67f-4902-b9ac-3069571a42fe', volUUID='c4cd1da8-05b7-45e0-80b1-1183d21443d9', options=None) >Thread-57::INFO::2014-07-10 09:26:15,567::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-57::DEBUG::2014-07-10 09:26:15,567::task::1185::TaskManager.Task::(prepare) Task=`337bd8ce-a3ee-4dcb-9473-234c8aaa5a01`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-57::DEBUG::2014-07-10 09:26:15,567::task::595::TaskManager.Task::(_updateState) Task=`337bd8ce-a3ee-4dcb-9473-234c8aaa5a01`::moving from state preparing -> state finished >Thread-57::DEBUG::2014-07-10 09:26:15,567::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-57::DEBUG::2014-07-10 09:26:15,567::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-57::DEBUG::2014-07-10 09:26:15,567::task::990::TaskManager.Task::(_decref) Task=`337bd8ce-a3ee-4dcb-9473-234c8aaa5a01`::ref 0 aborting False >Thread-67::DEBUG::2014-07-10 09:26:16,579::task::595::TaskManager.Task::(_updateState) Task=`7ab3c51e-c497-44d8-a429-82a9545dbe99`::moving from state init -> state preparing >Thread-67::INFO::2014-07-10 09:26:16,580::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='f30c2cb7-a43a-4bf5-82b5-cfe07336f65c', volUUID='b0fbb3c9-55af-4a3a-95ad-fc56a80b9cf5', options=None) >Thread-67::INFO::2014-07-10 09:26:16,580::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-67::DEBUG::2014-07-10 09:26:16,580::task::1185::TaskManager.Task::(prepare) Task=`7ab3c51e-c497-44d8-a429-82a9545dbe99`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-67::DEBUG::2014-07-10 09:26:16,580::task::595::TaskManager.Task::(_updateState) Task=`7ab3c51e-c497-44d8-a429-82a9545dbe99`::moving from state preparing -> state finished >Thread-67::DEBUG::2014-07-10 09:26:16,581::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-67::DEBUG::2014-07-10 09:26:16,581::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-67::DEBUG::2014-07-10 09:26:16,582::task::990::TaskManager.Task::(_decref) Task=`7ab3c51e-c497-44d8-a429-82a9545dbe99`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 09:26:16,650::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:26:16,773::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0633281 s, 16.2 MB/s\n'; <rc> = 0 >Thread-48::DEBUG::2014-07-10 09:26:17,103::task::595::TaskManager.Task::(_updateState) Task=`3d06c7d7-36de-4d2a-a8ef-1f5084b459f6`::moving from state init -> state preparing >Thread-48::INFO::2014-07-10 09:26:17,104::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='0cd7d6ce-f497-4243-a690-c57744861eea', volUUID='10b6a7dd-dc6c-43fa-ba17-92e4331b0e0b', options=None) >Thread-48::INFO::2014-07-10 09:26:17,105::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-48::DEBUG::2014-07-10 09:26:17,105::task::1185::TaskManager.Task::(prepare) Task=`3d06c7d7-36de-4d2a-a8ef-1f5084b459f6`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-48::DEBUG::2014-07-10 09:26:17,105::task::595::TaskManager.Task::(_updateState) Task=`3d06c7d7-36de-4d2a-a8ef-1f5084b459f6`::moving from state preparing -> state finished >Thread-48::DEBUG::2014-07-10 09:26:17,105::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-48::DEBUG::2014-07-10 09:26:17,105::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-48::DEBUG::2014-07-10 09:26:17,106::task::990::TaskManager.Task::(_decref) Task=`3d06c7d7-36de-4d2a-a8ef-1f5084b459f6`::ref 0 aborting False >Thread-76::DEBUG::2014-07-10 09:26:18,392::task::595::TaskManager.Task::(_updateState) Task=`c40e74a3-c828-448d-be08-593335a0a3cc`::moving from state init -> state preparing >Thread-76::INFO::2014-07-10 09:26:18,392::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='e4c65229-4247-4b33-b72a-f1d5ce72ad05', volUUID='cad94284-3ca9-4c30-933d-997f4460309e', options=None) >Thread-76::INFO::2014-07-10 09:26:18,393::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-76::DEBUG::2014-07-10 09:26:18,393::task::1185::TaskManager.Task::(prepare) Task=`c40e74a3-c828-448d-be08-593335a0a3cc`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-76::DEBUG::2014-07-10 09:26:18,393::task::595::TaskManager.Task::(_updateState) Task=`c40e74a3-c828-448d-be08-593335a0a3cc`::moving from state preparing -> state finished >Thread-76::DEBUG::2014-07-10 09:26:18,393::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-76::DEBUG::2014-07-10 09:26:18,394::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-76::DEBUG::2014-07-10 09:26:18,394::task::990::TaskManager.Task::(_decref) Task=`c40e74a3-c828-448d-be08-593335a0a3cc`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 09:26:18,790::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:26:19,340::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0322612 s, 31.7 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:26:21,349::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:26:21,437::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.029673 s, 34.5 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:26:23,453::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:26:23,546::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0316995 s, 32.3 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 09:26:23,656::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-14::DEBUG::2014-07-10 09:26:23,657::task::595::TaskManager.Task::(_updateState) Task=`ea92798b-9f28-4008-a7d3-83232d732206`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 09:26:23,658::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-14::INFO::2014-07-10 09:26:23,659::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:26:23,659::task::1185::TaskManager.Task::(prepare) Task=`ea92798b-9f28-4008-a7d3-83232d732206`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:26:23,659::task::595::TaskManager.Task::(_updateState) Task=`ea92798b-9f28-4008-a7d3-83232d732206`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 09:26:23,660::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 09:26:23,660::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 09:26:23,661::task::990::TaskManager.Task::(_decref) Task=`ea92798b-9f28-4008-a7d3-83232d732206`::ref 0 aborting False >Thread-34::DEBUG::2014-07-10 09:26:23,665::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-34::DEBUG::2014-07-10 09:26:23,665::task::595::TaskManager.Task::(_updateState) Task=`573fbce7-ae41-4ba9-a74f-2553a082a0fb`::moving from state init -> state preparing >Thread-34::INFO::2014-07-10 09:26:23,666::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-34::DEBUG::2014-07-10 09:26:23,666::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`b518d9cd-1375-4e89-b6ca-644d2a4520dd`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-10 09:26:23,667::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' for lock type 'shared' >Thread-34::DEBUG::2014-07-10 09:26:23,667::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-10 09:26:23,667::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`b518d9cd-1375-4e89-b6ca-644d2a4520dd`::Granted request >Thread-34::DEBUG::2014-07-10 09:26:23,668::task::827::TaskManager.Task::(resourceAcquired) Task=`573fbce7-ae41-4ba9-a74f-2553a082a0fb`::_resourcesAcquired: Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee (shared) >Thread-34::DEBUG::2014-07-10 09:26:23,668::task::990::TaskManager.Task::(_decref) Task=`573fbce7-ae41-4ba9-a74f-2553a082a0fb`::ref 1 aborting False >Thread-34::INFO::2014-07-10 09:26:23,669::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532067385344', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:26:23,669::task::1185::TaskManager.Task::(prepare) Task=`573fbce7-ae41-4ba9-a74f-2553a082a0fb`::finished: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532067385344', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:26:23,670::task::595::TaskManager.Task::(_updateState) Task=`573fbce7-ae41-4ba9-a74f-2553a082a0fb`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-10 09:26:23,670::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee': < ResourceRef 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-10 09:26:23,670::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-10 09:26:23,670::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' >Thread-34::DEBUG::2014-07-10 09:26:23,670::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' (0 active users) >Thread-34::DEBUG::2014-07-10 09:26:23,671::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-10 09:26:23,671::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', Clearing records. >Thread-34::DEBUG::2014-07-10 09:26:23,671::task::990::TaskManager.Task::(_decref) Task=`573fbce7-ae41-4ba9-a74f-2553a082a0fb`::ref 0 aborting False >Thread-14::DEBUG::2014-07-10 09:26:23,683::task::595::TaskManager.Task::(_updateState) Task=`7b146d2b-5a1b-48dd-8cdb-27f80c885a12`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 09:26:23,683::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::INFO::2014-07-10 09:26:23,683::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000621649', 'lastCheck': '9.9', 'valid': True}, '6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000377091', 'lastCheck': '8.2', 'valid': True}} >Thread-14::DEBUG::2014-07-10 09:26:23,683::task::1185::TaskManager.Task::(prepare) Task=`7b146d2b-5a1b-48dd-8cdb-27f80c885a12`::finished: {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000621649', 'lastCheck': '9.9', 'valid': True}, '6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000377091', 'lastCheck': '8.2', 'valid': True}} >Thread-14::DEBUG::2014-07-10 09:26:23,684::task::595::TaskManager.Task::(_updateState) Task=`7b146d2b-5a1b-48dd-8cdb-27f80c885a12`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 09:26:23,684::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 09:26:23,684::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 09:26:23,684::task::990::TaskManager.Task::(_decref) Task=`7b146d2b-5a1b-48dd-8cdb-27f80c885a12`::ref 0 aborting False >Thread-18::DEBUG::2014-07-10 09:26:23,785::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/metadata bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-10 09:26:23,807::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00084282 s, 4.9 MB/s\n'; <rc> = 0 >Thread-40::DEBUG::2014-07-10 09:26:25,554::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lion.qa.lab.tlv.redhat.com:_export_yuri2_backup2/6a70504d-00df-4869-8695-0f442053f6b6/dom_md/metadata bs=4096 count=1' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:26:25,572::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Thread-40::DEBUG::2014-07-10 09:26:25,595::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n369 bytes (369 B) copied, 0.000382463 s, 965 kB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:26:25,686::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0438908 s, 23.3 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:26:27,701::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:26:27,795::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0362963 s, 28.2 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:26:29,812::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:26:29,899::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.029796 s, 34.4 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:26:31,914::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:26:32,001::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0289968 s, 35.3 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 09:26:33,706::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-14::DEBUG::2014-07-10 09:26:33,707::task::595::TaskManager.Task::(_updateState) Task=`8946988d-6c90-440a-98b8-3c38fe474770`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 09:26:33,708::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-14::INFO::2014-07-10 09:26:33,708::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:26:33,708::task::1185::TaskManager.Task::(prepare) Task=`8946988d-6c90-440a-98b8-3c38fe474770`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:26:33,708::task::595::TaskManager.Task::(_updateState) Task=`8946988d-6c90-440a-98b8-3c38fe474770`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 09:26:33,709::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 09:26:33,709::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 09:26:33,709::task::990::TaskManager.Task::(_decref) Task=`8946988d-6c90-440a-98b8-3c38fe474770`::ref 0 aborting False >Thread-34::DEBUG::2014-07-10 09:26:33,713::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-34::DEBUG::2014-07-10 09:26:33,714::task::595::TaskManager.Task::(_updateState) Task=`1b914d0f-f680-43c5-99ac-25473f57c912`::moving from state init -> state preparing >Thread-34::INFO::2014-07-10 09:26:33,714::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-34::DEBUG::2014-07-10 09:26:33,714::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`11dbfa0a-e245-4e63-a2cc-b44a5b5a1efb`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-10 09:26:33,715::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' for lock type 'shared' >Thread-34::DEBUG::2014-07-10 09:26:33,715::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-10 09:26:33,715::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`11dbfa0a-e245-4e63-a2cc-b44a5b5a1efb`::Granted request >Thread-34::DEBUG::2014-07-10 09:26:33,716::task::827::TaskManager.Task::(resourceAcquired) Task=`1b914d0f-f680-43c5-99ac-25473f57c912`::_resourcesAcquired: Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee (shared) >Thread-34::DEBUG::2014-07-10 09:26:33,716::task::990::TaskManager.Task::(_decref) Task=`1b914d0f-f680-43c5-99ac-25473f57c912`::ref 1 aborting False >Thread-34::INFO::2014-07-10 09:26:33,717::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532067385344', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:26:33,717::task::1185::TaskManager.Task::(prepare) Task=`1b914d0f-f680-43c5-99ac-25473f57c912`::finished: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532067385344', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:26:33,718::task::595::TaskManager.Task::(_updateState) Task=`1b914d0f-f680-43c5-99ac-25473f57c912`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-10 09:26:33,718::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee': < ResourceRef 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-10 09:26:33,718::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-10 09:26:33,718::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' >Thread-34::DEBUG::2014-07-10 09:26:33,719::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' (0 active users) >Thread-34::DEBUG::2014-07-10 09:26:33,719::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-10 09:26:33,719::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', Clearing records. >Thread-34::DEBUG::2014-07-10 09:26:33,719::task::990::TaskManager.Task::(_decref) Task=`1b914d0f-f680-43c5-99ac-25473f57c912`::ref 0 aborting False >Thread-18::DEBUG::2014-07-10 09:26:33,836::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/metadata bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-10 09:26:33,858::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000634392 s, 6.5 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:26:34,015::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:26:34,108::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0338444 s, 30.3 MB/s\n'; <rc> = 0 >Thread-40::DEBUG::2014-07-10 09:26:35,628::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lion.qa.lab.tlv.redhat.com:_export_yuri2_backup2/6a70504d-00df-4869-8695-0f442053f6b6/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-40::DEBUG::2014-07-10 09:26:35,649::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n369 bytes (369 B) copied, 0.000464633 s, 794 kB/s\n'; <rc> = 0 >Thread-70::DEBUG::2014-07-10 09:26:35,695::task::595::TaskManager.Task::(_updateState) Task=`5537b9a1-674b-4245-9b9c-98f27715f7bf`::moving from state init -> state preparing >Thread-70::INFO::2014-07-10 09:26:35,696::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='cfaeead2-7caa-467c-b389-c89840ae6605', volUUID='567fe32d-31a6-4ff6-90f3-fd6a656fbecc', options=None) >Thread-70::INFO::2014-07-10 09:26:35,696::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-70::DEBUG::2014-07-10 09:26:35,696::task::1185::TaskManager.Task::(prepare) Task=`5537b9a1-674b-4245-9b9c-98f27715f7bf`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-70::DEBUG::2014-07-10 09:26:35,697::task::595::TaskManager.Task::(_updateState) Task=`5537b9a1-674b-4245-9b9c-98f27715f7bf`::moving from state preparing -> state finished >Thread-70::DEBUG::2014-07-10 09:26:35,697::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-70::DEBUG::2014-07-10 09:26:35,697::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-70::DEBUG::2014-07-10 09:26:35,697::task::990::TaskManager.Task::(_decref) Task=`5537b9a1-674b-4245-9b9c-98f27715f7bf`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 09:26:36,124::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:26:36,216::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0352678 s, 29.0 MB/s\n'; <rc> = 0 >Thread-60::DEBUG::2014-07-10 09:26:36,657::task::595::TaskManager.Task::(_updateState) Task=`7ddc3ae6-a520-4ffa-af48-9ebadb655530`::moving from state init -> state preparing >Thread-60::INFO::2014-07-10 09:26:36,657::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='b034d5b0-e1e0-4011-b49b-4d45ddb11556', volUUID='3d7f62b5-328f-4d8e-8b69-873cfb5ae14d', options=None) >Thread-60::INFO::2014-07-10 09:26:36,658::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-60::DEBUG::2014-07-10 09:26:36,658::task::1185::TaskManager.Task::(prepare) Task=`7ddc3ae6-a520-4ffa-af48-9ebadb655530`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-60::DEBUG::2014-07-10 09:26:36,658::task::595::TaskManager.Task::(_updateState) Task=`7ddc3ae6-a520-4ffa-af48-9ebadb655530`::moving from state preparing -> state finished >Thread-60::DEBUG::2014-07-10 09:26:36,658::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-60::DEBUG::2014-07-10 09:26:36,658::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-60::DEBUG::2014-07-10 09:26:36,658::task::990::TaskManager.Task::(_decref) Task=`7ddc3ae6-a520-4ffa-af48-9ebadb655530`::ref 0 aborting False >Thread-51::DEBUG::2014-07-10 09:26:36,781::task::595::TaskManager.Task::(_updateState) Task=`18972475-a897-428d-a15d-f802550f7da2`::moving from state init -> state preparing >Thread-51::INFO::2014-07-10 09:26:36,782::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='76fdb054-02cd-42ed-9721-b3e65b34c3a4', volUUID='022dfe46-2cf7-4915-80b3-883158e3ca83', options=None) >Thread-51::INFO::2014-07-10 09:26:36,782::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-51::DEBUG::2014-07-10 09:26:36,782::task::1185::TaskManager.Task::(prepare) Task=`18972475-a897-428d-a15d-f802550f7da2`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-51::DEBUG::2014-07-10 09:26:36,783::task::595::TaskManager.Task::(_updateState) Task=`18972475-a897-428d-a15d-f802550f7da2`::moving from state preparing -> state finished >Thread-51::DEBUG::2014-07-10 09:26:36,783::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-51::DEBUG::2014-07-10 09:26:36,783::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-51::DEBUG::2014-07-10 09:26:36,783::task::990::TaskManager.Task::(_decref) Task=`18972475-a897-428d-a15d-f802550f7da2`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 09:26:38,232::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:26:38,325::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0353619 s, 29.0 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 09:26:38,864::task::595::TaskManager.Task::(_updateState) Task=`1c4fff17-29ca-437f-9795-6e3cad29ed42`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 09:26:38,864::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::INFO::2014-07-10 09:26:38,865::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000634392', 'lastCheck': '5.0', 'valid': True}, '6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000464633', 'lastCheck': '3.2', 'valid': True}} >Thread-14::DEBUG::2014-07-10 09:26:38,865::task::1185::TaskManager.Task::(prepare) Task=`1c4fff17-29ca-437f-9795-6e3cad29ed42`::finished: {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000634392', 'lastCheck': '5.0', 'valid': True}, '6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000464633', 'lastCheck': '3.2', 'valid': True}} >Thread-14::DEBUG::2014-07-10 09:26:38,865::task::595::TaskManager.Task::(_updateState) Task=`1c4fff17-29ca-437f-9795-6e3cad29ed42`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 09:26:38,866::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 09:26:38,866::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 09:26:38,866::task::990::TaskManager.Task::(_decref) Task=`1c4fff17-29ca-437f-9795-6e3cad29ed42`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 09:26:40,340::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:26:40,442::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0438364 s, 23.4 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:26:42,457::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:26:42,567::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0344585 s, 29.7 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 09:26:43,756::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [72f5e52c] >Thread-14::DEBUG::2014-07-10 09:26:43,758::task::595::TaskManager.Task::(_updateState) Task=`3e9c3609-a431-4c0b-a81a-7bc9e079c497`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 09:26:43,758::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-14::INFO::2014-07-10 09:26:43,758::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:26:43,759::task::1185::TaskManager.Task::(prepare) Task=`3e9c3609-a431-4c0b-a81a-7bc9e079c497`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:26:43,759::task::595::TaskManager.Task::(_updateState) Task=`3e9c3609-a431-4c0b-a81a-7bc9e079c497`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 09:26:43,759::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 09:26:43,759::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 09:26:43,760::task::990::TaskManager.Task::(_decref) Task=`3e9c3609-a431-4c0b-a81a-7bc9e079c497`::ref 0 aborting False >Thread-34::DEBUG::2014-07-10 09:26:43,764::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [72f5e52c] >Thread-34::DEBUG::2014-07-10 09:26:43,764::task::595::TaskManager.Task::(_updateState) Task=`c8ef4413-5245-42e9-b964-ea6332e8b017`::moving from state init -> state preparing >Thread-34::INFO::2014-07-10 09:26:43,764::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-34::DEBUG::2014-07-10 09:26:43,765::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`0eef384e-3552-4126-bd53-b5d37b2274c0`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-10 09:26:43,765::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' for lock type 'shared' >Thread-34::DEBUG::2014-07-10 09:26:43,765::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-10 09:26:43,766::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`0eef384e-3552-4126-bd53-b5d37b2274c0`::Granted request >Thread-34::DEBUG::2014-07-10 09:26:43,766::task::827::TaskManager.Task::(resourceAcquired) Task=`c8ef4413-5245-42e9-b964-ea6332e8b017`::_resourcesAcquired: Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee (shared) >Thread-34::DEBUG::2014-07-10 09:26:43,766::task::990::TaskManager.Task::(_decref) Task=`c8ef4413-5245-42e9-b964-ea6332e8b017`::ref 1 aborting False >Thread-34::INFO::2014-07-10 09:26:43,767::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532067385344', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:26:43,767::task::1185::TaskManager.Task::(prepare) Task=`c8ef4413-5245-42e9-b964-ea6332e8b017`::finished: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532067385344', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:26:43,768::task::595::TaskManager.Task::(_updateState) Task=`c8ef4413-5245-42e9-b964-ea6332e8b017`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-10 09:26:43,768::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee': < ResourceRef 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-10 09:26:43,768::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-10 09:26:43,768::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' >Thread-34::DEBUG::2014-07-10 09:26:43,768::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' (0 active users) >Thread-34::DEBUG::2014-07-10 09:26:43,768::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-10 09:26:43,769::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', Clearing records. >Thread-34::DEBUG::2014-07-10 09:26:43,769::task::990::TaskManager.Task::(_decref) Task=`c8ef4413-5245-42e9-b964-ea6332e8b017`::ref 0 aborting False >Thread-18::DEBUG::2014-07-10 09:26:43,887::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/metadata bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-10 09:26:43,910::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000784118 s, 5.2 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:26:44,587::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:26:44,693::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0471992 s, 21.7 MB/s\n'; <rc> = 0 >Thread-40::DEBUG::2014-07-10 09:26:45,680::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lion.qa.lab.tlv.redhat.com:_export_yuri2_backup2/6a70504d-00df-4869-8695-0f442053f6b6/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-40::DEBUG::2014-07-10 09:26:45,700::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n369 bytes (369 B) copied, 0.000501049 s, 736 kB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:26:46,708::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:26:46,805::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0351227 s, 29.2 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:26:48,820::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:26:48,933::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0491359 s, 20.8 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:26:50,949::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:26:51,108::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0865379 s, 11.8 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:26:53,124::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:26:53,235::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0521856 s, 19.6 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 09:26:53,790::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-14::DEBUG::2014-07-10 09:26:53,791::task::595::TaskManager.Task::(_updateState) Task=`100de0c0-1a1a-48e8-89bd-bf54e9b38567`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 09:26:53,792::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-14::INFO::2014-07-10 09:26:53,792::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:26:53,793::task::1185::TaskManager.Task::(prepare) Task=`100de0c0-1a1a-48e8-89bd-bf54e9b38567`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:26:53,793::task::595::TaskManager.Task::(_updateState) Task=`100de0c0-1a1a-48e8-89bd-bf54e9b38567`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 09:26:53,793::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 09:26:53,793::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 09:26:53,793::task::990::TaskManager.Task::(_decref) Task=`100de0c0-1a1a-48e8-89bd-bf54e9b38567`::ref 0 aborting False >Thread-34::DEBUG::2014-07-10 09:26:53,798::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-34::DEBUG::2014-07-10 09:26:53,798::task::595::TaskManager.Task::(_updateState) Task=`0fd811ee-95a7-4ead-b2d6-a4a992c3cb0a`::moving from state init -> state preparing >Thread-34::INFO::2014-07-10 09:26:53,798::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-34::DEBUG::2014-07-10 09:26:53,799::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`1f2941fc-ac51-436c-9884-7cf58fa5992d`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-10 09:26:53,799::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' for lock type 'shared' >Thread-34::DEBUG::2014-07-10 09:26:53,800::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-10 09:26:53,800::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`1f2941fc-ac51-436c-9884-7cf58fa5992d`::Granted request >Thread-34::DEBUG::2014-07-10 09:26:53,800::task::827::TaskManager.Task::(resourceAcquired) Task=`0fd811ee-95a7-4ead-b2d6-a4a992c3cb0a`::_resourcesAcquired: Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee (shared) >Thread-34::DEBUG::2014-07-10 09:26:53,801::task::990::TaskManager.Task::(_decref) Task=`0fd811ee-95a7-4ead-b2d6-a4a992c3cb0a`::ref 1 aborting False >Thread-34::INFO::2014-07-10 09:26:53,802::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532067385344', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:26:53,802::task::1185::TaskManager.Task::(prepare) Task=`0fd811ee-95a7-4ead-b2d6-a4a992c3cb0a`::finished: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532067385344', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:26:53,802::task::595::TaskManager.Task::(_updateState) Task=`0fd811ee-95a7-4ead-b2d6-a4a992c3cb0a`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-10 09:26:53,802::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee': < ResourceRef 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-10 09:26:53,803::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-10 09:26:53,803::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' >Thread-34::DEBUG::2014-07-10 09:26:53,803::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' (0 active users) >Thread-34::DEBUG::2014-07-10 09:26:53,803::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-10 09:26:53,804::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', Clearing records. >Thread-34::DEBUG::2014-07-10 09:26:53,804::task::990::TaskManager.Task::(_decref) Task=`0fd811ee-95a7-4ead-b2d6-a4a992c3cb0a`::ref 0 aborting False >Thread-18::DEBUG::2014-07-10 09:26:53,939::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/metadata bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-10 09:26:53,959::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00056935 s, 7.2 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 09:26:54,094::task::595::TaskManager.Task::(_updateState) Task=`87372ddf-f035-4fe6-8ff5-301bc90256b5`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 09:26:54,094::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::INFO::2014-07-10 09:26:54,095::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00056935', 'lastCheck': '0.1', 'valid': True}, '6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000501049', 'lastCheck': '8.4', 'valid': True}} >Thread-14::DEBUG::2014-07-10 09:26:54,095::task::1185::TaskManager.Task::(prepare) Task=`87372ddf-f035-4fe6-8ff5-301bc90256b5`::finished: {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00056935', 'lastCheck': '0.1', 'valid': True}, '6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000501049', 'lastCheck': '8.4', 'valid': True}} >Thread-14::DEBUG::2014-07-10 09:26:54,095::task::595::TaskManager.Task::(_updateState) Task=`87372ddf-f035-4fe6-8ff5-301bc90256b5`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 09:26:54,095::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 09:26:54,095::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 09:26:54,096::task::990::TaskManager.Task::(_decref) Task=`87372ddf-f035-4fe6-8ff5-301bc90256b5`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 09:26:55,251::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:26:55,345::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0324984 s, 31.5 MB/s\n'; <rc> = 0 >Thread-40::DEBUG::2014-07-10 09:26:55,731::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lion.qa.lab.tlv.redhat.com:_export_yuri2_backup2/6a70504d-00df-4869-8695-0f442053f6b6/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-40::DEBUG::2014-07-10 09:26:55,752::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n369 bytes (369 B) copied, 0.000489838 s, 753 kB/s\n'; <rc> = 0 >Thread-64::DEBUG::2014-07-10 09:26:55,775::task::595::TaskManager.Task::(_updateState) Task=`b14776ce-cf88-42c6-9d05-422d939c0a31`::moving from state init -> state preparing >Thread-64::INFO::2014-07-10 09:26:55,775::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='aa20346a-4d3a-4e07-b8e1-52c0ebe4168c', volUUID='58fefce2-9bce-4bff-8949-8c6ce8122b27', options=None) >Thread-64::INFO::2014-07-10 09:26:55,776::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-64::DEBUG::2014-07-10 09:26:55,776::task::1185::TaskManager.Task::(prepare) Task=`b14776ce-cf88-42c6-9d05-422d939c0a31`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-64::DEBUG::2014-07-10 09:26:55,776::task::595::TaskManager.Task::(_updateState) Task=`b14776ce-cf88-42c6-9d05-422d939c0a31`::moving from state preparing -> state finished >Thread-64::DEBUG::2014-07-10 09:26:55,776::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-64::DEBUG::2014-07-10 09:26:55,776::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-64::DEBUG::2014-07-10 09:26:55,777::task::990::TaskManager.Task::(_decref) Task=`b14776ce-cf88-42c6-9d05-422d939c0a31`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 09:26:57,360::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:26:57,450::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0328185 s, 31.2 MB/s\n'; <rc> = 0 >Thread-54::DEBUG::2014-07-10 09:26:57,634::task::595::TaskManager.Task::(_updateState) Task=`b52c6540-1b6b-4023-a476-2a62431215e8`::moving from state init -> state preparing >Thread-73::DEBUG::2014-07-10 09:26:57,635::task::595::TaskManager.Task::(_updateState) Task=`ed6376ed-1efe-4f4d-a2c3-6352a2907e24`::moving from state init -> state preparing >Thread-54::INFO::2014-07-10 09:26:57,636::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='28408446-e5fd-4565-a976-e760951593fe', volUUID='776303a2-5585-451e-826e-0e338d4a1e98', options=None) >Thread-73::INFO::2014-07-10 09:26:57,637::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='c01d693b-cba0-4fed-9ad7-0aaa28912a19', volUUID='4bb5d954-2a50-4028-b299-0b43c261270c', options=None) >Thread-54::INFO::2014-07-10 09:26:57,638::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-73::INFO::2014-07-10 09:26:57,639::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-54::DEBUG::2014-07-10 09:26:57,640::task::1185::TaskManager.Task::(prepare) Task=`b52c6540-1b6b-4023-a476-2a62431215e8`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-73::DEBUG::2014-07-10 09:26:57,640::task::1185::TaskManager.Task::(prepare) Task=`ed6376ed-1efe-4f4d-a2c3-6352a2907e24`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-54::DEBUG::2014-07-10 09:26:57,641::task::595::TaskManager.Task::(_updateState) Task=`b52c6540-1b6b-4023-a476-2a62431215e8`::moving from state preparing -> state finished >Thread-73::DEBUG::2014-07-10 09:26:57,641::task::595::TaskManager.Task::(_updateState) Task=`ed6376ed-1efe-4f4d-a2c3-6352a2907e24`::moving from state preparing -> state finished >Thread-54::DEBUG::2014-07-10 09:26:57,642::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-73::DEBUG::2014-07-10 09:26:57,643::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-54::DEBUG::2014-07-10 09:26:57,644::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-73::DEBUG::2014-07-10 09:26:57,644::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-54::DEBUG::2014-07-10 09:26:57,645::task::990::TaskManager.Task::(_decref) Task=`b52c6540-1b6b-4023-a476-2a62431215e8`::ref 0 aborting False >Thread-73::DEBUG::2014-07-10 09:26:57,645::task::990::TaskManager.Task::(_decref) Task=`ed6376ed-1efe-4f4d-a2c3-6352a2907e24`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 09:26:59,467::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:26:59,554::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0302994 s, 33.8 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:27:01,570::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:27:01,656::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0277708 s, 36.9 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:27:03,672::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:27:03,767::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0328309 s, 31.2 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 09:27:03,831::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-14::DEBUG::2014-07-10 09:27:03,832::task::595::TaskManager.Task::(_updateState) Task=`39e9aa22-1683-4fa8-8675-edac1ab59236`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 09:27:03,833::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-14::INFO::2014-07-10 09:27:03,833::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:27:03,834::task::1185::TaskManager.Task::(prepare) Task=`39e9aa22-1683-4fa8-8675-edac1ab59236`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:27:03,834::task::595::TaskManager.Task::(_updateState) Task=`39e9aa22-1683-4fa8-8675-edac1ab59236`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 09:27:03,834::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 09:27:03,834::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 09:27:03,835::task::990::TaskManager.Task::(_decref) Task=`39e9aa22-1683-4fa8-8675-edac1ab59236`::ref 0 aborting False >Thread-34::DEBUG::2014-07-10 09:27:03,839::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-34::DEBUG::2014-07-10 09:27:03,840::task::595::TaskManager.Task::(_updateState) Task=`131ae80a-cab0-479f-b860-67239ac36eea`::moving from state init -> state preparing >Thread-34::INFO::2014-07-10 09:27:03,840::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-34::DEBUG::2014-07-10 09:27:03,841::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`1b2742ca-0086-4fe4-a482-73505f2ac8e4`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-10 09:27:03,841::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' for lock type 'shared' >Thread-34::DEBUG::2014-07-10 09:27:03,841::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-10 09:27:03,841::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`1b2742ca-0086-4fe4-a482-73505f2ac8e4`::Granted request >Thread-34::DEBUG::2014-07-10 09:27:03,842::task::827::TaskManager.Task::(resourceAcquired) Task=`131ae80a-cab0-479f-b860-67239ac36eea`::_resourcesAcquired: Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee (shared) >Thread-34::DEBUG::2014-07-10 09:27:03,842::task::990::TaskManager.Task::(_decref) Task=`131ae80a-cab0-479f-b860-67239ac36eea`::ref 1 aborting False >Thread-34::INFO::2014-07-10 09:27:03,843::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532067385344', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:27:03,844::task::1185::TaskManager.Task::(prepare) Task=`131ae80a-cab0-479f-b860-67239ac36eea`::finished: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532067385344', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:27:03,844::task::595::TaskManager.Task::(_updateState) Task=`131ae80a-cab0-479f-b860-67239ac36eea`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-10 09:27:03,844::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee': < ResourceRef 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-10 09:27:03,844::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-10 09:27:03,845::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' >Thread-34::DEBUG::2014-07-10 09:27:03,845::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' (0 active users) >Thread-34::DEBUG::2014-07-10 09:27:03,845::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-10 09:27:03,845::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', Clearing records. >Thread-34::DEBUG::2014-07-10 09:27:03,845::task::990::TaskManager.Task::(_decref) Task=`131ae80a-cab0-479f-b860-67239ac36eea`::ref 0 aborting False >Thread-18::DEBUG::2014-07-10 09:27:03,991::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/metadata bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-10 09:27:04,011::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000664073 s, 6.2 MB/s\n'; <rc> = 0 >Thread-40::DEBUG::2014-07-10 09:27:05,779::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lion.qa.lab.tlv.redhat.com:_export_yuri2_backup2/6a70504d-00df-4869-8695-0f442053f6b6/dom_md/metadata bs=4096 count=1' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:27:05,797::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Thread-40::DEBUG::2014-07-10 09:27:05,913::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n369 bytes (369 B) copied, 0.000514642 s, 717 kB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:27:06,019::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.155313 s, 6.6 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:27:08,043::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:27:08,140::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0393435 s, 26.0 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 09:27:09,263::task::595::TaskManager.Task::(_updateState) Task=`a64c8b86-5bf1-4999-a6f7-0aab4343e836`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 09:27:09,263::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::INFO::2014-07-10 09:27:09,264::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000664073', 'lastCheck': '5.2', 'valid': True}, '6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000514642', 'lastCheck': '3.3', 'valid': True}} >Thread-14::DEBUG::2014-07-10 09:27:09,264::task::1185::TaskManager.Task::(prepare) Task=`a64c8b86-5bf1-4999-a6f7-0aab4343e836`::finished: {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000664073', 'lastCheck': '5.2', 'valid': True}, '6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000514642', 'lastCheck': '3.3', 'valid': True}} >Thread-14::DEBUG::2014-07-10 09:27:09,264::task::595::TaskManager.Task::(_updateState) Task=`a64c8b86-5bf1-4999-a6f7-0aab4343e836`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 09:27:09,264::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 09:27:09,264::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 09:27:09,265::task::990::TaskManager.Task::(_decref) Task=`a64c8b86-5bf1-4999-a6f7-0aab4343e836`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 09:27:10,155::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:27:10,250::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0370235 s, 27.7 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:27:12,270::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:27:12,359::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0313729 s, 32.6 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 09:27:13,874::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-14::DEBUG::2014-07-10 09:27:13,875::task::595::TaskManager.Task::(_updateState) Task=`94af4718-edfe-4caf-aaab-8b7d2a501816`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 09:27:13,876::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-14::INFO::2014-07-10 09:27:13,876::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:27:13,877::task::1185::TaskManager.Task::(prepare) Task=`94af4718-edfe-4caf-aaab-8b7d2a501816`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:27:13,877::task::595::TaskManager.Task::(_updateState) Task=`94af4718-edfe-4caf-aaab-8b7d2a501816`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 09:27:13,877::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 09:27:13,877::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 09:27:13,877::task::990::TaskManager.Task::(_decref) Task=`94af4718-edfe-4caf-aaab-8b7d2a501816`::ref 0 aborting False >Thread-34::DEBUG::2014-07-10 09:27:13,881::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-34::DEBUG::2014-07-10 09:27:13,882::task::595::TaskManager.Task::(_updateState) Task=`16037d50-05d1-4ed2-af79-cced13c5047e`::moving from state init -> state preparing >Thread-34::INFO::2014-07-10 09:27:13,882::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-34::DEBUG::2014-07-10 09:27:13,883::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`1040ae1b-cc8b-49fe-b2e4-0a7f1ea89d35`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-10 09:27:13,883::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' for lock type 'shared' >Thread-34::DEBUG::2014-07-10 09:27:13,884::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-10 09:27:13,884::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`1040ae1b-cc8b-49fe-b2e4-0a7f1ea89d35`::Granted request >Thread-34::DEBUG::2014-07-10 09:27:13,884::task::827::TaskManager.Task::(resourceAcquired) Task=`16037d50-05d1-4ed2-af79-cced13c5047e`::_resourcesAcquired: Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee (shared) >Thread-34::DEBUG::2014-07-10 09:27:13,885::task::990::TaskManager.Task::(_decref) Task=`16037d50-05d1-4ed2-af79-cced13c5047e`::ref 1 aborting False >Thread-34::INFO::2014-07-10 09:27:13,886::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532067385344', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:27:13,886::task::1185::TaskManager.Task::(prepare) Task=`16037d50-05d1-4ed2-af79-cced13c5047e`::finished: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532067385344', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:27:13,886::task::595::TaskManager.Task::(_updateState) Task=`16037d50-05d1-4ed2-af79-cced13c5047e`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-10 09:27:13,887::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee': < ResourceRef 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-10 09:27:13,887::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-10 09:27:13,887::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' >Thread-34::DEBUG::2014-07-10 09:27:13,887::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' (0 active users) >Thread-34::DEBUG::2014-07-10 09:27:13,887::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-10 09:27:13,888::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', Clearing records. >Thread-34::DEBUG::2014-07-10 09:27:13,888::task::990::TaskManager.Task::(_decref) Task=`16037d50-05d1-4ed2-af79-cced13c5047e`::ref 0 aborting False >Thread-18::DEBUG::2014-07-10 09:27:14,040::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/metadata bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-10 09:27:14,065::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000849281 s, 4.8 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:27:14,375::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:27:14,483::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0355104 s, 28.8 MB/s\n'; <rc> = 0 >Thread-57::DEBUG::2014-07-10 09:27:15,860::task::595::TaskManager.Task::(_updateState) Task=`1c4e1f54-faa2-448e-8ca8-d35d1f651fee`::moving from state init -> state preparing >Thread-57::INFO::2014-07-10 09:27:15,860::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='b6f6c0da-e67f-4902-b9ac-3069571a42fe', volUUID='c4cd1da8-05b7-45e0-80b1-1183d21443d9', options=None) >Thread-57::INFO::2014-07-10 09:27:15,860::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-57::DEBUG::2014-07-10 09:27:15,861::task::1185::TaskManager.Task::(prepare) Task=`1c4e1f54-faa2-448e-8ca8-d35d1f651fee`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-57::DEBUG::2014-07-10 09:27:15,861::task::595::TaskManager.Task::(_updateState) Task=`1c4e1f54-faa2-448e-8ca8-d35d1f651fee`::moving from state preparing -> state finished >Thread-57::DEBUG::2014-07-10 09:27:15,861::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-57::DEBUG::2014-07-10 09:27:15,861::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-57::DEBUG::2014-07-10 09:27:15,861::task::990::TaskManager.Task::(_decref) Task=`1c4e1f54-faa2-448e-8ca8-d35d1f651fee`::ref 0 aborting False >Thread-40::DEBUG::2014-07-10 09:27:15,986::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lion.qa.lab.tlv.redhat.com:_export_yuri2_backup2/6a70504d-00df-4869-8695-0f442053f6b6/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-40::DEBUG::2014-07-10 09:27:16,016::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n369 bytes (369 B) copied, 0.000438604 s, 841 kB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:27:16,500::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:27:16,597::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0276376 s, 37.1 MB/s\n'; <rc> = 0 >Thread-67::DEBUG::2014-07-10 09:27:16,867::task::595::TaskManager.Task::(_updateState) Task=`2c795007-34d0-4d3b-bf4b-ce78944610bc`::moving from state init -> state preparing >Thread-67::INFO::2014-07-10 09:27:16,867::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='f30c2cb7-a43a-4bf5-82b5-cfe07336f65c', volUUID='b0fbb3c9-55af-4a3a-95ad-fc56a80b9cf5', options=None) >Thread-67::INFO::2014-07-10 09:27:16,868::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-67::DEBUG::2014-07-10 09:27:16,868::task::1185::TaskManager.Task::(prepare) Task=`2c795007-34d0-4d3b-bf4b-ce78944610bc`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-67::DEBUG::2014-07-10 09:27:16,868::task::595::TaskManager.Task::(_updateState) Task=`2c795007-34d0-4d3b-bf4b-ce78944610bc`::moving from state preparing -> state finished >Thread-67::DEBUG::2014-07-10 09:27:16,869::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-67::DEBUG::2014-07-10 09:27:16,869::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-67::DEBUG::2014-07-10 09:27:16,869::task::990::TaskManager.Task::(_decref) Task=`2c795007-34d0-4d3b-bf4b-ce78944610bc`::ref 0 aborting False >Thread-48::DEBUG::2014-07-10 09:27:17,378::task::595::TaskManager.Task::(_updateState) Task=`1b632a77-b294-4088-a1a5-b844d15ee33b`::moving from state init -> state preparing >Thread-48::INFO::2014-07-10 09:27:17,378::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='0cd7d6ce-f497-4243-a690-c57744861eea', volUUID='10b6a7dd-dc6c-43fa-ba17-92e4331b0e0b', options=None) >Thread-48::INFO::2014-07-10 09:27:17,378::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-48::DEBUG::2014-07-10 09:27:17,379::task::1185::TaskManager.Task::(prepare) Task=`1b632a77-b294-4088-a1a5-b844d15ee33b`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-48::DEBUG::2014-07-10 09:27:17,379::task::595::TaskManager.Task::(_updateState) Task=`1b632a77-b294-4088-a1a5-b844d15ee33b`::moving from state preparing -> state finished >Thread-48::DEBUG::2014-07-10 09:27:17,379::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-48::DEBUG::2014-07-10 09:27:17,379::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-48::DEBUG::2014-07-10 09:27:17,379::task::990::TaskManager.Task::(_decref) Task=`1b632a77-b294-4088-a1a5-b844d15ee33b`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 09:27:18,621::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Thread-76::DEBUG::2014-07-10 09:27:18,674::task::595::TaskManager.Task::(_updateState) Task=`ba37bfed-efe2-4277-ab54-7594cef62e89`::moving from state init -> state preparing >Thread-76::INFO::2014-07-10 09:27:18,678::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='e4c65229-4247-4b33-b72a-f1d5ce72ad05', volUUID='cad94284-3ca9-4c30-933d-997f4460309e', options=None) >Thread-76::INFO::2014-07-10 09:27:18,682::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-76::DEBUG::2014-07-10 09:27:18,685::task::1185::TaskManager.Task::(prepare) Task=`ba37bfed-efe2-4277-ab54-7594cef62e89`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-76::DEBUG::2014-07-10 09:27:18,687::task::595::TaskManager.Task::(_updateState) Task=`ba37bfed-efe2-4277-ab54-7594cef62e89`::moving from state preparing -> state finished >Thread-76::DEBUG::2014-07-10 09:27:18,689::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-76::DEBUG::2014-07-10 09:27:18,692::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-76::DEBUG::2014-07-10 09:27:18,694::task::990::TaskManager.Task::(_decref) Task=`ba37bfed-efe2-4277-ab54-7594cef62e89`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 09:27:18,747::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0660735 s, 15.5 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:27:20,764::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:27:20,869::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0301011 s, 34.0 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:27:22,888::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:27:22,977::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.030162 s, 34.0 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 09:27:23,916::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-14::DEBUG::2014-07-10 09:27:23,917::task::595::TaskManager.Task::(_updateState) Task=`37f1946b-7c27-4877-b0ee-6fc3c5ba5b4b`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 09:27:23,917::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-14::INFO::2014-07-10 09:27:23,918::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:27:23,918::task::1185::TaskManager.Task::(prepare) Task=`37f1946b-7c27-4877-b0ee-6fc3c5ba5b4b`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:27:23,918::task::595::TaskManager.Task::(_updateState) Task=`37f1946b-7c27-4877-b0ee-6fc3c5ba5b4b`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 09:27:23,918::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 09:27:23,919::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 09:27:23,919::task::990::TaskManager.Task::(_decref) Task=`37f1946b-7c27-4877-b0ee-6fc3c5ba5b4b`::ref 0 aborting False >Thread-34::DEBUG::2014-07-10 09:27:23,923::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-34::DEBUG::2014-07-10 09:27:23,923::task::595::TaskManager.Task::(_updateState) Task=`4fb1f60e-68bc-452c-b4b6-0247b0f85ea1`::moving from state init -> state preparing >Thread-34::INFO::2014-07-10 09:27:23,924::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-34::DEBUG::2014-07-10 09:27:23,925::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`5bfcb37c-7d0e-4015-9dec-f281963d58a6`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-10 09:27:23,925::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' for lock type 'shared' >Thread-34::DEBUG::2014-07-10 09:27:23,925::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-10 09:27:23,925::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`5bfcb37c-7d0e-4015-9dec-f281963d58a6`::Granted request >Thread-34::DEBUG::2014-07-10 09:27:23,926::task::827::TaskManager.Task::(resourceAcquired) Task=`4fb1f60e-68bc-452c-b4b6-0247b0f85ea1`::_resourcesAcquired: Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee (shared) >Thread-34::DEBUG::2014-07-10 09:27:23,926::task::990::TaskManager.Task::(_decref) Task=`4fb1f60e-68bc-452c-b4b6-0247b0f85ea1`::ref 1 aborting False >Thread-34::INFO::2014-07-10 09:27:23,927::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532067385344', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:27:23,928::task::1185::TaskManager.Task::(prepare) Task=`4fb1f60e-68bc-452c-b4b6-0247b0f85ea1`::finished: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532067385344', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:27:23,928::task::595::TaskManager.Task::(_updateState) Task=`4fb1f60e-68bc-452c-b4b6-0247b0f85ea1`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-10 09:27:23,928::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee': < ResourceRef 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-10 09:27:23,928::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-10 09:27:23,928::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' >Thread-34::DEBUG::2014-07-10 09:27:23,929::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' (0 active users) >Thread-34::DEBUG::2014-07-10 09:27:23,929::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-10 09:27:23,929::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', Clearing records. >Thread-34::DEBUG::2014-07-10 09:27:23,929::task::990::TaskManager.Task::(_decref) Task=`4fb1f60e-68bc-452c-b4b6-0247b0f85ea1`::ref 0 aborting False >Thread-18::DEBUG::2014-07-10 09:27:24,102::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/metadata bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-10 09:27:24,126::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000781666 s, 5.2 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 09:27:24,520::task::595::TaskManager.Task::(_updateState) Task=`6bfa8444-6bbd-463c-8c98-b4c25dac7c1f`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 09:27:24,520::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::INFO::2014-07-10 09:27:24,521::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000781666', 'lastCheck': '0.4', 'valid': True}, '6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000438604', 'lastCheck': '8.5', 'valid': True}} >Thread-14::DEBUG::2014-07-10 09:27:24,521::task::1185::TaskManager.Task::(prepare) Task=`6bfa8444-6bbd-463c-8c98-b4c25dac7c1f`::finished: {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000781666', 'lastCheck': '0.4', 'valid': True}, '6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000438604', 'lastCheck': '8.5', 'valid': True}} >Thread-14::DEBUG::2014-07-10 09:27:24,521::task::595::TaskManager.Task::(_updateState) Task=`6bfa8444-6bbd-463c-8c98-b4c25dac7c1f`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 09:27:24,521::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 09:27:24,522::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 09:27:24,522::task::990::TaskManager.Task::(_decref) Task=`6bfa8444-6bbd-463c-8c98-b4c25dac7c1f`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 09:27:24,994::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:27:25,085::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0349714 s, 29.3 MB/s\n'; <rc> = 0 >Thread-40::DEBUG::2014-07-10 09:27:26,043::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lion.qa.lab.tlv.redhat.com:_export_yuri2_backup2/6a70504d-00df-4869-8695-0f442053f6b6/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-40::DEBUG::2014-07-10 09:27:26,078::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n369 bytes (369 B) copied, 0.000412588 s, 894 kB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:27:27,100::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:27:27,188::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0308457 s, 33.2 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:27:29,205::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:27:29,301::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0266823 s, 38.4 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:27:31,316::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:27:31,402::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0286217 s, 35.8 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:27:33,418::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:27:33,564::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0313788 s, 32.6 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 09:27:33,957::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-14::DEBUG::2014-07-10 09:27:33,958::task::595::TaskManager.Task::(_updateState) Task=`bb4f6555-844f-4684-9949-2dddd4c359b6`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 09:27:33,958::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-14::INFO::2014-07-10 09:27:33,959::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:27:33,959::task::1185::TaskManager.Task::(prepare) Task=`bb4f6555-844f-4684-9949-2dddd4c359b6`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:27:33,959::task::595::TaskManager.Task::(_updateState) Task=`bb4f6555-844f-4684-9949-2dddd4c359b6`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 09:27:33,959::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 09:27:33,959::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 09:27:33,960::task::990::TaskManager.Task::(_decref) Task=`bb4f6555-844f-4684-9949-2dddd4c359b6`::ref 0 aborting False >Thread-34::DEBUG::2014-07-10 09:27:33,964::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-34::DEBUG::2014-07-10 09:27:33,964::task::595::TaskManager.Task::(_updateState) Task=`c912142a-3805-4125-bfda-f7e16a524e54`::moving from state init -> state preparing >Thread-34::INFO::2014-07-10 09:27:33,964::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-34::DEBUG::2014-07-10 09:27:33,965::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`a254590c-2c99-4561-a00d-8b979918faa7`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-10 09:27:33,965::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' for lock type 'shared' >Thread-34::DEBUG::2014-07-10 09:27:33,966::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-10 09:27:33,966::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`a254590c-2c99-4561-a00d-8b979918faa7`::Granted request >Thread-34::DEBUG::2014-07-10 09:27:33,966::task::827::TaskManager.Task::(resourceAcquired) Task=`c912142a-3805-4125-bfda-f7e16a524e54`::_resourcesAcquired: Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee (shared) >Thread-34::DEBUG::2014-07-10 09:27:33,966::task::990::TaskManager.Task::(_decref) Task=`c912142a-3805-4125-bfda-f7e16a524e54`::ref 1 aborting False >Thread-34::INFO::2014-07-10 09:27:33,968::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532067385344', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:27:33,968::task::1185::TaskManager.Task::(prepare) Task=`c912142a-3805-4125-bfda-f7e16a524e54`::finished: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532067385344', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:27:33,968::task::595::TaskManager.Task::(_updateState) Task=`c912142a-3805-4125-bfda-f7e16a524e54`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-10 09:27:33,968::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee': < ResourceRef 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-10 09:27:33,968::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-10 09:27:33,969::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' >Thread-34::DEBUG::2014-07-10 09:27:33,969::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' (0 active users) >Thread-34::DEBUG::2014-07-10 09:27:33,969::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-10 09:27:33,969::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', Clearing records. >Thread-34::DEBUG::2014-07-10 09:27:33,970::task::990::TaskManager.Task::(_decref) Task=`c912142a-3805-4125-bfda-f7e16a524e54`::ref 0 aborting False >Thread-18::DEBUG::2014-07-10 09:27:34,157::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/metadata bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-10 09:27:34,179::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000796182 s, 5.1 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:27:35,589::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:27:35,740::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0937195 s, 10.9 MB/s\n'; <rc> = 0 >Thread-70::DEBUG::2014-07-10 09:27:35,993::task::595::TaskManager.Task::(_updateState) Task=`e35095ab-b29e-4697-882a-bcbef9c8190f`::moving from state init -> state preparing >Thread-70::INFO::2014-07-10 09:27:35,994::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='cfaeead2-7caa-467c-b389-c89840ae6605', volUUID='567fe32d-31a6-4ff6-90f3-fd6a656fbecc', options=None) >Thread-70::INFO::2014-07-10 09:27:35,995::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-70::DEBUG::2014-07-10 09:27:35,995::task::1185::TaskManager.Task::(prepare) Task=`e35095ab-b29e-4697-882a-bcbef9c8190f`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-70::DEBUG::2014-07-10 09:27:35,995::task::595::TaskManager.Task::(_updateState) Task=`e35095ab-b29e-4697-882a-bcbef9c8190f`::moving from state preparing -> state finished >Thread-70::DEBUG::2014-07-10 09:27:35,995::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-70::DEBUG::2014-07-10 09:27:35,995::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-70::DEBUG::2014-07-10 09:27:35,996::task::990::TaskManager.Task::(_decref) Task=`e35095ab-b29e-4697-882a-bcbef9c8190f`::ref 0 aborting False >Thread-40::DEBUG::2014-07-10 09:27:36,121::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lion.qa.lab.tlv.redhat.com:_export_yuri2_backup2/6a70504d-00df-4869-8695-0f442053f6b6/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-40::DEBUG::2014-07-10 09:27:36,142::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n369 bytes (369 B) copied, 0.000421173 s, 876 kB/s\n'; <rc> = 0 >Thread-60::DEBUG::2014-07-10 09:27:36,950::task::595::TaskManager.Task::(_updateState) Task=`96d48d2f-d9a4-4859-83ee-6446fa8917c3`::moving from state init -> state preparing >Thread-60::INFO::2014-07-10 09:27:36,951::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='b034d5b0-e1e0-4011-b49b-4d45ddb11556', volUUID='3d7f62b5-328f-4d8e-8b69-873cfb5ae14d', options=None) >Thread-60::INFO::2014-07-10 09:27:36,951::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-60::DEBUG::2014-07-10 09:27:36,952::task::1185::TaskManager.Task::(prepare) Task=`96d48d2f-d9a4-4859-83ee-6446fa8917c3`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-60::DEBUG::2014-07-10 09:27:36,952::task::595::TaskManager.Task::(_updateState) Task=`96d48d2f-d9a4-4859-83ee-6446fa8917c3`::moving from state preparing -> state finished >Thread-60::DEBUG::2014-07-10 09:27:36,952::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-60::DEBUG::2014-07-10 09:27:36,952::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-60::DEBUG::2014-07-10 09:27:36,952::task::990::TaskManager.Task::(_decref) Task=`96d48d2f-d9a4-4859-83ee-6446fa8917c3`::ref 0 aborting False >Thread-51::DEBUG::2014-07-10 09:27:37,055::task::595::TaskManager.Task::(_updateState) Task=`1332f560-5f48-4204-bc0e-18abf2ae4bfb`::moving from state init -> state preparing >Thread-51::INFO::2014-07-10 09:27:37,056::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='76fdb054-02cd-42ed-9721-b3e65b34c3a4', volUUID='022dfe46-2cf7-4915-80b3-883158e3ca83', options=None) >Thread-51::INFO::2014-07-10 09:27:37,057::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-51::DEBUG::2014-07-10 09:27:37,057::task::1185::TaskManager.Task::(prepare) Task=`1332f560-5f48-4204-bc0e-18abf2ae4bfb`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-51::DEBUG::2014-07-10 09:27:37,057::task::595::TaskManager.Task::(_updateState) Task=`1332f560-5f48-4204-bc0e-18abf2ae4bfb`::moving from state preparing -> state finished >Thread-51::DEBUG::2014-07-10 09:27:37,057::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-51::DEBUG::2014-07-10 09:27:37,057::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-51::DEBUG::2014-07-10 09:27:37,057::task::990::TaskManager.Task::(_decref) Task=`1332f560-5f48-4204-bc0e-18abf2ae4bfb`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 09:27:37,756::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:27:37,844::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.029804 s, 34.4 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 09:27:39,757::task::595::TaskManager.Task::(_updateState) Task=`9edfb039-1e74-4247-a34e-36fb231fff1b`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 09:27:39,757::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::INFO::2014-07-10 09:27:39,758::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000796182', 'lastCheck': '5.5', 'valid': True}, '6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000421173', 'lastCheck': '3.6', 'valid': True}} >Thread-14::DEBUG::2014-07-10 09:27:39,758::task::1185::TaskManager.Task::(prepare) Task=`9edfb039-1e74-4247-a34e-36fb231fff1b`::finished: {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000796182', 'lastCheck': '5.5', 'valid': True}, '6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000421173', 'lastCheck': '3.6', 'valid': True}} >Thread-14::DEBUG::2014-07-10 09:27:39,758::task::595::TaskManager.Task::(_updateState) Task=`9edfb039-1e74-4247-a34e-36fb231fff1b`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 09:27:39,758::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 09:27:39,759::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 09:27:39,759::task::990::TaskManager.Task::(_decref) Task=`9edfb039-1e74-4247-a34e-36fb231fff1b`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 09:27:39,871::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:27:40,428::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0541139 s, 18.9 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:27:42,437::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:27:42,525::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0293797 s, 34.9 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 09:27:44,007::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-14::DEBUG::2014-07-10 09:27:44,008::task::595::TaskManager.Task::(_updateState) Task=`a00c23c1-5534-422c-ae66-46eaba0c8d48`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 09:27:44,009::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-14::INFO::2014-07-10 09:27:44,009::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:27:44,009::task::1185::TaskManager.Task::(prepare) Task=`a00c23c1-5534-422c-ae66-46eaba0c8d48`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:27:44,010::task::595::TaskManager.Task::(_updateState) Task=`a00c23c1-5534-422c-ae66-46eaba0c8d48`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 09:27:44,010::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 09:27:44,010::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 09:27:44,010::task::990::TaskManager.Task::(_decref) Task=`a00c23c1-5534-422c-ae66-46eaba0c8d48`::ref 0 aborting False >Thread-34::DEBUG::2014-07-10 09:27:44,014::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-34::DEBUG::2014-07-10 09:27:44,014::task::595::TaskManager.Task::(_updateState) Task=`30bfdfdd-dff1-4f14-bcd4-df8a98a51773`::moving from state init -> state preparing >Thread-34::INFO::2014-07-10 09:27:44,015::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-34::DEBUG::2014-07-10 09:27:44,015::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`7e308937-842c-40da-92d7-dbc2deda4d4e`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-10 09:27:44,015::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' for lock type 'shared' >Thread-34::DEBUG::2014-07-10 09:27:44,016::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-10 09:27:44,016::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`7e308937-842c-40da-92d7-dbc2deda4d4e`::Granted request >Thread-34::DEBUG::2014-07-10 09:27:44,016::task::827::TaskManager.Task::(resourceAcquired) Task=`30bfdfdd-dff1-4f14-bcd4-df8a98a51773`::_resourcesAcquired: Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee (shared) >Thread-34::DEBUG::2014-07-10 09:27:44,017::task::990::TaskManager.Task::(_decref) Task=`30bfdfdd-dff1-4f14-bcd4-df8a98a51773`::ref 1 aborting False >Thread-34::INFO::2014-07-10 09:27:44,018::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532067385344', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:27:44,018::task::1185::TaskManager.Task::(prepare) Task=`30bfdfdd-dff1-4f14-bcd4-df8a98a51773`::finished: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532067385344', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:27:44,018::task::595::TaskManager.Task::(_updateState) Task=`30bfdfdd-dff1-4f14-bcd4-df8a98a51773`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-10 09:27:44,019::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee': < ResourceRef 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-10 09:27:44,019::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-10 09:27:44,019::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' >Thread-34::DEBUG::2014-07-10 09:27:44,019::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' (0 active users) >Thread-34::DEBUG::2014-07-10 09:27:44,019::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-10 09:27:44,020::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', Clearing records. >Thread-34::DEBUG::2014-07-10 09:27:44,020::task::990::TaskManager.Task::(_decref) Task=`30bfdfdd-dff1-4f14-bcd4-df8a98a51773`::ref 0 aborting False >Thread-18::DEBUG::2014-07-10 09:27:44,209::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/metadata bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-10 09:27:44,231::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000935605 s, 4.4 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:27:44,541::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:27:44,633::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0346813 s, 29.5 MB/s\n'; <rc> = 0 >Thread-40::DEBUG::2014-07-10 09:27:46,175::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lion.qa.lab.tlv.redhat.com:_export_yuri2_backup2/6a70504d-00df-4869-8695-0f442053f6b6/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-40::DEBUG::2014-07-10 09:27:46,196::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n369 bytes (369 B) copied, 0.000600909 s, 614 kB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:27:46,649::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:27:46,736::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0286182 s, 35.8 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:27:48,751::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:27:48,843::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0357172 s, 28.7 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:27:50,873::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:27:51,020::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0642127 s, 15.9 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:27:53,051::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:27:53,136::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0287743 s, 35.6 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 09:27:54,049::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-14::DEBUG::2014-07-10 09:27:54,050::task::595::TaskManager.Task::(_updateState) Task=`48b2ae60-0715-425b-b357-533c66519616`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 09:27:54,051::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-14::INFO::2014-07-10 09:27:54,051::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:27:54,052::task::1185::TaskManager.Task::(prepare) Task=`48b2ae60-0715-425b-b357-533c66519616`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:27:54,052::task::595::TaskManager.Task::(_updateState) Task=`48b2ae60-0715-425b-b357-533c66519616`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 09:27:54,052::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 09:27:54,052::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 09:27:54,053::task::990::TaskManager.Task::(_decref) Task=`48b2ae60-0715-425b-b357-533c66519616`::ref 0 aborting False >Thread-34::DEBUG::2014-07-10 09:27:54,057::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-34::DEBUG::2014-07-10 09:27:54,058::task::595::TaskManager.Task::(_updateState) Task=`8cfab362-47d5-4671-968f-54517d70e2a0`::moving from state init -> state preparing >Thread-34::INFO::2014-07-10 09:27:54,059::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-34::DEBUG::2014-07-10 09:27:54,060::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`0a515f7b-ebac-465d-8247-77baeb80e384`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-10 09:27:54,061::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' for lock type 'shared' >Thread-34::DEBUG::2014-07-10 09:27:54,061::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-10 09:27:54,062::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`0a515f7b-ebac-465d-8247-77baeb80e384`::Granted request >Thread-34::DEBUG::2014-07-10 09:27:54,062::task::827::TaskManager.Task::(resourceAcquired) Task=`8cfab362-47d5-4671-968f-54517d70e2a0`::_resourcesAcquired: Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee (shared) >Thread-34::DEBUG::2014-07-10 09:27:54,062::task::990::TaskManager.Task::(_decref) Task=`8cfab362-47d5-4671-968f-54517d70e2a0`::ref 1 aborting False >Thread-34::INFO::2014-07-10 09:27:54,063::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532067385344', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:27:54,064::task::1185::TaskManager.Task::(prepare) Task=`8cfab362-47d5-4671-968f-54517d70e2a0`::finished: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532067385344', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:27:54,064::task::595::TaskManager.Task::(_updateState) Task=`8cfab362-47d5-4671-968f-54517d70e2a0`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-10 09:27:54,065::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee': < ResourceRef 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-10 09:27:54,065::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-10 09:27:54,065::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' >Thread-34::DEBUG::2014-07-10 09:27:54,065::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' (0 active users) >Thread-34::DEBUG::2014-07-10 09:27:54,065::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-10 09:27:54,066::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', Clearing records. >Thread-34::DEBUG::2014-07-10 09:27:54,066::task::990::TaskManager.Task::(_decref) Task=`8cfab362-47d5-4671-968f-54517d70e2a0`::ref 0 aborting False >Thread-18::DEBUG::2014-07-10 09:27:54,261::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/metadata bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-10 09:27:54,283::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000681096 s, 6.0 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 09:27:55,016::task::595::TaskManager.Task::(_updateState) Task=`83d9f6b4-0e53-4f71-a7de-28eb5eb1e066`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 09:27:55,017::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::INFO::2014-07-10 09:27:55,017::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000681096', 'lastCheck': '0.7', 'valid': True}, '6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000600909', 'lastCheck': '8.8', 'valid': True}} >Thread-14::DEBUG::2014-07-10 09:27:55,017::task::1185::TaskManager.Task::(prepare) Task=`83d9f6b4-0e53-4f71-a7de-28eb5eb1e066`::finished: {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000681096', 'lastCheck': '0.7', 'valid': True}, '6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000600909', 'lastCheck': '8.8', 'valid': True}} >Thread-14::DEBUG::2014-07-10 09:27:55,018::task::595::TaskManager.Task::(_updateState) Task=`83d9f6b4-0e53-4f71-a7de-28eb5eb1e066`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 09:27:55,018::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 09:27:55,018::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 09:27:55,018::task::990::TaskManager.Task::(_decref) Task=`83d9f6b4-0e53-4f71-a7de-28eb5eb1e066`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 09:27:55,152::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:27:55,251::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0326981 s, 31.3 MB/s\n'; <rc> = 0 >Thread-64::DEBUG::2014-07-10 09:27:56,067::task::595::TaskManager.Task::(_updateState) Task=`52a3c2bb-121f-44a8-846c-f0ceb687d235`::moving from state init -> state preparing >Thread-64::INFO::2014-07-10 09:27:56,068::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='aa20346a-4d3a-4e07-b8e1-52c0ebe4168c', volUUID='58fefce2-9bce-4bff-8949-8c6ce8122b27', options=None) >Thread-64::INFO::2014-07-10 09:27:56,068::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-64::DEBUG::2014-07-10 09:27:56,068::task::1185::TaskManager.Task::(prepare) Task=`52a3c2bb-121f-44a8-846c-f0ceb687d235`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-64::DEBUG::2014-07-10 09:27:56,069::task::595::TaskManager.Task::(_updateState) Task=`52a3c2bb-121f-44a8-846c-f0ceb687d235`::moving from state preparing -> state finished >Thread-64::DEBUG::2014-07-10 09:27:56,069::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-64::DEBUG::2014-07-10 09:27:56,069::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-64::DEBUG::2014-07-10 09:27:56,070::task::990::TaskManager.Task::(_decref) Task=`52a3c2bb-121f-44a8-846c-f0ceb687d235`::ref 0 aborting False >Thread-40::DEBUG::2014-07-10 09:27:56,200::domainMonitor::192::Storage.DomainMonitorThread::(_monitorDomain) Refreshing domain 6a70504d-00df-4869-8695-0f442053f6b6 >Thread-40::DEBUG::2014-07-10 09:27:56,224::fileSD::150::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/lion.qa.lab.tlv.redhat.com:_export_yuri2_backup2/6a70504d-00df-4869-8695-0f442053f6b6 >Thread-40::DEBUG::2014-07-10 09:27:56,226::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend >Thread-40::DEBUG::2014-07-10 09:27:56,229::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Backup', 'DESCRIPTION=test', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=0', 'POOL_UUID=4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', 'REMOTE_PATH=lion.qa.lab.tlv.redhat.com:/export/yuri2/backup2', 'ROLE=Regular', 'SDUUID=6a70504d-00df-4869-8695-0f442053f6b6', 'TYPE=NFS', 'VERSION=0', '_SHA_CKSUM=aab6b8e901ec435cd5f9de3c9e3f8b45dca569e0'] >Thread-40::DEBUG::2014-07-10 09:27:56,231::fileSD::609::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images [] >Thread-40::INFO::2014-07-10 09:27:56,231::sd::384::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 6a70504d-00df-4869-8695-0f442053f6b6_imageNS already registered >Thread-40::INFO::2014-07-10 09:27:56,231::sd::392::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 6a70504d-00df-4869-8695-0f442053f6b6_volumeNS already registered >Thread-40::DEBUG::2014-07-10 09:27:56,252::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lion.qa.lab.tlv.redhat.com:_export_yuri2_backup2/6a70504d-00df-4869-8695-0f442053f6b6/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-40::DEBUG::2014-07-10 09:27:56,275::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n369 bytes (369 B) copied, 0.00154386 s, 239 kB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:27:57,267::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:27:57,360::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0358999 s, 28.5 MB/s\n'; <rc> = 0 >Thread-73::DEBUG::2014-07-10 09:27:57,973::task::595::TaskManager.Task::(_updateState) Task=`b61ea96e-b7af-46dc-af0e-4d3ddf966dd6`::moving from state init -> state preparing >Thread-54::DEBUG::2014-07-10 09:27:57,973::task::595::TaskManager.Task::(_updateState) Task=`6460947e-00f9-49ba-85bc-81d554c91b55`::moving from state init -> state preparing >Thread-73::INFO::2014-07-10 09:27:57,976::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='c01d693b-cba0-4fed-9ad7-0aaa28912a19', volUUID='4bb5d954-2a50-4028-b299-0b43c261270c', options=None) >Thread-54::INFO::2014-07-10 09:27:57,978::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='28408446-e5fd-4565-a976-e760951593fe', volUUID='776303a2-5585-451e-826e-0e338d4a1e98', options=None) >Thread-73::INFO::2014-07-10 09:27:57,981::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-54::INFO::2014-07-10 09:27:57,982::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-73::DEBUG::2014-07-10 09:27:57,984::task::1185::TaskManager.Task::(prepare) Task=`b61ea96e-b7af-46dc-af0e-4d3ddf966dd6`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-54::DEBUG::2014-07-10 09:27:57,985::task::1185::TaskManager.Task::(prepare) Task=`6460947e-00f9-49ba-85bc-81d554c91b55`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-73::DEBUG::2014-07-10 09:27:57,986::task::595::TaskManager.Task::(_updateState) Task=`b61ea96e-b7af-46dc-af0e-4d3ddf966dd6`::moving from state preparing -> state finished >Thread-54::DEBUG::2014-07-10 09:27:57,989::task::595::TaskManager.Task::(_updateState) Task=`6460947e-00f9-49ba-85bc-81d554c91b55`::moving from state preparing -> state finished >Thread-73::DEBUG::2014-07-10 09:27:57,989::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-54::DEBUG::2014-07-10 09:27:57,991::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-73::DEBUG::2014-07-10 09:27:57,992::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-54::DEBUG::2014-07-10 09:27:57,994::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-73::DEBUG::2014-07-10 09:27:57,996::task::990::TaskManager.Task::(_decref) Task=`b61ea96e-b7af-46dc-af0e-4d3ddf966dd6`::ref 0 aborting False >Thread-54::DEBUG::2014-07-10 09:27:57,997::task::990::TaskManager.Task::(_decref) Task=`6460947e-00f9-49ba-85bc-81d554c91b55`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 09:27:59,376::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:27:59,459::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0281751 s, 36.3 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:28:01,474::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:28:01,561::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0275128 s, 37.2 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:28:03,577::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:28:03,673::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0386527 s, 26.5 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 09:28:04,108::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-14::DEBUG::2014-07-10 09:28:04,109::task::595::TaskManager.Task::(_updateState) Task=`6beef0c2-2653-4aa1-b0f3-1be42259d64f`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 09:28:04,109::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-14::INFO::2014-07-10 09:28:04,110::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:28:04,110::task::1185::TaskManager.Task::(prepare) Task=`6beef0c2-2653-4aa1-b0f3-1be42259d64f`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:28:04,110::task::595::TaskManager.Task::(_updateState) Task=`6beef0c2-2653-4aa1-b0f3-1be42259d64f`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 09:28:04,110::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 09:28:04,111::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 09:28:04,111::task::990::TaskManager.Task::(_decref) Task=`6beef0c2-2653-4aa1-b0f3-1be42259d64f`::ref 0 aborting False >Thread-34::DEBUG::2014-07-10 09:28:04,115::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-34::DEBUG::2014-07-10 09:28:04,116::task::595::TaskManager.Task::(_updateState) Task=`61ad1912-b63f-49ad-9443-2f32a53f30f9`::moving from state init -> state preparing >Thread-34::INFO::2014-07-10 09:28:04,117::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-34::DEBUG::2014-07-10 09:28:04,117::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`c534ebbe-0666-460c-8aeb-20866f465e0f`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-10 09:28:04,118::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' for lock type 'shared' >Thread-34::DEBUG::2014-07-10 09:28:04,118::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-10 09:28:04,118::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`c534ebbe-0666-460c-8aeb-20866f465e0f`::Granted request >Thread-34::DEBUG::2014-07-10 09:28:04,119::task::827::TaskManager.Task::(resourceAcquired) Task=`61ad1912-b63f-49ad-9443-2f32a53f30f9`::_resourcesAcquired: Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee (shared) >Thread-34::DEBUG::2014-07-10 09:28:04,119::task::990::TaskManager.Task::(_decref) Task=`61ad1912-b63f-49ad-9443-2f32a53f30f9`::ref 1 aborting False >Thread-34::INFO::2014-07-10 09:28:04,120::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532067385344', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:28:04,120::task::1185::TaskManager.Task::(prepare) Task=`61ad1912-b63f-49ad-9443-2f32a53f30f9`::finished: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532067385344', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:28:04,120::task::595::TaskManager.Task::(_updateState) Task=`61ad1912-b63f-49ad-9443-2f32a53f30f9`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-10 09:28:04,121::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee': < ResourceRef 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-10 09:28:04,122::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-10 09:28:04,122::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' >Thread-34::DEBUG::2014-07-10 09:28:04,122::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' (0 active users) >Thread-34::DEBUG::2014-07-10 09:28:04,123::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-10 09:28:04,123::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', Clearing records. >Thread-34::DEBUG::2014-07-10 09:28:04,124::task::990::TaskManager.Task::(_decref) Task=`61ad1912-b63f-49ad-9443-2f32a53f30f9`::ref 0 aborting False >Thread-18::DEBUG::2014-07-10 09:28:04,312::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/metadata bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-10 09:28:04,333::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000722828 s, 5.7 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:28:05,689::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:28:05,794::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.049926 s, 20.5 MB/s\n'; <rc> = 0 >Thread-40::DEBUG::2014-07-10 09:28:06,312::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lion.qa.lab.tlv.redhat.com:_export_yuri2_backup2/6a70504d-00df-4869-8695-0f442053f6b6/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-40::DEBUG::2014-07-10 09:28:06,333::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n369 bytes (369 B) copied, 0.000510292 s, 723 kB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:28:07,809::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:28:07,892::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0274709 s, 37.3 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:28:09,908::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:28:10,001::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0353776 s, 28.9 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 09:28:10,201::task::595::TaskManager.Task::(_updateState) Task=`ec5f255b-4e3d-43c2-b08b-41e127debef5`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 09:28:10,202::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::INFO::2014-07-10 09:28:10,202::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000722828', 'lastCheck': '5.8', 'valid': True}, '6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000510292', 'lastCheck': '3.9', 'valid': True}} >Thread-14::DEBUG::2014-07-10 09:28:10,203::task::1185::TaskManager.Task::(prepare) Task=`ec5f255b-4e3d-43c2-b08b-41e127debef5`::finished: {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000722828', 'lastCheck': '5.8', 'valid': True}, '6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000510292', 'lastCheck': '3.9', 'valid': True}} >Thread-14::DEBUG::2014-07-10 09:28:10,203::task::595::TaskManager.Task::(_updateState) Task=`ec5f255b-4e3d-43c2-b08b-41e127debef5`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 09:28:10,203::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 09:28:10,203::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 09:28:10,203::task::990::TaskManager.Task::(_decref) Task=`ec5f255b-4e3d-43c2-b08b-41e127debef5`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 09:28:12,017::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:28:12,201::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.121645 s, 8.4 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 09:28:14,166::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-14::DEBUG::2014-07-10 09:28:14,167::task::595::TaskManager.Task::(_updateState) Task=`194afa90-a226-415c-ab70-ebad123d4b09`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 09:28:14,168::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-14::INFO::2014-07-10 09:28:14,169::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:28:14,169::task::1185::TaskManager.Task::(prepare) Task=`194afa90-a226-415c-ab70-ebad123d4b09`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:28:14,170::task::595::TaskManager.Task::(_updateState) Task=`194afa90-a226-415c-ab70-ebad123d4b09`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 09:28:14,170::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 09:28:14,170::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 09:28:14,171::task::990::TaskManager.Task::(_decref) Task=`194afa90-a226-415c-ab70-ebad123d4b09`::ref 0 aborting False >Thread-34::DEBUG::2014-07-10 09:28:14,175::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-34::DEBUG::2014-07-10 09:28:14,176::task::595::TaskManager.Task::(_updateState) Task=`70a66b54-f4ea-4c44-9261-0b69d87ce2f6`::moving from state init -> state preparing >Thread-34::INFO::2014-07-10 09:28:14,176::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-34::DEBUG::2014-07-10 09:28:14,177::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`68c26c5a-ad1e-466b-89d0-068e1b1cc2a4`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-10 09:28:14,177::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' for lock type 'shared' >Thread-34::DEBUG::2014-07-10 09:28:14,178::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-10 09:28:14,178::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`68c26c5a-ad1e-466b-89d0-068e1b1cc2a4`::Granted request >Thread-34::DEBUG::2014-07-10 09:28:14,179::task::827::TaskManager.Task::(resourceAcquired) Task=`70a66b54-f4ea-4c44-9261-0b69d87ce2f6`::_resourcesAcquired: Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee (shared) >Thread-34::DEBUG::2014-07-10 09:28:14,179::task::990::TaskManager.Task::(_decref) Task=`70a66b54-f4ea-4c44-9261-0b69d87ce2f6`::ref 1 aborting False >Thread-34::INFO::2014-07-10 09:28:14,181::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532067385344', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:28:14,181::task::1185::TaskManager.Task::(prepare) Task=`70a66b54-f4ea-4c44-9261-0b69d87ce2f6`::finished: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532067385344', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:28:14,182::task::595::TaskManager.Task::(_updateState) Task=`70a66b54-f4ea-4c44-9261-0b69d87ce2f6`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-10 09:28:14,182::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee': < ResourceRef 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-10 09:28:14,183::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-10 09:28:14,183::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' >Thread-34::DEBUG::2014-07-10 09:28:14,184::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' (0 active users) >Thread-34::DEBUG::2014-07-10 09:28:14,184::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-10 09:28:14,185::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', Clearing records. >Thread-34::DEBUG::2014-07-10 09:28:14,186::task::990::TaskManager.Task::(_decref) Task=`70a66b54-f4ea-4c44-9261-0b69d87ce2f6`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 09:28:14,216::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:28:14,304::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0313721 s, 32.6 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-10 09:28:14,367::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/metadata bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-10 09:28:14,388::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000662353 s, 6.2 MB/s\n'; <rc> = 0 >Thread-57::DEBUG::2014-07-10 09:28:16,145::task::595::TaskManager.Task::(_updateState) Task=`e1cae2c3-c385-45fb-a630-252f007a4cb5`::moving from state init -> state preparing >Thread-57::INFO::2014-07-10 09:28:16,146::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='b6f6c0da-e67f-4902-b9ac-3069571a42fe', volUUID='c4cd1da8-05b7-45e0-80b1-1183d21443d9', options=None) >Thread-57::INFO::2014-07-10 09:28:16,146::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-57::DEBUG::2014-07-10 09:28:16,147::task::1185::TaskManager.Task::(prepare) Task=`e1cae2c3-c385-45fb-a630-252f007a4cb5`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-57::DEBUG::2014-07-10 09:28:16,147::task::595::TaskManager.Task::(_updateState) Task=`e1cae2c3-c385-45fb-a630-252f007a4cb5`::moving from state preparing -> state finished >Thread-57::DEBUG::2014-07-10 09:28:16,147::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-57::DEBUG::2014-07-10 09:28:16,147::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-57::DEBUG::2014-07-10 09:28:16,147::task::990::TaskManager.Task::(_decref) Task=`e1cae2c3-c385-45fb-a630-252f007a4cb5`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 09:28:16,320::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Thread-40::DEBUG::2014-07-10 09:28:16,421::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lion.qa.lab.tlv.redhat.com:_export_yuri2_backup2/6a70504d-00df-4869-8695-0f442053f6b6/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-40::DEBUG::2014-07-10 09:28:16,488::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n369 bytes (369 B) copied, 0.000614841 s, 600 kB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:28:16,558::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.18039 s, 5.7 MB/s\n'; <rc> = 0 >Thread-67::DEBUG::2014-07-10 09:28:17,159::task::595::TaskManager.Task::(_updateState) Task=`e36306c3-d33d-4508-a461-89215e40718c`::moving from state init -> state preparing >Thread-67::INFO::2014-07-10 09:28:17,160::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='f30c2cb7-a43a-4bf5-82b5-cfe07336f65c', volUUID='b0fbb3c9-55af-4a3a-95ad-fc56a80b9cf5', options=None) >Thread-67::INFO::2014-07-10 09:28:17,160::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-67::DEBUG::2014-07-10 09:28:17,161::task::1185::TaskManager.Task::(prepare) Task=`e36306c3-d33d-4508-a461-89215e40718c`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-67::DEBUG::2014-07-10 09:28:17,161::task::595::TaskManager.Task::(_updateState) Task=`e36306c3-d33d-4508-a461-89215e40718c`::moving from state preparing -> state finished >Thread-67::DEBUG::2014-07-10 09:28:17,161::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-67::DEBUG::2014-07-10 09:28:17,161::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-67::DEBUG::2014-07-10 09:28:17,161::task::990::TaskManager.Task::(_decref) Task=`e36306c3-d33d-4508-a461-89215e40718c`::ref 0 aborting False >Thread-48::DEBUG::2014-07-10 09:28:17,660::task::595::TaskManager.Task::(_updateState) Task=`9f9dceda-7b8d-4649-9a0e-6eeede8b85bd`::moving from state init -> state preparing >Thread-48::INFO::2014-07-10 09:28:17,660::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='0cd7d6ce-f497-4243-a690-c57744861eea', volUUID='10b6a7dd-dc6c-43fa-ba17-92e4331b0e0b', options=None) >Thread-48::INFO::2014-07-10 09:28:17,661::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-48::DEBUG::2014-07-10 09:28:17,661::task::1185::TaskManager.Task::(prepare) Task=`9f9dceda-7b8d-4649-9a0e-6eeede8b85bd`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-48::DEBUG::2014-07-10 09:28:17,661::task::595::TaskManager.Task::(_updateState) Task=`9f9dceda-7b8d-4649-9a0e-6eeede8b85bd`::moving from state preparing -> state finished >Thread-48::DEBUG::2014-07-10 09:28:17,662::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-48::DEBUG::2014-07-10 09:28:17,662::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-48::DEBUG::2014-07-10 09:28:17,662::task::990::TaskManager.Task::(_decref) Task=`9f9dceda-7b8d-4649-9a0e-6eeede8b85bd`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 09:28:18,573::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:28:18,669::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0369904 s, 27.7 MB/s\n'; <rc> = 0 >Thread-76::DEBUG::2014-07-10 09:28:18,985::task::595::TaskManager.Task::(_updateState) Task=`25893b72-3843-498b-ab7d-c34454c0f178`::moving from state init -> state preparing >Thread-76::INFO::2014-07-10 09:28:18,986::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='e4c65229-4247-4b33-b72a-f1d5ce72ad05', volUUID='cad94284-3ca9-4c30-933d-997f4460309e', options=None) >Thread-76::INFO::2014-07-10 09:28:18,986::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-76::DEBUG::2014-07-10 09:28:18,987::task::1185::TaskManager.Task::(prepare) Task=`25893b72-3843-498b-ab7d-c34454c0f178`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-76::DEBUG::2014-07-10 09:28:18,987::task::595::TaskManager.Task::(_updateState) Task=`25893b72-3843-498b-ab7d-c34454c0f178`::moving from state preparing -> state finished >Thread-76::DEBUG::2014-07-10 09:28:18,987::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-76::DEBUG::2014-07-10 09:28:18,987::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-76::DEBUG::2014-07-10 09:28:18,988::task::990::TaskManager.Task::(_decref) Task=`25893b72-3843-498b-ab7d-c34454c0f178`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 09:28:20,686::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:28:20,863::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.107451 s, 9.5 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:28:22,878::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:28:22,971::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.035777 s, 28.6 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 09:28:24,207::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-14::DEBUG::2014-07-10 09:28:24,208::task::595::TaskManager.Task::(_updateState) Task=`37340c9f-9e52-4017-adfa-6319ae1afaf1`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 09:28:24,209::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-14::INFO::2014-07-10 09:28:24,209::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:28:24,210::task::1185::TaskManager.Task::(prepare) Task=`37340c9f-9e52-4017-adfa-6319ae1afaf1`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:28:24,210::task::595::TaskManager.Task::(_updateState) Task=`37340c9f-9e52-4017-adfa-6319ae1afaf1`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 09:28:24,210::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 09:28:24,210::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 09:28:24,210::task::990::TaskManager.Task::(_decref) Task=`37340c9f-9e52-4017-adfa-6319ae1afaf1`::ref 0 aborting False >Thread-34::DEBUG::2014-07-10 09:28:24,215::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-34::DEBUG::2014-07-10 09:28:24,215::task::595::TaskManager.Task::(_updateState) Task=`90cc0467-a02d-4a38-aa76-8af89f8bd1d3`::moving from state init -> state preparing >Thread-34::INFO::2014-07-10 09:28:24,215::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-34::DEBUG::2014-07-10 09:28:24,216::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`5a32fe28-19fc-4557-82dc-330b5b26276b`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-10 09:28:24,216::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' for lock type 'shared' >Thread-34::DEBUG::2014-07-10 09:28:24,217::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-10 09:28:24,217::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`5a32fe28-19fc-4557-82dc-330b5b26276b`::Granted request >Thread-34::DEBUG::2014-07-10 09:28:24,217::task::827::TaskManager.Task::(resourceAcquired) Task=`90cc0467-a02d-4a38-aa76-8af89f8bd1d3`::_resourcesAcquired: Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee (shared) >Thread-34::DEBUG::2014-07-10 09:28:24,218::task::990::TaskManager.Task::(_decref) Task=`90cc0467-a02d-4a38-aa76-8af89f8bd1d3`::ref 1 aborting False >Thread-34::INFO::2014-07-10 09:28:24,219::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532067385344', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:28:24,219::task::1185::TaskManager.Task::(prepare) Task=`90cc0467-a02d-4a38-aa76-8af89f8bd1d3`::finished: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532067385344', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:28:24,219::task::595::TaskManager.Task::(_updateState) Task=`90cc0467-a02d-4a38-aa76-8af89f8bd1d3`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-10 09:28:24,219::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee': < ResourceRef 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-10 09:28:24,220::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-10 09:28:24,220::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' >Thread-34::DEBUG::2014-07-10 09:28:24,220::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' (0 active users) >Thread-34::DEBUG::2014-07-10 09:28:24,220::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-10 09:28:24,221::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', Clearing records. >Thread-34::DEBUG::2014-07-10 09:28:24,221::task::990::TaskManager.Task::(_decref) Task=`90cc0467-a02d-4a38-aa76-8af89f8bd1d3`::ref 0 aborting False >Thread-18::DEBUG::2014-07-10 09:28:24,417::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/metadata bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-10 09:28:24,440::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000876672 s, 4.7 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:28:24,986::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:28:25,086::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0362706 s, 28.2 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 09:28:25,504::task::595::TaskManager.Task::(_updateState) Task=`dc9ccdef-7c3b-4fc6-873b-c64352f9b730`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 09:28:25,505::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::INFO::2014-07-10 09:28:25,505::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000876672', 'lastCheck': '1.0', 'valid': True}, '6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000614841', 'lastCheck': '9.0', 'valid': True}} >Thread-14::DEBUG::2014-07-10 09:28:25,505::task::1185::TaskManager.Task::(prepare) Task=`dc9ccdef-7c3b-4fc6-873b-c64352f9b730`::finished: {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000876672', 'lastCheck': '1.0', 'valid': True}, '6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000614841', 'lastCheck': '9.0', 'valid': True}} >Thread-14::DEBUG::2014-07-10 09:28:25,505::task::595::TaskManager.Task::(_updateState) Task=`dc9ccdef-7c3b-4fc6-873b-c64352f9b730`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 09:28:25,506::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 09:28:25,506::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 09:28:25,506::task::990::TaskManager.Task::(_decref) Task=`dc9ccdef-7c3b-4fc6-873b-c64352f9b730`::ref 0 aborting False >Thread-40::DEBUG::2014-07-10 09:28:26,529::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lion.qa.lab.tlv.redhat.com:_export_yuri2_backup2/6a70504d-00df-4869-8695-0f442053f6b6/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-40::DEBUG::2014-07-10 09:28:26,550::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n369 bytes (369 B) copied, 0.000500067 s, 738 kB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:28:27,101::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:28:27,192::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0316145 s, 32.4 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:28:29,210::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:28:29,298::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0257112 s, 39.8 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:28:31,313::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:28:31,415::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0521855 s, 19.6 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:28:33,425::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:28:33,514::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0320685 s, 31.9 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 09:28:34,250::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-14::DEBUG::2014-07-10 09:28:34,251::task::595::TaskManager.Task::(_updateState) Task=`28ba5eaa-a949-4521-b4bf-6aefd39fc8b6`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 09:28:34,251::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-14::INFO::2014-07-10 09:28:34,252::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:28:34,252::task::1185::TaskManager.Task::(prepare) Task=`28ba5eaa-a949-4521-b4bf-6aefd39fc8b6`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:28:34,252::task::595::TaskManager.Task::(_updateState) Task=`28ba5eaa-a949-4521-b4bf-6aefd39fc8b6`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 09:28:34,253::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 09:28:34,253::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 09:28:34,253::task::990::TaskManager.Task::(_decref) Task=`28ba5eaa-a949-4521-b4bf-6aefd39fc8b6`::ref 0 aborting False >Thread-34::DEBUG::2014-07-10 09:28:34,258::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-34::DEBUG::2014-07-10 09:28:34,259::task::595::TaskManager.Task::(_updateState) Task=`53954350-abc8-40dc-aa49-37baee7850c9`::moving from state init -> state preparing >Thread-34::INFO::2014-07-10 09:28:34,259::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-34::DEBUG::2014-07-10 09:28:34,261::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`a683a3bd-255f-4320-84f9-072b5ad6e826`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-10 09:28:34,261::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' for lock type 'shared' >Thread-34::DEBUG::2014-07-10 09:28:34,261::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-10 09:28:34,261::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`a683a3bd-255f-4320-84f9-072b5ad6e826`::Granted request >Thread-34::DEBUG::2014-07-10 09:28:34,262::task::827::TaskManager.Task::(resourceAcquired) Task=`53954350-abc8-40dc-aa49-37baee7850c9`::_resourcesAcquired: Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee (shared) >Thread-34::DEBUG::2014-07-10 09:28:34,262::task::990::TaskManager.Task::(_decref) Task=`53954350-abc8-40dc-aa49-37baee7850c9`::ref 1 aborting False >Thread-34::INFO::2014-07-10 09:28:34,264::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532067385344', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:28:34,264::task::1185::TaskManager.Task::(prepare) Task=`53954350-abc8-40dc-aa49-37baee7850c9`::finished: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532067385344', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:28:34,264::task::595::TaskManager.Task::(_updateState) Task=`53954350-abc8-40dc-aa49-37baee7850c9`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-10 09:28:34,265::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee': < ResourceRef 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-10 09:28:34,265::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-10 09:28:34,267::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' >Thread-34::DEBUG::2014-07-10 09:28:34,267::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' (0 active users) >Thread-34::DEBUG::2014-07-10 09:28:34,267::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-10 09:28:34,267::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', Clearing records. >Thread-34::DEBUG::2014-07-10 09:28:34,268::task::990::TaskManager.Task::(_decref) Task=`53954350-abc8-40dc-aa49-37baee7850c9`::ref 0 aborting False >Thread-18::DEBUG::2014-07-10 09:28:34,470::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/metadata bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-10 09:28:34,492::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000742743 s, 5.5 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:28:35,530::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:28:35,621::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0334492 s, 30.6 MB/s\n'; <rc> = 0 >Thread-70::DEBUG::2014-07-10 09:28:36,269::task::595::TaskManager.Task::(_updateState) Task=`423d79e8-9cfe-46f6-8726-cd2a56d558b5`::moving from state init -> state preparing >Thread-70::INFO::2014-07-10 09:28:36,269::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='cfaeead2-7caa-467c-b389-c89840ae6605', volUUID='567fe32d-31a6-4ff6-90f3-fd6a656fbecc', options=None) >Thread-70::INFO::2014-07-10 09:28:36,270::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-70::DEBUG::2014-07-10 09:28:36,270::task::1185::TaskManager.Task::(prepare) Task=`423d79e8-9cfe-46f6-8726-cd2a56d558b5`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-70::DEBUG::2014-07-10 09:28:36,270::task::595::TaskManager.Task::(_updateState) Task=`423d79e8-9cfe-46f6-8726-cd2a56d558b5`::moving from state preparing -> state finished >Thread-70::DEBUG::2014-07-10 09:28:36,270::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-70::DEBUG::2014-07-10 09:28:36,271::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-70::DEBUG::2014-07-10 09:28:36,271::task::990::TaskManager.Task::(_decref) Task=`423d79e8-9cfe-46f6-8726-cd2a56d558b5`::ref 0 aborting False >Thread-40::DEBUG::2014-07-10 09:28:36,588::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lion.qa.lab.tlv.redhat.com:_export_yuri2_backup2/6a70504d-00df-4869-8695-0f442053f6b6/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-40::DEBUG::2014-07-10 09:28:36,608::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n369 bytes (369 B) copied, 0.000458399 s, 805 kB/s\n'; <rc> = 0 >Thread-60::DEBUG::2014-07-10 09:28:37,225::task::595::TaskManager.Task::(_updateState) Task=`4d51e164-dde8-41d1-8f61-7845ff704b3a`::moving from state init -> state preparing >Thread-60::INFO::2014-07-10 09:28:37,226::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='b034d5b0-e1e0-4011-b49b-4d45ddb11556', volUUID='3d7f62b5-328f-4d8e-8b69-873cfb5ae14d', options=None) >Thread-60::INFO::2014-07-10 09:28:37,227::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-60::DEBUG::2014-07-10 09:28:37,227::task::1185::TaskManager.Task::(prepare) Task=`4d51e164-dde8-41d1-8f61-7845ff704b3a`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-60::DEBUG::2014-07-10 09:28:37,227::task::595::TaskManager.Task::(_updateState) Task=`4d51e164-dde8-41d1-8f61-7845ff704b3a`::moving from state preparing -> state finished >Thread-60::DEBUG::2014-07-10 09:28:37,227::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-60::DEBUG::2014-07-10 09:28:37,228::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-60::DEBUG::2014-07-10 09:28:37,228::task::990::TaskManager.Task::(_decref) Task=`4d51e164-dde8-41d1-8f61-7845ff704b3a`::ref 0 aborting False >Thread-51::DEBUG::2014-07-10 09:28:37,314::task::595::TaskManager.Task::(_updateState) Task=`c8755a31-455f-49e3-a1b1-3377505c143a`::moving from state init -> state preparing >Thread-51::INFO::2014-07-10 09:28:37,314::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='76fdb054-02cd-42ed-9721-b3e65b34c3a4', volUUID='022dfe46-2cf7-4915-80b3-883158e3ca83', options=None) >Thread-51::INFO::2014-07-10 09:28:37,315::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-51::DEBUG::2014-07-10 09:28:37,315::task::1185::TaskManager.Task::(prepare) Task=`c8755a31-455f-49e3-a1b1-3377505c143a`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-51::DEBUG::2014-07-10 09:28:37,315::task::595::TaskManager.Task::(_updateState) Task=`c8755a31-455f-49e3-a1b1-3377505c143a`::moving from state preparing -> state finished >Thread-51::DEBUG::2014-07-10 09:28:37,315::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-51::DEBUG::2014-07-10 09:28:37,315::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-51::DEBUG::2014-07-10 09:28:37,316::task::990::TaskManager.Task::(_decref) Task=`c8755a31-455f-49e3-a1b1-3377505c143a`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 09:28:37,637::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:28:37,741::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0296223 s, 34.6 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:28:39,756::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:28:39,852::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0358078 s, 28.6 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 09:28:40,714::task::595::TaskManager.Task::(_updateState) Task=`90764216-d3c6-4a80-82da-f14c6749b728`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 09:28:40,714::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::INFO::2014-07-10 09:28:40,715::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000742743', 'lastCheck': '6.2', 'valid': True}, '6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000458399', 'lastCheck': '4.1', 'valid': True}} >Thread-14::DEBUG::2014-07-10 09:28:40,715::task::1185::TaskManager.Task::(prepare) Task=`90764216-d3c6-4a80-82da-f14c6749b728`::finished: {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000742743', 'lastCheck': '6.2', 'valid': True}, '6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000458399', 'lastCheck': '4.1', 'valid': True}} >Thread-14::DEBUG::2014-07-10 09:28:40,715::task::595::TaskManager.Task::(_updateState) Task=`90764216-d3c6-4a80-82da-f14c6749b728`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 09:28:40,715::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 09:28:40,715::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 09:28:40,716::task::990::TaskManager.Task::(_decref) Task=`90764216-d3c6-4a80-82da-f14c6749b728`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 09:28:41,867::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:28:41,983::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0584293 s, 17.5 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:28:43,998::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:28:44,088::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0294682 s, 34.7 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 09:28:44,308::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-14::DEBUG::2014-07-10 09:28:44,309::task::595::TaskManager.Task::(_updateState) Task=`3912f7bb-694b-471e-921c-5b4a656c9ef1`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 09:28:44,310::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-14::INFO::2014-07-10 09:28:44,311::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:28:44,311::task::1185::TaskManager.Task::(prepare) Task=`3912f7bb-694b-471e-921c-5b4a656c9ef1`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:28:44,311::task::595::TaskManager.Task::(_updateState) Task=`3912f7bb-694b-471e-921c-5b4a656c9ef1`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 09:28:44,312::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 09:28:44,312::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 09:28:44,312::task::990::TaskManager.Task::(_decref) Task=`3912f7bb-694b-471e-921c-5b4a656c9ef1`::ref 0 aborting False >Thread-34::DEBUG::2014-07-10 09:28:44,317::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-34::DEBUG::2014-07-10 09:28:44,317::task::595::TaskManager.Task::(_updateState) Task=`46555aea-7492-401b-9389-4cc6292e2b10`::moving from state init -> state preparing >Thread-34::INFO::2014-07-10 09:28:44,317::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-34::DEBUG::2014-07-10 09:28:44,318::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`85de0131-c512-4212-9364-375cb51f8ef5`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-10 09:28:44,318::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' for lock type 'shared' >Thread-34::DEBUG::2014-07-10 09:28:44,319::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-10 09:28:44,319::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`85de0131-c512-4212-9364-375cb51f8ef5`::Granted request >Thread-34::DEBUG::2014-07-10 09:28:44,320::task::827::TaskManager.Task::(resourceAcquired) Task=`46555aea-7492-401b-9389-4cc6292e2b10`::_resourcesAcquired: Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee (shared) >Thread-34::DEBUG::2014-07-10 09:28:44,320::task::990::TaskManager.Task::(_decref) Task=`46555aea-7492-401b-9389-4cc6292e2b10`::ref 1 aborting False >Thread-34::INFO::2014-07-10 09:28:44,322::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532067385344', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:28:44,323::task::1185::TaskManager.Task::(prepare) Task=`46555aea-7492-401b-9389-4cc6292e2b10`::finished: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532067385344', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:28:44,323::task::595::TaskManager.Task::(_updateState) Task=`46555aea-7492-401b-9389-4cc6292e2b10`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-10 09:28:44,323::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee': < ResourceRef 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-10 09:28:44,323::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-10 09:28:44,324::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' >Thread-34::DEBUG::2014-07-10 09:28:44,324::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' (0 active users) >Thread-34::DEBUG::2014-07-10 09:28:44,324::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-10 09:28:44,324::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', Clearing records. >Thread-34::DEBUG::2014-07-10 09:28:44,325::task::990::TaskManager.Task::(_decref) Task=`46555aea-7492-401b-9389-4cc6292e2b10`::ref 0 aborting False >Thread-18::DEBUG::2014-07-10 09:28:44,525::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/metadata bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-10 09:28:44,558::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00604748 s, 677 kB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:28:46,104::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:28:46,261::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0972112 s, 10.5 MB/s\n'; <rc> = 0 >Thread-40::DEBUG::2014-07-10 09:28:46,635::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lion.qa.lab.tlv.redhat.com:_export_yuri2_backup2/6a70504d-00df-4869-8695-0f442053f6b6/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-40::DEBUG::2014-07-10 09:28:46,657::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n369 bytes (369 B) copied, 0.00364524 s, 101 kB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:28:48,276::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:28:48,395::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0582014 s, 17.6 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:28:50,410::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:28:50,495::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0264704 s, 38.7 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:28:52,517::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:28:52,605::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0301326 s, 34.0 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 09:28:54,350::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-14::DEBUG::2014-07-10 09:28:54,352::task::595::TaskManager.Task::(_updateState) Task=`c65e639a-4611-4370-9626-4fef1d1ea947`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 09:28:54,352::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-14::INFO::2014-07-10 09:28:54,353::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:28:54,353::task::1185::TaskManager.Task::(prepare) Task=`c65e639a-4611-4370-9626-4fef1d1ea947`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:28:54,353::task::595::TaskManager.Task::(_updateState) Task=`c65e639a-4611-4370-9626-4fef1d1ea947`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 09:28:54,353::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 09:28:54,353::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 09:28:54,354::task::990::TaskManager.Task::(_decref) Task=`c65e639a-4611-4370-9626-4fef1d1ea947`::ref 0 aborting False >Thread-34::DEBUG::2014-07-10 09:28:54,358::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-34::DEBUG::2014-07-10 09:28:54,358::task::595::TaskManager.Task::(_updateState) Task=`69622355-33be-46b6-9a1b-f57c2c017ae5`::moving from state init -> state preparing >Thread-34::INFO::2014-07-10 09:28:54,359::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-34::DEBUG::2014-07-10 09:28:54,359::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`513aa25a-e044-4af0-8682-be37b7122e4d`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-10 09:28:54,359::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' for lock type 'shared' >Thread-34::DEBUG::2014-07-10 09:28:54,360::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-10 09:28:54,360::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`513aa25a-e044-4af0-8682-be37b7122e4d`::Granted request >Thread-34::DEBUG::2014-07-10 09:28:54,361::task::827::TaskManager.Task::(resourceAcquired) Task=`69622355-33be-46b6-9a1b-f57c2c017ae5`::_resourcesAcquired: Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee (shared) >Thread-34::DEBUG::2014-07-10 09:28:54,361::task::990::TaskManager.Task::(_decref) Task=`69622355-33be-46b6-9a1b-f57c2c017ae5`::ref 1 aborting False >Thread-34::INFO::2014-07-10 09:28:54,362::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532067385344', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:28:54,362::task::1185::TaskManager.Task::(prepare) Task=`69622355-33be-46b6-9a1b-f57c2c017ae5`::finished: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532067385344', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:28:54,362::task::595::TaskManager.Task::(_updateState) Task=`69622355-33be-46b6-9a1b-f57c2c017ae5`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-10 09:28:54,363::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee': < ResourceRef 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-10 09:28:54,363::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-10 09:28:54,363::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' >Thread-34::DEBUG::2014-07-10 09:28:54,363::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' (0 active users) >Thread-34::DEBUG::2014-07-10 09:28:54,363::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-10 09:28:54,364::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', Clearing records. >Thread-34::DEBUG::2014-07-10 09:28:54,364::task::990::TaskManager.Task::(_decref) Task=`69622355-33be-46b6-9a1b-f57c2c017ae5`::ref 0 aborting False >Thread-18::DEBUG::2014-07-10 09:28:54,587::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/metadata bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-10 09:28:54,612::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000710483 s, 5.8 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:28:54,622::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:28:55,144::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.464094 s, 2.2 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 09:28:55,893::task::595::TaskManager.Task::(_updateState) Task=`1c69760c-c1dc-4691-9df0-50520ed7848a`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 09:28:55,893::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::INFO::2014-07-10 09:28:55,894::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000710483', 'lastCheck': '0.8', 'valid': True}, '6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00364524', 'lastCheck': '9.2', 'valid': True}} >Thread-14::DEBUG::2014-07-10 09:28:55,894::task::1185::TaskManager.Task::(prepare) Task=`1c69760c-c1dc-4691-9df0-50520ed7848a`::finished: {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000710483', 'lastCheck': '0.8', 'valid': True}, '6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00364524', 'lastCheck': '9.2', 'valid': True}} >Thread-14::DEBUG::2014-07-10 09:28:55,894::task::595::TaskManager.Task::(_updateState) Task=`1c69760c-c1dc-4691-9df0-50520ed7848a`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 09:28:55,894::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 09:28:55,894::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 09:28:55,894::task::990::TaskManager.Task::(_decref) Task=`1c69760c-c1dc-4691-9df0-50520ed7848a`::ref 0 aborting False >Thread-64::DEBUG::2014-07-10 09:28:56,341::task::595::TaskManager.Task::(_updateState) Task=`7ef7cd3e-573c-49b8-a055-190caec76178`::moving from state init -> state preparing >Thread-64::INFO::2014-07-10 09:28:56,341::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='aa20346a-4d3a-4e07-b8e1-52c0ebe4168c', volUUID='58fefce2-9bce-4bff-8949-8c6ce8122b27', options=None) >Thread-64::INFO::2014-07-10 09:28:56,342::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-64::DEBUG::2014-07-10 09:28:56,342::task::1185::TaskManager.Task::(prepare) Task=`7ef7cd3e-573c-49b8-a055-190caec76178`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-64::DEBUG::2014-07-10 09:28:56,342::task::595::TaskManager.Task::(_updateState) Task=`7ef7cd3e-573c-49b8-a055-190caec76178`::moving from state preparing -> state finished >Thread-64::DEBUG::2014-07-10 09:28:56,342::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-64::DEBUG::2014-07-10 09:28:56,342::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-64::DEBUG::2014-07-10 09:28:56,343::task::990::TaskManager.Task::(_decref) Task=`7ef7cd3e-573c-49b8-a055-190caec76178`::ref 0 aborting False >Thread-40::DEBUG::2014-07-10 09:28:56,682::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lion.qa.lab.tlv.redhat.com:_export_yuri2_backup2/6a70504d-00df-4869-8695-0f442053f6b6/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-40::DEBUG::2014-07-10 09:28:56,703::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n369 bytes (369 B) copied, 0.00052199 s, 707 kB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:28:57,159::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:28:57,250::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0330979 s, 30.9 MB/s\n'; <rc> = 0 >Thread-54::DEBUG::2014-07-10 09:28:58,337::task::595::TaskManager.Task::(_updateState) Task=`3c419ff5-aa20-4814-a89f-449b509a699f`::moving from state init -> state preparing >Thread-73::DEBUG::2014-07-10 09:28:58,339::task::595::TaskManager.Task::(_updateState) Task=`4fde165f-7658-4e36-9184-7bf2a9d6fcb7`::moving from state init -> state preparing >Thread-54::INFO::2014-07-10 09:28:58,340::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='28408446-e5fd-4565-a976-e760951593fe', volUUID='776303a2-5585-451e-826e-0e338d4a1e98', options=None) >Thread-73::INFO::2014-07-10 09:28:58,341::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='c01d693b-cba0-4fed-9ad7-0aaa28912a19', volUUID='4bb5d954-2a50-4028-b299-0b43c261270c', options=None) >Thread-54::INFO::2014-07-10 09:28:58,342::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-73::INFO::2014-07-10 09:28:58,343::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-54::DEBUG::2014-07-10 09:28:58,343::task::1185::TaskManager.Task::(prepare) Task=`3c419ff5-aa20-4814-a89f-449b509a699f`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-73::DEBUG::2014-07-10 09:28:58,344::task::1185::TaskManager.Task::(prepare) Task=`4fde165f-7658-4e36-9184-7bf2a9d6fcb7`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-54::DEBUG::2014-07-10 09:28:58,345::task::595::TaskManager.Task::(_updateState) Task=`3c419ff5-aa20-4814-a89f-449b509a699f`::moving from state preparing -> state finished >Thread-73::DEBUG::2014-07-10 09:28:58,347::task::595::TaskManager.Task::(_updateState) Task=`4fde165f-7658-4e36-9184-7bf2a9d6fcb7`::moving from state preparing -> state finished >Thread-54::DEBUG::2014-07-10 09:28:58,347::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-73::DEBUG::2014-07-10 09:28:58,348::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-54::DEBUG::2014-07-10 09:28:58,348::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-73::DEBUG::2014-07-10 09:28:58,350::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-54::DEBUG::2014-07-10 09:28:58,350::task::990::TaskManager.Task::(_decref) Task=`3c419ff5-aa20-4814-a89f-449b509a699f`::ref 0 aborting False >Thread-73::DEBUG::2014-07-10 09:28:58,353::task::990::TaskManager.Task::(_decref) Task=`4fde165f-7658-4e36-9184-7bf2a9d6fcb7`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 09:28:59,265::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:28:59,351::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0274642 s, 37.3 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:29:01,366::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:29:01,463::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0365159 s, 28.0 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:29:03,478::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:29:03,569::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0331551 s, 30.9 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 09:29:04,391::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [72f5e52c] >Thread-14::DEBUG::2014-07-10 09:29:04,392::task::595::TaskManager.Task::(_updateState) Task=`f5051228-b565-416d-8b2e-c83ac648c89e`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 09:29:04,392::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-14::INFO::2014-07-10 09:29:04,393::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:29:04,393::task::1185::TaskManager.Task::(prepare) Task=`f5051228-b565-416d-8b2e-c83ac648c89e`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:29:04,393::task::595::TaskManager.Task::(_updateState) Task=`f5051228-b565-416d-8b2e-c83ac648c89e`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 09:29:04,393::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 09:29:04,394::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 09:29:04,394::task::990::TaskManager.Task::(_decref) Task=`f5051228-b565-416d-8b2e-c83ac648c89e`::ref 0 aborting False >Thread-34::DEBUG::2014-07-10 09:29:04,398::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [72f5e52c] >Thread-34::DEBUG::2014-07-10 09:29:04,399::task::595::TaskManager.Task::(_updateState) Task=`c6df20ea-4a1d-4435-a591-fe388a438e96`::moving from state init -> state preparing >Thread-34::INFO::2014-07-10 09:29:04,399::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-34::DEBUG::2014-07-10 09:29:04,400::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`673f914c-1c9e-433c-9b28-48db559e3caa`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-10 09:29:04,400::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' for lock type 'shared' >Thread-34::DEBUG::2014-07-10 09:29:04,400::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-10 09:29:04,400::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`673f914c-1c9e-433c-9b28-48db559e3caa`::Granted request >Thread-34::DEBUG::2014-07-10 09:29:04,401::task::827::TaskManager.Task::(resourceAcquired) Task=`c6df20ea-4a1d-4435-a591-fe388a438e96`::_resourcesAcquired: Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee (shared) >Thread-34::DEBUG::2014-07-10 09:29:04,401::task::990::TaskManager.Task::(_decref) Task=`c6df20ea-4a1d-4435-a591-fe388a438e96`::ref 1 aborting False >Thread-34::INFO::2014-07-10 09:29:04,402::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532067385344', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:29:04,402::task::1185::TaskManager.Task::(prepare) Task=`c6df20ea-4a1d-4435-a591-fe388a438e96`::finished: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532067385344', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:29:04,403::task::595::TaskManager.Task::(_updateState) Task=`c6df20ea-4a1d-4435-a591-fe388a438e96`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-10 09:29:04,403::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee': < ResourceRef 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-10 09:29:04,403::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-10 09:29:04,403::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' >Thread-34::DEBUG::2014-07-10 09:29:04,404::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' (0 active users) >Thread-34::DEBUG::2014-07-10 09:29:04,404::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-10 09:29:04,404::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', Clearing records. >Thread-34::DEBUG::2014-07-10 09:29:04,404::task::990::TaskManager.Task::(_decref) Task=`c6df20ea-4a1d-4435-a591-fe388a438e96`::ref 0 aborting False >Thread-18::DEBUG::2014-07-10 09:29:05,087::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/metadata bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-10 09:29:05,109::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000771658 s, 5.3 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:29:05,585::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:29:05,678::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0349546 s, 29.3 MB/s\n'; <rc> = 0 >Thread-40::DEBUG::2014-07-10 09:29:06,746::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lion.qa.lab.tlv.redhat.com:_export_yuri2_backup2/6a70504d-00df-4869-8695-0f442053f6b6/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-40::DEBUG::2014-07-10 09:29:06,782::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n369 bytes (369 B) copied, 0.000505634 s, 730 kB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:29:07,694::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:29:07,794::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0286563 s, 35.7 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:29:09,810::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:29:09,905::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.035563 s, 28.8 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 09:29:11,063::task::595::TaskManager.Task::(_updateState) Task=`0b0a8b8b-93ff-4593-947c-f47008eeada9`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 09:29:11,064::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::INFO::2014-07-10 09:29:11,065::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000771658', 'lastCheck': '5.9', 'valid': True}, '6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000505634', 'lastCheck': '4.3', 'valid': True}} >Thread-14::DEBUG::2014-07-10 09:29:11,065::task::1185::TaskManager.Task::(prepare) Task=`0b0a8b8b-93ff-4593-947c-f47008eeada9`::finished: {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000771658', 'lastCheck': '5.9', 'valid': True}, '6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000505634', 'lastCheck': '4.3', 'valid': True}} >Thread-14::DEBUG::2014-07-10 09:29:11,066::task::595::TaskManager.Task::(_updateState) Task=`0b0a8b8b-93ff-4593-947c-f47008eeada9`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 09:29:11,067::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 09:29:11,067::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 09:29:11,068::task::990::TaskManager.Task::(_decref) Task=`0b0a8b8b-93ff-4593-947c-f47008eeada9`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 09:29:11,924::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:29:12,013::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.030996 s, 33.0 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:29:14,029::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:29:14,122::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0254221 s, 40.3 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 09:29:14,440::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-14::DEBUG::2014-07-10 09:29:14,441::task::595::TaskManager.Task::(_updateState) Task=`510c5494-9abe-41ed-90f6-19cbcbd1fc89`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 09:29:14,441::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-14::INFO::2014-07-10 09:29:14,443::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:29:14,443::task::1185::TaskManager.Task::(prepare) Task=`510c5494-9abe-41ed-90f6-19cbcbd1fc89`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:29:14,444::task::595::TaskManager.Task::(_updateState) Task=`510c5494-9abe-41ed-90f6-19cbcbd1fc89`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 09:29:14,444::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 09:29:14,444::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 09:29:14,444::task::990::TaskManager.Task::(_decref) Task=`510c5494-9abe-41ed-90f6-19cbcbd1fc89`::ref 0 aborting False >Thread-34::DEBUG::2014-07-10 09:29:14,448::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-34::DEBUG::2014-07-10 09:29:14,449::task::595::TaskManager.Task::(_updateState) Task=`6e56e956-eea0-40f5-85d1-a379434a66fe`::moving from state init -> state preparing >Thread-34::INFO::2014-07-10 09:29:14,449::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-34::DEBUG::2014-07-10 09:29:14,450::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`b17c25f1-8a25-4144-9550-9db898b2cb0b`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-10 09:29:14,450::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' for lock type 'shared' >Thread-34::DEBUG::2014-07-10 09:29:14,450::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-10 09:29:14,450::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`b17c25f1-8a25-4144-9550-9db898b2cb0b`::Granted request >Thread-34::DEBUG::2014-07-10 09:29:14,451::task::827::TaskManager.Task::(resourceAcquired) Task=`6e56e956-eea0-40f5-85d1-a379434a66fe`::_resourcesAcquired: Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee (shared) >Thread-34::DEBUG::2014-07-10 09:29:14,451::task::990::TaskManager.Task::(_decref) Task=`6e56e956-eea0-40f5-85d1-a379434a66fe`::ref 1 aborting False >Thread-34::INFO::2014-07-10 09:29:14,452::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532067385344', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:29:14,453::task::1185::TaskManager.Task::(prepare) Task=`6e56e956-eea0-40f5-85d1-a379434a66fe`::finished: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532067385344', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:29:14,453::task::595::TaskManager.Task::(_updateState) Task=`6e56e956-eea0-40f5-85d1-a379434a66fe`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-10 09:29:14,453::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee': < ResourceRef 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-10 09:29:14,453::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-10 09:29:14,453::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' >Thread-34::DEBUG::2014-07-10 09:29:14,454::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' (0 active users) >Thread-34::DEBUG::2014-07-10 09:29:14,454::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-10 09:29:14,454::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', Clearing records. >Thread-34::DEBUG::2014-07-10 09:29:14,454::task::990::TaskManager.Task::(_decref) Task=`6e56e956-eea0-40f5-85d1-a379434a66fe`::ref 0 aborting False >Thread-18::DEBUG::2014-07-10 09:29:15,139::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/metadata bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-10 09:29:15,184::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.0007953 s, 5.2 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:29:16,137::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:29:16,245::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0505165 s, 20.3 MB/s\n'; <rc> = 0 >Thread-57::DEBUG::2014-07-10 09:29:16,449::task::595::TaskManager.Task::(_updateState) Task=`a6a0c266-163f-4fef-886e-201ef69a19ad`::moving from state init -> state preparing >Thread-57::INFO::2014-07-10 09:29:16,450::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='b6f6c0da-e67f-4902-b9ac-3069571a42fe', volUUID='c4cd1da8-05b7-45e0-80b1-1183d21443d9', options=None) >Thread-57::INFO::2014-07-10 09:29:16,450::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-57::DEBUG::2014-07-10 09:29:16,450::task::1185::TaskManager.Task::(prepare) Task=`a6a0c266-163f-4fef-886e-201ef69a19ad`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-57::DEBUG::2014-07-10 09:29:16,451::task::595::TaskManager.Task::(_updateState) Task=`a6a0c266-163f-4fef-886e-201ef69a19ad`::moving from state preparing -> state finished >Thread-57::DEBUG::2014-07-10 09:29:16,451::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-57::DEBUG::2014-07-10 09:29:16,451::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-57::DEBUG::2014-07-10 09:29:16,451::task::990::TaskManager.Task::(_decref) Task=`a6a0c266-163f-4fef-886e-201ef69a19ad`::ref 0 aborting False >Thread-40::DEBUG::2014-07-10 09:29:16,810::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lion.qa.lab.tlv.redhat.com:_export_yuri2_backup2/6a70504d-00df-4869-8695-0f442053f6b6/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-40::DEBUG::2014-07-10 09:29:16,839::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n369 bytes (369 B) copied, 0.000434592 s, 849 kB/s\n'; <rc> = 0 >Thread-67::DEBUG::2014-07-10 09:29:17,455::task::595::TaskManager.Task::(_updateState) Task=`072bace8-5b74-47fc-b4dc-38ef40bd21a6`::moving from state init -> state preparing >Thread-67::INFO::2014-07-10 09:29:17,456::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='f30c2cb7-a43a-4bf5-82b5-cfe07336f65c', volUUID='b0fbb3c9-55af-4a3a-95ad-fc56a80b9cf5', options=None) >Thread-67::INFO::2014-07-10 09:29:17,457::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-67::DEBUG::2014-07-10 09:29:17,457::task::1185::TaskManager.Task::(prepare) Task=`072bace8-5b74-47fc-b4dc-38ef40bd21a6`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-67::DEBUG::2014-07-10 09:29:17,457::task::595::TaskManager.Task::(_updateState) Task=`072bace8-5b74-47fc-b4dc-38ef40bd21a6`::moving from state preparing -> state finished >Thread-67::DEBUG::2014-07-10 09:29:17,457::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-67::DEBUG::2014-07-10 09:29:17,457::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-67::DEBUG::2014-07-10 09:29:17,458::task::990::TaskManager.Task::(_decref) Task=`072bace8-5b74-47fc-b4dc-38ef40bd21a6`::ref 0 aborting False >Thread-48::DEBUG::2014-07-10 09:29:17,941::task::595::TaskManager.Task::(_updateState) Task=`305e7614-0593-4e17-9f1a-47737239766e`::moving from state init -> state preparing >Thread-48::INFO::2014-07-10 09:29:17,942::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='0cd7d6ce-f497-4243-a690-c57744861eea', volUUID='10b6a7dd-dc6c-43fa-ba17-92e4331b0e0b', options=None) >Thread-48::INFO::2014-07-10 09:29:17,943::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-48::DEBUG::2014-07-10 09:29:17,943::task::1185::TaskManager.Task::(prepare) Task=`305e7614-0593-4e17-9f1a-47737239766e`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-48::DEBUG::2014-07-10 09:29:17,943::task::595::TaskManager.Task::(_updateState) Task=`305e7614-0593-4e17-9f1a-47737239766e`::moving from state preparing -> state finished >Thread-48::DEBUG::2014-07-10 09:29:17,943::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-48::DEBUG::2014-07-10 09:29:17,943::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-48::DEBUG::2014-07-10 09:29:17,943::task::990::TaskManager.Task::(_decref) Task=`305e7614-0593-4e17-9f1a-47737239766e`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 09:29:18,261::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:29:18,359::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0346416 s, 29.6 MB/s\n'; <rc> = 0 >Thread-76::DEBUG::2014-07-10 09:29:19,292::task::595::TaskManager.Task::(_updateState) Task=`0d1df0c1-e38d-405c-bee9-7d2f58b45598`::moving from state init -> state preparing >Thread-76::INFO::2014-07-10 09:29:19,293::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='e4c65229-4247-4b33-b72a-f1d5ce72ad05', volUUID='cad94284-3ca9-4c30-933d-997f4460309e', options=None) >Thread-76::INFO::2014-07-10 09:29:19,294::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-76::DEBUG::2014-07-10 09:29:19,294::task::1185::TaskManager.Task::(prepare) Task=`0d1df0c1-e38d-405c-bee9-7d2f58b45598`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-76::DEBUG::2014-07-10 09:29:19,294::task::595::TaskManager.Task::(_updateState) Task=`0d1df0c1-e38d-405c-bee9-7d2f58b45598`::moving from state preparing -> state finished >Thread-76::DEBUG::2014-07-10 09:29:19,294::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-76::DEBUG::2014-07-10 09:29:19,295::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-76::DEBUG::2014-07-10 09:29:19,295::task::990::TaskManager.Task::(_decref) Task=`0d1df0c1-e38d-405c-bee9-7d2f58b45598`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 09:29:20,374::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:29:20,461::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0296663 s, 34.5 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:29:22,476::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:29:22,569::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0324663 s, 31.5 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 09:29:24,475::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-14::DEBUG::2014-07-10 09:29:24,477::task::595::TaskManager.Task::(_updateState) Task=`875547d5-6b48-4b06-88e7-2d2a691179fd`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 09:29:24,477::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-14::INFO::2014-07-10 09:29:24,477::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:29:24,478::task::1185::TaskManager.Task::(prepare) Task=`875547d5-6b48-4b06-88e7-2d2a691179fd`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:29:24,478::task::595::TaskManager.Task::(_updateState) Task=`875547d5-6b48-4b06-88e7-2d2a691179fd`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 09:29:24,478::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 09:29:24,478::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 09:29:24,479::task::990::TaskManager.Task::(_decref) Task=`875547d5-6b48-4b06-88e7-2d2a691179fd`::ref 0 aborting False >Thread-34::DEBUG::2014-07-10 09:29:24,482::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-34::DEBUG::2014-07-10 09:29:24,483::task::595::TaskManager.Task::(_updateState) Task=`db0bbcd3-948a-4ecb-8531-7b560cfbc9a7`::moving from state init -> state preparing >Thread-34::INFO::2014-07-10 09:29:24,483::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-34::DEBUG::2014-07-10 09:29:24,484::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`11e60d37-cae2-4e4f-98fe-f23be5891e2c`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-10 09:29:24,484::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' for lock type 'shared' >Thread-34::DEBUG::2014-07-10 09:29:24,484::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-10 09:29:24,485::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`11e60d37-cae2-4e4f-98fe-f23be5891e2c`::Granted request >Thread-34::DEBUG::2014-07-10 09:29:24,485::task::827::TaskManager.Task::(resourceAcquired) Task=`db0bbcd3-948a-4ecb-8531-7b560cfbc9a7`::_resourcesAcquired: Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee (shared) >Thread-34::DEBUG::2014-07-10 09:29:24,485::task::990::TaskManager.Task::(_decref) Task=`db0bbcd3-948a-4ecb-8531-7b560cfbc9a7`::ref 1 aborting False >Thread-34::INFO::2014-07-10 09:29:24,487::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532067385344', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:29:24,487::task::1185::TaskManager.Task::(prepare) Task=`db0bbcd3-948a-4ecb-8531-7b560cfbc9a7`::finished: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532067385344', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:29:24,487::task::595::TaskManager.Task::(_updateState) Task=`db0bbcd3-948a-4ecb-8531-7b560cfbc9a7`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-10 09:29:24,487::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee': < ResourceRef 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-10 09:29:24,487::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-10 09:29:24,488::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' >Thread-34::DEBUG::2014-07-10 09:29:24,488::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' (0 active users) >Thread-34::DEBUG::2014-07-10 09:29:24,488::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-10 09:29:24,488::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', Clearing records. >Thread-34::DEBUG::2014-07-10 09:29:24,489::task::990::TaskManager.Task::(_decref) Task=`db0bbcd3-948a-4ecb-8531-7b560cfbc9a7`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 09:29:24,584::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:29:24,683::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0360638 s, 28.4 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-10 09:29:25,274::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/metadata bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-10 09:29:25,297::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000888103 s, 4.6 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 09:29:26,270::task::595::TaskManager.Task::(_updateState) Task=`4c2d4155-561e-4da4-9b03-1bc1ce30b87e`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 09:29:26,270::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::INFO::2014-07-10 09:29:26,271::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000888103', 'lastCheck': '0.9', 'valid': True}, '6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000434592', 'lastCheck': '9.4', 'valid': True}} >Thread-14::DEBUG::2014-07-10 09:29:26,271::task::1185::TaskManager.Task::(prepare) Task=`4c2d4155-561e-4da4-9b03-1bc1ce30b87e`::finished: {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000888103', 'lastCheck': '0.9', 'valid': True}, '6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000434592', 'lastCheck': '9.4', 'valid': True}} >Thread-14::DEBUG::2014-07-10 09:29:26,271::task::595::TaskManager.Task::(_updateState) Task=`4c2d4155-561e-4da4-9b03-1bc1ce30b87e`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 09:29:26,271::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 09:29:26,272::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 09:29:26,272::task::990::TaskManager.Task::(_decref) Task=`4c2d4155-561e-4da4-9b03-1bc1ce30b87e`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 09:29:26,700::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:29:26,800::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0297895 s, 34.4 MB/s\n'; <rc> = 0 >Thread-40::DEBUG::2014-07-10 09:29:26,870::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lion.qa.lab.tlv.redhat.com:_export_yuri2_backup2/6a70504d-00df-4869-8695-0f442053f6b6/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-40::DEBUG::2014-07-10 09:29:26,890::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n369 bytes (369 B) copied, 0.000490318 s, 753 kB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:29:28,820::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:29:28,913::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0347086 s, 29.5 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:29:30,928::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:29:31,027::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.041366 s, 24.8 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:29:33,042::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:29:33,129::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0310481 s, 33.0 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 09:29:34,567::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-14::DEBUG::2014-07-10 09:29:34,569::task::595::TaskManager.Task::(_updateState) Task=`99771b61-cd3e-427d-bbc1-a01978c37b14`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 09:29:34,569::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-14::INFO::2014-07-10 09:29:34,569::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:29:34,570::task::1185::TaskManager.Task::(prepare) Task=`99771b61-cd3e-427d-bbc1-a01978c37b14`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:29:34,570::task::595::TaskManager.Task::(_updateState) Task=`99771b61-cd3e-427d-bbc1-a01978c37b14`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 09:29:34,570::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 09:29:34,570::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 09:29:34,570::task::990::TaskManager.Task::(_decref) Task=`99771b61-cd3e-427d-bbc1-a01978c37b14`::ref 0 aborting False >Thread-34::DEBUG::2014-07-10 09:29:34,575::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-34::DEBUG::2014-07-10 09:29:34,575::task::595::TaskManager.Task::(_updateState) Task=`a122d6b2-1324-4578-a852-cdce08357572`::moving from state init -> state preparing >Thread-34::INFO::2014-07-10 09:29:34,575::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-34::DEBUG::2014-07-10 09:29:34,576::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`ac299b8a-cf77-4e0b-becb-bc7d25529a76`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-10 09:29:34,577::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' for lock type 'shared' >Thread-34::DEBUG::2014-07-10 09:29:34,577::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-10 09:29:34,577::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`ac299b8a-cf77-4e0b-becb-bc7d25529a76`::Granted request >Thread-34::DEBUG::2014-07-10 09:29:34,578::task::827::TaskManager.Task::(resourceAcquired) Task=`a122d6b2-1324-4578-a852-cdce08357572`::_resourcesAcquired: Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee (shared) >Thread-34::DEBUG::2014-07-10 09:29:34,578::task::990::TaskManager.Task::(_decref) Task=`a122d6b2-1324-4578-a852-cdce08357572`::ref 1 aborting False >Thread-34::INFO::2014-07-10 09:29:34,579::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532067385344', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:29:34,580::task::1185::TaskManager.Task::(prepare) Task=`a122d6b2-1324-4578-a852-cdce08357572`::finished: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532067385344', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:29:34,580::task::595::TaskManager.Task::(_updateState) Task=`a122d6b2-1324-4578-a852-cdce08357572`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-10 09:29:34,580::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee': < ResourceRef 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-10 09:29:34,580::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-10 09:29:34,580::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' >Thread-34::DEBUG::2014-07-10 09:29:34,581::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' (0 active users) >Thread-34::DEBUG::2014-07-10 09:29:34,581::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-10 09:29:34,581::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', Clearing records. >Thread-34::DEBUG::2014-07-10 09:29:34,581::task::990::TaskManager.Task::(_decref) Task=`a122d6b2-1324-4578-a852-cdce08357572`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 09:29:35,144::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:29:35,232::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.030184 s, 33.9 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-10 09:29:35,331::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/metadata bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-10 09:29:35,351::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000752255 s, 5.4 MB/s\n'; <rc> = 0 >Thread-70::DEBUG::2014-07-10 09:29:36,541::task::595::TaskManager.Task::(_updateState) Task=`bef14397-8975-4a14-b6db-a6062e4b9355`::moving from state init -> state preparing >Thread-70::INFO::2014-07-10 09:29:36,541::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='cfaeead2-7caa-467c-b389-c89840ae6605', volUUID='567fe32d-31a6-4ff6-90f3-fd6a656fbecc', options=None) >Thread-70::INFO::2014-07-10 09:29:36,542::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-70::DEBUG::2014-07-10 09:29:36,542::task::1185::TaskManager.Task::(prepare) Task=`bef14397-8975-4a14-b6db-a6062e4b9355`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-70::DEBUG::2014-07-10 09:29:36,542::task::595::TaskManager.Task::(_updateState) Task=`bef14397-8975-4a14-b6db-a6062e4b9355`::moving from state preparing -> state finished >Thread-70::DEBUG::2014-07-10 09:29:36,543::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-70::DEBUG::2014-07-10 09:29:36,543::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-70::DEBUG::2014-07-10 09:29:36,543::task::990::TaskManager.Task::(_decref) Task=`bef14397-8975-4a14-b6db-a6062e4b9355`::ref 0 aborting False >Thread-40::DEBUG::2014-07-10 09:29:36,920::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lion.qa.lab.tlv.redhat.com:_export_yuri2_backup2/6a70504d-00df-4869-8695-0f442053f6b6/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-40::DEBUG::2014-07-10 09:29:36,941::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n369 bytes (369 B) copied, 0.000472871 s, 780 kB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:29:37,247::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:29:37,338::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0306789 s, 33.4 MB/s\n'; <rc> = 0 >Thread-60::DEBUG::2014-07-10 09:29:37,519::task::595::TaskManager.Task::(_updateState) Task=`c23a71b4-7c43-4b1d-b503-c055d329e1d6`::moving from state init -> state preparing >Thread-60::INFO::2014-07-10 09:29:37,520::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='b034d5b0-e1e0-4011-b49b-4d45ddb11556', volUUID='3d7f62b5-328f-4d8e-8b69-873cfb5ae14d', options=None) >Thread-60::INFO::2014-07-10 09:29:37,520::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-60::DEBUG::2014-07-10 09:29:37,520::task::1185::TaskManager.Task::(prepare) Task=`c23a71b4-7c43-4b1d-b503-c055d329e1d6`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-60::DEBUG::2014-07-10 09:29:37,521::task::595::TaskManager.Task::(_updateState) Task=`c23a71b4-7c43-4b1d-b503-c055d329e1d6`::moving from state preparing -> state finished >Thread-60::DEBUG::2014-07-10 09:29:37,521::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-60::DEBUG::2014-07-10 09:29:37,521::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-60::DEBUG::2014-07-10 09:29:37,521::task::990::TaskManager.Task::(_decref) Task=`c23a71b4-7c43-4b1d-b503-c055d329e1d6`::ref 0 aborting False >Thread-51::DEBUG::2014-07-10 09:29:37,567::task::595::TaskManager.Task::(_updateState) Task=`fa2289dc-6f86-4d6c-9a56-9a60e4699e1a`::moving from state init -> state preparing >Thread-51::INFO::2014-07-10 09:29:37,568::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='76fdb054-02cd-42ed-9721-b3e65b34c3a4', volUUID='022dfe46-2cf7-4915-80b3-883158e3ca83', options=None) >Thread-51::INFO::2014-07-10 09:29:37,568::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-51::DEBUG::2014-07-10 09:29:37,568::task::1185::TaskManager.Task::(prepare) Task=`fa2289dc-6f86-4d6c-9a56-9a60e4699e1a`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-51::DEBUG::2014-07-10 09:29:37,568::task::595::TaskManager.Task::(_updateState) Task=`fa2289dc-6f86-4d6c-9a56-9a60e4699e1a`::moving from state preparing -> state finished >Thread-51::DEBUG::2014-07-10 09:29:37,569::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-51::DEBUG::2014-07-10 09:29:37,569::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-51::DEBUG::2014-07-10 09:29:37,569::task::990::TaskManager.Task::(_decref) Task=`fa2289dc-6f86-4d6c-9a56-9a60e4699e1a`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 09:29:39,354::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:29:39,449::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0329449 s, 31.1 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 09:29:41,457::task::595::TaskManager.Task::(_updateState) Task=`6f9f1ba9-40dd-48af-8618-d11db80b7f65`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 09:29:41,458::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::INFO::2014-07-10 09:29:41,458::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000752255', 'lastCheck': '6.1', 'valid': True}, '6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000472871', 'lastCheck': '4.5', 'valid': True}} >Thread-14::DEBUG::2014-07-10 09:29:41,458::task::1185::TaskManager.Task::(prepare) Task=`6f9f1ba9-40dd-48af-8618-d11db80b7f65`::finished: {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000752255', 'lastCheck': '6.1', 'valid': True}, '6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000472871', 'lastCheck': '4.5', 'valid': True}} >Thread-14::DEBUG::2014-07-10 09:29:41,459::task::595::TaskManager.Task::(_updateState) Task=`6f9f1ba9-40dd-48af-8618-d11db80b7f65`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 09:29:41,459::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 09:29:41,459::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 09:29:41,459::task::990::TaskManager.Task::(_decref) Task=`6f9f1ba9-40dd-48af-8618-d11db80b7f65`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 09:29:41,464::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:29:41,858::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0531039 s, 19.3 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:29:44,041::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:29:44,147::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0295247 s, 34.7 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 09:29:44,615::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-14::DEBUG::2014-07-10 09:29:44,617::task::595::TaskManager.Task::(_updateState) Task=`d1e3ec29-c02a-49fd-9e90-1d45fd3410b1`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 09:29:44,617::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-14::INFO::2014-07-10 09:29:44,618::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:29:44,618::task::1185::TaskManager.Task::(prepare) Task=`d1e3ec29-c02a-49fd-9e90-1d45fd3410b1`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:29:44,618::task::595::TaskManager.Task::(_updateState) Task=`d1e3ec29-c02a-49fd-9e90-1d45fd3410b1`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 09:29:44,618::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 09:29:44,619::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 09:29:44,619::task::990::TaskManager.Task::(_decref) Task=`d1e3ec29-c02a-49fd-9e90-1d45fd3410b1`::ref 0 aborting False >Thread-34::DEBUG::2014-07-10 09:29:44,663::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-34::DEBUG::2014-07-10 09:29:44,663::task::595::TaskManager.Task::(_updateState) Task=`fda083d1-15b5-4f0e-a76e-a275f2b9c551`::moving from state init -> state preparing >Thread-34::INFO::2014-07-10 09:29:44,664::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-34::DEBUG::2014-07-10 09:29:44,664::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`069cda4a-3b32-4c6b-a3df-b4ea01f1b4b9`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-10 09:29:44,665::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' for lock type 'shared' >Thread-34::DEBUG::2014-07-10 09:29:44,666::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-10 09:29:44,667::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`069cda4a-3b32-4c6b-a3df-b4ea01f1b4b9`::Granted request >Thread-34::DEBUG::2014-07-10 09:29:44,667::task::827::TaskManager.Task::(resourceAcquired) Task=`fda083d1-15b5-4f0e-a76e-a275f2b9c551`::_resourcesAcquired: Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee (shared) >Thread-34::DEBUG::2014-07-10 09:29:44,668::task::990::TaskManager.Task::(_decref) Task=`fda083d1-15b5-4f0e-a76e-a275f2b9c551`::ref 1 aborting False >Thread-34::INFO::2014-07-10 09:29:44,669::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532067385344', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:29:44,669::task::1185::TaskManager.Task::(prepare) Task=`fda083d1-15b5-4f0e-a76e-a275f2b9c551`::finished: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532067385344', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:29:44,669::task::595::TaskManager.Task::(_updateState) Task=`fda083d1-15b5-4f0e-a76e-a275f2b9c551`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-10 09:29:44,669::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee': < ResourceRef 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-10 09:29:44,670::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-10 09:29:44,670::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' >Thread-34::DEBUG::2014-07-10 09:29:44,670::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' (0 active users) >Thread-34::DEBUG::2014-07-10 09:29:44,670::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-10 09:29:44,670::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', Clearing records. >Thread-34::DEBUG::2014-07-10 09:29:44,671::task::990::TaskManager.Task::(_decref) Task=`fda083d1-15b5-4f0e-a76e-a275f2b9c551`::ref 0 aborting False >Thread-18::DEBUG::2014-07-10 09:29:45,381::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/metadata bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-10 09:29:45,402::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000637532 s, 6.4 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:29:46,163::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:29:46,323::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0391714 s, 26.1 MB/s\n'; <rc> = 0 >Thread-40::DEBUG::2014-07-10 09:29:46,968::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lion.qa.lab.tlv.redhat.com:_export_yuri2_backup2/6a70504d-00df-4869-8695-0f442053f6b6/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-40::DEBUG::2014-07-10 09:29:46,988::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n369 bytes (369 B) copied, 0.000518093 s, 712 kB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:29:48,339::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:29:48,434::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0360074 s, 28.4 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:29:50,449::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:29:50,538::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0298115 s, 34.3 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:29:52,553::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:29:52,659::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0318415 s, 32.2 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:29:54,677::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Thread-14::DEBUG::2014-07-10 09:29:54,704::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-14::DEBUG::2014-07-10 09:29:54,705::task::595::TaskManager.Task::(_updateState) Task=`577ff726-15f6-44d3-b183-592b1e85f41e`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 09:29:54,706::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-14::INFO::2014-07-10 09:29:54,706::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:29:54,706::task::1185::TaskManager.Task::(prepare) Task=`577ff726-15f6-44d3-b183-592b1e85f41e`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:29:54,707::task::595::TaskManager.Task::(_updateState) Task=`577ff726-15f6-44d3-b183-592b1e85f41e`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 09:29:54,707::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 09:29:54,707::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 09:29:54,707::task::990::TaskManager.Task::(_decref) Task=`577ff726-15f6-44d3-b183-592b1e85f41e`::ref 0 aborting False >Thread-34::DEBUG::2014-07-10 09:29:54,715::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-34::DEBUG::2014-07-10 09:29:54,718::task::595::TaskManager.Task::(_updateState) Task=`0ab81be5-7a7f-4d27-a621-e454415a4387`::moving from state init -> state preparing >Thread-34::INFO::2014-07-10 09:29:54,721::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-34::DEBUG::2014-07-10 09:29:54,728::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`e2d844dd-455c-4f7f-9809-5ebb5ee68c82`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-10 09:29:54,730::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' for lock type 'shared' >Thread-34::DEBUG::2014-07-10 09:29:54,734::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-10 09:29:54,736::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`e2d844dd-455c-4f7f-9809-5ebb5ee68c82`::Granted request >Thread-34::DEBUG::2014-07-10 09:29:54,741::task::827::TaskManager.Task::(resourceAcquired) Task=`0ab81be5-7a7f-4d27-a621-e454415a4387`::_resourcesAcquired: Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee (shared) >Thread-34::DEBUG::2014-07-10 09:29:54,744::task::990::TaskManager.Task::(_decref) Task=`0ab81be5-7a7f-4d27-a621-e454415a4387`::ref 1 aborting False >Thread-34::INFO::2014-07-10 09:29:54,756::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532067385344', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:29:54,759::task::1185::TaskManager.Task::(prepare) Task=`0ab81be5-7a7f-4d27-a621-e454415a4387`::finished: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532067385344', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:29:54,761::task::595::TaskManager.Task::(_updateState) Task=`0ab81be5-7a7f-4d27-a621-e454415a4387`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-10 09:29:54,763::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee': < ResourceRef 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-10 09:29:54,766::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-10 09:29:54,769::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' >Thread-34::DEBUG::2014-07-10 09:29:54,772::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' (0 active users) >Thread-34::DEBUG::2014-07-10 09:29:54,774::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-10 09:29:54,776::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', Clearing records. >Thread-34::DEBUG::2014-07-10 09:29:54,780::task::990::TaskManager.Task::(_decref) Task=`0ab81be5-7a7f-4d27-a621-e454415a4387`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 09:29:54,860::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.124242 s, 8.2 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-10 09:29:55,431::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/metadata bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-10 09:29:55,453::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00080534 s, 5.1 MB/s\n'; <rc> = 0 >Thread-64::DEBUG::2014-07-10 09:29:56,626::task::595::TaskManager.Task::(_updateState) Task=`2730cc4a-83de-418d-bf47-78371ce21864`::moving from state init -> state preparing >Thread-64::INFO::2014-07-10 09:29:56,627::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='aa20346a-4d3a-4e07-b8e1-52c0ebe4168c', volUUID='58fefce2-9bce-4bff-8949-8c6ce8122b27', options=None) >Thread-64::INFO::2014-07-10 09:29:56,628::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-64::DEBUG::2014-07-10 09:29:56,628::task::1185::TaskManager.Task::(prepare) Task=`2730cc4a-83de-418d-bf47-78371ce21864`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-64::DEBUG::2014-07-10 09:29:56,628::task::595::TaskManager.Task::(_updateState) Task=`2730cc4a-83de-418d-bf47-78371ce21864`::moving from state preparing -> state finished >Thread-64::DEBUG::2014-07-10 09:29:56,628::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-64::DEBUG::2014-07-10 09:29:56,628::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-64::DEBUG::2014-07-10 09:29:56,628::task::990::TaskManager.Task::(_decref) Task=`2730cc4a-83de-418d-bf47-78371ce21864`::ref 0 aborting False >Thread-14::DEBUG::2014-07-10 09:29:56,676::task::595::TaskManager.Task::(_updateState) Task=`c5871483-68e8-4350-bfd1-1d0b0b577228`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 09:29:56,676::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::INFO::2014-07-10 09:29:56,676::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00080534', 'lastCheck': '1.2', 'valid': True}, '6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000518093', 'lastCheck': '9.7', 'valid': True}} >Thread-14::DEBUG::2014-07-10 09:29:56,677::task::1185::TaskManager.Task::(prepare) Task=`c5871483-68e8-4350-bfd1-1d0b0b577228`::finished: {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00080534', 'lastCheck': '1.2', 'valid': True}, '6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000518093', 'lastCheck': '9.7', 'valid': True}} >Thread-14::DEBUG::2014-07-10 09:29:56,677::task::595::TaskManager.Task::(_updateState) Task=`c5871483-68e8-4350-bfd1-1d0b0b577228`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 09:29:56,677::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 09:29:56,677::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 09:29:56,677::task::990::TaskManager.Task::(_decref) Task=`c5871483-68e8-4350-bfd1-1d0b0b577228`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 09:29:56,876::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:29:56,966::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0323241 s, 31.7 MB/s\n'; <rc> = 0 >Thread-40::DEBUG::2014-07-10 09:29:57,019::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lion.qa.lab.tlv.redhat.com:_export_yuri2_backup2/6a70504d-00df-4869-8695-0f442053f6b6/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-40::DEBUG::2014-07-10 09:29:57,039::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n369 bytes (369 B) copied, 0.000499592 s, 739 kB/s\n'; <rc> = 0 >Thread-54::DEBUG::2014-07-10 09:29:58,643::task::595::TaskManager.Task::(_updateState) Task=`d6a6ec5b-5bbc-4a41-8ab2-c7c56a7959ac`::moving from state init -> state preparing >Thread-54::INFO::2014-07-10 09:29:58,644::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='28408446-e5fd-4565-a976-e760951593fe', volUUID='776303a2-5585-451e-826e-0e338d4a1e98', options=None) >Thread-54::INFO::2014-07-10 09:29:58,645::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-54::DEBUG::2014-07-10 09:29:58,645::task::1185::TaskManager.Task::(prepare) Task=`d6a6ec5b-5bbc-4a41-8ab2-c7c56a7959ac`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-54::DEBUG::2014-07-10 09:29:58,645::task::595::TaskManager.Task::(_updateState) Task=`d6a6ec5b-5bbc-4a41-8ab2-c7c56a7959ac`::moving from state preparing -> state finished >Thread-54::DEBUG::2014-07-10 09:29:58,645::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-54::DEBUG::2014-07-10 09:29:58,645::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-54::DEBUG::2014-07-10 09:29:58,645::task::990::TaskManager.Task::(_decref) Task=`d6a6ec5b-5bbc-4a41-8ab2-c7c56a7959ac`::ref 0 aborting False >Thread-73::DEBUG::2014-07-10 09:29:58,647::task::595::TaskManager.Task::(_updateState) Task=`cb2d72a7-3fb6-4701-a8ca-4cbe96e491f4`::moving from state init -> state preparing >Thread-73::INFO::2014-07-10 09:29:58,647::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='c01d693b-cba0-4fed-9ad7-0aaa28912a19', volUUID='4bb5d954-2a50-4028-b299-0b43c261270c', options=None) >Thread-73::INFO::2014-07-10 09:29:58,648::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-73::DEBUG::2014-07-10 09:29:58,648::task::1185::TaskManager.Task::(prepare) Task=`cb2d72a7-3fb6-4701-a8ca-4cbe96e491f4`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-73::DEBUG::2014-07-10 09:29:58,648::task::595::TaskManager.Task::(_updateState) Task=`cb2d72a7-3fb6-4701-a8ca-4cbe96e491f4`::moving from state preparing -> state finished >Thread-73::DEBUG::2014-07-10 09:29:58,648::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-73::DEBUG::2014-07-10 09:29:58,648::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-73::DEBUG::2014-07-10 09:29:58,649::task::990::TaskManager.Task::(_decref) Task=`cb2d72a7-3fb6-4701-a8ca-4cbe96e491f4`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 09:29:58,981::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:29:59,069::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0301583 s, 34.0 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:30:01,084::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:30:01,195::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0478701 s, 21.4 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:30:03,211::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:30:03,299::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0269051 s, 38.1 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 09:30:04,832::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-14::DEBUG::2014-07-10 09:30:04,836::task::595::TaskManager.Task::(_updateState) Task=`ed1b738e-d122-4523-bac6-4c1be0318c0f`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 09:30:04,837::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-14::INFO::2014-07-10 09:30:04,837::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:30:04,838::task::1185::TaskManager.Task::(prepare) Task=`ed1b738e-d122-4523-bac6-4c1be0318c0f`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:30:04,838::task::595::TaskManager.Task::(_updateState) Task=`ed1b738e-d122-4523-bac6-4c1be0318c0f`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 09:30:04,838::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 09:30:04,838::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 09:30:04,838::task::990::TaskManager.Task::(_decref) Task=`ed1b738e-d122-4523-bac6-4c1be0318c0f`::ref 0 aborting False >Thread-34::DEBUG::2014-07-10 09:30:04,843::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-34::DEBUG::2014-07-10 09:30:04,844::task::595::TaskManager.Task::(_updateState) Task=`4d6739be-c9b8-4a0e-8826-ce9ec9eb72c6`::moving from state init -> state preparing >Thread-34::INFO::2014-07-10 09:30:04,844::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-34::DEBUG::2014-07-10 09:30:04,845::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`33b695da-0299-44a6-aac5-fcf28d6bb6cf`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-10 09:30:04,845::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' for lock type 'shared' >Thread-34::DEBUG::2014-07-10 09:30:04,845::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-10 09:30:04,845::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`33b695da-0299-44a6-aac5-fcf28d6bb6cf`::Granted request >Thread-34::DEBUG::2014-07-10 09:30:04,846::task::827::TaskManager.Task::(resourceAcquired) Task=`4d6739be-c9b8-4a0e-8826-ce9ec9eb72c6`::_resourcesAcquired: Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee (shared) >Thread-34::DEBUG::2014-07-10 09:30:04,846::task::990::TaskManager.Task::(_decref) Task=`4d6739be-c9b8-4a0e-8826-ce9ec9eb72c6`::ref 1 aborting False >Thread-34::INFO::2014-07-10 09:30:04,847::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532067385344', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:30:04,847::task::1185::TaskManager.Task::(prepare) Task=`4d6739be-c9b8-4a0e-8826-ce9ec9eb72c6`::finished: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532067385344', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:30:04,847::task::595::TaskManager.Task::(_updateState) Task=`4d6739be-c9b8-4a0e-8826-ce9ec9eb72c6`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-10 09:30:04,847::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee': < ResourceRef 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-10 09:30:04,848::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-10 09:30:04,848::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' >Thread-34::DEBUG::2014-07-10 09:30:04,848::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' (0 active users) >Thread-34::DEBUG::2014-07-10 09:30:04,848::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-10 09:30:04,848::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', Clearing records. >Thread-34::DEBUG::2014-07-10 09:30:04,849::task::990::TaskManager.Task::(_decref) Task=`4d6739be-c9b8-4a0e-8826-ce9ec9eb72c6`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 09:30:05,322::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:30:05,415::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0356342 s, 28.7 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-10 09:30:05,478::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/metadata bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-10 09:30:05,511::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.0130482 s, 314 kB/s\n'; <rc> = 0 >Thread-40::DEBUG::2014-07-10 09:30:07,069::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lion.qa.lab.tlv.redhat.com:_export_yuri2_backup2/6a70504d-00df-4869-8695-0f442053f6b6/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-40::DEBUG::2014-07-10 09:30:07,089::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n369 bytes (369 B) copied, 0.000505975 s, 729 kB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:30:07,430::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:30:07,516::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0288832 s, 35.5 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:30:09,531::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:30:09,629::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0342331 s, 29.9 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:30:11,645::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:30:11,742::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0299491 s, 34.2 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 09:30:11,838::task::595::TaskManager.Task::(_updateState) Task=`81639d0f-5085-4ad1-8ef2-258734d15b7a`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 09:30:11,839::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::INFO::2014-07-10 09:30:11,839::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0130482', 'lastCheck': '6.3', 'valid': True}, '6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000505975', 'lastCheck': '4.7', 'valid': True}} >Thread-14::DEBUG::2014-07-10 09:30:11,839::task::1185::TaskManager.Task::(prepare) Task=`81639d0f-5085-4ad1-8ef2-258734d15b7a`::finished: {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0130482', 'lastCheck': '6.3', 'valid': True}, '6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000505975', 'lastCheck': '4.7', 'valid': True}} >Thread-14::DEBUG::2014-07-10 09:30:11,840::task::595::TaskManager.Task::(_updateState) Task=`81639d0f-5085-4ad1-8ef2-258734d15b7a`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 09:30:11,840::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 09:30:11,840::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 09:30:11,840::task::990::TaskManager.Task::(_decref) Task=`81639d0f-5085-4ad1-8ef2-258734d15b7a`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 09:30:13,758::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:30:13,846::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0297331 s, 34.4 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 09:30:14,874::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-14::DEBUG::2014-07-10 09:30:14,875::task::595::TaskManager.Task::(_updateState) Task=`04a908f3-ce64-420b-b711-e926ea390ff8`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 09:30:14,875::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-14::INFO::2014-07-10 09:30:14,876::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:30:14,876::task::1185::TaskManager.Task::(prepare) Task=`04a908f3-ce64-420b-b711-e926ea390ff8`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:30:14,876::task::595::TaskManager.Task::(_updateState) Task=`04a908f3-ce64-420b-b711-e926ea390ff8`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 09:30:14,877::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 09:30:14,877::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 09:30:14,877::task::990::TaskManager.Task::(_decref) Task=`04a908f3-ce64-420b-b711-e926ea390ff8`::ref 0 aborting False >Thread-34::DEBUG::2014-07-10 09:30:14,921::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-34::DEBUG::2014-07-10 09:30:14,921::task::595::TaskManager.Task::(_updateState) Task=`c241e1b3-2be6-4da8-bd56-40f8d2cf6f4e`::moving from state init -> state preparing >Thread-34::INFO::2014-07-10 09:30:14,922::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-34::DEBUG::2014-07-10 09:30:14,922::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`12664398-adf1-4285-b4fc-f331700e1192`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-10 09:30:14,922::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' for lock type 'shared' >Thread-34::DEBUG::2014-07-10 09:30:14,923::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-10 09:30:14,923::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`12664398-adf1-4285-b4fc-f331700e1192`::Granted request >Thread-34::DEBUG::2014-07-10 09:30:14,924::task::827::TaskManager.Task::(resourceAcquired) Task=`c241e1b3-2be6-4da8-bd56-40f8d2cf6f4e`::_resourcesAcquired: Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee (shared) >Thread-34::DEBUG::2014-07-10 09:30:14,924::task::990::TaskManager.Task::(_decref) Task=`c241e1b3-2be6-4da8-bd56-40f8d2cf6f4e`::ref 1 aborting False >Thread-34::INFO::2014-07-10 09:30:14,925::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532067385344', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:30:14,925::task::1185::TaskManager.Task::(prepare) Task=`c241e1b3-2be6-4da8-bd56-40f8d2cf6f4e`::finished: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532067385344', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:30:14,925::task::595::TaskManager.Task::(_updateState) Task=`c241e1b3-2be6-4da8-bd56-40f8d2cf6f4e`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-10 09:30:14,926::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee': < ResourceRef 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-10 09:30:14,926::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-10 09:30:14,926::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' >Thread-34::DEBUG::2014-07-10 09:30:14,926::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' (0 active users) >Thread-34::DEBUG::2014-07-10 09:30:14,926::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-10 09:30:14,927::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', Clearing records. >Thread-34::DEBUG::2014-07-10 09:30:14,927::task::990::TaskManager.Task::(_decref) Task=`c241e1b3-2be6-4da8-bd56-40f8d2cf6f4e`::ref 0 aborting False >Thread-18::DEBUG::2014-07-10 09:30:15,544::domainMonitor::192::Storage.DomainMonitorThread::(_monitorDomain) Refreshing domain 9e1aa540-1f4e-4ee3-a152-be381ef6c3bd >Thread-18::DEBUG::2014-07-10 09:30:15,546::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with LvMetadataRW backend >Thread-18::DEBUG::2014-07-10 09:30:15,546::blockSD::336::Storage.Misc.excCmd::(readlines) '/bin/dd iflag=direct skip=0 bs=2048 if=/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/metadata count=1' (cwd None) >Thread-18::DEBUG::2014-07-10 09:30:15,566::blockSD::336::Storage.Misc.excCmd::(readlines) SUCCESS: <err> = '1+0 records in\n1+0 records out\n2048 bytes (2.0 kB) copied, 0.000916277 s, 2.2 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-10 09:30:15,567::misc::282::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '2048 bytes (2.0 kB) copied, 0.000916277 s, 2.2 MB/s'], size: 2048 >Thread-18::DEBUG::2014-07-10 09:30:15,567::persistentDict::234::Storage.PersistentDict::(refresh) read lines (LvMetadataRW)=[] >Thread-18::WARNING::2014-07-10 09:30:15,567::persistentDict::256::Storage.PersistentDict::(refresh) data has no embedded checksum - trust it as it is >Thread-18::DEBUG::2014-07-10 09:30:15,568::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with VGTagMetadataRW backend >Thread-18::DEBUG::2014-07-10 09:30:15,570::lvm::503::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-18::DEBUG::2014-07-10 09:30:15,570::lvm::505::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-18::DEBUG::2014-07-10 09:30:15,571::lvm::513::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-18::DEBUG::2014-07-10 09:30:15,571::lvm::525::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-18::DEBUG::2014-07-10 09:30:15,571::lvm::373::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-18::DEBUG::2014-07-10 09:30:15,572::lvm::296::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/3600601601282300032826addbbdae311|/dev/mapper/360060160f4a030003840ec867ddee311|/dev/mapper/367cad74c2fcba00019e6afd20c781e67|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name 9e1aa540-1f4e-4ee3-a152-be381ef6c3bd' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:30:15,861::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Thread-18::DEBUG::2014-07-10 09:30:15,896::lvm::296::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-18::DEBUG::2014-07-10 09:30:15,907::lvm::415::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-18::DEBUG::2014-07-10 09:30:15,912::persistentDict::234::Storage.PersistentDict::(refresh) read lines (VGTagMetadataRW)=['LEASETIMESEC=60', 'VGUUID=9CsMxb-YbRc-yRG7-cQKD-xY3G-GLi5-YxUyPC', 'VERSION=3', 'TYPE=ISCSI', 'LOGBLKSIZE=512', u'PV0=pv:3600601601282300032826addbbdae311,uuid:7qEb8v-jk2X-3CPk-k4XB-eIBk-onYD-807hcV,pestart:0,pecount:8189,mapoffset:0', 'LEASERETRIES=3', 'IOOPTIMEOUTSEC=10', 'LOCKRENEWALINTERVALSEC=5', 'PHYBLKSIZE=512', 'SDUUID=9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'CLASS=Data', 'LOCKPOLICY=', 'DESCRIPTION=SD_REAL', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=DC_REAL', 'ROLE=Master', 'POOL_UUID=4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', 'POOL_SPM_ID=1', 'POOL_SPM_LVER=0', '_SHA_CKSUM=013b5a7910962201c4cceab31b9c6d9c79f7316f', u'POOL_DOMAINS=9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active'] >Thread-18::INFO::2014-07-10 09:30:15,922::sd::384::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 9e1aa540-1f4e-4ee3-a152-be381ef6c3bd_imageNS already registered >Thread-18::INFO::2014-07-10 09:30:15,924::sd::392::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 9e1aa540-1f4e-4ee3-a152-be381ef6c3bd_volumeNS already registered >Thread-18::INFO::2014-07-10 09:30:15,925::blockSD::452::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 9e1aa540-1f4e-4ee3-a152-be381ef6c3bd_lvmActivationNS already registered >Thread-18::DEBUG::2014-07-10 09:30:15,934::lvm::296::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgck --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/3600601601282300032826addbbdae311|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } " 9e1aa540-1f4e-4ee3-a152-be381ef6c3bd' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:30:16,042::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.119924 s, 8.5 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-10 09:30:16,150::lvm::296::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-18::DEBUG::2014-07-10 09:30:16,154::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/metadata bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-10 09:30:16,178::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000641679 s, 6.4 MB/s\n'; <rc> = 0 >Thread-57::DEBUG::2014-07-10 09:30:16,723::task::595::TaskManager.Task::(_updateState) Task=`6aeb0336-a058-4da5-bce9-c9a02297a652`::moving from state init -> state preparing >Thread-57::INFO::2014-07-10 09:30:16,724::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='b6f6c0da-e67f-4902-b9ac-3069571a42fe', volUUID='c4cd1da8-05b7-45e0-80b1-1183d21443d9', options=None) >Thread-57::INFO::2014-07-10 09:30:16,724::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-57::DEBUG::2014-07-10 09:30:16,724::task::1185::TaskManager.Task::(prepare) Task=`6aeb0336-a058-4da5-bce9-c9a02297a652`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-57::DEBUG::2014-07-10 09:30:16,725::task::595::TaskManager.Task::(_updateState) Task=`6aeb0336-a058-4da5-bce9-c9a02297a652`::moving from state preparing -> state finished >Thread-57::DEBUG::2014-07-10 09:30:16,725::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-57::DEBUG::2014-07-10 09:30:16,725::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-57::DEBUG::2014-07-10 09:30:16,725::task::990::TaskManager.Task::(_decref) Task=`6aeb0336-a058-4da5-bce9-c9a02297a652`::ref 0 aborting False >Thread-40::DEBUG::2014-07-10 09:30:17,115::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lion.qa.lab.tlv.redhat.com:_export_yuri2_backup2/6a70504d-00df-4869-8695-0f442053f6b6/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-40::DEBUG::2014-07-10 09:30:17,135::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n369 bytes (369 B) copied, 0.000415822 s, 887 kB/s\n'; <rc> = 0 >Thread-67::DEBUG::2014-07-10 09:30:17,732::task::595::TaskManager.Task::(_updateState) Task=`1439f467-5819-43e9-aded-cda5d4771676`::moving from state init -> state preparing >Thread-67::INFO::2014-07-10 09:30:17,732::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='f30c2cb7-a43a-4bf5-82b5-cfe07336f65c', volUUID='b0fbb3c9-55af-4a3a-95ad-fc56a80b9cf5', options=None) >Thread-67::INFO::2014-07-10 09:30:17,733::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-67::DEBUG::2014-07-10 09:30:17,733::task::1185::TaskManager.Task::(prepare) Task=`1439f467-5819-43e9-aded-cda5d4771676`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-67::DEBUG::2014-07-10 09:30:17,734::task::595::TaskManager.Task::(_updateState) Task=`1439f467-5819-43e9-aded-cda5d4771676`::moving from state preparing -> state finished >Thread-67::DEBUG::2014-07-10 09:30:17,734::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-67::DEBUG::2014-07-10 09:30:17,734::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-67::DEBUG::2014-07-10 09:30:17,735::task::990::TaskManager.Task::(_decref) Task=`1439f467-5819-43e9-aded-cda5d4771676`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 09:30:18,058::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:30:18,147::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0323792 s, 31.6 MB/s\n'; <rc> = 0 >Thread-48::DEBUG::2014-07-10 09:30:18,252::task::595::TaskManager.Task::(_updateState) Task=`34f51d8f-d860-4753-bd5f-fa9a0764add4`::moving from state init -> state preparing >Thread-48::INFO::2014-07-10 09:30:18,253::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='0cd7d6ce-f497-4243-a690-c57744861eea', volUUID='10b6a7dd-dc6c-43fa-ba17-92e4331b0e0b', options=None) >Thread-48::INFO::2014-07-10 09:30:18,253::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-48::DEBUG::2014-07-10 09:30:18,253::task::1185::TaskManager.Task::(prepare) Task=`34f51d8f-d860-4753-bd5f-fa9a0764add4`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-48::DEBUG::2014-07-10 09:30:18,254::task::595::TaskManager.Task::(_updateState) Task=`34f51d8f-d860-4753-bd5f-fa9a0764add4`::moving from state preparing -> state finished >Thread-48::DEBUG::2014-07-10 09:30:18,254::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-48::DEBUG::2014-07-10 09:30:18,254::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-48::DEBUG::2014-07-10 09:30:18,254::task::990::TaskManager.Task::(_decref) Task=`34f51d8f-d860-4753-bd5f-fa9a0764add4`::ref 0 aborting False >Thread-76::DEBUG::2014-07-10 09:30:19,602::task::595::TaskManager.Task::(_updateState) Task=`32f20b1b-5eaa-4c0e-814e-9b5f296e7af2`::moving from state init -> state preparing >Thread-76::INFO::2014-07-10 09:30:19,602::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='e4c65229-4247-4b33-b72a-f1d5ce72ad05', volUUID='cad94284-3ca9-4c30-933d-997f4460309e', options=None) >Thread-76::INFO::2014-07-10 09:30:19,603::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-76::DEBUG::2014-07-10 09:30:19,603::task::1185::TaskManager.Task::(prepare) Task=`32f20b1b-5eaa-4c0e-814e-9b5f296e7af2`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-76::DEBUG::2014-07-10 09:30:19,603::task::595::TaskManager.Task::(_updateState) Task=`32f20b1b-5eaa-4c0e-814e-9b5f296e7af2`::moving from state preparing -> state finished >Thread-76::DEBUG::2014-07-10 09:30:19,603::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-76::DEBUG::2014-07-10 09:30:19,603::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-76::DEBUG::2014-07-10 09:30:19,604::task::990::TaskManager.Task::(_decref) Task=`32f20b1b-5eaa-4c0e-814e-9b5f296e7af2`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 09:30:20,162::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:30:20,248::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0298706 s, 34.3 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:30:22,264::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:30:22,636::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0498313 s, 20.5 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:30:24,647::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:30:24,743::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0376996 s, 27.2 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 09:30:24,968::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-14::DEBUG::2014-07-10 09:30:24,969::task::595::TaskManager.Task::(_updateState) Task=`41aad064-1572-48cd-8903-17b168513db0`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 09:30:24,970::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-14::INFO::2014-07-10 09:30:24,970::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:30:24,971::task::1185::TaskManager.Task::(prepare) Task=`41aad064-1572-48cd-8903-17b168513db0`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:30:24,971::task::595::TaskManager.Task::(_updateState) Task=`41aad064-1572-48cd-8903-17b168513db0`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 09:30:24,971::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 09:30:24,971::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 09:30:24,971::task::990::TaskManager.Task::(_decref) Task=`41aad064-1572-48cd-8903-17b168513db0`::ref 0 aborting False >Thread-34::DEBUG::2014-07-10 09:30:24,976::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-34::DEBUG::2014-07-10 09:30:24,976::task::595::TaskManager.Task::(_updateState) Task=`b38daa63-e9d7-46bc-9a24-68490a8db03f`::moving from state init -> state preparing >Thread-34::INFO::2014-07-10 09:30:24,976::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-34::DEBUG::2014-07-10 09:30:24,977::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`92ebf288-4fe9-44e2-9603-7d6d7ea88d32`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-10 09:30:24,977::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' for lock type 'shared' >Thread-34::DEBUG::2014-07-10 09:30:24,978::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-10 09:30:24,978::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`92ebf288-4fe9-44e2-9603-7d6d7ea88d32`::Granted request >Thread-34::DEBUG::2014-07-10 09:30:24,978::task::827::TaskManager.Task::(resourceAcquired) Task=`b38daa63-e9d7-46bc-9a24-68490a8db03f`::_resourcesAcquired: Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee (shared) >Thread-34::DEBUG::2014-07-10 09:30:24,979::task::990::TaskManager.Task::(_decref) Task=`b38daa63-e9d7-46bc-9a24-68490a8db03f`::ref 1 aborting False >Thread-34::INFO::2014-07-10 09:30:24,980::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532067385344', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:30:24,980::task::1185::TaskManager.Task::(prepare) Task=`b38daa63-e9d7-46bc-9a24-68490a8db03f`::finished: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532067385344', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:30:24,980::task::595::TaskManager.Task::(_updateState) Task=`b38daa63-e9d7-46bc-9a24-68490a8db03f`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-10 09:30:24,981::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee': < ResourceRef 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-10 09:30:24,981::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-10 09:30:24,981::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' >Thread-34::DEBUG::2014-07-10 09:30:24,981::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' (0 active users) >Thread-34::DEBUG::2014-07-10 09:30:24,982::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-10 09:30:24,982::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', Clearing records. >Thread-34::DEBUG::2014-07-10 09:30:24,982::task::990::TaskManager.Task::(_decref) Task=`b38daa63-e9d7-46bc-9a24-68490a8db03f`::ref 0 aborting False >Thread-18::DEBUG::2014-07-10 09:30:26,329::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/metadata bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-10 09:30:26,360::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00901218 s, 454 kB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:30:26,760::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:30:26,861::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0416106 s, 24.6 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 09:30:27,031::task::595::TaskManager.Task::(_updateState) Task=`18cb566b-34e0-4955-a53e-0f461f8a7cf8`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 09:30:27,031::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::INFO::2014-07-10 09:30:27,032::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00901218', 'lastCheck': '0.6', 'valid': True}, '6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000415822', 'lastCheck': '9.9', 'valid': True}} >Thread-14::DEBUG::2014-07-10 09:30:27,032::task::1185::TaskManager.Task::(prepare) Task=`18cb566b-34e0-4955-a53e-0f461f8a7cf8`::finished: {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00901218', 'lastCheck': '0.6', 'valid': True}, '6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000415822', 'lastCheck': '9.9', 'valid': True}} >Thread-14::DEBUG::2014-07-10 09:30:27,032::task::595::TaskManager.Task::(_updateState) Task=`18cb566b-34e0-4955-a53e-0f461f8a7cf8`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 09:30:27,032::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 09:30:27,033::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 09:30:27,033::task::990::TaskManager.Task::(_decref) Task=`18cb566b-34e0-4955-a53e-0f461f8a7cf8`::ref 0 aborting False >Thread-40::DEBUG::2014-07-10 09:30:27,165::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lion.qa.lab.tlv.redhat.com:_export_yuri2_backup2/6a70504d-00df-4869-8695-0f442053f6b6/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-40::DEBUG::2014-07-10 09:30:27,184::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n369 bytes (369 B) copied, 0.000561391 s, 657 kB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:30:28,877::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:30:28,984::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0357567 s, 28.6 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:30:30,999::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:30:31,116::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0573092 s, 17.9 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:30:33,131::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:30:33,250::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0382763 s, 26.8 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 09:30:35,017::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-14::DEBUG::2014-07-10 09:30:35,018::task::595::TaskManager.Task::(_updateState) Task=`b70d7a95-1fae-4af7-926c-3db90de97fad`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 09:30:35,018::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-14::INFO::2014-07-10 09:30:35,019::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:30:35,019::task::1185::TaskManager.Task::(prepare) Task=`b70d7a95-1fae-4af7-926c-3db90de97fad`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:30:35,019::task::595::TaskManager.Task::(_updateState) Task=`b70d7a95-1fae-4af7-926c-3db90de97fad`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 09:30:35,020::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 09:30:35,020::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 09:30:35,020::task::990::TaskManager.Task::(_decref) Task=`b70d7a95-1fae-4af7-926c-3db90de97fad`::ref 0 aborting False >Thread-34::DEBUG::2014-07-10 09:30:35,024::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-34::DEBUG::2014-07-10 09:30:35,024::task::595::TaskManager.Task::(_updateState) Task=`3f381125-cfbb-424b-80a8-1e6e3e444dce`::moving from state init -> state preparing >Thread-34::INFO::2014-07-10 09:30:35,025::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-34::DEBUG::2014-07-10 09:30:35,025::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`400c858c-6e64-4b10-8968-1fc6ecd7f2a7`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-10 09:30:35,025::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' for lock type 'shared' >Thread-34::DEBUG::2014-07-10 09:30:35,026::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-10 09:30:35,026::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`400c858c-6e64-4b10-8968-1fc6ecd7f2a7`::Granted request >Thread-34::DEBUG::2014-07-10 09:30:35,026::task::827::TaskManager.Task::(resourceAcquired) Task=`3f381125-cfbb-424b-80a8-1e6e3e444dce`::_resourcesAcquired: Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee (shared) >Thread-34::DEBUG::2014-07-10 09:30:35,027::task::990::TaskManager.Task::(_decref) Task=`3f381125-cfbb-424b-80a8-1e6e3e444dce`::ref 1 aborting False >Thread-34::INFO::2014-07-10 09:30:35,028::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532067385344', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:30:35,028::task::1185::TaskManager.Task::(prepare) Task=`3f381125-cfbb-424b-80a8-1e6e3e444dce`::finished: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532067385344', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:30:35,028::task::595::TaskManager.Task::(_updateState) Task=`3f381125-cfbb-424b-80a8-1e6e3e444dce`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-10 09:30:35,028::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee': < ResourceRef 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-10 09:30:35,028::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-10 09:30:35,029::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' >Thread-34::DEBUG::2014-07-10 09:30:35,029::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' (0 active users) >Thread-34::DEBUG::2014-07-10 09:30:35,029::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-10 09:30:35,029::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', Clearing records. >Thread-34::DEBUG::2014-07-10 09:30:35,029::task::990::TaskManager.Task::(_decref) Task=`3f381125-cfbb-424b-80a8-1e6e3e444dce`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 09:30:35,265::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:30:35,345::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0251724 s, 40.7 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-10 09:30:36,426::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/metadata bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-10 09:30:36,450::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.0023035 s, 1.8 MB/s\n'; <rc> = 0 >Thread-70::DEBUG::2014-07-10 09:30:36,815::task::595::TaskManager.Task::(_updateState) Task=`aa439c63-f761-475c-a15c-e5b03344af9a`::moving from state init -> state preparing >Thread-70::INFO::2014-07-10 09:30:36,816::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='cfaeead2-7caa-467c-b389-c89840ae6605', volUUID='567fe32d-31a6-4ff6-90f3-fd6a656fbecc', options=None) >Thread-70::INFO::2014-07-10 09:30:36,816::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-70::DEBUG::2014-07-10 09:30:36,816::task::1185::TaskManager.Task::(prepare) Task=`aa439c63-f761-475c-a15c-e5b03344af9a`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-70::DEBUG::2014-07-10 09:30:36,816::task::595::TaskManager.Task::(_updateState) Task=`aa439c63-f761-475c-a15c-e5b03344af9a`::moving from state preparing -> state finished >Thread-70::DEBUG::2014-07-10 09:30:36,817::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-70::DEBUG::2014-07-10 09:30:36,817::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-70::DEBUG::2014-07-10 09:30:36,817::task::990::TaskManager.Task::(_decref) Task=`aa439c63-f761-475c-a15c-e5b03344af9a`::ref 0 aborting False >Thread-40::DEBUG::2014-07-10 09:30:37,216::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lion.qa.lab.tlv.redhat.com:_export_yuri2_backup2/6a70504d-00df-4869-8695-0f442053f6b6/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-40::DEBUG::2014-07-10 09:30:37,237::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n369 bytes (369 B) copied, 0.000490952 s, 752 kB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:30:37,361::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:30:37,450::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0328088 s, 31.2 MB/s\n'; <rc> = 0 >Thread-60::DEBUG::2014-07-10 09:30:37,794::task::595::TaskManager.Task::(_updateState) Task=`31c20518-107f-48fb-9687-77d1e2c18c2c`::moving from state init -> state preparing >Thread-60::INFO::2014-07-10 09:30:37,794::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='b034d5b0-e1e0-4011-b49b-4d45ddb11556', volUUID='3d7f62b5-328f-4d8e-8b69-873cfb5ae14d', options=None) >Thread-60::INFO::2014-07-10 09:30:37,795::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-60::DEBUG::2014-07-10 09:30:37,795::task::1185::TaskManager.Task::(prepare) Task=`31c20518-107f-48fb-9687-77d1e2c18c2c`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-60::DEBUG::2014-07-10 09:30:37,795::task::595::TaskManager.Task::(_updateState) Task=`31c20518-107f-48fb-9687-77d1e2c18c2c`::moving from state preparing -> state finished >Thread-60::DEBUG::2014-07-10 09:30:37,796::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-60::DEBUG::2014-07-10 09:30:37,796::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-60::DEBUG::2014-07-10 09:30:37,796::task::990::TaskManager.Task::(_decref) Task=`31c20518-107f-48fb-9687-77d1e2c18c2c`::ref 0 aborting False >Thread-51::DEBUG::2014-07-10 09:30:37,821::task::595::TaskManager.Task::(_updateState) Task=`2a303360-2bc8-4075-b1de-adc678e3a8da`::moving from state init -> state preparing >Thread-51::INFO::2014-07-10 09:30:37,821::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='76fdb054-02cd-42ed-9721-b3e65b34c3a4', volUUID='022dfe46-2cf7-4915-80b3-883158e3ca83', options=None) >Thread-51::INFO::2014-07-10 09:30:37,822::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-51::DEBUG::2014-07-10 09:30:37,822::task::1185::TaskManager.Task::(prepare) Task=`2a303360-2bc8-4075-b1de-adc678e3a8da`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-51::DEBUG::2014-07-10 09:30:37,822::task::595::TaskManager.Task::(_updateState) Task=`2a303360-2bc8-4075-b1de-adc678e3a8da`::moving from state preparing -> state finished >Thread-51::DEBUG::2014-07-10 09:30:37,823::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-51::DEBUG::2014-07-10 09:30:37,823::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-51::DEBUG::2014-07-10 09:30:37,823::task::990::TaskManager.Task::(_decref) Task=`2a303360-2bc8-4075-b1de-adc678e3a8da`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 09:30:39,465::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:30:39,556::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0335865 s, 30.5 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:30:41,571::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:30:41,664::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0344578 s, 29.7 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 09:30:42,259::task::595::TaskManager.Task::(_updateState) Task=`07f46ad7-a31a-4d05-9921-913a0d0f7fe6`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 09:30:42,259::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::INFO::2014-07-10 09:30:42,260::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0023035', 'lastCheck': '5.8', 'valid': True}, '6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000490952', 'lastCheck': '5.0', 'valid': True}} >Thread-14::DEBUG::2014-07-10 09:30:42,260::task::1185::TaskManager.Task::(prepare) Task=`07f46ad7-a31a-4d05-9921-913a0d0f7fe6`::finished: {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0023035', 'lastCheck': '5.8', 'valid': True}, '6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000490952', 'lastCheck': '5.0', 'valid': True}} >Thread-14::DEBUG::2014-07-10 09:30:42,260::task::595::TaskManager.Task::(_updateState) Task=`07f46ad7-a31a-4d05-9921-913a0d0f7fe6`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 09:30:42,260::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 09:30:42,261::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 09:30:42,261::task::990::TaskManager.Task::(_decref) Task=`07f46ad7-a31a-4d05-9921-913a0d0f7fe6`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 09:30:43,679::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:30:43,772::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0305481 s, 33.5 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 09:30:45,068::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-14::DEBUG::2014-07-10 09:30:45,069::task::595::TaskManager.Task::(_updateState) Task=`bfedaa8a-1d06-4413-adf2-2dc1491abd63`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 09:30:45,069::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-14::INFO::2014-07-10 09:30:45,070::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:30:45,070::task::1185::TaskManager.Task::(prepare) Task=`bfedaa8a-1d06-4413-adf2-2dc1491abd63`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:30:45,070::task::595::TaskManager.Task::(_updateState) Task=`bfedaa8a-1d06-4413-adf2-2dc1491abd63`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 09:30:45,070::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 09:30:45,071::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 09:30:45,071::task::990::TaskManager.Task::(_decref) Task=`bfedaa8a-1d06-4413-adf2-2dc1491abd63`::ref 0 aborting False >Thread-34::DEBUG::2014-07-10 09:30:45,115::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-34::DEBUG::2014-07-10 09:30:45,115::task::595::TaskManager.Task::(_updateState) Task=`75c83c74-084e-432e-99d8-458574d39def`::moving from state init -> state preparing >Thread-34::INFO::2014-07-10 09:30:45,116::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-34::DEBUG::2014-07-10 09:30:45,116::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`2f965b95-e3e6-4c75-801a-dcd28ef35e8c`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-10 09:30:45,116::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' for lock type 'shared' >Thread-34::DEBUG::2014-07-10 09:30:45,117::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-10 09:30:45,117::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`2f965b95-e3e6-4c75-801a-dcd28ef35e8c`::Granted request >Thread-34::DEBUG::2014-07-10 09:30:45,118::task::827::TaskManager.Task::(resourceAcquired) Task=`75c83c74-084e-432e-99d8-458574d39def`::_resourcesAcquired: Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee (shared) >Thread-34::DEBUG::2014-07-10 09:30:45,118::task::990::TaskManager.Task::(_decref) Task=`75c83c74-084e-432e-99d8-458574d39def`::ref 1 aborting False >Thread-34::INFO::2014-07-10 09:30:45,119::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532067385344', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:30:45,119::task::1185::TaskManager.Task::(prepare) Task=`75c83c74-084e-432e-99d8-458574d39def`::finished: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532067385344', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:30:45,119::task::595::TaskManager.Task::(_updateState) Task=`75c83c74-084e-432e-99d8-458574d39def`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-10 09:30:45,120::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee': < ResourceRef 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-10 09:30:45,120::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-10 09:30:45,120::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' >Thread-34::DEBUG::2014-07-10 09:30:45,120::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' (0 active users) >Thread-34::DEBUG::2014-07-10 09:30:45,120::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-10 09:30:45,121::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', Clearing records. >Thread-34::DEBUG::2014-07-10 09:30:45,121::task::990::TaskManager.Task::(_decref) Task=`75c83c74-084e-432e-99d8-458574d39def`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 09:30:45,788::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:30:45,896::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0465611 s, 22.0 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-10 09:30:46,495::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/metadata bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-10 09:30:46,516::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.0008606 s, 4.8 MB/s\n'; <rc> = 0 >Thread-40::DEBUG::2014-07-10 09:30:47,268::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lion.qa.lab.tlv.redhat.com:_export_yuri2_backup2/6a70504d-00df-4869-8695-0f442053f6b6/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-40::DEBUG::2014-07-10 09:30:47,289::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n369 bytes (369 B) copied, 0.0005031 s, 733 kB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:30:47,913::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:30:48,007::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0359731 s, 28.5 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:30:50,022::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:30:50,109::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0265653 s, 38.5 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:30:52,125::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:30:52,223::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0365843 s, 28.0 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:30:54,238::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:30:54,335::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0398596 s, 25.7 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 09:30:55,159::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-14::DEBUG::2014-07-10 09:30:55,160::task::595::TaskManager.Task::(_updateState) Task=`f3265cac-38c3-43ed-a254-637e0936ebe5`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 09:30:55,161::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-14::INFO::2014-07-10 09:30:55,161::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:30:55,162::task::1185::TaskManager.Task::(prepare) Task=`f3265cac-38c3-43ed-a254-637e0936ebe5`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:30:55,162::task::595::TaskManager.Task::(_updateState) Task=`f3265cac-38c3-43ed-a254-637e0936ebe5`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 09:30:55,162::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 09:30:55,162::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 09:30:55,162::task::990::TaskManager.Task::(_decref) Task=`f3265cac-38c3-43ed-a254-637e0936ebe5`::ref 0 aborting False >Thread-34::DEBUG::2014-07-10 09:30:55,167::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-34::DEBUG::2014-07-10 09:30:55,167::task::595::TaskManager.Task::(_updateState) Task=`b4221bc0-b943-4be6-903b-c642921830e6`::moving from state init -> state preparing >Thread-34::INFO::2014-07-10 09:30:55,167::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-34::DEBUG::2014-07-10 09:30:55,168::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`a5eab36d-6e9a-4353-8b5b-e7c37833884e`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-10 09:30:55,168::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' for lock type 'shared' >Thread-34::DEBUG::2014-07-10 09:30:55,169::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-10 09:30:55,169::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`a5eab36d-6e9a-4353-8b5b-e7c37833884e`::Granted request >Thread-34::DEBUG::2014-07-10 09:30:55,169::task::827::TaskManager.Task::(resourceAcquired) Task=`b4221bc0-b943-4be6-903b-c642921830e6`::_resourcesAcquired: Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee (shared) >Thread-34::DEBUG::2014-07-10 09:30:55,170::task::990::TaskManager.Task::(_decref) Task=`b4221bc0-b943-4be6-903b-c642921830e6`::ref 1 aborting False >Thread-34::INFO::2014-07-10 09:30:55,171::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532067385344', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:30:55,171::task::1185::TaskManager.Task::(prepare) Task=`b4221bc0-b943-4be6-903b-c642921830e6`::finished: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532067385344', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:30:55,171::task::595::TaskManager.Task::(_updateState) Task=`b4221bc0-b943-4be6-903b-c642921830e6`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-10 09:30:55,172::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee': < ResourceRef 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-10 09:30:55,172::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-10 09:30:55,172::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' >Thread-34::DEBUG::2014-07-10 09:30:55,172::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' (0 active users) >Thread-34::DEBUG::2014-07-10 09:30:55,172::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-10 09:30:55,173::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', Clearing records. >Thread-34::DEBUG::2014-07-10 09:30:55,173::task::990::TaskManager.Task::(_decref) Task=`b4221bc0-b943-4be6-903b-c642921830e6`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 09:30:56,350::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:30:56,488::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0335922 s, 30.5 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-10 09:30:56,584::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/metadata bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-10 09:30:56,618::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000674864 s, 6.1 MB/s\n'; <rc> = 0 >Thread-64::DEBUG::2014-07-10 09:30:56,901::task::595::TaskManager.Task::(_updateState) Task=`951afa3e-499a-46aa-b6a2-21acd683808a`::moving from state init -> state preparing >Thread-64::INFO::2014-07-10 09:30:56,901::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='aa20346a-4d3a-4e07-b8e1-52c0ebe4168c', volUUID='58fefce2-9bce-4bff-8949-8c6ce8122b27', options=None) >Thread-64::INFO::2014-07-10 09:30:56,902::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-64::DEBUG::2014-07-10 09:30:56,902::task::1185::TaskManager.Task::(prepare) Task=`951afa3e-499a-46aa-b6a2-21acd683808a`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-64::DEBUG::2014-07-10 09:30:56,903::task::595::TaskManager.Task::(_updateState) Task=`951afa3e-499a-46aa-b6a2-21acd683808a`::moving from state preparing -> state finished >Thread-64::DEBUG::2014-07-10 09:30:56,903::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-64::DEBUG::2014-07-10 09:30:56,903::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-64::DEBUG::2014-07-10 09:30:56,904::task::990::TaskManager.Task::(_decref) Task=`951afa3e-499a-46aa-b6a2-21acd683808a`::ref 0 aborting False >Thread-40::DEBUG::2014-07-10 09:30:57,320::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lion.qa.lab.tlv.redhat.com:_export_yuri2_backup2/6a70504d-00df-4869-8695-0f442053f6b6/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-40::DEBUG::2014-07-10 09:30:57,341::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n369 bytes (369 B) copied, 0.000526017 s, 701 kB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 09:30:57,459::task::595::TaskManager.Task::(_updateState) Task=`de96f108-eaae-46ea-99b9-5e57f1f8cbcc`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 09:30:57,459::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::INFO::2014-07-10 09:30:57,459::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000674864', 'lastCheck': '0.8', 'valid': True}, '6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000526017', 'lastCheck': '0.1', 'valid': True}} >Thread-14::DEBUG::2014-07-10 09:30:57,460::task::1185::TaskManager.Task::(prepare) Task=`de96f108-eaae-46ea-99b9-5e57f1f8cbcc`::finished: {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000674864', 'lastCheck': '0.8', 'valid': True}, '6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000526017', 'lastCheck': '0.1', 'valid': True}} >Thread-14::DEBUG::2014-07-10 09:30:57,460::task::595::TaskManager.Task::(_updateState) Task=`de96f108-eaae-46ea-99b9-5e57f1f8cbcc`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 09:30:57,460::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 09:30:57,460::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 09:30:57,460::task::990::TaskManager.Task::(_decref) Task=`de96f108-eaae-46ea-99b9-5e57f1f8cbcc`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 09:30:58,511::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:30:58,600::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.029956 s, 34.2 MB/s\n'; <rc> = 0 >Thread-54::DEBUG::2014-07-10 09:30:58,968::task::595::TaskManager.Task::(_updateState) Task=`53271d14-9312-42e3-a6dd-864bcc92d302`::moving from state init -> state preparing >Thread-73::DEBUG::2014-07-10 09:30:58,970::task::595::TaskManager.Task::(_updateState) Task=`37943340-5e53-4c91-8019-b99d37997143`::moving from state init -> state preparing >Thread-54::INFO::2014-07-10 09:30:58,970::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='28408446-e5fd-4565-a976-e760951593fe', volUUID='776303a2-5585-451e-826e-0e338d4a1e98', options=None) >Thread-73::INFO::2014-07-10 09:30:58,972::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='c01d693b-cba0-4fed-9ad7-0aaa28912a19', volUUID='4bb5d954-2a50-4028-b299-0b43c261270c', options=None) >Thread-54::INFO::2014-07-10 09:30:58,972::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-54::DEBUG::2014-07-10 09:30:58,974::task::1185::TaskManager.Task::(prepare) Task=`53271d14-9312-42e3-a6dd-864bcc92d302`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-73::INFO::2014-07-10 09:30:58,974::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-54::DEBUG::2014-07-10 09:30:58,975::task::595::TaskManager.Task::(_updateState) Task=`53271d14-9312-42e3-a6dd-864bcc92d302`::moving from state preparing -> state finished >Thread-73::DEBUG::2014-07-10 09:30:58,976::task::1185::TaskManager.Task::(prepare) Task=`37943340-5e53-4c91-8019-b99d37997143`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-54::DEBUG::2014-07-10 09:30:58,976::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-73::DEBUG::2014-07-10 09:30:58,977::task::595::TaskManager.Task::(_updateState) Task=`37943340-5e53-4c91-8019-b99d37997143`::moving from state preparing -> state finished >Thread-54::DEBUG::2014-07-10 09:30:58,978::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-73::DEBUG::2014-07-10 09:30:58,978::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-54::DEBUG::2014-07-10 09:30:58,979::task::990::TaskManager.Task::(_decref) Task=`53271d14-9312-42e3-a6dd-864bcc92d302`::ref 0 aborting False >Thread-73::DEBUG::2014-07-10 09:30:58,979::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-73::DEBUG::2014-07-10 09:30:58,981::task::990::TaskManager.Task::(_decref) Task=`37943340-5e53-4c91-8019-b99d37997143`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 09:31:00,616::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:31:00,707::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0352952 s, 29.0 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:31:02,724::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:31:02,818::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0352552 s, 29.0 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:31:04,833::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:31:04,919::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0297001 s, 34.5 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 09:31:05,210::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-14::DEBUG::2014-07-10 09:31:05,211::task::595::TaskManager.Task::(_updateState) Task=`92949ed6-acdc-4d54-b85e-458c86ca9825`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 09:31:05,212::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-14::INFO::2014-07-10 09:31:05,212::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:31:05,212::task::1185::TaskManager.Task::(prepare) Task=`92949ed6-acdc-4d54-b85e-458c86ca9825`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:31:05,213::task::595::TaskManager.Task::(_updateState) Task=`92949ed6-acdc-4d54-b85e-458c86ca9825`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 09:31:05,213::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 09:31:05,213::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 09:31:05,213::task::990::TaskManager.Task::(_decref) Task=`92949ed6-acdc-4d54-b85e-458c86ca9825`::ref 0 aborting False >Thread-34::DEBUG::2014-07-10 09:31:05,217::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-34::DEBUG::2014-07-10 09:31:05,218::task::595::TaskManager.Task::(_updateState) Task=`0321a2d9-7690-4af4-b238-21fbfd24cacd`::moving from state init -> state preparing >Thread-34::INFO::2014-07-10 09:31:05,218::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-34::DEBUG::2014-07-10 09:31:05,219::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`9b35d5f8-5e67-4a15-b9ef-2c8104c9631d`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-10 09:31:05,219::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' for lock type 'shared' >Thread-34::DEBUG::2014-07-10 09:31:05,220::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-10 09:31:05,220::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`9b35d5f8-5e67-4a15-b9ef-2c8104c9631d`::Granted request >Thread-34::DEBUG::2014-07-10 09:31:05,220::task::827::TaskManager.Task::(resourceAcquired) Task=`0321a2d9-7690-4af4-b238-21fbfd24cacd`::_resourcesAcquired: Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee (shared) >Thread-34::DEBUG::2014-07-10 09:31:05,221::task::990::TaskManager.Task::(_decref) Task=`0321a2d9-7690-4af4-b238-21fbfd24cacd`::ref 1 aborting False >Thread-34::INFO::2014-07-10 09:31:05,222::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532067385344', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:31:05,222::task::1185::TaskManager.Task::(prepare) Task=`0321a2d9-7690-4af4-b238-21fbfd24cacd`::finished: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532067385344', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:31:05,222::task::595::TaskManager.Task::(_updateState) Task=`0321a2d9-7690-4af4-b238-21fbfd24cacd`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-10 09:31:05,222::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee': < ResourceRef 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-10 09:31:05,223::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-10 09:31:05,223::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' >Thread-34::DEBUG::2014-07-10 09:31:05,223::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' (0 active users) >Thread-34::DEBUG::2014-07-10 09:31:05,223::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-10 09:31:05,224::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', Clearing records. >Thread-34::DEBUG::2014-07-10 09:31:05,224::task::990::TaskManager.Task::(_decref) Task=`0321a2d9-7690-4af4-b238-21fbfd24cacd`::ref 0 aborting False >Thread-18::DEBUG::2014-07-10 09:31:06,647::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/metadata bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-10 09:31:06,669::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00110403 s, 3.7 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:31:06,934::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:31:07,061::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0698114 s, 14.7 MB/s\n'; <rc> = 0 >Thread-40::DEBUG::2014-07-10 09:31:07,373::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lion.qa.lab.tlv.redhat.com:_export_yuri2_backup2/6a70504d-00df-4869-8695-0f442053f6b6/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-40::DEBUG::2014-07-10 09:31:07,400::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n369 bytes (369 B) copied, 0.00046657 s, 791 kB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:31:09,079::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:31:09,166::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0289058 s, 35.4 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:31:11,205::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:31:11,324::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0625649 s, 16.4 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 09:31:12,622::task::595::TaskManager.Task::(_updateState) Task=`b4c21b80-b540-4f47-900b-b50767c4cf23`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 09:31:12,623::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::INFO::2014-07-10 09:31:12,623::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00110403', 'lastCheck': '5.9', 'valid': True}, '6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00046657', 'lastCheck': '5.2', 'valid': True}} >Thread-14::DEBUG::2014-07-10 09:31:12,623::task::1185::TaskManager.Task::(prepare) Task=`b4c21b80-b540-4f47-900b-b50767c4cf23`::finished: {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00110403', 'lastCheck': '5.9', 'valid': True}, '6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00046657', 'lastCheck': '5.2', 'valid': True}} >Thread-14::DEBUG::2014-07-10 09:31:12,624::task::595::TaskManager.Task::(_updateState) Task=`b4c21b80-b540-4f47-900b-b50767c4cf23`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 09:31:12,624::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 09:31:12,624::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 09:31:12,624::task::990::TaskManager.Task::(_decref) Task=`b4c21b80-b540-4f47-900b-b50767c4cf23`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 09:31:13,339::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:31:13,484::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0706878 s, 14.5 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 09:31:15,281::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-14::DEBUG::2014-07-10 09:31:15,282::task::595::TaskManager.Task::(_updateState) Task=`80df826c-1179-43f0-8700-86071cf297d0`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 09:31:15,282::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-14::INFO::2014-07-10 09:31:15,283::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:31:15,283::task::1185::TaskManager.Task::(prepare) Task=`80df826c-1179-43f0-8700-86071cf297d0`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:31:15,283::task::595::TaskManager.Task::(_updateState) Task=`80df826c-1179-43f0-8700-86071cf297d0`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 09:31:15,283::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 09:31:15,283::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 09:31:15,284::task::990::TaskManager.Task::(_decref) Task=`80df826c-1179-43f0-8700-86071cf297d0`::ref 0 aborting False >Thread-34::DEBUG::2014-07-10 09:31:15,327::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-34::DEBUG::2014-07-10 09:31:15,327::task::595::TaskManager.Task::(_updateState) Task=`743b7e45-a49c-440a-84e2-19ad5df75c31`::moving from state init -> state preparing >Thread-34::INFO::2014-07-10 09:31:15,328::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-34::DEBUG::2014-07-10 09:31:15,328::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`fcb1c46f-82fd-4a0c-b88a-49977db8fdaa`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-10 09:31:15,329::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' for lock type 'shared' >Thread-34::DEBUG::2014-07-10 09:31:15,329::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-10 09:31:15,329::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`fcb1c46f-82fd-4a0c-b88a-49977db8fdaa`::Granted request >Thread-34::DEBUG::2014-07-10 09:31:15,329::task::827::TaskManager.Task::(resourceAcquired) Task=`743b7e45-a49c-440a-84e2-19ad5df75c31`::_resourcesAcquired: Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee (shared) >Thread-34::DEBUG::2014-07-10 09:31:15,330::task::990::TaskManager.Task::(_decref) Task=`743b7e45-a49c-440a-84e2-19ad5df75c31`::ref 1 aborting False >Thread-34::INFO::2014-07-10 09:31:15,331::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532067385344', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:31:15,331::task::1185::TaskManager.Task::(prepare) Task=`743b7e45-a49c-440a-84e2-19ad5df75c31`::finished: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532067385344', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:31:15,331::task::595::TaskManager.Task::(_updateState) Task=`743b7e45-a49c-440a-84e2-19ad5df75c31`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-10 09:31:15,331::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee': < ResourceRef 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-10 09:31:15,331::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-10 09:31:15,332::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' >Thread-34::DEBUG::2014-07-10 09:31:15,332::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' (0 active users) >Thread-34::DEBUG::2014-07-10 09:31:15,332::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-10 09:31:15,332::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', Clearing records. >Thread-34::DEBUG::2014-07-10 09:31:15,332::task::990::TaskManager.Task::(_decref) Task=`743b7e45-a49c-440a-84e2-19ad5df75c31`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 09:31:15,500::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:31:15,587::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0293682 s, 34.9 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-10 09:31:16,698::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/metadata bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-10 09:31:16,721::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000748176 s, 5.5 MB/s\n'; <rc> = 0 >Thread-57::DEBUG::2014-07-10 09:31:16,996::task::595::TaskManager.Task::(_updateState) Task=`0b789d0c-c262-4132-aaa6-12a239edff95`::moving from state init -> state preparing >Thread-57::INFO::2014-07-10 09:31:16,996::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='b6f6c0da-e67f-4902-b9ac-3069571a42fe', volUUID='c4cd1da8-05b7-45e0-80b1-1183d21443d9', options=None) >Thread-57::INFO::2014-07-10 09:31:16,997::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-57::DEBUG::2014-07-10 09:31:16,997::task::1185::TaskManager.Task::(prepare) Task=`0b789d0c-c262-4132-aaa6-12a239edff95`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-57::DEBUG::2014-07-10 09:31:16,997::task::595::TaskManager.Task::(_updateState) Task=`0b789d0c-c262-4132-aaa6-12a239edff95`::moving from state preparing -> state finished >Thread-57::DEBUG::2014-07-10 09:31:16,997::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-57::DEBUG::2014-07-10 09:31:16,998::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-57::DEBUG::2014-07-10 09:31:16,998::task::990::TaskManager.Task::(_decref) Task=`0b789d0c-c262-4132-aaa6-12a239edff95`::ref 0 aborting False >Thread-40::DEBUG::2014-07-10 09:31:17,431::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lion.qa.lab.tlv.redhat.com:_export_yuri2_backup2/6a70504d-00df-4869-8695-0f442053f6b6/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-40::DEBUG::2014-07-10 09:31:17,467::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n369 bytes (369 B) copied, 0.000413358 s, 893 kB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:31:17,602::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:31:17,696::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0336553 s, 30.4 MB/s\n'; <rc> = 0 >Thread-67::DEBUG::2014-07-10 09:31:17,987::task::595::TaskManager.Task::(_updateState) Task=`ca2f0440-f3d1-443f-922d-b47d620051e5`::moving from state init -> state preparing >Thread-67::INFO::2014-07-10 09:31:17,987::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='f30c2cb7-a43a-4bf5-82b5-cfe07336f65c', volUUID='b0fbb3c9-55af-4a3a-95ad-fc56a80b9cf5', options=None) >Thread-67::INFO::2014-07-10 09:31:17,988::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-67::DEBUG::2014-07-10 09:31:17,988::task::1185::TaskManager.Task::(prepare) Task=`ca2f0440-f3d1-443f-922d-b47d620051e5`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-67::DEBUG::2014-07-10 09:31:17,988::task::595::TaskManager.Task::(_updateState) Task=`ca2f0440-f3d1-443f-922d-b47d620051e5`::moving from state preparing -> state finished >Thread-67::DEBUG::2014-07-10 09:31:17,989::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-67::DEBUG::2014-07-10 09:31:17,989::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-67::DEBUG::2014-07-10 09:31:17,989::task::990::TaskManager.Task::(_decref) Task=`ca2f0440-f3d1-443f-922d-b47d620051e5`::ref 0 aborting False >Thread-48::DEBUG::2014-07-10 09:31:18,540::task::595::TaskManager.Task::(_updateState) Task=`23fd3ab0-13d9-4076-a4c8-e752ef409fec`::moving from state init -> state preparing >Thread-48::INFO::2014-07-10 09:31:18,541::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='0cd7d6ce-f497-4243-a690-c57744861eea', volUUID='10b6a7dd-dc6c-43fa-ba17-92e4331b0e0b', options=None) >Thread-48::INFO::2014-07-10 09:31:18,541::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-48::DEBUG::2014-07-10 09:31:18,542::task::1185::TaskManager.Task::(prepare) Task=`23fd3ab0-13d9-4076-a4c8-e752ef409fec`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-48::DEBUG::2014-07-10 09:31:18,542::task::595::TaskManager.Task::(_updateState) Task=`23fd3ab0-13d9-4076-a4c8-e752ef409fec`::moving from state preparing -> state finished >Thread-48::DEBUG::2014-07-10 09:31:18,542::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-48::DEBUG::2014-07-10 09:31:18,542::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-48::DEBUG::2014-07-10 09:31:18,542::task::990::TaskManager.Task::(_decref) Task=`23fd3ab0-13d9-4076-a4c8-e752ef409fec`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 09:31:19,712::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:31:19,800::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0272288 s, 37.6 MB/s\n'; <rc> = 0 >Thread-76::DEBUG::2014-07-10 09:31:19,877::task::595::TaskManager.Task::(_updateState) Task=`12a9d2b6-7cb5-4d0e-9a56-5feb8a6aa6d4`::moving from state init -> state preparing >Thread-76::INFO::2014-07-10 09:31:19,878::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='e4c65229-4247-4b33-b72a-f1d5ce72ad05', volUUID='cad94284-3ca9-4c30-933d-997f4460309e', options=None) >Thread-76::INFO::2014-07-10 09:31:19,878::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-76::DEBUG::2014-07-10 09:31:19,878::task::1185::TaskManager.Task::(prepare) Task=`12a9d2b6-7cb5-4d0e-9a56-5feb8a6aa6d4`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-76::DEBUG::2014-07-10 09:31:19,879::task::595::TaskManager.Task::(_updateState) Task=`12a9d2b6-7cb5-4d0e-9a56-5feb8a6aa6d4`::moving from state preparing -> state finished >Thread-76::DEBUG::2014-07-10 09:31:19,879::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-76::DEBUG::2014-07-10 09:31:19,879::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-76::DEBUG::2014-07-10 09:31:19,879::task::990::TaskManager.Task::(_decref) Task=`12a9d2b6-7cb5-4d0e-9a56-5feb8a6aa6d4`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 09:31:21,815::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:31:21,909::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0361758 s, 28.3 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:31:23,924::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:31:24,022::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0377627 s, 27.1 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 09:31:25,367::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-14::DEBUG::2014-07-10 09:31:25,368::task::595::TaskManager.Task::(_updateState) Task=`a59fbae2-33d1-40fa-bb14-128d1a783d0b`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 09:31:25,369::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-14::INFO::2014-07-10 09:31:25,369::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:31:25,369::task::1185::TaskManager.Task::(prepare) Task=`a59fbae2-33d1-40fa-bb14-128d1a783d0b`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:31:25,370::task::595::TaskManager.Task::(_updateState) Task=`a59fbae2-33d1-40fa-bb14-128d1a783d0b`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 09:31:25,370::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 09:31:25,370::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 09:31:25,370::task::990::TaskManager.Task::(_decref) Task=`a59fbae2-33d1-40fa-bb14-128d1a783d0b`::ref 0 aborting False >Thread-34::DEBUG::2014-07-10 09:31:25,374::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-34::DEBUG::2014-07-10 09:31:25,375::task::595::TaskManager.Task::(_updateState) Task=`1691af0b-a090-422b-81ab-f478d04fb4fe`::moving from state init -> state preparing >Thread-34::INFO::2014-07-10 09:31:25,375::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-34::DEBUG::2014-07-10 09:31:25,376::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`a946bf49-668b-494e-b6af-38e6c1216a75`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-10 09:31:25,376::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' for lock type 'shared' >Thread-34::DEBUG::2014-07-10 09:31:25,376::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-10 09:31:25,376::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`a946bf49-668b-494e-b6af-38e6c1216a75`::Granted request >Thread-34::DEBUG::2014-07-10 09:31:25,377::task::827::TaskManager.Task::(resourceAcquired) Task=`1691af0b-a090-422b-81ab-f478d04fb4fe`::_resourcesAcquired: Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee (shared) >Thread-34::DEBUG::2014-07-10 09:31:25,377::task::990::TaskManager.Task::(_decref) Task=`1691af0b-a090-422b-81ab-f478d04fb4fe`::ref 1 aborting False >Thread-34::INFO::2014-07-10 09:31:25,378::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532067385344', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:31:25,379::task::1185::TaskManager.Task::(prepare) Task=`1691af0b-a090-422b-81ab-f478d04fb4fe`::finished: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532067385344', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:31:25,379::task::595::TaskManager.Task::(_updateState) Task=`1691af0b-a090-422b-81ab-f478d04fb4fe`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-10 09:31:25,379::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee': < ResourceRef 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-10 09:31:25,379::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-10 09:31:25,379::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' >Thread-34::DEBUG::2014-07-10 09:31:25,380::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' (0 active users) >Thread-34::DEBUG::2014-07-10 09:31:25,380::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-10 09:31:25,380::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', Clearing records. >Thread-34::DEBUG::2014-07-10 09:31:25,380::task::990::TaskManager.Task::(_decref) Task=`1691af0b-a090-422b-81ab-f478d04fb4fe`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 09:31:26,037::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:31:26,126::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0302749 s, 33.8 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-10 09:31:26,750::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/metadata bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-10 09:31:26,773::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000860053 s, 4.8 MB/s\n'; <rc> = 0 >Thread-40::DEBUG::2014-07-10 09:31:27,500::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lion.qa.lab.tlv.redhat.com:_export_yuri2_backup2/6a70504d-00df-4869-8695-0f442053f6b6/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-40::DEBUG::2014-07-10 09:31:27,521::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n369 bytes (369 B) copied, 0.000649961 s, 568 kB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 09:31:27,805::task::595::TaskManager.Task::(_updateState) Task=`5a1f7ba0-0914-4db3-af32-547e28fa9460`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 09:31:27,806::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::INFO::2014-07-10 09:31:27,806::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000860053', 'lastCheck': '1.0', 'valid': True}, '6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000649961', 'lastCheck': '0.3', 'valid': True}} >Thread-14::DEBUG::2014-07-10 09:31:27,806::task::1185::TaskManager.Task::(prepare) Task=`5a1f7ba0-0914-4db3-af32-547e28fa9460`::finished: {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000860053', 'lastCheck': '1.0', 'valid': True}, '6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000649961', 'lastCheck': '0.3', 'valid': True}} >Thread-14::DEBUG::2014-07-10 09:31:27,806::task::595::TaskManager.Task::(_updateState) Task=`5a1f7ba0-0914-4db3-af32-547e28fa9460`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 09:31:27,807::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 09:31:27,807::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 09:31:27,807::task::990::TaskManager.Task::(_decref) Task=`5a1f7ba0-0914-4db3-af32-547e28fa9460`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 09:31:28,142::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:31:28,241::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0370218 s, 27.7 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:31:30,256::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:31:30,342::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0298178 s, 34.3 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:31:32,357::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:31:32,444::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0302216 s, 33.9 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:31:34,460::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:31:34,558::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0384082 s, 26.7 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 09:31:35,410::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-14::DEBUG::2014-07-10 09:31:35,411::task::595::TaskManager.Task::(_updateState) Task=`8bc9908c-e4b9-4879-a06c-11aa5ab722c4`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 09:31:35,411::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-14::INFO::2014-07-10 09:31:35,412::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:31:35,412::task::1185::TaskManager.Task::(prepare) Task=`8bc9908c-e4b9-4879-a06c-11aa5ab722c4`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:31:35,412::task::595::TaskManager.Task::(_updateState) Task=`8bc9908c-e4b9-4879-a06c-11aa5ab722c4`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 09:31:35,412::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 09:31:35,413::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 09:31:35,413::task::990::TaskManager.Task::(_decref) Task=`8bc9908c-e4b9-4879-a06c-11aa5ab722c4`::ref 0 aborting False >Thread-34::DEBUG::2014-07-10 09:31:35,417::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-34::DEBUG::2014-07-10 09:31:35,417::task::595::TaskManager.Task::(_updateState) Task=`215810e6-30d7-4ee5-8893-a36a9c66cf52`::moving from state init -> state preparing >Thread-34::INFO::2014-07-10 09:31:35,418::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-34::DEBUG::2014-07-10 09:31:35,418::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`0dfdf897-0ef1-4991-a12c-3d063125bfb6`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-10 09:31:35,418::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' for lock type 'shared' >Thread-34::DEBUG::2014-07-10 09:31:35,419::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-10 09:31:35,419::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`0dfdf897-0ef1-4991-a12c-3d063125bfb6`::Granted request >Thread-34::DEBUG::2014-07-10 09:31:35,419::task::827::TaskManager.Task::(resourceAcquired) Task=`215810e6-30d7-4ee5-8893-a36a9c66cf52`::_resourcesAcquired: Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee (shared) >Thread-34::DEBUG::2014-07-10 09:31:35,420::task::990::TaskManager.Task::(_decref) Task=`215810e6-30d7-4ee5-8893-a36a9c66cf52`::ref 1 aborting False >Thread-34::INFO::2014-07-10 09:31:35,421::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532067385344', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:31:35,421::task::1185::TaskManager.Task::(prepare) Task=`215810e6-30d7-4ee5-8893-a36a9c66cf52`::finished: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532067385344', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:31:35,421::task::595::TaskManager.Task::(_updateState) Task=`215810e6-30d7-4ee5-8893-a36a9c66cf52`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-10 09:31:35,421::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee': < ResourceRef 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-10 09:31:35,421::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-10 09:31:35,421::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' >Thread-34::DEBUG::2014-07-10 09:31:35,422::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' (0 active users) >Thread-34::DEBUG::2014-07-10 09:31:35,422::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-10 09:31:35,422::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', Clearing records. >Thread-34::DEBUG::2014-07-10 09:31:35,422::task::990::TaskManager.Task::(_decref) Task=`215810e6-30d7-4ee5-8893-a36a9c66cf52`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 09:31:36,567::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:31:36,650::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0253283 s, 40.4 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-10 09:31:36,802::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/metadata bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-10 09:31:36,824::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000880675 s, 4.7 MB/s\n'; <rc> = 0 >Thread-70::DEBUG::2014-07-10 09:31:37,080::task::595::TaskManager.Task::(_updateState) Task=`96881199-e936-4ab9-a16b-00fbb305c215`::moving from state init -> state preparing >Thread-70::INFO::2014-07-10 09:31:37,080::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='cfaeead2-7caa-467c-b389-c89840ae6605', volUUID='567fe32d-31a6-4ff6-90f3-fd6a656fbecc', options=None) >Thread-70::INFO::2014-07-10 09:31:37,081::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-70::DEBUG::2014-07-10 09:31:37,081::task::1185::TaskManager.Task::(prepare) Task=`96881199-e936-4ab9-a16b-00fbb305c215`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-70::DEBUG::2014-07-10 09:31:37,081::task::595::TaskManager.Task::(_updateState) Task=`96881199-e936-4ab9-a16b-00fbb305c215`::moving from state preparing -> state finished >Thread-70::DEBUG::2014-07-10 09:31:37,081::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-70::DEBUG::2014-07-10 09:31:37,082::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-70::DEBUG::2014-07-10 09:31:37,082::task::990::TaskManager.Task::(_decref) Task=`96881199-e936-4ab9-a16b-00fbb305c215`::ref 0 aborting False >Thread-40::DEBUG::2014-07-10 09:31:37,580::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lion.qa.lab.tlv.redhat.com:_export_yuri2_backup2/6a70504d-00df-4869-8695-0f442053f6b6/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-40::DEBUG::2014-07-10 09:31:37,604::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n369 bytes (369 B) copied, 0.000500045 s, 738 kB/s\n'; <rc> = 0 >Thread-60::DEBUG::2014-07-10 09:31:38,063::task::595::TaskManager.Task::(_updateState) Task=`5fa18f8e-a991-4e10-80ef-1eb6d7eca860`::moving from state init -> state preparing >Thread-60::INFO::2014-07-10 09:31:38,063::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='b034d5b0-e1e0-4011-b49b-4d45ddb11556', volUUID='3d7f62b5-328f-4d8e-8b69-873cfb5ae14d', options=None) >Thread-60::INFO::2014-07-10 09:31:38,064::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-60::DEBUG::2014-07-10 09:31:38,064::task::1185::TaskManager.Task::(prepare) Task=`5fa18f8e-a991-4e10-80ef-1eb6d7eca860`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-60::DEBUG::2014-07-10 09:31:38,064::task::595::TaskManager.Task::(_updateState) Task=`5fa18f8e-a991-4e10-80ef-1eb6d7eca860`::moving from state preparing -> state finished >Thread-60::DEBUG::2014-07-10 09:31:38,064::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-60::DEBUG::2014-07-10 09:31:38,065::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-60::DEBUG::2014-07-10 09:31:38,065::task::990::TaskManager.Task::(_decref) Task=`5fa18f8e-a991-4e10-80ef-1eb6d7eca860`::ref 0 aborting False >Thread-51::DEBUG::2014-07-10 09:31:38,101::task::595::TaskManager.Task::(_updateState) Task=`e2dc1cc5-846a-487b-ac35-a6d57382f178`::moving from state init -> state preparing >Thread-51::INFO::2014-07-10 09:31:38,102::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='76fdb054-02cd-42ed-9721-b3e65b34c3a4', volUUID='022dfe46-2cf7-4915-80b3-883158e3ca83', options=None) >Thread-51::INFO::2014-07-10 09:31:38,102::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-51::DEBUG::2014-07-10 09:31:38,102::task::1185::TaskManager.Task::(prepare) Task=`e2dc1cc5-846a-487b-ac35-a6d57382f178`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-51::DEBUG::2014-07-10 09:31:38,102::task::595::TaskManager.Task::(_updateState) Task=`e2dc1cc5-846a-487b-ac35-a6d57382f178`::moving from state preparing -> state finished >Thread-51::DEBUG::2014-07-10 09:31:38,103::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-51::DEBUG::2014-07-10 09:31:38,103::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-51::DEBUG::2014-07-10 09:31:38,103::task::990::TaskManager.Task::(_decref) Task=`e2dc1cc5-846a-487b-ac35-a6d57382f178`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 09:31:38,668::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:31:38,771::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0351106 s, 29.2 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:31:40,794::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:31:40,883::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0301911 s, 33.9 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:31:42,900::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:31:42,992::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.035988 s, 28.5 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 09:31:43,015::task::595::TaskManager.Task::(_updateState) Task=`c72e06d7-575c-4b03-bff3-24a9766dee17`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 09:31:43,018::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::INFO::2014-07-10 09:31:43,021::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000880675', 'lastCheck': '6.2', 'valid': True}, '6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000500045', 'lastCheck': '5.4', 'valid': True}} >Thread-14::DEBUG::2014-07-10 09:31:43,022::task::1185::TaskManager.Task::(prepare) Task=`c72e06d7-575c-4b03-bff3-24a9766dee17`::finished: {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000880675', 'lastCheck': '6.2', 'valid': True}, '6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000500045', 'lastCheck': '5.4', 'valid': True}} >Thread-14::DEBUG::2014-07-10 09:31:43,024::task::595::TaskManager.Task::(_updateState) Task=`c72e06d7-575c-4b03-bff3-24a9766dee17`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 09:31:43,026::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 09:31:43,027::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 09:31:43,029::task::990::TaskManager.Task::(_decref) Task=`c72e06d7-575c-4b03-bff3-24a9766dee17`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 09:31:45,056::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:31:45,157::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0353845 s, 28.9 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 09:31:45,460::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-14::DEBUG::2014-07-10 09:31:45,461::task::595::TaskManager.Task::(_updateState) Task=`4e4058b9-83d9-44c8-b7ac-52801e884383`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 09:31:45,462::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-14::INFO::2014-07-10 09:31:45,462::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:31:45,463::task::1185::TaskManager.Task::(prepare) Task=`4e4058b9-83d9-44c8-b7ac-52801e884383`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:31:45,463::task::595::TaskManager.Task::(_updateState) Task=`4e4058b9-83d9-44c8-b7ac-52801e884383`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 09:31:45,463::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 09:31:45,463::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 09:31:45,463::task::990::TaskManager.Task::(_decref) Task=`4e4058b9-83d9-44c8-b7ac-52801e884383`::ref 0 aborting False >Thread-34::DEBUG::2014-07-10 09:31:45,507::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-34::DEBUG::2014-07-10 09:31:45,507::task::595::TaskManager.Task::(_updateState) Task=`018b23bf-0fed-47e6-a850-a0e16a266418`::moving from state init -> state preparing >Thread-34::INFO::2014-07-10 09:31:45,508::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-34::DEBUG::2014-07-10 09:31:45,508::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`718816fb-810b-48da-a60e-d5dfb731bd50`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-10 09:31:45,509::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' for lock type 'shared' >Thread-34::DEBUG::2014-07-10 09:31:45,509::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-10 09:31:45,509::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`718816fb-810b-48da-a60e-d5dfb731bd50`::Granted request >Thread-34::DEBUG::2014-07-10 09:31:45,510::task::827::TaskManager.Task::(resourceAcquired) Task=`018b23bf-0fed-47e6-a850-a0e16a266418`::_resourcesAcquired: Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee (shared) >Thread-34::DEBUG::2014-07-10 09:31:45,510::task::990::TaskManager.Task::(_decref) Task=`018b23bf-0fed-47e6-a850-a0e16a266418`::ref 1 aborting False >Thread-34::INFO::2014-07-10 09:31:45,511::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532067385344', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:31:45,511::task::1185::TaskManager.Task::(prepare) Task=`018b23bf-0fed-47e6-a850-a0e16a266418`::finished: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532067385344', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:31:45,512::task::595::TaskManager.Task::(_updateState) Task=`018b23bf-0fed-47e6-a850-a0e16a266418`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-10 09:31:45,512::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee': < ResourceRef 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-10 09:31:45,512::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-10 09:31:45,512::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' >Thread-34::DEBUG::2014-07-10 09:31:45,512::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' (0 active users) >Thread-34::DEBUG::2014-07-10 09:31:45,513::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-10 09:31:45,513::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', Clearing records. >Thread-34::DEBUG::2014-07-10 09:31:45,513::task::990::TaskManager.Task::(_decref) Task=`018b23bf-0fed-47e6-a850-a0e16a266418`::ref 0 aborting False >Thread-18::DEBUG::2014-07-10 09:31:46,852::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/metadata bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-10 09:31:46,876::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000794551 s, 5.2 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:31:47,173::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:31:47,291::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0580067 s, 17.7 MB/s\n'; <rc> = 0 >Thread-40::DEBUG::2014-07-10 09:31:47,638::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lion.qa.lab.tlv.redhat.com:_export_yuri2_backup2/6a70504d-00df-4869-8695-0f442053f6b6/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-40::DEBUG::2014-07-10 09:31:47,657::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n369 bytes (369 B) copied, 0.000507976 s, 726 kB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:31:49,306::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:31:49,402::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0357738 s, 28.6 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:31:51,418::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:31:51,514::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.025453 s, 40.2 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:31:53,528::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:31:53,616::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0302478 s, 33.9 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 09:31:55,542::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-14::DEBUG::2014-07-10 09:31:55,543::task::595::TaskManager.Task::(_updateState) Task=`3f61ad75-6d82-44d5-8743-71e148d06a6e`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 09:31:55,544::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-14::INFO::2014-07-10 09:31:55,544::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:31:55,545::task::1185::TaskManager.Task::(prepare) Task=`3f61ad75-6d82-44d5-8743-71e148d06a6e`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:31:55,545::task::595::TaskManager.Task::(_updateState) Task=`3f61ad75-6d82-44d5-8743-71e148d06a6e`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 09:31:55,545::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 09:31:55,545::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 09:31:55,545::task::990::TaskManager.Task::(_decref) Task=`3f61ad75-6d82-44d5-8743-71e148d06a6e`::ref 0 aborting False >Thread-34::DEBUG::2014-07-10 09:31:55,549::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-34::DEBUG::2014-07-10 09:31:55,550::task::595::TaskManager.Task::(_updateState) Task=`cbd088e8-fc4c-4b53-bcc8-8b5a56592009`::moving from state init -> state preparing >Thread-34::INFO::2014-07-10 09:31:55,550::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-34::DEBUG::2014-07-10 09:31:55,551::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`1f6784e1-0b0b-41f9-ae9d-5cef715b2c4d`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-10 09:31:55,551::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' for lock type 'shared' >Thread-34::DEBUG::2014-07-10 09:31:55,551::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-10 09:31:55,552::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`1f6784e1-0b0b-41f9-ae9d-5cef715b2c4d`::Granted request >Thread-34::DEBUG::2014-07-10 09:31:55,552::task::827::TaskManager.Task::(resourceAcquired) Task=`cbd088e8-fc4c-4b53-bcc8-8b5a56592009`::_resourcesAcquired: Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee (shared) >Thread-34::DEBUG::2014-07-10 09:31:55,552::task::990::TaskManager.Task::(_decref) Task=`cbd088e8-fc4c-4b53-bcc8-8b5a56592009`::ref 1 aborting False >Thread-34::INFO::2014-07-10 09:31:55,554::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532067385344', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:31:55,554::task::1185::TaskManager.Task::(prepare) Task=`cbd088e8-fc4c-4b53-bcc8-8b5a56592009`::finished: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532067385344', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:31:55,554::task::595::TaskManager.Task::(_updateState) Task=`cbd088e8-fc4c-4b53-bcc8-8b5a56592009`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-10 09:31:55,554::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee': < ResourceRef 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-10 09:31:55,554::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-10 09:31:55,555::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' >Thread-34::DEBUG::2014-07-10 09:31:55,555::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' (0 active users) >Thread-34::DEBUG::2014-07-10 09:31:55,555::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-10 09:31:55,555::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', Clearing records. >Thread-34::DEBUG::2014-07-10 09:31:55,555::task::990::TaskManager.Task::(_decref) Task=`cbd088e8-fc4c-4b53-bcc8-8b5a56592009`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 09:31:55,632::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:31:55,721::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0302626 s, 33.8 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-10 09:31:56,906::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/metadata bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-10 09:31:56,928::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000768558 s, 5.3 MB/s\n'; <rc> = 0 >Thread-64::DEBUG::2014-07-10 09:31:57,182::task::595::TaskManager.Task::(_updateState) Task=`ecb3c991-7b6b-4117-850d-4097a110fd12`::moving from state init -> state preparing >Thread-64::INFO::2014-07-10 09:31:57,183::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='aa20346a-4d3a-4e07-b8e1-52c0ebe4168c', volUUID='58fefce2-9bce-4bff-8949-8c6ce8122b27', options=None) >Thread-64::INFO::2014-07-10 09:31:57,184::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-64::DEBUG::2014-07-10 09:31:57,184::task::1185::TaskManager.Task::(prepare) Task=`ecb3c991-7b6b-4117-850d-4097a110fd12`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-64::DEBUG::2014-07-10 09:31:57,184::task::595::TaskManager.Task::(_updateState) Task=`ecb3c991-7b6b-4117-850d-4097a110fd12`::moving from state preparing -> state finished >Thread-64::DEBUG::2014-07-10 09:31:57,184::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-64::DEBUG::2014-07-10 09:31:57,184::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-64::DEBUG::2014-07-10 09:31:57,185::task::990::TaskManager.Task::(_decref) Task=`ecb3c991-7b6b-4117-850d-4097a110fd12`::ref 0 aborting False >Thread-40::DEBUG::2014-07-10 09:31:57,688::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lion.qa.lab.tlv.redhat.com:_export_yuri2_backup2/6a70504d-00df-4869-8695-0f442053f6b6/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-40::DEBUG::2014-07-10 09:31:57,708::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n369 bytes (369 B) copied, 0.000419789 s, 879 kB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:31:57,736::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:31:57,872::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0363798 s, 28.1 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 09:31:58,287::task::595::TaskManager.Task::(_updateState) Task=`c2a2217a-675d-44ad-820f-05f395e84289`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 09:31:58,287::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::INFO::2014-07-10 09:31:58,288::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000768558', 'lastCheck': '1.3', 'valid': True}, '6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000419789', 'lastCheck': '0.6', 'valid': True}} >Thread-14::DEBUG::2014-07-10 09:31:58,288::task::1185::TaskManager.Task::(prepare) Task=`c2a2217a-675d-44ad-820f-05f395e84289`::finished: {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000768558', 'lastCheck': '1.3', 'valid': True}, '6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000419789', 'lastCheck': '0.6', 'valid': True}} >Thread-14::DEBUG::2014-07-10 09:31:58,288::task::595::TaskManager.Task::(_updateState) Task=`c2a2217a-675d-44ad-820f-05f395e84289`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 09:31:58,288::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 09:31:58,288::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 09:31:58,289::task::990::TaskManager.Task::(_decref) Task=`c2a2217a-675d-44ad-820f-05f395e84289`::ref 0 aborting False >Thread-54::DEBUG::2014-07-10 09:31:59,277::task::595::TaskManager.Task::(_updateState) Task=`4a5ee3bd-9044-434b-8477-3a1d95f6a983`::moving from state init -> state preparing >Thread-54::INFO::2014-07-10 09:31:59,278::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='28408446-e5fd-4565-a976-e760951593fe', volUUID='776303a2-5585-451e-826e-0e338d4a1e98', options=None) >Thread-73::DEBUG::2014-07-10 09:31:59,279::task::595::TaskManager.Task::(_updateState) Task=`9ddcdc06-6091-45f9-aff2-f28efd41bf14`::moving from state init -> state preparing >Thread-54::INFO::2014-07-10 09:31:59,281::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-73::INFO::2014-07-10 09:31:59,282::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='c01d693b-cba0-4fed-9ad7-0aaa28912a19', volUUID='4bb5d954-2a50-4028-b299-0b43c261270c', options=None) >Thread-54::DEBUG::2014-07-10 09:31:59,282::task::1185::TaskManager.Task::(prepare) Task=`4a5ee3bd-9044-434b-8477-3a1d95f6a983`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-54::DEBUG::2014-07-10 09:31:59,284::task::595::TaskManager.Task::(_updateState) Task=`4a5ee3bd-9044-434b-8477-3a1d95f6a983`::moving from state preparing -> state finished >Thread-73::INFO::2014-07-10 09:31:59,285::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-54::DEBUG::2014-07-10 09:31:59,285::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-73::DEBUG::2014-07-10 09:31:59,286::task::1185::TaskManager.Task::(prepare) Task=`9ddcdc06-6091-45f9-aff2-f28efd41bf14`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-54::DEBUG::2014-07-10 09:31:59,287::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-73::DEBUG::2014-07-10 09:31:59,288::task::595::TaskManager.Task::(_updateState) Task=`9ddcdc06-6091-45f9-aff2-f28efd41bf14`::moving from state preparing -> state finished >Thread-54::DEBUG::2014-07-10 09:31:59,289::task::990::TaskManager.Task::(_decref) Task=`4a5ee3bd-9044-434b-8477-3a1d95f6a983`::ref 0 aborting False >Thread-73::DEBUG::2014-07-10 09:31:59,290::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-73::DEBUG::2014-07-10 09:31:59,291::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-73::DEBUG::2014-07-10 09:31:59,291::task::990::TaskManager.Task::(_decref) Task=`9ddcdc06-6091-45f9-aff2-f28efd41bf14`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 09:31:59,903::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:32:00,007::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0444478 s, 23.0 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:32:02,022::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:32:02,146::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0297421 s, 34.4 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:32:04,162::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:32:04,298::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0579448 s, 17.7 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 09:32:05,593::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-14::DEBUG::2014-07-10 09:32:05,594::task::595::TaskManager.Task::(_updateState) Task=`dd11527e-7ceb-4ac6-b3b4-36defa795f4d`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 09:32:05,594::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-14::INFO::2014-07-10 09:32:05,595::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:32:05,595::task::1185::TaskManager.Task::(prepare) Task=`dd11527e-7ceb-4ac6-b3b4-36defa795f4d`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:32:05,595::task::595::TaskManager.Task::(_updateState) Task=`dd11527e-7ceb-4ac6-b3b4-36defa795f4d`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 09:32:05,595::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 09:32:05,595::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 09:32:05,596::task::990::TaskManager.Task::(_decref) Task=`dd11527e-7ceb-4ac6-b3b4-36defa795f4d`::ref 0 aborting False >Thread-34::DEBUG::2014-07-10 09:32:05,600::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-34::DEBUG::2014-07-10 09:32:05,600::task::595::TaskManager.Task::(_updateState) Task=`81164693-002f-48e7-86ec-876b0df9965e`::moving from state init -> state preparing >Thread-34::INFO::2014-07-10 09:32:05,600::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-34::DEBUG::2014-07-10 09:32:05,601::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`1eedf820-9a30-40f9-a0be-8b6762c34649`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-10 09:32:05,601::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' for lock type 'shared' >Thread-34::DEBUG::2014-07-10 09:32:05,601::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-10 09:32:05,602::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`1eedf820-9a30-40f9-a0be-8b6762c34649`::Granted request >Thread-34::DEBUG::2014-07-10 09:32:05,602::task::827::TaskManager.Task::(resourceAcquired) Task=`81164693-002f-48e7-86ec-876b0df9965e`::_resourcesAcquired: Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee (shared) >Thread-34::DEBUG::2014-07-10 09:32:05,602::task::990::TaskManager.Task::(_decref) Task=`81164693-002f-48e7-86ec-876b0df9965e`::ref 1 aborting False >Thread-34::INFO::2014-07-10 09:32:05,603::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532067385344', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:32:05,603::task::1185::TaskManager.Task::(prepare) Task=`81164693-002f-48e7-86ec-876b0df9965e`::finished: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532067385344', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:32:05,604::task::595::TaskManager.Task::(_updateState) Task=`81164693-002f-48e7-86ec-876b0df9965e`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-10 09:32:05,604::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee': < ResourceRef 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-10 09:32:05,604::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-10 09:32:05,604::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' >Thread-34::DEBUG::2014-07-10 09:32:05,604::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' (0 active users) >Thread-34::DEBUG::2014-07-10 09:32:05,605::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-10 09:32:05,605::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', Clearing records. >Thread-34::DEBUG::2014-07-10 09:32:05,605::task::990::TaskManager.Task::(_decref) Task=`81164693-002f-48e7-86ec-876b0df9965e`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 09:32:06,313::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:32:06,401::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0305813 s, 33.5 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-10 09:32:06,957::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/metadata bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-10 09:32:06,978::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000746365 s, 5.5 MB/s\n'; <rc> = 0 >Thread-40::DEBUG::2014-07-10 09:32:07,733::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lion.qa.lab.tlv.redhat.com:_export_yuri2_backup2/6a70504d-00df-4869-8695-0f442053f6b6/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-40::DEBUG::2014-07-10 09:32:07,756::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n369 bytes (369 B) copied, 0.000461525 s, 800 kB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:32:08,420::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:32:08,513::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0355981 s, 28.8 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:32:10,529::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:32:10,616::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0354114 s, 28.9 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:32:12,626::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:32:12,714::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0277259 s, 36.9 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 09:32:13,471::task::595::TaskManager.Task::(_updateState) Task=`dde383c9-60be-476e-8e0b-ed4037e1ecba`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 09:32:13,472::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::INFO::2014-07-10 09:32:13,473::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000746365', 'lastCheck': '6.5', 'valid': True}, '6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000461525', 'lastCheck': '5.7', 'valid': True}} >Thread-14::DEBUG::2014-07-10 09:32:13,473::task::1185::TaskManager.Task::(prepare) Task=`dde383c9-60be-476e-8e0b-ed4037e1ecba`::finished: {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000746365', 'lastCheck': '6.5', 'valid': True}, '6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000461525', 'lastCheck': '5.7', 'valid': True}} >Thread-14::DEBUG::2014-07-10 09:32:13,473::task::595::TaskManager.Task::(_updateState) Task=`dde383c9-60be-476e-8e0b-ed4037e1ecba`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 09:32:13,473::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 09:32:13,473::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 09:32:13,474::task::990::TaskManager.Task::(_decref) Task=`dde383c9-60be-476e-8e0b-ed4037e1ecba`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 09:32:14,729::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:32:14,827::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0352385 s, 29.1 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 09:32:15,643::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-14::DEBUG::2014-07-10 09:32:15,644::task::595::TaskManager.Task::(_updateState) Task=`0f35776c-dd3f-487b-800b-25b5f6728775`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 09:32:15,644::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-14::INFO::2014-07-10 09:32:15,645::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:32:15,645::task::1185::TaskManager.Task::(prepare) Task=`0f35776c-dd3f-487b-800b-25b5f6728775`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:32:15,645::task::595::TaskManager.Task::(_updateState) Task=`0f35776c-dd3f-487b-800b-25b5f6728775`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 09:32:15,645::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 09:32:15,646::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 09:32:15,646::task::990::TaskManager.Task::(_decref) Task=`0f35776c-dd3f-487b-800b-25b5f6728775`::ref 0 aborting False >Thread-34::DEBUG::2014-07-10 09:32:15,650::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-34::DEBUG::2014-07-10 09:32:15,651::task::595::TaskManager.Task::(_updateState) Task=`bf082c61-94be-4752-a86d-592c18b5d707`::moving from state init -> state preparing >Thread-34::INFO::2014-07-10 09:32:15,651::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-34::DEBUG::2014-07-10 09:32:15,652::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`f5cfef09-43ca-49b6-8550-d2c78bf7d61d`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-10 09:32:15,652::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' for lock type 'shared' >Thread-34::DEBUG::2014-07-10 09:32:15,652::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-10 09:32:15,652::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`f5cfef09-43ca-49b6-8550-d2c78bf7d61d`::Granted request >Thread-34::DEBUG::2014-07-10 09:32:15,653::task::827::TaskManager.Task::(resourceAcquired) Task=`bf082c61-94be-4752-a86d-592c18b5d707`::_resourcesAcquired: Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee (shared) >Thread-34::DEBUG::2014-07-10 09:32:15,653::task::990::TaskManager.Task::(_decref) Task=`bf082c61-94be-4752-a86d-592c18b5d707`::ref 1 aborting False >Thread-34::INFO::2014-07-10 09:32:15,654::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532067385344', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:32:15,654::task::1185::TaskManager.Task::(prepare) Task=`bf082c61-94be-4752-a86d-592c18b5d707`::finished: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532067385344', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:32:15,655::task::595::TaskManager.Task::(_updateState) Task=`bf082c61-94be-4752-a86d-592c18b5d707`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-10 09:32:15,655::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee': < ResourceRef 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-10 09:32:15,655::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-10 09:32:15,655::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' >Thread-34::DEBUG::2014-07-10 09:32:15,656::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' (0 active users) >Thread-34::DEBUG::2014-07-10 09:32:15,656::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-10 09:32:15,656::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', Clearing records. >Thread-34::DEBUG::2014-07-10 09:32:15,656::task::990::TaskManager.Task::(_decref) Task=`bf082c61-94be-4752-a86d-592c18b5d707`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 09:32:16,846::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:32:16,934::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.029588 s, 34.6 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-10 09:32:17,008::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/metadata bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-10 09:32:17,030::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000658675 s, 6.2 MB/s\n'; <rc> = 0 >Thread-57::DEBUG::2014-07-10 09:32:17,259::task::595::TaskManager.Task::(_updateState) Task=`38ae8ce8-9067-43b9-bb1e-c474125d1cc9`::moving from state init -> state preparing >Thread-57::INFO::2014-07-10 09:32:17,260::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='b6f6c0da-e67f-4902-b9ac-3069571a42fe', volUUID='c4cd1da8-05b7-45e0-80b1-1183d21443d9', options=None) >Thread-57::INFO::2014-07-10 09:32:17,260::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-57::DEBUG::2014-07-10 09:32:17,261::task::1185::TaskManager.Task::(prepare) Task=`38ae8ce8-9067-43b9-bb1e-c474125d1cc9`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-57::DEBUG::2014-07-10 09:32:17,261::task::595::TaskManager.Task::(_updateState) Task=`38ae8ce8-9067-43b9-bb1e-c474125d1cc9`::moving from state preparing -> state finished >Thread-57::DEBUG::2014-07-10 09:32:17,261::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-57::DEBUG::2014-07-10 09:32:17,261::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-57::DEBUG::2014-07-10 09:32:17,261::task::990::TaskManager.Task::(_decref) Task=`38ae8ce8-9067-43b9-bb1e-c474125d1cc9`::ref 0 aborting False >Thread-40::DEBUG::2014-07-10 09:32:17,788::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lion.qa.lab.tlv.redhat.com:_export_yuri2_backup2/6a70504d-00df-4869-8695-0f442053f6b6/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-40::DEBUG::2014-07-10 09:32:17,809::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n369 bytes (369 B) copied, 0.000513147 s, 719 kB/s\n'; <rc> = 0 >Thread-67::DEBUG::2014-07-10 09:32:18,272::task::595::TaskManager.Task::(_updateState) Task=`e3b6675d-7fd8-452e-8ebe-de1c9f7d051f`::moving from state init -> state preparing >Thread-67::INFO::2014-07-10 09:32:18,273::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='f30c2cb7-a43a-4bf5-82b5-cfe07336f65c', volUUID='b0fbb3c9-55af-4a3a-95ad-fc56a80b9cf5', options=None) >Thread-67::INFO::2014-07-10 09:32:18,273::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-67::DEBUG::2014-07-10 09:32:18,273::task::1185::TaskManager.Task::(prepare) Task=`e3b6675d-7fd8-452e-8ebe-de1c9f7d051f`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-67::DEBUG::2014-07-10 09:32:18,273::task::595::TaskManager.Task::(_updateState) Task=`e3b6675d-7fd8-452e-8ebe-de1c9f7d051f`::moving from state preparing -> state finished >Thread-67::DEBUG::2014-07-10 09:32:18,274::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-67::DEBUG::2014-07-10 09:32:18,274::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-67::DEBUG::2014-07-10 09:32:18,274::task::990::TaskManager.Task::(_decref) Task=`e3b6675d-7fd8-452e-8ebe-de1c9f7d051f`::ref 0 aborting False >Thread-48::DEBUG::2014-07-10 09:32:18,824::task::595::TaskManager.Task::(_updateState) Task=`3f42f996-0d1a-488a-948f-ce8f6851c426`::moving from state init -> state preparing >Thread-48::INFO::2014-07-10 09:32:18,824::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='0cd7d6ce-f497-4243-a690-c57744861eea', volUUID='10b6a7dd-dc6c-43fa-ba17-92e4331b0e0b', options=None) >Thread-48::INFO::2014-07-10 09:32:18,825::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-48::DEBUG::2014-07-10 09:32:18,825::task::1185::TaskManager.Task::(prepare) Task=`3f42f996-0d1a-488a-948f-ce8f6851c426`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-48::DEBUG::2014-07-10 09:32:18,826::task::595::TaskManager.Task::(_updateState) Task=`3f42f996-0d1a-488a-948f-ce8f6851c426`::moving from state preparing -> state finished >Thread-48::DEBUG::2014-07-10 09:32:18,826::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-48::DEBUG::2014-07-10 09:32:18,826::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-48::DEBUG::2014-07-10 09:32:18,826::task::990::TaskManager.Task::(_decref) Task=`3f42f996-0d1a-488a-948f-ce8f6851c426`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 09:32:18,950::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:32:19,040::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0340245 s, 30.1 MB/s\n'; <rc> = 0 >Thread-76::DEBUG::2014-07-10 09:32:20,164::task::595::TaskManager.Task::(_updateState) Task=`3ab6b70f-b1e9-4459-9e8f-e5b0b95c3cc4`::moving from state init -> state preparing >Thread-76::INFO::2014-07-10 09:32:20,168::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='e4c65229-4247-4b33-b72a-f1d5ce72ad05', volUUID='cad94284-3ca9-4c30-933d-997f4460309e', options=None) >Thread-76::INFO::2014-07-10 09:32:20,172::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-76::DEBUG::2014-07-10 09:32:20,173::task::1185::TaskManager.Task::(prepare) Task=`3ab6b70f-b1e9-4459-9e8f-e5b0b95c3cc4`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-76::DEBUG::2014-07-10 09:32:20,175::task::595::TaskManager.Task::(_updateState) Task=`3ab6b70f-b1e9-4459-9e8f-e5b0b95c3cc4`::moving from state preparing -> state finished >Thread-76::DEBUG::2014-07-10 09:32:20,177::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-76::DEBUG::2014-07-10 09:32:20,179::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-76::DEBUG::2014-07-10 09:32:20,182::task::990::TaskManager.Task::(_decref) Task=`3ab6b70f-b1e9-4459-9e8f-e5b0b95c3cc4`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 09:32:21,055::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:32:21,157::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0437373 s, 23.4 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:32:23,173::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:32:23,261::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.029536 s, 34.7 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:32:25,277::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:32:25,376::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0323118 s, 31.7 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 09:32:25,684::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-14::DEBUG::2014-07-10 09:32:25,686::task::595::TaskManager.Task::(_updateState) Task=`a209341b-74df-4939-aaa4-ee824cd10955`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 09:32:25,686::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-14::INFO::2014-07-10 09:32:25,687::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:32:25,687::task::1185::TaskManager.Task::(prepare) Task=`a209341b-74df-4939-aaa4-ee824cd10955`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:32:25,687::task::595::TaskManager.Task::(_updateState) Task=`a209341b-74df-4939-aaa4-ee824cd10955`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 09:32:25,687::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 09:32:25,687::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 09:32:25,687::task::990::TaskManager.Task::(_decref) Task=`a209341b-74df-4939-aaa4-ee824cd10955`::ref 0 aborting False >Thread-34::DEBUG::2014-07-10 09:32:25,692::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-34::DEBUG::2014-07-10 09:32:25,692::task::595::TaskManager.Task::(_updateState) Task=`377ac51b-ffd0-4a9b-91cb-054acd8da26f`::moving from state init -> state preparing >Thread-34::INFO::2014-07-10 09:32:25,692::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-34::DEBUG::2014-07-10 09:32:25,693::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`03bc7fd0-a277-4757-b643-600bd7c8d9d0`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-10 09:32:25,693::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' for lock type 'shared' >Thread-34::DEBUG::2014-07-10 09:32:25,693::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-10 09:32:25,693::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`03bc7fd0-a277-4757-b643-600bd7c8d9d0`::Granted request >Thread-34::DEBUG::2014-07-10 09:32:25,694::task::827::TaskManager.Task::(resourceAcquired) Task=`377ac51b-ffd0-4a9b-91cb-054acd8da26f`::_resourcesAcquired: Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee (shared) >Thread-34::DEBUG::2014-07-10 09:32:25,694::task::990::TaskManager.Task::(_decref) Task=`377ac51b-ffd0-4a9b-91cb-054acd8da26f`::ref 1 aborting False >Thread-34::INFO::2014-07-10 09:32:25,695::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532067385344', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:32:25,695::task::1185::TaskManager.Task::(prepare) Task=`377ac51b-ffd0-4a9b-91cb-054acd8da26f`::finished: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532067385344', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:32:25,695::task::595::TaskManager.Task::(_updateState) Task=`377ac51b-ffd0-4a9b-91cb-054acd8da26f`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-10 09:32:25,696::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee': < ResourceRef 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-10 09:32:25,696::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-10 09:32:25,696::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' >Thread-34::DEBUG::2014-07-10 09:32:25,696::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' (0 active users) >Thread-34::DEBUG::2014-07-10 09:32:25,696::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-10 09:32:25,696::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', Clearing records. >Thread-34::DEBUG::2014-07-10 09:32:25,697::task::990::TaskManager.Task::(_decref) Task=`377ac51b-ffd0-4a9b-91cb-054acd8da26f`::ref 0 aborting False >Thread-18::DEBUG::2014-07-10 09:32:27,058::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/metadata bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-10 09:32:27,080::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000703968 s, 5.8 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:32:27,392::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:32:27,494::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.03544 s, 28.9 MB/s\n'; <rc> = 0 >Thread-40::DEBUG::2014-07-10 09:32:27,840::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lion.qa.lab.tlv.redhat.com:_export_yuri2_backup2/6a70504d-00df-4869-8695-0f442053f6b6/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-40::DEBUG::2014-07-10 09:32:27,860::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n369 bytes (369 B) copied, 0.000460557 s, 801 kB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 09:32:28,843::task::595::TaskManager.Task::(_updateState) Task=`3084975d-f956-435d-9ce2-55fcb1f37e5c`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 09:32:28,843::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::INFO::2014-07-10 09:32:28,844::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000703968', 'lastCheck': '1.7', 'valid': True}, '6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000460557', 'lastCheck': '1.0', 'valid': True}} >Thread-14::DEBUG::2014-07-10 09:32:28,844::task::1185::TaskManager.Task::(prepare) Task=`3084975d-f956-435d-9ce2-55fcb1f37e5c`::finished: {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000703968', 'lastCheck': '1.7', 'valid': True}, '6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000460557', 'lastCheck': '1.0', 'valid': True}} >Thread-14::DEBUG::2014-07-10 09:32:28,844::task::595::TaskManager.Task::(_updateState) Task=`3084975d-f956-435d-9ce2-55fcb1f37e5c`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 09:32:28,844::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 09:32:28,844::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 09:32:28,845::task::990::TaskManager.Task::(_decref) Task=`3084975d-f956-435d-9ce2-55fcb1f37e5c`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 09:32:29,508::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:32:29,597::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0304622 s, 33.6 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:32:31,613::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:32:31,701::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0301699 s, 33.9 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:32:33,716::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:32:34,052::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0325483 s, 31.5 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 09:32:35,735::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-14::DEBUG::2014-07-10 09:32:35,736::task::595::TaskManager.Task::(_updateState) Task=`177287e8-34c6-41b6-9dfd-f15ed5a56a49`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 09:32:35,737::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-14::INFO::2014-07-10 09:32:35,737::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:32:35,738::task::1185::TaskManager.Task::(prepare) Task=`177287e8-34c6-41b6-9dfd-f15ed5a56a49`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:32:35,738::task::595::TaskManager.Task::(_updateState) Task=`177287e8-34c6-41b6-9dfd-f15ed5a56a49`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 09:32:35,738::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 09:32:35,738::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 09:32:35,738::task::990::TaskManager.Task::(_decref) Task=`177287e8-34c6-41b6-9dfd-f15ed5a56a49`::ref 0 aborting False >Thread-34::DEBUG::2014-07-10 09:32:35,743::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-34::DEBUG::2014-07-10 09:32:35,743::task::595::TaskManager.Task::(_updateState) Task=`b4a797ae-1962-44ac-8706-6752de40618c`::moving from state init -> state preparing >Thread-34::INFO::2014-07-10 09:32:35,744::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-34::DEBUG::2014-07-10 09:32:35,744::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`582e9652-0f3a-4b95-9288-89fcb83717a4`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-10 09:32:35,745::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' for lock type 'shared' >Thread-34::DEBUG::2014-07-10 09:32:35,745::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-10 09:32:35,745::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`582e9652-0f3a-4b95-9288-89fcb83717a4`::Granted request >Thread-34::DEBUG::2014-07-10 09:32:35,746::task::827::TaskManager.Task::(resourceAcquired) Task=`b4a797ae-1962-44ac-8706-6752de40618c`::_resourcesAcquired: Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee (shared) >Thread-34::DEBUG::2014-07-10 09:32:35,746::task::990::TaskManager.Task::(_decref) Task=`b4a797ae-1962-44ac-8706-6752de40618c`::ref 1 aborting False >Thread-34::INFO::2014-07-10 09:32:35,747::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532067385344', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:32:35,747::task::1185::TaskManager.Task::(prepare) Task=`b4a797ae-1962-44ac-8706-6752de40618c`::finished: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532067385344', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:32:35,748::task::595::TaskManager.Task::(_updateState) Task=`b4a797ae-1962-44ac-8706-6752de40618c`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-10 09:32:35,748::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee': < ResourceRef 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-10 09:32:35,748::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-10 09:32:35,748::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' >Thread-34::DEBUG::2014-07-10 09:32:35,748::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' (0 active users) >Thread-34::DEBUG::2014-07-10 09:32:35,749::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-10 09:32:35,749::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', Clearing records. >Thread-34::DEBUG::2014-07-10 09:32:35,749::task::990::TaskManager.Task::(_decref) Task=`b4a797ae-1962-44ac-8706-6752de40618c`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 09:32:36,261::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:32:36,390::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0684158 s, 15.0 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-10 09:32:37,109::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/metadata bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-10 09:32:37,131::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000657403 s, 6.2 MB/s\n'; <rc> = 0 >Thread-70::DEBUG::2014-07-10 09:32:37,391::task::595::TaskManager.Task::(_updateState) Task=`985fe1d3-bd4e-49fc-a6df-21b9ba8ffa92`::moving from state init -> state preparing >Thread-70::INFO::2014-07-10 09:32:37,392::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='cfaeead2-7caa-467c-b389-c89840ae6605', volUUID='567fe32d-31a6-4ff6-90f3-fd6a656fbecc', options=None) >Thread-70::INFO::2014-07-10 09:32:37,392::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-70::DEBUG::2014-07-10 09:32:37,393::task::1185::TaskManager.Task::(prepare) Task=`985fe1d3-bd4e-49fc-a6df-21b9ba8ffa92`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-70::DEBUG::2014-07-10 09:32:37,393::task::595::TaskManager.Task::(_updateState) Task=`985fe1d3-bd4e-49fc-a6df-21b9ba8ffa92`::moving from state preparing -> state finished >Thread-70::DEBUG::2014-07-10 09:32:37,393::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-70::DEBUG::2014-07-10 09:32:37,393::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-70::DEBUG::2014-07-10 09:32:37,393::task::990::TaskManager.Task::(_decref) Task=`985fe1d3-bd4e-49fc-a6df-21b9ba8ffa92`::ref 0 aborting False >Thread-40::DEBUG::2014-07-10 09:32:37,886::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lion.qa.lab.tlv.redhat.com:_export_yuri2_backup2/6a70504d-00df-4869-8695-0f442053f6b6/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-40::DEBUG::2014-07-10 09:32:37,907::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n369 bytes (369 B) copied, 0.000429411 s, 859 kB/s\n'; <rc> = 0 >Thread-60::DEBUG::2014-07-10 09:32:38,352::task::595::TaskManager.Task::(_updateState) Task=`f8bdbe04-8c52-46d5-b0b3-11b74535c431`::moving from state init -> state preparing >Thread-60::INFO::2014-07-10 09:32:38,353::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='b034d5b0-e1e0-4011-b49b-4d45ddb11556', volUUID='3d7f62b5-328f-4d8e-8b69-873cfb5ae14d', options=None) >Thread-60::INFO::2014-07-10 09:32:38,353::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-60::DEBUG::2014-07-10 09:32:38,353::task::1185::TaskManager.Task::(prepare) Task=`f8bdbe04-8c52-46d5-b0b3-11b74535c431`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-60::DEBUG::2014-07-10 09:32:38,354::task::595::TaskManager.Task::(_updateState) Task=`f8bdbe04-8c52-46d5-b0b3-11b74535c431`::moving from state preparing -> state finished >Thread-60::DEBUG::2014-07-10 09:32:38,354::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-60::DEBUG::2014-07-10 09:32:38,354::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-60::DEBUG::2014-07-10 09:32:38,354::task::990::TaskManager.Task::(_decref) Task=`f8bdbe04-8c52-46d5-b0b3-11b74535c431`::ref 0 aborting False >Thread-51::DEBUG::2014-07-10 09:32:38,375::task::595::TaskManager.Task::(_updateState) Task=`bab8ce45-b7e8-4f55-bf6e-0561fbc7a34d`::moving from state init -> state preparing >Thread-51::INFO::2014-07-10 09:32:38,375::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='76fdb054-02cd-42ed-9721-b3e65b34c3a4', volUUID='022dfe46-2cf7-4915-80b3-883158e3ca83', options=None) >Thread-51::INFO::2014-07-10 09:32:38,375::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-51::DEBUG::2014-07-10 09:32:38,376::task::1185::TaskManager.Task::(prepare) Task=`bab8ce45-b7e8-4f55-bf6e-0561fbc7a34d`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-51::DEBUG::2014-07-10 09:32:38,376::task::595::TaskManager.Task::(_updateState) Task=`bab8ce45-b7e8-4f55-bf6e-0561fbc7a34d`::moving from state preparing -> state finished >Thread-51::DEBUG::2014-07-10 09:32:38,376::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-51::DEBUG::2014-07-10 09:32:38,376::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-51::DEBUG::2014-07-10 09:32:38,377::task::990::TaskManager.Task::(_decref) Task=`bab8ce45-b7e8-4f55-bf6e-0561fbc7a34d`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 09:32:38,407::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:32:38,570::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.102484 s, 10.0 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:32:40,585::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:32:40,668::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0365019 s, 28.1 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:32:42,676::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:32:42,765::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0295381 s, 34.7 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 09:32:44,028::task::595::TaskManager.Task::(_updateState) Task=`7124a149-c520-4e37-ad1a-36b75540fba3`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 09:32:44,028::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::INFO::2014-07-10 09:32:44,029::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000657403', 'lastCheck': '6.9', 'valid': True}, '6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000429411', 'lastCheck': '6.1', 'valid': True}} >Thread-14::DEBUG::2014-07-10 09:32:44,029::task::1185::TaskManager.Task::(prepare) Task=`7124a149-c520-4e37-ad1a-36b75540fba3`::finished: {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000657403', 'lastCheck': '6.9', 'valid': True}, '6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000429411', 'lastCheck': '6.1', 'valid': True}} >Thread-14::DEBUG::2014-07-10 09:32:44,030::task::595::TaskManager.Task::(_updateState) Task=`7124a149-c520-4e37-ad1a-36b75540fba3`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 09:32:44,030::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 09:32:44,030::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 09:32:44,030::task::990::TaskManager.Task::(_decref) Task=`7124a149-c520-4e37-ad1a-36b75540fba3`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 09:32:44,781::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:32:44,874::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0322103 s, 31.8 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 09:32:45,786::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-14::DEBUG::2014-07-10 09:32:45,788::task::595::TaskManager.Task::(_updateState) Task=`a350c3fb-41c7-4ff1-9fde-7404760d30d6`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 09:32:45,789::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-14::INFO::2014-07-10 09:32:45,789::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:32:45,790::task::1185::TaskManager.Task::(prepare) Task=`a350c3fb-41c7-4ff1-9fde-7404760d30d6`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:32:45,790::task::595::TaskManager.Task::(_updateState) Task=`a350c3fb-41c7-4ff1-9fde-7404760d30d6`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 09:32:45,790::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 09:32:45,791::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 09:32:45,791::task::990::TaskManager.Task::(_decref) Task=`a350c3fb-41c7-4ff1-9fde-7404760d30d6`::ref 0 aborting False >Thread-34::DEBUG::2014-07-10 09:32:45,835::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-34::DEBUG::2014-07-10 09:32:45,836::task::595::TaskManager.Task::(_updateState) Task=`9ef3a60d-2fc3-4a0e-8fb5-82ad8875f9cc`::moving from state init -> state preparing >Thread-34::INFO::2014-07-10 09:32:45,836::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-34::DEBUG::2014-07-10 09:32:45,837::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`e7f04ec1-7c94-42a5-b4bc-8c3b30fc1b7e`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-10 09:32:45,837::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' for lock type 'shared' >Thread-34::DEBUG::2014-07-10 09:32:45,838::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-10 09:32:45,838::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`e7f04ec1-7c94-42a5-b4bc-8c3b30fc1b7e`::Granted request >Thread-34::DEBUG::2014-07-10 09:32:45,838::task::827::TaskManager.Task::(resourceAcquired) Task=`9ef3a60d-2fc3-4a0e-8fb5-82ad8875f9cc`::_resourcesAcquired: Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee (shared) >Thread-34::DEBUG::2014-07-10 09:32:45,838::task::990::TaskManager.Task::(_decref) Task=`9ef3a60d-2fc3-4a0e-8fb5-82ad8875f9cc`::ref 1 aborting False >Thread-34::INFO::2014-07-10 09:32:45,840::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532067385344', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:32:45,840::task::1185::TaskManager.Task::(prepare) Task=`9ef3a60d-2fc3-4a0e-8fb5-82ad8875f9cc`::finished: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532067385344', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:32:45,840::task::595::TaskManager.Task::(_updateState) Task=`9ef3a60d-2fc3-4a0e-8fb5-82ad8875f9cc`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-10 09:32:45,840::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee': < ResourceRef 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-10 09:32:45,841::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-10 09:32:45,841::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' >Thread-34::DEBUG::2014-07-10 09:32:45,841::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' (0 active users) >Thread-34::DEBUG::2014-07-10 09:32:45,841::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-10 09:32:45,841::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', Clearing records. >Thread-34::DEBUG::2014-07-10 09:32:45,842::task::990::TaskManager.Task::(_decref) Task=`9ef3a60d-2fc3-4a0e-8fb5-82ad8875f9cc`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 09:32:46,889::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:32:46,978::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0297436 s, 34.4 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-10 09:32:47,163::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/metadata bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-10 09:32:47,219::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000585391 s, 7.0 MB/s\n'; <rc> = 0 >Thread-40::DEBUG::2014-07-10 09:32:47,938::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lion.qa.lab.tlv.redhat.com:_export_yuri2_backup2/6a70504d-00df-4869-8695-0f442053f6b6/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-40::DEBUG::2014-07-10 09:32:47,959::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n369 bytes (369 B) copied, 0.000602366 s, 613 kB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:32:48,995::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:32:49,088::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0349116 s, 29.3 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:32:51,104::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:32:51,209::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0474977 s, 21.6 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:32:53,225::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:32:53,312::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0304235 s, 33.7 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:32:55,327::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:32:55,461::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0765513 s, 13.4 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 09:32:55,877::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [72f5e52c] >Thread-14::DEBUG::2014-07-10 09:32:55,879::task::595::TaskManager.Task::(_updateState) Task=`dd5d15b7-c723-486a-aa3e-e73db5ae87ed`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 09:32:55,879::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-14::INFO::2014-07-10 09:32:55,880::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:32:55,880::task::1185::TaskManager.Task::(prepare) Task=`dd5d15b7-c723-486a-aa3e-e73db5ae87ed`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:32:55,880::task::595::TaskManager.Task::(_updateState) Task=`dd5d15b7-c723-486a-aa3e-e73db5ae87ed`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 09:32:55,881::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 09:32:55,881::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 09:32:55,881::task::990::TaskManager.Task::(_decref) Task=`dd5d15b7-c723-486a-aa3e-e73db5ae87ed`::ref 0 aborting False >Thread-34::DEBUG::2014-07-10 09:32:55,885::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [72f5e52c] >Thread-34::DEBUG::2014-07-10 09:32:55,886::task::595::TaskManager.Task::(_updateState) Task=`def4ed87-4768-451c-bb35-bc661e9088e6`::moving from state init -> state preparing >Thread-34::INFO::2014-07-10 09:32:55,886::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-34::DEBUG::2014-07-10 09:32:55,886::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`2abe81ca-242d-482a-a1ed-2e557b8e8764`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-10 09:32:55,887::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' for lock type 'shared' >Thread-34::DEBUG::2014-07-10 09:32:55,887::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-10 09:32:55,887::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`2abe81ca-242d-482a-a1ed-2e557b8e8764`::Granted request >Thread-34::DEBUG::2014-07-10 09:32:55,888::task::827::TaskManager.Task::(resourceAcquired) Task=`def4ed87-4768-451c-bb35-bc661e9088e6`::_resourcesAcquired: Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee (shared) >Thread-34::DEBUG::2014-07-10 09:32:55,888::task::990::TaskManager.Task::(_decref) Task=`def4ed87-4768-451c-bb35-bc661e9088e6`::ref 1 aborting False >Thread-34::INFO::2014-07-10 09:32:55,889::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532067385344', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:32:55,889::task::1185::TaskManager.Task::(prepare) Task=`def4ed87-4768-451c-bb35-bc661e9088e6`::finished: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532067385344', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:32:55,889::task::595::TaskManager.Task::(_updateState) Task=`def4ed87-4768-451c-bb35-bc661e9088e6`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-10 09:32:55,889::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee': < ResourceRef 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-10 09:32:55,890::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-10 09:32:55,890::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' >Thread-34::DEBUG::2014-07-10 09:32:55,890::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' (0 active users) >Thread-34::DEBUG::2014-07-10 09:32:55,890::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-10 09:32:55,890::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', Clearing records. >Thread-34::DEBUG::2014-07-10 09:32:55,890::task::990::TaskManager.Task::(_decref) Task=`def4ed87-4768-451c-bb35-bc661e9088e6`::ref 0 aborting False >Thread-18::DEBUG::2014-07-10 09:32:57,254::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/metadata bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-10 09:32:57,276::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000811237 s, 5.0 MB/s\n'; <rc> = 0 >Thread-64::DEBUG::2014-07-10 09:32:57,480::task::595::TaskManager.Task::(_updateState) Task=`3a2d30ee-ca99-44d9-879f-8f57f2b497ae`::moving from state init -> state preparing >Thread-64::INFO::2014-07-10 09:32:57,483::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='aa20346a-4d3a-4e07-b8e1-52c0ebe4168c', volUUID='58fefce2-9bce-4bff-8949-8c6ce8122b27', options=None) >Dummy-33::DEBUG::2014-07-10 09:32:57,485::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Thread-64::INFO::2014-07-10 09:32:57,504::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-64::DEBUG::2014-07-10 09:32:57,507::task::1185::TaskManager.Task::(prepare) Task=`3a2d30ee-ca99-44d9-879f-8f57f2b497ae`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-64::DEBUG::2014-07-10 09:32:57,507::task::595::TaskManager.Task::(_updateState) Task=`3a2d30ee-ca99-44d9-879f-8f57f2b497ae`::moving from state preparing -> state finished >Thread-64::DEBUG::2014-07-10 09:32:57,508::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-64::DEBUG::2014-07-10 09:32:57,508::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-64::DEBUG::2014-07-10 09:32:57,508::task::990::TaskManager.Task::(_decref) Task=`3a2d30ee-ca99-44d9-879f-8f57f2b497ae`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 09:32:57,587::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0397049 s, 25.8 MB/s\n'; <rc> = 0 >Thread-40::DEBUG::2014-07-10 09:32:57,962::domainMonitor::192::Storage.DomainMonitorThread::(_monitorDomain) Refreshing domain 6a70504d-00df-4869-8695-0f442053f6b6 >Thread-40::DEBUG::2014-07-10 09:32:57,995::fileSD::150::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/lion.qa.lab.tlv.redhat.com:_export_yuri2_backup2/6a70504d-00df-4869-8695-0f442053f6b6 >Thread-40::DEBUG::2014-07-10 09:32:57,996::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend >Thread-40::DEBUG::2014-07-10 09:32:58,000::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Backup', 'DESCRIPTION=test', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=0', 'POOL_UUID=4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', 'REMOTE_PATH=lion.qa.lab.tlv.redhat.com:/export/yuri2/backup2', 'ROLE=Regular', 'SDUUID=6a70504d-00df-4869-8695-0f442053f6b6', 'TYPE=NFS', 'VERSION=0', '_SHA_CKSUM=aab6b8e901ec435cd5f9de3c9e3f8b45dca569e0'] >Thread-40::DEBUG::2014-07-10 09:32:58,001::fileSD::609::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images [] >Thread-40::INFO::2014-07-10 09:32:58,002::sd::384::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 6a70504d-00df-4869-8695-0f442053f6b6_imageNS already registered >Thread-40::INFO::2014-07-10 09:32:58,002::sd::392::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 6a70504d-00df-4869-8695-0f442053f6b6_volumeNS already registered >Thread-40::DEBUG::2014-07-10 09:32:58,030::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lion.qa.lab.tlv.redhat.com:_export_yuri2_backup2/6a70504d-00df-4869-8695-0f442053f6b6/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-40::DEBUG::2014-07-10 09:32:58,049::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n369 bytes (369 B) copied, 0.000490793 s, 752 kB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 09:32:59,231::task::595::TaskManager.Task::(_updateState) Task=`d5ac85aa-1f1c-4444-88e8-06edddf78a83`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 09:32:59,232::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::INFO::2014-07-10 09:32:59,232::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000811237', 'lastCheck': '1.9', 'valid': True}, '6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000490793', 'lastCheck': '1.2', 'valid': True}} >Thread-14::DEBUG::2014-07-10 09:32:59,232::task::1185::TaskManager.Task::(prepare) Task=`d5ac85aa-1f1c-4444-88e8-06edddf78a83`::finished: {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000811237', 'lastCheck': '1.9', 'valid': True}, '6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000490793', 'lastCheck': '1.2', 'valid': True}} >Thread-14::DEBUG::2014-07-10 09:32:59,233::task::595::TaskManager.Task::(_updateState) Task=`d5ac85aa-1f1c-4444-88e8-06edddf78a83`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 09:32:59,233::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 09:32:59,233::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 09:32:59,233::task::990::TaskManager.Task::(_decref) Task=`d5ac85aa-1f1c-4444-88e8-06edddf78a83`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 09:32:59,605::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Thread-54::DEBUG::2014-07-10 09:32:59,606::task::595::TaskManager.Task::(_updateState) Task=`096bff5a-e881-4e8c-ab4c-ac394c00fce8`::moving from state init -> state preparing >Thread-54::INFO::2014-07-10 09:32:59,625::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='28408446-e5fd-4565-a976-e760951593fe', volUUID='776303a2-5585-451e-826e-0e338d4a1e98', options=None) >Thread-73::DEBUG::2014-07-10 09:32:59,627::task::595::TaskManager.Task::(_updateState) Task=`a6cf5e60-b6cf-4d5f-844c-a081f9b3c2fb`::moving from state init -> state preparing >Thread-54::INFO::2014-07-10 09:32:59,628::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-73::INFO::2014-07-10 09:32:59,628::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='c01d693b-cba0-4fed-9ad7-0aaa28912a19', volUUID='4bb5d954-2a50-4028-b299-0b43c261270c', options=None) >Thread-54::DEBUG::2014-07-10 09:32:59,630::task::1185::TaskManager.Task::(prepare) Task=`096bff5a-e881-4e8c-ab4c-ac394c00fce8`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-73::INFO::2014-07-10 09:32:59,630::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-54::DEBUG::2014-07-10 09:32:59,631::task::595::TaskManager.Task::(_updateState) Task=`096bff5a-e881-4e8c-ab4c-ac394c00fce8`::moving from state preparing -> state finished >Thread-73::DEBUG::2014-07-10 09:32:59,632::task::1185::TaskManager.Task::(prepare) Task=`a6cf5e60-b6cf-4d5f-844c-a081f9b3c2fb`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-54::DEBUG::2014-07-10 09:32:59,633::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-73::DEBUG::2014-07-10 09:32:59,633::task::595::TaskManager.Task::(_updateState) Task=`a6cf5e60-b6cf-4d5f-844c-a081f9b3c2fb`::moving from state preparing -> state finished >Thread-54::DEBUG::2014-07-10 09:32:59,634::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-73::DEBUG::2014-07-10 09:32:59,634::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-54::DEBUG::2014-07-10 09:32:59,636::task::990::TaskManager.Task::(_decref) Task=`096bff5a-e881-4e8c-ab4c-ac394c00fce8`::ref 0 aborting False >Thread-73::DEBUG::2014-07-10 09:32:59,636::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-73::DEBUG::2014-07-10 09:32:59,638::task::990::TaskManager.Task::(_decref) Task=`a6cf5e60-b6cf-4d5f-844c-a081f9b3c2fb`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 09:32:59,705::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0404247 s, 25.3 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:33:01,738::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:33:01,854::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0302194 s, 33.9 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:33:03,869::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:33:03,961::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0358824 s, 28.5 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 09:33:05,919::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-14::DEBUG::2014-07-10 09:33:05,920::task::595::TaskManager.Task::(_updateState) Task=`9afa6d50-5a65-4877-9dc0-44e1be1c6b66`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 09:33:05,920::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-14::INFO::2014-07-10 09:33:05,921::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:33:05,921::task::1185::TaskManager.Task::(prepare) Task=`9afa6d50-5a65-4877-9dc0-44e1be1c6b66`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:33:05,921::task::595::TaskManager.Task::(_updateState) Task=`9afa6d50-5a65-4877-9dc0-44e1be1c6b66`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 09:33:05,921::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 09:33:05,922::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 09:33:05,922::task::990::TaskManager.Task::(_decref) Task=`9afa6d50-5a65-4877-9dc0-44e1be1c6b66`::ref 0 aborting False >Thread-34::DEBUG::2014-07-10 09:33:05,926::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-34::DEBUG::2014-07-10 09:33:05,926::task::595::TaskManager.Task::(_updateState) Task=`5aea1512-24c5-4371-b7c4-7abcc3b7672a`::moving from state init -> state preparing >Thread-34::INFO::2014-07-10 09:33:05,926::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-34::DEBUG::2014-07-10 09:33:05,927::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`39937910-8892-4c01-89a8-66be8c1c03f3`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-10 09:33:05,927::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' for lock type 'shared' >Thread-34::DEBUG::2014-07-10 09:33:05,928::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-10 09:33:05,928::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`39937910-8892-4c01-89a8-66be8c1c03f3`::Granted request >Thread-34::DEBUG::2014-07-10 09:33:05,928::task::827::TaskManager.Task::(resourceAcquired) Task=`5aea1512-24c5-4371-b7c4-7abcc3b7672a`::_resourcesAcquired: Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee (shared) >Thread-34::DEBUG::2014-07-10 09:33:05,929::task::990::TaskManager.Task::(_decref) Task=`5aea1512-24c5-4371-b7c4-7abcc3b7672a`::ref 1 aborting False >Thread-34::INFO::2014-07-10 09:33:05,930::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532067385344', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:33:05,930::task::1185::TaskManager.Task::(prepare) Task=`5aea1512-24c5-4371-b7c4-7abcc3b7672a`::finished: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532067385344', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:33:05,930::task::595::TaskManager.Task::(_updateState) Task=`5aea1512-24c5-4371-b7c4-7abcc3b7672a`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-10 09:33:05,930::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee': < ResourceRef 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-10 09:33:05,930::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-10 09:33:05,931::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' >Thread-34::DEBUG::2014-07-10 09:33:05,931::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' (0 active users) >Thread-34::DEBUG::2014-07-10 09:33:05,931::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-10 09:33:05,931::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', Clearing records. >Thread-34::DEBUG::2014-07-10 09:33:05,931::task::990::TaskManager.Task::(_decref) Task=`5aea1512-24c5-4371-b7c4-7abcc3b7672a`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 09:33:05,976::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:33:06,062::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0296778 s, 34.5 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-10 09:33:07,305::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/metadata bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-10 09:33:07,328::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000935473 s, 4.4 MB/s\n'; <rc> = 0 >Thread-40::DEBUG::2014-07-10 09:33:08,073::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lion.qa.lab.tlv.redhat.com:_export_yuri2_backup2/6a70504d-00df-4869-8695-0f442053f6b6/dom_md/metadata bs=4096 count=1' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:33:08,092::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Thread-40::DEBUG::2014-07-10 09:33:08,136::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n369 bytes (369 B) copied, 0.000412277 s, 895 kB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:33:08,217::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0642338 s, 15.9 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:33:10,232::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:33:10,322::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0339956 s, 30.1 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:33:12,337::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:33:12,449::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0356194 s, 28.7 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 09:33:14,422::task::595::TaskManager.Task::(_updateState) Task=`d5dcf62f-69d9-4002-9c2e-e2e72c750cf5`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 09:33:14,423::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::INFO::2014-07-10 09:33:14,423::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000935473', 'lastCheck': '7.1', 'valid': True}, '6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000412277', 'lastCheck': '6.3', 'valid': True}} >Thread-14::DEBUG::2014-07-10 09:33:14,423::task::1185::TaskManager.Task::(prepare) Task=`d5dcf62f-69d9-4002-9c2e-e2e72c750cf5`::finished: {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000935473', 'lastCheck': '7.1', 'valid': True}, '6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000412277', 'lastCheck': '6.3', 'valid': True}} >Thread-14::DEBUG::2014-07-10 09:33:14,424::task::595::TaskManager.Task::(_updateState) Task=`d5dcf62f-69d9-4002-9c2e-e2e72c750cf5`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 09:33:14,424::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 09:33:14,424::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 09:33:14,424::task::990::TaskManager.Task::(_decref) Task=`d5dcf62f-69d9-4002-9c2e-e2e72c750cf5`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 09:33:14,465::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:33:14,554::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0294834 s, 34.7 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 09:33:15,969::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-14::DEBUG::2014-07-10 09:33:15,970::task::595::TaskManager.Task::(_updateState) Task=`85c0ef98-77e6-4261-ad15-149cc0a9eb13`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 09:33:15,971::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-14::INFO::2014-07-10 09:33:15,971::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:33:15,971::task::1185::TaskManager.Task::(prepare) Task=`85c0ef98-77e6-4261-ad15-149cc0a9eb13`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:33:15,972::task::595::TaskManager.Task::(_updateState) Task=`85c0ef98-77e6-4261-ad15-149cc0a9eb13`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 09:33:15,972::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 09:33:15,972::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 09:33:15,972::task::990::TaskManager.Task::(_decref) Task=`85c0ef98-77e6-4261-ad15-149cc0a9eb13`::ref 0 aborting False >Thread-34::DEBUG::2014-07-10 09:33:16,016::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-34::DEBUG::2014-07-10 09:33:16,016::task::595::TaskManager.Task::(_updateState) Task=`3e678a2b-5eeb-481b-be04-71deaea2e877`::moving from state init -> state preparing >Thread-34::INFO::2014-07-10 09:33:16,017::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-34::DEBUG::2014-07-10 09:33:16,017::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`e2e4f8cf-bb5c-4e99-9c20-a67f7005ab03`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-10 09:33:16,018::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' for lock type 'shared' >Thread-34::DEBUG::2014-07-10 09:33:16,018::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-10 09:33:16,018::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`e2e4f8cf-bb5c-4e99-9c20-a67f7005ab03`::Granted request >Thread-34::DEBUG::2014-07-10 09:33:16,019::task::827::TaskManager.Task::(resourceAcquired) Task=`3e678a2b-5eeb-481b-be04-71deaea2e877`::_resourcesAcquired: Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee (shared) >Thread-34::DEBUG::2014-07-10 09:33:16,019::task::990::TaskManager.Task::(_decref) Task=`3e678a2b-5eeb-481b-be04-71deaea2e877`::ref 1 aborting False >Thread-34::INFO::2014-07-10 09:33:16,020::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532067385344', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:33:16,020::task::1185::TaskManager.Task::(prepare) Task=`3e678a2b-5eeb-481b-be04-71deaea2e877`::finished: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532067385344', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:33:16,021::task::595::TaskManager.Task::(_updateState) Task=`3e678a2b-5eeb-481b-be04-71deaea2e877`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-10 09:33:16,021::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee': < ResourceRef 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-10 09:33:16,021::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-10 09:33:16,021::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' >Thread-34::DEBUG::2014-07-10 09:33:16,022::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' (0 active users) >Thread-34::DEBUG::2014-07-10 09:33:16,022::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-10 09:33:16,022::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', Clearing records. >Thread-34::DEBUG::2014-07-10 09:33:16,022::task::990::TaskManager.Task::(_decref) Task=`3e678a2b-5eeb-481b-be04-71deaea2e877`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 09:33:16,570::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:33:16,685::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0453263 s, 22.6 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-10 09:33:17,362::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/metadata bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-10 09:33:17,383::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000903845 s, 4.5 MB/s\n'; <rc> = 0 >Thread-57::DEBUG::2014-07-10 09:33:17,545::task::595::TaskManager.Task::(_updateState) Task=`16c566fa-68dd-4bc5-954c-728ecbf49eaa`::moving from state init -> state preparing >Thread-57::INFO::2014-07-10 09:33:17,545::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='b6f6c0da-e67f-4902-b9ac-3069571a42fe', volUUID='c4cd1da8-05b7-45e0-80b1-1183d21443d9', options=None) >Thread-57::INFO::2014-07-10 09:33:17,546::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-57::DEBUG::2014-07-10 09:33:17,546::task::1185::TaskManager.Task::(prepare) Task=`16c566fa-68dd-4bc5-954c-728ecbf49eaa`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-57::DEBUG::2014-07-10 09:33:17,546::task::595::TaskManager.Task::(_updateState) Task=`16c566fa-68dd-4bc5-954c-728ecbf49eaa`::moving from state preparing -> state finished >Thread-57::DEBUG::2014-07-10 09:33:17,547::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-57::DEBUG::2014-07-10 09:33:17,547::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-57::DEBUG::2014-07-10 09:33:17,547::task::990::TaskManager.Task::(_decref) Task=`16c566fa-68dd-4bc5-954c-728ecbf49eaa`::ref 0 aborting False >Thread-40::DEBUG::2014-07-10 09:33:18,177::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lion.qa.lab.tlv.redhat.com:_export_yuri2_backup2/6a70504d-00df-4869-8695-0f442053f6b6/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-40::DEBUG::2014-07-10 09:33:18,198::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n369 bytes (369 B) copied, 0.000492705 s, 749 kB/s\n'; <rc> = 0 >Thread-67::DEBUG::2014-07-10 09:33:18,532::task::595::TaskManager.Task::(_updateState) Task=`3f9eae8a-9311-41db-9609-beaa4861fffe`::moving from state init -> state preparing >Thread-67::INFO::2014-07-10 09:33:18,533::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='f30c2cb7-a43a-4bf5-82b5-cfe07336f65c', volUUID='b0fbb3c9-55af-4a3a-95ad-fc56a80b9cf5', options=None) >Thread-67::INFO::2014-07-10 09:33:18,534::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-67::DEBUG::2014-07-10 09:33:18,534::task::1185::TaskManager.Task::(prepare) Task=`3f9eae8a-9311-41db-9609-beaa4861fffe`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-67::DEBUG::2014-07-10 09:33:18,534::task::595::TaskManager.Task::(_updateState) Task=`3f9eae8a-9311-41db-9609-beaa4861fffe`::moving from state preparing -> state finished >Thread-67::DEBUG::2014-07-10 09:33:18,534::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-67::DEBUG::2014-07-10 09:33:18,534::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-67::DEBUG::2014-07-10 09:33:18,535::task::990::TaskManager.Task::(_decref) Task=`3f9eae8a-9311-41db-9609-beaa4861fffe`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 09:33:18,694::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:33:18,791::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0380957 s, 26.9 MB/s\n'; <rc> = 0 >Thread-48::DEBUG::2014-07-10 09:33:19,106::task::595::TaskManager.Task::(_updateState) Task=`b76a5692-760b-4e56-a077-c26026fe96b1`::moving from state init -> state preparing >Thread-48::INFO::2014-07-10 09:33:19,106::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='0cd7d6ce-f497-4243-a690-c57744861eea', volUUID='10b6a7dd-dc6c-43fa-ba17-92e4331b0e0b', options=None) >Thread-48::INFO::2014-07-10 09:33:19,107::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-48::DEBUG::2014-07-10 09:33:19,107::task::1185::TaskManager.Task::(prepare) Task=`b76a5692-760b-4e56-a077-c26026fe96b1`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-48::DEBUG::2014-07-10 09:33:19,107::task::595::TaskManager.Task::(_updateState) Task=`b76a5692-760b-4e56-a077-c26026fe96b1`::moving from state preparing -> state finished >Thread-48::DEBUG::2014-07-10 09:33:19,108::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-48::DEBUG::2014-07-10 09:33:19,108::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-48::DEBUG::2014-07-10 09:33:19,108::task::990::TaskManager.Task::(_decref) Task=`b76a5692-760b-4e56-a077-c26026fe96b1`::ref 0 aborting False >Thread-76::DEBUG::2014-07-10 09:33:20,469::task::595::TaskManager.Task::(_updateState) Task=`298ce131-5e39-4c4f-a3e5-f8d09057d98f`::moving from state init -> state preparing >Thread-76::INFO::2014-07-10 09:33:20,470::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='e4c65229-4247-4b33-b72a-f1d5ce72ad05', volUUID='cad94284-3ca9-4c30-933d-997f4460309e', options=None) >Thread-76::INFO::2014-07-10 09:33:20,470::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-76::DEBUG::2014-07-10 09:33:20,471::task::1185::TaskManager.Task::(prepare) Task=`298ce131-5e39-4c4f-a3e5-f8d09057d98f`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-76::DEBUG::2014-07-10 09:33:20,471::task::595::TaskManager.Task::(_updateState) Task=`298ce131-5e39-4c4f-a3e5-f8d09057d98f`::moving from state preparing -> state finished >Thread-76::DEBUG::2014-07-10 09:33:20,471::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-76::DEBUG::2014-07-10 09:33:20,471::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-76::DEBUG::2014-07-10 09:33:20,471::task::990::TaskManager.Task::(_decref) Task=`298ce131-5e39-4c4f-a3e5-f8d09057d98f`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 09:33:20,807::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:33:20,894::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0270792 s, 37.8 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:33:22,909::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:33:22,998::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0304586 s, 33.6 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:33:25,045::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:33:25,189::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0897002 s, 11.4 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 09:33:26,044::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-14::DEBUG::2014-07-10 09:33:26,045::task::595::TaskManager.Task::(_updateState) Task=`85349fc2-0499-4241-8eca-d4258c13f22a`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 09:33:26,046::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-14::INFO::2014-07-10 09:33:26,046::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:33:26,046::task::1185::TaskManager.Task::(prepare) Task=`85349fc2-0499-4241-8eca-d4258c13f22a`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:33:26,046::task::595::TaskManager.Task::(_updateState) Task=`85349fc2-0499-4241-8eca-d4258c13f22a`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 09:33:26,047::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 09:33:26,047::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 09:33:26,047::task::990::TaskManager.Task::(_decref) Task=`85349fc2-0499-4241-8eca-d4258c13f22a`::ref 0 aborting False >Thread-34::DEBUG::2014-07-10 09:33:26,051::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-34::DEBUG::2014-07-10 09:33:26,051::task::595::TaskManager.Task::(_updateState) Task=`31edd82b-5ad5-48f6-8376-f1747b09ad26`::moving from state init -> state preparing >Thread-34::INFO::2014-07-10 09:33:26,052::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-34::DEBUG::2014-07-10 09:33:26,052::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`645d7457-2077-4be9-af5d-093bb59809fb`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-10 09:33:26,053::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' for lock type 'shared' >Thread-34::DEBUG::2014-07-10 09:33:26,053::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-10 09:33:26,053::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`645d7457-2077-4be9-af5d-093bb59809fb`::Granted request >Thread-34::DEBUG::2014-07-10 09:33:26,054::task::827::TaskManager.Task::(resourceAcquired) Task=`31edd82b-5ad5-48f6-8376-f1747b09ad26`::_resourcesAcquired: Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee (shared) >Thread-34::DEBUG::2014-07-10 09:33:26,054::task::990::TaskManager.Task::(_decref) Task=`31edd82b-5ad5-48f6-8376-f1747b09ad26`::ref 1 aborting False >Thread-34::INFO::2014-07-10 09:33:26,055::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532067385344', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:33:26,055::task::1185::TaskManager.Task::(prepare) Task=`31edd82b-5ad5-48f6-8376-f1747b09ad26`::finished: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532067385344', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:33:26,055::task::595::TaskManager.Task::(_updateState) Task=`31edd82b-5ad5-48f6-8376-f1747b09ad26`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-10 09:33:26,055::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee': < ResourceRef 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-10 09:33:26,055::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-10 09:33:26,056::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' >Thread-34::DEBUG::2014-07-10 09:33:26,056::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' (0 active users) >Thread-34::DEBUG::2014-07-10 09:33:26,056::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-10 09:33:26,056::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', Clearing records. >Thread-34::DEBUG::2014-07-10 09:33:26,056::task::990::TaskManager.Task::(_decref) Task=`31edd82b-5ad5-48f6-8376-f1747b09ad26`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 09:33:27,207::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:33:27,327::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.033459 s, 30.6 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-10 09:33:27,412::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/metadata bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-10 09:33:27,433::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000736264 s, 5.6 MB/s\n'; <rc> = 0 >Thread-40::DEBUG::2014-07-10 09:33:28,229::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lion.qa.lab.tlv.redhat.com:_export_yuri2_backup2/6a70504d-00df-4869-8695-0f442053f6b6/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-40::DEBUG::2014-07-10 09:33:28,250::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n369 bytes (369 B) copied, 0.000511182 s, 722 kB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:33:29,342::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:33:29,425::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0263768 s, 38.8 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 09:33:29,595::task::595::TaskManager.Task::(_updateState) Task=`20a2aafa-2f5f-4815-9d79-25ea6af6e387`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 09:33:29,596::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::INFO::2014-07-10 09:33:29,596::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000736264', 'lastCheck': '2.1', 'valid': True}, '6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000511182', 'lastCheck': '1.3', 'valid': True}} >Thread-14::DEBUG::2014-07-10 09:33:29,597::task::1185::TaskManager.Task::(prepare) Task=`20a2aafa-2f5f-4815-9d79-25ea6af6e387`::finished: {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000736264', 'lastCheck': '2.1', 'valid': True}, '6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000511182', 'lastCheck': '1.3', 'valid': True}} >Thread-14::DEBUG::2014-07-10 09:33:29,597::task::595::TaskManager.Task::(_updateState) Task=`20a2aafa-2f5f-4815-9d79-25ea6af6e387`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 09:33:29,597::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 09:33:29,597::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 09:33:29,598::task::990::TaskManager.Task::(_decref) Task=`20a2aafa-2f5f-4815-9d79-25ea6af6e387`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 09:33:31,440::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:33:31,589::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0905416 s, 11.3 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:33:33,604::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:33:33,709::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0431728 s, 23.7 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:33:35,724::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:33:35,818::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0271756 s, 37.7 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 09:33:36,084::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-14::DEBUG::2014-07-10 09:33:36,085::task::595::TaskManager.Task::(_updateState) Task=`ae431bcd-44ea-42d3-a9b4-707151d166b3`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 09:33:36,086::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-14::INFO::2014-07-10 09:33:36,086::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:33:36,086::task::1185::TaskManager.Task::(prepare) Task=`ae431bcd-44ea-42d3-a9b4-707151d166b3`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:33:36,086::task::595::TaskManager.Task::(_updateState) Task=`ae431bcd-44ea-42d3-a9b4-707151d166b3`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 09:33:36,087::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 09:33:36,087::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 09:33:36,087::task::990::TaskManager.Task::(_decref) Task=`ae431bcd-44ea-42d3-a9b4-707151d166b3`::ref 0 aborting False >Thread-34::DEBUG::2014-07-10 09:33:36,091::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-34::DEBUG::2014-07-10 09:33:36,092::task::595::TaskManager.Task::(_updateState) Task=`e96fa654-cae2-4c4e-b9eb-40293963c0d5`::moving from state init -> state preparing >Thread-34::INFO::2014-07-10 09:33:36,092::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-34::DEBUG::2014-07-10 09:33:36,092::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`f12c5215-f38d-4bc9-a3ac-86436d575c9b`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-10 09:33:36,093::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' for lock type 'shared' >Thread-34::DEBUG::2014-07-10 09:33:36,093::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-10 09:33:36,093::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`f12c5215-f38d-4bc9-a3ac-86436d575c9b`::Granted request >Thread-34::DEBUG::2014-07-10 09:33:36,094::task::827::TaskManager.Task::(resourceAcquired) Task=`e96fa654-cae2-4c4e-b9eb-40293963c0d5`::_resourcesAcquired: Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee (shared) >Thread-34::DEBUG::2014-07-10 09:33:36,094::task::990::TaskManager.Task::(_decref) Task=`e96fa654-cae2-4c4e-b9eb-40293963c0d5`::ref 1 aborting False >Thread-34::INFO::2014-07-10 09:33:36,095::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532067385344', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:33:36,095::task::1185::TaskManager.Task::(prepare) Task=`e96fa654-cae2-4c4e-b9eb-40293963c0d5`::finished: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532067385344', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:33:36,095::task::595::TaskManager.Task::(_updateState) Task=`e96fa654-cae2-4c4e-b9eb-40293963c0d5`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-10 09:33:36,096::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee': < ResourceRef 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-10 09:33:36,096::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-10 09:33:36,096::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' >Thread-34::DEBUG::2014-07-10 09:33:36,096::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' (0 active users) >Thread-34::DEBUG::2014-07-10 09:33:36,097::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-10 09:33:36,097::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', Clearing records. >Thread-34::DEBUG::2014-07-10 09:33:36,097::task::990::TaskManager.Task::(_decref) Task=`e96fa654-cae2-4c4e-b9eb-40293963c0d5`::ref 0 aborting False >Thread-18::DEBUG::2014-07-10 09:33:37,498::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/metadata bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-10 09:33:37,519::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000560875 s, 7.3 MB/s\n'; <rc> = 0 >Thread-70::DEBUG::2014-07-10 09:33:37,660::task::595::TaskManager.Task::(_updateState) Task=`8d0127d8-9b88-499b-87f7-27c7e36a8f2d`::moving from state init -> state preparing >Thread-70::INFO::2014-07-10 09:33:37,660::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='cfaeead2-7caa-467c-b389-c89840ae6605', volUUID='567fe32d-31a6-4ff6-90f3-fd6a656fbecc', options=None) >Thread-70::INFO::2014-07-10 09:33:37,661::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-70::DEBUG::2014-07-10 09:33:37,661::task::1185::TaskManager.Task::(prepare) Task=`8d0127d8-9b88-499b-87f7-27c7e36a8f2d`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-70::DEBUG::2014-07-10 09:33:37,661::task::595::TaskManager.Task::(_updateState) Task=`8d0127d8-9b88-499b-87f7-27c7e36a8f2d`::moving from state preparing -> state finished >Thread-70::DEBUG::2014-07-10 09:33:37,662::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-70::DEBUG::2014-07-10 09:33:37,662::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-70::DEBUG::2014-07-10 09:33:37,662::task::990::TaskManager.Task::(_decref) Task=`8d0127d8-9b88-499b-87f7-27c7e36a8f2d`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 09:33:37,832::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:33:37,922::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0330906 s, 30.9 MB/s\n'; <rc> = 0 >Thread-40::DEBUG::2014-07-10 09:33:38,284::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lion.qa.lab.tlv.redhat.com:_export_yuri2_backup2/6a70504d-00df-4869-8695-0f442053f6b6/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-40::DEBUG::2014-07-10 09:33:38,305::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n369 bytes (369 B) copied, 0.000644259 s, 573 kB/s\n'; <rc> = 0 >Thread-60::DEBUG::2014-07-10 09:33:38,623::task::595::TaskManager.Task::(_updateState) Task=`6cb38230-8050-4de5-8fda-7c131a635d76`::moving from state init -> state preparing >Thread-60::INFO::2014-07-10 09:33:38,624::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='b034d5b0-e1e0-4011-b49b-4d45ddb11556', volUUID='3d7f62b5-328f-4d8e-8b69-873cfb5ae14d', options=None) >Thread-60::INFO::2014-07-10 09:33:38,624::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-60::DEBUG::2014-07-10 09:33:38,624::task::1185::TaskManager.Task::(prepare) Task=`6cb38230-8050-4de5-8fda-7c131a635d76`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-60::DEBUG::2014-07-10 09:33:38,625::task::595::TaskManager.Task::(_updateState) Task=`6cb38230-8050-4de5-8fda-7c131a635d76`::moving from state preparing -> state finished >Thread-60::DEBUG::2014-07-10 09:33:38,625::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-60::DEBUG::2014-07-10 09:33:38,625::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-60::DEBUG::2014-07-10 09:33:38,625::task::990::TaskManager.Task::(_decref) Task=`6cb38230-8050-4de5-8fda-7c131a635d76`::ref 0 aborting False >Thread-51::DEBUG::2014-07-10 09:33:38,669::task::595::TaskManager.Task::(_updateState) Task=`779c2599-5d67-4c9a-819e-825d1b222c90`::moving from state init -> state preparing >Thread-51::INFO::2014-07-10 09:33:38,670::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='76fdb054-02cd-42ed-9721-b3e65b34c3a4', volUUID='022dfe46-2cf7-4915-80b3-883158e3ca83', options=None) >Thread-51::INFO::2014-07-10 09:33:38,670::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-51::DEBUG::2014-07-10 09:33:38,670::task::1185::TaskManager.Task::(prepare) Task=`779c2599-5d67-4c9a-819e-825d1b222c90`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-51::DEBUG::2014-07-10 09:33:38,671::task::595::TaskManager.Task::(_updateState) Task=`779c2599-5d67-4c9a-819e-825d1b222c90`::moving from state preparing -> state finished >Thread-51::DEBUG::2014-07-10 09:33:38,671::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-51::DEBUG::2014-07-10 09:33:38,671::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-51::DEBUG::2014-07-10 09:33:38,671::task::990::TaskManager.Task::(_decref) Task=`779c2599-5d67-4c9a-819e-825d1b222c90`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 09:33:39,938::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:33:40,027::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0323642 s, 31.6 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:33:42,043::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:33:42,133::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0319809 s, 32.0 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:33:44,148::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:33:44,237::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0277076 s, 37.0 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 09:33:44,812::task::595::TaskManager.Task::(_updateState) Task=`f7792054-6085-4a63-b236-7ff97132e220`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 09:33:44,813::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::INFO::2014-07-10 09:33:44,813::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000560875', 'lastCheck': '7.3', 'valid': True}, '6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000644259', 'lastCheck': '6.5', 'valid': True}} >Thread-14::DEBUG::2014-07-10 09:33:44,814::task::1185::TaskManager.Task::(prepare) Task=`f7792054-6085-4a63-b236-7ff97132e220`::finished: {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000560875', 'lastCheck': '7.3', 'valid': True}, '6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000644259', 'lastCheck': '6.5', 'valid': True}} >Thread-14::DEBUG::2014-07-10 09:33:44,814::task::595::TaskManager.Task::(_updateState) Task=`f7792054-6085-4a63-b236-7ff97132e220`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 09:33:44,814::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 09:33:44,814::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 09:33:44,815::task::990::TaskManager.Task::(_decref) Task=`f7792054-6085-4a63-b236-7ff97132e220`::ref 0 aborting False >Thread-14::DEBUG::2014-07-10 09:33:46,128::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-14::DEBUG::2014-07-10 09:33:46,129::task::595::TaskManager.Task::(_updateState) Task=`fb3161d5-fb47-474e-a53f-b439c0160189`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 09:33:46,129::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-14::INFO::2014-07-10 09:33:46,130::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:33:46,130::task::1185::TaskManager.Task::(prepare) Task=`fb3161d5-fb47-474e-a53f-b439c0160189`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:33:46,130::task::595::TaskManager.Task::(_updateState) Task=`fb3161d5-fb47-474e-a53f-b439c0160189`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 09:33:46,130::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 09:33:46,130::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 09:33:46,131::task::990::TaskManager.Task::(_decref) Task=`fb3161d5-fb47-474e-a53f-b439c0160189`::ref 0 aborting False >Thread-34::DEBUG::2014-07-10 09:33:46,174::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-34::DEBUG::2014-07-10 09:33:46,174::task::595::TaskManager.Task::(_updateState) Task=`f5c6f5ff-6a8c-40a3-af56-929c3980510f`::moving from state init -> state preparing >Thread-34::INFO::2014-07-10 09:33:46,175::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-34::DEBUG::2014-07-10 09:33:46,175::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`c3a39bad-8b52-439b-b6bf-8c4bc78d0df4`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-10 09:33:46,176::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' for lock type 'shared' >Thread-34::DEBUG::2014-07-10 09:33:46,176::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-10 09:33:46,176::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`c3a39bad-8b52-439b-b6bf-8c4bc78d0df4`::Granted request >Thread-34::DEBUG::2014-07-10 09:33:46,177::task::827::TaskManager.Task::(resourceAcquired) Task=`f5c6f5ff-6a8c-40a3-af56-929c3980510f`::_resourcesAcquired: Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee (shared) >Thread-34::DEBUG::2014-07-10 09:33:46,177::task::990::TaskManager.Task::(_decref) Task=`f5c6f5ff-6a8c-40a3-af56-929c3980510f`::ref 1 aborting False >Thread-34::INFO::2014-07-10 09:33:46,178::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532067385344', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:33:46,179::task::1185::TaskManager.Task::(prepare) Task=`f5c6f5ff-6a8c-40a3-af56-929c3980510f`::finished: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532067385344', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:33:46,179::task::595::TaskManager.Task::(_updateState) Task=`f5c6f5ff-6a8c-40a3-af56-929c3980510f`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-10 09:33:46,179::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee': < ResourceRef 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-10 09:33:46,180::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-10 09:33:46,180::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' >Thread-34::DEBUG::2014-07-10 09:33:46,181::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' (0 active users) >Thread-34::DEBUG::2014-07-10 09:33:46,181::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-10 09:33:46,181::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', Clearing records. >Thread-34::DEBUG::2014-07-10 09:33:46,181::task::990::TaskManager.Task::(_decref) Task=`f5c6f5ff-6a8c-40a3-af56-929c3980510f`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 09:33:46,253::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:33:46,346::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0339811 s, 30.1 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-10 09:33:47,548::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/metadata bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-10 09:33:47,572::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000966412 s, 4.2 MB/s\n'; <rc> = 0 >Thread-40::DEBUG::2014-07-10 09:33:48,337::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lion.qa.lab.tlv.redhat.com:_export_yuri2_backup2/6a70504d-00df-4869-8695-0f442053f6b6/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-40::DEBUG::2014-07-10 09:33:48,358::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n369 bytes (369 B) copied, 0.000507913 s, 727 kB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:33:48,364::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:33:48,460::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0362279 s, 28.3 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:33:50,476::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:33:50,569::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0337718 s, 30.3 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:33:52,585::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:33:52,680::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0340183 s, 30.1 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:33:54,695::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:33:54,795::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0407391 s, 25.1 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 09:33:56,219::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-14::DEBUG::2014-07-10 09:33:56,220::task::595::TaskManager.Task::(_updateState) Task=`4a36be7c-83f4-4594-bb5e-1ad64aaa4119`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 09:33:56,221::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-14::INFO::2014-07-10 09:33:56,221::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:33:56,221::task::1185::TaskManager.Task::(prepare) Task=`4a36be7c-83f4-4594-bb5e-1ad64aaa4119`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:33:56,221::task::595::TaskManager.Task::(_updateState) Task=`4a36be7c-83f4-4594-bb5e-1ad64aaa4119`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 09:33:56,222::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 09:33:56,222::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 09:33:56,222::task::990::TaskManager.Task::(_decref) Task=`4a36be7c-83f4-4594-bb5e-1ad64aaa4119`::ref 0 aborting False >Thread-34::DEBUG::2014-07-10 09:33:56,226::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-34::DEBUG::2014-07-10 09:33:56,227::task::595::TaskManager.Task::(_updateState) Task=`701795d5-074b-49ec-bf67-3f7fca7677dc`::moving from state init -> state preparing >Thread-34::INFO::2014-07-10 09:33:56,227::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-34::DEBUG::2014-07-10 09:33:56,227::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`05b7d1de-7dc0-489d-8214-03e9f54d9307`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-10 09:33:56,228::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' for lock type 'shared' >Thread-34::DEBUG::2014-07-10 09:33:56,228::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-10 09:33:56,228::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`05b7d1de-7dc0-489d-8214-03e9f54d9307`::Granted request >Thread-34::DEBUG::2014-07-10 09:33:56,229::task::827::TaskManager.Task::(resourceAcquired) Task=`701795d5-074b-49ec-bf67-3f7fca7677dc`::_resourcesAcquired: Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee (shared) >Thread-34::DEBUG::2014-07-10 09:33:56,229::task::990::TaskManager.Task::(_decref) Task=`701795d5-074b-49ec-bf67-3f7fca7677dc`::ref 1 aborting False >Thread-34::INFO::2014-07-10 09:33:56,230::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532067385344', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:33:56,230::task::1185::TaskManager.Task::(prepare) Task=`701795d5-074b-49ec-bf67-3f7fca7677dc`::finished: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532067385344', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:33:56,230::task::595::TaskManager.Task::(_updateState) Task=`701795d5-074b-49ec-bf67-3f7fca7677dc`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-10 09:33:56,230::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee': < ResourceRef 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-10 09:33:56,230::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-10 09:33:56,231::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' >Thread-34::DEBUG::2014-07-10 09:33:56,231::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' (0 active users) >Thread-34::DEBUG::2014-07-10 09:33:56,231::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-10 09:33:56,231::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', Clearing records. >Thread-34::DEBUG::2014-07-10 09:33:56,231::task::990::TaskManager.Task::(_decref) Task=`701795d5-074b-49ec-bf67-3f7fca7677dc`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 09:33:56,811::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:33:56,927::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0299656 s, 34.2 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-10 09:33:57,601::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/metadata bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-10 09:33:57,622::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000819346 s, 5.0 MB/s\n'; <rc> = 0 >Thread-64::DEBUG::2014-07-10 09:33:57,768::task::595::TaskManager.Task::(_updateState) Task=`fd16913b-4985-4458-8e75-3250d3a6fa19`::moving from state init -> state preparing >Thread-64::INFO::2014-07-10 09:33:57,768::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='aa20346a-4d3a-4e07-b8e1-52c0ebe4168c', volUUID='58fefce2-9bce-4bff-8949-8c6ce8122b27', options=None) >Thread-64::INFO::2014-07-10 09:33:57,769::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-64::DEBUG::2014-07-10 09:33:57,769::task::1185::TaskManager.Task::(prepare) Task=`fd16913b-4985-4458-8e75-3250d3a6fa19`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-64::DEBUG::2014-07-10 09:33:57,769::task::595::TaskManager.Task::(_updateState) Task=`fd16913b-4985-4458-8e75-3250d3a6fa19`::moving from state preparing -> state finished >Thread-64::DEBUG::2014-07-10 09:33:57,770::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-64::DEBUG::2014-07-10 09:33:57,770::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-64::DEBUG::2014-07-10 09:33:57,770::task::990::TaskManager.Task::(_decref) Task=`fd16913b-4985-4458-8e75-3250d3a6fa19`::ref 0 aborting False >Thread-40::DEBUG::2014-07-10 09:33:58,395::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lion.qa.lab.tlv.redhat.com:_export_yuri2_backup2/6a70504d-00df-4869-8695-0f442053f6b6/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-40::DEBUG::2014-07-10 09:33:58,417::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n369 bytes (369 B) copied, 0.00181843 s, 203 kB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:33:58,942::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:33:59,028::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0295813 s, 34.6 MB/s\n'; <rc> = 0 >Thread-73::DEBUG::2014-07-10 09:33:59,931::task::595::TaskManager.Task::(_updateState) Task=`53aff5f1-35cb-419e-a050-d9f6ce78ca7c`::moving from state init -> state preparing >Thread-54::DEBUG::2014-07-10 09:33:59,935::task::595::TaskManager.Task::(_updateState) Task=`db91f8e4-4cbb-4ca6-b7ce-049e8e8e6311`::moving from state init -> state preparing >Thread-73::INFO::2014-07-10 09:33:59,935::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='c01d693b-cba0-4fed-9ad7-0aaa28912a19', volUUID='4bb5d954-2a50-4028-b299-0b43c261270c', options=None) >Thread-54::INFO::2014-07-10 09:33:59,939::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='28408446-e5fd-4565-a976-e760951593fe', volUUID='776303a2-5585-451e-826e-0e338d4a1e98', options=None) >Thread-73::INFO::2014-07-10 09:33:59,941::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-73::DEBUG::2014-07-10 09:33:59,944::task::1185::TaskManager.Task::(prepare) Task=`53aff5f1-35cb-419e-a050-d9f6ce78ca7c`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-54::INFO::2014-07-10 09:33:59,944::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-73::DEBUG::2014-07-10 09:33:59,947::task::595::TaskManager.Task::(_updateState) Task=`53aff5f1-35cb-419e-a050-d9f6ce78ca7c`::moving from state preparing -> state finished >Thread-54::DEBUG::2014-07-10 09:33:59,948::task::1185::TaskManager.Task::(prepare) Task=`db91f8e4-4cbb-4ca6-b7ce-049e8e8e6311`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-73::DEBUG::2014-07-10 09:33:59,950::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-54::DEBUG::2014-07-10 09:33:59,951::task::595::TaskManager.Task::(_updateState) Task=`db91f8e4-4cbb-4ca6-b7ce-049e8e8e6311`::moving from state preparing -> state finished >Thread-73::DEBUG::2014-07-10 09:33:59,953::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-54::DEBUG::2014-07-10 09:33:59,958::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-73::DEBUG::2014-07-10 09:33:59,961::task::990::TaskManager.Task::(_decref) Task=`53aff5f1-35cb-419e-a050-d9f6ce78ca7c`::ref 0 aborting False >Thread-54::DEBUG::2014-07-10 09:33:59,963::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-54::DEBUG::2014-07-10 09:33:59,965::task::990::TaskManager.Task::(_decref) Task=`db91f8e4-4cbb-4ca6-b7ce-049e8e8e6311`::ref 0 aborting False >Thread-14::DEBUG::2014-07-10 09:33:59,994::task::595::TaskManager.Task::(_updateState) Task=`ffbe98b2-94d9-4727-8fd0-e9142b4597e0`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 09:33:59,995::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::INFO::2014-07-10 09:33:59,995::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000819346', 'lastCheck': '2.3', 'valid': True}, '6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00181843', 'lastCheck': '1.6', 'valid': True}} >Thread-14::DEBUG::2014-07-10 09:33:59,995::task::1185::TaskManager.Task::(prepare) Task=`ffbe98b2-94d9-4727-8fd0-e9142b4597e0`::finished: {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000819346', 'lastCheck': '2.3', 'valid': True}, '6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00181843', 'lastCheck': '1.6', 'valid': True}} >Thread-14::DEBUG::2014-07-10 09:33:59,995::task::595::TaskManager.Task::(_updateState) Task=`ffbe98b2-94d9-4727-8fd0-e9142b4597e0`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 09:33:59,996::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 09:33:59,996::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 09:33:59,996::task::990::TaskManager.Task::(_decref) Task=`ffbe98b2-94d9-4727-8fd0-e9142b4597e0`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 09:34:01,044::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:34:01,138::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.034543 s, 29.6 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:34:03,153::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:34:03,240::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0295725 s, 34.6 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:34:05,256::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:34:05,346::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.029687 s, 34.5 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 09:34:06,252::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-14::DEBUG::2014-07-10 09:34:06,253::task::595::TaskManager.Task::(_updateState) Task=`1a840bef-a2b1-4830-934f-9a838431408c`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 09:34:06,254::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-14::INFO::2014-07-10 09:34:06,254::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:34:06,255::task::1185::TaskManager.Task::(prepare) Task=`1a840bef-a2b1-4830-934f-9a838431408c`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:34:06,255::task::595::TaskManager.Task::(_updateState) Task=`1a840bef-a2b1-4830-934f-9a838431408c`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 09:34:06,255::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 09:34:06,255::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 09:34:06,255::task::990::TaskManager.Task::(_decref) Task=`1a840bef-a2b1-4830-934f-9a838431408c`::ref 0 aborting False >Thread-34::DEBUG::2014-07-10 09:34:06,259::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-34::DEBUG::2014-07-10 09:34:06,259::task::595::TaskManager.Task::(_updateState) Task=`6aaf9a46-4a82-4155-84c5-022970562eb3`::moving from state init -> state preparing >Thread-34::INFO::2014-07-10 09:34:06,260::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-34::DEBUG::2014-07-10 09:34:06,260::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`8cb481f3-b36e-460d-891b-97e18dd8f308`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-10 09:34:06,261::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' for lock type 'shared' >Thread-34::DEBUG::2014-07-10 09:34:06,261::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-10 09:34:06,261::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`8cb481f3-b36e-460d-891b-97e18dd8f308`::Granted request >Thread-34::DEBUG::2014-07-10 09:34:06,262::task::827::TaskManager.Task::(resourceAcquired) Task=`6aaf9a46-4a82-4155-84c5-022970562eb3`::_resourcesAcquired: Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee (shared) >Thread-34::DEBUG::2014-07-10 09:34:06,262::task::990::TaskManager.Task::(_decref) Task=`6aaf9a46-4a82-4155-84c5-022970562eb3`::ref 1 aborting False >Thread-34::INFO::2014-07-10 09:34:06,263::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532067385344', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:34:06,263::task::1185::TaskManager.Task::(prepare) Task=`6aaf9a46-4a82-4155-84c5-022970562eb3`::finished: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532067385344', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:34:06,264::task::595::TaskManager.Task::(_updateState) Task=`6aaf9a46-4a82-4155-84c5-022970562eb3`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-10 09:34:06,264::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee': < ResourceRef 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-10 09:34:06,264::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-10 09:34:06,264::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' >Thread-34::DEBUG::2014-07-10 09:34:06,264::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' (0 active users) >Thread-34::DEBUG::2014-07-10 09:34:06,265::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-10 09:34:06,265::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', Clearing records. >Thread-34::DEBUG::2014-07-10 09:34:06,265::task::990::TaskManager.Task::(_decref) Task=`6aaf9a46-4a82-4155-84c5-022970562eb3`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 09:34:07,361::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:34:07,482::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0632046 s, 16.2 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-10 09:34:07,651::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/metadata bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-10 09:34:07,674::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000637551 s, 6.4 MB/s\n'; <rc> = 0 >Thread-40::DEBUG::2014-07-10 09:34:08,443::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lion.qa.lab.tlv.redhat.com:_export_yuri2_backup2/6a70504d-00df-4869-8695-0f442053f6b6/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-40::DEBUG::2014-07-10 09:34:08,462::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n369 bytes (369 B) copied, 0.000448812 s, 822 kB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:34:09,498::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:34:09,601::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0429846 s, 23.8 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:34:11,616::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:34:11,712::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0278334 s, 36.8 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:34:13,727::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:34:13,904::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.029017 s, 35.3 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 09:34:15,213::task::595::TaskManager.Task::(_updateState) Task=`ad884d53-039f-4bd9-92fe-e2047d969db6`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 09:34:15,214::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::INFO::2014-07-10 09:34:15,214::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000637551', 'lastCheck': '7.5', 'valid': True}, '6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000448812', 'lastCheck': '6.7', 'valid': True}} >Thread-14::DEBUG::2014-07-10 09:34:15,215::task::1185::TaskManager.Task::(prepare) Task=`ad884d53-039f-4bd9-92fe-e2047d969db6`::finished: {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000637551', 'lastCheck': '7.5', 'valid': True}, '6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000448812', 'lastCheck': '6.7', 'valid': True}} >Thread-14::DEBUG::2014-07-10 09:34:15,215::task::595::TaskManager.Task::(_updateState) Task=`ad884d53-039f-4bd9-92fe-e2047d969db6`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 09:34:15,215::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 09:34:15,215::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 09:34:15,215::task::990::TaskManager.Task::(_decref) Task=`ad884d53-039f-4bd9-92fe-e2047d969db6`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 09:34:15,919::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:34:16,012::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0358834 s, 28.5 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 09:34:16,300::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-14::DEBUG::2014-07-10 09:34:16,302::task::595::TaskManager.Task::(_updateState) Task=`97fffaf6-9696-45f9-8079-d2c92b048abc`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 09:34:16,302::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-14::INFO::2014-07-10 09:34:16,303::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:34:16,303::task::1185::TaskManager.Task::(prepare) Task=`97fffaf6-9696-45f9-8079-d2c92b048abc`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:34:16,303::task::595::TaskManager.Task::(_updateState) Task=`97fffaf6-9696-45f9-8079-d2c92b048abc`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 09:34:16,303::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 09:34:16,303::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 09:34:16,304::task::990::TaskManager.Task::(_decref) Task=`97fffaf6-9696-45f9-8079-d2c92b048abc`::ref 0 aborting False >Thread-34::DEBUG::2014-07-10 09:34:16,347::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-34::DEBUG::2014-07-10 09:34:16,348::task::595::TaskManager.Task::(_updateState) Task=`852d8856-e6e9-4ae7-af22-ebf88ca8ad98`::moving from state init -> state preparing >Thread-34::INFO::2014-07-10 09:34:16,348::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-34::DEBUG::2014-07-10 09:34:16,349::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`9da255e0-531c-4bfa-905b-0bdf8a99fc03`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-10 09:34:16,349::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' for lock type 'shared' >Thread-34::DEBUG::2014-07-10 09:34:16,349::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-10 09:34:16,349::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`9da255e0-531c-4bfa-905b-0bdf8a99fc03`::Granted request >Thread-34::DEBUG::2014-07-10 09:34:16,350::task::827::TaskManager.Task::(resourceAcquired) Task=`852d8856-e6e9-4ae7-af22-ebf88ca8ad98`::_resourcesAcquired: Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee (shared) >Thread-34::DEBUG::2014-07-10 09:34:16,350::task::990::TaskManager.Task::(_decref) Task=`852d8856-e6e9-4ae7-af22-ebf88ca8ad98`::ref 1 aborting False >Thread-34::INFO::2014-07-10 09:34:16,351::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532067385344', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:34:16,352::task::1185::TaskManager.Task::(prepare) Task=`852d8856-e6e9-4ae7-af22-ebf88ca8ad98`::finished: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532067385344', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:34:16,352::task::595::TaskManager.Task::(_updateState) Task=`852d8856-e6e9-4ae7-af22-ebf88ca8ad98`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-10 09:34:16,352::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee': < ResourceRef 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-10 09:34:16,352::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-10 09:34:16,353::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' >Thread-34::DEBUG::2014-07-10 09:34:16,353::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' (0 active users) >Thread-34::DEBUG::2014-07-10 09:34:16,353::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-10 09:34:16,353::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', Clearing records. >Thread-34::DEBUG::2014-07-10 09:34:16,353::task::990::TaskManager.Task::(_decref) Task=`852d8856-e6e9-4ae7-af22-ebf88ca8ad98`::ref 0 aborting False >Thread-18::DEBUG::2014-07-10 09:34:17,746::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/metadata bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-10 09:34:17,769::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000826551 s, 5.0 MB/s\n'; <rc> = 0 >Thread-57::DEBUG::2014-07-10 09:34:17,824::task::595::TaskManager.Task::(_updateState) Task=`8036aaba-14f9-4db3-9366-7296f232b673`::moving from state init -> state preparing >Thread-57::INFO::2014-07-10 09:34:17,825::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='b6f6c0da-e67f-4902-b9ac-3069571a42fe', volUUID='c4cd1da8-05b7-45e0-80b1-1183d21443d9', options=None) >Thread-57::INFO::2014-07-10 09:34:17,825::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-57::DEBUG::2014-07-10 09:34:17,826::task::1185::TaskManager.Task::(prepare) Task=`8036aaba-14f9-4db3-9366-7296f232b673`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-57::DEBUG::2014-07-10 09:34:17,826::task::595::TaskManager.Task::(_updateState) Task=`8036aaba-14f9-4db3-9366-7296f232b673`::moving from state preparing -> state finished >Thread-57::DEBUG::2014-07-10 09:34:17,826::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-57::DEBUG::2014-07-10 09:34:17,826::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-57::DEBUG::2014-07-10 09:34:17,826::task::990::TaskManager.Task::(_decref) Task=`8036aaba-14f9-4db3-9366-7296f232b673`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 09:34:18,027::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:34:18,137::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.040724 s, 25.1 MB/s\n'; <rc> = 0 >Thread-40::DEBUG::2014-07-10 09:34:18,502::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lion.qa.lab.tlv.redhat.com:_export_yuri2_backup2/6a70504d-00df-4869-8695-0f442053f6b6/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-40::DEBUG::2014-07-10 09:34:18,522::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n369 bytes (369 B) copied, 0.000554779 s, 665 kB/s\n'; <rc> = 0 >Thread-67::DEBUG::2014-07-10 09:34:18,810::task::595::TaskManager.Task::(_updateState) Task=`39fbeb95-ee88-4938-b7fb-d99da66bb490`::moving from state init -> state preparing >Thread-67::INFO::2014-07-10 09:34:18,811::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='f30c2cb7-a43a-4bf5-82b5-cfe07336f65c', volUUID='b0fbb3c9-55af-4a3a-95ad-fc56a80b9cf5', options=None) >Thread-67::INFO::2014-07-10 09:34:18,811::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-67::DEBUG::2014-07-10 09:34:18,811::task::1185::TaskManager.Task::(prepare) Task=`39fbeb95-ee88-4938-b7fb-d99da66bb490`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-67::DEBUG::2014-07-10 09:34:18,811::task::595::TaskManager.Task::(_updateState) Task=`39fbeb95-ee88-4938-b7fb-d99da66bb490`::moving from state preparing -> state finished >Thread-67::DEBUG::2014-07-10 09:34:18,812::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-67::DEBUG::2014-07-10 09:34:18,812::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-67::DEBUG::2014-07-10 09:34:18,812::task::990::TaskManager.Task::(_decref) Task=`39fbeb95-ee88-4938-b7fb-d99da66bb490`::ref 0 aborting False >Thread-48::DEBUG::2014-07-10 09:34:19,380::task::595::TaskManager.Task::(_updateState) Task=`0dc3580f-beeb-42d9-9751-611af31f72be`::moving from state init -> state preparing >Thread-48::INFO::2014-07-10 09:34:19,381::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='0cd7d6ce-f497-4243-a690-c57744861eea', volUUID='10b6a7dd-dc6c-43fa-ba17-92e4331b0e0b', options=None) >Thread-48::INFO::2014-07-10 09:34:19,381::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-48::DEBUG::2014-07-10 09:34:19,381::task::1185::TaskManager.Task::(prepare) Task=`0dc3580f-beeb-42d9-9751-611af31f72be`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-48::DEBUG::2014-07-10 09:34:19,381::task::595::TaskManager.Task::(_updateState) Task=`0dc3580f-beeb-42d9-9751-611af31f72be`::moving from state preparing -> state finished >Thread-48::DEBUG::2014-07-10 09:34:19,382::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-48::DEBUG::2014-07-10 09:34:19,382::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-48::DEBUG::2014-07-10 09:34:19,382::task::990::TaskManager.Task::(_decref) Task=`0dc3580f-beeb-42d9-9751-611af31f72be`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 09:34:20,153::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:34:20,241::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0298731 s, 34.3 MB/s\n'; <rc> = 0 >Thread-76::DEBUG::2014-07-10 09:34:20,743::task::595::TaskManager.Task::(_updateState) Task=`2b2bdb60-b4e8-4583-83fc-7c020b7480ee`::moving from state init -> state preparing >Thread-76::INFO::2014-07-10 09:34:20,743::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='e4c65229-4247-4b33-b72a-f1d5ce72ad05', volUUID='cad94284-3ca9-4c30-933d-997f4460309e', options=None) >Thread-76::INFO::2014-07-10 09:34:20,744::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-76::DEBUG::2014-07-10 09:34:20,744::task::1185::TaskManager.Task::(prepare) Task=`2b2bdb60-b4e8-4583-83fc-7c020b7480ee`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-76::DEBUG::2014-07-10 09:34:20,744::task::595::TaskManager.Task::(_updateState) Task=`2b2bdb60-b4e8-4583-83fc-7c020b7480ee`::moving from state preparing -> state finished >Thread-76::DEBUG::2014-07-10 09:34:20,744::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-76::DEBUG::2014-07-10 09:34:20,745::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-76::DEBUG::2014-07-10 09:34:20,745::task::990::TaskManager.Task::(_decref) Task=`2b2bdb60-b4e8-4583-83fc-7c020b7480ee`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 09:34:22,257::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:34:22,366::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0388248 s, 26.4 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:34:24,382::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:34:24,476::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0355645 s, 28.8 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 09:34:26,378::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-14::DEBUG::2014-07-10 09:34:26,379::task::595::TaskManager.Task::(_updateState) Task=`c6804585-94c5-4f63-af2e-e65e124eb63a`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 09:34:26,380::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-14::INFO::2014-07-10 09:34:26,380::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:34:26,381::task::1185::TaskManager.Task::(prepare) Task=`c6804585-94c5-4f63-af2e-e65e124eb63a`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:34:26,381::task::595::TaskManager.Task::(_updateState) Task=`c6804585-94c5-4f63-af2e-e65e124eb63a`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 09:34:26,381::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 09:34:26,381::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 09:34:26,381::task::990::TaskManager.Task::(_decref) Task=`c6804585-94c5-4f63-af2e-e65e124eb63a`::ref 0 aborting False >Thread-34::DEBUG::2014-07-10 09:34:26,385::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-34::DEBUG::2014-07-10 09:34:26,386::task::595::TaskManager.Task::(_updateState) Task=`806fdb7e-1502-4d19-ae0d-23fedc68a7b5`::moving from state init -> state preparing >Thread-34::INFO::2014-07-10 09:34:26,386::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-34::DEBUG::2014-07-10 09:34:26,386::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`916d9f3c-a6e9-4c1d-95f4-e39e60a6f923`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-10 09:34:26,387::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' for lock type 'shared' >Thread-34::DEBUG::2014-07-10 09:34:26,387::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-10 09:34:26,387::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`916d9f3c-a6e9-4c1d-95f4-e39e60a6f923`::Granted request >Thread-34::DEBUG::2014-07-10 09:34:26,387::task::827::TaskManager.Task::(resourceAcquired) Task=`806fdb7e-1502-4d19-ae0d-23fedc68a7b5`::_resourcesAcquired: Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee (shared) >Thread-34::DEBUG::2014-07-10 09:34:26,388::task::990::TaskManager.Task::(_decref) Task=`806fdb7e-1502-4d19-ae0d-23fedc68a7b5`::ref 1 aborting False >Thread-34::INFO::2014-07-10 09:34:26,389::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532067385344', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:34:26,389::task::1185::TaskManager.Task::(prepare) Task=`806fdb7e-1502-4d19-ae0d-23fedc68a7b5`::finished: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532067385344', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:34:26,389::task::595::TaskManager.Task::(_updateState) Task=`806fdb7e-1502-4d19-ae0d-23fedc68a7b5`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-10 09:34:26,389::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee': < ResourceRef 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-10 09:34:26,389::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-10 09:34:26,390::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' >Thread-34::DEBUG::2014-07-10 09:34:26,390::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' (0 active users) >Thread-34::DEBUG::2014-07-10 09:34:26,390::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-10 09:34:26,390::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', Clearing records. >Thread-34::DEBUG::2014-07-10 09:34:26,390::task::990::TaskManager.Task::(_decref) Task=`806fdb7e-1502-4d19-ae0d-23fedc68a7b5`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 09:34:26,491::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:34:26,578::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0295672 s, 34.6 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-10 09:34:27,798::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/metadata bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-10 09:34:27,820::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000913906 s, 4.5 MB/s\n'; <rc> = 0 >Thread-40::DEBUG::2014-07-10 09:34:28,551::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lion.qa.lab.tlv.redhat.com:_export_yuri2_backup2/6a70504d-00df-4869-8695-0f442053f6b6/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-40::DEBUG::2014-07-10 09:34:28,572::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n369 bytes (369 B) copied, 0.000551262 s, 669 kB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:34:28,594::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:34:28,686::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.03461 s, 29.6 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 09:34:30,525::task::595::TaskManager.Task::(_updateState) Task=`24a70dbd-1c27-4b0c-8cc1-05d3ef0918cf`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 09:34:30,525::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::INFO::2014-07-10 09:34:30,526::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000913906', 'lastCheck': '2.7', 'valid': True}, '6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000551262', 'lastCheck': '2.0', 'valid': True}} >Thread-14::DEBUG::2014-07-10 09:34:30,526::task::1185::TaskManager.Task::(prepare) Task=`24a70dbd-1c27-4b0c-8cc1-05d3ef0918cf`::finished: {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000913906', 'lastCheck': '2.7', 'valid': True}, '6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000551262', 'lastCheck': '2.0', 'valid': True}} >Thread-14::DEBUG::2014-07-10 09:34:30,526::task::595::TaskManager.Task::(_updateState) Task=`24a70dbd-1c27-4b0c-8cc1-05d3ef0918cf`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 09:34:30,526::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 09:34:30,527::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 09:34:30,527::task::990::TaskManager.Task::(_decref) Task=`24a70dbd-1c27-4b0c-8cc1-05d3ef0918cf`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 09:34:30,701::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:34:30,794::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0333479 s, 30.7 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:34:32,810::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:34:32,901::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.03128 s, 32.7 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:34:34,920::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:34:35,010::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0281296 s, 36.4 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 09:34:36,420::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-14::DEBUG::2014-07-10 09:34:36,422::task::595::TaskManager.Task::(_updateState) Task=`c7d47d0b-9461-458b-acbd-ee8952df513c`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 09:34:36,422::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-14::INFO::2014-07-10 09:34:36,422::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:34:36,423::task::1185::TaskManager.Task::(prepare) Task=`c7d47d0b-9461-458b-acbd-ee8952df513c`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:34:36,423::task::595::TaskManager.Task::(_updateState) Task=`c7d47d0b-9461-458b-acbd-ee8952df513c`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 09:34:36,423::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 09:34:36,423::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 09:34:36,424::task::990::TaskManager.Task::(_decref) Task=`c7d47d0b-9461-458b-acbd-ee8952df513c`::ref 0 aborting False >Thread-34::DEBUG::2014-07-10 09:34:36,428::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-34::DEBUG::2014-07-10 09:34:36,428::task::595::TaskManager.Task::(_updateState) Task=`3886e09b-eae9-44af-abad-e9d2825de64f`::moving from state init -> state preparing >Thread-34::INFO::2014-07-10 09:34:36,428::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-34::DEBUG::2014-07-10 09:34:36,429::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`febda6cb-b096-48de-812b-265e865cdd56`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-10 09:34:36,429::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' for lock type 'shared' >Thread-34::DEBUG::2014-07-10 09:34:36,430::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-10 09:34:36,430::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`febda6cb-b096-48de-812b-265e865cdd56`::Granted request >Thread-34::DEBUG::2014-07-10 09:34:36,430::task::827::TaskManager.Task::(resourceAcquired) Task=`3886e09b-eae9-44af-abad-e9d2825de64f`::_resourcesAcquired: Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee (shared) >Thread-34::DEBUG::2014-07-10 09:34:36,431::task::990::TaskManager.Task::(_decref) Task=`3886e09b-eae9-44af-abad-e9d2825de64f`::ref 1 aborting False >Thread-34::INFO::2014-07-10 09:34:36,432::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532067385344', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:34:36,432::task::1185::TaskManager.Task::(prepare) Task=`3886e09b-eae9-44af-abad-e9d2825de64f`::finished: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532067385344', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:34:36,432::task::595::TaskManager.Task::(_updateState) Task=`3886e09b-eae9-44af-abad-e9d2825de64f`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-10 09:34:36,432::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee': < ResourceRef 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-10 09:34:36,433::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-10 09:34:36,433::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' >Thread-34::DEBUG::2014-07-10 09:34:36,433::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' (0 active users) >Thread-34::DEBUG::2014-07-10 09:34:36,433::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-10 09:34:36,433::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', Clearing records. >Thread-34::DEBUG::2014-07-10 09:34:36,434::task::990::TaskManager.Task::(_decref) Task=`3886e09b-eae9-44af-abad-e9d2825de64f`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 09:34:37,024::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:34:37,117::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0350516 s, 29.2 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-10 09:34:37,849::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/metadata bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-10 09:34:37,870::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000683672 s, 6.0 MB/s\n'; <rc> = 0 >Thread-70::DEBUG::2014-07-10 09:34:37,939::task::595::TaskManager.Task::(_updateState) Task=`89a0c7e4-2d85-41a7-8fa9-7dff5cbc8dfc`::moving from state init -> state preparing >Thread-70::INFO::2014-07-10 09:34:37,939::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='cfaeead2-7caa-467c-b389-c89840ae6605', volUUID='567fe32d-31a6-4ff6-90f3-fd6a656fbecc', options=None) >Thread-70::INFO::2014-07-10 09:34:37,940::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-70::DEBUG::2014-07-10 09:34:37,940::task::1185::TaskManager.Task::(prepare) Task=`89a0c7e4-2d85-41a7-8fa9-7dff5cbc8dfc`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-70::DEBUG::2014-07-10 09:34:37,940::task::595::TaskManager.Task::(_updateState) Task=`89a0c7e4-2d85-41a7-8fa9-7dff5cbc8dfc`::moving from state preparing -> state finished >Thread-70::DEBUG::2014-07-10 09:34:37,940::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-70::DEBUG::2014-07-10 09:34:37,941::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-70::DEBUG::2014-07-10 09:34:37,941::task::990::TaskManager.Task::(_decref) Task=`89a0c7e4-2d85-41a7-8fa9-7dff5cbc8dfc`::ref 0 aborting False >Thread-40::DEBUG::2014-07-10 09:34:38,602::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lion.qa.lab.tlv.redhat.com:_export_yuri2_backup2/6a70504d-00df-4869-8695-0f442053f6b6/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-40::DEBUG::2014-07-10 09:34:38,623::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n369 bytes (369 B) copied, 0.000471194 s, 783 kB/s\n'; <rc> = 0 >Thread-60::DEBUG::2014-07-10 09:34:38,898::task::595::TaskManager.Task::(_updateState) Task=`bf6f15ae-ee31-45a4-859d-c94e178e06bf`::moving from state init -> state preparing >Thread-60::INFO::2014-07-10 09:34:38,898::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='b034d5b0-e1e0-4011-b49b-4d45ddb11556', volUUID='3d7f62b5-328f-4d8e-8b69-873cfb5ae14d', options=None) >Thread-60::INFO::2014-07-10 09:34:38,899::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-60::DEBUG::2014-07-10 09:34:38,899::task::1185::TaskManager.Task::(prepare) Task=`bf6f15ae-ee31-45a4-859d-c94e178e06bf`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-60::DEBUG::2014-07-10 09:34:38,899::task::595::TaskManager.Task::(_updateState) Task=`bf6f15ae-ee31-45a4-859d-c94e178e06bf`::moving from state preparing -> state finished >Thread-60::DEBUG::2014-07-10 09:34:38,899::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-60::DEBUG::2014-07-10 09:34:38,900::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-60::DEBUG::2014-07-10 09:34:38,900::task::990::TaskManager.Task::(_decref) Task=`bf6f15ae-ee31-45a4-859d-c94e178e06bf`::ref 0 aborting False >Thread-51::DEBUG::2014-07-10 09:34:38,949::task::595::TaskManager.Task::(_updateState) Task=`384d4f3d-ec02-46a3-91ef-25ccd4f8a561`::moving from state init -> state preparing >Thread-51::INFO::2014-07-10 09:34:38,949::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='76fdb054-02cd-42ed-9721-b3e65b34c3a4', volUUID='022dfe46-2cf7-4915-80b3-883158e3ca83', options=None) >Thread-51::INFO::2014-07-10 09:34:38,950::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-51::DEBUG::2014-07-10 09:34:38,953::task::1185::TaskManager.Task::(prepare) Task=`384d4f3d-ec02-46a3-91ef-25ccd4f8a561`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-51::DEBUG::2014-07-10 09:34:38,953::task::595::TaskManager.Task::(_updateState) Task=`384d4f3d-ec02-46a3-91ef-25ccd4f8a561`::moving from state preparing -> state finished >Thread-51::DEBUG::2014-07-10 09:34:38,953::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-51::DEBUG::2014-07-10 09:34:38,953::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-51::DEBUG::2014-07-10 09:34:38,953::task::990::TaskManager.Task::(_decref) Task=`384d4f3d-ec02-46a3-91ef-25ccd4f8a561`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 09:34:39,132::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:34:39,231::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0340038 s, 30.1 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:34:41,247::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:34:41,334::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0300181 s, 34.1 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:34:43,350::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:34:43,445::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0360286 s, 28.4 MB/s\n'; <rc> = 0 >Thread-34::DEBUG::2014-07-10 09:34:45,140::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-34::DEBUG::2014-07-10 09:34:45,141::task::595::TaskManager.Task::(_updateState) Task=`fe34f0a1-0a97-45fd-93d2-486a8c8dc923`::moving from state init -> state preparing >Thread-34::INFO::2014-07-10 09:34:45,142::logUtils::44::dispatcher::(wrapper) Run and protect: updateVM(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', vmList=[{'imglist': 'b034d5b0-e1e0-4011-b49b-4d45ddb11556', 'ovf': '<?xml version=\'1.0\' encoding=\'UTF-8\'?><ovf:Envelope xmlns:ovf="http://schemas.dmtf.org/ovf/envelope/1/" xmlns:rasd="http://schemas.dmtf.org/wbem/wscim/1/cim-schema/2/CIM_ResourceAllocationSettingData" xmlns:vssd="http://schemas.dmtf.org/wbem/wscim/1/cim-schema/2/CIM_VirtualSystemSettingData" xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance" ovf:version="3.4.0.0"><References><File ovf:href="b034d5b0-e1e0-4011-b49b-4d45ddb11556/3d7f62b5-328f-4d8e-8b69-873cfb5ae14d" ovf:id="3d7f62b5-328f-4d8e-8b69-873cfb5ae14d" ovf:size="10737418240" ovf:description="Active VM"/><Nic ovf:id="602ac16a-040a-4ac7-9705-82e954c48629"/></References><Section xsi:type="ovf:NetworkSection_Type"><Info>List of networks</Info><Network ovf:name="Network 1"/></Section><Section xsi:type="ovf:DiskSection_Type"><Info>List of Virtual Disks</Info><Disk ovf:diskId="3d7f62b5-328f-4d8e-8b69-873cfb5ae14d" ovf:size="10" ovf:actual_size="1" ovf:vm_snapshot_id="624441a6-a174-4313-a693-b557aae35d4d" ovf:parentRef="" ovf:fileRef="b034d5b0-e1e0-4011-b49b-4d45ddb11556/3d7f62b5-328f-4d8e-8b69-873cfb5ae14d" ovf:format="http://www.gnome.org/~markmc/qcow-image-format.html" ovf:volume-format="COW" ovf:volume-type="Sparse" ovf:disk-interface="VirtIO" ovf:boot="true" ovf:disk-alias="vm_4_fake_Disk1" ovf:wipe-after-delete="false"/></Section><Content ovf:id="out" xsi:type="ovf:VirtualSystem_Type"><Description></Description><CreationDate>2014/07/10 08:59:23</CreationDate><ExportDate>2014/07/10 09:31:59</ExportDate><DeleteProtected>false</DeleteProtected><SsoMethod>guest_agent</SsoMethod><IsSmartcardEnabled>false</IsSmartcardEnabled><TimeZone></TimeZone><default_boot_sequence>0</default_boot_sequence><Generation>2</Generation><VmType>1</VmType><MinAllocatedMem>1024</MinAllocatedMem><IsStateless>false</IsStateless><IsRunAndPause>false</IsRunAndPause><AutoStartup>false</AutoStartup><Priority>1</Priority><CreatedByUserId>fdfc627c-d875-11e0-90f0-83df133b58cc</CreatedByUserId><Name>scale_5</Name><TemplateId>0670c2d7-3c1c-4b42-800c-060445cb5530</TemplateId><TemplateName>new_templ_4_fake</TemplateName><IsInitilized>true</IsInitilized><Origin>3</Origin><app_list>kernel-2.6.32-431.el6,rhevm-guest-agent-common-1.0.9-1.el6ev</app_list><DefaultDisplayType>1</DefaultDisplayType><TrustedService>false</TrustedService><OriginalTemplateId>0670c2d7-3c1c-4b42-800c-060445cb5530</OriginalTemplateId><OriginalTemplateName>new_templ_4_fake</OriginalTemplateName><UseLatestVersion>false</UseLatestVersion><Section ovf:id="2386fa8c-f537-495c-ae07-e178171d77f2" ovf:required="false" xsi:type="ovf:OperatingSystemSection_Type"><Info>Guest Operating System</Info><Description>rhel_7x64</Description></Section><Section xsi:type="ovf:VirtualHardwareSection_Type"><Info>2 CPU, 1024 Memeory</Info><System><vssd:VirtualSystemType>ENGINE 3.4.0.0</vssd:VirtualSystemType></System><Item><rasd:Caption>2 virtual cpu</rasd:Caption><rasd:Description>Number of virtual CPU</rasd:Description><rasd:InstanceId>1</rasd:InstanceId><rasd:ResourceType>3</rasd:ResourceType><rasd:num_of_sockets>1</rasd:num_of_sockets><rasd:cpu_per_socket>2</rasd:cpu_per_socket></Item><Item><rasd:Caption>1024 MB of memory</rasd:Caption><rasd:Description>Memory Size</rasd:Description><rasd:InstanceId>2</rasd:InstanceId><rasd:ResourceType>4</rasd:ResourceType><rasd:AllocationUnits>MegaBytes</rasd:AllocationUnits><rasd:VirtualQuantity>1024</rasd:VirtualQuantity></Item><Item><rasd:Caption>vm_4_fake_Disk1</rasd:Caption><rasd:InstanceId>3d7f62b5-328f-4d8e-8b69-873cfb5ae14d</rasd:InstanceId><rasd:ResourceType>17</rasd:ResourceType><rasd:HostResource>b034d5b0-e1e0-4011-b49b-4d45ddb11556/3d7f62b5-328f-4d8e-8b69-873cfb5ae14d</rasd:HostResource><rasd:Parent>47592965-e853-4e59-9728-d11cca6a7a8a</rasd:Parent><rasd:Template>47592965-e853-4e59-9728-d11cca6a7a8a</rasd:Template><rasd:ApplicationList></rasd:ApplicationList><rasd:StorageId>9e1aa540-1f4e-4ee3-a152-be381ef6c3bd</rasd:StorageId><rasd:StoragePoolId>4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee</rasd:StoragePoolId><rasd:CreationDate>2014/07/10 09:02:16</rasd:CreationDate><rasd:LastModified>2014/07/10 09:02:16</rasd:LastModified><rasd:last_modified_date>2014/07/10 09:31:59</rasd:last_modified_date></Item><Item><rasd:Caption>Ethernet adapter on rhevm</rasd:Caption><rasd:InstanceId>602ac16a-040a-4ac7-9705-82e954c48629</rasd:InstanceId><rasd:ResourceType>10</rasd:ResourceType><rasd:OtherResourceType>rhevm</rasd:OtherResourceType><rasd:ResourceSubType>3</rasd:ResourceSubType><rasd:Connection>rhevm</rasd:Connection><rasd:Linked>true</rasd:Linked><rasd:Name>nic1</rasd:Name><rasd:MACAddress>00:1a:4a:de:6d:7c</rasd:MACAddress><rasd:speed>1000</rasd:speed></Item><Item><rasd:Caption>USB Controller</rasd:Caption><rasd:InstanceId>3</rasd:InstanceId><rasd:ResourceType>23</rasd:ResourceType><rasd:UsbPolicy>DISABLED</rasd:UsbPolicy></Item></Section></Content></ovf:Envelope>', 'vm': '2386fa8c-f537-495c-ae07-e178171d77f2'}, {'imglist': '76fdb054-02cd-42ed-9721-b3e65b34c3a4', 'ovf': '<?xml version=\'1.0\' encoding=\'UTF-8\'?><ovf:Envelope xmlns:ovf="http://schemas.dmtf.org/ovf/envelope/1/" xmlns:rasd="http://schemas.dmtf.org/wbem/wscim/1/cim-schema/2/CIM_ResourceAllocationSettingData" xmlns:vssd="http://schemas.dmtf.org/wbem/wscim/1/cim-schema/2/CIM_VirtualSystemSettingData" xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance" ovf:version="3.4.0.0"><References><File ovf:href="76fdb054-02cd-42ed-9721-b3e65b34c3a4/022dfe46-2cf7-4915-80b3-883158e3ca83" ovf:id="022dfe46-2cf7-4915-80b3-883158e3ca83" ovf:size="10737418240" ovf:description="Active VM"/><Nic ovf:id="eadb1867-f1dc-4a3f-bc2b-e7b3bb16147f"/></References><Section xsi:type="ovf:NetworkSection_Type"><Info>List of networks</Info><Network ovf:name="Network 1"/></Section><Section xsi:type="ovf:DiskSection_Type"><Info>List of Virtual Disks</Info><Disk ovf:diskId="022dfe46-2cf7-4915-80b3-883158e3ca83" ovf:size="10" ovf:actual_size="1" ovf:vm_snapshot_id="f4ea2a87-51d7-4ae7-9492-fc553f284ab0" ovf:parentRef="" ovf:fileRef="76fdb054-02cd-42ed-9721-b3e65b34c3a4/022dfe46-2cf7-4915-80b3-883158e3ca83" ovf:format="http://www.gnome.org/~markmc/qcow-image-format.html" ovf:volume-format="COW" ovf:volume-type="Sparse" ovf:disk-interface="VirtIO" ovf:boot="true" ovf:disk-alias="vm_4_fake_Disk1" ovf:wipe-after-delete="false"/></Section><Content ovf:id="out" xsi:type="ovf:VirtualSystem_Type"><Description></Description><CreationDate>2014/07/10 08:58:25</CreationDate><ExportDate>2014/07/10 09:31:59</ExportDate><DeleteProtected>false</DeleteProtected><SsoMethod>guest_agent</SsoMethod><IsSmartcardEnabled>false</IsSmartcardEnabled><TimeZone></TimeZone><default_boot_sequence>0</default_boot_sequence><Generation>2</Generation><VmType>1</VmType><MinAllocatedMem>1024</MinAllocatedMem><IsStateless>false</IsStateless><IsRunAndPause>false</IsRunAndPause><AutoStartup>false</AutoStartup><Priority>1</Priority><CreatedByUserId>fdfc627c-d875-11e0-90f0-83df133b58cc</CreatedByUserId><Name>scale_2</Name><TemplateId>0670c2d7-3c1c-4b42-800c-060445cb5530</TemplateId><TemplateName>new_templ_4_fake</TemplateName><IsInitilized>true</IsInitilized><Origin>3</Origin><app_list>kernel-2.6.32-431.el6,rhevm-guest-agent-common-1.0.9-1.el6ev</app_list><DefaultDisplayType>1</DefaultDisplayType><TrustedService>false</TrustedService><OriginalTemplateId>0670c2d7-3c1c-4b42-800c-060445cb5530</OriginalTemplateId><OriginalTemplateName>new_templ_4_fake</OriginalTemplateName><UseLatestVersion>false</UseLatestVersion><Section ovf:id="52e238aa-e62a-48a8-a200-604e72422f3f" ovf:required="false" xsi:type="ovf:OperatingSystemSection_Type"><Info>Guest Operating System</Info><Description>rhel_7x64</Description></Section><Section xsi:type="ovf:VirtualHardwareSection_Type"><Info>2 CPU, 1024 Memeory</Info><System><vssd:VirtualSystemType>ENGINE 3.4.0.0</vssd:VirtualSystemType></System><Item><rasd:Caption>2 virtual cpu</rasd:Caption><rasd:Description>Number of virtual CPU</rasd:Description><rasd:InstanceId>1</rasd:InstanceId><rasd:ResourceType>3</rasd:ResourceType><rasd:num_of_sockets>1</rasd:num_of_sockets><rasd:cpu_per_socket>2</rasd:cpu_per_socket></Item><Item><rasd:Caption>1024 MB of memory</rasd:Caption><rasd:Description>Memory Size</rasd:Description><rasd:InstanceId>2</rasd:InstanceId><rasd:ResourceType>4</rasd:ResourceType><rasd:AllocationUnits>MegaBytes</rasd:AllocationUnits><rasd:VirtualQuantity>1024</rasd:VirtualQuantity></Item><Item><rasd:Caption>vm_4_fake_Disk1</rasd:Caption><rasd:InstanceId>022dfe46-2cf7-4915-80b3-883158e3ca83</rasd:InstanceId><rasd:ResourceType>17</rasd:ResourceType><rasd:HostResource>76fdb054-02cd-42ed-9721-b3e65b34c3a4/022dfe46-2cf7-4915-80b3-883158e3ca83</rasd:HostResource><rasd:Parent>47592965-e853-4e59-9728-d11cca6a7a8a</rasd:Parent><rasd:Template>47592965-e853-4e59-9728-d11cca6a7a8a</rasd:Template><rasd:ApplicationList></rasd:ApplicationList><rasd:StorageId>9e1aa540-1f4e-4ee3-a152-be381ef6c3bd</rasd:StorageId><rasd:StoragePoolId>4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee</rasd:StoragePoolId><rasd:CreationDate>2014/07/10 09:01:18</rasd:CreationDate><rasd:LastModified>2014/07/10 09:01:18</rasd:LastModified><rasd:last_modified_date>2014/07/10 09:31:59</rasd:last_modified_date></Item><Item><rasd:Caption>Ethernet adapter on rhevm</rasd:Caption><rasd:InstanceId>eadb1867-f1dc-4a3f-bc2b-e7b3bb16147f</rasd:InstanceId><rasd:ResourceType>10</rasd:ResourceType><rasd:OtherResourceType>rhevm</rasd:OtherResourceType><rasd:ResourceSubType>3</rasd:ResourceSubType><rasd:Connection>rhevm</rasd:Connection><rasd:Linked>true</rasd:Linked><rasd:Name>nic1</rasd:Name><rasd:MACAddress>00:1a:4a:de:6d:7b</rasd:MACAddress><rasd:speed>1000</rasd:speed></Item><Item><rasd:Caption>USB Controller</rasd:Caption><rasd:InstanceId>3</rasd:InstanceId><rasd:ResourceType>23</rasd:ResourceType><rasd:UsbPolicy>DISABLED</rasd:UsbPolicy></Item></Section></Content></ovf:Envelope>', 'vm': '52e238aa-e62a-48a8-a200-604e72422f3f'}, {'imglist': 'f30c2cb7-a43a-4bf5-82b5-cfe07336f65c', 'ovf': '<?xml version=\'1.0\' encoding=\'UTF-8\'?><ovf:Envelope xmlns:ovf="http://schemas.dmtf.org/ovf/envelope/1/" xmlns:rasd="http://schemas.dmtf.org/wbem/wscim/1/cim-schema/2/CIM_ResourceAllocationSettingData" xmlns:vssd="http://schemas.dmtf.org/wbem/wscim/1/cim-schema/2/CIM_VirtualSystemSettingData" xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance" ovf:version="3.4.0.0"><References><File ovf:href="f30c2cb7-a43a-4bf5-82b5-cfe07336f65c/b0fbb3c9-55af-4a3a-95ad-fc56a80b9cf5" ovf:id="b0fbb3c9-55af-4a3a-95ad-fc56a80b9cf5" ovf:size="10737418240" ovf:description="Active VM"/><Nic ovf:id="9aad6e0d-00f0-411d-8c91-c4a387f13d81"/></References><Section xsi:type="ovf:NetworkSection_Type"><Info>List of networks</Info><Network ovf:name="Network 1"/></Section><Section xsi:type="ovf:DiskSection_Type"><Info>List of Virtual Disks</Info><Disk ovf:diskId="b0fbb3c9-55af-4a3a-95ad-fc56a80b9cf5" ovf:size="10" ovf:actual_size="1" ovf:vm_snapshot_id="9c238f37-789d-41be-9ca8-ee3a44b18763" ovf:parentRef="" ovf:fileRef="f30c2cb7-a43a-4bf5-82b5-cfe07336f65c/b0fbb3c9-55af-4a3a-95ad-fc56a80b9cf5" ovf:format="http://www.gnome.org/~markmc/qcow-image-format.html" ovf:volume-format="COW" ovf:volume-type="Sparse" ovf:disk-interface="VirtIO" ovf:boot="true" ovf:disk-alias="vm_4_fake_Disk1" ovf:wipe-after-delete="false"/></Section><Content ovf:id="out" xsi:type="ovf:VirtualSystem_Type"><Description></Description><CreationDate>2014/07/10 09:00:03</CreationDate><ExportDate>2014/07/10 09:31:59</ExportDate><DeleteProtected>false</DeleteProtected><SsoMethod>guest_agent</SsoMethod><IsSmartcardEnabled>false</IsSmartcardEnabled><TimeZone></TimeZone><default_boot_sequence>0</default_boot_sequence><Generation>2</Generation><VmType>1</VmType><MinAllocatedMem>1024</MinAllocatedMem><IsStateless>false</IsStateless><IsRunAndPause>false</IsRunAndPause><AutoStartup>false</AutoStartup><Priority>1</Priority><CreatedByUserId>fdfc627c-d875-11e0-90f0-83df133b58cc</CreatedByUserId><Name>scale_7</Name><TemplateId>0670c2d7-3c1c-4b42-800c-060445cb5530</TemplateId><TemplateName>new_templ_4_fake</TemplateName><IsInitilized>true</IsInitilized><Origin>3</Origin><app_list>kernel-2.6.32-431.el6,rhevm-guest-agent-common-1.0.9-1.el6ev</app_list><DefaultDisplayType>1</DefaultDisplayType><TrustedService>false</TrustedService><OriginalTemplateId>0670c2d7-3c1c-4b42-800c-060445cb5530</OriginalTemplateId><OriginalTemplateName>new_templ_4_fake</OriginalTemplateName><UseLatestVersion>false</UseLatestVersion><Section ovf:id="a766ed65-ac2e-4862-8ff0-0352480cf6f1" ovf:required="false" xsi:type="ovf:OperatingSystemSection_Type"><Info>Guest Operating System</Info><Description>rhel_7x64</Description></Section><Section xsi:type="ovf:VirtualHardwareSection_Type"><Info>2 CPU, 1024 Memeory</Info><System><vssd:VirtualSystemType>ENGINE 3.4.0.0</vssd:VirtualSystemType></System><Item><rasd:Caption>2 virtual cpu</rasd:Caption><rasd:Description>Number of virtual CPU</rasd:Description><rasd:InstanceId>1</rasd:InstanceId><rasd:ResourceType>3</rasd:ResourceType><rasd:num_of_sockets>1</rasd:num_of_sockets><rasd:cpu_per_socket>2</rasd:cpu_per_socket></Item><Item><rasd:Caption>1024 MB of memory</rasd:Caption><rasd:Description>Memory Size</rasd:Description><rasd:InstanceId>2</rasd:InstanceId><rasd:ResourceType>4</rasd:ResourceType><rasd:AllocationUnits>MegaBytes</rasd:AllocationUnits><rasd:VirtualQuantity>1024</rasd:VirtualQuantity></Item><Item><rasd:Caption>vm_4_fake_Disk1</rasd:Caption><rasd:InstanceId>b0fbb3c9-55af-4a3a-95ad-fc56a80b9cf5</rasd:InstanceId><rasd:ResourceType>17</rasd:ResourceType><rasd:HostResource>f30c2cb7-a43a-4bf5-82b5-cfe07336f65c/b0fbb3c9-55af-4a3a-95ad-fc56a80b9cf5</rasd:HostResource><rasd:Parent>47592965-e853-4e59-9728-d11cca6a7a8a</rasd:Parent><rasd:Template>47592965-e853-4e59-9728-d11cca6a7a8a</rasd:Template><rasd:ApplicationList></rasd:ApplicationList><rasd:StorageId>9e1aa540-1f4e-4ee3-a152-be381ef6c3bd</rasd:StorageId><rasd:StoragePoolId>4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee</rasd:StoragePoolId><rasd:CreationDate>2014/07/10 09:02:56</rasd:CreationDate><rasd:LastModified>2014/07/10 09:02:56</rasd:LastModified><rasd:last_modified_date>2014/07/10 09:31:59</rasd:last_modified_date></Item><Item><rasd:Caption>Ethernet adapter on rhevm</rasd:Caption><rasd:InstanceId>9aad6e0d-00f0-411d-8c91-c4a387f13d81</rasd:InstanceId><rasd:ResourceType>10</rasd:ResourceType><rasd:OtherResourceType>rhevm</rasd:OtherResourceType><rasd:ResourceSubType>3</rasd:ResourceSubType><rasd:Connection>rhevm</rasd:Connection><rasd:Linked>true</rasd:Linked><rasd:Name>nic1</rasd:Name><rasd:MACAddress>00:1a:4a:de:6d:88</rasd:MACAddress><rasd:speed>1000</rasd:speed></Item><Item><rasd:Caption>USB Controller</rasd:Caption><rasd:InstanceId>3</rasd:InstanceId><rasd:ResourceType>23</rasd:ResourceType><rasd:UsbPolicy>DISABLED</rasd:UsbPolicy></Item></Section></Content></ovf:Envelope>', 'vm': 'a766ed65-ac2e-4862-8ff0-0352480cf6f1'}, {'imglist': 'aa20346a-4d3a-4e07-b8e1-52c0ebe4168c', 'ovf': '<?xml version=\'1.0\' encoding=\'UTF-8\'?><ovf:Envelope xmlns:ovf="http://schemas.dmtf.org/ovf/envelope/1/" xmlns:rasd="http://schemas.dmtf.org/wbem/wscim/1/cim-schema/2/CIM_ResourceAllocationSettingData" xmlns:vssd="http://schemas.dmtf.org/wbem/wscim/1/cim-schema/2/CIM_VirtualSystemSettingData" xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance" ovf:version="3.4.0.0"><References><File ovf:href="aa20346a-4d3a-4e07-b8e1-52c0ebe4168c/58fefce2-9bce-4bff-8949-8c6ce8122b27" ovf:id="58fefce2-9bce-4bff-8949-8c6ce8122b27" ovf:size="10737418240" ovf:description="Active VM"/><Nic ovf:id="0c0ab911-d156-4b66-b507-d8e5ca85c184"/></References><Section xsi:type="ovf:NetworkSection_Type"><Info>List of networks</Info><Network ovf:name="Network 1"/></Section><Section xsi:type="ovf:DiskSection_Type"><Info>List of Virtual Disks</Info><Disk ovf:diskId="58fefce2-9bce-4bff-8949-8c6ce8122b27" ovf:size="10" ovf:actual_size="1" ovf:vm_snapshot_id="877fef8d-5e93-4e1a-9447-26e02d85f080" ovf:parentRef="" ovf:fileRef="aa20346a-4d3a-4e07-b8e1-52c0ebe4168c/58fefce2-9bce-4bff-8949-8c6ce8122b27" ovf:format="http://www.gnome.org/~markmc/qcow-image-format.html" ovf:volume-format="COW" ovf:volume-type="Sparse" ovf:disk-interface="VirtIO" ovf:boot="true" ovf:disk-alias="vm_4_fake_Disk1" ovf:wipe-after-delete="false"/></Section><Content ovf:id="out" xsi:type="ovf:VirtualSystem_Type"><Description></Description><CreationDate>2014/07/10 08:59:45</CreationDate><ExportDate>2014/07/10 09:31:59</ExportDate><DeleteProtected>false</DeleteProtected><SsoMethod>guest_agent</SsoMethod><IsSmartcardEnabled>false</IsSmartcardEnabled><TimeZone></TimeZone><default_boot_sequence>0</default_boot_sequence><Generation>2</Generation><VmType>1</VmType><MinAllocatedMem>1024</MinAllocatedMem><IsStateless>false</IsStateless><IsRunAndPause>false</IsRunAndPause><AutoStartup>false</AutoStartup><Priority>1</Priority><CreatedByUserId>fdfc627c-d875-11e0-90f0-83df133b58cc</CreatedByUserId><Name>scale_6</Name><TemplateId>0670c2d7-3c1c-4b42-800c-060445cb5530</TemplateId><TemplateName>new_templ_4_fake</TemplateName><IsInitilized>true</IsInitilized><Origin>3</Origin><app_list>kernel-2.6.32-431.el6,rhevm-guest-agent-common-1.0.9-1.el6ev</app_list><DefaultDisplayType>1</DefaultDisplayType><TrustedService>false</TrustedService><OriginalTemplateId>0670c2d7-3c1c-4b42-800c-060445cb5530</OriginalTemplateId><OriginalTemplateName>new_templ_4_fake</OriginalTemplateName><UseLatestVersion>false</UseLatestVersion><Section ovf:id="7fc21bb8-bd92-4924-acef-8360998e92a1" ovf:required="false" xsi:type="ovf:OperatingSystemSection_Type"><Info>Guest Operating System</Info><Description>rhel_7x64</Description></Section><Section xsi:type="ovf:VirtualHardwareSection_Type"><Info>2 CPU, 1024 Memeory</Info><System><vssd:VirtualSystemType>ENGINE 3.4.0.0</vssd:VirtualSystemType></System><Item><rasd:Caption>2 virtual cpu</rasd:Caption><rasd:Description>Number of virtual CPU</rasd:Description><rasd:InstanceId>1</rasd:InstanceId><rasd:ResourceType>3</rasd:ResourceType><rasd:num_of_sockets>1</rasd:num_of_sockets><rasd:cpu_per_socket>2</rasd:cpu_per_socket></Item><Item><rasd:Caption>1024 MB of memory</rasd:Caption><rasd:Description>Memory Size</rasd:Description><rasd:InstanceId>2</rasd:InstanceId><rasd:ResourceType>4</rasd:ResourceType><rasd:AllocationUnits>MegaBytes</rasd:AllocationUnits><rasd:VirtualQuantity>1024</rasd:VirtualQuantity></Item><Item><rasd:Caption>vm_4_fake_Disk1</rasd:Caption><rasd:InstanceId>58fefce2-9bce-4bff-8949-8c6ce8122b27</rasd:InstanceId><rasd:ResourceType>17</rasd:ResourceType><rasd:HostResource>aa20346a-4d3a-4e07-b8e1-52c0ebe4168c/58fefce2-9bce-4bff-8949-8c6ce8122b27</rasd:HostResource><rasd:Parent>47592965-e853-4e59-9728-d11cca6a7a8a</rasd:Parent><rasd:Template>47592965-e853-4e59-9728-d11cca6a7a8a</rasd:Template><rasd:ApplicationList></rasd:ApplicationList><rasd:StorageId>9e1aa540-1f4e-4ee3-a152-be381ef6c3bd</rasd:StorageId><rasd:StoragePoolId>4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee</rasd:StoragePoolId><rasd:CreationDate>2014/07/10 09:02:43</rasd:CreationDate><rasd:LastModified>2014/07/10 09:02:43</rasd:LastModified><rasd:last_modified_date>2014/07/10 09:31:59</rasd:last_modified_date></Item><Item><rasd:Caption>Ethernet adapter on rhevm</rasd:Caption><rasd:InstanceId>0c0ab911-d156-4b66-b507-d8e5ca85c184</rasd:InstanceId><rasd:ResourceType>10</rasd:ResourceType><rasd:OtherResourceType>rhevm</rasd:OtherResourceType><rasd:ResourceSubType>3</rasd:ResourceSubType><rasd:Connection>rhevm</rasd:Connection><rasd:Linked>true</rasd:Linked><rasd:Name>nic1</rasd:Name><rasd:MACAddress>00:1a:4a:de:6d:7d</rasd:MACAddress><rasd:speed>1000</rasd:speed></Item><Item><rasd:Caption>USB Controller</rasd:Caption><rasd:InstanceId>3</rasd:InstanceId><rasd:ResourceType>23</rasd:ResourceType><rasd:UsbPolicy>DISABLED</rasd:UsbPolicy></Item></Section></Content></ovf:Envelope>', 'vm': '7fc21bb8-bd92-4924-acef-8360998e92a1'}, {'imglist': 'b6f6c0da-e67f-4902-b9ac-3069571a42fe', 'ovf': '<?xml version=\'1.0\' encoding=\'UTF-8\'?><ovf:Envelope xmlns:ovf="http://schemas.dmtf.org/ovf/envelope/1/" xmlns:rasd="http://schemas.dmtf.org/wbem/wscim/1/cim-schema/2/CIM_ResourceAllocationSettingData" xmlns:vssd="http://schemas.dmtf.org/wbem/wscim/1/cim-schema/2/CIM_VirtualSystemSettingData" xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance" ovf:version="3.4.0.0"><References><File ovf:href="b6f6c0da-e67f-4902-b9ac-3069571a42fe/c4cd1da8-05b7-45e0-80b1-1183d21443d9" ovf:id="c4cd1da8-05b7-45e0-80b1-1183d21443d9" ovf:size="10737418240" ovf:description="Active VM"/><Nic ovf:id="30e7f4b6-b9f0-4cfa-b0de-94e497ebc281"/></References><Section xsi:type="ovf:NetworkSection_Type"><Info>List of networks</Info><Network ovf:name="Network 1"/></Section><Section xsi:type="ovf:DiskSection_Type"><Info>List of Virtual Disks</Info><Disk ovf:diskId="c4cd1da8-05b7-45e0-80b1-1183d21443d9" ovf:size="10" ovf:actual_size="1" ovf:vm_snapshot_id="6c96208c-b6e2-4a3d-9ab4-ca5c1fc9bb60" ovf:parentRef="" ovf:fileRef="b6f6c0da-e67f-4902-b9ac-3069571a42fe/c4cd1da8-05b7-45e0-80b1-1183d21443d9" ovf:format="http://www.gnome.org/~markmc/qcow-image-format.html" ovf:volume-format="COW" ovf:volume-type="Sparse" ovf:disk-interface="VirtIO" ovf:boot="true" ovf:disk-alias="vm_4_fake_Disk1" ovf:wipe-after-delete="false"/></Section><Content ovf:id="out" xsi:type="ovf:VirtualSystem_Type"><Description></Description><CreationDate>2014/07/10 08:59:05</CreationDate><ExportDate>2014/07/10 09:31:59</ExportDate><DeleteProtected>false</DeleteProtected><SsoMethod>guest_agent</SsoMethod><IsSmartcardEnabled>false</IsSmartcardEnabled><TimeZone></TimeZone><default_boot_sequence>0</default_boot_sequence><Generation>2</Generation><VmType>1</VmType><MinAllocatedMem>1024</MinAllocatedMem><IsStateless>false</IsStateless><IsRunAndPause>false</IsRunAndPause><AutoStartup>false</AutoStartup><Priority>1</Priority><CreatedByUserId>fdfc627c-d875-11e0-90f0-83df133b58cc</CreatedByUserId><Name>scale_4</Name><TemplateId>0670c2d7-3c1c-4b42-800c-060445cb5530</TemplateId><TemplateName>new_templ_4_fake</TemplateName><IsInitilized>true</IsInitilized><Origin>3</Origin><app_list>kernel-2.6.32-431.el6,rhevm-guest-agent-common-1.0.9-1.el6ev</app_list><DefaultDisplayType>1</DefaultDisplayType><TrustedService>false</TrustedService><OriginalTemplateId>0670c2d7-3c1c-4b42-800c-060445cb5530</OriginalTemplateId><OriginalTemplateName>new_templ_4_fake</OriginalTemplateName><UseLatestVersion>false</UseLatestVersion><Section ovf:id="0e968db5-5d49-467f-9ff3-afc37b64364f" ovf:required="false" xsi:type="ovf:OperatingSystemSection_Type"><Info>Guest Operating System</Info><Description>rhel_7x64</Description></Section><Section xsi:type="ovf:VirtualHardwareSection_Type"><Info>2 CPU, 1024 Memeory</Info><System><vssd:VirtualSystemType>ENGINE 3.4.0.0</vssd:VirtualSystemType></System><Item><rasd:Caption>2 virtual cpu</rasd:Caption><rasd:Description>Number of virtual CPU</rasd:Description><rasd:InstanceId>1</rasd:InstanceId><rasd:ResourceType>3</rasd:ResourceType><rasd:num_of_sockets>1</rasd:num_of_sockets><rasd:cpu_per_socket>2</rasd:cpu_per_socket></Item><Item><rasd:Caption>1024 MB of memory</rasd:Caption><rasd:Description>Memory Size</rasd:Description><rasd:InstanceId>2</rasd:InstanceId><rasd:ResourceType>4</rasd:ResourceType><rasd:AllocationUnits>MegaBytes</rasd:AllocationUnits><rasd:VirtualQuantity>1024</rasd:VirtualQuantity></Item><Item><rasd:Caption>vm_4_fake_Disk1</rasd:Caption><rasd:InstanceId>c4cd1da8-05b7-45e0-80b1-1183d21443d9</rasd:InstanceId><rasd:ResourceType>17</rasd:ResourceType><rasd:HostResource>b6f6c0da-e67f-4902-b9ac-3069571a42fe/c4cd1da8-05b7-45e0-80b1-1183d21443d9</rasd:HostResource><rasd:Parent>47592965-e853-4e59-9728-d11cca6a7a8a</rasd:Parent><rasd:Template>47592965-e853-4e59-9728-d11cca6a7a8a</rasd:Template><rasd:ApplicationList></rasd:ApplicationList><rasd:StorageId>9e1aa540-1f4e-4ee3-a152-be381ef6c3bd</rasd:StorageId><rasd:StoragePoolId>4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee</rasd:StoragePoolId><rasd:CreationDate>2014/07/10 09:01:58</rasd:CreationDate><rasd:LastModified>2014/07/10 09:01:58</rasd:LastModified><rasd:last_modified_date>2014/07/10 09:31:59</rasd:last_modified_date></Item><Item><rasd:Caption>Ethernet adapter on rhevm</rasd:Caption><rasd:InstanceId>30e7f4b6-b9f0-4cfa-b0de-94e497ebc281</rasd:InstanceId><rasd:ResourceType>10</rasd:ResourceType><rasd:OtherResourceType>rhevm</rasd:OtherResourceType><rasd:ResourceSubType>3</rasd:ResourceSubType><rasd:Connection>rhevm</rasd:Connection><rasd:Linked>true</rasd:Linked><rasd:Name>nic1</rasd:Name><rasd:MACAddress>00:1a:4a:de:6d:7f</rasd:MACAddress><rasd:speed>1000</rasd:speed></Item><Item><rasd:Caption>USB Controller</rasd:Caption><rasd:InstanceId>3</rasd:InstanceId><rasd:ResourceType>23</rasd:ResourceType><rasd:UsbPolicy>DISABLED</rasd:UsbPolicy></Item></Section></Content></ovf:Envelope>', 'vm': '0e968db5-5d49-467f-9ff3-afc37b64364f'}, {'imglist': 'c01d693b-cba0-4fed-9ad7-0aaa28912a19', 'ovf': '<?xml version=\'1.0\' encoding=\'UTF-8\'?><ovf:Envelope xmlns:ovf="http://schemas.dmtf.org/ovf/envelope/1/" xmlns:rasd="http://schemas.dmtf.org/wbem/wscim/1/cim-schema/2/CIM_ResourceAllocationSettingData" xmlns:vssd="http://schemas.dmtf.org/wbem/wscim/1/cim-schema/2/CIM_VirtualSystemSettingData" xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance" ovf:version="3.4.0.0"><References><File ovf:href="c01d693b-cba0-4fed-9ad7-0aaa28912a19/4bb5d954-2a50-4028-b299-0b43c261270c" ovf:id="4bb5d954-2a50-4028-b299-0b43c261270c" ovf:size="10737418240" ovf:description="Active VM"/><Nic ovf:id="4f57f078-b2cc-4e19-8cf0-ddc1c8181814"/></References><Section xsi:type="ovf:NetworkSection_Type"><Info>List of networks</Info><Network ovf:name="Network 1"/></Section><Section xsi:type="ovf:DiskSection_Type"><Info>List of Virtual Disks</Info><Disk ovf:diskId="4bb5d954-2a50-4028-b299-0b43c261270c" ovf:size="10" ovf:actual_size="1" ovf:vm_snapshot_id="3e141539-9030-44f7-bd3c-7d490be5382f" ovf:parentRef="" ovf:fileRef="c01d693b-cba0-4fed-9ad7-0aaa28912a19/4bb5d954-2a50-4028-b299-0b43c261270c" ovf:format="http://www.gnome.org/~markmc/qcow-image-format.html" ovf:volume-format="COW" ovf:volume-type="Sparse" ovf:disk-interface="VirtIO" ovf:boot="true" ovf:disk-alias="vm_4_fake_Disk1" ovf:wipe-after-delete="false"/></Section><Content ovf:id="out" xsi:type="ovf:VirtualSystem_Type"><Description></Description><CreationDate>2014/07/10 09:00:44</CreationDate><ExportDate>2014/07/10 09:31:59</ExportDate><DeleteProtected>false</DeleteProtected><SsoMethod>guest_agent</SsoMethod><IsSmartcardEnabled>false</IsSmartcardEnabled><TimeZone></TimeZone><default_boot_sequence>0</default_boot_sequence><Generation>2</Generation><VmType>1</VmType><MinAllocatedMem>1024</MinAllocatedMem><IsStateless>false</IsStateless><IsRunAndPause>false</IsRunAndPause><AutoStartup>false</AutoStartup><Priority>1</Priority><CreatedByUserId>fdfc627c-d875-11e0-90f0-83df133b58cc</CreatedByUserId><Name>scale_9</Name><TemplateId>0670c2d7-3c1c-4b42-800c-060445cb5530</TemplateId><TemplateName>new_templ_4_fake</TemplateName><IsInitilized>true</IsInitilized><Origin>3</Origin><app_list>kernel-2.6.32-431.el6,rhevm-guest-agent-common-1.0.9-1.el6ev</app_list><DefaultDisplayType>1</DefaultDisplayType><TrustedService>false</TrustedService><OriginalTemplateId>0670c2d7-3c1c-4b42-800c-060445cb5530</OriginalTemplateId><OriginalTemplateName>new_templ_4_fake</OriginalTemplateName><UseLatestVersion>false</UseLatestVersion><Section ovf:id="62e7aad5-ff72-4fe3-830f-e7726ed4bfba" ovf:required="false" xsi:type="ovf:OperatingSystemSection_Type"><Info>Guest Operating System</Info><Description>rhel_7x64</Description></Section><Section xsi:type="ovf:VirtualHardwareSection_Type"><Info>2 CPU, 1024 Memeory</Info><System><vssd:VirtualSystemType>ENGINE 3.4.0.0</vssd:VirtualSystemType></System><Item><rasd:Caption>2 virtual cpu</rasd:Caption><rasd:Description>Number of virtual CPU</rasd:Description><rasd:InstanceId>1</rasd:InstanceId><rasd:ResourceType>3</rasd:ResourceType><rasd:num_of_sockets>1</rasd:num_of_sockets><rasd:cpu_per_socket>2</rasd:cpu_per_socket></Item><Item><rasd:Caption>1024 MB of memory</rasd:Caption><rasd:Description>Memory Size</rasd:Description><rasd:InstanceId>2</rasd:InstanceId><rasd:ResourceType>4</rasd:ResourceType><rasd:AllocationUnits>MegaBytes</rasd:AllocationUnits><rasd:VirtualQuantity>1024</rasd:VirtualQuantity></Item><Item><rasd:Caption>vm_4_fake_Disk1</rasd:Caption><rasd:InstanceId>4bb5d954-2a50-4028-b299-0b43c261270c</rasd:InstanceId><rasd:ResourceType>17</rasd:ResourceType><rasd:HostResource>c01d693b-cba0-4fed-9ad7-0aaa28912a19/4bb5d954-2a50-4028-b299-0b43c261270c</rasd:HostResource><rasd:Parent>47592965-e853-4e59-9728-d11cca6a7a8a</rasd:Parent><rasd:Template>47592965-e853-4e59-9728-d11cca6a7a8a</rasd:Template><rasd:ApplicationList></rasd:ApplicationList><rasd:StorageId>9e1aa540-1f4e-4ee3-a152-be381ef6c3bd</rasd:StorageId><rasd:StoragePoolId>4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee</rasd:StoragePoolId><rasd:CreationDate>2014/07/10 09:03:37</rasd:CreationDate><rasd:LastModified>2014/07/10 09:03:37</rasd:LastModified><rasd:last_modified_date>2014/07/10 09:31:59</rasd:last_modified_date></Item><Item><rasd:Caption>Ethernet adapter on rhevm</rasd:Caption><rasd:InstanceId>4f57f078-b2cc-4e19-8cf0-ddc1c8181814</rasd:InstanceId><rasd:ResourceType>10</rasd:ResourceType><rasd:OtherResourceType>rhevm</rasd:OtherResourceType><rasd:ResourceSubType>3</rasd:ResourceSubType><rasd:Connection>rhevm</rasd:Connection><rasd:Linked>true</rasd:Linked><rasd:Name>nic1</rasd:Name><rasd:MACAddress>00:1a:4a:de:6d:83</rasd:MACAddress><rasd:speed>1000</rasd:speed></Item><Item><rasd:Caption>USB Controller</rasd:Caption><rasd:InstanceId>3</rasd:InstanceId><rasd:ResourceType>23</rasd:ResourceType><rasd:UsbPolicy>DISABLED</rasd:UsbPolicy></Item></Section></Content></ovf:Envelope>', 'vm': '62e7aad5-ff72-4fe3-830f-e7726ed4bfba'}, {'imglist': '28408446-e5fd-4565-a976-e760951593fe', 'ovf': '<?xml version=\'1.0\' encoding=\'UTF-8\'?><ovf:Envelope xmlns:ovf="http://schemas.dmtf.org/ovf/envelope/1/" xmlns:rasd="http://schemas.dmtf.org/wbem/wscim/1/cim-schema/2/CIM_ResourceAllocationSettingData" xmlns:vssd="http://schemas.dmtf.org/wbem/wscim/1/cim-schema/2/CIM_VirtualSystemSettingData" xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance" ovf:version="3.4.0.0"><References><File ovf:href="28408446-e5fd-4565-a976-e760951593fe/776303a2-5585-451e-826e-0e338d4a1e98" ovf:id="776303a2-5585-451e-826e-0e338d4a1e98" ovf:size="10737418240" ovf:description="Active VM"/><Nic ovf:id="a26407ea-3132-4435-8180-5542669782e6"/></References><Section xsi:type="ovf:NetworkSection_Type"><Info>List of networks</Info><Network ovf:name="Network 1"/></Section><Section xsi:type="ovf:DiskSection_Type"><Info>List of Virtual Disks</Info><Disk ovf:diskId="776303a2-5585-451e-826e-0e338d4a1e98" ovf:size="10" ovf:actual_size="1" ovf:vm_snapshot_id="cc840262-22f4-42ce-b4a9-1229a8f805b4" ovf:parentRef="" ovf:fileRef="28408446-e5fd-4565-a976-e760951593fe/776303a2-5585-451e-826e-0e338d4a1e98" ovf:format="http://www.gnome.org/~markmc/qcow-image-format.html" ovf:volume-format="COW" ovf:volume-type="Sparse" ovf:disk-interface="VirtIO" ovf:boot="true" ovf:disk-alias="vm_4_fake_Disk1" ovf:wipe-after-delete="false"/></Section><Content ovf:id="out" xsi:type="ovf:VirtualSystem_Type"><Description></Description><CreationDate>2014/07/10 08:58:44</CreationDate><ExportDate>2014/07/10 09:31:59</ExportDate><DeleteProtected>false</DeleteProtected><SsoMethod>guest_agent</SsoMethod><IsSmartcardEnabled>false</IsSmartcardEnabled><TimeZone></TimeZone><default_boot_sequence>0</default_boot_sequence><Generation>2</Generation><VmType>1</VmType><MinAllocatedMem>1024</MinAllocatedMem><IsStateless>false</IsStateless><IsRunAndPause>false</IsRunAndPause><AutoStartup>false</AutoStartup><Priority>1</Priority><CreatedByUserId>fdfc627c-d875-11e0-90f0-83df133b58cc</CreatedByUserId><Name>scale_3</Name><TemplateId>0670c2d7-3c1c-4b42-800c-060445cb5530</TemplateId><TemplateName>new_templ_4_fake</TemplateName><IsInitilized>true</IsInitilized><Origin>3</Origin><app_list>kernel-2.6.32-431.el6,rhevm-guest-agent-common-1.0.9-1.el6ev</app_list><DefaultDisplayType>1</DefaultDisplayType><TrustedService>false</TrustedService><OriginalTemplateId>0670c2d7-3c1c-4b42-800c-060445cb5530</OriginalTemplateId><OriginalTemplateName>new_templ_4_fake</OriginalTemplateName><UseLatestVersion>false</UseLatestVersion><Section ovf:id="949f6c19-87b5-4f16-a91c-0049749423ea" ovf:required="false" xsi:type="ovf:OperatingSystemSection_Type"><Info>Guest Operating System</Info><Description>rhel_7x64</Description></Section><Section xsi:type="ovf:VirtualHardwareSection_Type"><Info>2 CPU, 1024 Memeory</Info><System><vssd:VirtualSystemType>ENGINE 3.4.0.0</vssd:VirtualSystemType></System><Item><rasd:Caption>2 virtual cpu</rasd:Caption><rasd:Description>Number of virtual CPU</rasd:Description><rasd:InstanceId>1</rasd:InstanceId><rasd:ResourceType>3</rasd:ResourceType><rasd:num_of_sockets>1</rasd:num_of_sockets><rasd:cpu_per_socket>2</rasd:cpu_per_socket></Item><Item><rasd:Caption>1024 MB of memory</rasd:Caption><rasd:Description>Memory Size</rasd:Description><rasd:InstanceId>2</rasd:InstanceId><rasd:ResourceType>4</rasd:ResourceType><rasd:AllocationUnits>MegaBytes</rasd:AllocationUnits><rasd:VirtualQuantity>1024</rasd:VirtualQuantity></Item><Item><rasd:Caption>vm_4_fake_Disk1</rasd:Caption><rasd:InstanceId>776303a2-5585-451e-826e-0e338d4a1e98</rasd:InstanceId><rasd:ResourceType>17</rasd:ResourceType><rasd:HostResource>28408446-e5fd-4565-a976-e760951593fe/776303a2-5585-451e-826e-0e338d4a1e98</rasd:HostResource><rasd:Parent>47592965-e853-4e59-9728-d11cca6a7a8a</rasd:Parent><rasd:Template>47592965-e853-4e59-9728-d11cca6a7a8a</rasd:Template><rasd:ApplicationList></rasd:ApplicationList><rasd:StorageId>9e1aa540-1f4e-4ee3-a152-be381ef6c3bd</rasd:StorageId><rasd:StoragePoolId>4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee</rasd:StoragePoolId><rasd:CreationDate>2014/07/10 09:01:37</rasd:CreationDate><rasd:LastModified>2014/07/10 09:01:37</rasd:LastModified><rasd:last_modified_date>2014/07/10 09:31:59</rasd:last_modified_date></Item><Item><rasd:Caption>Ethernet adapter on rhevm</rasd:Caption><rasd:InstanceId>a26407ea-3132-4435-8180-5542669782e6</rasd:InstanceId><rasd:ResourceType>10</rasd:ResourceType><rasd:OtherResourceType>rhevm</rasd:OtherResourceType><rasd:ResourceSubType>3</rasd:ResourceSubType><rasd:Connection>rhevm</rasd:Connection><rasd:Linked>true</rasd:Linked><rasd:Name>nic1</rasd:Name><rasd:MACAddress>00:1a:4a:de:6d:7e</rasd:MACAddress><rasd:speed>1000</rasd:speed></Item><Item><rasd:Caption>USB Controller</rasd:Caption><rasd:InstanceId>3</rasd:InstanceId><rasd:ResourceType>23</rasd:ResourceType><rasd:UsbPolicy>DISABLED</rasd:UsbPolicy></Item></Section></Content></ovf:Envelope>', 'vm': '949f6c19-87b5-4f16-a91c-0049749423ea'}, {'imglist': '0cd7d6ce-f497-4243-a690-c57744861eea', 'ovf': '<?xml version=\'1.0\' encoding=\'UTF-8\'?><ovf:Envelope xmlns:ovf="http://schemas.dmtf.org/ovf/envelope/1/" xmlns:rasd="http://schemas.dmtf.org/wbem/wscim/1/cim-schema/2/CIM_ResourceAllocationSettingData" xmlns:vssd="http://schemas.dmtf.org/wbem/wscim/1/cim-schema/2/CIM_VirtualSystemSettingData" xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance" ovf:version="3.4.0.0"><References><File ovf:href="0cd7d6ce-f497-4243-a690-c57744861eea/10b6a7dd-dc6c-43fa-ba17-92e4331b0e0b" ovf:id="10b6a7dd-dc6c-43fa-ba17-92e4331b0e0b" ovf:size="10737418240" ovf:description="Active VM"/><Nic ovf:id="b2b5755c-2939-4f5a-a882-6bae89dead18"/></References><Section xsi:type="ovf:NetworkSection_Type"><Info>List of networks</Info><Network ovf:name="Network 1"/></Section><Section xsi:type="ovf:DiskSection_Type"><Info>List of Virtual Disks</Info><Disk ovf:diskId="10b6a7dd-dc6c-43fa-ba17-92e4331b0e0b" ovf:size="10" ovf:actual_size="1" ovf:vm_snapshot_id="ce1f377b-4713-4c59-abc9-d30edadbca5f" ovf:parentRef="" ovf:fileRef="0cd7d6ce-f497-4243-a690-c57744861eea/10b6a7dd-dc6c-43fa-ba17-92e4331b0e0b" ovf:format="http://www.gnome.org/~markmc/qcow-image-format.html" ovf:volume-format="COW" ovf:volume-type="Sparse" ovf:disk-interface="VirtIO" ovf:boot="true" ovf:disk-alias="vm_4_fake_Disk1" ovf:wipe-after-delete="false"/></Section><Content ovf:id="out" xsi:type="ovf:VirtualSystem_Type"><Description></Description><CreationDate>2014/07/10 08:58:09</CreationDate><ExportDate>2014/07/10 09:31:59</ExportDate><DeleteProtected>false</DeleteProtected><SsoMethod>guest_agent</SsoMethod><IsSmartcardEnabled>false</IsSmartcardEnabled><TimeZone></TimeZone><default_boot_sequence>0</default_boot_sequence><Generation>2</Generation><VmType>1</VmType><MinAllocatedMem>1024</MinAllocatedMem><IsStateless>false</IsStateless><IsRunAndPause>false</IsRunAndPause><AutoStartup>false</AutoStartup><Priority>1</Priority><CreatedByUserId>fdfc627c-d875-11e0-90f0-83df133b58cc</CreatedByUserId><Name>scale_1</Name><TemplateId>0670c2d7-3c1c-4b42-800c-060445cb5530</TemplateId><TemplateName>new_templ_4_fake</TemplateName><IsInitilized>true</IsInitilized><Origin>3</Origin><app_list>kernel-2.6.32-431.el6,rhevm-guest-agent-common-1.0.9-1.el6ev</app_list><DefaultDisplayType>1</DefaultDisplayType><TrustedService>false</TrustedService><OriginalTemplateId>0670c2d7-3c1c-4b42-800c-060445cb5530</OriginalTemplateId><OriginalTemplateName>new_templ_4_fake</OriginalTemplateName><UseLatestVersion>false</UseLatestVersion><Section ovf:id="ed909f7e-0ee2-4f6f-b4a5-a165f689a276" ovf:required="false" xsi:type="ovf:OperatingSystemSection_Type"><Info>Guest Operating System</Info><Description>rhel_7x64</Description></Section><Section xsi:type="ovf:VirtualHardwareSection_Type"><Info>2 CPU, 1024 Memeory</Info><System><vssd:VirtualSystemType>ENGINE 3.4.0.0</vssd:VirtualSystemType></System><Item><rasd:Caption>2 virtual cpu</rasd:Caption><rasd:Description>Number of virtual CPU</rasd:Description><rasd:InstanceId>1</rasd:InstanceId><rasd:ResourceType>3</rasd:ResourceType><rasd:num_of_sockets>1</rasd:num_of_sockets><rasd:cpu_per_socket>2</rasd:cpu_per_socket></Item><Item><rasd:Caption>1024 MB of memory</rasd:Caption><rasd:Description>Memory Size</rasd:Description><rasd:InstanceId>2</rasd:InstanceId><rasd:ResourceType>4</rasd:ResourceType><rasd:AllocationUnits>MegaBytes</rasd:AllocationUnits><rasd:VirtualQuantity>1024</rasd:VirtualQuantity></Item><Item><rasd:Caption>vm_4_fake_Disk1</rasd:Caption><rasd:InstanceId>10b6a7dd-dc6c-43fa-ba17-92e4331b0e0b</rasd:InstanceId><rasd:ResourceType>17</rasd:ResourceType><rasd:HostResource>0cd7d6ce-f497-4243-a690-c57744861eea/10b6a7dd-dc6c-43fa-ba17-92e4331b0e0b</rasd:HostResource><rasd:Parent>47592965-e853-4e59-9728-d11cca6a7a8a</rasd:Parent><rasd:Template>47592965-e853-4e59-9728-d11cca6a7a8a</rasd:Template><rasd:ApplicationList></rasd:ApplicationList><rasd:StorageId>9e1aa540-1f4e-4ee3-a152-be381ef6c3bd</rasd:StorageId><rasd:StoragePoolId>4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee</rasd:StoragePoolId><rasd:CreationDate>2014/07/10 09:00:58</rasd:CreationDate><rasd:LastModified>2014/07/10 09:00:58</rasd:LastModified><rasd:last_modified_date>2014/07/10 09:31:59</rasd:last_modified_date></Item><Item><rasd:Caption>Ethernet adapter on rhevm</rasd:Caption><rasd:InstanceId>b2b5755c-2939-4f5a-a882-6bae89dead18</rasd:InstanceId><rasd:ResourceType>10</rasd:ResourceType><rasd:OtherResourceType>rhevm</rasd:OtherResourceType><rasd:ResourceSubType>3</rasd:ResourceSubType><rasd:Connection>rhevm</rasd:Connection><rasd:Linked>true</rasd:Linked><rasd:Name>nic1</rasd:Name><rasd:MACAddress>00:1a:4a:de:6d:7a</rasd:MACAddress><rasd:speed>1000</rasd:speed></Item><Item><rasd:Caption>USB Controller</rasd:Caption><rasd:InstanceId>3</rasd:InstanceId><rasd:ResourceType>23</rasd:ResourceType><rasd:UsbPolicy>DISABLED</rasd:UsbPolicy></Item></Section></Content></ovf:Envelope>', 'vm': 'ed909f7e-0ee2-4f6f-b4a5-a165f689a276'}, {'imglist': 'cfaeead2-7caa-467c-b389-c89840ae6605', 'ovf': '<?xml version=\'1.0\' encoding=\'UTF-8\'?><ovf:Envelope xmlns:ovf="http://schemas.dmtf.org/ovf/envelope/1/" xmlns:rasd="http://schemas.dmtf.org/wbem/wscim/1/cim-schema/2/CIM_ResourceAllocationSettingData" xmlns:vssd="http://schemas.dmtf.org/wbem/wscim/1/cim-schema/2/CIM_VirtualSystemSettingData" xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance" ovf:version="3.4.0.0"><References><File ovf:href="cfaeead2-7caa-467c-b389-c89840ae6605/567fe32d-31a6-4ff6-90f3-fd6a656fbecc" ovf:id="567fe32d-31a6-4ff6-90f3-fd6a656fbecc" ovf:size="10737418240" ovf:description="Active VM"/><Nic ovf:id="4b0dcb08-2250-460b-87d5-6b9cd0808970"/></References><Section xsi:type="ovf:NetworkSection_Type"><Info>List of networks</Info><Network ovf:name="Network 1"/></Section><Section xsi:type="ovf:DiskSection_Type"><Info>List of Virtual Disks</Info><Disk ovf:diskId="567fe32d-31a6-4ff6-90f3-fd6a656fbecc" ovf:size="10" ovf:actual_size="1" ovf:vm_snapshot_id="ff8d0275-3cb9-4203-9071-b6b062c0c9f0" ovf:parentRef="" ovf:fileRef="cfaeead2-7caa-467c-b389-c89840ae6605/567fe32d-31a6-4ff6-90f3-fd6a656fbecc" ovf:format="http://www.gnome.org/~markmc/qcow-image-format.html" ovf:volume-format="COW" ovf:volume-type="Sparse" ovf:disk-interface="VirtIO" ovf:boot="true" ovf:disk-alias="vm_4_fake_Disk1" ovf:wipe-after-delete="false"/></Section><Content ovf:id="out" xsi:type="ovf:VirtualSystem_Type"><Description></Description><CreationDate>2014/07/10 09:00:25</CreationDate><ExportDate>2014/07/10 09:31:59</ExportDate><DeleteProtected>false</DeleteProtected><SsoMethod>guest_agent</SsoMethod><IsSmartcardEnabled>false</IsSmartcardEnabled><TimeZone></TimeZone><default_boot_sequence>0</default_boot_sequence><Generation>2</Generation><VmType>1</VmType><MinAllocatedMem>1024</MinAllocatedMem><IsStateless>false</IsStateless><IsRunAndPause>false</IsRunAndPause><AutoStartup>false</AutoStartup><Priority>1</Priority><CreatedByUserId>fdfc627c-d875-11e0-90f0-83df133b58cc</CreatedByUserId><Name>scale_8</Name><TemplateId>0670c2d7-3c1c-4b42-800c-060445cb5530</TemplateId><TemplateName>new_templ_4_fake</TemplateName><IsInitilized>true</IsInitilized><Origin>3</Origin><app_list>kernel-2.6.32-431.el6,rhevm-guest-agent-common-1.0.9-1.el6ev</app_list><DefaultDisplayType>1</DefaultDisplayType><TrustedService>false</TrustedService><OriginalTemplateId>0670c2d7-3c1c-4b42-800c-060445cb5530</OriginalTemplateId><OriginalTemplateName>new_templ_4_fake</OriginalTemplateName><UseLatestVersion>false</UseLatestVersion><Section ovf:id="5d49ebac-3f0d-4688-aed0-b3f5fe364000" ovf:required="false" xsi:type="ovf:OperatingSystemSection_Type"><Info>Guest Operating System</Info><Description>rhel_7x64</Description></Section><Section xsi:type="ovf:VirtualHardwareSection_Type"><Info>2 CPU, 1024 Memeory</Info><System><vssd:VirtualSystemType>ENGINE 3.4.0.0</vssd:VirtualSystemType></System><Item><rasd:Caption>2 virtual cpu</rasd:Caption><rasd:Description>Number of virtual CPU</rasd:Description><rasd:InstanceId>1</rasd:InstanceId><rasd:ResourceType>3</rasd:ResourceType><rasd:num_of_sockets>1</rasd:num_of_sockets><rasd:cpu_per_socket>2</rasd:cpu_per_socket></Item><Item><rasd:Caption>1024 MB of memory</rasd:Caption><rasd:Description>Memory Size</rasd:Description><rasd:InstanceId>2</rasd:InstanceId><rasd:ResourceType>4</rasd:ResourceType><rasd:AllocationUnits>MegaBytes</rasd:AllocationUnits><rasd:VirtualQuantity>1024</rasd:VirtualQuantity></Item><Item><rasd:Caption>vm_4_fake_Disk1</rasd:Caption><rasd:InstanceId>567fe32d-31a6-4ff6-90f3-fd6a656fbecc</rasd:InstanceId><rasd:ResourceType>17</rasd:ResourceType><rasd:HostResource>cfaeead2-7caa-467c-b389-c89840ae6605/567fe32d-31a6-4ff6-90f3-fd6a656fbecc</rasd:HostResource><rasd:Parent>47592965-e853-4e59-9728-d11cca6a7a8a</rasd:Parent><rasd:Template>47592965-e853-4e59-9728-d11cca6a7a8a</rasd:Template><rasd:ApplicationList></rasd:ApplicationList><rasd:StorageId>9e1aa540-1f4e-4ee3-a152-be381ef6c3bd</rasd:StorageId><rasd:StoragePoolId>4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee</rasd:StoragePoolId><rasd:CreationDate>2014/07/10 09:03:18</rasd:CreationDate><rasd:LastModified>2014/07/10 09:03:18</rasd:LastModified><rasd:last_modified_date>2014/07/10 09:31:59</rasd:last_modified_date></Item><Item><rasd:Caption>Ethernet adapter on rhevm</rasd:Caption><rasd:InstanceId>4b0dcb08-2250-460b-87d5-6b9cd0808970</rasd:InstanceId><rasd:ResourceType>10</rasd:ResourceType><rasd:OtherResourceType>rhevm</rasd:OtherResourceType><rasd:ResourceSubType>3</rasd:ResourceSubType><rasd:Connection>rhevm</rasd:Connection><rasd:Linked>true</rasd:Linked><rasd:Name>nic1</rasd:Name><rasd:MACAddress>00:1a:4a:de:6d:89</rasd:MACAddress><rasd:speed>1000</rasd:speed></Item><Item><rasd:Caption>USB Controller</rasd:Caption><rasd:InstanceId>3</rasd:InstanceId><rasd:ResourceType>23</rasd:ResourceType><rasd:UsbPolicy>DISABLED</rasd:UsbPolicy></Item></Section></Content></ovf:Envelope>', 'vm': '5d49ebac-3f0d-4688-aed0-b3f5fe364000'}, {'imglist': 'e4c65229-4247-4b33-b72a-f1d5ce72ad05', 'ovf': '<?xml version=\'1.0\' encoding=\'UTF-8\'?><ovf:Envelope xmlns:ovf="http://schemas.dmtf.org/ovf/envelope/1/" xmlns:rasd="http://schemas.dmtf.org/wbem/wscim/1/cim-schema/2/CIM_ResourceAllocationSettingData" xmlns:vssd="http://schemas.dmtf.org/wbem/wscim/1/cim-schema/2/CIM_VirtualSystemSettingData" xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance" ovf:version="3.4.0.0"><References><File ovf:href="e4c65229-4247-4b33-b72a-f1d5ce72ad05/cad94284-3ca9-4c30-933d-997f4460309e" ovf:id="cad94284-3ca9-4c30-933d-997f4460309e" ovf:size="10737418240" ovf:description="Active VM"/><Nic ovf:id="0fa4de37-ea6b-4a38-9756-5554f46ef32f"/></References><Section xsi:type="ovf:NetworkSection_Type"><Info>List of networks</Info><Network ovf:name="Network 1"/></Section><Section xsi:type="ovf:DiskSection_Type"><Info>List of Virtual Disks</Info><Disk ovf:diskId="cad94284-3ca9-4c30-933d-997f4460309e" ovf:size="10" ovf:actual_size="1" ovf:vm_snapshot_id="6028a6bb-54b9-422a-a01b-b7e95bf1e729" ovf:parentRef="" ovf:fileRef="e4c65229-4247-4b33-b72a-f1d5ce72ad05/cad94284-3ca9-4c30-933d-997f4460309e" ovf:format="http://www.gnome.org/~markmc/qcow-image-format.html" ovf:volume-format="COW" ovf:volume-type="Sparse" ovf:disk-interface="VirtIO" ovf:boot="true" ovf:disk-alias="vm_4_fake_Disk1" ovf:wipe-after-delete="false"/></Section><Content ovf:id="out" xsi:type="ovf:VirtualSystem_Type"><Description></Description><CreationDate>2014/07/10 09:01:05</CreationDate><ExportDate>2014/07/10 09:31:59</ExportDate><DeleteProtected>false</DeleteProtected><SsoMethod>guest_agent</SsoMethod><IsSmartcardEnabled>false</IsSmartcardEnabled><TimeZone></TimeZone><default_boot_sequence>0</default_boot_sequence><Generation>2</Generation><VmType>1</VmType><MinAllocatedMem>1024</MinAllocatedMem><IsStateless>false</IsStateless><IsRunAndPause>false</IsRunAndPause><AutoStartup>false</AutoStartup><Priority>1</Priority><CreatedByUserId>fdfc627c-d875-11e0-90f0-83df133b58cc</CreatedByUserId><Name>scale_10</Name><TemplateId>0670c2d7-3c1c-4b42-800c-060445cb5530</TemplateId><TemplateName>new_templ_4_fake</TemplateName><IsInitilized>true</IsInitilized><Origin>3</Origin><app_list>kernel-2.6.32-431.el6,rhevm-guest-agent-common-1.0.9-1.el6ev</app_list><DefaultDisplayType>1</DefaultDisplayType><TrustedService>false</TrustedService><OriginalTemplateId>0670c2d7-3c1c-4b42-800c-060445cb5530</OriginalTemplateId><OriginalTemplateName>new_templ_4_fake</OriginalTemplateName><UseLatestVersion>false</UseLatestVersion><Section ovf:id="e2b026e7-b32b-4f60-ae2d-b588066ddfa7" ovf:required="false" xsi:type="ovf:OperatingSystemSection_Type"><Info>Guest Operating System</Info><Description>rhel_7x64</Description></Section><Section xsi:type="ovf:VirtualHardwareSection_Type"><Info>2 CPU, 1024 Memeory</Info><System><vssd:VirtualSystemType>ENGINE 3.4.0.0</vssd:VirtualSystemType></System><Item><rasd:Caption>2 virtual cpu</rasd:Caption><rasd:Description>Number of virtual CPU</rasd:Description><rasd:InstanceId>1</rasd:InstanceId><rasd:ResourceType>3</rasd:ResourceType><rasd:num_of_sockets>1</rasd:num_of_sockets><rasd:cpu_per_socket>2</rasd:cpu_per_socket></Item><Item><rasd:Caption>1024 MB of memory</rasd:Caption><rasd:Description>Memory Size</rasd:Description><rasd:InstanceId>2</rasd:InstanceId><rasd:ResourceType>4</rasd:ResourceType><rasd:AllocationUnits>MegaBytes</rasd:AllocationUnits><rasd:VirtualQuantity>1024</rasd:VirtualQuantity></Item><Item><rasd:Caption>vm_4_fake_Disk1</rasd:Caption><rasd:InstanceId>cad94284-3ca9-4c30-933d-997f4460309e</rasd:InstanceId><rasd:ResourceType>17</rasd:ResourceType><rasd:HostResource>e4c65229-4247-4b33-b72a-f1d5ce72ad05/cad94284-3ca9-4c30-933d-997f4460309e</rasd:HostResource><rasd:Parent>47592965-e853-4e59-9728-d11cca6a7a8a</rasd:Parent><rasd:Template>47592965-e853-4e59-9728-d11cca6a7a8a</rasd:Template><rasd:ApplicationList></rasd:ApplicationList><rasd:StorageId>9e1aa540-1f4e-4ee3-a152-be381ef6c3bd</rasd:StorageId><rasd:StoragePoolId>4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee</rasd:StoragePoolId><rasd:CreationDate>2014/07/10 09:03:58</rasd:CreationDate><rasd:LastModified>2014/07/10 09:03:58</rasd:LastModified><rasd:last_modified_date>2014/07/10 09:31:59</rasd:last_modified_date></Item><Item><rasd:Caption>Ethernet adapter on rhevm</rasd:Caption><rasd:InstanceId>0fa4de37-ea6b-4a38-9756-5554f46ef32f</rasd:InstanceId><rasd:ResourceType>10</rasd:ResourceType><rasd:OtherResourceType>rhevm</rasd:OtherResourceType><rasd:ResourceSubType>3</rasd:ResourceSubType><rasd:Connection>rhevm</rasd:Connection><rasd:Linked>true</rasd:Linked><rasd:Name>nic1</rasd:Name><rasd:MACAddress>00:1a:4a:de:6d:82</rasd:MACAddress><rasd:speed>1000</rasd:speed></Item><Item><rasd:Caption>USB Controller</rasd:Caption><rasd:InstanceId>3</rasd:InstanceId><rasd:ResourceType>23</rasd:ResourceType><rasd:UsbPolicy>DISABLED</rasd:UsbPolicy></Item></Section></Content></ovf:Envelope>', 'vm': 'e2b026e7-b32b-4f60-ae2d-b588066ddfa7'}], sdUUID=None, options=None) >Thread-34::DEBUG::2014-07-10 09:34:45,143::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`6ba6da6e-c4eb-4645-8285-33baef7e79b7`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '1346' at 'updateVM' >Thread-34::DEBUG::2014-07-10 09:34:45,143::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' for lock type 'shared' >Thread-34::DEBUG::2014-07-10 09:34:45,143::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-10 09:34:45,143::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`6ba6da6e-c4eb-4645-8285-33baef7e79b7`::Granted request >Thread-34::DEBUG::2014-07-10 09:34:45,144::task::827::TaskManager.Task::(resourceAcquired) Task=`fe34f0a1-0a97-45fd-93d2-486a8c8dc923`::_resourcesAcquired: Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee (shared) >Thread-34::DEBUG::2014-07-10 09:34:45,144::task::990::TaskManager.Task::(_decref) Task=`fe34f0a1-0a97-45fd-93d2-486a8c8dc923`::ref 1 aborting False >Thread-34::DEBUG::2014-07-10 09:34:45,145::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.vms_9e1aa540-1f4e-4ee3-a152-be381ef6c3bd`ReqID=`4235e156-cb11-46d8-90c1-a9f7ef99cbe2`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '1351' at 'updateVM' >Thread-34::DEBUG::2014-07-10 09:34:45,145::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.vms_9e1aa540-1f4e-4ee3-a152-be381ef6c3bd' for lock type 'exclusive' >Thread-34::DEBUG::2014-07-10 09:34:45,145::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.vms_9e1aa540-1f4e-4ee3-a152-be381ef6c3bd' is free. Now locking as 'exclusive' (1 active user) >Thread-34::DEBUG::2014-07-10 09:34:45,145::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.vms_9e1aa540-1f4e-4ee3-a152-be381ef6c3bd`ReqID=`4235e156-cb11-46d8-90c1-a9f7ef99cbe2`::Granted request >Thread-34::DEBUG::2014-07-10 09:34:45,146::task::827::TaskManager.Task::(resourceAcquired) Task=`fe34f0a1-0a97-45fd-93d2-486a8c8dc923`::_resourcesAcquired: Storage.vms_9e1aa540-1f4e-4ee3-a152-be381ef6c3bd (exclusive) >Thread-34::DEBUG::2014-07-10 09:34:45,146::task::990::TaskManager.Task::(_decref) Task=`fe34f0a1-0a97-45fd-93d2-486a8c8dc923`::ref 1 aborting False >Thread-34::INFO::2014-07-10 09:34:45,146::sp::1237::Storage.StoragePool::(updateVM) spUUID=4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee sdUUID=9e1aa540-1f4e-4ee3-a152-be381ef6c3bd >Thread-34::INFO::2014-07-10 09:34:45,147::sp::1248::Storage.StoragePool::(updateVM) vmUUID=2386fa8c-f537-495c-ae07-e178171d77f2 imgList=['b034d5b0-e1e0-4011-b49b-4d45ddb11556'] >Thread-34::INFO::2014-07-10 09:34:45,150::sp::1248::Storage.StoragePool::(updateVM) vmUUID=52e238aa-e62a-48a8-a200-604e72422f3f imgList=['76fdb054-02cd-42ed-9721-b3e65b34c3a4'] >Thread-34::INFO::2014-07-10 09:34:45,150::sp::1248::Storage.StoragePool::(updateVM) vmUUID=a766ed65-ac2e-4862-8ff0-0352480cf6f1 imgList=['f30c2cb7-a43a-4bf5-82b5-cfe07336f65c'] >Thread-34::INFO::2014-07-10 09:34:45,151::sp::1248::Storage.StoragePool::(updateVM) vmUUID=7fc21bb8-bd92-4924-acef-8360998e92a1 imgList=['aa20346a-4d3a-4e07-b8e1-52c0ebe4168c'] >Thread-34::INFO::2014-07-10 09:34:45,151::sp::1248::Storage.StoragePool::(updateVM) vmUUID=0e968db5-5d49-467f-9ff3-afc37b64364f imgList=['b6f6c0da-e67f-4902-b9ac-3069571a42fe'] >Thread-34::INFO::2014-07-10 09:34:45,151::sp::1248::Storage.StoragePool::(updateVM) vmUUID=62e7aad5-ff72-4fe3-830f-e7726ed4bfba imgList=['c01d693b-cba0-4fed-9ad7-0aaa28912a19'] >Thread-34::INFO::2014-07-10 09:34:45,152::sp::1248::Storage.StoragePool::(updateVM) vmUUID=949f6c19-87b5-4f16-a91c-0049749423ea imgList=['28408446-e5fd-4565-a976-e760951593fe'] >Thread-34::INFO::2014-07-10 09:34:45,152::sp::1248::Storage.StoragePool::(updateVM) vmUUID=ed909f7e-0ee2-4f6f-b4a5-a165f689a276 imgList=['0cd7d6ce-f497-4243-a690-c57744861eea'] >Thread-34::INFO::2014-07-10 09:34:45,153::sp::1248::Storage.StoragePool::(updateVM) vmUUID=5d49ebac-3f0d-4688-aed0-b3f5fe364000 imgList=['cfaeead2-7caa-467c-b389-c89840ae6605'] >Thread-34::INFO::2014-07-10 09:34:45,153::sp::1248::Storage.StoragePool::(updateVM) vmUUID=e2b026e7-b32b-4f60-ae2d-b588066ddfa7 imgList=['e4c65229-4247-4b33-b72a-f1d5ce72ad05'] >Thread-34::INFO::2014-07-10 09:34:45,153::logUtils::47::dispatcher::(wrapper) Run and protect: updateVM, Return response: None >Thread-34::DEBUG::2014-07-10 09:34:45,154::task::1185::TaskManager.Task::(prepare) Task=`fe34f0a1-0a97-45fd-93d2-486a8c8dc923`::finished: None >Thread-34::DEBUG::2014-07-10 09:34:45,154::task::595::TaskManager.Task::(_updateState) Task=`fe34f0a1-0a97-45fd-93d2-486a8c8dc923`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-10 09:34:45,154::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.vms_9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': < ResourceRef 'Storage.vms_9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', isValid: 'True' obj: 'None'>, 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee': < ResourceRef 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-10 09:34:45,154::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-10 09:34:45,155::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.vms_9e1aa540-1f4e-4ee3-a152-be381ef6c3bd' >Thread-34::DEBUG::2014-07-10 09:34:45,155::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.vms_9e1aa540-1f4e-4ee3-a152-be381ef6c3bd' (0 active users) >Thread-34::DEBUG::2014-07-10 09:34:45,155::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.vms_9e1aa540-1f4e-4ee3-a152-be381ef6c3bd' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-10 09:34:45,155::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.vms_9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', Clearing records. >Thread-34::DEBUG::2014-07-10 09:34:45,155::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' >Thread-34::DEBUG::2014-07-10 09:34:45,156::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' (0 active users) >Thread-34::DEBUG::2014-07-10 09:34:45,156::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-10 09:34:45,156::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', Clearing records. >Thread-34::DEBUG::2014-07-10 09:34:45,156::task::990::TaskManager.Task::(_decref) Task=`fe34f0a1-0a97-45fd-93d2-486a8c8dc923`::ref 0 aborting False >Thread-34::DEBUG::2014-07-10 09:34:45,204::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-34::DEBUG::2014-07-10 09:34:45,205::task::595::TaskManager.Task::(_updateState) Task=`4bd6cf58-33c2-46f7-b27a-15a0eb7f4321`::moving from state init -> state preparing >Thread-34::INFO::2014-07-10 09:34:45,206::logUtils::44::dispatcher::(wrapper) Run and protect: updateVM(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', vmList=[{'imglist': '9cf413b7-7f14-4a61-8c71-913e5b0ea9c0', 'ovf': '<?xml version=\'1.0\' encoding=\'UTF-8\'?><ovf:Envelope xmlns:ovf="http://schemas.dmtf.org/ovf/envelope/1/" xmlns:rasd="http://schemas.dmtf.org/wbem/wscim/1/cim-schema/2/CIM_ResourceAllocationSettingData" xmlns:vssd="http://schemas.dmtf.org/wbem/wscim/1/cim-schema/2/CIM_VirtualSystemSettingData" xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance" ovf:version="3.4.0.0"><References><File ovf:href="9cf413b7-7f14-4a61-8c71-913e5b0ea9c0/47592965-e853-4e59-9728-d11cca6a7a8a" ovf:id="47592965-e853-4e59-9728-d11cca6a7a8a" ovf:size="10737418240" ovf:description=""/><Nic ovf:id="6885382e-3365-4a99-99b5-bbcc5b7c9aa7"/></References><Section xsi:type="ovf:NetworkSection_Type"><Info>List of networks</Info><Network ovf:name="Network 1"/></Section><Section xsi:type="ovf:DiskSection_Type"><Info>List of Virtual Disks</Info><Disk ovf:diskId="47592965-e853-4e59-9728-d11cca6a7a8a" ovf:size="10" ovf:actual_size="10" ovf:vm_snapshot_id="7db9d144-4112-4a71-bf2d-60de22d5c3c0" ovf:parentRef="" ovf:fileRef="9cf413b7-7f14-4a61-8c71-913e5b0ea9c0/47592965-e853-4e59-9728-d11cca6a7a8a" ovf:format="http://www.vmware.com/specifications/vmdk.html#sparse" ovf:volume-format="RAW" ovf:volume-type="Preallocated" ovf:disk-interface="VirtIO" ovf:boot="true" ovf:disk-alias="vm_4_fake_Disk1" ovf:wipe-after-delete="false"/></Section><Content ovf:id="out" xsi:type="ovf:VirtualSystem_Type"><Description></Description><CreationDate>2014/05/15 09:52:35</CreationDate><ExportDate>2014/07/10 09:31:59</ExportDate><DeleteProtected>false</DeleteProtected><SsoMethod>guest_agent</SsoMethod><IsSmartcardEnabled>false</IsSmartcardEnabled><TimeZone></TimeZone><default_boot_sequence>0</default_boot_sequence><Generation>1</Generation><VmType>1</VmType><MinAllocatedMem>2048</MinAllocatedMem><IsStateless>false</IsStateless><IsRunAndPause>false</IsRunAndPause><AutoStartup>false</AutoStartup><Priority>1</Priority><CreatedByUserId>fdfc627c-d875-11e0-90f0-83df133b58cc</CreatedByUserId><Name>new_templ_4_fake</Name><TemplateId>0670c2d7-3c1c-4b42-800c-060445cb5530</TemplateId><Origin>3</Origin><default_display_type>1</default_display_type><IsDisabled>false</IsDisabled><TrustedService>false</TrustedService><TemplateType>TEMPLATE</TemplateType><BaseTemplateId>0670c2d7-3c1c-4b42-800c-060445cb5530</BaseTemplateId><TemplateVersionNumber>1</TemplateVersionNumber><TemplateVersionName>base version</TemplateVersionName><Section ovf:id="0670c2d7-3c1c-4b42-800c-060445cb5530" ovf:required="false" xsi:type="ovf:OperatingSystemSection_Type"><Info>Guest Operating System</Info><Description>rhel_7x64</Description></Section><Section xsi:type="ovf:VirtualHardwareSection_Type"><Info>2 CPU, 2048 Memeory</Info><System><vssd:VirtualSystemType>ENGINE 3.4.0.0</vssd:VirtualSystemType></System><Item><rasd:Caption>2 virtual cpu</rasd:Caption><rasd:Description>Number of virtual CPU</rasd:Description><rasd:InstanceId>1</rasd:InstanceId><rasd:ResourceType>3</rasd:ResourceType><rasd:num_of_sockets>1</rasd:num_of_sockets><rasd:cpu_per_socket>2</rasd:cpu_per_socket></Item><Item><rasd:Caption>2048 MB of memory</rasd:Caption><rasd:Description>Memory Size</rasd:Description><rasd:InstanceId>2</rasd:InstanceId><rasd:ResourceType>4</rasd:ResourceType><rasd:AllocationUnits>MegaBytes</rasd:AllocationUnits><rasd:VirtualQuantity>2048</rasd:VirtualQuantity></Item><Item><rasd:Caption>vm_4_fake_Disk1</rasd:Caption><rasd:InstanceId>47592965-e853-4e59-9728-d11cca6a7a8a</rasd:InstanceId><rasd:ResourceType>17</rasd:ResourceType><rasd:HostResource>9cf413b7-7f14-4a61-8c71-913e5b0ea9c0/47592965-e853-4e59-9728-d11cca6a7a8a</rasd:HostResource><rasd:Parent>00000000-0000-0000-0000-000000000000</rasd:Parent><rasd:Template>00000000-0000-0000-0000-000000000000</rasd:Template><rasd:ApplicationList></rasd:ApplicationList><rasd:StorageId>9e1aa540-1f4e-4ee3-a152-be381ef6c3bd</rasd:StorageId><rasd:StoragePoolId>4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee</rasd:StoragePoolId><rasd:CreationDate>2014/07/10 08:54:43</rasd:CreationDate><rasd:LastModified>2014/07/10 08:54:44</rasd:LastModified></Item><Item><rasd:Caption>Ethernet adapter on rhevm</rasd:Caption><rasd:InstanceId>6885382e-3365-4a99-99b5-bbcc5b7c9aa7</rasd:InstanceId><rasd:ResourceType>10</rasd:ResourceType><rasd:OtherResourceType>rhevm</rasd:OtherResourceType><rasd:ResourceSubType>3</rasd:ResourceSubType><rasd:Connection>rhevm</rasd:Connection><rasd:Linked>true</rasd:Linked><rasd:Name>nic1</rasd:Name><rasd:speed>1000</rasd:speed></Item><Item><rasd:Caption>USB Controller</rasd:Caption><rasd:InstanceId>3</rasd:InstanceId><rasd:ResourceType>23</rasd:ResourceType><rasd:UsbPolicy>DISABLED</rasd:UsbPolicy></Item></Section></Content></ovf:Envelope>', 'vm': '0670c2d7-3c1c-4b42-800c-060445cb5530'}], sdUUID=None, options=None) >Thread-34::DEBUG::2014-07-10 09:34:45,207::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`1107a1ad-6c52-4fea-8442-7f605a91706d`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '1346' at 'updateVM' >Thread-34::DEBUG::2014-07-10 09:34:45,207::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' for lock type 'shared' >Thread-34::DEBUG::2014-07-10 09:34:45,207::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-10 09:34:45,207::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`1107a1ad-6c52-4fea-8442-7f605a91706d`::Granted request >Thread-34::DEBUG::2014-07-10 09:34:45,208::task::827::TaskManager.Task::(resourceAcquired) Task=`4bd6cf58-33c2-46f7-b27a-15a0eb7f4321`::_resourcesAcquired: Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee (shared) >Thread-34::DEBUG::2014-07-10 09:34:45,208::task::990::TaskManager.Task::(_decref) Task=`4bd6cf58-33c2-46f7-b27a-15a0eb7f4321`::ref 1 aborting False >Thread-34::DEBUG::2014-07-10 09:34:45,209::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.vms_9e1aa540-1f4e-4ee3-a152-be381ef6c3bd`ReqID=`415c058d-43ff-4018-9004-0b5bee60e56c`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '1351' at 'updateVM' >Thread-34::DEBUG::2014-07-10 09:34:45,209::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.vms_9e1aa540-1f4e-4ee3-a152-be381ef6c3bd' for lock type 'exclusive' >Thread-34::DEBUG::2014-07-10 09:34:45,209::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.vms_9e1aa540-1f4e-4ee3-a152-be381ef6c3bd' is free. Now locking as 'exclusive' (1 active user) >Thread-34::DEBUG::2014-07-10 09:34:45,209::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.vms_9e1aa540-1f4e-4ee3-a152-be381ef6c3bd`ReqID=`415c058d-43ff-4018-9004-0b5bee60e56c`::Granted request >Thread-34::DEBUG::2014-07-10 09:34:45,210::task::827::TaskManager.Task::(resourceAcquired) Task=`4bd6cf58-33c2-46f7-b27a-15a0eb7f4321`::_resourcesAcquired: Storage.vms_9e1aa540-1f4e-4ee3-a152-be381ef6c3bd (exclusive) >Thread-34::DEBUG::2014-07-10 09:34:45,210::task::990::TaskManager.Task::(_decref) Task=`4bd6cf58-33c2-46f7-b27a-15a0eb7f4321`::ref 1 aborting False >Thread-34::INFO::2014-07-10 09:34:45,210::sp::1237::Storage.StoragePool::(updateVM) spUUID=4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee sdUUID=9e1aa540-1f4e-4ee3-a152-be381ef6c3bd >Thread-34::INFO::2014-07-10 09:34:45,210::sp::1248::Storage.StoragePool::(updateVM) vmUUID=0670c2d7-3c1c-4b42-800c-060445cb5530 imgList=['9cf413b7-7f14-4a61-8c71-913e5b0ea9c0'] >Thread-34::INFO::2014-07-10 09:34:45,211::logUtils::47::dispatcher::(wrapper) Run and protect: updateVM, Return response: None >Thread-34::DEBUG::2014-07-10 09:34:45,211::task::1185::TaskManager.Task::(prepare) Task=`4bd6cf58-33c2-46f7-b27a-15a0eb7f4321`::finished: None >Thread-34::DEBUG::2014-07-10 09:34:45,212::task::595::TaskManager.Task::(_updateState) Task=`4bd6cf58-33c2-46f7-b27a-15a0eb7f4321`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-10 09:34:45,212::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.vms_9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': < ResourceRef 'Storage.vms_9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', isValid: 'True' obj: 'None'>, 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee': < ResourceRef 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-10 09:34:45,212::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-10 09:34:45,213::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.vms_9e1aa540-1f4e-4ee3-a152-be381ef6c3bd' >Thread-34::DEBUG::2014-07-10 09:34:45,213::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.vms_9e1aa540-1f4e-4ee3-a152-be381ef6c3bd' (0 active users) >Thread-34::DEBUG::2014-07-10 09:34:45,213::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.vms_9e1aa540-1f4e-4ee3-a152-be381ef6c3bd' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-10 09:34:45,213::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.vms_9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', Clearing records. >Thread-34::DEBUG::2014-07-10 09:34:45,214::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' >Thread-34::DEBUG::2014-07-10 09:34:45,214::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' (0 active users) >Thread-34::DEBUG::2014-07-10 09:34:45,214::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-10 09:34:45,214::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', Clearing records. >Thread-34::DEBUG::2014-07-10 09:34:45,214::task::990::TaskManager.Task::(_decref) Task=`4bd6cf58-33c2-46f7-b27a-15a0eb7f4321`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 09:34:45,461::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:34:45,559::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0339804 s, 30.1 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 09:34:45,751::task::595::TaskManager.Task::(_updateState) Task=`49b66ff8-178f-46bd-86b5-f243d9179a71`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 09:34:45,755::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::INFO::2014-07-10 09:34:45,759::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000683672', 'lastCheck': '7.9', 'valid': True}, '6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000471194', 'lastCheck': '7.1', 'valid': True}} >Thread-14::DEBUG::2014-07-10 09:34:45,761::task::1185::TaskManager.Task::(prepare) Task=`49b66ff8-178f-46bd-86b5-f243d9179a71`::finished: {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000683672', 'lastCheck': '7.9', 'valid': True}, '6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000471194', 'lastCheck': '7.1', 'valid': True}} >Thread-14::DEBUG::2014-07-10 09:34:45,763::task::595::TaskManager.Task::(_updateState) Task=`49b66ff8-178f-46bd-86b5-f243d9179a71`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 09:34:45,765::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 09:34:45,767::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 09:34:45,769::task::990::TaskManager.Task::(_decref) Task=`49b66ff8-178f-46bd-86b5-f243d9179a71`::ref 0 aborting False >Thread-14::DEBUG::2014-07-10 09:34:46,463::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-14::DEBUG::2014-07-10 09:34:46,464::task::595::TaskManager.Task::(_updateState) Task=`320b853f-17f5-4ec7-bebc-c32a2966e5be`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 09:34:46,464::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-14::INFO::2014-07-10 09:34:46,464::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:34:46,465::task::1185::TaskManager.Task::(prepare) Task=`320b853f-17f5-4ec7-bebc-c32a2966e5be`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:34:46,465::task::595::TaskManager.Task::(_updateState) Task=`320b853f-17f5-4ec7-bebc-c32a2966e5be`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 09:34:46,465::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 09:34:46,465::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 09:34:46,465::task::990::TaskManager.Task::(_decref) Task=`320b853f-17f5-4ec7-bebc-c32a2966e5be`::ref 0 aborting False >Thread-34::DEBUG::2014-07-10 09:34:46,509::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-34::DEBUG::2014-07-10 09:34:46,510::task::595::TaskManager.Task::(_updateState) Task=`252fb52d-c4ae-445b-8dd5-b0e9dd517b39`::moving from state init -> state preparing >Thread-34::INFO::2014-07-10 09:34:46,510::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-34::DEBUG::2014-07-10 09:34:46,510::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`252f237f-22cf-40d5-9eb9-a6ee5d008c7c`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-10 09:34:46,511::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' for lock type 'shared' >Thread-34::DEBUG::2014-07-10 09:34:46,511::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-10 09:34:46,511::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`252f237f-22cf-40d5-9eb9-a6ee5d008c7c`::Granted request >Thread-34::DEBUG::2014-07-10 09:34:46,512::task::827::TaskManager.Task::(resourceAcquired) Task=`252fb52d-c4ae-445b-8dd5-b0e9dd517b39`::_resourcesAcquired: Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee (shared) >Thread-34::DEBUG::2014-07-10 09:34:46,512::task::990::TaskManager.Task::(_decref) Task=`252fb52d-c4ae-445b-8dd5-b0e9dd517b39`::ref 1 aborting False >Thread-34::INFO::2014-07-10 09:34:46,513::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532067385344', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:34:46,513::task::1185::TaskManager.Task::(prepare) Task=`252fb52d-c4ae-445b-8dd5-b0e9dd517b39`::finished: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532067385344', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:34:46,513::task::595::TaskManager.Task::(_updateState) Task=`252fb52d-c4ae-445b-8dd5-b0e9dd517b39`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-10 09:34:46,514::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee': < ResourceRef 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-10 09:34:46,514::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-10 09:34:46,514::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' >Thread-34::DEBUG::2014-07-10 09:34:46,514::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' (0 active users) >Thread-34::DEBUG::2014-07-10 09:34:46,514::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-10 09:34:46,515::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', Clearing records. >Thread-34::DEBUG::2014-07-10 09:34:46,515::task::990::TaskManager.Task::(_decref) Task=`252fb52d-c4ae-445b-8dd5-b0e9dd517b39`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 09:34:47,574::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:34:47,678::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0299826 s, 34.2 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-10 09:34:47,900::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/metadata bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-10 09:34:47,926::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00618298 s, 662 kB/s\n'; <rc> = 0 >Thread-40::DEBUG::2014-07-10 09:34:48,653::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lion.qa.lab.tlv.redhat.com:_export_yuri2_backup2/6a70504d-00df-4869-8695-0f442053f6b6/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-40::DEBUG::2014-07-10 09:34:48,674::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n369 bytes (369 B) copied, 0.000511623 s, 721 kB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:34:49,693::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:34:49,787::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0327637 s, 31.3 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:34:51,796::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:34:51,897::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0430499 s, 23.8 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:34:53,912::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:34:54,003::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.028592 s, 35.8 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:34:56,022::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:34:56,112::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0304642 s, 33.6 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 09:34:56,538::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-14::DEBUG::2014-07-10 09:34:56,540::task::595::TaskManager.Task::(_updateState) Task=`3fc290b5-9a49-4644-b641-ea4c1208467a`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 09:34:56,540::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-14::INFO::2014-07-10 09:34:56,541::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:34:56,541::task::1185::TaskManager.Task::(prepare) Task=`3fc290b5-9a49-4644-b641-ea4c1208467a`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:34:56,541::task::595::TaskManager.Task::(_updateState) Task=`3fc290b5-9a49-4644-b641-ea4c1208467a`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 09:34:56,541::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 09:34:56,541::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 09:34:56,542::task::990::TaskManager.Task::(_decref) Task=`3fc290b5-9a49-4644-b641-ea4c1208467a`::ref 0 aborting False >Thread-34::DEBUG::2014-07-10 09:34:56,546::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-34::DEBUG::2014-07-10 09:34:56,546::task::595::TaskManager.Task::(_updateState) Task=`2d58a88d-19d5-4cad-ad8c-bfc0a9bef5af`::moving from state init -> state preparing >Thread-34::INFO::2014-07-10 09:34:56,547::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-34::DEBUG::2014-07-10 09:34:56,547::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`fe00f49a-44fa-4aa3-a37a-637ce78d5a02`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-10 09:34:56,548::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' for lock type 'shared' >Thread-34::DEBUG::2014-07-10 09:34:56,548::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-10 09:34:56,548::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`fe00f49a-44fa-4aa3-a37a-637ce78d5a02`::Granted request >Thread-34::DEBUG::2014-07-10 09:34:56,549::task::827::TaskManager.Task::(resourceAcquired) Task=`2d58a88d-19d5-4cad-ad8c-bfc0a9bef5af`::_resourcesAcquired: Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee (shared) >Thread-34::DEBUG::2014-07-10 09:34:56,549::task::990::TaskManager.Task::(_decref) Task=`2d58a88d-19d5-4cad-ad8c-bfc0a9bef5af`::ref 1 aborting False >Thread-34::INFO::2014-07-10 09:34:56,550::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532067385344', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:34:56,550::task::1185::TaskManager.Task::(prepare) Task=`2d58a88d-19d5-4cad-ad8c-bfc0a9bef5af`::finished: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532067385344', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:34:56,550::task::595::TaskManager.Task::(_updateState) Task=`2d58a88d-19d5-4cad-ad8c-bfc0a9bef5af`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-10 09:34:56,551::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee': < ResourceRef 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-10 09:34:56,551::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-10 09:34:56,551::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' >Thread-34::DEBUG::2014-07-10 09:34:56,551::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' (0 active users) >Thread-34::DEBUG::2014-07-10 09:34:56,551::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-10 09:34:56,552::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', Clearing records. >Thread-34::DEBUG::2014-07-10 09:34:56,552::task::990::TaskManager.Task::(_decref) Task=`2d58a88d-19d5-4cad-ad8c-bfc0a9bef5af`::ref 0 aborting False >Thread-18::DEBUG::2014-07-10 09:34:57,957::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/metadata bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-10 09:34:57,980::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000802264 s, 5.1 MB/s\n'; <rc> = 0 >Thread-64::DEBUG::2014-07-10 09:34:58,055::task::595::TaskManager.Task::(_updateState) Task=`252f216e-7c93-410c-af6a-56afd5c7e251`::moving from state init -> state preparing >Thread-64::INFO::2014-07-10 09:34:58,056::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='aa20346a-4d3a-4e07-b8e1-52c0ebe4168c', volUUID='58fefce2-9bce-4bff-8949-8c6ce8122b27', options=None) >Thread-64::INFO::2014-07-10 09:34:58,056::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-64::DEBUG::2014-07-10 09:34:58,056::task::1185::TaskManager.Task::(prepare) Task=`252f216e-7c93-410c-af6a-56afd5c7e251`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-64::DEBUG::2014-07-10 09:34:58,057::task::595::TaskManager.Task::(_updateState) Task=`252f216e-7c93-410c-af6a-56afd5c7e251`::moving from state preparing -> state finished >Thread-64::DEBUG::2014-07-10 09:34:58,057::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-64::DEBUG::2014-07-10 09:34:58,057::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-64::DEBUG::2014-07-10 09:34:58,057::task::990::TaskManager.Task::(_decref) Task=`252f216e-7c93-410c-af6a-56afd5c7e251`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 09:34:58,138::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:34:58,237::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0323743 s, 31.6 MB/s\n'; <rc> = 0 >Thread-40::DEBUG::2014-07-10 09:34:58,704::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lion.qa.lab.tlv.redhat.com:_export_yuri2_backup2/6a70504d-00df-4869-8695-0f442053f6b6/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-40::DEBUG::2014-07-10 09:34:58,725::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n369 bytes (369 B) copied, 0.000407749 s, 905 kB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:35:00,253::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Thread-73::DEBUG::2014-07-10 09:35:00,280::task::595::TaskManager.Task::(_updateState) Task=`41a72aea-c2f8-4599-a6d3-28bf99b3fdee`::moving from state init -> state preparing >Thread-73::INFO::2014-07-10 09:35:00,282::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='c01d693b-cba0-4fed-9ad7-0aaa28912a19', volUUID='4bb5d954-2a50-4028-b299-0b43c261270c', options=None) >Thread-54::DEBUG::2014-07-10 09:35:00,282::task::595::TaskManager.Task::(_updateState) Task=`ec3f9da5-4330-47f5-b3e8-4097404e9e4b`::moving from state init -> state preparing >Thread-54::INFO::2014-07-10 09:35:00,283::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='28408446-e5fd-4565-a976-e760951593fe', volUUID='776303a2-5585-451e-826e-0e338d4a1e98', options=None) >Thread-73::INFO::2014-07-10 09:35:00,284::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-73::DEBUG::2014-07-10 09:35:00,284::task::1185::TaskManager.Task::(prepare) Task=`41a72aea-c2f8-4599-a6d3-28bf99b3fdee`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-73::DEBUG::2014-07-10 09:35:00,285::task::595::TaskManager.Task::(_updateState) Task=`41a72aea-c2f8-4599-a6d3-28bf99b3fdee`::moving from state preparing -> state finished >Thread-54::INFO::2014-07-10 09:35:00,285::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-73::DEBUG::2014-07-10 09:35:00,286::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-54::DEBUG::2014-07-10 09:35:00,286::task::1185::TaskManager.Task::(prepare) Task=`ec3f9da5-4330-47f5-b3e8-4097404e9e4b`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-73::DEBUG::2014-07-10 09:35:00,287::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-54::DEBUG::2014-07-10 09:35:00,287::task::595::TaskManager.Task::(_updateState) Task=`ec3f9da5-4330-47f5-b3e8-4097404e9e4b`::moving from state preparing -> state finished >Thread-73::DEBUG::2014-07-10 09:35:00,288::task::990::TaskManager.Task::(_decref) Task=`41a72aea-c2f8-4599-a6d3-28bf99b3fdee`::ref 0 aborting False >Thread-54::DEBUG::2014-07-10 09:35:00,288::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-54::DEBUG::2014-07-10 09:35:00,289::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-54::DEBUG::2014-07-10 09:35:00,289::task::990::TaskManager.Task::(_decref) Task=`ec3f9da5-4330-47f5-b3e8-4097404e9e4b`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 09:35:00,359::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0464096 s, 22.1 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 09:35:01,239::task::595::TaskManager.Task::(_updateState) Task=`3d7c4f77-a561-4218-918e-deb45325a66b`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 09:35:01,240::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::INFO::2014-07-10 09:35:01,240::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000802264', 'lastCheck': '3.2', 'valid': True}, '6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000407749', 'lastCheck': '2.5', 'valid': True}} >Thread-14::DEBUG::2014-07-10 09:35:01,240::task::1185::TaskManager.Task::(prepare) Task=`3d7c4f77-a561-4218-918e-deb45325a66b`::finished: {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000802264', 'lastCheck': '3.2', 'valid': True}, '6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000407749', 'lastCheck': '2.5', 'valid': True}} >Thread-14::DEBUG::2014-07-10 09:35:01,241::task::595::TaskManager.Task::(_updateState) Task=`3d7c4f77-a561-4218-918e-deb45325a66b`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 09:35:01,241::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 09:35:01,241::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 09:35:01,241::task::990::TaskManager.Task::(_decref) Task=`3d7c4f77-a561-4218-918e-deb45325a66b`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 09:35:02,378::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:35:02,527::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0633652 s, 16.2 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:35:04,541::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:35:04,641::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0354719 s, 28.9 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 09:35:06,579::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-14::DEBUG::2014-07-10 09:35:06,580::task::595::TaskManager.Task::(_updateState) Task=`6734eef2-507c-488e-9021-7ed135afa076`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 09:35:06,581::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-14::INFO::2014-07-10 09:35:06,581::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:35:06,582::task::1185::TaskManager.Task::(prepare) Task=`6734eef2-507c-488e-9021-7ed135afa076`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:35:06,582::task::595::TaskManager.Task::(_updateState) Task=`6734eef2-507c-488e-9021-7ed135afa076`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 09:35:06,582::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 09:35:06,582::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 09:35:06,582::task::990::TaskManager.Task::(_decref) Task=`6734eef2-507c-488e-9021-7ed135afa076`::ref 0 aborting False >Thread-34::DEBUG::2014-07-10 09:35:06,587::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-34::DEBUG::2014-07-10 09:35:06,587::task::595::TaskManager.Task::(_updateState) Task=`7811fcaa-668b-4276-8688-391ed1bbc085`::moving from state init -> state preparing >Thread-34::INFO::2014-07-10 09:35:06,587::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-34::DEBUG::2014-07-10 09:35:06,588::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`1a7fd550-696e-46b7-92e2-5c3955f5d861`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-10 09:35:06,588::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' for lock type 'shared' >Thread-34::DEBUG::2014-07-10 09:35:06,589::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-10 09:35:06,589::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`1a7fd550-696e-46b7-92e2-5c3955f5d861`::Granted request >Thread-34::DEBUG::2014-07-10 09:35:06,590::task::827::TaskManager.Task::(resourceAcquired) Task=`7811fcaa-668b-4276-8688-391ed1bbc085`::_resourcesAcquired: Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee (shared) >Thread-34::DEBUG::2014-07-10 09:35:06,590::task::990::TaskManager.Task::(_decref) Task=`7811fcaa-668b-4276-8688-391ed1bbc085`::ref 1 aborting False >Thread-34::INFO::2014-07-10 09:35:06,591::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532067385344', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:35:06,591::task::1185::TaskManager.Task::(prepare) Task=`7811fcaa-668b-4276-8688-391ed1bbc085`::finished: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532067385344', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:35:06,591::task::595::TaskManager.Task::(_updateState) Task=`7811fcaa-668b-4276-8688-391ed1bbc085`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-10 09:35:06,592::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee': < ResourceRef 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-10 09:35:06,592::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-10 09:35:06,592::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' >Thread-34::DEBUG::2014-07-10 09:35:06,592::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' (0 active users) >Thread-34::DEBUG::2014-07-10 09:35:06,592::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-10 09:35:06,593::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', Clearing records. >Thread-34::DEBUG::2014-07-10 09:35:06,593::task::990::TaskManager.Task::(_decref) Task=`7811fcaa-668b-4276-8688-391ed1bbc085`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 09:35:06,657::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:35:06,793::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0691097 s, 14.8 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-10 09:35:08,009::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/metadata bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-10 09:35:08,031::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000796359 s, 5.1 MB/s\n'; <rc> = 0 >Thread-40::DEBUG::2014-07-10 09:35:08,756::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lion.qa.lab.tlv.redhat.com:_export_yuri2_backup2/6a70504d-00df-4869-8695-0f442053f6b6/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-40::DEBUG::2014-07-10 09:35:08,778::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n369 bytes (369 B) copied, 0.000456227 s, 809 kB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:35:08,816::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:35:08,930::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0324342 s, 31.6 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:35:10,946::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:35:11,041::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0398204 s, 25.7 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:35:13,058::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:35:13,158::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0385 s, 26.6 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:35:15,175::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:35:15,265::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0304397 s, 33.6 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 09:35:16,491::task::595::TaskManager.Task::(_updateState) Task=`e13166c6-1250-4886-b1d0-1ef3bad4461c`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 09:35:16,492::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::INFO::2014-07-10 09:35:16,493::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000796359', 'lastCheck': '8.4', 'valid': True}, '6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000456227', 'lastCheck': '7.7', 'valid': True}} >Thread-14::DEBUG::2014-07-10 09:35:16,493::task::1185::TaskManager.Task::(prepare) Task=`e13166c6-1250-4886-b1d0-1ef3bad4461c`::finished: {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000796359', 'lastCheck': '8.4', 'valid': True}, '6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000456227', 'lastCheck': '7.7', 'valid': True}} >Thread-14::DEBUG::2014-07-10 09:35:16,493::task::595::TaskManager.Task::(_updateState) Task=`e13166c6-1250-4886-b1d0-1ef3bad4461c`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 09:35:16,493::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 09:35:16,493::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 09:35:16,494::task::990::TaskManager.Task::(_decref) Task=`e13166c6-1250-4886-b1d0-1ef3bad4461c`::ref 0 aborting False >Thread-14::DEBUG::2014-07-10 09:35:16,629::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-14::DEBUG::2014-07-10 09:35:16,630::task::595::TaskManager.Task::(_updateState) Task=`7a4c98ab-1828-43c3-a6a5-2e5fcf974452`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 09:35:16,630::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-14::INFO::2014-07-10 09:35:16,630::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:35:16,631::task::1185::TaskManager.Task::(prepare) Task=`7a4c98ab-1828-43c3-a6a5-2e5fcf974452`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:35:16,631::task::595::TaskManager.Task::(_updateState) Task=`7a4c98ab-1828-43c3-a6a5-2e5fcf974452`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 09:35:16,631::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 09:35:16,631::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 09:35:16,631::task::990::TaskManager.Task::(_decref) Task=`7a4c98ab-1828-43c3-a6a5-2e5fcf974452`::ref 0 aborting False >Thread-34::DEBUG::2014-07-10 09:35:16,675::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-34::DEBUG::2014-07-10 09:35:16,676::task::595::TaskManager.Task::(_updateState) Task=`d02b1111-c867-4c84-b294-1cda921a14c3`::moving from state init -> state preparing >Thread-34::INFO::2014-07-10 09:35:16,676::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-34::DEBUG::2014-07-10 09:35:16,677::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`7e32e8ef-6413-4d45-87bb-808f1c82c10e`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-10 09:35:16,677::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' for lock type 'shared' >Thread-34::DEBUG::2014-07-10 09:35:16,677::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-10 09:35:16,678::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`7e32e8ef-6413-4d45-87bb-808f1c82c10e`::Granted request >Thread-34::DEBUG::2014-07-10 09:35:16,678::task::827::TaskManager.Task::(resourceAcquired) Task=`d02b1111-c867-4c84-b294-1cda921a14c3`::_resourcesAcquired: Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee (shared) >Thread-34::DEBUG::2014-07-10 09:35:16,679::task::990::TaskManager.Task::(_decref) Task=`d02b1111-c867-4c84-b294-1cda921a14c3`::ref 1 aborting False >Thread-34::INFO::2014-07-10 09:35:16,680::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532067385344', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:35:16,680::task::1185::TaskManager.Task::(prepare) Task=`d02b1111-c867-4c84-b294-1cda921a14c3`::finished: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532067385344', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:35:16,680::task::595::TaskManager.Task::(_updateState) Task=`d02b1111-c867-4c84-b294-1cda921a14c3`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-10 09:35:16,680::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee': < ResourceRef 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-10 09:35:16,680::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-10 09:35:16,681::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' >Thread-34::DEBUG::2014-07-10 09:35:16,681::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' (0 active users) >Thread-34::DEBUG::2014-07-10 09:35:16,681::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-10 09:35:16,681::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', Clearing records. >Thread-34::DEBUG::2014-07-10 09:35:16,682::task::990::TaskManager.Task::(_decref) Task=`d02b1111-c867-4c84-b294-1cda921a14c3`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 09:35:17,280::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:35:17,368::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0268864 s, 38.1 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-10 09:35:18,083::domainMonitor::192::Storage.DomainMonitorThread::(_monitorDomain) Refreshing domain 9e1aa540-1f4e-4ee3-a152-be381ef6c3bd >Thread-18::DEBUG::2014-07-10 09:35:18,084::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with LvMetadataRW backend >Thread-18::DEBUG::2014-07-10 09:35:18,085::blockSD::336::Storage.Misc.excCmd::(readlines) '/bin/dd iflag=direct skip=0 bs=2048 if=/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/metadata count=1' (cwd None) >Thread-18::DEBUG::2014-07-10 09:35:18,117::blockSD::336::Storage.Misc.excCmd::(readlines) SUCCESS: <err> = '1+0 records in\n1+0 records out\n2048 bytes (2.0 kB) copied, 0.0143678 s, 143 kB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-10 09:35:18,117::misc::282::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '2048 bytes (2.0 kB) copied, 0.0143678 s, 143 kB/s'], size: 2048 >Thread-18::DEBUG::2014-07-10 09:35:18,117::persistentDict::234::Storage.PersistentDict::(refresh) read lines (LvMetadataRW)=[] >Thread-18::WARNING::2014-07-10 09:35:18,118::persistentDict::256::Storage.PersistentDict::(refresh) data has no embedded checksum - trust it as it is >Thread-18::DEBUG::2014-07-10 09:35:18,118::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with VGTagMetadataRW backend >Thread-18::DEBUG::2014-07-10 09:35:18,121::lvm::503::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-18::DEBUG::2014-07-10 09:35:18,121::lvm::505::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-18::DEBUG::2014-07-10 09:35:18,121::lvm::513::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-18::DEBUG::2014-07-10 09:35:18,122::lvm::525::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-18::DEBUG::2014-07-10 09:35:18,122::lvm::373::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-18::DEBUG::2014-07-10 09:35:18,123::lvm::296::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/3600601601282300032826addbbdae311|/dev/mapper/360060160f4a030003840ec867ddee311|/dev/mapper/367cad74c2fcba00019e6afd20c781e67|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name 9e1aa540-1f4e-4ee3-a152-be381ef6c3bd' (cwd None) >Thread-57::DEBUG::2014-07-10 09:35:18,144::task::595::TaskManager.Task::(_updateState) Task=`1a6cbbbd-e7e4-4014-83af-45a4bb326c53`::moving from state init -> state preparing >Thread-57::INFO::2014-07-10 09:35:18,145::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='b6f6c0da-e67f-4902-b9ac-3069571a42fe', volUUID='c4cd1da8-05b7-45e0-80b1-1183d21443d9', options=None) >Thread-18::DEBUG::2014-07-10 09:35:18,476::lvm::296::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-18::DEBUG::2014-07-10 09:35:18,478::lvm::415::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-18::DEBUG::2014-07-10 09:35:18,479::persistentDict::234::Storage.PersistentDict::(refresh) read lines (VGTagMetadataRW)=['LEASETIMESEC=60', 'VGUUID=9CsMxb-YbRc-yRG7-cQKD-xY3G-GLi5-YxUyPC', 'VERSION=3', 'TYPE=ISCSI', 'LOGBLKSIZE=512', u'PV0=pv:3600601601282300032826addbbdae311,uuid:7qEb8v-jk2X-3CPk-k4XB-eIBk-onYD-807hcV,pestart:0,pecount:8189,mapoffset:0', 'LEASERETRIES=3', 'IOOPTIMEOUTSEC=10', 'LOCKRENEWALINTERVALSEC=5', 'PHYBLKSIZE=512', 'SDUUID=9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'CLASS=Data', 'LOCKPOLICY=', 'DESCRIPTION=SD_REAL', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=DC_REAL', 'ROLE=Master', 'POOL_UUID=4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', 'POOL_SPM_ID=1', 'POOL_SPM_LVER=0', '_SHA_CKSUM=013b5a7910962201c4cceab31b9c6d9c79f7316f', u'POOL_DOMAINS=9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active'] >Thread-18::INFO::2014-07-10 09:35:18,482::sd::384::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 9e1aa540-1f4e-4ee3-a152-be381ef6c3bd_imageNS already registered >Thread-18::INFO::2014-07-10 09:35:18,482::sd::392::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 9e1aa540-1f4e-4ee3-a152-be381ef6c3bd_volumeNS already registered >Thread-18::INFO::2014-07-10 09:35:18,482::blockSD::452::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 9e1aa540-1f4e-4ee3-a152-be381ef6c3bd_lvmActivationNS already registered >Thread-57::INFO::2014-07-10 09:35:18,485::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-57::DEBUG::2014-07-10 09:35:18,488::task::1185::TaskManager.Task::(prepare) Task=`1a6cbbbd-e7e4-4014-83af-45a4bb326c53`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-18::DEBUG::2014-07-10 09:35:18,490::lvm::296::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgck --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/3600601601282300032826addbbdae311|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } " 9e1aa540-1f4e-4ee3-a152-be381ef6c3bd' (cwd None) >Thread-57::DEBUG::2014-07-10 09:35:18,490::task::595::TaskManager.Task::(_updateState) Task=`1a6cbbbd-e7e4-4014-83af-45a4bb326c53`::moving from state preparing -> state finished >Thread-57::DEBUG::2014-07-10 09:35:18,513::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-57::DEBUG::2014-07-10 09:35:18,514::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-57::DEBUG::2014-07-10 09:35:18,515::task::990::TaskManager.Task::(_decref) Task=`1a6cbbbd-e7e4-4014-83af-45a4bb326c53`::ref 0 aborting False >Thread-18::DEBUG::2014-07-10 09:35:18,701::lvm::296::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-18::DEBUG::2014-07-10 09:35:18,702::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/metadata bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-10 09:35:18,733::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.0103654 s, 395 kB/s\n'; <rc> = 0 >Thread-40::DEBUG::2014-07-10 09:35:18,809::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lion.qa.lab.tlv.redhat.com:_export_yuri2_backup2/6a70504d-00df-4869-8695-0f442053f6b6/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-40::DEBUG::2014-07-10 09:35:18,829::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n369 bytes (369 B) copied, 0.000486675 s, 758 kB/s\n'; <rc> = 0 >Thread-67::DEBUG::2014-07-10 09:35:19,107::task::595::TaskManager.Task::(_updateState) Task=`e32cce19-77ac-4326-9db5-8393a6c173e0`::moving from state init -> state preparing >Thread-67::INFO::2014-07-10 09:35:19,107::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='f30c2cb7-a43a-4bf5-82b5-cfe07336f65c', volUUID='b0fbb3c9-55af-4a3a-95ad-fc56a80b9cf5', options=None) >Thread-67::INFO::2014-07-10 09:35:19,108::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-67::DEBUG::2014-07-10 09:35:19,108::task::1185::TaskManager.Task::(prepare) Task=`e32cce19-77ac-4326-9db5-8393a6c173e0`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-67::DEBUG::2014-07-10 09:35:19,108::task::595::TaskManager.Task::(_updateState) Task=`e32cce19-77ac-4326-9db5-8393a6c173e0`::moving from state preparing -> state finished >Thread-67::DEBUG::2014-07-10 09:35:19,108::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-67::DEBUG::2014-07-10 09:35:19,108::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-67::DEBUG::2014-07-10 09:35:19,109::task::990::TaskManager.Task::(_decref) Task=`e32cce19-77ac-4326-9db5-8393a6c173e0`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 09:35:19,384::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:35:19,495::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0537005 s, 19.1 MB/s\n'; <rc> = 0 >Thread-48::DEBUG::2014-07-10 09:35:19,670::task::595::TaskManager.Task::(_updateState) Task=`5c56c305-3a4b-4761-8e1c-cb011cb6296b`::moving from state init -> state preparing >Thread-48::INFO::2014-07-10 09:35:19,670::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='0cd7d6ce-f497-4243-a690-c57744861eea', volUUID='10b6a7dd-dc6c-43fa-ba17-92e4331b0e0b', options=None) >Thread-48::INFO::2014-07-10 09:35:19,671::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-48::DEBUG::2014-07-10 09:35:19,671::task::1185::TaskManager.Task::(prepare) Task=`5c56c305-3a4b-4761-8e1c-cb011cb6296b`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-48::DEBUG::2014-07-10 09:35:19,671::task::595::TaskManager.Task::(_updateState) Task=`5c56c305-3a4b-4761-8e1c-cb011cb6296b`::moving from state preparing -> state finished >Thread-48::DEBUG::2014-07-10 09:35:19,671::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-48::DEBUG::2014-07-10 09:35:19,672::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-48::DEBUG::2014-07-10 09:35:19,672::task::990::TaskManager.Task::(_decref) Task=`5c56c305-3a4b-4761-8e1c-cb011cb6296b`::ref 0 aborting False >Thread-76::DEBUG::2014-07-10 09:35:21,033::task::595::TaskManager.Task::(_updateState) Task=`7c736b4e-5914-4655-8fc5-cb1bd0e11388`::moving from state init -> state preparing >Thread-76::INFO::2014-07-10 09:35:21,034::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='e4c65229-4247-4b33-b72a-f1d5ce72ad05', volUUID='cad94284-3ca9-4c30-933d-997f4460309e', options=None) >Thread-76::INFO::2014-07-10 09:35:21,034::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-76::DEBUG::2014-07-10 09:35:21,034::task::1185::TaskManager.Task::(prepare) Task=`7c736b4e-5914-4655-8fc5-cb1bd0e11388`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-76::DEBUG::2014-07-10 09:35:21,035::task::595::TaskManager.Task::(_updateState) Task=`7c736b4e-5914-4655-8fc5-cb1bd0e11388`::moving from state preparing -> state finished >Thread-76::DEBUG::2014-07-10 09:35:21,035::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-76::DEBUG::2014-07-10 09:35:21,035::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-76::DEBUG::2014-07-10 09:35:21,035::task::990::TaskManager.Task::(_decref) Task=`7c736b4e-5914-4655-8fc5-cb1bd0e11388`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 09:35:21,510::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:35:21,602::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0328787 s, 31.1 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:35:23,617::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:35:23,706::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0302346 s, 33.9 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:35:25,722::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:35:25,833::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0484925 s, 21.1 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 09:35:26,706::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-14::DEBUG::2014-07-10 09:35:26,707::task::595::TaskManager.Task::(_updateState) Task=`96a02ff7-875b-4c87-a77d-8a95e2cdacbc`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 09:35:26,707::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-14::INFO::2014-07-10 09:35:26,708::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:35:26,708::task::1185::TaskManager.Task::(prepare) Task=`96a02ff7-875b-4c87-a77d-8a95e2cdacbc`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:35:26,708::task::595::TaskManager.Task::(_updateState) Task=`96a02ff7-875b-4c87-a77d-8a95e2cdacbc`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 09:35:26,708::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 09:35:26,709::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 09:35:26,709::task::990::TaskManager.Task::(_decref) Task=`96a02ff7-875b-4c87-a77d-8a95e2cdacbc`::ref 0 aborting False >Thread-34::DEBUG::2014-07-10 09:35:26,717::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-34::DEBUG::2014-07-10 09:35:26,718::task::595::TaskManager.Task::(_updateState) Task=`974cb429-8aa0-4594-a7fa-ec85a6e3ef27`::moving from state init -> state preparing >Thread-34::INFO::2014-07-10 09:35:26,718::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-34::DEBUG::2014-07-10 09:35:26,719::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`040131ce-b6e1-42f5-b283-340639b0808e`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-10 09:35:26,719::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' for lock type 'shared' >Thread-34::DEBUG::2014-07-10 09:35:26,719::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-10 09:35:26,720::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`040131ce-b6e1-42f5-b283-340639b0808e`::Granted request >Thread-34::DEBUG::2014-07-10 09:35:26,720::task::827::TaskManager.Task::(resourceAcquired) Task=`974cb429-8aa0-4594-a7fa-ec85a6e3ef27`::_resourcesAcquired: Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee (shared) >Thread-34::DEBUG::2014-07-10 09:35:26,720::task::990::TaskManager.Task::(_decref) Task=`974cb429-8aa0-4594-a7fa-ec85a6e3ef27`::ref 1 aborting False >Thread-34::INFO::2014-07-10 09:35:26,721::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532067385344', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:35:26,722::task::1185::TaskManager.Task::(prepare) Task=`974cb429-8aa0-4594-a7fa-ec85a6e3ef27`::finished: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532067385344', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:35:26,722::task::595::TaskManager.Task::(_updateState) Task=`974cb429-8aa0-4594-a7fa-ec85a6e3ef27`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-10 09:35:26,722::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee': < ResourceRef 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-10 09:35:26,722::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-10 09:35:26,724::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' >Thread-34::DEBUG::2014-07-10 09:35:26,724::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' (0 active users) >Thread-34::DEBUG::2014-07-10 09:35:26,724::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-10 09:35:26,724::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', Clearing records. >Thread-34::DEBUG::2014-07-10 09:35:26,725::task::990::TaskManager.Task::(_decref) Task=`974cb429-8aa0-4594-a7fa-ec85a6e3ef27`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 09:35:27,844::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:35:27,936::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0357563 s, 28.6 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-10 09:35:28,769::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/metadata bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-10 09:35:28,795::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00527666 s, 776 kB/s\n'; <rc> = 0 >Thread-40::DEBUG::2014-07-10 09:35:28,855::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lion.qa.lab.tlv.redhat.com:_export_yuri2_backup2/6a70504d-00df-4869-8695-0f442053f6b6/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-40::DEBUG::2014-07-10 09:35:28,874::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n369 bytes (369 B) copied, 0.000478277 s, 772 kB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:35:29,951::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:35:30,043::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.035428 s, 28.9 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 09:35:31,665::task::595::TaskManager.Task::(_updateState) Task=`83f3ea34-28fa-4ae6-8b30-e5ee45195c2f`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 09:35:31,666::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::INFO::2014-07-10 09:35:31,666::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00527666', 'lastCheck': '2.8', 'valid': True}, '6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000478277', 'lastCheck': '2.8', 'valid': True}} >Thread-14::DEBUG::2014-07-10 09:35:31,667::task::1185::TaskManager.Task::(prepare) Task=`83f3ea34-28fa-4ae6-8b30-e5ee45195c2f`::finished: {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00527666', 'lastCheck': '2.8', 'valid': True}, '6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000478277', 'lastCheck': '2.8', 'valid': True}} >Thread-14::DEBUG::2014-07-10 09:35:31,667::task::595::TaskManager.Task::(_updateState) Task=`83f3ea34-28fa-4ae6-8b30-e5ee45195c2f`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 09:35:31,667::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 09:35:31,667::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 09:35:31,667::task::990::TaskManager.Task::(_decref) Task=`83f3ea34-28fa-4ae6-8b30-e5ee45195c2f`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 09:35:32,058::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:35:32,149::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0310747 s, 33.0 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:35:34,164::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:35:34,269::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.04023 s, 25.5 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:35:36,285::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:35:36,373::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.02911 s, 35.2 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 09:35:36,756::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-14::DEBUG::2014-07-10 09:35:36,757::task::595::TaskManager.Task::(_updateState) Task=`ceb41cd7-ce00-4afb-9376-c8933b25a353`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 09:35:36,758::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-14::INFO::2014-07-10 09:35:36,758::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:35:36,759::task::1185::TaskManager.Task::(prepare) Task=`ceb41cd7-ce00-4afb-9376-c8933b25a353`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:35:36,759::task::595::TaskManager.Task::(_updateState) Task=`ceb41cd7-ce00-4afb-9376-c8933b25a353`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 09:35:36,760::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 09:35:36,760::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 09:35:36,760::task::990::TaskManager.Task::(_decref) Task=`ceb41cd7-ce00-4afb-9376-c8933b25a353`::ref 0 aborting False >Thread-34::DEBUG::2014-07-10 09:35:36,764::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-34::DEBUG::2014-07-10 09:35:36,765::task::595::TaskManager.Task::(_updateState) Task=`93b909cb-6b88-4cfb-9d21-6dfd333dd2c2`::moving from state init -> state preparing >Thread-34::INFO::2014-07-10 09:35:36,765::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-34::DEBUG::2014-07-10 09:35:36,766::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`a94f3c77-e9a4-423a-ab4c-bb1afca0ac53`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-10 09:35:36,766::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' for lock type 'shared' >Thread-34::DEBUG::2014-07-10 09:35:36,766::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-10 09:35:36,766::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`a94f3c77-e9a4-423a-ab4c-bb1afca0ac53`::Granted request >Thread-34::DEBUG::2014-07-10 09:35:36,767::task::827::TaskManager.Task::(resourceAcquired) Task=`93b909cb-6b88-4cfb-9d21-6dfd333dd2c2`::_resourcesAcquired: Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee (shared) >Thread-34::DEBUG::2014-07-10 09:35:36,767::task::990::TaskManager.Task::(_decref) Task=`93b909cb-6b88-4cfb-9d21-6dfd333dd2c2`::ref 1 aborting False >Thread-34::INFO::2014-07-10 09:35:36,768::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532067385344', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:35:36,768::task::1185::TaskManager.Task::(prepare) Task=`93b909cb-6b88-4cfb-9d21-6dfd333dd2c2`::finished: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532067385344', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:35:36,770::task::595::TaskManager.Task::(_updateState) Task=`93b909cb-6b88-4cfb-9d21-6dfd333dd2c2`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-10 09:35:36,776::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee': < ResourceRef 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-10 09:35:36,787::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-10 09:35:36,818::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' >Thread-34::DEBUG::2014-07-10 09:35:36,833::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' (0 active users) >Thread-34::DEBUG::2014-07-10 09:35:36,843::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-10 09:35:36,854::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', Clearing records. >Thread-34::DEBUG::2014-07-10 09:35:36,883::task::990::TaskManager.Task::(_decref) Task=`93b909cb-6b88-4cfb-9d21-6dfd333dd2c2`::ref 0 aborting False >Thread-70::DEBUG::2014-07-10 09:35:38,227::task::595::TaskManager.Task::(_updateState) Task=`2d159d21-d916-4427-900f-7fbe6ec3a4d6`::moving from state init -> state preparing >Thread-70::INFO::2014-07-10 09:35:38,228::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='cfaeead2-7caa-467c-b389-c89840ae6605', volUUID='567fe32d-31a6-4ff6-90f3-fd6a656fbecc', options=None) >Thread-70::INFO::2014-07-10 09:35:38,228::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-70::DEBUG::2014-07-10 09:35:38,228::task::1185::TaskManager.Task::(prepare) Task=`2d159d21-d916-4427-900f-7fbe6ec3a4d6`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-70::DEBUG::2014-07-10 09:35:38,229::task::595::TaskManager.Task::(_updateState) Task=`2d159d21-d916-4427-900f-7fbe6ec3a4d6`::moving from state preparing -> state finished >Thread-70::DEBUG::2014-07-10 09:35:38,229::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-70::DEBUG::2014-07-10 09:35:38,229::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-70::DEBUG::2014-07-10 09:35:38,229::task::990::TaskManager.Task::(_decref) Task=`2d159d21-d916-4427-900f-7fbe6ec3a4d6`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 09:35:38,388::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:35:38,470::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.026175 s, 39.1 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-10 09:35:38,825::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/metadata bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-10 09:35:38,850::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00473948 s, 864 kB/s\n'; <rc> = 0 >Thread-40::DEBUG::2014-07-10 09:35:38,906::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lion.qa.lab.tlv.redhat.com:_export_yuri2_backup2/6a70504d-00df-4869-8695-0f442053f6b6/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-40::DEBUG::2014-07-10 09:35:38,927::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n369 bytes (369 B) copied, 0.00053493 s, 690 kB/s\n'; <rc> = 0 >Thread-60::DEBUG::2014-07-10 09:35:39,175::task::595::TaskManager.Task::(_updateState) Task=`2cafe2b4-8353-42ee-854b-78f795958331`::moving from state init -> state preparing >Thread-60::INFO::2014-07-10 09:35:39,175::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='b034d5b0-e1e0-4011-b49b-4d45ddb11556', volUUID='3d7f62b5-328f-4d8e-8b69-873cfb5ae14d', options=None) >Thread-60::INFO::2014-07-10 09:35:39,176::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-60::DEBUG::2014-07-10 09:35:39,176::task::1185::TaskManager.Task::(prepare) Task=`2cafe2b4-8353-42ee-854b-78f795958331`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-60::DEBUG::2014-07-10 09:35:39,176::task::595::TaskManager.Task::(_updateState) Task=`2cafe2b4-8353-42ee-854b-78f795958331`::moving from state preparing -> state finished >Thread-60::DEBUG::2014-07-10 09:35:39,176::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-60::DEBUG::2014-07-10 09:35:39,177::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-60::DEBUG::2014-07-10 09:35:39,177::task::990::TaskManager.Task::(_decref) Task=`2cafe2b4-8353-42ee-854b-78f795958331`::ref 0 aborting False >Thread-51::DEBUG::2014-07-10 09:35:39,221::task::595::TaskManager.Task::(_updateState) Task=`ffbc0dbc-6606-4edd-be58-daa66adcaa17`::moving from state init -> state preparing >Thread-51::INFO::2014-07-10 09:35:39,221::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='76fdb054-02cd-42ed-9721-b3e65b34c3a4', volUUID='022dfe46-2cf7-4915-80b3-883158e3ca83', options=None) >Thread-51::INFO::2014-07-10 09:35:39,222::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-51::DEBUG::2014-07-10 09:35:39,222::task::1185::TaskManager.Task::(prepare) Task=`ffbc0dbc-6606-4edd-be58-daa66adcaa17`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-51::DEBUG::2014-07-10 09:35:39,222::task::595::TaskManager.Task::(_updateState) Task=`ffbc0dbc-6606-4edd-be58-daa66adcaa17`::moving from state preparing -> state finished >Thread-51::DEBUG::2014-07-10 09:35:39,222::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-51::DEBUG::2014-07-10 09:35:39,223::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-51::DEBUG::2014-07-10 09:35:39,223::task::990::TaskManager.Task::(_decref) Task=`ffbc0dbc-6606-4edd-be58-daa66adcaa17`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 09:35:40,485::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:35:40,597::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0540555 s, 18.9 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:35:42,613::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:35:42,708::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0362509 s, 28.2 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:35:44,723::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:35:44,812::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0302433 s, 33.9 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:35:46,827::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Thread-14::DEBUG::2014-07-10 09:35:46,874::task::595::TaskManager.Task::(_updateState) Task=`aa0d0e71-c2c6-4d85-ad1d-7d4d164f262d`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 09:35:46,875::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::INFO::2014-07-10 09:35:46,876::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00473948', 'lastCheck': '8.0', 'valid': True}, '6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00053493', 'lastCheck': '7.9', 'valid': True}} >Thread-14::DEBUG::2014-07-10 09:35:46,876::task::1185::TaskManager.Task::(prepare) Task=`aa0d0e71-c2c6-4d85-ad1d-7d4d164f262d`::finished: {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00473948', 'lastCheck': '8.0', 'valid': True}, '6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00053493', 'lastCheck': '7.9', 'valid': True}} >Thread-14::DEBUG::2014-07-10 09:35:46,876::task::595::TaskManager.Task::(_updateState) Task=`aa0d0e71-c2c6-4d85-ad1d-7d4d164f262d`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 09:35:46,877::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 09:35:46,877::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 09:35:46,877::task::990::TaskManager.Task::(_decref) Task=`aa0d0e71-c2c6-4d85-ad1d-7d4d164f262d`::ref 0 aborting False >Thread-13::DEBUG::2014-07-10 09:35:47,022::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-13::DEBUG::2014-07-10 09:35:47,026::task::595::TaskManager.Task::(_updateState) Task=`7c40e779-fc69-4d84-9d05-ca035c077174`::moving from state init -> state preparing >Thread-13::INFO::2014-07-10 09:35:47,028::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-13::INFO::2014-07-10 09:35:47,031::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-13::DEBUG::2014-07-10 09:35:47,033::task::1185::TaskManager.Task::(prepare) Task=`7c40e779-fc69-4d84-9d05-ca035c077174`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-13::DEBUG::2014-07-10 09:35:47,035::task::595::TaskManager.Task::(_updateState) Task=`7c40e779-fc69-4d84-9d05-ca035c077174`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-07-10 09:35:47,039::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-07-10 09:35:47,041::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-07-10 09:35:47,047::task::990::TaskManager.Task::(_decref) Task=`7c40e779-fc69-4d84-9d05-ca035c077174`::ref 0 aborting False >Thread-34::DEBUG::2014-07-10 09:35:47,087::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-34::DEBUG::2014-07-10 09:35:47,099::task::595::TaskManager.Task::(_updateState) Task=`5111ffd9-a0fd-402e-944e-559e955919ce`::moving from state init -> state preparing >Thread-34::INFO::2014-07-10 09:35:47,114::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-34::DEBUG::2014-07-10 09:35:47,147::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`b77d1e55-f5c8-4999-8ec5-2e7cf72e2108`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-10 09:35:47,158::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' for lock type 'shared' >Thread-34::DEBUG::2014-07-10 09:35:47,184::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-10 09:35:47,200::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`b77d1e55-f5c8-4999-8ec5-2e7cf72e2108`::Granted request >Thread-34::DEBUG::2014-07-10 09:35:47,209::task::827::TaskManager.Task::(resourceAcquired) Task=`5111ffd9-a0fd-402e-944e-559e955919ce`::_resourcesAcquired: Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee (shared) >Thread-34::DEBUG::2014-07-10 09:35:47,215::task::990::TaskManager.Task::(_decref) Task=`5111ffd9-a0fd-402e-944e-559e955919ce`::ref 1 aborting False >Thread-34::INFO::2014-07-10 09:35:47,246::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532067385344', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:35:47,250::task::1185::TaskManager.Task::(prepare) Task=`5111ffd9-a0fd-402e-944e-559e955919ce`::finished: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532067385344', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:35:47,252::task::595::TaskManager.Task::(_updateState) Task=`5111ffd9-a0fd-402e-944e-559e955919ce`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-10 09:35:47,263::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee': < ResourceRef 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-10 09:35:47,265::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-10 09:35:47,277::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' >Thread-34::DEBUG::2014-07-10 09:35:47,280::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' (0 active users) >Thread-34::DEBUG::2014-07-10 09:35:47,285::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-10 09:35:47,286::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', Clearing records. >Thread-34::DEBUG::2014-07-10 09:35:47,288::task::990::TaskManager.Task::(_decref) Task=`5111ffd9-a0fd-402e-944e-559e955919ce`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 09:35:47,318::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0436138 s, 23.5 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-10 09:35:48,882::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/metadata bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-10 09:35:48,910::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00761457 s, 538 kB/s\n'; <rc> = 0 >Thread-40::DEBUG::2014-07-10 09:35:49,079::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lion.qa.lab.tlv.redhat.com:_export_yuri2_backup2/6a70504d-00df-4869-8695-0f442053f6b6/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-40::DEBUG::2014-07-10 09:35:49,100::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n369 bytes (369 B) copied, 0.000496647 s, 743 kB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:35:49,334::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:35:49,447::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0501384 s, 20.4 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:35:51,462::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:35:51,548::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0265952 s, 38.5 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:35:53,564::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:35:53,651::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0296254 s, 34.6 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:35:55,666::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:35:55,758::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0333063 s, 30.7 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 09:35:57,380::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-14::DEBUG::2014-07-10 09:35:57,381::task::595::TaskManager.Task::(_updateState) Task=`b6bcfd0a-7946-4a76-bc23-e031dc511ddc`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 09:35:57,382::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-14::INFO::2014-07-10 09:35:57,382::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:35:57,382::task::1185::TaskManager.Task::(prepare) Task=`b6bcfd0a-7946-4a76-bc23-e031dc511ddc`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:35:57,383::task::595::TaskManager.Task::(_updateState) Task=`b6bcfd0a-7946-4a76-bc23-e031dc511ddc`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 09:35:57,383::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 09:35:57,383::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 09:35:57,383::task::990::TaskManager.Task::(_decref) Task=`b6bcfd0a-7946-4a76-bc23-e031dc511ddc`::ref 0 aborting False >Thread-34::DEBUG::2014-07-10 09:35:57,387::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-34::DEBUG::2014-07-10 09:35:57,388::task::595::TaskManager.Task::(_updateState) Task=`0e2ead36-aad2-47f4-97f1-de00ac332195`::moving from state init -> state preparing >Thread-34::INFO::2014-07-10 09:35:57,388::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-34::DEBUG::2014-07-10 09:35:57,389::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`8f9a7f54-e360-48ec-be98-23d84b733efb`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-10 09:35:57,389::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' for lock type 'shared' >Thread-34::DEBUG::2014-07-10 09:35:57,389::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-10 09:35:57,390::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`8f9a7f54-e360-48ec-be98-23d84b733efb`::Granted request >Thread-34::DEBUG::2014-07-10 09:35:57,390::task::827::TaskManager.Task::(resourceAcquired) Task=`0e2ead36-aad2-47f4-97f1-de00ac332195`::_resourcesAcquired: Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee (shared) >Thread-34::DEBUG::2014-07-10 09:35:57,390::task::990::TaskManager.Task::(_decref) Task=`0e2ead36-aad2-47f4-97f1-de00ac332195`::ref 1 aborting False >Thread-34::INFO::2014-07-10 09:35:57,391::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532067385344', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:35:57,391::task::1185::TaskManager.Task::(prepare) Task=`0e2ead36-aad2-47f4-97f1-de00ac332195`::finished: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532067385344', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:35:57,392::task::595::TaskManager.Task::(_updateState) Task=`0e2ead36-aad2-47f4-97f1-de00ac332195`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-10 09:35:57,392::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee': < ResourceRef 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-10 09:35:57,392::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-10 09:35:57,392::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' >Thread-34::DEBUG::2014-07-10 09:35:57,393::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' (0 active users) >Thread-34::DEBUG::2014-07-10 09:35:57,393::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-10 09:35:57,393::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', Clearing records. >Thread-34::DEBUG::2014-07-10 09:35:57,393::task::990::TaskManager.Task::(_decref) Task=`0e2ead36-aad2-47f4-97f1-de00ac332195`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 09:35:57,774::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:35:57,883::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0507321 s, 20.2 MB/s\n'; <rc> = 0 >Thread-64::DEBUG::2014-07-10 09:35:58,331::task::595::TaskManager.Task::(_updateState) Task=`7c3b9770-621e-4d81-9ec9-93a18eb501f0`::moving from state init -> state preparing >Thread-64::INFO::2014-07-10 09:35:58,332::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='aa20346a-4d3a-4e07-b8e1-52c0ebe4168c', volUUID='58fefce2-9bce-4bff-8949-8c6ce8122b27', options=None) >Thread-64::INFO::2014-07-10 09:35:58,333::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-64::DEBUG::2014-07-10 09:35:58,333::task::1185::TaskManager.Task::(prepare) Task=`7c3b9770-621e-4d81-9ec9-93a18eb501f0`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-64::DEBUG::2014-07-10 09:35:58,333::task::595::TaskManager.Task::(_updateState) Task=`7c3b9770-621e-4d81-9ec9-93a18eb501f0`::moving from state preparing -> state finished >Thread-64::DEBUG::2014-07-10 09:35:58,333::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-64::DEBUG::2014-07-10 09:35:58,333::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-64::DEBUG::2014-07-10 09:35:58,334::task::990::TaskManager.Task::(_decref) Task=`7c3b9770-621e-4d81-9ec9-93a18eb501f0`::ref 0 aborting False >Thread-18::DEBUG::2014-07-10 09:35:59,062::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/metadata bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-10 09:35:59,084::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000690174 s, 5.9 MB/s\n'; <rc> = 0 >Thread-40::DEBUG::2014-07-10 09:35:59,289::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lion.qa.lab.tlv.redhat.com:_export_yuri2_backup2/6a70504d-00df-4869-8695-0f442053f6b6/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-40::DEBUG::2014-07-10 09:35:59,315::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n369 bytes (369 B) copied, 0.000440507 s, 838 kB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:35:59,901::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:35:59,997::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0353646 s, 29.0 MB/s\n'; <rc> = 0 >Thread-73::DEBUG::2014-07-10 09:36:00,593::task::595::TaskManager.Task::(_updateState) Task=`58f80b9f-bc95-4c74-beeb-88ebe66df6bf`::moving from state init -> state preparing >Thread-73::INFO::2014-07-10 09:36:00,593::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='c01d693b-cba0-4fed-9ad7-0aaa28912a19', volUUID='4bb5d954-2a50-4028-b299-0b43c261270c', options=None) >Thread-73::INFO::2014-07-10 09:36:00,594::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-73::DEBUG::2014-07-10 09:36:00,594::task::1185::TaskManager.Task::(prepare) Task=`58f80b9f-bc95-4c74-beeb-88ebe66df6bf`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-73::DEBUG::2014-07-10 09:36:00,594::task::595::TaskManager.Task::(_updateState) Task=`58f80b9f-bc95-4c74-beeb-88ebe66df6bf`::moving from state preparing -> state finished >Thread-73::DEBUG::2014-07-10 09:36:00,594::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-73::DEBUG::2014-07-10 09:36:00,595::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-73::DEBUG::2014-07-10 09:36:00,595::task::990::TaskManager.Task::(_decref) Task=`58f80b9f-bc95-4c74-beeb-88ebe66df6bf`::ref 0 aborting False >Thread-54::DEBUG::2014-07-10 09:36:00,597::task::595::TaskManager.Task::(_updateState) Task=`d7b96d86-0907-405d-ad42-6e9b59a5da48`::moving from state init -> state preparing >Thread-54::INFO::2014-07-10 09:36:00,598::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='28408446-e5fd-4565-a976-e760951593fe', volUUID='776303a2-5585-451e-826e-0e338d4a1e98', options=None) >Thread-54::INFO::2014-07-10 09:36:00,599::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-54::DEBUG::2014-07-10 09:36:00,599::task::1185::TaskManager.Task::(prepare) Task=`d7b96d86-0907-405d-ad42-6e9b59a5da48`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-54::DEBUG::2014-07-10 09:36:00,599::task::595::TaskManager.Task::(_updateState) Task=`d7b96d86-0907-405d-ad42-6e9b59a5da48`::moving from state preparing -> state finished >Thread-54::DEBUG::2014-07-10 09:36:00,599::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-54::DEBUG::2014-07-10 09:36:00,600::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-54::DEBUG::2014-07-10 09:36:00,600::task::990::TaskManager.Task::(_decref) Task=`d7b96d86-0907-405d-ad42-6e9b59a5da48`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 09:36:02,012::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:36:02,112::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0406394 s, 25.2 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 09:36:02,491::task::595::TaskManager.Task::(_updateState) Task=`9ba4fe34-34e8-45f5-bb19-05e82be4355d`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 09:36:02,492::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::INFO::2014-07-10 09:36:02,492::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000690174', 'lastCheck': '3.2', 'valid': True}, '6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000440507', 'lastCheck': '3.2', 'valid': True}} >Thread-14::DEBUG::2014-07-10 09:36:02,493::task::1185::TaskManager.Task::(prepare) Task=`9ba4fe34-34e8-45f5-bb19-05e82be4355d`::finished: {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000690174', 'lastCheck': '3.2', 'valid': True}, '6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000440507', 'lastCheck': '3.2', 'valid': True}} >Thread-14::DEBUG::2014-07-10 09:36:02,493::task::595::TaskManager.Task::(_updateState) Task=`9ba4fe34-34e8-45f5-bb19-05e82be4355d`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 09:36:02,493::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 09:36:02,493::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 09:36:02,494::task::990::TaskManager.Task::(_decref) Task=`9ba4fe34-34e8-45f5-bb19-05e82be4355d`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 09:36:04,127::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:36:04,223::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0361353 s, 28.3 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:36:06,238::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:36:06,327::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0323491 s, 31.7 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 09:36:07,422::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-14::DEBUG::2014-07-10 09:36:07,424::task::595::TaskManager.Task::(_updateState) Task=`eae936b9-fd00-4987-8d9f-faff7d39601b`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 09:36:07,424::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-14::INFO::2014-07-10 09:36:07,425::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:36:07,425::task::1185::TaskManager.Task::(prepare) Task=`eae936b9-fd00-4987-8d9f-faff7d39601b`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:36:07,425::task::595::TaskManager.Task::(_updateState) Task=`eae936b9-fd00-4987-8d9f-faff7d39601b`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 09:36:07,426::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 09:36:07,426::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 09:36:07,426::task::990::TaskManager.Task::(_decref) Task=`eae936b9-fd00-4987-8d9f-faff7d39601b`::ref 0 aborting False >Thread-34::DEBUG::2014-07-10 09:36:07,431::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-34::DEBUG::2014-07-10 09:36:07,432::task::595::TaskManager.Task::(_updateState) Task=`6ae5522f-439a-4359-af40-e52721c84aec`::moving from state init -> state preparing >Thread-34::INFO::2014-07-10 09:36:07,432::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-34::DEBUG::2014-07-10 09:36:07,433::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`e1414b70-5c83-47bd-ad75-313df3a87e9c`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-10 09:36:07,433::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' for lock type 'shared' >Thread-34::DEBUG::2014-07-10 09:36:07,434::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-10 09:36:07,434::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`e1414b70-5c83-47bd-ad75-313df3a87e9c`::Granted request >Thread-34::DEBUG::2014-07-10 09:36:07,435::task::827::TaskManager.Task::(resourceAcquired) Task=`6ae5522f-439a-4359-af40-e52721c84aec`::_resourcesAcquired: Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee (shared) >Thread-34::DEBUG::2014-07-10 09:36:07,435::task::990::TaskManager.Task::(_decref) Task=`6ae5522f-439a-4359-af40-e52721c84aec`::ref 1 aborting False >Thread-34::INFO::2014-07-10 09:36:07,437::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532067385344', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:36:07,438::task::1185::TaskManager.Task::(prepare) Task=`6ae5522f-439a-4359-af40-e52721c84aec`::finished: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532067385344', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:36:07,438::task::595::TaskManager.Task::(_updateState) Task=`6ae5522f-439a-4359-af40-e52721c84aec`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-10 09:36:07,438::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee': < ResourceRef 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-10 09:36:07,438::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-10 09:36:07,439::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' >Thread-34::DEBUG::2014-07-10 09:36:07,439::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' (0 active users) >Thread-34::DEBUG::2014-07-10 09:36:07,439::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-10 09:36:07,439::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', Clearing records. >Thread-34::DEBUG::2014-07-10 09:36:07,440::task::990::TaskManager.Task::(_decref) Task=`6ae5522f-439a-4359-af40-e52721c84aec`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 09:36:08,342::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:36:08,458::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.055638 s, 18.4 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-10 09:36:09,255::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/metadata bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-10 09:36:09,281::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00545839 s, 750 kB/s\n'; <rc> = 0 >Thread-40::DEBUG::2014-07-10 09:36:09,722::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lion.qa.lab.tlv.redhat.com:_export_yuri2_backup2/6a70504d-00df-4869-8695-0f442053f6b6/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-40::DEBUG::2014-07-10 09:36:09,742::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n369 bytes (369 B) copied, 0.00051597 s, 715 kB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:36:10,473::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:36:10,613::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0657486 s, 15.6 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:36:12,628::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:36:12,762::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0748786 s, 13.7 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:36:14,778::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:36:14,877::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0419147 s, 24.4 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:36:16,893::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:36:17,022::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0535763 s, 19.1 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 09:36:17,505::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-14::DEBUG::2014-07-10 09:36:17,507::task::595::TaskManager.Task::(_updateState) Task=`f2eaf13e-a16f-4063-9303-d521ae150bc3`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 09:36:17,507::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-14::INFO::2014-07-10 09:36:17,508::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:36:17,509::task::1185::TaskManager.Task::(prepare) Task=`f2eaf13e-a16f-4063-9303-d521ae150bc3`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:36:17,509::task::595::TaskManager.Task::(_updateState) Task=`f2eaf13e-a16f-4063-9303-d521ae150bc3`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 09:36:17,509::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 09:36:17,509::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 09:36:17,510::task::990::TaskManager.Task::(_decref) Task=`f2eaf13e-a16f-4063-9303-d521ae150bc3`::ref 0 aborting False >Thread-34::DEBUG::2014-07-10 09:36:17,515::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-34::DEBUG::2014-07-10 09:36:17,516::task::595::TaskManager.Task::(_updateState) Task=`34df0eda-7e61-43a5-9bce-45f5cea238f6`::moving from state init -> state preparing >Thread-34::INFO::2014-07-10 09:36:17,516::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-34::DEBUG::2014-07-10 09:36:17,517::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`146ee8e6-cc7a-4729-8f3f-95cbea148bf5`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-10 09:36:17,517::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' for lock type 'shared' >Thread-34::DEBUG::2014-07-10 09:36:17,518::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-10 09:36:17,518::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`146ee8e6-cc7a-4729-8f3f-95cbea148bf5`::Granted request >Thread-34::DEBUG::2014-07-10 09:36:17,519::task::827::TaskManager.Task::(resourceAcquired) Task=`34df0eda-7e61-43a5-9bce-45f5cea238f6`::_resourcesAcquired: Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee (shared) >Thread-34::DEBUG::2014-07-10 09:36:17,520::task::990::TaskManager.Task::(_decref) Task=`34df0eda-7e61-43a5-9bce-45f5cea238f6`::ref 1 aborting False >Thread-34::INFO::2014-07-10 09:36:17,521::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532067385344', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:36:17,522::task::1185::TaskManager.Task::(prepare) Task=`34df0eda-7e61-43a5-9bce-45f5cea238f6`::finished: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532067385344', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:36:17,522::task::595::TaskManager.Task::(_updateState) Task=`34df0eda-7e61-43a5-9bce-45f5cea238f6`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-10 09:36:17,522::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee': < ResourceRef 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-10 09:36:17,523::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-10 09:36:17,523::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' >Thread-34::DEBUG::2014-07-10 09:36:17,524::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' (0 active users) >Thread-34::DEBUG::2014-07-10 09:36:17,524::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-10 09:36:17,524::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', Clearing records. >Thread-34::DEBUG::2014-07-10 09:36:17,525::task::990::TaskManager.Task::(_decref) Task=`34df0eda-7e61-43a5-9bce-45f5cea238f6`::ref 0 aborting False >Thread-14::DEBUG::2014-07-10 09:36:17,701::task::595::TaskManager.Task::(_updateState) Task=`108ba53b-0a16-4385-9e15-1d5c49e2fca3`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 09:36:17,702::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::INFO::2014-07-10 09:36:17,702::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00545839', 'lastCheck': '8.0', 'valid': True}, '6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00051597', 'lastCheck': '8.0', 'valid': True}} >Thread-14::DEBUG::2014-07-10 09:36:17,703::task::1185::TaskManager.Task::(prepare) Task=`108ba53b-0a16-4385-9e15-1d5c49e2fca3`::finished: {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00545839', 'lastCheck': '8.0', 'valid': True}, '6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00051597', 'lastCheck': '8.0', 'valid': True}} >Thread-14::DEBUG::2014-07-10 09:36:17,703::task::595::TaskManager.Task::(_updateState) Task=`108ba53b-0a16-4385-9e15-1d5c49e2fca3`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 09:36:17,703::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 09:36:17,703::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 09:36:17,704::task::990::TaskManager.Task::(_decref) Task=`108ba53b-0a16-4385-9e15-1d5c49e2fca3`::ref 0 aborting False >Thread-57::DEBUG::2014-07-10 09:36:18,805::task::595::TaskManager.Task::(_updateState) Task=`67ce1aa8-f6af-460c-8a2e-1de5bffd809b`::moving from state init -> state preparing >Thread-57::INFO::2014-07-10 09:36:18,806::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='b6f6c0da-e67f-4902-b9ac-3069571a42fe', volUUID='c4cd1da8-05b7-45e0-80b1-1183d21443d9', options=None) >Thread-57::INFO::2014-07-10 09:36:18,807::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-57::DEBUG::2014-07-10 09:36:18,807::task::1185::TaskManager.Task::(prepare) Task=`67ce1aa8-f6af-460c-8a2e-1de5bffd809b`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-57::DEBUG::2014-07-10 09:36:18,807::task::595::TaskManager.Task::(_updateState) Task=`67ce1aa8-f6af-460c-8a2e-1de5bffd809b`::moving from state preparing -> state finished >Thread-57::DEBUG::2014-07-10 09:36:18,807::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-57::DEBUG::2014-07-10 09:36:18,807::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-57::DEBUG::2014-07-10 09:36:18,808::task::990::TaskManager.Task::(_decref) Task=`67ce1aa8-f6af-460c-8a2e-1de5bffd809b`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 09:36:19,044::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:36:19,134::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0323829 s, 31.6 MB/s\n'; <rc> = 0 >Thread-67::DEBUG::2014-07-10 09:36:19,412::task::595::TaskManager.Task::(_updateState) Task=`800ee144-2ce5-4559-bfe4-ea903b7c319f`::moving from state init -> state preparing >Thread-67::INFO::2014-07-10 09:36:19,413::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='f30c2cb7-a43a-4bf5-82b5-cfe07336f65c', volUUID='b0fbb3c9-55af-4a3a-95ad-fc56a80b9cf5', options=None) >Thread-67::INFO::2014-07-10 09:36:19,413::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-67::DEBUG::2014-07-10 09:36:19,414::task::1185::TaskManager.Task::(prepare) Task=`800ee144-2ce5-4559-bfe4-ea903b7c319f`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-67::DEBUG::2014-07-10 09:36:19,414::task::595::TaskManager.Task::(_updateState) Task=`800ee144-2ce5-4559-bfe4-ea903b7c319f`::moving from state preparing -> state finished >Thread-67::DEBUG::2014-07-10 09:36:19,414::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-67::DEBUG::2014-07-10 09:36:19,417::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-67::DEBUG::2014-07-10 09:36:19,418::task::990::TaskManager.Task::(_decref) Task=`800ee144-2ce5-4559-bfe4-ea903b7c319f`::ref 0 aborting False >Thread-18::DEBUG::2014-07-10 09:36:19,709::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/metadata bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-10 09:36:19,735::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00549678 s, 745 kB/s\n'; <rc> = 0 >Thread-40::DEBUG::2014-07-10 09:36:19,920::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lion.qa.lab.tlv.redhat.com:_export_yuri2_backup2/6a70504d-00df-4869-8695-0f442053f6b6/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-40::DEBUG::2014-07-10 09:36:19,947::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n369 bytes (369 B) copied, 0.000438354 s, 842 kB/s\n'; <rc> = 0 >Thread-48::DEBUG::2014-07-10 09:36:19,965::task::595::TaskManager.Task::(_updateState) Task=`d3eec007-d500-4e78-8ca2-f9f4c3109c63`::moving from state init -> state preparing >Thread-48::INFO::2014-07-10 09:36:19,966::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='0cd7d6ce-f497-4243-a690-c57744861eea', volUUID='10b6a7dd-dc6c-43fa-ba17-92e4331b0e0b', options=None) >Thread-48::INFO::2014-07-10 09:36:19,966::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-48::DEBUG::2014-07-10 09:36:19,966::task::1185::TaskManager.Task::(prepare) Task=`d3eec007-d500-4e78-8ca2-f9f4c3109c63`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-48::DEBUG::2014-07-10 09:36:19,966::task::595::TaskManager.Task::(_updateState) Task=`d3eec007-d500-4e78-8ca2-f9f4c3109c63`::moving from state preparing -> state finished >Thread-48::DEBUG::2014-07-10 09:36:19,967::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-48::DEBUG::2014-07-10 09:36:19,967::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-48::DEBUG::2014-07-10 09:36:19,967::task::990::TaskManager.Task::(_decref) Task=`d3eec007-d500-4e78-8ca2-f9f4c3109c63`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 09:36:21,150::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:36:21,245::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0374432 s, 27.3 MB/s\n'; <rc> = 0 >Thread-76::DEBUG::2014-07-10 09:36:21,329::task::595::TaskManager.Task::(_updateState) Task=`40a6aaaa-8060-408a-8de5-66d9087eca38`::moving from state init -> state preparing >Thread-76::INFO::2014-07-10 09:36:21,330::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='e4c65229-4247-4b33-b72a-f1d5ce72ad05', volUUID='cad94284-3ca9-4c30-933d-997f4460309e', options=None) >Thread-76::INFO::2014-07-10 09:36:21,330::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-76::DEBUG::2014-07-10 09:36:21,330::task::1185::TaskManager.Task::(prepare) Task=`40a6aaaa-8060-408a-8de5-66d9087eca38`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-76::DEBUG::2014-07-10 09:36:21,330::task::595::TaskManager.Task::(_updateState) Task=`40a6aaaa-8060-408a-8de5-66d9087eca38`::moving from state preparing -> state finished >Thread-76::DEBUG::2014-07-10 09:36:21,331::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-76::DEBUG::2014-07-10 09:36:21,331::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-76::DEBUG::2014-07-10 09:36:21,331::task::990::TaskManager.Task::(_decref) Task=`40a6aaaa-8060-408a-8de5-66d9087eca38`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 09:36:23,261::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:36:23,352::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0271639 s, 37.7 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:36:25,368::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:36:25,477::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0415019 s, 24.7 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:36:27,491::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Thread-14::DEBUG::2014-07-10 09:36:27,565::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-14::DEBUG::2014-07-10 09:36:27,569::task::595::TaskManager.Task::(_updateState) Task=`1c880630-c292-459e-8ae2-14caf8c433e1`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 09:36:27,571::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-14::INFO::2014-07-10 09:36:27,574::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:36:27,575::task::1185::TaskManager.Task::(prepare) Task=`1c880630-c292-459e-8ae2-14caf8c433e1`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:36:27,576::task::595::TaskManager.Task::(_updateState) Task=`1c880630-c292-459e-8ae2-14caf8c433e1`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 09:36:27,578::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 09:36:27,579::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 09:36:27,581::task::990::TaskManager.Task::(_decref) Task=`1c880630-c292-459e-8ae2-14caf8c433e1`::ref 0 aborting False >Thread-34::DEBUG::2014-07-10 09:36:27,596::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-34::DEBUG::2014-07-10 09:36:27,601::task::595::TaskManager.Task::(_updateState) Task=`d42eba84-c985-41fc-b2d1-a8636fceb873`::moving from state init -> state preparing >Thread-34::INFO::2014-07-10 09:36:27,604::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-34::DEBUG::2014-07-10 09:36:27,610::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`f164a760-51a1-45e8-b0a7-0ba0e184792b`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-10 09:36:27,613::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' for lock type 'shared' >Thread-34::DEBUG::2014-07-10 09:36:27,616::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-10 09:36:27,619::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`f164a760-51a1-45e8-b0a7-0ba0e184792b`::Granted request >Thread-34::DEBUG::2014-07-10 09:36:27,643::task::827::TaskManager.Task::(resourceAcquired) Task=`d42eba84-c985-41fc-b2d1-a8636fceb873`::_resourcesAcquired: Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee (shared) >Thread-34::DEBUG::2014-07-10 09:36:27,655::task::990::TaskManager.Task::(_decref) Task=`d42eba84-c985-41fc-b2d1-a8636fceb873`::ref 1 aborting False >Thread-34::INFO::2014-07-10 09:36:27,696::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532067385344', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:36:27,701::task::1185::TaskManager.Task::(prepare) Task=`d42eba84-c985-41fc-b2d1-a8636fceb873`::finished: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532067385344', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:36:27,707::task::595::TaskManager.Task::(_updateState) Task=`d42eba84-c985-41fc-b2d1-a8636fceb873`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-10 09:36:27,713::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee': < ResourceRef 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-10 09:36:27,717::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-10 09:36:27,721::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' >Thread-34::DEBUG::2014-07-10 09:36:27,725::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' (0 active users) >Thread-34::DEBUG::2014-07-10 09:36:27,727::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-10 09:36:27,729::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', Clearing records. >Thread-34::DEBUG::2014-07-10 09:36:27,733::task::990::TaskManager.Task::(_decref) Task=`d42eba84-c985-41fc-b2d1-a8636fceb873`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 09:36:27,752::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0280793 s, 36.5 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:36:29,767::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:36:29,855::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0306032 s, 33.5 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-10 09:36:29,907::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/metadata bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-10 09:36:29,928::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000693118 s, 5.9 MB/s\n'; <rc> = 0 >Thread-40::DEBUG::2014-07-10 09:36:29,995::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lion.qa.lab.tlv.redhat.com:_export_yuri2_backup2/6a70504d-00df-4869-8695-0f442053f6b6/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-40::DEBUG::2014-07-10 09:36:30,015::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n369 bytes (369 B) copied, 0.000489968 s, 753 kB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:36:31,883::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:36:32,020::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0311585 s, 32.9 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 09:36:32,885::task::595::TaskManager.Task::(_updateState) Task=`07f1d6cc-53f6-405d-a3c6-0fe0365c2029`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 09:36:32,888::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::INFO::2014-07-10 09:36:32,888::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000693118', 'lastCheck': '2.9', 'valid': True}, '6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000489968', 'lastCheck': '2.9', 'valid': True}} >Thread-14::DEBUG::2014-07-10 09:36:32,889::task::1185::TaskManager.Task::(prepare) Task=`07f1d6cc-53f6-405d-a3c6-0fe0365c2029`::finished: {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000693118', 'lastCheck': '2.9', 'valid': True}, '6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000489968', 'lastCheck': '2.9', 'valid': True}} >Thread-14::DEBUG::2014-07-10 09:36:32,889::task::595::TaskManager.Task::(_updateState) Task=`07f1d6cc-53f6-405d-a3c6-0fe0365c2029`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 09:36:32,889::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 09:36:32,889::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 09:36:32,890::task::990::TaskManager.Task::(_decref) Task=`07f1d6cc-53f6-405d-a3c6-0fe0365c2029`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 09:36:34,036::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:36:34,201::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0379762 s, 27.0 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:36:36,216::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:36:36,303::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0306934 s, 33.4 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 09:36:37,771::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-14::DEBUG::2014-07-10 09:36:37,773::task::595::TaskManager.Task::(_updateState) Task=`fb85659b-3dcc-4816-9876-ac409095b3fa`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 09:36:37,773::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-14::INFO::2014-07-10 09:36:37,773::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:36:37,774::task::1185::TaskManager.Task::(prepare) Task=`fb85659b-3dcc-4816-9876-ac409095b3fa`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:36:37,774::task::595::TaskManager.Task::(_updateState) Task=`fb85659b-3dcc-4816-9876-ac409095b3fa`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 09:36:37,774::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 09:36:37,774::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 09:36:37,774::task::990::TaskManager.Task::(_decref) Task=`fb85659b-3dcc-4816-9876-ac409095b3fa`::ref 0 aborting False >Thread-34::DEBUG::2014-07-10 09:36:37,779::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-34::DEBUG::2014-07-10 09:36:37,779::task::595::TaskManager.Task::(_updateState) Task=`45b65833-6770-4317-bd87-61f6872599a0`::moving from state init -> state preparing >Thread-34::INFO::2014-07-10 09:36:37,779::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-34::DEBUG::2014-07-10 09:36:37,780::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`6e2a3832-abdf-4f87-a6ab-cad2663e29b8`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-10 09:36:37,780::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' for lock type 'shared' >Thread-34::DEBUG::2014-07-10 09:36:37,781::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-10 09:36:37,781::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`6e2a3832-abdf-4f87-a6ab-cad2663e29b8`::Granted request >Thread-34::DEBUG::2014-07-10 09:36:37,781::task::827::TaskManager.Task::(resourceAcquired) Task=`45b65833-6770-4317-bd87-61f6872599a0`::_resourcesAcquired: Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee (shared) >Thread-34::DEBUG::2014-07-10 09:36:37,781::task::990::TaskManager.Task::(_decref) Task=`45b65833-6770-4317-bd87-61f6872599a0`::ref 1 aborting False >Thread-34::INFO::2014-07-10 09:36:37,783::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532067385344', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:36:37,783::task::1185::TaskManager.Task::(prepare) Task=`45b65833-6770-4317-bd87-61f6872599a0`::finished: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532067385344', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:36:37,783::task::595::TaskManager.Task::(_updateState) Task=`45b65833-6770-4317-bd87-61f6872599a0`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-10 09:36:37,783::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee': < ResourceRef 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-10 09:36:37,783::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-10 09:36:37,784::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' >Thread-34::DEBUG::2014-07-10 09:36:37,784::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' (0 active users) >Thread-34::DEBUG::2014-07-10 09:36:37,784::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-10 09:36:37,784::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', Clearing records. >Thread-34::DEBUG::2014-07-10 09:36:37,785::task::990::TaskManager.Task::(_decref) Task=`45b65833-6770-4317-bd87-61f6872599a0`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 09:36:38,319::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:36:38,406::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0295691 s, 34.6 MB/s\n'; <rc> = 0 >Thread-70::DEBUG::2014-07-10 09:36:38,502::task::595::TaskManager.Task::(_updateState) Task=`56f32067-e05d-45a9-95a3-3bbf3e64d719`::moving from state init -> state preparing >Thread-70::INFO::2014-07-10 09:36:38,503::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='cfaeead2-7caa-467c-b389-c89840ae6605', volUUID='567fe32d-31a6-4ff6-90f3-fd6a656fbecc', options=None) >Thread-70::INFO::2014-07-10 09:36:38,503::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-70::DEBUG::2014-07-10 09:36:38,504::task::1185::TaskManager.Task::(prepare) Task=`56f32067-e05d-45a9-95a3-3bbf3e64d719`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-70::DEBUG::2014-07-10 09:36:38,504::task::595::TaskManager.Task::(_updateState) Task=`56f32067-e05d-45a9-95a3-3bbf3e64d719`::moving from state preparing -> state finished >Thread-70::DEBUG::2014-07-10 09:36:38,504::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-70::DEBUG::2014-07-10 09:36:38,504::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-70::DEBUG::2014-07-10 09:36:38,505::task::990::TaskManager.Task::(_decref) Task=`56f32067-e05d-45a9-95a3-3bbf3e64d719`::ref 0 aborting False >Thread-60::DEBUG::2014-07-10 09:36:39,477::task::595::TaskManager.Task::(_updateState) Task=`f8b57c92-9f01-432c-9601-10960d790d15`::moving from state init -> state preparing >Thread-60::INFO::2014-07-10 09:36:39,478::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='b034d5b0-e1e0-4011-b49b-4d45ddb11556', volUUID='3d7f62b5-328f-4d8e-8b69-873cfb5ae14d', options=None) >Thread-60::INFO::2014-07-10 09:36:39,479::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-60::DEBUG::2014-07-10 09:36:39,479::task::1185::TaskManager.Task::(prepare) Task=`f8b57c92-9f01-432c-9601-10960d790d15`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-60::DEBUG::2014-07-10 09:36:39,479::task::595::TaskManager.Task::(_updateState) Task=`f8b57c92-9f01-432c-9601-10960d790d15`::moving from state preparing -> state finished >Thread-60::DEBUG::2014-07-10 09:36:39,479::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-60::DEBUG::2014-07-10 09:36:39,479::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-60::DEBUG::2014-07-10 09:36:39,480::task::990::TaskManager.Task::(_decref) Task=`f8b57c92-9f01-432c-9601-10960d790d15`::ref 0 aborting False >Thread-51::DEBUG::2014-07-10 09:36:39,502::task::595::TaskManager.Task::(_updateState) Task=`d5f13ee2-4db5-45dc-9823-9af4d2fb09cf`::moving from state init -> state preparing >Thread-51::INFO::2014-07-10 09:36:39,502::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='76fdb054-02cd-42ed-9721-b3e65b34c3a4', volUUID='022dfe46-2cf7-4915-80b3-883158e3ca83', options=None) >Thread-51::INFO::2014-07-10 09:36:39,502::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-51::DEBUG::2014-07-10 09:36:39,503::task::1185::TaskManager.Task::(prepare) Task=`d5f13ee2-4db5-45dc-9823-9af4d2fb09cf`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-51::DEBUG::2014-07-10 09:36:39,503::task::595::TaskManager.Task::(_updateState) Task=`d5f13ee2-4db5-45dc-9823-9af4d2fb09cf`::moving from state preparing -> state finished >Thread-51::DEBUG::2014-07-10 09:36:39,503::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-51::DEBUG::2014-07-10 09:36:39,503::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-51::DEBUG::2014-07-10 09:36:39,503::task::990::TaskManager.Task::(_decref) Task=`d5f13ee2-4db5-45dc-9823-9af4d2fb09cf`::ref 0 aborting False >Thread-18::DEBUG::2014-07-10 09:36:39,971::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/metadata bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-10 09:36:39,993::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000741028 s, 5.5 MB/s\n'; <rc> = 0 >Thread-40::DEBUG::2014-07-10 09:36:40,066::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lion.qa.lab.tlv.redhat.com:_export_yuri2_backup2/6a70504d-00df-4869-8695-0f442053f6b6/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-40::DEBUG::2014-07-10 09:36:40,086::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n369 bytes (369 B) copied, 0.000449666 s, 821 kB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:36:40,422::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:36:40,521::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0391507 s, 26.2 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:36:42,550::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:36:42,640::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0313562 s, 32.7 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:36:44,655::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:36:44,757::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.044087 s, 23.2 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:36:46,771::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:36:46,883::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0493713 s, 20.7 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 09:36:47,813::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-14::DEBUG::2014-07-10 09:36:47,814::task::595::TaskManager.Task::(_updateState) Task=`36246af4-b3dd-401b-821b-a25f167a6751`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 09:36:47,815::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-14::INFO::2014-07-10 09:36:47,815::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:36:47,815::task::1185::TaskManager.Task::(prepare) Task=`36246af4-b3dd-401b-821b-a25f167a6751`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:36:47,816::task::595::TaskManager.Task::(_updateState) Task=`36246af4-b3dd-401b-821b-a25f167a6751`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 09:36:47,816::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 09:36:47,816::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 09:36:47,816::task::990::TaskManager.Task::(_decref) Task=`36246af4-b3dd-401b-821b-a25f167a6751`::ref 0 aborting False >Thread-34::DEBUG::2014-07-10 09:36:47,820::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-34::DEBUG::2014-07-10 09:36:47,820::task::595::TaskManager.Task::(_updateState) Task=`089c9f37-de98-4bdf-87d3-5bc0c87489a3`::moving from state init -> state preparing >Thread-34::INFO::2014-07-10 09:36:47,821::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-34::DEBUG::2014-07-10 09:36:47,821::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`10870a4f-6dea-42b6-9238-38d13b5c08a5`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-10 09:36:47,822::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' for lock type 'shared' >Thread-34::DEBUG::2014-07-10 09:36:47,822::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-10 09:36:47,822::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`10870a4f-6dea-42b6-9238-38d13b5c08a5`::Granted request >Thread-34::DEBUG::2014-07-10 09:36:47,822::task::827::TaskManager.Task::(resourceAcquired) Task=`089c9f37-de98-4bdf-87d3-5bc0c87489a3`::_resourcesAcquired: Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee (shared) >Thread-34::DEBUG::2014-07-10 09:36:47,823::task::990::TaskManager.Task::(_decref) Task=`089c9f37-de98-4bdf-87d3-5bc0c87489a3`::ref 1 aborting False >Thread-34::INFO::2014-07-10 09:36:47,824::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532067385344', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:36:47,824::task::1185::TaskManager.Task::(prepare) Task=`089c9f37-de98-4bdf-87d3-5bc0c87489a3`::finished: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532067385344', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:36:47,824::task::595::TaskManager.Task::(_updateState) Task=`089c9f37-de98-4bdf-87d3-5bc0c87489a3`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-10 09:36:47,824::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee': < ResourceRef 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-10 09:36:47,824::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-10 09:36:47,825::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' >Thread-34::DEBUG::2014-07-10 09:36:47,825::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' (0 active users) >Thread-34::DEBUG::2014-07-10 09:36:47,825::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-10 09:36:47,825::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', Clearing records. >Thread-34::DEBUG::2014-07-10 09:36:47,825::task::990::TaskManager.Task::(_decref) Task=`089c9f37-de98-4bdf-87d3-5bc0c87489a3`::ref 0 aborting False >Thread-14::DEBUG::2014-07-10 09:36:48,092::task::595::TaskManager.Task::(_updateState) Task=`5ab5d974-467c-49ef-8d36-7043223f1520`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 09:36:48,092::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::INFO::2014-07-10 09:36:48,092::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000741028', 'lastCheck': '8.1', 'valid': True}, '6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000449666', 'lastCheck': '8.0', 'valid': True}} >Thread-14::DEBUG::2014-07-10 09:36:48,093::task::1185::TaskManager.Task::(prepare) Task=`5ab5d974-467c-49ef-8d36-7043223f1520`::finished: {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000741028', 'lastCheck': '8.1', 'valid': True}, '6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000449666', 'lastCheck': '8.0', 'valid': True}} >Thread-14::DEBUG::2014-07-10 09:36:48,093::task::595::TaskManager.Task::(_updateState) Task=`5ab5d974-467c-49ef-8d36-7043223f1520`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 09:36:48,093::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 09:36:48,093::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 09:36:48,093::task::990::TaskManager.Task::(_decref) Task=`5ab5d974-467c-49ef-8d36-7043223f1520`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 09:36:48,898::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:36:48,992::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.029969 s, 34.2 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-10 09:36:50,042::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/metadata bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-10 09:36:50,064::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000720914 s, 5.7 MB/s\n'; <rc> = 0 >Thread-40::DEBUG::2014-07-10 09:36:50,151::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lion.qa.lab.tlv.redhat.com:_export_yuri2_backup2/6a70504d-00df-4869-8695-0f442053f6b6/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-40::DEBUG::2014-07-10 09:36:50,176::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n369 bytes (369 B) copied, 0.000423569 s, 871 kB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:36:51,007::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:36:51,101::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.035292 s, 29.0 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:36:53,116::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:36:53,206::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0316558 s, 32.3 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:36:55,223::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:36:55,320::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0357346 s, 28.7 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:36:57,349::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:36:57,434::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.027657 s, 37.0 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 09:36:57,855::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-14::DEBUG::2014-07-10 09:36:57,856::task::595::TaskManager.Task::(_updateState) Task=`e57b37cd-2605-4450-ac13-f6fdc227593b`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 09:36:57,856::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-14::INFO::2014-07-10 09:36:57,857::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:36:57,857::task::1185::TaskManager.Task::(prepare) Task=`e57b37cd-2605-4450-ac13-f6fdc227593b`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:36:57,857::task::595::TaskManager.Task::(_updateState) Task=`e57b37cd-2605-4450-ac13-f6fdc227593b`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 09:36:57,858::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 09:36:57,858::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 09:36:57,858::task::990::TaskManager.Task::(_decref) Task=`e57b37cd-2605-4450-ac13-f6fdc227593b`::ref 0 aborting False >Thread-34::DEBUG::2014-07-10 09:36:57,863::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-34::DEBUG::2014-07-10 09:36:57,865::task::595::TaskManager.Task::(_updateState) Task=`a91155ac-32ec-439c-9705-73617a41c5d9`::moving from state init -> state preparing >Thread-34::INFO::2014-07-10 09:36:57,866::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-34::DEBUG::2014-07-10 09:36:57,867::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`414a41d9-95e4-42c0-8506-9a4b82840e7b`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-10 09:36:57,868::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' for lock type 'shared' >Thread-34::DEBUG::2014-07-10 09:36:57,868::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-10 09:36:57,868::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`414a41d9-95e4-42c0-8506-9a4b82840e7b`::Granted request >Thread-34::DEBUG::2014-07-10 09:36:57,869::task::827::TaskManager.Task::(resourceAcquired) Task=`a91155ac-32ec-439c-9705-73617a41c5d9`::_resourcesAcquired: Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee (shared) >Thread-34::DEBUG::2014-07-10 09:36:57,869::task::990::TaskManager.Task::(_decref) Task=`a91155ac-32ec-439c-9705-73617a41c5d9`::ref 1 aborting False >Thread-34::INFO::2014-07-10 09:36:57,871::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532067385344', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:36:57,871::task::1185::TaskManager.Task::(prepare) Task=`a91155ac-32ec-439c-9705-73617a41c5d9`::finished: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532067385344', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:36:57,871::task::595::TaskManager.Task::(_updateState) Task=`a91155ac-32ec-439c-9705-73617a41c5d9`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-10 09:36:57,872::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee': < ResourceRef 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-10 09:36:57,872::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-10 09:36:57,872::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' >Thread-34::DEBUG::2014-07-10 09:36:57,873::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' (0 active users) >Thread-34::DEBUG::2014-07-10 09:36:57,873::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-10 09:36:57,873::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', Clearing records. >Thread-34::DEBUG::2014-07-10 09:36:57,874::task::990::TaskManager.Task::(_decref) Task=`a91155ac-32ec-439c-9705-73617a41c5d9`::ref 0 aborting False >Thread-64::DEBUG::2014-07-10 09:36:58,606::task::595::TaskManager.Task::(_updateState) Task=`9f503fdb-3ee6-46b0-a74a-4f9425cd01a2`::moving from state init -> state preparing >Thread-64::INFO::2014-07-10 09:36:58,607::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='aa20346a-4d3a-4e07-b8e1-52c0ebe4168c', volUUID='58fefce2-9bce-4bff-8949-8c6ce8122b27', options=None) >Thread-64::INFO::2014-07-10 09:36:58,607::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-64::DEBUG::2014-07-10 09:36:58,607::task::1185::TaskManager.Task::(prepare) Task=`9f503fdb-3ee6-46b0-a74a-4f9425cd01a2`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-64::DEBUG::2014-07-10 09:36:58,608::task::595::TaskManager.Task::(_updateState) Task=`9f503fdb-3ee6-46b0-a74a-4f9425cd01a2`::moving from state preparing -> state finished >Thread-64::DEBUG::2014-07-10 09:36:58,608::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-64::DEBUG::2014-07-10 09:36:58,608::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-64::DEBUG::2014-07-10 09:36:58,608::task::990::TaskManager.Task::(_decref) Task=`9f503fdb-3ee6-46b0-a74a-4f9425cd01a2`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 09:36:59,449::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:36:59,541::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.031096 s, 32.9 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-10 09:37:00,123::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/metadata bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-10 09:37:00,147::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00111253 s, 3.7 MB/s\n'; <rc> = 0 >Thread-40::DEBUG::2014-07-10 09:37:00,209::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lion.qa.lab.tlv.redhat.com:_export_yuri2_backup2/6a70504d-00df-4869-8695-0f442053f6b6/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-40::DEBUG::2014-07-10 09:37:00,229::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n369 bytes (369 B) copied, 0.000458405 s, 805 kB/s\n'; <rc> = 0 >Thread-73::DEBUG::2014-07-10 09:37:00,928::task::595::TaskManager.Task::(_updateState) Task=`3ee9c2e9-a47e-4193-a539-b331d1770dce`::moving from state init -> state preparing >Thread-54::DEBUG::2014-07-10 09:37:00,928::task::595::TaskManager.Task::(_updateState) Task=`0908c65d-4a79-4951-9dc5-f549b5a88e62`::moving from state init -> state preparing >Thread-73::INFO::2014-07-10 09:37:00,930::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='c01d693b-cba0-4fed-9ad7-0aaa28912a19', volUUID='4bb5d954-2a50-4028-b299-0b43c261270c', options=None) >Thread-54::INFO::2014-07-10 09:37:00,930::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='28408446-e5fd-4565-a976-e760951593fe', volUUID='776303a2-5585-451e-826e-0e338d4a1e98', options=None) >Thread-73::INFO::2014-07-10 09:37:00,932::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-54::INFO::2014-07-10 09:37:00,933::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-73::DEBUG::2014-07-10 09:37:00,934::task::1185::TaskManager.Task::(prepare) Task=`3ee9c2e9-a47e-4193-a539-b331d1770dce`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-54::DEBUG::2014-07-10 09:37:00,935::task::1185::TaskManager.Task::(prepare) Task=`0908c65d-4a79-4951-9dc5-f549b5a88e62`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-73::DEBUG::2014-07-10 09:37:00,936::task::595::TaskManager.Task::(_updateState) Task=`3ee9c2e9-a47e-4193-a539-b331d1770dce`::moving from state preparing -> state finished >Thread-54::DEBUG::2014-07-10 09:37:00,936::task::595::TaskManager.Task::(_updateState) Task=`0908c65d-4a79-4951-9dc5-f549b5a88e62`::moving from state preparing -> state finished >Thread-73::DEBUG::2014-07-10 09:37:00,938::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-54::DEBUG::2014-07-10 09:37:00,938::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-73::DEBUG::2014-07-10 09:37:00,939::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-54::DEBUG::2014-07-10 09:37:00,940::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-73::DEBUG::2014-07-10 09:37:00,941::task::990::TaskManager.Task::(_decref) Task=`3ee9c2e9-a47e-4193-a539-b331d1770dce`::ref 0 aborting False >Thread-54::DEBUG::2014-07-10 09:37:00,942::task::990::TaskManager.Task::(_decref) Task=`0908c65d-4a79-4951-9dc5-f549b5a88e62`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 09:37:01,557::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:37:01,659::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.035795 s, 28.6 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 09:37:03,308::task::595::TaskManager.Task::(_updateState) Task=`09c02b60-4d35-4f07-8308-ed0e09c9fbf7`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 09:37:03,309::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::INFO::2014-07-10 09:37:03,309::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00111253', 'lastCheck': '3.1', 'valid': True}, '6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000458405', 'lastCheck': '3.1', 'valid': True}} >Thread-14::DEBUG::2014-07-10 09:37:03,309::task::1185::TaskManager.Task::(prepare) Task=`09c02b60-4d35-4f07-8308-ed0e09c9fbf7`::finished: {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00111253', 'lastCheck': '3.1', 'valid': True}, '6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000458405', 'lastCheck': '3.1', 'valid': True}} >Thread-14::DEBUG::2014-07-10 09:37:03,309::task::595::TaskManager.Task::(_updateState) Task=`09c02b60-4d35-4f07-8308-ed0e09c9fbf7`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 09:37:03,310::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 09:37:03,310::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 09:37:03,310::task::990::TaskManager.Task::(_decref) Task=`09c02b60-4d35-4f07-8308-ed0e09c9fbf7`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 09:37:03,673::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:37:03,767::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0355882 s, 28.8 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:37:05,782::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:37:05,875::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0337701 s, 30.3 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:37:07,891::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Thread-14::DEBUG::2014-07-10 09:37:07,912::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-14::DEBUG::2014-07-10 09:37:07,913::task::595::TaskManager.Task::(_updateState) Task=`62c55d6f-eb60-489a-9ed0-aeb2aad5f105`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 09:37:07,914::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-14::INFO::2014-07-10 09:37:07,914::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:37:07,915::task::1185::TaskManager.Task::(prepare) Task=`62c55d6f-eb60-489a-9ed0-aeb2aad5f105`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:37:07,915::task::595::TaskManager.Task::(_updateState) Task=`62c55d6f-eb60-489a-9ed0-aeb2aad5f105`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 09:37:07,915::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 09:37:07,915::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 09:37:07,915::task::990::TaskManager.Task::(_decref) Task=`62c55d6f-eb60-489a-9ed0-aeb2aad5f105`::ref 0 aborting False >Thread-34::DEBUG::2014-07-10 09:37:07,920::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-34::DEBUG::2014-07-10 09:37:07,921::task::595::TaskManager.Task::(_updateState) Task=`711c1bd5-6de7-4a8c-b4bc-ef900e1545d7`::moving from state init -> state preparing >Thread-34::INFO::2014-07-10 09:37:07,922::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-34::DEBUG::2014-07-10 09:37:07,924::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`e44d20eb-b316-4096-996a-b733e2f0148e`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-10 09:37:07,924::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' for lock type 'shared' >Thread-34::DEBUG::2014-07-10 09:37:07,925::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-10 09:37:07,926::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`e44d20eb-b316-4096-996a-b733e2f0148e`::Granted request >Thread-34::DEBUG::2014-07-10 09:37:07,927::task::827::TaskManager.Task::(resourceAcquired) Task=`711c1bd5-6de7-4a8c-b4bc-ef900e1545d7`::_resourcesAcquired: Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee (shared) >Thread-34::DEBUG::2014-07-10 09:37:07,928::task::990::TaskManager.Task::(_decref) Task=`711c1bd5-6de7-4a8c-b4bc-ef900e1545d7`::ref 1 aborting False >Thread-34::INFO::2014-07-10 09:37:07,930::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532067385344', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:37:07,931::task::1185::TaskManager.Task::(prepare) Task=`711c1bd5-6de7-4a8c-b4bc-ef900e1545d7`::finished: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532067385344', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:37:07,931::task::595::TaskManager.Task::(_updateState) Task=`711c1bd5-6de7-4a8c-b4bc-ef900e1545d7`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-10 09:37:07,932::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee': < ResourceRef 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-10 09:37:07,932::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-10 09:37:07,934::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' >Thread-34::DEBUG::2014-07-10 09:37:07,934::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' (0 active users) >Thread-34::DEBUG::2014-07-10 09:37:07,935::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-10 09:37:07,935::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', Clearing records. >Thread-34::DEBUG::2014-07-10 09:37:07,936::task::990::TaskManager.Task::(_decref) Task=`711c1bd5-6de7-4a8c-b4bc-ef900e1545d7`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 09:37:08,014::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0525488 s, 19.5 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:37:10,027::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:37:10,138::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0419062 s, 24.4 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-10 09:37:10,179::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/metadata bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-10 09:37:10,217::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000782004 s, 5.2 MB/s\n'; <rc> = 0 >Thread-40::DEBUG::2014-07-10 09:37:10,656::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lion.qa.lab.tlv.redhat.com:_export_yuri2_backup2/6a70504d-00df-4869-8695-0f442053f6b6/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-40::DEBUG::2014-07-10 09:37:10,702::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n369 bytes (369 B) copied, 0.000422205 s, 874 kB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:37:12,153::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:37:12,242::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0271525 s, 37.7 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:37:14,258::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:37:14,345::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0301255 s, 34.0 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:37:16,362::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:37:16,464::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0382768 s, 26.8 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 09:37:18,013::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-14::DEBUG::2014-07-10 09:37:18,014::task::595::TaskManager.Task::(_updateState) Task=`7c049d0c-3315-4c8e-a37f-5208e33a357a`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 09:37:18,015::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-14::INFO::2014-07-10 09:37:18,015::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:37:18,015::task::1185::TaskManager.Task::(prepare) Task=`7c049d0c-3315-4c8e-a37f-5208e33a357a`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:37:18,015::task::595::TaskManager.Task::(_updateState) Task=`7c049d0c-3315-4c8e-a37f-5208e33a357a`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 09:37:18,016::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 09:37:18,016::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 09:37:18,016::task::990::TaskManager.Task::(_decref) Task=`7c049d0c-3315-4c8e-a37f-5208e33a357a`::ref 0 aborting False >Thread-34::DEBUG::2014-07-10 09:37:18,020::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-34::DEBUG::2014-07-10 09:37:18,020::task::595::TaskManager.Task::(_updateState) Task=`b0cbdd8b-6200-4115-80a9-cd4d8da4f75c`::moving from state init -> state preparing >Thread-34::INFO::2014-07-10 09:37:18,020::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-34::DEBUG::2014-07-10 09:37:18,021::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`453b7ac9-2bf5-4249-a057-7469b8e8fa4f`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-10 09:37:18,021::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' for lock type 'shared' >Thread-34::DEBUG::2014-07-10 09:37:18,022::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-10 09:37:18,022::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`453b7ac9-2bf5-4249-a057-7469b8e8fa4f`::Granted request >Thread-34::DEBUG::2014-07-10 09:37:18,022::task::827::TaskManager.Task::(resourceAcquired) Task=`b0cbdd8b-6200-4115-80a9-cd4d8da4f75c`::_resourcesAcquired: Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee (shared) >Thread-34::DEBUG::2014-07-10 09:37:18,022::task::990::TaskManager.Task::(_decref) Task=`b0cbdd8b-6200-4115-80a9-cd4d8da4f75c`::ref 1 aborting False >Thread-34::INFO::2014-07-10 09:37:18,023::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532067385344', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:37:18,024::task::1185::TaskManager.Task::(prepare) Task=`b0cbdd8b-6200-4115-80a9-cd4d8da4f75c`::finished: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532067385344', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:37:18,024::task::595::TaskManager.Task::(_updateState) Task=`b0cbdd8b-6200-4115-80a9-cd4d8da4f75c`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-10 09:37:18,024::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee': < ResourceRef 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-10 09:37:18,024::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-10 09:37:18,024::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' >Thread-34::DEBUG::2014-07-10 09:37:18,025::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' (0 active users) >Thread-34::DEBUG::2014-07-10 09:37:18,025::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-10 09:37:18,025::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', Clearing records. >Thread-34::DEBUG::2014-07-10 09:37:18,025::task::990::TaskManager.Task::(_decref) Task=`b0cbdd8b-6200-4115-80a9-cd4d8da4f75c`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 09:37:18,479::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Thread-14::DEBUG::2014-07-10 09:37:18,502::task::595::TaskManager.Task::(_updateState) Task=`f8c28cd0-14fb-4037-a8e9-a752383bb8b3`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 09:37:18,503::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::INFO::2014-07-10 09:37:18,504::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000782004', 'lastCheck': '7.9', 'valid': True}, '6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000422205', 'lastCheck': '7.8', 'valid': True}} >Thread-14::DEBUG::2014-07-10 09:37:18,505::task::1185::TaskManager.Task::(prepare) Task=`f8c28cd0-14fb-4037-a8e9-a752383bb8b3`::finished: {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000782004', 'lastCheck': '7.9', 'valid': True}, '6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000422205', 'lastCheck': '7.8', 'valid': True}} >Thread-14::DEBUG::2014-07-10 09:37:18,505::task::595::TaskManager.Task::(_updateState) Task=`f8c28cd0-14fb-4037-a8e9-a752383bb8b3`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 09:37:18,506::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 09:37:18,507::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 09:37:18,508::task::990::TaskManager.Task::(_decref) Task=`f8c28cd0-14fb-4037-a8e9-a752383bb8b3`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 09:37:18,604::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0660088 s, 15.5 MB/s\n'; <rc> = 0 >Thread-57::DEBUG::2014-07-10 09:37:19,095::task::595::TaskManager.Task::(_updateState) Task=`86cd7f04-71b1-4810-b1fc-fcb764337d0d`::moving from state init -> state preparing >Thread-57::INFO::2014-07-10 09:37:19,096::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='b6f6c0da-e67f-4902-b9ac-3069571a42fe', volUUID='c4cd1da8-05b7-45e0-80b1-1183d21443d9', options=None) >Thread-57::INFO::2014-07-10 09:37:19,096::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-57::DEBUG::2014-07-10 09:37:19,096::task::1185::TaskManager.Task::(prepare) Task=`86cd7f04-71b1-4810-b1fc-fcb764337d0d`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-57::DEBUG::2014-07-10 09:37:19,097::task::595::TaskManager.Task::(_updateState) Task=`86cd7f04-71b1-4810-b1fc-fcb764337d0d`::moving from state preparing -> state finished >Thread-57::DEBUG::2014-07-10 09:37:19,097::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-57::DEBUG::2014-07-10 09:37:19,097::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-57::DEBUG::2014-07-10 09:37:19,097::task::990::TaskManager.Task::(_decref) Task=`86cd7f04-71b1-4810-b1fc-fcb764337d0d`::ref 0 aborting False >Thread-67::DEBUG::2014-07-10 09:37:19,704::task::595::TaskManager.Task::(_updateState) Task=`8fb28354-fe6f-435a-bc38-956bd96a1b43`::moving from state init -> state preparing >Thread-67::INFO::2014-07-10 09:37:19,704::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='f30c2cb7-a43a-4bf5-82b5-cfe07336f65c', volUUID='b0fbb3c9-55af-4a3a-95ad-fc56a80b9cf5', options=None) >Thread-67::INFO::2014-07-10 09:37:19,704::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-67::DEBUG::2014-07-10 09:37:19,705::task::1185::TaskManager.Task::(prepare) Task=`8fb28354-fe6f-435a-bc38-956bd96a1b43`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-67::DEBUG::2014-07-10 09:37:19,705::task::595::TaskManager.Task::(_updateState) Task=`8fb28354-fe6f-435a-bc38-956bd96a1b43`::moving from state preparing -> state finished >Thread-67::DEBUG::2014-07-10 09:37:19,705::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-67::DEBUG::2014-07-10 09:37:19,705::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-67::DEBUG::2014-07-10 09:37:19,706::task::990::TaskManager.Task::(_decref) Task=`8fb28354-fe6f-435a-bc38-956bd96a1b43`::ref 0 aborting False >Thread-48::DEBUG::2014-07-10 09:37:20,250::task::595::TaskManager.Task::(_updateState) Task=`53801fcd-17e6-4960-b06d-e1dc3cf13c07`::moving from state init -> state preparing >Thread-48::INFO::2014-07-10 09:37:20,251::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='0cd7d6ce-f497-4243-a690-c57744861eea', volUUID='10b6a7dd-dc6c-43fa-ba17-92e4331b0e0b', options=None) >Thread-48::INFO::2014-07-10 09:37:20,251::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-48::DEBUG::2014-07-10 09:37:20,251::task::1185::TaskManager.Task::(prepare) Task=`53801fcd-17e6-4960-b06d-e1dc3cf13c07`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-48::DEBUG::2014-07-10 09:37:20,251::task::595::TaskManager.Task::(_updateState) Task=`53801fcd-17e6-4960-b06d-e1dc3cf13c07`::moving from state preparing -> state finished >Thread-48::DEBUG::2014-07-10 09:37:20,252::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-48::DEBUG::2014-07-10 09:37:20,252::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-48::DEBUG::2014-07-10 09:37:20,252::task::990::TaskManager.Task::(_decref) Task=`53801fcd-17e6-4960-b06d-e1dc3cf13c07`::ref 0 aborting False >Thread-18::DEBUG::2014-07-10 09:37:20,589::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/metadata bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-10 09:37:20,613::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00609384 s, 672 kB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:37:20,628::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Thread-40::DEBUG::2014-07-10 09:37:21,492::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lion.qa.lab.tlv.redhat.com:_export_yuri2_backup2/6a70504d-00df-4869-8695-0f442053f6b6/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-40::DEBUG::2014-07-10 09:37:21,536::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n369 bytes (369 B) copied, 0.000366851 s, 1.0 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:37:21,596::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.909259 s, 1.1 MB/s\n'; <rc> = 0 >Thread-76::DEBUG::2014-07-10 09:37:21,606::task::595::TaskManager.Task::(_updateState) Task=`5e7c72e6-1ea2-4acf-af9e-0236582a2539`::moving from state init -> state preparing >Thread-76::INFO::2014-07-10 09:37:21,607::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='e4c65229-4247-4b33-b72a-f1d5ce72ad05', volUUID='cad94284-3ca9-4c30-933d-997f4460309e', options=None) >Thread-76::INFO::2014-07-10 09:37:21,609::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-76::DEBUG::2014-07-10 09:37:21,610::task::1185::TaskManager.Task::(prepare) Task=`5e7c72e6-1ea2-4acf-af9e-0236582a2539`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-76::DEBUG::2014-07-10 09:37:21,611::task::595::TaskManager.Task::(_updateState) Task=`5e7c72e6-1ea2-4acf-af9e-0236582a2539`::moving from state preparing -> state finished >Thread-76::DEBUG::2014-07-10 09:37:21,611::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-76::DEBUG::2014-07-10 09:37:21,612::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-76::DEBUG::2014-07-10 09:37:21,613::task::990::TaskManager.Task::(_decref) Task=`5e7c72e6-1ea2-4acf-af9e-0236582a2539`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 09:37:23,622::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:37:23,714::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0260023 s, 39.4 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:37:25,730::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:37:25,848::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.045827 s, 22.3 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:37:27,863::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:37:27,953::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0303152 s, 33.8 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 09:37:28,063::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-14::DEBUG::2014-07-10 09:37:28,064::task::595::TaskManager.Task::(_updateState) Task=`b9ae72d3-90fc-4970-a2eb-0e43c6eeb582`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 09:37:28,064::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-14::INFO::2014-07-10 09:37:28,065::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:37:28,065::task::1185::TaskManager.Task::(prepare) Task=`b9ae72d3-90fc-4970-a2eb-0e43c6eeb582`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:37:28,065::task::595::TaskManager.Task::(_updateState) Task=`b9ae72d3-90fc-4970-a2eb-0e43c6eeb582`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 09:37:28,066::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 09:37:28,066::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 09:37:28,066::task::990::TaskManager.Task::(_decref) Task=`b9ae72d3-90fc-4970-a2eb-0e43c6eeb582`::ref 0 aborting False >Thread-34::DEBUG::2014-07-10 09:37:28,070::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-34::DEBUG::2014-07-10 09:37:28,070::task::595::TaskManager.Task::(_updateState) Task=`088c4843-4a32-41c4-8af2-a1b721ac1ced`::moving from state init -> state preparing >Thread-34::INFO::2014-07-10 09:37:28,071::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-34::DEBUG::2014-07-10 09:37:28,071::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`969716c1-1297-44ac-aa99-194b77231e79`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-10 09:37:28,072::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' for lock type 'shared' >Thread-34::DEBUG::2014-07-10 09:37:28,072::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-10 09:37:28,072::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`969716c1-1297-44ac-aa99-194b77231e79`::Granted request >Thread-34::DEBUG::2014-07-10 09:37:28,073::task::827::TaskManager.Task::(resourceAcquired) Task=`088c4843-4a32-41c4-8af2-a1b721ac1ced`::_resourcesAcquired: Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee (shared) >Thread-34::DEBUG::2014-07-10 09:37:28,073::task::990::TaskManager.Task::(_decref) Task=`088c4843-4a32-41c4-8af2-a1b721ac1ced`::ref 1 aborting False >Thread-34::INFO::2014-07-10 09:37:28,074::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532067385344', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:37:28,074::task::1185::TaskManager.Task::(prepare) Task=`088c4843-4a32-41c4-8af2-a1b721ac1ced`::finished: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532067385344', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:37:28,075::task::595::TaskManager.Task::(_updateState) Task=`088c4843-4a32-41c4-8af2-a1b721ac1ced`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-10 09:37:28,075::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee': < ResourceRef 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-10 09:37:28,075::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-10 09:37:28,075::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' >Thread-34::DEBUG::2014-07-10 09:37:28,075::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' (0 active users) >Thread-34::DEBUG::2014-07-10 09:37:28,076::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-10 09:37:28,076::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', Clearing records. >Thread-34::DEBUG::2014-07-10 09:37:28,076::task::990::TaskManager.Task::(_decref) Task=`088c4843-4a32-41c4-8af2-a1b721ac1ced`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 09:37:29,968::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:37:30,056::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0302274 s, 33.9 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-10 09:37:31,402::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/metadata bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-10 09:37:31,432::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00712591 s, 575 kB/s\n'; <rc> = 0 >Thread-40::DEBUG::2014-07-10 09:37:31,575::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lion.qa.lab.tlv.redhat.com:_export_yuri2_backup2/6a70504d-00df-4869-8695-0f442053f6b6/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-40::DEBUG::2014-07-10 09:37:31,594::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n369 bytes (369 B) copied, 0.000440006 s, 839 kB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:37:32,071::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:37:32,240::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0300565 s, 34.1 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 09:37:33,678::task::595::TaskManager.Task::(_updateState) Task=`75131f24-38d2-412b-8262-65ff3d08e210`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 09:37:33,679::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::INFO::2014-07-10 09:37:33,679::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00712591', 'lastCheck': '2.2', 'valid': True}, '6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000440006', 'lastCheck': '2.1', 'valid': True}} >Thread-14::DEBUG::2014-07-10 09:37:33,679::task::1185::TaskManager.Task::(prepare) Task=`75131f24-38d2-412b-8262-65ff3d08e210`::finished: {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00712591', 'lastCheck': '2.2', 'valid': True}, '6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000440006', 'lastCheck': '2.1', 'valid': True}} >Thread-14::DEBUG::2014-07-10 09:37:33,679::task::595::TaskManager.Task::(_updateState) Task=`75131f24-38d2-412b-8262-65ff3d08e210`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 09:37:33,680::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 09:37:33,680::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 09:37:33,680::task::990::TaskManager.Task::(_decref) Task=`75131f24-38d2-412b-8262-65ff3d08e210`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 09:37:34,255::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:37:34,354::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0377461 s, 27.1 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:37:36,371::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:37:36,463::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0343246 s, 29.8 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 09:37:38,114::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-14::DEBUG::2014-07-10 09:37:38,116::task::595::TaskManager.Task::(_updateState) Task=`88791b0b-65ed-413b-9281-e8b5cb582e48`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 09:37:38,116::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-14::INFO::2014-07-10 09:37:38,117::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:37:38,117::task::1185::TaskManager.Task::(prepare) Task=`88791b0b-65ed-413b-9281-e8b5cb582e48`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:37:38,118::task::595::TaskManager.Task::(_updateState) Task=`88791b0b-65ed-413b-9281-e8b5cb582e48`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 09:37:38,118::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 09:37:38,118::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 09:37:38,119::task::990::TaskManager.Task::(_decref) Task=`88791b0b-65ed-413b-9281-e8b5cb582e48`::ref 0 aborting False >Thread-34::DEBUG::2014-07-10 09:37:38,123::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-34::DEBUG::2014-07-10 09:37:38,123::task::595::TaskManager.Task::(_updateState) Task=`cd6a5c91-c06b-4e39-932a-0cb72091bc3b`::moving from state init -> state preparing >Thread-34::INFO::2014-07-10 09:37:38,123::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-34::DEBUG::2014-07-10 09:37:38,124::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`cb6272d9-7c76-4943-9dc8-481c53805e45`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-10 09:37:38,124::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' for lock type 'shared' >Thread-34::DEBUG::2014-07-10 09:37:38,124::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-10 09:37:38,125::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`cb6272d9-7c76-4943-9dc8-481c53805e45`::Granted request >Thread-34::DEBUG::2014-07-10 09:37:38,125::task::827::TaskManager.Task::(resourceAcquired) Task=`cd6a5c91-c06b-4e39-932a-0cb72091bc3b`::_resourcesAcquired: Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee (shared) >Thread-34::DEBUG::2014-07-10 09:37:38,125::task::990::TaskManager.Task::(_decref) Task=`cd6a5c91-c06b-4e39-932a-0cb72091bc3b`::ref 1 aborting False >Thread-34::INFO::2014-07-10 09:37:38,126::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532067385344', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:37:38,126::task::1185::TaskManager.Task::(prepare) Task=`cd6a5c91-c06b-4e39-932a-0cb72091bc3b`::finished: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532067385344', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:37:38,127::task::595::TaskManager.Task::(_updateState) Task=`cd6a5c91-c06b-4e39-932a-0cb72091bc3b`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-10 09:37:38,127::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee': < ResourceRef 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-10 09:37:38,127::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-10 09:37:38,127::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' >Thread-34::DEBUG::2014-07-10 09:37:38,128::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' (0 active users) >Thread-34::DEBUG::2014-07-10 09:37:38,128::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-10 09:37:38,128::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', Clearing records. >Thread-34::DEBUG::2014-07-10 09:37:38,128::task::990::TaskManager.Task::(_decref) Task=`cd6a5c91-c06b-4e39-932a-0cb72091bc3b`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 09:37:38,478::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:37:38,563::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0271128 s, 37.8 MB/s\n'; <rc> = 0 >Thread-70::DEBUG::2014-07-10 09:37:38,787::task::595::TaskManager.Task::(_updateState) Task=`acb27b4b-ab57-4409-aa69-48726fff3360`::moving from state init -> state preparing >Thread-70::INFO::2014-07-10 09:37:38,788::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='cfaeead2-7caa-467c-b389-c89840ae6605', volUUID='567fe32d-31a6-4ff6-90f3-fd6a656fbecc', options=None) >Thread-70::INFO::2014-07-10 09:37:38,789::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-70::DEBUG::2014-07-10 09:37:38,789::task::1185::TaskManager.Task::(prepare) Task=`acb27b4b-ab57-4409-aa69-48726fff3360`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-70::DEBUG::2014-07-10 09:37:38,789::task::595::TaskManager.Task::(_updateState) Task=`acb27b4b-ab57-4409-aa69-48726fff3360`::moving from state preparing -> state finished >Thread-70::DEBUG::2014-07-10 09:37:38,789::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-70::DEBUG::2014-07-10 09:37:38,789::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-70::DEBUG::2014-07-10 09:37:38,790::task::990::TaskManager.Task::(_decref) Task=`acb27b4b-ab57-4409-aa69-48726fff3360`::ref 0 aborting False >Thread-60::DEBUG::2014-07-10 09:37:39,765::task::595::TaskManager.Task::(_updateState) Task=`f6756905-4f0b-48d9-bc77-5cf444c4ab29`::moving from state init -> state preparing >Thread-60::INFO::2014-07-10 09:37:39,765::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='b034d5b0-e1e0-4011-b49b-4d45ddb11556', volUUID='3d7f62b5-328f-4d8e-8b69-873cfb5ae14d', options=None) >Thread-60::INFO::2014-07-10 09:37:39,766::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-60::DEBUG::2014-07-10 09:37:39,766::task::1185::TaskManager.Task::(prepare) Task=`f6756905-4f0b-48d9-bc77-5cf444c4ab29`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-60::DEBUG::2014-07-10 09:37:39,766::task::595::TaskManager.Task::(_updateState) Task=`f6756905-4f0b-48d9-bc77-5cf444c4ab29`::moving from state preparing -> state finished >Thread-60::DEBUG::2014-07-10 09:37:39,766::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-60::DEBUG::2014-07-10 09:37:39,766::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-60::DEBUG::2014-07-10 09:37:39,767::task::990::TaskManager.Task::(_decref) Task=`f6756905-4f0b-48d9-bc77-5cf444c4ab29`::ref 0 aborting False >Thread-51::DEBUG::2014-07-10 09:37:39,785::task::595::TaskManager.Task::(_updateState) Task=`9336ba3d-55e3-4b64-b7c1-ee4d6356ee52`::moving from state init -> state preparing >Thread-51::INFO::2014-07-10 09:37:39,786::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='76fdb054-02cd-42ed-9721-b3e65b34c3a4', volUUID='022dfe46-2cf7-4915-80b3-883158e3ca83', options=None) >Thread-51::INFO::2014-07-10 09:37:39,786::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-51::DEBUG::2014-07-10 09:37:39,786::task::1185::TaskManager.Task::(prepare) Task=`9336ba3d-55e3-4b64-b7c1-ee4d6356ee52`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-51::DEBUG::2014-07-10 09:37:39,786::task::595::TaskManager.Task::(_updateState) Task=`9336ba3d-55e3-4b64-b7c1-ee4d6356ee52`::moving from state preparing -> state finished >Thread-51::DEBUG::2014-07-10 09:37:39,787::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-51::DEBUG::2014-07-10 09:37:39,787::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-51::DEBUG::2014-07-10 09:37:39,787::task::990::TaskManager.Task::(_decref) Task=`9336ba3d-55e3-4b64-b7c1-ee4d6356ee52`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 09:37:40,578::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:37:40,707::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0529867 s, 19.3 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-10 09:37:41,465::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/metadata bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-10 09:37:41,493::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00738362 s, 555 kB/s\n'; <rc> = 0 >Thread-40::DEBUG::2014-07-10 09:37:41,623::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lion.qa.lab.tlv.redhat.com:_export_yuri2_backup2/6a70504d-00df-4869-8695-0f442053f6b6/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-40::DEBUG::2014-07-10 09:37:41,644::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n369 bytes (369 B) copied, 0.000467464 s, 789 kB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:37:42,724::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:37:42,878::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0662487 s, 15.5 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:37:44,893::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:37:44,999::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0477457 s, 21.4 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:37:47,015::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:37:47,145::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0450025 s, 22.8 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 09:37:48,155::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-14::DEBUG::2014-07-10 09:37:48,156::task::595::TaskManager.Task::(_updateState) Task=`91e047ad-e183-479b-b858-e0de09520032`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 09:37:48,157::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-14::INFO::2014-07-10 09:37:48,157::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:37:48,157::task::1185::TaskManager.Task::(prepare) Task=`91e047ad-e183-479b-b858-e0de09520032`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:37:48,157::task::595::TaskManager.Task::(_updateState) Task=`91e047ad-e183-479b-b858-e0de09520032`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 09:37:48,158::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 09:37:48,158::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 09:37:48,158::task::990::TaskManager.Task::(_decref) Task=`91e047ad-e183-479b-b858-e0de09520032`::ref 0 aborting False >Thread-34::DEBUG::2014-07-10 09:37:48,162::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-34::DEBUG::2014-07-10 09:37:48,163::task::595::TaskManager.Task::(_updateState) Task=`bb397576-8b40-42e7-a146-ebdf39157a5c`::moving from state init -> state preparing >Thread-34::INFO::2014-07-10 09:37:48,163::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-34::DEBUG::2014-07-10 09:37:48,164::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`2c852718-0a67-43ea-9e1f-3a29553cb3ff`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-10 09:37:48,164::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' for lock type 'shared' >Thread-34::DEBUG::2014-07-10 09:37:48,165::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-10 09:37:48,165::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`2c852718-0a67-43ea-9e1f-3a29553cb3ff`::Granted request >Thread-34::DEBUG::2014-07-10 09:37:48,165::task::827::TaskManager.Task::(resourceAcquired) Task=`bb397576-8b40-42e7-a146-ebdf39157a5c`::_resourcesAcquired: Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee (shared) >Thread-34::DEBUG::2014-07-10 09:37:48,165::task::990::TaskManager.Task::(_decref) Task=`bb397576-8b40-42e7-a146-ebdf39157a5c`::ref 1 aborting False >Thread-34::INFO::2014-07-10 09:37:48,167::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532067385344', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:37:48,167::task::1185::TaskManager.Task::(prepare) Task=`bb397576-8b40-42e7-a146-ebdf39157a5c`::finished: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532067385344', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:37:48,167::task::595::TaskManager.Task::(_updateState) Task=`bb397576-8b40-42e7-a146-ebdf39157a5c`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-10 09:37:48,167::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee': < ResourceRef 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-10 09:37:48,167::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-10 09:37:48,168::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' >Thread-34::DEBUG::2014-07-10 09:37:48,168::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' (0 active users) >Thread-34::DEBUG::2014-07-10 09:37:48,168::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-10 09:37:48,168::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', Clearing records. >Thread-34::DEBUG::2014-07-10 09:37:48,169::task::990::TaskManager.Task::(_decref) Task=`bb397576-8b40-42e7-a146-ebdf39157a5c`::ref 0 aborting False >Thread-14::DEBUG::2014-07-10 09:37:48,882::task::595::TaskManager.Task::(_updateState) Task=`9bf09d26-090e-413c-b9b9-64d8564d5f65`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 09:37:48,884::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::INFO::2014-07-10 09:37:48,884::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00738362', 'lastCheck': '7.4', 'valid': True}, '6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000467464', 'lastCheck': '7.2', 'valid': True}} >Thread-14::DEBUG::2014-07-10 09:37:48,884::task::1185::TaskManager.Task::(prepare) Task=`9bf09d26-090e-413c-b9b9-64d8564d5f65`::finished: {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00738362', 'lastCheck': '7.4', 'valid': True}, '6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000467464', 'lastCheck': '7.2', 'valid': True}} >Thread-14::DEBUG::2014-07-10 09:37:48,885::task::595::TaskManager.Task::(_updateState) Task=`9bf09d26-090e-413c-b9b9-64d8564d5f65`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 09:37:48,885::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 09:37:48,885::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 09:37:48,885::task::990::TaskManager.Task::(_decref) Task=`9bf09d26-090e-413c-b9b9-64d8564d5f65`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 09:37:49,176::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:37:49,430::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.195397 s, 5.2 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:37:51,450::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Thread-18::DEBUG::2014-07-10 09:37:51,523::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/metadata bs=4096 count=1' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:37:51,677::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0876393 s, 11.7 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-10 09:37:51,698::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.0497708 s, 82.3 kB/s\n'; <rc> = 0 >Thread-40::DEBUG::2014-07-10 09:37:52,783::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lion.qa.lab.tlv.redhat.com:_export_yuri2_backup2/6a70504d-00df-4869-8695-0f442053f6b6/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-40::DEBUG::2014-07-10 09:37:52,890::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n369 bytes (369 B) copied, 0.000425536 s, 867 kB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:37:54,939::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:37:55,027::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0301718 s, 33.9 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:37:57,043::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:37:57,136::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0353877 s, 28.9 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 09:37:58,203::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-14::DEBUG::2014-07-10 09:37:58,205::task::595::TaskManager.Task::(_updateState) Task=`c256cdc9-1c17-48b9-8e8f-e3ebba55a83a`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 09:37:58,205::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-14::INFO::2014-07-10 09:37:58,205::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:37:58,206::task::1185::TaskManager.Task::(prepare) Task=`c256cdc9-1c17-48b9-8e8f-e3ebba55a83a`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:37:58,206::task::595::TaskManager.Task::(_updateState) Task=`c256cdc9-1c17-48b9-8e8f-e3ebba55a83a`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 09:37:58,206::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 09:37:58,206::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 09:37:58,206::task::990::TaskManager.Task::(_decref) Task=`c256cdc9-1c17-48b9-8e8f-e3ebba55a83a`::ref 0 aborting False >Thread-34::DEBUG::2014-07-10 09:37:58,250::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-34::DEBUG::2014-07-10 09:37:58,251::task::595::TaskManager.Task::(_updateState) Task=`4fc4fdfd-56c7-4cb6-bfaa-43d04a0a8d41`::moving from state init -> state preparing >Thread-34::INFO::2014-07-10 09:37:58,251::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-34::DEBUG::2014-07-10 09:37:58,252::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`bfff0291-1a1d-4e47-b0b2-fb4ff8786956`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-10 09:37:58,253::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' for lock type 'shared' >Thread-34::DEBUG::2014-07-10 09:37:58,253::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-10 09:37:58,254::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`bfff0291-1a1d-4e47-b0b2-fb4ff8786956`::Granted request >Thread-34::DEBUG::2014-07-10 09:37:58,254::task::827::TaskManager.Task::(resourceAcquired) Task=`4fc4fdfd-56c7-4cb6-bfaa-43d04a0a8d41`::_resourcesAcquired: Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee (shared) >Thread-34::DEBUG::2014-07-10 09:37:58,255::task::990::TaskManager.Task::(_decref) Task=`4fc4fdfd-56c7-4cb6-bfaa-43d04a0a8d41`::ref 1 aborting False >Thread-34::INFO::2014-07-10 09:37:58,256::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532067385344', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:37:58,257::task::1185::TaskManager.Task::(prepare) Task=`4fc4fdfd-56c7-4cb6-bfaa-43d04a0a8d41`::finished: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532067385344', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:37:58,257::task::595::TaskManager.Task::(_updateState) Task=`4fc4fdfd-56c7-4cb6-bfaa-43d04a0a8d41`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-10 09:37:58,257::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee': < ResourceRef 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-10 09:37:58,257::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-10 09:37:58,258::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' >Thread-34::DEBUG::2014-07-10 09:37:58,258::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' (0 active users) >Thread-34::DEBUG::2014-07-10 09:37:58,258::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-10 09:37:58,258::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', Clearing records. >Thread-34::DEBUG::2014-07-10 09:37:58,258::task::990::TaskManager.Task::(_decref) Task=`4fc4fdfd-56c7-4cb6-bfaa-43d04a0a8d41`::ref 0 aborting False >Thread-64::DEBUG::2014-07-10 09:37:58,898::task::595::TaskManager.Task::(_updateState) Task=`06c49b5a-6b83-4e4a-b13e-290349d1149d`::moving from state init -> state preparing >Thread-64::INFO::2014-07-10 09:37:58,898::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='aa20346a-4d3a-4e07-b8e1-52c0ebe4168c', volUUID='58fefce2-9bce-4bff-8949-8c6ce8122b27', options=None) >Thread-64::INFO::2014-07-10 09:37:58,899::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-64::DEBUG::2014-07-10 09:37:58,899::task::1185::TaskManager.Task::(prepare) Task=`06c49b5a-6b83-4e4a-b13e-290349d1149d`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-64::DEBUG::2014-07-10 09:37:58,899::task::595::TaskManager.Task::(_updateState) Task=`06c49b5a-6b83-4e4a-b13e-290349d1149d`::moving from state preparing -> state finished >Thread-64::DEBUG::2014-07-10 09:37:58,899::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-64::DEBUG::2014-07-10 09:37:58,900::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-64::DEBUG::2014-07-10 09:37:58,900::task::990::TaskManager.Task::(_decref) Task=`06c49b5a-6b83-4e4a-b13e-290349d1149d`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 09:37:59,151::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:37:59,233::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0256329 s, 39.9 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:38:01,251::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Thread-73::DEBUG::2014-07-10 09:38:01,276::task::595::TaskManager.Task::(_updateState) Task=`e214f428-0282-4dde-be38-5fed442dc968`::moving from state init -> state preparing >Thread-54::DEBUG::2014-07-10 09:38:01,278::task::595::TaskManager.Task::(_updateState) Task=`fc5b96ad-c748-4e8d-9117-003cffb2b729`::moving from state init -> state preparing >Thread-73::INFO::2014-07-10 09:38:01,284::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='c01d693b-cba0-4fed-9ad7-0aaa28912a19', volUUID='4bb5d954-2a50-4028-b299-0b43c261270c', options=None) >Thread-54::INFO::2014-07-10 09:38:01,286::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='28408446-e5fd-4565-a976-e760951593fe', volUUID='776303a2-5585-451e-826e-0e338d4a1e98', options=None) >Thread-73::INFO::2014-07-10 09:38:01,292::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-54::INFO::2014-07-10 09:38:01,294::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-73::DEBUG::2014-07-10 09:38:01,297::task::1185::TaskManager.Task::(prepare) Task=`e214f428-0282-4dde-be38-5fed442dc968`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-54::DEBUG::2014-07-10 09:38:01,299::task::1185::TaskManager.Task::(prepare) Task=`fc5b96ad-c748-4e8d-9117-003cffb2b729`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-73::DEBUG::2014-07-10 09:38:01,303::task::595::TaskManager.Task::(_updateState) Task=`e214f428-0282-4dde-be38-5fed442dc968`::moving from state preparing -> state finished >Thread-54::DEBUG::2014-07-10 09:38:01,304::task::595::TaskManager.Task::(_updateState) Task=`fc5b96ad-c748-4e8d-9117-003cffb2b729`::moving from state preparing -> state finished >Thread-73::DEBUG::2014-07-10 09:38:01,308::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-54::DEBUG::2014-07-10 09:38:01,310::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-73::DEBUG::2014-07-10 09:38:01,314::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-54::DEBUG::2014-07-10 09:38:01,316::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-73::DEBUG::2014-07-10 09:38:01,320::task::990::TaskManager.Task::(_decref) Task=`e214f428-0282-4dde-be38-5fed442dc968`::ref 0 aborting False >Thread-54::DEBUG::2014-07-10 09:38:01,321::task::990::TaskManager.Task::(_decref) Task=`fc5b96ad-c748-4e8d-9117-003cffb2b729`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 09:38:01,408::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0931711 s, 11.0 MB/s\n'; <rc> = 0 >Thread-40::DEBUG::2014-07-10 09:38:02,930::domainMonitor::192::Storage.DomainMonitorThread::(_monitorDomain) Refreshing domain 6a70504d-00df-4869-8695-0f442053f6b6 >Thread-18::DEBUG::2014-07-10 09:38:02,935::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/metadata bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-10 09:38:02,972::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.0073905 s, 554 kB/s\n'; <rc> = 0 >Thread-40::DEBUG::2014-07-10 09:38:03,192::fileSD::150::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/lion.qa.lab.tlv.redhat.com:_export_yuri2_backup2/6a70504d-00df-4869-8695-0f442053f6b6 >Thread-40::DEBUG::2014-07-10 09:38:03,199::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend >Thread-40::DEBUG::2014-07-10 09:38:03,207::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Backup', 'DESCRIPTION=test', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=0', 'POOL_UUID=4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', 'REMOTE_PATH=lion.qa.lab.tlv.redhat.com:/export/yuri2/backup2', 'ROLE=Regular', 'SDUUID=6a70504d-00df-4869-8695-0f442053f6b6', 'TYPE=NFS', 'VERSION=0', '_SHA_CKSUM=aab6b8e901ec435cd5f9de3c9e3f8b45dca569e0'] >Thread-40::DEBUG::2014-07-10 09:38:03,209::fileSD::609::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images [] >Thread-40::INFO::2014-07-10 09:38:03,209::sd::384::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 6a70504d-00df-4869-8695-0f442053f6b6_imageNS already registered >Thread-40::INFO::2014-07-10 09:38:03,210::sd::392::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 6a70504d-00df-4869-8695-0f442053f6b6_volumeNS already registered >Thread-40::DEBUG::2014-07-10 09:38:03,236::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lion.qa.lab.tlv.redhat.com:_export_yuri2_backup2/6a70504d-00df-4869-8695-0f442053f6b6/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-40::DEBUG::2014-07-10 09:38:03,255::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n369 bytes (369 B) copied, 0.000459454 s, 803 kB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:38:03,424::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:38:03,590::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0338957 s, 30.2 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 09:38:04,203::task::595::TaskManager.Task::(_updateState) Task=`4b8cf926-d7b3-477b-9eee-9c116ada9ca9`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 09:38:04,203::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::INFO::2014-07-10 09:38:04,204::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0073905', 'lastCheck': '1.0', 'valid': True}, '6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000459454', 'lastCheck': '0.9', 'valid': True}} >Thread-14::DEBUG::2014-07-10 09:38:04,204::task::1185::TaskManager.Task::(prepare) Task=`4b8cf926-d7b3-477b-9eee-9c116ada9ca9`::finished: {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0073905', 'lastCheck': '1.0', 'valid': True}, '6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000459454', 'lastCheck': '0.9', 'valid': True}} >Thread-14::DEBUG::2014-07-10 09:38:04,204::task::595::TaskManager.Task::(_updateState) Task=`4b8cf926-d7b3-477b-9eee-9c116ada9ca9`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 09:38:04,204::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 09:38:04,205::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 09:38:04,205::task::990::TaskManager.Task::(_decref) Task=`4b8cf926-d7b3-477b-9eee-9c116ada9ca9`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 09:38:05,621::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:38:05,725::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0447583 s, 22.9 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:38:07,746::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:38:08,054::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.035424 s, 28.9 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 09:38:08,289::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-14::DEBUG::2014-07-10 09:38:08,290::task::595::TaskManager.Task::(_updateState) Task=`649420d4-e44a-4b2d-9655-9de34b25057f`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 09:38:08,290::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-14::INFO::2014-07-10 09:38:08,291::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:38:08,291::task::1185::TaskManager.Task::(prepare) Task=`649420d4-e44a-4b2d-9655-9de34b25057f`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:38:08,291::task::595::TaskManager.Task::(_updateState) Task=`649420d4-e44a-4b2d-9655-9de34b25057f`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 09:38:08,291::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 09:38:08,292::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 09:38:08,292::task::990::TaskManager.Task::(_decref) Task=`649420d4-e44a-4b2d-9655-9de34b25057f`::ref 0 aborting False >Thread-34::DEBUG::2014-07-10 09:38:08,296::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-34::DEBUG::2014-07-10 09:38:08,296::task::595::TaskManager.Task::(_updateState) Task=`33340351-3b5a-433d-99c6-f30fecafa575`::moving from state init -> state preparing >Thread-34::INFO::2014-07-10 09:38:08,296::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-34::DEBUG::2014-07-10 09:38:08,297::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`e79880d0-c781-43f4-888e-d5880d64b552`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-10 09:38:08,297::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' for lock type 'shared' >Thread-34::DEBUG::2014-07-10 09:38:08,297::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-10 09:38:08,298::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`e79880d0-c781-43f4-888e-d5880d64b552`::Granted request >Thread-34::DEBUG::2014-07-10 09:38:08,298::task::827::TaskManager.Task::(resourceAcquired) Task=`33340351-3b5a-433d-99c6-f30fecafa575`::_resourcesAcquired: Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee (shared) >Thread-34::DEBUG::2014-07-10 09:38:08,298::task::990::TaskManager.Task::(_decref) Task=`33340351-3b5a-433d-99c6-f30fecafa575`::ref 1 aborting False >Thread-34::INFO::2014-07-10 09:38:08,299::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532067385344', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:38:08,299::task::1185::TaskManager.Task::(prepare) Task=`33340351-3b5a-433d-99c6-f30fecafa575`::finished: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532067385344', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:38:08,300::task::595::TaskManager.Task::(_updateState) Task=`33340351-3b5a-433d-99c6-f30fecafa575`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-10 09:38:08,300::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee': < ResourceRef 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-10 09:38:08,300::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-10 09:38:08,300::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' >Thread-34::DEBUG::2014-07-10 09:38:08,301::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' (0 active users) >Thread-34::DEBUG::2014-07-10 09:38:08,301::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-10 09:38:08,301::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', Clearing records. >Thread-34::DEBUG::2014-07-10 09:38:08,301::task::990::TaskManager.Task::(_decref) Task=`33340351-3b5a-433d-99c6-f30fecafa575`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 09:38:10,064::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:38:10,149::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0270316 s, 37.9 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:38:12,165::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:38:12,365::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0596626 s, 17.2 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-10 09:38:13,206::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/metadata bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-10 09:38:13,228::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000892835 s, 4.6 MB/s\n'; <rc> = 0 >Thread-40::DEBUG::2014-07-10 09:38:13,286::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lion.qa.lab.tlv.redhat.com:_export_yuri2_backup2/6a70504d-00df-4869-8695-0f442053f6b6/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-40::DEBUG::2014-07-10 09:38:13,306::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n369 bytes (369 B) copied, 0.000619377 s, 596 kB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:38:14,381::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:38:14,485::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0462097 s, 22.2 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:38:16,500::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:38:16,618::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0602154 s, 17.0 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 09:38:18,330::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-14::DEBUG::2014-07-10 09:38:18,331::task::595::TaskManager.Task::(_updateState) Task=`ef0ff828-6d51-4bbd-a1f5-f9363685403d`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 09:38:18,332::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-14::INFO::2014-07-10 09:38:18,332::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:38:18,332::task::1185::TaskManager.Task::(prepare) Task=`ef0ff828-6d51-4bbd-a1f5-f9363685403d`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:38:18,332::task::595::TaskManager.Task::(_updateState) Task=`ef0ff828-6d51-4bbd-a1f5-f9363685403d`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 09:38:18,333::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 09:38:18,333::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 09:38:18,333::task::990::TaskManager.Task::(_decref) Task=`ef0ff828-6d51-4bbd-a1f5-f9363685403d`::ref 0 aborting False >Thread-34::DEBUG::2014-07-10 09:38:18,337::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-34::DEBUG::2014-07-10 09:38:18,338::task::595::TaskManager.Task::(_updateState) Task=`eb40d7e0-4235-44c5-b3a3-dfe12a1b210c`::moving from state init -> state preparing >Thread-34::INFO::2014-07-10 09:38:18,338::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-34::DEBUG::2014-07-10 09:38:18,338::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`0f724e98-5749-4370-afae-6cdd4b503956`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-10 09:38:18,339::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' for lock type 'shared' >Thread-34::DEBUG::2014-07-10 09:38:18,339::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-10 09:38:18,339::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`0f724e98-5749-4370-afae-6cdd4b503956`::Granted request >Thread-34::DEBUG::2014-07-10 09:38:18,340::task::827::TaskManager.Task::(resourceAcquired) Task=`eb40d7e0-4235-44c5-b3a3-dfe12a1b210c`::_resourcesAcquired: Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee (shared) >Thread-34::DEBUG::2014-07-10 09:38:18,340::task::990::TaskManager.Task::(_decref) Task=`eb40d7e0-4235-44c5-b3a3-dfe12a1b210c`::ref 1 aborting False >Thread-34::INFO::2014-07-10 09:38:18,341::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532067385344', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:38:18,341::task::1185::TaskManager.Task::(prepare) Task=`eb40d7e0-4235-44c5-b3a3-dfe12a1b210c`::finished: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532067385344', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:38:18,342::task::595::TaskManager.Task::(_updateState) Task=`eb40d7e0-4235-44c5-b3a3-dfe12a1b210c`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-10 09:38:18,342::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee': < ResourceRef 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-10 09:38:18,342::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-10 09:38:18,342::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' >Thread-34::DEBUG::2014-07-10 09:38:18,343::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' (0 active users) >Thread-34::DEBUG::2014-07-10 09:38:18,343::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-10 09:38:18,343::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', Clearing records. >Thread-34::DEBUG::2014-07-10 09:38:18,343::task::990::TaskManager.Task::(_decref) Task=`eb40d7e0-4235-44c5-b3a3-dfe12a1b210c`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 09:38:18,633::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:38:18,737::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0452522 s, 22.6 MB/s\n'; <rc> = 0 >Thread-57::DEBUG::2014-07-10 09:38:19,379::task::595::TaskManager.Task::(_updateState) Task=`93da2384-dbe6-4392-8280-5251a30de8f0`::moving from state init -> state preparing >Thread-57::INFO::2014-07-10 09:38:19,379::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='b6f6c0da-e67f-4902-b9ac-3069571a42fe', volUUID='c4cd1da8-05b7-45e0-80b1-1183d21443d9', options=None) >Thread-57::INFO::2014-07-10 09:38:19,380::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-57::DEBUG::2014-07-10 09:38:19,380::task::1185::TaskManager.Task::(prepare) Task=`93da2384-dbe6-4392-8280-5251a30de8f0`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-57::DEBUG::2014-07-10 09:38:19,380::task::595::TaskManager.Task::(_updateState) Task=`93da2384-dbe6-4392-8280-5251a30de8f0`::moving from state preparing -> state finished >Thread-57::DEBUG::2014-07-10 09:38:19,380::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-57::DEBUG::2014-07-10 09:38:19,381::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-57::DEBUG::2014-07-10 09:38:19,381::task::990::TaskManager.Task::(_decref) Task=`93da2384-dbe6-4392-8280-5251a30de8f0`::ref 0 aborting False >Thread-14::DEBUG::2014-07-10 09:38:19,400::task::595::TaskManager.Task::(_updateState) Task=`f51cbeed-638b-44d0-910b-7b130bfbd78b`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 09:38:19,402::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::INFO::2014-07-10 09:38:19,403::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000892835', 'lastCheck': '6.1', 'valid': True}, '6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000619377', 'lastCheck': '6.1', 'valid': True}} >Thread-14::DEBUG::2014-07-10 09:38:19,403::task::1185::TaskManager.Task::(prepare) Task=`f51cbeed-638b-44d0-910b-7b130bfbd78b`::finished: {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000892835', 'lastCheck': '6.1', 'valid': True}, '6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000619377', 'lastCheck': '6.1', 'valid': True}} >Thread-14::DEBUG::2014-07-10 09:38:19,403::task::595::TaskManager.Task::(_updateState) Task=`f51cbeed-638b-44d0-910b-7b130bfbd78b`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 09:38:19,403::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 09:38:19,403::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 09:38:19,404::task::990::TaskManager.Task::(_decref) Task=`f51cbeed-638b-44d0-910b-7b130bfbd78b`::ref 0 aborting False >Thread-67::DEBUG::2014-07-10 09:38:19,985::task::595::TaskManager.Task::(_updateState) Task=`ce3ee592-5c34-47e3-8e41-97208900eb9a`::moving from state init -> state preparing >Thread-67::INFO::2014-07-10 09:38:19,986::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='f30c2cb7-a43a-4bf5-82b5-cfe07336f65c', volUUID='b0fbb3c9-55af-4a3a-95ad-fc56a80b9cf5', options=None) >Thread-67::INFO::2014-07-10 09:38:19,986::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-67::DEBUG::2014-07-10 09:38:19,986::task::1185::TaskManager.Task::(prepare) Task=`ce3ee592-5c34-47e3-8e41-97208900eb9a`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-67::DEBUG::2014-07-10 09:38:19,987::task::595::TaskManager.Task::(_updateState) Task=`ce3ee592-5c34-47e3-8e41-97208900eb9a`::moving from state preparing -> state finished >Thread-67::DEBUG::2014-07-10 09:38:19,987::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-67::DEBUG::2014-07-10 09:38:19,987::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-67::DEBUG::2014-07-10 09:38:19,987::task::990::TaskManager.Task::(_decref) Task=`ce3ee592-5c34-47e3-8e41-97208900eb9a`::ref 0 aborting False >Thread-48::DEBUG::2014-07-10 09:38:20,537::task::595::TaskManager.Task::(_updateState) Task=`99863e42-7189-4ad2-9a97-12b88db48168`::moving from state init -> state preparing >Thread-48::INFO::2014-07-10 09:38:20,537::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='0cd7d6ce-f497-4243-a690-c57744861eea', volUUID='10b6a7dd-dc6c-43fa-ba17-92e4331b0e0b', options=None) >Thread-48::INFO::2014-07-10 09:38:20,537::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-48::DEBUG::2014-07-10 09:38:20,538::task::1185::TaskManager.Task::(prepare) Task=`99863e42-7189-4ad2-9a97-12b88db48168`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-48::DEBUG::2014-07-10 09:38:20,538::task::595::TaskManager.Task::(_updateState) Task=`99863e42-7189-4ad2-9a97-12b88db48168`::moving from state preparing -> state finished >Thread-48::DEBUG::2014-07-10 09:38:20,538::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-48::DEBUG::2014-07-10 09:38:20,538::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-48::DEBUG::2014-07-10 09:38:20,538::task::990::TaskManager.Task::(_decref) Task=`99863e42-7189-4ad2-9a97-12b88db48168`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 09:38:20,752::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:38:20,857::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0311545 s, 32.9 MB/s\n'; <rc> = 0 >Thread-76::DEBUG::2014-07-10 09:38:21,909::task::595::TaskManager.Task::(_updateState) Task=`2caff686-7803-4694-8543-cd94d5bcbee6`::moving from state init -> state preparing >Thread-76::INFO::2014-07-10 09:38:21,910::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='e4c65229-4247-4b33-b72a-f1d5ce72ad05', volUUID='cad94284-3ca9-4c30-933d-997f4460309e', options=None) >Thread-76::INFO::2014-07-10 09:38:21,910::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-76::DEBUG::2014-07-10 09:38:21,910::task::1185::TaskManager.Task::(prepare) Task=`2caff686-7803-4694-8543-cd94d5bcbee6`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-76::DEBUG::2014-07-10 09:38:21,911::task::595::TaskManager.Task::(_updateState) Task=`2caff686-7803-4694-8543-cd94d5bcbee6`::moving from state preparing -> state finished >Thread-76::DEBUG::2014-07-10 09:38:21,911::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-76::DEBUG::2014-07-10 09:38:21,911::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-76::DEBUG::2014-07-10 09:38:21,911::task::990::TaskManager.Task::(_decref) Task=`2caff686-7803-4694-8543-cd94d5bcbee6`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 09:38:22,872::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:38:22,993::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0351049 s, 29.2 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-10 09:38:23,258::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/metadata bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-10 09:38:23,284::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00513617 s, 797 kB/s\n'; <rc> = 0 >Thread-40::DEBUG::2014-07-10 09:38:23,363::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lion.qa.lab.tlv.redhat.com:_export_yuri2_backup2/6a70504d-00df-4869-8695-0f442053f6b6/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-40::DEBUG::2014-07-10 09:38:23,383::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n369 bytes (369 B) copied, 0.000441013 s, 837 kB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:38:25,003::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:38:25,098::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0390195 s, 26.2 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:38:27,113::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:38:27,206::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.037705 s, 27.2 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 09:38:28,364::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-14::DEBUG::2014-07-10 09:38:28,366::task::595::TaskManager.Task::(_updateState) Task=`531f6f34-741a-4fe6-a69e-12189126f97a`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 09:38:28,366::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-14::INFO::2014-07-10 09:38:28,367::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:38:28,367::task::1185::TaskManager.Task::(prepare) Task=`531f6f34-741a-4fe6-a69e-12189126f97a`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:38:28,367::task::595::TaskManager.Task::(_updateState) Task=`531f6f34-741a-4fe6-a69e-12189126f97a`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 09:38:28,367::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 09:38:28,368::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 09:38:28,368::task::990::TaskManager.Task::(_decref) Task=`531f6f34-741a-4fe6-a69e-12189126f97a`::ref 0 aborting False >Thread-34::DEBUG::2014-07-10 09:38:28,372::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-34::DEBUG::2014-07-10 09:38:28,372::task::595::TaskManager.Task::(_updateState) Task=`bd583f4e-5d70-46b6-aef0-e63ff98ebbe0`::moving from state init -> state preparing >Thread-34::INFO::2014-07-10 09:38:28,373::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-34::DEBUG::2014-07-10 09:38:28,373::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`a8428272-4642-4064-98e7-cd20ef532e67`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-10 09:38:28,373::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' for lock type 'shared' >Thread-34::DEBUG::2014-07-10 09:38:28,374::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-10 09:38:28,374::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`a8428272-4642-4064-98e7-cd20ef532e67`::Granted request >Thread-34::DEBUG::2014-07-10 09:38:28,374::task::827::TaskManager.Task::(resourceAcquired) Task=`bd583f4e-5d70-46b6-aef0-e63ff98ebbe0`::_resourcesAcquired: Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee (shared) >Thread-34::DEBUG::2014-07-10 09:38:28,375::task::990::TaskManager.Task::(_decref) Task=`bd583f4e-5d70-46b6-aef0-e63ff98ebbe0`::ref 1 aborting False >Thread-34::INFO::2014-07-10 09:38:28,376::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532067385344', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:38:28,376::task::1185::TaskManager.Task::(prepare) Task=`bd583f4e-5d70-46b6-aef0-e63ff98ebbe0`::finished: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532067385344', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:38:28,376::task::595::TaskManager.Task::(_updateState) Task=`bd583f4e-5d70-46b6-aef0-e63ff98ebbe0`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-10 09:38:28,376::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee': < ResourceRef 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-10 09:38:28,377::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-10 09:38:28,377::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' >Thread-34::DEBUG::2014-07-10 09:38:28,377::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' (0 active users) >Thread-34::DEBUG::2014-07-10 09:38:28,377::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-10 09:38:28,378::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', Clearing records. >Thread-34::DEBUG::2014-07-10 09:38:28,378::task::990::TaskManager.Task::(_decref) Task=`bd583f4e-5d70-46b6-aef0-e63ff98ebbe0`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 09:38:29,221::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:38:29,309::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0306044 s, 33.5 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:38:31,324::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:38:31,417::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0345028 s, 29.7 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-10 09:38:33,339::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/metadata bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-10 09:38:33,379::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.0182927 s, 224 kB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:38:33,444::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Thread-40::DEBUG::2014-07-10 09:38:34,278::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lion.qa.lab.tlv.redhat.com:_export_yuri2_backup2/6a70504d-00df-4869-8695-0f442053f6b6/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-40::DEBUG::2014-07-10 09:38:34,326::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n369 bytes (369 B) copied, 0.000516576 s, 714 kB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:38:34,388::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.884358 s, 1.2 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 09:38:34,591::task::595::TaskManager.Task::(_updateState) Task=`fab0f131-b259-4099-a83f-69d3badb3493`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 09:38:34,591::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::INFO::2014-07-10 09:38:34,591::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0182927', 'lastCheck': '0.3', 'valid': True}, '6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000516576', 'lastCheck': '0.3', 'valid': True}} >Thread-14::DEBUG::2014-07-10 09:38:34,592::task::1185::TaskManager.Task::(prepare) Task=`fab0f131-b259-4099-a83f-69d3badb3493`::finished: {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0182927', 'lastCheck': '0.3', 'valid': True}, '6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000516576', 'lastCheck': '0.3', 'valid': True}} >Thread-14::DEBUG::2014-07-10 09:38:34,592::task::595::TaskManager.Task::(_updateState) Task=`fab0f131-b259-4099-a83f-69d3badb3493`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 09:38:34,592::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 09:38:34,592::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 09:38:34,592::task::990::TaskManager.Task::(_decref) Task=`fab0f131-b259-4099-a83f-69d3badb3493`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 09:38:36,403::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:38:36,565::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.103748 s, 9.9 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 09:38:38,414::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-14::DEBUG::2014-07-10 09:38:38,416::task::595::TaskManager.Task::(_updateState) Task=`8c3626a9-8554-4877-bf5e-d09bf58e2792`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 09:38:38,416::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-14::INFO::2014-07-10 09:38:38,417::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:38:38,417::task::1185::TaskManager.Task::(prepare) Task=`8c3626a9-8554-4877-bf5e-d09bf58e2792`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:38:38,417::task::595::TaskManager.Task::(_updateState) Task=`8c3626a9-8554-4877-bf5e-d09bf58e2792`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 09:38:38,418::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 09:38:38,418::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 09:38:38,418::task::990::TaskManager.Task::(_decref) Task=`8c3626a9-8554-4877-bf5e-d09bf58e2792`::ref 0 aborting False >Thread-34::DEBUG::2014-07-10 09:38:38,422::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-34::DEBUG::2014-07-10 09:38:38,422::task::595::TaskManager.Task::(_updateState) Task=`f3b9be5b-917d-4b51-afdb-ba101e6c2fed`::moving from state init -> state preparing >Thread-34::INFO::2014-07-10 09:38:38,423::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-34::DEBUG::2014-07-10 09:38:38,423::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`4713983c-e9c2-4898-b5ba-634eb211014b`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-10 09:38:38,424::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' for lock type 'shared' >Thread-34::DEBUG::2014-07-10 09:38:38,424::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-10 09:38:38,424::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`4713983c-e9c2-4898-b5ba-634eb211014b`::Granted request >Thread-34::DEBUG::2014-07-10 09:38:38,425::task::827::TaskManager.Task::(resourceAcquired) Task=`f3b9be5b-917d-4b51-afdb-ba101e6c2fed`::_resourcesAcquired: Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee (shared) >Thread-34::DEBUG::2014-07-10 09:38:38,425::task::990::TaskManager.Task::(_decref) Task=`f3b9be5b-917d-4b51-afdb-ba101e6c2fed`::ref 1 aborting False >Thread-34::INFO::2014-07-10 09:38:38,426::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532067385344', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:38:38,426::task::1185::TaskManager.Task::(prepare) Task=`f3b9be5b-917d-4b51-afdb-ba101e6c2fed`::finished: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532067385344', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:38:38,427::task::595::TaskManager.Task::(_updateState) Task=`f3b9be5b-917d-4b51-afdb-ba101e6c2fed`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-10 09:38:38,427::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee': < ResourceRef 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-10 09:38:38,427::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-10 09:38:38,427::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' >Thread-34::DEBUG::2014-07-10 09:38:38,427::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' (0 active users) >Thread-34::DEBUG::2014-07-10 09:38:38,428::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-10 09:38:38,428::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', Clearing records. >Thread-34::DEBUG::2014-07-10 09:38:38,428::task::990::TaskManager.Task::(_decref) Task=`f3b9be5b-917d-4b51-afdb-ba101e6c2fed`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 09:38:38,580::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:38:38,680::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0372514 s, 27.5 MB/s\n'; <rc> = 0 >Thread-70::DEBUG::2014-07-10 09:38:39,086::task::595::TaskManager.Task::(_updateState) Task=`f3307929-8943-4eb7-aa07-dfaadf990891`::moving from state init -> state preparing >Thread-70::INFO::2014-07-10 09:38:39,087::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='cfaeead2-7caa-467c-b389-c89840ae6605', volUUID='567fe32d-31a6-4ff6-90f3-fd6a656fbecc', options=None) >Thread-70::INFO::2014-07-10 09:38:39,088::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-70::DEBUG::2014-07-10 09:38:39,088::task::1185::TaskManager.Task::(prepare) Task=`f3307929-8943-4eb7-aa07-dfaadf990891`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-70::DEBUG::2014-07-10 09:38:39,088::task::595::TaskManager.Task::(_updateState) Task=`f3307929-8943-4eb7-aa07-dfaadf990891`::moving from state preparing -> state finished >Thread-70::DEBUG::2014-07-10 09:38:39,088::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-70::DEBUG::2014-07-10 09:38:39,089::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-70::DEBUG::2014-07-10 09:38:39,089::task::990::TaskManager.Task::(_decref) Task=`f3307929-8943-4eb7-aa07-dfaadf990891`::ref 0 aborting False >Thread-60::DEBUG::2014-07-10 09:38:40,094::task::595::TaskManager.Task::(_updateState) Task=`78155245-c674-45b0-8a9f-4752fd23b839`::moving from state init -> state preparing >Thread-51::DEBUG::2014-07-10 09:38:40,095::task::595::TaskManager.Task::(_updateState) Task=`a8701b67-3bba-4764-800c-62cfd4a9281e`::moving from state init -> state preparing >Thread-60::INFO::2014-07-10 09:38:40,096::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='b034d5b0-e1e0-4011-b49b-4d45ddb11556', volUUID='3d7f62b5-328f-4d8e-8b69-873cfb5ae14d', options=None) >Thread-51::INFO::2014-07-10 09:38:40,096::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='76fdb054-02cd-42ed-9721-b3e65b34c3a4', volUUID='022dfe46-2cf7-4915-80b3-883158e3ca83', options=None) >Thread-60::INFO::2014-07-10 09:38:40,098::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-51::INFO::2014-07-10 09:38:40,098::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-60::DEBUG::2014-07-10 09:38:40,099::task::1185::TaskManager.Task::(prepare) Task=`78155245-c674-45b0-8a9f-4752fd23b839`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-51::DEBUG::2014-07-10 09:38:40,099::task::1185::TaskManager.Task::(prepare) Task=`a8701b67-3bba-4764-800c-62cfd4a9281e`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-60::DEBUG::2014-07-10 09:38:40,100::task::595::TaskManager.Task::(_updateState) Task=`78155245-c674-45b0-8a9f-4752fd23b839`::moving from state preparing -> state finished >Thread-51::DEBUG::2014-07-10 09:38:40,100::task::595::TaskManager.Task::(_updateState) Task=`a8701b67-3bba-4764-800c-62cfd4a9281e`::moving from state preparing -> state finished >Thread-60::DEBUG::2014-07-10 09:38:40,101::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-51::DEBUG::2014-07-10 09:38:40,102::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-60::DEBUG::2014-07-10 09:38:40,103::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-51::DEBUG::2014-07-10 09:38:40,103::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-60::DEBUG::2014-07-10 09:38:40,104::task::990::TaskManager.Task::(_decref) Task=`78155245-c674-45b0-8a9f-4752fd23b839`::ref 0 aborting False >Thread-51::DEBUG::2014-07-10 09:38:40,104::task::990::TaskManager.Task::(_decref) Task=`a8701b67-3bba-4764-800c-62cfd4a9281e`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 09:38:40,695::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:38:40,804::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0350083 s, 29.3 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:38:42,819::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:38:42,904::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0269555 s, 38.0 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-10 09:38:44,259::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/metadata bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-10 09:38:44,323::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00786798 s, 521 kB/s\n'; <rc> = 0 >Thread-40::DEBUG::2014-07-10 09:38:44,901::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lion.qa.lab.tlv.redhat.com:_export_yuri2_backup2/6a70504d-00df-4869-8695-0f442053f6b6/dom_md/metadata bs=4096 count=1' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:38:44,924::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Thread-40::DEBUG::2014-07-10 09:38:44,947::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n369 bytes (369 B) copied, 0.000387779 s, 952 kB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:38:45,032::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0476605 s, 21.5 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:38:47,046::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:38:47,145::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0387139 s, 26.5 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 09:38:48,456::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-14::DEBUG::2014-07-10 09:38:48,457::task::595::TaskManager.Task::(_updateState) Task=`8adb9bab-6f5e-4e04-8875-c8e182819fd3`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 09:38:48,458::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-14::INFO::2014-07-10 09:38:48,458::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:38:48,459::task::1185::TaskManager.Task::(prepare) Task=`8adb9bab-6f5e-4e04-8875-c8e182819fd3`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:38:48,459::task::595::TaskManager.Task::(_updateState) Task=`8adb9bab-6f5e-4e04-8875-c8e182819fd3`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 09:38:48,459::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 09:38:48,459::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 09:38:48,459::task::990::TaskManager.Task::(_decref) Task=`8adb9bab-6f5e-4e04-8875-c8e182819fd3`::ref 0 aborting False >Thread-34::DEBUG::2014-07-10 09:38:48,463::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-34::DEBUG::2014-07-10 09:38:48,464::task::595::TaskManager.Task::(_updateState) Task=`ce292609-aa85-4c5b-a324-952ec30d0513`::moving from state init -> state preparing >Thread-34::INFO::2014-07-10 09:38:48,464::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-34::DEBUG::2014-07-10 09:38:48,465::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`b0677e5f-5c5b-4997-81a0-7922dfd4674a`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-10 09:38:48,465::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' for lock type 'shared' >Thread-34::DEBUG::2014-07-10 09:38:48,465::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-10 09:38:48,466::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`b0677e5f-5c5b-4997-81a0-7922dfd4674a`::Granted request >Thread-34::DEBUG::2014-07-10 09:38:48,466::task::827::TaskManager.Task::(resourceAcquired) Task=`ce292609-aa85-4c5b-a324-952ec30d0513`::_resourcesAcquired: Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee (shared) >Thread-34::DEBUG::2014-07-10 09:38:48,466::task::990::TaskManager.Task::(_decref) Task=`ce292609-aa85-4c5b-a324-952ec30d0513`::ref 1 aborting False >Thread-34::INFO::2014-07-10 09:38:48,467::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532067385344', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:38:48,468::task::1185::TaskManager.Task::(prepare) Task=`ce292609-aa85-4c5b-a324-952ec30d0513`::finished: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532067385344', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:38:48,468::task::595::TaskManager.Task::(_updateState) Task=`ce292609-aa85-4c5b-a324-952ec30d0513`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-10 09:38:48,468::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee': < ResourceRef 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-10 09:38:48,468::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-10 09:38:48,468::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' >Thread-34::DEBUG::2014-07-10 09:38:48,469::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' (0 active users) >Thread-34::DEBUG::2014-07-10 09:38:48,469::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-10 09:38:48,469::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', Clearing records. >Thread-34::DEBUG::2014-07-10 09:38:48,469::task::990::TaskManager.Task::(_decref) Task=`ce292609-aa85-4c5b-a324-952ec30d0513`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 09:38:49,160::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:38:49,277::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0575424 s, 17.8 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 09:38:49,795::task::595::TaskManager.Task::(_updateState) Task=`55e7b81b-57f7-4504-b077-67852383cabb`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 09:38:49,796::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::INFO::2014-07-10 09:38:49,796::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00786798', 'lastCheck': '4.9', 'valid': True}, '6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000387779', 'lastCheck': '4.8', 'valid': True}} >Thread-14::DEBUG::2014-07-10 09:38:49,796::task::1185::TaskManager.Task::(prepare) Task=`55e7b81b-57f7-4504-b077-67852383cabb`::finished: {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00786798', 'lastCheck': '4.9', 'valid': True}, '6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000387779', 'lastCheck': '4.8', 'valid': True}} >Thread-14::DEBUG::2014-07-10 09:38:49,796::task::595::TaskManager.Task::(_updateState) Task=`55e7b81b-57f7-4504-b077-67852383cabb`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 09:38:49,797::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 09:38:49,797::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 09:38:49,797::task::990::TaskManager.Task::(_decref) Task=`55e7b81b-57f7-4504-b077-67852383cabb`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 09:38:51,292::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:38:51,390::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0404719 s, 25.3 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:38:53,406::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:38:53,506::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0415157 s, 24.7 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-10 09:38:54,898::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/metadata bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-10 09:38:54,925::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00694353 s, 590 kB/s\n'; <rc> = 0 >Thread-40::DEBUG::2014-07-10 09:38:54,987::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lion.qa.lab.tlv.redhat.com:_export_yuri2_backup2/6a70504d-00df-4869-8695-0f442053f6b6/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-40::DEBUG::2014-07-10 09:38:55,007::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n369 bytes (369 B) copied, 0.000522622 s, 706 kB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:38:55,521::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:38:55,626::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0490724 s, 20.9 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:38:57,653::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:38:57,738::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0279411 s, 36.6 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 09:38:58,501::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-14::DEBUG::2014-07-10 09:38:58,506::task::595::TaskManager.Task::(_updateState) Task=`f68b0516-be2a-4593-acb9-18a008cf84d5`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 09:38:58,509::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-14::INFO::2014-07-10 09:38:58,515::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:38:58,517::task::1185::TaskManager.Task::(prepare) Task=`f68b0516-be2a-4593-acb9-18a008cf84d5`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:38:58,519::task::595::TaskManager.Task::(_updateState) Task=`f68b0516-be2a-4593-acb9-18a008cf84d5`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 09:38:58,522::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 09:38:58,524::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 09:38:58,526::task::990::TaskManager.Task::(_decref) Task=`f68b0516-be2a-4593-acb9-18a008cf84d5`::ref 0 aborting False >Thread-34::DEBUG::2014-07-10 09:38:58,541::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-34::DEBUG::2014-07-10 09:38:58,545::task::595::TaskManager.Task::(_updateState) Task=`0c06bd5f-1ec5-4505-87bc-a863489bba5f`::moving from state init -> state preparing >Thread-34::INFO::2014-07-10 09:38:58,548::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-34::DEBUG::2014-07-10 09:38:58,557::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`65a9e7f3-a84c-4a1b-ba21-1328fb9a38e2`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-10 09:38:58,561::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' for lock type 'shared' >Thread-34::DEBUG::2014-07-10 09:38:58,573::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-10 09:38:58,580::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`65a9e7f3-a84c-4a1b-ba21-1328fb9a38e2`::Granted request >Thread-34::DEBUG::2014-07-10 09:38:58,597::task::827::TaskManager.Task::(resourceAcquired) Task=`0c06bd5f-1ec5-4505-87bc-a863489bba5f`::_resourcesAcquired: Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee (shared) >Thread-34::DEBUG::2014-07-10 09:38:58,605::task::990::TaskManager.Task::(_decref) Task=`0c06bd5f-1ec5-4505-87bc-a863489bba5f`::ref 1 aborting False >Thread-34::INFO::2014-07-10 09:38:58,647::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532067385344', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:38:58,655::task::1185::TaskManager.Task::(prepare) Task=`0c06bd5f-1ec5-4505-87bc-a863489bba5f`::finished: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532067385344', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:38:58,665::task::595::TaskManager.Task::(_updateState) Task=`0c06bd5f-1ec5-4505-87bc-a863489bba5f`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-10 09:38:58,671::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee': < ResourceRef 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-10 09:38:58,677::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-10 09:38:58,690::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' >Thread-34::DEBUG::2014-07-10 09:38:58,700::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' (0 active users) >Thread-34::DEBUG::2014-07-10 09:38:58,707::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-10 09:38:58,717::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', Clearing records. >Thread-34::DEBUG::2014-07-10 09:38:58,727::task::990::TaskManager.Task::(_decref) Task=`0c06bd5f-1ec5-4505-87bc-a863489bba5f`::ref 0 aborting False >Thread-64::DEBUG::2014-07-10 09:38:59,172::task::595::TaskManager.Task::(_updateState) Task=`a9fbeae4-a889-4c63-8fb3-426d5ac4ccb1`::moving from state init -> state preparing >Thread-64::INFO::2014-07-10 09:38:59,173::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='aa20346a-4d3a-4e07-b8e1-52c0ebe4168c', volUUID='58fefce2-9bce-4bff-8949-8c6ce8122b27', options=None) >Thread-64::INFO::2014-07-10 09:38:59,173::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-64::DEBUG::2014-07-10 09:38:59,173::task::1185::TaskManager.Task::(prepare) Task=`a9fbeae4-a889-4c63-8fb3-426d5ac4ccb1`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-64::DEBUG::2014-07-10 09:38:59,174::task::595::TaskManager.Task::(_updateState) Task=`a9fbeae4-a889-4c63-8fb3-426d5ac4ccb1`::moving from state preparing -> state finished >Thread-64::DEBUG::2014-07-10 09:38:59,174::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-64::DEBUG::2014-07-10 09:38:59,174::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-64::DEBUG::2014-07-10 09:38:59,174::task::990::TaskManager.Task::(_decref) Task=`a9fbeae4-a889-4c63-8fb3-426d5ac4ccb1`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 09:38:59,754::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:38:59,847::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0353691 s, 29.0 MB/s\n'; <rc> = 0 >Thread-54::DEBUG::2014-07-10 09:39:01,632::task::595::TaskManager.Task::(_updateState) Task=`aed74a60-e1ed-4313-a724-1a0b041afea1`::moving from state init -> state preparing >Thread-73::DEBUG::2014-07-10 09:39:01,635::task::595::TaskManager.Task::(_updateState) Task=`8a29ae8a-6781-46d0-81a8-6959bcf02c7e`::moving from state init -> state preparing >Thread-54::INFO::2014-07-10 09:39:01,637::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='28408446-e5fd-4565-a976-e760951593fe', volUUID='776303a2-5585-451e-826e-0e338d4a1e98', options=None) >Thread-73::INFO::2014-07-10 09:39:01,641::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='c01d693b-cba0-4fed-9ad7-0aaa28912a19', volUUID='4bb5d954-2a50-4028-b299-0b43c261270c', options=None) >Thread-54::INFO::2014-07-10 09:39:01,643::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-73::INFO::2014-07-10 09:39:01,645::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-54::DEBUG::2014-07-10 09:39:01,646::task::1185::TaskManager.Task::(prepare) Task=`aed74a60-e1ed-4313-a724-1a0b041afea1`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-73::DEBUG::2014-07-10 09:39:01,648::task::1185::TaskManager.Task::(prepare) Task=`8a29ae8a-6781-46d0-81a8-6959bcf02c7e`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-54::DEBUG::2014-07-10 09:39:01,650::task::595::TaskManager.Task::(_updateState) Task=`aed74a60-e1ed-4313-a724-1a0b041afea1`::moving from state preparing -> state finished >Thread-73::DEBUG::2014-07-10 09:39:01,651::task::595::TaskManager.Task::(_updateState) Task=`8a29ae8a-6781-46d0-81a8-6959bcf02c7e`::moving from state preparing -> state finished >Thread-54::DEBUG::2014-07-10 09:39:01,654::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-73::DEBUG::2014-07-10 09:39:01,654::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-54::DEBUG::2014-07-10 09:39:01,657::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-73::DEBUG::2014-07-10 09:39:01,658::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-54::DEBUG::2014-07-10 09:39:01,660::task::990::TaskManager.Task::(_decref) Task=`aed74a60-e1ed-4313-a724-1a0b041afea1`::ref 0 aborting False >Thread-73::DEBUG::2014-07-10 09:39:01,661::task::990::TaskManager.Task::(_decref) Task=`8a29ae8a-6781-46d0-81a8-6959bcf02c7e`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 09:39:01,863::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:39:01,957::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.035219 s, 29.1 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:39:03,972::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:39:04,059::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0299016 s, 34.2 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-10 09:39:04,963::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/metadata bs=4096 count=1' (cwd None) >Thread-14::DEBUG::2014-07-10 09:39:05,006::task::595::TaskManager.Task::(_updateState) Task=`a3f5bbe1-9299-4475-9715-dbdfc8df4940`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 09:39:05,009::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::INFO::2014-07-10 09:39:05,017::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00694353', 'lastCheck': '10.1', 'valid': True}, '6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000522622', 'lastCheck': '10.0', 'valid': True}} >Thread-14::DEBUG::2014-07-10 09:39:05,023::task::1185::TaskManager.Task::(prepare) Task=`a3f5bbe1-9299-4475-9715-dbdfc8df4940`::finished: {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00694353', 'lastCheck': '10.1', 'valid': True}, '6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000522622', 'lastCheck': '10.0', 'valid': True}} >Thread-14::DEBUG::2014-07-10 09:39:05,027::task::595::TaskManager.Task::(_updateState) Task=`a3f5bbe1-9299-4475-9715-dbdfc8df4940`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 09:39:05,032::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 09:39:05,038::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 09:39:05,039::task::990::TaskManager.Task::(_decref) Task=`a3f5bbe1-9299-4475-9715-dbdfc8df4940`::ref 0 aborting False >Thread-18::DEBUG::2014-07-10 09:39:05,052::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00835281 s, 490 kB/s\n'; <rc> = 0 >Thread-40::DEBUG::2014-07-10 09:39:05,115::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lion.qa.lab.tlv.redhat.com:_export_yuri2_backup2/6a70504d-00df-4869-8695-0f442053f6b6/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-40::DEBUG::2014-07-10 09:39:05,166::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n369 bytes (369 B) copied, 0.000368742 s, 1.0 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:39:06,075::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:39:06,172::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0378044 s, 27.1 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:39:08,187::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:39:08,276::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0311854 s, 32.8 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 09:39:08,776::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-14::DEBUG::2014-07-10 09:39:08,781::task::595::TaskManager.Task::(_updateState) Task=`b988e91f-733f-4809-a5b4-2a2200d421bc`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 09:39:08,784::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-14::INFO::2014-07-10 09:39:08,788::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:39:08,789::task::1185::TaskManager.Task::(prepare) Task=`b988e91f-733f-4809-a5b4-2a2200d421bc`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:39:08,791::task::595::TaskManager.Task::(_updateState) Task=`b988e91f-733f-4809-a5b4-2a2200d421bc`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 09:39:08,793::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 09:39:08,795::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 09:39:08,797::task::990::TaskManager.Task::(_decref) Task=`b988e91f-733f-4809-a5b4-2a2200d421bc`::ref 0 aborting False >Thread-34::DEBUG::2014-07-10 09:39:08,813::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-34::DEBUG::2014-07-10 09:39:08,825::task::595::TaskManager.Task::(_updateState) Task=`1c03b9ca-7d79-40c6-ac1b-429bab4605bc`::moving from state init -> state preparing >Thread-34::INFO::2014-07-10 09:39:08,833::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-34::DEBUG::2014-07-10 09:39:08,851::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`0514eb5b-328f-4ca3-b22d-da968a77b623`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-10 09:39:08,857::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' for lock type 'shared' >Thread-34::DEBUG::2014-07-10 09:39:08,867::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-10 09:39:08,873::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`0514eb5b-328f-4ca3-b22d-da968a77b623`::Granted request >Thread-34::DEBUG::2014-07-10 09:39:08,889::task::827::TaskManager.Task::(resourceAcquired) Task=`1c03b9ca-7d79-40c6-ac1b-429bab4605bc`::_resourcesAcquired: Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee (shared) >Thread-34::DEBUG::2014-07-10 09:39:08,896::task::990::TaskManager.Task::(_decref) Task=`1c03b9ca-7d79-40c6-ac1b-429bab4605bc`::ref 1 aborting False >Thread-34::INFO::2014-07-10 09:39:08,928::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532067385344', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:39:08,935::task::1185::TaskManager.Task::(prepare) Task=`1c03b9ca-7d79-40c6-ac1b-429bab4605bc`::finished: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532067385344', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:39:08,939::task::595::TaskManager.Task::(_updateState) Task=`1c03b9ca-7d79-40c6-ac1b-429bab4605bc`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-10 09:39:08,942::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee': < ResourceRef 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-10 09:39:08,946::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-10 09:39:08,951::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' >Thread-34::DEBUG::2014-07-10 09:39:08,960::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' (0 active users) >Thread-34::DEBUG::2014-07-10 09:39:08,966::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-10 09:39:08,972::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', Clearing records. >Thread-34::DEBUG::2014-07-10 09:39:08,983::task::990::TaskManager.Task::(_decref) Task=`1c03b9ca-7d79-40c6-ac1b-429bab4605bc`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 09:39:10,318::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:39:10,413::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0365929 s, 28.0 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:39:12,429::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:39:12,537::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0275824 s, 37.1 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:39:14,553::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:39:14,644::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0342558 s, 29.9 MB/s\n'; <rc> = 0 >Thread-40::DEBUG::2014-07-10 09:39:15,221::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lion.qa.lab.tlv.redhat.com:_export_yuri2_backup2/6a70504d-00df-4869-8695-0f442053f6b6/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-40::DEBUG::2014-07-10 09:39:15,242::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n369 bytes (369 B) copied, 0.000546396 s, 675 kB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-10 09:39:15,286::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/metadata bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-10 09:39:15,308::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000600245 s, 6.8 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:39:16,670::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:39:16,801::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0661665 s, 15.5 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:39:18,817::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:39:18,904::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0298968 s, 34.3 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 09:39:19,024::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-14::DEBUG::2014-07-10 09:39:19,025::task::595::TaskManager.Task::(_updateState) Task=`e5cd0844-ff75-4540-be4d-ffeeb7fad7ee`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 09:39:19,025::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-14::INFO::2014-07-10 09:39:19,026::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:39:19,026::task::1185::TaskManager.Task::(prepare) Task=`e5cd0844-ff75-4540-be4d-ffeeb7fad7ee`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:39:19,026::task::595::TaskManager.Task::(_updateState) Task=`e5cd0844-ff75-4540-be4d-ffeeb7fad7ee`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 09:39:19,027::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 09:39:19,027::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 09:39:19,027::task::990::TaskManager.Task::(_decref) Task=`e5cd0844-ff75-4540-be4d-ffeeb7fad7ee`::ref 0 aborting False >Thread-34::DEBUG::2014-07-10 09:39:19,031::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-34::DEBUG::2014-07-10 09:39:19,032::task::595::TaskManager.Task::(_updateState) Task=`1dc27efa-35b6-4590-9e48-f225fe3ff6d9`::moving from state init -> state preparing >Thread-34::INFO::2014-07-10 09:39:19,032::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-34::DEBUG::2014-07-10 09:39:19,033::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`f7762777-679e-4531-8d1e-fc39155ca5eb`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-10 09:39:19,033::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' for lock type 'shared' >Thread-34::DEBUG::2014-07-10 09:39:19,033::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-10 09:39:19,034::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`f7762777-679e-4531-8d1e-fc39155ca5eb`::Granted request >Thread-34::DEBUG::2014-07-10 09:39:19,034::task::827::TaskManager.Task::(resourceAcquired) Task=`1dc27efa-35b6-4590-9e48-f225fe3ff6d9`::_resourcesAcquired: Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee (shared) >Thread-34::DEBUG::2014-07-10 09:39:19,034::task::990::TaskManager.Task::(_decref) Task=`1dc27efa-35b6-4590-9e48-f225fe3ff6d9`::ref 1 aborting False >Thread-34::INFO::2014-07-10 09:39:19,036::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532067385344', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:39:19,036::task::1185::TaskManager.Task::(prepare) Task=`1dc27efa-35b6-4590-9e48-f225fe3ff6d9`::finished: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532067385344', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:39:19,036::task::595::TaskManager.Task::(_updateState) Task=`1dc27efa-35b6-4590-9e48-f225fe3ff6d9`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-10 09:39:19,036::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee': < ResourceRef 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-10 09:39:19,036::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-10 09:39:19,037::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' >Thread-34::DEBUG::2014-07-10 09:39:19,037::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' (0 active users) >Thread-34::DEBUG::2014-07-10 09:39:19,037::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-10 09:39:19,037::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', Clearing records. >Thread-34::DEBUG::2014-07-10 09:39:19,037::task::990::TaskManager.Task::(_decref) Task=`1dc27efa-35b6-4590-9e48-f225fe3ff6d9`::ref 0 aborting False >Thread-57::DEBUG::2014-07-10 09:39:19,650::task::595::TaskManager.Task::(_updateState) Task=`912bee62-c59a-41ba-8ee3-c27d3f624aaa`::moving from state init -> state preparing >Thread-57::INFO::2014-07-10 09:39:19,651::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='b6f6c0da-e67f-4902-b9ac-3069571a42fe', volUUID='c4cd1da8-05b7-45e0-80b1-1183d21443d9', options=None) >Thread-57::INFO::2014-07-10 09:39:19,652::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-57::DEBUG::2014-07-10 09:39:19,652::task::1185::TaskManager.Task::(prepare) Task=`912bee62-c59a-41ba-8ee3-c27d3f624aaa`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-57::DEBUG::2014-07-10 09:39:19,652::task::595::TaskManager.Task::(_updateState) Task=`912bee62-c59a-41ba-8ee3-c27d3f624aaa`::moving from state preparing -> state finished >Thread-57::DEBUG::2014-07-10 09:39:19,652::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-57::DEBUG::2014-07-10 09:39:19,652::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-57::DEBUG::2014-07-10 09:39:19,653::task::990::TaskManager.Task::(_decref) Task=`912bee62-c59a-41ba-8ee3-c27d3f624aaa`::ref 0 aborting False >Thread-67::DEBUG::2014-07-10 09:39:20,255::task::595::TaskManager.Task::(_updateState) Task=`2ad8045c-9585-4518-b1d2-ba918cff80c0`::moving from state init -> state preparing >Thread-67::INFO::2014-07-10 09:39:20,256::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='f30c2cb7-a43a-4bf5-82b5-cfe07336f65c', volUUID='b0fbb3c9-55af-4a3a-95ad-fc56a80b9cf5', options=None) >Thread-67::INFO::2014-07-10 09:39:20,257::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-67::DEBUG::2014-07-10 09:39:20,257::task::1185::TaskManager.Task::(prepare) Task=`2ad8045c-9585-4518-b1d2-ba918cff80c0`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-67::DEBUG::2014-07-10 09:39:20,257::task::595::TaskManager.Task::(_updateState) Task=`2ad8045c-9585-4518-b1d2-ba918cff80c0`::moving from state preparing -> state finished >Thread-67::DEBUG::2014-07-10 09:39:20,257::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-67::DEBUG::2014-07-10 09:39:20,257::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-67::DEBUG::2014-07-10 09:39:20,258::task::990::TaskManager.Task::(_decref) Task=`2ad8045c-9585-4518-b1d2-ba918cff80c0`::ref 0 aborting False >Thread-14::DEBUG::2014-07-10 09:39:20,448::task::595::TaskManager.Task::(_updateState) Task=`dca5a4dd-f2b0-4a0c-9994-e21faafd1e6f`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 09:39:20,449::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::INFO::2014-07-10 09:39:20,449::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000600245', 'lastCheck': '5.1', 'valid': True}, '6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000546396', 'lastCheck': '5.2', 'valid': True}} >Thread-14::DEBUG::2014-07-10 09:39:20,450::task::1185::TaskManager.Task::(prepare) Task=`dca5a4dd-f2b0-4a0c-9994-e21faafd1e6f`::finished: {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000600245', 'lastCheck': '5.1', 'valid': True}, '6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000546396', 'lastCheck': '5.2', 'valid': True}} >Thread-14::DEBUG::2014-07-10 09:39:20,450::task::595::TaskManager.Task::(_updateState) Task=`dca5a4dd-f2b0-4a0c-9994-e21faafd1e6f`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 09:39:20,450::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 09:39:20,450::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 09:39:20,450::task::990::TaskManager.Task::(_decref) Task=`dca5a4dd-f2b0-4a0c-9994-e21faafd1e6f`::ref 0 aborting False >Thread-48::DEBUG::2014-07-10 09:39:20,808::task::595::TaskManager.Task::(_updateState) Task=`f0926e5c-ac3b-4ac7-9173-07c44b993378`::moving from state init -> state preparing >Thread-48::INFO::2014-07-10 09:39:20,808::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='0cd7d6ce-f497-4243-a690-c57744861eea', volUUID='10b6a7dd-dc6c-43fa-ba17-92e4331b0e0b', options=None) >Thread-48::INFO::2014-07-10 09:39:20,809::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-48::DEBUG::2014-07-10 09:39:20,809::task::1185::TaskManager.Task::(prepare) Task=`f0926e5c-ac3b-4ac7-9173-07c44b993378`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-48::DEBUG::2014-07-10 09:39:20,809::task::595::TaskManager.Task::(_updateState) Task=`f0926e5c-ac3b-4ac7-9173-07c44b993378`::moving from state preparing -> state finished >Thread-48::DEBUG::2014-07-10 09:39:20,809::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-48::DEBUG::2014-07-10 09:39:20,810::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-48::DEBUG::2014-07-10 09:39:20,810::task::990::TaskManager.Task::(_decref) Task=`f0926e5c-ac3b-4ac7-9173-07c44b993378`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 09:39:20,919::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:39:21,012::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.033276 s, 30.8 MB/s\n'; <rc> = 0 >Thread-76::DEBUG::2014-07-10 09:39:22,181::task::595::TaskManager.Task::(_updateState) Task=`a04e6988-de54-4102-9caa-4d12facbfb2e`::moving from state init -> state preparing >Thread-76::INFO::2014-07-10 09:39:22,181::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='e4c65229-4247-4b33-b72a-f1d5ce72ad05', volUUID='cad94284-3ca9-4c30-933d-997f4460309e', options=None) >Thread-76::INFO::2014-07-10 09:39:22,182::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-76::DEBUG::2014-07-10 09:39:22,182::task::1185::TaskManager.Task::(prepare) Task=`a04e6988-de54-4102-9caa-4d12facbfb2e`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-76::DEBUG::2014-07-10 09:39:22,182::task::595::TaskManager.Task::(_updateState) Task=`a04e6988-de54-4102-9caa-4d12facbfb2e`::moving from state preparing -> state finished >Thread-76::DEBUG::2014-07-10 09:39:22,182::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-76::DEBUG::2014-07-10 09:39:22,182::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-76::DEBUG::2014-07-10 09:39:22,183::task::990::TaskManager.Task::(_decref) Task=`a04e6988-de54-4102-9caa-4d12facbfb2e`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 09:39:23,027::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:39:23,121::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0365904 s, 28.0 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:39:25,137::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Thread-18::DEBUG::2014-07-10 09:39:25,373::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/metadata bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-10 09:39:25,560::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000780843 s, 5.2 MB/s\n'; <rc> = 0 >Thread-40::DEBUG::2014-07-10 09:39:26,098::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lion.qa.lab.tlv.redhat.com:_export_yuri2_backup2/6a70504d-00df-4869-8695-0f442053f6b6/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-40::DEBUG::2014-07-10 09:39:26,195::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n369 bytes (369 B) copied, 0.0004641 s, 795 kB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:39:26,206::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0361396 s, 28.3 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:39:28,256::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:39:28,400::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0442548 s, 23.1 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 09:39:29,074::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-14::DEBUG::2014-07-10 09:39:29,075::task::595::TaskManager.Task::(_updateState) Task=`944f5dbe-57c5-43e1-a4a3-01b847a6ecc9`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 09:39:29,075::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-14::INFO::2014-07-10 09:39:29,076::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:39:29,076::task::1185::TaskManager.Task::(prepare) Task=`944f5dbe-57c5-43e1-a4a3-01b847a6ecc9`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:39:29,076::task::595::TaskManager.Task::(_updateState) Task=`944f5dbe-57c5-43e1-a4a3-01b847a6ecc9`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 09:39:29,076::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 09:39:29,076::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 09:39:29,077::task::990::TaskManager.Task::(_decref) Task=`944f5dbe-57c5-43e1-a4a3-01b847a6ecc9`::ref 0 aborting False >Thread-34::DEBUG::2014-07-10 09:39:29,081::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-34::DEBUG::2014-07-10 09:39:29,082::task::595::TaskManager.Task::(_updateState) Task=`729d5773-09be-48e2-80ae-5da94395137b`::moving from state init -> state preparing >Thread-34::INFO::2014-07-10 09:39:29,082::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-34::DEBUG::2014-07-10 09:39:29,083::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`d371f1fe-cfe9-4cb9-ad19-9c79daeef122`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-10 09:39:29,083::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' for lock type 'shared' >Thread-34::DEBUG::2014-07-10 09:39:29,083::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-10 09:39:29,083::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`d371f1fe-cfe9-4cb9-ad19-9c79daeef122`::Granted request >Thread-34::DEBUG::2014-07-10 09:39:29,084::task::827::TaskManager.Task::(resourceAcquired) Task=`729d5773-09be-48e2-80ae-5da94395137b`::_resourcesAcquired: Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee (shared) >Thread-34::DEBUG::2014-07-10 09:39:29,084::task::990::TaskManager.Task::(_decref) Task=`729d5773-09be-48e2-80ae-5da94395137b`::ref 1 aborting False >Thread-34::INFO::2014-07-10 09:39:29,085::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532067385344', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:39:29,085::task::1185::TaskManager.Task::(prepare) Task=`729d5773-09be-48e2-80ae-5da94395137b`::finished: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532067385344', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:39:29,086::task::595::TaskManager.Task::(_updateState) Task=`729d5773-09be-48e2-80ae-5da94395137b`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-10 09:39:29,086::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee': < ResourceRef 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-10 09:39:29,086::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-10 09:39:29,086::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' >Thread-34::DEBUG::2014-07-10 09:39:29,086::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' (0 active users) >Thread-34::DEBUG::2014-07-10 09:39:29,086::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-10 09:39:29,087::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', Clearing records. >Thread-34::DEBUG::2014-07-10 09:39:29,087::task::990::TaskManager.Task::(_decref) Task=`729d5773-09be-48e2-80ae-5da94395137b`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 09:39:30,416::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:39:30,512::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0358611 s, 28.6 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:39:32,527::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:39:32,660::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0571404 s, 17.9 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:39:34,676::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:39:34,940::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.204772 s, 5.0 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 09:39:35,652::task::595::TaskManager.Task::(_updateState) Task=`927ea758-a12a-4a3b-868a-3706ebbda445`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 09:39:35,653::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::INFO::2014-07-10 09:39:35,654::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000780843', 'lastCheck': '9.4', 'valid': True}, '6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.0004641', 'lastCheck': '9.4', 'valid': True}} >Thread-14::DEBUG::2014-07-10 09:39:35,654::task::1185::TaskManager.Task::(prepare) Task=`927ea758-a12a-4a3b-868a-3706ebbda445`::finished: {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000780843', 'lastCheck': '9.4', 'valid': True}, '6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.0004641', 'lastCheck': '9.4', 'valid': True}} >Thread-14::DEBUG::2014-07-10 09:39:35,654::task::595::TaskManager.Task::(_updateState) Task=`927ea758-a12a-4a3b-868a-3706ebbda445`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 09:39:35,654::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 09:39:35,654::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 09:39:35,655::task::990::TaskManager.Task::(_decref) Task=`927ea758-a12a-4a3b-868a-3706ebbda445`::ref 0 aborting False >Thread-18::DEBUG::2014-07-10 09:39:36,247::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/metadata bs=4096 count=1' (cwd None) >Thread-40::DEBUG::2014-07-10 09:39:36,288::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lion.qa.lab.tlv.redhat.com:_export_yuri2_backup2/6a70504d-00df-4869-8695-0f442053f6b6/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-40::DEBUG::2014-07-10 09:39:36,345::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n369 bytes (369 B) copied, 0.000486397 s, 759 kB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-10 09:39:36,353::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.0117591 s, 348 kB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:39:36,970::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:39:37,139::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.102331 s, 10.0 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:39:39,153::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Thread-14::DEBUG::2014-07-10 09:39:39,173::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-14::DEBUG::2014-07-10 09:39:39,174::task::595::TaskManager.Task::(_updateState) Task=`c89233ca-2660-4100-ace4-68203bb73d3b`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 09:39:39,175::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-14::INFO::2014-07-10 09:39:39,175::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:39:39,175::task::1185::TaskManager.Task::(prepare) Task=`c89233ca-2660-4100-ace4-68203bb73d3b`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:39:39,176::task::595::TaskManager.Task::(_updateState) Task=`c89233ca-2660-4100-ace4-68203bb73d3b`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 09:39:39,176::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 09:39:39,176::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 09:39:39,176::task::990::TaskManager.Task::(_decref) Task=`c89233ca-2660-4100-ace4-68203bb73d3b`::ref 0 aborting False >Thread-34::DEBUG::2014-07-10 09:39:39,180::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-34::DEBUG::2014-07-10 09:39:39,181::task::595::TaskManager.Task::(_updateState) Task=`84b4ee14-695a-4fe4-9b7b-92da9483fadc`::moving from state init -> state preparing >Thread-34::INFO::2014-07-10 09:39:39,181::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-34::DEBUG::2014-07-10 09:39:39,181::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`6e56e61b-66c0-451c-9f54-7987e28ed3d4`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-10 09:39:39,182::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' for lock type 'shared' >Thread-34::DEBUG::2014-07-10 09:39:39,182::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-10 09:39:39,182::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`6e56e61b-66c0-451c-9f54-7987e28ed3d4`::Granted request >Thread-34::DEBUG::2014-07-10 09:39:39,183::task::827::TaskManager.Task::(resourceAcquired) Task=`84b4ee14-695a-4fe4-9b7b-92da9483fadc`::_resourcesAcquired: Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee (shared) >Thread-34::DEBUG::2014-07-10 09:39:39,183::task::990::TaskManager.Task::(_decref) Task=`84b4ee14-695a-4fe4-9b7b-92da9483fadc`::ref 1 aborting False >Thread-34::INFO::2014-07-10 09:39:39,184::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532067385344', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:39:39,184::task::1185::TaskManager.Task::(prepare) Task=`84b4ee14-695a-4fe4-9b7b-92da9483fadc`::finished: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532067385344', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:39:39,184::task::595::TaskManager.Task::(_updateState) Task=`84b4ee14-695a-4fe4-9b7b-92da9483fadc`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-10 09:39:39,184::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee': < ResourceRef 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-10 09:39:39,185::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-10 09:39:39,185::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' >Thread-34::DEBUG::2014-07-10 09:39:39,185::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' (0 active users) >Thread-34::DEBUG::2014-07-10 09:39:39,185::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-10 09:39:39,185::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', Clearing records. >Thread-34::DEBUG::2014-07-10 09:39:39,186::task::990::TaskManager.Task::(_decref) Task=`84b4ee14-695a-4fe4-9b7b-92da9483fadc`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 09:39:39,261::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0500979 s, 20.4 MB/s\n'; <rc> = 0 >Thread-70::DEBUG::2014-07-10 09:39:39,376::task::595::TaskManager.Task::(_updateState) Task=`eb19ee5d-9786-4357-97bb-d725afffb6be`::moving from state init -> state preparing >Thread-70::INFO::2014-07-10 09:39:39,380::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='cfaeead2-7caa-467c-b389-c89840ae6605', volUUID='567fe32d-31a6-4ff6-90f3-fd6a656fbecc', options=None) >Thread-70::INFO::2014-07-10 09:39:39,383::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-70::DEBUG::2014-07-10 09:39:39,384::task::1185::TaskManager.Task::(prepare) Task=`eb19ee5d-9786-4357-97bb-d725afffb6be`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-70::DEBUG::2014-07-10 09:39:39,386::task::595::TaskManager.Task::(_updateState) Task=`eb19ee5d-9786-4357-97bb-d725afffb6be`::moving from state preparing -> state finished >Thread-70::DEBUG::2014-07-10 09:39:39,388::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-70::DEBUG::2014-07-10 09:39:39,391::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-70::DEBUG::2014-07-10 09:39:39,393::task::990::TaskManager.Task::(_decref) Task=`eb19ee5d-9786-4357-97bb-d725afffb6be`::ref 0 aborting False >Thread-51::DEBUG::2014-07-10 09:39:40,423::task::595::TaskManager.Task::(_updateState) Task=`efec48b4-ba03-42e1-b930-df6c896a7ea1`::moving from state init -> state preparing >Thread-51::INFO::2014-07-10 09:39:40,424::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='76fdb054-02cd-42ed-9721-b3e65b34c3a4', volUUID='022dfe46-2cf7-4915-80b3-883158e3ca83', options=None) >Thread-60::DEBUG::2014-07-10 09:39:40,425::task::595::TaskManager.Task::(_updateState) Task=`c15fdc83-3ea0-4cc7-bc79-31b418062680`::moving from state init -> state preparing >Thread-51::INFO::2014-07-10 09:39:40,426::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-60::INFO::2014-07-10 09:39:40,427::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='b034d5b0-e1e0-4011-b49b-4d45ddb11556', volUUID='3d7f62b5-328f-4d8e-8b69-873cfb5ae14d', options=None) >Thread-51::DEBUG::2014-07-10 09:39:40,427::task::1185::TaskManager.Task::(prepare) Task=`efec48b4-ba03-42e1-b930-df6c896a7ea1`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-51::DEBUG::2014-07-10 09:39:40,428::task::595::TaskManager.Task::(_updateState) Task=`efec48b4-ba03-42e1-b930-df6c896a7ea1`::moving from state preparing -> state finished >Thread-60::INFO::2014-07-10 09:39:40,429::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-51::DEBUG::2014-07-10 09:39:40,429::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-60::DEBUG::2014-07-10 09:39:40,430::task::1185::TaskManager.Task::(prepare) Task=`c15fdc83-3ea0-4cc7-bc79-31b418062680`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-51::DEBUG::2014-07-10 09:39:40,430::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-60::DEBUG::2014-07-10 09:39:40,431::task::595::TaskManager.Task::(_updateState) Task=`c15fdc83-3ea0-4cc7-bc79-31b418062680`::moving from state preparing -> state finished >Thread-51::DEBUG::2014-07-10 09:39:40,432::task::990::TaskManager.Task::(_decref) Task=`efec48b4-ba03-42e1-b930-df6c896a7ea1`::ref 0 aborting False >Thread-60::DEBUG::2014-07-10 09:39:40,432::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-60::DEBUG::2014-07-10 09:39:40,433::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-60::DEBUG::2014-07-10 09:39:40,433::task::990::TaskManager.Task::(_decref) Task=`c15fdc83-3ea0-4cc7-bc79-31b418062680`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 09:39:41,278::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:39:41,364::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.028315 s, 36.2 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:39:43,379::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:39:43,487::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0386692 s, 26.5 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:39:45,502::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:39:45,694::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0415783 s, 24.6 MB/s\n'; <rc> = 0 >Thread-40::DEBUG::2014-07-10 09:39:46,388::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lion.qa.lab.tlv.redhat.com:_export_yuri2_backup2/6a70504d-00df-4869-8695-0f442053f6b6/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-10 09:39:46,416::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/metadata bs=4096 count=1' (cwd None) >Thread-40::DEBUG::2014-07-10 09:39:46,447::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n369 bytes (369 B) copied, 0.000403191 s, 915 kB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-10 09:39:46,463::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000794646 s, 5.2 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:39:47,710::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:39:47,798::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.030683 s, 33.4 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 09:39:49,215::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-14::DEBUG::2014-07-10 09:39:49,216::task::595::TaskManager.Task::(_updateState) Task=`1562fe64-4f72-4a7d-8808-d3eb3abb5332`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 09:39:49,217::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-14::INFO::2014-07-10 09:39:49,217::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:39:49,217::task::1185::TaskManager.Task::(prepare) Task=`1562fe64-4f72-4a7d-8808-d3eb3abb5332`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:39:49,217::task::595::TaskManager.Task::(_updateState) Task=`1562fe64-4f72-4a7d-8808-d3eb3abb5332`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 09:39:49,218::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 09:39:49,218::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 09:39:49,218::task::990::TaskManager.Task::(_decref) Task=`1562fe64-4f72-4a7d-8808-d3eb3abb5332`::ref 0 aborting False >Thread-34::DEBUG::2014-07-10 09:39:49,222::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-34::DEBUG::2014-07-10 09:39:49,223::task::595::TaskManager.Task::(_updateState) Task=`57a7d446-7d62-459e-985f-1c771b0637a8`::moving from state init -> state preparing >Thread-34::INFO::2014-07-10 09:39:49,223::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-34::DEBUG::2014-07-10 09:39:49,223::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`85daf560-9b6f-4e8b-bdca-7db0380a8c6d`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-10 09:39:49,224::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' for lock type 'shared' >Thread-34::DEBUG::2014-07-10 09:39:49,224::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-10 09:39:49,224::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`85daf560-9b6f-4e8b-bdca-7db0380a8c6d`::Granted request >Thread-34::DEBUG::2014-07-10 09:39:49,225::task::827::TaskManager.Task::(resourceAcquired) Task=`57a7d446-7d62-459e-985f-1c771b0637a8`::_resourcesAcquired: Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee (shared) >Thread-34::DEBUG::2014-07-10 09:39:49,225::task::990::TaskManager.Task::(_decref) Task=`57a7d446-7d62-459e-985f-1c771b0637a8`::ref 1 aborting False >Thread-34::INFO::2014-07-10 09:39:49,226::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532067385344', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:39:49,226::task::1185::TaskManager.Task::(prepare) Task=`57a7d446-7d62-459e-985f-1c771b0637a8`::finished: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532067385344', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:39:49,227::task::595::TaskManager.Task::(_updateState) Task=`57a7d446-7d62-459e-985f-1c771b0637a8`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-10 09:39:49,227::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee': < ResourceRef 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-10 09:39:49,227::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-10 09:39:49,227::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' >Thread-34::DEBUG::2014-07-10 09:39:49,227::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' (0 active users) >Thread-34::DEBUG::2014-07-10 09:39:49,228::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-10 09:39:49,228::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', Clearing records. >Thread-34::DEBUG::2014-07-10 09:39:49,228::task::990::TaskManager.Task::(_decref) Task=`57a7d446-7d62-459e-985f-1c771b0637a8`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 09:39:49,816::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:39:49,924::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0452386 s, 22.6 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 09:39:50,859::task::595::TaskManager.Task::(_updateState) Task=`00d12b72-b4c8-40f1-a1e1-e463f795e76b`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 09:39:50,860::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::INFO::2014-07-10 09:39:50,860::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000794646', 'lastCheck': '4.4', 'valid': True}, '6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000403191', 'lastCheck': '4.4', 'valid': True}} >Thread-14::DEBUG::2014-07-10 09:39:50,860::task::1185::TaskManager.Task::(prepare) Task=`00d12b72-b4c8-40f1-a1e1-e463f795e76b`::finished: {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000794646', 'lastCheck': '4.4', 'valid': True}, '6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000403191', 'lastCheck': '4.4', 'valid': True}} >Thread-14::DEBUG::2014-07-10 09:39:50,860::task::595::TaskManager.Task::(_updateState) Task=`00d12b72-b4c8-40f1-a1e1-e463f795e76b`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 09:39:50,861::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 09:39:50,861::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 09:39:50,861::task::990::TaskManager.Task::(_decref) Task=`00d12b72-b4c8-40f1-a1e1-e463f795e76b`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 09:39:51,939::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:39:52,034::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.035728 s, 28.7 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:39:54,050::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:39:54,137::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0276817 s, 37.0 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:39:56,153::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:39:56,269::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0584651 s, 17.5 MB/s\n'; <rc> = 0 >Thread-40::DEBUG::2014-07-10 09:39:56,490::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lion.qa.lab.tlv.redhat.com:_export_yuri2_backup2/6a70504d-00df-4869-8695-0f442053f6b6/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-10 09:39:56,524::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/metadata bs=4096 count=1' (cwd None) >Thread-40::DEBUG::2014-07-10 09:39:56,593::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n369 bytes (369 B) copied, 0.000469726 s, 786 kB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-10 09:39:56,621::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000543204 s, 7.5 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:39:58,282::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:39:58,379::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0357933 s, 28.6 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 09:39:59,257::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-14::DEBUG::2014-07-10 09:39:59,258::task::595::TaskManager.Task::(_updateState) Task=`45adabbd-c4d4-445c-afec-06c8ca1c5a50`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 09:39:59,258::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-14::INFO::2014-07-10 09:39:59,258::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:39:59,259::task::1185::TaskManager.Task::(prepare) Task=`45adabbd-c4d4-445c-afec-06c8ca1c5a50`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:39:59,259::task::595::TaskManager.Task::(_updateState) Task=`45adabbd-c4d4-445c-afec-06c8ca1c5a50`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 09:39:59,259::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 09:39:59,259::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 09:39:59,259::task::990::TaskManager.Task::(_decref) Task=`45adabbd-c4d4-445c-afec-06c8ca1c5a50`::ref 0 aborting False >Thread-34::DEBUG::2014-07-10 09:39:59,264::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-34::DEBUG::2014-07-10 09:39:59,265::task::595::TaskManager.Task::(_updateState) Task=`b2eba4fd-8ffe-4310-a78e-ede11fa505d6`::moving from state init -> state preparing >Thread-34::INFO::2014-07-10 09:39:59,265::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-34::DEBUG::2014-07-10 09:39:59,266::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`3306f52c-2f2a-4f74-acf5-948ee16dfe15`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-10 09:39:59,266::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' for lock type 'shared' >Thread-34::DEBUG::2014-07-10 09:39:59,266::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-10 09:39:59,266::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`3306f52c-2f2a-4f74-acf5-948ee16dfe15`::Granted request >Thread-34::DEBUG::2014-07-10 09:39:59,267::task::827::TaskManager.Task::(resourceAcquired) Task=`b2eba4fd-8ffe-4310-a78e-ede11fa505d6`::_resourcesAcquired: Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee (shared) >Thread-34::DEBUG::2014-07-10 09:39:59,267::task::990::TaskManager.Task::(_decref) Task=`b2eba4fd-8ffe-4310-a78e-ede11fa505d6`::ref 1 aborting False >Thread-34::INFO::2014-07-10 09:39:59,268::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532067385344', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:39:59,268::task::1185::TaskManager.Task::(prepare) Task=`b2eba4fd-8ffe-4310-a78e-ede11fa505d6`::finished: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532067385344', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:39:59,268::task::595::TaskManager.Task::(_updateState) Task=`b2eba4fd-8ffe-4310-a78e-ede11fa505d6`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-10 09:39:59,269::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee': < ResourceRef 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-10 09:39:59,269::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-10 09:39:59,269::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' >Thread-34::DEBUG::2014-07-10 09:39:59,269::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' (0 active users) >Thread-34::DEBUG::2014-07-10 09:39:59,269::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-10 09:39:59,269::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', Clearing records. >Thread-34::DEBUG::2014-07-10 09:39:59,270::task::990::TaskManager.Task::(_decref) Task=`b2eba4fd-8ffe-4310-a78e-ede11fa505d6`::ref 0 aborting False >Thread-64::DEBUG::2014-07-10 09:39:59,460::task::595::TaskManager.Task::(_updateState) Task=`9700ec4b-bd60-4c5b-9814-8f95ff073186`::moving from state init -> state preparing >Thread-64::INFO::2014-07-10 09:39:59,461::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='aa20346a-4d3a-4e07-b8e1-52c0ebe4168c', volUUID='58fefce2-9bce-4bff-8949-8c6ce8122b27', options=None) >Thread-64::INFO::2014-07-10 09:39:59,462::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-64::DEBUG::2014-07-10 09:39:59,462::task::1185::TaskManager.Task::(prepare) Task=`9700ec4b-bd60-4c5b-9814-8f95ff073186`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-64::DEBUG::2014-07-10 09:39:59,462::task::595::TaskManager.Task::(_updateState) Task=`9700ec4b-bd60-4c5b-9814-8f95ff073186`::moving from state preparing -> state finished >Thread-64::DEBUG::2014-07-10 09:39:59,462::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-64::DEBUG::2014-07-10 09:39:59,463::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-64::DEBUG::2014-07-10 09:39:59,463::task::990::TaskManager.Task::(_decref) Task=`9700ec4b-bd60-4c5b-9814-8f95ff073186`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 09:40:00,396::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:40:00,486::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0290009 s, 35.3 MB/s\n'; <rc> = 0 >Thread-54::DEBUG::2014-07-10 09:40:01,945::task::595::TaskManager.Task::(_updateState) Task=`e6ed6a05-0a6d-4cca-b5a8-f781c9356127`::moving from state init -> state preparing >Thread-73::DEBUG::2014-07-10 09:40:01,946::task::595::TaskManager.Task::(_updateState) Task=`e8da451b-4596-4d56-bc71-e5111d8308b2`::moving from state init -> state preparing >Thread-54::INFO::2014-07-10 09:40:01,948::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='28408446-e5fd-4565-a976-e760951593fe', volUUID='776303a2-5585-451e-826e-0e338d4a1e98', options=None) >Thread-73::INFO::2014-07-10 09:40:01,948::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='c01d693b-cba0-4fed-9ad7-0aaa28912a19', volUUID='4bb5d954-2a50-4028-b299-0b43c261270c', options=None) >Thread-54::INFO::2014-07-10 09:40:01,950::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-73::INFO::2014-07-10 09:40:01,950::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-54::DEBUG::2014-07-10 09:40:01,951::task::1185::TaskManager.Task::(prepare) Task=`e6ed6a05-0a6d-4cca-b5a8-f781c9356127`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-73::DEBUG::2014-07-10 09:40:01,951::task::1185::TaskManager.Task::(prepare) Task=`e8da451b-4596-4d56-bc71-e5111d8308b2`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-54::DEBUG::2014-07-10 09:40:01,952::task::595::TaskManager.Task::(_updateState) Task=`e6ed6a05-0a6d-4cca-b5a8-f781c9356127`::moving from state preparing -> state finished >Thread-73::DEBUG::2014-07-10 09:40:01,953::task::595::TaskManager.Task::(_updateState) Task=`e8da451b-4596-4d56-bc71-e5111d8308b2`::moving from state preparing -> state finished >Thread-54::DEBUG::2014-07-10 09:40:01,953::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-73::DEBUG::2014-07-10 09:40:01,954::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-54::DEBUG::2014-07-10 09:40:01,955::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-73::DEBUG::2014-07-10 09:40:01,955::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-54::DEBUG::2014-07-10 09:40:01,956::task::990::TaskManager.Task::(_decref) Task=`e6ed6a05-0a6d-4cca-b5a8-f781c9356127`::ref 0 aborting False >Thread-73::DEBUG::2014-07-10 09:40:01,957::task::990::TaskManager.Task::(_decref) Task=`e8da451b-4596-4d56-bc71-e5111d8308b2`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 09:40:02,502::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:40:02,623::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0346631 s, 29.5 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:40:04,638::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:40:04,732::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0353817 s, 28.9 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 09:40:06,031::task::595::TaskManager.Task::(_updateState) Task=`305ab5c4-87bc-466c-8160-71e862b51437`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 09:40:06,031::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::INFO::2014-07-10 09:40:06,032::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000543204', 'lastCheck': '9.4', 'valid': True}, '6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000469726', 'lastCheck': '9.4', 'valid': True}} >Thread-14::DEBUG::2014-07-10 09:40:06,032::task::1185::TaskManager.Task::(prepare) Task=`305ab5c4-87bc-466c-8160-71e862b51437`::finished: {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000543204', 'lastCheck': '9.4', 'valid': True}, '6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000469726', 'lastCheck': '9.4', 'valid': True}} >Thread-14::DEBUG::2014-07-10 09:40:06,032::task::595::TaskManager.Task::(_updateState) Task=`305ab5c4-87bc-466c-8160-71e862b51437`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 09:40:06,032::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 09:40:06,033::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 09:40:06,033::task::990::TaskManager.Task::(_decref) Task=`305ab5c4-87bc-466c-8160-71e862b51437`::ref 0 aborting False >Thread-18::DEBUG::2014-07-10 09:40:06,651::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/metadata bs=4096 count=1' (cwd None) >Thread-40::DEBUG::2014-07-10 09:40:06,721::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lion.qa.lab.tlv.redhat.com:_export_yuri2_backup2/6a70504d-00df-4869-8695-0f442053f6b6/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-10 09:40:06,742::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000709774 s, 5.8 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:40:06,765::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Thread-40::DEBUG::2014-07-10 09:40:06,799::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n369 bytes (369 B) copied, 0.000447756 s, 824 kB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:40:07,210::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.379019 s, 2.7 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:40:09,225::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:40:09,309::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0260165 s, 39.4 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 09:40:09,358::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-14::DEBUG::2014-07-10 09:40:09,359::task::595::TaskManager.Task::(_updateState) Task=`390a5148-48dc-4ebb-ae3a-7f6fa7b9dc04`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 09:40:09,359::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-14::INFO::2014-07-10 09:40:09,360::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:40:09,360::task::1185::TaskManager.Task::(prepare) Task=`390a5148-48dc-4ebb-ae3a-7f6fa7b9dc04`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:40:09,360::task::595::TaskManager.Task::(_updateState) Task=`390a5148-48dc-4ebb-ae3a-7f6fa7b9dc04`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 09:40:09,360::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 09:40:09,361::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 09:40:09,361::task::990::TaskManager.Task::(_decref) Task=`390a5148-48dc-4ebb-ae3a-7f6fa7b9dc04`::ref 0 aborting False >Thread-34::DEBUG::2014-07-10 09:40:09,365::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-34::DEBUG::2014-07-10 09:40:09,365::task::595::TaskManager.Task::(_updateState) Task=`15367d0d-4752-4b98-b5c4-ba57e3646d70`::moving from state init -> state preparing >Thread-34::INFO::2014-07-10 09:40:09,366::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-34::DEBUG::2014-07-10 09:40:09,366::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`77e4d5c2-e2da-4206-91fb-3cf7d6f7a327`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-10 09:40:09,367::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' for lock type 'shared' >Thread-34::DEBUG::2014-07-10 09:40:09,367::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-10 09:40:09,367::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`77e4d5c2-e2da-4206-91fb-3cf7d6f7a327`::Granted request >Thread-34::DEBUG::2014-07-10 09:40:09,368::task::827::TaskManager.Task::(resourceAcquired) Task=`15367d0d-4752-4b98-b5c4-ba57e3646d70`::_resourcesAcquired: Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee (shared) >Thread-34::DEBUG::2014-07-10 09:40:09,368::task::990::TaskManager.Task::(_decref) Task=`15367d0d-4752-4b98-b5c4-ba57e3646d70`::ref 1 aborting False >Thread-34::INFO::2014-07-10 09:40:09,369::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532067385344', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:40:09,369::task::1185::TaskManager.Task::(prepare) Task=`15367d0d-4752-4b98-b5c4-ba57e3646d70`::finished: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532067385344', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:40:09,370::task::595::TaskManager.Task::(_updateState) Task=`15367d0d-4752-4b98-b5c4-ba57e3646d70`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-10 09:40:09,370::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee': < ResourceRef 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-10 09:40:09,370::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-10 09:40:09,370::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' >Thread-34::DEBUG::2014-07-10 09:40:09,370::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' (0 active users) >Thread-34::DEBUG::2014-07-10 09:40:09,371::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-10 09:40:09,371::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', Clearing records. >Thread-34::DEBUG::2014-07-10 09:40:09,371::task::990::TaskManager.Task::(_decref) Task=`15367d0d-4752-4b98-b5c4-ba57e3646d70`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 09:40:11,324::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:40:11,410::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0286516 s, 35.7 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:40:13,426::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:40:13,549::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0666855 s, 15.4 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:40:15,564::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:40:15,652::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0298346 s, 34.3 MB/s\n'; <rc> = 0 >Thread-40::DEBUG::2014-07-10 09:40:16,871::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lion.qa.lab.tlv.redhat.com:_export_yuri2_backup2/6a70504d-00df-4869-8695-0f442053f6b6/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-40::DEBUG::2014-07-10 09:40:16,890::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n369 bytes (369 B) copied, 0.000455093 s, 811 kB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-10 09:40:17,146::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/metadata bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-10 09:40:17,183::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000853622 s, 4.8 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:40:17,668::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:40:17,762::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0358366 s, 28.6 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 09:40:19,398::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-14::DEBUG::2014-07-10 09:40:19,400::task::595::TaskManager.Task::(_updateState) Task=`6e3d7eab-e866-4ece-a12c-263de9b28823`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 09:40:19,400::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-14::INFO::2014-07-10 09:40:19,401::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:40:19,401::task::1185::TaskManager.Task::(prepare) Task=`6e3d7eab-e866-4ece-a12c-263de9b28823`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:40:19,401::task::595::TaskManager.Task::(_updateState) Task=`6e3d7eab-e866-4ece-a12c-263de9b28823`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 09:40:19,401::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 09:40:19,402::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 09:40:19,402::task::990::TaskManager.Task::(_decref) Task=`6e3d7eab-e866-4ece-a12c-263de9b28823`::ref 0 aborting False >Thread-34::DEBUG::2014-07-10 09:40:19,406::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-34::DEBUG::2014-07-10 09:40:19,407::task::595::TaskManager.Task::(_updateState) Task=`fbc3dbdf-e262-4229-93ec-cf2035af7b1e`::moving from state init -> state preparing >Thread-34::INFO::2014-07-10 09:40:19,407::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-34::DEBUG::2014-07-10 09:40:19,408::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`881dcc0f-824e-4b1c-a537-8a42c501f4b8`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-10 09:40:19,408::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' for lock type 'shared' >Thread-34::DEBUG::2014-07-10 09:40:19,408::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-10 09:40:19,409::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`881dcc0f-824e-4b1c-a537-8a42c501f4b8`::Granted request >Thread-34::DEBUG::2014-07-10 09:40:19,409::task::827::TaskManager.Task::(resourceAcquired) Task=`fbc3dbdf-e262-4229-93ec-cf2035af7b1e`::_resourcesAcquired: Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee (shared) >Thread-34::DEBUG::2014-07-10 09:40:19,409::task::990::TaskManager.Task::(_decref) Task=`fbc3dbdf-e262-4229-93ec-cf2035af7b1e`::ref 1 aborting False >Thread-34::INFO::2014-07-10 09:40:19,410::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532067385344', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:40:19,411::task::1185::TaskManager.Task::(prepare) Task=`fbc3dbdf-e262-4229-93ec-cf2035af7b1e`::finished: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532067385344', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:40:19,411::task::595::TaskManager.Task::(_updateState) Task=`fbc3dbdf-e262-4229-93ec-cf2035af7b1e`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-10 09:40:19,411::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee': < ResourceRef 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-10 09:40:19,411::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-10 09:40:19,412::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' >Thread-34::DEBUG::2014-07-10 09:40:19,412::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' (0 active users) >Thread-34::DEBUG::2014-07-10 09:40:19,412::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-10 09:40:19,412::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', Clearing records. >Thread-34::DEBUG::2014-07-10 09:40:19,412::task::990::TaskManager.Task::(_decref) Task=`fbc3dbdf-e262-4229-93ec-cf2035af7b1e`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 09:40:19,781::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Thread-57::DEBUG::2014-07-10 09:40:19,947::task::595::TaskManager.Task::(_updateState) Task=`e37dc10d-9a09-4fa0-a5d7-8d7b2423b88f`::moving from state init -> state preparing >Thread-57::INFO::2014-07-10 09:40:19,954::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='b6f6c0da-e67f-4902-b9ac-3069571a42fe', volUUID='c4cd1da8-05b7-45e0-80b1-1183d21443d9', options=None) >Thread-57::INFO::2014-07-10 09:40:19,966::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-57::DEBUG::2014-07-10 09:40:19,976::task::1185::TaskManager.Task::(prepare) Task=`e37dc10d-9a09-4fa0-a5d7-8d7b2423b88f`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-57::DEBUG::2014-07-10 09:40:19,984::task::595::TaskManager.Task::(_updateState) Task=`e37dc10d-9a09-4fa0-a5d7-8d7b2423b88f`::moving from state preparing -> state finished >Thread-57::DEBUG::2014-07-10 09:40:19,992::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-57::DEBUG::2014-07-10 09:40:19,999::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-57::DEBUG::2014-07-10 09:40:20,009::task::990::TaskManager.Task::(_decref) Task=`e37dc10d-9a09-4fa0-a5d7-8d7b2423b88f`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 09:40:20,243::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.392893 s, 2.6 MB/s\n'; <rc> = 0 >Thread-67::DEBUG::2014-07-10 09:40:20,526::task::595::TaskManager.Task::(_updateState) Task=`6e19bad3-eea2-4d4a-a8a0-913b404f609a`::moving from state init -> state preparing >Thread-67::INFO::2014-07-10 09:40:20,527::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='f30c2cb7-a43a-4bf5-82b5-cfe07336f65c', volUUID='b0fbb3c9-55af-4a3a-95ad-fc56a80b9cf5', options=None) >Thread-67::INFO::2014-07-10 09:40:20,527::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-67::DEBUG::2014-07-10 09:40:20,527::task::1185::TaskManager.Task::(prepare) Task=`6e19bad3-eea2-4d4a-a8a0-913b404f609a`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-67::DEBUG::2014-07-10 09:40:20,528::task::595::TaskManager.Task::(_updateState) Task=`6e19bad3-eea2-4d4a-a8a0-913b404f609a`::moving from state preparing -> state finished >Thread-67::DEBUG::2014-07-10 09:40:20,528::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-67::DEBUG::2014-07-10 09:40:20,528::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-67::DEBUG::2014-07-10 09:40:20,528::task::990::TaskManager.Task::(_decref) Task=`6e19bad3-eea2-4d4a-a8a0-913b404f609a`::ref 0 aborting False >Thread-48::DEBUG::2014-07-10 09:40:21,055::task::595::TaskManager.Task::(_updateState) Task=`0b55551f-c6b3-4230-af55-8868887742ba`::moving from state init -> state preparing >Thread-48::INFO::2014-07-10 09:40:21,056::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='0cd7d6ce-f497-4243-a690-c57744861eea', volUUID='10b6a7dd-dc6c-43fa-ba17-92e4331b0e0b', options=None) >Thread-48::INFO::2014-07-10 09:40:21,056::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-48::DEBUG::2014-07-10 09:40:21,057::task::1185::TaskManager.Task::(prepare) Task=`0b55551f-c6b3-4230-af55-8868887742ba`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-48::DEBUG::2014-07-10 09:40:21,057::task::595::TaskManager.Task::(_updateState) Task=`0b55551f-c6b3-4230-af55-8868887742ba`::moving from state preparing -> state finished >Thread-48::DEBUG::2014-07-10 09:40:21,057::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-48::DEBUG::2014-07-10 09:40:21,057::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-48::DEBUG::2014-07-10 09:40:21,057::task::990::TaskManager.Task::(_decref) Task=`0b55551f-c6b3-4230-af55-8868887742ba`::ref 0 aborting False >Thread-14::DEBUG::2014-07-10 09:40:21,209::task::595::TaskManager.Task::(_updateState) Task=`e3d1d059-85a4-430e-a65f-d2635841748c`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 09:40:21,209::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::INFO::2014-07-10 09:40:21,210::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000853622', 'lastCheck': '4.0', 'valid': True}, '6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000455093', 'lastCheck': '4.3', 'valid': True}} >Thread-14::DEBUG::2014-07-10 09:40:21,210::task::1185::TaskManager.Task::(prepare) Task=`e3d1d059-85a4-430e-a65f-d2635841748c`::finished: {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000853622', 'lastCheck': '4.0', 'valid': True}, '6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000455093', 'lastCheck': '4.3', 'valid': True}} >Thread-14::DEBUG::2014-07-10 09:40:21,210::task::595::TaskManager.Task::(_updateState) Task=`e3d1d059-85a4-430e-a65f-d2635841748c`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 09:40:21,210::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 09:40:21,210::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 09:40:21,211::task::990::TaskManager.Task::(_decref) Task=`e3d1d059-85a4-430e-a65f-d2635841748c`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 09:40:22,258::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:40:22,353::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.035225 s, 29.1 MB/s\n'; <rc> = 0 >Thread-76::DEBUG::2014-07-10 09:40:22,485::task::595::TaskManager.Task::(_updateState) Task=`2c6b9c91-9f60-4987-a2d9-67d25cbc7b0a`::moving from state init -> state preparing >Thread-76::INFO::2014-07-10 09:40:22,486::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='e4c65229-4247-4b33-b72a-f1d5ce72ad05', volUUID='cad94284-3ca9-4c30-933d-997f4460309e', options=None) >Thread-76::INFO::2014-07-10 09:40:22,487::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-76::DEBUG::2014-07-10 09:40:22,488::task::1185::TaskManager.Task::(prepare) Task=`2c6b9c91-9f60-4987-a2d9-67d25cbc7b0a`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-76::DEBUG::2014-07-10 09:40:22,488::task::595::TaskManager.Task::(_updateState) Task=`2c6b9c91-9f60-4987-a2d9-67d25cbc7b0a`::moving from state preparing -> state finished >Thread-76::DEBUG::2014-07-10 09:40:22,488::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-76::DEBUG::2014-07-10 09:40:22,488::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-76::DEBUG::2014-07-10 09:40:22,488::task::990::TaskManager.Task::(_decref) Task=`2c6b9c91-9f60-4987-a2d9-67d25cbc7b0a`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 09:40:24,371::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:40:24,457::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0293971 s, 34.8 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:40:26,472::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:40:26,590::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0298667 s, 34.3 MB/s\n'; <rc> = 0 >Thread-40::DEBUG::2014-07-10 09:40:26,923::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lion.qa.lab.tlv.redhat.com:_export_yuri2_backup2/6a70504d-00df-4869-8695-0f442053f6b6/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-40::DEBUG::2014-07-10 09:40:26,943::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n369 bytes (369 B) copied, 0.000408651 s, 903 kB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-10 09:40:27,214::domainMonitor::192::Storage.DomainMonitorThread::(_monitorDomain) Refreshing domain 9e1aa540-1f4e-4ee3-a152-be381ef6c3bd >Thread-18::DEBUG::2014-07-10 09:40:27,215::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with LvMetadataRW backend >Thread-18::DEBUG::2014-07-10 09:40:27,216::blockSD::336::Storage.Misc.excCmd::(readlines) '/bin/dd iflag=direct skip=0 bs=2048 if=/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/metadata count=1' (cwd None) >Thread-18::DEBUG::2014-07-10 09:40:27,235::blockSD::336::Storage.Misc.excCmd::(readlines) SUCCESS: <err> = '1+0 records in\n1+0 records out\n2048 bytes (2.0 kB) copied, 0.000689465 s, 3.0 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-10 09:40:27,236::misc::282::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '2048 bytes (2.0 kB) copied, 0.000689465 s, 3.0 MB/s'], size: 2048 >Thread-18::DEBUG::2014-07-10 09:40:27,236::persistentDict::234::Storage.PersistentDict::(refresh) read lines (LvMetadataRW)=[] >Thread-18::WARNING::2014-07-10 09:40:27,236::persistentDict::256::Storage.PersistentDict::(refresh) data has no embedded checksum - trust it as it is >Thread-18::DEBUG::2014-07-10 09:40:27,237::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with VGTagMetadataRW backend >Thread-18::DEBUG::2014-07-10 09:40:27,237::lvm::503::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-18::DEBUG::2014-07-10 09:40:27,238::lvm::505::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-18::DEBUG::2014-07-10 09:40:27,238::lvm::513::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-18::DEBUG::2014-07-10 09:40:27,238::lvm::525::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-18::DEBUG::2014-07-10 09:40:27,238::lvm::373::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-18::DEBUG::2014-07-10 09:40:27,239::lvm::296::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/3600601601282300032826addbbdae311|/dev/mapper/360060160f4a030003840ec867ddee311|/dev/mapper/367cad74c2fcba00019e6afd20c781e67|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name 9e1aa540-1f4e-4ee3-a152-be381ef6c3bd' (cwd None) >Thread-18::DEBUG::2014-07-10 09:40:27,581::lvm::296::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-18::DEBUG::2014-07-10 09:40:27,586::lvm::415::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-18::DEBUG::2014-07-10 09:40:27,598::persistentDict::234::Storage.PersistentDict::(refresh) read lines (VGTagMetadataRW)=['LEASETIMESEC=60', 'VGUUID=9CsMxb-YbRc-yRG7-cQKD-xY3G-GLi5-YxUyPC', 'VERSION=3', 'TYPE=ISCSI', 'LOGBLKSIZE=512', u'PV0=pv:3600601601282300032826addbbdae311,uuid:7qEb8v-jk2X-3CPk-k4XB-eIBk-onYD-807hcV,pestart:0,pecount:8189,mapoffset:0', 'LEASERETRIES=3', 'IOOPTIMEOUTSEC=10', 'LOCKRENEWALINTERVALSEC=5', 'PHYBLKSIZE=512', 'SDUUID=9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'CLASS=Data', 'LOCKPOLICY=', 'DESCRIPTION=SD_REAL', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=DC_REAL', 'ROLE=Master', 'POOL_UUID=4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', 'POOL_SPM_ID=1', 'POOL_SPM_LVER=0', '_SHA_CKSUM=013b5a7910962201c4cceab31b9c6d9c79f7316f', u'POOL_DOMAINS=9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active'] >Thread-18::INFO::2014-07-10 09:40:27,600::sd::384::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 9e1aa540-1f4e-4ee3-a152-be381ef6c3bd_imageNS already registered >Thread-18::INFO::2014-07-10 09:40:27,600::sd::392::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 9e1aa540-1f4e-4ee3-a152-be381ef6c3bd_volumeNS already registered >Thread-18::INFO::2014-07-10 09:40:27,600::blockSD::452::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 9e1aa540-1f4e-4ee3-a152-be381ef6c3bd_lvmActivationNS already registered >Thread-18::DEBUG::2014-07-10 09:40:27,601::lvm::296::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgck --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/3600601601282300032826addbbdae311|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } " 9e1aa540-1f4e-4ee3-a152-be381ef6c3bd' (cwd None) >Thread-18::DEBUG::2014-07-10 09:40:27,833::lvm::296::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-18::DEBUG::2014-07-10 09:40:27,834::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/metadata bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-10 09:40:27,856::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000622924 s, 6.6 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:40:28,607::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:40:28,703::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0388532 s, 26.4 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 09:40:29,449::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-14::DEBUG::2014-07-10 09:40:29,450::task::595::TaskManager.Task::(_updateState) Task=`5cbbc5f2-0ad5-46f2-aec7-d7f34d472adf`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 09:40:29,450::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-14::INFO::2014-07-10 09:40:29,451::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:40:29,451::task::1185::TaskManager.Task::(prepare) Task=`5cbbc5f2-0ad5-46f2-aec7-d7f34d472adf`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:40:29,451::task::595::TaskManager.Task::(_updateState) Task=`5cbbc5f2-0ad5-46f2-aec7-d7f34d472adf`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 09:40:29,451::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 09:40:29,451::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 09:40:29,452::task::990::TaskManager.Task::(_decref) Task=`5cbbc5f2-0ad5-46f2-aec7-d7f34d472adf`::ref 0 aborting False >Thread-34::DEBUG::2014-07-10 09:40:29,456::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-34::DEBUG::2014-07-10 09:40:29,456::task::595::TaskManager.Task::(_updateState) Task=`cfa546eb-de0a-4485-80bf-e7a52ddc1d8f`::moving from state init -> state preparing >Thread-34::INFO::2014-07-10 09:40:29,456::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-34::DEBUG::2014-07-10 09:40:29,457::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`8624ba64-53c1-4e0f-a003-6d68e1fa1ce6`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-10 09:40:29,457::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' for lock type 'shared' >Thread-34::DEBUG::2014-07-10 09:40:29,458::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-10 09:40:29,458::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`8624ba64-53c1-4e0f-a003-6d68e1fa1ce6`::Granted request >Thread-34::DEBUG::2014-07-10 09:40:29,458::task::827::TaskManager.Task::(resourceAcquired) Task=`cfa546eb-de0a-4485-80bf-e7a52ddc1d8f`::_resourcesAcquired: Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee (shared) >Thread-34::DEBUG::2014-07-10 09:40:29,458::task::990::TaskManager.Task::(_decref) Task=`cfa546eb-de0a-4485-80bf-e7a52ddc1d8f`::ref 1 aborting False >Thread-34::INFO::2014-07-10 09:40:29,459::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532067385344', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:40:29,460::task::1185::TaskManager.Task::(prepare) Task=`cfa546eb-de0a-4485-80bf-e7a52ddc1d8f`::finished: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532067385344', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:40:29,460::task::595::TaskManager.Task::(_updateState) Task=`cfa546eb-de0a-4485-80bf-e7a52ddc1d8f`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-10 09:40:29,460::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee': < ResourceRef 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-10 09:40:29,460::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-10 09:40:29,460::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' >Thread-34::DEBUG::2014-07-10 09:40:29,461::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' (0 active users) >Thread-34::DEBUG::2014-07-10 09:40:29,461::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-10 09:40:29,461::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', Clearing records. >Thread-34::DEBUG::2014-07-10 09:40:29,461::task::990::TaskManager.Task::(_decref) Task=`cfa546eb-de0a-4485-80bf-e7a52ddc1d8f`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 09:40:30,723::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:40:30,814::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0313435 s, 32.7 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:40:32,830::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:40:32,925::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0362074 s, 28.3 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:40:34,940::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:40:35,049::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0499655 s, 20.5 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 09:40:36,454::task::595::TaskManager.Task::(_updateState) Task=`723fa8b3-f7af-4ade-8b83-acf713366720`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 09:40:36,455::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::INFO::2014-07-10 09:40:36,455::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000622924', 'lastCheck': '8.6', 'valid': True}, '6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000408651', 'lastCheck': '9.5', 'valid': True}} >Thread-14::DEBUG::2014-07-10 09:40:36,455::task::1185::TaskManager.Task::(prepare) Task=`723fa8b3-f7af-4ade-8b83-acf713366720`::finished: {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000622924', 'lastCheck': '8.6', 'valid': True}, '6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000408651', 'lastCheck': '9.5', 'valid': True}} >Thread-14::DEBUG::2014-07-10 09:40:36,455::task::595::TaskManager.Task::(_updateState) Task=`723fa8b3-f7af-4ade-8b83-acf713366720`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 09:40:36,456::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 09:40:36,456::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 09:40:36,456::task::990::TaskManager.Task::(_decref) Task=`723fa8b3-f7af-4ade-8b83-acf713366720`::ref 0 aborting False >Thread-40::DEBUG::2014-07-10 09:40:36,971::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lion.qa.lab.tlv.redhat.com:_export_yuri2_backup2/6a70504d-00df-4869-8695-0f442053f6b6/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-40::DEBUG::2014-07-10 09:40:36,993::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n369 bytes (369 B) copied, 0.000616096 s, 599 kB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:40:37,065::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:40:37,159::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0356844 s, 28.7 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-10 09:40:37,885::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/metadata bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-10 09:40:37,923::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.0166191 s, 246 kB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:40:39,177::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:40:39,266::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0294435 s, 34.8 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 09:40:39,533::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-14::DEBUG::2014-07-10 09:40:39,535::task::595::TaskManager.Task::(_updateState) Task=`f71532a6-4934-4287-b9c2-8783e8542de6`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 09:40:39,535::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-14::INFO::2014-07-10 09:40:39,536::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:40:39,536::task::1185::TaskManager.Task::(prepare) Task=`f71532a6-4934-4287-b9c2-8783e8542de6`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:40:39,536::task::595::TaskManager.Task::(_updateState) Task=`f71532a6-4934-4287-b9c2-8783e8542de6`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 09:40:39,536::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 09:40:39,537::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 09:40:39,537::task::990::TaskManager.Task::(_decref) Task=`f71532a6-4934-4287-b9c2-8783e8542de6`::ref 0 aborting False >Thread-34::DEBUG::2014-07-10 09:40:39,581::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-34::DEBUG::2014-07-10 09:40:39,582::task::595::TaskManager.Task::(_updateState) Task=`a2df2337-ea46-4b36-9352-69e97bbc0e3a`::moving from state init -> state preparing >Thread-34::INFO::2014-07-10 09:40:39,583::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-34::DEBUG::2014-07-10 09:40:39,584::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`cd622e1c-5a4c-4739-a718-75c710cddedb`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-10 09:40:39,584::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' for lock type 'shared' >Thread-34::DEBUG::2014-07-10 09:40:39,584::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-10 09:40:39,584::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`cd622e1c-5a4c-4739-a718-75c710cddedb`::Granted request >Thread-34::DEBUG::2014-07-10 09:40:39,585::task::827::TaskManager.Task::(resourceAcquired) Task=`a2df2337-ea46-4b36-9352-69e97bbc0e3a`::_resourcesAcquired: Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee (shared) >Thread-34::DEBUG::2014-07-10 09:40:39,585::task::990::TaskManager.Task::(_decref) Task=`a2df2337-ea46-4b36-9352-69e97bbc0e3a`::ref 1 aborting False >Thread-34::INFO::2014-07-10 09:40:39,586::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532067385344', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:40:39,587::task::1185::TaskManager.Task::(prepare) Task=`a2df2337-ea46-4b36-9352-69e97bbc0e3a`::finished: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532067385344', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:40:39,587::task::595::TaskManager.Task::(_updateState) Task=`a2df2337-ea46-4b36-9352-69e97bbc0e3a`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-10 09:40:39,587::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee': < ResourceRef 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-10 09:40:39,587::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-10 09:40:39,588::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' >Thread-34::DEBUG::2014-07-10 09:40:39,588::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' (0 active users) >Thread-34::DEBUG::2014-07-10 09:40:39,588::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-10 09:40:39,588::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', Clearing records. >Thread-34::DEBUG::2014-07-10 09:40:39,589::task::990::TaskManager.Task::(_decref) Task=`a2df2337-ea46-4b36-9352-69e97bbc0e3a`::ref 0 aborting False >Thread-70::DEBUG::2014-07-10 09:40:39,678::task::595::TaskManager.Task::(_updateState) Task=`f4d7723b-1220-4911-b978-9be31d5e8b60`::moving from state init -> state preparing >Thread-70::INFO::2014-07-10 09:40:39,678::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='cfaeead2-7caa-467c-b389-c89840ae6605', volUUID='567fe32d-31a6-4ff6-90f3-fd6a656fbecc', options=None) >Thread-70::INFO::2014-07-10 09:40:39,678::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-70::DEBUG::2014-07-10 09:40:39,679::task::1185::TaskManager.Task::(prepare) Task=`f4d7723b-1220-4911-b978-9be31d5e8b60`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-70::DEBUG::2014-07-10 09:40:39,679::task::595::TaskManager.Task::(_updateState) Task=`f4d7723b-1220-4911-b978-9be31d5e8b60`::moving from state preparing -> state finished >Thread-70::DEBUG::2014-07-10 09:40:39,679::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-70::DEBUG::2014-07-10 09:40:39,679::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-70::DEBUG::2014-07-10 09:40:39,679::task::990::TaskManager.Task::(_decref) Task=`f4d7723b-1220-4911-b978-9be31d5e8b60`::ref 0 aborting False >Thread-60::DEBUG::2014-07-10 09:40:40,747::task::595::TaskManager.Task::(_updateState) Task=`c3d7e8ac-6dd3-45e3-8ecb-bcf308a2928e`::moving from state init -> state preparing >Thread-60::INFO::2014-07-10 09:40:40,748::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='b034d5b0-e1e0-4011-b49b-4d45ddb11556', volUUID='3d7f62b5-328f-4d8e-8b69-873cfb5ae14d', options=None) >Thread-51::DEBUG::2014-07-10 09:40:40,750::task::595::TaskManager.Task::(_updateState) Task=`c15964dc-3ba2-4d14-aaf4-ac9af3ddeb03`::moving from state init -> state preparing >Thread-60::INFO::2014-07-10 09:40:40,752::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-51::INFO::2014-07-10 09:40:40,754::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='76fdb054-02cd-42ed-9721-b3e65b34c3a4', volUUID='022dfe46-2cf7-4915-80b3-883158e3ca83', options=None) >Thread-60::DEBUG::2014-07-10 09:40:40,755::task::1185::TaskManager.Task::(prepare) Task=`c3d7e8ac-6dd3-45e3-8ecb-bcf308a2928e`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-51::INFO::2014-07-10 09:40:40,758::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-60::DEBUG::2014-07-10 09:40:40,759::task::595::TaskManager.Task::(_updateState) Task=`c3d7e8ac-6dd3-45e3-8ecb-bcf308a2928e`::moving from state preparing -> state finished >Thread-51::DEBUG::2014-07-10 09:40:40,761::task::1185::TaskManager.Task::(prepare) Task=`c15964dc-3ba2-4d14-aaf4-ac9af3ddeb03`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-60::DEBUG::2014-07-10 09:40:40,762::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-51::DEBUG::2014-07-10 09:40:40,764::task::595::TaskManager.Task::(_updateState) Task=`c15964dc-3ba2-4d14-aaf4-ac9af3ddeb03`::moving from state preparing -> state finished >Thread-60::DEBUG::2014-07-10 09:40:40,766::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-51::DEBUG::2014-07-10 09:40:40,767::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-51::DEBUG::2014-07-10 09:40:40,769::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-60::DEBUG::2014-07-10 09:40:40,769::task::990::TaskManager.Task::(_decref) Task=`c3d7e8ac-6dd3-45e3-8ecb-bcf308a2928e`::ref 0 aborting False >Thread-51::DEBUG::2014-07-10 09:40:40,772::task::990::TaskManager.Task::(_decref) Task=`c15964dc-3ba2-4d14-aaf4-ac9af3ddeb03`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 09:40:41,281::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:40:41,364::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0258394 s, 39.6 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:40:43,379::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:40:43,481::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0368886 s, 27.8 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:40:45,498::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:40:45,586::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0300627 s, 34.1 MB/s\n'; <rc> = 0 >Thread-40::DEBUG::2014-07-10 09:40:47,026::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lion.qa.lab.tlv.redhat.com:_export_yuri2_backup2/6a70504d-00df-4869-8695-0f442053f6b6/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-40::DEBUG::2014-07-10 09:40:47,046::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n369 bytes (369 B) copied, 0.000435434 s, 847 kB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:40:47,602::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:40:47,720::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0295935 s, 34.6 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-10 09:40:47,955::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/metadata bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-10 09:40:47,994::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000780081 s, 5.3 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 09:40:49,615::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-14::DEBUG::2014-07-10 09:40:49,617::task::595::TaskManager.Task::(_updateState) Task=`30cb3a73-6b6d-4973-96c9-76e2382665c8`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 09:40:49,618::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-14::INFO::2014-07-10 09:40:49,618::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:40:49,619::task::1185::TaskManager.Task::(prepare) Task=`30cb3a73-6b6d-4973-96c9-76e2382665c8`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:40:49,619::task::595::TaskManager.Task::(_updateState) Task=`30cb3a73-6b6d-4973-96c9-76e2382665c8`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 09:40:49,619::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 09:40:49,619::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 09:40:49,620::task::990::TaskManager.Task::(_decref) Task=`30cb3a73-6b6d-4973-96c9-76e2382665c8`::ref 0 aborting False >Thread-34::DEBUG::2014-07-10 09:40:49,624::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-34::DEBUG::2014-07-10 09:40:49,624::task::595::TaskManager.Task::(_updateState) Task=`4224ace8-effa-4777-a36a-91801fa38762`::moving from state init -> state preparing >Thread-34::INFO::2014-07-10 09:40:49,624::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-34::DEBUG::2014-07-10 09:40:49,625::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`7ec6a9a4-9f75-4ef3-9b1d-2d1adc24e6b7`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-10 09:40:49,625::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' for lock type 'shared' >Thread-34::DEBUG::2014-07-10 09:40:49,626::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-10 09:40:49,626::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`7ec6a9a4-9f75-4ef3-9b1d-2d1adc24e6b7`::Granted request >Thread-34::DEBUG::2014-07-10 09:40:49,626::task::827::TaskManager.Task::(resourceAcquired) Task=`4224ace8-effa-4777-a36a-91801fa38762`::_resourcesAcquired: Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee (shared) >Thread-34::DEBUG::2014-07-10 09:40:49,627::task::990::TaskManager.Task::(_decref) Task=`4224ace8-effa-4777-a36a-91801fa38762`::ref 1 aborting False >Thread-34::INFO::2014-07-10 09:40:49,628::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532067385344', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:40:49,628::task::1185::TaskManager.Task::(prepare) Task=`4224ace8-effa-4777-a36a-91801fa38762`::finished: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532067385344', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:40:49,628::task::595::TaskManager.Task::(_updateState) Task=`4224ace8-effa-4777-a36a-91801fa38762`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-10 09:40:49,629::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee': < ResourceRef 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-10 09:40:49,629::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-10 09:40:49,629::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' >Thread-34::DEBUG::2014-07-10 09:40:49,629::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' (0 active users) >Thread-34::DEBUG::2014-07-10 09:40:49,629::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-10 09:40:49,630::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', Clearing records. >Thread-34::DEBUG::2014-07-10 09:40:49,630::task::990::TaskManager.Task::(_decref) Task=`4224ace8-effa-4777-a36a-91801fa38762`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 09:40:49,737::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:40:49,835::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.038097 s, 26.9 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 09:40:51,634::task::595::TaskManager.Task::(_updateState) Task=`e513c8e6-81b0-4b7e-bac1-a294953b7f47`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 09:40:51,635::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::INFO::2014-07-10 09:40:51,635::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000780081', 'lastCheck': '3.6', 'valid': True}, '6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000435434', 'lastCheck': '4.6', 'valid': True}} >Thread-14::DEBUG::2014-07-10 09:40:51,635::task::1185::TaskManager.Task::(prepare) Task=`e513c8e6-81b0-4b7e-bac1-a294953b7f47`::finished: {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000780081', 'lastCheck': '3.6', 'valid': True}, '6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000435434', 'lastCheck': '4.6', 'valid': True}} >Thread-14::DEBUG::2014-07-10 09:40:51,635::task::595::TaskManager.Task::(_updateState) Task=`e513c8e6-81b0-4b7e-bac1-a294953b7f47`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 09:40:51,635::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 09:40:51,636::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 09:40:51,636::task::990::TaskManager.Task::(_decref) Task=`e513c8e6-81b0-4b7e-bac1-a294953b7f47`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 09:40:51,850::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:40:51,934::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0271962 s, 37.7 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:40:53,949::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:40:54,043::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0352719 s, 29.0 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:40:56,058::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:40:56,153::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0377521 s, 27.1 MB/s\n'; <rc> = 0 >Thread-40::DEBUG::2014-07-10 09:40:57,071::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lion.qa.lab.tlv.redhat.com:_export_yuri2_backup2/6a70504d-00df-4869-8695-0f442053f6b6/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-40::DEBUG::2014-07-10 09:40:57,092::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n369 bytes (369 B) copied, 0.000598057 s, 617 kB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-10 09:40:58,038::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/metadata bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-10 09:40:58,059::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000777988 s, 5.3 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:40:58,163::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:40:58,288::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0623359 s, 16.4 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 09:40:59,665::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-14::DEBUG::2014-07-10 09:40:59,667::task::595::TaskManager.Task::(_updateState) Task=`26fa4324-db36-42e5-bcb4-2ce709a1f096`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 09:40:59,667::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-14::INFO::2014-07-10 09:40:59,668::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:40:59,668::task::1185::TaskManager.Task::(prepare) Task=`26fa4324-db36-42e5-bcb4-2ce709a1f096`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:40:59,669::task::595::TaskManager.Task::(_updateState) Task=`26fa4324-db36-42e5-bcb4-2ce709a1f096`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 09:40:59,669::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 09:40:59,669::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 09:40:59,669::task::990::TaskManager.Task::(_decref) Task=`26fa4324-db36-42e5-bcb4-2ce709a1f096`::ref 0 aborting False >Thread-34::DEBUG::2014-07-10 09:40:59,674::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-34::DEBUG::2014-07-10 09:40:59,674::task::595::TaskManager.Task::(_updateState) Task=`4cc2eaf7-3a07-4949-9bdf-273d3e607bad`::moving from state init -> state preparing >Thread-34::INFO::2014-07-10 09:40:59,674::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-34::DEBUG::2014-07-10 09:40:59,675::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`fabdb141-7b06-4876-899c-f9926cdbf138`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-10 09:40:59,675::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' for lock type 'shared' >Thread-34::DEBUG::2014-07-10 09:40:59,675::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-10 09:40:59,675::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`fabdb141-7b06-4876-899c-f9926cdbf138`::Granted request >Thread-34::DEBUG::2014-07-10 09:40:59,676::task::827::TaskManager.Task::(resourceAcquired) Task=`4cc2eaf7-3a07-4949-9bdf-273d3e607bad`::_resourcesAcquired: Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee (shared) >Thread-34::DEBUG::2014-07-10 09:40:59,676::task::990::TaskManager.Task::(_decref) Task=`4cc2eaf7-3a07-4949-9bdf-273d3e607bad`::ref 1 aborting False >Thread-34::INFO::2014-07-10 09:40:59,677::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532067385344', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:40:59,678::task::1185::TaskManager.Task::(prepare) Task=`4cc2eaf7-3a07-4949-9bdf-273d3e607bad`::finished: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532067385344', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:40:59,678::task::595::TaskManager.Task::(_updateState) Task=`4cc2eaf7-3a07-4949-9bdf-273d3e607bad`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-10 09:40:59,678::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee': < ResourceRef 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-10 09:40:59,678::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-10 09:40:59,679::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' >Thread-34::DEBUG::2014-07-10 09:40:59,679::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' (0 active users) >Thread-34::DEBUG::2014-07-10 09:40:59,679::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-10 09:40:59,679::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', Clearing records. >Thread-34::DEBUG::2014-07-10 09:40:59,679::task::990::TaskManager.Task::(_decref) Task=`4cc2eaf7-3a07-4949-9bdf-273d3e607bad`::ref 0 aborting False >Thread-64::DEBUG::2014-07-10 09:40:59,757::task::595::TaskManager.Task::(_updateState) Task=`2eb19285-4988-437d-abad-80104cd28c9e`::moving from state init -> state preparing >Thread-64::INFO::2014-07-10 09:40:59,757::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='aa20346a-4d3a-4e07-b8e1-52c0ebe4168c', volUUID='58fefce2-9bce-4bff-8949-8c6ce8122b27', options=None) >Thread-64::INFO::2014-07-10 09:40:59,758::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-64::DEBUG::2014-07-10 09:40:59,758::task::1185::TaskManager.Task::(prepare) Task=`2eb19285-4988-437d-abad-80104cd28c9e`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-64::DEBUG::2014-07-10 09:40:59,758::task::595::TaskManager.Task::(_updateState) Task=`2eb19285-4988-437d-abad-80104cd28c9e`::moving from state preparing -> state finished >Thread-64::DEBUG::2014-07-10 09:40:59,758::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-64::DEBUG::2014-07-10 09:40:59,758::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-64::DEBUG::2014-07-10 09:40:59,759::task::990::TaskManager.Task::(_decref) Task=`2eb19285-4988-437d-abad-80104cd28c9e`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 09:41:00,303::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:41:00,390::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0270827 s, 37.8 MB/s\n'; <rc> = 0 >Thread-54::DEBUG::2014-07-10 09:41:02,270::task::595::TaskManager.Task::(_updateState) Task=`12ad4f9a-f8cb-4b34-9b86-a3c6775fd1ee`::moving from state init -> state preparing >Thread-54::INFO::2014-07-10 09:41:02,270::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='28408446-e5fd-4565-a976-e760951593fe', volUUID='776303a2-5585-451e-826e-0e338d4a1e98', options=None) >Thread-54::INFO::2014-07-10 09:41:02,271::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-54::DEBUG::2014-07-10 09:41:02,271::task::1185::TaskManager.Task::(prepare) Task=`12ad4f9a-f8cb-4b34-9b86-a3c6775fd1ee`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-54::DEBUG::2014-07-10 09:41:02,271::task::595::TaskManager.Task::(_updateState) Task=`12ad4f9a-f8cb-4b34-9b86-a3c6775fd1ee`::moving from state preparing -> state finished >Thread-54::DEBUG::2014-07-10 09:41:02,271::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-54::DEBUG::2014-07-10 09:41:02,271::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-54::DEBUG::2014-07-10 09:41:02,272::task::990::TaskManager.Task::(_decref) Task=`12ad4f9a-f8cb-4b34-9b86-a3c6775fd1ee`::ref 0 aborting False >Thread-73::DEBUG::2014-07-10 09:41:02,273::task::595::TaskManager.Task::(_updateState) Task=`265bb2b7-2497-4fa5-b700-75560fe195f6`::moving from state init -> state preparing >Thread-73::INFO::2014-07-10 09:41:02,273::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='c01d693b-cba0-4fed-9ad7-0aaa28912a19', volUUID='4bb5d954-2a50-4028-b299-0b43c261270c', options=None) >Thread-73::INFO::2014-07-10 09:41:02,274::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-73::DEBUG::2014-07-10 09:41:02,274::task::1185::TaskManager.Task::(prepare) Task=`265bb2b7-2497-4fa5-b700-75560fe195f6`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-73::DEBUG::2014-07-10 09:41:02,274::task::595::TaskManager.Task::(_updateState) Task=`265bb2b7-2497-4fa5-b700-75560fe195f6`::moving from state preparing -> state finished >Thread-73::DEBUG::2014-07-10 09:41:02,274::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-73::DEBUG::2014-07-10 09:41:02,274::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-73::DEBUG::2014-07-10 09:41:02,275::task::990::TaskManager.Task::(_decref) Task=`265bb2b7-2497-4fa5-b700-75560fe195f6`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 09:41:02,501::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:41:02,589::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0304565 s, 33.6 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:41:04,605::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:41:04,750::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0324676 s, 31.5 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:41:06,782::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Thread-14::DEBUG::2014-07-10 09:41:06,873::task::595::TaskManager.Task::(_updateState) Task=`2a401147-3a81-4269-a206-594493c09ede`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 09:41:06,877::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::INFO::2014-07-10 09:41:06,882::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000777988', 'lastCheck': '8.8', 'valid': True}, '6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000598057', 'lastCheck': '9.8', 'valid': True}} >Thread-14::DEBUG::2014-07-10 09:41:06,885::task::1185::TaskManager.Task::(prepare) Task=`2a401147-3a81-4269-a206-594493c09ede`::finished: {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000777988', 'lastCheck': '8.8', 'valid': True}, '6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000598057', 'lastCheck': '9.8', 'valid': True}} >Thread-14::DEBUG::2014-07-10 09:41:06,891::task::595::TaskManager.Task::(_updateState) Task=`2a401147-3a81-4269-a206-594493c09ede`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 09:41:06,897::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 09:41:06,902::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 09:41:06,908::task::990::TaskManager.Task::(_decref) Task=`2a401147-3a81-4269-a206-594493c09ede`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 09:41:07,368::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0396096 s, 25.9 MB/s\n'; <rc> = 0 >Thread-40::DEBUG::2014-07-10 09:41:07,812::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lion.qa.lab.tlv.redhat.com:_export_yuri2_backup2/6a70504d-00df-4869-8695-0f442053f6b6/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-40::DEBUG::2014-07-10 09:41:07,848::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n369 bytes (369 B) copied, 0.000393832 s, 937 kB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-10 09:41:08,088::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/metadata bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-10 09:41:08,109::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000621368 s, 6.6 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 09:41:09,720::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-14::DEBUG::2014-07-10 09:41:09,722::task::595::TaskManager.Task::(_updateState) Task=`7630d4f6-2e74-45f8-abd6-80958850151b`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 09:41:09,722::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-14::INFO::2014-07-10 09:41:09,723::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:41:09,723::task::1185::TaskManager.Task::(prepare) Task=`7630d4f6-2e74-45f8-abd6-80958850151b`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:41:09,723::task::595::TaskManager.Task::(_updateState) Task=`7630d4f6-2e74-45f8-abd6-80958850151b`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 09:41:09,723::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 09:41:09,723::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 09:41:09,724::task::990::TaskManager.Task::(_decref) Task=`7630d4f6-2e74-45f8-abd6-80958850151b`::ref 0 aborting False >Thread-34::DEBUG::2014-07-10 09:41:09,768::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-34::DEBUG::2014-07-10 09:41:09,769::task::595::TaskManager.Task::(_updateState) Task=`fe47d472-db58-47c2-a462-d632407203fe`::moving from state init -> state preparing >Thread-34::INFO::2014-07-10 09:41:09,770::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-34::DEBUG::2014-07-10 09:41:09,771::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`3b28c2e4-4551-4020-abf1-c36abb03928b`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-10 09:41:09,771::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' for lock type 'shared' >Thread-34::DEBUG::2014-07-10 09:41:09,771::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-10 09:41:09,772::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`3b28c2e4-4551-4020-abf1-c36abb03928b`::Granted request >Thread-34::DEBUG::2014-07-10 09:41:09,772::task::827::TaskManager.Task::(resourceAcquired) Task=`fe47d472-db58-47c2-a462-d632407203fe`::_resourcesAcquired: Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee (shared) >Thread-34::DEBUG::2014-07-10 09:41:09,772::task::990::TaskManager.Task::(_decref) Task=`fe47d472-db58-47c2-a462-d632407203fe`::ref 1 aborting False >Thread-34::INFO::2014-07-10 09:41:09,774::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532067385344', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:41:09,774::task::1185::TaskManager.Task::(prepare) Task=`fe47d472-db58-47c2-a462-d632407203fe`::finished: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532067385344', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:41:09,774::task::595::TaskManager.Task::(_updateState) Task=`fe47d472-db58-47c2-a462-d632407203fe`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-10 09:41:09,774::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee': < ResourceRef 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-10 09:41:09,774::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-10 09:41:09,775::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' >Thread-34::DEBUG::2014-07-10 09:41:09,775::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' (0 active users) >Thread-34::DEBUG::2014-07-10 09:41:09,775::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-10 09:41:09,775::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', Clearing records. >Thread-34::DEBUG::2014-07-10 09:41:09,776::task::990::TaskManager.Task::(_decref) Task=`fe47d472-db58-47c2-a462-d632407203fe`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 09:41:09,862::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:41:09,957::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0327635 s, 31.3 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:41:11,971::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:41:12,059::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0302487 s, 33.9 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:41:14,075::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:41:14,168::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0319538 s, 32.0 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:41:16,178::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:41:16,269::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0326843 s, 31.3 MB/s\n'; <rc> = 0 >Thread-40::DEBUG::2014-07-10 09:41:17,884::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lion.qa.lab.tlv.redhat.com:_export_yuri2_backup2/6a70504d-00df-4869-8695-0f442053f6b6/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-40::DEBUG::2014-07-10 09:41:17,905::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n369 bytes (369 B) copied, 0.000489905 s, 753 kB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-10 09:41:18,139::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/metadata bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-10 09:41:18,162::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00197095 s, 2.1 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:41:18,288::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:41:18,377::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.032885 s, 31.1 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 09:41:19,801::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-14::DEBUG::2014-07-10 09:41:19,805::task::595::TaskManager.Task::(_updateState) Task=`aee2ce27-bf82-45e3-b68e-f41ba5e37b4a`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 09:41:19,808::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-14::INFO::2014-07-10 09:41:19,811::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:41:19,811::task::1185::TaskManager.Task::(prepare) Task=`aee2ce27-bf82-45e3-b68e-f41ba5e37b4a`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:41:19,812::task::595::TaskManager.Task::(_updateState) Task=`aee2ce27-bf82-45e3-b68e-f41ba5e37b4a`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 09:41:19,813::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 09:41:19,815::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 09:41:19,815::task::990::TaskManager.Task::(_decref) Task=`aee2ce27-bf82-45e3-b68e-f41ba5e37b4a`::ref 0 aborting False >Thread-34::DEBUG::2014-07-10 09:41:19,819::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-34::DEBUG::2014-07-10 09:41:19,819::task::595::TaskManager.Task::(_updateState) Task=`202f1a3e-46ae-45c9-b002-770ec25072e2`::moving from state init -> state preparing >Thread-34::INFO::2014-07-10 09:41:19,820::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-34::DEBUG::2014-07-10 09:41:19,820::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`efeb8418-4050-4ea7-8ea5-3aaf60cc35a6`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-10 09:41:19,821::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' for lock type 'shared' >Thread-34::DEBUG::2014-07-10 09:41:19,821::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-10 09:41:19,821::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`efeb8418-4050-4ea7-8ea5-3aaf60cc35a6`::Granted request >Thread-34::DEBUG::2014-07-10 09:41:19,822::task::827::TaskManager.Task::(resourceAcquired) Task=`202f1a3e-46ae-45c9-b002-770ec25072e2`::_resourcesAcquired: Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee (shared) >Thread-34::DEBUG::2014-07-10 09:41:19,822::task::990::TaskManager.Task::(_decref) Task=`202f1a3e-46ae-45c9-b002-770ec25072e2`::ref 1 aborting False >Thread-34::INFO::2014-07-10 09:41:19,823::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532067385344', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:41:19,823::task::1185::TaskManager.Task::(prepare) Task=`202f1a3e-46ae-45c9-b002-770ec25072e2`::finished: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532067385344', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:41:19,824::task::595::TaskManager.Task::(_updateState) Task=`202f1a3e-46ae-45c9-b002-770ec25072e2`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-10 09:41:19,824::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee': < ResourceRef 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-10 09:41:19,824::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-10 09:41:19,824::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' >Thread-34::DEBUG::2014-07-10 09:41:19,825::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' (0 active users) >Thread-34::DEBUG::2014-07-10 09:41:19,825::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-10 09:41:19,825::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', Clearing records. >Thread-34::DEBUG::2014-07-10 09:41:19,826::task::990::TaskManager.Task::(_decref) Task=`202f1a3e-46ae-45c9-b002-770ec25072e2`::ref 0 aborting False >Thread-57::DEBUG::2014-07-10 09:41:20,290::task::595::TaskManager.Task::(_updateState) Task=`2c38b73a-279d-416f-83f9-5f641326b53c`::moving from state init -> state preparing >Thread-57::INFO::2014-07-10 09:41:20,290::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='b6f6c0da-e67f-4902-b9ac-3069571a42fe', volUUID='c4cd1da8-05b7-45e0-80b1-1183d21443d9', options=None) >Thread-57::INFO::2014-07-10 09:41:20,291::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-57::DEBUG::2014-07-10 09:41:20,291::task::1185::TaskManager.Task::(prepare) Task=`2c38b73a-279d-416f-83f9-5f641326b53c`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-57::DEBUG::2014-07-10 09:41:20,291::task::595::TaskManager.Task::(_updateState) Task=`2c38b73a-279d-416f-83f9-5f641326b53c`::moving from state preparing -> state finished >Thread-57::DEBUG::2014-07-10 09:41:20,291::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-57::DEBUG::2014-07-10 09:41:20,291::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-57::DEBUG::2014-07-10 09:41:20,291::task::990::TaskManager.Task::(_decref) Task=`2c38b73a-279d-416f-83f9-5f641326b53c`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 09:41:20,393::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:41:20,480::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0308433 s, 33.2 MB/s\n'; <rc> = 0 >Thread-67::DEBUG::2014-07-10 09:41:20,807::task::595::TaskManager.Task::(_updateState) Task=`18992d4e-18b5-4309-9074-3bbad314140b`::moving from state init -> state preparing >Thread-67::INFO::2014-07-10 09:41:20,808::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='f30c2cb7-a43a-4bf5-82b5-cfe07336f65c', volUUID='b0fbb3c9-55af-4a3a-95ad-fc56a80b9cf5', options=None) >Thread-67::INFO::2014-07-10 09:41:20,808::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-67::DEBUG::2014-07-10 09:41:20,808::task::1185::TaskManager.Task::(prepare) Task=`18992d4e-18b5-4309-9074-3bbad314140b`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-67::DEBUG::2014-07-10 09:41:20,809::task::595::TaskManager.Task::(_updateState) Task=`18992d4e-18b5-4309-9074-3bbad314140b`::moving from state preparing -> state finished >Thread-67::DEBUG::2014-07-10 09:41:20,809::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-67::DEBUG::2014-07-10 09:41:20,809::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-67::DEBUG::2014-07-10 09:41:20,809::task::990::TaskManager.Task::(_decref) Task=`18992d4e-18b5-4309-9074-3bbad314140b`::ref 0 aborting False >Thread-48::DEBUG::2014-07-10 09:41:21,321::task::595::TaskManager.Task::(_updateState) Task=`48c46704-81e9-43e0-b1a7-28aa4d336cae`::moving from state init -> state preparing >Thread-48::INFO::2014-07-10 09:41:21,322::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='0cd7d6ce-f497-4243-a690-c57744861eea', volUUID='10b6a7dd-dc6c-43fa-ba17-92e4331b0e0b', options=None) >Thread-48::INFO::2014-07-10 09:41:21,322::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-48::DEBUG::2014-07-10 09:41:21,322::task::1185::TaskManager.Task::(prepare) Task=`48c46704-81e9-43e0-b1a7-28aa4d336cae`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-48::DEBUG::2014-07-10 09:41:21,322::task::595::TaskManager.Task::(_updateState) Task=`48c46704-81e9-43e0-b1a7-28aa4d336cae`::moving from state preparing -> state finished >Thread-48::DEBUG::2014-07-10 09:41:21,323::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-48::DEBUG::2014-07-10 09:41:21,323::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-48::DEBUG::2014-07-10 09:41:21,323::task::990::TaskManager.Task::(_decref) Task=`48c46704-81e9-43e0-b1a7-28aa4d336cae`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 09:41:22,496::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:41:22,588::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0329726 s, 31.1 MB/s\n'; <rc> = 0 >Thread-76::DEBUG::2014-07-10 09:41:22,776::task::595::TaskManager.Task::(_updateState) Task=`d0c5b283-a58c-4b9f-8a94-77b0ccedbe58`::moving from state init -> state preparing >Thread-76::INFO::2014-07-10 09:41:22,776::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='e4c65229-4247-4b33-b72a-f1d5ce72ad05', volUUID='cad94284-3ca9-4c30-933d-997f4460309e', options=None) >Thread-76::INFO::2014-07-10 09:41:22,777::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-76::DEBUG::2014-07-10 09:41:22,777::task::1185::TaskManager.Task::(prepare) Task=`d0c5b283-a58c-4b9f-8a94-77b0ccedbe58`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-76::DEBUG::2014-07-10 09:41:22,777::task::595::TaskManager.Task::(_updateState) Task=`d0c5b283-a58c-4b9f-8a94-77b0ccedbe58`::moving from state preparing -> state finished >Thread-76::DEBUG::2014-07-10 09:41:22,777::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-76::DEBUG::2014-07-10 09:41:22,777::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-76::DEBUG::2014-07-10 09:41:22,778::task::990::TaskManager.Task::(_decref) Task=`d0c5b283-a58c-4b9f-8a94-77b0ccedbe58`::ref 0 aborting False >Thread-14::DEBUG::2014-07-10 09:41:22,823::task::595::TaskManager.Task::(_updateState) Task=`e0e03853-3b65-43b6-bc3e-7630ffc7351e`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 09:41:22,823::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::INFO::2014-07-10 09:41:22,824::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00197095', 'lastCheck': '4.6', 'valid': True}, '6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000489905', 'lastCheck': '4.9', 'valid': True}} >Thread-14::DEBUG::2014-07-10 09:41:22,824::task::1185::TaskManager.Task::(prepare) Task=`e0e03853-3b65-43b6-bc3e-7630ffc7351e`::finished: {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00197095', 'lastCheck': '4.6', 'valid': True}, '6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000489905', 'lastCheck': '4.9', 'valid': True}} >Thread-14::DEBUG::2014-07-10 09:41:22,825::task::595::TaskManager.Task::(_updateState) Task=`e0e03853-3b65-43b6-bc3e-7630ffc7351e`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 09:41:22,825::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 09:41:22,825::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 09:41:22,825::task::990::TaskManager.Task::(_decref) Task=`e0e03853-3b65-43b6-bc3e-7630ffc7351e`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 09:41:24,604::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:41:24,697::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0352314 s, 29.1 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:41:26,712::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:41:26,800::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0293262 s, 34.9 MB/s\n'; <rc> = 0 >Thread-40::DEBUG::2014-07-10 09:41:27,941::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lion.qa.lab.tlv.redhat.com:_export_yuri2_backup2/6a70504d-00df-4869-8695-0f442053f6b6/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-40::DEBUG::2014-07-10 09:41:27,961::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n369 bytes (369 B) copied, 0.000465383 s, 793 kB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-10 09:41:28,192::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/metadata bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-10 09:41:28,214::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000895754 s, 4.6 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:41:28,816::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:41:28,923::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0436294 s, 23.5 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 09:41:29,850::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-14::DEBUG::2014-07-10 09:41:29,851::task::595::TaskManager.Task::(_updateState) Task=`439e457b-ba00-4291-90da-3589758b0aa7`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 09:41:29,852::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-14::INFO::2014-07-10 09:41:29,852::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:41:29,852::task::1185::TaskManager.Task::(prepare) Task=`439e457b-ba00-4291-90da-3589758b0aa7`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:41:29,853::task::595::TaskManager.Task::(_updateState) Task=`439e457b-ba00-4291-90da-3589758b0aa7`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 09:41:29,853::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 09:41:29,853::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 09:41:29,853::task::990::TaskManager.Task::(_decref) Task=`439e457b-ba00-4291-90da-3589758b0aa7`::ref 0 aborting False >Thread-34::DEBUG::2014-07-10 09:41:29,857::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-34::DEBUG::2014-07-10 09:41:29,858::task::595::TaskManager.Task::(_updateState) Task=`58ce5a57-dd11-4694-8503-40a60ce881f7`::moving from state init -> state preparing >Thread-34::INFO::2014-07-10 09:41:29,858::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-34::DEBUG::2014-07-10 09:41:29,859::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`d3797b92-dcc2-450a-8b07-3432d323a293`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-10 09:41:29,859::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' for lock type 'shared' >Thread-34::DEBUG::2014-07-10 09:41:29,859::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-10 09:41:29,860::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`d3797b92-dcc2-450a-8b07-3432d323a293`::Granted request >Thread-34::DEBUG::2014-07-10 09:41:29,860::task::827::TaskManager.Task::(resourceAcquired) Task=`58ce5a57-dd11-4694-8503-40a60ce881f7`::_resourcesAcquired: Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee (shared) >Thread-34::DEBUG::2014-07-10 09:41:29,860::task::990::TaskManager.Task::(_decref) Task=`58ce5a57-dd11-4694-8503-40a60ce881f7`::ref 1 aborting False >Thread-34::INFO::2014-07-10 09:41:29,862::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532067385344', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:41:29,862::task::1185::TaskManager.Task::(prepare) Task=`58ce5a57-dd11-4694-8503-40a60ce881f7`::finished: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532067385344', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:41:29,862::task::595::TaskManager.Task::(_updateState) Task=`58ce5a57-dd11-4694-8503-40a60ce881f7`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-10 09:41:29,862::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee': < ResourceRef 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-10 09:41:29,862::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-10 09:41:29,863::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' >Thread-34::DEBUG::2014-07-10 09:41:29,863::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' (0 active users) >Thread-34::DEBUG::2014-07-10 09:41:29,863::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-10 09:41:29,863::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', Clearing records. >Thread-34::DEBUG::2014-07-10 09:41:29,864::task::990::TaskManager.Task::(_decref) Task=`58ce5a57-dd11-4694-8503-40a60ce881f7`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 09:41:30,939::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:41:31,033::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0330558 s, 31.0 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:41:33,053::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:41:33,241::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0295157 s, 34.7 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:41:35,256::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:41:35,368::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0504797 s, 20.3 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:41:37,383::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:41:37,486::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0394334 s, 26.0 MB/s\n'; <rc> = 0 >Thread-40::DEBUG::2014-07-10 09:41:37,994::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lion.qa.lab.tlv.redhat.com:_export_yuri2_backup2/6a70504d-00df-4869-8695-0f442053f6b6/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-40::DEBUG::2014-07-10 09:41:38,014::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n369 bytes (369 B) copied, 0.000520284 s, 709 kB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 09:41:38,076::task::595::TaskManager.Task::(_updateState) Task=`16b3c7b1-c989-4eb3-a57b-e257d6ef690e`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 09:41:38,076::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::INFO::2014-07-10 09:41:38,077::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000895754', 'lastCheck': '9.8', 'valid': True}, '6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000520284', 'lastCheck': '0.1', 'valid': True}} >Thread-14::DEBUG::2014-07-10 09:41:38,077::task::1185::TaskManager.Task::(prepare) Task=`16b3c7b1-c989-4eb3-a57b-e257d6ef690e`::finished: {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000895754', 'lastCheck': '9.8', 'valid': True}, '6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000520284', 'lastCheck': '0.1', 'valid': True}} >Thread-14::DEBUG::2014-07-10 09:41:38,077::task::595::TaskManager.Task::(_updateState) Task=`16b3c7b1-c989-4eb3-a57b-e257d6ef690e`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 09:41:38,077::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 09:41:38,078::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 09:41:38,078::task::990::TaskManager.Task::(_decref) Task=`16b3c7b1-c989-4eb3-a57b-e257d6ef690e`::ref 0 aborting False >Thread-18::DEBUG::2014-07-10 09:41:38,245::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/metadata bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-10 09:41:38,270::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00431845 s, 948 kB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:41:39,502::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:41:39,595::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0337738 s, 30.3 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 09:41:39,907::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-14::DEBUG::2014-07-10 09:41:39,909::task::595::TaskManager.Task::(_updateState) Task=`c3c7327f-bd5d-4072-a9c5-c9243711888e`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 09:41:39,909::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-14::INFO::2014-07-10 09:41:39,910::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:41:39,910::task::1185::TaskManager.Task::(prepare) Task=`c3c7327f-bd5d-4072-a9c5-c9243711888e`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:41:39,911::task::595::TaskManager.Task::(_updateState) Task=`c3c7327f-bd5d-4072-a9c5-c9243711888e`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 09:41:39,911::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 09:41:39,911::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 09:41:39,911::task::990::TaskManager.Task::(_decref) Task=`c3c7327f-bd5d-4072-a9c5-c9243711888e`::ref 0 aborting False >Thread-34::DEBUG::2014-07-10 09:41:39,955::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-34::DEBUG::2014-07-10 09:41:39,956::task::595::TaskManager.Task::(_updateState) Task=`968d77fd-5f02-4168-9941-fb01eae5ffb1`::moving from state init -> state preparing >Thread-34::INFO::2014-07-10 09:41:39,957::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-34::DEBUG::2014-07-10 09:41:39,958::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`a32972bb-ae9f-4e55-bf10-6d32c48ade54`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-10 09:41:39,958::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' for lock type 'shared' >Thread-34::DEBUG::2014-07-10 09:41:39,960::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free. Now locking as 'shared' (1 active user) >Thread-70::DEBUG::2014-07-10 09:41:39,960::task::595::TaskManager.Task::(_updateState) Task=`86989039-8200-4aa8-966d-66c4dacfc5c5`::moving from state init -> state preparing >Thread-34::DEBUG::2014-07-10 09:41:39,962::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`a32972bb-ae9f-4e55-bf10-6d32c48ade54`::Granted request >Thread-70::INFO::2014-07-10 09:41:39,963::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='cfaeead2-7caa-467c-b389-c89840ae6605', volUUID='567fe32d-31a6-4ff6-90f3-fd6a656fbecc', options=None) >Thread-34::DEBUG::2014-07-10 09:41:39,965::task::827::TaskManager.Task::(resourceAcquired) Task=`968d77fd-5f02-4168-9941-fb01eae5ffb1`::_resourcesAcquired: Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee (shared) >Thread-70::INFO::2014-07-10 09:41:39,966::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-34::DEBUG::2014-07-10 09:41:39,968::task::990::TaskManager.Task::(_decref) Task=`968d77fd-5f02-4168-9941-fb01eae5ffb1`::ref 1 aborting False >Thread-70::DEBUG::2014-07-10 09:41:39,969::task::1185::TaskManager.Task::(prepare) Task=`86989039-8200-4aa8-966d-66c4dacfc5c5`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-70::DEBUG::2014-07-10 09:41:39,972::task::595::TaskManager.Task::(_updateState) Task=`86989039-8200-4aa8-966d-66c4dacfc5c5`::moving from state preparing -> state finished >Thread-70::DEBUG::2014-07-10 09:41:39,973::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-70::DEBUG::2014-07-10 09:41:39,976::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::INFO::2014-07-10 09:41:39,987::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532067385344', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-70::DEBUG::2014-07-10 09:41:39,989::task::990::TaskManager.Task::(_decref) Task=`86989039-8200-4aa8-966d-66c4dacfc5c5`::ref 0 aborting False >Thread-34::DEBUG::2014-07-10 09:41:39,990::task::1185::TaskManager.Task::(prepare) Task=`968d77fd-5f02-4168-9941-fb01eae5ffb1`::finished: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532067385344', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:41:39,991::task::595::TaskManager.Task::(_updateState) Task=`968d77fd-5f02-4168-9941-fb01eae5ffb1`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-10 09:41:39,992::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee': < ResourceRef 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-10 09:41:39,992::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-10 09:41:39,993::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' >Thread-34::DEBUG::2014-07-10 09:41:39,993::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' (0 active users) >Thread-34::DEBUG::2014-07-10 09:41:39,993::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-10 09:41:39,994::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', Clearing records. >Thread-34::DEBUG::2014-07-10 09:41:39,994::task::990::TaskManager.Task::(_decref) Task=`968d77fd-5f02-4168-9941-fb01eae5ffb1`::ref 0 aborting False >Thread-51::DEBUG::2014-07-10 09:41:41,102::task::595::TaskManager.Task::(_updateState) Task=`19ad4ad6-eefd-4c2b-9962-2d5e84022098`::moving from state init -> state preparing >Thread-60::DEBUG::2014-07-10 09:41:41,102::task::595::TaskManager.Task::(_updateState) Task=`a0c8ab1d-0ebd-44c6-9188-f1a09b81b5af`::moving from state init -> state preparing >Thread-51::INFO::2014-07-10 09:41:41,104::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='76fdb054-02cd-42ed-9721-b3e65b34c3a4', volUUID='022dfe46-2cf7-4915-80b3-883158e3ca83', options=None) >Thread-60::INFO::2014-07-10 09:41:41,104::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='b034d5b0-e1e0-4011-b49b-4d45ddb11556', volUUID='3d7f62b5-328f-4d8e-8b69-873cfb5ae14d', options=None) >Thread-60::INFO::2014-07-10 09:41:41,106::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-51::INFO::2014-07-10 09:41:41,106::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-60::DEBUG::2014-07-10 09:41:41,107::task::1185::TaskManager.Task::(prepare) Task=`a0c8ab1d-0ebd-44c6-9188-f1a09b81b5af`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-51::DEBUG::2014-07-10 09:41:41,107::task::1185::TaskManager.Task::(prepare) Task=`19ad4ad6-eefd-4c2b-9962-2d5e84022098`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-60::DEBUG::2014-07-10 09:41:41,108::task::595::TaskManager.Task::(_updateState) Task=`a0c8ab1d-0ebd-44c6-9188-f1a09b81b5af`::moving from state preparing -> state finished >Thread-51::DEBUG::2014-07-10 09:41:41,109::task::595::TaskManager.Task::(_updateState) Task=`19ad4ad6-eefd-4c2b-9962-2d5e84022098`::moving from state preparing -> state finished >Thread-60::DEBUG::2014-07-10 09:41:41,109::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-51::DEBUG::2014-07-10 09:41:41,110::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-60::DEBUG::2014-07-10 09:41:41,111::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-51::DEBUG::2014-07-10 09:41:41,111::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-60::DEBUG::2014-07-10 09:41:41,112::task::990::TaskManager.Task::(_decref) Task=`a0c8ab1d-0ebd-44c6-9188-f1a09b81b5af`::ref 0 aborting False >Thread-51::DEBUG::2014-07-10 09:41:41,113::task::990::TaskManager.Task::(_decref) Task=`19ad4ad6-eefd-4c2b-9962-2d5e84022098`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 09:41:41,610::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:41:41,712::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0295238 s, 34.7 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:41:43,727::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:41:43,829::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0415011 s, 24.7 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:41:45,845::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:41:45,939::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.035624 s, 28.7 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:41:47,955::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Thread-40::DEBUG::2014-07-10 09:41:48,187::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lion.qa.lab.tlv.redhat.com:_export_yuri2_backup2/6a70504d-00df-4869-8695-0f442053f6b6/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-40::DEBUG::2014-07-10 09:41:48,230::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n369 bytes (369 B) copied, 0.000453379 s, 814 kB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:41:48,254::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0310193 s, 33.0 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-10 09:41:48,298::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/metadata bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-10 09:41:48,318::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000891912 s, 4.6 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 09:41:50,017::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-14::DEBUG::2014-07-10 09:41:50,018::task::595::TaskManager.Task::(_updateState) Task=`3da6eb83-c700-4a3d-b74b-84aefdccacaf`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 09:41:50,018::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-14::INFO::2014-07-10 09:41:50,019::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:41:50,019::task::1185::TaskManager.Task::(prepare) Task=`3da6eb83-c700-4a3d-b74b-84aefdccacaf`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:41:50,019::task::595::TaskManager.Task::(_updateState) Task=`3da6eb83-c700-4a3d-b74b-84aefdccacaf`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 09:41:50,019::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 09:41:50,020::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 09:41:50,020::task::990::TaskManager.Task::(_decref) Task=`3da6eb83-c700-4a3d-b74b-84aefdccacaf`::ref 0 aborting False >Thread-34::DEBUG::2014-07-10 09:41:50,024::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-34::DEBUG::2014-07-10 09:41:50,024::task::595::TaskManager.Task::(_updateState) Task=`30d802e1-c938-45b5-b9b0-5d3996e47b29`::moving from state init -> state preparing >Thread-34::INFO::2014-07-10 09:41:50,025::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-34::DEBUG::2014-07-10 09:41:50,025::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`45ee2eeb-d3c5-4a6b-bc47-6a9a8e1e5612`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-10 09:41:50,026::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' for lock type 'shared' >Thread-34::DEBUG::2014-07-10 09:41:50,026::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-10 09:41:50,026::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`45ee2eeb-d3c5-4a6b-bc47-6a9a8e1e5612`::Granted request >Thread-34::DEBUG::2014-07-10 09:41:50,027::task::827::TaskManager.Task::(resourceAcquired) Task=`30d802e1-c938-45b5-b9b0-5d3996e47b29`::_resourcesAcquired: Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee (shared) >Thread-34::DEBUG::2014-07-10 09:41:50,027::task::990::TaskManager.Task::(_decref) Task=`30d802e1-c938-45b5-b9b0-5d3996e47b29`::ref 1 aborting False >Thread-34::INFO::2014-07-10 09:41:50,028::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532067385344', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:41:50,029::task::1185::TaskManager.Task::(prepare) Task=`30d802e1-c938-45b5-b9b0-5d3996e47b29`::finished: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532067385344', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:41:50,029::task::595::TaskManager.Task::(_updateState) Task=`30d802e1-c938-45b5-b9b0-5d3996e47b29`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-10 09:41:50,029::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee': < ResourceRef 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-10 09:41:50,029::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-10 09:41:50,030::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' >Thread-34::DEBUG::2014-07-10 09:41:50,030::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' (0 active users) >Thread-34::DEBUG::2014-07-10 09:41:50,030::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-10 09:41:50,030::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', Clearing records. >Thread-34::DEBUG::2014-07-10 09:41:50,030::task::990::TaskManager.Task::(_decref) Task=`30d802e1-c938-45b5-b9b0-5d3996e47b29`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 09:41:50,269::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:41:50,378::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0409901 s, 25.0 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:41:52,395::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:41:52,505::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0424366 s, 24.1 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 09:41:53,266::task::595::TaskManager.Task::(_updateState) Task=`55b93dd6-2c9b-4e43-89bf-23c104c84f19`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 09:41:53,267::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::INFO::2014-07-10 09:41:53,267::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000891912', 'lastCheck': '4.9', 'valid': True}, '6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000453379', 'lastCheck': '5.0', 'valid': True}} >Thread-14::DEBUG::2014-07-10 09:41:53,268::task::1185::TaskManager.Task::(prepare) Task=`55b93dd6-2c9b-4e43-89bf-23c104c84f19`::finished: {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000891912', 'lastCheck': '4.9', 'valid': True}, '6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000453379', 'lastCheck': '5.0', 'valid': True}} >Thread-14::DEBUG::2014-07-10 09:41:53,268::task::595::TaskManager.Task::(_updateState) Task=`55b93dd6-2c9b-4e43-89bf-23c104c84f19`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 09:41:53,268::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 09:41:53,268::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 09:41:53,268::task::990::TaskManager.Task::(_decref) Task=`55b93dd6-2c9b-4e43-89bf-23c104c84f19`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 09:41:54,520::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:41:54,609::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0310056 s, 33.0 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:41:56,625::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:41:56,717::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0305697 s, 33.5 MB/s\n'; <rc> = 0 >Thread-40::DEBUG::2014-07-10 09:41:58,269::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lion.qa.lab.tlv.redhat.com:_export_yuri2_backup2/6a70504d-00df-4869-8695-0f442053f6b6/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-40::DEBUG::2014-07-10 09:41:58,289::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n369 bytes (369 B) copied, 0.000526479 s, 701 kB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-10 09:41:58,347::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/metadata bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-10 09:41:58,367::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000860393 s, 4.8 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:41:58,744::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:41:58,838::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0360535 s, 28.4 MB/s\n'; <rc> = 0 >Thread-64::DEBUG::2014-07-10 09:42:00,055::task::595::TaskManager.Task::(_updateState) Task=`7ecdf727-8cef-4061-b27f-ee21f394a141`::moving from state init -> state preparing >Thread-64::INFO::2014-07-10 09:42:00,055::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='aa20346a-4d3a-4e07-b8e1-52c0ebe4168c', volUUID='58fefce2-9bce-4bff-8949-8c6ce8122b27', options=None) >Thread-64::INFO::2014-07-10 09:42:00,056::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-64::DEBUG::2014-07-10 09:42:00,056::task::1185::TaskManager.Task::(prepare) Task=`7ecdf727-8cef-4061-b27f-ee21f394a141`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-64::DEBUG::2014-07-10 09:42:00,057::task::595::TaskManager.Task::(_updateState) Task=`7ecdf727-8cef-4061-b27f-ee21f394a141`::moving from state preparing -> state finished >Thread-64::DEBUG::2014-07-10 09:42:00,057::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-64::DEBUG::2014-07-10 09:42:00,057::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-64::DEBUG::2014-07-10 09:42:00,057::task::990::TaskManager.Task::(_decref) Task=`7ecdf727-8cef-4061-b27f-ee21f394a141`::ref 0 aborting False >Thread-14::DEBUG::2014-07-10 09:42:00,059::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-14::DEBUG::2014-07-10 09:42:00,059::task::595::TaskManager.Task::(_updateState) Task=`7236b3ed-3666-4640-9dce-b92ab447c37d`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 09:42:00,059::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-14::INFO::2014-07-10 09:42:00,060::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:42:00,061::task::1185::TaskManager.Task::(prepare) Task=`7236b3ed-3666-4640-9dce-b92ab447c37d`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:42:00,061::task::595::TaskManager.Task::(_updateState) Task=`7236b3ed-3666-4640-9dce-b92ab447c37d`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 09:42:00,061::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 09:42:00,061::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 09:42:00,061::task::990::TaskManager.Task::(_decref) Task=`7236b3ed-3666-4640-9dce-b92ab447c37d`::ref 0 aborting False >Thread-34::DEBUG::2014-07-10 09:42:00,065::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-34::DEBUG::2014-07-10 09:42:00,066::task::595::TaskManager.Task::(_updateState) Task=`2cd782a8-55a6-4210-9ee6-36686016cf5b`::moving from state init -> state preparing >Thread-34::INFO::2014-07-10 09:42:00,066::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-34::DEBUG::2014-07-10 09:42:00,067::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`01154894-fe03-4a22-a60c-e753d01c8b86`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-10 09:42:00,067::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' for lock type 'shared' >Thread-34::DEBUG::2014-07-10 09:42:00,067::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-10 09:42:00,067::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`01154894-fe03-4a22-a60c-e753d01c8b86`::Granted request >Thread-34::DEBUG::2014-07-10 09:42:00,068::task::827::TaskManager.Task::(resourceAcquired) Task=`2cd782a8-55a6-4210-9ee6-36686016cf5b`::_resourcesAcquired: Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee (shared) >Thread-34::DEBUG::2014-07-10 09:42:00,068::task::990::TaskManager.Task::(_decref) Task=`2cd782a8-55a6-4210-9ee6-36686016cf5b`::ref 1 aborting False >Thread-34::INFO::2014-07-10 09:42:00,070::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532067385344', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:42:00,070::task::1185::TaskManager.Task::(prepare) Task=`2cd782a8-55a6-4210-9ee6-36686016cf5b`::finished: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532067385344', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:42:00,070::task::595::TaskManager.Task::(_updateState) Task=`2cd782a8-55a6-4210-9ee6-36686016cf5b`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-10 09:42:00,070::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee': < ResourceRef 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-10 09:42:00,071::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-10 09:42:00,071::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' >Thread-34::DEBUG::2014-07-10 09:42:00,071::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' (0 active users) >Thread-34::DEBUG::2014-07-10 09:42:00,071::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-10 09:42:00,071::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', Clearing records. >Thread-34::DEBUG::2014-07-10 09:42:00,071::task::990::TaskManager.Task::(_decref) Task=`2cd782a8-55a6-4210-9ee6-36686016cf5b`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 09:42:00,854::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:42:00,949::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0362594 s, 28.2 MB/s\n'; <rc> = 0 >Thread-54::DEBUG::2014-07-10 09:42:02,571::task::595::TaskManager.Task::(_updateState) Task=`5f929c8b-dec1-42f5-944d-c7f6d0f1f130`::moving from state init -> state preparing >Thread-73::DEBUG::2014-07-10 09:42:02,571::task::595::TaskManager.Task::(_updateState) Task=`11b2952a-669c-412c-b395-71beae4d3ff4`::moving from state init -> state preparing >Thread-54::INFO::2014-07-10 09:42:02,572::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='28408446-e5fd-4565-a976-e760951593fe', volUUID='776303a2-5585-451e-826e-0e338d4a1e98', options=None) >Thread-73::INFO::2014-07-10 09:42:02,572::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='c01d693b-cba0-4fed-9ad7-0aaa28912a19', volUUID='4bb5d954-2a50-4028-b299-0b43c261270c', options=None) >Thread-54::INFO::2014-07-10 09:42:02,573::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-73::INFO::2014-07-10 09:42:02,573::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-54::DEBUG::2014-07-10 09:42:02,573::task::1185::TaskManager.Task::(prepare) Task=`5f929c8b-dec1-42f5-944d-c7f6d0f1f130`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-73::DEBUG::2014-07-10 09:42:02,574::task::1185::TaskManager.Task::(prepare) Task=`11b2952a-669c-412c-b395-71beae4d3ff4`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-54::DEBUG::2014-07-10 09:42:02,574::task::595::TaskManager.Task::(_updateState) Task=`5f929c8b-dec1-42f5-944d-c7f6d0f1f130`::moving from state preparing -> state finished >Thread-73::DEBUG::2014-07-10 09:42:02,574::task::595::TaskManager.Task::(_updateState) Task=`11b2952a-669c-412c-b395-71beae4d3ff4`::moving from state preparing -> state finished >Thread-54::DEBUG::2014-07-10 09:42:02,574::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-73::DEBUG::2014-07-10 09:42:02,574::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-54::DEBUG::2014-07-10 09:42:02,575::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-73::DEBUG::2014-07-10 09:42:02,575::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-54::DEBUG::2014-07-10 09:42:02,575::task::990::TaskManager.Task::(_decref) Task=`5f929c8b-dec1-42f5-944d-c7f6d0f1f130`::ref 0 aborting False >Thread-73::DEBUG::2014-07-10 09:42:02,575::task::990::TaskManager.Task::(_decref) Task=`11b2952a-669c-412c-b395-71beae4d3ff4`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 09:42:02,962::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:42:03,055::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0316599 s, 32.3 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:42:05,071::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:42:05,166::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0372733 s, 27.5 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:42:07,182::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:42:07,277::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0356535 s, 28.7 MB/s\n'; <rc> = 0 >Thread-40::DEBUG::2014-07-10 09:42:08,315::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lion.qa.lab.tlv.redhat.com:_export_yuri2_backup2/6a70504d-00df-4869-8695-0f442053f6b6/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-40::DEBUG::2014-07-10 09:42:08,335::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n369 bytes (369 B) copied, 0.000562043 s, 657 kB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-10 09:42:08,442::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/metadata bs=4096 count=1' (cwd None) >Thread-14::DEBUG::2014-07-10 09:42:08,493::task::595::TaskManager.Task::(_updateState) Task=`b6cc47ad-c24b-4eae-9fec-2b4073e7c2b0`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 09:42:08,498::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::INFO::2014-07-10 09:42:08,503::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000860393', 'lastCheck': '10.1', 'valid': True}, '6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000562043', 'lastCheck': '0.2', 'valid': True}} >Thread-14::DEBUG::2014-07-10 09:42:08,506::task::1185::TaskManager.Task::(prepare) Task=`b6cc47ad-c24b-4eae-9fec-2b4073e7c2b0`::finished: {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000860393', 'lastCheck': '10.1', 'valid': True}, '6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000562043', 'lastCheck': '0.2', 'valid': True}} >Thread-14::DEBUG::2014-07-10 09:42:08,509::task::595::TaskManager.Task::(_updateState) Task=`b6cc47ad-c24b-4eae-9fec-2b4073e7c2b0`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 09:42:08,511::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 09:42:08,514::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 09:42:08,518::task::990::TaskManager.Task::(_decref) Task=`b6cc47ad-c24b-4eae-9fec-2b4073e7c2b0`::ref 0 aborting False >Thread-18::DEBUG::2014-07-10 09:42:08,542::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000764012 s, 5.4 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:42:09,293::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:42:09,389::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0399292 s, 25.6 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 09:42:10,100::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-14::DEBUG::2014-07-10 09:42:10,101::task::595::TaskManager.Task::(_updateState) Task=`bffbbaf0-3968-4f21-9ff1-9b4ac6c830b9`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 09:42:10,102::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-14::INFO::2014-07-10 09:42:10,102::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:42:10,103::task::1185::TaskManager.Task::(prepare) Task=`bffbbaf0-3968-4f21-9ff1-9b4ac6c830b9`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:42:10,103::task::595::TaskManager.Task::(_updateState) Task=`bffbbaf0-3968-4f21-9ff1-9b4ac6c830b9`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 09:42:10,103::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 09:42:10,103::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 09:42:10,103::task::990::TaskManager.Task::(_decref) Task=`bffbbaf0-3968-4f21-9ff1-9b4ac6c830b9`::ref 0 aborting False >Thread-34::DEBUG::2014-07-10 09:42:10,147::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-34::DEBUG::2014-07-10 09:42:10,147::task::595::TaskManager.Task::(_updateState) Task=`47f9fcae-01f2-402a-be75-3ef4a352b17f`::moving from state init -> state preparing >Thread-34::INFO::2014-07-10 09:42:10,147::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-34::DEBUG::2014-07-10 09:42:10,148::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`ad3f1828-87c5-4718-b026-dc5178f9af04`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-10 09:42:10,148::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' for lock type 'shared' >Thread-34::DEBUG::2014-07-10 09:42:10,149::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-10 09:42:10,149::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`ad3f1828-87c5-4718-b026-dc5178f9af04`::Granted request >Thread-34::DEBUG::2014-07-10 09:42:10,150::task::827::TaskManager.Task::(resourceAcquired) Task=`47f9fcae-01f2-402a-be75-3ef4a352b17f`::_resourcesAcquired: Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee (shared) >Thread-34::DEBUG::2014-07-10 09:42:10,150::task::990::TaskManager.Task::(_decref) Task=`47f9fcae-01f2-402a-be75-3ef4a352b17f`::ref 1 aborting False >Thread-34::INFO::2014-07-10 09:42:10,151::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532067385344', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:42:10,151::task::1185::TaskManager.Task::(prepare) Task=`47f9fcae-01f2-402a-be75-3ef4a352b17f`::finished: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532067385344', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:42:10,151::task::595::TaskManager.Task::(_updateState) Task=`47f9fcae-01f2-402a-be75-3ef4a352b17f`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-10 09:42:10,152::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee': < ResourceRef 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-10 09:42:10,152::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-10 09:42:10,152::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' >Thread-34::DEBUG::2014-07-10 09:42:10,152::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' (0 active users) >Thread-34::DEBUG::2014-07-10 09:42:10,152::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-10 09:42:10,153::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', Clearing records. >Thread-34::DEBUG::2014-07-10 09:42:10,154::task::990::TaskManager.Task::(_decref) Task=`47f9fcae-01f2-402a-be75-3ef4a352b17f`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 09:42:11,403::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:42:11,496::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0332191 s, 30.8 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:42:13,511::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:42:13,624::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0351273 s, 29.2 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:42:15,646::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:42:15,778::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0747708 s, 13.7 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:42:17,794::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:42:17,882::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0314912 s, 32.5 MB/s\n'; <rc> = 0 >Thread-40::DEBUG::2014-07-10 09:42:18,367::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lion.qa.lab.tlv.redhat.com:_export_yuri2_backup2/6a70504d-00df-4869-8695-0f442053f6b6/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-40::DEBUG::2014-07-10 09:42:18,387::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n369 bytes (369 B) copied, 0.000483547 s, 763 kB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-10 09:42:18,890::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/metadata bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-10 09:42:18,915::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00430507 s, 951 kB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:42:19,897::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:42:19,992::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0350973 s, 29.2 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 09:42:20,183::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-14::DEBUG::2014-07-10 09:42:20,184::task::595::TaskManager.Task::(_updateState) Task=`a71ab3f0-1cb8-4df6-87ea-2b31fc38d833`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 09:42:20,185::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-14::INFO::2014-07-10 09:42:20,185::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:42:20,185::task::1185::TaskManager.Task::(prepare) Task=`a71ab3f0-1cb8-4df6-87ea-2b31fc38d833`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:42:20,186::task::595::TaskManager.Task::(_updateState) Task=`a71ab3f0-1cb8-4df6-87ea-2b31fc38d833`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 09:42:20,186::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 09:42:20,186::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 09:42:20,186::task::990::TaskManager.Task::(_decref) Task=`a71ab3f0-1cb8-4df6-87ea-2b31fc38d833`::ref 0 aborting False >Thread-34::DEBUG::2014-07-10 09:42:20,190::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-34::DEBUG::2014-07-10 09:42:20,191::task::595::TaskManager.Task::(_updateState) Task=`5a98edb4-e95a-4acf-91d0-c4bd55836f8e`::moving from state init -> state preparing >Thread-34::INFO::2014-07-10 09:42:20,191::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-34::DEBUG::2014-07-10 09:42:20,192::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`b3c809ac-c603-4ca8-ac89-693af55eb606`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-10 09:42:20,192::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' for lock type 'shared' >Thread-34::DEBUG::2014-07-10 09:42:20,193::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-10 09:42:20,193::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`b3c809ac-c603-4ca8-ac89-693af55eb606`::Granted request >Thread-34::DEBUG::2014-07-10 09:42:20,193::task::827::TaskManager.Task::(resourceAcquired) Task=`5a98edb4-e95a-4acf-91d0-c4bd55836f8e`::_resourcesAcquired: Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee (shared) >Thread-34::DEBUG::2014-07-10 09:42:20,193::task::990::TaskManager.Task::(_decref) Task=`5a98edb4-e95a-4acf-91d0-c4bd55836f8e`::ref 1 aborting False >Thread-34::INFO::2014-07-10 09:42:20,195::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532067385344', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:42:20,195::task::1185::TaskManager.Task::(prepare) Task=`5a98edb4-e95a-4acf-91d0-c4bd55836f8e`::finished: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532067385344', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:42:20,195::task::595::TaskManager.Task::(_updateState) Task=`5a98edb4-e95a-4acf-91d0-c4bd55836f8e`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-10 09:42:20,195::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee': < ResourceRef 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-10 09:42:20,195::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-10 09:42:20,196::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' >Thread-34::DEBUG::2014-07-10 09:42:20,196::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' (0 active users) >Thread-34::DEBUG::2014-07-10 09:42:20,197::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-10 09:42:20,197::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', Clearing records. >Thread-34::DEBUG::2014-07-10 09:42:20,197::task::990::TaskManager.Task::(_decref) Task=`5a98edb4-e95a-4acf-91d0-c4bd55836f8e`::ref 0 aborting False >Thread-57::DEBUG::2014-07-10 09:42:20,566::task::595::TaskManager.Task::(_updateState) Task=`b146fb8a-faf3-4045-8145-904841e89853`::moving from state init -> state preparing >Thread-57::INFO::2014-07-10 09:42:20,567::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='b6f6c0da-e67f-4902-b9ac-3069571a42fe', volUUID='c4cd1da8-05b7-45e0-80b1-1183d21443d9', options=None) >Thread-57::INFO::2014-07-10 09:42:20,567::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-57::DEBUG::2014-07-10 09:42:20,568::task::1185::TaskManager.Task::(prepare) Task=`b146fb8a-faf3-4045-8145-904841e89853`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-57::DEBUG::2014-07-10 09:42:20,568::task::595::TaskManager.Task::(_updateState) Task=`b146fb8a-faf3-4045-8145-904841e89853`::moving from state preparing -> state finished >Thread-57::DEBUG::2014-07-10 09:42:20,568::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-57::DEBUG::2014-07-10 09:42:20,568::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-57::DEBUG::2014-07-10 09:42:20,568::task::990::TaskManager.Task::(_decref) Task=`b146fb8a-faf3-4045-8145-904841e89853`::ref 0 aborting False >Thread-67::DEBUG::2014-07-10 09:42:21,078::task::595::TaskManager.Task::(_updateState) Task=`28b447f7-c7f8-4237-9833-6876845b96fd`::moving from state init -> state preparing >Thread-67::INFO::2014-07-10 09:42:21,078::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='f30c2cb7-a43a-4bf5-82b5-cfe07336f65c', volUUID='b0fbb3c9-55af-4a3a-95ad-fc56a80b9cf5', options=None) >Thread-67::INFO::2014-07-10 09:42:21,079::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-67::DEBUG::2014-07-10 09:42:21,079::task::1185::TaskManager.Task::(prepare) Task=`28b447f7-c7f8-4237-9833-6876845b96fd`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-67::DEBUG::2014-07-10 09:42:21,079::task::595::TaskManager.Task::(_updateState) Task=`28b447f7-c7f8-4237-9833-6876845b96fd`::moving from state preparing -> state finished >Thread-67::DEBUG::2014-07-10 09:42:21,079::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-67::DEBUG::2014-07-10 09:42:21,079::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-67::DEBUG::2014-07-10 09:42:21,079::task::990::TaskManager.Task::(_decref) Task=`28b447f7-c7f8-4237-9833-6876845b96fd`::ref 0 aborting False >Thread-48::DEBUG::2014-07-10 09:42:21,599::task::595::TaskManager.Task::(_updateState) Task=`eca1afb4-7bea-4c7a-a4f6-7ba008f46cba`::moving from state init -> state preparing >Thread-48::INFO::2014-07-10 09:42:21,600::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='0cd7d6ce-f497-4243-a690-c57744861eea', volUUID='10b6a7dd-dc6c-43fa-ba17-92e4331b0e0b', options=None) >Thread-48::INFO::2014-07-10 09:42:21,600::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-48::DEBUG::2014-07-10 09:42:21,601::task::1185::TaskManager.Task::(prepare) Task=`eca1afb4-7bea-4c7a-a4f6-7ba008f46cba`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-48::DEBUG::2014-07-10 09:42:21,601::task::595::TaskManager.Task::(_updateState) Task=`eca1afb4-7bea-4c7a-a4f6-7ba008f46cba`::moving from state preparing -> state finished >Thread-48::DEBUG::2014-07-10 09:42:21,601::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-48::DEBUG::2014-07-10 09:42:21,601::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-48::DEBUG::2014-07-10 09:42:21,601::task::990::TaskManager.Task::(_decref) Task=`eca1afb4-7bea-4c7a-a4f6-7ba008f46cba`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 09:42:22,007::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:42:22,101::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0352833 s, 29.0 MB/s\n'; <rc> = 0 >Thread-76::DEBUG::2014-07-10 09:42:23,063::task::595::TaskManager.Task::(_updateState) Task=`ac455166-eecc-4f54-8342-9f7ea0fcf62d`::moving from state init -> state preparing >Thread-76::INFO::2014-07-10 09:42:23,065::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='e4c65229-4247-4b33-b72a-f1d5ce72ad05', volUUID='cad94284-3ca9-4c30-933d-997f4460309e', options=None) >Thread-76::INFO::2014-07-10 09:42:23,065::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-76::DEBUG::2014-07-10 09:42:23,066::task::1185::TaskManager.Task::(prepare) Task=`ac455166-eecc-4f54-8342-9f7ea0fcf62d`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-76::DEBUG::2014-07-10 09:42:23,066::task::595::TaskManager.Task::(_updateState) Task=`ac455166-eecc-4f54-8342-9f7ea0fcf62d`::moving from state preparing -> state finished >Thread-76::DEBUG::2014-07-10 09:42:23,066::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-76::DEBUG::2014-07-10 09:42:23,066::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-76::DEBUG::2014-07-10 09:42:23,066::task::990::TaskManager.Task::(_decref) Task=`ac455166-eecc-4f54-8342-9f7ea0fcf62d`::ref 0 aborting False >Thread-14::DEBUG::2014-07-10 09:42:24,052::task::595::TaskManager.Task::(_updateState) Task=`d5931f1a-3d4c-4f57-80b7-931eecad58eb`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 09:42:24,053::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::INFO::2014-07-10 09:42:24,053::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00430507', 'lastCheck': '5.1', 'valid': True}, '6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000483547', 'lastCheck': '5.7', 'valid': True}} >Thread-14::DEBUG::2014-07-10 09:42:24,053::task::1185::TaskManager.Task::(prepare) Task=`d5931f1a-3d4c-4f57-80b7-931eecad58eb`::finished: {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00430507', 'lastCheck': '5.1', 'valid': True}, '6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000483547', 'lastCheck': '5.7', 'valid': True}} >Thread-14::DEBUG::2014-07-10 09:42:24,054::task::595::TaskManager.Task::(_updateState) Task=`d5931f1a-3d4c-4f57-80b7-931eecad58eb`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 09:42:24,054::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 09:42:24,054::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 09:42:24,054::task::990::TaskManager.Task::(_decref) Task=`d5931f1a-3d4c-4f57-80b7-931eecad58eb`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 09:42:24,127::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:42:24,227::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0330029 s, 31.0 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:42:26,241::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:42:26,329::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0294676 s, 34.8 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:42:28,344::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Thread-40::DEBUG::2014-07-10 09:42:28,763::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lion.qa.lab.tlv.redhat.com:_export_yuri2_backup2/6a70504d-00df-4869-8695-0f442053f6b6/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-40::DEBUG::2014-07-10 09:42:28,846::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n369 bytes (369 B) copied, 0.000414562 s, 890 kB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:42:28,909::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.215656 s, 4.7 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-10 09:42:28,943::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/metadata bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-10 09:42:28,964::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00068507 s, 6.0 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 09:42:30,224::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-14::DEBUG::2014-07-10 09:42:30,225::task::595::TaskManager.Task::(_updateState) Task=`11f9d814-fcb3-4b8e-8eb5-cae5cc55e0f5`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 09:42:30,226::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-14::INFO::2014-07-10 09:42:30,226::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:42:30,226::task::1185::TaskManager.Task::(prepare) Task=`11f9d814-fcb3-4b8e-8eb5-cae5cc55e0f5`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:42:30,226::task::595::TaskManager.Task::(_updateState) Task=`11f9d814-fcb3-4b8e-8eb5-cae5cc55e0f5`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 09:42:30,227::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 09:42:30,227::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 09:42:30,227::task::990::TaskManager.Task::(_decref) Task=`11f9d814-fcb3-4b8e-8eb5-cae5cc55e0f5`::ref 0 aborting False >Thread-34::DEBUG::2014-07-10 09:42:30,270::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-34::DEBUG::2014-07-10 09:42:30,270::task::595::TaskManager.Task::(_updateState) Task=`be0a695d-b8d5-412e-af37-b985293c5dc6`::moving from state init -> state preparing >Thread-34::INFO::2014-07-10 09:42:30,271::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-34::DEBUG::2014-07-10 09:42:30,271::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`9b2a6a09-5971-4b7c-9620-4976496cda06`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-10 09:42:30,272::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' for lock type 'shared' >Thread-34::DEBUG::2014-07-10 09:42:30,272::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-10 09:42:30,272::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`9b2a6a09-5971-4b7c-9620-4976496cda06`::Granted request >Thread-34::DEBUG::2014-07-10 09:42:30,272::task::827::TaskManager.Task::(resourceAcquired) Task=`be0a695d-b8d5-412e-af37-b985293c5dc6`::_resourcesAcquired: Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee (shared) >Thread-34::DEBUG::2014-07-10 09:42:30,273::task::990::TaskManager.Task::(_decref) Task=`be0a695d-b8d5-412e-af37-b985293c5dc6`::ref 1 aborting False >Thread-34::INFO::2014-07-10 09:42:30,274::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532067385344', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:42:30,274::task::1185::TaskManager.Task::(prepare) Task=`be0a695d-b8d5-412e-af37-b985293c5dc6`::finished: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532067385344', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:42:30,274::task::595::TaskManager.Task::(_updateState) Task=`be0a695d-b8d5-412e-af37-b985293c5dc6`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-10 09:42:30,274::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee': < ResourceRef 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-10 09:42:30,274::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-10 09:42:30,275::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' >Thread-34::DEBUG::2014-07-10 09:42:30,275::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' (0 active users) >Thread-34::DEBUG::2014-07-10 09:42:30,275::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-10 09:42:30,275::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', Clearing records. >Thread-34::DEBUG::2014-07-10 09:42:30,275::task::990::TaskManager.Task::(_decref) Task=`be0a695d-b8d5-412e-af37-b985293c5dc6`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 09:42:30,925::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:42:31,014::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0298332 s, 34.3 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:42:33,031::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:42:33,118::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0294792 s, 34.7 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:42:35,134::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:42:35,237::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0421496 s, 24.3 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:42:37,252::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:42:37,346::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0355361 s, 28.8 MB/s\n'; <rc> = 0 >Thread-40::DEBUG::2014-07-10 09:42:38,900::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lion.qa.lab.tlv.redhat.com:_export_yuri2_backup2/6a70504d-00df-4869-8695-0f442053f6b6/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-40::DEBUG::2014-07-10 09:42:38,921::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n369 bytes (369 B) copied, 0.000560977 s, 658 kB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-10 09:42:38,993::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/metadata bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-10 09:42:39,015::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000672485 s, 6.1 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 09:42:39,239::task::595::TaskManager.Task::(_updateState) Task=`0a62c3bd-67a3-4392-8e08-79275517d602`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 09:42:39,240::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::INFO::2014-07-10 09:42:39,240::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000672485', 'lastCheck': '0.2', 'valid': True}, '6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000560977', 'lastCheck': '0.3', 'valid': True}} >Thread-14::DEBUG::2014-07-10 09:42:39,241::task::1185::TaskManager.Task::(prepare) Task=`0a62c3bd-67a3-4392-8e08-79275517d602`::finished: {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000672485', 'lastCheck': '0.2', 'valid': True}, '6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000560977', 'lastCheck': '0.3', 'valid': True}} >Thread-14::DEBUG::2014-07-10 09:42:39,241::task::595::TaskManager.Task::(_updateState) Task=`0a62c3bd-67a3-4392-8e08-79275517d602`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 09:42:39,241::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 09:42:39,241::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 09:42:39,241::task::990::TaskManager.Task::(_decref) Task=`0a62c3bd-67a3-4392-8e08-79275517d602`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 09:42:39,361::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:42:39,459::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.034976 s, 29.3 MB/s\n'; <rc> = 0 >Thread-70::DEBUG::2014-07-10 09:42:40,276::task::595::TaskManager.Task::(_updateState) Task=`d196eef0-39e8-46b3-ba71-7504040376e5`::moving from state init -> state preparing >Thread-70::INFO::2014-07-10 09:42:40,277::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='cfaeead2-7caa-467c-b389-c89840ae6605', volUUID='567fe32d-31a6-4ff6-90f3-fd6a656fbecc', options=None) >Thread-70::INFO::2014-07-10 09:42:40,277::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-70::DEBUG::2014-07-10 09:42:40,278::task::1185::TaskManager.Task::(prepare) Task=`d196eef0-39e8-46b3-ba71-7504040376e5`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-70::DEBUG::2014-07-10 09:42:40,278::task::595::TaskManager.Task::(_updateState) Task=`d196eef0-39e8-46b3-ba71-7504040376e5`::moving from state preparing -> state finished >Thread-70::DEBUG::2014-07-10 09:42:40,278::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-70::DEBUG::2014-07-10 09:42:40,278::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-70::DEBUG::2014-07-10 09:42:40,278::task::990::TaskManager.Task::(_decref) Task=`d196eef0-39e8-46b3-ba71-7504040376e5`::ref 0 aborting False >Thread-14::DEBUG::2014-07-10 09:42:40,398::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-14::DEBUG::2014-07-10 09:42:40,401::task::595::TaskManager.Task::(_updateState) Task=`5bed1cd2-23af-4374-bdb1-6923862ea59c`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 09:42:40,402::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-14::INFO::2014-07-10 09:42:40,404::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:42:40,405::task::1185::TaskManager.Task::(prepare) Task=`5bed1cd2-23af-4374-bdb1-6923862ea59c`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:42:40,407::task::595::TaskManager.Task::(_updateState) Task=`5bed1cd2-23af-4374-bdb1-6923862ea59c`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 09:42:40,407::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 09:42:40,408::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 09:42:40,408::task::990::TaskManager.Task::(_decref) Task=`5bed1cd2-23af-4374-bdb1-6923862ea59c`::ref 0 aborting False >Thread-34::DEBUG::2014-07-10 09:42:40,451::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-34::DEBUG::2014-07-10 09:42:40,452::task::595::TaskManager.Task::(_updateState) Task=`e095e2dd-821c-4da9-83d4-4bc30abbe508`::moving from state init -> state preparing >Thread-34::INFO::2014-07-10 09:42:40,452::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-34::DEBUG::2014-07-10 09:42:40,453::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`8a9a86bd-4f76-4479-86a8-b5009e641987`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-10 09:42:40,453::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' for lock type 'shared' >Thread-34::DEBUG::2014-07-10 09:42:40,453::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-10 09:42:40,453::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`8a9a86bd-4f76-4479-86a8-b5009e641987`::Granted request >Thread-34::DEBUG::2014-07-10 09:42:40,454::task::827::TaskManager.Task::(resourceAcquired) Task=`e095e2dd-821c-4da9-83d4-4bc30abbe508`::_resourcesAcquired: Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee (shared) >Thread-34::DEBUG::2014-07-10 09:42:40,454::task::990::TaskManager.Task::(_decref) Task=`e095e2dd-821c-4da9-83d4-4bc30abbe508`::ref 1 aborting False >Thread-34::INFO::2014-07-10 09:42:40,455::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532067385344', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:42:40,455::task::1185::TaskManager.Task::(prepare) Task=`e095e2dd-821c-4da9-83d4-4bc30abbe508`::finished: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532067385344', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:42:40,456::task::595::TaskManager.Task::(_updateState) Task=`e095e2dd-821c-4da9-83d4-4bc30abbe508`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-10 09:42:40,456::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee': < ResourceRef 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-10 09:42:40,456::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-10 09:42:40,456::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' >Thread-34::DEBUG::2014-07-10 09:42:40,457::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' (0 active users) >Thread-34::DEBUG::2014-07-10 09:42:40,457::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-10 09:42:40,457::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', Clearing records. >Thread-34::DEBUG::2014-07-10 09:42:40,457::task::990::TaskManager.Task::(_decref) Task=`e095e2dd-821c-4da9-83d4-4bc30abbe508`::ref 0 aborting False >Thread-51::DEBUG::2014-07-10 09:42:41,458::task::595::TaskManager.Task::(_updateState) Task=`7072b7ed-3bea-4aef-8dc9-fa4eccf68056`::moving from state init -> state preparing >Thread-51::INFO::2014-07-10 09:42:41,460::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='76fdb054-02cd-42ed-9721-b3e65b34c3a4', volUUID='022dfe46-2cf7-4915-80b3-883158e3ca83', options=None) >Thread-60::DEBUG::2014-07-10 09:42:41,461::task::595::TaskManager.Task::(_updateState) Task=`3b830a16-38e7-4aa8-a8f4-fbb9bb9ecb5d`::moving from state init -> state preparing >Thread-60::INFO::2014-07-10 09:42:41,467::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='b034d5b0-e1e0-4011-b49b-4d45ddb11556', volUUID='3d7f62b5-328f-4d8e-8b69-873cfb5ae14d', options=None) >Thread-60::INFO::2014-07-10 09:42:41,473::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-51::INFO::2014-07-10 09:42:41,473::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Dummy-33::DEBUG::2014-07-10 09:42:41,475::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Thread-60::DEBUG::2014-07-10 09:42:41,477::task::1185::TaskManager.Task::(prepare) Task=`3b830a16-38e7-4aa8-a8f4-fbb9bb9ecb5d`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-51::DEBUG::2014-07-10 09:42:41,478::task::1185::TaskManager.Task::(prepare) Task=`7072b7ed-3bea-4aef-8dc9-fa4eccf68056`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-60::DEBUG::2014-07-10 09:42:41,512::task::595::TaskManager.Task::(_updateState) Task=`3b830a16-38e7-4aa8-a8f4-fbb9bb9ecb5d`::moving from state preparing -> state finished >Thread-51::DEBUG::2014-07-10 09:42:41,514::task::595::TaskManager.Task::(_updateState) Task=`7072b7ed-3bea-4aef-8dc9-fa4eccf68056`::moving from state preparing -> state finished >Thread-51::DEBUG::2014-07-10 09:42:41,519::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-60::DEBUG::2014-07-10 09:42:41,520::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-51::DEBUG::2014-07-10 09:42:41,521::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-60::DEBUG::2014-07-10 09:42:41,521::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-51::DEBUG::2014-07-10 09:42:41,523::task::990::TaskManager.Task::(_decref) Task=`7072b7ed-3bea-4aef-8dc9-fa4eccf68056`::ref 0 aborting False >Thread-60::DEBUG::2014-07-10 09:42:41,523::task::990::TaskManager.Task::(_decref) Task=`3b830a16-38e7-4aa8-a8f4-fbb9bb9ecb5d`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 09:42:41,593::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0384733 s, 26.6 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:42:43,615::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:42:43,709::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0359826 s, 28.5 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:42:45,724::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:42:45,811::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0282253 s, 36.3 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:42:47,827::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:42:48,002::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.115622 s, 8.9 MB/s\n'; <rc> = 0 >Thread-40::DEBUG::2014-07-10 09:42:48,952::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lion.qa.lab.tlv.redhat.com:_export_yuri2_backup2/6a70504d-00df-4869-8695-0f442053f6b6/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-40::DEBUG::2014-07-10 09:42:48,972::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n369 bytes (369 B) copied, 0.00038442 s, 960 kB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-10 09:42:49,043::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/metadata bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-10 09:42:49,064::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000658771 s, 6.2 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:42:50,017::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:42:50,110::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0332355 s, 30.8 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 09:42:50,486::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-14::DEBUG::2014-07-10 09:42:50,487::task::595::TaskManager.Task::(_updateState) Task=`62c4ebb9-1fba-489f-85e7-37041db23b9a`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 09:42:50,488::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-14::INFO::2014-07-10 09:42:50,488::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:42:50,488::task::1185::TaskManager.Task::(prepare) Task=`62c4ebb9-1fba-489f-85e7-37041db23b9a`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:42:50,488::task::595::TaskManager.Task::(_updateState) Task=`62c4ebb9-1fba-489f-85e7-37041db23b9a`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 09:42:50,489::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 09:42:50,489::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 09:42:50,489::task::990::TaskManager.Task::(_decref) Task=`62c4ebb9-1fba-489f-85e7-37041db23b9a`::ref 0 aborting False >Thread-34::DEBUG::2014-07-10 09:42:50,493::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-34::DEBUG::2014-07-10 09:42:50,494::task::595::TaskManager.Task::(_updateState) Task=`5c70dec5-4501-424d-a5ee-84202f0ad607`::moving from state init -> state preparing >Thread-34::INFO::2014-07-10 09:42:50,494::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-34::DEBUG::2014-07-10 09:42:50,495::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`ea50fdae-102c-403f-b7df-2adcfcad94e0`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-10 09:42:50,495::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' for lock type 'shared' >Thread-34::DEBUG::2014-07-10 09:42:50,495::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-10 09:42:50,495::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`ea50fdae-102c-403f-b7df-2adcfcad94e0`::Granted request >Thread-34::DEBUG::2014-07-10 09:42:50,496::task::827::TaskManager.Task::(resourceAcquired) Task=`5c70dec5-4501-424d-a5ee-84202f0ad607`::_resourcesAcquired: Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee (shared) >Thread-34::DEBUG::2014-07-10 09:42:50,496::task::990::TaskManager.Task::(_decref) Task=`5c70dec5-4501-424d-a5ee-84202f0ad607`::ref 1 aborting False >Thread-34::INFO::2014-07-10 09:42:50,497::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532067385344', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:42:50,497::task::1185::TaskManager.Task::(prepare) Task=`5c70dec5-4501-424d-a5ee-84202f0ad607`::finished: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532067385344', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:42:50,497::task::595::TaskManager.Task::(_updateState) Task=`5c70dec5-4501-424d-a5ee-84202f0ad607`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-10 09:42:50,497::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee': < ResourceRef 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-10 09:42:50,498::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-10 09:42:50,498::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' >Thread-34::DEBUG::2014-07-10 09:42:50,498::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' (0 active users) >Thread-34::DEBUG::2014-07-10 09:42:50,498::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-10 09:42:50,498::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', Clearing records. >Thread-34::DEBUG::2014-07-10 09:42:50,498::task::990::TaskManager.Task::(_decref) Task=`5c70dec5-4501-424d-a5ee-84202f0ad607`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 09:42:52,125::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:42:52,259::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0697636 s, 14.7 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:42:54,274::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:42:54,366::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0301996 s, 33.9 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 09:42:54,420::task::595::TaskManager.Task::(_updateState) Task=`7ea7622f-31d9-4f62-b005-26caf6e25bea`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 09:42:54,421::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::INFO::2014-07-10 09:42:54,421::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000658771', 'lastCheck': '5.3', 'valid': True}, '6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00038442', 'lastCheck': '5.4', 'valid': True}} >Thread-14::DEBUG::2014-07-10 09:42:54,421::task::1185::TaskManager.Task::(prepare) Task=`7ea7622f-31d9-4f62-b005-26caf6e25bea`::finished: {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000658771', 'lastCheck': '5.3', 'valid': True}, '6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00038442', 'lastCheck': '5.4', 'valid': True}} >Thread-14::DEBUG::2014-07-10 09:42:54,421::task::595::TaskManager.Task::(_updateState) Task=`7ea7622f-31d9-4f62-b005-26caf6e25bea`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 09:42:54,422::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 09:42:54,422::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 09:42:54,422::task::990::TaskManager.Task::(_decref) Task=`7ea7622f-31d9-4f62-b005-26caf6e25bea`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 09:42:56,380::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:42:56,469::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0302477 s, 33.9 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:42:58,484::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:42:58,579::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.036636 s, 28.0 MB/s\n'; <rc> = 0 >Thread-40::DEBUG::2014-07-10 09:42:59,003::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lion.qa.lab.tlv.redhat.com:_export_yuri2_backup2/6a70504d-00df-4869-8695-0f442053f6b6/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-40::DEBUG::2014-07-10 09:42:59,022::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n369 bytes (369 B) copied, 0.000501555 s, 736 kB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-10 09:42:59,092::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/metadata bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-10 09:42:59,114::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000704279 s, 5.8 MB/s\n'; <rc> = 0 >Thread-64::DEBUG::2014-07-10 09:43:00,345::task::595::TaskManager.Task::(_updateState) Task=`7ff22cbb-ab0c-4503-98fe-9ebe3507ed6f`::moving from state init -> state preparing >Thread-64::INFO::2014-07-10 09:43:00,345::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='aa20346a-4d3a-4e07-b8e1-52c0ebe4168c', volUUID='58fefce2-9bce-4bff-8949-8c6ce8122b27', options=None) >Thread-64::INFO::2014-07-10 09:43:00,346::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-64::DEBUG::2014-07-10 09:43:00,346::task::1185::TaskManager.Task::(prepare) Task=`7ff22cbb-ab0c-4503-98fe-9ebe3507ed6f`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-64::DEBUG::2014-07-10 09:43:00,346::task::595::TaskManager.Task::(_updateState) Task=`7ff22cbb-ab0c-4503-98fe-9ebe3507ed6f`::moving from state preparing -> state finished >Thread-64::DEBUG::2014-07-10 09:43:00,346::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-64::DEBUG::2014-07-10 09:43:00,346::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-64::DEBUG::2014-07-10 09:43:00,346::task::990::TaskManager.Task::(_decref) Task=`7ff22cbb-ab0c-4503-98fe-9ebe3507ed6f`::ref 0 aborting False >Thread-14::DEBUG::2014-07-10 09:43:00,534::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-14::DEBUG::2014-07-10 09:43:00,535::task::595::TaskManager.Task::(_updateState) Task=`f68ff8d1-166f-4485-a592-8ac665b7669a`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 09:43:00,536::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-14::INFO::2014-07-10 09:43:00,536::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:43:00,536::task::1185::TaskManager.Task::(prepare) Task=`f68ff8d1-166f-4485-a592-8ac665b7669a`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:43:00,536::task::595::TaskManager.Task::(_updateState) Task=`f68ff8d1-166f-4485-a592-8ac665b7669a`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 09:43:00,537::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 09:43:00,537::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 09:43:00,537::task::990::TaskManager.Task::(_decref) Task=`f68ff8d1-166f-4485-a592-8ac665b7669a`::ref 0 aborting False >Thread-34::DEBUG::2014-07-10 09:43:00,541::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-34::DEBUG::2014-07-10 09:43:00,541::task::595::TaskManager.Task::(_updateState) Task=`5c187def-952e-4297-9c42-84d5a140e749`::moving from state init -> state preparing >Thread-34::INFO::2014-07-10 09:43:00,542::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-34::DEBUG::2014-07-10 09:43:00,542::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`79ffaf4a-a216-4543-a5f6-5c3009259ca8`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-10 09:43:00,542::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' for lock type 'shared' >Thread-34::DEBUG::2014-07-10 09:43:00,543::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-10 09:43:00,543::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`79ffaf4a-a216-4543-a5f6-5c3009259ca8`::Granted request >Thread-34::DEBUG::2014-07-10 09:43:00,543::task::827::TaskManager.Task::(resourceAcquired) Task=`5c187def-952e-4297-9c42-84d5a140e749`::_resourcesAcquired: Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee (shared) >Thread-34::DEBUG::2014-07-10 09:43:00,544::task::990::TaskManager.Task::(_decref) Task=`5c187def-952e-4297-9c42-84d5a140e749`::ref 1 aborting False >Thread-34::INFO::2014-07-10 09:43:00,545::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532067385344', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:43:00,545::task::1185::TaskManager.Task::(prepare) Task=`5c187def-952e-4297-9c42-84d5a140e749`::finished: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532067385344', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:43:00,545::task::595::TaskManager.Task::(_updateState) Task=`5c187def-952e-4297-9c42-84d5a140e749`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-10 09:43:00,545::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee': < ResourceRef 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-10 09:43:00,545::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-10 09:43:00,546::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' >Thread-34::DEBUG::2014-07-10 09:43:00,546::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' (0 active users) >Thread-34::DEBUG::2014-07-10 09:43:00,546::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-10 09:43:00,546::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', Clearing records. >Thread-34::DEBUG::2014-07-10 09:43:00,546::task::990::TaskManager.Task::(_decref) Task=`5c187def-952e-4297-9c42-84d5a140e749`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 09:43:00,595::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:43:00,682::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0299352 s, 34.2 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:43:02,697::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:43:02,785::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0292876 s, 35.0 MB/s\n'; <rc> = 0 >Thread-54::DEBUG::2014-07-10 09:43:02,915::task::595::TaskManager.Task::(_updateState) Task=`7b0dbb3f-73a7-4cb7-849e-ccd11da237ed`::moving from state init -> state preparing >Thread-73::DEBUG::2014-07-10 09:43:02,923::task::595::TaskManager.Task::(_updateState) Task=`5fbab2a7-f8ba-496d-8f26-a8ae104d481a`::moving from state init -> state preparing >Thread-54::INFO::2014-07-10 09:43:02,930::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='28408446-e5fd-4565-a976-e760951593fe', volUUID='776303a2-5585-451e-826e-0e338d4a1e98', options=None) >Thread-73::INFO::2014-07-10 09:43:02,934::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='c01d693b-cba0-4fed-9ad7-0aaa28912a19', volUUID='4bb5d954-2a50-4028-b299-0b43c261270c', options=None) >Thread-54::INFO::2014-07-10 09:43:02,940::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-73::INFO::2014-07-10 09:43:02,947::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-54::DEBUG::2014-07-10 09:43:02,948::task::1185::TaskManager.Task::(prepare) Task=`7b0dbb3f-73a7-4cb7-849e-ccd11da237ed`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-73::DEBUG::2014-07-10 09:43:02,956::task::1185::TaskManager.Task::(prepare) Task=`5fbab2a7-f8ba-496d-8f26-a8ae104d481a`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-54::DEBUG::2014-07-10 09:43:02,959::task::595::TaskManager.Task::(_updateState) Task=`7b0dbb3f-73a7-4cb7-849e-ccd11da237ed`::moving from state preparing -> state finished >Thread-54::DEBUG::2014-07-10 09:43:02,967::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-73::DEBUG::2014-07-10 09:43:02,966::task::595::TaskManager.Task::(_updateState) Task=`5fbab2a7-f8ba-496d-8f26-a8ae104d481a`::moving from state preparing -> state finished >Thread-54::DEBUG::2014-07-10 09:43:02,973::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-73::DEBUG::2014-07-10 09:43:02,976::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-54::DEBUG::2014-07-10 09:43:02,987::task::990::TaskManager.Task::(_decref) Task=`7b0dbb3f-73a7-4cb7-849e-ccd11da237ed`::ref 0 aborting False >Thread-73::DEBUG::2014-07-10 09:43:02,991::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-73::DEBUG::2014-07-10 09:43:03,021::task::990::TaskManager.Task::(_decref) Task=`5fbab2a7-f8ba-496d-8f26-a8ae104d481a`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 09:43:04,802::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:43:04,898::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0340692 s, 30.1 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:43:06,914::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:43:07,002::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0300626 s, 34.1 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:43:09,017::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Thread-40::DEBUG::2014-07-10 09:43:09,035::domainMonitor::192::Storage.DomainMonitorThread::(_monitorDomain) Refreshing domain 6a70504d-00df-4869-8695-0f442053f6b6 >Thread-40::DEBUG::2014-07-10 09:43:09,069::fileSD::150::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/lion.qa.lab.tlv.redhat.com:_export_yuri2_backup2/6a70504d-00df-4869-8695-0f442053f6b6 >Thread-40::DEBUG::2014-07-10 09:43:09,071::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend >Thread-40::DEBUG::2014-07-10 09:43:09,074::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Backup', 'DESCRIPTION=test', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=0', 'POOL_UUID=4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', 'REMOTE_PATH=lion.qa.lab.tlv.redhat.com:/export/yuri2/backup2', 'ROLE=Regular', 'SDUUID=6a70504d-00df-4869-8695-0f442053f6b6', 'TYPE=NFS', 'VERSION=0', '_SHA_CKSUM=aab6b8e901ec435cd5f9de3c9e3f8b45dca569e0'] >Thread-40::DEBUG::2014-07-10 09:43:09,076::fileSD::609::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images [] >Thread-40::INFO::2014-07-10 09:43:09,076::sd::384::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 6a70504d-00df-4869-8695-0f442053f6b6_imageNS already registered >Thread-40::INFO::2014-07-10 09:43:09,076::sd::392::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 6a70504d-00df-4869-8695-0f442053f6b6_volumeNS already registered >Thread-40::DEBUG::2014-07-10 09:43:09,110::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lion.qa.lab.tlv.redhat.com:_export_yuri2_backup2/6a70504d-00df-4869-8695-0f442053f6b6/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-10 09:43:09,157::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/metadata bs=4096 count=1' (cwd None) >Thread-40::DEBUG::2014-07-10 09:43:09,203::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n369 bytes (369 B) copied, 0.000431015 s, 856 kB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-10 09:43:09,289::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000532592 s, 7.7 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 09:43:09,617::task::595::TaskManager.Task::(_updateState) Task=`daf3cc26-ae49-4ac0-89eb-d6257c6e42d7`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 09:43:09,623::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::INFO::2014-07-10 09:43:09,631::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000704279', 'lastCheck': '10.5', 'valid': True}, '6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000431015', 'lastCheck': '0.4', 'valid': True}} >Thread-14::DEBUG::2014-07-10 09:43:09,636::task::1185::TaskManager.Task::(prepare) Task=`daf3cc26-ae49-4ac0-89eb-d6257c6e42d7`::finished: {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000704279', 'lastCheck': '10.5', 'valid': True}, '6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000431015', 'lastCheck': '0.4', 'valid': True}} >Thread-14::DEBUG::2014-07-10 09:43:09,641::task::595::TaskManager.Task::(_updateState) Task=`daf3cc26-ae49-4ac0-89eb-d6257c6e42d7`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 09:43:09,647::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 09:43:09,651::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 09:43:09,657::task::990::TaskManager.Task::(_decref) Task=`daf3cc26-ae49-4ac0-89eb-d6257c6e42d7`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 09:43:09,855::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.432994 s, 2.4 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 09:43:10,576::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-14::DEBUG::2014-07-10 09:43:10,577::task::595::TaskManager.Task::(_updateState) Task=`018146a5-bf91-4679-b2a3-82f1e857190c`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 09:43:10,577::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-14::INFO::2014-07-10 09:43:10,578::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:43:10,578::task::1185::TaskManager.Task::(prepare) Task=`018146a5-bf91-4679-b2a3-82f1e857190c`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:43:10,578::task::595::TaskManager.Task::(_updateState) Task=`018146a5-bf91-4679-b2a3-82f1e857190c`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 09:43:10,578::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 09:43:10,579::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 09:43:10,579::task::990::TaskManager.Task::(_decref) Task=`018146a5-bf91-4679-b2a3-82f1e857190c`::ref 0 aborting False >Thread-34::DEBUG::2014-07-10 09:43:10,583::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-34::DEBUG::2014-07-10 09:43:10,583::task::595::TaskManager.Task::(_updateState) Task=`e19be083-54de-49ef-bc06-705d8a9fdcf1`::moving from state init -> state preparing >Thread-34::INFO::2014-07-10 09:43:10,584::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-34::DEBUG::2014-07-10 09:43:10,584::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`388b9d42-20f2-4b65-a16f-e50f3a0e127f`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-10 09:43:10,584::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' for lock type 'shared' >Thread-34::DEBUG::2014-07-10 09:43:10,585::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-10 09:43:10,585::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`388b9d42-20f2-4b65-a16f-e50f3a0e127f`::Granted request >Thread-34::DEBUG::2014-07-10 09:43:10,586::task::827::TaskManager.Task::(resourceAcquired) Task=`e19be083-54de-49ef-bc06-705d8a9fdcf1`::_resourcesAcquired: Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee (shared) >Thread-34::DEBUG::2014-07-10 09:43:10,586::task::990::TaskManager.Task::(_decref) Task=`e19be083-54de-49ef-bc06-705d8a9fdcf1`::ref 1 aborting False >Thread-34::INFO::2014-07-10 09:43:10,587::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532067385344', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:43:10,587::task::1185::TaskManager.Task::(prepare) Task=`e19be083-54de-49ef-bc06-705d8a9fdcf1`::finished: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532067385344', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:43:10,587::task::595::TaskManager.Task::(_updateState) Task=`e19be083-54de-49ef-bc06-705d8a9fdcf1`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-10 09:43:10,587::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee': < ResourceRef 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-10 09:43:10,588::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-10 09:43:10,588::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' >Thread-34::DEBUG::2014-07-10 09:43:10,588::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' (0 active users) >Thread-34::DEBUG::2014-07-10 09:43:10,588::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-10 09:43:10,588::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', Clearing records. >Thread-34::DEBUG::2014-07-10 09:43:10,589::task::990::TaskManager.Task::(_decref) Task=`e19be083-54de-49ef-bc06-705d8a9fdcf1`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 09:43:11,871::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:43:11,968::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0389638 s, 26.3 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:43:13,984::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:43:14,079::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0347808 s, 29.4 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:43:16,095::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:43:16,182::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0305613 s, 33.5 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:43:18,197::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:43:18,285::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.029947 s, 34.2 MB/s\n'; <rc> = 0 >Thread-40::DEBUG::2014-07-10 09:43:19,255::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lion.qa.lab.tlv.redhat.com:_export_yuri2_backup2/6a70504d-00df-4869-8695-0f442053f6b6/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-40::DEBUG::2014-07-10 09:43:19,294::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n369 bytes (369 B) copied, 0.000468628 s, 787 kB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-10 09:43:19,668::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/metadata bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-10 09:43:19,690::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000789874 s, 5.2 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:43:20,300::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:43:20,388::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0299973 s, 34.1 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 09:43:20,618::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-14::DEBUG::2014-07-10 09:43:20,619::task::595::TaskManager.Task::(_updateState) Task=`f7ade5cd-4305-40ed-b0f2-ca8c7fb51d17`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 09:43:20,620::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-14::INFO::2014-07-10 09:43:20,620::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:43:20,621::task::1185::TaskManager.Task::(prepare) Task=`f7ade5cd-4305-40ed-b0f2-ca8c7fb51d17`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:43:20,621::task::595::TaskManager.Task::(_updateState) Task=`f7ade5cd-4305-40ed-b0f2-ca8c7fb51d17`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 09:43:20,621::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 09:43:20,621::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 09:43:20,621::task::990::TaskManager.Task::(_decref) Task=`f7ade5cd-4305-40ed-b0f2-ca8c7fb51d17`::ref 0 aborting False >Thread-34::DEBUG::2014-07-10 09:43:20,626::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-34::DEBUG::2014-07-10 09:43:20,626::task::595::TaskManager.Task::(_updateState) Task=`0c7944d1-03e1-45df-a9d2-960cb863e9a2`::moving from state init -> state preparing >Thread-34::INFO::2014-07-10 09:43:20,626::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-34::DEBUG::2014-07-10 09:43:20,627::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`e267f8bf-4292-4689-8aa3-a3d3a319f711`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-10 09:43:20,627::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' for lock type 'shared' >Thread-34::DEBUG::2014-07-10 09:43:20,628::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-10 09:43:20,628::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`e267f8bf-4292-4689-8aa3-a3d3a319f711`::Granted request >Thread-34::DEBUG::2014-07-10 09:43:20,628::task::827::TaskManager.Task::(resourceAcquired) Task=`0c7944d1-03e1-45df-a9d2-960cb863e9a2`::_resourcesAcquired: Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee (shared) >Thread-34::DEBUG::2014-07-10 09:43:20,629::task::990::TaskManager.Task::(_decref) Task=`0c7944d1-03e1-45df-a9d2-960cb863e9a2`::ref 1 aborting False >Thread-34::INFO::2014-07-10 09:43:20,630::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532067385344', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:43:20,630::task::1185::TaskManager.Task::(prepare) Task=`0c7944d1-03e1-45df-a9d2-960cb863e9a2`::finished: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532067385344', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:43:20,630::task::595::TaskManager.Task::(_updateState) Task=`0c7944d1-03e1-45df-a9d2-960cb863e9a2`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-10 09:43:20,630::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee': < ResourceRef 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-10 09:43:20,631::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-10 09:43:20,631::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' >Thread-34::DEBUG::2014-07-10 09:43:20,631::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' (0 active users) >Thread-34::DEBUG::2014-07-10 09:43:20,631::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-10 09:43:20,632::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', Clearing records. >Thread-34::DEBUG::2014-07-10 09:43:20,632::task::990::TaskManager.Task::(_decref) Task=`0c7944d1-03e1-45df-a9d2-960cb863e9a2`::ref 0 aborting False >Thread-57::DEBUG::2014-07-10 09:43:20,854::task::595::TaskManager.Task::(_updateState) Task=`da6701ee-3c4f-4e13-a4ce-8d5f9a9f9e9b`::moving from state init -> state preparing >Thread-57::INFO::2014-07-10 09:43:20,855::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='b6f6c0da-e67f-4902-b9ac-3069571a42fe', volUUID='c4cd1da8-05b7-45e0-80b1-1183d21443d9', options=None) >Thread-57::INFO::2014-07-10 09:43:20,855::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-57::DEBUG::2014-07-10 09:43:20,856::task::1185::TaskManager.Task::(prepare) Task=`da6701ee-3c4f-4e13-a4ce-8d5f9a9f9e9b`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-57::DEBUG::2014-07-10 09:43:20,856::task::595::TaskManager.Task::(_updateState) Task=`da6701ee-3c4f-4e13-a4ce-8d5f9a9f9e9b`::moving from state preparing -> state finished >Thread-57::DEBUG::2014-07-10 09:43:20,856::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-57::DEBUG::2014-07-10 09:43:20,856::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-57::DEBUG::2014-07-10 09:43:20,856::task::990::TaskManager.Task::(_decref) Task=`da6701ee-3c4f-4e13-a4ce-8d5f9a9f9e9b`::ref 0 aborting False >Thread-67::DEBUG::2014-07-10 09:43:21,351::task::595::TaskManager.Task::(_updateState) Task=`b69e2bab-467f-4a9c-b2c1-7fe07939c58e`::moving from state init -> state preparing >Thread-67::INFO::2014-07-10 09:43:21,351::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='f30c2cb7-a43a-4bf5-82b5-cfe07336f65c', volUUID='b0fbb3c9-55af-4a3a-95ad-fc56a80b9cf5', options=None) >Thread-67::INFO::2014-07-10 09:43:21,352::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-67::DEBUG::2014-07-10 09:43:21,352::task::1185::TaskManager.Task::(prepare) Task=`b69e2bab-467f-4a9c-b2c1-7fe07939c58e`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-67::DEBUG::2014-07-10 09:43:21,352::task::595::TaskManager.Task::(_updateState) Task=`b69e2bab-467f-4a9c-b2c1-7fe07939c58e`::moving from state preparing -> state finished >Thread-67::DEBUG::2014-07-10 09:43:21,352::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-67::DEBUG::2014-07-10 09:43:21,352::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-67::DEBUG::2014-07-10 09:43:21,353::task::990::TaskManager.Task::(_decref) Task=`b69e2bab-467f-4a9c-b2c1-7fe07939c58e`::ref 0 aborting False >Thread-48::DEBUG::2014-07-10 09:43:21,873::task::595::TaskManager.Task::(_updateState) Task=`17c7926f-e107-4640-9e83-7e52028b3318`::moving from state init -> state preparing >Thread-48::INFO::2014-07-10 09:43:21,874::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='0cd7d6ce-f497-4243-a690-c57744861eea', volUUID='10b6a7dd-dc6c-43fa-ba17-92e4331b0e0b', options=None) >Thread-48::INFO::2014-07-10 09:43:21,874::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-48::DEBUG::2014-07-10 09:43:21,874::task::1185::TaskManager.Task::(prepare) Task=`17c7926f-e107-4640-9e83-7e52028b3318`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-48::DEBUG::2014-07-10 09:43:21,875::task::595::TaskManager.Task::(_updateState) Task=`17c7926f-e107-4640-9e83-7e52028b3318`::moving from state preparing -> state finished >Thread-48::DEBUG::2014-07-10 09:43:21,875::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-48::DEBUG::2014-07-10 09:43:21,875::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-48::DEBUG::2014-07-10 09:43:21,875::task::990::TaskManager.Task::(_decref) Task=`17c7926f-e107-4640-9e83-7e52028b3318`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 09:43:22,403::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:43:22,510::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0334527 s, 30.6 MB/s\n'; <rc> = 0 >Thread-76::DEBUG::2014-07-10 09:43:23,345::task::595::TaskManager.Task::(_updateState) Task=`155ece6c-03d2-4e2a-b0ae-1421f5f8fb71`::moving from state init -> state preparing >Thread-76::INFO::2014-07-10 09:43:23,346::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='e4c65229-4247-4b33-b72a-f1d5ce72ad05', volUUID='cad94284-3ca9-4c30-933d-997f4460309e', options=None) >Thread-76::INFO::2014-07-10 09:43:23,346::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-76::DEBUG::2014-07-10 09:43:23,346::task::1185::TaskManager.Task::(prepare) Task=`155ece6c-03d2-4e2a-b0ae-1421f5f8fb71`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-76::DEBUG::2014-07-10 09:43:23,346::task::595::TaskManager.Task::(_updateState) Task=`155ece6c-03d2-4e2a-b0ae-1421f5f8fb71`::moving from state preparing -> state finished >Thread-76::DEBUG::2014-07-10 09:43:23,347::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-76::DEBUG::2014-07-10 09:43:23,347::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-76::DEBUG::2014-07-10 09:43:23,347::task::990::TaskManager.Task::(_decref) Task=`155ece6c-03d2-4e2a-b0ae-1421f5f8fb71`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 09:43:24,527::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:43:24,692::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0869165 s, 11.8 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 09:43:24,994::task::595::TaskManager.Task::(_updateState) Task=`7f9d2e98-65d8-4012-a645-67af1b1c81b3`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 09:43:24,994::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::INFO::2014-07-10 09:43:24,995::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000789874', 'lastCheck': '5.3', 'valid': True}, '6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000468628', 'lastCheck': '5.7', 'valid': True}} >Thread-14::DEBUG::2014-07-10 09:43:24,995::task::1185::TaskManager.Task::(prepare) Task=`7f9d2e98-65d8-4012-a645-67af1b1c81b3`::finished: {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000789874', 'lastCheck': '5.3', 'valid': True}, '6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000468628', 'lastCheck': '5.7', 'valid': True}} >Thread-14::DEBUG::2014-07-10 09:43:24,995::task::595::TaskManager.Task::(_updateState) Task=`7f9d2e98-65d8-4012-a645-67af1b1c81b3`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 09:43:24,995::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 09:43:24,996::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 09:43:24,996::task::990::TaskManager.Task::(_decref) Task=`7f9d2e98-65d8-4012-a645-67af1b1c81b3`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 09:43:26,707::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:43:26,799::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0267311 s, 38.3 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:43:28,815::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:43:28,915::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0420352 s, 24.4 MB/s\n'; <rc> = 0 >Thread-40::DEBUG::2014-07-10 09:43:29,320::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lion.qa.lab.tlv.redhat.com:_export_yuri2_backup2/6a70504d-00df-4869-8695-0f442053f6b6/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-40::DEBUG::2014-07-10 09:43:29,340::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n369 bytes (369 B) copied, 0.000472007 s, 782 kB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-10 09:43:29,719::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/metadata bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-10 09:43:29,739::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000654 s, 6.3 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 09:43:30,668::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-14::DEBUG::2014-07-10 09:43:30,669::task::595::TaskManager.Task::(_updateState) Task=`7d2d2147-459f-46b6-9335-33ca078db449`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 09:43:30,669::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-14::INFO::2014-07-10 09:43:30,670::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:43:30,670::task::1185::TaskManager.Task::(prepare) Task=`7d2d2147-459f-46b6-9335-33ca078db449`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:43:30,670::task::595::TaskManager.Task::(_updateState) Task=`7d2d2147-459f-46b6-9335-33ca078db449`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 09:43:30,670::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 09:43:30,670::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 09:43:30,671::task::990::TaskManager.Task::(_decref) Task=`7d2d2147-459f-46b6-9335-33ca078db449`::ref 0 aborting False >Thread-34::DEBUG::2014-07-10 09:43:30,675::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-34::DEBUG::2014-07-10 09:43:30,675::task::595::TaskManager.Task::(_updateState) Task=`6ac361a2-f369-4498-ab89-64b88a21a99c`::moving from state init -> state preparing >Thread-34::INFO::2014-07-10 09:43:30,675::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-34::DEBUG::2014-07-10 09:43:30,676::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`94e8b34f-5e9f-4e04-97c9-ecd75af37a04`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-10 09:43:30,676::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' for lock type 'shared' >Thread-34::DEBUG::2014-07-10 09:43:30,677::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-10 09:43:30,677::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`94e8b34f-5e9f-4e04-97c9-ecd75af37a04`::Granted request >Thread-34::DEBUG::2014-07-10 09:43:30,677::task::827::TaskManager.Task::(resourceAcquired) Task=`6ac361a2-f369-4498-ab89-64b88a21a99c`::_resourcesAcquired: Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee (shared) >Thread-34::DEBUG::2014-07-10 09:43:30,678::task::990::TaskManager.Task::(_decref) Task=`6ac361a2-f369-4498-ab89-64b88a21a99c`::ref 1 aborting False >Thread-34::INFO::2014-07-10 09:43:30,679::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532067385344', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:43:30,679::task::1185::TaskManager.Task::(prepare) Task=`6ac361a2-f369-4498-ab89-64b88a21a99c`::finished: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532067385344', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:43:30,679::task::595::TaskManager.Task::(_updateState) Task=`6ac361a2-f369-4498-ab89-64b88a21a99c`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-10 09:43:30,679::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee': < ResourceRef 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-10 09:43:30,680::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-10 09:43:30,680::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' >Thread-34::DEBUG::2014-07-10 09:43:30,680::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' (0 active users) >Thread-34::DEBUG::2014-07-10 09:43:30,680::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-10 09:43:30,681::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', Clearing records. >Thread-34::DEBUG::2014-07-10 09:43:30,681::task::990::TaskManager.Task::(_decref) Task=`6ac361a2-f369-4498-ab89-64b88a21a99c`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 09:43:30,938::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:43:31,029::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0331211 s, 30.9 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:43:33,044::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:43:33,149::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0475535 s, 21.5 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:43:35,164::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:43:35,264::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0319814 s, 32.0 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:43:37,279::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:43:37,364::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0266536 s, 38.4 MB/s\n'; <rc> = 0 >Thread-40::DEBUG::2014-07-10 09:43:39,371::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lion.qa.lab.tlv.redhat.com:_export_yuri2_backup2/6a70504d-00df-4869-8695-0f442053f6b6/dom_md/metadata bs=4096 count=1' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:43:39,399::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Thread-40::DEBUG::2014-07-10 09:43:39,422::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n369 bytes (369 B) copied, 0.00050073 s, 737 kB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:43:39,505::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0404542 s, 25.3 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-10 09:43:39,768::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/metadata bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-10 09:43:39,790::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000697058 s, 5.9 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 09:43:40,216::task::595::TaskManager.Task::(_updateState) Task=`07aae32f-c085-4271-bda1-9909dfa5ae72`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 09:43:40,216::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::INFO::2014-07-10 09:43:40,217::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000697058', 'lastCheck': '0.4', 'valid': True}, '6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00050073', 'lastCheck': '0.8', 'valid': True}} >Thread-14::DEBUG::2014-07-10 09:43:40,217::task::1185::TaskManager.Task::(prepare) Task=`07aae32f-c085-4271-bda1-9909dfa5ae72`::finished: {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000697058', 'lastCheck': '0.4', 'valid': True}, '6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00050073', 'lastCheck': '0.8', 'valid': True}} >Thread-14::DEBUG::2014-07-10 09:43:40,217::task::595::TaskManager.Task::(_updateState) Task=`07aae32f-c085-4271-bda1-9909dfa5ae72`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 09:43:40,217::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 09:43:40,218::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 09:43:40,218::task::990::TaskManager.Task::(_decref) Task=`07aae32f-c085-4271-bda1-9909dfa5ae72`::ref 0 aborting False >Thread-70::DEBUG::2014-07-10 09:43:40,561::task::595::TaskManager.Task::(_updateState) Task=`032dba14-9662-4ab4-a705-94866deb319f`::moving from state init -> state preparing >Thread-70::INFO::2014-07-10 09:43:40,561::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='cfaeead2-7caa-467c-b389-c89840ae6605', volUUID='567fe32d-31a6-4ff6-90f3-fd6a656fbecc', options=None) >Thread-70::INFO::2014-07-10 09:43:40,562::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-70::DEBUG::2014-07-10 09:43:40,562::task::1185::TaskManager.Task::(prepare) Task=`032dba14-9662-4ab4-a705-94866deb319f`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-70::DEBUG::2014-07-10 09:43:40,562::task::595::TaskManager.Task::(_updateState) Task=`032dba14-9662-4ab4-a705-94866deb319f`::moving from state preparing -> state finished >Thread-70::DEBUG::2014-07-10 09:43:40,562::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-70::DEBUG::2014-07-10 09:43:40,562::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-70::DEBUG::2014-07-10 09:43:40,563::task::990::TaskManager.Task::(_decref) Task=`032dba14-9662-4ab4-a705-94866deb319f`::ref 0 aborting False >Thread-14::DEBUG::2014-07-10 09:43:40,710::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-14::DEBUG::2014-07-10 09:43:40,711::task::595::TaskManager.Task::(_updateState) Task=`c0303872-dae0-4ba6-ac5e-04b2f8f7218c`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 09:43:40,711::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-14::INFO::2014-07-10 09:43:40,711::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:43:40,712::task::1185::TaskManager.Task::(prepare) Task=`c0303872-dae0-4ba6-ac5e-04b2f8f7218c`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:43:40,712::task::595::TaskManager.Task::(_updateState) Task=`c0303872-dae0-4ba6-ac5e-04b2f8f7218c`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 09:43:40,712::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 09:43:40,712::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 09:43:40,712::task::990::TaskManager.Task::(_decref) Task=`c0303872-dae0-4ba6-ac5e-04b2f8f7218c`::ref 0 aborting False >Thread-34::DEBUG::2014-07-10 09:43:40,755::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-34::DEBUG::2014-07-10 09:43:40,756::task::595::TaskManager.Task::(_updateState) Task=`b9f34eab-c852-49db-adf3-d1d00621e3f7`::moving from state init -> state preparing >Thread-34::INFO::2014-07-10 09:43:40,756::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-34::DEBUG::2014-07-10 09:43:40,757::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`139cc692-c6e2-4b5d-90b1-077163680a8d`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-10 09:43:40,757::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' for lock type 'shared' >Thread-34::DEBUG::2014-07-10 09:43:40,757::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-10 09:43:40,757::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`139cc692-c6e2-4b5d-90b1-077163680a8d`::Granted request >Thread-34::DEBUG::2014-07-10 09:43:40,758::task::827::TaskManager.Task::(resourceAcquired) Task=`b9f34eab-c852-49db-adf3-d1d00621e3f7`::_resourcesAcquired: Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee (shared) >Thread-34::DEBUG::2014-07-10 09:43:40,758::task::990::TaskManager.Task::(_decref) Task=`b9f34eab-c852-49db-adf3-d1d00621e3f7`::ref 1 aborting False >Thread-34::INFO::2014-07-10 09:43:40,759::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532067385344', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:43:40,759::task::1185::TaskManager.Task::(prepare) Task=`b9f34eab-c852-49db-adf3-d1d00621e3f7`::finished: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532067385344', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:43:40,760::task::595::TaskManager.Task::(_updateState) Task=`b9f34eab-c852-49db-adf3-d1d00621e3f7`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-10 09:43:40,760::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee': < ResourceRef 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-10 09:43:40,760::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-10 09:43:40,761::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' >Thread-34::DEBUG::2014-07-10 09:43:40,761::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' (0 active users) >Thread-34::DEBUG::2014-07-10 09:43:40,761::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-10 09:43:40,761::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', Clearing records. >Thread-34::DEBUG::2014-07-10 09:43:40,761::task::990::TaskManager.Task::(_decref) Task=`b9f34eab-c852-49db-adf3-d1d00621e3f7`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 09:43:41,520::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:43:41,621::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0279972 s, 36.6 MB/s\n'; <rc> = 0 >Thread-51::DEBUG::2014-07-10 09:43:41,849::task::595::TaskManager.Task::(_updateState) Task=`beaab386-f146-487e-bd4d-71f9b90a5800`::moving from state init -> state preparing >Thread-51::INFO::2014-07-10 09:43:41,852::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='76fdb054-02cd-42ed-9721-b3e65b34c3a4', volUUID='022dfe46-2cf7-4915-80b3-883158e3ca83', options=None) >Thread-60::DEBUG::2014-07-10 09:43:41,853::task::595::TaskManager.Task::(_updateState) Task=`4a13da47-4c36-4fa8-8e26-6fd03fe5bbb5`::moving from state init -> state preparing >Thread-60::INFO::2014-07-10 09:43:41,857::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='b034d5b0-e1e0-4011-b49b-4d45ddb11556', volUUID='3d7f62b5-328f-4d8e-8b69-873cfb5ae14d', options=None) >Thread-51::INFO::2014-07-10 09:43:41,858::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-60::INFO::2014-07-10 09:43:41,861::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-51::DEBUG::2014-07-10 09:43:41,862::task::1185::TaskManager.Task::(prepare) Task=`beaab386-f146-487e-bd4d-71f9b90a5800`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-60::DEBUG::2014-07-10 09:43:41,864::task::1185::TaskManager.Task::(prepare) Task=`4a13da47-4c36-4fa8-8e26-6fd03fe5bbb5`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-51::DEBUG::2014-07-10 09:43:41,866::task::595::TaskManager.Task::(_updateState) Task=`beaab386-f146-487e-bd4d-71f9b90a5800`::moving from state preparing -> state finished >Thread-60::DEBUG::2014-07-10 09:43:41,867::task::595::TaskManager.Task::(_updateState) Task=`4a13da47-4c36-4fa8-8e26-6fd03fe5bbb5`::moving from state preparing -> state finished >Thread-51::DEBUG::2014-07-10 09:43:41,869::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-60::DEBUG::2014-07-10 09:43:41,870::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-51::DEBUG::2014-07-10 09:43:41,873::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-60::DEBUG::2014-07-10 09:43:41,873::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-51::DEBUG::2014-07-10 09:43:41,877::task::990::TaskManager.Task::(_decref) Task=`beaab386-f146-487e-bd4d-71f9b90a5800`::ref 0 aborting False >Thread-60::DEBUG::2014-07-10 09:43:41,877::task::990::TaskManager.Task::(_decref) Task=`4a13da47-4c36-4fa8-8e26-6fd03fe5bbb5`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 09:43:43,636::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:43:43,730::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0349263 s, 29.3 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:43:45,772::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:43:45,861::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0323067 s, 31.7 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:43:47,876::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:43:47,974::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0345201 s, 29.7 MB/s\n'; <rc> = 0 >Thread-40::DEBUG::2014-07-10 09:43:49,457::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lion.qa.lab.tlv.redhat.com:_export_yuri2_backup2/6a70504d-00df-4869-8695-0f442053f6b6/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-40::DEBUG::2014-07-10 09:43:49,478::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n369 bytes (369 B) copied, 0.000373293 s, 988 kB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-10 09:43:49,820::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/metadata bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-10 09:43:49,842::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000830924 s, 4.9 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:43:49,990::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:43:50,086::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0387249 s, 26.4 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 09:43:50,785::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-14::DEBUG::2014-07-10 09:43:50,787::task::595::TaskManager.Task::(_updateState) Task=`f66a09ee-63b3-4523-9a83-ef6d63814444`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 09:43:50,787::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-14::INFO::2014-07-10 09:43:50,788::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:43:50,788::task::1185::TaskManager.Task::(prepare) Task=`f66a09ee-63b3-4523-9a83-ef6d63814444`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:43:50,788::task::595::TaskManager.Task::(_updateState) Task=`f66a09ee-63b3-4523-9a83-ef6d63814444`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 09:43:50,788::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 09:43:50,788::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 09:43:50,789::task::990::TaskManager.Task::(_decref) Task=`f66a09ee-63b3-4523-9a83-ef6d63814444`::ref 0 aborting False >Thread-34::DEBUG::2014-07-10 09:43:50,793::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-34::DEBUG::2014-07-10 09:43:50,793::task::595::TaskManager.Task::(_updateState) Task=`9ddfb0ff-4966-418a-aa68-ab6627b93079`::moving from state init -> state preparing >Thread-34::INFO::2014-07-10 09:43:50,793::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-34::DEBUG::2014-07-10 09:43:50,794::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`0e6595f2-98f9-458c-89f4-04fbb32109e7`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-10 09:43:50,794::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' for lock type 'shared' >Thread-34::DEBUG::2014-07-10 09:43:50,795::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-10 09:43:50,795::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`0e6595f2-98f9-458c-89f4-04fbb32109e7`::Granted request >Thread-34::DEBUG::2014-07-10 09:43:50,795::task::827::TaskManager.Task::(resourceAcquired) Task=`9ddfb0ff-4966-418a-aa68-ab6627b93079`::_resourcesAcquired: Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee (shared) >Thread-34::DEBUG::2014-07-10 09:43:50,795::task::990::TaskManager.Task::(_decref) Task=`9ddfb0ff-4966-418a-aa68-ab6627b93079`::ref 1 aborting False >Thread-34::INFO::2014-07-10 09:43:50,797::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532067385344', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:43:50,797::task::1185::TaskManager.Task::(prepare) Task=`9ddfb0ff-4966-418a-aa68-ab6627b93079`::finished: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532067385344', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:43:50,797::task::595::TaskManager.Task::(_updateState) Task=`9ddfb0ff-4966-418a-aa68-ab6627b93079`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-10 09:43:50,797::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee': < ResourceRef 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-10 09:43:50,797::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-10 09:43:50,797::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' >Thread-34::DEBUG::2014-07-10 09:43:50,798::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' (0 active users) >Thread-34::DEBUG::2014-07-10 09:43:50,798::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-10 09:43:50,798::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', Clearing records. >Thread-34::DEBUG::2014-07-10 09:43:50,798::task::990::TaskManager.Task::(_decref) Task=`9ddfb0ff-4966-418a-aa68-ab6627b93079`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 09:43:52,104::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:43:52,216::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0485055 s, 21.1 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:43:54,231::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:43:54,322::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0332832 s, 30.8 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 09:43:55,423::task::595::TaskManager.Task::(_updateState) Task=`623b282f-b4fe-43d9-979e-7c77a83021af`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 09:43:55,423::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::INFO::2014-07-10 09:43:55,424::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000830924', 'lastCheck': '5.6', 'valid': True}, '6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000373293', 'lastCheck': '5.9', 'valid': True}} >Thread-14::DEBUG::2014-07-10 09:43:55,424::task::1185::TaskManager.Task::(prepare) Task=`623b282f-b4fe-43d9-979e-7c77a83021af`::finished: {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000830924', 'lastCheck': '5.6', 'valid': True}, '6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000373293', 'lastCheck': '5.9', 'valid': True}} >Thread-14::DEBUG::2014-07-10 09:43:55,424::task::595::TaskManager.Task::(_updateState) Task=`623b282f-b4fe-43d9-979e-7c77a83021af`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 09:43:55,424::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 09:43:55,425::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 09:43:55,425::task::990::TaskManager.Task::(_decref) Task=`623b282f-b4fe-43d9-979e-7c77a83021af`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 09:43:56,337::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:43:56,425::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0295171 s, 34.7 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:43:58,441::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:43:58,597::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0643205 s, 15.9 MB/s\n'; <rc> = 0 >Thread-40::DEBUG::2014-07-10 09:43:59,504::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lion.qa.lab.tlv.redhat.com:_export_yuri2_backup2/6a70504d-00df-4869-8695-0f442053f6b6/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-40::DEBUG::2014-07-10 09:43:59,525::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n369 bytes (369 B) copied, 0.000468535 s, 788 kB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-10 09:43:59,872::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/metadata bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-10 09:43:59,893::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000566362 s, 7.2 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:44:00,620::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Thread-64::DEBUG::2014-07-10 09:44:00,652::task::595::TaskManager.Task::(_updateState) Task=`70aa3a91-cf52-4b22-af23-a2b63d25e536`::moving from state init -> state preparing >Thread-64::INFO::2014-07-10 09:44:00,661::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='aa20346a-4d3a-4e07-b8e1-52c0ebe4168c', volUUID='58fefce2-9bce-4bff-8949-8c6ce8122b27', options=None) >Thread-64::INFO::2014-07-10 09:44:00,664::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-64::DEBUG::2014-07-10 09:44:00,666::task::1185::TaskManager.Task::(prepare) Task=`70aa3a91-cf52-4b22-af23-a2b63d25e536`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-64::DEBUG::2014-07-10 09:44:00,668::task::595::TaskManager.Task::(_updateState) Task=`70aa3a91-cf52-4b22-af23-a2b63d25e536`::moving from state preparing -> state finished >Thread-64::DEBUG::2014-07-10 09:44:00,670::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-64::DEBUG::2014-07-10 09:44:00,672::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-64::DEBUG::2014-07-10 09:44:00,674::task::990::TaskManager.Task::(_decref) Task=`70aa3a91-cf52-4b22-af23-a2b63d25e536`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 09:44:00,746::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0656869 s, 15.6 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 09:44:00,835::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-14::DEBUG::2014-07-10 09:44:00,836::task::595::TaskManager.Task::(_updateState) Task=`33b69cad-396f-4383-ae42-d93f255e164b`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 09:44:00,836::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-14::INFO::2014-07-10 09:44:00,837::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:44:00,837::task::1185::TaskManager.Task::(prepare) Task=`33b69cad-396f-4383-ae42-d93f255e164b`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:44:00,837::task::595::TaskManager.Task::(_updateState) Task=`33b69cad-396f-4383-ae42-d93f255e164b`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 09:44:00,837::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 09:44:00,837::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 09:44:00,838::task::990::TaskManager.Task::(_decref) Task=`33b69cad-396f-4383-ae42-d93f255e164b`::ref 0 aborting False >Thread-34::DEBUG::2014-07-10 09:44:00,842::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-34::DEBUG::2014-07-10 09:44:00,842::task::595::TaskManager.Task::(_updateState) Task=`e4cd6414-a4f8-4296-a06f-2e2988062ba4`::moving from state init -> state preparing >Thread-34::INFO::2014-07-10 09:44:00,843::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-34::DEBUG::2014-07-10 09:44:00,843::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`f5b30af6-0cde-4068-89e2-0bfc9865d874`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-10 09:44:00,844::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' for lock type 'shared' >Thread-34::DEBUG::2014-07-10 09:44:00,844::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-10 09:44:00,844::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`f5b30af6-0cde-4068-89e2-0bfc9865d874`::Granted request >Thread-34::DEBUG::2014-07-10 09:44:00,845::task::827::TaskManager.Task::(resourceAcquired) Task=`e4cd6414-a4f8-4296-a06f-2e2988062ba4`::_resourcesAcquired: Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee (shared) >Thread-34::DEBUG::2014-07-10 09:44:00,845::task::990::TaskManager.Task::(_decref) Task=`e4cd6414-a4f8-4296-a06f-2e2988062ba4`::ref 1 aborting False >Thread-34::INFO::2014-07-10 09:44:00,846::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532067385344', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:44:00,846::task::1185::TaskManager.Task::(prepare) Task=`e4cd6414-a4f8-4296-a06f-2e2988062ba4`::finished: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532067385344', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:44:00,847::task::595::TaskManager.Task::(_updateState) Task=`e4cd6414-a4f8-4296-a06f-2e2988062ba4`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-10 09:44:00,847::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee': < ResourceRef 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-10 09:44:00,847::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-10 09:44:00,847::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' >Thread-34::DEBUG::2014-07-10 09:44:00,848::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' (0 active users) >Thread-34::DEBUG::2014-07-10 09:44:00,848::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-10 09:44:00,848::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', Clearing records. >Thread-34::DEBUG::2014-07-10 09:44:00,848::task::990::TaskManager.Task::(_decref) Task=`e4cd6414-a4f8-4296-a06f-2e2988062ba4`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 09:44:02,761::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:44:02,851::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0298811 s, 34.3 MB/s\n'; <rc> = 0 >Thread-54::DEBUG::2014-07-10 09:44:03,358::task::595::TaskManager.Task::(_updateState) Task=`ff53dc2d-7d86-4709-abad-006f89069bbb`::moving from state init -> state preparing >Thread-73::DEBUG::2014-07-10 09:44:03,359::task::595::TaskManager.Task::(_updateState) Task=`b147cf16-2b42-4655-928c-ad57ac3e50e5`::moving from state init -> state preparing >Thread-54::INFO::2014-07-10 09:44:03,360::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='28408446-e5fd-4565-a976-e760951593fe', volUUID='776303a2-5585-451e-826e-0e338d4a1e98', options=None) >Thread-73::INFO::2014-07-10 09:44:03,361::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='c01d693b-cba0-4fed-9ad7-0aaa28912a19', volUUID='4bb5d954-2a50-4028-b299-0b43c261270c', options=None) >Thread-54::INFO::2014-07-10 09:44:03,362::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-73::INFO::2014-07-10 09:44:03,362::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-54::DEBUG::2014-07-10 09:44:03,363::task::1185::TaskManager.Task::(prepare) Task=`ff53dc2d-7d86-4709-abad-006f89069bbb`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-73::DEBUG::2014-07-10 09:44:03,364::task::1185::TaskManager.Task::(prepare) Task=`b147cf16-2b42-4655-928c-ad57ac3e50e5`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-54::DEBUG::2014-07-10 09:44:03,364::task::595::TaskManager.Task::(_updateState) Task=`ff53dc2d-7d86-4709-abad-006f89069bbb`::moving from state preparing -> state finished >Thread-73::DEBUG::2014-07-10 09:44:03,365::task::595::TaskManager.Task::(_updateState) Task=`b147cf16-2b42-4655-928c-ad57ac3e50e5`::moving from state preparing -> state finished >Thread-54::DEBUG::2014-07-10 09:44:03,366::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-73::DEBUG::2014-07-10 09:44:03,366::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-54::DEBUG::2014-07-10 09:44:03,367::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-73::DEBUG::2014-07-10 09:44:03,367::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-54::DEBUG::2014-07-10 09:44:03,368::task::990::TaskManager.Task::(_decref) Task=`ff53dc2d-7d86-4709-abad-006f89069bbb`::ref 0 aborting False >Thread-73::DEBUG::2014-07-10 09:44:03,369::task::990::TaskManager.Task::(_decref) Task=`b147cf16-2b42-4655-928c-ad57ac3e50e5`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 09:44:04,866::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:44:04,960::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.035564 s, 28.8 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:44:06,976::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:44:07,071::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0279393 s, 36.7 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:44:09,087::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:44:09,175::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0305033 s, 33.6 MB/s\n'; <rc> = 0 >Thread-40::DEBUG::2014-07-10 09:44:09,555::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lion.qa.lab.tlv.redhat.com:_export_yuri2_backup2/6a70504d-00df-4869-8695-0f442053f6b6/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-40::DEBUG::2014-07-10 09:44:09,576::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n369 bytes (369 B) copied, 0.000472386 s, 781 kB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-10 09:44:09,922::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/metadata bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-10 09:44:09,943::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000500854 s, 8.2 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 09:44:10,626::task::595::TaskManager.Task::(_updateState) Task=`4ef6b2cd-bf9e-4d8a-bdd8-8250b1c834e8`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 09:44:10,627::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::INFO::2014-07-10 09:44:10,627::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000500854', 'lastCheck': '0.7', 'valid': True}, '6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000472386', 'lastCheck': '1.0', 'valid': True}} >Thread-14::DEBUG::2014-07-10 09:44:10,627::task::1185::TaskManager.Task::(prepare) Task=`4ef6b2cd-bf9e-4d8a-bdd8-8250b1c834e8`::finished: {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000500854', 'lastCheck': '0.7', 'valid': True}, '6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000472386', 'lastCheck': '1.0', 'valid': True}} >Thread-14::DEBUG::2014-07-10 09:44:10,627::task::595::TaskManager.Task::(_updateState) Task=`4ef6b2cd-bf9e-4d8a-bdd8-8250b1c834e8`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 09:44:10,628::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 09:44:10,628::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 09:44:10,628::task::990::TaskManager.Task::(_decref) Task=`4ef6b2cd-bf9e-4d8a-bdd8-8250b1c834e8`::ref 0 aborting False >Thread-14::DEBUG::2014-07-10 09:44:10,881::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-14::DEBUG::2014-07-10 09:44:10,882::task::595::TaskManager.Task::(_updateState) Task=`2fbd276d-ff2a-4bc8-853f-1d149bfb24f2`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 09:44:10,883::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-14::INFO::2014-07-10 09:44:10,883::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:44:10,883::task::1185::TaskManager.Task::(prepare) Task=`2fbd276d-ff2a-4bc8-853f-1d149bfb24f2`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:44:10,884::task::595::TaskManager.Task::(_updateState) Task=`2fbd276d-ff2a-4bc8-853f-1d149bfb24f2`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 09:44:10,884::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 09:44:10,884::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 09:44:10,884::task::990::TaskManager.Task::(_decref) Task=`2fbd276d-ff2a-4bc8-853f-1d149bfb24f2`::ref 0 aborting False >Thread-34::DEBUG::2014-07-10 09:44:10,888::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-34::DEBUG::2014-07-10 09:44:10,889::task::595::TaskManager.Task::(_updateState) Task=`cb03b83e-b59c-4f01-babf-9303d750a6c7`::moving from state init -> state preparing >Thread-34::INFO::2014-07-10 09:44:10,889::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-34::DEBUG::2014-07-10 09:44:10,890::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`5d81f9ee-0746-42b2-9d6b-408256e8a00c`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-10 09:44:10,890::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' for lock type 'shared' >Thread-34::DEBUG::2014-07-10 09:44:10,890::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-10 09:44:10,890::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`5d81f9ee-0746-42b2-9d6b-408256e8a00c`::Granted request >Thread-34::DEBUG::2014-07-10 09:44:10,891::task::827::TaskManager.Task::(resourceAcquired) Task=`cb03b83e-b59c-4f01-babf-9303d750a6c7`::_resourcesAcquired: Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee (shared) >Thread-34::DEBUG::2014-07-10 09:44:10,891::task::990::TaskManager.Task::(_decref) Task=`cb03b83e-b59c-4f01-babf-9303d750a6c7`::ref 1 aborting False >Thread-34::INFO::2014-07-10 09:44:10,892::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532067385344', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:44:10,892::task::1185::TaskManager.Task::(prepare) Task=`cb03b83e-b59c-4f01-babf-9303d750a6c7`::finished: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532067385344', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:44:10,893::task::595::TaskManager.Task::(_updateState) Task=`cb03b83e-b59c-4f01-babf-9303d750a6c7`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-10 09:44:10,893::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee': < ResourceRef 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-10 09:44:10,893::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-10 09:44:10,893::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' >Thread-34::DEBUG::2014-07-10 09:44:10,894::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' (0 active users) >Thread-34::DEBUG::2014-07-10 09:44:10,894::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-10 09:44:10,894::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', Clearing records. >Thread-34::DEBUG::2014-07-10 09:44:10,894::task::990::TaskManager.Task::(_decref) Task=`cb03b83e-b59c-4f01-babf-9303d750a6c7`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 09:44:11,190::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:44:11,352::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.105144 s, 9.7 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:44:13,362::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:44:13,453::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0311118 s, 32.9 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:44:15,469::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:44:15,562::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0277471 s, 36.9 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:44:17,577::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:44:17,668::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0323861 s, 31.6 MB/s\n'; <rc> = 0 >Thread-40::DEBUG::2014-07-10 09:44:19,607::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lion.qa.lab.tlv.redhat.com:_export_yuri2_backup2/6a70504d-00df-4869-8695-0f442053f6b6/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-40::DEBUG::2014-07-10 09:44:19,630::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n369 bytes (369 B) copied, 0.00037069 s, 995 kB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:44:19,683::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:44:19,773::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0329249 s, 31.1 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-10 09:44:19,972::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/metadata bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-10 09:44:19,995::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000673294 s, 6.1 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 09:44:20,919::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-14::DEBUG::2014-07-10 09:44:20,920::task::595::TaskManager.Task::(_updateState) Task=`edab5fc6-5528-4435-91d2-a1123ff18e9e`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 09:44:20,921::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-14::INFO::2014-07-10 09:44:20,921::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:44:20,921::task::1185::TaskManager.Task::(prepare) Task=`edab5fc6-5528-4435-91d2-a1123ff18e9e`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:44:20,922::task::595::TaskManager.Task::(_updateState) Task=`edab5fc6-5528-4435-91d2-a1123ff18e9e`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 09:44:20,922::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 09:44:20,922::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 09:44:20,922::task::990::TaskManager.Task::(_decref) Task=`edab5fc6-5528-4435-91d2-a1123ff18e9e`::ref 0 aborting False >Thread-34::DEBUG::2014-07-10 09:44:20,927::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-34::DEBUG::2014-07-10 09:44:20,927::task::595::TaskManager.Task::(_updateState) Task=`800dd6a8-36a3-4085-a26b-bcd03adb59f9`::moving from state init -> state preparing >Thread-34::INFO::2014-07-10 09:44:20,927::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-34::DEBUG::2014-07-10 09:44:20,928::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`eb7eaee2-545d-4ec2-80da-99e8b6d838c7`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-10 09:44:20,928::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' for lock type 'shared' >Thread-34::DEBUG::2014-07-10 09:44:20,929::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-10 09:44:20,929::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`eb7eaee2-545d-4ec2-80da-99e8b6d838c7`::Granted request >Thread-34::DEBUG::2014-07-10 09:44:20,929::task::827::TaskManager.Task::(resourceAcquired) Task=`800dd6a8-36a3-4085-a26b-bcd03adb59f9`::_resourcesAcquired: Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee (shared) >Thread-34::DEBUG::2014-07-10 09:44:20,930::task::990::TaskManager.Task::(_decref) Task=`800dd6a8-36a3-4085-a26b-bcd03adb59f9`::ref 1 aborting False >Thread-34::INFO::2014-07-10 09:44:20,931::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532067385344', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:44:20,931::task::1185::TaskManager.Task::(prepare) Task=`800dd6a8-36a3-4085-a26b-bcd03adb59f9`::finished: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532067385344', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:44:20,931::task::595::TaskManager.Task::(_updateState) Task=`800dd6a8-36a3-4085-a26b-bcd03adb59f9`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-10 09:44:20,931::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee': < ResourceRef 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-10 09:44:20,932::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-10 09:44:20,932::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' >Thread-34::DEBUG::2014-07-10 09:44:20,932::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' (0 active users) >Thread-34::DEBUG::2014-07-10 09:44:20,932::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-10 09:44:20,932::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', Clearing records. >Thread-34::DEBUG::2014-07-10 09:44:20,933::task::990::TaskManager.Task::(_decref) Task=`800dd6a8-36a3-4085-a26b-bcd03adb59f9`::ref 0 aborting False >Thread-57::DEBUG::2014-07-10 09:44:21,158::task::595::TaskManager.Task::(_updateState) Task=`b5f6cf12-11bf-4956-8c42-a18e6dfa8f30`::moving from state init -> state preparing >Thread-57::INFO::2014-07-10 09:44:21,158::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='b6f6c0da-e67f-4902-b9ac-3069571a42fe', volUUID='c4cd1da8-05b7-45e0-80b1-1183d21443d9', options=None) >Thread-57::INFO::2014-07-10 09:44:21,159::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-57::DEBUG::2014-07-10 09:44:21,159::task::1185::TaskManager.Task::(prepare) Task=`b5f6cf12-11bf-4956-8c42-a18e6dfa8f30`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-57::DEBUG::2014-07-10 09:44:21,159::task::595::TaskManager.Task::(_updateState) Task=`b5f6cf12-11bf-4956-8c42-a18e6dfa8f30`::moving from state preparing -> state finished >Thread-57::DEBUG::2014-07-10 09:44:21,159::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-57::DEBUG::2014-07-10 09:44:21,160::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-57::DEBUG::2014-07-10 09:44:21,160::task::990::TaskManager.Task::(_decref) Task=`b5f6cf12-11bf-4956-8c42-a18e6dfa8f30`::ref 0 aborting False >Thread-67::DEBUG::2014-07-10 09:44:21,638::task::595::TaskManager.Task::(_updateState) Task=`ec6b9ad4-3a53-4985-b57d-ee78bf033c7e`::moving from state init -> state preparing >Thread-67::INFO::2014-07-10 09:44:21,639::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='f30c2cb7-a43a-4bf5-82b5-cfe07336f65c', volUUID='b0fbb3c9-55af-4a3a-95ad-fc56a80b9cf5', options=None) >Thread-67::INFO::2014-07-10 09:44:21,640::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-67::DEBUG::2014-07-10 09:44:21,640::task::1185::TaskManager.Task::(prepare) Task=`ec6b9ad4-3a53-4985-b57d-ee78bf033c7e`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-67::DEBUG::2014-07-10 09:44:21,640::task::595::TaskManager.Task::(_updateState) Task=`ec6b9ad4-3a53-4985-b57d-ee78bf033c7e`::moving from state preparing -> state finished >Thread-67::DEBUG::2014-07-10 09:44:21,640::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-67::DEBUG::2014-07-10 09:44:21,641::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-67::DEBUG::2014-07-10 09:44:21,641::task::990::TaskManager.Task::(_decref) Task=`ec6b9ad4-3a53-4985-b57d-ee78bf033c7e`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 09:44:21,789::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:44:21,882::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0351809 s, 29.1 MB/s\n'; <rc> = 0 >Thread-48::DEBUG::2014-07-10 09:44:22,142::task::595::TaskManager.Task::(_updateState) Task=`1eadc001-fd2f-4e28-941b-a39afaf92a60`::moving from state init -> state preparing >Thread-48::INFO::2014-07-10 09:44:22,142::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='0cd7d6ce-f497-4243-a690-c57744861eea', volUUID='10b6a7dd-dc6c-43fa-ba17-92e4331b0e0b', options=None) >Thread-48::INFO::2014-07-10 09:44:22,143::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-48::DEBUG::2014-07-10 09:44:22,143::task::1185::TaskManager.Task::(prepare) Task=`1eadc001-fd2f-4e28-941b-a39afaf92a60`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-48::DEBUG::2014-07-10 09:44:22,143::task::595::TaskManager.Task::(_updateState) Task=`1eadc001-fd2f-4e28-941b-a39afaf92a60`::moving from state preparing -> state finished >Thread-48::DEBUG::2014-07-10 09:44:22,143::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-48::DEBUG::2014-07-10 09:44:22,144::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-48::DEBUG::2014-07-10 09:44:22,144::task::990::TaskManager.Task::(_decref) Task=`1eadc001-fd2f-4e28-941b-a39afaf92a60`::ref 0 aborting False >Thread-76::DEBUG::2014-07-10 09:44:23,644::task::595::TaskManager.Task::(_updateState) Task=`e7df012a-0143-4d28-b0af-b3d5f6d14a23`::moving from state init -> state preparing >Thread-76::INFO::2014-07-10 09:44:23,645::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='e4c65229-4247-4b33-b72a-f1d5ce72ad05', volUUID='cad94284-3ca9-4c30-933d-997f4460309e', options=None) >Thread-76::INFO::2014-07-10 09:44:23,645::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-76::DEBUG::2014-07-10 09:44:23,646::task::1185::TaskManager.Task::(prepare) Task=`e7df012a-0143-4d28-b0af-b3d5f6d14a23`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-76::DEBUG::2014-07-10 09:44:23,646::task::595::TaskManager.Task::(_updateState) Task=`e7df012a-0143-4d28-b0af-b3d5f6d14a23`::moving from state preparing -> state finished >Thread-76::DEBUG::2014-07-10 09:44:23,646::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-76::DEBUG::2014-07-10 09:44:23,646::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-76::DEBUG::2014-07-10 09:44:23,646::task::990::TaskManager.Task::(_decref) Task=`e7df012a-0143-4d28-b0af-b3d5f6d14a23`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 09:44:23,897::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:44:23,986::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.029832 s, 34.3 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 09:44:25,821::task::595::TaskManager.Task::(_updateState) Task=`fc09db12-1962-403d-a7f6-a270b3715f28`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 09:44:25,821::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::INFO::2014-07-10 09:44:25,822::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000673294', 'lastCheck': '5.8', 'valid': True}, '6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00037069', 'lastCheck': '6.2', 'valid': True}} >Thread-14::DEBUG::2014-07-10 09:44:25,822::task::1185::TaskManager.Task::(prepare) Task=`fc09db12-1962-403d-a7f6-a270b3715f28`::finished: {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000673294', 'lastCheck': '5.8', 'valid': True}, '6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00037069', 'lastCheck': '6.2', 'valid': True}} >Thread-14::DEBUG::2014-07-10 09:44:25,822::task::595::TaskManager.Task::(_updateState) Task=`fc09db12-1962-403d-a7f6-a270b3715f28`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 09:44:25,823::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 09:44:25,823::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 09:44:25,823::task::990::TaskManager.Task::(_decref) Task=`fc09db12-1962-403d-a7f6-a270b3715f28`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 09:44:26,002::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:44:26,097::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.034275 s, 29.9 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:44:28,111::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:44:28,220::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0357447 s, 28.6 MB/s\n'; <rc> = 0 >Thread-40::DEBUG::2014-07-10 09:44:29,657::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lion.qa.lab.tlv.redhat.com:_export_yuri2_backup2/6a70504d-00df-4869-8695-0f442053f6b6/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-40::DEBUG::2014-07-10 09:44:29,678::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n369 bytes (369 B) copied, 0.000574473 s, 642 kB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-10 09:44:30,024::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/metadata bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-10 09:44:30,046::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00070301 s, 5.8 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:44:30,237::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:44:30,327::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0336789 s, 30.4 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 09:44:30,960::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-14::DEBUG::2014-07-10 09:44:30,961::task::595::TaskManager.Task::(_updateState) Task=`fe2c04cc-a6d3-4df9-9385-997e27cfb95b`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 09:44:30,962::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-14::INFO::2014-07-10 09:44:30,963::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:44:30,963::task::1185::TaskManager.Task::(prepare) Task=`fe2c04cc-a6d3-4df9-9385-997e27cfb95b`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:44:30,963::task::595::TaskManager.Task::(_updateState) Task=`fe2c04cc-a6d3-4df9-9385-997e27cfb95b`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 09:44:30,963::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 09:44:30,963::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 09:44:30,964::task::990::TaskManager.Task::(_decref) Task=`fe2c04cc-a6d3-4df9-9385-997e27cfb95b`::ref 0 aborting False >Thread-34::DEBUG::2014-07-10 09:44:30,968::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-34::DEBUG::2014-07-10 09:44:30,969::task::595::TaskManager.Task::(_updateState) Task=`258cec89-350d-451c-86df-10a8e2e21c52`::moving from state init -> state preparing >Thread-34::INFO::2014-07-10 09:44:30,969::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-34::DEBUG::2014-07-10 09:44:30,970::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`dafdc728-de94-4c51-975a-8cc33e049339`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-10 09:44:30,970::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' for lock type 'shared' >Thread-34::DEBUG::2014-07-10 09:44:30,970::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-10 09:44:30,970::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`dafdc728-de94-4c51-975a-8cc33e049339`::Granted request >Thread-34::DEBUG::2014-07-10 09:44:30,971::task::827::TaskManager.Task::(resourceAcquired) Task=`258cec89-350d-451c-86df-10a8e2e21c52`::_resourcesAcquired: Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee (shared) >Thread-34::DEBUG::2014-07-10 09:44:30,971::task::990::TaskManager.Task::(_decref) Task=`258cec89-350d-451c-86df-10a8e2e21c52`::ref 1 aborting False >Thread-34::INFO::2014-07-10 09:44:30,973::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532067385344', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:44:30,973::task::1185::TaskManager.Task::(prepare) Task=`258cec89-350d-451c-86df-10a8e2e21c52`::finished: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532067385344', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:44:30,973::task::595::TaskManager.Task::(_updateState) Task=`258cec89-350d-451c-86df-10a8e2e21c52`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-10 09:44:30,973::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee': < ResourceRef 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-10 09:44:30,973::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-10 09:44:30,974::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' >Thread-34::DEBUG::2014-07-10 09:44:30,974::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' (0 active users) >Thread-34::DEBUG::2014-07-10 09:44:30,974::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-10 09:44:30,974::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', Clearing records. >Thread-34::DEBUG::2014-07-10 09:44:30,975::task::990::TaskManager.Task::(_decref) Task=`258cec89-350d-451c-86df-10a8e2e21c52`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 09:44:32,342::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:44:32,448::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0299648 s, 34.2 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:44:34,678::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:44:34,771::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0360784 s, 28.4 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:44:36,786::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:44:36,884::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0377815 s, 27.1 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:44:38,900::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:44:38,988::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0297396 s, 34.4 MB/s\n'; <rc> = 0 >Thread-40::DEBUG::2014-07-10 09:44:39,709::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lion.qa.lab.tlv.redhat.com:_export_yuri2_backup2/6a70504d-00df-4869-8695-0f442053f6b6/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-40::DEBUG::2014-07-10 09:44:39,729::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n369 bytes (369 B) copied, 0.00045021 s, 820 kB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-10 09:44:40,075::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/metadata bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-10 09:44:40,098::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000757686 s, 5.4 MB/s\n'; <rc> = 0 >Thread-70::DEBUG::2014-07-10 09:44:40,836::task::595::TaskManager.Task::(_updateState) Task=`72799a9e-2273-40b8-91cf-9ee4160b8895`::moving from state init -> state preparing >Thread-70::INFO::2014-07-10 09:44:40,836::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='cfaeead2-7caa-467c-b389-c89840ae6605', volUUID='567fe32d-31a6-4ff6-90f3-fd6a656fbecc', options=None) >Thread-70::INFO::2014-07-10 09:44:40,837::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-70::DEBUG::2014-07-10 09:44:40,837::task::1185::TaskManager.Task::(prepare) Task=`72799a9e-2273-40b8-91cf-9ee4160b8895`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-70::DEBUG::2014-07-10 09:44:40,837::task::595::TaskManager.Task::(_updateState) Task=`72799a9e-2273-40b8-91cf-9ee4160b8895`::moving from state preparing -> state finished >Thread-70::DEBUG::2014-07-10 09:44:40,838::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-70::DEBUG::2014-07-10 09:44:40,838::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-70::DEBUG::2014-07-10 09:44:40,838::task::990::TaskManager.Task::(_decref) Task=`72799a9e-2273-40b8-91cf-9ee4160b8895`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 09:44:41,004::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Thread-14::DEBUG::2014-07-10 09:44:41,038::task::595::TaskManager.Task::(_updateState) Task=`bd743314-f12d-41c4-9d7e-4282fd6f4801`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 09:44:41,043::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::INFO::2014-07-10 09:44:41,046::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000757686', 'lastCheck': '0.9', 'valid': True}, '6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00045021', 'lastCheck': '1.3', 'valid': True}} >Thread-14::DEBUG::2014-07-10 09:44:41,048::task::1185::TaskManager.Task::(prepare) Task=`bd743314-f12d-41c4-9d7e-4282fd6f4801`::finished: {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000757686', 'lastCheck': '0.9', 'valid': True}, '6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00045021', 'lastCheck': '1.3', 'valid': True}} >Thread-14::DEBUG::2014-07-10 09:44:41,051::task::595::TaskManager.Task::(_updateState) Task=`bd743314-f12d-41c4-9d7e-4282fd6f4801`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 09:44:41,053::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 09:44:41,055::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 09:44:41,057::task::990::TaskManager.Task::(_decref) Task=`bd743314-f12d-41c4-9d7e-4282fd6f4801`::ref 0 aborting False >Thread-13::DEBUG::2014-07-10 09:44:41,109::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-13::DEBUG::2014-07-10 09:44:41,117::task::595::TaskManager.Task::(_updateState) Task=`228725d7-a6da-4800-93fd-d40831c45098`::moving from state init -> state preparing >Thread-13::INFO::2014-07-10 09:44:41,124::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-13::INFO::2014-07-10 09:44:41,133::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-13::DEBUG::2014-07-10 09:44:41,137::task::1185::TaskManager.Task::(prepare) Task=`228725d7-a6da-4800-93fd-d40831c45098`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-13::DEBUG::2014-07-10 09:44:41,142::task::595::TaskManager.Task::(_updateState) Task=`228725d7-a6da-4800-93fd-d40831c45098`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-07-10 09:44:41,147::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-07-10 09:44:41,152::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-07-10 09:44:41,158::task::990::TaskManager.Task::(_decref) Task=`228725d7-a6da-4800-93fd-d40831c45098`::ref 0 aborting False >Thread-34::DEBUG::2014-07-10 09:44:41,187::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-34::DEBUG::2014-07-10 09:44:41,194::task::595::TaskManager.Task::(_updateState) Task=`d54a6931-1b8c-40eb-8616-d0c1b2593d6a`::moving from state init -> state preparing >Thread-34::INFO::2014-07-10 09:44:41,197::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-34::DEBUG::2014-07-10 09:44:41,210::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`3b54a405-7e03-42f7-84f8-1470d857c02f`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-10 09:44:41,215::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' for lock type 'shared' >Thread-34::DEBUG::2014-07-10 09:44:41,223::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-10 09:44:41,227::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`3b54a405-7e03-42f7-84f8-1470d857c02f`::Granted request >Thread-34::DEBUG::2014-07-10 09:44:41,238::task::827::TaskManager.Task::(resourceAcquired) Task=`d54a6931-1b8c-40eb-8616-d0c1b2593d6a`::_resourcesAcquired: Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee (shared) >Thread-34::DEBUG::2014-07-10 09:44:41,243::task::990::TaskManager.Task::(_decref) Task=`d54a6931-1b8c-40eb-8616-d0c1b2593d6a`::ref 1 aborting False >Thread-34::INFO::2014-07-10 09:44:41,266::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532067385344', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:44:41,270::task::1185::TaskManager.Task::(prepare) Task=`d54a6931-1b8c-40eb-8616-d0c1b2593d6a`::finished: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532067385344', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:44:41,275::task::595::TaskManager.Task::(_updateState) Task=`d54a6931-1b8c-40eb-8616-d0c1b2593d6a`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-10 09:44:41,279::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee': < ResourceRef 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-10 09:44:41,284::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-10 09:44:41,292::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' >Thread-34::DEBUG::2014-07-10 09:44:41,300::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' (0 active users) >Thread-34::DEBUG::2014-07-10 09:44:41,304::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-10 09:44:41,309::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', Clearing records. >Thread-34::DEBUG::2014-07-10 09:44:41,317::task::990::TaskManager.Task::(_decref) Task=`d54a6931-1b8c-40eb-8616-d0c1b2593d6a`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 09:44:41,436::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.372661 s, 2.7 MB/s\n'; <rc> = 0 >Thread-51::DEBUG::2014-07-10 09:44:42,186::task::595::TaskManager.Task::(_updateState) Task=`5022f632-c755-47f1-96fb-5540f1df32cf`::moving from state init -> state preparing >Thread-60::DEBUG::2014-07-10 09:44:42,187::task::595::TaskManager.Task::(_updateState) Task=`58ad9498-b2a7-4423-a975-f6d6884dbab4`::moving from state init -> state preparing >Thread-51::INFO::2014-07-10 09:44:42,189::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='76fdb054-02cd-42ed-9721-b3e65b34c3a4', volUUID='022dfe46-2cf7-4915-80b3-883158e3ca83', options=None) >Thread-60::INFO::2014-07-10 09:44:42,190::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='b034d5b0-e1e0-4011-b49b-4d45ddb11556', volUUID='3d7f62b5-328f-4d8e-8b69-873cfb5ae14d', options=None) >Thread-51::INFO::2014-07-10 09:44:42,190::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-60::INFO::2014-07-10 09:44:42,191::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-51::DEBUG::2014-07-10 09:44:42,192::task::1185::TaskManager.Task::(prepare) Task=`5022f632-c755-47f1-96fb-5540f1df32cf`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-60::DEBUG::2014-07-10 09:44:42,193::task::1185::TaskManager.Task::(prepare) Task=`58ad9498-b2a7-4423-a975-f6d6884dbab4`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-51::DEBUG::2014-07-10 09:44:42,193::task::595::TaskManager.Task::(_updateState) Task=`5022f632-c755-47f1-96fb-5540f1df32cf`::moving from state preparing -> state finished >Thread-60::DEBUG::2014-07-10 09:44:42,194::task::595::TaskManager.Task::(_updateState) Task=`58ad9498-b2a7-4423-a975-f6d6884dbab4`::moving from state preparing -> state finished >Thread-51::DEBUG::2014-07-10 09:44:42,194::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-60::DEBUG::2014-07-10 09:44:42,195::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-51::DEBUG::2014-07-10 09:44:42,196::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-60::DEBUG::2014-07-10 09:44:42,196::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-60::DEBUG::2014-07-10 09:44:42,197::task::990::TaskManager.Task::(_decref) Task=`58ad9498-b2a7-4423-a975-f6d6884dbab4`::ref 0 aborting False >Thread-51::DEBUG::2014-07-10 09:44:42,197::task::990::TaskManager.Task::(_decref) Task=`5022f632-c755-47f1-96fb-5540f1df32cf`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 09:44:43,461::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:44:43,561::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0353719 s, 28.9 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:44:45,588::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:44:45,803::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0310293 s, 33.0 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:44:47,820::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:44:47,909::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0310074 s, 33.0 MB/s\n'; <rc> = 0 >Thread-40::DEBUG::2014-07-10 09:44:49,759::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lion.qa.lab.tlv.redhat.com:_export_yuri2_backup2/6a70504d-00df-4869-8695-0f442053f6b6/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-40::DEBUG::2014-07-10 09:44:49,781::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n369 bytes (369 B) copied, 0.000505839 s, 729 kB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:44:49,925::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:44:50,020::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0351562 s, 29.1 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-10 09:44:50,129::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/metadata bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-10 09:44:50,152::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000811642 s, 5.0 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 09:44:51,377::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-14::DEBUG::2014-07-10 09:44:51,378::task::595::TaskManager.Task::(_updateState) Task=`722fc174-7a1b-433a-b5ff-28278c6f8e21`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 09:44:51,378::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-14::INFO::2014-07-10 09:44:51,379::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:44:51,379::task::1185::TaskManager.Task::(prepare) Task=`722fc174-7a1b-433a-b5ff-28278c6f8e21`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:44:51,379::task::595::TaskManager.Task::(_updateState) Task=`722fc174-7a1b-433a-b5ff-28278c6f8e21`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 09:44:51,379::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 09:44:51,380::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 09:44:51,380::task::990::TaskManager.Task::(_decref) Task=`722fc174-7a1b-433a-b5ff-28278c6f8e21`::ref 0 aborting False >Thread-34::DEBUG::2014-07-10 09:44:51,384::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-34::DEBUG::2014-07-10 09:44:51,384::task::595::TaskManager.Task::(_updateState) Task=`47c7cdc0-dc44-49d3-8d9a-bbf88309b113`::moving from state init -> state preparing >Thread-34::INFO::2014-07-10 09:44:51,384::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-34::DEBUG::2014-07-10 09:44:51,385::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`bb20c200-8093-407f-8ea6-9c354fada44e`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-10 09:44:51,385::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' for lock type 'shared' >Thread-34::DEBUG::2014-07-10 09:44:51,386::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-10 09:44:51,386::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`bb20c200-8093-407f-8ea6-9c354fada44e`::Granted request >Thread-34::DEBUG::2014-07-10 09:44:51,386::task::827::TaskManager.Task::(resourceAcquired) Task=`47c7cdc0-dc44-49d3-8d9a-bbf88309b113`::_resourcesAcquired: Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee (shared) >Thread-34::DEBUG::2014-07-10 09:44:51,386::task::990::TaskManager.Task::(_decref) Task=`47c7cdc0-dc44-49d3-8d9a-bbf88309b113`::ref 1 aborting False >Thread-34::INFO::2014-07-10 09:44:51,387::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532067385344', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:44:51,388::task::1185::TaskManager.Task::(prepare) Task=`47c7cdc0-dc44-49d3-8d9a-bbf88309b113`::finished: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532067385344', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:44:51,388::task::595::TaskManager.Task::(_updateState) Task=`47c7cdc0-dc44-49d3-8d9a-bbf88309b113`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-10 09:44:51,388::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee': < ResourceRef 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-10 09:44:51,388::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-10 09:44:51,388::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' >Thread-34::DEBUG::2014-07-10 09:44:51,389::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' (0 active users) >Thread-34::DEBUG::2014-07-10 09:44:51,389::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-10 09:44:51,389::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', Clearing records. >Thread-34::DEBUG::2014-07-10 09:44:51,389::task::990::TaskManager.Task::(_decref) Task=`47c7cdc0-dc44-49d3-8d9a-bbf88309b113`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 09:44:52,036::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:44:52,130::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0350404 s, 29.2 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:44:54,145::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:44:54,234::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0314333 s, 32.6 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:44:56,249::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:44:56,348::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0345315 s, 29.7 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 09:44:56,521::task::595::TaskManager.Task::(_updateState) Task=`bf7ed1f0-2e0f-4ca8-b440-55001c04d7d3`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 09:44:56,521::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::INFO::2014-07-10 09:44:56,522::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000811642', 'lastCheck': '6.3', 'valid': True}, '6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000505839', 'lastCheck': '6.7', 'valid': True}} >Thread-14::DEBUG::2014-07-10 09:44:56,522::task::1185::TaskManager.Task::(prepare) Task=`bf7ed1f0-2e0f-4ca8-b440-55001c04d7d3`::finished: {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000811642', 'lastCheck': '6.3', 'valid': True}, '6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000505839', 'lastCheck': '6.7', 'valid': True}} >Thread-14::DEBUG::2014-07-10 09:44:56,522::task::595::TaskManager.Task::(_updateState) Task=`bf7ed1f0-2e0f-4ca8-b440-55001c04d7d3`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 09:44:56,522::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 09:44:56,523::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 09:44:56,523::task::990::TaskManager.Task::(_decref) Task=`bf7ed1f0-2e0f-4ca8-b440-55001c04d7d3`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 09:44:58,364::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:44:58,456::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0334908 s, 30.6 MB/s\n'; <rc> = 0 >Thread-40::DEBUG::2014-07-10 09:44:59,806::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lion.qa.lab.tlv.redhat.com:_export_yuri2_backup2/6a70504d-00df-4869-8695-0f442053f6b6/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-40::DEBUG::2014-07-10 09:44:59,826::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n369 bytes (369 B) copied, 0.000465748 s, 792 kB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-10 09:45:00,182::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/metadata bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-10 09:45:00,203::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000869582 s, 4.7 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:45:00,473::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:45:00,567::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0368341 s, 27.8 MB/s\n'; <rc> = 0 >Thread-64::DEBUG::2014-07-10 09:45:00,941::task::595::TaskManager.Task::(_updateState) Task=`058f38f7-c8ab-44ac-9d57-0bcfbf6a9985`::moving from state init -> state preparing >Thread-64::INFO::2014-07-10 09:45:00,942::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='aa20346a-4d3a-4e07-b8e1-52c0ebe4168c', volUUID='58fefce2-9bce-4bff-8949-8c6ce8122b27', options=None) >Thread-64::INFO::2014-07-10 09:45:00,942::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-64::DEBUG::2014-07-10 09:45:00,942::task::1185::TaskManager.Task::(prepare) Task=`058f38f7-c8ab-44ac-9d57-0bcfbf6a9985`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-64::DEBUG::2014-07-10 09:45:00,942::task::595::TaskManager.Task::(_updateState) Task=`058f38f7-c8ab-44ac-9d57-0bcfbf6a9985`::moving from state preparing -> state finished >Thread-64::DEBUG::2014-07-10 09:45:00,943::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-64::DEBUG::2014-07-10 09:45:00,943::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-64::DEBUG::2014-07-10 09:45:00,943::task::990::TaskManager.Task::(_decref) Task=`058f38f7-c8ab-44ac-9d57-0bcfbf6a9985`::ref 0 aborting False >Thread-14::DEBUG::2014-07-10 09:45:01,420::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-14::DEBUG::2014-07-10 09:45:01,421::task::595::TaskManager.Task::(_updateState) Task=`999dc915-fac5-43f2-9c7d-793bfe44cefa`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 09:45:01,421::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-14::INFO::2014-07-10 09:45:01,421::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:45:01,422::task::1185::TaskManager.Task::(prepare) Task=`999dc915-fac5-43f2-9c7d-793bfe44cefa`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:45:01,422::task::595::TaskManager.Task::(_updateState) Task=`999dc915-fac5-43f2-9c7d-793bfe44cefa`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 09:45:01,422::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 09:45:01,422::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 09:45:01,422::task::990::TaskManager.Task::(_decref) Task=`999dc915-fac5-43f2-9c7d-793bfe44cefa`::ref 0 aborting False >Thread-34::DEBUG::2014-07-10 09:45:01,427::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-34::DEBUG::2014-07-10 09:45:01,427::task::595::TaskManager.Task::(_updateState) Task=`4062f535-7417-42d4-b192-c874ee51ce7e`::moving from state init -> state preparing >Thread-34::INFO::2014-07-10 09:45:01,427::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-34::DEBUG::2014-07-10 09:45:01,428::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`64f01bd4-2920-4d22-9654-108e1cea6ad2`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-10 09:45:01,428::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' for lock type 'shared' >Thread-34::DEBUG::2014-07-10 09:45:01,429::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-10 09:45:01,429::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`64f01bd4-2920-4d22-9654-108e1cea6ad2`::Granted request >Thread-34::DEBUG::2014-07-10 09:45:01,430::task::827::TaskManager.Task::(resourceAcquired) Task=`4062f535-7417-42d4-b192-c874ee51ce7e`::_resourcesAcquired: Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee (shared) >Thread-34::DEBUG::2014-07-10 09:45:01,430::task::990::TaskManager.Task::(_decref) Task=`4062f535-7417-42d4-b192-c874ee51ce7e`::ref 1 aborting False >Thread-34::INFO::2014-07-10 09:45:01,431::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532067385344', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:45:01,431::task::1185::TaskManager.Task::(prepare) Task=`4062f535-7417-42d4-b192-c874ee51ce7e`::finished: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532067385344', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:45:01,431::task::595::TaskManager.Task::(_updateState) Task=`4062f535-7417-42d4-b192-c874ee51ce7e`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-10 09:45:01,432::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee': < ResourceRef 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-10 09:45:01,432::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-10 09:45:01,432::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' >Thread-34::DEBUG::2014-07-10 09:45:01,432::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' (0 active users) >Thread-34::DEBUG::2014-07-10 09:45:01,432::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-10 09:45:01,433::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', Clearing records. >Thread-34::DEBUG::2014-07-10 09:45:01,433::task::990::TaskManager.Task::(_decref) Task=`4062f535-7417-42d4-b192-c874ee51ce7e`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 09:45:02,582::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:45:02,684::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0266448 s, 38.4 MB/s\n'; <rc> = 0 >Thread-54::DEBUG::2014-07-10 09:45:03,679::task::595::TaskManager.Task::(_updateState) Task=`97a25b2c-c381-4987-bb97-af290f0f5949`::moving from state init -> state preparing >Thread-73::DEBUG::2014-07-10 09:45:03,681::task::595::TaskManager.Task::(_updateState) Task=`727519c0-ada1-4553-b06b-2a4c6da26cdd`::moving from state init -> state preparing >Thread-54::INFO::2014-07-10 09:45:03,681::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='28408446-e5fd-4565-a976-e760951593fe', volUUID='776303a2-5585-451e-826e-0e338d4a1e98', options=None) >Thread-73::INFO::2014-07-10 09:45:03,682::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='c01d693b-cba0-4fed-9ad7-0aaa28912a19', volUUID='4bb5d954-2a50-4028-b299-0b43c261270c', options=None) >Thread-54::INFO::2014-07-10 09:45:03,683::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-54::DEBUG::2014-07-10 09:45:03,684::task::1185::TaskManager.Task::(prepare) Task=`97a25b2c-c381-4987-bb97-af290f0f5949`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-73::INFO::2014-07-10 09:45:03,684::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-54::DEBUG::2014-07-10 09:45:03,685::task::595::TaskManager.Task::(_updateState) Task=`97a25b2c-c381-4987-bb97-af290f0f5949`::moving from state preparing -> state finished >Thread-73::DEBUG::2014-07-10 09:45:03,685::task::1185::TaskManager.Task::(prepare) Task=`727519c0-ada1-4553-b06b-2a4c6da26cdd`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-54::DEBUG::2014-07-10 09:45:03,686::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-73::DEBUG::2014-07-10 09:45:03,687::task::595::TaskManager.Task::(_updateState) Task=`727519c0-ada1-4553-b06b-2a4c6da26cdd`::moving from state preparing -> state finished >Thread-54::DEBUG::2014-07-10 09:45:03,688::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-73::DEBUG::2014-07-10 09:45:03,688::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-73::DEBUG::2014-07-10 09:45:03,689::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-54::DEBUG::2014-07-10 09:45:03,689::task::990::TaskManager.Task::(_decref) Task=`97a25b2c-c381-4987-bb97-af290f0f5949`::ref 0 aborting False >Thread-73::DEBUG::2014-07-10 09:45:03,690::task::990::TaskManager.Task::(_decref) Task=`727519c0-ada1-4553-b06b-2a4c6da26cdd`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 09:45:04,699::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:45:04,792::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0354759 s, 28.9 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:45:06,808::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:45:06,897::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0300107 s, 34.1 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:45:08,911::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:45:09,037::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.029028 s, 35.3 MB/s\n'; <rc> = 0 >Thread-40::DEBUG::2014-07-10 09:45:09,857::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lion.qa.lab.tlv.redhat.com:_export_yuri2_backup2/6a70504d-00df-4869-8695-0f442053f6b6/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-40::DEBUG::2014-07-10 09:45:09,880::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n369 bytes (369 B) copied, 0.000409269 s, 902 kB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-10 09:45:10,232::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/metadata bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-10 09:45:10,254::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000712146 s, 5.8 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:45:11,052::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:45:11,159::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0431147 s, 23.8 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 09:45:11,494::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-14::DEBUG::2014-07-10 09:45:11,495::task::595::TaskManager.Task::(_updateState) Task=`8052fd3b-0012-4ccb-bcbe-92fdf8134300`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 09:45:11,496::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-14::INFO::2014-07-10 09:45:11,496::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:45:11,496::task::1185::TaskManager.Task::(prepare) Task=`8052fd3b-0012-4ccb-bcbe-92fdf8134300`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:45:11,497::task::595::TaskManager.Task::(_updateState) Task=`8052fd3b-0012-4ccb-bcbe-92fdf8134300`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 09:45:11,497::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 09:45:11,497::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 09:45:11,497::task::990::TaskManager.Task::(_decref) Task=`8052fd3b-0012-4ccb-bcbe-92fdf8134300`::ref 0 aborting False >Thread-34::DEBUG::2014-07-10 09:45:11,501::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-34::DEBUG::2014-07-10 09:45:11,501::task::595::TaskManager.Task::(_updateState) Task=`f411dd33-015a-4c76-8d7e-e8ab2876f240`::moving from state init -> state preparing >Thread-34::INFO::2014-07-10 09:45:11,502::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-34::DEBUG::2014-07-10 09:45:11,502::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`1679c3fb-c770-4d3a-8339-33da7bd8be04`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-10 09:45:11,503::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' for lock type 'shared' >Thread-34::DEBUG::2014-07-10 09:45:11,503::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-10 09:45:11,503::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`1679c3fb-c770-4d3a-8339-33da7bd8be04`::Granted request >Thread-34::DEBUG::2014-07-10 09:45:11,504::task::827::TaskManager.Task::(resourceAcquired) Task=`f411dd33-015a-4c76-8d7e-e8ab2876f240`::_resourcesAcquired: Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee (shared) >Thread-34::DEBUG::2014-07-10 09:45:11,504::task::990::TaskManager.Task::(_decref) Task=`f411dd33-015a-4c76-8d7e-e8ab2876f240`::ref 1 aborting False >Thread-34::INFO::2014-07-10 09:45:11,505::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532067385344', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:45:11,505::task::1185::TaskManager.Task::(prepare) Task=`f411dd33-015a-4c76-8d7e-e8ab2876f240`::finished: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532067385344', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:45:11,505::task::595::TaskManager.Task::(_updateState) Task=`f411dd33-015a-4c76-8d7e-e8ab2876f240`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-10 09:45:11,505::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee': < ResourceRef 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-10 09:45:11,505::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-10 09:45:11,506::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' >Thread-34::DEBUG::2014-07-10 09:45:11,506::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' (0 active users) >Thread-34::DEBUG::2014-07-10 09:45:11,506::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-10 09:45:11,506::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', Clearing records. >Thread-34::DEBUG::2014-07-10 09:45:11,507::task::990::TaskManager.Task::(_decref) Task=`f411dd33-015a-4c76-8d7e-e8ab2876f240`::ref 0 aborting False >Thread-14::DEBUG::2014-07-10 09:45:11,695::task::595::TaskManager.Task::(_updateState) Task=`7a91c7ff-f6b7-4346-9246-8edce1a6006f`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 09:45:11,695::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::INFO::2014-07-10 09:45:11,695::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000712146', 'lastCheck': '1.4', 'valid': True}, '6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000409269', 'lastCheck': '1.8', 'valid': True}} >Thread-14::DEBUG::2014-07-10 09:45:11,695::task::1185::TaskManager.Task::(prepare) Task=`7a91c7ff-f6b7-4346-9246-8edce1a6006f`::finished: {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000712146', 'lastCheck': '1.4', 'valid': True}, '6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000409269', 'lastCheck': '1.8', 'valid': True}} >Thread-14::DEBUG::2014-07-10 09:45:11,695::task::595::TaskManager.Task::(_updateState) Task=`7a91c7ff-f6b7-4346-9246-8edce1a6006f`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 09:45:11,696::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 09:45:11,696::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 09:45:11,696::task::990::TaskManager.Task::(_decref) Task=`7a91c7ff-f6b7-4346-9246-8edce1a6006f`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 09:45:13,175::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:45:13,302::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0576368 s, 17.8 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:45:15,318::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:45:15,419::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0398445 s, 25.7 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:45:17,434::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:45:17,516::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0256212 s, 40.0 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:45:19,532::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:45:19,636::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0457687 s, 22.4 MB/s\n'; <rc> = 0 >Thread-40::DEBUG::2014-07-10 09:45:19,911::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lion.qa.lab.tlv.redhat.com:_export_yuri2_backup2/6a70504d-00df-4869-8695-0f442053f6b6/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-40::DEBUG::2014-07-10 09:45:19,935::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n369 bytes (369 B) copied, 0.000461643 s, 799 kB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-10 09:45:20,283::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/metadata bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-10 09:45:20,310::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.0059756 s, 685 kB/s\n'; <rc> = 0 >Thread-57::DEBUG::2014-07-10 09:45:21,433::task::595::TaskManager.Task::(_updateState) Task=`b550ec95-ea01-4bdd-b1b7-d2dffb0838e0`::moving from state init -> state preparing >Thread-57::INFO::2014-07-10 09:45:21,434::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='b6f6c0da-e67f-4902-b9ac-3069571a42fe', volUUID='c4cd1da8-05b7-45e0-80b1-1183d21443d9', options=None) >Thread-57::INFO::2014-07-10 09:45:21,435::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-57::DEBUG::2014-07-10 09:45:21,435::task::1185::TaskManager.Task::(prepare) Task=`b550ec95-ea01-4bdd-b1b7-d2dffb0838e0`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-57::DEBUG::2014-07-10 09:45:21,436::task::595::TaskManager.Task::(_updateState) Task=`b550ec95-ea01-4bdd-b1b7-d2dffb0838e0`::moving from state preparing -> state finished >Thread-57::DEBUG::2014-07-10 09:45:21,436::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-57::DEBUG::2014-07-10 09:45:21,436::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-57::DEBUG::2014-07-10 09:45:21,436::task::990::TaskManager.Task::(_decref) Task=`b550ec95-ea01-4bdd-b1b7-d2dffb0838e0`::ref 0 aborting False >Thread-14::DEBUG::2014-07-10 09:45:21,536::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-14::DEBUG::2014-07-10 09:45:21,536::task::595::TaskManager.Task::(_updateState) Task=`23771a9d-aa9a-4154-ae0c-a8ffdac0e4be`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 09:45:21,536::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-14::INFO::2014-07-10 09:45:21,537::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:45:21,537::task::1185::TaskManager.Task::(prepare) Task=`23771a9d-aa9a-4154-ae0c-a8ffdac0e4be`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:45:21,537::task::595::TaskManager.Task::(_updateState) Task=`23771a9d-aa9a-4154-ae0c-a8ffdac0e4be`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 09:45:21,537::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 09:45:21,537::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 09:45:21,538::task::990::TaskManager.Task::(_decref) Task=`23771a9d-aa9a-4154-ae0c-a8ffdac0e4be`::ref 0 aborting False >Thread-34::DEBUG::2014-07-10 09:45:21,542::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-34::DEBUG::2014-07-10 09:45:21,542::task::595::TaskManager.Task::(_updateState) Task=`56c2136f-e7e6-46a0-912f-9e2ecd25b67e`::moving from state init -> state preparing >Thread-34::INFO::2014-07-10 09:45:21,542::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-34::DEBUG::2014-07-10 09:45:21,543::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`8565a86f-edf5-4625-b3da-e1749985e4eb`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-10 09:45:21,543::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' for lock type 'shared' >Thread-34::DEBUG::2014-07-10 09:45:21,543::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-10 09:45:21,543::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`8565a86f-edf5-4625-b3da-e1749985e4eb`::Granted request >Thread-34::DEBUG::2014-07-10 09:45:21,544::task::827::TaskManager.Task::(resourceAcquired) Task=`56c2136f-e7e6-46a0-912f-9e2ecd25b67e`::_resourcesAcquired: Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee (shared) >Thread-34::DEBUG::2014-07-10 09:45:21,544::task::990::TaskManager.Task::(_decref) Task=`56c2136f-e7e6-46a0-912f-9e2ecd25b67e`::ref 1 aborting False >Thread-34::INFO::2014-07-10 09:45:21,545::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532067385344', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:45:21,545::task::1185::TaskManager.Task::(prepare) Task=`56c2136f-e7e6-46a0-912f-9e2ecd25b67e`::finished: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532067385344', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:45:21,546::task::595::TaskManager.Task::(_updateState) Task=`56c2136f-e7e6-46a0-912f-9e2ecd25b67e`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-10 09:45:21,546::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee': < ResourceRef 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-10 09:45:21,546::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-10 09:45:21,546::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' >Thread-34::DEBUG::2014-07-10 09:45:21,546::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' (0 active users) >Thread-34::DEBUG::2014-07-10 09:45:21,546::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-10 09:45:21,547::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', Clearing records. >Thread-34::DEBUG::2014-07-10 09:45:21,547::task::990::TaskManager.Task::(_decref) Task=`56c2136f-e7e6-46a0-912f-9e2ecd25b67e`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 09:45:21,651::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:45:21,737::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0274406 s, 37.3 MB/s\n'; <rc> = 0 >Thread-67::DEBUG::2014-07-10 09:45:21,939::task::595::TaskManager.Task::(_updateState) Task=`0252ba94-1795-412a-827b-a8d20c7520bc`::moving from state init -> state preparing >Thread-67::INFO::2014-07-10 09:45:21,940::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='f30c2cb7-a43a-4bf5-82b5-cfe07336f65c', volUUID='b0fbb3c9-55af-4a3a-95ad-fc56a80b9cf5', options=None) >Thread-67::INFO::2014-07-10 09:45:21,940::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-67::DEBUG::2014-07-10 09:45:21,940::task::1185::TaskManager.Task::(prepare) Task=`0252ba94-1795-412a-827b-a8d20c7520bc`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-67::DEBUG::2014-07-10 09:45:21,940::task::595::TaskManager.Task::(_updateState) Task=`0252ba94-1795-412a-827b-a8d20c7520bc`::moving from state preparing -> state finished >Thread-67::DEBUG::2014-07-10 09:45:21,941::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-67::DEBUG::2014-07-10 09:45:21,941::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-67::DEBUG::2014-07-10 09:45:21,941::task::990::TaskManager.Task::(_decref) Task=`0252ba94-1795-412a-827b-a8d20c7520bc`::ref 0 aborting False >Thread-48::DEBUG::2014-07-10 09:45:22,403::task::595::TaskManager.Task::(_updateState) Task=`6a7becab-dc5c-40cd-95c8-a4b7dbe506de`::moving from state init -> state preparing >Thread-48::INFO::2014-07-10 09:45:22,404::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='0cd7d6ce-f497-4243-a690-c57744861eea', volUUID='10b6a7dd-dc6c-43fa-ba17-92e4331b0e0b', options=None) >Thread-48::INFO::2014-07-10 09:45:22,404::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-48::DEBUG::2014-07-10 09:45:22,404::task::1185::TaskManager.Task::(prepare) Task=`6a7becab-dc5c-40cd-95c8-a4b7dbe506de`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-48::DEBUG::2014-07-10 09:45:22,404::task::595::TaskManager.Task::(_updateState) Task=`6a7becab-dc5c-40cd-95c8-a4b7dbe506de`::moving from state preparing -> state finished >Thread-48::DEBUG::2014-07-10 09:45:22,405::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-48::DEBUG::2014-07-10 09:45:22,405::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-48::DEBUG::2014-07-10 09:45:22,405::task::990::TaskManager.Task::(_decref) Task=`6a7becab-dc5c-40cd-95c8-a4b7dbe506de`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 09:45:23,753::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:45:23,840::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.029293 s, 35.0 MB/s\n'; <rc> = 0 >Thread-76::DEBUG::2014-07-10 09:45:23,944::task::595::TaskManager.Task::(_updateState) Task=`c1fb4fbd-f041-427a-b908-a40aca52ee59`::moving from state init -> state preparing >Thread-76::INFO::2014-07-10 09:45:23,944::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='e4c65229-4247-4b33-b72a-f1d5ce72ad05', volUUID='cad94284-3ca9-4c30-933d-997f4460309e', options=None) >Thread-76::INFO::2014-07-10 09:45:23,945::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-76::DEBUG::2014-07-10 09:45:23,945::task::1185::TaskManager.Task::(prepare) Task=`c1fb4fbd-f041-427a-b908-a40aca52ee59`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-76::DEBUG::2014-07-10 09:45:23,945::task::595::TaskManager.Task::(_updateState) Task=`c1fb4fbd-f041-427a-b908-a40aca52ee59`::moving from state preparing -> state finished >Thread-76::DEBUG::2014-07-10 09:45:23,945::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-76::DEBUG::2014-07-10 09:45:23,945::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-76::DEBUG::2014-07-10 09:45:23,946::task::990::TaskManager.Task::(_decref) Task=`c1fb4fbd-f041-427a-b908-a40aca52ee59`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 09:45:25,858::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:45:25,950::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0381118 s, 26.9 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 09:45:26,872::task::595::TaskManager.Task::(_updateState) Task=`2dc8403a-5d04-48d9-85fb-9e413bccd4e1`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 09:45:26,872::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::INFO::2014-07-10 09:45:26,872::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0059756', 'lastCheck': '6.5', 'valid': True}, '6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000461643', 'lastCheck': '6.9', 'valid': True}} >Thread-14::DEBUG::2014-07-10 09:45:26,873::task::1185::TaskManager.Task::(prepare) Task=`2dc8403a-5d04-48d9-85fb-9e413bccd4e1`::finished: {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0059756', 'lastCheck': '6.5', 'valid': True}, '6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000461643', 'lastCheck': '6.9', 'valid': True}} >Thread-14::DEBUG::2014-07-10 09:45:26,873::task::595::TaskManager.Task::(_updateState) Task=`2dc8403a-5d04-48d9-85fb-9e413bccd4e1`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 09:45:26,873::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 09:45:26,873::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 09:45:26,873::task::990::TaskManager.Task::(_decref) Task=`2dc8403a-5d04-48d9-85fb-9e413bccd4e1`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 09:45:27,965::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:45:28,055::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0287591 s, 35.6 MB/s\n'; <rc> = 0 >Thread-40::DEBUG::2014-07-10 09:45:29,961::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lion.qa.lab.tlv.redhat.com:_export_yuri2_backup2/6a70504d-00df-4869-8695-0f442053f6b6/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-40::DEBUG::2014-07-10 09:45:29,981::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n369 bytes (369 B) copied, 0.000453495 s, 814 kB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:45:30,082::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:45:30,172::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0330281 s, 31.0 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-10 09:45:30,339::domainMonitor::192::Storage.DomainMonitorThread::(_monitorDomain) Refreshing domain 9e1aa540-1f4e-4ee3-a152-be381ef6c3bd >Thread-18::DEBUG::2014-07-10 09:45:30,340::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with LvMetadataRW backend >Thread-18::DEBUG::2014-07-10 09:45:30,340::blockSD::336::Storage.Misc.excCmd::(readlines) '/bin/dd iflag=direct skip=0 bs=2048 if=/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/metadata count=1' (cwd None) >Thread-18::DEBUG::2014-07-10 09:45:30,367::blockSD::336::Storage.Misc.excCmd::(readlines) SUCCESS: <err> = '1+0 records in\n1+0 records out\n2048 bytes (2.0 kB) copied, 0.00824729 s, 248 kB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-10 09:45:30,368::misc::282::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '2048 bytes (2.0 kB) copied, 0.00824729 s, 248 kB/s'], size: 2048 >Thread-18::DEBUG::2014-07-10 09:45:30,368::persistentDict::234::Storage.PersistentDict::(refresh) read lines (LvMetadataRW)=[] >Thread-18::WARNING::2014-07-10 09:45:30,369::persistentDict::256::Storage.PersistentDict::(refresh) data has no embedded checksum - trust it as it is >Thread-18::DEBUG::2014-07-10 09:45:30,369::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with VGTagMetadataRW backend >Thread-18::DEBUG::2014-07-10 09:45:30,369::lvm::503::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-18::DEBUG::2014-07-10 09:45:30,370::lvm::505::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-18::DEBUG::2014-07-10 09:45:30,370::lvm::513::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-18::DEBUG::2014-07-10 09:45:30,370::lvm::525::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-18::DEBUG::2014-07-10 09:45:30,371::lvm::373::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-18::DEBUG::2014-07-10 09:45:30,371::lvm::296::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/3600601601282300032826addbbdae311|/dev/mapper/360060160f4a030003840ec867ddee311|/dev/mapper/367cad74c2fcba00019e6afd20c781e67|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name 9e1aa540-1f4e-4ee3-a152-be381ef6c3bd' (cwd None) >Thread-18::DEBUG::2014-07-10 09:45:30,694::lvm::296::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-18::DEBUG::2014-07-10 09:45:30,696::lvm::415::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-18::DEBUG::2014-07-10 09:45:30,697::persistentDict::234::Storage.PersistentDict::(refresh) read lines (VGTagMetadataRW)=['LEASETIMESEC=60', 'VGUUID=9CsMxb-YbRc-yRG7-cQKD-xY3G-GLi5-YxUyPC', 'VERSION=3', 'TYPE=ISCSI', 'LOGBLKSIZE=512', u'PV0=pv:3600601601282300032826addbbdae311,uuid:7qEb8v-jk2X-3CPk-k4XB-eIBk-onYD-807hcV,pestart:0,pecount:8189,mapoffset:0', 'LEASERETRIES=3', 'IOOPTIMEOUTSEC=10', 'LOCKRENEWALINTERVALSEC=5', 'PHYBLKSIZE=512', 'SDUUID=9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'CLASS=Data', 'LOCKPOLICY=', 'DESCRIPTION=SD_REAL', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=DC_REAL', 'ROLE=Master', 'POOL_UUID=4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', 'POOL_SPM_ID=1', 'POOL_SPM_LVER=0', '_SHA_CKSUM=013b5a7910962201c4cceab31b9c6d9c79f7316f', u'POOL_DOMAINS=9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active'] >Thread-18::INFO::2014-07-10 09:45:30,698::sd::384::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 9e1aa540-1f4e-4ee3-a152-be381ef6c3bd_imageNS already registered >Thread-18::INFO::2014-07-10 09:45:30,698::sd::392::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 9e1aa540-1f4e-4ee3-a152-be381ef6c3bd_volumeNS already registered >Thread-18::INFO::2014-07-10 09:45:30,699::blockSD::452::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 9e1aa540-1f4e-4ee3-a152-be381ef6c3bd_lvmActivationNS already registered >Thread-18::DEBUG::2014-07-10 09:45:30,699::lvm::296::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgck --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/3600601601282300032826addbbdae311|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } " 9e1aa540-1f4e-4ee3-a152-be381ef6c3bd' (cwd None) >Thread-18::DEBUG::2014-07-10 09:45:30,911::lvm::296::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-18::DEBUG::2014-07-10 09:45:30,912::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/metadata bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-10 09:45:30,932::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00101169 s, 4.0 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 09:45:31,578::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-14::DEBUG::2014-07-10 09:45:31,579::task::595::TaskManager.Task::(_updateState) Task=`57e6e46d-8b59-481c-8999-5abe41cee763`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 09:45:31,579::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-14::INFO::2014-07-10 09:45:31,580::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:45:31,580::task::1185::TaskManager.Task::(prepare) Task=`57e6e46d-8b59-481c-8999-5abe41cee763`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:45:31,580::task::595::TaskManager.Task::(_updateState) Task=`57e6e46d-8b59-481c-8999-5abe41cee763`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 09:45:31,580::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 09:45:31,581::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 09:45:31,581::task::990::TaskManager.Task::(_decref) Task=`57e6e46d-8b59-481c-8999-5abe41cee763`::ref 0 aborting False >Thread-34::DEBUG::2014-07-10 09:45:31,585::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-34::DEBUG::2014-07-10 09:45:31,586::task::595::TaskManager.Task::(_updateState) Task=`4d5ea039-8fc5-4205-9167-04168815e008`::moving from state init -> state preparing >Thread-34::INFO::2014-07-10 09:45:31,586::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-34::DEBUG::2014-07-10 09:45:31,586::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`c3893d86-1a26-41c9-9161-e854e7409a70`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-10 09:45:31,587::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' for lock type 'shared' >Thread-34::DEBUG::2014-07-10 09:45:31,587::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-10 09:45:31,587::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`c3893d86-1a26-41c9-9161-e854e7409a70`::Granted request >Thread-34::DEBUG::2014-07-10 09:45:31,588::task::827::TaskManager.Task::(resourceAcquired) Task=`4d5ea039-8fc5-4205-9167-04168815e008`::_resourcesAcquired: Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee (shared) >Thread-34::DEBUG::2014-07-10 09:45:31,588::task::990::TaskManager.Task::(_decref) Task=`4d5ea039-8fc5-4205-9167-04168815e008`::ref 1 aborting False >Thread-34::INFO::2014-07-10 09:45:31,589::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532067385344', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:45:31,589::task::1185::TaskManager.Task::(prepare) Task=`4d5ea039-8fc5-4205-9167-04168815e008`::finished: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532067385344', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:45:31,590::task::595::TaskManager.Task::(_updateState) Task=`4d5ea039-8fc5-4205-9167-04168815e008`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-10 09:45:31,590::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee': < ResourceRef 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-10 09:45:31,590::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-10 09:45:31,590::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' >Thread-34::DEBUG::2014-07-10 09:45:31,590::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' (0 active users) >Thread-34::DEBUG::2014-07-10 09:45:31,591::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-10 09:45:31,591::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', Clearing records. >Thread-34::DEBUG::2014-07-10 09:45:31,591::task::990::TaskManager.Task::(_decref) Task=`4d5ea039-8fc5-4205-9167-04168815e008`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 09:45:32,187::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:45:32,297::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0369917 s, 27.7 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:45:34,313::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:45:34,438::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0649566 s, 15.8 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:45:36,454::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:45:36,555::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0343686 s, 29.8 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:45:38,570::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:45:38,694::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.067344 s, 15.2 MB/s\n'; <rc> = 0 >Thread-40::DEBUG::2014-07-10 09:45:40,012::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lion.qa.lab.tlv.redhat.com:_export_yuri2_backup2/6a70504d-00df-4869-8695-0f442053f6b6/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-40::DEBUG::2014-07-10 09:45:40,032::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n369 bytes (369 B) copied, 0.000485463 s, 760 kB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:45:40,707::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:45:40,822::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0338005 s, 30.3 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-10 09:45:40,963::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/metadata bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-10 09:45:40,986::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00424379 s, 965 kB/s\n'; <rc> = 0 >Thread-70::DEBUG::2014-07-10 09:45:41,112::task::595::TaskManager.Task::(_updateState) Task=`ef64a03d-83bd-4d62-9066-4a98ca3990d1`::moving from state init -> state preparing >Thread-70::INFO::2014-07-10 09:45:41,113::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='cfaeead2-7caa-467c-b389-c89840ae6605', volUUID='567fe32d-31a6-4ff6-90f3-fd6a656fbecc', options=None) >Thread-70::INFO::2014-07-10 09:45:41,113::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-70::DEBUG::2014-07-10 09:45:41,114::task::1185::TaskManager.Task::(prepare) Task=`ef64a03d-83bd-4d62-9066-4a98ca3990d1`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-70::DEBUG::2014-07-10 09:45:41,114::task::595::TaskManager.Task::(_updateState) Task=`ef64a03d-83bd-4d62-9066-4a98ca3990d1`::moving from state preparing -> state finished >Thread-70::DEBUG::2014-07-10 09:45:41,114::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-70::DEBUG::2014-07-10 09:45:41,114::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-70::DEBUG::2014-07-10 09:45:41,114::task::990::TaskManager.Task::(_decref) Task=`ef64a03d-83bd-4d62-9066-4a98ca3990d1`::ref 0 aborting False >Thread-14::DEBUG::2014-07-10 09:45:41,620::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-14::DEBUG::2014-07-10 09:45:41,621::task::595::TaskManager.Task::(_updateState) Task=`03ee299d-8081-442e-ad49-be599e3aaf9b`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 09:45:41,621::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-14::INFO::2014-07-10 09:45:41,622::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:45:41,622::task::1185::TaskManager.Task::(prepare) Task=`03ee299d-8081-442e-ad49-be599e3aaf9b`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:45:41,622::task::595::TaskManager.Task::(_updateState) Task=`03ee299d-8081-442e-ad49-be599e3aaf9b`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 09:45:41,623::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 09:45:41,623::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 09:45:41,623::task::990::TaskManager.Task::(_decref) Task=`03ee299d-8081-442e-ad49-be599e3aaf9b`::ref 0 aborting False >Thread-34::DEBUG::2014-07-10 09:45:41,627::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-34::DEBUG::2014-07-10 09:45:41,627::task::595::TaskManager.Task::(_updateState) Task=`f2ebe45a-0b20-4966-90d0-57af6ece66dc`::moving from state init -> state preparing >Thread-34::INFO::2014-07-10 09:45:41,628::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-34::DEBUG::2014-07-10 09:45:41,628::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`bc847ca4-6e81-4561-8fd8-c2d5ce8f4acb`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-10 09:45:41,628::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' for lock type 'shared' >Thread-34::DEBUG::2014-07-10 09:45:41,629::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-10 09:45:41,629::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`bc847ca4-6e81-4561-8fd8-c2d5ce8f4acb`::Granted request >Thread-34::DEBUG::2014-07-10 09:45:41,629::task::827::TaskManager.Task::(resourceAcquired) Task=`f2ebe45a-0b20-4966-90d0-57af6ece66dc`::_resourcesAcquired: Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee (shared) >Thread-34::DEBUG::2014-07-10 09:45:41,630::task::990::TaskManager.Task::(_decref) Task=`f2ebe45a-0b20-4966-90d0-57af6ece66dc`::ref 1 aborting False >Thread-34::INFO::2014-07-10 09:45:41,631::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532067385344', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:45:41,631::task::1185::TaskManager.Task::(prepare) Task=`f2ebe45a-0b20-4966-90d0-57af6ece66dc`::finished: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532067385344', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:45:41,631::task::595::TaskManager.Task::(_updateState) Task=`f2ebe45a-0b20-4966-90d0-57af6ece66dc`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-10 09:45:41,631::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee': < ResourceRef 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-10 09:45:41,631::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-10 09:45:41,632::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' >Thread-34::DEBUG::2014-07-10 09:45:41,632::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' (0 active users) >Thread-34::DEBUG::2014-07-10 09:45:41,632::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-10 09:45:41,632::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', Clearing records. >Thread-34::DEBUG::2014-07-10 09:45:41,632::task::990::TaskManager.Task::(_decref) Task=`f2ebe45a-0b20-4966-90d0-57af6ece66dc`::ref 0 aborting False >Thread-14::DEBUG::2014-07-10 09:45:42,046::task::595::TaskManager.Task::(_updateState) Task=`0593f7b7-8580-4481-a1c2-c11646baf87c`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 09:45:42,047::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::INFO::2014-07-10 09:45:42,047::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00424379', 'lastCheck': '1.0', 'valid': True}, '6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000485463', 'lastCheck': '2.0', 'valid': True}} >Thread-14::DEBUG::2014-07-10 09:45:42,047::task::1185::TaskManager.Task::(prepare) Task=`0593f7b7-8580-4481-a1c2-c11646baf87c`::finished: {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00424379', 'lastCheck': '1.0', 'valid': True}, '6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000485463', 'lastCheck': '2.0', 'valid': True}} >Thread-14::DEBUG::2014-07-10 09:45:42,047::task::595::TaskManager.Task::(_updateState) Task=`0593f7b7-8580-4481-a1c2-c11646baf87c`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 09:45:42,047::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 09:45:42,048::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 09:45:42,048::task::990::TaskManager.Task::(_decref) Task=`0593f7b7-8580-4481-a1c2-c11646baf87c`::ref 0 aborting False >Thread-51::DEBUG::2014-07-10 09:45:42,535::task::595::TaskManager.Task::(_updateState) Task=`b79b74ea-38c2-4e5a-80a3-b6f459bd326e`::moving from state init -> state preparing >Thread-51::INFO::2014-07-10 09:45:42,535::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='76fdb054-02cd-42ed-9721-b3e65b34c3a4', volUUID='022dfe46-2cf7-4915-80b3-883158e3ca83', options=None) >Thread-51::INFO::2014-07-10 09:45:42,536::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-51::DEBUG::2014-07-10 09:45:42,536::task::1185::TaskManager.Task::(prepare) Task=`b79b74ea-38c2-4e5a-80a3-b6f459bd326e`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-51::DEBUG::2014-07-10 09:45:42,536::task::595::TaskManager.Task::(_updateState) Task=`b79b74ea-38c2-4e5a-80a3-b6f459bd326e`::moving from state preparing -> state finished >Thread-51::DEBUG::2014-07-10 09:45:42,536::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-51::DEBUG::2014-07-10 09:45:42,536::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-51::DEBUG::2014-07-10 09:45:42,537::task::990::TaskManager.Task::(_decref) Task=`b79b74ea-38c2-4e5a-80a3-b6f459bd326e`::ref 0 aborting False >Thread-60::DEBUG::2014-07-10 09:45:42,538::task::595::TaskManager.Task::(_updateState) Task=`0c246825-4972-49a1-81bb-8f0d63bcbfa4`::moving from state init -> state preparing >Thread-60::INFO::2014-07-10 09:45:42,539::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='b034d5b0-e1e0-4011-b49b-4d45ddb11556', volUUID='3d7f62b5-328f-4d8e-8b69-873cfb5ae14d', options=None) >Thread-60::INFO::2014-07-10 09:45:42,539::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-60::DEBUG::2014-07-10 09:45:42,539::task::1185::TaskManager.Task::(prepare) Task=`0c246825-4972-49a1-81bb-8f0d63bcbfa4`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-60::DEBUG::2014-07-10 09:45:42,539::task::595::TaskManager.Task::(_updateState) Task=`0c246825-4972-49a1-81bb-8f0d63bcbfa4`::moving from state preparing -> state finished >Thread-60::DEBUG::2014-07-10 09:45:42,540::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-60::DEBUG::2014-07-10 09:45:42,540::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-60::DEBUG::2014-07-10 09:45:42,540::task::990::TaskManager.Task::(_decref) Task=`0c246825-4972-49a1-81bb-8f0d63bcbfa4`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 09:45:42,836::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:45:42,923::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0292554 s, 35.0 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:45:44,938::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:45:45,026::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0291969 s, 35.1 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:45:47,040::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:45:47,134::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0355029 s, 28.8 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:45:49,150::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:45:49,246::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0373765 s, 27.4 MB/s\n'; <rc> = 0 >Thread-40::DEBUG::2014-07-10 09:45:50,063::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lion.qa.lab.tlv.redhat.com:_export_yuri2_backup2/6a70504d-00df-4869-8695-0f442053f6b6/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-40::DEBUG::2014-07-10 09:45:50,083::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n369 bytes (369 B) copied, 0.000346937 s, 1.1 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-10 09:45:51,016::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/metadata bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-10 09:45:51,041::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00432255 s, 948 kB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:45:51,261::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:45:51,353::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0338292 s, 30.3 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 09:45:51,662::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-14::DEBUG::2014-07-10 09:45:51,664::task::595::TaskManager.Task::(_updateState) Task=`91efb437-d2fd-48a9-91ba-389a3aff3ff3`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 09:45:51,664::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-14::INFO::2014-07-10 09:45:51,665::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:45:51,665::task::1185::TaskManager.Task::(prepare) Task=`91efb437-d2fd-48a9-91ba-389a3aff3ff3`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:45:51,665::task::595::TaskManager.Task::(_updateState) Task=`91efb437-d2fd-48a9-91ba-389a3aff3ff3`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 09:45:51,665::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 09:45:51,666::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 09:45:51,666::task::990::TaskManager.Task::(_decref) Task=`91efb437-d2fd-48a9-91ba-389a3aff3ff3`::ref 0 aborting False >Thread-34::DEBUG::2014-07-10 09:45:51,670::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-34::DEBUG::2014-07-10 09:45:51,671::task::595::TaskManager.Task::(_updateState) Task=`cc57ec04-48ee-4fb4-b52e-77414b3f627f`::moving from state init -> state preparing >Thread-34::INFO::2014-07-10 09:45:51,671::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-34::DEBUG::2014-07-10 09:45:51,672::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`fa3f9c0e-c470-4f12-9f3b-82ffb07bd9dc`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-10 09:45:51,672::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' for lock type 'shared' >Thread-34::DEBUG::2014-07-10 09:45:51,672::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-10 09:45:51,672::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`fa3f9c0e-c470-4f12-9f3b-82ffb07bd9dc`::Granted request >Thread-34::DEBUG::2014-07-10 09:45:51,673::task::827::TaskManager.Task::(resourceAcquired) Task=`cc57ec04-48ee-4fb4-b52e-77414b3f627f`::_resourcesAcquired: Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee (shared) >Thread-34::DEBUG::2014-07-10 09:45:51,673::task::990::TaskManager.Task::(_decref) Task=`cc57ec04-48ee-4fb4-b52e-77414b3f627f`::ref 1 aborting False >Thread-34::INFO::2014-07-10 09:45:51,674::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532067385344', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:45:51,675::task::1185::TaskManager.Task::(prepare) Task=`cc57ec04-48ee-4fb4-b52e-77414b3f627f`::finished: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532067385344', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:45:51,675::task::595::TaskManager.Task::(_updateState) Task=`cc57ec04-48ee-4fb4-b52e-77414b3f627f`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-10 09:45:51,675::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee': < ResourceRef 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-10 09:45:51,675::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-10 09:45:51,675::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' >Thread-34::DEBUG::2014-07-10 09:45:51,676::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' (0 active users) >Thread-34::DEBUG::2014-07-10 09:45:51,676::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-10 09:45:51,676::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', Clearing records. >Thread-34::DEBUG::2014-07-10 09:45:51,676::task::990::TaskManager.Task::(_decref) Task=`cc57ec04-48ee-4fb4-b52e-77414b3f627f`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 09:45:53,368::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:45:54,008::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0659095 s, 15.5 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:45:56,438::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:45:56,531::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0345158 s, 29.7 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 09:45:57,260::task::595::TaskManager.Task::(_updateState) Task=`ceface59-d858-4b28-8d57-16c88636844f`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 09:45:57,261::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::INFO::2014-07-10 09:45:57,261::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00432255', 'lastCheck': '6.2', 'valid': True}, '6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000346937', 'lastCheck': '7.2', 'valid': True}} >Thread-14::DEBUG::2014-07-10 09:45:57,262::task::1185::TaskManager.Task::(prepare) Task=`ceface59-d858-4b28-8d57-16c88636844f`::finished: {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00432255', 'lastCheck': '6.2', 'valid': True}, '6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000346937', 'lastCheck': '7.2', 'valid': True}} >Thread-14::DEBUG::2014-07-10 09:45:57,262::task::595::TaskManager.Task::(_updateState) Task=`ceface59-d858-4b28-8d57-16c88636844f`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 09:45:57,262::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 09:45:57,262::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 09:45:57,262::task::990::TaskManager.Task::(_decref) Task=`ceface59-d858-4b28-8d57-16c88636844f`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 09:45:58,546::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:45:58,649::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.033294 s, 30.8 MB/s\n'; <rc> = 0 >Thread-40::DEBUG::2014-07-10 09:46:00,109::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lion.qa.lab.tlv.redhat.com:_export_yuri2_backup2/6a70504d-00df-4869-8695-0f442053f6b6/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-40::DEBUG::2014-07-10 09:46:00,129::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n369 bytes (369 B) copied, 0.000617346 s, 598 kB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:46:00,713::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:46:00,937::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.121482 s, 8.4 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-10 09:46:01,071::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/metadata bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-10 09:46:01,097::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00575343 s, 712 kB/s\n'; <rc> = 0 >Thread-64::DEBUG::2014-07-10 09:46:01,212::task::595::TaskManager.Task::(_updateState) Task=`126ff753-0edb-46c9-94ec-31973b27c6bb`::moving from state init -> state preparing >Thread-64::INFO::2014-07-10 09:46:01,212::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='aa20346a-4d3a-4e07-b8e1-52c0ebe4168c', volUUID='58fefce2-9bce-4bff-8949-8c6ce8122b27', options=None) >Thread-64::INFO::2014-07-10 09:46:01,213::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-64::DEBUG::2014-07-10 09:46:01,213::task::1185::TaskManager.Task::(prepare) Task=`126ff753-0edb-46c9-94ec-31973b27c6bb`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-64::DEBUG::2014-07-10 09:46:01,213::task::595::TaskManager.Task::(_updateState) Task=`126ff753-0edb-46c9-94ec-31973b27c6bb`::moving from state preparing -> state finished >Thread-64::DEBUG::2014-07-10 09:46:01,213::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-64::DEBUG::2014-07-10 09:46:01,214::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-64::DEBUG::2014-07-10 09:46:01,214::task::990::TaskManager.Task::(_decref) Task=`126ff753-0edb-46c9-94ec-31973b27c6bb`::ref 0 aborting False >Thread-14::DEBUG::2014-07-10 09:46:01,712::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-14::DEBUG::2014-07-10 09:46:01,713::task::595::TaskManager.Task::(_updateState) Task=`4b4405bb-4302-48f9-9c7f-8ab2a2369868`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 09:46:01,714::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-14::INFO::2014-07-10 09:46:01,714::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:46:01,715::task::1185::TaskManager.Task::(prepare) Task=`4b4405bb-4302-48f9-9c7f-8ab2a2369868`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:46:01,715::task::595::TaskManager.Task::(_updateState) Task=`4b4405bb-4302-48f9-9c7f-8ab2a2369868`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 09:46:01,715::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 09:46:01,715::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 09:46:01,715::task::990::TaskManager.Task::(_decref) Task=`4b4405bb-4302-48f9-9c7f-8ab2a2369868`::ref 0 aborting False >Thread-34::DEBUG::2014-07-10 09:46:01,720::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-34::DEBUG::2014-07-10 09:46:01,720::task::595::TaskManager.Task::(_updateState) Task=`32149d87-18cf-4393-abca-5128ab5fed47`::moving from state init -> state preparing >Thread-34::INFO::2014-07-10 09:46:01,720::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-34::DEBUG::2014-07-10 09:46:01,721::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`5f181c81-7f33-4877-87b7-c662bf5895f3`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-10 09:46:01,721::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' for lock type 'shared' >Thread-34::DEBUG::2014-07-10 09:46:01,722::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-10 09:46:01,722::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`5f181c81-7f33-4877-87b7-c662bf5895f3`::Granted request >Thread-34::DEBUG::2014-07-10 09:46:01,722::task::827::TaskManager.Task::(resourceAcquired) Task=`32149d87-18cf-4393-abca-5128ab5fed47`::_resourcesAcquired: Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee (shared) >Thread-34::DEBUG::2014-07-10 09:46:01,722::task::990::TaskManager.Task::(_decref) Task=`32149d87-18cf-4393-abca-5128ab5fed47`::ref 1 aborting False >Thread-34::INFO::2014-07-10 09:46:01,724::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532067385344', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:46:01,724::task::1185::TaskManager.Task::(prepare) Task=`32149d87-18cf-4393-abca-5128ab5fed47`::finished: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532067385344', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:46:01,724::task::595::TaskManager.Task::(_updateState) Task=`32149d87-18cf-4393-abca-5128ab5fed47`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-10 09:46:01,725::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee': < ResourceRef 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-10 09:46:01,725::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-10 09:46:01,725::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' >Thread-34::DEBUG::2014-07-10 09:46:01,725::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' (0 active users) >Thread-34::DEBUG::2014-07-10 09:46:01,726::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-10 09:46:01,726::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', Clearing records. >Thread-34::DEBUG::2014-07-10 09:46:01,726::task::990::TaskManager.Task::(_decref) Task=`32149d87-18cf-4393-abca-5128ab5fed47`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 09:46:02,954::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:46:03,041::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0296344 s, 34.6 MB/s\n'; <rc> = 0 >Thread-54::DEBUG::2014-07-10 09:46:04,030::task::595::TaskManager.Task::(_updateState) Task=`2308b78f-452d-43da-a3f2-1c1a245e3e87`::moving from state init -> state preparing >Thread-73::DEBUG::2014-07-10 09:46:04,034::task::595::TaskManager.Task::(_updateState) Task=`0d4b92b2-cef3-4ed6-9964-3b6a829f5c8a`::moving from state init -> state preparing >Thread-54::INFO::2014-07-10 09:46:04,034::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='28408446-e5fd-4565-a976-e760951593fe', volUUID='776303a2-5585-451e-826e-0e338d4a1e98', options=None) >Thread-73::INFO::2014-07-10 09:46:04,037::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='c01d693b-cba0-4fed-9ad7-0aaa28912a19', volUUID='4bb5d954-2a50-4028-b299-0b43c261270c', options=None) >Thread-54::INFO::2014-07-10 09:46:04,039::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-73::INFO::2014-07-10 09:46:04,041::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-54::DEBUG::2014-07-10 09:46:04,042::task::1185::TaskManager.Task::(prepare) Task=`2308b78f-452d-43da-a3f2-1c1a245e3e87`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-73::DEBUG::2014-07-10 09:46:04,044::task::1185::TaskManager.Task::(prepare) Task=`0d4b92b2-cef3-4ed6-9964-3b6a829f5c8a`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-73::DEBUG::2014-07-10 09:46:04,047::task::595::TaskManager.Task::(_updateState) Task=`0d4b92b2-cef3-4ed6-9964-3b6a829f5c8a`::moving from state preparing -> state finished >Thread-54::DEBUG::2014-07-10 09:46:04,046::task::595::TaskManager.Task::(_updateState) Task=`2308b78f-452d-43da-a3f2-1c1a245e3e87`::moving from state preparing -> state finished >Thread-73::DEBUG::2014-07-10 09:46:04,049::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-54::DEBUG::2014-07-10 09:46:04,050::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-73::DEBUG::2014-07-10 09:46:04,052::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-54::DEBUG::2014-07-10 09:46:04,053::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-73::DEBUG::2014-07-10 09:46:04,055::task::990::TaskManager.Task::(_decref) Task=`0d4b92b2-cef3-4ed6-9964-3b6a829f5c8a`::ref 0 aborting False >Thread-54::DEBUG::2014-07-10 09:46:04,057::task::990::TaskManager.Task::(_decref) Task=`2308b78f-452d-43da-a3f2-1c1a245e3e87`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 09:46:05,055::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:46:05,150::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0365764 s, 28.0 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:46:07,165::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:46:07,252::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0291244 s, 35.2 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:46:09,269::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:46:09,375::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0394026 s, 26.0 MB/s\n'; <rc> = 0 >Thread-40::DEBUG::2014-07-10 09:46:10,163::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lion.qa.lab.tlv.redhat.com:_export_yuri2_backup2/6a70504d-00df-4869-8695-0f442053f6b6/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-40::DEBUG::2014-07-10 09:46:10,190::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n369 bytes (369 B) copied, 0.000462719 s, 797 kB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-10 09:46:11,126::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/metadata bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-10 09:46:11,155::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00700236 s, 585 kB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:46:11,390::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:46:11,481::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0354953 s, 28.8 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 09:46:11,762::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-14::DEBUG::2014-07-10 09:46:11,763::task::595::TaskManager.Task::(_updateState) Task=`2440f2a1-7353-46e1-bc2d-532276954ac3`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 09:46:11,764::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-14::INFO::2014-07-10 09:46:11,764::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:46:11,765::task::1185::TaskManager.Task::(prepare) Task=`2440f2a1-7353-46e1-bc2d-532276954ac3`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:46:11,765::task::595::TaskManager.Task::(_updateState) Task=`2440f2a1-7353-46e1-bc2d-532276954ac3`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 09:46:11,765::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 09:46:11,765::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 09:46:11,766::task::990::TaskManager.Task::(_decref) Task=`2440f2a1-7353-46e1-bc2d-532276954ac3`::ref 0 aborting False >Thread-34::DEBUG::2014-07-10 09:46:11,770::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-34::DEBUG::2014-07-10 09:46:11,771::task::595::TaskManager.Task::(_updateState) Task=`c808ff99-0caf-4c87-93b6-bb36cba3bf87`::moving from state init -> state preparing >Thread-34::INFO::2014-07-10 09:46:11,771::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-34::DEBUG::2014-07-10 09:46:11,772::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`0ffc4872-e9a9-4bad-9a7d-8729bd2388b7`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-10 09:46:11,772::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' for lock type 'shared' >Thread-34::DEBUG::2014-07-10 09:46:11,773::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-10 09:46:11,773::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`0ffc4872-e9a9-4bad-9a7d-8729bd2388b7`::Granted request >Thread-34::DEBUG::2014-07-10 09:46:11,773::task::827::TaskManager.Task::(resourceAcquired) Task=`c808ff99-0caf-4c87-93b6-bb36cba3bf87`::_resourcesAcquired: Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee (shared) >Thread-34::DEBUG::2014-07-10 09:46:11,773::task::990::TaskManager.Task::(_decref) Task=`c808ff99-0caf-4c87-93b6-bb36cba3bf87`::ref 1 aborting False >Thread-34::INFO::2014-07-10 09:46:11,775::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532067385344', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:46:11,775::task::1185::TaskManager.Task::(prepare) Task=`c808ff99-0caf-4c87-93b6-bb36cba3bf87`::finished: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532067385344', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:46:11,775::task::595::TaskManager.Task::(_updateState) Task=`c808ff99-0caf-4c87-93b6-bb36cba3bf87`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-10 09:46:11,775::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee': < ResourceRef 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-10 09:46:11,775::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-10 09:46:11,776::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' >Thread-34::DEBUG::2014-07-10 09:46:11,776::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' (0 active users) >Thread-34::DEBUG::2014-07-10 09:46:11,776::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-10 09:46:11,776::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', Clearing records. >Thread-34::DEBUG::2014-07-10 09:46:11,776::task::990::TaskManager.Task::(_decref) Task=`c808ff99-0caf-4c87-93b6-bb36cba3bf87`::ref 0 aborting False >Thread-14::DEBUG::2014-07-10 09:46:12,483::task::595::TaskManager.Task::(_updateState) Task=`a65aa9bf-4938-4eb9-9fa0-a7454184aa14`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 09:46:12,483::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::INFO::2014-07-10 09:46:12,484::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00700236', 'lastCheck': '1.3', 'valid': True}, '6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000462719', 'lastCheck': '2.3', 'valid': True}} >Thread-14::DEBUG::2014-07-10 09:46:12,484::task::1185::TaskManager.Task::(prepare) Task=`a65aa9bf-4938-4eb9-9fa0-a7454184aa14`::finished: {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00700236', 'lastCheck': '1.3', 'valid': True}, '6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000462719', 'lastCheck': '2.3', 'valid': True}} >Thread-14::DEBUG::2014-07-10 09:46:12,484::task::595::TaskManager.Task::(_updateState) Task=`a65aa9bf-4938-4eb9-9fa0-a7454184aa14`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 09:46:12,484::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 09:46:12,484::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 09:46:12,485::task::990::TaskManager.Task::(_decref) Task=`a65aa9bf-4938-4eb9-9fa0-a7454184aa14`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 09:46:13,491::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:46:13,579::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0285475 s, 35.9 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:46:15,594::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:46:15,706::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0510595 s, 20.1 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:46:17,722::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:46:17,826::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0422758 s, 24.2 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:46:19,841::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:46:19,933::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0319662 s, 32.0 MB/s\n'; <rc> = 0 >Thread-40::DEBUG::2014-07-10 09:46:20,232::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lion.qa.lab.tlv.redhat.com:_export_yuri2_backup2/6a70504d-00df-4869-8695-0f442053f6b6/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-40::DEBUG::2014-07-10 09:46:20,259::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n369 bytes (369 B) copied, 0.000500138 s, 738 kB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-10 09:46:21,184::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/metadata bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-10 09:46:21,213::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00718543 s, 570 kB/s\n'; <rc> = 0 >Thread-57::DEBUG::2014-07-10 09:46:21,711::task::595::TaskManager.Task::(_updateState) Task=`420f5369-275e-4ed1-9172-6b7393968ac7`::moving from state init -> state preparing >Thread-57::INFO::2014-07-10 09:46:21,712::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='b6f6c0da-e67f-4902-b9ac-3069571a42fe', volUUID='c4cd1da8-05b7-45e0-80b1-1183d21443d9', options=None) >Thread-57::INFO::2014-07-10 09:46:21,712::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-57::DEBUG::2014-07-10 09:46:21,712::task::1185::TaskManager.Task::(prepare) Task=`420f5369-275e-4ed1-9172-6b7393968ac7`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-57::DEBUG::2014-07-10 09:46:21,713::task::595::TaskManager.Task::(_updateState) Task=`420f5369-275e-4ed1-9172-6b7393968ac7`::moving from state preparing -> state finished >Thread-57::DEBUG::2014-07-10 09:46:21,713::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-57::DEBUG::2014-07-10 09:46:21,713::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-57::DEBUG::2014-07-10 09:46:21,713::task::990::TaskManager.Task::(_decref) Task=`420f5369-275e-4ed1-9172-6b7393968ac7`::ref 0 aborting False >Thread-14::DEBUG::2014-07-10 09:46:21,811::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-14::DEBUG::2014-07-10 09:46:21,812::task::595::TaskManager.Task::(_updateState) Task=`bbce32af-3d9e-4eb6-842d-377736dfafdc`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 09:46:21,812::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-14::INFO::2014-07-10 09:46:21,813::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:46:21,813::task::1185::TaskManager.Task::(prepare) Task=`bbce32af-3d9e-4eb6-842d-377736dfafdc`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:46:21,813::task::595::TaskManager.Task::(_updateState) Task=`bbce32af-3d9e-4eb6-842d-377736dfafdc`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 09:46:21,813::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 09:46:21,814::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 09:46:21,814::task::990::TaskManager.Task::(_decref) Task=`bbce32af-3d9e-4eb6-842d-377736dfafdc`::ref 0 aborting False >Thread-34::DEBUG::2014-07-10 09:46:21,818::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-34::DEBUG::2014-07-10 09:46:21,818::task::595::TaskManager.Task::(_updateState) Task=`1d459ed1-bce7-406e-b56d-5ba4e32bcc5f`::moving from state init -> state preparing >Thread-34::INFO::2014-07-10 09:46:21,819::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-34::DEBUG::2014-07-10 09:46:21,820::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`58a649c1-4da6-4c81-b253-a2fac6506b59`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-10 09:46:21,820::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' for lock type 'shared' >Thread-34::DEBUG::2014-07-10 09:46:21,820::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-10 09:46:21,821::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`58a649c1-4da6-4c81-b253-a2fac6506b59`::Granted request >Thread-34::DEBUG::2014-07-10 09:46:21,821::task::827::TaskManager.Task::(resourceAcquired) Task=`1d459ed1-bce7-406e-b56d-5ba4e32bcc5f`::_resourcesAcquired: Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee (shared) >Thread-34::DEBUG::2014-07-10 09:46:21,822::task::990::TaskManager.Task::(_decref) Task=`1d459ed1-bce7-406e-b56d-5ba4e32bcc5f`::ref 1 aborting False >Thread-34::INFO::2014-07-10 09:46:21,823::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532067385344', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:46:21,823::task::1185::TaskManager.Task::(prepare) Task=`1d459ed1-bce7-406e-b56d-5ba4e32bcc5f`::finished: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532067385344', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:46:21,824::task::595::TaskManager.Task::(_updateState) Task=`1d459ed1-bce7-406e-b56d-5ba4e32bcc5f`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-10 09:46:21,824::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee': < ResourceRef 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-10 09:46:21,824::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-10 09:46:21,825::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' >Thread-34::DEBUG::2014-07-10 09:46:21,825::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' (0 active users) >Thread-34::DEBUG::2014-07-10 09:46:21,825::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-10 09:46:21,825::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', Clearing records. >Thread-34::DEBUG::2014-07-10 09:46:21,826::task::990::TaskManager.Task::(_decref) Task=`1d459ed1-bce7-406e-b56d-5ba4e32bcc5f`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 09:46:21,956::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:46:22,063::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.050426 s, 20.3 MB/s\n'; <rc> = 0 >Thread-67::DEBUG::2014-07-10 09:46:22,239::task::595::TaskManager.Task::(_updateState) Task=`2f27ed2f-b6f3-4e4d-94ea-a900731745c1`::moving from state init -> state preparing >Thread-67::INFO::2014-07-10 09:46:22,240::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='f30c2cb7-a43a-4bf5-82b5-cfe07336f65c', volUUID='b0fbb3c9-55af-4a3a-95ad-fc56a80b9cf5', options=None) >Thread-67::INFO::2014-07-10 09:46:22,240::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-67::DEBUG::2014-07-10 09:46:22,240::task::1185::TaskManager.Task::(prepare) Task=`2f27ed2f-b6f3-4e4d-94ea-a900731745c1`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-67::DEBUG::2014-07-10 09:46:22,241::task::595::TaskManager.Task::(_updateState) Task=`2f27ed2f-b6f3-4e4d-94ea-a900731745c1`::moving from state preparing -> state finished >Thread-67::DEBUG::2014-07-10 09:46:22,241::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-67::DEBUG::2014-07-10 09:46:22,241::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-67::DEBUG::2014-07-10 09:46:22,241::task::990::TaskManager.Task::(_decref) Task=`2f27ed2f-b6f3-4e4d-94ea-a900731745c1`::ref 0 aborting False >Thread-48::DEBUG::2014-07-10 09:46:22,701::task::595::TaskManager.Task::(_updateState) Task=`c55d6898-20d7-491b-a55d-ad9b85447757`::moving from state init -> state preparing >Thread-48::INFO::2014-07-10 09:46:22,701::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='0cd7d6ce-f497-4243-a690-c57744861eea', volUUID='10b6a7dd-dc6c-43fa-ba17-92e4331b0e0b', options=None) >Thread-48::INFO::2014-07-10 09:46:22,702::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-48::DEBUG::2014-07-10 09:46:22,702::task::1185::TaskManager.Task::(prepare) Task=`c55d6898-20d7-491b-a55d-ad9b85447757`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-48::DEBUG::2014-07-10 09:46:22,702::task::595::TaskManager.Task::(_updateState) Task=`c55d6898-20d7-491b-a55d-ad9b85447757`::moving from state preparing -> state finished >Thread-48::DEBUG::2014-07-10 09:46:22,702::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-48::DEBUG::2014-07-10 09:46:22,703::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-48::DEBUG::2014-07-10 09:46:22,703::task::990::TaskManager.Task::(_decref) Task=`c55d6898-20d7-491b-a55d-ad9b85447757`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 09:46:24,078::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:46:24,168::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0269724 s, 38.0 MB/s\n'; <rc> = 0 >Thread-76::DEBUG::2014-07-10 09:46:24,245::task::595::TaskManager.Task::(_updateState) Task=`cf2222a9-dad5-477c-bfb1-c8434c41e21c`::moving from state init -> state preparing >Thread-76::INFO::2014-07-10 09:46:24,245::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='e4c65229-4247-4b33-b72a-f1d5ce72ad05', volUUID='cad94284-3ca9-4c30-933d-997f4460309e', options=None) >Thread-76::INFO::2014-07-10 09:46:24,246::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-76::DEBUG::2014-07-10 09:46:24,246::task::1185::TaskManager.Task::(prepare) Task=`cf2222a9-dad5-477c-bfb1-c8434c41e21c`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-76::DEBUG::2014-07-10 09:46:24,246::task::595::TaskManager.Task::(_updateState) Task=`cf2222a9-dad5-477c-bfb1-c8434c41e21c`::moving from state preparing -> state finished >Thread-76::DEBUG::2014-07-10 09:46:24,246::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-76::DEBUG::2014-07-10 09:46:24,247::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-76::DEBUG::2014-07-10 09:46:24,247::task::990::TaskManager.Task::(_decref) Task=`cf2222a9-dad5-477c-bfb1-c8434c41e21c`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 09:46:26,204::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:46:26,306::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0378057 s, 27.1 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 09:46:27,684::task::595::TaskManager.Task::(_updateState) Task=`2fdaa002-8879-4630-845d-c8c1d6846aad`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 09:46:27,684::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::INFO::2014-07-10 09:46:27,685::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00718543', 'lastCheck': '6.4', 'valid': True}, '6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000500138', 'lastCheck': '7.4', 'valid': True}} >Thread-14::DEBUG::2014-07-10 09:46:27,685::task::1185::TaskManager.Task::(prepare) Task=`2fdaa002-8879-4630-845d-c8c1d6846aad`::finished: {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00718543', 'lastCheck': '6.4', 'valid': True}, '6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000500138', 'lastCheck': '7.4', 'valid': True}} >Thread-14::DEBUG::2014-07-10 09:46:27,685::task::595::TaskManager.Task::(_updateState) Task=`2fdaa002-8879-4630-845d-c8c1d6846aad`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 09:46:27,685::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 09:46:27,685::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 09:46:27,686::task::990::TaskManager.Task::(_decref) Task=`2fdaa002-8879-4630-845d-c8c1d6846aad`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 09:46:28,323::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:46:28,415::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0336556 s, 30.4 MB/s\n'; <rc> = 0 >Thread-40::DEBUG::2014-07-10 09:46:30,285::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lion.qa.lab.tlv.redhat.com:_export_yuri2_backup2/6a70504d-00df-4869-8695-0f442053f6b6/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-40::DEBUG::2014-07-10 09:46:30,305::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n369 bytes (369 B) copied, 0.000450137 s, 820 kB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:46:30,430::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:46:30,534::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0349419 s, 29.3 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-10 09:46:31,243::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/metadata bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-10 09:46:31,264::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000695841 s, 5.9 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 09:46:31,862::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-14::DEBUG::2014-07-10 09:46:31,863::task::595::TaskManager.Task::(_updateState) Task=`38b187a9-15e8-46cd-ae37-577a9437d3b0`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 09:46:31,864::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-14::INFO::2014-07-10 09:46:31,864::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:46:31,864::task::1185::TaskManager.Task::(prepare) Task=`38b187a9-15e8-46cd-ae37-577a9437d3b0`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:46:31,865::task::595::TaskManager.Task::(_updateState) Task=`38b187a9-15e8-46cd-ae37-577a9437d3b0`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 09:46:31,865::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 09:46:31,865::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 09:46:31,865::task::990::TaskManager.Task::(_decref) Task=`38b187a9-15e8-46cd-ae37-577a9437d3b0`::ref 0 aborting False >Thread-34::DEBUG::2014-07-10 09:46:31,869::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-34::DEBUG::2014-07-10 09:46:31,870::task::595::TaskManager.Task::(_updateState) Task=`712dc322-603c-4b7a-8d4e-02512f262a71`::moving from state init -> state preparing >Thread-34::INFO::2014-07-10 09:46:31,870::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-34::DEBUG::2014-07-10 09:46:31,871::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`554c90d4-0e63-44da-bde6-7ffa3e802d9d`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-10 09:46:31,871::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' for lock type 'shared' >Thread-34::DEBUG::2014-07-10 09:46:31,871::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-10 09:46:31,871::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`554c90d4-0e63-44da-bde6-7ffa3e802d9d`::Granted request >Thread-34::DEBUG::2014-07-10 09:46:31,872::task::827::TaskManager.Task::(resourceAcquired) Task=`712dc322-603c-4b7a-8d4e-02512f262a71`::_resourcesAcquired: Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee (shared) >Thread-34::DEBUG::2014-07-10 09:46:31,872::task::990::TaskManager.Task::(_decref) Task=`712dc322-603c-4b7a-8d4e-02512f262a71`::ref 1 aborting False >Thread-34::INFO::2014-07-10 09:46:31,873::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532067385344', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:46:31,874::task::1185::TaskManager.Task::(prepare) Task=`712dc322-603c-4b7a-8d4e-02512f262a71`::finished: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532067385344', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:46:31,874::task::595::TaskManager.Task::(_updateState) Task=`712dc322-603c-4b7a-8d4e-02512f262a71`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-10 09:46:31,874::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee': < ResourceRef 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-10 09:46:31,874::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-10 09:46:31,874::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' >Thread-34::DEBUG::2014-07-10 09:46:31,875::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' (0 active users) >Thread-34::DEBUG::2014-07-10 09:46:31,875::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-10 09:46:31,875::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', Clearing records. >Thread-34::DEBUG::2014-07-10 09:46:31,875::task::990::TaskManager.Task::(_decref) Task=`712dc322-603c-4b7a-8d4e-02512f262a71`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 09:46:32,550::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:46:32,636::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0271342 s, 37.7 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:46:34,652::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:46:34,768::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0353946 s, 28.9 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:46:36,861::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:46:36,955::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0326358 s, 31.4 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:46:38,972::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:46:39,065::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.033943 s, 30.2 MB/s\n'; <rc> = 0 >Thread-40::DEBUG::2014-07-10 09:46:40,337::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lion.qa.lab.tlv.redhat.com:_export_yuri2_backup2/6a70504d-00df-4869-8695-0f442053f6b6/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-40::DEBUG::2014-07-10 09:46:40,360::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n369 bytes (369 B) copied, 0.000483004 s, 764 kB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:46:41,081::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:46:41,173::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0323911 s, 31.6 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-10 09:46:41,294::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/metadata bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-10 09:46:41,315::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000752935 s, 5.4 MB/s\n'; <rc> = 0 >Thread-70::DEBUG::2014-07-10 09:46:41,407::task::595::TaskManager.Task::(_updateState) Task=`d920f8ef-8968-4184-a501-28b1fd876825`::moving from state init -> state preparing >Thread-70::INFO::2014-07-10 09:46:41,408::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='cfaeead2-7caa-467c-b389-c89840ae6605', volUUID='567fe32d-31a6-4ff6-90f3-fd6a656fbecc', options=None) >Thread-70::INFO::2014-07-10 09:46:41,408::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-70::DEBUG::2014-07-10 09:46:41,408::task::1185::TaskManager.Task::(prepare) Task=`d920f8ef-8968-4184-a501-28b1fd876825`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-70::DEBUG::2014-07-10 09:46:41,409::task::595::TaskManager.Task::(_updateState) Task=`d920f8ef-8968-4184-a501-28b1fd876825`::moving from state preparing -> state finished >Thread-70::DEBUG::2014-07-10 09:46:41,409::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-70::DEBUG::2014-07-10 09:46:41,409::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-70::DEBUG::2014-07-10 09:46:41,409::task::990::TaskManager.Task::(_decref) Task=`d920f8ef-8968-4184-a501-28b1fd876825`::ref 0 aborting False >Thread-14::DEBUG::2014-07-10 09:46:41,904::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-14::DEBUG::2014-07-10 09:46:41,905::task::595::TaskManager.Task::(_updateState) Task=`209faa1c-36df-423a-a3e0-b9919db151b4`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 09:46:41,905::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-14::INFO::2014-07-10 09:46:41,906::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:46:41,906::task::1185::TaskManager.Task::(prepare) Task=`209faa1c-36df-423a-a3e0-b9919db151b4`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:46:41,906::task::595::TaskManager.Task::(_updateState) Task=`209faa1c-36df-423a-a3e0-b9919db151b4`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 09:46:41,906::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 09:46:41,906::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 09:46:41,907::task::990::TaskManager.Task::(_decref) Task=`209faa1c-36df-423a-a3e0-b9919db151b4`::ref 0 aborting False >Thread-34::DEBUG::2014-07-10 09:46:41,911::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-34::DEBUG::2014-07-10 09:46:41,911::task::595::TaskManager.Task::(_updateState) Task=`b9a3e11b-83d1-4296-974e-7ca3ca995b6f`::moving from state init -> state preparing >Thread-34::INFO::2014-07-10 09:46:41,911::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-34::DEBUG::2014-07-10 09:46:41,912::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`6bd42514-e1f5-45ec-bac6-fd6937aa5adb`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-10 09:46:41,912::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' for lock type 'shared' >Thread-34::DEBUG::2014-07-10 09:46:41,912::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-10 09:46:41,913::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`6bd42514-e1f5-45ec-bac6-fd6937aa5adb`::Granted request >Thread-34::DEBUG::2014-07-10 09:46:41,913::task::827::TaskManager.Task::(resourceAcquired) Task=`b9a3e11b-83d1-4296-974e-7ca3ca995b6f`::_resourcesAcquired: Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee (shared) >Thread-34::DEBUG::2014-07-10 09:46:41,913::task::990::TaskManager.Task::(_decref) Task=`b9a3e11b-83d1-4296-974e-7ca3ca995b6f`::ref 1 aborting False >Thread-34::INFO::2014-07-10 09:46:41,914::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532067385344', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:46:41,914::task::1185::TaskManager.Task::(prepare) Task=`b9a3e11b-83d1-4296-974e-7ca3ca995b6f`::finished: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532067385344', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:46:41,915::task::595::TaskManager.Task::(_updateState) Task=`b9a3e11b-83d1-4296-974e-7ca3ca995b6f`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-10 09:46:41,915::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee': < ResourceRef 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-10 09:46:41,915::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-10 09:46:41,915::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' >Thread-34::DEBUG::2014-07-10 09:46:41,915::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' (0 active users) >Thread-34::DEBUG::2014-07-10 09:46:41,915::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-10 09:46:41,916::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', Clearing records. >Thread-34::DEBUG::2014-07-10 09:46:41,916::task::990::TaskManager.Task::(_decref) Task=`b9a3e11b-83d1-4296-974e-7ca3ca995b6f`::ref 0 aborting False >Thread-60::DEBUG::2014-07-10 09:46:42,853::task::595::TaskManager.Task::(_updateState) Task=`2db34d24-0273-4a4a-8439-9026bad18d48`::moving from state init -> state preparing >Thread-51::DEBUG::2014-07-10 09:46:42,854::task::595::TaskManager.Task::(_updateState) Task=`c9313c44-3220-4681-9b79-bfaf697fe41b`::moving from state init -> state preparing >Thread-60::INFO::2014-07-10 09:46:42,854::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='b034d5b0-e1e0-4011-b49b-4d45ddb11556', volUUID='3d7f62b5-328f-4d8e-8b69-873cfb5ae14d', options=None) >Thread-51::INFO::2014-07-10 09:46:42,854::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='76fdb054-02cd-42ed-9721-b3e65b34c3a4', volUUID='022dfe46-2cf7-4915-80b3-883158e3ca83', options=None) >Thread-60::INFO::2014-07-10 09:46:42,855::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-51::INFO::2014-07-10 09:46:42,855::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-60::DEBUG::2014-07-10 09:46:42,855::task::1185::TaskManager.Task::(prepare) Task=`2db34d24-0273-4a4a-8439-9026bad18d48`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-51::DEBUG::2014-07-10 09:46:42,856::task::1185::TaskManager.Task::(prepare) Task=`c9313c44-3220-4681-9b79-bfaf697fe41b`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-60::DEBUG::2014-07-10 09:46:42,856::task::595::TaskManager.Task::(_updateState) Task=`2db34d24-0273-4a4a-8439-9026bad18d48`::moving from state preparing -> state finished >Thread-51::DEBUG::2014-07-10 09:46:42,856::task::595::TaskManager.Task::(_updateState) Task=`c9313c44-3220-4681-9b79-bfaf697fe41b`::moving from state preparing -> state finished >Thread-60::DEBUG::2014-07-10 09:46:42,856::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-51::DEBUG::2014-07-10 09:46:42,856::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-60::DEBUG::2014-07-10 09:46:42,857::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-51::DEBUG::2014-07-10 09:46:42,857::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-60::DEBUG::2014-07-10 09:46:42,857::task::990::TaskManager.Task::(_decref) Task=`2db34d24-0273-4a4a-8439-9026bad18d48`::ref 0 aborting False >Thread-51::DEBUG::2014-07-10 09:46:42,857::task::990::TaskManager.Task::(_decref) Task=`c9313c44-3220-4681-9b79-bfaf697fe41b`::ref 0 aborting False >Thread-14::DEBUG::2014-07-10 09:46:42,872::task::595::TaskManager.Task::(_updateState) Task=`8d267a4a-dbf2-434f-ac6d-dce84bdbd88d`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 09:46:42,873::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::INFO::2014-07-10 09:46:42,873::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000752935', 'lastCheck': '1.5', 'valid': True}, '6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000483004', 'lastCheck': '2.5', 'valid': True}} >Thread-14::DEBUG::2014-07-10 09:46:42,873::task::1185::TaskManager.Task::(prepare) Task=`8d267a4a-dbf2-434f-ac6d-dce84bdbd88d`::finished: {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000752935', 'lastCheck': '1.5', 'valid': True}, '6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000483004', 'lastCheck': '2.5', 'valid': True}} >Thread-14::DEBUG::2014-07-10 09:46:42,873::task::595::TaskManager.Task::(_updateState) Task=`8d267a4a-dbf2-434f-ac6d-dce84bdbd88d`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 09:46:42,874::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 09:46:42,874::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 09:46:42,874::task::990::TaskManager.Task::(_decref) Task=`8d267a4a-dbf2-434f-ac6d-dce84bdbd88d`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 09:46:43,189::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:46:43,340::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0269563 s, 38.0 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:46:45,369::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:46:45,477::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0492782 s, 20.8 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:46:47,496::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:46:47,598::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0269444 s, 38.0 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:46:49,614::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:46:49,708::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0351156 s, 29.2 MB/s\n'; <rc> = 0 >Thread-40::DEBUG::2014-07-10 09:46:50,390::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lion.qa.lab.tlv.redhat.com:_export_yuri2_backup2/6a70504d-00df-4869-8695-0f442053f6b6/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-40::DEBUG::2014-07-10 09:46:50,416::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n369 bytes (369 B) copied, 0.000469624 s, 786 kB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-10 09:46:51,344::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/metadata bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-10 09:46:51,366::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000678117 s, 6.0 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:46:51,723::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:46:51,813::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0324545 s, 31.6 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 09:46:51,953::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-14::DEBUG::2014-07-10 09:46:51,955::task::595::TaskManager.Task::(_updateState) Task=`181e86d3-835d-48db-ab2d-2aa44c6360b5`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 09:46:51,955::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-14::INFO::2014-07-10 09:46:51,956::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:46:51,956::task::1185::TaskManager.Task::(prepare) Task=`181e86d3-835d-48db-ab2d-2aa44c6360b5`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:46:51,956::task::595::TaskManager.Task::(_updateState) Task=`181e86d3-835d-48db-ab2d-2aa44c6360b5`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 09:46:51,956::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 09:46:51,956::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 09:46:51,957::task::990::TaskManager.Task::(_decref) Task=`181e86d3-835d-48db-ab2d-2aa44c6360b5`::ref 0 aborting False >Thread-34::DEBUG::2014-07-10 09:46:51,961::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-34::DEBUG::2014-07-10 09:46:51,961::task::595::TaskManager.Task::(_updateState) Task=`ebc0bc09-4f97-4449-88c0-255530cce3a7`::moving from state init -> state preparing >Thread-34::INFO::2014-07-10 09:46:51,962::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-34::DEBUG::2014-07-10 09:46:51,962::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`9c216070-cb1d-4e02-8b7f-0710680b5923`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-10 09:46:51,963::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' for lock type 'shared' >Thread-34::DEBUG::2014-07-10 09:46:51,963::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-10 09:46:51,963::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`9c216070-cb1d-4e02-8b7f-0710680b5923`::Granted request >Thread-34::DEBUG::2014-07-10 09:46:51,964::task::827::TaskManager.Task::(resourceAcquired) Task=`ebc0bc09-4f97-4449-88c0-255530cce3a7`::_resourcesAcquired: Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee (shared) >Thread-34::DEBUG::2014-07-10 09:46:51,964::task::990::TaskManager.Task::(_decref) Task=`ebc0bc09-4f97-4449-88c0-255530cce3a7`::ref 1 aborting False >Thread-34::INFO::2014-07-10 09:46:51,965::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532067385344', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:46:51,965::task::1185::TaskManager.Task::(prepare) Task=`ebc0bc09-4f97-4449-88c0-255530cce3a7`::finished: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532067385344', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:46:51,965::task::595::TaskManager.Task::(_updateState) Task=`ebc0bc09-4f97-4449-88c0-255530cce3a7`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-10 09:46:51,966::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee': < ResourceRef 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-10 09:46:51,966::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-10 09:46:51,966::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' >Thread-34::DEBUG::2014-07-10 09:46:51,966::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' (0 active users) >Thread-34::DEBUG::2014-07-10 09:46:51,966::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-10 09:46:51,967::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', Clearing records. >Thread-34::DEBUG::2014-07-10 09:46:51,967::task::990::TaskManager.Task::(_decref) Task=`ebc0bc09-4f97-4449-88c0-255530cce3a7`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 09:46:53,828::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:46:53,920::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0303016 s, 33.8 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:46:55,935::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:46:56,053::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0430678 s, 23.8 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 09:46:58,058::task::595::TaskManager.Task::(_updateState) Task=`0071f009-80bc-4215-afce-279d7bdecf9b`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 09:46:58,058::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::INFO::2014-07-10 09:46:58,059::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000678117', 'lastCheck': '6.7', 'valid': True}, '6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000469624', 'lastCheck': '7.6', 'valid': True}} >Thread-14::DEBUG::2014-07-10 09:46:58,059::task::1185::TaskManager.Task::(prepare) Task=`0071f009-80bc-4215-afce-279d7bdecf9b`::finished: {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000678117', 'lastCheck': '6.7', 'valid': True}, '6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000469624', 'lastCheck': '7.6', 'valid': True}} >Thread-14::DEBUG::2014-07-10 09:46:58,059::task::595::TaskManager.Task::(_updateState) Task=`0071f009-80bc-4215-afce-279d7bdecf9b`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 09:46:58,059::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 09:46:58,059::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 09:46:58,059::task::990::TaskManager.Task::(_decref) Task=`0071f009-80bc-4215-afce-279d7bdecf9b`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 09:46:58,086::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:46:58,176::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0298844 s, 34.3 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:47:00,191::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:47:00,281::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0309888 s, 33.0 MB/s\n'; <rc> = 0 >Thread-40::DEBUG::2014-07-10 09:47:00,448::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lion.qa.lab.tlv.redhat.com:_export_yuri2_backup2/6a70504d-00df-4869-8695-0f442053f6b6/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-40::DEBUG::2014-07-10 09:47:00,474::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n369 bytes (369 B) copied, 0.000346354 s, 1.1 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-10 09:47:01,395::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/metadata bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-10 09:47:01,415::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000599601 s, 6.8 MB/s\n'; <rc> = 0 >Thread-64::DEBUG::2014-07-10 09:47:01,490::task::595::TaskManager.Task::(_updateState) Task=`b2f8d5d0-921a-4a18-ba26-245edd6933bf`::moving from state init -> state preparing >Thread-64::INFO::2014-07-10 09:47:01,491::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='aa20346a-4d3a-4e07-b8e1-52c0ebe4168c', volUUID='58fefce2-9bce-4bff-8949-8c6ce8122b27', options=None) >Thread-64::INFO::2014-07-10 09:47:01,491::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-64::DEBUG::2014-07-10 09:47:01,491::task::1185::TaskManager.Task::(prepare) Task=`b2f8d5d0-921a-4a18-ba26-245edd6933bf`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-64::DEBUG::2014-07-10 09:47:01,491::task::595::TaskManager.Task::(_updateState) Task=`b2f8d5d0-921a-4a18-ba26-245edd6933bf`::moving from state preparing -> state finished >Thread-64::DEBUG::2014-07-10 09:47:01,492::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-64::DEBUG::2014-07-10 09:47:01,492::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-64::DEBUG::2014-07-10 09:47:01,492::task::990::TaskManager.Task::(_decref) Task=`b2f8d5d0-921a-4a18-ba26-245edd6933bf`::ref 0 aborting False >Thread-14::DEBUG::2014-07-10 09:47:01,995::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-14::DEBUG::2014-07-10 09:47:01,996::task::595::TaskManager.Task::(_updateState) Task=`7f42d292-02a1-4fcf-be74-975bc8b5ed4b`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 09:47:01,997::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-14::INFO::2014-07-10 09:47:01,997::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:47:01,998::task::1185::TaskManager.Task::(prepare) Task=`7f42d292-02a1-4fcf-be74-975bc8b5ed4b`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:47:01,998::task::595::TaskManager.Task::(_updateState) Task=`7f42d292-02a1-4fcf-be74-975bc8b5ed4b`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 09:47:01,998::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 09:47:01,998::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 09:47:01,998::task::990::TaskManager.Task::(_decref) Task=`7f42d292-02a1-4fcf-be74-975bc8b5ed4b`::ref 0 aborting False >Thread-34::DEBUG::2014-07-10 09:47:02,003::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-34::DEBUG::2014-07-10 09:47:02,003::task::595::TaskManager.Task::(_updateState) Task=`1f1f3934-980c-4897-8029-21fdf9a7310b`::moving from state init -> state preparing >Thread-34::INFO::2014-07-10 09:47:02,004::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-34::DEBUG::2014-07-10 09:47:02,004::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`c8bca492-9822-443f-8791-75e3d3ff3158`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-10 09:47:02,005::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' for lock type 'shared' >Thread-34::DEBUG::2014-07-10 09:47:02,005::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-10 09:47:02,005::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`c8bca492-9822-443f-8791-75e3d3ff3158`::Granted request >Thread-34::DEBUG::2014-07-10 09:47:02,006::task::827::TaskManager.Task::(resourceAcquired) Task=`1f1f3934-980c-4897-8029-21fdf9a7310b`::_resourcesAcquired: Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee (shared) >Thread-34::DEBUG::2014-07-10 09:47:02,006::task::990::TaskManager.Task::(_decref) Task=`1f1f3934-980c-4897-8029-21fdf9a7310b`::ref 1 aborting False >Thread-34::INFO::2014-07-10 09:47:02,007::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532067385344', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:47:02,007::task::1185::TaskManager.Task::(prepare) Task=`1f1f3934-980c-4897-8029-21fdf9a7310b`::finished: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532067385344', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:47:02,007::task::595::TaskManager.Task::(_updateState) Task=`1f1f3934-980c-4897-8029-21fdf9a7310b`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-10 09:47:02,008::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee': < ResourceRef 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-10 09:47:02,008::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-10 09:47:02,008::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' >Thread-34::DEBUG::2014-07-10 09:47:02,008::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' (0 active users) >Thread-34::DEBUG::2014-07-10 09:47:02,009::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-10 09:47:02,009::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', Clearing records. >Thread-34::DEBUG::2014-07-10 09:47:02,009::task::990::TaskManager.Task::(_decref) Task=`1f1f3934-980c-4897-8029-21fdf9a7310b`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 09:47:02,296::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:47:02,384::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0317653 s, 32.2 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:47:04,400::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Thread-54::DEBUG::2014-07-10 09:47:04,502::task::595::TaskManager.Task::(_updateState) Task=`9d252817-e5e0-4057-a094-b3071a457892`::moving from state init -> state preparing >Thread-73::DEBUG::2014-07-10 09:47:04,512::task::595::TaskManager.Task::(_updateState) Task=`643d048f-64c0-43ad-a052-718c93d76d11`::moving from state init -> state preparing >Thread-54::INFO::2014-07-10 09:47:04,519::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='28408446-e5fd-4565-a976-e760951593fe', volUUID='776303a2-5585-451e-826e-0e338d4a1e98', options=None) >Thread-73::INFO::2014-07-10 09:47:04,525::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='c01d693b-cba0-4fed-9ad7-0aaa28912a19', volUUID='4bb5d954-2a50-4028-b299-0b43c261270c', options=None) >Thread-54::INFO::2014-07-10 09:47:04,536::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-73::INFO::2014-07-10 09:47:04,544::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-54::DEBUG::2014-07-10 09:47:04,547::task::1185::TaskManager.Task::(prepare) Task=`9d252817-e5e0-4057-a094-b3071a457892`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-73::DEBUG::2014-07-10 09:47:04,553::task::1185::TaskManager.Task::(prepare) Task=`643d048f-64c0-43ad-a052-718c93d76d11`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-54::DEBUG::2014-07-10 09:47:04,557::task::595::TaskManager.Task::(_updateState) Task=`9d252817-e5e0-4057-a094-b3071a457892`::moving from state preparing -> state finished >Thread-73::DEBUG::2014-07-10 09:47:04,563::task::595::TaskManager.Task::(_updateState) Task=`643d048f-64c0-43ad-a052-718c93d76d11`::moving from state preparing -> state finished >Thread-54::DEBUG::2014-07-10 09:47:04,566::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-73::DEBUG::2014-07-10 09:47:04,573::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-54::DEBUG::2014-07-10 09:47:04,576::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-73::DEBUG::2014-07-10 09:47:04,581::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-54::DEBUG::2014-07-10 09:47:04,586::task::990::TaskManager.Task::(_decref) Task=`9d252817-e5e0-4057-a094-b3071a457892`::ref 0 aborting False >Thread-73::DEBUG::2014-07-10 09:47:04,591::task::990::TaskManager.Task::(_decref) Task=`643d048f-64c0-43ad-a052-718c93d76d11`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 09:47:04,596::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0314081 s, 32.6 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:47:06,614::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:47:06,703::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0269711 s, 38.0 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:47:08,729::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:47:08,816::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0302118 s, 33.9 MB/s\n'; <rc> = 0 >Thread-40::DEBUG::2014-07-10 09:47:10,505::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lion.qa.lab.tlv.redhat.com:_export_yuri2_backup2/6a70504d-00df-4869-8695-0f442053f6b6/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-40::DEBUG::2014-07-10 09:47:10,525::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n369 bytes (369 B) copied, 0.000377794 s, 977 kB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:47:10,832::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:47:10,925::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0349661 s, 29.3 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-10 09:47:11,446::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/metadata bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-10 09:47:11,470::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00448582 s, 913 kB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 09:47:12,047::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-14::DEBUG::2014-07-10 09:47:12,049::task::595::TaskManager.Task::(_updateState) Task=`367c892c-1039-4802-969f-01fdf23e6b37`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 09:47:12,049::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-14::INFO::2014-07-10 09:47:12,050::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:47:12,050::task::1185::TaskManager.Task::(prepare) Task=`367c892c-1039-4802-969f-01fdf23e6b37`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:47:12,050::task::595::TaskManager.Task::(_updateState) Task=`367c892c-1039-4802-969f-01fdf23e6b37`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 09:47:12,051::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 09:47:12,051::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 09:47:12,051::task::990::TaskManager.Task::(_decref) Task=`367c892c-1039-4802-969f-01fdf23e6b37`::ref 0 aborting False >Thread-34::DEBUG::2014-07-10 09:47:12,055::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-34::DEBUG::2014-07-10 09:47:12,056::task::595::TaskManager.Task::(_updateState) Task=`7ab74365-ffe0-43bc-b321-a26ccead3d27`::moving from state init -> state preparing >Thread-34::INFO::2014-07-10 09:47:12,056::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-34::DEBUG::2014-07-10 09:47:12,057::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`310e08a5-8dac-48aa-9872-21d713d18248`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-10 09:47:12,057::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' for lock type 'shared' >Thread-34::DEBUG::2014-07-10 09:47:12,057::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-10 09:47:12,057::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`310e08a5-8dac-48aa-9872-21d713d18248`::Granted request >Thread-34::DEBUG::2014-07-10 09:47:12,058::task::827::TaskManager.Task::(resourceAcquired) Task=`7ab74365-ffe0-43bc-b321-a26ccead3d27`::_resourcesAcquired: Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee (shared) >Thread-34::DEBUG::2014-07-10 09:47:12,058::task::990::TaskManager.Task::(_decref) Task=`7ab74365-ffe0-43bc-b321-a26ccead3d27`::ref 1 aborting False >Thread-34::INFO::2014-07-10 09:47:12,059::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532067385344', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:47:12,059::task::1185::TaskManager.Task::(prepare) Task=`7ab74365-ffe0-43bc-b321-a26ccead3d27`::finished: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532067385344', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:47:12,060::task::595::TaskManager.Task::(_updateState) Task=`7ab74365-ffe0-43bc-b321-a26ccead3d27`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-10 09:47:12,060::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee': < ResourceRef 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-10 09:47:12,060::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-10 09:47:12,060::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' >Thread-34::DEBUG::2014-07-10 09:47:12,061::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' (0 active users) >Thread-34::DEBUG::2014-07-10 09:47:12,061::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-10 09:47:12,061::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', Clearing records. >Thread-34::DEBUG::2014-07-10 09:47:12,061::task::990::TaskManager.Task::(_decref) Task=`7ab74365-ffe0-43bc-b321-a26ccead3d27`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 09:47:12,941::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:47:13,033::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0355271 s, 28.8 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 09:47:13,235::task::595::TaskManager.Task::(_updateState) Task=`5d3dd5d7-1d7c-4c81-b3a9-8d3630784367`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 09:47:13,236::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::INFO::2014-07-10 09:47:13,236::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00448582', 'lastCheck': '1.7', 'valid': True}, '6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000377794', 'lastCheck': '2.7', 'valid': True}} >Thread-14::DEBUG::2014-07-10 09:47:13,236::task::1185::TaskManager.Task::(prepare) Task=`5d3dd5d7-1d7c-4c81-b3a9-8d3630784367`::finished: {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00448582', 'lastCheck': '1.7', 'valid': True}, '6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000377794', 'lastCheck': '2.7', 'valid': True}} >Thread-14::DEBUG::2014-07-10 09:47:13,236::task::595::TaskManager.Task::(_updateState) Task=`5d3dd5d7-1d7c-4c81-b3a9-8d3630784367`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 09:47:13,237::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 09:47:13,237::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 09:47:13,237::task::990::TaskManager.Task::(_decref) Task=`5d3dd5d7-1d7c-4c81-b3a9-8d3630784367`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 09:47:15,053::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:47:15,137::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.027417 s, 37.3 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:47:17,152::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:47:17,251::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.040823 s, 25.1 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:47:19,268::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:47:19,371::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0460092 s, 22.3 MB/s\n'; <rc> = 0 >Thread-40::DEBUG::2014-07-10 09:47:20,556::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lion.qa.lab.tlv.redhat.com:_export_yuri2_backup2/6a70504d-00df-4869-8695-0f442053f6b6/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-40::DEBUG::2014-07-10 09:47:20,577::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n369 bytes (369 B) copied, 0.000452685 s, 815 kB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:47:21,388::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:47:21,482::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0352893 s, 29.0 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-10 09:47:21,499::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/metadata bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-10 09:47:21,522::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00130895 s, 3.1 MB/s\n'; <rc> = 0 >Thread-57::DEBUG::2014-07-10 09:47:21,988::task::595::TaskManager.Task::(_updateState) Task=`861f8dfa-90f7-4b22-8403-e11a2c01b1c8`::moving from state init -> state preparing >Thread-57::INFO::2014-07-10 09:47:21,989::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='b6f6c0da-e67f-4902-b9ac-3069571a42fe', volUUID='c4cd1da8-05b7-45e0-80b1-1183d21443d9', options=None) >Thread-57::INFO::2014-07-10 09:47:21,989::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-57::DEBUG::2014-07-10 09:47:21,990::task::1185::TaskManager.Task::(prepare) Task=`861f8dfa-90f7-4b22-8403-e11a2c01b1c8`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-57::DEBUG::2014-07-10 09:47:21,990::task::595::TaskManager.Task::(_updateState) Task=`861f8dfa-90f7-4b22-8403-e11a2c01b1c8`::moving from state preparing -> state finished >Thread-57::DEBUG::2014-07-10 09:47:21,990::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-57::DEBUG::2014-07-10 09:47:21,990::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-57::DEBUG::2014-07-10 09:47:21,990::task::990::TaskManager.Task::(_decref) Task=`861f8dfa-90f7-4b22-8403-e11a2c01b1c8`::ref 0 aborting False >Thread-14::DEBUG::2014-07-10 09:47:22,095::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-14::DEBUG::2014-07-10 09:47:22,096::task::595::TaskManager.Task::(_updateState) Task=`d446e633-812a-41c3-bd61-0eb611f1f7d9`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 09:47:22,096::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-14::INFO::2014-07-10 09:47:22,097::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:47:22,097::task::1185::TaskManager.Task::(prepare) Task=`d446e633-812a-41c3-bd61-0eb611f1f7d9`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:47:22,097::task::595::TaskManager.Task::(_updateState) Task=`d446e633-812a-41c3-bd61-0eb611f1f7d9`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 09:47:22,097::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 09:47:22,097::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 09:47:22,098::task::990::TaskManager.Task::(_decref) Task=`d446e633-812a-41c3-bd61-0eb611f1f7d9`::ref 0 aborting False >Thread-34::DEBUG::2014-07-10 09:47:22,102::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-34::DEBUG::2014-07-10 09:47:22,102::task::595::TaskManager.Task::(_updateState) Task=`34946f11-3c95-4f73-ba17-89e01526177a`::moving from state init -> state preparing >Thread-34::INFO::2014-07-10 09:47:22,102::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-34::DEBUG::2014-07-10 09:47:22,103::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`a4b427e0-973e-407e-a700-0f8cd3c3db72`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-10 09:47:22,103::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' for lock type 'shared' >Thread-34::DEBUG::2014-07-10 09:47:22,104::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-10 09:47:22,104::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`a4b427e0-973e-407e-a700-0f8cd3c3db72`::Granted request >Thread-34::DEBUG::2014-07-10 09:47:22,105::task::827::TaskManager.Task::(resourceAcquired) Task=`34946f11-3c95-4f73-ba17-89e01526177a`::_resourcesAcquired: Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee (shared) >Thread-34::DEBUG::2014-07-10 09:47:22,105::task::990::TaskManager.Task::(_decref) Task=`34946f11-3c95-4f73-ba17-89e01526177a`::ref 1 aborting False >Thread-34::INFO::2014-07-10 09:47:22,106::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532067385344', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:47:22,106::task::1185::TaskManager.Task::(prepare) Task=`34946f11-3c95-4f73-ba17-89e01526177a`::finished: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532067385344', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:47:22,106::task::595::TaskManager.Task::(_updateState) Task=`34946f11-3c95-4f73-ba17-89e01526177a`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-10 09:47:22,107::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee': < ResourceRef 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-10 09:47:22,107::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-10 09:47:22,107::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' >Thread-34::DEBUG::2014-07-10 09:47:22,107::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' (0 active users) >Thread-34::DEBUG::2014-07-10 09:47:22,108::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-10 09:47:22,108::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', Clearing records. >Thread-34::DEBUG::2014-07-10 09:47:22,108::task::990::TaskManager.Task::(_decref) Task=`34946f11-3c95-4f73-ba17-89e01526177a`::ref 0 aborting False >Thread-67::DEBUG::2014-07-10 09:47:22,589::task::595::TaskManager.Task::(_updateState) Task=`eeb1c784-11b0-4388-9688-0043aa10e4c0`::moving from state init -> state preparing >Thread-67::INFO::2014-07-10 09:47:22,590::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='f30c2cb7-a43a-4bf5-82b5-cfe07336f65c', volUUID='b0fbb3c9-55af-4a3a-95ad-fc56a80b9cf5', options=None) >Thread-67::INFO::2014-07-10 09:47:22,590::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-67::DEBUG::2014-07-10 09:47:22,591::task::1185::TaskManager.Task::(prepare) Task=`eeb1c784-11b0-4388-9688-0043aa10e4c0`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-67::DEBUG::2014-07-10 09:47:22,591::task::595::TaskManager.Task::(_updateState) Task=`eeb1c784-11b0-4388-9688-0043aa10e4c0`::moving from state preparing -> state finished >Thread-67::DEBUG::2014-07-10 09:47:22,591::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-67::DEBUG::2014-07-10 09:47:22,591::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-67::DEBUG::2014-07-10 09:47:22,591::task::990::TaskManager.Task::(_decref) Task=`eeb1c784-11b0-4388-9688-0043aa10e4c0`::ref 0 aborting False >Thread-48::DEBUG::2014-07-10 09:47:22,997::task::595::TaskManager.Task::(_updateState) Task=`594bb3ae-4ead-4fd5-8183-143b0c45a1cd`::moving from state init -> state preparing >Thread-48::INFO::2014-07-10 09:47:22,997::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='0cd7d6ce-f497-4243-a690-c57744861eea', volUUID='10b6a7dd-dc6c-43fa-ba17-92e4331b0e0b', options=None) >Thread-48::INFO::2014-07-10 09:47:22,998::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-48::DEBUG::2014-07-10 09:47:22,998::task::1185::TaskManager.Task::(prepare) Task=`594bb3ae-4ead-4fd5-8183-143b0c45a1cd`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-48::DEBUG::2014-07-10 09:47:22,998::task::595::TaskManager.Task::(_updateState) Task=`594bb3ae-4ead-4fd5-8183-143b0c45a1cd`::moving from state preparing -> state finished >Thread-48::DEBUG::2014-07-10 09:47:22,998::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-48::DEBUG::2014-07-10 09:47:22,998::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-48::DEBUG::2014-07-10 09:47:22,999::task::990::TaskManager.Task::(_decref) Task=`594bb3ae-4ead-4fd5-8183-143b0c45a1cd`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 09:47:23,497::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:47:23,588::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0353493 s, 29.0 MB/s\n'; <rc> = 0 >Thread-76::DEBUG::2014-07-10 09:47:24,595::task::595::TaskManager.Task::(_updateState) Task=`1d49b967-bb03-40ba-af9f-e974a58e5847`::moving from state init -> state preparing >Thread-76::INFO::2014-07-10 09:47:24,596::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='e4c65229-4247-4b33-b72a-f1d5ce72ad05', volUUID='cad94284-3ca9-4c30-933d-997f4460309e', options=None) >Thread-76::INFO::2014-07-10 09:47:24,596::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-76::DEBUG::2014-07-10 09:47:24,597::task::1185::TaskManager.Task::(prepare) Task=`1d49b967-bb03-40ba-af9f-e974a58e5847`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-76::DEBUG::2014-07-10 09:47:24,597::task::595::TaskManager.Task::(_updateState) Task=`1d49b967-bb03-40ba-af9f-e974a58e5847`::moving from state preparing -> state finished >Thread-76::DEBUG::2014-07-10 09:47:24,597::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-76::DEBUG::2014-07-10 09:47:24,597::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-76::DEBUG::2014-07-10 09:47:24,597::task::990::TaskManager.Task::(_decref) Task=`1d49b967-bb03-40ba-af9f-e974a58e5847`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 09:47:25,598::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:47:25,688::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0314435 s, 32.6 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:47:27,707::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:47:27,800::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0339875 s, 30.1 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 09:47:28,431::task::595::TaskManager.Task::(_updateState) Task=`c173e544-bed4-4936-afac-48cefa1739ac`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 09:47:28,432::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::INFO::2014-07-10 09:47:28,432::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00130895', 'lastCheck': '6.9', 'valid': True}, '6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000452685', 'lastCheck': '7.8', 'valid': True}} >Thread-14::DEBUG::2014-07-10 09:47:28,432::task::1185::TaskManager.Task::(prepare) Task=`c173e544-bed4-4936-afac-48cefa1739ac`::finished: {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00130895', 'lastCheck': '6.9', 'valid': True}, '6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000452685', 'lastCheck': '7.8', 'valid': True}} >Thread-14::DEBUG::2014-07-10 09:47:28,433::task::595::TaskManager.Task::(_updateState) Task=`c173e544-bed4-4936-afac-48cefa1739ac`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 09:47:28,433::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 09:47:28,433::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 09:47:28,433::task::990::TaskManager.Task::(_decref) Task=`c173e544-bed4-4936-afac-48cefa1739ac`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 09:47:29,815::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:47:29,921::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0324442 s, 31.6 MB/s\n'; <rc> = 0 >Thread-40::DEBUG::2014-07-10 09:47:30,611::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lion.qa.lab.tlv.redhat.com:_export_yuri2_backup2/6a70504d-00df-4869-8695-0f442053f6b6/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-40::DEBUG::2014-07-10 09:47:30,632::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n369 bytes (369 B) copied, 0.000442794 s, 833 kB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-10 09:47:31,551::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/metadata bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-10 09:47:31,572::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00083483 s, 4.9 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:47:31,985::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:47:32,105::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0579321 s, 17.7 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 09:47:32,137::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-14::DEBUG::2014-07-10 09:47:32,139::task::595::TaskManager.Task::(_updateState) Task=`b8e26cb0-021a-4ae6-a0f2-c22e638c9b20`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 09:47:32,139::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-14::INFO::2014-07-10 09:47:32,140::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:47:32,140::task::1185::TaskManager.Task::(prepare) Task=`b8e26cb0-021a-4ae6-a0f2-c22e638c9b20`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:47:32,140::task::595::TaskManager.Task::(_updateState) Task=`b8e26cb0-021a-4ae6-a0f2-c22e638c9b20`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 09:47:32,141::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 09:47:32,141::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 09:47:32,141::task::990::TaskManager.Task::(_decref) Task=`b8e26cb0-021a-4ae6-a0f2-c22e638c9b20`::ref 0 aborting False >Thread-34::DEBUG::2014-07-10 09:47:32,145::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-34::DEBUG::2014-07-10 09:47:32,145::task::595::TaskManager.Task::(_updateState) Task=`d4483f6d-e468-4ca6-a7f4-2a3445307282`::moving from state init -> state preparing >Thread-34::INFO::2014-07-10 09:47:32,146::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-34::DEBUG::2014-07-10 09:47:32,146::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`8e1bab38-4315-41dd-8ec5-f2c804ec2235`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-10 09:47:32,147::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' for lock type 'shared' >Thread-34::DEBUG::2014-07-10 09:47:32,147::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-10 09:47:32,147::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`8e1bab38-4315-41dd-8ec5-f2c804ec2235`::Granted request >Thread-34::DEBUG::2014-07-10 09:47:32,148::task::827::TaskManager.Task::(resourceAcquired) Task=`d4483f6d-e468-4ca6-a7f4-2a3445307282`::_resourcesAcquired: Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee (shared) >Thread-34::DEBUG::2014-07-10 09:47:32,148::task::990::TaskManager.Task::(_decref) Task=`d4483f6d-e468-4ca6-a7f4-2a3445307282`::ref 1 aborting False >Thread-34::INFO::2014-07-10 09:47:32,149::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532067385344', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:47:32,149::task::1185::TaskManager.Task::(prepare) Task=`d4483f6d-e468-4ca6-a7f4-2a3445307282`::finished: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532067385344', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:47:32,150::task::595::TaskManager.Task::(_updateState) Task=`d4483f6d-e468-4ca6-a7f4-2a3445307282`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-10 09:47:32,150::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee': < ResourceRef 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-10 09:47:32,150::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-10 09:47:32,150::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' >Thread-34::DEBUG::2014-07-10 09:47:32,151::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' (0 active users) >Thread-34::DEBUG::2014-07-10 09:47:32,151::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-10 09:47:32,151::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', Clearing records. >Thread-34::DEBUG::2014-07-10 09:47:32,151::task::990::TaskManager.Task::(_decref) Task=`d4483f6d-e468-4ca6-a7f4-2a3445307282`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 09:47:34,121::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:47:34,215::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0355927 s, 28.8 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:47:36,230::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:47:36,317::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0296233 s, 34.6 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:47:38,333::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:47:38,437::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0467133 s, 21.9 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:47:40,452::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:47:40,546::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0302201 s, 33.9 MB/s\n'; <rc> = 0 >Thread-40::DEBUG::2014-07-10 09:47:40,663::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lion.qa.lab.tlv.redhat.com:_export_yuri2_backup2/6a70504d-00df-4869-8695-0f442053f6b6/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-40::DEBUG::2014-07-10 09:47:40,683::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n369 bytes (369 B) copied, 0.000494026 s, 747 kB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-10 09:47:41,601::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/metadata bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-10 09:47:41,622::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000881647 s, 4.6 MB/s\n'; <rc> = 0 >Thread-70::DEBUG::2014-07-10 09:47:41,694::task::595::TaskManager.Task::(_updateState) Task=`5f38d95d-a983-4597-9565-64d51a059f7f`::moving from state init -> state preparing >Thread-70::INFO::2014-07-10 09:47:41,695::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='cfaeead2-7caa-467c-b389-c89840ae6605', volUUID='567fe32d-31a6-4ff6-90f3-fd6a656fbecc', options=None) >Thread-70::INFO::2014-07-10 09:47:41,695::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-70::DEBUG::2014-07-10 09:47:41,696::task::1185::TaskManager.Task::(prepare) Task=`5f38d95d-a983-4597-9565-64d51a059f7f`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-70::DEBUG::2014-07-10 09:47:41,696::task::595::TaskManager.Task::(_updateState) Task=`5f38d95d-a983-4597-9565-64d51a059f7f`::moving from state preparing -> state finished >Thread-70::DEBUG::2014-07-10 09:47:41,696::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-70::DEBUG::2014-07-10 09:47:41,696::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-70::DEBUG::2014-07-10 09:47:41,696::task::990::TaskManager.Task::(_decref) Task=`5f38d95d-a983-4597-9565-64d51a059f7f`::ref 0 aborting False >Thread-14::DEBUG::2014-07-10 09:47:42,188::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-14::DEBUG::2014-07-10 09:47:42,189::task::595::TaskManager.Task::(_updateState) Task=`aca2f9a8-be28-4ebe-8bfb-9e35eaff8b1f`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 09:47:42,189::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-14::INFO::2014-07-10 09:47:42,189::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:47:42,190::task::1185::TaskManager.Task::(prepare) Task=`aca2f9a8-be28-4ebe-8bfb-9e35eaff8b1f`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:47:42,190::task::595::TaskManager.Task::(_updateState) Task=`aca2f9a8-be28-4ebe-8bfb-9e35eaff8b1f`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 09:47:42,190::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 09:47:42,190::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 09:47:42,190::task::990::TaskManager.Task::(_decref) Task=`aca2f9a8-be28-4ebe-8bfb-9e35eaff8b1f`::ref 0 aborting False >Thread-34::DEBUG::2014-07-10 09:47:42,195::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-34::DEBUG::2014-07-10 09:47:42,195::task::595::TaskManager.Task::(_updateState) Task=`8e6d7954-b4b9-45cd-a059-c56cbdcd0a60`::moving from state init -> state preparing >Thread-34::INFO::2014-07-10 09:47:42,195::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-34::DEBUG::2014-07-10 09:47:42,196::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`06f184df-ca3d-41c9-8cac-81423c3f9691`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-10 09:47:42,196::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' for lock type 'shared' >Thread-34::DEBUG::2014-07-10 09:47:42,197::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-10 09:47:42,197::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`06f184df-ca3d-41c9-8cac-81423c3f9691`::Granted request >Thread-34::DEBUG::2014-07-10 09:47:42,197::task::827::TaskManager.Task::(resourceAcquired) Task=`8e6d7954-b4b9-45cd-a059-c56cbdcd0a60`::_resourcesAcquired: Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee (shared) >Thread-34::DEBUG::2014-07-10 09:47:42,197::task::990::TaskManager.Task::(_decref) Task=`8e6d7954-b4b9-45cd-a059-c56cbdcd0a60`::ref 1 aborting False >Thread-34::INFO::2014-07-10 09:47:42,199::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532067385344', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:47:42,199::task::1185::TaskManager.Task::(prepare) Task=`8e6d7954-b4b9-45cd-a059-c56cbdcd0a60`::finished: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532067385344', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:47:42,199::task::595::TaskManager.Task::(_updateState) Task=`8e6d7954-b4b9-45cd-a059-c56cbdcd0a60`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-10 09:47:42,199::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee': < ResourceRef 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-10 09:47:42,199::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-10 09:47:42,200::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' >Thread-34::DEBUG::2014-07-10 09:47:42,200::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' (0 active users) >Thread-34::DEBUG::2014-07-10 09:47:42,200::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-10 09:47:42,200::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', Clearing records. >Thread-34::DEBUG::2014-07-10 09:47:42,201::task::990::TaskManager.Task::(_decref) Task=`8e6d7954-b4b9-45cd-a059-c56cbdcd0a60`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 09:47:42,562::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:47:42,654::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0345826 s, 29.6 MB/s\n'; <rc> = 0 >Thread-51::DEBUG::2014-07-10 09:47:43,174::task::595::TaskManager.Task::(_updateState) Task=`a6c9bf71-be28-49c6-8ad7-65903b2e2379`::moving from state init -> state preparing >Thread-51::INFO::2014-07-10 09:47:43,174::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='76fdb054-02cd-42ed-9721-b3e65b34c3a4', volUUID='022dfe46-2cf7-4915-80b3-883158e3ca83', options=None) >Thread-60::DEBUG::2014-07-10 09:47:43,178::task::595::TaskManager.Task::(_updateState) Task=`2d892682-79c1-45a9-88d8-94eee7203caa`::moving from state init -> state preparing >Thread-51::INFO::2014-07-10 09:47:43,178::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-60::INFO::2014-07-10 09:47:43,182::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='b034d5b0-e1e0-4011-b49b-4d45ddb11556', volUUID='3d7f62b5-328f-4d8e-8b69-873cfb5ae14d', options=None) >Thread-51::DEBUG::2014-07-10 09:47:43,182::task::1185::TaskManager.Task::(prepare) Task=`a6c9bf71-be28-49c6-8ad7-65903b2e2379`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-51::DEBUG::2014-07-10 09:47:43,185::task::595::TaskManager.Task::(_updateState) Task=`a6c9bf71-be28-49c6-8ad7-65903b2e2379`::moving from state preparing -> state finished >Thread-60::INFO::2014-07-10 09:47:43,186::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-51::DEBUG::2014-07-10 09:47:43,188::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-60::DEBUG::2014-07-10 09:47:43,189::task::1185::TaskManager.Task::(prepare) Task=`2d892682-79c1-45a9-88d8-94eee7203caa`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-51::DEBUG::2014-07-10 09:47:43,192::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-60::DEBUG::2014-07-10 09:47:43,192::task::595::TaskManager.Task::(_updateState) Task=`2d892682-79c1-45a9-88d8-94eee7203caa`::moving from state preparing -> state finished >Thread-60::DEBUG::2014-07-10 09:47:43,196::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-51::DEBUG::2014-07-10 09:47:43,196::task::990::TaskManager.Task::(_decref) Task=`a6c9bf71-be28-49c6-8ad7-65903b2e2379`::ref 0 aborting False >Thread-60::DEBUG::2014-07-10 09:47:43,198::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-60::DEBUG::2014-07-10 09:47:43,200::task::990::TaskManager.Task::(_decref) Task=`2d892682-79c1-45a9-88d8-94eee7203caa`::ref 0 aborting False >Thread-14::DEBUG::2014-07-10 09:47:43,639::task::595::TaskManager.Task::(_updateState) Task=`90fe3b93-c1f6-4dfb-89f7-1b36ceb45c77`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 09:47:43,639::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::INFO::2014-07-10 09:47:43,640::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000881647', 'lastCheck': '2.0', 'valid': True}, '6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000494026', 'lastCheck': '3.0', 'valid': True}} >Thread-14::DEBUG::2014-07-10 09:47:43,640::task::1185::TaskManager.Task::(prepare) Task=`90fe3b93-c1f6-4dfb-89f7-1b36ceb45c77`::finished: {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000881647', 'lastCheck': '2.0', 'valid': True}, '6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000494026', 'lastCheck': '3.0', 'valid': True}} >Thread-14::DEBUG::2014-07-10 09:47:43,640::task::595::TaskManager.Task::(_updateState) Task=`90fe3b93-c1f6-4dfb-89f7-1b36ceb45c77`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 09:47:43,640::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 09:47:43,641::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 09:47:43,641::task::990::TaskManager.Task::(_decref) Task=`90fe3b93-c1f6-4dfb-89f7-1b36ceb45c77`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 09:47:44,669::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:47:44,762::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0293658 s, 34.9 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:47:46,778::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:47:46,877::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0411703 s, 24.9 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:47:48,892::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:47:48,995::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0436264 s, 23.5 MB/s\n'; <rc> = 0 >Thread-40::DEBUG::2014-07-10 09:47:50,709::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lion.qa.lab.tlv.redhat.com:_export_yuri2_backup2/6a70504d-00df-4869-8695-0f442053f6b6/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-40::DEBUG::2014-07-10 09:47:50,729::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n369 bytes (369 B) copied, 0.000491547 s, 751 kB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:47:51,010::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:47:51,120::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0365182 s, 28.0 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-10 09:47:51,651::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/metadata bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-10 09:47:51,672::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000687068 s, 6.0 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 09:47:52,239::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-14::DEBUG::2014-07-10 09:47:52,240::task::595::TaskManager.Task::(_updateState) Task=`9367ee30-f2f6-4e49-af44-b67b72130e88`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 09:47:52,241::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-14::INFO::2014-07-10 09:47:52,245::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:47:52,248::task::1185::TaskManager.Task::(prepare) Task=`9367ee30-f2f6-4e49-af44-b67b72130e88`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:47:52,250::task::595::TaskManager.Task::(_updateState) Task=`9367ee30-f2f6-4e49-af44-b67b72130e88`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 09:47:52,252::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 09:47:52,254::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 09:47:52,258::task::990::TaskManager.Task::(_decref) Task=`9367ee30-f2f6-4e49-af44-b67b72130e88`::ref 0 aborting False >Thread-34::DEBUG::2014-07-10 09:47:52,272::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-34::DEBUG::2014-07-10 09:47:52,274::task::595::TaskManager.Task::(_updateState) Task=`f2b2c331-78b0-4808-a689-5c10baf998a3`::moving from state init -> state preparing >Thread-34::INFO::2014-07-10 09:47:52,275::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-34::DEBUG::2014-07-10 09:47:52,276::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`f9e61ddd-e457-4dc8-b01d-cce5eecd47b2`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-10 09:47:52,276::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' for lock type 'shared' >Thread-34::DEBUG::2014-07-10 09:47:52,277::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-10 09:47:52,278::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`f9e61ddd-e457-4dc8-b01d-cce5eecd47b2`::Granted request >Thread-34::DEBUG::2014-07-10 09:47:52,279::task::827::TaskManager.Task::(resourceAcquired) Task=`f2b2c331-78b0-4808-a689-5c10baf998a3`::_resourcesAcquired: Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee (shared) >Thread-34::DEBUG::2014-07-10 09:47:52,279::task::990::TaskManager.Task::(_decref) Task=`f2b2c331-78b0-4808-a689-5c10baf998a3`::ref 1 aborting False >Thread-34::INFO::2014-07-10 09:47:52,281::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532067385344', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:47:52,281::task::1185::TaskManager.Task::(prepare) Task=`f2b2c331-78b0-4808-a689-5c10baf998a3`::finished: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532067385344', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:47:52,282::task::595::TaskManager.Task::(_updateState) Task=`f2b2c331-78b0-4808-a689-5c10baf998a3`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-10 09:47:52,282::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee': < ResourceRef 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-10 09:47:52,282::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-10 09:47:52,282::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' >Thread-34::DEBUG::2014-07-10 09:47:52,283::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' (0 active users) >Thread-34::DEBUG::2014-07-10 09:47:52,283::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-10 09:47:52,283::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', Clearing records. >Thread-34::DEBUG::2014-07-10 09:47:52,284::task::990::TaskManager.Task::(_decref) Task=`f2b2c331-78b0-4808-a689-5c10baf998a3`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 09:47:53,135::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:47:53,226::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0340888 s, 30.0 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:47:55,241::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:47:55,329::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0256703 s, 39.9 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:47:57,344::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:47:57,432::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0297065 s, 34.5 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 09:47:58,807::task::595::TaskManager.Task::(_updateState) Task=`1b07d568-0954-4c7e-b21f-3d39ca56ffee`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 09:47:58,808::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::INFO::2014-07-10 09:47:58,809::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000687068', 'lastCheck': '7.1', 'valid': True}, '6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000491547', 'lastCheck': '8.1', 'valid': True}} >Thread-14::DEBUG::2014-07-10 09:47:58,809::task::1185::TaskManager.Task::(prepare) Task=`1b07d568-0954-4c7e-b21f-3d39ca56ffee`::finished: {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000687068', 'lastCheck': '7.1', 'valid': True}, '6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000491547', 'lastCheck': '8.1', 'valid': True}} >Thread-14::DEBUG::2014-07-10 09:47:58,809::task::595::TaskManager.Task::(_updateState) Task=`1b07d568-0954-4c7e-b21f-3d39ca56ffee`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 09:47:58,809::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 09:47:58,809::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 09:47:58,810::task::990::TaskManager.Task::(_decref) Task=`1b07d568-0954-4c7e-b21f-3d39ca56ffee`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 09:47:59,448::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:47:59,537::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0318479 s, 32.2 MB/s\n'; <rc> = 0 >Thread-40::DEBUG::2014-07-10 09:48:00,755::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lion.qa.lab.tlv.redhat.com:_export_yuri2_backup2/6a70504d-00df-4869-8695-0f442053f6b6/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-40::DEBUG::2014-07-10 09:48:00,775::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n369 bytes (369 B) copied, 0.000536859 s, 687 kB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:48:01,552::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:48:01,644::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0349833 s, 29.3 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-10 09:48:01,700::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/metadata bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-10 09:48:01,719::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000718541 s, 5.7 MB/s\n'; <rc> = 0 >Thread-64::DEBUG::2014-07-10 09:48:01,773::task::595::TaskManager.Task::(_updateState) Task=`ad84bfc2-cef4-42ad-a8cc-197565aa17a6`::moving from state init -> state preparing >Thread-64::INFO::2014-07-10 09:48:01,773::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='aa20346a-4d3a-4e07-b8e1-52c0ebe4168c', volUUID='58fefce2-9bce-4bff-8949-8c6ce8122b27', options=None) >Thread-64::INFO::2014-07-10 09:48:01,774::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-64::DEBUG::2014-07-10 09:48:01,774::task::1185::TaskManager.Task::(prepare) Task=`ad84bfc2-cef4-42ad-a8cc-197565aa17a6`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-64::DEBUG::2014-07-10 09:48:01,774::task::595::TaskManager.Task::(_updateState) Task=`ad84bfc2-cef4-42ad-a8cc-197565aa17a6`::moving from state preparing -> state finished >Thread-64::DEBUG::2014-07-10 09:48:01,774::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-64::DEBUG::2014-07-10 09:48:01,775::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-64::DEBUG::2014-07-10 09:48:01,775::task::990::TaskManager.Task::(_decref) Task=`ad84bfc2-cef4-42ad-a8cc-197565aa17a6`::ref 0 aborting False >Thread-14::DEBUG::2014-07-10 09:48:02,320::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-14::DEBUG::2014-07-10 09:48:02,321::task::595::TaskManager.Task::(_updateState) Task=`7788a674-91e8-4b01-ad7d-3a0e8fc6eb30`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 09:48:02,321::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-14::INFO::2014-07-10 09:48:02,322::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:48:02,322::task::1185::TaskManager.Task::(prepare) Task=`7788a674-91e8-4b01-ad7d-3a0e8fc6eb30`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:48:02,322::task::595::TaskManager.Task::(_updateState) Task=`7788a674-91e8-4b01-ad7d-3a0e8fc6eb30`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 09:48:02,322::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 09:48:02,322::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 09:48:02,323::task::990::TaskManager.Task::(_decref) Task=`7788a674-91e8-4b01-ad7d-3a0e8fc6eb30`::ref 0 aborting False >Thread-34::DEBUG::2014-07-10 09:48:02,327::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-34::DEBUG::2014-07-10 09:48:02,327::task::595::TaskManager.Task::(_updateState) Task=`22c83227-1234-4098-9bf1-5965f655fb86`::moving from state init -> state preparing >Thread-34::INFO::2014-07-10 09:48:02,327::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-34::DEBUG::2014-07-10 09:48:02,328::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`9c8c6ad4-50f7-444e-bff9-db4e14dc807b`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-10 09:48:02,328::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' for lock type 'shared' >Thread-34::DEBUG::2014-07-10 09:48:02,329::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-10 09:48:02,329::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`9c8c6ad4-50f7-444e-bff9-db4e14dc807b`::Granted request >Thread-34::DEBUG::2014-07-10 09:48:02,329::task::827::TaskManager.Task::(resourceAcquired) Task=`22c83227-1234-4098-9bf1-5965f655fb86`::_resourcesAcquired: Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee (shared) >Thread-34::DEBUG::2014-07-10 09:48:02,330::task::990::TaskManager.Task::(_decref) Task=`22c83227-1234-4098-9bf1-5965f655fb86`::ref 1 aborting False >Thread-34::INFO::2014-07-10 09:48:02,331::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532067385344', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:48:02,331::task::1185::TaskManager.Task::(prepare) Task=`22c83227-1234-4098-9bf1-5965f655fb86`::finished: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532067385344', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:48:02,331::task::595::TaskManager.Task::(_updateState) Task=`22c83227-1234-4098-9bf1-5965f655fb86`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-10 09:48:02,331::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee': < ResourceRef 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-10 09:48:02,332::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-10 09:48:02,332::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' >Thread-34::DEBUG::2014-07-10 09:48:02,332::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' (0 active users) >Thread-34::DEBUG::2014-07-10 09:48:02,332::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-10 09:48:02,332::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', Clearing records. >Thread-34::DEBUG::2014-07-10 09:48:02,333::task::990::TaskManager.Task::(_decref) Task=`22c83227-1234-4098-9bf1-5965f655fb86`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 09:48:03,660::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:48:03,747::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0300407 s, 34.1 MB/s\n'; <rc> = 0 >Thread-54::DEBUG::2014-07-10 09:48:04,878::task::595::TaskManager.Task::(_updateState) Task=`a90fb67f-b296-464b-b9d7-a15659f7f679`::moving from state init -> state preparing >Thread-54::INFO::2014-07-10 09:48:04,878::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='28408446-e5fd-4565-a976-e760951593fe', volUUID='776303a2-5585-451e-826e-0e338d4a1e98', options=None) >Thread-54::INFO::2014-07-10 09:48:04,879::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-54::DEBUG::2014-07-10 09:48:04,879::task::1185::TaskManager.Task::(prepare) Task=`a90fb67f-b296-464b-b9d7-a15659f7f679`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-54::DEBUG::2014-07-10 09:48:04,879::task::595::TaskManager.Task::(_updateState) Task=`a90fb67f-b296-464b-b9d7-a15659f7f679`::moving from state preparing -> state finished >Thread-54::DEBUG::2014-07-10 09:48:04,880::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-54::DEBUG::2014-07-10 09:48:04,880::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-54::DEBUG::2014-07-10 09:48:04,880::task::990::TaskManager.Task::(_decref) Task=`a90fb67f-b296-464b-b9d7-a15659f7f679`::ref 0 aborting False >Thread-73::DEBUG::2014-07-10 09:48:04,889::task::595::TaskManager.Task::(_updateState) Task=`0f80e1c6-f3ba-4def-9dd4-fa4338137ea4`::moving from state init -> state preparing >Thread-73::INFO::2014-07-10 09:48:04,889::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='c01d693b-cba0-4fed-9ad7-0aaa28912a19', volUUID='4bb5d954-2a50-4028-b299-0b43c261270c', options=None) >Thread-73::INFO::2014-07-10 09:48:04,890::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-73::DEBUG::2014-07-10 09:48:04,890::task::1185::TaskManager.Task::(prepare) Task=`0f80e1c6-f3ba-4def-9dd4-fa4338137ea4`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-73::DEBUG::2014-07-10 09:48:04,890::task::595::TaskManager.Task::(_updateState) Task=`0f80e1c6-f3ba-4def-9dd4-fa4338137ea4`::moving from state preparing -> state finished >Thread-73::DEBUG::2014-07-10 09:48:04,890::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-73::DEBUG::2014-07-10 09:48:04,891::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-73::DEBUG::2014-07-10 09:48:04,891::task::990::TaskManager.Task::(_decref) Task=`0f80e1c6-f3ba-4def-9dd4-fa4338137ea4`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 09:48:05,762::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:48:05,854::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0268745 s, 38.1 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:48:07,873::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:48:08,006::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0423945 s, 24.2 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:48:10,023::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:48:10,116::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0329384 s, 31.1 MB/s\n'; <rc> = 0 >Thread-40::DEBUG::2014-07-10 09:48:10,779::domainMonitor::192::Storage.DomainMonitorThread::(_monitorDomain) Refreshing domain 6a70504d-00df-4869-8695-0f442053f6b6 >Thread-40::DEBUG::2014-07-10 09:48:10,809::fileSD::150::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/lion.qa.lab.tlv.redhat.com:_export_yuri2_backup2/6a70504d-00df-4869-8695-0f442053f6b6 >Thread-40::DEBUG::2014-07-10 09:48:10,812::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend >Thread-40::DEBUG::2014-07-10 09:48:10,816::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Backup', 'DESCRIPTION=test', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=0', 'POOL_UUID=4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', 'REMOTE_PATH=lion.qa.lab.tlv.redhat.com:/export/yuri2/backup2', 'ROLE=Regular', 'SDUUID=6a70504d-00df-4869-8695-0f442053f6b6', 'TYPE=NFS', 'VERSION=0', '_SHA_CKSUM=aab6b8e901ec435cd5f9de3c9e3f8b45dca569e0'] >Thread-40::DEBUG::2014-07-10 09:48:10,817::fileSD::609::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images [] >Thread-40::INFO::2014-07-10 09:48:10,818::sd::384::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 6a70504d-00df-4869-8695-0f442053f6b6_imageNS already registered >Thread-40::INFO::2014-07-10 09:48:10,818::sd::392::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 6a70504d-00df-4869-8695-0f442053f6b6_volumeNS already registered >Thread-40::DEBUG::2014-07-10 09:48:10,844::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lion.qa.lab.tlv.redhat.com:_export_yuri2_backup2/6a70504d-00df-4869-8695-0f442053f6b6/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-40::DEBUG::2014-07-10 09:48:10,868::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n369 bytes (369 B) copied, 0.000550922 s, 670 kB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-10 09:48:11,749::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/metadata bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-10 09:48:11,814::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.0456456 s, 89.7 kB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:48:12,132::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:48:12,227::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0350468 s, 29.2 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 09:48:12,355::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-14::DEBUG::2014-07-10 09:48:12,356::task::595::TaskManager.Task::(_updateState) Task=`5a1a5795-9db1-4597-aae8-47497543cb48`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 09:48:12,357::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-14::INFO::2014-07-10 09:48:12,357::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:48:12,358::task::1185::TaskManager.Task::(prepare) Task=`5a1a5795-9db1-4597-aae8-47497543cb48`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:48:12,358::task::595::TaskManager.Task::(_updateState) Task=`5a1a5795-9db1-4597-aae8-47497543cb48`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 09:48:12,358::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 09:48:12,358::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 09:48:12,359::task::990::TaskManager.Task::(_decref) Task=`5a1a5795-9db1-4597-aae8-47497543cb48`::ref 0 aborting False >Thread-34::DEBUG::2014-07-10 09:48:12,363::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-34::DEBUG::2014-07-10 09:48:12,363::task::595::TaskManager.Task::(_updateState) Task=`f7addcb8-8e98-4dc9-abe5-db3913a55c02`::moving from state init -> state preparing >Thread-34::INFO::2014-07-10 09:48:12,364::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-34::DEBUG::2014-07-10 09:48:12,364::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`e9c004de-2bb0-41d7-af62-e78a478d1256`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-10 09:48:12,365::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' for lock type 'shared' >Thread-34::DEBUG::2014-07-10 09:48:12,365::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-10 09:48:12,365::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`e9c004de-2bb0-41d7-af62-e78a478d1256`::Granted request >Thread-34::DEBUG::2014-07-10 09:48:12,366::task::827::TaskManager.Task::(resourceAcquired) Task=`f7addcb8-8e98-4dc9-abe5-db3913a55c02`::_resourcesAcquired: Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee (shared) >Thread-34::DEBUG::2014-07-10 09:48:12,366::task::990::TaskManager.Task::(_decref) Task=`f7addcb8-8e98-4dc9-abe5-db3913a55c02`::ref 1 aborting False >Thread-34::INFO::2014-07-10 09:48:12,367::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532067385344', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:48:12,367::task::1185::TaskManager.Task::(prepare) Task=`f7addcb8-8e98-4dc9-abe5-db3913a55c02`::finished: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532067385344', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:48:12,368::task::595::TaskManager.Task::(_updateState) Task=`f7addcb8-8e98-4dc9-abe5-db3913a55c02`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-10 09:48:12,368::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee': < ResourceRef 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-10 09:48:12,368::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-10 09:48:12,368::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' >Thread-34::DEBUG::2014-07-10 09:48:12,369::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' (0 active users) >Thread-34::DEBUG::2014-07-10 09:48:12,369::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-10 09:48:12,369::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', Clearing records. >Thread-34::DEBUG::2014-07-10 09:48:12,369::task::990::TaskManager.Task::(_decref) Task=`f7addcb8-8e98-4dc9-abe5-db3913a55c02`::ref 0 aborting False >Thread-14::DEBUG::2014-07-10 09:48:14,016::task::595::TaskManager.Task::(_updateState) Task=`7c0f0fc9-b968-48f0-8f32-1507772dd405`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 09:48:14,016::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::INFO::2014-07-10 09:48:14,016::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0456456', 'lastCheck': '2.2', 'valid': True}, '6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000550922', 'lastCheck': '3.1', 'valid': True}} >Thread-14::DEBUG::2014-07-10 09:48:14,017::task::1185::TaskManager.Task::(prepare) Task=`7c0f0fc9-b968-48f0-8f32-1507772dd405`::finished: {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0456456', 'lastCheck': '2.2', 'valid': True}, '6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000550922', 'lastCheck': '3.1', 'valid': True}} >Thread-14::DEBUG::2014-07-10 09:48:14,017::task::595::TaskManager.Task::(_updateState) Task=`7c0f0fc9-b968-48f0-8f32-1507772dd405`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 09:48:14,017::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 09:48:14,017::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 09:48:14,018::task::990::TaskManager.Task::(_decref) Task=`7c0f0fc9-b968-48f0-8f32-1507772dd405`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 09:48:14,243::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:48:14,361::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0366345 s, 28.0 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:48:16,376::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:48:16,462::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0278557 s, 36.8 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:48:18,478::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:48:18,712::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0295979 s, 34.6 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:48:20,727::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:48:20,815::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0296586 s, 34.5 MB/s\n'; <rc> = 0 >Thread-40::DEBUG::2014-07-10 09:48:20,901::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lion.qa.lab.tlv.redhat.com:_export_yuri2_backup2/6a70504d-00df-4869-8695-0f442053f6b6/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-40::DEBUG::2014-07-10 09:48:20,927::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n369 bytes (369 B) copied, 0.000416888 s, 885 kB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-10 09:48:21,843::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/metadata bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-10 09:48:21,865::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000938737 s, 4.4 MB/s\n'; <rc> = 0 >Thread-57::DEBUG::2014-07-10 09:48:22,264::task::595::TaskManager.Task::(_updateState) Task=`2e189fd8-a5a3-4de1-b922-81d2c4846f7d`::moving from state init -> state preparing >Thread-57::INFO::2014-07-10 09:48:22,265::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='b6f6c0da-e67f-4902-b9ac-3069571a42fe', volUUID='c4cd1da8-05b7-45e0-80b1-1183d21443d9', options=None) >Thread-57::INFO::2014-07-10 09:48:22,265::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-57::DEBUG::2014-07-10 09:48:22,266::task::1185::TaskManager.Task::(prepare) Task=`2e189fd8-a5a3-4de1-b922-81d2c4846f7d`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-57::DEBUG::2014-07-10 09:48:22,266::task::595::TaskManager.Task::(_updateState) Task=`2e189fd8-a5a3-4de1-b922-81d2c4846f7d`::moving from state preparing -> state finished >Thread-57::DEBUG::2014-07-10 09:48:22,266::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-57::DEBUG::2014-07-10 09:48:22,266::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-57::DEBUG::2014-07-10 09:48:22,266::task::990::TaskManager.Task::(_decref) Task=`2e189fd8-a5a3-4de1-b922-81d2c4846f7d`::ref 0 aborting False >Thread-14::DEBUG::2014-07-10 09:48:22,405::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-14::DEBUG::2014-07-10 09:48:22,406::task::595::TaskManager.Task::(_updateState) Task=`ecae2ccf-b8c3-4137-b8be-8a245c5657d3`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 09:48:22,407::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-14::INFO::2014-07-10 09:48:22,407::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:48:22,407::task::1185::TaskManager.Task::(prepare) Task=`ecae2ccf-b8c3-4137-b8be-8a245c5657d3`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:48:22,408::task::595::TaskManager.Task::(_updateState) Task=`ecae2ccf-b8c3-4137-b8be-8a245c5657d3`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 09:48:22,408::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 09:48:22,408::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 09:48:22,408::task::990::TaskManager.Task::(_decref) Task=`ecae2ccf-b8c3-4137-b8be-8a245c5657d3`::ref 0 aborting False >Thread-34::DEBUG::2014-07-10 09:48:22,412::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-34::DEBUG::2014-07-10 09:48:22,413::task::595::TaskManager.Task::(_updateState) Task=`4efd236d-e536-4f52-ba2d-347622865772`::moving from state init -> state preparing >Thread-34::INFO::2014-07-10 09:48:22,413::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-34::DEBUG::2014-07-10 09:48:22,414::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`96a8c80a-ca28-4b11-9b1a-a5573a221551`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-10 09:48:22,414::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' for lock type 'shared' >Thread-34::DEBUG::2014-07-10 09:48:22,414::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-10 09:48:22,415::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`96a8c80a-ca28-4b11-9b1a-a5573a221551`::Granted request >Thread-34::DEBUG::2014-07-10 09:48:22,415::task::827::TaskManager.Task::(resourceAcquired) Task=`4efd236d-e536-4f52-ba2d-347622865772`::_resourcesAcquired: Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee (shared) >Thread-34::DEBUG::2014-07-10 09:48:22,415::task::990::TaskManager.Task::(_decref) Task=`4efd236d-e536-4f52-ba2d-347622865772`::ref 1 aborting False >Thread-34::INFO::2014-07-10 09:48:22,417::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532067385344', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:48:22,417::task::1185::TaskManager.Task::(prepare) Task=`4efd236d-e536-4f52-ba2d-347622865772`::finished: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532067385344', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:48:22,417::task::595::TaskManager.Task::(_updateState) Task=`4efd236d-e536-4f52-ba2d-347622865772`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-10 09:48:22,417::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee': < ResourceRef 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-10 09:48:22,418::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-10 09:48:22,418::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' >Thread-34::DEBUG::2014-07-10 09:48:22,418::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' (0 active users) >Thread-34::DEBUG::2014-07-10 09:48:22,418::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-10 09:48:22,418::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', Clearing records. >Thread-34::DEBUG::2014-07-10 09:48:22,419::task::990::TaskManager.Task::(_decref) Task=`4efd236d-e536-4f52-ba2d-347622865772`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 09:48:22,831::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Thread-67::DEBUG::2014-07-10 09:48:22,940::task::595::TaskManager.Task::(_updateState) Task=`e5e60659-11da-4ae5-953d-08709578776d`::moving from state init -> state preparing >Thread-67::INFO::2014-07-10 09:48:22,945::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='f30c2cb7-a43a-4bf5-82b5-cfe07336f65c', volUUID='b0fbb3c9-55af-4a3a-95ad-fc56a80b9cf5', options=None) >Thread-67::INFO::2014-07-10 09:48:22,948::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-67::DEBUG::2014-07-10 09:48:22,950::task::1185::TaskManager.Task::(prepare) Task=`e5e60659-11da-4ae5-953d-08709578776d`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-67::DEBUG::2014-07-10 09:48:22,952::task::595::TaskManager.Task::(_updateState) Task=`e5e60659-11da-4ae5-953d-08709578776d`::moving from state preparing -> state finished >Thread-67::DEBUG::2014-07-10 09:48:22,954::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-67::DEBUG::2014-07-10 09:48:22,955::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-67::DEBUG::2014-07-10 09:48:22,957::task::990::TaskManager.Task::(_decref) Task=`e5e60659-11da-4ae5-953d-08709578776d`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 09:48:22,963::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0350701 s, 29.2 MB/s\n'; <rc> = 0 >Thread-48::DEBUG::2014-07-10 09:48:23,265::task::595::TaskManager.Task::(_updateState) Task=`4659d2b2-387d-4c94-af87-fe64f113e9b2`::moving from state init -> state preparing >Thread-48::INFO::2014-07-10 09:48:23,265::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='0cd7d6ce-f497-4243-a690-c57744861eea', volUUID='10b6a7dd-dc6c-43fa-ba17-92e4331b0e0b', options=None) >Thread-48::INFO::2014-07-10 09:48:23,266::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-48::DEBUG::2014-07-10 09:48:23,266::task::1185::TaskManager.Task::(prepare) Task=`4659d2b2-387d-4c94-af87-fe64f113e9b2`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-48::DEBUG::2014-07-10 09:48:23,266::task::595::TaskManager.Task::(_updateState) Task=`4659d2b2-387d-4c94-af87-fe64f113e9b2`::moving from state preparing -> state finished >Thread-48::DEBUG::2014-07-10 09:48:23,266::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-48::DEBUG::2014-07-10 09:48:23,266::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-48::DEBUG::2014-07-10 09:48:23,267::task::990::TaskManager.Task::(_decref) Task=`4659d2b2-387d-4c94-af87-fe64f113e9b2`::ref 0 aborting False >Thread-76::DEBUG::2014-07-10 09:48:24,944::task::595::TaskManager.Task::(_updateState) Task=`56400bdd-861a-4b88-8f59-23c89ffc30ee`::moving from state init -> state preparing >Thread-76::INFO::2014-07-10 09:48:24,944::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='e4c65229-4247-4b33-b72a-f1d5ce72ad05', volUUID='cad94284-3ca9-4c30-933d-997f4460309e', options=None) >Thread-76::INFO::2014-07-10 09:48:24,945::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-76::DEBUG::2014-07-10 09:48:24,945::task::1185::TaskManager.Task::(prepare) Task=`56400bdd-861a-4b88-8f59-23c89ffc30ee`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-76::DEBUG::2014-07-10 09:48:24,945::task::595::TaskManager.Task::(_updateState) Task=`56400bdd-861a-4b88-8f59-23c89ffc30ee`::moving from state preparing -> state finished >Thread-76::DEBUG::2014-07-10 09:48:24,945::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-76::DEBUG::2014-07-10 09:48:24,946::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-76::DEBUG::2014-07-10 09:48:24,946::task::990::TaskManager.Task::(_decref) Task=`56400bdd-861a-4b88-8f59-23c89ffc30ee`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 09:48:24,979::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:48:25,112::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.076166 s, 13.4 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:48:27,127::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:48:27,213::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.028801 s, 35.6 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 09:48:29,192::task::595::TaskManager.Task::(_updateState) Task=`93b3e67d-de78-4aad-b050-541f3355873c`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 09:48:29,192::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::INFO::2014-07-10 09:48:29,193::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000938737', 'lastCheck': '7.3', 'valid': True}, '6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000416888', 'lastCheck': '8.3', 'valid': True}} >Thread-14::DEBUG::2014-07-10 09:48:29,193::task::1185::TaskManager.Task::(prepare) Task=`93b3e67d-de78-4aad-b050-541f3355873c`::finished: {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000938737', 'lastCheck': '7.3', 'valid': True}, '6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000416888', 'lastCheck': '8.3', 'valid': True}} >Thread-14::DEBUG::2014-07-10 09:48:29,193::task::595::TaskManager.Task::(_updateState) Task=`93b3e67d-de78-4aad-b050-541f3355873c`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 09:48:29,193::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 09:48:29,193::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 09:48:29,194::task::990::TaskManager.Task::(_decref) Task=`93b3e67d-de78-4aad-b050-541f3355873c`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 09:48:29,229::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:48:29,322::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0345365 s, 29.6 MB/s\n'; <rc> = 0 >Thread-40::DEBUG::2014-07-10 09:48:30,960::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lion.qa.lab.tlv.redhat.com:_export_yuri2_backup2/6a70504d-00df-4869-8695-0f442053f6b6/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-40::DEBUG::2014-07-10 09:48:30,980::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n369 bytes (369 B) copied, 0.000434364 s, 850 kB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:48:31,336::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:48:31,432::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0320425 s, 32.0 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-10 09:48:31,894::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/metadata bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-10 09:48:31,921::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00648346 s, 632 kB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 09:48:32,454::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-14::DEBUG::2014-07-10 09:48:32,454::task::595::TaskManager.Task::(_updateState) Task=`84c373cc-e56b-4bd9-9826-39ed11c93137`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 09:48:32,455::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-14::INFO::2014-07-10 09:48:32,455::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:48:32,455::task::1185::TaskManager.Task::(prepare) Task=`84c373cc-e56b-4bd9-9826-39ed11c93137`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:48:32,456::task::595::TaskManager.Task::(_updateState) Task=`84c373cc-e56b-4bd9-9826-39ed11c93137`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 09:48:32,456::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 09:48:32,456::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 09:48:32,456::task::990::TaskManager.Task::(_decref) Task=`84c373cc-e56b-4bd9-9826-39ed11c93137`::ref 0 aborting False >Thread-34::DEBUG::2014-07-10 09:48:32,460::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-34::DEBUG::2014-07-10 09:48:32,460::task::595::TaskManager.Task::(_updateState) Task=`f8f8c579-6802-4ab1-98cc-83d1d7097c47`::moving from state init -> state preparing >Thread-34::INFO::2014-07-10 09:48:32,461::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-34::DEBUG::2014-07-10 09:48:32,461::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`165bc485-64cd-4d1b-ba7f-474e4ad6c13a`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-10 09:48:32,462::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' for lock type 'shared' >Thread-34::DEBUG::2014-07-10 09:48:32,462::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-10 09:48:32,462::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`165bc485-64cd-4d1b-ba7f-474e4ad6c13a`::Granted request >Thread-34::DEBUG::2014-07-10 09:48:32,463::task::827::TaskManager.Task::(resourceAcquired) Task=`f8f8c579-6802-4ab1-98cc-83d1d7097c47`::_resourcesAcquired: Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee (shared) >Thread-34::DEBUG::2014-07-10 09:48:32,463::task::990::TaskManager.Task::(_decref) Task=`f8f8c579-6802-4ab1-98cc-83d1d7097c47`::ref 1 aborting False >Thread-34::INFO::2014-07-10 09:48:32,464::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532067385344', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:48:32,464::task::1185::TaskManager.Task::(prepare) Task=`f8f8c579-6802-4ab1-98cc-83d1d7097c47`::finished: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532067385344', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:48:32,464::task::595::TaskManager.Task::(_updateState) Task=`f8f8c579-6802-4ab1-98cc-83d1d7097c47`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-10 09:48:32,465::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee': < ResourceRef 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-10 09:48:32,465::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-10 09:48:32,465::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' >Thread-34::DEBUG::2014-07-10 09:48:32,465::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' (0 active users) >Thread-34::DEBUG::2014-07-10 09:48:32,465::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-10 09:48:32,466::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', Clearing records. >Thread-34::DEBUG::2014-07-10 09:48:32,466::task::990::TaskManager.Task::(_decref) Task=`f8f8c579-6802-4ab1-98cc-83d1d7097c47`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 09:48:33,448::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:48:33,538::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0327272 s, 31.3 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:48:35,553::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:48:35,638::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0324328 s, 31.6 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:48:37,649::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:48:37,736::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0301392 s, 34.0 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:48:39,751::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:48:39,835::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0268653 s, 38.1 MB/s\n'; <rc> = 0 >Thread-40::DEBUG::2014-07-10 09:48:41,011::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lion.qa.lab.tlv.redhat.com:_export_yuri2_backup2/6a70504d-00df-4869-8695-0f442053f6b6/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-40::DEBUG::2014-07-10 09:48:41,032::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n369 bytes (369 B) copied, 0.000413353 s, 893 kB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:48:41,851::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:48:41,933::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0272449 s, 37.6 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-10 09:48:41,957::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/metadata bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-10 09:48:41,979::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000913718 s, 4.5 MB/s\n'; <rc> = 0 >Thread-70::DEBUG::2014-07-10 09:48:41,988::task::595::TaskManager.Task::(_updateState) Task=`8287400e-e958-49ab-bf50-1bae29491cf4`::moving from state init -> state preparing >Thread-70::INFO::2014-07-10 09:48:41,996::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='cfaeead2-7caa-467c-b389-c89840ae6605', volUUID='567fe32d-31a6-4ff6-90f3-fd6a656fbecc', options=None) >Thread-70::INFO::2014-07-10 09:48:42,002::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-70::DEBUG::2014-07-10 09:48:42,005::task::1185::TaskManager.Task::(prepare) Task=`8287400e-e958-49ab-bf50-1bae29491cf4`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-70::DEBUG::2014-07-10 09:48:42,008::task::595::TaskManager.Task::(_updateState) Task=`8287400e-e958-49ab-bf50-1bae29491cf4`::moving from state preparing -> state finished >Thread-70::DEBUG::2014-07-10 09:48:42,011::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-70::DEBUG::2014-07-10 09:48:42,015::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-70::DEBUG::2014-07-10 09:48:42,018::task::990::TaskManager.Task::(_decref) Task=`8287400e-e958-49ab-bf50-1bae29491cf4`::ref 0 aborting False >Thread-14::DEBUG::2014-07-10 09:48:42,489::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-14::DEBUG::2014-07-10 09:48:42,490::task::595::TaskManager.Task::(_updateState) Task=`82b4ab1b-cf24-40f6-b5ae-fe67b44e1cc1`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 09:48:42,490::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-14::INFO::2014-07-10 09:48:42,491::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:48:42,491::task::1185::TaskManager.Task::(prepare) Task=`82b4ab1b-cf24-40f6-b5ae-fe67b44e1cc1`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:48:42,491::task::595::TaskManager.Task::(_updateState) Task=`82b4ab1b-cf24-40f6-b5ae-fe67b44e1cc1`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 09:48:42,491::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 09:48:42,491::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 09:48:42,492::task::990::TaskManager.Task::(_decref) Task=`82b4ab1b-cf24-40f6-b5ae-fe67b44e1cc1`::ref 0 aborting False >Thread-34::DEBUG::2014-07-10 09:48:42,496::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-34::DEBUG::2014-07-10 09:48:42,496::task::595::TaskManager.Task::(_updateState) Task=`47a92396-b321-449d-b418-c2f28cd3a07b`::moving from state init -> state preparing >Thread-34::INFO::2014-07-10 09:48:42,496::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-34::DEBUG::2014-07-10 09:48:42,497::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`b0a4673b-8a2b-431a-b770-3784a8d1387a`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-10 09:48:42,497::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' for lock type 'shared' >Thread-34::DEBUG::2014-07-10 09:48:42,498::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-10 09:48:42,498::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`b0a4673b-8a2b-431a-b770-3784a8d1387a`::Granted request >Thread-34::DEBUG::2014-07-10 09:48:42,499::task::827::TaskManager.Task::(resourceAcquired) Task=`47a92396-b321-449d-b418-c2f28cd3a07b`::_resourcesAcquired: Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee (shared) >Thread-34::DEBUG::2014-07-10 09:48:42,499::task::990::TaskManager.Task::(_decref) Task=`47a92396-b321-449d-b418-c2f28cd3a07b`::ref 1 aborting False >Thread-34::INFO::2014-07-10 09:48:42,500::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532067385344', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:48:42,500::task::1185::TaskManager.Task::(prepare) Task=`47a92396-b321-449d-b418-c2f28cd3a07b`::finished: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '532067385344', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:48:42,500::task::595::TaskManager.Task::(_updateState) Task=`47a92396-b321-449d-b418-c2f28cd3a07b`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-10 09:48:42,501::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee': < ResourceRef 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-10 09:48:42,501::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-10 09:48:42,501::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' >Thread-34::DEBUG::2014-07-10 09:48:42,501::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' (0 active users) >Thread-34::DEBUG::2014-07-10 09:48:42,502::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-10 09:48:42,502::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', Clearing records. >Thread-34::DEBUG::2014-07-10 09:48:42,502::task::990::TaskManager.Task::(_decref) Task=`47a92396-b321-449d-b418-c2f28cd3a07b`::ref 0 aborting False >Thread-51::DEBUG::2014-07-10 09:48:43,522::task::595::TaskManager.Task::(_updateState) Task=`c04eaa48-fb38-42a0-b610-4d170d862789`::moving from state init -> state preparing >Thread-51::INFO::2014-07-10 09:48:43,522::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='76fdb054-02cd-42ed-9721-b3e65b34c3a4', volUUID='022dfe46-2cf7-4915-80b3-883158e3ca83', options=None) >Thread-51::INFO::2014-07-10 09:48:43,523::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-51::DEBUG::2014-07-10 09:48:43,524::task::1185::TaskManager.Task::(prepare) Task=`c04eaa48-fb38-42a0-b610-4d170d862789`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-60::DEBUG::2014-07-10 09:48:43,524::task::595::TaskManager.Task::(_updateState) Task=`c1dd9da9-2697-4b97-8796-83f1b2ebff12`::moving from state init -> state preparing >Thread-51::DEBUG::2014-07-10 09:48:43,525::task::595::TaskManager.Task::(_updateState) Task=`c04eaa48-fb38-42a0-b610-4d170d862789`::moving from state preparing -> state finished >Thread-51::DEBUG::2014-07-10 09:48:43,526::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-60::INFO::2014-07-10 09:48:43,526::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='b034d5b0-e1e0-4011-b49b-4d45ddb11556', volUUID='3d7f62b5-328f-4d8e-8b69-873cfb5ae14d', options=None) >Thread-51::DEBUG::2014-07-10 09:48:43,527::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-60::INFO::2014-07-10 09:48:43,528::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-51::DEBUG::2014-07-10 09:48:43,528::task::990::TaskManager.Task::(_decref) Task=`c04eaa48-fb38-42a0-b610-4d170d862789`::ref 0 aborting False >Thread-60::DEBUG::2014-07-10 09:48:43,529::task::1185::TaskManager.Task::(prepare) Task=`c1dd9da9-2697-4b97-8796-83f1b2ebff12`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-60::DEBUG::2014-07-10 09:48:43,530::task::595::TaskManager.Task::(_updateState) Task=`c1dd9da9-2697-4b97-8796-83f1b2ebff12`::moving from state preparing -> state finished >Thread-60::DEBUG::2014-07-10 09:48:43,530::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-60::DEBUG::2014-07-10 09:48:43,530::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-60::DEBUG::2014-07-10 09:48:43,531::task::990::TaskManager.Task::(_decref) Task=`c1dd9da9-2697-4b97-8796-83f1b2ebff12`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 09:48:43,949::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:48:44,054::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0454727 s, 22.5 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 09:48:44,410::task::595::TaskManager.Task::(_updateState) Task=`5222c708-eef7-49fd-866d-fc58726e7aa9`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 09:48:44,410::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::INFO::2014-07-10 09:48:44,411::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000913718', 'lastCheck': '2.4', 'valid': True}, '6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000413353', 'lastCheck': '3.4', 'valid': True}} >Thread-14::DEBUG::2014-07-10 09:48:44,411::task::1185::TaskManager.Task::(prepare) Task=`5222c708-eef7-49fd-866d-fc58726e7aa9`::finished: {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000913718', 'lastCheck': '2.4', 'valid': True}, '6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000413353', 'lastCheck': '3.4', 'valid': True}} >Thread-14::DEBUG::2014-07-10 09:48:44,411::task::595::TaskManager.Task::(_updateState) Task=`5222c708-eef7-49fd-866d-fc58726e7aa9`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 09:48:44,412::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 09:48:44,412::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 09:48:44,412::task::990::TaskManager.Task::(_decref) Task=`5222c708-eef7-49fd-866d-fc58726e7aa9`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 09:48:46,070::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:48:46,168::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0401202 s, 25.5 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:48:48,183::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:48:48,266::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0268203 s, 38.2 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:48:50,281::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:48:50,392::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0538561 s, 19.0 MB/s\n'; <rc> = 0 >Thread-40::DEBUG::2014-07-10 09:48:51,058::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lion.qa.lab.tlv.redhat.com:_export_yuri2_backup2/6a70504d-00df-4869-8695-0f442053f6b6/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-40::DEBUG::2014-07-10 09:48:51,078::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n369 bytes (369 B) copied, 0.000405015 s, 911 kB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-10 09:48:52,047::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/metadata bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-10 09:48:52,068::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00073804 s, 5.5 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:48:52,408::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:48:52,512::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0455329 s, 22.5 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 09:48:52,538::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-14::DEBUG::2014-07-10 09:48:52,540::task::595::TaskManager.Task::(_updateState) Task=`38f4df23-12ad-4887-ad12-14ee1ae85ba6`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 09:48:52,540::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-14::INFO::2014-07-10 09:48:52,540::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:48:52,541::task::1185::TaskManager.Task::(prepare) Task=`38f4df23-12ad-4887-ad12-14ee1ae85ba6`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:48:52,541::task::595::TaskManager.Task::(_updateState) Task=`38f4df23-12ad-4887-ad12-14ee1ae85ba6`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 09:48:52,541::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 09:48:52,541::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 09:48:52,542::task::990::TaskManager.Task::(_decref) Task=`38f4df23-12ad-4887-ad12-14ee1ae85ba6`::ref 0 aborting False >Thread-34::DEBUG::2014-07-10 09:48:52,547::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-34::DEBUG::2014-07-10 09:48:52,547::task::595::TaskManager.Task::(_updateState) Task=`33db2413-0e76-43ef-b23b-ed38d9b3e600`::moving from state init -> state preparing >Thread-34::INFO::2014-07-10 09:48:52,548::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-34::DEBUG::2014-07-10 09:48:52,549::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`b0dcd902-1e0c-4cad-9d14-0a2a78396928`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-10 09:48:52,549::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' for lock type 'shared' >Thread-34::DEBUG::2014-07-10 09:48:52,549::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-10 09:48:52,549::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`b0dcd902-1e0c-4cad-9d14-0a2a78396928`::Granted request >Thread-34::DEBUG::2014-07-10 09:48:52,550::task::827::TaskManager.Task::(resourceAcquired) Task=`33db2413-0e76-43ef-b23b-ed38d9b3e600`::_resourcesAcquired: Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee (shared) >Thread-34::DEBUG::2014-07-10 09:48:52,550::task::990::TaskManager.Task::(_decref) Task=`33db2413-0e76-43ef-b23b-ed38d9b3e600`::ref 1 aborting False >Thread-34::INFO::2014-07-10 09:48:52,551::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '531976159232', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:48:52,552::task::1185::TaskManager.Task::(prepare) Task=`33db2413-0e76-43ef-b23b-ed38d9b3e600`::finished: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '531976159232', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:48:52,553::task::595::TaskManager.Task::(_updateState) Task=`33db2413-0e76-43ef-b23b-ed38d9b3e600`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-10 09:48:52,553::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee': < ResourceRef 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-10 09:48:52,553::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-10 09:48:52,553::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' >Thread-34::DEBUG::2014-07-10 09:48:52,554::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' (0 active users) >Thread-34::DEBUG::2014-07-10 09:48:52,554::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-10 09:48:52,554::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', Clearing records. >Thread-34::DEBUG::2014-07-10 09:48:52,554::task::990::TaskManager.Task::(_decref) Task=`33db2413-0e76-43ef-b23b-ed38d9b3e600`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 09:48:54,528::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:48:54,614::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0298341 s, 34.3 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:48:56,630::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:48:56,717::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0297426 s, 34.4 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:48:58,733::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:48:58,855::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0327889 s, 31.2 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 09:48:59,579::task::595::TaskManager.Task::(_updateState) Task=`25c44305-3b66-4f9e-ada6-53e55633d744`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 09:48:59,580::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::INFO::2014-07-10 09:48:59,580::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00073804', 'lastCheck': '7.5', 'valid': True}, '6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000405015', 'lastCheck': '8.5', 'valid': True}} >Thread-14::DEBUG::2014-07-10 09:48:59,580::task::1185::TaskManager.Task::(prepare) Task=`25c44305-3b66-4f9e-ada6-53e55633d744`::finished: {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00073804', 'lastCheck': '7.5', 'valid': True}, '6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000405015', 'lastCheck': '8.5', 'valid': True}} >Thread-14::DEBUG::2014-07-10 09:48:59,580::task::595::TaskManager.Task::(_updateState) Task=`25c44305-3b66-4f9e-ada6-53e55633d744`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 09:48:59,581::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 09:48:59,581::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 09:48:59,581::task::990::TaskManager.Task::(_decref) Task=`25c44305-3b66-4f9e-ada6-53e55633d744`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 09:49:00,871::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:49:00,969::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.042356 s, 24.2 MB/s\n'; <rc> = 0 >Thread-40::DEBUG::2014-07-10 09:49:01,112::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lion.qa.lab.tlv.redhat.com:_export_yuri2_backup2/6a70504d-00df-4869-8695-0f442053f6b6/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-40::DEBUG::2014-07-10 09:49:01,173::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n369 bytes (369 B) copied, 0.000548952 s, 672 kB/s\n'; <rc> = 0 >Thread-64::DEBUG::2014-07-10 09:49:02,065::task::595::TaskManager.Task::(_updateState) Task=`dcf6fb33-d817-4077-8036-8f246d0ba8f0`::moving from state init -> state preparing >Thread-64::INFO::2014-07-10 09:49:02,074::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='aa20346a-4d3a-4e07-b8e1-52c0ebe4168c', volUUID='58fefce2-9bce-4bff-8949-8c6ce8122b27', options=None) >Thread-64::INFO::2014-07-10 09:49:02,074::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-64::DEBUG::2014-07-10 09:49:02,074::task::1185::TaskManager.Task::(prepare) Task=`dcf6fb33-d817-4077-8036-8f246d0ba8f0`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-64::DEBUG::2014-07-10 09:49:02,074::task::595::TaskManager.Task::(_updateState) Task=`dcf6fb33-d817-4077-8036-8f246d0ba8f0`::moving from state preparing -> state finished >Thread-64::DEBUG::2014-07-10 09:49:02,075::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-64::DEBUG::2014-07-10 09:49:02,075::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-64::DEBUG::2014-07-10 09:49:02,075::task::990::TaskManager.Task::(_decref) Task=`dcf6fb33-d817-4077-8036-8f246d0ba8f0`::ref 0 aborting False >Thread-18::DEBUG::2014-07-10 09:49:02,096::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/metadata bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-10 09:49:02,117::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00070054 s, 5.8 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 09:49:02,590::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-14::DEBUG::2014-07-10 09:49:02,591::task::595::TaskManager.Task::(_updateState) Task=`519d0857-6c86-41b8-ae53-023addc7f2db`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 09:49:02,592::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-14::INFO::2014-07-10 09:49:02,592::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:49:02,593::task::1185::TaskManager.Task::(prepare) Task=`519d0857-6c86-41b8-ae53-023addc7f2db`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:49:02,593::task::595::TaskManager.Task::(_updateState) Task=`519d0857-6c86-41b8-ae53-023addc7f2db`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 09:49:02,593::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 09:49:02,593::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 09:49:02,593::task::990::TaskManager.Task::(_decref) Task=`519d0857-6c86-41b8-ae53-023addc7f2db`::ref 0 aborting False >Thread-34::DEBUG::2014-07-10 09:49:02,637::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-34::DEBUG::2014-07-10 09:49:02,637::task::595::TaskManager.Task::(_updateState) Task=`d0640c66-58fe-454c-8799-4a06b0c619fa`::moving from state init -> state preparing >Thread-34::INFO::2014-07-10 09:49:02,637::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-34::DEBUG::2014-07-10 09:49:02,638::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`22a7ecc5-353a-445f-b1f2-dc384c501e16`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-10 09:49:02,639::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' for lock type 'shared' >Thread-34::DEBUG::2014-07-10 09:49:02,639::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-10 09:49:02,639::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`22a7ecc5-353a-445f-b1f2-dc384c501e16`::Granted request >Thread-34::DEBUG::2014-07-10 09:49:02,640::task::827::TaskManager.Task::(resourceAcquired) Task=`d0640c66-58fe-454c-8799-4a06b0c619fa`::_resourcesAcquired: Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee (shared) >Thread-34::DEBUG::2014-07-10 09:49:02,640::task::990::TaskManager.Task::(_decref) Task=`d0640c66-58fe-454c-8799-4a06b0c619fa`::ref 1 aborting False >Thread-34::INFO::2014-07-10 09:49:02,641::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '531976159232', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:49:02,641::task::1185::TaskManager.Task::(prepare) Task=`d0640c66-58fe-454c-8799-4a06b0c619fa`::finished: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '531976159232', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:49:02,642::task::595::TaskManager.Task::(_updateState) Task=`d0640c66-58fe-454c-8799-4a06b0c619fa`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-10 09:49:02,642::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee': < ResourceRef 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-10 09:49:02,642::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-10 09:49:02,642::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' >Thread-34::DEBUG::2014-07-10 09:49:02,643::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' (0 active users) >Thread-34::DEBUG::2014-07-10 09:49:02,643::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-10 09:49:02,643::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', Clearing records. >Thread-34::DEBUG::2014-07-10 09:49:02,643::task::990::TaskManager.Task::(_decref) Task=`d0640c66-58fe-454c-8799-4a06b0c619fa`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 09:49:02,985::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:49:03,069::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0270173 s, 37.9 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:49:05,084::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Thread-54::DEBUG::2014-07-10 09:49:05,187::task::595::TaskManager.Task::(_updateState) Task=`774d4c0d-2004-44a8-a87c-3600ea01e825`::moving from state init -> state preparing >Thread-54::INFO::2014-07-10 09:49:05,191::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='28408446-e5fd-4565-a976-e760951593fe', volUUID='776303a2-5585-451e-826e-0e338d4a1e98', options=None) >Thread-54::INFO::2014-07-10 09:49:05,195::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-54::DEBUG::2014-07-10 09:49:05,199::task::1185::TaskManager.Task::(prepare) Task=`774d4c0d-2004-44a8-a87c-3600ea01e825`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-54::DEBUG::2014-07-10 09:49:05,202::task::595::TaskManager.Task::(_updateState) Task=`774d4c0d-2004-44a8-a87c-3600ea01e825`::moving from state preparing -> state finished >Thread-54::DEBUG::2014-07-10 09:49:05,204::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-54::DEBUG::2014-07-10 09:49:05,210::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-73::DEBUG::2014-07-10 09:49:05,212::task::595::TaskManager.Task::(_updateState) Task=`4eccb906-f72a-42f1-b84c-3f46a31191fe`::moving from state init -> state preparing >Thread-54::DEBUG::2014-07-10 09:49:05,216::task::990::TaskManager.Task::(_decref) Task=`774d4c0d-2004-44a8-a87c-3600ea01e825`::ref 0 aborting False >Thread-73::INFO::2014-07-10 09:49:05,219::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='c01d693b-cba0-4fed-9ad7-0aaa28912a19', volUUID='4bb5d954-2a50-4028-b299-0b43c261270c', options=None) >Thread-73::INFO::2014-07-10 09:49:05,226::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-73::DEBUG::2014-07-10 09:49:05,232::task::1185::TaskManager.Task::(prepare) Task=`4eccb906-f72a-42f1-b84c-3f46a31191fe`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-73::DEBUG::2014-07-10 09:49:05,239::task::595::TaskManager.Task::(_updateState) Task=`4eccb906-f72a-42f1-b84c-3f46a31191fe`::moving from state preparing -> state finished >Thread-73::DEBUG::2014-07-10 09:49:05,246::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-73::DEBUG::2014-07-10 09:49:05,253::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-73::DEBUG::2014-07-10 09:49:05,261::task::990::TaskManager.Task::(_decref) Task=`4eccb906-f72a-42f1-b84c-3f46a31191fe`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 09:49:05,346::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0587911 s, 17.4 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:49:07,372::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:49:07,465::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0330964 s, 30.9 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:49:09,480::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:49:09,567::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0300783 s, 34.0 MB/s\n'; <rc> = 0 >Thread-40::DEBUG::2014-07-10 09:49:11,230::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lion.qa.lab.tlv.redhat.com:_export_yuri2_backup2/6a70504d-00df-4869-8695-0f442053f6b6/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-40::DEBUG::2014-07-10 09:49:11,252::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n369 bytes (369 B) copied, 0.00045351 s, 814 kB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:49:11,583::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:49:11,674::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.036154 s, 28.3 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-10 09:49:12,148::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/metadata bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-10 09:49:12,170::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000734314 s, 5.6 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 09:49:12,722::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-14::DEBUG::2014-07-10 09:49:12,724::task::595::TaskManager.Task::(_updateState) Task=`16dee264-d8f4-4c6c-85f5-fee3ca13b754`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 09:49:12,724::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-14::INFO::2014-07-10 09:49:12,725::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:49:12,725::task::1185::TaskManager.Task::(prepare) Task=`16dee264-d8f4-4c6c-85f5-fee3ca13b754`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:49:12,725::task::595::TaskManager.Task::(_updateState) Task=`16dee264-d8f4-4c6c-85f5-fee3ca13b754`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 09:49:12,725::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 09:49:12,725::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 09:49:12,726::task::990::TaskManager.Task::(_decref) Task=`16dee264-d8f4-4c6c-85f5-fee3ca13b754`::ref 0 aborting False >Thread-34::DEBUG::2014-07-10 09:49:12,730::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-34::DEBUG::2014-07-10 09:49:12,731::task::595::TaskManager.Task::(_updateState) Task=`930867ee-6023-4ada-a214-a208c5b3a088`::moving from state init -> state preparing >Thread-34::INFO::2014-07-10 09:49:12,731::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-34::DEBUG::2014-07-10 09:49:12,732::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`10d07487-8dac-4ad8-b20f-ebc128d7eb5d`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-10 09:49:12,732::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' for lock type 'shared' >Thread-34::DEBUG::2014-07-10 09:49:12,732::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-10 09:49:12,733::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`10d07487-8dac-4ad8-b20f-ebc128d7eb5d`::Granted request >Thread-34::DEBUG::2014-07-10 09:49:12,733::task::827::TaskManager.Task::(resourceAcquired) Task=`930867ee-6023-4ada-a214-a208c5b3a088`::_resourcesAcquired: Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee (shared) >Thread-34::DEBUG::2014-07-10 09:49:12,733::task::990::TaskManager.Task::(_decref) Task=`930867ee-6023-4ada-a214-a208c5b3a088`::ref 1 aborting False >Thread-34::INFO::2014-07-10 09:49:12,735::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '531975110656', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:49:12,735::task::1185::TaskManager.Task::(prepare) Task=`930867ee-6023-4ada-a214-a208c5b3a088`::finished: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '531975110656', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:49:12,735::task::595::TaskManager.Task::(_updateState) Task=`930867ee-6023-4ada-a214-a208c5b3a088`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-10 09:49:12,735::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee': < ResourceRef 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-10 09:49:12,735::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-10 09:49:12,736::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' >Thread-34::DEBUG::2014-07-10 09:49:12,736::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' (0 active users) >Thread-34::DEBUG::2014-07-10 09:49:12,736::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-10 09:49:12,736::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', Clearing records. >Thread-34::DEBUG::2014-07-10 09:49:12,736::task::990::TaskManager.Task::(_decref) Task=`930867ee-6023-4ada-a214-a208c5b3a088`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 09:49:13,683::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:49:13,798::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.043078 s, 23.8 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 09:49:14,767::task::595::TaskManager.Task::(_updateState) Task=`241883d9-2a4c-4ad1-96bb-8f2acb887175`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 09:49:14,767::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::INFO::2014-07-10 09:49:14,768::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000734314', 'lastCheck': '2.6', 'valid': True}, '6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00045351', 'lastCheck': '3.5', 'valid': True}} >Thread-14::DEBUG::2014-07-10 09:49:14,768::task::1185::TaskManager.Task::(prepare) Task=`241883d9-2a4c-4ad1-96bb-8f2acb887175`::finished: {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000734314', 'lastCheck': '2.6', 'valid': True}, '6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00045351', 'lastCheck': '3.5', 'valid': True}} >Thread-14::DEBUG::2014-07-10 09:49:14,768::task::595::TaskManager.Task::(_updateState) Task=`241883d9-2a4c-4ad1-96bb-8f2acb887175`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 09:49:14,768::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 09:49:14,768::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 09:49:14,768::task::990::TaskManager.Task::(_decref) Task=`241883d9-2a4c-4ad1-96bb-8f2acb887175`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 09:49:15,813::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:49:15,901::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0298717 s, 34.3 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:49:17,917::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:49:18,042::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0320627 s, 31.9 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:49:20,057::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:49:20,177::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0356725 s, 28.7 MB/s\n'; <rc> = 0 >Thread-40::DEBUG::2014-07-10 09:49:21,278::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lion.qa.lab.tlv.redhat.com:_export_yuri2_backup2/6a70504d-00df-4869-8695-0f442053f6b6/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-40::DEBUG::2014-07-10 09:49:21,298::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n369 bytes (369 B) copied, 0.000476718 s, 774 kB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:49:22,192::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Thread-18::DEBUG::2014-07-10 09:49:22,216::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/metadata bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-10 09:49:22,279::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000568238 s, 7.2 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:49:22,476::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.227384 s, 4.5 MB/s\n'; <rc> = 0 >Thread-57::DEBUG::2014-07-10 09:49:22,548::task::595::TaskManager.Task::(_updateState) Task=`ca067998-49e0-4b5c-a35a-d6f1d5bba971`::moving from state init -> state preparing >Thread-57::INFO::2014-07-10 09:49:22,549::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='b6f6c0da-e67f-4902-b9ac-3069571a42fe', volUUID='c4cd1da8-05b7-45e0-80b1-1183d21443d9', options=None) >Thread-57::INFO::2014-07-10 09:49:22,549::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-57::DEBUG::2014-07-10 09:49:22,549::task::1185::TaskManager.Task::(prepare) Task=`ca067998-49e0-4b5c-a35a-d6f1d5bba971`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-57::DEBUG::2014-07-10 09:49:22,549::task::595::TaskManager.Task::(_updateState) Task=`ca067998-49e0-4b5c-a35a-d6f1d5bba971`::moving from state preparing -> state finished >Thread-57::DEBUG::2014-07-10 09:49:22,550::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-57::DEBUG::2014-07-10 09:49:22,552::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-57::DEBUG::2014-07-10 09:49:22,554::task::990::TaskManager.Task::(_decref) Task=`ca067998-49e0-4b5c-a35a-d6f1d5bba971`::ref 0 aborting False >Thread-14::DEBUG::2014-07-10 09:49:22,773::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-14::DEBUG::2014-07-10 09:49:22,774::task::595::TaskManager.Task::(_updateState) Task=`5ca2ed4e-4390-4be5-bde4-d1157d3042ff`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 09:49:22,774::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-14::INFO::2014-07-10 09:49:22,774::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:49:22,775::task::1185::TaskManager.Task::(prepare) Task=`5ca2ed4e-4390-4be5-bde4-d1157d3042ff`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:49:22,775::task::595::TaskManager.Task::(_updateState) Task=`5ca2ed4e-4390-4be5-bde4-d1157d3042ff`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 09:49:22,776::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 09:49:22,776::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 09:49:22,776::task::990::TaskManager.Task::(_decref) Task=`5ca2ed4e-4390-4be5-bde4-d1157d3042ff`::ref 0 aborting False >Thread-34::DEBUG::2014-07-10 09:49:22,780::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-34::DEBUG::2014-07-10 09:49:22,781::task::595::TaskManager.Task::(_updateState) Task=`4283d22e-43ea-4b40-b147-973afa004789`::moving from state init -> state preparing >Thread-34::INFO::2014-07-10 09:49:22,781::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-34::DEBUG::2014-07-10 09:49:22,782::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`228ba09a-1af7-427f-9dec-eb5f4c89091e`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-10 09:49:22,782::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' for lock type 'shared' >Thread-34::DEBUG::2014-07-10 09:49:22,783::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-10 09:49:22,783::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`228ba09a-1af7-427f-9dec-eb5f4c89091e`::Granted request >Thread-34::DEBUG::2014-07-10 09:49:22,783::task::827::TaskManager.Task::(resourceAcquired) Task=`4283d22e-43ea-4b40-b147-973afa004789`::_resourcesAcquired: Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee (shared) >Thread-34::DEBUG::2014-07-10 09:49:22,783::task::990::TaskManager.Task::(_decref) Task=`4283d22e-43ea-4b40-b147-973afa004789`::ref 1 aborting False >Thread-34::INFO::2014-07-10 09:49:22,785::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '531975110656', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:49:22,785::task::1185::TaskManager.Task::(prepare) Task=`4283d22e-43ea-4b40-b147-973afa004789`::finished: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '531975110656', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:49:22,785::task::595::TaskManager.Task::(_updateState) Task=`4283d22e-43ea-4b40-b147-973afa004789`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-10 09:49:22,785::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee': < ResourceRef 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-10 09:49:22,785::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-10 09:49:22,786::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' >Thread-34::DEBUG::2014-07-10 09:49:22,786::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' (0 active users) >Thread-34::DEBUG::2014-07-10 09:49:22,786::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-10 09:49:22,786::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', Clearing records. >Thread-34::DEBUG::2014-07-10 09:49:22,786::task::990::TaskManager.Task::(_decref) Task=`4283d22e-43ea-4b40-b147-973afa004789`::ref 0 aborting False >Thread-67::DEBUG::2014-07-10 09:49:23,302::task::595::TaskManager.Task::(_updateState) Task=`4a9b6669-5418-4259-8786-a4eda4f672a0`::moving from state init -> state preparing >Thread-67::INFO::2014-07-10 09:49:23,302::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='f30c2cb7-a43a-4bf5-82b5-cfe07336f65c', volUUID='b0fbb3c9-55af-4a3a-95ad-fc56a80b9cf5', options=None) >Thread-67::INFO::2014-07-10 09:49:23,303::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-67::DEBUG::2014-07-10 09:49:23,303::task::1185::TaskManager.Task::(prepare) Task=`4a9b6669-5418-4259-8786-a4eda4f672a0`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-67::DEBUG::2014-07-10 09:49:23,303::task::595::TaskManager.Task::(_updateState) Task=`4a9b6669-5418-4259-8786-a4eda4f672a0`::moving from state preparing -> state finished >Thread-67::DEBUG::2014-07-10 09:49:23,303::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-67::DEBUG::2014-07-10 09:49:23,303::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-67::DEBUG::2014-07-10 09:49:23,303::task::990::TaskManager.Task::(_decref) Task=`4a9b6669-5418-4259-8786-a4eda4f672a0`::ref 0 aborting False >Thread-48::DEBUG::2014-07-10 09:49:23,540::task::595::TaskManager.Task::(_updateState) Task=`c689d8ff-43c4-433a-b974-2fa7ed5aed12`::moving from state init -> state preparing >Thread-48::INFO::2014-07-10 09:49:23,540::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='0cd7d6ce-f497-4243-a690-c57744861eea', volUUID='10b6a7dd-dc6c-43fa-ba17-92e4331b0e0b', options=None) >Thread-48::INFO::2014-07-10 09:49:23,540::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-48::DEBUG::2014-07-10 09:49:23,541::task::1185::TaskManager.Task::(prepare) Task=`c689d8ff-43c4-433a-b974-2fa7ed5aed12`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-48::DEBUG::2014-07-10 09:49:23,541::task::595::TaskManager.Task::(_updateState) Task=`c689d8ff-43c4-433a-b974-2fa7ed5aed12`::moving from state preparing -> state finished >Thread-48::DEBUG::2014-07-10 09:49:23,541::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-48::DEBUG::2014-07-10 09:49:23,541::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-48::DEBUG::2014-07-10 09:49:23,541::task::990::TaskManager.Task::(_decref) Task=`c689d8ff-43c4-433a-b974-2fa7ed5aed12`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 09:49:24,492::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:49:24,579::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0298178 s, 34.3 MB/s\n'; <rc> = 0 >Thread-76::DEBUG::2014-07-10 09:49:25,238::task::595::TaskManager.Task::(_updateState) Task=`fe176143-c062-4ae9-a69f-7ae852323ce0`::moving from state init -> state preparing >Thread-76::INFO::2014-07-10 09:49:25,239::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='e4c65229-4247-4b33-b72a-f1d5ce72ad05', volUUID='cad94284-3ca9-4c30-933d-997f4460309e', options=None) >Thread-76::INFO::2014-07-10 09:49:25,240::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-76::DEBUG::2014-07-10 09:49:25,240::task::1185::TaskManager.Task::(prepare) Task=`fe176143-c062-4ae9-a69f-7ae852323ce0`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-76::DEBUG::2014-07-10 09:49:25,240::task::595::TaskManager.Task::(_updateState) Task=`fe176143-c062-4ae9-a69f-7ae852323ce0`::moving from state preparing -> state finished >Thread-76::DEBUG::2014-07-10 09:49:25,240::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-76::DEBUG::2014-07-10 09:49:25,240::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-76::DEBUG::2014-07-10 09:49:25,241::task::990::TaskManager.Task::(_decref) Task=`fe176143-c062-4ae9-a69f-7ae852323ce0`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 09:49:26,595::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:49:26,685::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0359944 s, 28.4 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:49:28,696::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:49:28,814::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0354793 s, 28.9 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 09:49:29,979::task::595::TaskManager.Task::(_updateState) Task=`5344ea24-dc9d-41da-961d-693b2505a180`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 09:49:29,980::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::INFO::2014-07-10 09:49:29,980::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000568238', 'lastCheck': '7.6', 'valid': True}, '6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000476718', 'lastCheck': '8.7', 'valid': True}} >Thread-14::DEBUG::2014-07-10 09:49:29,980::task::1185::TaskManager.Task::(prepare) Task=`5344ea24-dc9d-41da-961d-693b2505a180`::finished: {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000568238', 'lastCheck': '7.6', 'valid': True}, '6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000476718', 'lastCheck': '8.7', 'valid': True}} >Thread-14::DEBUG::2014-07-10 09:49:29,981::task::595::TaskManager.Task::(_updateState) Task=`5344ea24-dc9d-41da-961d-693b2505a180`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 09:49:29,981::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 09:49:29,981::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 09:49:29,981::task::990::TaskManager.Task::(_decref) Task=`5344ea24-dc9d-41da-961d-693b2505a180`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 09:49:30,829::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:49:30,914::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.027073 s, 37.8 MB/s\n'; <rc> = 0 >Thread-40::DEBUG::2014-07-10 09:49:31,332::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lion.qa.lab.tlv.redhat.com:_export_yuri2_backup2/6a70504d-00df-4869-8695-0f442053f6b6/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-40::DEBUG::2014-07-10 09:49:31,351::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n369 bytes (369 B) copied, 0.000483748 s, 763 kB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-10 09:49:32,427::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/metadata bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-10 09:49:32,450::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00090706 s, 4.5 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 09:49:32,861::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-14::DEBUG::2014-07-10 09:49:32,862::task::595::TaskManager.Task::(_updateState) Task=`dccbc691-e359-41e0-aee8-c03595d4fd2c`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 09:49:32,862::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-14::INFO::2014-07-10 09:49:32,863::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:49:32,863::task::1185::TaskManager.Task::(prepare) Task=`dccbc691-e359-41e0-aee8-c03595d4fd2c`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:49:32,863::task::595::TaskManager.Task::(_updateState) Task=`dccbc691-e359-41e0-aee8-c03595d4fd2c`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 09:49:32,863::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 09:49:32,863::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 09:49:32,863::task::990::TaskManager.Task::(_decref) Task=`dccbc691-e359-41e0-aee8-c03595d4fd2c`::ref 0 aborting False >Thread-34::DEBUG::2014-07-10 09:49:32,868::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-34::DEBUG::2014-07-10 09:49:32,868::task::595::TaskManager.Task::(_updateState) Task=`4372a683-3493-4c8c-b700-92904d4e78d7`::moving from state init -> state preparing >Thread-34::INFO::2014-07-10 09:49:32,868::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-34::DEBUG::2014-07-10 09:49:32,869::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`17a0a626-f637-4fd5-ac20-bbb67f29ae09`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-10 09:49:32,869::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' for lock type 'shared' >Thread-34::DEBUG::2014-07-10 09:49:32,869::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-10 09:49:32,870::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`17a0a626-f637-4fd5-ac20-bbb67f29ae09`::Granted request >Thread-34::DEBUG::2014-07-10 09:49:32,870::task::827::TaskManager.Task::(resourceAcquired) Task=`4372a683-3493-4c8c-b700-92904d4e78d7`::_resourcesAcquired: Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee (shared) >Thread-34::DEBUG::2014-07-10 09:49:32,870::task::990::TaskManager.Task::(_decref) Task=`4372a683-3493-4c8c-b700-92904d4e78d7`::ref 1 aborting False >Thread-34::INFO::2014-07-10 09:49:32,871::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '531975110656', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:49:32,871::task::1185::TaskManager.Task::(prepare) Task=`4372a683-3493-4c8c-b700-92904d4e78d7`::finished: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '531975110656', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:49:32,872::task::595::TaskManager.Task::(_updateState) Task=`4372a683-3493-4c8c-b700-92904d4e78d7`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-10 09:49:32,872::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee': < ResourceRef 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-10 09:49:32,872::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-10 09:49:32,872::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' >Thread-34::DEBUG::2014-07-10 09:49:32,873::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' (0 active users) >Thread-34::DEBUG::2014-07-10 09:49:32,873::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-10 09:49:32,873::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', Clearing records. >Thread-34::DEBUG::2014-07-10 09:49:32,873::task::990::TaskManager.Task::(_decref) Task=`4372a683-3493-4c8c-b700-92904d4e78d7`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 09:49:32,930::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:49:33,042::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.029309 s, 34.9 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:49:35,072::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:49:35,177::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0347781 s, 29.4 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:49:37,205::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:49:37,308::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0452828 s, 22.6 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:49:39,326::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:49:39,435::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0309107 s, 33.1 MB/s\n'; <rc> = 0 >Thread-40::DEBUG::2014-07-10 09:49:41,385::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lion.qa.lab.tlv.redhat.com:_export_yuri2_backup2/6a70504d-00df-4869-8695-0f442053f6b6/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-40::DEBUG::2014-07-10 09:49:41,424::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n369 bytes (369 B) copied, 0.000501968 s, 735 kB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:49:41,457::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:49:41,553::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0360087 s, 28.4 MB/s\n'; <rc> = 0 >Thread-70::DEBUG::2014-07-10 09:49:42,318::task::595::TaskManager.Task::(_updateState) Task=`07e9ec21-beb0-4bb7-b2a4-8c12dd7d316c`::moving from state init -> state preparing >Thread-70::INFO::2014-07-10 09:49:42,319::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='cfaeead2-7caa-467c-b389-c89840ae6605', volUUID='567fe32d-31a6-4ff6-90f3-fd6a656fbecc', options=None) >Thread-70::INFO::2014-07-10 09:49:42,319::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-70::DEBUG::2014-07-10 09:49:42,319::task::1185::TaskManager.Task::(prepare) Task=`07e9ec21-beb0-4bb7-b2a4-8c12dd7d316c`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-70::DEBUG::2014-07-10 09:49:42,320::task::595::TaskManager.Task::(_updateState) Task=`07e9ec21-beb0-4bb7-b2a4-8c12dd7d316c`::moving from state preparing -> state finished >Thread-70::DEBUG::2014-07-10 09:49:42,320::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-70::DEBUG::2014-07-10 09:49:42,320::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-70::DEBUG::2014-07-10 09:49:42,320::task::990::TaskManager.Task::(_decref) Task=`07e9ec21-beb0-4bb7-b2a4-8c12dd7d316c`::ref 0 aborting False >Thread-18::DEBUG::2014-07-10 09:49:42,478::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/metadata bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-10 09:49:42,500::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000651234 s, 6.3 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 09:49:42,906::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-14::DEBUG::2014-07-10 09:49:42,907::task::595::TaskManager.Task::(_updateState) Task=`92798cee-6388-47bc-932d-9d70401730b3`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 09:49:42,908::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-14::INFO::2014-07-10 09:49:42,908::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:49:42,908::task::1185::TaskManager.Task::(prepare) Task=`92798cee-6388-47bc-932d-9d70401730b3`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:49:42,909::task::595::TaskManager.Task::(_updateState) Task=`92798cee-6388-47bc-932d-9d70401730b3`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 09:49:42,909::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 09:49:42,909::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 09:49:42,909::task::990::TaskManager.Task::(_decref) Task=`92798cee-6388-47bc-932d-9d70401730b3`::ref 0 aborting False >Thread-34::DEBUG::2014-07-10 09:49:42,914::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-34::DEBUG::2014-07-10 09:49:42,914::task::595::TaskManager.Task::(_updateState) Task=`2c3f108c-09dd-41ee-ac4e-9a3d83ac90ea`::moving from state init -> state preparing >Thread-34::INFO::2014-07-10 09:49:42,914::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-34::DEBUG::2014-07-10 09:49:42,915::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`c8afcdcd-1826-4765-b3d6-15d3afabd10a`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-10 09:49:42,915::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' for lock type 'shared' >Thread-34::DEBUG::2014-07-10 09:49:42,916::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-10 09:49:42,916::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`c8afcdcd-1826-4765-b3d6-15d3afabd10a`::Granted request >Thread-34::DEBUG::2014-07-10 09:49:42,916::task::827::TaskManager.Task::(resourceAcquired) Task=`2c3f108c-09dd-41ee-ac4e-9a3d83ac90ea`::_resourcesAcquired: Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee (shared) >Thread-34::DEBUG::2014-07-10 09:49:42,917::task::990::TaskManager.Task::(_decref) Task=`2c3f108c-09dd-41ee-ac4e-9a3d83ac90ea`::ref 1 aborting False >Thread-34::INFO::2014-07-10 09:49:42,918::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '531975110656', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:49:42,918::task::1185::TaskManager.Task::(prepare) Task=`2c3f108c-09dd-41ee-ac4e-9a3d83ac90ea`::finished: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '531975110656', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:49:42,918::task::595::TaskManager.Task::(_updateState) Task=`2c3f108c-09dd-41ee-ac4e-9a3d83ac90ea`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-10 09:49:42,918::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee': < ResourceRef 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-10 09:49:42,918::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-10 09:49:42,919::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' >Thread-34::DEBUG::2014-07-10 09:49:42,919::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' (0 active users) >Thread-34::DEBUG::2014-07-10 09:49:42,919::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-10 09:49:42,919::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', Clearing records. >Thread-34::DEBUG::2014-07-10 09:49:42,920::task::990::TaskManager.Task::(_decref) Task=`2c3f108c-09dd-41ee-ac4e-9a3d83ac90ea`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 09:49:43,569::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:49:43,697::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0395455 s, 25.9 MB/s\n'; <rc> = 0 >Thread-51::DEBUG::2014-07-10 09:49:43,841::task::595::TaskManager.Task::(_updateState) Task=`75d946a7-4337-4942-b5d7-7b51feb79cf3`::moving from state init -> state preparing >Thread-60::DEBUG::2014-07-10 09:49:43,845::task::595::TaskManager.Task::(_updateState) Task=`09ced551-ec0e-4b68-bd24-d2b79484e432`::moving from state init -> state preparing >Thread-51::INFO::2014-07-10 09:49:43,845::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='76fdb054-02cd-42ed-9721-b3e65b34c3a4', volUUID='022dfe46-2cf7-4915-80b3-883158e3ca83', options=None) >Thread-60::INFO::2014-07-10 09:49:43,849::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='b034d5b0-e1e0-4011-b49b-4d45ddb11556', volUUID='3d7f62b5-328f-4d8e-8b69-873cfb5ae14d', options=None) >Thread-51::INFO::2014-07-10 09:49:43,850::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-51::DEBUG::2014-07-10 09:49:43,853::task::1185::TaskManager.Task::(prepare) Task=`75d946a7-4337-4942-b5d7-7b51feb79cf3`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-60::INFO::2014-07-10 09:49:43,853::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-51::DEBUG::2014-07-10 09:49:43,855::task::595::TaskManager.Task::(_updateState) Task=`75d946a7-4337-4942-b5d7-7b51feb79cf3`::moving from state preparing -> state finished >Thread-60::DEBUG::2014-07-10 09:49:43,856::task::1185::TaskManager.Task::(prepare) Task=`09ced551-ec0e-4b68-bd24-d2b79484e432`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-51::DEBUG::2014-07-10 09:49:43,858::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-60::DEBUG::2014-07-10 09:49:43,859::task::595::TaskManager.Task::(_updateState) Task=`09ced551-ec0e-4b68-bd24-d2b79484e432`::moving from state preparing -> state finished >Thread-51::DEBUG::2014-07-10 09:49:43,861::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-60::DEBUG::2014-07-10 09:49:43,862::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-60::DEBUG::2014-07-10 09:49:43,864::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-51::DEBUG::2014-07-10 09:49:43,864::task::990::TaskManager.Task::(_decref) Task=`75d946a7-4337-4942-b5d7-7b51feb79cf3`::ref 0 aborting False >Thread-60::DEBUG::2014-07-10 09:49:43,867::task::990::TaskManager.Task::(_decref) Task=`09ced551-ec0e-4b68-bd24-d2b79484e432`::ref 0 aborting False >Thread-14::DEBUG::2014-07-10 09:49:45,157::task::595::TaskManager.Task::(_updateState) Task=`ff9508d1-7d48-4c5d-9fcf-84dbec5f8fe1`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 09:49:45,157::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::INFO::2014-07-10 09:49:45,158::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000651234', 'lastCheck': '2.6', 'valid': True}, '6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000501968', 'lastCheck': '3.7', 'valid': True}} >Thread-14::DEBUG::2014-07-10 09:49:45,158::task::1185::TaskManager.Task::(prepare) Task=`ff9508d1-7d48-4c5d-9fcf-84dbec5f8fe1`::finished: {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000651234', 'lastCheck': '2.6', 'valid': True}, '6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000501968', 'lastCheck': '3.7', 'valid': True}} >Thread-14::DEBUG::2014-07-10 09:49:45,158::task::595::TaskManager.Task::(_updateState) Task=`ff9508d1-7d48-4c5d-9fcf-84dbec5f8fe1`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 09:49:45,158::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 09:49:45,158::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 09:49:45,158::task::990::TaskManager.Task::(_decref) Task=`ff9508d1-7d48-4c5d-9fcf-84dbec5f8fe1`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 09:49:45,712::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:49:45,874::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0276495 s, 37.0 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:49:47,890::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:49:47,989::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0355842 s, 28.8 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:49:50,004::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:49:50,114::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0520696 s, 19.7 MB/s\n'; <rc> = 0 >Thread-40::DEBUG::2014-07-10 09:49:51,450::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lion.qa.lab.tlv.redhat.com:_export_yuri2_backup2/6a70504d-00df-4869-8695-0f442053f6b6/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-40::DEBUG::2014-07-10 09:49:51,472::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n369 bytes (369 B) copied, 0.000385751 s, 957 kB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:49:52,130::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:49:52,223::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0353252 s, 29.0 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-10 09:49:52,532::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/metadata bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-10 09:49:52,563::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00741926 s, 552 kB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 09:49:52,956::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [20826f36] >Thread-14::DEBUG::2014-07-10 09:49:52,958::task::595::TaskManager.Task::(_updateState) Task=`9685ab31-5c81-4e3a-bcf4-1b87d5d385d9`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 09:49:52,958::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-14::INFO::2014-07-10 09:49:52,959::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:49:52,959::task::1185::TaskManager.Task::(prepare) Task=`9685ab31-5c81-4e3a-bcf4-1b87d5d385d9`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:49:52,959::task::595::TaskManager.Task::(_updateState) Task=`9685ab31-5c81-4e3a-bcf4-1b87d5d385d9`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 09:49:52,959::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 09:49:52,960::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 09:49:52,960::task::990::TaskManager.Task::(_decref) Task=`9685ab31-5c81-4e3a-bcf4-1b87d5d385d9`::ref 0 aborting False >Thread-34::DEBUG::2014-07-10 09:49:52,964::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] flowID [20826f36] >Thread-34::DEBUG::2014-07-10 09:49:52,965::task::595::TaskManager.Task::(_updateState) Task=`d1ae08ed-594f-42cd-87b8-cf2518f35796`::moving from state init -> state preparing >Thread-34::INFO::2014-07-10 09:49:52,965::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-34::DEBUG::2014-07-10 09:49:52,966::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`9d7ce794-70d1-432c-b388-a17e47b82a61`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-10 09:49:52,966::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' for lock type 'shared' >Thread-34::DEBUG::2014-07-10 09:49:52,967::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-10 09:49:52,967::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`9d7ce794-70d1-432c-b388-a17e47b82a61`::Granted request >Thread-34::DEBUG::2014-07-10 09:49:52,968::task::827::TaskManager.Task::(resourceAcquired) Task=`d1ae08ed-594f-42cd-87b8-cf2518f35796`::_resourcesAcquired: Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee (shared) >Thread-34::DEBUG::2014-07-10 09:49:52,968::task::990::TaskManager.Task::(_decref) Task=`d1ae08ed-594f-42cd-87b8-cf2518f35796`::ref 1 aborting False >Thread-34::INFO::2014-07-10 09:49:52,969::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '531975110656', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:49:52,969::task::1185::TaskManager.Task::(prepare) Task=`d1ae08ed-594f-42cd-87b8-cf2518f35796`::finished: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '531975110656', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:49:52,970::task::595::TaskManager.Task::(_updateState) Task=`d1ae08ed-594f-42cd-87b8-cf2518f35796`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-10 09:49:52,970::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee': < ResourceRef 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-10 09:49:52,970::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-10 09:49:52,970::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' >Thread-34::DEBUG::2014-07-10 09:49:52,971::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' (0 active users) >Thread-34::DEBUG::2014-07-10 09:49:52,971::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-10 09:49:52,971::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', Clearing records. >Thread-34::DEBUG::2014-07-10 09:49:52,971::task::990::TaskManager.Task::(_decref) Task=`d1ae08ed-594f-42cd-87b8-cf2518f35796`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 09:49:54,239::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:49:54,325::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0293754 s, 34.9 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:49:56,353::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:49:56,458::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0368008 s, 27.8 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:49:58,474::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:49:58,600::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0483969 s, 21.2 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 09:50:00,363::task::595::TaskManager.Task::(_updateState) Task=`b443efea-02d8-4771-94a0-d354aaf11267`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 09:50:00,364::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::INFO::2014-07-10 09:50:00,364::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00741926', 'lastCheck': '7.8', 'valid': True}, '6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000385751', 'lastCheck': '8.9', 'valid': True}} >Thread-14::DEBUG::2014-07-10 09:50:00,364::task::1185::TaskManager.Task::(prepare) Task=`b443efea-02d8-4771-94a0-d354aaf11267`::finished: {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00741926', 'lastCheck': '7.8', 'valid': True}, '6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000385751', 'lastCheck': '8.9', 'valid': True}} >Thread-14::DEBUG::2014-07-10 09:50:00,364::task::595::TaskManager.Task::(_updateState) Task=`b443efea-02d8-4771-94a0-d354aaf11267`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 09:50:00,365::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 09:50:00,365::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 09:50:00,365::task::990::TaskManager.Task::(_decref) Task=`b443efea-02d8-4771-94a0-d354aaf11267`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 09:50:00,616::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:50:00,702::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0277582 s, 36.9 MB/s\n'; <rc> = 0 >Thread-40::DEBUG::2014-07-10 09:50:01,550::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lion.qa.lab.tlv.redhat.com:_export_yuri2_backup2/6a70504d-00df-4869-8695-0f442053f6b6/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-40::DEBUG::2014-07-10 09:50:01,578::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n369 bytes (369 B) copied, 0.000399508 s, 924 kB/s\n'; <rc> = 0 >Thread-64::DEBUG::2014-07-10 09:50:02,399::task::595::TaskManager.Task::(_updateState) Task=`c095ca4c-676e-4a2f-b19a-cc5733fc8370`::moving from state init -> state preparing >Thread-64::INFO::2014-07-10 09:50:02,400::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='aa20346a-4d3a-4e07-b8e1-52c0ebe4168c', volUUID='58fefce2-9bce-4bff-8949-8c6ce8122b27', options=None) >Thread-64::INFO::2014-07-10 09:50:02,400::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-64::DEBUG::2014-07-10 09:50:02,401::task::1185::TaskManager.Task::(prepare) Task=`c095ca4c-676e-4a2f-b19a-cc5733fc8370`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-64::DEBUG::2014-07-10 09:50:02,401::task::595::TaskManager.Task::(_updateState) Task=`c095ca4c-676e-4a2f-b19a-cc5733fc8370`::moving from state preparing -> state finished >Thread-64::DEBUG::2014-07-10 09:50:02,401::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-64::DEBUG::2014-07-10 09:50:02,401::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-64::DEBUG::2014-07-10 09:50:02,401::task::990::TaskManager.Task::(_decref) Task=`c095ca4c-676e-4a2f-b19a-cc5733fc8370`::ref 0 aborting False >Thread-18::DEBUG::2014-07-10 09:50:02,593::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/metadata bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-10 09:50:02,614::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000763671 s, 5.4 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:50:02,717::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:50:02,827::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.033772 s, 30.3 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 09:50:03,006::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-14::DEBUG::2014-07-10 09:50:03,007::task::595::TaskManager.Task::(_updateState) Task=`73145d02-7a73-4508-a5f5-5a0a63032e4e`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 09:50:03,007::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-14::INFO::2014-07-10 09:50:03,008::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:50:03,008::task::1185::TaskManager.Task::(prepare) Task=`73145d02-7a73-4508-a5f5-5a0a63032e4e`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:50:03,008::task::595::TaskManager.Task::(_updateState) Task=`73145d02-7a73-4508-a5f5-5a0a63032e4e`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 09:50:03,008::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 09:50:03,009::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 09:50:03,009::task::990::TaskManager.Task::(_decref) Task=`73145d02-7a73-4508-a5f5-5a0a63032e4e`::ref 0 aborting False >Thread-34::DEBUG::2014-07-10 09:50:03,052::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-34::DEBUG::2014-07-10 09:50:03,052::task::595::TaskManager.Task::(_updateState) Task=`7532db37-0bec-4444-b3c9-bdc4e8c6f1bc`::moving from state init -> state preparing >Thread-34::INFO::2014-07-10 09:50:03,053::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-34::DEBUG::2014-07-10 09:50:03,053::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`6caca690-9b06-458f-adec-1c4cd5a27d52`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-10 09:50:03,054::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' for lock type 'shared' >Thread-34::DEBUG::2014-07-10 09:50:03,054::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-10 09:50:03,054::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`6caca690-9b06-458f-adec-1c4cd5a27d52`::Granted request >Thread-34::DEBUG::2014-07-10 09:50:03,055::task::827::TaskManager.Task::(resourceAcquired) Task=`7532db37-0bec-4444-b3c9-bdc4e8c6f1bc`::_resourcesAcquired: Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee (shared) >Thread-34::DEBUG::2014-07-10 09:50:03,055::task::990::TaskManager.Task::(_decref) Task=`7532db37-0bec-4444-b3c9-bdc4e8c6f1bc`::ref 1 aborting False >Thread-34::INFO::2014-07-10 09:50:03,056::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '531975110656', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:50:03,056::task::1185::TaskManager.Task::(prepare) Task=`7532db37-0bec-4444-b3c9-bdc4e8c6f1bc`::finished: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '531975110656', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:50:03,057::task::595::TaskManager.Task::(_updateState) Task=`7532db37-0bec-4444-b3c9-bdc4e8c6f1bc`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-10 09:50:03,057::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee': < ResourceRef 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-10 09:50:03,057::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-10 09:50:03,057::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' >Thread-34::DEBUG::2014-07-10 09:50:03,058::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' (0 active users) >Thread-34::DEBUG::2014-07-10 09:50:03,058::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-10 09:50:03,058::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', Clearing records. >Thread-34::DEBUG::2014-07-10 09:50:03,058::task::990::TaskManager.Task::(_decref) Task=`7532db37-0bec-4444-b3c9-bdc4e8c6f1bc`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 09:50:04,845::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:50:04,959::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0356618 s, 28.7 MB/s\n'; <rc> = 0 >Thread-54::DEBUG::2014-07-10 09:50:05,529::task::595::TaskManager.Task::(_updateState) Task=`34c74467-0e22-49e5-824b-8d2869cbcc45`::moving from state init -> state preparing >Thread-54::INFO::2014-07-10 09:50:05,530::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='28408446-e5fd-4565-a976-e760951593fe', volUUID='776303a2-5585-451e-826e-0e338d4a1e98', options=None) >Thread-54::INFO::2014-07-10 09:50:05,530::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-54::DEBUG::2014-07-10 09:50:05,531::task::1185::TaskManager.Task::(prepare) Task=`34c74467-0e22-49e5-824b-8d2869cbcc45`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-54::DEBUG::2014-07-10 09:50:05,531::task::595::TaskManager.Task::(_updateState) Task=`34c74467-0e22-49e5-824b-8d2869cbcc45`::moving from state preparing -> state finished >Thread-54::DEBUG::2014-07-10 09:50:05,531::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-54::DEBUG::2014-07-10 09:50:05,531::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-54::DEBUG::2014-07-10 09:50:05,532::task::990::TaskManager.Task::(_decref) Task=`34c74467-0e22-49e5-824b-8d2869cbcc45`::ref 0 aborting False >Thread-73::DEBUG::2014-07-10 09:50:05,552::task::595::TaskManager.Task::(_updateState) Task=`cfe49607-c354-4bcf-8cb5-d94fa550a247`::moving from state init -> state preparing >Thread-73::INFO::2014-07-10 09:50:05,552::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='c01d693b-cba0-4fed-9ad7-0aaa28912a19', volUUID='4bb5d954-2a50-4028-b299-0b43c261270c', options=None) >Thread-73::INFO::2014-07-10 09:50:05,553::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-73::DEBUG::2014-07-10 09:50:05,553::task::1185::TaskManager.Task::(prepare) Task=`cfe49607-c354-4bcf-8cb5-d94fa550a247`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-73::DEBUG::2014-07-10 09:50:05,553::task::595::TaskManager.Task::(_updateState) Task=`cfe49607-c354-4bcf-8cb5-d94fa550a247`::moving from state preparing -> state finished >Thread-73::DEBUG::2014-07-10 09:50:05,553::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-73::DEBUG::2014-07-10 09:50:05,553::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-73::DEBUG::2014-07-10 09:50:05,553::task::990::TaskManager.Task::(_decref) Task=`cfe49607-c354-4bcf-8cb5-d94fa550a247`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 09:50:06,974::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:50:07,184::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.152282 s, 6.7 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:50:09,199::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:50:09,282::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0248746 s, 41.2 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:50:11,297::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:50:11,392::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0333874 s, 30.7 MB/s\n'; <rc> = 0 >Thread-40::DEBUG::2014-07-10 09:50:11,608::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lion.qa.lab.tlv.redhat.com:_export_yuri2_backup2/6a70504d-00df-4869-8695-0f442053f6b6/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-40::DEBUG::2014-07-10 09:50:11,629::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n369 bytes (369 B) copied, 0.000450125 s, 820 kB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-10 09:50:12,649::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/metadata bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-10 09:50:12,677::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00827976 s, 495 kB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 09:50:13,090::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-14::DEBUG::2014-07-10 09:50:13,094::task::595::TaskManager.Task::(_updateState) Task=`041da067-36b2-4679-afcc-bd0c96c7eed3`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 09:50:13,096::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-14::INFO::2014-07-10 09:50:13,097::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:50:13,099::task::1185::TaskManager.Task::(prepare) Task=`041da067-36b2-4679-afcc-bd0c96c7eed3`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:50:13,100::task::595::TaskManager.Task::(_updateState) Task=`041da067-36b2-4679-afcc-bd0c96c7eed3`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 09:50:13,100::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 09:50:13,100::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 09:50:13,100::task::990::TaskManager.Task::(_decref) Task=`041da067-36b2-4679-afcc-bd0c96c7eed3`::ref 0 aborting False >Thread-34::DEBUG::2014-07-10 09:50:13,104::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-34::DEBUG::2014-07-10 09:50:13,105::task::595::TaskManager.Task::(_updateState) Task=`1e09b139-17af-4b36-84e5-08129d0da48a`::moving from state init -> state preparing >Thread-34::INFO::2014-07-10 09:50:13,105::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-34::DEBUG::2014-07-10 09:50:13,106::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`c53ecf6d-860d-4958-a4c2-bbc0c4eb10c5`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-10 09:50:13,106::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' for lock type 'shared' >Thread-34::DEBUG::2014-07-10 09:50:13,106::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-10 09:50:13,107::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`c53ecf6d-860d-4958-a4c2-bbc0c4eb10c5`::Granted request >Thread-34::DEBUG::2014-07-10 09:50:13,107::task::827::TaskManager.Task::(resourceAcquired) Task=`1e09b139-17af-4b36-84e5-08129d0da48a`::_resourcesAcquired: Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee (shared) >Thread-34::DEBUG::2014-07-10 09:50:13,107::task::990::TaskManager.Task::(_decref) Task=`1e09b139-17af-4b36-84e5-08129d0da48a`::ref 1 aborting False >Thread-34::INFO::2014-07-10 09:50:13,108::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '531975110656', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:50:13,108::task::1185::TaskManager.Task::(prepare) Task=`1e09b139-17af-4b36-84e5-08129d0da48a`::finished: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '531975110656', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:50:13,109::task::595::TaskManager.Task::(_updateState) Task=`1e09b139-17af-4b36-84e5-08129d0da48a`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-10 09:50:13,109::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee': < ResourceRef 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-10 09:50:13,109::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-10 09:50:13,109::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' >Thread-34::DEBUG::2014-07-10 09:50:13,110::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' (0 active users) >Thread-34::DEBUG::2014-07-10 09:50:13,110::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-10 09:50:13,110::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', Clearing records. >Thread-34::DEBUG::2014-07-10 09:50:13,110::task::990::TaskManager.Task::(_decref) Task=`1e09b139-17af-4b36-84e5-08129d0da48a`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 09:50:13,406::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:50:13,550::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0315038 s, 32.5 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 09:50:15,537::task::595::TaskManager.Task::(_updateState) Task=`0911cb22-5d31-470b-8e7a-aa07a5e2ea84`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 09:50:15,537::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::INFO::2014-07-10 09:50:15,538::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00827976', 'lastCheck': '2.8', 'valid': True}, '6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000450125', 'lastCheck': '3.9', 'valid': True}} >Thread-14::DEBUG::2014-07-10 09:50:15,538::task::1185::TaskManager.Task::(prepare) Task=`0911cb22-5d31-470b-8e7a-aa07a5e2ea84`::finished: {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00827976', 'lastCheck': '2.8', 'valid': True}, '6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000450125', 'lastCheck': '3.9', 'valid': True}} >Thread-14::DEBUG::2014-07-10 09:50:15,538::task::595::TaskManager.Task::(_updateState) Task=`0911cb22-5d31-470b-8e7a-aa07a5e2ea84`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 09:50:15,538::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 09:50:15,538::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 09:50:15,539::task::990::TaskManager.Task::(_decref) Task=`0911cb22-5d31-470b-8e7a-aa07a5e2ea84`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 09:50:15,567::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:50:15,654::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0257255 s, 39.8 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:50:17,669::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:50:17,756::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0363782 s, 28.1 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:50:19,766::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:50:19,868::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0402251 s, 25.5 MB/s\n'; <rc> = 0 >Thread-40::DEBUG::2014-07-10 09:50:21,656::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lion.qa.lab.tlv.redhat.com:_export_yuri2_backup2/6a70504d-00df-4869-8695-0f442053f6b6/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-40::DEBUG::2014-07-10 09:50:21,676::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n369 bytes (369 B) copied, 0.000466762 s, 791 kB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:50:21,883::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:50:22,002::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0610588 s, 16.8 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-10 09:50:22,706::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/metadata bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-10 09:50:22,736::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00613891 s, 667 kB/s\n'; <rc> = 0 >Thread-57::DEBUG::2014-07-10 09:50:22,822::task::595::TaskManager.Task::(_updateState) Task=`c8d0e37f-f562-413b-ad1c-55d988fb268f`::moving from state init -> state preparing >Thread-57::INFO::2014-07-10 09:50:22,823::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='b6f6c0da-e67f-4902-b9ac-3069571a42fe', volUUID='c4cd1da8-05b7-45e0-80b1-1183d21443d9', options=None) >Thread-57::INFO::2014-07-10 09:50:22,823::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-57::DEBUG::2014-07-10 09:50:22,824::task::1185::TaskManager.Task::(prepare) Task=`c8d0e37f-f562-413b-ad1c-55d988fb268f`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-57::DEBUG::2014-07-10 09:50:22,824::task::595::TaskManager.Task::(_updateState) Task=`c8d0e37f-f562-413b-ad1c-55d988fb268f`::moving from state preparing -> state finished >Thread-57::DEBUG::2014-07-10 09:50:22,824::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-57::DEBUG::2014-07-10 09:50:22,824::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-57::DEBUG::2014-07-10 09:50:22,824::task::990::TaskManager.Task::(_decref) Task=`c8d0e37f-f562-413b-ad1c-55d988fb268f`::ref 0 aborting False >Thread-14::DEBUG::2014-07-10 09:50:23,139::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-14::DEBUG::2014-07-10 09:50:23,140::task::595::TaskManager.Task::(_updateState) Task=`d6b4d8ec-4365-4f40-95c2-16c973c34c33`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 09:50:23,141::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-14::INFO::2014-07-10 09:50:23,141::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:50:23,142::task::1185::TaskManager.Task::(prepare) Task=`d6b4d8ec-4365-4f40-95c2-16c973c34c33`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:50:23,143::task::595::TaskManager.Task::(_updateState) Task=`d6b4d8ec-4365-4f40-95c2-16c973c34c33`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 09:50:23,145::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 09:50:23,146::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 09:50:23,147::task::990::TaskManager.Task::(_decref) Task=`d6b4d8ec-4365-4f40-95c2-16c973c34c33`::ref 0 aborting False >Thread-34::DEBUG::2014-07-10 09:50:23,153::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-34::DEBUG::2014-07-10 09:50:23,153::task::595::TaskManager.Task::(_updateState) Task=`5e1d03fc-b320-4432-9a8d-9c40cb20ee2a`::moving from state init -> state preparing >Thread-34::INFO::2014-07-10 09:50:23,154::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-34::DEBUG::2014-07-10 09:50:23,154::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`e535ac49-9372-462f-99f9-49708bb30331`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-10 09:50:23,155::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' for lock type 'shared' >Thread-34::DEBUG::2014-07-10 09:50:23,155::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-10 09:50:23,155::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`e535ac49-9372-462f-99f9-49708bb30331`::Granted request >Thread-34::DEBUG::2014-07-10 09:50:23,156::task::827::TaskManager.Task::(resourceAcquired) Task=`5e1d03fc-b320-4432-9a8d-9c40cb20ee2a`::_resourcesAcquired: Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee (shared) >Thread-34::DEBUG::2014-07-10 09:50:23,156::task::990::TaskManager.Task::(_decref) Task=`5e1d03fc-b320-4432-9a8d-9c40cb20ee2a`::ref 1 aborting False >Thread-34::INFO::2014-07-10 09:50:23,157::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '531975110656', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:50:23,157::task::1185::TaskManager.Task::(prepare) Task=`5e1d03fc-b320-4432-9a8d-9c40cb20ee2a`::finished: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '531975110656', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:50:23,158::task::595::TaskManager.Task::(_updateState) Task=`5e1d03fc-b320-4432-9a8d-9c40cb20ee2a`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-10 09:50:23,158::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee': < ResourceRef 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-10 09:50:23,158::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-10 09:50:23,158::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' >Thread-34::DEBUG::2014-07-10 09:50:23,158::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' (0 active users) >Thread-34::DEBUG::2014-07-10 09:50:23,159::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-10 09:50:23,159::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', Clearing records. >Thread-34::DEBUG::2014-07-10 09:50:23,159::task::990::TaskManager.Task::(_decref) Task=`5e1d03fc-b320-4432-9a8d-9c40cb20ee2a`::ref 0 aborting False >Thread-67::DEBUG::2014-07-10 09:50:23,605::task::595::TaskManager.Task::(_updateState) Task=`27a7dfe3-9a44-481c-8ef3-1254232b40e1`::moving from state init -> state preparing >Thread-67::INFO::2014-07-10 09:50:23,606::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='f30c2cb7-a43a-4bf5-82b5-cfe07336f65c', volUUID='b0fbb3c9-55af-4a3a-95ad-fc56a80b9cf5', options=None) >Thread-67::INFO::2014-07-10 09:50:23,606::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-67::DEBUG::2014-07-10 09:50:23,606::task::1185::TaskManager.Task::(prepare) Task=`27a7dfe3-9a44-481c-8ef3-1254232b40e1`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-67::DEBUG::2014-07-10 09:50:23,606::task::595::TaskManager.Task::(_updateState) Task=`27a7dfe3-9a44-481c-8ef3-1254232b40e1`::moving from state preparing -> state finished >Thread-67::DEBUG::2014-07-10 09:50:23,607::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-67::DEBUG::2014-07-10 09:50:23,607::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-67::DEBUG::2014-07-10 09:50:23,607::task::990::TaskManager.Task::(_decref) Task=`27a7dfe3-9a44-481c-8ef3-1254232b40e1`::ref 0 aborting False >Thread-48::DEBUG::2014-07-10 09:50:23,801::task::595::TaskManager.Task::(_updateState) Task=`85c982e4-579e-4246-88f9-3a7e9900f499`::moving from state init -> state preparing >Thread-48::INFO::2014-07-10 09:50:23,802::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='0cd7d6ce-f497-4243-a690-c57744861eea', volUUID='10b6a7dd-dc6c-43fa-ba17-92e4331b0e0b', options=None) >Thread-48::INFO::2014-07-10 09:50:23,802::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-48::DEBUG::2014-07-10 09:50:23,802::task::1185::TaskManager.Task::(prepare) Task=`85c982e4-579e-4246-88f9-3a7e9900f499`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-48::DEBUG::2014-07-10 09:50:23,802::task::595::TaskManager.Task::(_updateState) Task=`85c982e4-579e-4246-88f9-3a7e9900f499`::moving from state preparing -> state finished >Thread-48::DEBUG::2014-07-10 09:50:23,802::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-48::DEBUG::2014-07-10 09:50:23,802::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-48::DEBUG::2014-07-10 09:50:23,803::task::990::TaskManager.Task::(_decref) Task=`85c982e4-579e-4246-88f9-3a7e9900f499`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 09:50:24,017::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:50:24,130::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0455686 s, 22.5 MB/s\n'; <rc> = 0 >Thread-76::DEBUG::2014-07-10 09:50:25,521::task::595::TaskManager.Task::(_updateState) Task=`695e4e15-3492-4f0d-afc9-e36c28d87fec`::moving from state init -> state preparing >Thread-76::INFO::2014-07-10 09:50:25,522::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='e4c65229-4247-4b33-b72a-f1d5ce72ad05', volUUID='cad94284-3ca9-4c30-933d-997f4460309e', options=None) >Thread-76::INFO::2014-07-10 09:50:25,522::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-76::DEBUG::2014-07-10 09:50:25,522::task::1185::TaskManager.Task::(prepare) Task=`695e4e15-3492-4f0d-afc9-e36c28d87fec`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-76::DEBUG::2014-07-10 09:50:25,523::task::595::TaskManager.Task::(_updateState) Task=`695e4e15-3492-4f0d-afc9-e36c28d87fec`::moving from state preparing -> state finished >Thread-76::DEBUG::2014-07-10 09:50:25,523::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-76::DEBUG::2014-07-10 09:50:25,523::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-76::DEBUG::2014-07-10 09:50:25,523::task::990::TaskManager.Task::(_decref) Task=`695e4e15-3492-4f0d-afc9-e36c28d87fec`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 09:50:26,145::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:50:26,239::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0359591 s, 28.5 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:50:28,255::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:50:28,408::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0774855 s, 13.2 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:50:30,423::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:50:30,511::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0286154 s, 35.8 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 09:50:30,724::task::595::TaskManager.Task::(_updateState) Task=`6994b61c-b8e1-4820-a985-8febdbf230b4`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 09:50:30,725::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::INFO::2014-07-10 09:50:30,725::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00613891', 'lastCheck': '8.0', 'valid': True}, '6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000466762', 'lastCheck': '9.0', 'valid': True}} >Thread-14::DEBUG::2014-07-10 09:50:30,725::task::1185::TaskManager.Task::(prepare) Task=`6994b61c-b8e1-4820-a985-8febdbf230b4`::finished: {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00613891', 'lastCheck': '8.0', 'valid': True}, '6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000466762', 'lastCheck': '9.0', 'valid': True}} >Thread-14::DEBUG::2014-07-10 09:50:30,726::task::595::TaskManager.Task::(_updateState) Task=`6994b61c-b8e1-4820-a985-8febdbf230b4`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 09:50:30,726::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 09:50:30,726::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 09:50:30,726::task::990::TaskManager.Task::(_decref) Task=`6994b61c-b8e1-4820-a985-8febdbf230b4`::ref 0 aborting False >Thread-40::DEBUG::2014-07-10 09:50:31,711::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lion.qa.lab.tlv.redhat.com:_export_yuri2_backup2/6a70504d-00df-4869-8695-0f442053f6b6/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-40::DEBUG::2014-07-10 09:50:31,731::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n369 bytes (369 B) copied, 0.00046085 s, 801 kB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:50:32,527::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:50:32,627::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0413833 s, 24.7 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-10 09:50:32,765::domainMonitor::192::Storage.DomainMonitorThread::(_monitorDomain) Refreshing domain 9e1aa540-1f4e-4ee3-a152-be381ef6c3bd >Thread-18::DEBUG::2014-07-10 09:50:32,766::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with LvMetadataRW backend >Thread-18::DEBUG::2014-07-10 09:50:32,766::blockSD::336::Storage.Misc.excCmd::(readlines) '/bin/dd iflag=direct skip=0 bs=2048 if=/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/metadata count=1' (cwd None) >Thread-18::DEBUG::2014-07-10 09:50:32,786::blockSD::336::Storage.Misc.excCmd::(readlines) SUCCESS: <err> = '1+0 records in\n1+0 records out\n2048 bytes (2.0 kB) copied, 0.000763127 s, 2.7 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-10 09:50:32,787::misc::282::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '2048 bytes (2.0 kB) copied, 0.000763127 s, 2.7 MB/s'], size: 2048 >Thread-18::DEBUG::2014-07-10 09:50:32,787::persistentDict::234::Storage.PersistentDict::(refresh) read lines (LvMetadataRW)=[] >Thread-18::WARNING::2014-07-10 09:50:32,787::persistentDict::256::Storage.PersistentDict::(refresh) data has no embedded checksum - trust it as it is >Thread-18::DEBUG::2014-07-10 09:50:32,787::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with VGTagMetadataRW backend >Thread-18::DEBUG::2014-07-10 09:50:32,788::lvm::503::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-18::DEBUG::2014-07-10 09:50:32,788::lvm::505::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-18::DEBUG::2014-07-10 09:50:32,788::lvm::513::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-18::DEBUG::2014-07-10 09:50:32,789::lvm::525::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-18::DEBUG::2014-07-10 09:50:32,789::lvm::373::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-18::DEBUG::2014-07-10 09:50:32,790::lvm::296::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/3600601601282300032826addbbdae311|/dev/mapper/360060160f4a030003840ec867ddee311|/dev/mapper/367cad74c2fcba00019e6afd20c781e67|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name 9e1aa540-1f4e-4ee3-a152-be381ef6c3bd' (cwd None) >Thread-18::DEBUG::2014-07-10 09:50:33,132::lvm::296::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-18::DEBUG::2014-07-10 09:50:33,138::lvm::415::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-18::DEBUG::2014-07-10 09:50:33,143::persistentDict::234::Storage.PersistentDict::(refresh) read lines (VGTagMetadataRW)=['LEASETIMESEC=60', 'VGUUID=9CsMxb-YbRc-yRG7-cQKD-xY3G-GLi5-YxUyPC', 'VERSION=3', 'TYPE=ISCSI', 'LOGBLKSIZE=512', u'PV0=pv:3600601601282300032826addbbdae311,uuid:7qEb8v-jk2X-3CPk-k4XB-eIBk-onYD-807hcV,pestart:0,pecount:8189,mapoffset:0', 'LEASERETRIES=3', 'IOOPTIMEOUTSEC=10', 'LOCKRENEWALINTERVALSEC=5', 'PHYBLKSIZE=512', 'SDUUID=9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'CLASS=Data', 'LOCKPOLICY=', 'DESCRIPTION=SD_REAL', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=DC_REAL', 'ROLE=Master', 'POOL_UUID=4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', 'POOL_SPM_ID=1', 'POOL_SPM_LVER=0', '_SHA_CKSUM=013b5a7910962201c4cceab31b9c6d9c79f7316f', u'POOL_DOMAINS=9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active'] >Thread-18::INFO::2014-07-10 09:50:33,151::sd::384::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 9e1aa540-1f4e-4ee3-a152-be381ef6c3bd_imageNS already registered >Thread-18::INFO::2014-07-10 09:50:33,152::sd::392::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 9e1aa540-1f4e-4ee3-a152-be381ef6c3bd_volumeNS already registered >Thread-18::INFO::2014-07-10 09:50:33,152::blockSD::452::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 9e1aa540-1f4e-4ee3-a152-be381ef6c3bd_lvmActivationNS already registered >Thread-18::DEBUG::2014-07-10 09:50:33,153::lvm::296::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgck --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/3600601601282300032826addbbdae311|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } " 9e1aa540-1f4e-4ee3-a152-be381ef6c3bd' (cwd None) >Thread-14::DEBUG::2014-07-10 09:50:33,200::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-14::DEBUG::2014-07-10 09:50:33,201::task::595::TaskManager.Task::(_updateState) Task=`c2e7489e-fa24-4d06-ad54-c148edfe9cdd`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 09:50:33,202::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-14::INFO::2014-07-10 09:50:33,202::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:50:33,203::task::1185::TaskManager.Task::(prepare) Task=`c2e7489e-fa24-4d06-ad54-c148edfe9cdd`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:50:33,203::task::595::TaskManager.Task::(_updateState) Task=`c2e7489e-fa24-4d06-ad54-c148edfe9cdd`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 09:50:33,203::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 09:50:33,203::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 09:50:33,203::task::990::TaskManager.Task::(_decref) Task=`c2e7489e-fa24-4d06-ad54-c148edfe9cdd`::ref 0 aborting False >Thread-34::DEBUG::2014-07-10 09:50:33,247::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-34::DEBUG::2014-07-10 09:50:33,248::task::595::TaskManager.Task::(_updateState) Task=`4fc06ff5-98ef-4100-bd30-91b103d0c816`::moving from state init -> state preparing >Thread-34::INFO::2014-07-10 09:50:33,249::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-34::DEBUG::2014-07-10 09:50:33,250::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`7aaca97f-f840-4729-8588-e76791c89d15`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-10 09:50:33,250::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' for lock type 'shared' >Thread-34::DEBUG::2014-07-10 09:50:33,250::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-10 09:50:33,251::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`7aaca97f-f840-4729-8588-e76791c89d15`::Granted request >Thread-34::DEBUG::2014-07-10 09:50:33,251::task::827::TaskManager.Task::(resourceAcquired) Task=`4fc06ff5-98ef-4100-bd30-91b103d0c816`::_resourcesAcquired: Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee (shared) >Thread-34::DEBUG::2014-07-10 09:50:33,251::task::990::TaskManager.Task::(_decref) Task=`4fc06ff5-98ef-4100-bd30-91b103d0c816`::ref 1 aborting False >Thread-34::INFO::2014-07-10 09:50:33,253::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '531975110656', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:50:33,253::task::1185::TaskManager.Task::(prepare) Task=`4fc06ff5-98ef-4100-bd30-91b103d0c816`::finished: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '531975110656', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:50:33,253::task::595::TaskManager.Task::(_updateState) Task=`4fc06ff5-98ef-4100-bd30-91b103d0c816`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-10 09:50:33,253::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee': < ResourceRef 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-10 09:50:33,253::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-10 09:50:33,254::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' >Thread-34::DEBUG::2014-07-10 09:50:33,254::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' (0 active users) >Thread-34::DEBUG::2014-07-10 09:50:33,254::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-10 09:50:33,254::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', Clearing records. >Thread-34::DEBUG::2014-07-10 09:50:33,255::task::990::TaskManager.Task::(_decref) Task=`4fc06ff5-98ef-4100-bd30-91b103d0c816`::ref 0 aborting False >Thread-18::DEBUG::2014-07-10 09:50:33,376::lvm::296::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-18::DEBUG::2014-07-10 09:50:33,377::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/metadata bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-10 09:50:33,398::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000753822 s, 5.4 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:50:34,642::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:50:34,737::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0354273 s, 28.9 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:50:36,752::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:50:36,840::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0292467 s, 35.0 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:50:38,856::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:50:38,997::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0546568 s, 18.7 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:50:41,023::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:50:41,143::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0560861 s, 18.3 MB/s\n'; <rc> = 0 >Thread-40::DEBUG::2014-07-10 09:50:41,763::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lion.qa.lab.tlv.redhat.com:_export_yuri2_backup2/6a70504d-00df-4869-8695-0f442053f6b6/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-40::DEBUG::2014-07-10 09:50:41,783::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n369 bytes (369 B) copied, 0.000491499 s, 751 kB/s\n'; <rc> = 0 >Thread-70::DEBUG::2014-07-10 09:50:42,586::task::595::TaskManager.Task::(_updateState) Task=`38a5b89b-342b-4dba-95be-9d45a4f34632`::moving from state init -> state preparing >Thread-70::INFO::2014-07-10 09:50:42,587::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='cfaeead2-7caa-467c-b389-c89840ae6605', volUUID='567fe32d-31a6-4ff6-90f3-fd6a656fbecc', options=None) >Thread-70::INFO::2014-07-10 09:50:42,587::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-70::DEBUG::2014-07-10 09:50:42,588::task::1185::TaskManager.Task::(prepare) Task=`38a5b89b-342b-4dba-95be-9d45a4f34632`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-70::DEBUG::2014-07-10 09:50:42,588::task::595::TaskManager.Task::(_updateState) Task=`38a5b89b-342b-4dba-95be-9d45a4f34632`::moving from state preparing -> state finished >Thread-70::DEBUG::2014-07-10 09:50:42,588::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-70::DEBUG::2014-07-10 09:50:42,588::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-70::DEBUG::2014-07-10 09:50:42,588::task::990::TaskManager.Task::(_decref) Task=`38a5b89b-342b-4dba-95be-9d45a4f34632`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 09:50:43,158::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:50:43,279::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0681291 s, 15.0 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 09:50:43,284::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-14::DEBUG::2014-07-10 09:50:43,288::task::595::TaskManager.Task::(_updateState) Task=`02801ee3-c6b4-4993-81bb-d917c0981dc1`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 09:50:43,290::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-14::INFO::2014-07-10 09:50:43,294::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:50:43,295::task::1185::TaskManager.Task::(prepare) Task=`02801ee3-c6b4-4993-81bb-d917c0981dc1`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:50:43,296::task::595::TaskManager.Task::(_updateState) Task=`02801ee3-c6b4-4993-81bb-d917c0981dc1`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 09:50:43,298::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 09:50:43,300::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 09:50:43,302::task::990::TaskManager.Task::(_decref) Task=`02801ee3-c6b4-4993-81bb-d917c0981dc1`::ref 0 aborting False >Thread-34::DEBUG::2014-07-10 09:50:43,312::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-34::DEBUG::2014-07-10 09:50:43,315::task::595::TaskManager.Task::(_updateState) Task=`5fbde007-2b59-49f1-98fe-ada0c0136638`::moving from state init -> state preparing >Thread-34::INFO::2014-07-10 09:50:43,317::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-34::DEBUG::2014-07-10 09:50:43,320::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`bdb46610-0572-47ec-aa3f-481c0c2cd4a1`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-10 09:50:43,322::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' for lock type 'shared' >Thread-34::DEBUG::2014-07-10 09:50:43,324::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-10 09:50:43,325::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`bdb46610-0572-47ec-aa3f-481c0c2cd4a1`::Granted request >Thread-34::DEBUG::2014-07-10 09:50:43,329::task::827::TaskManager.Task::(resourceAcquired) Task=`5fbde007-2b59-49f1-98fe-ada0c0136638`::_resourcesAcquired: Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee (shared) >Thread-34::DEBUG::2014-07-10 09:50:43,331::task::990::TaskManager.Task::(_decref) Task=`5fbde007-2b59-49f1-98fe-ada0c0136638`::ref 1 aborting False >Thread-34::INFO::2014-07-10 09:50:43,340::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '531975110656', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:50:43,342::task::1185::TaskManager.Task::(prepare) Task=`5fbde007-2b59-49f1-98fe-ada0c0136638`::finished: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '531975110656', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:50:43,343::task::595::TaskManager.Task::(_updateState) Task=`5fbde007-2b59-49f1-98fe-ada0c0136638`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-10 09:50:43,345::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee': < ResourceRef 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-10 09:50:43,346::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-10 09:50:43,349::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' >Thread-34::DEBUG::2014-07-10 09:50:43,351::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' (0 active users) >Thread-34::DEBUG::2014-07-10 09:50:43,352::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-10 09:50:43,354::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', Clearing records. >Thread-34::DEBUG::2014-07-10 09:50:43,356::task::990::TaskManager.Task::(_decref) Task=`5fbde007-2b59-49f1-98fe-ada0c0136638`::ref 0 aborting False >Thread-18::DEBUG::2014-07-10 09:50:43,430::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/metadata bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-10 09:50:43,451::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000785142 s, 5.2 MB/s\n'; <rc> = 0 >Thread-51::DEBUG::2014-07-10 09:50:44,179::task::595::TaskManager.Task::(_updateState) Task=`f732bd15-e824-4996-8ee4-a4fc2791cd0c`::moving from state init -> state preparing >Thread-51::INFO::2014-07-10 09:50:44,180::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='76fdb054-02cd-42ed-9721-b3e65b34c3a4', volUUID='022dfe46-2cf7-4915-80b3-883158e3ca83', options=None) >Thread-51::INFO::2014-07-10 09:50:44,181::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-51::DEBUG::2014-07-10 09:50:44,181::task::1185::TaskManager.Task::(prepare) Task=`f732bd15-e824-4996-8ee4-a4fc2791cd0c`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-51::DEBUG::2014-07-10 09:50:44,182::task::595::TaskManager.Task::(_updateState) Task=`f732bd15-e824-4996-8ee4-a4fc2791cd0c`::moving from state preparing -> state finished >Thread-60::DEBUG::2014-07-10 09:50:44,183::task::595::TaskManager.Task::(_updateState) Task=`6924b4d4-37e6-44d3-ab5c-ae9a49121d4a`::moving from state init -> state preparing >Thread-51::DEBUG::2014-07-10 09:50:44,184::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-51::DEBUG::2014-07-10 09:50:44,185::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-60::INFO::2014-07-10 09:50:44,185::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='b034d5b0-e1e0-4011-b49b-4d45ddb11556', volUUID='3d7f62b5-328f-4d8e-8b69-873cfb5ae14d', options=None) >Thread-51::DEBUG::2014-07-10 09:50:44,186::task::990::TaskManager.Task::(_decref) Task=`f732bd15-e824-4996-8ee4-a4fc2791cd0c`::ref 0 aborting False >Thread-60::INFO::2014-07-10 09:50:44,187::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-60::DEBUG::2014-07-10 09:50:44,187::task::1185::TaskManager.Task::(prepare) Task=`6924b4d4-37e6-44d3-ab5c-ae9a49121d4a`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-60::DEBUG::2014-07-10 09:50:44,187::task::595::TaskManager.Task::(_updateState) Task=`6924b4d4-37e6-44d3-ab5c-ae9a49121d4a`::moving from state preparing -> state finished >Thread-60::DEBUG::2014-07-10 09:50:44,188::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-60::DEBUG::2014-07-10 09:50:44,188::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-60::DEBUG::2014-07-10 09:50:44,188::task::990::TaskManager.Task::(_decref) Task=`6924b4d4-37e6-44d3-ab5c-ae9a49121d4a`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 09:50:45,375::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:50:45,584::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.152194 s, 6.7 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 09:50:45,910::task::595::TaskManager.Task::(_updateState) Task=`a4d1276d-2068-4be9-80c5-26c101ad1f99`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 09:50:45,910::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::INFO::2014-07-10 09:50:45,910::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000785142', 'lastCheck': '2.4', 'valid': True}, '6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000491499', 'lastCheck': '4.1', 'valid': True}} >Thread-14::DEBUG::2014-07-10 09:50:45,911::task::1185::TaskManager.Task::(prepare) Task=`a4d1276d-2068-4be9-80c5-26c101ad1f99`::finished: {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000785142', 'lastCheck': '2.4', 'valid': True}, '6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000491499', 'lastCheck': '4.1', 'valid': True}} >Thread-14::DEBUG::2014-07-10 09:50:45,911::task::595::TaskManager.Task::(_updateState) Task=`a4d1276d-2068-4be9-80c5-26c101ad1f99`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 09:50:45,911::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 09:50:45,911::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 09:50:45,912::task::990::TaskManager.Task::(_decref) Task=`a4d1276d-2068-4be9-80c5-26c101ad1f99`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 09:50:47,610::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:50:47,705::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0352388 s, 29.1 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:50:49,720::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:50:49,847::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0689233 s, 14.9 MB/s\n'; <rc> = 0 >Thread-40::DEBUG::2014-07-10 09:50:51,811::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lion.qa.lab.tlv.redhat.com:_export_yuri2_backup2/6a70504d-00df-4869-8695-0f442053f6b6/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-40::DEBUG::2014-07-10 09:50:51,831::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n369 bytes (369 B) copied, 0.000480036 s, 769 kB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:50:51,863::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:50:51,981::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0573205 s, 17.9 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 09:50:53,456::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-14::DEBUG::2014-07-10 09:50:53,457::task::595::TaskManager.Task::(_updateState) Task=`58f7475d-0656-4c25-b01f-e7fc5eb63531`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 09:50:53,458::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-14::INFO::2014-07-10 09:50:53,458::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:50:53,459::task::1185::TaskManager.Task::(prepare) Task=`58f7475d-0656-4c25-b01f-e7fc5eb63531`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:50:53,459::task::595::TaskManager.Task::(_updateState) Task=`58f7475d-0656-4c25-b01f-e7fc5eb63531`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 09:50:53,459::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 09:50:53,459::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 09:50:53,460::task::990::TaskManager.Task::(_decref) Task=`58f7475d-0656-4c25-b01f-e7fc5eb63531`::ref 0 aborting False >Thread-34::DEBUG::2014-07-10 09:50:53,464::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-34::DEBUG::2014-07-10 09:50:53,464::task::595::TaskManager.Task::(_updateState) Task=`b52dd136-f8ef-41e1-88e1-d3b79f8f6c53`::moving from state init -> state preparing >Thread-34::INFO::2014-07-10 09:50:53,464::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-34::DEBUG::2014-07-10 09:50:53,465::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`148fa17e-578e-400d-9bca-a14bf6369f74`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-10 09:50:53,465::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' for lock type 'shared' >Thread-34::DEBUG::2014-07-10 09:50:53,466::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-10 09:50:53,466::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`148fa17e-578e-400d-9bca-a14bf6369f74`::Granted request >Thread-34::DEBUG::2014-07-10 09:50:53,466::task::827::TaskManager.Task::(resourceAcquired) Task=`b52dd136-f8ef-41e1-88e1-d3b79f8f6c53`::_resourcesAcquired: Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee (shared) >Thread-34::DEBUG::2014-07-10 09:50:53,467::task::990::TaskManager.Task::(_decref) Task=`b52dd136-f8ef-41e1-88e1-d3b79f8f6c53`::ref 1 aborting False >Thread-34::INFO::2014-07-10 09:50:53,468::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '531975110656', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:50:53,468::task::1185::TaskManager.Task::(prepare) Task=`b52dd136-f8ef-41e1-88e1-d3b79f8f6c53`::finished: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '531975110656', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:50:53,468::task::595::TaskManager.Task::(_updateState) Task=`b52dd136-f8ef-41e1-88e1-d3b79f8f6c53`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-10 09:50:53,469::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee': < ResourceRef 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-10 09:50:53,469::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-10 09:50:53,469::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' >Thread-34::DEBUG::2014-07-10 09:50:53,469::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' (0 active users) >Thread-34::DEBUG::2014-07-10 09:50:53,469::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-10 09:50:53,470::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', Clearing records. >Thread-34::DEBUG::2014-07-10 09:50:53,470::task::990::TaskManager.Task::(_decref) Task=`b52dd136-f8ef-41e1-88e1-d3b79f8f6c53`::ref 0 aborting False >Thread-18::DEBUG::2014-07-10 09:50:53,483::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/metadata bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-10 09:50:53,511::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00829876 s, 494 kB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:50:53,996::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:50:54,107::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0537447 s, 19.1 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:50:56,122::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:50:56,228::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0469079 s, 21.8 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:50:58,244::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:50:58,369::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0679559 s, 15.1 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:51:00,386::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:51:00,498::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0518018 s, 19.8 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 09:51:01,093::task::595::TaskManager.Task::(_updateState) Task=`aa21e6a1-b2c9-449b-9233-1e96eef03d53`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 09:51:01,093::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::INFO::2014-07-10 09:51:01,094::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00829876', 'lastCheck': '7.6', 'valid': True}, '6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000480036', 'lastCheck': '9.3', 'valid': True}} >Thread-14::DEBUG::2014-07-10 09:51:01,094::task::1185::TaskManager.Task::(prepare) Task=`aa21e6a1-b2c9-449b-9233-1e96eef03d53`::finished: {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00829876', 'lastCheck': '7.6', 'valid': True}, '6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000480036', 'lastCheck': '9.3', 'valid': True}} >Thread-14::DEBUG::2014-07-10 09:51:01,094::task::595::TaskManager.Task::(_updateState) Task=`aa21e6a1-b2c9-449b-9233-1e96eef03d53`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 09:51:01,094::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 09:51:01,095::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 09:51:01,095::task::990::TaskManager.Task::(_decref) Task=`aa21e6a1-b2c9-449b-9233-1e96eef03d53`::ref 0 aborting False >Thread-40::DEBUG::2014-07-10 09:51:01,862::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lion.qa.lab.tlv.redhat.com:_export_yuri2_backup2/6a70504d-00df-4869-8695-0f442053f6b6/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-40::DEBUG::2014-07-10 09:51:01,882::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n369 bytes (369 B) copied, 0.000467498 s, 789 kB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:51:02,513::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:51:02,628::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0586579 s, 17.5 MB/s\n'; <rc> = 0 >Thread-64::DEBUG::2014-07-10 09:51:02,676::task::595::TaskManager.Task::(_updateState) Task=`b951ad60-4165-4a4f-afcb-6932d34ddc0e`::moving from state init -> state preparing >Thread-64::INFO::2014-07-10 09:51:02,676::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='aa20346a-4d3a-4e07-b8e1-52c0ebe4168c', volUUID='58fefce2-9bce-4bff-8949-8c6ce8122b27', options=None) >Thread-64::INFO::2014-07-10 09:51:02,677::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-64::DEBUG::2014-07-10 09:51:02,677::task::1185::TaskManager.Task::(prepare) Task=`b951ad60-4165-4a4f-afcb-6932d34ddc0e`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-64::DEBUG::2014-07-10 09:51:02,677::task::595::TaskManager.Task::(_updateState) Task=`b951ad60-4165-4a4f-afcb-6932d34ddc0e`::moving from state preparing -> state finished >Thread-64::DEBUG::2014-07-10 09:51:02,678::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-64::DEBUG::2014-07-10 09:51:02,678::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-64::DEBUG::2014-07-10 09:51:02,678::task::990::TaskManager.Task::(_decref) Task=`b951ad60-4165-4a4f-afcb-6932d34ddc0e`::ref 0 aborting False >Thread-14::DEBUG::2014-07-10 09:51:03,520::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-14::DEBUG::2014-07-10 09:51:03,521::task::595::TaskManager.Task::(_updateState) Task=`24725751-0305-493b-8e89-caf9976b9a81`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 09:51:03,522::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-14::INFO::2014-07-10 09:51:03,522::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:51:03,522::task::1185::TaskManager.Task::(prepare) Task=`24725751-0305-493b-8e89-caf9976b9a81`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:51:03,523::task::595::TaskManager.Task::(_updateState) Task=`24725751-0305-493b-8e89-caf9976b9a81`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 09:51:03,523::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 09:51:03,523::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 09:51:03,523::task::990::TaskManager.Task::(_decref) Task=`24725751-0305-493b-8e89-caf9976b9a81`::ref 0 aborting False >Thread-18::DEBUG::2014-07-10 09:51:03,539::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/metadata bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-10 09:51:03,565::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00533946 s, 767 kB/s\n'; <rc> = 0 >Thread-34::DEBUG::2014-07-10 09:51:03,573::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-34::DEBUG::2014-07-10 09:51:03,579::task::595::TaskManager.Task::(_updateState) Task=`b31dfe13-5202-4de9-bfea-111098f95193`::moving from state init -> state preparing >Thread-34::INFO::2014-07-10 09:51:03,584::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-34::DEBUG::2014-07-10 09:51:03,592::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`dc32f682-d3ca-49eb-a69f-5d816fbb21c7`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-10 09:51:03,595::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' for lock type 'shared' >Thread-34::DEBUG::2014-07-10 09:51:03,600::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-10 09:51:03,603::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`dc32f682-d3ca-49eb-a69f-5d816fbb21c7`::Granted request >Thread-34::DEBUG::2014-07-10 09:51:03,610::task::827::TaskManager.Task::(resourceAcquired) Task=`b31dfe13-5202-4de9-bfea-111098f95193`::_resourcesAcquired: Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee (shared) >Thread-34::DEBUG::2014-07-10 09:51:03,618::task::990::TaskManager.Task::(_decref) Task=`b31dfe13-5202-4de9-bfea-111098f95193`::ref 1 aborting False >Thread-34::INFO::2014-07-10 09:51:03,656::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '531975110656', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:51:03,658::task::1185::TaskManager.Task::(prepare) Task=`b31dfe13-5202-4de9-bfea-111098f95193`::finished: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '531975110656', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:51:03,661::task::595::TaskManager.Task::(_updateState) Task=`b31dfe13-5202-4de9-bfea-111098f95193`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-10 09:51:03,664::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee': < ResourceRef 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-10 09:51:03,667::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-10 09:51:03,672::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' >Thread-34::DEBUG::2014-07-10 09:51:03,676::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' (0 active users) >Thread-34::DEBUG::2014-07-10 09:51:03,679::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-10 09:51:03,682::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', Clearing records. >Thread-34::DEBUG::2014-07-10 09:51:03,692::task::990::TaskManager.Task::(_decref) Task=`b31dfe13-5202-4de9-bfea-111098f95193`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 09:51:04,643::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:51:04,794::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0477767 s, 21.4 MB/s\n'; <rc> = 0 >Thread-73::DEBUG::2014-07-10 09:51:05,847::task::595::TaskManager.Task::(_updateState) Task=`f15e27b9-82bc-43f2-b73f-120fb651406e`::moving from state init -> state preparing >Thread-54::DEBUG::2014-07-10 09:51:05,848::task::595::TaskManager.Task::(_updateState) Task=`1cace05e-6ec9-475c-ba38-61cf1ce47417`::moving from state init -> state preparing >Thread-73::INFO::2014-07-10 09:51:05,849::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='c01d693b-cba0-4fed-9ad7-0aaa28912a19', volUUID='4bb5d954-2a50-4028-b299-0b43c261270c', options=None) >Thread-54::INFO::2014-07-10 09:51:05,850::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='28408446-e5fd-4565-a976-e760951593fe', volUUID='776303a2-5585-451e-826e-0e338d4a1e98', options=None) >Thread-73::INFO::2014-07-10 09:51:05,852::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-54::INFO::2014-07-10 09:51:05,853::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-73::DEBUG::2014-07-10 09:51:05,853::task::1185::TaskManager.Task::(prepare) Task=`f15e27b9-82bc-43f2-b73f-120fb651406e`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-54::DEBUG::2014-07-10 09:51:05,853::task::1185::TaskManager.Task::(prepare) Task=`1cace05e-6ec9-475c-ba38-61cf1ce47417`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-73::DEBUG::2014-07-10 09:51:05,854::task::595::TaskManager.Task::(_updateState) Task=`f15e27b9-82bc-43f2-b73f-120fb651406e`::moving from state preparing -> state finished >Thread-54::DEBUG::2014-07-10 09:51:05,855::task::595::TaskManager.Task::(_updateState) Task=`1cace05e-6ec9-475c-ba38-61cf1ce47417`::moving from state preparing -> state finished >Thread-73::DEBUG::2014-07-10 09:51:05,855::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-54::DEBUG::2014-07-10 09:51:05,855::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-73::DEBUG::2014-07-10 09:51:05,856::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-54::DEBUG::2014-07-10 09:51:05,856::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-73::DEBUG::2014-07-10 09:51:05,857::task::990::TaskManager.Task::(_decref) Task=`f15e27b9-82bc-43f2-b73f-120fb651406e`::ref 0 aborting False >Thread-54::DEBUG::2014-07-10 09:51:05,858::task::990::TaskManager.Task::(_decref) Task=`1cace05e-6ec9-475c-ba38-61cf1ce47417`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 09:51:06,824::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:51:06,929::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0458109 s, 22.4 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:51:08,945::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:51:09,061::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0291132 s, 35.2 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:51:11,086::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:51:11,186::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.036373 s, 28.2 MB/s\n'; <rc> = 0 >Thread-40::DEBUG::2014-07-10 09:51:11,908::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lion.qa.lab.tlv.redhat.com:_export_yuri2_backup2/6a70504d-00df-4869-8695-0f442053f6b6/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-40::DEBUG::2014-07-10 09:51:11,929::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n369 bytes (369 B) copied, 0.000469038 s, 787 kB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:51:13,201::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:51:13,359::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0842575 s, 12.2 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-10 09:51:13,750::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/metadata bs=4096 count=1' (cwd None) >Thread-14::DEBUG::2014-07-10 09:51:13,750::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-14::DEBUG::2014-07-10 09:51:13,774::task::595::TaskManager.Task::(_updateState) Task=`b7192ab4-0b94-416d-9a73-6b6cd3ce80d4`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 09:51:13,779::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-14::INFO::2014-07-10 09:51:13,785::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:51:13,787::task::1185::TaskManager.Task::(prepare) Task=`b7192ab4-0b94-416d-9a73-6b6cd3ce80d4`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:51:13,790::task::595::TaskManager.Task::(_updateState) Task=`b7192ab4-0b94-416d-9a73-6b6cd3ce80d4`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 09:51:13,793::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 09:51:13,795::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 09:51:13,798::task::990::TaskManager.Task::(_decref) Task=`b7192ab4-0b94-416d-9a73-6b6cd3ce80d4`::ref 0 aborting False >Thread-18::DEBUG::2014-07-10 09:51:13,809::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000710652 s, 5.8 MB/s\n'; <rc> = 0 >Thread-34::DEBUG::2014-07-10 09:51:13,813::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-34::DEBUG::2014-07-10 09:51:13,820::task::595::TaskManager.Task::(_updateState) Task=`688fc9d2-c67e-4db4-9f4a-32e586194215`::moving from state init -> state preparing >Thread-34::INFO::2014-07-10 09:51:13,824::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-34::DEBUG::2014-07-10 09:51:13,831::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`cc097ef4-37e5-494c-843d-665df0ea1585`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-10 09:51:13,837::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' for lock type 'shared' >Thread-34::DEBUG::2014-07-10 09:51:13,856::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-10 09:51:13,866::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`cc097ef4-37e5-494c-843d-665df0ea1585`::Granted request >Thread-34::DEBUG::2014-07-10 09:51:13,887::task::827::TaskManager.Task::(resourceAcquired) Task=`688fc9d2-c67e-4db4-9f4a-32e586194215`::_resourcesAcquired: Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee (shared) >Thread-34::DEBUG::2014-07-10 09:51:13,891::task::990::TaskManager.Task::(_decref) Task=`688fc9d2-c67e-4db4-9f4a-32e586194215`::ref 1 aborting False >Thread-34::INFO::2014-07-10 09:51:13,904::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '531975110656', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:51:13,907::task::1185::TaskManager.Task::(prepare) Task=`688fc9d2-c67e-4db4-9f4a-32e586194215`::finished: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '531975110656', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:51:13,910::task::595::TaskManager.Task::(_updateState) Task=`688fc9d2-c67e-4db4-9f4a-32e586194215`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-10 09:51:13,912::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee': < ResourceRef 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-10 09:51:13,915::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-10 09:51:13,920::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' >Thread-34::DEBUG::2014-07-10 09:51:13,924::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' (0 active users) >Thread-34::DEBUG::2014-07-10 09:51:13,927::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-10 09:51:13,929::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', Clearing records. >Thread-34::DEBUG::2014-07-10 09:51:13,934::task::990::TaskManager.Task::(_decref) Task=`688fc9d2-c67e-4db4-9f4a-32e586194215`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 09:51:15,374::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:51:15,473::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.025674 s, 39.9 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 09:51:16,310::task::595::TaskManager.Task::(_updateState) Task=`7ca0aeb8-c23c-49a7-9dd3-71524b367d37`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 09:51:16,311::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::INFO::2014-07-10 09:51:16,312::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000710652', 'lastCheck': '2.3', 'valid': True}, '6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000469038', 'lastCheck': '4.4', 'valid': True}} >Thread-14::DEBUG::2014-07-10 09:51:16,312::task::1185::TaskManager.Task::(prepare) Task=`7ca0aeb8-c23c-49a7-9dd3-71524b367d37`::finished: {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000710652', 'lastCheck': '2.3', 'valid': True}, '6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000469038', 'lastCheck': '4.4', 'valid': True}} >Thread-14::DEBUG::2014-07-10 09:51:16,312::task::595::TaskManager.Task::(_updateState) Task=`7ca0aeb8-c23c-49a7-9dd3-71524b367d37`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 09:51:16,312::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 09:51:16,312::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 09:51:16,313::task::990::TaskManager.Task::(_decref) Task=`7ca0aeb8-c23c-49a7-9dd3-71524b367d37`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 09:51:17,489::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:51:17,583::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0356274 s, 28.7 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:51:19,598::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:51:19,687::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0297017 s, 34.5 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:51:21,703::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:51:21,797::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0357728 s, 28.6 MB/s\n'; <rc> = 0 >Thread-40::DEBUG::2014-07-10 09:51:21,960::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lion.qa.lab.tlv.redhat.com:_export_yuri2_backup2/6a70504d-00df-4869-8695-0f442053f6b6/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-40::DEBUG::2014-07-10 09:51:21,980::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n369 bytes (369 B) copied, 0.000573999 s, 643 kB/s\n'; <rc> = 0 >Thread-57::DEBUG::2014-07-10 09:51:23,145::task::595::TaskManager.Task::(_updateState) Task=`d53b5282-dec1-40d6-9faa-55a198fe75f8`::moving from state init -> state preparing >Thread-57::INFO::2014-07-10 09:51:23,145::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='b6f6c0da-e67f-4902-b9ac-3069571a42fe', volUUID='c4cd1da8-05b7-45e0-80b1-1183d21443d9', options=None) >Thread-57::INFO::2014-07-10 09:51:23,146::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-57::DEBUG::2014-07-10 09:51:23,146::task::1185::TaskManager.Task::(prepare) Task=`d53b5282-dec1-40d6-9faa-55a198fe75f8`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-57::DEBUG::2014-07-10 09:51:23,146::task::595::TaskManager.Task::(_updateState) Task=`d53b5282-dec1-40d6-9faa-55a198fe75f8`::moving from state preparing -> state finished >Thread-57::DEBUG::2014-07-10 09:51:23,146::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-57::DEBUG::2014-07-10 09:51:23,146::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-57::DEBUG::2014-07-10 09:51:23,147::task::990::TaskManager.Task::(_decref) Task=`d53b5282-dec1-40d6-9faa-55a198fe75f8`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 09:51:23,814::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Thread-67::DEBUG::2014-07-10 09:51:23,884::task::595::TaskManager.Task::(_updateState) Task=`06f4d6e0-aef5-4930-a135-df52a18790f0`::moving from state init -> state preparing >Thread-67::INFO::2014-07-10 09:51:23,889::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='f30c2cb7-a43a-4bf5-82b5-cfe07336f65c', volUUID='b0fbb3c9-55af-4a3a-95ad-fc56a80b9cf5', options=None) >Thread-67::INFO::2014-07-10 09:51:23,893::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-67::DEBUG::2014-07-10 09:51:23,896::task::1185::TaskManager.Task::(prepare) Task=`06f4d6e0-aef5-4930-a135-df52a18790f0`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-67::DEBUG::2014-07-10 09:51:23,906::task::595::TaskManager.Task::(_updateState) Task=`06f4d6e0-aef5-4930-a135-df52a18790f0`::moving from state preparing -> state finished >Thread-67::DEBUG::2014-07-10 09:51:23,917::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-67::DEBUG::2014-07-10 09:51:23,927::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-67::DEBUG::2014-07-10 09:51:23,938::task::990::TaskManager.Task::(_decref) Task=`06f4d6e0-aef5-4930-a135-df52a18790f0`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 09:51:23,975::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0288802 s, 35.5 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-10 09:51:23,979::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/metadata bs=4096 count=1' (cwd None) >Thread-14::DEBUG::2014-07-10 09:51:24,014::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-14::DEBUG::2014-07-10 09:51:24,027::task::595::TaskManager.Task::(_updateState) Task=`5dc2be41-3c42-49c1-a215-b38849f36c56`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 09:51:24,035::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-14::INFO::2014-07-10 09:51:24,051::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:51:24,058::task::1185::TaskManager.Task::(prepare) Task=`5dc2be41-3c42-49c1-a215-b38849f36c56`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:51:24,069::task::595::TaskManager.Task::(_updateState) Task=`5dc2be41-3c42-49c1-a215-b38849f36c56`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 09:51:24,080::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-48::DEBUG::2014-07-10 09:51:24,088::task::595::TaskManager.Task::(_updateState) Task=`1f568be2-aad6-49c2-bbcb-27f2d5af7524`::moving from state init -> state preparing >Thread-14::DEBUG::2014-07-10 09:51:24,090::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-48::INFO::2014-07-10 09:51:24,099::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='0cd7d6ce-f497-4243-a690-c57744861eea', volUUID='10b6a7dd-dc6c-43fa-ba17-92e4331b0e0b', options=None) >Thread-14::DEBUG::2014-07-10 09:51:24,101::task::990::TaskManager.Task::(_decref) Task=`5dc2be41-3c42-49c1-a215-b38849f36c56`::ref 0 aborting False >Thread-48::INFO::2014-07-10 09:51:24,117::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-48::DEBUG::2014-07-10 09:51:24,127::task::1185::TaskManager.Task::(prepare) Task=`1f568be2-aad6-49c2-bbcb-27f2d5af7524`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-48::DEBUG::2014-07-10 09:51:24,136::task::595::TaskManager.Task::(_updateState) Task=`1f568be2-aad6-49c2-bbcb-27f2d5af7524`::moving from state preparing -> state finished >Thread-48::DEBUG::2014-07-10 09:51:24,144::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-34::DEBUG::2014-07-10 09:51:24,149::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-48::DEBUG::2014-07-10 09:51:24,154::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-10 09:51:24,163::task::595::TaskManager.Task::(_updateState) Task=`959ed207-73f2-489c-8484-f4de105e642a`::moving from state init -> state preparing >Thread-48::DEBUG::2014-07-10 09:51:24,165::task::990::TaskManager.Task::(_decref) Task=`1f568be2-aad6-49c2-bbcb-27f2d5af7524`::ref 0 aborting False >Thread-34::INFO::2014-07-10 09:51:24,175::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-34::DEBUG::2014-07-10 09:51:24,189::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`5845fd87-9ea5-4c89-8414-239e5cb2d3ec`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-10 09:51:24,195::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' for lock type 'shared' >Thread-18::DEBUG::2014-07-10 09:51:24,203::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000606969 s, 6.7 MB/s\n'; <rc> = 0 >Thread-34::DEBUG::2014-07-10 09:51:24,204::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-10 09:51:24,211::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`5845fd87-9ea5-4c89-8414-239e5cb2d3ec`::Granted request >Thread-34::DEBUG::2014-07-10 09:51:24,224::task::827::TaskManager.Task::(resourceAcquired) Task=`959ed207-73f2-489c-8484-f4de105e642a`::_resourcesAcquired: Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee (shared) >Thread-34::DEBUG::2014-07-10 09:51:24,230::task::990::TaskManager.Task::(_decref) Task=`959ed207-73f2-489c-8484-f4de105e642a`::ref 1 aborting False >Thread-34::INFO::2014-07-10 09:51:24,259::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '531975110656', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:51:24,265::task::1185::TaskManager.Task::(prepare) Task=`959ed207-73f2-489c-8484-f4de105e642a`::finished: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '531975110656', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:51:24,272::task::595::TaskManager.Task::(_updateState) Task=`959ed207-73f2-489c-8484-f4de105e642a`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-10 09:51:24,277::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee': < ResourceRef 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-10 09:51:24,282::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-10 09:51:24,291::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' >Thread-34::DEBUG::2014-07-10 09:51:24,298::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' (0 active users) >Thread-34::DEBUG::2014-07-10 09:51:24,303::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-10 09:51:24,308::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', Clearing records. >Thread-34::DEBUG::2014-07-10 09:51:24,317::task::990::TaskManager.Task::(_decref) Task=`959ed207-73f2-489c-8484-f4de105e642a`::ref 0 aborting False >Thread-76::DEBUG::2014-07-10 09:51:25,816::task::595::TaskManager.Task::(_updateState) Task=`22805c62-684e-40c8-86ec-d77fe220c098`::moving from state init -> state preparing >Thread-76::INFO::2014-07-10 09:51:25,816::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='e4c65229-4247-4b33-b72a-f1d5ce72ad05', volUUID='cad94284-3ca9-4c30-933d-997f4460309e', options=None) >Thread-76::INFO::2014-07-10 09:51:25,816::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-76::DEBUG::2014-07-10 09:51:25,817::task::1185::TaskManager.Task::(prepare) Task=`22805c62-684e-40c8-86ec-d77fe220c098`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-76::DEBUG::2014-07-10 09:51:25,817::task::595::TaskManager.Task::(_updateState) Task=`22805c62-684e-40c8-86ec-d77fe220c098`::moving from state preparing -> state finished >Thread-76::DEBUG::2014-07-10 09:51:25,817::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-76::DEBUG::2014-07-10 09:51:25,817::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-76::DEBUG::2014-07-10 09:51:25,817::task::990::TaskManager.Task::(_decref) Task=`22805c62-684e-40c8-86ec-d77fe220c098`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 09:51:26,461::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:51:26,560::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0383231 s, 26.7 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:51:28,576::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:51:28,661::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0286764 s, 35.7 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:51:30,677::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:51:30,762::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0293725 s, 34.9 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 09:51:31,487::task::595::TaskManager.Task::(_updateState) Task=`bb562943-b431-426c-a274-38ed96d73463`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 09:51:31,488::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::INFO::2014-07-10 09:51:31,488::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000606969', 'lastCheck': '7.0', 'valid': True}, '6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000573999', 'lastCheck': '9.5', 'valid': True}} >Thread-14::DEBUG::2014-07-10 09:51:31,489::task::1185::TaskManager.Task::(prepare) Task=`bb562943-b431-426c-a274-38ed96d73463`::finished: {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000606969', 'lastCheck': '7.0', 'valid': True}, '6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000573999', 'lastCheck': '9.5', 'valid': True}} >Thread-14::DEBUG::2014-07-10 09:51:31,489::task::595::TaskManager.Task::(_updateState) Task=`bb562943-b431-426c-a274-38ed96d73463`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 09:51:31,489::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 09:51:31,489::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 09:51:31,489::task::990::TaskManager.Task::(_decref) Task=`bb562943-b431-426c-a274-38ed96d73463`::ref 0 aborting False >Thread-40::DEBUG::2014-07-10 09:51:32,011::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lion.qa.lab.tlv.redhat.com:_export_yuri2_backup2/6a70504d-00df-4869-8695-0f442053f6b6/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-40::DEBUG::2014-07-10 09:51:32,031::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n369 bytes (369 B) copied, 0.000448582 s, 823 kB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:51:32,776::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:51:32,936::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.101379 s, 10.1 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 09:51:34,374::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-14::DEBUG::2014-07-10 09:51:34,375::task::595::TaskManager.Task::(_updateState) Task=`84ae9d1b-251e-40a8-9998-c56201001a20`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 09:51:34,375::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-14::INFO::2014-07-10 09:51:34,376::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:51:34,376::task::1185::TaskManager.Task::(prepare) Task=`84ae9d1b-251e-40a8-9998-c56201001a20`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:51:34,376::task::595::TaskManager.Task::(_updateState) Task=`84ae9d1b-251e-40a8-9998-c56201001a20`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 09:51:34,378::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 09:51:34,378::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 09:51:34,378::task::990::TaskManager.Task::(_decref) Task=`84ae9d1b-251e-40a8-9998-c56201001a20`::ref 0 aborting False >Thread-34::DEBUG::2014-07-10 09:51:34,421::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-34::DEBUG::2014-07-10 09:51:34,422::task::595::TaskManager.Task::(_updateState) Task=`00bc6d99-1c31-4c37-9e97-13d54297408c`::moving from state init -> state preparing >Thread-34::INFO::2014-07-10 09:51:34,422::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-34::DEBUG::2014-07-10 09:51:34,423::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`7aded0ce-539b-4379-a5a0-f7c12d22a09c`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-10 09:51:34,423::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' for lock type 'shared' >Thread-34::DEBUG::2014-07-10 09:51:34,423::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-10 09:51:34,423::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`7aded0ce-539b-4379-a5a0-f7c12d22a09c`::Granted request >Thread-34::DEBUG::2014-07-10 09:51:34,424::task::827::TaskManager.Task::(resourceAcquired) Task=`00bc6d99-1c31-4c37-9e97-13d54297408c`::_resourcesAcquired: Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee (shared) >Thread-34::DEBUG::2014-07-10 09:51:34,424::task::990::TaskManager.Task::(_decref) Task=`00bc6d99-1c31-4c37-9e97-13d54297408c`::ref 1 aborting False >Thread-34::INFO::2014-07-10 09:51:34,425::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '531975110656', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:51:34,426::task::1185::TaskManager.Task::(prepare) Task=`00bc6d99-1c31-4c37-9e97-13d54297408c`::finished: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '531975110656', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:51:34,426::task::595::TaskManager.Task::(_updateState) Task=`00bc6d99-1c31-4c37-9e97-13d54297408c`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-10 09:51:34,426::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee': < ResourceRef 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-10 09:51:34,426::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-10 09:51:34,427::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' >Thread-34::DEBUG::2014-07-10 09:51:34,427::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' (0 active users) >Thread-34::DEBUG::2014-07-10 09:51:34,427::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-10 09:51:34,427::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', Clearing records. >Thread-34::DEBUG::2014-07-10 09:51:34,427::task::990::TaskManager.Task::(_decref) Task=`00bc6d99-1c31-4c37-9e97-13d54297408c`::ref 0 aborting False >Thread-18::DEBUG::2014-07-10 09:51:34,456::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/metadata bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-10 09:51:34,490::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.0103407 s, 396 kB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:51:34,952::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:51:35,067::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0566966 s, 18.1 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:51:37,083::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:51:37,185::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0416546 s, 24.6 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:51:39,201::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:51:39,372::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.030408 s, 33.7 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:51:41,388::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:51:41,501::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0561223 s, 18.2 MB/s\n'; <rc> = 0 >Thread-40::DEBUG::2014-07-10 09:51:42,063::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lion.qa.lab.tlv.redhat.com:_export_yuri2_backup2/6a70504d-00df-4869-8695-0f442053f6b6/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-40::DEBUG::2014-07-10 09:51:42,086::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n369 bytes (369 B) copied, 0.000528556 s, 698 kB/s\n'; <rc> = 0 >Thread-70::DEBUG::2014-07-10 09:51:42,868::task::595::TaskManager.Task::(_updateState) Task=`19010868-aca6-40b6-9490-048dc70e4baf`::moving from state init -> state preparing >Thread-70::INFO::2014-07-10 09:51:42,869::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='cfaeead2-7caa-467c-b389-c89840ae6605', volUUID='567fe32d-31a6-4ff6-90f3-fd6a656fbecc', options=None) >Thread-70::INFO::2014-07-10 09:51:42,869::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-70::DEBUG::2014-07-10 09:51:42,870::task::1185::TaskManager.Task::(prepare) Task=`19010868-aca6-40b6-9490-048dc70e4baf`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-70::DEBUG::2014-07-10 09:51:42,870::task::595::TaskManager.Task::(_updateState) Task=`19010868-aca6-40b6-9490-048dc70e4baf`::moving from state preparing -> state finished >Thread-70::DEBUG::2014-07-10 09:51:42,870::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-70::DEBUG::2014-07-10 09:51:42,870::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-70::DEBUG::2014-07-10 09:51:42,871::task::990::TaskManager.Task::(_decref) Task=`19010868-aca6-40b6-9490-048dc70e4baf`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 09:51:43,516::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:51:43,670::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0773275 s, 13.2 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 09:51:44,457::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-14::DEBUG::2014-07-10 09:51:44,458::task::595::TaskManager.Task::(_updateState) Task=`136cccc1-4df5-4258-bfbc-e04a1d4a65b6`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 09:51:44,459::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-14::INFO::2014-07-10 09:51:44,459::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:51:44,460::task::1185::TaskManager.Task::(prepare) Task=`136cccc1-4df5-4258-bfbc-e04a1d4a65b6`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:51:44,460::task::595::TaskManager.Task::(_updateState) Task=`136cccc1-4df5-4258-bfbc-e04a1d4a65b6`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 09:51:44,460::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 09:51:44,460::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 09:51:44,460::task::990::TaskManager.Task::(_decref) Task=`136cccc1-4df5-4258-bfbc-e04a1d4a65b6`::ref 0 aborting False >Thread-34::DEBUG::2014-07-10 09:51:44,464::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-34::DEBUG::2014-07-10 09:51:44,465::task::595::TaskManager.Task::(_updateState) Task=`2d93234a-63bc-4fce-9df5-e7bb0a59d6db`::moving from state init -> state preparing >Thread-34::INFO::2014-07-10 09:51:44,465::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-34::DEBUG::2014-07-10 09:51:44,466::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`198f32e2-6123-40e9-a1ae-1c3ef647cf0d`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-10 09:51:44,466::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' for lock type 'shared' >Thread-34::DEBUG::2014-07-10 09:51:44,467::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-10 09:51:44,467::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`198f32e2-6123-40e9-a1ae-1c3ef647cf0d`::Granted request >Thread-34::DEBUG::2014-07-10 09:51:44,467::task::827::TaskManager.Task::(resourceAcquired) Task=`2d93234a-63bc-4fce-9df5-e7bb0a59d6db`::_resourcesAcquired: Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee (shared) >Thread-34::DEBUG::2014-07-10 09:51:44,467::task::990::TaskManager.Task::(_decref) Task=`2d93234a-63bc-4fce-9df5-e7bb0a59d6db`::ref 1 aborting False >Thread-34::INFO::2014-07-10 09:51:44,469::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '531976159232', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:51:44,470::task::1185::TaskManager.Task::(prepare) Task=`2d93234a-63bc-4fce-9df5-e7bb0a59d6db`::finished: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '531976159232', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:51:44,470::task::595::TaskManager.Task::(_updateState) Task=`2d93234a-63bc-4fce-9df5-e7bb0a59d6db`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-10 09:51:44,470::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee': < ResourceRef 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-10 09:51:44,470::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-10 09:51:44,471::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' >Thread-34::DEBUG::2014-07-10 09:51:44,471::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' (0 active users) >Thread-34::DEBUG::2014-07-10 09:51:44,471::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-10 09:51:44,471::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', Clearing records. >Thread-34::DEBUG::2014-07-10 09:51:44,472::task::990::TaskManager.Task::(_decref) Task=`2d93234a-63bc-4fce-9df5-e7bb0a59d6db`::ref 0 aborting False >Thread-60::DEBUG::2014-07-10 09:51:44,475::task::595::TaskManager.Task::(_updateState) Task=`6358beb3-14df-4497-94f5-3b44a23b94d5`::moving from state init -> state preparing >Thread-60::INFO::2014-07-10 09:51:44,475::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='b034d5b0-e1e0-4011-b49b-4d45ddb11556', volUUID='3d7f62b5-328f-4d8e-8b69-873cfb5ae14d', options=None) >Thread-60::INFO::2014-07-10 09:51:44,476::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-60::DEBUG::2014-07-10 09:51:44,476::task::1185::TaskManager.Task::(prepare) Task=`6358beb3-14df-4497-94f5-3b44a23b94d5`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-60::DEBUG::2014-07-10 09:51:44,476::task::595::TaskManager.Task::(_updateState) Task=`6358beb3-14df-4497-94f5-3b44a23b94d5`::moving from state preparing -> state finished >Thread-60::DEBUG::2014-07-10 09:51:44,477::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-60::DEBUG::2014-07-10 09:51:44,477::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-60::DEBUG::2014-07-10 09:51:44,477::task::990::TaskManager.Task::(_decref) Task=`6358beb3-14df-4497-94f5-3b44a23b94d5`::ref 0 aborting False >Thread-51::DEBUG::2014-07-10 09:51:44,507::task::595::TaskManager.Task::(_updateState) Task=`cbcd8098-8ccf-414e-8b8f-327033018087`::moving from state init -> state preparing >Thread-51::INFO::2014-07-10 09:51:44,507::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='76fdb054-02cd-42ed-9721-b3e65b34c3a4', volUUID='022dfe46-2cf7-4915-80b3-883158e3ca83', options=None) >Thread-51::INFO::2014-07-10 09:51:44,507::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-51::DEBUG::2014-07-10 09:51:44,507::task::1185::TaskManager.Task::(prepare) Task=`cbcd8098-8ccf-414e-8b8f-327033018087`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-51::DEBUG::2014-07-10 09:51:44,508::task::595::TaskManager.Task::(_updateState) Task=`cbcd8098-8ccf-414e-8b8f-327033018087`::moving from state preparing -> state finished >Thread-51::DEBUG::2014-07-10 09:51:44,508::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-51::DEBUG::2014-07-10 09:51:44,508::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-51::DEBUG::2014-07-10 09:51:44,508::task::990::TaskManager.Task::(_decref) Task=`cbcd8098-8ccf-414e-8b8f-327033018087`::ref 0 aborting False >Thread-18::DEBUG::2014-07-10 09:51:44,518::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/metadata bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-10 09:51:44,547::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00666209 s, 615 kB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:51:45,693::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:51:45,799::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0460716 s, 22.2 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 09:51:46,686::task::595::TaskManager.Task::(_updateState) Task=`defe2729-c385-4aed-a460-4a16e4e9be0d`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 09:51:46,687::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::INFO::2014-07-10 09:51:46,687::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00666209', 'lastCheck': '2.1', 'valid': True}, '6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000528556', 'lastCheck': '4.6', 'valid': True}} >Thread-14::DEBUG::2014-07-10 09:51:46,688::task::1185::TaskManager.Task::(prepare) Task=`defe2729-c385-4aed-a460-4a16e4e9be0d`::finished: {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00666209', 'lastCheck': '2.1', 'valid': True}, '6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000528556', 'lastCheck': '4.6', 'valid': True}} >Thread-14::DEBUG::2014-07-10 09:51:46,688::task::595::TaskManager.Task::(_updateState) Task=`defe2729-c385-4aed-a460-4a16e4e9be0d`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 09:51:46,688::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 09:51:46,688::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 09:51:46,689::task::990::TaskManager.Task::(_decref) Task=`defe2729-c385-4aed-a460-4a16e4e9be0d`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 09:51:47,815::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:51:47,915::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0331067 s, 30.9 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:51:49,930::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:51:50,023::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0345357 s, 29.7 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:51:52,038::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Thread-40::DEBUG::2014-07-10 09:51:52,280::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lion.qa.lab.tlv.redhat.com:_export_yuri2_backup2/6a70504d-00df-4869-8695-0f442053f6b6/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-40::DEBUG::2014-07-10 09:51:52,324::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n369 bytes (369 B) copied, 0.000363771 s, 1.0 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:51:52,352::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0267076 s, 38.3 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:51:54,368::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:51:54,454::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0293896 s, 34.8 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 09:51:54,499::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-14::DEBUG::2014-07-10 09:51:54,500::task::595::TaskManager.Task::(_updateState) Task=`339dbb42-416a-474b-b1f6-278d289587be`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 09:51:54,501::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-14::INFO::2014-07-10 09:51:54,501::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:51:54,502::task::1185::TaskManager.Task::(prepare) Task=`339dbb42-416a-474b-b1f6-278d289587be`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:51:54,502::task::595::TaskManager.Task::(_updateState) Task=`339dbb42-416a-474b-b1f6-278d289587be`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 09:51:54,502::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 09:51:54,502::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 09:51:54,503::task::990::TaskManager.Task::(_decref) Task=`339dbb42-416a-474b-b1f6-278d289587be`::ref 0 aborting False >Thread-34::DEBUG::2014-07-10 09:51:54,507::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-34::DEBUG::2014-07-10 09:51:54,507::task::595::TaskManager.Task::(_updateState) Task=`7580062b-3f97-474b-825c-c8dffb88d19e`::moving from state init -> state preparing >Thread-34::INFO::2014-07-10 09:51:54,508::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-34::DEBUG::2014-07-10 09:51:54,508::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`dc534851-615c-40cb-9023-b6a2d44ed337`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-10 09:51:54,508::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' for lock type 'shared' >Thread-34::DEBUG::2014-07-10 09:51:54,509::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-10 09:51:54,509::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`dc534851-615c-40cb-9023-b6a2d44ed337`::Granted request >Thread-34::DEBUG::2014-07-10 09:51:54,510::task::827::TaskManager.Task::(resourceAcquired) Task=`7580062b-3f97-474b-825c-c8dffb88d19e`::_resourcesAcquired: Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee (shared) >Thread-34::DEBUG::2014-07-10 09:51:54,510::task::990::TaskManager.Task::(_decref) Task=`7580062b-3f97-474b-825c-c8dffb88d19e`::ref 1 aborting False >Thread-34::INFO::2014-07-10 09:51:54,511::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '531976159232', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:51:54,511::task::1185::TaskManager.Task::(prepare) Task=`7580062b-3f97-474b-825c-c8dffb88d19e`::finished: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '531976159232', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:51:54,511::task::595::TaskManager.Task::(_updateState) Task=`7580062b-3f97-474b-825c-c8dffb88d19e`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-10 09:51:54,512::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee': < ResourceRef 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-10 09:51:54,512::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-10 09:51:54,512::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' >Thread-34::DEBUG::2014-07-10 09:51:54,512::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' (0 active users) >Thread-34::DEBUG::2014-07-10 09:51:54,512::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-10 09:51:54,513::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', Clearing records. >Thread-34::DEBUG::2014-07-10 09:51:54,513::task::990::TaskManager.Task::(_decref) Task=`7580062b-3f97-474b-825c-c8dffb88d19e`::ref 0 aborting False >Thread-18::DEBUG::2014-07-10 09:51:54,580::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/metadata bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-10 09:51:54,604::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00425354 s, 963 kB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:51:56,470::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:51:56,565::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0349781 s, 29.3 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:51:58,579::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:51:58,699::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0622099 s, 16.5 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:52:00,714::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:52:00,804::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0322738 s, 31.7 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 09:52:01,888::task::595::TaskManager.Task::(_updateState) Task=`daf5df8f-81e6-44ab-b90f-fa6f57987230`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 09:52:01,889::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::INFO::2014-07-10 09:52:01,889::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00425354', 'lastCheck': '7.2', 'valid': True}, '6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000363771', 'lastCheck': '9.6', 'valid': True}} >Thread-14::DEBUG::2014-07-10 09:52:01,890::task::1185::TaskManager.Task::(prepare) Task=`daf5df8f-81e6-44ab-b90f-fa6f57987230`::finished: {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00425354', 'lastCheck': '7.2', 'valid': True}, '6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000363771', 'lastCheck': '9.6', 'valid': True}} >Thread-14::DEBUG::2014-07-10 09:52:01,890::task::595::TaskManager.Task::(_updateState) Task=`daf5df8f-81e6-44ab-b90f-fa6f57987230`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 09:52:01,890::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 09:52:01,890::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 09:52:01,890::task::990::TaskManager.Task::(_decref) Task=`daf5df8f-81e6-44ab-b90f-fa6f57987230`::ref 0 aborting False >Thread-40::DEBUG::2014-07-10 09:52:02,366::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lion.qa.lab.tlv.redhat.com:_export_yuri2_backup2/6a70504d-00df-4869-8695-0f442053f6b6/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-40::DEBUG::2014-07-10 09:52:02,388::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n369 bytes (369 B) copied, 0.000426786 s, 865 kB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:52:02,819::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:52:02,919::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0394396 s, 26.0 MB/s\n'; <rc> = 0 >Thread-64::DEBUG::2014-07-10 09:52:02,961::task::595::TaskManager.Task::(_updateState) Task=`3558ecd7-1e0e-4b4d-b816-e1bdbc7e6ab2`::moving from state init -> state preparing >Thread-64::INFO::2014-07-10 09:52:02,962::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='aa20346a-4d3a-4e07-b8e1-52c0ebe4168c', volUUID='58fefce2-9bce-4bff-8949-8c6ce8122b27', options=None) >Thread-64::INFO::2014-07-10 09:52:02,962::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-64::DEBUG::2014-07-10 09:52:02,962::task::1185::TaskManager.Task::(prepare) Task=`3558ecd7-1e0e-4b4d-b816-e1bdbc7e6ab2`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-64::DEBUG::2014-07-10 09:52:02,963::task::595::TaskManager.Task::(_updateState) Task=`3558ecd7-1e0e-4b4d-b816-e1bdbc7e6ab2`::moving from state preparing -> state finished >Thread-64::DEBUG::2014-07-10 09:52:02,963::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-64::DEBUG::2014-07-10 09:52:02,963::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-64::DEBUG::2014-07-10 09:52:02,963::task::990::TaskManager.Task::(_decref) Task=`3558ecd7-1e0e-4b4d-b816-e1bdbc7e6ab2`::ref 0 aborting False >Thread-14::DEBUG::2014-07-10 09:52:04,541::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-14::DEBUG::2014-07-10 09:52:04,542::task::595::TaskManager.Task::(_updateState) Task=`cb05801f-93d6-410a-816d-4bf73505c43f`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 09:52:04,542::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-14::INFO::2014-07-10 09:52:04,543::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:52:04,543::task::1185::TaskManager.Task::(prepare) Task=`cb05801f-93d6-410a-816d-4bf73505c43f`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:52:04,543::task::595::TaskManager.Task::(_updateState) Task=`cb05801f-93d6-410a-816d-4bf73505c43f`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 09:52:04,543::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 09:52:04,544::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 09:52:04,544::task::990::TaskManager.Task::(_decref) Task=`cb05801f-93d6-410a-816d-4bf73505c43f`::ref 0 aborting False >Thread-34::DEBUG::2014-07-10 09:52:04,587::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-34::DEBUG::2014-07-10 09:52:04,588::task::595::TaskManager.Task::(_updateState) Task=`fbdd1293-9dd9-4549-9dc2-c53dcd694180`::moving from state init -> state preparing >Thread-34::INFO::2014-07-10 09:52:04,588::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-34::DEBUG::2014-07-10 09:52:04,589::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`31e2b103-4ba7-4963-917b-a6f248e96ddc`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-10 09:52:04,589::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' for lock type 'shared' >Thread-34::DEBUG::2014-07-10 09:52:04,589::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-10 09:52:04,590::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`31e2b103-4ba7-4963-917b-a6f248e96ddc`::Granted request >Thread-34::DEBUG::2014-07-10 09:52:04,590::task::827::TaskManager.Task::(resourceAcquired) Task=`fbdd1293-9dd9-4549-9dc2-c53dcd694180`::_resourcesAcquired: Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee (shared) >Thread-34::DEBUG::2014-07-10 09:52:04,590::task::990::TaskManager.Task::(_decref) Task=`fbdd1293-9dd9-4549-9dc2-c53dcd694180`::ref 1 aborting False >Thread-34::INFO::2014-07-10 09:52:04,592::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '531976159232', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:52:04,592::task::1185::TaskManager.Task::(prepare) Task=`fbdd1293-9dd9-4549-9dc2-c53dcd694180`::finished: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '531976159232', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:52:04,592::task::595::TaskManager.Task::(_updateState) Task=`fbdd1293-9dd9-4549-9dc2-c53dcd694180`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-10 09:52:04,592::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee': < ResourceRef 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-10 09:52:04,592::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-10 09:52:04,593::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' >Thread-34::DEBUG::2014-07-10 09:52:04,593::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' (0 active users) >Thread-34::DEBUG::2014-07-10 09:52:04,593::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-10 09:52:04,593::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', Clearing records. >Thread-34::DEBUG::2014-07-10 09:52:04,594::task::990::TaskManager.Task::(_decref) Task=`fbdd1293-9dd9-4549-9dc2-c53dcd694180`::ref 0 aborting False >Thread-18::DEBUG::2014-07-10 09:52:04,664::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/metadata bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-10 09:52:04,691::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00654258 s, 626 kB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:52:04,934::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:52:05,062::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0471015 s, 21.7 MB/s\n'; <rc> = 0 >Thread-54::DEBUG::2014-07-10 09:52:06,192::task::595::TaskManager.Task::(_updateState) Task=`394a1a23-f9b4-4ae7-947a-d67507914b1e`::moving from state init -> state preparing >Thread-73::DEBUG::2014-07-10 09:52:06,193::task::595::TaskManager.Task::(_updateState) Task=`fdea34d1-2825-40ec-a473-e30ac9412fdd`::moving from state init -> state preparing >Thread-54::INFO::2014-07-10 09:52:06,194::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='28408446-e5fd-4565-a976-e760951593fe', volUUID='776303a2-5585-451e-826e-0e338d4a1e98', options=None) >Thread-73::INFO::2014-07-10 09:52:06,194::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='c01d693b-cba0-4fed-9ad7-0aaa28912a19', volUUID='4bb5d954-2a50-4028-b299-0b43c261270c', options=None) >Thread-54::INFO::2014-07-10 09:52:06,195::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-73::INFO::2014-07-10 09:52:06,195::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-54::DEBUG::2014-07-10 09:52:06,195::task::1185::TaskManager.Task::(prepare) Task=`394a1a23-f9b4-4ae7-947a-d67507914b1e`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-73::DEBUG::2014-07-10 09:52:06,195::task::1185::TaskManager.Task::(prepare) Task=`fdea34d1-2825-40ec-a473-e30ac9412fdd`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-54::DEBUG::2014-07-10 09:52:06,196::task::595::TaskManager.Task::(_updateState) Task=`394a1a23-f9b4-4ae7-947a-d67507914b1e`::moving from state preparing -> state finished >Thread-73::DEBUG::2014-07-10 09:52:06,196::task::595::TaskManager.Task::(_updateState) Task=`fdea34d1-2825-40ec-a473-e30ac9412fdd`::moving from state preparing -> state finished >Thread-54::DEBUG::2014-07-10 09:52:06,196::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-73::DEBUG::2014-07-10 09:52:06,196::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-54::DEBUG::2014-07-10 09:52:06,197::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-73::DEBUG::2014-07-10 09:52:06,197::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-54::DEBUG::2014-07-10 09:52:06,197::task::990::TaskManager.Task::(_decref) Task=`394a1a23-f9b4-4ae7-947a-d67507914b1e`::ref 0 aborting False >Thread-73::DEBUG::2014-07-10 09:52:06,197::task::990::TaskManager.Task::(_decref) Task=`fdea34d1-2825-40ec-a473-e30ac9412fdd`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 09:52:07,077::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:52:07,170::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0345118 s, 29.7 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:52:09,185::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:52:09,275::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0333787 s, 30.7 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:52:11,291::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:52:11,386::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0367827 s, 27.8 MB/s\n'; <rc> = 0 >Thread-40::DEBUG::2014-07-10 09:52:12,415::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lion.qa.lab.tlv.redhat.com:_export_yuri2_backup2/6a70504d-00df-4869-8695-0f442053f6b6/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-40::DEBUG::2014-07-10 09:52:12,434::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n369 bytes (369 B) copied, 0.000498765 s, 740 kB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:52:13,404::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:52:13,515::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0499739 s, 20.5 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 09:52:14,624::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-14::DEBUG::2014-07-10 09:52:14,625::task::595::TaskManager.Task::(_updateState) Task=`e2ce8bd9-8628-4520-a2de-b8debc7f46ad`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 09:52:14,625::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-14::INFO::2014-07-10 09:52:14,626::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:52:14,626::task::1185::TaskManager.Task::(prepare) Task=`e2ce8bd9-8628-4520-a2de-b8debc7f46ad`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:52:14,626::task::595::TaskManager.Task::(_updateState) Task=`e2ce8bd9-8628-4520-a2de-b8debc7f46ad`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 09:52:14,626::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 09:52:14,626::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 09:52:14,627::task::990::TaskManager.Task::(_decref) Task=`e2ce8bd9-8628-4520-a2de-b8debc7f46ad`::ref 0 aborting False >Thread-34::DEBUG::2014-07-10 09:52:14,631::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-34::DEBUG::2014-07-10 09:52:14,631::task::595::TaskManager.Task::(_updateState) Task=`ef8743d3-f7fa-408b-b2fa-68dfa695f041`::moving from state init -> state preparing >Thread-34::INFO::2014-07-10 09:52:14,631::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-34::DEBUG::2014-07-10 09:52:14,632::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`5187706c-9a8f-4bf7-99b6-43c1e6ed8155`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-10 09:52:14,632::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' for lock type 'shared' >Thread-34::DEBUG::2014-07-10 09:52:14,633::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-10 09:52:14,633::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`5187706c-9a8f-4bf7-99b6-43c1e6ed8155`::Granted request >Thread-34::DEBUG::2014-07-10 09:52:14,634::task::827::TaskManager.Task::(resourceAcquired) Task=`ef8743d3-f7fa-408b-b2fa-68dfa695f041`::_resourcesAcquired: Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee (shared) >Thread-34::DEBUG::2014-07-10 09:52:14,634::task::990::TaskManager.Task::(_decref) Task=`ef8743d3-f7fa-408b-b2fa-68dfa695f041`::ref 1 aborting False >Thread-34::INFO::2014-07-10 09:52:14,635::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '531976159232', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:52:14,635::task::1185::TaskManager.Task::(prepare) Task=`ef8743d3-f7fa-408b-b2fa-68dfa695f041`::finished: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '531976159232', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:52:14,635::task::595::TaskManager.Task::(_updateState) Task=`ef8743d3-f7fa-408b-b2fa-68dfa695f041`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-10 09:52:14,636::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee': < ResourceRef 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-10 09:52:14,636::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-10 09:52:14,636::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' >Thread-34::DEBUG::2014-07-10 09:52:14,636::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' (0 active users) >Thread-34::DEBUG::2014-07-10 09:52:14,636::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-10 09:52:14,637::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', Clearing records. >Thread-34::DEBUG::2014-07-10 09:52:14,637::task::990::TaskManager.Task::(_decref) Task=`ef8743d3-f7fa-408b-b2fa-68dfa695f041`::ref 0 aborting False >Thread-18::DEBUG::2014-07-10 09:52:14,720::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/metadata bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-10 09:52:14,762::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.0209493 s, 196 kB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:52:15,530::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:52:15,617::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0285388 s, 35.9 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 09:52:17,086::task::595::TaskManager.Task::(_updateState) Task=`9e7d0e9e-f39a-44e5-a82f-2cec50dd9d05`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 09:52:17,086::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::INFO::2014-07-10 09:52:17,087::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0209493', 'lastCheck': '2.3', 'valid': True}, '6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000498765', 'lastCheck': '4.6', 'valid': True}} >Thread-14::DEBUG::2014-07-10 09:52:17,087::task::1185::TaskManager.Task::(prepare) Task=`9e7d0e9e-f39a-44e5-a82f-2cec50dd9d05`::finished: {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0209493', 'lastCheck': '2.3', 'valid': True}, '6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000498765', 'lastCheck': '4.6', 'valid': True}} >Thread-14::DEBUG::2014-07-10 09:52:17,087::task::595::TaskManager.Task::(_updateState) Task=`9e7d0e9e-f39a-44e5-a82f-2cec50dd9d05`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 09:52:17,087::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 09:52:17,088::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 09:52:17,088::task::990::TaskManager.Task::(_decref) Task=`9e7d0e9e-f39a-44e5-a82f-2cec50dd9d05`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 09:52:17,644::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:52:17,733::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.030987 s, 33.0 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:52:19,748::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:52:19,902::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0955753 s, 10.7 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:52:21,928::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:52:22,016::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0291629 s, 35.1 MB/s\n'; <rc> = 0 >Thread-40::DEBUG::2014-07-10 09:52:22,469::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lion.qa.lab.tlv.redhat.com:_export_yuri2_backup2/6a70504d-00df-4869-8695-0f442053f6b6/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-40::DEBUG::2014-07-10 09:52:22,489::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n369 bytes (369 B) copied, 0.000442076 s, 835 kB/s\n'; <rc> = 0 >Thread-57::DEBUG::2014-07-10 09:52:23,432::task::595::TaskManager.Task::(_updateState) Task=`7789aa4d-c983-4cd4-bb62-7cd1e75ab84d`::moving from state init -> state preparing >Thread-57::INFO::2014-07-10 09:52:23,433::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='b6f6c0da-e67f-4902-b9ac-3069571a42fe', volUUID='c4cd1da8-05b7-45e0-80b1-1183d21443d9', options=None) >Thread-57::INFO::2014-07-10 09:52:23,434::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-57::DEBUG::2014-07-10 09:52:23,434::task::1185::TaskManager.Task::(prepare) Task=`7789aa4d-c983-4cd4-bb62-7cd1e75ab84d`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-57::DEBUG::2014-07-10 09:52:23,434::task::595::TaskManager.Task::(_updateState) Task=`7789aa4d-c983-4cd4-bb62-7cd1e75ab84d`::moving from state preparing -> state finished >Thread-57::DEBUG::2014-07-10 09:52:23,434::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-57::DEBUG::2014-07-10 09:52:23,435::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-57::DEBUG::2014-07-10 09:52:23,435::task::990::TaskManager.Task::(_decref) Task=`7789aa4d-c983-4cd4-bb62-7cd1e75ab84d`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 09:52:24,031::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:52:24,122::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0296963 s, 34.5 MB/s\n'; <rc> = 0 >Thread-67::DEBUG::2014-07-10 09:52:24,262::task::595::TaskManager.Task::(_updateState) Task=`bb2908cd-1083-4ee4-bad9-e65694b71a12`::moving from state init -> state preparing >Thread-67::INFO::2014-07-10 09:52:24,263::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='f30c2cb7-a43a-4bf5-82b5-cfe07336f65c', volUUID='b0fbb3c9-55af-4a3a-95ad-fc56a80b9cf5', options=None) >Thread-67::INFO::2014-07-10 09:52:24,263::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-67::DEBUG::2014-07-10 09:52:24,263::task::1185::TaskManager.Task::(prepare) Task=`bb2908cd-1083-4ee4-bad9-e65694b71a12`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-67::DEBUG::2014-07-10 09:52:24,264::task::595::TaskManager.Task::(_updateState) Task=`bb2908cd-1083-4ee4-bad9-e65694b71a12`::moving from state preparing -> state finished >Thread-67::DEBUG::2014-07-10 09:52:24,264::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-67::DEBUG::2014-07-10 09:52:24,264::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-67::DEBUG::2014-07-10 09:52:24,264::task::990::TaskManager.Task::(_decref) Task=`bb2908cd-1083-4ee4-bad9-e65694b71a12`::ref 0 aborting False >Thread-48::DEBUG::2014-07-10 09:52:24,471::task::595::TaskManager.Task::(_updateState) Task=`2453aaa8-e653-4cb8-ba5e-4a6d42e8131e`::moving from state init -> state preparing >Thread-48::INFO::2014-07-10 09:52:24,471::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='0cd7d6ce-f497-4243-a690-c57744861eea', volUUID='10b6a7dd-dc6c-43fa-ba17-92e4331b0e0b', options=None) >Thread-48::INFO::2014-07-10 09:52:24,472::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-48::DEBUG::2014-07-10 09:52:24,472::task::1185::TaskManager.Task::(prepare) Task=`2453aaa8-e653-4cb8-ba5e-4a6d42e8131e`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-48::DEBUG::2014-07-10 09:52:24,472::task::595::TaskManager.Task::(_updateState) Task=`2453aaa8-e653-4cb8-ba5e-4a6d42e8131e`::moving from state preparing -> state finished >Thread-48::DEBUG::2014-07-10 09:52:24,472::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-48::DEBUG::2014-07-10 09:52:24,473::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-48::DEBUG::2014-07-10 09:52:24,473::task::990::TaskManager.Task::(_decref) Task=`2453aaa8-e653-4cb8-ba5e-4a6d42e8131e`::ref 0 aborting False >Thread-14::DEBUG::2014-07-10 09:52:24,666::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-14::DEBUG::2014-07-10 09:52:24,667::task::595::TaskManager.Task::(_updateState) Task=`74e6e6d3-bbb8-4832-aa89-c477d78e0a73`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 09:52:24,668::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-14::INFO::2014-07-10 09:52:24,668::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:52:24,668::task::1185::TaskManager.Task::(prepare) Task=`74e6e6d3-bbb8-4832-aa89-c477d78e0a73`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:52:24,669::task::595::TaskManager.Task::(_updateState) Task=`74e6e6d3-bbb8-4832-aa89-c477d78e0a73`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 09:52:24,669::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 09:52:24,669::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 09:52:24,669::task::990::TaskManager.Task::(_decref) Task=`74e6e6d3-bbb8-4832-aa89-c477d78e0a73`::ref 0 aborting False >Thread-34::DEBUG::2014-07-10 09:52:24,673::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-34::DEBUG::2014-07-10 09:52:24,674::task::595::TaskManager.Task::(_updateState) Task=`eb8ee695-4ad8-4f1b-bd30-f1fe3a32a2c1`::moving from state init -> state preparing >Thread-34::INFO::2014-07-10 09:52:24,674::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-34::DEBUG::2014-07-10 09:52:24,675::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`1083cfef-2e92-46b5-8c5f-2cfd2a8e5387`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-10 09:52:24,675::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' for lock type 'shared' >Thread-34::DEBUG::2014-07-10 09:52:24,675::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-10 09:52:24,676::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`1083cfef-2e92-46b5-8c5f-2cfd2a8e5387`::Granted request >Thread-34::DEBUG::2014-07-10 09:52:24,676::task::827::TaskManager.Task::(resourceAcquired) Task=`eb8ee695-4ad8-4f1b-bd30-f1fe3a32a2c1`::_resourcesAcquired: Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee (shared) >Thread-34::DEBUG::2014-07-10 09:52:24,676::task::990::TaskManager.Task::(_decref) Task=`eb8ee695-4ad8-4f1b-bd30-f1fe3a32a2c1`::ref 1 aborting False >Thread-34::INFO::2014-07-10 09:52:24,677::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '531976159232', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:52:24,678::task::1185::TaskManager.Task::(prepare) Task=`eb8ee695-4ad8-4f1b-bd30-f1fe3a32a2c1`::finished: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '531976159232', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:52:24,678::task::595::TaskManager.Task::(_updateState) Task=`eb8ee695-4ad8-4f1b-bd30-f1fe3a32a2c1`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-10 09:52:24,678::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee': < ResourceRef 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-10 09:52:24,678::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-10 09:52:24,678::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' >Thread-34::DEBUG::2014-07-10 09:52:24,679::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' (0 active users) >Thread-34::DEBUG::2014-07-10 09:52:24,679::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-10 09:52:24,679::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', Clearing records. >Thread-34::DEBUG::2014-07-10 09:52:24,679::task::990::TaskManager.Task::(_decref) Task=`eb8ee695-4ad8-4f1b-bd30-f1fe3a32a2c1`::ref 0 aborting False >Thread-18::DEBUG::2014-07-10 09:52:24,791::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/metadata bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-10 09:52:24,816::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.0058163 s, 704 kB/s\n'; <rc> = 0 >Thread-76::DEBUG::2014-07-10 09:52:26,102::task::595::TaskManager.Task::(_updateState) Task=`1dbda537-7c56-4488-a66d-a7fc68fd05c0`::moving from state init -> state preparing >Thread-76::INFO::2014-07-10 09:52:26,102::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='e4c65229-4247-4b33-b72a-f1d5ce72ad05', volUUID='cad94284-3ca9-4c30-933d-997f4460309e', options=None) >Thread-76::INFO::2014-07-10 09:52:26,103::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-76::DEBUG::2014-07-10 09:52:26,103::task::1185::TaskManager.Task::(prepare) Task=`1dbda537-7c56-4488-a66d-a7fc68fd05c0`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-76::DEBUG::2014-07-10 09:52:26,103::task::595::TaskManager.Task::(_updateState) Task=`1dbda537-7c56-4488-a66d-a7fc68fd05c0`::moving from state preparing -> state finished >Thread-76::DEBUG::2014-07-10 09:52:26,104::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-76::DEBUG::2014-07-10 09:52:26,104::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-76::DEBUG::2014-07-10 09:52:26,104::task::990::TaskManager.Task::(_decref) Task=`1dbda537-7c56-4488-a66d-a7fc68fd05c0`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 09:52:26,137::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:52:26,233::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0375745 s, 27.3 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:52:28,263::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:52:28,370::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0292649 s, 35.0 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:52:30,387::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:52:30,474::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0272178 s, 37.6 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 09:52:32,277::task::595::TaskManager.Task::(_updateState) Task=`3b5ad9b3-ce66-47d8-bcc9-1905a02b7240`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 09:52:32,278::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::INFO::2014-07-10 09:52:32,278::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0058163', 'lastCheck': '7.4', 'valid': True}, '6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000442076', 'lastCheck': '9.8', 'valid': True}} >Thread-14::DEBUG::2014-07-10 09:52:32,278::task::1185::TaskManager.Task::(prepare) Task=`3b5ad9b3-ce66-47d8-bcc9-1905a02b7240`::finished: {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0058163', 'lastCheck': '7.4', 'valid': True}, '6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000442076', 'lastCheck': '9.8', 'valid': True}} >Thread-14::DEBUG::2014-07-10 09:52:32,278::task::595::TaskManager.Task::(_updateState) Task=`3b5ad9b3-ce66-47d8-bcc9-1905a02b7240`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 09:52:32,279::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 09:52:32,279::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 09:52:32,279::task::990::TaskManager.Task::(_decref) Task=`3b5ad9b3-ce66-47d8-bcc9-1905a02b7240`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 09:52:32,489::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Thread-40::DEBUG::2014-07-10 09:52:32,657::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lion.qa.lab.tlv.redhat.com:_export_yuri2_backup2/6a70504d-00df-4869-8695-0f442053f6b6/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-40::DEBUG::2014-07-10 09:52:32,689::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n369 bytes (369 B) copied, 0.000438187 s, 842 kB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:52:32,767::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.215729 s, 4.7 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 09:52:34,729::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-14::DEBUG::2014-07-10 09:52:34,730::task::595::TaskManager.Task::(_updateState) Task=`c59b35e4-258a-43f3-be6b-eb0d583872ae`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 09:52:34,730::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-14::INFO::2014-07-10 09:52:34,731::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:52:34,731::task::1185::TaskManager.Task::(prepare) Task=`c59b35e4-258a-43f3-be6b-eb0d583872ae`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:52:34,731::task::595::TaskManager.Task::(_updateState) Task=`c59b35e4-258a-43f3-be6b-eb0d583872ae`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 09:52:34,731::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 09:52:34,732::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 09:52:34,732::task::990::TaskManager.Task::(_decref) Task=`c59b35e4-258a-43f3-be6b-eb0d583872ae`::ref 0 aborting False >Thread-34::DEBUG::2014-07-10 09:52:34,775::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-34::DEBUG::2014-07-10 09:52:34,776::task::595::TaskManager.Task::(_updateState) Task=`0077914f-aa01-44ff-8acd-88a44aa64b2a`::moving from state init -> state preparing >Thread-34::INFO::2014-07-10 09:52:34,776::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-34::DEBUG::2014-07-10 09:52:34,777::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`890d7d91-e1b1-440d-bf96-b5f1080bfc51`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-10 09:52:34,777::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' for lock type 'shared' >Thread-34::DEBUG::2014-07-10 09:52:34,777::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-10 09:52:34,777::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`890d7d91-e1b1-440d-bf96-b5f1080bfc51`::Granted request >Thread-34::DEBUG::2014-07-10 09:52:34,778::task::827::TaskManager.Task::(resourceAcquired) Task=`0077914f-aa01-44ff-8acd-88a44aa64b2a`::_resourcesAcquired: Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee (shared) >Thread-34::DEBUG::2014-07-10 09:52:34,778::task::990::TaskManager.Task::(_decref) Task=`0077914f-aa01-44ff-8acd-88a44aa64b2a`::ref 1 aborting False >Thread-34::INFO::2014-07-10 09:52:34,779::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '531976159232', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:52:34,780::task::1185::TaskManager.Task::(prepare) Task=`0077914f-aa01-44ff-8acd-88a44aa64b2a`::finished: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '531976159232', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:52:34,780::task::595::TaskManager.Task::(_updateState) Task=`0077914f-aa01-44ff-8acd-88a44aa64b2a`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-10 09:52:34,780::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee': < ResourceRef 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-10 09:52:34,780::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-10 09:52:34,781::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' >Thread-34::DEBUG::2014-07-10 09:52:34,781::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' (0 active users) >Thread-34::DEBUG::2014-07-10 09:52:34,781::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-10 09:52:34,781::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', Clearing records. >Thread-34::DEBUG::2014-07-10 09:52:34,781::task::990::TaskManager.Task::(_decref) Task=`0077914f-aa01-44ff-8acd-88a44aa64b2a`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 09:52:34,785::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Thread-18::DEBUG::2014-07-10 09:52:34,848::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/metadata bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-10 09:52:34,935::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000551276 s, 7.4 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:52:35,363::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0326129 s, 31.4 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:52:37,379::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:52:37,465::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0263012 s, 38.9 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:52:39,481::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:52:39,577::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0351981 s, 29.1 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:52:41,595::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:52:41,686::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0328772 s, 31.1 MB/s\n'; <rc> = 0 >Thread-40::DEBUG::2014-07-10 09:52:42,722::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lion.qa.lab.tlv.redhat.com:_export_yuri2_backup2/6a70504d-00df-4869-8695-0f442053f6b6/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-40::DEBUG::2014-07-10 09:52:42,742::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n369 bytes (369 B) copied, 0.000622307 s, 593 kB/s\n'; <rc> = 0 >Thread-70::DEBUG::2014-07-10 09:52:43,143::task::595::TaskManager.Task::(_updateState) Task=`8e12c221-6155-486e-8b04-682fe22b8251`::moving from state init -> state preparing >Thread-70::INFO::2014-07-10 09:52:43,144::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='cfaeead2-7caa-467c-b389-c89840ae6605', volUUID='567fe32d-31a6-4ff6-90f3-fd6a656fbecc', options=None) >Thread-70::INFO::2014-07-10 09:52:43,144::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-70::DEBUG::2014-07-10 09:52:43,145::task::1185::TaskManager.Task::(prepare) Task=`8e12c221-6155-486e-8b04-682fe22b8251`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-70::DEBUG::2014-07-10 09:52:43,145::task::595::TaskManager.Task::(_updateState) Task=`8e12c221-6155-486e-8b04-682fe22b8251`::moving from state preparing -> state finished >Thread-70::DEBUG::2014-07-10 09:52:43,145::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-70::DEBUG::2014-07-10 09:52:43,145::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-70::DEBUG::2014-07-10 09:52:43,146::task::990::TaskManager.Task::(_decref) Task=`8e12c221-6155-486e-8b04-682fe22b8251`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 09:52:43,701::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:52:43,885::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.110017 s, 9.3 MB/s\n'; <rc> = 0 >Thread-60::DEBUG::2014-07-10 09:52:44,791::task::595::TaskManager.Task::(_updateState) Task=`744c2ae1-5af2-41ba-ba1f-449954c18233`::moving from state init -> state preparing >Thread-60::INFO::2014-07-10 09:52:44,792::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='b034d5b0-e1e0-4011-b49b-4d45ddb11556', volUUID='3d7f62b5-328f-4d8e-8b69-873cfb5ae14d', options=None) >Thread-60::INFO::2014-07-10 09:52:44,792::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-60::DEBUG::2014-07-10 09:52:44,792::task::1185::TaskManager.Task::(prepare) Task=`744c2ae1-5af2-41ba-ba1f-449954c18233`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-60::DEBUG::2014-07-10 09:52:44,792::task::595::TaskManager.Task::(_updateState) Task=`744c2ae1-5af2-41ba-ba1f-449954c18233`::moving from state preparing -> state finished >Thread-60::DEBUG::2014-07-10 09:52:44,793::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-60::DEBUG::2014-07-10 09:52:44,793::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-60::DEBUG::2014-07-10 09:52:44,793::task::990::TaskManager.Task::(_decref) Task=`744c2ae1-5af2-41ba-ba1f-449954c18233`::ref 0 aborting False >Thread-51::DEBUG::2014-07-10 09:52:44,795::task::595::TaskManager.Task::(_updateState) Task=`8fc5dde4-6b6e-440f-82d4-f1e498e4583a`::moving from state init -> state preparing >Thread-51::INFO::2014-07-10 09:52:44,796::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='76fdb054-02cd-42ed-9721-b3e65b34c3a4', volUUID='022dfe46-2cf7-4915-80b3-883158e3ca83', options=None) >Thread-51::INFO::2014-07-10 09:52:44,796::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-51::DEBUG::2014-07-10 09:52:44,796::task::1185::TaskManager.Task::(prepare) Task=`8fc5dde4-6b6e-440f-82d4-f1e498e4583a`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-51::DEBUG::2014-07-10 09:52:44,796::task::595::TaskManager.Task::(_updateState) Task=`8fc5dde4-6b6e-440f-82d4-f1e498e4583a`::moving from state preparing -> state finished >Thread-51::DEBUG::2014-07-10 09:52:44,796::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-51::DEBUG::2014-07-10 09:52:44,797::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-51::DEBUG::2014-07-10 09:52:44,797::task::990::TaskManager.Task::(_decref) Task=`8fc5dde4-6b6e-440f-82d4-f1e498e4583a`::ref 0 aborting False >Thread-14::DEBUG::2014-07-10 09:52:44,833::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-14::DEBUG::2014-07-10 09:52:44,833::task::595::TaskManager.Task::(_updateState) Task=`23dec2db-9fe0-41a7-b98f-71a6cf54e45c`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 09:52:44,834::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-14::INFO::2014-07-10 09:52:44,834::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:52:44,834::task::1185::TaskManager.Task::(prepare) Task=`23dec2db-9fe0-41a7-b98f-71a6cf54e45c`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:52:44,835::task::595::TaskManager.Task::(_updateState) Task=`23dec2db-9fe0-41a7-b98f-71a6cf54e45c`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 09:52:44,835::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 09:52:44,835::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 09:52:44,835::task::990::TaskManager.Task::(_decref) Task=`23dec2db-9fe0-41a7-b98f-71a6cf54e45c`::ref 0 aborting False >Thread-34::DEBUG::2014-07-10 09:52:44,839::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-34::DEBUG::2014-07-10 09:52:44,839::task::595::TaskManager.Task::(_updateState) Task=`6ca1be7a-51a1-4dd3-a4ff-272d78f614f5`::moving from state init -> state preparing >Thread-34::INFO::2014-07-10 09:52:44,840::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-34::DEBUG::2014-07-10 09:52:44,840::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`224fb223-ca8b-47d5-9e1d-de9903c87bf2`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-10 09:52:44,841::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' for lock type 'shared' >Thread-34::DEBUG::2014-07-10 09:52:44,841::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-10 09:52:44,841::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`224fb223-ca8b-47d5-9e1d-de9903c87bf2`::Granted request >Thread-34::DEBUG::2014-07-10 09:52:44,842::task::827::TaskManager.Task::(resourceAcquired) Task=`6ca1be7a-51a1-4dd3-a4ff-272d78f614f5`::_resourcesAcquired: Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee (shared) >Thread-34::DEBUG::2014-07-10 09:52:44,842::task::990::TaskManager.Task::(_decref) Task=`6ca1be7a-51a1-4dd3-a4ff-272d78f614f5`::ref 1 aborting False >Thread-34::INFO::2014-07-10 09:52:44,843::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '531976159232', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:52:44,843::task::1185::TaskManager.Task::(prepare) Task=`6ca1be7a-51a1-4dd3-a4ff-272d78f614f5`::finished: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '531976159232', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:52:44,844::task::595::TaskManager.Task::(_updateState) Task=`6ca1be7a-51a1-4dd3-a4ff-272d78f614f5`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-10 09:52:44,844::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee': < ResourceRef 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-10 09:52:44,844::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-10 09:52:44,844::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' >Thread-34::DEBUG::2014-07-10 09:52:44,845::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' (0 active users) >Thread-34::DEBUG::2014-07-10 09:52:44,845::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-10 09:52:44,845::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', Clearing records. >Thread-34::DEBUG::2014-07-10 09:52:44,845::task::990::TaskManager.Task::(_decref) Task=`6ca1be7a-51a1-4dd3-a4ff-272d78f614f5`::ref 0 aborting False >Thread-18::DEBUG::2014-07-10 09:52:45,327::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/metadata bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-10 09:52:45,353::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00532261 s, 770 kB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:52:45,900::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:52:46,015::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0580775 s, 17.6 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 09:52:47,469::task::595::TaskManager.Task::(_updateState) Task=`cb13620c-9b24-4321-99b3-5c54440942d9`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 09:52:47,470::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::INFO::2014-07-10 09:52:47,470::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00532261', 'lastCheck': '2.1', 'valid': True}, '6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000622307', 'lastCheck': '4.7', 'valid': True}} >Thread-14::DEBUG::2014-07-10 09:52:47,470::task::1185::TaskManager.Task::(prepare) Task=`cb13620c-9b24-4321-99b3-5c54440942d9`::finished: {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00532261', 'lastCheck': '2.1', 'valid': True}, '6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000622307', 'lastCheck': '4.7', 'valid': True}} >Thread-14::DEBUG::2014-07-10 09:52:47,471::task::595::TaskManager.Task::(_updateState) Task=`cb13620c-9b24-4321-99b3-5c54440942d9`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 09:52:47,471::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 09:52:47,471::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 09:52:47,471::task::990::TaskManager.Task::(_decref) Task=`cb13620c-9b24-4321-99b3-5c54440942d9`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 09:52:48,030::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:52:48,118::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0297854 s, 34.4 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:52:50,456::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:52:50,596::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0792471 s, 12.9 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:52:52,611::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:52:52,715::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0467044 s, 21.9 MB/s\n'; <rc> = 0 >Thread-40::DEBUG::2014-07-10 09:52:52,773::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lion.qa.lab.tlv.redhat.com:_export_yuri2_backup2/6a70504d-00df-4869-8695-0f442053f6b6/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-40::DEBUG::2014-07-10 09:52:52,792::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n369 bytes (369 B) copied, 0.00055847 s, 661 kB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:52:54,731::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:52:54,836::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0458579 s, 22.3 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 09:52:54,883::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-14::DEBUG::2014-07-10 09:52:54,885::task::595::TaskManager.Task::(_updateState) Task=`a2a96d7d-d459-439c-ba89-31cc543c97e8`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 09:52:54,885::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-14::INFO::2014-07-10 09:52:54,886::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:52:54,886::task::1185::TaskManager.Task::(prepare) Task=`a2a96d7d-d459-439c-ba89-31cc543c97e8`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:52:54,886::task::595::TaskManager.Task::(_updateState) Task=`a2a96d7d-d459-439c-ba89-31cc543c97e8`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 09:52:54,886::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 09:52:54,887::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 09:52:54,887::task::990::TaskManager.Task::(_decref) Task=`a2a96d7d-d459-439c-ba89-31cc543c97e8`::ref 0 aborting False >Thread-34::DEBUG::2014-07-10 09:52:54,891::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-34::DEBUG::2014-07-10 09:52:54,891::task::595::TaskManager.Task::(_updateState) Task=`a9a75e12-927f-4810-b519-07228336e9f3`::moving from state init -> state preparing >Thread-34::INFO::2014-07-10 09:52:54,892::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-34::DEBUG::2014-07-10 09:52:54,892::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`e4f812d1-c1bd-4a0e-aa09-afede4bc2d87`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-10 09:52:54,893::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' for lock type 'shared' >Thread-34::DEBUG::2014-07-10 09:52:54,893::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-10 09:52:54,894::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`e4f812d1-c1bd-4a0e-aa09-afede4bc2d87`::Granted request >Thread-34::DEBUG::2014-07-10 09:52:54,895::task::827::TaskManager.Task::(resourceAcquired) Task=`a9a75e12-927f-4810-b519-07228336e9f3`::_resourcesAcquired: Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee (shared) >Thread-34::DEBUG::2014-07-10 09:52:54,896::task::990::TaskManager.Task::(_decref) Task=`a9a75e12-927f-4810-b519-07228336e9f3`::ref 1 aborting False >Thread-34::INFO::2014-07-10 09:52:54,897::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '531976159232', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:52:54,897::task::1185::TaskManager.Task::(prepare) Task=`a9a75e12-927f-4810-b519-07228336e9f3`::finished: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '531976159232', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:52:54,898::task::595::TaskManager.Task::(_updateState) Task=`a9a75e12-927f-4810-b519-07228336e9f3`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-10 09:52:54,898::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee': < ResourceRef 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-10 09:52:54,898::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-10 09:52:54,898::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' >Thread-34::DEBUG::2014-07-10 09:52:54,899::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' (0 active users) >Thread-34::DEBUG::2014-07-10 09:52:54,899::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-10 09:52:54,900::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', Clearing records. >Thread-34::DEBUG::2014-07-10 09:52:54,900::task::990::TaskManager.Task::(_decref) Task=`a9a75e12-927f-4810-b519-07228336e9f3`::ref 0 aborting False >Thread-18::DEBUG::2014-07-10 09:52:55,399::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/metadata bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-10 09:52:55,431::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.0108033 s, 379 kB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:52:56,851::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:52:57,015::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0356663 s, 28.7 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:52:59,032::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:52:59,196::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.106322 s, 9.6 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:53:01,211::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:53:01,323::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0502338 s, 20.4 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 09:53:02,720::task::595::TaskManager.Task::(_updateState) Task=`74fbed1d-e031-4b40-ba29-1aa9fdd0685b`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 09:53:02,720::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::INFO::2014-07-10 09:53:02,721::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0108033', 'lastCheck': '7.3', 'valid': True}, '6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00055847', 'lastCheck': '9.9', 'valid': True}} >Thread-14::DEBUG::2014-07-10 09:53:02,721::task::1185::TaskManager.Task::(prepare) Task=`74fbed1d-e031-4b40-ba29-1aa9fdd0685b`::finished: {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0108033', 'lastCheck': '7.3', 'valid': True}, '6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00055847', 'lastCheck': '9.9', 'valid': True}} >Thread-14::DEBUG::2014-07-10 09:53:02,721::task::595::TaskManager.Task::(_updateState) Task=`74fbed1d-e031-4b40-ba29-1aa9fdd0685b`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 09:53:02,721::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 09:53:02,721::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 09:53:02,722::task::990::TaskManager.Task::(_decref) Task=`74fbed1d-e031-4b40-ba29-1aa9fdd0685b`::ref 0 aborting False >Thread-40::DEBUG::2014-07-10 09:53:02,822::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lion.qa.lab.tlv.redhat.com:_export_yuri2_backup2/6a70504d-00df-4869-8695-0f442053f6b6/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-40::DEBUG::2014-07-10 09:53:02,842::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n369 bytes (369 B) copied, 0.000478317 s, 771 kB/s\n'; <rc> = 0 >Thread-64::DEBUG::2014-07-10 09:53:03,252::task::595::TaskManager.Task::(_updateState) Task=`e59049fe-37e0-42a6-8138-ace3557bf859`::moving from state init -> state preparing >Thread-64::INFO::2014-07-10 09:53:03,252::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='aa20346a-4d3a-4e07-b8e1-52c0ebe4168c', volUUID='58fefce2-9bce-4bff-8949-8c6ce8122b27', options=None) >Thread-64::INFO::2014-07-10 09:53:03,253::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-64::DEBUG::2014-07-10 09:53:03,253::task::1185::TaskManager.Task::(prepare) Task=`e59049fe-37e0-42a6-8138-ace3557bf859`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-64::DEBUG::2014-07-10 09:53:03,253::task::595::TaskManager.Task::(_updateState) Task=`e59049fe-37e0-42a6-8138-ace3557bf859`::moving from state preparing -> state finished >Thread-64::DEBUG::2014-07-10 09:53:03,253::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-64::DEBUG::2014-07-10 09:53:03,253::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-64::DEBUG::2014-07-10 09:53:03,253::task::990::TaskManager.Task::(_decref) Task=`e59049fe-37e0-42a6-8138-ace3557bf859`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 09:53:03,338::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:53:03,424::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0296502 s, 34.5 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 09:53:04,933::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-14::DEBUG::2014-07-10 09:53:04,934::task::595::TaskManager.Task::(_updateState) Task=`3678ee66-93f7-4055-ae88-065e91bb95e4`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 09:53:04,934::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-14::INFO::2014-07-10 09:53:04,935::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:53:04,935::task::1185::TaskManager.Task::(prepare) Task=`3678ee66-93f7-4055-ae88-065e91bb95e4`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:53:04,936::task::595::TaskManager.Task::(_updateState) Task=`3678ee66-93f7-4055-ae88-065e91bb95e4`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 09:53:04,936::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 09:53:04,936::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 09:53:04,936::task::990::TaskManager.Task::(_decref) Task=`3678ee66-93f7-4055-ae88-065e91bb95e4`::ref 0 aborting False >Thread-34::DEBUG::2014-07-10 09:53:04,981::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-34::DEBUG::2014-07-10 09:53:04,982::task::595::TaskManager.Task::(_updateState) Task=`10c132f0-85d0-4329-8c45-71227bae2efa`::moving from state init -> state preparing >Thread-34::INFO::2014-07-10 09:53:04,982::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-34::DEBUG::2014-07-10 09:53:04,983::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`3246870d-30c1-4e74-baad-f31dbfee03c7`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-10 09:53:04,983::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' for lock type 'shared' >Thread-34::DEBUG::2014-07-10 09:53:04,983::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-10 09:53:04,984::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`3246870d-30c1-4e74-baad-f31dbfee03c7`::Granted request >Thread-34::DEBUG::2014-07-10 09:53:04,984::task::827::TaskManager.Task::(resourceAcquired) Task=`10c132f0-85d0-4329-8c45-71227bae2efa`::_resourcesAcquired: Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee (shared) >Thread-34::DEBUG::2014-07-10 09:53:04,984::task::990::TaskManager.Task::(_decref) Task=`10c132f0-85d0-4329-8c45-71227bae2efa`::ref 1 aborting False >Thread-34::INFO::2014-07-10 09:53:04,986::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '531976159232', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:53:04,986::task::1185::TaskManager.Task::(prepare) Task=`10c132f0-85d0-4329-8c45-71227bae2efa`::finished: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '531976159232', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:53:04,986::task::595::TaskManager.Task::(_updateState) Task=`10c132f0-85d0-4329-8c45-71227bae2efa`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-10 09:53:04,986::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee': < ResourceRef 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-10 09:53:04,986::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-10 09:53:04,987::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' >Thread-34::DEBUG::2014-07-10 09:53:04,987::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' (0 active users) >Thread-34::DEBUG::2014-07-10 09:53:04,987::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-10 09:53:04,987::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', Clearing records. >Thread-34::DEBUG::2014-07-10 09:53:04,987::task::990::TaskManager.Task::(_decref) Task=`10c132f0-85d0-4329-8c45-71227bae2efa`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 09:53:05,439::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Thread-18::DEBUG::2014-07-10 09:53:05,467::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/metadata bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-10 09:53:05,545::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00565511 s, 724 kB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:53:05,950::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.453235 s, 2.3 MB/s\n'; <rc> = 0 >Thread-54::DEBUG::2014-07-10 09:53:06,507::task::595::TaskManager.Task::(_updateState) Task=`ef49236e-21f3-4f5b-a111-cb2ab21a4b69`::moving from state init -> state preparing >Thread-54::INFO::2014-07-10 09:53:06,509::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='28408446-e5fd-4565-a976-e760951593fe', volUUID='776303a2-5585-451e-826e-0e338d4a1e98', options=None) >Thread-73::DEBUG::2014-07-10 09:53:06,509::task::595::TaskManager.Task::(_updateState) Task=`9674c16a-8d71-4206-abf0-1b5fc456014d`::moving from state init -> state preparing >Thread-54::INFO::2014-07-10 09:53:06,511::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-73::INFO::2014-07-10 09:53:06,511::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='c01d693b-cba0-4fed-9ad7-0aaa28912a19', volUUID='4bb5d954-2a50-4028-b299-0b43c261270c', options=None) >Thread-54::DEBUG::2014-07-10 09:53:06,512::task::1185::TaskManager.Task::(prepare) Task=`ef49236e-21f3-4f5b-a111-cb2ab21a4b69`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-73::INFO::2014-07-10 09:53:06,513::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-54::DEBUG::2014-07-10 09:53:06,513::task::595::TaskManager.Task::(_updateState) Task=`ef49236e-21f3-4f5b-a111-cb2ab21a4b69`::moving from state preparing -> state finished >Thread-73::DEBUG::2014-07-10 09:53:06,514::task::1185::TaskManager.Task::(prepare) Task=`9674c16a-8d71-4206-abf0-1b5fc456014d`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-54::DEBUG::2014-07-10 09:53:06,514::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-73::DEBUG::2014-07-10 09:53:06,515::task::595::TaskManager.Task::(_updateState) Task=`9674c16a-8d71-4206-abf0-1b5fc456014d`::moving from state preparing -> state finished >Thread-54::DEBUG::2014-07-10 09:53:06,516::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-73::DEBUG::2014-07-10 09:53:06,517::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-54::DEBUG::2014-07-10 09:53:06,517::task::990::TaskManager.Task::(_decref) Task=`ef49236e-21f3-4f5b-a111-cb2ab21a4b69`::ref 0 aborting False >Thread-73::DEBUG::2014-07-10 09:53:06,518::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-73::DEBUG::2014-07-10 09:53:06,519::task::990::TaskManager.Task::(_decref) Task=`9674c16a-8d71-4206-abf0-1b5fc456014d`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 09:53:07,972::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:53:08,067::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0388203 s, 26.4 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:53:10,083::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:53:10,174::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.032347 s, 31.7 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:53:12,189::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:53:12,277::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0296438 s, 34.5 MB/s\n'; <rc> = 0 >Thread-40::DEBUG::2014-07-10 09:53:12,846::domainMonitor::192::Storage.DomainMonitorThread::(_monitorDomain) Refreshing domain 6a70504d-00df-4869-8695-0f442053f6b6 >Thread-40::DEBUG::2014-07-10 09:53:12,876::fileSD::150::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/lion.qa.lab.tlv.redhat.com:_export_yuri2_backup2/6a70504d-00df-4869-8695-0f442053f6b6 >Thread-40::DEBUG::2014-07-10 09:53:12,880::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend >Thread-40::DEBUG::2014-07-10 09:53:12,883::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Backup', 'DESCRIPTION=test', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=0', 'POOL_UUID=4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', 'REMOTE_PATH=lion.qa.lab.tlv.redhat.com:/export/yuri2/backup2', 'ROLE=Regular', 'SDUUID=6a70504d-00df-4869-8695-0f442053f6b6', 'TYPE=NFS', 'VERSION=0', '_SHA_CKSUM=aab6b8e901ec435cd5f9de3c9e3f8b45dca569e0'] >Thread-40::DEBUG::2014-07-10 09:53:12,885::fileSD::609::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images [] >Thread-40::INFO::2014-07-10 09:53:12,885::sd::384::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 6a70504d-00df-4869-8695-0f442053f6b6_imageNS already registered >Thread-40::INFO::2014-07-10 09:53:12,886::sd::392::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 6a70504d-00df-4869-8695-0f442053f6b6_volumeNS already registered >Thread-40::DEBUG::2014-07-10 09:53:12,912::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lion.qa.lab.tlv.redhat.com:_export_yuri2_backup2/6a70504d-00df-4869-8695-0f442053f6b6/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-40::DEBUG::2014-07-10 09:53:12,931::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n369 bytes (369 B) copied, 0.000452023 s, 816 kB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:53:14,292::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:53:14,380::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0332852 s, 30.8 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 09:53:15,023::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-14::DEBUG::2014-07-10 09:53:15,024::task::595::TaskManager.Task::(_updateState) Task=`2d20a8f9-85da-4c00-93ec-275463852ce7`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 09:53:15,024::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-14::INFO::2014-07-10 09:53:15,024::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:53:15,025::task::1185::TaskManager.Task::(prepare) Task=`2d20a8f9-85da-4c00-93ec-275463852ce7`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:53:15,025::task::595::TaskManager.Task::(_updateState) Task=`2d20a8f9-85da-4c00-93ec-275463852ce7`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 09:53:15,025::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 09:53:15,025::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 09:53:15,025::task::990::TaskManager.Task::(_decref) Task=`2d20a8f9-85da-4c00-93ec-275463852ce7`::ref 0 aborting False >Thread-34::DEBUG::2014-07-10 09:53:15,029::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-34::DEBUG::2014-07-10 09:53:15,030::task::595::TaskManager.Task::(_updateState) Task=`3394d8d3-da14-4230-a9e7-0b6784dadc3a`::moving from state init -> state preparing >Thread-34::INFO::2014-07-10 09:53:15,030::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-34::DEBUG::2014-07-10 09:53:15,031::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`9a3a4cf4-3cc9-45ce-ac51-5f5d5e2c0eff`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-10 09:53:15,031::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' for lock type 'shared' >Thread-34::DEBUG::2014-07-10 09:53:15,031::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-10 09:53:15,031::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`9a3a4cf4-3cc9-45ce-ac51-5f5d5e2c0eff`::Granted request >Thread-34::DEBUG::2014-07-10 09:53:15,032::task::827::TaskManager.Task::(resourceAcquired) Task=`3394d8d3-da14-4230-a9e7-0b6784dadc3a`::_resourcesAcquired: Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee (shared) >Thread-34::DEBUG::2014-07-10 09:53:15,032::task::990::TaskManager.Task::(_decref) Task=`3394d8d3-da14-4230-a9e7-0b6784dadc3a`::ref 1 aborting False >Thread-34::INFO::2014-07-10 09:53:15,034::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '531976159232', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:53:15,035::task::1185::TaskManager.Task::(prepare) Task=`3394d8d3-da14-4230-a9e7-0b6784dadc3a`::finished: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '531976159232', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:53:15,035::task::595::TaskManager.Task::(_updateState) Task=`3394d8d3-da14-4230-a9e7-0b6784dadc3a`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-10 09:53:15,035::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee': < ResourceRef 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-10 09:53:15,035::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-10 09:53:15,035::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' >Thread-34::DEBUG::2014-07-10 09:53:15,036::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' (0 active users) >Thread-34::DEBUG::2014-07-10 09:53:15,036::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-10 09:53:15,036::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', Clearing records. >Thread-34::DEBUG::2014-07-10 09:53:15,036::task::990::TaskManager.Task::(_decref) Task=`3394d8d3-da14-4230-a9e7-0b6784dadc3a`::ref 0 aborting False >Thread-18::DEBUG::2014-07-10 09:53:15,904::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/metadata bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-10 09:53:15,926::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000782097 s, 5.2 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:53:16,395::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:53:16,488::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0382447 s, 26.8 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 09:53:17,932::task::595::TaskManager.Task::(_updateState) Task=`300affc0-2143-4fc3-b101-83cdad1d6335`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 09:53:17,933::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::INFO::2014-07-10 09:53:17,933::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000782097', 'lastCheck': '2.0', 'valid': True}, '6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000452023', 'lastCheck': '5.0', 'valid': True}} >Thread-14::DEBUG::2014-07-10 09:53:17,933::task::1185::TaskManager.Task::(prepare) Task=`300affc0-2143-4fc3-b101-83cdad1d6335`::finished: {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000782097', 'lastCheck': '2.0', 'valid': True}, '6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000452023', 'lastCheck': '5.0', 'valid': True}} >Thread-14::DEBUG::2014-07-10 09:53:17,933::task::595::TaskManager.Task::(_updateState) Task=`300affc0-2143-4fc3-b101-83cdad1d6335`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 09:53:17,934::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 09:53:17,934::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 09:53:17,934::task::990::TaskManager.Task::(_decref) Task=`300affc0-2143-4fc3-b101-83cdad1d6335`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 09:53:18,504::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:53:18,592::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0330132 s, 31.0 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:53:20,608::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:53:20,705::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0367448 s, 27.9 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:53:22,720::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:53:22,808::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0302729 s, 33.8 MB/s\n'; <rc> = 0 >Thread-40::DEBUG::2014-07-10 09:53:22,961::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lion.qa.lab.tlv.redhat.com:_export_yuri2_backup2/6a70504d-00df-4869-8695-0f442053f6b6/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-40::DEBUG::2014-07-10 09:53:22,980::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n369 bytes (369 B) copied, 0.000505619 s, 730 kB/s\n'; <rc> = 0 >Thread-57::DEBUG::2014-07-10 09:53:23,715::task::595::TaskManager.Task::(_updateState) Task=`c1153f9a-cda3-4c92-a70a-fe757176a8e1`::moving from state init -> state preparing >Thread-57::INFO::2014-07-10 09:53:23,715::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='b6f6c0da-e67f-4902-b9ac-3069571a42fe', volUUID='c4cd1da8-05b7-45e0-80b1-1183d21443d9', options=None) >Thread-57::INFO::2014-07-10 09:53:23,716::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-57::DEBUG::2014-07-10 09:53:23,716::task::1185::TaskManager.Task::(prepare) Task=`c1153f9a-cda3-4c92-a70a-fe757176a8e1`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-57::DEBUG::2014-07-10 09:53:23,716::task::595::TaskManager.Task::(_updateState) Task=`c1153f9a-cda3-4c92-a70a-fe757176a8e1`::moving from state preparing -> state finished >Thread-57::DEBUG::2014-07-10 09:53:23,716::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-57::DEBUG::2014-07-10 09:53:23,717::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-57::DEBUG::2014-07-10 09:53:23,717::task::990::TaskManager.Task::(_decref) Task=`c1153f9a-cda3-4c92-a70a-fe757176a8e1`::ref 0 aborting False >Thread-67::DEBUG::2014-07-10 09:53:24,554::task::595::TaskManager.Task::(_updateState) Task=`ea9be71d-ec8f-41f6-8048-49f7f4031842`::moving from state init -> state preparing >Thread-67::INFO::2014-07-10 09:53:24,554::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='f30c2cb7-a43a-4bf5-82b5-cfe07336f65c', volUUID='b0fbb3c9-55af-4a3a-95ad-fc56a80b9cf5', options=None) >Thread-67::INFO::2014-07-10 09:53:24,555::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-67::DEBUG::2014-07-10 09:53:24,555::task::1185::TaskManager.Task::(prepare) Task=`ea9be71d-ec8f-41f6-8048-49f7f4031842`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-67::DEBUG::2014-07-10 09:53:24,555::task::595::TaskManager.Task::(_updateState) Task=`ea9be71d-ec8f-41f6-8048-49f7f4031842`::moving from state preparing -> state finished >Thread-67::DEBUG::2014-07-10 09:53:24,555::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-67::DEBUG::2014-07-10 09:53:24,555::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-67::DEBUG::2014-07-10 09:53:24,556::task::990::TaskManager.Task::(_decref) Task=`ea9be71d-ec8f-41f6-8048-49f7f4031842`::ref 0 aborting False >Thread-48::DEBUG::2014-07-10 09:53:24,750::task::595::TaskManager.Task::(_updateState) Task=`93825bac-9493-4e62-93d3-c8207848844d`::moving from state init -> state preparing >Thread-48::INFO::2014-07-10 09:53:24,750::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='0cd7d6ce-f497-4243-a690-c57744861eea', volUUID='10b6a7dd-dc6c-43fa-ba17-92e4331b0e0b', options=None) >Thread-48::INFO::2014-07-10 09:53:24,751::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-48::DEBUG::2014-07-10 09:53:24,751::task::1185::TaskManager.Task::(prepare) Task=`93825bac-9493-4e62-93d3-c8207848844d`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-48::DEBUG::2014-07-10 09:53:24,751::task::595::TaskManager.Task::(_updateState) Task=`93825bac-9493-4e62-93d3-c8207848844d`::moving from state preparing -> state finished >Thread-48::DEBUG::2014-07-10 09:53:24,751::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-48::DEBUG::2014-07-10 09:53:24,752::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-48::DEBUG::2014-07-10 09:53:24,752::task::990::TaskManager.Task::(_decref) Task=`93825bac-9493-4e62-93d3-c8207848844d`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 09:53:24,862::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:53:24,985::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0679853 s, 15.1 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 09:53:25,066::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-14::DEBUG::2014-07-10 09:53:25,067::task::595::TaskManager.Task::(_updateState) Task=`8e7fa9ee-d1bf-4ed3-95aa-17d8260fcdd3`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 09:53:25,067::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-14::INFO::2014-07-10 09:53:25,068::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:53:25,068::task::1185::TaskManager.Task::(prepare) Task=`8e7fa9ee-d1bf-4ed3-95aa-17d8260fcdd3`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:53:25,068::task::595::TaskManager.Task::(_updateState) Task=`8e7fa9ee-d1bf-4ed3-95aa-17d8260fcdd3`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 09:53:25,069::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 09:53:25,069::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 09:53:25,069::task::990::TaskManager.Task::(_decref) Task=`8e7fa9ee-d1bf-4ed3-95aa-17d8260fcdd3`::ref 0 aborting False >Thread-34::DEBUG::2014-07-10 09:53:25,073::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-34::DEBUG::2014-07-10 09:53:25,074::task::595::TaskManager.Task::(_updateState) Task=`07350014-04d7-4130-9303-0b17bb2528fb`::moving from state init -> state preparing >Thread-34::INFO::2014-07-10 09:53:25,074::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-34::DEBUG::2014-07-10 09:53:25,075::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`d4ff1e58-6dd8-4d2c-ac50-bd8a91e26415`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-10 09:53:25,075::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' for lock type 'shared' >Thread-34::DEBUG::2014-07-10 09:53:25,075::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-10 09:53:25,076::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`d4ff1e58-6dd8-4d2c-ac50-bd8a91e26415`::Granted request >Thread-34::DEBUG::2014-07-10 09:53:25,076::task::827::TaskManager.Task::(resourceAcquired) Task=`07350014-04d7-4130-9303-0b17bb2528fb`::_resourcesAcquired: Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee (shared) >Thread-34::DEBUG::2014-07-10 09:53:25,076::task::990::TaskManager.Task::(_decref) Task=`07350014-04d7-4130-9303-0b17bb2528fb`::ref 1 aborting False >Thread-34::INFO::2014-07-10 09:53:25,078::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '531976159232', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:53:25,078::task::1185::TaskManager.Task::(prepare) Task=`07350014-04d7-4130-9303-0b17bb2528fb`::finished: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '531976159232', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:53:25,078::task::595::TaskManager.Task::(_updateState) Task=`07350014-04d7-4130-9303-0b17bb2528fb`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-10 09:53:25,078::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee': < ResourceRef 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-10 09:53:25,078::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-10 09:53:25,079::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' >Thread-34::DEBUG::2014-07-10 09:53:25,079::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' (0 active users) >Thread-34::DEBUG::2014-07-10 09:53:25,079::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-10 09:53:25,079::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', Clearing records. >Thread-34::DEBUG::2014-07-10 09:53:25,079::task::990::TaskManager.Task::(_decref) Task=`07350014-04d7-4130-9303-0b17bb2528fb`::ref 0 aborting False >Thread-18::DEBUG::2014-07-10 09:53:25,955::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/metadata bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-10 09:53:25,983::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00682149 s, 600 kB/s\n'; <rc> = 0 >Thread-76::DEBUG::2014-07-10 09:53:26,398::task::595::TaskManager.Task::(_updateState) Task=`8a57d365-e863-4f04-ae43-28113dfb4996`::moving from state init -> state preparing >Thread-76::INFO::2014-07-10 09:53:26,399::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='e4c65229-4247-4b33-b72a-f1d5ce72ad05', volUUID='cad94284-3ca9-4c30-933d-997f4460309e', options=None) >Thread-76::INFO::2014-07-10 09:53:26,400::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-76::DEBUG::2014-07-10 09:53:26,400::task::1185::TaskManager.Task::(prepare) Task=`8a57d365-e863-4f04-ae43-28113dfb4996`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-76::DEBUG::2014-07-10 09:53:26,400::task::595::TaskManager.Task::(_updateState) Task=`8a57d365-e863-4f04-ae43-28113dfb4996`::moving from state preparing -> state finished >Thread-76::DEBUG::2014-07-10 09:53:26,400::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-76::DEBUG::2014-07-10 09:53:26,400::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-76::DEBUG::2014-07-10 09:53:26,401::task::990::TaskManager.Task::(_decref) Task=`8a57d365-e863-4f04-ae43-28113dfb4996`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 09:53:27,000::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:53:27,104::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0301299 s, 34.0 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:53:29,120::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:53:29,218::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.037524 s, 27.3 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:53:31,233::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:53:31,344::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0321889 s, 31.8 MB/s\n'; <rc> = 0 >Thread-40::DEBUG::2014-07-10 09:53:33,005::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lion.qa.lab.tlv.redhat.com:_export_yuri2_backup2/6a70504d-00df-4869-8695-0f442053f6b6/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-40::DEBUG::2014-07-10 09:53:33,026::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n369 bytes (369 B) copied, 0.000380091 s, 971 kB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 09:53:33,110::task::595::TaskManager.Task::(_updateState) Task=`b556152f-5211-4d75-a1ab-f70575f0b679`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 09:53:33,111::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::INFO::2014-07-10 09:53:33,111::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00682149', 'lastCheck': '7.1', 'valid': True}, '6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000380091', 'lastCheck': '0.1', 'valid': True}} >Thread-14::DEBUG::2014-07-10 09:53:33,111::task::1185::TaskManager.Task::(prepare) Task=`b556152f-5211-4d75-a1ab-f70575f0b679`::finished: {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00682149', 'lastCheck': '7.1', 'valid': True}, '6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000380091', 'lastCheck': '0.1', 'valid': True}} >Thread-14::DEBUG::2014-07-10 09:53:33,112::task::595::TaskManager.Task::(_updateState) Task=`b556152f-5211-4d75-a1ab-f70575f0b679`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 09:53:33,112::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 09:53:33,112::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 09:53:33,112::task::990::TaskManager.Task::(_decref) Task=`b556152f-5211-4d75-a1ab-f70575f0b679`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 09:53:33,359::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:53:33,457::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0378798 s, 27.0 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 09:53:35,109::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-14::DEBUG::2014-07-10 09:53:35,111::task::595::TaskManager.Task::(_updateState) Task=`a359051e-4a0b-4aa7-aef8-96632bdd69c0`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 09:53:35,115::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-14::INFO::2014-07-10 09:53:35,118::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:53:35,120::task::1185::TaskManager.Task::(prepare) Task=`a359051e-4a0b-4aa7-aef8-96632bdd69c0`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:53:35,122::task::595::TaskManager.Task::(_updateState) Task=`a359051e-4a0b-4aa7-aef8-96632bdd69c0`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 09:53:35,124::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 09:53:35,126::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 09:53:35,129::task::990::TaskManager.Task::(_decref) Task=`a359051e-4a0b-4aa7-aef8-96632bdd69c0`::ref 0 aborting False >Thread-34::DEBUG::2014-07-10 09:53:35,175::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-34::DEBUG::2014-07-10 09:53:35,175::task::595::TaskManager.Task::(_updateState) Task=`0f7abafa-6011-4f72-8d44-e3d827af1c5d`::moving from state init -> state preparing >Thread-34::INFO::2014-07-10 09:53:35,175::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-34::DEBUG::2014-07-10 09:53:35,176::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`7466fd0e-0822-448f-b711-4cc09c9fbb04`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-10 09:53:35,176::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' for lock type 'shared' >Thread-34::DEBUG::2014-07-10 09:53:35,177::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-10 09:53:35,177::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`7466fd0e-0822-448f-b711-4cc09c9fbb04`::Granted request >Thread-34::DEBUG::2014-07-10 09:53:35,177::task::827::TaskManager.Task::(resourceAcquired) Task=`0f7abafa-6011-4f72-8d44-e3d827af1c5d`::_resourcesAcquired: Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee (shared) >Thread-34::DEBUG::2014-07-10 09:53:35,177::task::990::TaskManager.Task::(_decref) Task=`0f7abafa-6011-4f72-8d44-e3d827af1c5d`::ref 1 aborting False >Thread-34::INFO::2014-07-10 09:53:35,179::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '531976159232', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:53:35,179::task::1185::TaskManager.Task::(prepare) Task=`0f7abafa-6011-4f72-8d44-e3d827af1c5d`::finished: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '531976159232', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:53:35,179::task::595::TaskManager.Task::(_updateState) Task=`0f7abafa-6011-4f72-8d44-e3d827af1c5d`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-10 09:53:35,179::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee': < ResourceRef 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-10 09:53:35,180::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-10 09:53:35,180::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' >Thread-34::DEBUG::2014-07-10 09:53:35,180::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' (0 active users) >Thread-34::DEBUG::2014-07-10 09:53:35,180::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-10 09:53:35,180::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', Clearing records. >Thread-34::DEBUG::2014-07-10 09:53:35,181::task::990::TaskManager.Task::(_decref) Task=`0f7abafa-6011-4f72-8d44-e3d827af1c5d`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 09:53:35,472::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:53:35,566::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0360417 s, 28.4 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-10 09:53:36,034::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/metadata bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-10 09:53:36,055::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00087181 s, 4.7 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:53:37,581::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:53:37,687::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0478164 s, 21.4 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:53:39,703::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:53:39,804::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0294866 s, 34.7 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:53:41,820::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:53:41,913::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0367991 s, 27.8 MB/s\n'; <rc> = 0 >Thread-40::DEBUG::2014-07-10 09:53:43,053::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lion.qa.lab.tlv.redhat.com:_export_yuri2_backup2/6a70504d-00df-4869-8695-0f442053f6b6/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-40::DEBUG::2014-07-10 09:53:43,072::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n369 bytes (369 B) copied, 0.000442117 s, 835 kB/s\n'; <rc> = 0 >Thread-70::DEBUG::2014-07-10 09:53:43,419::task::595::TaskManager.Task::(_updateState) Task=`37e5b451-ba85-4df3-9a05-944feed43320`::moving from state init -> state preparing >Thread-70::INFO::2014-07-10 09:53:43,420::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='cfaeead2-7caa-467c-b389-c89840ae6605', volUUID='567fe32d-31a6-4ff6-90f3-fd6a656fbecc', options=None) >Thread-70::INFO::2014-07-10 09:53:43,420::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-70::DEBUG::2014-07-10 09:53:43,421::task::1185::TaskManager.Task::(prepare) Task=`37e5b451-ba85-4df3-9a05-944feed43320`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-70::DEBUG::2014-07-10 09:53:43,421::task::595::TaskManager.Task::(_updateState) Task=`37e5b451-ba85-4df3-9a05-944feed43320`::moving from state preparing -> state finished >Thread-70::DEBUG::2014-07-10 09:53:43,421::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-70::DEBUG::2014-07-10 09:53:43,421::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-70::DEBUG::2014-07-10 09:53:43,422::task::990::TaskManager.Task::(_decref) Task=`37e5b451-ba85-4df3-9a05-944feed43320`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 09:53:43,928::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:53:44,036::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0495094 s, 20.7 MB/s\n'; <rc> = 0 >Thread-60::DEBUG::2014-07-10 09:53:45,108::task::595::TaskManager.Task::(_updateState) Task=`2a88f986-6b17-4cca-856a-7d2dad0f7964`::moving from state init -> state preparing >Thread-51::DEBUG::2014-07-10 09:53:45,108::task::595::TaskManager.Task::(_updateState) Task=`7a318783-d75b-40c2-97df-270ead20f321`::moving from state init -> state preparing >Thread-60::INFO::2014-07-10 09:53:45,109::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='b034d5b0-e1e0-4011-b49b-4d45ddb11556', volUUID='3d7f62b5-328f-4d8e-8b69-873cfb5ae14d', options=None) >Thread-51::INFO::2014-07-10 09:53:45,109::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='76fdb054-02cd-42ed-9721-b3e65b34c3a4', volUUID='022dfe46-2cf7-4915-80b3-883158e3ca83', options=None) >Thread-60::INFO::2014-07-10 09:53:45,110::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-51::INFO::2014-07-10 09:53:45,110::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-60::DEBUG::2014-07-10 09:53:45,110::task::1185::TaskManager.Task::(prepare) Task=`2a88f986-6b17-4cca-856a-7d2dad0f7964`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-51::DEBUG::2014-07-10 09:53:45,111::task::1185::TaskManager.Task::(prepare) Task=`7a318783-d75b-40c2-97df-270ead20f321`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-60::DEBUG::2014-07-10 09:53:45,111::task::595::TaskManager.Task::(_updateState) Task=`2a88f986-6b17-4cca-856a-7d2dad0f7964`::moving from state preparing -> state finished >Thread-51::DEBUG::2014-07-10 09:53:45,111::task::595::TaskManager.Task::(_updateState) Task=`7a318783-d75b-40c2-97df-270ead20f321`::moving from state preparing -> state finished >Thread-60::DEBUG::2014-07-10 09:53:45,111::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-51::DEBUG::2014-07-10 09:53:45,112::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-60::DEBUG::2014-07-10 09:53:45,112::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-51::DEBUG::2014-07-10 09:53:45,112::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-60::DEBUG::2014-07-10 09:53:45,112::task::990::TaskManager.Task::(_decref) Task=`2a88f986-6b17-4cca-856a-7d2dad0f7964`::ref 0 aborting False >Thread-51::DEBUG::2014-07-10 09:53:45,112::task::990::TaskManager.Task::(_decref) Task=`7a318783-d75b-40c2-97df-270ead20f321`::ref 0 aborting False >Thread-14::DEBUG::2014-07-10 09:53:45,207::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-14::DEBUG::2014-07-10 09:53:45,208::task::595::TaskManager.Task::(_updateState) Task=`a119cff7-2332-4d16-985e-08a2ffda1fbe`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 09:53:45,208::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-14::INFO::2014-07-10 09:53:45,209::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:53:45,209::task::1185::TaskManager.Task::(prepare) Task=`a119cff7-2332-4d16-985e-08a2ffda1fbe`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:53:45,209::task::595::TaskManager.Task::(_updateState) Task=`a119cff7-2332-4d16-985e-08a2ffda1fbe`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 09:53:45,210::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 09:53:45,210::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 09:53:45,210::task::990::TaskManager.Task::(_decref) Task=`a119cff7-2332-4d16-985e-08a2ffda1fbe`::ref 0 aborting False >Thread-34::DEBUG::2014-07-10 09:53:45,214::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-34::DEBUG::2014-07-10 09:53:45,214::task::595::TaskManager.Task::(_updateState) Task=`dab2461d-5a06-471e-965a-2fadbd4b89e5`::moving from state init -> state preparing >Thread-34::INFO::2014-07-10 09:53:45,214::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-34::DEBUG::2014-07-10 09:53:45,215::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`1e0d3da7-1a98-45ab-b812-8ab54f30ebca`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-10 09:53:45,215::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' for lock type 'shared' >Thread-34::DEBUG::2014-07-10 09:53:45,216::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-10 09:53:45,216::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`1e0d3da7-1a98-45ab-b812-8ab54f30ebca`::Granted request >Thread-34::DEBUG::2014-07-10 09:53:45,216::task::827::TaskManager.Task::(resourceAcquired) Task=`dab2461d-5a06-471e-965a-2fadbd4b89e5`::_resourcesAcquired: Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee (shared) >Thread-34::DEBUG::2014-07-10 09:53:45,216::task::990::TaskManager.Task::(_decref) Task=`dab2461d-5a06-471e-965a-2fadbd4b89e5`::ref 1 aborting False >Thread-34::INFO::2014-07-10 09:53:45,217::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '531976159232', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:53:45,217::task::1185::TaskManager.Task::(prepare) Task=`dab2461d-5a06-471e-965a-2fadbd4b89e5`::finished: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '531976159232', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:53:45,218::task::595::TaskManager.Task::(_updateState) Task=`dab2461d-5a06-471e-965a-2fadbd4b89e5`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-10 09:53:45,218::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee': < ResourceRef 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-10 09:53:45,218::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-10 09:53:45,218::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' >Thread-34::DEBUG::2014-07-10 09:53:45,218::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' (0 active users) >Thread-34::DEBUG::2014-07-10 09:53:45,219::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-10 09:53:45,219::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', Clearing records. >Thread-34::DEBUG::2014-07-10 09:53:45,219::task::990::TaskManager.Task::(_decref) Task=`dab2461d-5a06-471e-965a-2fadbd4b89e5`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 09:53:46,051::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Thread-18::DEBUG::2014-07-10 09:53:46,085::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/metadata bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-10 09:53:46,125::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000461215 s, 8.9 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:53:46,359::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.211937 s, 4.8 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 09:53:48,349::task::595::TaskManager.Task::(_updateState) Task=`a672e55e-765e-43fc-a317-2fdbba393bd4`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 09:53:48,350::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::INFO::2014-07-10 09:53:48,350::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000461215', 'lastCheck': '2.0', 'valid': True}, '6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000442117', 'lastCheck': '5.3', 'valid': True}} >Thread-14::DEBUG::2014-07-10 09:53:48,351::task::1185::TaskManager.Task::(prepare) Task=`a672e55e-765e-43fc-a317-2fdbba393bd4`::finished: {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000461215', 'lastCheck': '2.0', 'valid': True}, '6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000442117', 'lastCheck': '5.3', 'valid': True}} >Thread-14::DEBUG::2014-07-10 09:53:48,351::task::595::TaskManager.Task::(_updateState) Task=`a672e55e-765e-43fc-a317-2fdbba393bd4`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 09:53:48,351::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 09:53:48,351::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 09:53:48,351::task::990::TaskManager.Task::(_decref) Task=`a672e55e-765e-43fc-a317-2fdbba393bd4`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 09:53:48,375::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:53:48,474::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0318718 s, 32.1 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:53:50,489::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:53:50,596::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0492055 s, 20.8 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:53:52,612::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:53:52,709::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0372034 s, 27.5 MB/s\n'; <rc> = 0 >Thread-40::DEBUG::2014-07-10 09:53:53,102::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lion.qa.lab.tlv.redhat.com:_export_yuri2_backup2/6a70504d-00df-4869-8695-0f442053f6b6/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-40::DEBUG::2014-07-10 09:53:53,122::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n369 bytes (369 B) copied, 0.000478897 s, 771 kB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:53:54,725::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:53:54,831::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0488366 s, 21.0 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 09:53:55,250::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-14::DEBUG::2014-07-10 09:53:55,251::task::595::TaskManager.Task::(_updateState) Task=`1a915fb0-9a4b-40fc-b8bd-b935a7690db5`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 09:53:55,252::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-14::INFO::2014-07-10 09:53:55,252::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:53:55,252::task::1185::TaskManager.Task::(prepare) Task=`1a915fb0-9a4b-40fc-b8bd-b935a7690db5`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:53:55,253::task::595::TaskManager.Task::(_updateState) Task=`1a915fb0-9a4b-40fc-b8bd-b935a7690db5`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 09:53:55,253::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 09:53:55,253::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 09:53:55,253::task::990::TaskManager.Task::(_decref) Task=`1a915fb0-9a4b-40fc-b8bd-b935a7690db5`::ref 0 aborting False >Thread-34::DEBUG::2014-07-10 09:53:55,257::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-34::DEBUG::2014-07-10 09:53:55,258::task::595::TaskManager.Task::(_updateState) Task=`8065097d-3ec5-489f-9e31-8874c9c22749`::moving from state init -> state preparing >Thread-34::INFO::2014-07-10 09:53:55,258::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-34::DEBUG::2014-07-10 09:53:55,259::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`fa968d0a-2624-4ae1-a6f7-4e0aba29ff81`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-10 09:53:55,259::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' for lock type 'shared' >Thread-34::DEBUG::2014-07-10 09:53:55,259::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-10 09:53:55,260::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`fa968d0a-2624-4ae1-a6f7-4e0aba29ff81`::Granted request >Thread-34::DEBUG::2014-07-10 09:53:55,260::task::827::TaskManager.Task::(resourceAcquired) Task=`8065097d-3ec5-489f-9e31-8874c9c22749`::_resourcesAcquired: Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee (shared) >Thread-34::DEBUG::2014-07-10 09:53:55,260::task::990::TaskManager.Task::(_decref) Task=`8065097d-3ec5-489f-9e31-8874c9c22749`::ref 1 aborting False >Thread-34::INFO::2014-07-10 09:53:55,261::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '531976159232', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:53:55,262::task::1185::TaskManager.Task::(prepare) Task=`8065097d-3ec5-489f-9e31-8874c9c22749`::finished: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '531976159232', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:53:55,262::task::595::TaskManager.Task::(_updateState) Task=`8065097d-3ec5-489f-9e31-8874c9c22749`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-10 09:53:55,262::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee': < ResourceRef 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-10 09:53:55,262::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-10 09:53:55,263::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' >Thread-34::DEBUG::2014-07-10 09:53:55,263::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' (0 active users) >Thread-34::DEBUG::2014-07-10 09:53:55,263::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-10 09:53:55,263::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', Clearing records. >Thread-34::DEBUG::2014-07-10 09:53:55,263::task::990::TaskManager.Task::(_decref) Task=`8065097d-3ec5-489f-9e31-8874c9c22749`::ref 0 aborting False >Thread-18::DEBUG::2014-07-10 09:53:56,304::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/metadata bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-10 09:53:56,330::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00589061 s, 695 kB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:53:56,851::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:53:56,962::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0494757 s, 20.7 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:53:58,972::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:53:59,060::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0294107 s, 34.8 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:54:01,076::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:54:01,161::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0268596 s, 38.1 MB/s\n'; <rc> = 0 >Thread-40::DEBUG::2014-07-10 09:54:03,148::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lion.qa.lab.tlv.redhat.com:_export_yuri2_backup2/6a70504d-00df-4869-8695-0f442053f6b6/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-40::DEBUG::2014-07-10 09:54:03,168::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n369 bytes (369 B) copied, 0.000492904 s, 749 kB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:54:03,176::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:54:03,275::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0358266 s, 28.6 MB/s\n'; <rc> = 0 >Thread-64::DEBUG::2014-07-10 09:54:03,516::task::595::TaskManager.Task::(_updateState) Task=`acb13461-5221-4ee9-8efa-4d75c14bb96b`::moving from state init -> state preparing >Thread-64::INFO::2014-07-10 09:54:03,516::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='aa20346a-4d3a-4e07-b8e1-52c0ebe4168c', volUUID='58fefce2-9bce-4bff-8949-8c6ce8122b27', options=None) >Thread-64::INFO::2014-07-10 09:54:03,517::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-64::DEBUG::2014-07-10 09:54:03,517::task::1185::TaskManager.Task::(prepare) Task=`acb13461-5221-4ee9-8efa-4d75c14bb96b`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-64::DEBUG::2014-07-10 09:54:03,517::task::595::TaskManager.Task::(_updateState) Task=`acb13461-5221-4ee9-8efa-4d75c14bb96b`::moving from state preparing -> state finished >Thread-64::DEBUG::2014-07-10 09:54:03,518::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-64::DEBUG::2014-07-10 09:54:03,520::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-64::DEBUG::2014-07-10 09:54:03,522::task::990::TaskManager.Task::(_decref) Task=`acb13461-5221-4ee9-8efa-4d75c14bb96b`::ref 0 aborting False >Thread-14::DEBUG::2014-07-10 09:54:03,552::task::595::TaskManager.Task::(_updateState) Task=`cf2a51bc-cf79-4a36-b96c-23da1a3f9c81`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 09:54:03,553::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::INFO::2014-07-10 09:54:03,553::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00589061', 'lastCheck': '7.2', 'valid': True}, '6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000492904', 'lastCheck': '0.4', 'valid': True}} >Thread-14::DEBUG::2014-07-10 09:54:03,554::task::1185::TaskManager.Task::(prepare) Task=`cf2a51bc-cf79-4a36-b96c-23da1a3f9c81`::finished: {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00589061', 'lastCheck': '7.2', 'valid': True}, '6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000492904', 'lastCheck': '0.4', 'valid': True}} >Thread-14::DEBUG::2014-07-10 09:54:03,554::task::595::TaskManager.Task::(_updateState) Task=`cf2a51bc-cf79-4a36-b96c-23da1a3f9c81`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 09:54:03,554::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 09:54:03,554::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 09:54:03,555::task::990::TaskManager.Task::(_decref) Task=`cf2a51bc-cf79-4a36-b96c-23da1a3f9c81`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 09:54:05,290::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Thread-14::DEBUG::2014-07-10 09:54:05,311::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-14::DEBUG::2014-07-10 09:54:05,314::task::595::TaskManager.Task::(_updateState) Task=`e859c79e-91b5-4518-84fe-eafe166e9195`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 09:54:05,315::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-14::INFO::2014-07-10 09:54:05,317::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:54:05,319::task::1185::TaskManager.Task::(prepare) Task=`e859c79e-91b5-4518-84fe-eafe166e9195`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:54:05,320::task::595::TaskManager.Task::(_updateState) Task=`e859c79e-91b5-4518-84fe-eafe166e9195`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 09:54:05,321::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 09:54:05,322::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 09:54:05,323::task::990::TaskManager.Task::(_decref) Task=`e859c79e-91b5-4518-84fe-eafe166e9195`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 09:54:05,396::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0484415 s, 21.1 MB/s\n'; <rc> = 0 >Thread-34::DEBUG::2014-07-10 09:54:05,526::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-34::DEBUG::2014-07-10 09:54:05,529::task::595::TaskManager.Task::(_updateState) Task=`d6c32d49-c318-4068-8723-f22e08633f18`::moving from state init -> state preparing >Thread-34::INFO::2014-07-10 09:54:05,530::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-34::DEBUG::2014-07-10 09:54:05,534::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`9cb19971-be89-4b5f-94e2-fef486684ba0`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-10 09:54:05,535::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' for lock type 'shared' >Thread-34::DEBUG::2014-07-10 09:54:05,536::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-10 09:54:05,537::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`9cb19971-be89-4b5f-94e2-fef486684ba0`::Granted request >Thread-34::DEBUG::2014-07-10 09:54:05,537::task::827::TaskManager.Task::(resourceAcquired) Task=`d6c32d49-c318-4068-8723-f22e08633f18`::_resourcesAcquired: Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee (shared) >Thread-34::DEBUG::2014-07-10 09:54:05,537::task::990::TaskManager.Task::(_decref) Task=`d6c32d49-c318-4068-8723-f22e08633f18`::ref 1 aborting False >Thread-34::INFO::2014-07-10 09:54:05,539::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '531976159232', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:54:05,539::task::1185::TaskManager.Task::(prepare) Task=`d6c32d49-c318-4068-8723-f22e08633f18`::finished: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '531976159232', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:54:05,539::task::595::TaskManager.Task::(_updateState) Task=`d6c32d49-c318-4068-8723-f22e08633f18`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-10 09:54:05,539::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee': < ResourceRef 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-10 09:54:05,540::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-10 09:54:05,540::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' >Thread-34::DEBUG::2014-07-10 09:54:05,540::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' (0 active users) >Thread-34::DEBUG::2014-07-10 09:54:05,540::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-10 09:54:05,540::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', Clearing records. >Thread-34::DEBUG::2014-07-10 09:54:05,541::task::990::TaskManager.Task::(_decref) Task=`d6c32d49-c318-4068-8723-f22e08633f18`::ref 0 aborting False >Thread-18::DEBUG::2014-07-10 09:54:06,383::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/metadata bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-10 09:54:06,412::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00961993 s, 426 kB/s\n'; <rc> = 0 >Thread-54::DEBUG::2014-07-10 09:54:06,815::task::595::TaskManager.Task::(_updateState) Task=`79bc692c-4cc3-4cae-af4b-6830d50eb8ef`::moving from state init -> state preparing >Thread-73::DEBUG::2014-07-10 09:54:06,819::task::595::TaskManager.Task::(_updateState) Task=`1f066dc1-8e85-4a0f-8781-9420475efd35`::moving from state init -> state preparing >Thread-54::INFO::2014-07-10 09:54:06,820::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='28408446-e5fd-4565-a976-e760951593fe', volUUID='776303a2-5585-451e-826e-0e338d4a1e98', options=None) >Thread-73::INFO::2014-07-10 09:54:06,823::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='c01d693b-cba0-4fed-9ad7-0aaa28912a19', volUUID='4bb5d954-2a50-4028-b299-0b43c261270c', options=None) >Thread-54::INFO::2014-07-10 09:54:06,826::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-73::INFO::2014-07-10 09:54:06,827::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-73::DEBUG::2014-07-10 09:54:06,830::task::1185::TaskManager.Task::(prepare) Task=`1f066dc1-8e85-4a0f-8781-9420475efd35`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-54::DEBUG::2014-07-10 09:54:06,830::task::1185::TaskManager.Task::(prepare) Task=`79bc692c-4cc3-4cae-af4b-6830d50eb8ef`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-73::DEBUG::2014-07-10 09:54:06,833::task::595::TaskManager.Task::(_updateState) Task=`1f066dc1-8e85-4a0f-8781-9420475efd35`::moving from state preparing -> state finished >Thread-54::DEBUG::2014-07-10 09:54:06,834::task::595::TaskManager.Task::(_updateState) Task=`79bc692c-4cc3-4cae-af4b-6830d50eb8ef`::moving from state preparing -> state finished >Thread-73::DEBUG::2014-07-10 09:54:06,835::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-54::DEBUG::2014-07-10 09:54:06,837::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-73::DEBUG::2014-07-10 09:54:06,838::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-54::DEBUG::2014-07-10 09:54:06,840::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-73::DEBUG::2014-07-10 09:54:06,841::task::990::TaskManager.Task::(_decref) Task=`1f066dc1-8e85-4a0f-8781-9420475efd35`::ref 0 aborting False >Thread-54::DEBUG::2014-07-10 09:54:06,844::task::990::TaskManager.Task::(_decref) Task=`79bc692c-4cc3-4cae-af4b-6830d50eb8ef`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 09:54:07,411::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:54:07,580::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.036626 s, 28.0 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:54:09,595::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:54:09,687::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0315332 s, 32.5 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:54:11,702::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:54:11,794::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.035773 s, 28.6 MB/s\n'; <rc> = 0 >Thread-40::DEBUG::2014-07-10 09:54:13,199::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lion.qa.lab.tlv.redhat.com:_export_yuri2_backup2/6a70504d-00df-4869-8695-0f442053f6b6/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-40::DEBUG::2014-07-10 09:54:13,219::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n369 bytes (369 B) copied, 0.000420347 s, 878 kB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:54:13,810::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:54:13,913::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0449076 s, 22.8 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 09:54:15,568::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-14::DEBUG::2014-07-10 09:54:15,569::task::595::TaskManager.Task::(_updateState) Task=`d435a816-a38b-4242-b5c0-d6a4bf787263`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 09:54:15,569::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-14::INFO::2014-07-10 09:54:15,570::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:54:15,570::task::1185::TaskManager.Task::(prepare) Task=`d435a816-a38b-4242-b5c0-d6a4bf787263`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:54:15,570::task::595::TaskManager.Task::(_updateState) Task=`d435a816-a38b-4242-b5c0-d6a4bf787263`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 09:54:15,570::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 09:54:15,570::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 09:54:15,571::task::990::TaskManager.Task::(_decref) Task=`d435a816-a38b-4242-b5c0-d6a4bf787263`::ref 0 aborting False >Thread-34::DEBUG::2014-07-10 09:54:15,575::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-34::DEBUG::2014-07-10 09:54:15,575::task::595::TaskManager.Task::(_updateState) Task=`537871b3-d13d-454a-a3da-82aa19e663d0`::moving from state init -> state preparing >Thread-34::INFO::2014-07-10 09:54:15,575::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-34::DEBUG::2014-07-10 09:54:15,576::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`ae1f6510-fa92-4252-ac45-0dfc322662c7`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-10 09:54:15,576::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' for lock type 'shared' >Thread-34::DEBUG::2014-07-10 09:54:15,577::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-10 09:54:15,577::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`ae1f6510-fa92-4252-ac45-0dfc322662c7`::Granted request >Thread-34::DEBUG::2014-07-10 09:54:15,577::task::827::TaskManager.Task::(resourceAcquired) Task=`537871b3-d13d-454a-a3da-82aa19e663d0`::_resourcesAcquired: Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee (shared) >Thread-34::DEBUG::2014-07-10 09:54:15,577::task::990::TaskManager.Task::(_decref) Task=`537871b3-d13d-454a-a3da-82aa19e663d0`::ref 1 aborting False >Thread-34::INFO::2014-07-10 09:54:15,578::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '531976159232', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:54:15,579::task::1185::TaskManager.Task::(prepare) Task=`537871b3-d13d-454a-a3da-82aa19e663d0`::finished: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '531976159232', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:54:15,579::task::595::TaskManager.Task::(_updateState) Task=`537871b3-d13d-454a-a3da-82aa19e663d0`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-10 09:54:15,579::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee': < ResourceRef 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-10 09:54:15,579::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-10 09:54:15,579::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' >Thread-34::DEBUG::2014-07-10 09:54:15,580::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' (0 active users) >Thread-34::DEBUG::2014-07-10 09:54:15,580::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-10 09:54:15,580::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', Clearing records. >Thread-34::DEBUG::2014-07-10 09:54:15,580::task::990::TaskManager.Task::(_decref) Task=`537871b3-d13d-454a-a3da-82aa19e663d0`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 09:54:15,927::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:54:16,017::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0315407 s, 32.5 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-10 09:54:16,442::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/metadata bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-10 09:54:16,464::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000646972 s, 6.3 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:54:18,033::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:54:18,120::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0271666 s, 37.7 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 09:54:18,735::task::595::TaskManager.Task::(_updateState) Task=`9b85cee2-94c1-487e-af51-cd7e7d8dabc3`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 09:54:18,735::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::INFO::2014-07-10 09:54:18,736::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000646972', 'lastCheck': '2.2', 'valid': True}, '6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000420347', 'lastCheck': '5.5', 'valid': True}} >Thread-14::DEBUG::2014-07-10 09:54:18,736::task::1185::TaskManager.Task::(prepare) Task=`9b85cee2-94c1-487e-af51-cd7e7d8dabc3`::finished: {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000646972', 'lastCheck': '2.2', 'valid': True}, '6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000420347', 'lastCheck': '5.5', 'valid': True}} >Thread-14::DEBUG::2014-07-10 09:54:18,736::task::595::TaskManager.Task::(_updateState) Task=`9b85cee2-94c1-487e-af51-cd7e7d8dabc3`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 09:54:18,736::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 09:54:18,737::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 09:54:18,737::task::990::TaskManager.Task::(_decref) Task=`9b85cee2-94c1-487e-af51-cd7e7d8dabc3`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 09:54:20,137::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:54:20,241::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.046608 s, 22.0 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:54:22,269::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:54:22,354::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0278272 s, 36.8 MB/s\n'; <rc> = 0 >Thread-40::DEBUG::2014-07-10 09:54:23,250::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lion.qa.lab.tlv.redhat.com:_export_yuri2_backup2/6a70504d-00df-4869-8695-0f442053f6b6/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-40::DEBUG::2014-07-10 09:54:23,271::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n369 bytes (369 B) copied, 0.000605504 s, 609 kB/s\n'; <rc> = 0 >Thread-57::DEBUG::2014-07-10 09:54:23,988::task::595::TaskManager.Task::(_updateState) Task=`b59497d8-76b4-4f39-bcc9-70befca36737`::moving from state init -> state preparing >Thread-57::INFO::2014-07-10 09:54:23,991::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='b6f6c0da-e67f-4902-b9ac-3069571a42fe', volUUID='c4cd1da8-05b7-45e0-80b1-1183d21443d9', options=None) >Thread-57::INFO::2014-07-10 09:54:23,991::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-57::DEBUG::2014-07-10 09:54:23,992::task::1185::TaskManager.Task::(prepare) Task=`b59497d8-76b4-4f39-bcc9-70befca36737`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-57::DEBUG::2014-07-10 09:54:23,992::task::595::TaskManager.Task::(_updateState) Task=`b59497d8-76b4-4f39-bcc9-70befca36737`::moving from state preparing -> state finished >Thread-57::DEBUG::2014-07-10 09:54:23,992::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-57::DEBUG::2014-07-10 09:54:23,992::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-57::DEBUG::2014-07-10 09:54:23,992::task::990::TaskManager.Task::(_decref) Task=`b59497d8-76b4-4f39-bcc9-70befca36737`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 09:54:24,370::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:54:24,459::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0320362 s, 32.0 MB/s\n'; <rc> = 0 >Thread-67::DEBUG::2014-07-10 09:54:24,860::task::595::TaskManager.Task::(_updateState) Task=`67b4063c-6998-4306-ab00-cb3a7c130c9e`::moving from state init -> state preparing >Thread-67::INFO::2014-07-10 09:54:24,860::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='f30c2cb7-a43a-4bf5-82b5-cfe07336f65c', volUUID='b0fbb3c9-55af-4a3a-95ad-fc56a80b9cf5', options=None) >Thread-67::INFO::2014-07-10 09:54:24,861::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-67::DEBUG::2014-07-10 09:54:24,861::task::1185::TaskManager.Task::(prepare) Task=`67b4063c-6998-4306-ab00-cb3a7c130c9e`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-67::DEBUG::2014-07-10 09:54:24,861::task::595::TaskManager.Task::(_updateState) Task=`67b4063c-6998-4306-ab00-cb3a7c130c9e`::moving from state preparing -> state finished >Thread-67::DEBUG::2014-07-10 09:54:24,862::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-67::DEBUG::2014-07-10 09:54:24,862::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-67::DEBUG::2014-07-10 09:54:24,862::task::990::TaskManager.Task::(_decref) Task=`67b4063c-6998-4306-ab00-cb3a7c130c9e`::ref 0 aborting False >Thread-48::DEBUG::2014-07-10 09:54:25,006::task::595::TaskManager.Task::(_updateState) Task=`dc71e2e3-e339-44b0-8054-4fd392dd3c37`::moving from state init -> state preparing >Thread-48::INFO::2014-07-10 09:54:25,007::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='0cd7d6ce-f497-4243-a690-c57744861eea', volUUID='10b6a7dd-dc6c-43fa-ba17-92e4331b0e0b', options=None) >Thread-48::INFO::2014-07-10 09:54:25,007::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-48::DEBUG::2014-07-10 09:54:25,007::task::1185::TaskManager.Task::(prepare) Task=`dc71e2e3-e339-44b0-8054-4fd392dd3c37`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-48::DEBUG::2014-07-10 09:54:25,007::task::595::TaskManager.Task::(_updateState) Task=`dc71e2e3-e339-44b0-8054-4fd392dd3c37`::moving from state preparing -> state finished >Thread-48::DEBUG::2014-07-10 09:54:25,008::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-48::DEBUG::2014-07-10 09:54:25,008::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-48::DEBUG::2014-07-10 09:54:25,008::task::990::TaskManager.Task::(_decref) Task=`dc71e2e3-e339-44b0-8054-4fd392dd3c37`::ref 0 aborting False >Thread-14::DEBUG::2014-07-10 09:54:25,608::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-14::DEBUG::2014-07-10 09:54:25,609::task::595::TaskManager.Task::(_updateState) Task=`e9e36fc4-1cf7-42e6-a6a3-fd7db8aab954`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 09:54:25,610::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-14::INFO::2014-07-10 09:54:25,610::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:54:25,610::task::1185::TaskManager.Task::(prepare) Task=`e9e36fc4-1cf7-42e6-a6a3-fd7db8aab954`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:54:25,611::task::595::TaskManager.Task::(_updateState) Task=`e9e36fc4-1cf7-42e6-a6a3-fd7db8aab954`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 09:54:25,611::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 09:54:25,611::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 09:54:25,611::task::990::TaskManager.Task::(_decref) Task=`e9e36fc4-1cf7-42e6-a6a3-fd7db8aab954`::ref 0 aborting False >Thread-34::DEBUG::2014-07-10 09:54:25,615::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-34::DEBUG::2014-07-10 09:54:25,616::task::595::TaskManager.Task::(_updateState) Task=`685bc566-94a4-4b07-9425-fd22f1e30aef`::moving from state init -> state preparing >Thread-34::INFO::2014-07-10 09:54:25,616::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-34::DEBUG::2014-07-10 09:54:25,617::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`9236cf58-a07b-43f9-b919-0ef93d22a811`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-10 09:54:25,617::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' for lock type 'shared' >Thread-34::DEBUG::2014-07-10 09:54:25,617::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-10 09:54:25,617::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`9236cf58-a07b-43f9-b919-0ef93d22a811`::Granted request >Thread-34::DEBUG::2014-07-10 09:54:25,618::task::827::TaskManager.Task::(resourceAcquired) Task=`685bc566-94a4-4b07-9425-fd22f1e30aef`::_resourcesAcquired: Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee (shared) >Thread-34::DEBUG::2014-07-10 09:54:25,618::task::990::TaskManager.Task::(_decref) Task=`685bc566-94a4-4b07-9425-fd22f1e30aef`::ref 1 aborting False >Thread-34::INFO::2014-07-10 09:54:25,619::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '531976159232', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:54:25,620::task::1185::TaskManager.Task::(prepare) Task=`685bc566-94a4-4b07-9425-fd22f1e30aef`::finished: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '531976159232', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:54:25,620::task::595::TaskManager.Task::(_updateState) Task=`685bc566-94a4-4b07-9425-fd22f1e30aef`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-10 09:54:25,620::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee': < ResourceRef 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-10 09:54:25,620::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-10 09:54:25,620::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' >Thread-34::DEBUG::2014-07-10 09:54:25,621::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' (0 active users) >Thread-34::DEBUG::2014-07-10 09:54:25,621::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-10 09:54:25,621::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', Clearing records. >Thread-34::DEBUG::2014-07-10 09:54:25,621::task::990::TaskManager.Task::(_decref) Task=`685bc566-94a4-4b07-9425-fd22f1e30aef`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 09:54:26,474::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Thread-18::DEBUG::2014-07-10 09:54:26,496::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/metadata bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-10 09:54:26,517::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00184157 s, 2.2 MB/s\n'; <rc> = 0 >Thread-76::DEBUG::2014-07-10 09:54:26,686::task::595::TaskManager.Task::(_updateState) Task=`9adac1b2-7500-4219-837f-31611ecf96a0`::moving from state init -> state preparing >Thread-76::INFO::2014-07-10 09:54:26,697::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='e4c65229-4247-4b33-b72a-f1d5ce72ad05', volUUID='cad94284-3ca9-4c30-933d-997f4460309e', options=None) >Thread-76::INFO::2014-07-10 09:54:26,708::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-76::DEBUG::2014-07-10 09:54:26,717::task::1185::TaskManager.Task::(prepare) Task=`9adac1b2-7500-4219-837f-31611ecf96a0`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-76::DEBUG::2014-07-10 09:54:26,724::task::595::TaskManager.Task::(_updateState) Task=`9adac1b2-7500-4219-837f-31611ecf96a0`::moving from state preparing -> state finished >Thread-76::DEBUG::2014-07-10 09:54:26,731::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-76::DEBUG::2014-07-10 09:54:26,739::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-76::DEBUG::2014-07-10 09:54:26,748::task::990::TaskManager.Task::(_decref) Task=`9adac1b2-7500-4219-837f-31611ecf96a0`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 09:54:26,866::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.333195 s, 3.1 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:54:28,881::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:54:29,014::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0510973 s, 20.0 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:54:31,050::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:54:31,152::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.044329 s, 23.1 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:54:33,167::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:54:33,418::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0550139 s, 18.6 MB/s\n'; <rc> = 0 >Thread-40::DEBUG::2014-07-10 09:54:33,594::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lion.qa.lab.tlv.redhat.com:_export_yuri2_backup2/6a70504d-00df-4869-8695-0f442053f6b6/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-40::DEBUG::2014-07-10 09:54:33,624::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n369 bytes (369 B) copied, 0.000470608 s, 784 kB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 09:54:33,932::task::595::TaskManager.Task::(_updateState) Task=`1f2558ff-5291-4318-a203-bbc94ed981c0`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 09:54:33,933::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::INFO::2014-07-10 09:54:33,933::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00184157', 'lastCheck': '7.1', 'valid': True}, '6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000470608', 'lastCheck': '0.3', 'valid': True}} >Thread-14::DEBUG::2014-07-10 09:54:33,933::task::1185::TaskManager.Task::(prepare) Task=`1f2558ff-5291-4318-a203-bbc94ed981c0`::finished: {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00184157', 'lastCheck': '7.1', 'valid': True}, '6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000470608', 'lastCheck': '0.3', 'valid': True}} >Thread-14::DEBUG::2014-07-10 09:54:33,934::task::595::TaskManager.Task::(_updateState) Task=`1f2558ff-5291-4318-a203-bbc94ed981c0`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 09:54:33,934::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 09:54:33,934::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 09:54:33,934::task::990::TaskManager.Task::(_decref) Task=`1f2558ff-5291-4318-a203-bbc94ed981c0`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 09:54:35,638::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Thread-14::DEBUG::2014-07-10 09:54:35,661::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-14::DEBUG::2014-07-10 09:54:35,664::task::595::TaskManager.Task::(_updateState) Task=`103e8621-9d79-4976-9dc6-56d9e114ef78`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 09:54:35,666::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-14::INFO::2014-07-10 09:54:35,668::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:54:35,669::task::1185::TaskManager.Task::(prepare) Task=`103e8621-9d79-4976-9dc6-56d9e114ef78`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:54:35,670::task::595::TaskManager.Task::(_updateState) Task=`103e8621-9d79-4976-9dc6-56d9e114ef78`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 09:54:35,671::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 09:54:35,672::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 09:54:35,674::task::990::TaskManager.Task::(_decref) Task=`103e8621-9d79-4976-9dc6-56d9e114ef78`::ref 0 aborting False >Thread-34::DEBUG::2014-07-10 09:54:35,721::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-34::DEBUG::2014-07-10 09:54:35,722::task::595::TaskManager.Task::(_updateState) Task=`bc3d422c-80f3-4ca6-9fca-0c23ecfcd6c0`::moving from state init -> state preparing >Thread-34::INFO::2014-07-10 09:54:35,724::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-34::DEBUG::2014-07-10 09:54:35,727::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`a8fdefb3-7413-46f5-bbd2-e3fe358b0a9e`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-10 09:54:35,728::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' for lock type 'shared' >Thread-34::DEBUG::2014-07-10 09:54:35,730::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-10 09:54:35,732::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`a8fdefb3-7413-46f5-bbd2-e3fe358b0a9e`::Granted request >Thread-34::DEBUG::2014-07-10 09:54:35,734::task::827::TaskManager.Task::(resourceAcquired) Task=`bc3d422c-80f3-4ca6-9fca-0c23ecfcd6c0`::_resourcesAcquired: Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee (shared) >Thread-34::DEBUG::2014-07-10 09:54:35,736::task::990::TaskManager.Task::(_decref) Task=`bc3d422c-80f3-4ca6-9fca-0c23ecfcd6c0`::ref 1 aborting False >Thread-34::INFO::2014-07-10 09:54:35,742::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '531976159232', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:54:35,743::task::1185::TaskManager.Task::(prepare) Task=`bc3d422c-80f3-4ca6-9fca-0c23ecfcd6c0`::finished: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '531976159232', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:54:35,745::task::595::TaskManager.Task::(_updateState) Task=`bc3d422c-80f3-4ca6-9fca-0c23ecfcd6c0`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-10 09:54:35,746::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee': < ResourceRef 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-10 09:54:35,747::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-10 09:54:35,749::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' >Thread-34::DEBUG::2014-07-10 09:54:35,751::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' (0 active users) >Thread-34::DEBUG::2014-07-10 09:54:35,752::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-10 09:54:35,753::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', Clearing records. >Thread-34::DEBUG::2014-07-10 09:54:35,755::task::990::TaskManager.Task::(_decref) Task=`bc3d422c-80f3-4ca6-9fca-0c23ecfcd6c0`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 09:54:35,797::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0650635 s, 15.7 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-10 09:54:36,803::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/metadata bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-10 09:54:36,828::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00456196 s, 898 kB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:54:37,812::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:54:37,985::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.1141 s, 9.0 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:54:40,000::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:54:40,103::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0290456 s, 35.3 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:54:42,119::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:54:42,235::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0305677 s, 33.5 MB/s\n'; <rc> = 0 >Thread-40::DEBUG::2014-07-10 09:54:43,666::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lion.qa.lab.tlv.redhat.com:_export_yuri2_backup2/6a70504d-00df-4869-8695-0f442053f6b6/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-40::DEBUG::2014-07-10 09:54:43,684::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n369 bytes (369 B) copied, 0.000427494 s, 863 kB/s\n'; <rc> = 0 >Thread-70::DEBUG::2014-07-10 09:54:43,706::task::595::TaskManager.Task::(_updateState) Task=`6e40116e-52d5-4893-ab17-b8910c6f1c3e`::moving from state init -> state preparing >Thread-70::INFO::2014-07-10 09:54:43,706::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='cfaeead2-7caa-467c-b389-c89840ae6605', volUUID='567fe32d-31a6-4ff6-90f3-fd6a656fbecc', options=None) >Thread-70::INFO::2014-07-10 09:54:43,707::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-70::DEBUG::2014-07-10 09:54:43,707::task::1185::TaskManager.Task::(prepare) Task=`6e40116e-52d5-4893-ab17-b8910c6f1c3e`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-70::DEBUG::2014-07-10 09:54:43,707::task::595::TaskManager.Task::(_updateState) Task=`6e40116e-52d5-4893-ab17-b8910c6f1c3e`::moving from state preparing -> state finished >Thread-70::DEBUG::2014-07-10 09:54:43,707::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-70::DEBUG::2014-07-10 09:54:43,708::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-70::DEBUG::2014-07-10 09:54:43,708::task::990::TaskManager.Task::(_decref) Task=`6e40116e-52d5-4893-ab17-b8910c6f1c3e`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 09:54:44,251::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:54:44,355::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.046073 s, 22.2 MB/s\n'; <rc> = 0 >Thread-51::DEBUG::2014-07-10 09:54:45,424::task::595::TaskManager.Task::(_updateState) Task=`7af29a5d-de87-43eb-a46a-790de20ae754`::moving from state init -> state preparing >Thread-51::INFO::2014-07-10 09:54:45,425::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='76fdb054-02cd-42ed-9721-b3e65b34c3a4', volUUID='022dfe46-2cf7-4915-80b3-883158e3ca83', options=None) >Thread-60::DEBUG::2014-07-10 09:54:45,426::task::595::TaskManager.Task::(_updateState) Task=`562e0824-703a-456f-b0a6-5ba9337690a4`::moving from state init -> state preparing >Thread-60::INFO::2014-07-10 09:54:45,427::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='b034d5b0-e1e0-4011-b49b-4d45ddb11556', volUUID='3d7f62b5-328f-4d8e-8b69-873cfb5ae14d', options=None) >Thread-51::INFO::2014-07-10 09:54:45,428::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-51::DEBUG::2014-07-10 09:54:45,428::task::1185::TaskManager.Task::(prepare) Task=`7af29a5d-de87-43eb-a46a-790de20ae754`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-60::INFO::2014-07-10 09:54:45,428::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-51::DEBUG::2014-07-10 09:54:45,429::task::595::TaskManager.Task::(_updateState) Task=`7af29a5d-de87-43eb-a46a-790de20ae754`::moving from state preparing -> state finished >Thread-60::DEBUG::2014-07-10 09:54:45,429::task::1185::TaskManager.Task::(prepare) Task=`562e0824-703a-456f-b0a6-5ba9337690a4`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-51::DEBUG::2014-07-10 09:54:45,429::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-60::DEBUG::2014-07-10 09:54:45,430::task::595::TaskManager.Task::(_updateState) Task=`562e0824-703a-456f-b0a6-5ba9337690a4`::moving from state preparing -> state finished >Thread-51::DEBUG::2014-07-10 09:54:45,430::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-60::DEBUG::2014-07-10 09:54:45,430::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-51::DEBUG::2014-07-10 09:54:45,431::task::990::TaskManager.Task::(_decref) Task=`7af29a5d-de87-43eb-a46a-790de20ae754`::ref 0 aborting False >Thread-60::DEBUG::2014-07-10 09:54:45,431::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-60::DEBUG::2014-07-10 09:54:45,432::task::990::TaskManager.Task::(_decref) Task=`562e0824-703a-456f-b0a6-5ba9337690a4`::ref 0 aborting False >Thread-14::DEBUG::2014-07-10 09:54:45,783::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-14::DEBUG::2014-07-10 09:54:45,784::task::595::TaskManager.Task::(_updateState) Task=`ac31c22f-c7ff-4030-9b2d-26150ea9597c`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 09:54:45,785::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-14::INFO::2014-07-10 09:54:45,785::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:54:45,785::task::1185::TaskManager.Task::(prepare) Task=`ac31c22f-c7ff-4030-9b2d-26150ea9597c`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:54:45,785::task::595::TaskManager.Task::(_updateState) Task=`ac31c22f-c7ff-4030-9b2d-26150ea9597c`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 09:54:45,786::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 09:54:45,786::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 09:54:45,786::task::990::TaskManager.Task::(_decref) Task=`ac31c22f-c7ff-4030-9b2d-26150ea9597c`::ref 0 aborting False >Thread-34::DEBUG::2014-07-10 09:54:45,790::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-34::DEBUG::2014-07-10 09:54:45,791::task::595::TaskManager.Task::(_updateState) Task=`2aa9c273-aaf0-4563-9d11-fb42ccc5ff0f`::moving from state init -> state preparing >Thread-34::INFO::2014-07-10 09:54:45,791::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-34::DEBUG::2014-07-10 09:54:45,791::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`4d89dc0f-a81f-4b59-89b6-8926bb4b3fc1`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-10 09:54:45,792::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' for lock type 'shared' >Thread-34::DEBUG::2014-07-10 09:54:45,792::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-10 09:54:45,792::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`4d89dc0f-a81f-4b59-89b6-8926bb4b3fc1`::Granted request >Thread-34::DEBUG::2014-07-10 09:54:45,793::task::827::TaskManager.Task::(resourceAcquired) Task=`2aa9c273-aaf0-4563-9d11-fb42ccc5ff0f`::_resourcesAcquired: Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee (shared) >Thread-34::DEBUG::2014-07-10 09:54:45,793::task::990::TaskManager.Task::(_decref) Task=`2aa9c273-aaf0-4563-9d11-fb42ccc5ff0f`::ref 1 aborting False >Thread-34::INFO::2014-07-10 09:54:45,794::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '531976159232', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:54:45,794::task::1185::TaskManager.Task::(prepare) Task=`2aa9c273-aaf0-4563-9d11-fb42ccc5ff0f`::finished: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '531976159232', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:54:45,794::task::595::TaskManager.Task::(_updateState) Task=`2aa9c273-aaf0-4563-9d11-fb42ccc5ff0f`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-10 09:54:45,794::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee': < ResourceRef 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-10 09:54:45,795::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-10 09:54:45,795::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' >Thread-34::DEBUG::2014-07-10 09:54:45,795::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' (0 active users) >Thread-34::DEBUG::2014-07-10 09:54:45,795::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-10 09:54:45,795::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', Clearing records. >Thread-34::DEBUG::2014-07-10 09:54:45,795::task::990::TaskManager.Task::(_decref) Task=`2aa9c273-aaf0-4563-9d11-fb42ccc5ff0f`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 09:54:46,370::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:54:46,465::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0277989 s, 36.8 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-10 09:54:46,859::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/metadata bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-10 09:54:46,888::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00700031 s, 585 kB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:54:48,485::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:54:48,581::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0328216 s, 31.2 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 09:54:49,122::task::595::TaskManager.Task::(_updateState) Task=`270b9c81-fc13-41bc-88d5-bc44ff57ddbb`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 09:54:49,123::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::INFO::2014-07-10 09:54:49,123::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00700031', 'lastCheck': '2.2', 'valid': True}, '6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000427494', 'lastCheck': '5.4', 'valid': True}} >Thread-14::DEBUG::2014-07-10 09:54:49,124::task::1185::TaskManager.Task::(prepare) Task=`270b9c81-fc13-41bc-88d5-bc44ff57ddbb`::finished: {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00700031', 'lastCheck': '2.2', 'valid': True}, '6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000427494', 'lastCheck': '5.4', 'valid': True}} >Thread-14::DEBUG::2014-07-10 09:54:49,124::task::595::TaskManager.Task::(_updateState) Task=`270b9c81-fc13-41bc-88d5-bc44ff57ddbb`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 09:54:49,124::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 09:54:49,124::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 09:54:49,124::task::990::TaskManager.Task::(_decref) Task=`270b9c81-fc13-41bc-88d5-bc44ff57ddbb`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 09:54:50,596::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:54:50,706::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0354018 s, 28.9 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:54:52,721::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:54:52,807::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0272009 s, 37.6 MB/s\n'; <rc> = 0 >Thread-40::DEBUG::2014-07-10 09:54:53,715::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lion.qa.lab.tlv.redhat.com:_export_yuri2_backup2/6a70504d-00df-4869-8695-0f442053f6b6/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-40::DEBUG::2014-07-10 09:54:53,732::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n369 bytes (369 B) copied, 0.00037253 s, 991 kB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:54:54,823::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:54:54,912::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0328509 s, 31.2 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 09:54:55,825::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-14::DEBUG::2014-07-10 09:54:55,826::task::595::TaskManager.Task::(_updateState) Task=`310c8344-8569-47c2-83a2-574674a34047`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 09:54:55,826::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-14::INFO::2014-07-10 09:54:55,827::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:54:55,827::task::1185::TaskManager.Task::(prepare) Task=`310c8344-8569-47c2-83a2-574674a34047`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:54:55,827::task::595::TaskManager.Task::(_updateState) Task=`310c8344-8569-47c2-83a2-574674a34047`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 09:54:55,828::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 09:54:55,828::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 09:54:55,828::task::990::TaskManager.Task::(_decref) Task=`310c8344-8569-47c2-83a2-574674a34047`::ref 0 aborting False >Thread-34::DEBUG::2014-07-10 09:54:55,832::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-34::DEBUG::2014-07-10 09:54:55,833::task::595::TaskManager.Task::(_updateState) Task=`174ac23b-9329-4781-aaaa-a311966c5971`::moving from state init -> state preparing >Thread-34::INFO::2014-07-10 09:54:55,833::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-34::DEBUG::2014-07-10 09:54:55,834::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`2da71c35-d406-43b5-8f7a-61e62b8209f1`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-10 09:54:55,834::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' for lock type 'shared' >Thread-34::DEBUG::2014-07-10 09:54:55,834::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-10 09:54:55,834::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`2da71c35-d406-43b5-8f7a-61e62b8209f1`::Granted request >Thread-34::DEBUG::2014-07-10 09:54:55,835::task::827::TaskManager.Task::(resourceAcquired) Task=`174ac23b-9329-4781-aaaa-a311966c5971`::_resourcesAcquired: Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee (shared) >Thread-34::DEBUG::2014-07-10 09:54:55,835::task::990::TaskManager.Task::(_decref) Task=`174ac23b-9329-4781-aaaa-a311966c5971`::ref 1 aborting False >Thread-34::INFO::2014-07-10 09:54:55,836::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '531976159232', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:54:55,837::task::1185::TaskManager.Task::(prepare) Task=`174ac23b-9329-4781-aaaa-a311966c5971`::finished: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '531976159232', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:54:55,837::task::595::TaskManager.Task::(_updateState) Task=`174ac23b-9329-4781-aaaa-a311966c5971`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-10 09:54:55,837::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee': < ResourceRef 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-10 09:54:55,837::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-10 09:54:55,838::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' >Thread-34::DEBUG::2014-07-10 09:54:55,838::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' (0 active users) >Thread-34::DEBUG::2014-07-10 09:54:55,838::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-10 09:54:55,839::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', Clearing records. >Thread-34::DEBUG::2014-07-10 09:54:55,839::task::990::TaskManager.Task::(_decref) Task=`174ac23b-9329-4781-aaaa-a311966c5971`::ref 0 aborting False >Thread-18::DEBUG::2014-07-10 09:54:56,920::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/metadata bs=4096 count=1' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:54:56,944::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Thread-18::DEBUG::2014-07-10 09:54:57,016::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00435062 s, 941 kB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:54:57,131::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.127403 s, 8.0 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:54:59,149::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:54:59,254::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0390767 s, 26.2 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:55:01,277::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:55:01,367::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0304794 s, 33.6 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:55:03,383::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:55:03,470::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0296673 s, 34.5 MB/s\n'; <rc> = 0 >Thread-40::DEBUG::2014-07-10 09:55:03,761::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lion.qa.lab.tlv.redhat.com:_export_yuri2_backup2/6a70504d-00df-4869-8695-0f442053f6b6/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-40::DEBUG::2014-07-10 09:55:03,782::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n369 bytes (369 B) copied, 0.000468916 s, 787 kB/s\n'; <rc> = 0 >Thread-64::DEBUG::2014-07-10 09:55:03,812::task::595::TaskManager.Task::(_updateState) Task=`83387d24-ea71-4a0c-9dd9-fd8bff11be23`::moving from state init -> state preparing >Thread-64::INFO::2014-07-10 09:55:03,812::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='aa20346a-4d3a-4e07-b8e1-52c0ebe4168c', volUUID='58fefce2-9bce-4bff-8949-8c6ce8122b27', options=None) >Thread-64::INFO::2014-07-10 09:55:03,813::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-64::DEBUG::2014-07-10 09:55:03,813::task::1185::TaskManager.Task::(prepare) Task=`83387d24-ea71-4a0c-9dd9-fd8bff11be23`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-64::DEBUG::2014-07-10 09:55:03,813::task::595::TaskManager.Task::(_updateState) Task=`83387d24-ea71-4a0c-9dd9-fd8bff11be23`::moving from state preparing -> state finished >Thread-64::DEBUG::2014-07-10 09:55:03,814::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-64::DEBUG::2014-07-10 09:55:03,814::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-64::DEBUG::2014-07-10 09:55:03,814::task::990::TaskManager.Task::(_decref) Task=`83387d24-ea71-4a0c-9dd9-fd8bff11be23`::ref 0 aborting False >Thread-14::DEBUG::2014-07-10 09:55:04,308::task::595::TaskManager.Task::(_updateState) Task=`7026ad53-695c-49b0-99de-ed932d202f7f`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 09:55:04,309::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::INFO::2014-07-10 09:55:04,310::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00435062', 'lastCheck': '7.2', 'valid': True}, '6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000468916', 'lastCheck': '0.5', 'valid': True}} >Thread-14::DEBUG::2014-07-10 09:55:04,310::task::1185::TaskManager.Task::(prepare) Task=`7026ad53-695c-49b0-99de-ed932d202f7f`::finished: {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00435062', 'lastCheck': '7.2', 'valid': True}, '6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000468916', 'lastCheck': '0.5', 'valid': True}} >Thread-14::DEBUG::2014-07-10 09:55:04,310::task::595::TaskManager.Task::(_updateState) Task=`7026ad53-695c-49b0-99de-ed932d202f7f`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 09:55:04,310::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 09:55:04,311::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 09:55:04,311::task::990::TaskManager.Task::(_decref) Task=`7026ad53-695c-49b0-99de-ed932d202f7f`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 09:55:05,485::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:55:05,578::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.035135 s, 29.1 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 09:55:05,867::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-14::DEBUG::2014-07-10 09:55:05,868::task::595::TaskManager.Task::(_updateState) Task=`c4e684c6-7638-4eda-94d7-b7acc456bf97`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 09:55:05,869::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-14::INFO::2014-07-10 09:55:05,869::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:55:05,870::task::1185::TaskManager.Task::(prepare) Task=`c4e684c6-7638-4eda-94d7-b7acc456bf97`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:55:05,870::task::595::TaskManager.Task::(_updateState) Task=`c4e684c6-7638-4eda-94d7-b7acc456bf97`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 09:55:05,870::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 09:55:05,870::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 09:55:05,870::task::990::TaskManager.Task::(_decref) Task=`c4e684c6-7638-4eda-94d7-b7acc456bf97`::ref 0 aborting False >Thread-34::DEBUG::2014-07-10 09:55:05,914::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-34::DEBUG::2014-07-10 09:55:05,914::task::595::TaskManager.Task::(_updateState) Task=`72f7e993-1a2b-419a-99c3-bc2fe546c25d`::moving from state init -> state preparing >Thread-34::INFO::2014-07-10 09:55:05,915::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-34::DEBUG::2014-07-10 09:55:05,915::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`a708d54b-409d-49eb-96f9-00823c55eb6e`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-10 09:55:05,915::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' for lock type 'shared' >Thread-34::DEBUG::2014-07-10 09:55:05,916::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-10 09:55:05,916::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`a708d54b-409d-49eb-96f9-00823c55eb6e`::Granted request >Thread-34::DEBUG::2014-07-10 09:55:05,917::task::827::TaskManager.Task::(resourceAcquired) Task=`72f7e993-1a2b-419a-99c3-bc2fe546c25d`::_resourcesAcquired: Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee (shared) >Thread-34::DEBUG::2014-07-10 09:55:05,917::task::990::TaskManager.Task::(_decref) Task=`72f7e993-1a2b-419a-99c3-bc2fe546c25d`::ref 1 aborting False >Thread-34::INFO::2014-07-10 09:55:05,918::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '531976159232', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:55:05,918::task::1185::TaskManager.Task::(prepare) Task=`72f7e993-1a2b-419a-99c3-bc2fe546c25d`::finished: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '531976159232', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:55:05,919::task::595::TaskManager.Task::(_updateState) Task=`72f7e993-1a2b-419a-99c3-bc2fe546c25d`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-10 09:55:05,919::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee': < ResourceRef 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-10 09:55:05,919::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-10 09:55:05,919::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' >Thread-34::DEBUG::2014-07-10 09:55:05,919::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' (0 active users) >Thread-34::DEBUG::2014-07-10 09:55:05,920::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-10 09:55:05,920::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', Clearing records. >Thread-34::DEBUG::2014-07-10 09:55:05,920::task::990::TaskManager.Task::(_decref) Task=`72f7e993-1a2b-419a-99c3-bc2fe546c25d`::ref 0 aborting False >Thread-18::DEBUG::2014-07-10 09:55:07,074::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/metadata bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-10 09:55:07,099::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00439959 s, 931 kB/s\n'; <rc> = 0 >Thread-54::DEBUG::2014-07-10 09:55:07,167::task::595::TaskManager.Task::(_updateState) Task=`ca38af6c-82ee-4f5c-aa8f-97a889c0b36e`::moving from state init -> state preparing >Thread-54::INFO::2014-07-10 09:55:07,168::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='28408446-e5fd-4565-a976-e760951593fe', volUUID='776303a2-5585-451e-826e-0e338d4a1e98', options=None) >Thread-54::INFO::2014-07-10 09:55:07,168::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-54::DEBUG::2014-07-10 09:55:07,168::task::1185::TaskManager.Task::(prepare) Task=`ca38af6c-82ee-4f5c-aa8f-97a889c0b36e`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-54::DEBUG::2014-07-10 09:55:07,169::task::595::TaskManager.Task::(_updateState) Task=`ca38af6c-82ee-4f5c-aa8f-97a889c0b36e`::moving from state preparing -> state finished >Thread-54::DEBUG::2014-07-10 09:55:07,171::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-73::DEBUG::2014-07-10 09:55:07,173::task::595::TaskManager.Task::(_updateState) Task=`bae754c9-3cdb-497e-bd0c-f85e43b8c523`::moving from state init -> state preparing >Thread-54::DEBUG::2014-07-10 09:55:07,175::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-73::INFO::2014-07-10 09:55:07,178::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='c01d693b-cba0-4fed-9ad7-0aaa28912a19', volUUID='4bb5d954-2a50-4028-b299-0b43c261270c', options=None) >Thread-54::DEBUG::2014-07-10 09:55:07,178::task::990::TaskManager.Task::(_decref) Task=`ca38af6c-82ee-4f5c-aa8f-97a889c0b36e`::ref 0 aborting False >Thread-73::INFO::2014-07-10 09:55:07,182::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-73::DEBUG::2014-07-10 09:55:07,182::task::1185::TaskManager.Task::(prepare) Task=`bae754c9-3cdb-497e-bd0c-f85e43b8c523`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-73::DEBUG::2014-07-10 09:55:07,182::task::595::TaskManager.Task::(_updateState) Task=`bae754c9-3cdb-497e-bd0c-f85e43b8c523`::moving from state preparing -> state finished >Thread-73::DEBUG::2014-07-10 09:55:07,183::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-73::DEBUG::2014-07-10 09:55:07,183::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-73::DEBUG::2014-07-10 09:55:07,183::task::990::TaskManager.Task::(_decref) Task=`bae754c9-3cdb-497e-bd0c-f85e43b8c523`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 09:55:07,599::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:55:07,713::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0556634 s, 18.4 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:55:09,729::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:55:09,825::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0370548 s, 27.6 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:55:11,840::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:55:11,938::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0376572 s, 27.2 MB/s\n'; <rc> = 0 >Thread-40::DEBUG::2014-07-10 09:55:13,809::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lion.qa.lab.tlv.redhat.com:_export_yuri2_backup2/6a70504d-00df-4869-8695-0f442053f6b6/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-40::DEBUG::2014-07-10 09:55:13,830::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n369 bytes (369 B) copied, 0.000459148 s, 804 kB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:55:13,954::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:55:14,067::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0485181 s, 21.1 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 09:55:15,951::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-14::DEBUG::2014-07-10 09:55:15,952::task::595::TaskManager.Task::(_updateState) Task=`a4e8f731-cdee-4eb8-a65d-d8ed4e38bd97`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 09:55:15,952::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-14::INFO::2014-07-10 09:55:15,953::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:55:15,953::task::1185::TaskManager.Task::(prepare) Task=`a4e8f731-cdee-4eb8-a65d-d8ed4e38bd97`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:55:15,953::task::595::TaskManager.Task::(_updateState) Task=`a4e8f731-cdee-4eb8-a65d-d8ed4e38bd97`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 09:55:15,953::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 09:55:15,953::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 09:55:15,954::task::990::TaskManager.Task::(_decref) Task=`a4e8f731-cdee-4eb8-a65d-d8ed4e38bd97`::ref 0 aborting False >Thread-34::DEBUG::2014-07-10 09:55:15,958::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-34::DEBUG::2014-07-10 09:55:15,958::task::595::TaskManager.Task::(_updateState) Task=`9c31918a-93e9-42fe-a177-844008c7101a`::moving from state init -> state preparing >Thread-34::INFO::2014-07-10 09:55:15,958::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-34::DEBUG::2014-07-10 09:55:15,959::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`e69fbfd2-2e0f-45f2-826d-31f6c824c586`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-10 09:55:15,959::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' for lock type 'shared' >Thread-34::DEBUG::2014-07-10 09:55:15,960::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-10 09:55:15,960::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`e69fbfd2-2e0f-45f2-826d-31f6c824c586`::Granted request >Thread-34::DEBUG::2014-07-10 09:55:15,960::task::827::TaskManager.Task::(resourceAcquired) Task=`9c31918a-93e9-42fe-a177-844008c7101a`::_resourcesAcquired: Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee (shared) >Thread-34::DEBUG::2014-07-10 09:55:15,960::task::990::TaskManager.Task::(_decref) Task=`9c31918a-93e9-42fe-a177-844008c7101a`::ref 1 aborting False >Thread-34::INFO::2014-07-10 09:55:15,961::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '531976159232', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:55:15,961::task::1185::TaskManager.Task::(prepare) Task=`9c31918a-93e9-42fe-a177-844008c7101a`::finished: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '531976159232', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:55:15,962::task::595::TaskManager.Task::(_updateState) Task=`9c31918a-93e9-42fe-a177-844008c7101a`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-10 09:55:15,962::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee': < ResourceRef 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-10 09:55:15,962::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-10 09:55:15,962::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' >Thread-34::DEBUG::2014-07-10 09:55:15,962::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' (0 active users) >Thread-34::DEBUG::2014-07-10 09:55:15,963::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-10 09:55:15,963::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', Clearing records. >Thread-34::DEBUG::2014-07-10 09:55:15,963::task::990::TaskManager.Task::(_decref) Task=`9c31918a-93e9-42fe-a177-844008c7101a`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 09:55:16,083::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:55:16,171::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0300577 s, 34.1 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-10 09:55:17,129::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/metadata bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-10 09:55:17,150::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000834417 s, 4.9 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:55:18,186::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:55:18,296::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.047503 s, 21.6 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 09:55:19,500::task::595::TaskManager.Task::(_updateState) Task=`c360d664-a06e-4fb9-b151-ca2b7e32bcdd`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 09:55:19,501::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::INFO::2014-07-10 09:55:19,501::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000834417', 'lastCheck': '2.3', 'valid': True}, '6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000459148', 'lastCheck': '5.7', 'valid': True}} >Thread-14::DEBUG::2014-07-10 09:55:19,501::task::1185::TaskManager.Task::(prepare) Task=`c360d664-a06e-4fb9-b151-ca2b7e32bcdd`::finished: {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000834417', 'lastCheck': '2.3', 'valid': True}, '6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000459148', 'lastCheck': '5.7', 'valid': True}} >Thread-14::DEBUG::2014-07-10 09:55:19,502::task::595::TaskManager.Task::(_updateState) Task=`c360d664-a06e-4fb9-b151-ca2b7e32bcdd`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 09:55:19,502::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 09:55:19,502::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 09:55:19,502::task::990::TaskManager.Task::(_decref) Task=`c360d664-a06e-4fb9-b151-ca2b7e32bcdd`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 09:55:20,312::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:55:20,500::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0467705 s, 21.9 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:55:22,515::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:55:22,602::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0292731 s, 35.0 MB/s\n'; <rc> = 0 >Thread-40::DEBUG::2014-07-10 09:55:23,860::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lion.qa.lab.tlv.redhat.com:_export_yuri2_backup2/6a70504d-00df-4869-8695-0f442053f6b6/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-40::DEBUG::2014-07-10 09:55:23,880::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n369 bytes (369 B) copied, 0.000510765 s, 722 kB/s\n'; <rc> = 0 >Thread-57::DEBUG::2014-07-10 09:55:24,297::task::595::TaskManager.Task::(_updateState) Task=`26dddf7b-96e9-4198-b985-8ecc347f3fce`::moving from state init -> state preparing >Thread-57::INFO::2014-07-10 09:55:24,298::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='b6f6c0da-e67f-4902-b9ac-3069571a42fe', volUUID='c4cd1da8-05b7-45e0-80b1-1183d21443d9', options=None) >Thread-57::INFO::2014-07-10 09:55:24,298::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-57::DEBUG::2014-07-10 09:55:24,298::task::1185::TaskManager.Task::(prepare) Task=`26dddf7b-96e9-4198-b985-8ecc347f3fce`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-57::DEBUG::2014-07-10 09:55:24,298::task::595::TaskManager.Task::(_updateState) Task=`26dddf7b-96e9-4198-b985-8ecc347f3fce`::moving from state preparing -> state finished >Thread-57::DEBUG::2014-07-10 09:55:24,299::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-57::DEBUG::2014-07-10 09:55:24,299::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-57::DEBUG::2014-07-10 09:55:24,299::task::990::TaskManager.Task::(_decref) Task=`26dddf7b-96e9-4198-b985-8ecc347f3fce`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 09:55:24,618::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:55:24,727::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0424912 s, 24.1 MB/s\n'; <rc> = 0 >Thread-67::DEBUG::2014-07-10 09:55:25,128::task::595::TaskManager.Task::(_updateState) Task=`4f714634-0e14-4510-90ae-6fe9d189c4d0`::moving from state init -> state preparing >Thread-67::INFO::2014-07-10 09:55:25,129::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='f30c2cb7-a43a-4bf5-82b5-cfe07336f65c', volUUID='b0fbb3c9-55af-4a3a-95ad-fc56a80b9cf5', options=None) >Thread-67::INFO::2014-07-10 09:55:25,129::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-67::DEBUG::2014-07-10 09:55:25,129::task::1185::TaskManager.Task::(prepare) Task=`4f714634-0e14-4510-90ae-6fe9d189c4d0`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-67::DEBUG::2014-07-10 09:55:25,129::task::595::TaskManager.Task::(_updateState) Task=`4f714634-0e14-4510-90ae-6fe9d189c4d0`::moving from state preparing -> state finished >Thread-67::DEBUG::2014-07-10 09:55:25,130::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-67::DEBUG::2014-07-10 09:55:25,130::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-67::DEBUG::2014-07-10 09:55:25,130::task::990::TaskManager.Task::(_decref) Task=`4f714634-0e14-4510-90ae-6fe9d189c4d0`::ref 0 aborting False >Thread-48::DEBUG::2014-07-10 09:55:25,268::task::595::TaskManager.Task::(_updateState) Task=`fb14e03f-defc-42e5-848c-32f9f8d4f08e`::moving from state init -> state preparing >Thread-48::INFO::2014-07-10 09:55:25,268::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='0cd7d6ce-f497-4243-a690-c57744861eea', volUUID='10b6a7dd-dc6c-43fa-ba17-92e4331b0e0b', options=None) >Thread-48::INFO::2014-07-10 09:55:25,269::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-48::DEBUG::2014-07-10 09:55:25,269::task::1185::TaskManager.Task::(prepare) Task=`fb14e03f-defc-42e5-848c-32f9f8d4f08e`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-48::DEBUG::2014-07-10 09:55:25,269::task::595::TaskManager.Task::(_updateState) Task=`fb14e03f-defc-42e5-848c-32f9f8d4f08e`::moving from state preparing -> state finished >Thread-48::DEBUG::2014-07-10 09:55:25,269::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-48::DEBUG::2014-07-10 09:55:25,270::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-48::DEBUG::2014-07-10 09:55:25,270::task::990::TaskManager.Task::(_decref) Task=`fb14e03f-defc-42e5-848c-32f9f8d4f08e`::ref 0 aborting False >Thread-14::DEBUG::2014-07-10 09:55:25,992::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-14::DEBUG::2014-07-10 09:55:25,992::task::595::TaskManager.Task::(_updateState) Task=`88688f68-4806-4abd-93a4-39b8377dd67b`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 09:55:25,993::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-14::INFO::2014-07-10 09:55:25,993::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:55:25,993::task::1185::TaskManager.Task::(prepare) Task=`88688f68-4806-4abd-93a4-39b8377dd67b`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:55:25,994::task::595::TaskManager.Task::(_updateState) Task=`88688f68-4806-4abd-93a4-39b8377dd67b`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 09:55:25,994::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 09:55:25,994::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 09:55:25,994::task::990::TaskManager.Task::(_decref) Task=`88688f68-4806-4abd-93a4-39b8377dd67b`::ref 0 aborting False >Thread-34::DEBUG::2014-07-10 09:55:25,998::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-34::DEBUG::2014-07-10 09:55:25,999::task::595::TaskManager.Task::(_updateState) Task=`caaad6eb-200d-4e1c-9f1b-b636cae232fc`::moving from state init -> state preparing >Thread-34::INFO::2014-07-10 09:55:25,999::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-34::DEBUG::2014-07-10 09:55:26,000::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`4429a859-0503-4224-900f-4bd4d67c33e6`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-10 09:55:26,000::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' for lock type 'shared' >Thread-34::DEBUG::2014-07-10 09:55:26,000::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-10 09:55:26,001::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`4429a859-0503-4224-900f-4bd4d67c33e6`::Granted request >Thread-34::DEBUG::2014-07-10 09:55:26,001::task::827::TaskManager.Task::(resourceAcquired) Task=`caaad6eb-200d-4e1c-9f1b-b636cae232fc`::_resourcesAcquired: Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee (shared) >Thread-34::DEBUG::2014-07-10 09:55:26,001::task::990::TaskManager.Task::(_decref) Task=`caaad6eb-200d-4e1c-9f1b-b636cae232fc`::ref 1 aborting False >Thread-34::INFO::2014-07-10 09:55:26,003::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '531976159232', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:55:26,003::task::1185::TaskManager.Task::(prepare) Task=`caaad6eb-200d-4e1c-9f1b-b636cae232fc`::finished: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '531976159232', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:55:26,003::task::595::TaskManager.Task::(_updateState) Task=`caaad6eb-200d-4e1c-9f1b-b636cae232fc`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-10 09:55:26,003::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee': < ResourceRef 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-10 09:55:26,003::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-10 09:55:26,004::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' >Thread-34::DEBUG::2014-07-10 09:55:26,004::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' (0 active users) >Thread-34::DEBUG::2014-07-10 09:55:26,004::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-10 09:55:26,004::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', Clearing records. >Thread-34::DEBUG::2014-07-10 09:55:26,005::task::990::TaskManager.Task::(_decref) Task=`caaad6eb-200d-4e1c-9f1b-b636cae232fc`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 09:55:26,741::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:55:26,839::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0372537 s, 27.5 MB/s\n'; <rc> = 0 >Thread-76::DEBUG::2014-07-10 09:55:27,077::task::595::TaskManager.Task::(_updateState) Task=`e27a34ea-22d7-4542-91e7-23dafd22bb7b`::moving from state init -> state preparing >Thread-76::INFO::2014-07-10 09:55:27,077::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='e4c65229-4247-4b33-b72a-f1d5ce72ad05', volUUID='cad94284-3ca9-4c30-933d-997f4460309e', options=None) >Thread-76::INFO::2014-07-10 09:55:27,078::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-76::DEBUG::2014-07-10 09:55:27,078::task::1185::TaskManager.Task::(prepare) Task=`e27a34ea-22d7-4542-91e7-23dafd22bb7b`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-76::DEBUG::2014-07-10 09:55:27,078::task::595::TaskManager.Task::(_updateState) Task=`e27a34ea-22d7-4542-91e7-23dafd22bb7b`::moving from state preparing -> state finished >Thread-76::DEBUG::2014-07-10 09:55:27,078::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-76::DEBUG::2014-07-10 09:55:27,079::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-76::DEBUG::2014-07-10 09:55:27,079::task::990::TaskManager.Task::(_decref) Task=`e27a34ea-22d7-4542-91e7-23dafd22bb7b`::ref 0 aborting False >Thread-18::DEBUG::2014-07-10 09:55:27,181::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/metadata bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-10 09:55:27,249::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.0472557 s, 86.7 kB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:55:28,854::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:55:29,046::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.120612 s, 8.5 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:55:31,062::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:55:31,178::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0542955 s, 18.9 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:55:33,193::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:55:33,277::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0262861 s, 39.0 MB/s\n'; <rc> = 0 >Thread-40::DEBUG::2014-07-10 09:55:33,912::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lion.qa.lab.tlv.redhat.com:_export_yuri2_backup2/6a70504d-00df-4869-8695-0f442053f6b6/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-40::DEBUG::2014-07-10 09:55:33,932::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n369 bytes (369 B) copied, 0.000440105 s, 838 kB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 09:55:34,691::task::595::TaskManager.Task::(_updateState) Task=`e297f687-dbac-49a2-8e70-8d64d22229e2`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 09:55:34,691::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::INFO::2014-07-10 09:55:34,692::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0472557', 'lastCheck': '7.4', 'valid': True}, '6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000440105', 'lastCheck': '0.8', 'valid': True}} >Thread-14::DEBUG::2014-07-10 09:55:34,692::task::1185::TaskManager.Task::(prepare) Task=`e297f687-dbac-49a2-8e70-8d64d22229e2`::finished: {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0472557', 'lastCheck': '7.4', 'valid': True}, '6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000440105', 'lastCheck': '0.8', 'valid': True}} >Thread-14::DEBUG::2014-07-10 09:55:34,692::task::595::TaskManager.Task::(_updateState) Task=`e297f687-dbac-49a2-8e70-8d64d22229e2`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 09:55:34,692::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 09:55:34,693::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 09:55:34,693::task::990::TaskManager.Task::(_decref) Task=`e297f687-dbac-49a2-8e70-8d64d22229e2`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 09:55:35,292::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:55:35,411::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0608637 s, 16.8 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 09:55:36,047::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-14::DEBUG::2014-07-10 09:55:36,048::task::595::TaskManager.Task::(_updateState) Task=`20a127bd-bc74-4c96-8478-b18f6e3e34e2`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 09:55:36,049::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-14::INFO::2014-07-10 09:55:36,049::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:55:36,049::task::1185::TaskManager.Task::(prepare) Task=`20a127bd-bc74-4c96-8478-b18f6e3e34e2`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:55:36,050::task::595::TaskManager.Task::(_updateState) Task=`20a127bd-bc74-4c96-8478-b18f6e3e34e2`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 09:55:36,050::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 09:55:36,050::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 09:55:36,050::task::990::TaskManager.Task::(_decref) Task=`20a127bd-bc74-4c96-8478-b18f6e3e34e2`::ref 0 aborting False >Thread-34::DEBUG::2014-07-10 09:55:36,094::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-34::DEBUG::2014-07-10 09:55:36,095::task::595::TaskManager.Task::(_updateState) Task=`5d8f3501-30c3-4def-9cde-ea9c93e8bcbc`::moving from state init -> state preparing >Thread-34::INFO::2014-07-10 09:55:36,095::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-34::DEBUG::2014-07-10 09:55:36,096::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`a5f2d845-f91d-44e5-b338-6af58f45064d`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-10 09:55:36,096::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' for lock type 'shared' >Thread-34::DEBUG::2014-07-10 09:55:36,096::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-10 09:55:36,096::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`a5f2d845-f91d-44e5-b338-6af58f45064d`::Granted request >Thread-34::DEBUG::2014-07-10 09:55:36,097::task::827::TaskManager.Task::(resourceAcquired) Task=`5d8f3501-30c3-4def-9cde-ea9c93e8bcbc`::_resourcesAcquired: Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee (shared) >Thread-34::DEBUG::2014-07-10 09:55:36,097::task::990::TaskManager.Task::(_decref) Task=`5d8f3501-30c3-4def-9cde-ea9c93e8bcbc`::ref 1 aborting False >Thread-34::INFO::2014-07-10 09:55:36,098::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '531976159232', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:55:36,098::task::1185::TaskManager.Task::(prepare) Task=`5d8f3501-30c3-4def-9cde-ea9c93e8bcbc`::finished: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '531976159232', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:55:36,099::task::595::TaskManager.Task::(_updateState) Task=`5d8f3501-30c3-4def-9cde-ea9c93e8bcbc`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-10 09:55:36,099::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee': < ResourceRef 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-10 09:55:36,099::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-10 09:55:36,099::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' >Thread-34::DEBUG::2014-07-10 09:55:36,099::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' (0 active users) >Thread-34::DEBUG::2014-07-10 09:55:36,099::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-10 09:55:36,100::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', Clearing records. >Thread-34::DEBUG::2014-07-10 09:55:36,100::task::990::TaskManager.Task::(_decref) Task=`5d8f3501-30c3-4def-9cde-ea9c93e8bcbc`::ref 0 aborting False >Thread-18::DEBUG::2014-07-10 09:55:37,277::domainMonitor::192::Storage.DomainMonitorThread::(_monitorDomain) Refreshing domain 9e1aa540-1f4e-4ee3-a152-be381ef6c3bd >Thread-18::DEBUG::2014-07-10 09:55:37,278::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with LvMetadataRW backend >Thread-18::DEBUG::2014-07-10 09:55:37,278::blockSD::336::Storage.Misc.excCmd::(readlines) '/bin/dd iflag=direct skip=0 bs=2048 if=/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/metadata count=1' (cwd None) >Thread-18::DEBUG::2014-07-10 09:55:37,302::blockSD::336::Storage.Misc.excCmd::(readlines) SUCCESS: <err> = '1+0 records in\n1+0 records out\n2048 bytes (2.0 kB) copied, 0.00418089 s, 490 kB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-10 09:55:37,302::misc::282::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '2048 bytes (2.0 kB) copied, 0.00418089 s, 490 kB/s'], size: 2048 >Thread-18::DEBUG::2014-07-10 09:55:37,303::persistentDict::234::Storage.PersistentDict::(refresh) read lines (LvMetadataRW)=[] >Thread-18::WARNING::2014-07-10 09:55:37,303::persistentDict::256::Storage.PersistentDict::(refresh) data has no embedded checksum - trust it as it is >Thread-18::DEBUG::2014-07-10 09:55:37,303::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with VGTagMetadataRW backend >Thread-18::DEBUG::2014-07-10 09:55:37,304::lvm::503::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-18::DEBUG::2014-07-10 09:55:37,304::lvm::505::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-18::DEBUG::2014-07-10 09:55:37,304::lvm::513::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-18::DEBUG::2014-07-10 09:55:37,305::lvm::525::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-18::DEBUG::2014-07-10 09:55:37,305::lvm::373::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-18::DEBUG::2014-07-10 09:55:37,306::lvm::296::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/3600601601282300032826addbbdae311|/dev/mapper/360060160f4a030003840ec867ddee311|/dev/mapper/367cad74c2fcba00019e6afd20c781e67|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name 9e1aa540-1f4e-4ee3-a152-be381ef6c3bd' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:55:37,438::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:55:37,539::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0391977 s, 26.1 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-10 09:55:37,673::lvm::296::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-18::DEBUG::2014-07-10 09:55:37,675::lvm::415::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-18::DEBUG::2014-07-10 09:55:37,676::persistentDict::234::Storage.PersistentDict::(refresh) read lines (VGTagMetadataRW)=['LEASETIMESEC=60', 'VGUUID=9CsMxb-YbRc-yRG7-cQKD-xY3G-GLi5-YxUyPC', 'VERSION=3', 'TYPE=ISCSI', 'LOGBLKSIZE=512', u'PV0=pv:3600601601282300032826addbbdae311,uuid:7qEb8v-jk2X-3CPk-k4XB-eIBk-onYD-807hcV,pestart:0,pecount:8189,mapoffset:0', 'LEASERETRIES=3', 'IOOPTIMEOUTSEC=10', 'LOCKRENEWALINTERVALSEC=5', 'PHYBLKSIZE=512', 'SDUUID=9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'CLASS=Data', 'LOCKPOLICY=', 'DESCRIPTION=SD_REAL', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=DC_REAL', 'ROLE=Master', 'POOL_UUID=4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', 'POOL_SPM_ID=1', 'POOL_SPM_LVER=0', '_SHA_CKSUM=013b5a7910962201c4cceab31b9c6d9c79f7316f', u'POOL_DOMAINS=9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active'] >Thread-18::INFO::2014-07-10 09:55:37,680::sd::384::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 9e1aa540-1f4e-4ee3-a152-be381ef6c3bd_imageNS already registered >Thread-18::INFO::2014-07-10 09:55:37,681::sd::392::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 9e1aa540-1f4e-4ee3-a152-be381ef6c3bd_volumeNS already registered >Thread-18::INFO::2014-07-10 09:55:37,681::blockSD::452::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 9e1aa540-1f4e-4ee3-a152-be381ef6c3bd_lvmActivationNS already registered >Thread-18::DEBUG::2014-07-10 09:55:37,681::lvm::296::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgck --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/3600601601282300032826addbbdae311|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } " 9e1aa540-1f4e-4ee3-a152-be381ef6c3bd' (cwd None) >Thread-18::DEBUG::2014-07-10 09:55:37,879::lvm::296::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-18::DEBUG::2014-07-10 09:55:37,880::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/metadata bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-10 09:55:37,902::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00125934 s, 3.3 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:55:39,555::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:55:39,643::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0300799 s, 34.0 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:55:41,658::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:55:41,759::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0348808 s, 29.4 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:55:43,774::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:55:43,878::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0295805 s, 34.6 MB/s\n'; <rc> = 0 >Thread-40::DEBUG::2014-07-10 09:55:43,962::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lion.qa.lab.tlv.redhat.com:_export_yuri2_backup2/6a70504d-00df-4869-8695-0f442053f6b6/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-40::DEBUG::2014-07-10 09:55:43,983::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n369 bytes (369 B) copied, 0.000415323 s, 888 kB/s\n'; <rc> = 0 >Thread-70::DEBUG::2014-07-10 09:55:43,988::task::595::TaskManager.Task::(_updateState) Task=`b6ae6d41-ce86-45b2-b984-6f4225e8d25c`::moving from state init -> state preparing >Thread-70::INFO::2014-07-10 09:55:43,989::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='cfaeead2-7caa-467c-b389-c89840ae6605', volUUID='567fe32d-31a6-4ff6-90f3-fd6a656fbecc', options=None) >Thread-70::INFO::2014-07-10 09:55:43,990::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-70::DEBUG::2014-07-10 09:55:43,990::task::1185::TaskManager.Task::(prepare) Task=`b6ae6d41-ce86-45b2-b984-6f4225e8d25c`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-70::DEBUG::2014-07-10 09:55:43,990::task::595::TaskManager.Task::(_updateState) Task=`b6ae6d41-ce86-45b2-b984-6f4225e8d25c`::moving from state preparing -> state finished >Thread-70::DEBUG::2014-07-10 09:55:43,990::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-70::DEBUG::2014-07-10 09:55:43,990::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-70::DEBUG::2014-07-10 09:55:43,991::task::990::TaskManager.Task::(_decref) Task=`b6ae6d41-ce86-45b2-b984-6f4225e8d25c`::ref 0 aborting False >Thread-51::DEBUG::2014-07-10 09:55:45,746::task::595::TaskManager.Task::(_updateState) Task=`bffe9010-1d14-4891-988c-b32a7a3da789`::moving from state init -> state preparing >Thread-60::DEBUG::2014-07-10 09:55:45,747::task::595::TaskManager.Task::(_updateState) Task=`f8c10111-835d-45a5-972c-da2d23a9ed09`::moving from state init -> state preparing >Thread-51::INFO::2014-07-10 09:55:45,749::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='76fdb054-02cd-42ed-9721-b3e65b34c3a4', volUUID='022dfe46-2cf7-4915-80b3-883158e3ca83', options=None) >Thread-60::INFO::2014-07-10 09:55:45,750::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='b034d5b0-e1e0-4011-b49b-4d45ddb11556', volUUID='3d7f62b5-328f-4d8e-8b69-873cfb5ae14d', options=None) >Thread-51::INFO::2014-07-10 09:55:45,752::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-60::INFO::2014-07-10 09:55:45,752::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-51::DEBUG::2014-07-10 09:55:45,753::task::1185::TaskManager.Task::(prepare) Task=`bffe9010-1d14-4891-988c-b32a7a3da789`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-60::DEBUG::2014-07-10 09:55:45,755::task::1185::TaskManager.Task::(prepare) Task=`f8c10111-835d-45a5-972c-da2d23a9ed09`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-51::DEBUG::2014-07-10 09:55:45,755::task::595::TaskManager.Task::(_updateState) Task=`bffe9010-1d14-4891-988c-b32a7a3da789`::moving from state preparing -> state finished >Thread-51::DEBUG::2014-07-10 09:55:45,757::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-60::DEBUG::2014-07-10 09:55:45,757::task::595::TaskManager.Task::(_updateState) Task=`f8c10111-835d-45a5-972c-da2d23a9ed09`::moving from state preparing -> state finished >Thread-51::DEBUG::2014-07-10 09:55:45,758::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-60::DEBUG::2014-07-10 09:55:45,759::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-51::DEBUG::2014-07-10 09:55:45,760::task::990::TaskManager.Task::(_decref) Task=`bffe9010-1d14-4891-988c-b32a7a3da789`::ref 0 aborting False >Thread-60::DEBUG::2014-07-10 09:55:45,760::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-60::DEBUG::2014-07-10 09:55:45,762::task::990::TaskManager.Task::(_decref) Task=`f8c10111-835d-45a5-972c-da2d23a9ed09`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 09:55:45,894::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:55:45,988::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0337916 s, 30.3 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 09:55:46,127::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-14::DEBUG::2014-07-10 09:55:46,128::task::595::TaskManager.Task::(_updateState) Task=`d7ef721f-cfb0-4493-bc8b-3bff00e2e148`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 09:55:46,128::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-14::INFO::2014-07-10 09:55:46,129::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:55:46,129::task::1185::TaskManager.Task::(prepare) Task=`d7ef721f-cfb0-4493-bc8b-3bff00e2e148`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:55:46,129::task::595::TaskManager.Task::(_updateState) Task=`d7ef721f-cfb0-4493-bc8b-3bff00e2e148`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 09:55:46,129::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 09:55:46,129::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 09:55:46,130::task::990::TaskManager.Task::(_decref) Task=`d7ef721f-cfb0-4493-bc8b-3bff00e2e148`::ref 0 aborting False >Thread-34::DEBUG::2014-07-10 09:55:46,134::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-34::DEBUG::2014-07-10 09:55:46,134::task::595::TaskManager.Task::(_updateState) Task=`6ef676da-f20e-4fc3-bf4d-5ff9ac79ff57`::moving from state init -> state preparing >Thread-34::INFO::2014-07-10 09:55:46,134::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-34::DEBUG::2014-07-10 09:55:46,135::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`a924c1be-ead3-43ad-b6e1-f6ff906a95da`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-10 09:55:46,135::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' for lock type 'shared' >Thread-34::DEBUG::2014-07-10 09:55:46,136::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-10 09:55:46,136::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`a924c1be-ead3-43ad-b6e1-f6ff906a95da`::Granted request >Thread-34::DEBUG::2014-07-10 09:55:46,136::task::827::TaskManager.Task::(resourceAcquired) Task=`6ef676da-f20e-4fc3-bf4d-5ff9ac79ff57`::_resourcesAcquired: Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee (shared) >Thread-34::DEBUG::2014-07-10 09:55:46,137::task::990::TaskManager.Task::(_decref) Task=`6ef676da-f20e-4fc3-bf4d-5ff9ac79ff57`::ref 1 aborting False >Thread-34::INFO::2014-07-10 09:55:46,138::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '531976159232', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:55:46,138::task::1185::TaskManager.Task::(prepare) Task=`6ef676da-f20e-4fc3-bf4d-5ff9ac79ff57`::finished: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '531976159232', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:55:46,138::task::595::TaskManager.Task::(_updateState) Task=`6ef676da-f20e-4fc3-bf4d-5ff9ac79ff57`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-10 09:55:46,138::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee': < ResourceRef 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-10 09:55:46,139::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-10 09:55:46,139::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' >Thread-34::DEBUG::2014-07-10 09:55:46,139::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' (0 active users) >Thread-34::DEBUG::2014-07-10 09:55:46,139::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-10 09:55:46,139::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', Clearing records. >Thread-34::DEBUG::2014-07-10 09:55:46,140::task::990::TaskManager.Task::(_decref) Task=`6ef676da-f20e-4fc3-bf4d-5ff9ac79ff57`::ref 0 aborting False >Thread-18::DEBUG::2014-07-10 09:55:47,935::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/metadata bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-10 09:55:47,956::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000750579 s, 5.5 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:55:48,004::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:55:48,092::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0333577 s, 30.7 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 09:55:49,891::task::595::TaskManager.Task::(_updateState) Task=`eab0de9c-baff-4ce6-a943-cb73f143527f`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 09:55:49,891::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::INFO::2014-07-10 09:55:49,892::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000750579', 'lastCheck': '1.9', 'valid': True}, '6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000415323', 'lastCheck': '5.9', 'valid': True}} >Thread-14::DEBUG::2014-07-10 09:55:49,892::task::1185::TaskManager.Task::(prepare) Task=`eab0de9c-baff-4ce6-a943-cb73f143527f`::finished: {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000750579', 'lastCheck': '1.9', 'valid': True}, '6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000415323', 'lastCheck': '5.9', 'valid': True}} >Thread-14::DEBUG::2014-07-10 09:55:49,892::task::595::TaskManager.Task::(_updateState) Task=`eab0de9c-baff-4ce6-a943-cb73f143527f`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 09:55:49,892::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 09:55:49,893::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 09:55:49,893::task::990::TaskManager.Task::(_decref) Task=`eab0de9c-baff-4ce6-a943-cb73f143527f`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 09:55:50,102::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:55:50,187::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0278919 s, 36.7 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:55:52,203::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:55:52,294::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0329339 s, 31.1 MB/s\n'; <rc> = 0 >Thread-40::DEBUG::2014-07-10 09:55:54,013::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lion.qa.lab.tlv.redhat.com:_export_yuri2_backup2/6a70504d-00df-4869-8695-0f442053f6b6/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-40::DEBUG::2014-07-10 09:55:54,033::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n369 bytes (369 B) copied, 0.000461262 s, 800 kB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:55:54,309::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:55:54,400::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0332066 s, 30.8 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 09:55:56,176::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-14::DEBUG::2014-07-10 09:55:56,177::task::595::TaskManager.Task::(_updateState) Task=`7d6a8413-6b03-484e-a2cc-076a9dba1fa9`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 09:55:56,177::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-14::INFO::2014-07-10 09:55:56,178::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:55:56,178::task::1185::TaskManager.Task::(prepare) Task=`7d6a8413-6b03-484e-a2cc-076a9dba1fa9`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:55:56,178::task::595::TaskManager.Task::(_updateState) Task=`7d6a8413-6b03-484e-a2cc-076a9dba1fa9`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 09:55:56,178::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 09:55:56,179::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 09:55:56,179::task::990::TaskManager.Task::(_decref) Task=`7d6a8413-6b03-484e-a2cc-076a9dba1fa9`::ref 0 aborting False >Thread-34::DEBUG::2014-07-10 09:55:56,193::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-34::DEBUG::2014-07-10 09:55:56,193::task::595::TaskManager.Task::(_updateState) Task=`2d552dea-1e37-455d-8158-93becd3fcd57`::moving from state init -> state preparing >Thread-34::INFO::2014-07-10 09:55:56,193::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-34::DEBUG::2014-07-10 09:55:56,194::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`82d4bb89-6955-4ac8-9788-e67b51213427`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-10 09:55:56,194::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' for lock type 'shared' >Thread-34::DEBUG::2014-07-10 09:55:56,195::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-10 09:55:56,195::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`82d4bb89-6955-4ac8-9788-e67b51213427`::Granted request >Thread-34::DEBUG::2014-07-10 09:55:56,195::task::827::TaskManager.Task::(resourceAcquired) Task=`2d552dea-1e37-455d-8158-93becd3fcd57`::_resourcesAcquired: Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee (shared) >Thread-34::DEBUG::2014-07-10 09:55:56,195::task::990::TaskManager.Task::(_decref) Task=`2d552dea-1e37-455d-8158-93becd3fcd57`::ref 1 aborting False >Thread-34::INFO::2014-07-10 09:55:56,197::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '531976159232', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:55:56,197::task::1185::TaskManager.Task::(prepare) Task=`2d552dea-1e37-455d-8158-93becd3fcd57`::finished: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '531976159232', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:55:56,197::task::595::TaskManager.Task::(_updateState) Task=`2d552dea-1e37-455d-8158-93becd3fcd57`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-10 09:55:56,197::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee': < ResourceRef 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-10 09:55:56,197::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-10 09:55:56,198::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' >Thread-34::DEBUG::2014-07-10 09:55:56,198::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' (0 active users) >Thread-34::DEBUG::2014-07-10 09:55:56,198::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-10 09:55:56,198::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', Clearing records. >Thread-34::DEBUG::2014-07-10 09:55:56,199::task::990::TaskManager.Task::(_decref) Task=`2d552dea-1e37-455d-8158-93becd3fcd57`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 09:55:56,429::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:55:56,530::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0421477 s, 24.3 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-10 09:55:57,985::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/metadata bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-10 09:55:58,007::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000837034 s, 4.9 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:55:58,544::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:55:58,639::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.035202 s, 29.1 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:56:00,657::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:56:00,742::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0292119 s, 35.1 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:56:02,758::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:56:02,856::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0325351 s, 31.5 MB/s\n'; <rc> = 0 >Thread-40::DEBUG::2014-07-10 09:56:04,059::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lion.qa.lab.tlv.redhat.com:_export_yuri2_backup2/6a70504d-00df-4869-8695-0f442053f6b6/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-64::DEBUG::2014-07-10 09:56:04,098::task::595::TaskManager.Task::(_updateState) Task=`e9cf08d5-8508-4a4d-aa58-81926f00aaad`::moving from state init -> state preparing >Thread-64::INFO::2014-07-10 09:56:04,108::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='aa20346a-4d3a-4e07-b8e1-52c0ebe4168c', volUUID='58fefce2-9bce-4bff-8949-8c6ce8122b27', options=None) >Thread-64::INFO::2014-07-10 09:56:04,124::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-64::DEBUG::2014-07-10 09:56:04,134::task::1185::TaskManager.Task::(prepare) Task=`e9cf08d5-8508-4a4d-aa58-81926f00aaad`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-64::DEBUG::2014-07-10 09:56:04,145::task::595::TaskManager.Task::(_updateState) Task=`e9cf08d5-8508-4a4d-aa58-81926f00aaad`::moving from state preparing -> state finished >Thread-64::DEBUG::2014-07-10 09:56:04,153::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-40::DEBUG::2014-07-10 09:56:04,157::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n369 bytes (369 B) copied, 0.000393366 s, 938 kB/s\n'; <rc> = 0 >Thread-64::DEBUG::2014-07-10 09:56:04,159::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-64::DEBUG::2014-07-10 09:56:04,164::task::990::TaskManager.Task::(_decref) Task=`e9cf08d5-8508-4a4d-aa58-81926f00aaad`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 09:56:04,871::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:56:05,069::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0362043 s, 28.3 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 09:56:05,085::task::595::TaskManager.Task::(_updateState) Task=`878e49f3-181c-4223-80a8-9327b8d9ca19`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 09:56:05,088::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::INFO::2014-07-10 09:56:05,091::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000837034', 'lastCheck': '7.1', 'valid': True}, '6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000393366', 'lastCheck': '0.9', 'valid': True}} >Thread-14::DEBUG::2014-07-10 09:56:05,093::task::1185::TaskManager.Task::(prepare) Task=`878e49f3-181c-4223-80a8-9327b8d9ca19`::finished: {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000837034', 'lastCheck': '7.1', 'valid': True}, '6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000393366', 'lastCheck': '0.9', 'valid': True}} >Thread-14::DEBUG::2014-07-10 09:56:05,094::task::595::TaskManager.Task::(_updateState) Task=`878e49f3-181c-4223-80a8-9327b8d9ca19`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 09:56:05,096::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 09:56:05,097::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 09:56:05,099::task::990::TaskManager.Task::(_decref) Task=`878e49f3-181c-4223-80a8-9327b8d9ca19`::ref 0 aborting False >Thread-14::DEBUG::2014-07-10 09:56:06,226::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-14::DEBUG::2014-07-10 09:56:06,228::task::595::TaskManager.Task::(_updateState) Task=`f7ca1399-b8cf-42cf-a4de-ce88feaea301`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 09:56:06,228::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-14::INFO::2014-07-10 09:56:06,229::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:56:06,230::task::1185::TaskManager.Task::(prepare) Task=`f7ca1399-b8cf-42cf-a4de-ce88feaea301`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:56:06,230::task::595::TaskManager.Task::(_updateState) Task=`f7ca1399-b8cf-42cf-a4de-ce88feaea301`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 09:56:06,230::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 09:56:06,230::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 09:56:06,231::task::990::TaskManager.Task::(_decref) Task=`f7ca1399-b8cf-42cf-a4de-ce88feaea301`::ref 0 aborting False >Thread-34::DEBUG::2014-07-10 09:56:06,274::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-34::DEBUG::2014-07-10 09:56:06,274::task::595::TaskManager.Task::(_updateState) Task=`83f4d9f5-151f-4b24-9e5b-cb7ec7da0370`::moving from state init -> state preparing >Thread-34::INFO::2014-07-10 09:56:06,274::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-34::DEBUG::2014-07-10 09:56:06,275::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`0f1ebc16-3edf-4731-ac2f-8e8df983047f`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-10 09:56:06,275::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' for lock type 'shared' >Thread-34::DEBUG::2014-07-10 09:56:06,276::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-10 09:56:06,276::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`0f1ebc16-3edf-4731-ac2f-8e8df983047f`::Granted request >Thread-34::DEBUG::2014-07-10 09:56:06,276::task::827::TaskManager.Task::(resourceAcquired) Task=`83f4d9f5-151f-4b24-9e5b-cb7ec7da0370`::_resourcesAcquired: Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee (shared) >Thread-34::DEBUG::2014-07-10 09:56:06,276::task::990::TaskManager.Task::(_decref) Task=`83f4d9f5-151f-4b24-9e5b-cb7ec7da0370`::ref 1 aborting False >Thread-34::INFO::2014-07-10 09:56:06,277::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '531976159232', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:56:06,278::task::1185::TaskManager.Task::(prepare) Task=`83f4d9f5-151f-4b24-9e5b-cb7ec7da0370`::finished: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '531976159232', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:56:06,278::task::595::TaskManager.Task::(_updateState) Task=`83f4d9f5-151f-4b24-9e5b-cb7ec7da0370`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-10 09:56:06,278::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee': < ResourceRef 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-10 09:56:06,278::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-10 09:56:06,278::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' >Thread-34::DEBUG::2014-07-10 09:56:06,279::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' (0 active users) >Thread-34::DEBUG::2014-07-10 09:56:06,279::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-10 09:56:06,279::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', Clearing records. >Thread-34::DEBUG::2014-07-10 09:56:06,279::task::990::TaskManager.Task::(_decref) Task=`83f4d9f5-151f-4b24-9e5b-cb7ec7da0370`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 09:56:07,158::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:56:07,249::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0327024 s, 31.3 MB/s\n'; <rc> = 0 >Thread-73::DEBUG::2014-07-10 09:56:07,478::task::595::TaskManager.Task::(_updateState) Task=`2c747252-6c60-4a6b-bdc1-a4415086b45d`::moving from state init -> state preparing >Thread-73::INFO::2014-07-10 09:56:07,480::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='c01d693b-cba0-4fed-9ad7-0aaa28912a19', volUUID='4bb5d954-2a50-4028-b299-0b43c261270c', options=None) >Thread-54::DEBUG::2014-07-10 09:56:07,480::task::595::TaskManager.Task::(_updateState) Task=`c6cd0e71-cf48-4ccd-bb5b-19e21df7c1bf`::moving from state init -> state preparing >Thread-73::INFO::2014-07-10 09:56:07,483::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-54::INFO::2014-07-10 09:56:07,483::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='28408446-e5fd-4565-a976-e760951593fe', volUUID='776303a2-5585-451e-826e-0e338d4a1e98', options=None) >Thread-73::DEBUG::2014-07-10 09:56:07,484::task::1185::TaskManager.Task::(prepare) Task=`2c747252-6c60-4a6b-bdc1-a4415086b45d`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-73::DEBUG::2014-07-10 09:56:07,486::task::595::TaskManager.Task::(_updateState) Task=`2c747252-6c60-4a6b-bdc1-a4415086b45d`::moving from state preparing -> state finished >Thread-54::INFO::2014-07-10 09:56:07,486::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-73::DEBUG::2014-07-10 09:56:07,487::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-54::DEBUG::2014-07-10 09:56:07,488::task::1185::TaskManager.Task::(prepare) Task=`c6cd0e71-cf48-4ccd-bb5b-19e21df7c1bf`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-73::DEBUG::2014-07-10 09:56:07,489::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-54::DEBUG::2014-07-10 09:56:07,490::task::595::TaskManager.Task::(_updateState) Task=`c6cd0e71-cf48-4ccd-bb5b-19e21df7c1bf`::moving from state preparing -> state finished >Thread-73::DEBUG::2014-07-10 09:56:07,491::task::990::TaskManager.Task::(_decref) Task=`2c747252-6c60-4a6b-bdc1-a4415086b45d`::ref 0 aborting False >Thread-54::DEBUG::2014-07-10 09:56:07,492::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-54::DEBUG::2014-07-10 09:56:07,493::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-54::DEBUG::2014-07-10 09:56:07,493::task::990::TaskManager.Task::(_decref) Task=`c6cd0e71-cf48-4ccd-bb5b-19e21df7c1bf`::ref 0 aborting False >Thread-18::DEBUG::2014-07-10 09:56:08,037::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/metadata bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-10 09:56:08,057::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00075847 s, 5.4 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:56:09,264::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:56:09,378::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0274754 s, 37.3 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:56:11,394::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:56:11,517::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0456976 s, 22.4 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:56:13,532::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:56:13,633::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0378724 s, 27.0 MB/s\n'; <rc> = 0 >Thread-40::DEBUG::2014-07-10 09:56:14,214::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lion.qa.lab.tlv.redhat.com:_export_yuri2_backup2/6a70504d-00df-4869-8695-0f442053f6b6/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-40::DEBUG::2014-07-10 09:56:14,235::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n369 bytes (369 B) copied, 0.000468357 s, 788 kB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:56:15,649::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:56:15,735::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0296499 s, 34.5 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 09:56:16,310::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-14::DEBUG::2014-07-10 09:56:16,311::task::595::TaskManager.Task::(_updateState) Task=`beb063f6-8c76-482f-bbc5-ad522ff7525c`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 09:56:16,312::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-14::INFO::2014-07-10 09:56:16,312::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:56:16,312::task::1185::TaskManager.Task::(prepare) Task=`beb063f6-8c76-482f-bbc5-ad522ff7525c`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:56:16,313::task::595::TaskManager.Task::(_updateState) Task=`beb063f6-8c76-482f-bbc5-ad522ff7525c`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 09:56:16,313::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 09:56:16,313::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 09:56:16,313::task::990::TaskManager.Task::(_decref) Task=`beb063f6-8c76-482f-bbc5-ad522ff7525c`::ref 0 aborting False >Thread-34::DEBUG::2014-07-10 09:56:16,318::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-34::DEBUG::2014-07-10 09:56:16,318::task::595::TaskManager.Task::(_updateState) Task=`652896da-0033-4b1a-9ee4-5592651c6092`::moving from state init -> state preparing >Thread-34::INFO::2014-07-10 09:56:16,318::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-34::DEBUG::2014-07-10 09:56:16,319::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`6aadcf5c-e849-48d2-bb65-7a6e6c89364c`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-10 09:56:16,319::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' for lock type 'shared' >Thread-34::DEBUG::2014-07-10 09:56:16,320::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-10 09:56:16,320::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`6aadcf5c-e849-48d2-bb65-7a6e6c89364c`::Granted request >Thread-34::DEBUG::2014-07-10 09:56:16,320::task::827::TaskManager.Task::(resourceAcquired) Task=`652896da-0033-4b1a-9ee4-5592651c6092`::_resourcesAcquired: Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee (shared) >Thread-34::DEBUG::2014-07-10 09:56:16,320::task::990::TaskManager.Task::(_decref) Task=`652896da-0033-4b1a-9ee4-5592651c6092`::ref 1 aborting False >Thread-34::INFO::2014-07-10 09:56:16,322::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '531976159232', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:56:16,322::task::1185::TaskManager.Task::(prepare) Task=`652896da-0033-4b1a-9ee4-5592651c6092`::finished: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '531976159232', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:56:16,322::task::595::TaskManager.Task::(_updateState) Task=`652896da-0033-4b1a-9ee4-5592651c6092`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-10 09:56:16,322::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee': < ResourceRef 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-10 09:56:16,323::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-10 09:56:16,323::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' >Thread-34::DEBUG::2014-07-10 09:56:16,323::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' (0 active users) >Thread-34::DEBUG::2014-07-10 09:56:16,323::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-10 09:56:16,323::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', Clearing records. >Thread-34::DEBUG::2014-07-10 09:56:16,324::task::990::TaskManager.Task::(_decref) Task=`652896da-0033-4b1a-9ee4-5592651c6092`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 09:56:17,750::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:56:17,839::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.030812 s, 33.2 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-10 09:56:18,086::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/metadata bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-10 09:56:18,113::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00551666 s, 742 kB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:56:19,854::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:56:19,962::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0505522 s, 20.3 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 09:56:20,378::task::595::TaskManager.Task::(_updateState) Task=`5f33743f-a443-4544-be5c-6fdf7dd49bcf`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 09:56:20,378::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::INFO::2014-07-10 09:56:20,379::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00551666', 'lastCheck': '2.2', 'valid': True}, '6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000468357', 'lastCheck': '6.1', 'valid': True}} >Thread-14::DEBUG::2014-07-10 09:56:20,379::task::1185::TaskManager.Task::(prepare) Task=`5f33743f-a443-4544-be5c-6fdf7dd49bcf`::finished: {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00551666', 'lastCheck': '2.2', 'valid': True}, '6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000468357', 'lastCheck': '6.1', 'valid': True}} >Thread-14::DEBUG::2014-07-10 09:56:20,379::task::595::TaskManager.Task::(_updateState) Task=`5f33743f-a443-4544-be5c-6fdf7dd49bcf`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 09:56:20,379::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 09:56:20,380::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 09:56:20,380::task::990::TaskManager.Task::(_decref) Task=`5f33743f-a443-4544-be5c-6fdf7dd49bcf`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 09:56:21,979::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:56:22,076::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0376297 s, 27.2 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:56:24,091::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:56:24,205::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0290119 s, 35.3 MB/s\n'; <rc> = 0 >Thread-40::DEBUG::2014-07-10 09:56:24,268::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lion.qa.lab.tlv.redhat.com:_export_yuri2_backup2/6a70504d-00df-4869-8695-0f442053f6b6/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-40::DEBUG::2014-07-10 09:56:24,290::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n369 bytes (369 B) copied, 0.000497877 s, 741 kB/s\n'; <rc> = 0 >Thread-57::DEBUG::2014-07-10 09:56:24,581::task::595::TaskManager.Task::(_updateState) Task=`28b362bc-3fc0-4265-a0d7-9b8da1629d57`::moving from state init -> state preparing >Thread-57::INFO::2014-07-10 09:56:24,582::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='b6f6c0da-e67f-4902-b9ac-3069571a42fe', volUUID='c4cd1da8-05b7-45e0-80b1-1183d21443d9', options=None) >Thread-57::INFO::2014-07-10 09:56:24,582::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-57::DEBUG::2014-07-10 09:56:24,582::task::1185::TaskManager.Task::(prepare) Task=`28b362bc-3fc0-4265-a0d7-9b8da1629d57`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-57::DEBUG::2014-07-10 09:56:24,583::task::595::TaskManager.Task::(_updateState) Task=`28b362bc-3fc0-4265-a0d7-9b8da1629d57`::moving from state preparing -> state finished >Thread-57::DEBUG::2014-07-10 09:56:24,583::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-57::DEBUG::2014-07-10 09:56:24,583::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-57::DEBUG::2014-07-10 09:56:24,583::task::990::TaskManager.Task::(_decref) Task=`28b362bc-3fc0-4265-a0d7-9b8da1629d57`::ref 0 aborting False >Thread-67::DEBUG::2014-07-10 09:56:25,393::task::595::TaskManager.Task::(_updateState) Task=`88695819-c2f7-4596-a1db-fdaad18e8c25`::moving from state init -> state preparing >Thread-67::INFO::2014-07-10 09:56:25,394::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='f30c2cb7-a43a-4bf5-82b5-cfe07336f65c', volUUID='b0fbb3c9-55af-4a3a-95ad-fc56a80b9cf5', options=None) >Thread-67::INFO::2014-07-10 09:56:25,394::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-67::DEBUG::2014-07-10 09:56:25,394::task::1185::TaskManager.Task::(prepare) Task=`88695819-c2f7-4596-a1db-fdaad18e8c25`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-67::DEBUG::2014-07-10 09:56:25,395::task::595::TaskManager.Task::(_updateState) Task=`88695819-c2f7-4596-a1db-fdaad18e8c25`::moving from state preparing -> state finished >Thread-67::DEBUG::2014-07-10 09:56:25,395::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-67::DEBUG::2014-07-10 09:56:25,395::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-67::DEBUG::2014-07-10 09:56:25,395::task::990::TaskManager.Task::(_decref) Task=`88695819-c2f7-4596-a1db-fdaad18e8c25`::ref 0 aborting False >Thread-48::DEBUG::2014-07-10 09:56:25,546::task::595::TaskManager.Task::(_updateState) Task=`d279a53d-ca72-48e8-9561-a3ad774ea267`::moving from state init -> state preparing >Thread-48::INFO::2014-07-10 09:56:25,546::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='0cd7d6ce-f497-4243-a690-c57744861eea', volUUID='10b6a7dd-dc6c-43fa-ba17-92e4331b0e0b', options=None) >Thread-48::INFO::2014-07-10 09:56:25,547::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-48::DEBUG::2014-07-10 09:56:25,547::task::1185::TaskManager.Task::(prepare) Task=`d279a53d-ca72-48e8-9561-a3ad774ea267`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-48::DEBUG::2014-07-10 09:56:25,547::task::595::TaskManager.Task::(_updateState) Task=`d279a53d-ca72-48e8-9561-a3ad774ea267`::moving from state preparing -> state finished >Thread-48::DEBUG::2014-07-10 09:56:25,547::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-48::DEBUG::2014-07-10 09:56:25,548::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-48::DEBUG::2014-07-10 09:56:25,548::task::990::TaskManager.Task::(_decref) Task=`d279a53d-ca72-48e8-9561-a3ad774ea267`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 09:56:26,229::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:56:26,333::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0445464 s, 23.0 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 09:56:26,352::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-14::DEBUG::2014-07-10 09:56:26,353::task::595::TaskManager.Task::(_updateState) Task=`ea9cc144-0d9b-44e3-9724-256a799c91a2`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 09:56:26,353::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-14::INFO::2014-07-10 09:56:26,354::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:56:26,354::task::1185::TaskManager.Task::(prepare) Task=`ea9cc144-0d9b-44e3-9724-256a799c91a2`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:56:26,354::task::595::TaskManager.Task::(_updateState) Task=`ea9cc144-0d9b-44e3-9724-256a799c91a2`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 09:56:26,355::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 09:56:26,355::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 09:56:26,355::task::990::TaskManager.Task::(_decref) Task=`ea9cc144-0d9b-44e3-9724-256a799c91a2`::ref 0 aborting False >Thread-34::DEBUG::2014-07-10 09:56:26,359::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-34::DEBUG::2014-07-10 09:56:26,360::task::595::TaskManager.Task::(_updateState) Task=`e17c82bd-7808-4697-9d82-8c0a7378b97d`::moving from state init -> state preparing >Thread-34::INFO::2014-07-10 09:56:26,360::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-34::DEBUG::2014-07-10 09:56:26,361::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`20b07ecc-d98c-4f5a-ab5f-7c952751e489`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-10 09:56:26,361::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' for lock type 'shared' >Thread-34::DEBUG::2014-07-10 09:56:26,361::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-10 09:56:26,361::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`20b07ecc-d98c-4f5a-ab5f-7c952751e489`::Granted request >Thread-34::DEBUG::2014-07-10 09:56:26,362::task::827::TaskManager.Task::(resourceAcquired) Task=`e17c82bd-7808-4697-9d82-8c0a7378b97d`::_resourcesAcquired: Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee (shared) >Thread-34::DEBUG::2014-07-10 09:56:26,362::task::990::TaskManager.Task::(_decref) Task=`e17c82bd-7808-4697-9d82-8c0a7378b97d`::ref 1 aborting False >Thread-34::INFO::2014-07-10 09:56:26,363::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '531976159232', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:56:26,364::task::1185::TaskManager.Task::(prepare) Task=`e17c82bd-7808-4697-9d82-8c0a7378b97d`::finished: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '531976159232', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:56:26,364::task::595::TaskManager.Task::(_updateState) Task=`e17c82bd-7808-4697-9d82-8c0a7378b97d`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-10 09:56:26,364::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee': < ResourceRef 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-10 09:56:26,364::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-10 09:56:26,365::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' >Thread-34::DEBUG::2014-07-10 09:56:26,365::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' (0 active users) >Thread-34::DEBUG::2014-07-10 09:56:26,365::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-10 09:56:26,365::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', Clearing records. >Thread-34::DEBUG::2014-07-10 09:56:26,366::task::990::TaskManager.Task::(_decref) Task=`e17c82bd-7808-4697-9d82-8c0a7378b97d`::ref 0 aborting False >Thread-76::DEBUG::2014-07-10 09:56:27,354::task::595::TaskManager.Task::(_updateState) Task=`f44886aa-dcd9-4d81-af9c-7d92f05758b2`::moving from state init -> state preparing >Thread-76::INFO::2014-07-10 09:56:27,355::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='e4c65229-4247-4b33-b72a-f1d5ce72ad05', volUUID='cad94284-3ca9-4c30-933d-997f4460309e', options=None) >Thread-76::INFO::2014-07-10 09:56:27,356::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-76::DEBUG::2014-07-10 09:56:27,356::task::1185::TaskManager.Task::(prepare) Task=`f44886aa-dcd9-4d81-af9c-7d92f05758b2`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-76::DEBUG::2014-07-10 09:56:27,356::task::595::TaskManager.Task::(_updateState) Task=`f44886aa-dcd9-4d81-af9c-7d92f05758b2`::moving from state preparing -> state finished >Thread-76::DEBUG::2014-07-10 09:56:27,356::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-76::DEBUG::2014-07-10 09:56:27,356::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-76::DEBUG::2014-07-10 09:56:27,357::task::990::TaskManager.Task::(_decref) Task=`f44886aa-dcd9-4d81-af9c-7d92f05758b2`::ref 0 aborting False >Thread-18::DEBUG::2014-07-10 09:56:28,142::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/metadata bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-10 09:56:28,163::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000765027 s, 5.4 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:56:28,348::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:56:28,438::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0328583 s, 31.2 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:56:30,455::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:56:30,543::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0300179 s, 34.1 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:56:32,559::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:56:32,650::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0322401 s, 31.8 MB/s\n'; <rc> = 0 >Thread-40::DEBUG::2014-07-10 09:56:34,316::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lion.qa.lab.tlv.redhat.com:_export_yuri2_backup2/6a70504d-00df-4869-8695-0f442053f6b6/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-40::DEBUG::2014-07-10 09:56:34,360::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n369 bytes (369 B) copied, 0.000359459 s, 1.0 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:56:34,666::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:56:34,763::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0401939 s, 25.5 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 09:56:35,561::task::595::TaskManager.Task::(_updateState) Task=`cad440ea-0a50-49b7-9e51-863d353b5be2`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 09:56:35,561::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::INFO::2014-07-10 09:56:35,562::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000765027', 'lastCheck': '7.4', 'valid': True}, '6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000359459', 'lastCheck': '1.2', 'valid': True}} >Thread-14::DEBUG::2014-07-10 09:56:35,562::task::1185::TaskManager.Task::(prepare) Task=`cad440ea-0a50-49b7-9e51-863d353b5be2`::finished: {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000765027', 'lastCheck': '7.4', 'valid': True}, '6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000359459', 'lastCheck': '1.2', 'valid': True}} >Thread-14::DEBUG::2014-07-10 09:56:35,562::task::595::TaskManager.Task::(_updateState) Task=`cad440ea-0a50-49b7-9e51-863d353b5be2`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 09:56:35,562::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 09:56:35,563::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 09:56:35,563::task::990::TaskManager.Task::(_decref) Task=`cad440ea-0a50-49b7-9e51-863d353b5be2`::ref 0 aborting False >Thread-14::DEBUG::2014-07-10 09:56:36,402::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-14::DEBUG::2014-07-10 09:56:36,403::task::595::TaskManager.Task::(_updateState) Task=`43482313-43b4-40e3-ad68-258d0a020e1b`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 09:56:36,403::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-14::INFO::2014-07-10 09:56:36,404::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:56:36,404::task::1185::TaskManager.Task::(prepare) Task=`43482313-43b4-40e3-ad68-258d0a020e1b`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:56:36,404::task::595::TaskManager.Task::(_updateState) Task=`43482313-43b4-40e3-ad68-258d0a020e1b`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 09:56:36,404::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 09:56:36,405::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 09:56:36,405::task::990::TaskManager.Task::(_decref) Task=`43482313-43b4-40e3-ad68-258d0a020e1b`::ref 0 aborting False >Thread-34::DEBUG::2014-07-10 09:56:36,448::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-34::DEBUG::2014-07-10 09:56:36,449::task::595::TaskManager.Task::(_updateState) Task=`18205b59-39c8-4ea8-9dc3-9bdb3653a908`::moving from state init -> state preparing >Thread-34::INFO::2014-07-10 09:56:36,449::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-34::DEBUG::2014-07-10 09:56:36,450::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`b880c5c3-c0c6-4af6-8a6b-1d333e989535`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-10 09:56:36,450::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' for lock type 'shared' >Thread-34::DEBUG::2014-07-10 09:56:36,451::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-10 09:56:36,451::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`b880c5c3-c0c6-4af6-8a6b-1d333e989535`::Granted request >Thread-34::DEBUG::2014-07-10 09:56:36,451::task::827::TaskManager.Task::(resourceAcquired) Task=`18205b59-39c8-4ea8-9dc3-9bdb3653a908`::_resourcesAcquired: Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee (shared) >Thread-34::DEBUG::2014-07-10 09:56:36,452::task::990::TaskManager.Task::(_decref) Task=`18205b59-39c8-4ea8-9dc3-9bdb3653a908`::ref 1 aborting False >Thread-34::INFO::2014-07-10 09:56:36,453::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '531976159232', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:56:36,453::task::1185::TaskManager.Task::(prepare) Task=`18205b59-39c8-4ea8-9dc3-9bdb3653a908`::finished: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '531976159232', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:56:36,453::task::595::TaskManager.Task::(_updateState) Task=`18205b59-39c8-4ea8-9dc3-9bdb3653a908`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-10 09:56:36,453::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee': < ResourceRef 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-10 09:56:36,453::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-10 09:56:36,454::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' >Thread-34::DEBUG::2014-07-10 09:56:36,454::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' (0 active users) >Thread-34::DEBUG::2014-07-10 09:56:36,454::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-10 09:56:36,454::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', Clearing records. >Thread-34::DEBUG::2014-07-10 09:56:36,455::task::990::TaskManager.Task::(_decref) Task=`18205b59-39c8-4ea8-9dc3-9bdb3653a908`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 09:56:36,778::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:56:36,863::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0270912 s, 37.8 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-10 09:56:38,193::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/metadata bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-10 09:56:38,216::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000806984 s, 5.1 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:56:38,879::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:56:38,971::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0356535 s, 28.7 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:56:40,985::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:56:41,067::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0271919 s, 37.7 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:56:43,083::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:56:43,177::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0331059 s, 30.9 MB/s\n'; <rc> = 0 >Thread-70::DEBUG::2014-07-10 09:56:44,281::task::595::TaskManager.Task::(_updateState) Task=`9d45dea4-718b-4cc5-adb1-fab2f2b80cd7`::moving from state init -> state preparing >Thread-70::INFO::2014-07-10 09:56:44,282::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='cfaeead2-7caa-467c-b389-c89840ae6605', volUUID='567fe32d-31a6-4ff6-90f3-fd6a656fbecc', options=None) >Thread-70::INFO::2014-07-10 09:56:44,283::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-70::DEBUG::2014-07-10 09:56:44,283::task::1185::TaskManager.Task::(prepare) Task=`9d45dea4-718b-4cc5-adb1-fab2f2b80cd7`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-70::DEBUG::2014-07-10 09:56:44,283::task::595::TaskManager.Task::(_updateState) Task=`9d45dea4-718b-4cc5-adb1-fab2f2b80cd7`::moving from state preparing -> state finished >Thread-70::DEBUG::2014-07-10 09:56:44,283::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-70::DEBUG::2014-07-10 09:56:44,284::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-70::DEBUG::2014-07-10 09:56:44,284::task::990::TaskManager.Task::(_decref) Task=`9d45dea4-718b-4cc5-adb1-fab2f2b80cd7`::ref 0 aborting False >Thread-40::DEBUG::2014-07-10 09:56:44,402::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lion.qa.lab.tlv.redhat.com:_export_yuri2_backup2/6a70504d-00df-4869-8695-0f442053f6b6/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-40::DEBUG::2014-07-10 09:56:44,473::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n369 bytes (369 B) copied, 0.000502405 s, 734 kB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:56:45,193::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:56:45,279::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0296288 s, 34.6 MB/s\n'; <rc> = 0 >Thread-60::DEBUG::2014-07-10 09:56:46,105::task::595::TaskManager.Task::(_updateState) Task=`535fe28c-cd5c-4756-8b27-53bbf390aafd`::moving from state init -> state preparing >Thread-51::DEBUG::2014-07-10 09:56:46,106::task::595::TaskManager.Task::(_updateState) Task=`2f15e652-cf88-4926-af2c-68f4f2039867`::moving from state init -> state preparing >Thread-60::INFO::2014-07-10 09:56:46,109::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='b034d5b0-e1e0-4011-b49b-4d45ddb11556', volUUID='3d7f62b5-328f-4d8e-8b69-873cfb5ae14d', options=None) >Thread-51::INFO::2014-07-10 09:56:46,111::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='76fdb054-02cd-42ed-9721-b3e65b34c3a4', volUUID='022dfe46-2cf7-4915-80b3-883158e3ca83', options=None) >Thread-60::INFO::2014-07-10 09:56:46,114::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-60::DEBUG::2014-07-10 09:56:46,116::task::1185::TaskManager.Task::(prepare) Task=`535fe28c-cd5c-4756-8b27-53bbf390aafd`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-51::INFO::2014-07-10 09:56:46,117::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-60::DEBUG::2014-07-10 09:56:46,119::task::595::TaskManager.Task::(_updateState) Task=`535fe28c-cd5c-4756-8b27-53bbf390aafd`::moving from state preparing -> state finished >Thread-51::DEBUG::2014-07-10 09:56:46,121::task::1185::TaskManager.Task::(prepare) Task=`2f15e652-cf88-4926-af2c-68f4f2039867`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-60::DEBUG::2014-07-10 09:56:46,121::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-51::DEBUG::2014-07-10 09:56:46,123::task::595::TaskManager.Task::(_updateState) Task=`2f15e652-cf88-4926-af2c-68f4f2039867`::moving from state preparing -> state finished >Thread-60::DEBUG::2014-07-10 09:56:46,125::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-51::DEBUG::2014-07-10 09:56:46,127::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-60::DEBUG::2014-07-10 09:56:46,128::task::990::TaskManager.Task::(_decref) Task=`535fe28c-cd5c-4756-8b27-53bbf390aafd`::ref 0 aborting False >Thread-51::DEBUG::2014-07-10 09:56:46,130::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-51::DEBUG::2014-07-10 09:56:46,132::task::990::TaskManager.Task::(_decref) Task=`2f15e652-cf88-4926-af2c-68f4f2039867`::ref 0 aborting False >Thread-14::DEBUG::2014-07-10 09:56:46,478::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-14::DEBUG::2014-07-10 09:56:46,479::task::595::TaskManager.Task::(_updateState) Task=`a529f86f-7764-4db0-a69d-4e8a665249d1`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 09:56:46,479::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-14::INFO::2014-07-10 09:56:46,480::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:56:46,480::task::1185::TaskManager.Task::(prepare) Task=`a529f86f-7764-4db0-a69d-4e8a665249d1`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:56:46,481::task::595::TaskManager.Task::(_updateState) Task=`a529f86f-7764-4db0-a69d-4e8a665249d1`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 09:56:46,481::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 09:56:46,481::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 09:56:46,481::task::990::TaskManager.Task::(_decref) Task=`a529f86f-7764-4db0-a69d-4e8a665249d1`::ref 0 aborting False >Thread-34::DEBUG::2014-07-10 09:56:46,486::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-34::DEBUG::2014-07-10 09:56:46,487::task::595::TaskManager.Task::(_updateState) Task=`e1a59d87-391d-4d9d-9f57-3316bf183d47`::moving from state init -> state preparing >Thread-34::INFO::2014-07-10 09:56:46,487::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-34::DEBUG::2014-07-10 09:56:46,488::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`412925ec-9824-4da2-a9f2-28cf57922665`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-10 09:56:46,489::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' for lock type 'shared' >Thread-34::DEBUG::2014-07-10 09:56:46,489::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-10 09:56:46,489::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`412925ec-9824-4da2-a9f2-28cf57922665`::Granted request >Thread-34::DEBUG::2014-07-10 09:56:46,490::task::827::TaskManager.Task::(resourceAcquired) Task=`e1a59d87-391d-4d9d-9f57-3316bf183d47`::_resourcesAcquired: Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee (shared) >Thread-34::DEBUG::2014-07-10 09:56:46,490::task::990::TaskManager.Task::(_decref) Task=`e1a59d87-391d-4d9d-9f57-3316bf183d47`::ref 1 aborting False >Thread-34::INFO::2014-07-10 09:56:46,491::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '531976159232', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:56:46,491::task::1185::TaskManager.Task::(prepare) Task=`e1a59d87-391d-4d9d-9f57-3316bf183d47`::finished: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '531976159232', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:56:46,492::task::595::TaskManager.Task::(_updateState) Task=`e1a59d87-391d-4d9d-9f57-3316bf183d47`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-10 09:56:46,492::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee': < ResourceRef 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-10 09:56:46,492::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-10 09:56:46,492::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' >Thread-34::DEBUG::2014-07-10 09:56:46,492::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' (0 active users) >Thread-34::DEBUG::2014-07-10 09:56:46,493::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-10 09:56:46,493::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', Clearing records. >Thread-34::DEBUG::2014-07-10 09:56:46,493::task::990::TaskManager.Task::(_decref) Task=`e1a59d87-391d-4d9d-9f57-3316bf183d47`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 09:56:47,294::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:56:47,389::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0351069 s, 29.2 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-10 09:56:48,245::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/metadata bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-10 09:56:48,268::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000952085 s, 4.3 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:56:49,404::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:56:49,681::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0884171 s, 11.6 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 09:56:50,757::task::595::TaskManager.Task::(_updateState) Task=`c1e751a0-c9c2-4988-b9a1-64508c40c4e0`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 09:56:50,761::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::INFO::2014-07-10 09:56:50,765::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000952085', 'lastCheck': '2.5', 'valid': True}, '6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000502405', 'lastCheck': '6.3', 'valid': True}} >Thread-14::DEBUG::2014-07-10 09:56:50,767::task::1185::TaskManager.Task::(prepare) Task=`c1e751a0-c9c2-4988-b9a1-64508c40c4e0`::finished: {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000952085', 'lastCheck': '2.5', 'valid': True}, '6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000502405', 'lastCheck': '6.3', 'valid': True}} >Thread-14::DEBUG::2014-07-10 09:56:50,769::task::595::TaskManager.Task::(_updateState) Task=`c1e751a0-c9c2-4988-b9a1-64508c40c4e0`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 09:56:50,771::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 09:56:50,773::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 09:56:50,775::task::990::TaskManager.Task::(_decref) Task=`c1e751a0-c9c2-4988-b9a1-64508c40c4e0`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 09:56:51,706::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:56:51,815::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0353848 s, 28.9 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:56:53,831::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:56:53,933::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0412394 s, 24.8 MB/s\n'; <rc> = 0 >Thread-40::DEBUG::2014-07-10 09:56:54,505::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lion.qa.lab.tlv.redhat.com:_export_yuri2_backup2/6a70504d-00df-4869-8695-0f442053f6b6/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-40::DEBUG::2014-07-10 09:56:54,525::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n369 bytes (369 B) copied, 0.000447997 s, 824 kB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:56:55,948::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:56:56,058::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0526359 s, 19.5 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 09:56:56,528::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-14::DEBUG::2014-07-10 09:56:56,529::task::595::TaskManager.Task::(_updateState) Task=`07b53d50-4397-4ec2-ab95-f5efb7ba0229`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 09:56:56,529::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-14::INFO::2014-07-10 09:56:56,530::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:56:56,530::task::1185::TaskManager.Task::(prepare) Task=`07b53d50-4397-4ec2-ab95-f5efb7ba0229`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:56:56,530::task::595::TaskManager.Task::(_updateState) Task=`07b53d50-4397-4ec2-ab95-f5efb7ba0229`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 09:56:56,531::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 09:56:56,531::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 09:56:56,531::task::990::TaskManager.Task::(_decref) Task=`07b53d50-4397-4ec2-ab95-f5efb7ba0229`::ref 0 aborting False >Thread-34::DEBUG::2014-07-10 09:56:56,535::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-34::DEBUG::2014-07-10 09:56:56,535::task::595::TaskManager.Task::(_updateState) Task=`b1331605-a776-4a37-a44d-8ff3812854b6`::moving from state init -> state preparing >Thread-34::INFO::2014-07-10 09:56:56,536::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-34::DEBUG::2014-07-10 09:56:56,536::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`2d4c3b55-ce76-49f2-97e1-669e8f3d992d`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-10 09:56:56,537::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' for lock type 'shared' >Thread-34::DEBUG::2014-07-10 09:56:56,537::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-10 09:56:56,537::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`2d4c3b55-ce76-49f2-97e1-669e8f3d992d`::Granted request >Thread-34::DEBUG::2014-07-10 09:56:56,538::task::827::TaskManager.Task::(resourceAcquired) Task=`b1331605-a776-4a37-a44d-8ff3812854b6`::_resourcesAcquired: Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee (shared) >Thread-34::DEBUG::2014-07-10 09:56:56,538::task::990::TaskManager.Task::(_decref) Task=`b1331605-a776-4a37-a44d-8ff3812854b6`::ref 1 aborting False >Thread-34::INFO::2014-07-10 09:56:56,539::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '531976159232', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:56:56,539::task::1185::TaskManager.Task::(prepare) Task=`b1331605-a776-4a37-a44d-8ff3812854b6`::finished: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '531976159232', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:56:56,540::task::595::TaskManager.Task::(_updateState) Task=`b1331605-a776-4a37-a44d-8ff3812854b6`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-10 09:56:56,540::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee': < ResourceRef 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-10 09:56:56,541::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-10 09:56:56,542::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' >Thread-34::DEBUG::2014-07-10 09:56:56,542::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' (0 active users) >Thread-34::DEBUG::2014-07-10 09:56:56,542::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-10 09:56:56,543::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', Clearing records. >Thread-34::DEBUG::2014-07-10 09:56:56,543::task::990::TaskManager.Task::(_decref) Task=`b1331605-a776-4a37-a44d-8ff3812854b6`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 09:56:58,073::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:56:58,166::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0359914 s, 28.5 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-10 09:56:58,297::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/metadata bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-10 09:56:58,318::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000693416 s, 5.9 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:57:00,188::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:57:00,286::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.027766 s, 36.9 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:57:02,302::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:57:02,398::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0373598 s, 27.4 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:57:04,415::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Thread-64::DEBUG::2014-07-10 09:57:04,471::task::595::TaskManager.Task::(_updateState) Task=`21fab83b-5cfe-491d-9f33-62ca327ab22b`::moving from state init -> state preparing >Thread-64::INFO::2014-07-10 09:57:04,485::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='aa20346a-4d3a-4e07-b8e1-52c0ebe4168c', volUUID='58fefce2-9bce-4bff-8949-8c6ce8122b27', options=None) >Thread-64::INFO::2014-07-10 09:57:04,495::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-64::DEBUG::2014-07-10 09:57:04,505::task::1185::TaskManager.Task::(prepare) Task=`21fab83b-5cfe-491d-9f33-62ca327ab22b`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-64::DEBUG::2014-07-10 09:57:04,513::task::595::TaskManager.Task::(_updateState) Task=`21fab83b-5cfe-491d-9f33-62ca327ab22b`::moving from state preparing -> state finished >Thread-64::DEBUG::2014-07-10 09:57:04,522::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-64::DEBUG::2014-07-10 09:57:04,527::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-64::DEBUG::2014-07-10 09:57:04,535::task::990::TaskManager.Task::(_decref) Task=`21fab83b-5cfe-491d-9f33-62ca327ab22b`::ref 0 aborting False >Thread-40::DEBUG::2014-07-10 09:57:04,755::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lion.qa.lab.tlv.redhat.com:_export_yuri2_backup2/6a70504d-00df-4869-8695-0f442053f6b6/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-40::DEBUG::2014-07-10 09:57:04,804::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n369 bytes (369 B) copied, 0.000484441 s, 762 kB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:57:04,850::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.312789 s, 3.3 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 09:57:06,290::task::595::TaskManager.Task::(_updateState) Task=`121089cb-0a84-43ec-bb8c-a33d5523a243`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 09:57:06,291::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::INFO::2014-07-10 09:57:06,291::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000693416', 'lastCheck': '7.9', 'valid': True}, '6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000484441', 'lastCheck': '1.5', 'valid': True}} >Thread-14::DEBUG::2014-07-10 09:57:06,291::task::1185::TaskManager.Task::(prepare) Task=`121089cb-0a84-43ec-bb8c-a33d5523a243`::finished: {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000693416', 'lastCheck': '7.9', 'valid': True}, '6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000484441', 'lastCheck': '1.5', 'valid': True}} >Thread-14::DEBUG::2014-07-10 09:57:06,292::task::595::TaskManager.Task::(_updateState) Task=`121089cb-0a84-43ec-bb8c-a33d5523a243`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 09:57:06,292::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 09:57:06,292::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 09:57:06,292::task::990::TaskManager.Task::(_decref) Task=`121089cb-0a84-43ec-bb8c-a33d5523a243`::ref 0 aborting False >Thread-14::DEBUG::2014-07-10 09:57:06,573::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-14::DEBUG::2014-07-10 09:57:06,573::task::595::TaskManager.Task::(_updateState) Task=`41ce5a6b-31f2-4cd3-8299-6c861dea50e1`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 09:57:06,574::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-14::INFO::2014-07-10 09:57:06,574::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:57:06,574::task::1185::TaskManager.Task::(prepare) Task=`41ce5a6b-31f2-4cd3-8299-6c861dea50e1`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:57:06,574::task::595::TaskManager.Task::(_updateState) Task=`41ce5a6b-31f2-4cd3-8299-6c861dea50e1`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 09:57:06,575::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 09:57:06,575::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 09:57:06,575::task::990::TaskManager.Task::(_decref) Task=`41ce5a6b-31f2-4cd3-8299-6c861dea50e1`::ref 0 aborting False >Thread-34::DEBUG::2014-07-10 09:57:06,618::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-34::DEBUG::2014-07-10 09:57:06,619::task::595::TaskManager.Task::(_updateState) Task=`4d9bd481-6ed1-463c-a6c4-46bac8e764bf`::moving from state init -> state preparing >Thread-34::INFO::2014-07-10 09:57:06,619::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-34::DEBUG::2014-07-10 09:57:06,619::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`35f0f8a2-ce4c-40fa-9297-38ca8627baf3`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-10 09:57:06,619::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' for lock type 'shared' >Thread-34::DEBUG::2014-07-10 09:57:06,620::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-10 09:57:06,620::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`35f0f8a2-ce4c-40fa-9297-38ca8627baf3`::Granted request >Thread-34::DEBUG::2014-07-10 09:57:06,620::task::827::TaskManager.Task::(resourceAcquired) Task=`4d9bd481-6ed1-463c-a6c4-46bac8e764bf`::_resourcesAcquired: Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee (shared) >Thread-34::DEBUG::2014-07-10 09:57:06,621::task::990::TaskManager.Task::(_decref) Task=`4d9bd481-6ed1-463c-a6c4-46bac8e764bf`::ref 1 aborting False >Thread-34::INFO::2014-07-10 09:57:06,622::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '531976159232', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:57:06,622::task::1185::TaskManager.Task::(prepare) Task=`4d9bd481-6ed1-463c-a6c4-46bac8e764bf`::finished: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '531976159232', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:57:06,622::task::595::TaskManager.Task::(_updateState) Task=`4d9bd481-6ed1-463c-a6c4-46bac8e764bf`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-10 09:57:06,622::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee': < ResourceRef 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-10 09:57:06,622::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-10 09:57:06,623::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' >Thread-34::DEBUG::2014-07-10 09:57:06,623::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' (0 active users) >Thread-34::DEBUG::2014-07-10 09:57:06,623::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-10 09:57:06,623::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', Clearing records. >Thread-34::DEBUG::2014-07-10 09:57:06,623::task::990::TaskManager.Task::(_decref) Task=`4d9bd481-6ed1-463c-a6c4-46bac8e764bf`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 09:57:06,864::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:57:06,953::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0300245 s, 34.1 MB/s\n'; <rc> = 0 >Thread-54::DEBUG::2014-07-10 09:57:07,801::task::595::TaskManager.Task::(_updateState) Task=`dc041443-bb56-4579-b45c-249f661f7977`::moving from state init -> state preparing >Thread-54::INFO::2014-07-10 09:57:07,802::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='28408446-e5fd-4565-a976-e760951593fe', volUUID='776303a2-5585-451e-826e-0e338d4a1e98', options=None) >Thread-54::INFO::2014-07-10 09:57:07,802::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-54::DEBUG::2014-07-10 09:57:07,802::task::1185::TaskManager.Task::(prepare) Task=`dc041443-bb56-4579-b45c-249f661f7977`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-54::DEBUG::2014-07-10 09:57:07,803::task::595::TaskManager.Task::(_updateState) Task=`dc041443-bb56-4579-b45c-249f661f7977`::moving from state preparing -> state finished >Thread-54::DEBUG::2014-07-10 09:57:07,805::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-73::DEBUG::2014-07-10 09:57:07,806::task::595::TaskManager.Task::(_updateState) Task=`6df9750d-28fd-4ef8-8c5e-87eea6f68ddc`::moving from state init -> state preparing >Thread-54::DEBUG::2014-07-10 09:57:07,808::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-73::INFO::2014-07-10 09:57:07,812::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='c01d693b-cba0-4fed-9ad7-0aaa28912a19', volUUID='4bb5d954-2a50-4028-b299-0b43c261270c', options=None) >Thread-54::DEBUG::2014-07-10 09:57:07,812::task::990::TaskManager.Task::(_decref) Task=`dc041443-bb56-4579-b45c-249f661f7977`::ref 0 aborting False >Thread-73::INFO::2014-07-10 09:57:07,816::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-73::DEBUG::2014-07-10 09:57:07,816::task::1185::TaskManager.Task::(prepare) Task=`6df9750d-28fd-4ef8-8c5e-87eea6f68ddc`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-73::DEBUG::2014-07-10 09:57:07,816::task::595::TaskManager.Task::(_updateState) Task=`6df9750d-28fd-4ef8-8c5e-87eea6f68ddc`::moving from state preparing -> state finished >Thread-73::DEBUG::2014-07-10 09:57:07,816::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-73::DEBUG::2014-07-10 09:57:07,817::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-73::DEBUG::2014-07-10 09:57:07,817::task::990::TaskManager.Task::(_decref) Task=`6df9750d-28fd-4ef8-8c5e-87eea6f68ddc`::ref 0 aborting False >Thread-18::DEBUG::2014-07-10 09:57:08,348::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/metadata bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-10 09:57:08,371::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000629508 s, 6.5 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:57:08,969::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:57:09,061::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0327057 s, 31.3 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:57:11,077::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:57:11,165::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0298457 s, 34.3 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:57:13,180::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:57:13,266::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0267674 s, 38.3 MB/s\n'; <rc> = 0 >Thread-40::DEBUG::2014-07-10 09:57:14,843::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lion.qa.lab.tlv.redhat.com:_export_yuri2_backup2/6a70504d-00df-4869-8695-0f442053f6b6/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-40::DEBUG::2014-07-10 09:57:14,864::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n369 bytes (369 B) copied, 0.000419751 s, 879 kB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:57:15,281::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:57:15,368::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0297325 s, 34.4 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 09:57:16,644::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-14::DEBUG::2014-07-10 09:57:16,645::task::595::TaskManager.Task::(_updateState) Task=`660e13b2-e796-4a22-b0e0-ffba2e6ae6a8`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 09:57:16,645::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-14::INFO::2014-07-10 09:57:16,646::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:57:16,646::task::1185::TaskManager.Task::(prepare) Task=`660e13b2-e796-4a22-b0e0-ffba2e6ae6a8`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:57:16,646::task::595::TaskManager.Task::(_updateState) Task=`660e13b2-e796-4a22-b0e0-ffba2e6ae6a8`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 09:57:16,646::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 09:57:16,647::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 09:57:16,647::task::990::TaskManager.Task::(_decref) Task=`660e13b2-e796-4a22-b0e0-ffba2e6ae6a8`::ref 0 aborting False >Thread-34::DEBUG::2014-07-10 09:57:16,651::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-34::DEBUG::2014-07-10 09:57:16,651::task::595::TaskManager.Task::(_updateState) Task=`068a2128-53fe-4744-aadc-9220109b9e06`::moving from state init -> state preparing >Thread-34::INFO::2014-07-10 09:57:16,651::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-34::DEBUG::2014-07-10 09:57:16,652::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`47addf90-c250-4406-a32f-9e57bd1de174`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-10 09:57:16,652::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' for lock type 'shared' >Thread-34::DEBUG::2014-07-10 09:57:16,653::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-10 09:57:16,653::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`47addf90-c250-4406-a32f-9e57bd1de174`::Granted request >Thread-34::DEBUG::2014-07-10 09:57:16,654::task::827::TaskManager.Task::(resourceAcquired) Task=`068a2128-53fe-4744-aadc-9220109b9e06`::_resourcesAcquired: Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee (shared) >Thread-34::DEBUG::2014-07-10 09:57:16,654::task::990::TaskManager.Task::(_decref) Task=`068a2128-53fe-4744-aadc-9220109b9e06`::ref 1 aborting False >Thread-34::INFO::2014-07-10 09:57:16,655::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '531976159232', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:57:16,655::task::1185::TaskManager.Task::(prepare) Task=`068a2128-53fe-4744-aadc-9220109b9e06`::finished: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '531976159232', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:57:16,656::task::595::TaskManager.Task::(_updateState) Task=`068a2128-53fe-4744-aadc-9220109b9e06`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-10 09:57:16,656::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee': < ResourceRef 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-10 09:57:16,656::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-10 09:57:16,656::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' >Thread-34::DEBUG::2014-07-10 09:57:16,657::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' (0 active users) >Thread-34::DEBUG::2014-07-10 09:57:16,657::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-10 09:57:16,657::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', Clearing records. >Thread-34::DEBUG::2014-07-10 09:57:16,657::task::990::TaskManager.Task::(_decref) Task=`068a2128-53fe-4744-aadc-9220109b9e06`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 09:57:17,383::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:57:17,476::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0342238 s, 29.9 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-10 09:57:18,400::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/metadata bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-10 09:57:18,421::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000692811 s, 5.9 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:57:19,491::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:57:19,633::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0794836 s, 12.9 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 09:57:21,486::task::595::TaskManager.Task::(_updateState) Task=`b577c10b-1a04-474e-8e36-f22afc09c204`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 09:57:21,490::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::INFO::2014-07-10 09:57:21,492::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000692811', 'lastCheck': '3.0', 'valid': True}, '6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000419751', 'lastCheck': '6.6', 'valid': True}} >Thread-14::DEBUG::2014-07-10 09:57:21,495::task::1185::TaskManager.Task::(prepare) Task=`b577c10b-1a04-474e-8e36-f22afc09c204`::finished: {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000692811', 'lastCheck': '3.0', 'valid': True}, '6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000419751', 'lastCheck': '6.6', 'valid': True}} >Thread-14::DEBUG::2014-07-10 09:57:21,504::task::595::TaskManager.Task::(_updateState) Task=`b577c10b-1a04-474e-8e36-f22afc09c204`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 09:57:21,509::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 09:57:21,509::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 09:57:21,510::task::990::TaskManager.Task::(_decref) Task=`b577c10b-1a04-474e-8e36-f22afc09c204`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 09:57:21,664::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:57:21,752::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0293869 s, 34.8 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:57:23,767::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:57:23,880::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0545116 s, 18.8 MB/s\n'; <rc> = 0 >Thread-57::DEBUG::2014-07-10 09:57:24,893::task::595::TaskManager.Task::(_updateState) Task=`2c016c80-a43b-43b3-8995-6abe623c4e7c`::moving from state init -> state preparing >Thread-57::INFO::2014-07-10 09:57:24,897::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='b6f6c0da-e67f-4902-b9ac-3069571a42fe', volUUID='c4cd1da8-05b7-45e0-80b1-1183d21443d9', options=None) >Thread-57::INFO::2014-07-10 09:57:24,901::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-57::DEBUG::2014-07-10 09:57:24,904::task::1185::TaskManager.Task::(prepare) Task=`2c016c80-a43b-43b3-8995-6abe623c4e7c`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-57::DEBUG::2014-07-10 09:57:24,907::task::595::TaskManager.Task::(_updateState) Task=`2c016c80-a43b-43b3-8995-6abe623c4e7c`::moving from state preparing -> state finished >Thread-57::DEBUG::2014-07-10 09:57:24,909::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-57::DEBUG::2014-07-10 09:57:24,912::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-57::DEBUG::2014-07-10 09:57:24,915::task::990::TaskManager.Task::(_decref) Task=`2c016c80-a43b-43b3-8995-6abe623c4e7c`::ref 0 aborting False >Thread-40::DEBUG::2014-07-10 09:57:24,923::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lion.qa.lab.tlv.redhat.com:_export_yuri2_backup2/6a70504d-00df-4869-8695-0f442053f6b6/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-40::DEBUG::2014-07-10 09:57:24,944::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n369 bytes (369 B) copied, 0.000394713 s, 935 kB/s\n'; <rc> = 0 >Thread-67::DEBUG::2014-07-10 09:57:25,654::task::595::TaskManager.Task::(_updateState) Task=`0cc8b1fe-cb82-4be8-96e4-e731589528ce`::moving from state init -> state preparing >Thread-67::INFO::2014-07-10 09:57:25,655::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='f30c2cb7-a43a-4bf5-82b5-cfe07336f65c', volUUID='b0fbb3c9-55af-4a3a-95ad-fc56a80b9cf5', options=None) >Thread-67::INFO::2014-07-10 09:57:25,655::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-67::DEBUG::2014-07-10 09:57:25,655::task::1185::TaskManager.Task::(prepare) Task=`0cc8b1fe-cb82-4be8-96e4-e731589528ce`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-67::DEBUG::2014-07-10 09:57:25,656::task::595::TaskManager.Task::(_updateState) Task=`0cc8b1fe-cb82-4be8-96e4-e731589528ce`::moving from state preparing -> state finished >Thread-67::DEBUG::2014-07-10 09:57:25,656::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-67::DEBUG::2014-07-10 09:57:25,656::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-67::DEBUG::2014-07-10 09:57:25,657::task::990::TaskManager.Task::(_decref) Task=`0cc8b1fe-cb82-4be8-96e4-e731589528ce`::ref 0 aborting False >Thread-48::DEBUG::2014-07-10 09:57:25,811::task::595::TaskManager.Task::(_updateState) Task=`ca652a99-8a14-441e-9c77-db1c24873c61`::moving from state init -> state preparing >Thread-48::INFO::2014-07-10 09:57:25,811::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='0cd7d6ce-f497-4243-a690-c57744861eea', volUUID='10b6a7dd-dc6c-43fa-ba17-92e4331b0e0b', options=None) >Thread-48::INFO::2014-07-10 09:57:25,811::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-48::DEBUG::2014-07-10 09:57:25,812::task::1185::TaskManager.Task::(prepare) Task=`ca652a99-8a14-441e-9c77-db1c24873c61`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-48::DEBUG::2014-07-10 09:57:25,812::task::595::TaskManager.Task::(_updateState) Task=`ca652a99-8a14-441e-9c77-db1c24873c61`::moving from state preparing -> state finished >Thread-48::DEBUG::2014-07-10 09:57:25,812::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-48::DEBUG::2014-07-10 09:57:25,812::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-48::DEBUG::2014-07-10 09:57:25,812::task::990::TaskManager.Task::(_decref) Task=`ca652a99-8a14-441e-9c77-db1c24873c61`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 09:57:25,896::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:57:26,017::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0610545 s, 16.8 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 09:57:26,685::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-14::DEBUG::2014-07-10 09:57:26,686::task::595::TaskManager.Task::(_updateState) Task=`d94a60e1-fdd9-458b-b899-eec35a98e6a5`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 09:57:26,686::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-14::INFO::2014-07-10 09:57:26,688::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:57:26,689::task::1185::TaskManager.Task::(prepare) Task=`d94a60e1-fdd9-458b-b899-eec35a98e6a5`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:57:26,689::task::595::TaskManager.Task::(_updateState) Task=`d94a60e1-fdd9-458b-b899-eec35a98e6a5`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 09:57:26,689::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 09:57:26,689::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 09:57:26,689::task::990::TaskManager.Task::(_decref) Task=`d94a60e1-fdd9-458b-b899-eec35a98e6a5`::ref 0 aborting False >Thread-34::DEBUG::2014-07-10 09:57:26,694::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-34::DEBUG::2014-07-10 09:57:26,694::task::595::TaskManager.Task::(_updateState) Task=`f4363051-718b-487a-ae5f-db71e3a0e974`::moving from state init -> state preparing >Thread-34::INFO::2014-07-10 09:57:26,694::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-34::DEBUG::2014-07-10 09:57:26,695::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`218d489f-f215-4e56-8914-fddbf7932c68`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-10 09:57:26,695::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' for lock type 'shared' >Thread-34::DEBUG::2014-07-10 09:57:26,696::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-10 09:57:26,696::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`218d489f-f215-4e56-8914-fddbf7932c68`::Granted request >Thread-34::DEBUG::2014-07-10 09:57:26,696::task::827::TaskManager.Task::(resourceAcquired) Task=`f4363051-718b-487a-ae5f-db71e3a0e974`::_resourcesAcquired: Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee (shared) >Thread-34::DEBUG::2014-07-10 09:57:26,697::task::990::TaskManager.Task::(_decref) Task=`f4363051-718b-487a-ae5f-db71e3a0e974`::ref 1 aborting False >Thread-34::INFO::2014-07-10 09:57:26,698::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '531976159232', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:57:26,698::task::1185::TaskManager.Task::(prepare) Task=`f4363051-718b-487a-ae5f-db71e3a0e974`::finished: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '531976159232', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:57:26,698::task::595::TaskManager.Task::(_updateState) Task=`f4363051-718b-487a-ae5f-db71e3a0e974`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-10 09:57:26,698::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee': < ResourceRef 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-10 09:57:26,699::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-10 09:57:26,699::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' >Thread-34::DEBUG::2014-07-10 09:57:26,699::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' (0 active users) >Thread-34::DEBUG::2014-07-10 09:57:26,699::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-10 09:57:26,699::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', Clearing records. >Thread-34::DEBUG::2014-07-10 09:57:26,700::task::990::TaskManager.Task::(_decref) Task=`f4363051-718b-487a-ae5f-db71e3a0e974`::ref 0 aborting False >Thread-76::DEBUG::2014-07-10 09:57:27,634::task::595::TaskManager.Task::(_updateState) Task=`b46e9216-9c2d-4c66-81e3-842036eecc46`::moving from state init -> state preparing >Thread-76::INFO::2014-07-10 09:57:27,634::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='e4c65229-4247-4b33-b72a-f1d5ce72ad05', volUUID='cad94284-3ca9-4c30-933d-997f4460309e', options=None) >Thread-76::INFO::2014-07-10 09:57:27,635::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-76::DEBUG::2014-07-10 09:57:27,635::task::1185::TaskManager.Task::(prepare) Task=`b46e9216-9c2d-4c66-81e3-842036eecc46`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-76::DEBUG::2014-07-10 09:57:27,635::task::595::TaskManager.Task::(_updateState) Task=`b46e9216-9c2d-4c66-81e3-842036eecc46`::moving from state preparing -> state finished >Thread-76::DEBUG::2014-07-10 09:57:27,635::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-76::DEBUG::2014-07-10 09:57:27,635::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-76::DEBUG::2014-07-10 09:57:27,636::task::990::TaskManager.Task::(_decref) Task=`b46e9216-9c2d-4c66-81e3-842036eecc46`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 09:57:28,033::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:57:28,121::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.029961 s, 34.2 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-10 09:57:28,466::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/metadata bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-10 09:57:28,491::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00625611 s, 655 kB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:57:30,154::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:57:30,262::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0522272 s, 19.6 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:57:32,277::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:57:32,370::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0331 s, 30.9 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:57:34,388::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:57:34,500::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0397909 s, 25.7 MB/s\n'; <rc> = 0 >Thread-40::DEBUG::2014-07-10 09:57:34,975::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lion.qa.lab.tlv.redhat.com:_export_yuri2_backup2/6a70504d-00df-4869-8695-0f442053f6b6/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-40::DEBUG::2014-07-10 09:57:34,994::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n369 bytes (369 B) copied, 0.000473506 s, 779 kB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:57:36,517::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:57:36,609::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0314499 s, 32.6 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 09:57:36,687::task::595::TaskManager.Task::(_updateState) Task=`add9eea7-b27d-4415-b6f4-97882c4750e4`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 09:57:36,688::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::INFO::2014-07-10 09:57:36,688::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00625611', 'lastCheck': '8.2', 'valid': True}, '6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000473506', 'lastCheck': '1.7', 'valid': True}} >Thread-14::DEBUG::2014-07-10 09:57:36,688::task::1185::TaskManager.Task::(prepare) Task=`add9eea7-b27d-4415-b6f4-97882c4750e4`::finished: {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00625611', 'lastCheck': '8.2', 'valid': True}, '6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000473506', 'lastCheck': '1.7', 'valid': True}} >Thread-14::DEBUG::2014-07-10 09:57:36,688::task::595::TaskManager.Task::(_updateState) Task=`add9eea7-b27d-4415-b6f4-97882c4750e4`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 09:57:36,689::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 09:57:36,689::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 09:57:36,689::task::990::TaskManager.Task::(_decref) Task=`add9eea7-b27d-4415-b6f4-97882c4750e4`::ref 0 aborting False >Thread-14::DEBUG::2014-07-10 09:57:36,734::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-14::DEBUG::2014-07-10 09:57:36,734::task::595::TaskManager.Task::(_updateState) Task=`1fa30126-3d53-4aa8-ac65-fa4f425000af`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 09:57:36,735::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-14::INFO::2014-07-10 09:57:36,735::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:57:36,735::task::1185::TaskManager.Task::(prepare) Task=`1fa30126-3d53-4aa8-ac65-fa4f425000af`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:57:36,736::task::595::TaskManager.Task::(_updateState) Task=`1fa30126-3d53-4aa8-ac65-fa4f425000af`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 09:57:36,736::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 09:57:36,736::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 09:57:36,736::task::990::TaskManager.Task::(_decref) Task=`1fa30126-3d53-4aa8-ac65-fa4f425000af`::ref 0 aborting False >Thread-34::DEBUG::2014-07-10 09:57:36,779::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-34::DEBUG::2014-07-10 09:57:36,780::task::595::TaskManager.Task::(_updateState) Task=`21f581fe-5321-4bdd-910a-b35e5d10a9ea`::moving from state init -> state preparing >Thread-34::INFO::2014-07-10 09:57:36,780::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-34::DEBUG::2014-07-10 09:57:36,781::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`6d094e20-8284-478e-83fb-c8a2eb71d302`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-10 09:57:36,781::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' for lock type 'shared' >Thread-34::DEBUG::2014-07-10 09:57:36,781::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-10 09:57:36,782::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`6d094e20-8284-478e-83fb-c8a2eb71d302`::Granted request >Thread-34::DEBUG::2014-07-10 09:57:36,782::task::827::TaskManager.Task::(resourceAcquired) Task=`21f581fe-5321-4bdd-910a-b35e5d10a9ea`::_resourcesAcquired: Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee (shared) >Thread-34::DEBUG::2014-07-10 09:57:36,782::task::990::TaskManager.Task::(_decref) Task=`21f581fe-5321-4bdd-910a-b35e5d10a9ea`::ref 1 aborting False >Thread-34::INFO::2014-07-10 09:57:36,783::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '531976159232', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:57:36,784::task::1185::TaskManager.Task::(prepare) Task=`21f581fe-5321-4bdd-910a-b35e5d10a9ea`::finished: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '531976159232', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:57:36,784::task::595::TaskManager.Task::(_updateState) Task=`21f581fe-5321-4bdd-910a-b35e5d10a9ea`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-10 09:57:36,784::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee': < ResourceRef 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-10 09:57:36,784::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-10 09:57:36,784::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' >Thread-34::DEBUG::2014-07-10 09:57:36,785::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' (0 active users) >Thread-34::DEBUG::2014-07-10 09:57:36,785::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-10 09:57:36,785::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', Clearing records. >Thread-34::DEBUG::2014-07-10 09:57:36,785::task::990::TaskManager.Task::(_decref) Task=`21f581fe-5321-4bdd-910a-b35e5d10a9ea`::ref 0 aborting False >Thread-18::DEBUG::2014-07-10 09:57:38,523::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/metadata bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-10 09:57:38,552::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00549845 s, 745 kB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:57:38,625::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:57:38,723::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0366536 s, 27.9 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:57:40,738::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:57:40,850::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0529601 s, 19.3 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:57:42,865::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:57:42,952::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0298367 s, 34.3 MB/s\n'; <rc> = 0 >Thread-70::DEBUG::2014-07-10 09:57:44,576::task::595::TaskManager.Task::(_updateState) Task=`4c2f552a-da25-4d71-91a2-325ec96f6ba8`::moving from state init -> state preparing >Thread-70::INFO::2014-07-10 09:57:44,577::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='cfaeead2-7caa-467c-b389-c89840ae6605', volUUID='567fe32d-31a6-4ff6-90f3-fd6a656fbecc', options=None) >Thread-70::INFO::2014-07-10 09:57:44,577::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-70::DEBUG::2014-07-10 09:57:44,578::task::1185::TaskManager.Task::(prepare) Task=`4c2f552a-da25-4d71-91a2-325ec96f6ba8`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-70::DEBUG::2014-07-10 09:57:44,578::task::595::TaskManager.Task::(_updateState) Task=`4c2f552a-da25-4d71-91a2-325ec96f6ba8`::moving from state preparing -> state finished >Thread-70::DEBUG::2014-07-10 09:57:44,578::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-70::DEBUG::2014-07-10 09:57:44,578::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-70::DEBUG::2014-07-10 09:57:44,578::task::990::TaskManager.Task::(_decref) Task=`4c2f552a-da25-4d71-91a2-325ec96f6ba8`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 09:57:44,968::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Thread-40::DEBUG::2014-07-10 09:57:45,224::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lion.qa.lab.tlv.redhat.com:_export_yuri2_backup2/6a70504d-00df-4869-8695-0f442053f6b6/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-40::DEBUG::2014-07-10 09:57:45,264::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n369 bytes (369 B) copied, 0.000436408 s, 846 kB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:57:45,327::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.298979 s, 3.4 MB/s\n'; <rc> = 0 >Thread-51::DEBUG::2014-07-10 09:57:46,461::task::595::TaskManager.Task::(_updateState) Task=`a3b8bf60-294a-4d91-bb78-93fd73b4e4c3`::moving from state init -> state preparing >Thread-60::DEBUG::2014-07-10 09:57:46,461::task::595::TaskManager.Task::(_updateState) Task=`24385d4a-cd4f-4f09-8c6c-26d6ca5c647d`::moving from state init -> state preparing >Thread-51::INFO::2014-07-10 09:57:46,463::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='76fdb054-02cd-42ed-9721-b3e65b34c3a4', volUUID='022dfe46-2cf7-4915-80b3-883158e3ca83', options=None) >Thread-60::INFO::2014-07-10 09:57:46,464::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='b034d5b0-e1e0-4011-b49b-4d45ddb11556', volUUID='3d7f62b5-328f-4d8e-8b69-873cfb5ae14d', options=None) >Thread-51::INFO::2014-07-10 09:57:46,466::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-60::INFO::2014-07-10 09:57:46,466::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-51::DEBUG::2014-07-10 09:57:46,467::task::1185::TaskManager.Task::(prepare) Task=`a3b8bf60-294a-4d91-bb78-93fd73b4e4c3`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-60::DEBUG::2014-07-10 09:57:46,468::task::1185::TaskManager.Task::(prepare) Task=`24385d4a-cd4f-4f09-8c6c-26d6ca5c647d`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-51::DEBUG::2014-07-10 09:57:46,469::task::595::TaskManager.Task::(_updateState) Task=`a3b8bf60-294a-4d91-bb78-93fd73b4e4c3`::moving from state preparing -> state finished >Thread-60::DEBUG::2014-07-10 09:57:46,469::task::595::TaskManager.Task::(_updateState) Task=`24385d4a-cd4f-4f09-8c6c-26d6ca5c647d`::moving from state preparing -> state finished >Thread-60::DEBUG::2014-07-10 09:57:46,471::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-51::DEBUG::2014-07-10 09:57:46,471::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-60::DEBUG::2014-07-10 09:57:46,472::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-51::DEBUG::2014-07-10 09:57:46,472::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-60::DEBUG::2014-07-10 09:57:46,473::task::990::TaskManager.Task::(_decref) Task=`24385d4a-cd4f-4f09-8c6c-26d6ca5c647d`::ref 0 aborting False >Thread-51::DEBUG::2014-07-10 09:57:46,474::task::990::TaskManager.Task::(_decref) Task=`a3b8bf60-294a-4d91-bb78-93fd73b4e4c3`::ref 0 aborting False >Thread-14::DEBUG::2014-07-10 09:57:46,827::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-14::DEBUG::2014-07-10 09:57:46,828::task::595::TaskManager.Task::(_updateState) Task=`855c1e4a-71e3-4c67-a78b-43b94cab3e96`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 09:57:46,828::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-14::INFO::2014-07-10 09:57:46,829::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:57:46,829::task::1185::TaskManager.Task::(prepare) Task=`855c1e4a-71e3-4c67-a78b-43b94cab3e96`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:57:46,829::task::595::TaskManager.Task::(_updateState) Task=`855c1e4a-71e3-4c67-a78b-43b94cab3e96`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 09:57:46,829::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 09:57:46,829::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 09:57:46,830::task::990::TaskManager.Task::(_decref) Task=`855c1e4a-71e3-4c67-a78b-43b94cab3e96`::ref 0 aborting False >Thread-34::DEBUG::2014-07-10 09:57:46,833::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-34::DEBUG::2014-07-10 09:57:46,834::task::595::TaskManager.Task::(_updateState) Task=`ab331f2d-2ae9-475e-b259-092d0602f320`::moving from state init -> state preparing >Thread-34::INFO::2014-07-10 09:57:46,834::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-34::DEBUG::2014-07-10 09:57:46,835::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`6f9c393a-4965-4c73-9ffa-a5ffa88509ce`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-10 09:57:46,835::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' for lock type 'shared' >Thread-34::DEBUG::2014-07-10 09:57:46,835::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-10 09:57:46,836::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`6f9c393a-4965-4c73-9ffa-a5ffa88509ce`::Granted request >Thread-34::DEBUG::2014-07-10 09:57:46,836::task::827::TaskManager.Task::(resourceAcquired) Task=`ab331f2d-2ae9-475e-b259-092d0602f320`::_resourcesAcquired: Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee (shared) >Thread-34::DEBUG::2014-07-10 09:57:46,836::task::990::TaskManager.Task::(_decref) Task=`ab331f2d-2ae9-475e-b259-092d0602f320`::ref 1 aborting False >Thread-34::INFO::2014-07-10 09:57:46,837::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '531976159232', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:57:46,838::task::1185::TaskManager.Task::(prepare) Task=`ab331f2d-2ae9-475e-b259-092d0602f320`::finished: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '531976159232', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:57:46,838::task::595::TaskManager.Task::(_updateState) Task=`ab331f2d-2ae9-475e-b259-092d0602f320`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-10 09:57:46,838::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee': < ResourceRef 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-10 09:57:46,838::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-10 09:57:46,839::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' >Thread-34::DEBUG::2014-07-10 09:57:46,839::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' (0 active users) >Thread-34::DEBUG::2014-07-10 09:57:46,839::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-10 09:57:46,839::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', Clearing records. >Thread-34::DEBUG::2014-07-10 09:57:46,839::task::990::TaskManager.Task::(_decref) Task=`ab331f2d-2ae9-475e-b259-092d0602f320`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 09:57:47,343::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:57:47,435::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0353645 s, 29.0 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-10 09:57:48,584::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/metadata bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-10 09:57:48,616::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.0117264 s, 349 kB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:57:49,451::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:57:49,545::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.036116 s, 28.4 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:57:51,572::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:57:51,664::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0321556 s, 31.8 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 09:57:51,887::task::595::TaskManager.Task::(_updateState) Task=`565e74e0-9fbe-4780-88c4-25af8db59731`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 09:57:51,888::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::INFO::2014-07-10 09:57:51,888::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0117264', 'lastCheck': '3.2', 'valid': True}, '6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000436408', 'lastCheck': '6.6', 'valid': True}} >Thread-14::DEBUG::2014-07-10 09:57:51,889::task::1185::TaskManager.Task::(prepare) Task=`565e74e0-9fbe-4780-88c4-25af8db59731`::finished: {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0117264', 'lastCheck': '3.2', 'valid': True}, '6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000436408', 'lastCheck': '6.6', 'valid': True}} >Thread-14::DEBUG::2014-07-10 09:57:51,889::task::595::TaskManager.Task::(_updateState) Task=`565e74e0-9fbe-4780-88c4-25af8db59731`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 09:57:51,889::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 09:57:51,889::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 09:57:51,890::task::990::TaskManager.Task::(_decref) Task=`565e74e0-9fbe-4780-88c4-25af8db59731`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 09:57:53,679::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:57:53,769::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0326393 s, 31.4 MB/s\n'; <rc> = 0 >Thread-40::DEBUG::2014-07-10 09:57:55,312::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lion.qa.lab.tlv.redhat.com:_export_yuri2_backup2/6a70504d-00df-4869-8695-0f442053f6b6/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-40::DEBUG::2014-07-10 09:57:55,332::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n369 bytes (369 B) copied, 0.000435744 s, 847 kB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:57:55,786::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:57:55,879::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0355264 s, 28.8 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 09:57:56,870::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-14::DEBUG::2014-07-10 09:57:56,871::task::595::TaskManager.Task::(_updateState) Task=`1459e3e3-47b1-4c9a-863a-fadace3088ad`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 09:57:56,871::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-14::INFO::2014-07-10 09:57:56,872::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:57:56,872::task::1185::TaskManager.Task::(prepare) Task=`1459e3e3-47b1-4c9a-863a-fadace3088ad`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:57:56,872::task::595::TaskManager.Task::(_updateState) Task=`1459e3e3-47b1-4c9a-863a-fadace3088ad`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 09:57:56,872::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 09:57:56,872::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 09:57:56,873::task::990::TaskManager.Task::(_decref) Task=`1459e3e3-47b1-4c9a-863a-fadace3088ad`::ref 0 aborting False >Thread-34::DEBUG::2014-07-10 09:57:56,877::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-34::DEBUG::2014-07-10 09:57:56,877::task::595::TaskManager.Task::(_updateState) Task=`2dae2452-68b0-491b-8ab0-ffc85c7ef2e5`::moving from state init -> state preparing >Thread-34::INFO::2014-07-10 09:57:56,878::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-34::DEBUG::2014-07-10 09:57:56,878::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`0cd39946-e9d2-479e-a31d-75adfa94e91c`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-10 09:57:56,879::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' for lock type 'shared' >Thread-34::DEBUG::2014-07-10 09:57:56,879::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-10 09:57:56,879::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`0cd39946-e9d2-479e-a31d-75adfa94e91c`::Granted request >Thread-34::DEBUG::2014-07-10 09:57:56,880::task::827::TaskManager.Task::(resourceAcquired) Task=`2dae2452-68b0-491b-8ab0-ffc85c7ef2e5`::_resourcesAcquired: Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee (shared) >Thread-34::DEBUG::2014-07-10 09:57:56,880::task::990::TaskManager.Task::(_decref) Task=`2dae2452-68b0-491b-8ab0-ffc85c7ef2e5`::ref 1 aborting False >Thread-34::INFO::2014-07-10 09:57:56,881::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '531976159232', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:57:56,881::task::1185::TaskManager.Task::(prepare) Task=`2dae2452-68b0-491b-8ab0-ffc85c7ef2e5`::finished: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '531976159232', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:57:56,881::task::595::TaskManager.Task::(_updateState) Task=`2dae2452-68b0-491b-8ab0-ffc85c7ef2e5`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-10 09:57:56,882::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee': < ResourceRef 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-10 09:57:56,882::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-10 09:57:56,882::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' >Thread-34::DEBUG::2014-07-10 09:57:56,882::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' (0 active users) >Thread-34::DEBUG::2014-07-10 09:57:56,882::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-10 09:57:56,883::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', Clearing records. >Thread-34::DEBUG::2014-07-10 09:57:56,883::task::990::TaskManager.Task::(_decref) Task=`2dae2452-68b0-491b-8ab0-ffc85c7ef2e5`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 09:57:57,894::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:57:57,985::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0279674 s, 36.6 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-10 09:57:58,648::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/metadata bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-10 09:57:58,672::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00061275 s, 6.7 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:58:00,000::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:58:00,114::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0527751 s, 19.4 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:58:02,129::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:58:02,250::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0623521 s, 16.4 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:58:04,265::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:58:04,403::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0420209 s, 24.4 MB/s\n'; <rc> = 0 >Thread-64::DEBUG::2014-07-10 09:58:04,795::task::595::TaskManager.Task::(_updateState) Task=`5b630d29-3480-41c3-8cec-809765ce0e1c`::moving from state init -> state preparing >Thread-64::INFO::2014-07-10 09:58:04,796::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='aa20346a-4d3a-4e07-b8e1-52c0ebe4168c', volUUID='58fefce2-9bce-4bff-8949-8c6ce8122b27', options=None) >Thread-64::INFO::2014-07-10 09:58:04,796::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-64::DEBUG::2014-07-10 09:58:04,796::task::1185::TaskManager.Task::(prepare) Task=`5b630d29-3480-41c3-8cec-809765ce0e1c`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-64::DEBUG::2014-07-10 09:58:04,797::task::595::TaskManager.Task::(_updateState) Task=`5b630d29-3480-41c3-8cec-809765ce0e1c`::moving from state preparing -> state finished >Thread-64::DEBUG::2014-07-10 09:58:04,797::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-64::DEBUG::2014-07-10 09:58:04,797::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-64::DEBUG::2014-07-10 09:58:04,797::task::990::TaskManager.Task::(_decref) Task=`5b630d29-3480-41c3-8cec-809765ce0e1c`::ref 0 aborting False >Thread-40::DEBUG::2014-07-10 09:58:05,362::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lion.qa.lab.tlv.redhat.com:_export_yuri2_backup2/6a70504d-00df-4869-8695-0f442053f6b6/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-40::DEBUG::2014-07-10 09:58:05,384::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n369 bytes (369 B) copied, 0.000503431 s, 733 kB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:58:06,419::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:58:06,521::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0293123 s, 34.9 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 09:58:06,910::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-14::DEBUG::2014-07-10 09:58:06,911::task::595::TaskManager.Task::(_updateState) Task=`97afbc3c-fad4-41a3-9773-c6a3f1447a07`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 09:58:06,912::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-14::INFO::2014-07-10 09:58:06,912::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:58:06,912::task::1185::TaskManager.Task::(prepare) Task=`97afbc3c-fad4-41a3-9773-c6a3f1447a07`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:58:06,913::task::595::TaskManager.Task::(_updateState) Task=`97afbc3c-fad4-41a3-9773-c6a3f1447a07`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 09:58:06,913::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 09:58:06,913::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 09:58:06,913::task::990::TaskManager.Task::(_decref) Task=`97afbc3c-fad4-41a3-9773-c6a3f1447a07`::ref 0 aborting False >Thread-34::DEBUG::2014-07-10 09:58:06,917::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-34::DEBUG::2014-07-10 09:58:06,918::task::595::TaskManager.Task::(_updateState) Task=`63b6de5a-c708-4be0-8b61-418e33a111f4`::moving from state init -> state preparing >Thread-34::INFO::2014-07-10 09:58:06,918::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-34::DEBUG::2014-07-10 09:58:06,919::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`912035db-e118-4bd3-a67b-790382de17c9`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-10 09:58:06,919::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' for lock type 'shared' >Thread-34::DEBUG::2014-07-10 09:58:06,919::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-10 09:58:06,920::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`912035db-e118-4bd3-a67b-790382de17c9`::Granted request >Thread-34::DEBUG::2014-07-10 09:58:06,920::task::827::TaskManager.Task::(resourceAcquired) Task=`63b6de5a-c708-4be0-8b61-418e33a111f4`::_resourcesAcquired: Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee (shared) >Thread-34::DEBUG::2014-07-10 09:58:06,921::task::990::TaskManager.Task::(_decref) Task=`63b6de5a-c708-4be0-8b61-418e33a111f4`::ref 1 aborting False >Thread-34::INFO::2014-07-10 09:58:06,922::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '531976159232', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:58:06,922::task::1185::TaskManager.Task::(prepare) Task=`63b6de5a-c708-4be0-8b61-418e33a111f4`::finished: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '531976159232', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:58:06,922::task::595::TaskManager.Task::(_updateState) Task=`63b6de5a-c708-4be0-8b61-418e33a111f4`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-10 09:58:06,922::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee': < ResourceRef 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-10 09:58:06,923::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-10 09:58:06,923::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' >Thread-34::DEBUG::2014-07-10 09:58:06,923::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' (0 active users) >Thread-34::DEBUG::2014-07-10 09:58:06,923::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-10 09:58:06,923::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', Clearing records. >Thread-34::DEBUG::2014-07-10 09:58:06,924::task::990::TaskManager.Task::(_decref) Task=`63b6de5a-c708-4be0-8b61-418e33a111f4`::ref 0 aborting False >Thread-14::DEBUG::2014-07-10 09:58:07,076::task::595::TaskManager.Task::(_updateState) Task=`a725b203-e223-4903-b9b4-9a88b03f734a`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 09:58:07,077::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::INFO::2014-07-10 09:58:07,077::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00061275', 'lastCheck': '8.4', 'valid': True}, '6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000503431', 'lastCheck': '1.7', 'valid': True}} >Thread-14::DEBUG::2014-07-10 09:58:07,077::task::1185::TaskManager.Task::(prepare) Task=`a725b203-e223-4903-b9b4-9a88b03f734a`::finished: {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00061275', 'lastCheck': '8.4', 'valid': True}, '6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000503431', 'lastCheck': '1.7', 'valid': True}} >Thread-14::DEBUG::2014-07-10 09:58:07,077::task::595::TaskManager.Task::(_updateState) Task=`a725b203-e223-4903-b9b4-9a88b03f734a`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 09:58:07,077::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 09:58:07,078::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 09:58:07,078::task::990::TaskManager.Task::(_decref) Task=`a725b203-e223-4903-b9b4-9a88b03f734a`::ref 0 aborting False >Thread-54::DEBUG::2014-07-10 09:58:08,122::task::595::TaskManager.Task::(_updateState) Task=`94d16739-26de-43d3-b8de-1ca25a4d0c56`::moving from state init -> state preparing >Thread-54::INFO::2014-07-10 09:58:08,123::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='28408446-e5fd-4565-a976-e760951593fe', volUUID='776303a2-5585-451e-826e-0e338d4a1e98', options=None) >Thread-54::INFO::2014-07-10 09:58:08,124::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-73::DEBUG::2014-07-10 09:58:08,125::task::595::TaskManager.Task::(_updateState) Task=`d44b52b0-840c-455b-9a63-fa618bde293a`::moving from state init -> state preparing >Thread-54::DEBUG::2014-07-10 09:58:08,125::task::1185::TaskManager.Task::(prepare) Task=`94d16739-26de-43d3-b8de-1ca25a4d0c56`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-73::INFO::2014-07-10 09:58:08,126::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='c01d693b-cba0-4fed-9ad7-0aaa28912a19', volUUID='4bb5d954-2a50-4028-b299-0b43c261270c', options=None) >Thread-54::DEBUG::2014-07-10 09:58:08,127::task::595::TaskManager.Task::(_updateState) Task=`94d16739-26de-43d3-b8de-1ca25a4d0c56`::moving from state preparing -> state finished >Thread-54::DEBUG::2014-07-10 09:58:08,128::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-73::INFO::2014-07-10 09:58:08,128::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-54::DEBUG::2014-07-10 09:58:08,129::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-73::DEBUG::2014-07-10 09:58:08,129::task::1185::TaskManager.Task::(prepare) Task=`d44b52b0-840c-455b-9a63-fa618bde293a`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-54::DEBUG::2014-07-10 09:58:08,130::task::990::TaskManager.Task::(_decref) Task=`94d16739-26de-43d3-b8de-1ca25a4d0c56`::ref 0 aborting False >Thread-73::DEBUG::2014-07-10 09:58:08,131::task::595::TaskManager.Task::(_updateState) Task=`d44b52b0-840c-455b-9a63-fa618bde293a`::moving from state preparing -> state finished >Thread-73::DEBUG::2014-07-10 09:58:08,132::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-73::DEBUG::2014-07-10 09:58:08,132::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-73::DEBUG::2014-07-10 09:58:08,133::task::990::TaskManager.Task::(_decref) Task=`d44b52b0-840c-455b-9a63-fa618bde293a`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 09:58:08,536::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:58:08,659::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0353734 s, 28.9 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-10 09:58:08,706::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/metadata bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-10 09:58:08,735::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00661696 s, 619 kB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:58:10,675::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:58:10,780::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0301163 s, 34.0 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:58:12,795::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:58:12,885::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0269996 s, 37.9 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:58:14,898::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:58:14,998::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0411567 s, 24.9 MB/s\n'; <rc> = 0 >Thread-40::DEBUG::2014-07-10 09:58:15,388::domainMonitor::192::Storage.DomainMonitorThread::(_monitorDomain) Refreshing domain 6a70504d-00df-4869-8695-0f442053f6b6 >Thread-40::DEBUG::2014-07-10 09:58:15,413::fileSD::150::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/lion.qa.lab.tlv.redhat.com:_export_yuri2_backup2/6a70504d-00df-4869-8695-0f442053f6b6 >Thread-40::DEBUG::2014-07-10 09:58:15,415::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend >Thread-40::DEBUG::2014-07-10 09:58:15,418::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Backup', 'DESCRIPTION=test', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=0', 'POOL_UUID=4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', 'REMOTE_PATH=lion.qa.lab.tlv.redhat.com:/export/yuri2/backup2', 'ROLE=Regular', 'SDUUID=6a70504d-00df-4869-8695-0f442053f6b6', 'TYPE=NFS', 'VERSION=0', '_SHA_CKSUM=aab6b8e901ec435cd5f9de3c9e3f8b45dca569e0'] >Thread-40::DEBUG::2014-07-10 09:58:15,419::fileSD::609::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images [] >Thread-40::INFO::2014-07-10 09:58:15,419::sd::384::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 6a70504d-00df-4869-8695-0f442053f6b6_imageNS already registered >Thread-40::INFO::2014-07-10 09:58:15,420::sd::392::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 6a70504d-00df-4869-8695-0f442053f6b6_volumeNS already registered >Thread-40::DEBUG::2014-07-10 09:58:15,441::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lion.qa.lab.tlv.redhat.com:_export_yuri2_backup2/6a70504d-00df-4869-8695-0f442053f6b6/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-40::DEBUG::2014-07-10 09:58:15,462::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n369 bytes (369 B) copied, 0.000522612 s, 706 kB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 09:58:16,952::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-14::DEBUG::2014-07-10 09:58:16,953::task::595::TaskManager.Task::(_updateState) Task=`5f4d83ee-9bec-4a12-9c96-8efadfbc8256`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 09:58:16,954::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-14::INFO::2014-07-10 09:58:16,954::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:58:16,954::task::1185::TaskManager.Task::(prepare) Task=`5f4d83ee-9bec-4a12-9c96-8efadfbc8256`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:58:16,955::task::595::TaskManager.Task::(_updateState) Task=`5f4d83ee-9bec-4a12-9c96-8efadfbc8256`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 09:58:16,955::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 09:58:16,955::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 09:58:16,955::task::990::TaskManager.Task::(_decref) Task=`5f4d83ee-9bec-4a12-9c96-8efadfbc8256`::ref 0 aborting False >Thread-34::DEBUG::2014-07-10 09:58:16,959::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-34::DEBUG::2014-07-10 09:58:16,960::task::595::TaskManager.Task::(_updateState) Task=`54e8ae68-a140-4087-95db-8ae3612f99e7`::moving from state init -> state preparing >Thread-34::INFO::2014-07-10 09:58:16,960::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-34::DEBUG::2014-07-10 09:58:16,961::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`7214f5da-7f15-4cb8-b998-5e83e1de9db7`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-10 09:58:16,961::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' for lock type 'shared' >Thread-34::DEBUG::2014-07-10 09:58:16,961::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-10 09:58:16,962::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`7214f5da-7f15-4cb8-b998-5e83e1de9db7`::Granted request >Thread-34::DEBUG::2014-07-10 09:58:16,962::task::827::TaskManager.Task::(resourceAcquired) Task=`54e8ae68-a140-4087-95db-8ae3612f99e7`::_resourcesAcquired: Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee (shared) >Thread-34::DEBUG::2014-07-10 09:58:16,962::task::990::TaskManager.Task::(_decref) Task=`54e8ae68-a140-4087-95db-8ae3612f99e7`::ref 1 aborting False >Thread-34::INFO::2014-07-10 09:58:16,963::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '531976159232', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:58:16,964::task::1185::TaskManager.Task::(prepare) Task=`54e8ae68-a140-4087-95db-8ae3612f99e7`::finished: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '531976159232', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:58:16,964::task::595::TaskManager.Task::(_updateState) Task=`54e8ae68-a140-4087-95db-8ae3612f99e7`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-10 09:58:16,964::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee': < ResourceRef 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-10 09:58:16,964::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-10 09:58:16,965::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' >Thread-34::DEBUG::2014-07-10 09:58:16,965::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' (0 active users) >Thread-34::DEBUG::2014-07-10 09:58:16,965::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-10 09:58:16,965::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', Clearing records. >Thread-34::DEBUG::2014-07-10 09:58:16,965::task::990::TaskManager.Task::(_decref) Task=`54e8ae68-a140-4087-95db-8ae3612f99e7`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 09:58:17,014::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:58:17,110::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0354783 s, 28.9 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-10 09:58:18,764::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/metadata bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-10 09:58:18,792::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00712326 s, 575 kB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:58:19,126::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:58:19,223::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0385898 s, 26.5 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:58:21,251::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:58:21,354::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0431102 s, 23.8 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 09:58:22,249::task::595::TaskManager.Task::(_updateState) Task=`5dfadb94-9457-4158-9639-9c9939eab356`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 09:58:22,249::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::INFO::2014-07-10 09:58:22,250::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00712326', 'lastCheck': '3.4', 'valid': True}, '6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000522612', 'lastCheck': '6.8', 'valid': True}} >Thread-14::DEBUG::2014-07-10 09:58:22,250::task::1185::TaskManager.Task::(prepare) Task=`5dfadb94-9457-4158-9639-9c9939eab356`::finished: {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00712326', 'lastCheck': '3.4', 'valid': True}, '6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000522612', 'lastCheck': '6.8', 'valid': True}} >Thread-14::DEBUG::2014-07-10 09:58:22,250::task::595::TaskManager.Task::(_updateState) Task=`5dfadb94-9457-4158-9639-9c9939eab356`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 09:58:22,250::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 09:58:22,251::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 09:58:22,251::task::990::TaskManager.Task::(_decref) Task=`5dfadb94-9457-4158-9639-9c9939eab356`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 09:58:23,368::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:58:23,458::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0328928 s, 31.1 MB/s\n'; <rc> = 0 >Thread-57::DEBUG::2014-07-10 09:58:25,187::task::595::TaskManager.Task::(_updateState) Task=`c2a7c228-8a51-4fc2-adca-c181800a84cc`::moving from state init -> state preparing >Thread-57::INFO::2014-07-10 09:58:25,187::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='b6f6c0da-e67f-4902-b9ac-3069571a42fe', volUUID='c4cd1da8-05b7-45e0-80b1-1183d21443d9', options=None) >Thread-57::INFO::2014-07-10 09:58:25,188::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-57::DEBUG::2014-07-10 09:58:25,188::task::1185::TaskManager.Task::(prepare) Task=`c2a7c228-8a51-4fc2-adca-c181800a84cc`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-57::DEBUG::2014-07-10 09:58:25,188::task::595::TaskManager.Task::(_updateState) Task=`c2a7c228-8a51-4fc2-adca-c181800a84cc`::moving from state preparing -> state finished >Thread-57::DEBUG::2014-07-10 09:58:25,188::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-57::DEBUG::2014-07-10 09:58:25,189::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-57::DEBUG::2014-07-10 09:58:25,189::task::990::TaskManager.Task::(_decref) Task=`c2a7c228-8a51-4fc2-adca-c181800a84cc`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 09:58:25,474::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Thread-40::DEBUG::2014-07-10 09:58:25,529::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lion.qa.lab.tlv.redhat.com:_export_yuri2_backup2/6a70504d-00df-4869-8695-0f442053f6b6/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-40::DEBUG::2014-07-10 09:58:25,571::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n369 bytes (369 B) copied, 0.00043092 s, 856 kB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:58:25,651::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.118807 s, 8.6 MB/s\n'; <rc> = 0 >Thread-67::DEBUG::2014-07-10 09:58:25,923::task::595::TaskManager.Task::(_updateState) Task=`8813df11-8eba-40f8-ae83-9fc1ceb78bcc`::moving from state init -> state preparing >Thread-67::INFO::2014-07-10 09:58:25,924::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='f30c2cb7-a43a-4bf5-82b5-cfe07336f65c', volUUID='b0fbb3c9-55af-4a3a-95ad-fc56a80b9cf5', options=None) >Thread-67::INFO::2014-07-10 09:58:25,924::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-67::DEBUG::2014-07-10 09:58:25,925::task::1185::TaskManager.Task::(prepare) Task=`8813df11-8eba-40f8-ae83-9fc1ceb78bcc`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-67::DEBUG::2014-07-10 09:58:25,925::task::595::TaskManager.Task::(_updateState) Task=`8813df11-8eba-40f8-ae83-9fc1ceb78bcc`::moving from state preparing -> state finished >Thread-67::DEBUG::2014-07-10 09:58:25,925::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-67::DEBUG::2014-07-10 09:58:25,925::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-67::DEBUG::2014-07-10 09:58:25,926::task::990::TaskManager.Task::(_decref) Task=`8813df11-8eba-40f8-ae83-9fc1ceb78bcc`::ref 0 aborting False >Thread-48::DEBUG::2014-07-10 09:58:26,065::task::595::TaskManager.Task::(_updateState) Task=`e81040bb-ec87-4b5d-9de4-c7229f0400ab`::moving from state init -> state preparing >Thread-48::INFO::2014-07-10 09:58:26,065::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='0cd7d6ce-f497-4243-a690-c57744861eea', volUUID='10b6a7dd-dc6c-43fa-ba17-92e4331b0e0b', options=None) >Thread-48::INFO::2014-07-10 09:58:26,065::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-48::DEBUG::2014-07-10 09:58:26,065::task::1185::TaskManager.Task::(prepare) Task=`e81040bb-ec87-4b5d-9de4-c7229f0400ab`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-48::DEBUG::2014-07-10 09:58:26,066::task::595::TaskManager.Task::(_updateState) Task=`e81040bb-ec87-4b5d-9de4-c7229f0400ab`::moving from state preparing -> state finished >Thread-48::DEBUG::2014-07-10 09:58:26,066::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-48::DEBUG::2014-07-10 09:58:26,066::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-48::DEBUG::2014-07-10 09:58:26,066::task::990::TaskManager.Task::(_decref) Task=`e81040bb-ec87-4b5d-9de4-c7229f0400ab`::ref 0 aborting False >Thread-14::DEBUG::2014-07-10 09:58:26,995::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-14::DEBUG::2014-07-10 09:58:26,996::task::595::TaskManager.Task::(_updateState) Task=`54a97c55-3210-44f9-8d8b-eb8f92b77db4`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 09:58:26,996::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-14::INFO::2014-07-10 09:58:26,997::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:58:26,997::task::1185::TaskManager.Task::(prepare) Task=`54a97c55-3210-44f9-8d8b-eb8f92b77db4`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:58:26,997::task::595::TaskManager.Task::(_updateState) Task=`54a97c55-3210-44f9-8d8b-eb8f92b77db4`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 09:58:26,997::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 09:58:26,997::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 09:58:26,998::task::990::TaskManager.Task::(_decref) Task=`54a97c55-3210-44f9-8d8b-eb8f92b77db4`::ref 0 aborting False >Thread-34::DEBUG::2014-07-10 09:58:27,002::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-34::DEBUG::2014-07-10 09:58:27,002::task::595::TaskManager.Task::(_updateState) Task=`5c22927b-0db3-4974-ac3f-3b005c7d336d`::moving from state init -> state preparing >Thread-34::INFO::2014-07-10 09:58:27,003::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-34::DEBUG::2014-07-10 09:58:27,003::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`04067724-3f40-4a60-b53d-1683241f1442`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-10 09:58:27,003::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' for lock type 'shared' >Thread-34::DEBUG::2014-07-10 09:58:27,004::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-10 09:58:27,004::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`04067724-3f40-4a60-b53d-1683241f1442`::Granted request >Thread-34::DEBUG::2014-07-10 09:58:27,005::task::827::TaskManager.Task::(resourceAcquired) Task=`5c22927b-0db3-4974-ac3f-3b005c7d336d`::_resourcesAcquired: Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee (shared) >Thread-34::DEBUG::2014-07-10 09:58:27,005::task::990::TaskManager.Task::(_decref) Task=`5c22927b-0db3-4974-ac3f-3b005c7d336d`::ref 1 aborting False >Thread-34::INFO::2014-07-10 09:58:27,006::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '531976159232', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:58:27,006::task::1185::TaskManager.Task::(prepare) Task=`5c22927b-0db3-4974-ac3f-3b005c7d336d`::finished: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '531976159232', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:58:27,007::task::595::TaskManager.Task::(_updateState) Task=`5c22927b-0db3-4974-ac3f-3b005c7d336d`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-10 09:58:27,007::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee': < ResourceRef 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-10 09:58:27,007::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-10 09:58:27,007::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' >Thread-34::DEBUG::2014-07-10 09:58:27,007::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' (0 active users) >Thread-34::DEBUG::2014-07-10 09:58:27,008::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-10 09:58:27,008::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', Clearing records. >Thread-34::DEBUG::2014-07-10 09:58:27,008::task::990::TaskManager.Task::(_decref) Task=`5c22927b-0db3-4974-ac3f-3b005c7d336d`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 09:58:27,667::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:58:27,767::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0270629 s, 37.8 MB/s\n'; <rc> = 0 >Thread-76::DEBUG::2014-07-10 09:58:27,929::task::595::TaskManager.Task::(_updateState) Task=`d29f8667-d249-4894-9624-27d9d57e9615`::moving from state init -> state preparing >Thread-76::INFO::2014-07-10 09:58:27,929::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='e4c65229-4247-4b33-b72a-f1d5ce72ad05', volUUID='cad94284-3ca9-4c30-933d-997f4460309e', options=None) >Thread-76::INFO::2014-07-10 09:58:27,930::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-76::DEBUG::2014-07-10 09:58:27,930::task::1185::TaskManager.Task::(prepare) Task=`d29f8667-d249-4894-9624-27d9d57e9615`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-76::DEBUG::2014-07-10 09:58:27,930::task::595::TaskManager.Task::(_updateState) Task=`d29f8667-d249-4894-9624-27d9d57e9615`::moving from state preparing -> state finished >Thread-76::DEBUG::2014-07-10 09:58:27,930::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-76::DEBUG::2014-07-10 09:58:27,931::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-76::DEBUG::2014-07-10 09:58:27,931::task::990::TaskManager.Task::(_decref) Task=`d29f8667-d249-4894-9624-27d9d57e9615`::ref 0 aborting False >Thread-18::DEBUG::2014-07-10 09:58:28,821::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/metadata bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-10 09:58:28,885::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00442464 s, 926 kB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:58:29,783::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:58:29,888::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0476473 s, 21.5 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:58:31,904::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:58:32,003::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0378058 s, 27.1 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:58:34,021::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:58:34,108::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0291748 s, 35.1 MB/s\n'; <rc> = 0 >Thread-40::DEBUG::2014-07-10 09:58:35,629::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lion.qa.lab.tlv.redhat.com:_export_yuri2_backup2/6a70504d-00df-4869-8695-0f442053f6b6/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-40::DEBUG::2014-07-10 09:58:35,652::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n369 bytes (369 B) copied, 0.000583812 s, 632 kB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:58:36,123::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:58:36,239::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0436666 s, 23.5 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 09:58:37,035::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-14::DEBUG::2014-07-10 09:58:37,036::task::595::TaskManager.Task::(_updateState) Task=`aff62f11-2b4a-4f2c-917d-c501929efd20`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 09:58:37,037::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-14::INFO::2014-07-10 09:58:37,037::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:58:37,037::task::1185::TaskManager.Task::(prepare) Task=`aff62f11-2b4a-4f2c-917d-c501929efd20`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:58:37,038::task::595::TaskManager.Task::(_updateState) Task=`aff62f11-2b4a-4f2c-917d-c501929efd20`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 09:58:37,038::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 09:58:37,038::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 09:58:37,038::task::990::TaskManager.Task::(_decref) Task=`aff62f11-2b4a-4f2c-917d-c501929efd20`::ref 0 aborting False >Thread-34::DEBUG::2014-07-10 09:58:37,043::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-34::DEBUG::2014-07-10 09:58:37,043::task::595::TaskManager.Task::(_updateState) Task=`55571143-ad49-4bba-9ecf-e4413a5ea836`::moving from state init -> state preparing >Thread-34::INFO::2014-07-10 09:58:37,043::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-34::DEBUG::2014-07-10 09:58:37,044::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`bb62e980-9ae1-4ac5-9852-1aa7db4f9903`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-10 09:58:37,044::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' for lock type 'shared' >Thread-34::DEBUG::2014-07-10 09:58:37,045::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-10 09:58:37,045::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`bb62e980-9ae1-4ac5-9852-1aa7db4f9903`::Granted request >Thread-34::DEBUG::2014-07-10 09:58:37,045::task::827::TaskManager.Task::(resourceAcquired) Task=`55571143-ad49-4bba-9ecf-e4413a5ea836`::_resourcesAcquired: Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee (shared) >Thread-34::DEBUG::2014-07-10 09:58:37,046::task::990::TaskManager.Task::(_decref) Task=`55571143-ad49-4bba-9ecf-e4413a5ea836`::ref 1 aborting False >Thread-34::INFO::2014-07-10 09:58:37,047::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '531976159232', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:58:37,047::task::1185::TaskManager.Task::(prepare) Task=`55571143-ad49-4bba-9ecf-e4413a5ea836`::finished: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '531976159232', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:58:37,047::task::595::TaskManager.Task::(_updateState) Task=`55571143-ad49-4bba-9ecf-e4413a5ea836`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-10 09:58:37,047::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee': < ResourceRef 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-10 09:58:37,048::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-10 09:58:37,048::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' >Thread-34::DEBUG::2014-07-10 09:58:37,048::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' (0 active users) >Thread-34::DEBUG::2014-07-10 09:58:37,048::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-10 09:58:37,048::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', Clearing records. >Thread-34::DEBUG::2014-07-10 09:58:37,049::task::990::TaskManager.Task::(_decref) Task=`55571143-ad49-4bba-9ecf-e4413a5ea836`::ref 0 aborting False >Thread-14::DEBUG::2014-07-10 09:58:37,480::task::595::TaskManager.Task::(_updateState) Task=`fcf37d54-5ad3-4bc2-9936-104c3b27e613`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 09:58:37,480::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::INFO::2014-07-10 09:58:37,481::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00442464', 'lastCheck': '8.5', 'valid': True}, '6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000583812', 'lastCheck': '1.8', 'valid': True}} >Thread-14::DEBUG::2014-07-10 09:58:37,481::task::1185::TaskManager.Task::(prepare) Task=`fcf37d54-5ad3-4bc2-9936-104c3b27e613`::finished: {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00442464', 'lastCheck': '8.5', 'valid': True}, '6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000583812', 'lastCheck': '1.8', 'valid': True}} >Thread-14::DEBUG::2014-07-10 09:58:37,481::task::595::TaskManager.Task::(_updateState) Task=`fcf37d54-5ad3-4bc2-9936-104c3b27e613`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 09:58:37,481::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 09:58:37,482::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 09:58:37,482::task::990::TaskManager.Task::(_decref) Task=`fcf37d54-5ad3-4bc2-9936-104c3b27e613`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 09:58:38,249::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:58:38,350::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0352925 s, 29.0 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-10 09:58:38,970::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/metadata bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-10 09:58:38,993::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000607046 s, 6.7 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:58:40,365::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:58:40,454::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0294049 s, 34.8 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:58:42,469::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:58:42,567::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0413616 s, 24.8 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:58:44,583::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:58:44,753::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0349701 s, 29.3 MB/s\n'; <rc> = 0 >Thread-70::DEBUG::2014-07-10 09:58:44,876::task::595::TaskManager.Task::(_updateState) Task=`e2460e78-5ee1-4924-a39f-a503e6e23272`::moving from state init -> state preparing >Thread-70::INFO::2014-07-10 09:58:44,877::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='cfaeead2-7caa-467c-b389-c89840ae6605', volUUID='567fe32d-31a6-4ff6-90f3-fd6a656fbecc', options=None) >Thread-70::INFO::2014-07-10 09:58:44,877::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-70::DEBUG::2014-07-10 09:58:44,877::task::1185::TaskManager.Task::(prepare) Task=`e2460e78-5ee1-4924-a39f-a503e6e23272`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-70::DEBUG::2014-07-10 09:58:44,877::task::595::TaskManager.Task::(_updateState) Task=`e2460e78-5ee1-4924-a39f-a503e6e23272`::moving from state preparing -> state finished >Thread-70::DEBUG::2014-07-10 09:58:44,878::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-70::DEBUG::2014-07-10 09:58:44,878::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-70::DEBUG::2014-07-10 09:58:44,878::task::990::TaskManager.Task::(_decref) Task=`e2460e78-5ee1-4924-a39f-a503e6e23272`::ref 0 aborting False >Thread-40::DEBUG::2014-07-10 09:58:45,680::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lion.qa.lab.tlv.redhat.com:_export_yuri2_backup2/6a70504d-00df-4869-8695-0f442053f6b6/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-40::DEBUG::2014-07-10 09:58:45,701::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n369 bytes (369 B) copied, 0.000769374 s, 480 kB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:58:46,768::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Thread-51::DEBUG::2014-07-10 09:58:46,797::task::595::TaskManager.Task::(_updateState) Task=`65eea1b4-c1bc-4874-a7c8-84c5f78235fd`::moving from state init -> state preparing >Thread-60::DEBUG::2014-07-10 09:58:46,797::task::595::TaskManager.Task::(_updateState) Task=`5ad9f0ce-375e-4c86-a257-699fcf7af975`::moving from state init -> state preparing >Thread-51::INFO::2014-07-10 09:58:46,799::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='76fdb054-02cd-42ed-9721-b3e65b34c3a4', volUUID='022dfe46-2cf7-4915-80b3-883158e3ca83', options=None) >Thread-60::INFO::2014-07-10 09:58:46,800::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='b034d5b0-e1e0-4011-b49b-4d45ddb11556', volUUID='3d7f62b5-328f-4d8e-8b69-873cfb5ae14d', options=None) >Thread-51::INFO::2014-07-10 09:58:46,801::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-60::INFO::2014-07-10 09:58:46,802::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-51::DEBUG::2014-07-10 09:58:46,803::task::1185::TaskManager.Task::(prepare) Task=`65eea1b4-c1bc-4874-a7c8-84c5f78235fd`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-60::DEBUG::2014-07-10 09:58:46,803::task::1185::TaskManager.Task::(prepare) Task=`5ad9f0ce-375e-4c86-a257-699fcf7af975`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-51::DEBUG::2014-07-10 09:58:46,804::task::595::TaskManager.Task::(_updateState) Task=`65eea1b4-c1bc-4874-a7c8-84c5f78235fd`::moving from state preparing -> state finished >Thread-60::DEBUG::2014-07-10 09:58:46,804::task::595::TaskManager.Task::(_updateState) Task=`5ad9f0ce-375e-4c86-a257-699fcf7af975`::moving from state preparing -> state finished >Thread-51::DEBUG::2014-07-10 09:58:46,805::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-60::DEBUG::2014-07-10 09:58:46,806::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-51::DEBUG::2014-07-10 09:58:46,806::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-60::DEBUG::2014-07-10 09:58:46,808::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-51::DEBUG::2014-07-10 09:58:46,810::task::990::TaskManager.Task::(_decref) Task=`65eea1b4-c1bc-4874-a7c8-84c5f78235fd`::ref 0 aborting False >Thread-60::DEBUG::2014-07-10 09:58:46,813::task::990::TaskManager.Task::(_decref) Task=`5ad9f0ce-375e-4c86-a257-699fcf7af975`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 09:58:46,897::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0681295 s, 15.0 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 09:58:47,078::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-14::DEBUG::2014-07-10 09:58:47,080::task::595::TaskManager.Task::(_updateState) Task=`0f33731e-ea33-4eca-b886-c24164bdcc2e`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 09:58:47,080::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-14::INFO::2014-07-10 09:58:47,081::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:58:47,081::task::1185::TaskManager.Task::(prepare) Task=`0f33731e-ea33-4eca-b886-c24164bdcc2e`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:58:47,081::task::595::TaskManager.Task::(_updateState) Task=`0f33731e-ea33-4eca-b886-c24164bdcc2e`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 09:58:47,082::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 09:58:47,082::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 09:58:47,082::task::990::TaskManager.Task::(_decref) Task=`0f33731e-ea33-4eca-b886-c24164bdcc2e`::ref 0 aborting False >Thread-34::DEBUG::2014-07-10 09:58:47,086::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-34::DEBUG::2014-07-10 09:58:47,086::task::595::TaskManager.Task::(_updateState) Task=`ea996ea1-98ad-4443-8ca4-8f99e0627036`::moving from state init -> state preparing >Thread-34::INFO::2014-07-10 09:58:47,087::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-34::DEBUG::2014-07-10 09:58:47,087::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`65fe7988-8b3c-4fdc-a1dc-35f7dd3659ea`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-10 09:58:47,088::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' for lock type 'shared' >Thread-34::DEBUG::2014-07-10 09:58:47,088::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-10 09:58:47,089::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`65fe7988-8b3c-4fdc-a1dc-35f7dd3659ea`::Granted request >Thread-34::DEBUG::2014-07-10 09:58:47,090::task::827::TaskManager.Task::(resourceAcquired) Task=`ea996ea1-98ad-4443-8ca4-8f99e0627036`::_resourcesAcquired: Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee (shared) >Thread-34::DEBUG::2014-07-10 09:58:47,090::task::990::TaskManager.Task::(_decref) Task=`ea996ea1-98ad-4443-8ca4-8f99e0627036`::ref 1 aborting False >Thread-34::INFO::2014-07-10 09:58:47,091::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '531976159232', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:58:47,092::task::1185::TaskManager.Task::(prepare) Task=`ea996ea1-98ad-4443-8ca4-8f99e0627036`::finished: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '531976159232', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:58:47,092::task::595::TaskManager.Task::(_updateState) Task=`ea996ea1-98ad-4443-8ca4-8f99e0627036`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-10 09:58:47,092::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee': < ResourceRef 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-10 09:58:47,092::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-10 09:58:47,092::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' >Thread-34::DEBUG::2014-07-10 09:58:47,093::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' (0 active users) >Thread-34::DEBUG::2014-07-10 09:58:47,093::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-10 09:58:47,093::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', Clearing records. >Thread-34::DEBUG::2014-07-10 09:58:47,093::task::990::TaskManager.Task::(_decref) Task=`ea996ea1-98ad-4443-8ca4-8f99e0627036`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 09:58:48,912::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:58:49,017::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0460012 s, 22.3 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-10 09:58:49,028::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/metadata bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-10 09:58:49,082::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00197959 s, 2.1 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:58:51,346::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:58:51,449::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0452944 s, 22.6 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 09:58:52,670::task::595::TaskManager.Task::(_updateState) Task=`2da261d3-d313-4281-b79b-d35644ec6326`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 09:58:52,671::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::INFO::2014-07-10 09:58:52,672::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00197959', 'lastCheck': '3.3', 'valid': True}, '6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000769374', 'lastCheck': '7.0', 'valid': True}} >Thread-14::DEBUG::2014-07-10 09:58:52,672::task::1185::TaskManager.Task::(prepare) Task=`2da261d3-d313-4281-b79b-d35644ec6326`::finished: {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00197959', 'lastCheck': '3.3', 'valid': True}, '6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000769374', 'lastCheck': '7.0', 'valid': True}} >Thread-14::DEBUG::2014-07-10 09:58:52,672::task::595::TaskManager.Task::(_updateState) Task=`2da261d3-d313-4281-b79b-d35644ec6326`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 09:58:52,673::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 09:58:52,673::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 09:58:52,673::task::990::TaskManager.Task::(_decref) Task=`2da261d3-d313-4281-b79b-d35644ec6326`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 09:58:53,464::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:58:53,577::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0539198 s, 19.0 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:58:55,593::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:58:55,692::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0398233 s, 25.7 MB/s\n'; <rc> = 0 >Thread-40::DEBUG::2014-07-10 09:58:55,773::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lion.qa.lab.tlv.redhat.com:_export_yuri2_backup2/6a70504d-00df-4869-8695-0f442053f6b6/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-40::DEBUG::2014-07-10 09:58:55,794::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n369 bytes (369 B) copied, 0.000387573 s, 952 kB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 09:58:57,129::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-14::DEBUG::2014-07-10 09:58:57,131::task::595::TaskManager.Task::(_updateState) Task=`cda2ed1a-aac3-432d-ab04-5bced0c5ab6d`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 09:58:57,131::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-14::INFO::2014-07-10 09:58:57,132::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:58:57,132::task::1185::TaskManager.Task::(prepare) Task=`cda2ed1a-aac3-432d-ab04-5bced0c5ab6d`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:58:57,133::task::595::TaskManager.Task::(_updateState) Task=`cda2ed1a-aac3-432d-ab04-5bced0c5ab6d`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 09:58:57,133::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 09:58:57,133::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 09:58:57,133::task::990::TaskManager.Task::(_decref) Task=`cda2ed1a-aac3-432d-ab04-5bced0c5ab6d`::ref 0 aborting False >Thread-34::DEBUG::2014-07-10 09:58:57,138::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-34::DEBUG::2014-07-10 09:58:57,138::task::595::TaskManager.Task::(_updateState) Task=`d164bfea-2fe3-4115-8e67-3f60e64bb72f`::moving from state init -> state preparing >Thread-34::INFO::2014-07-10 09:58:57,138::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-34::DEBUG::2014-07-10 09:58:57,139::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`f8d76974-e3c8-480c-b89b-ec684b2d35b5`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-10 09:58:57,139::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' for lock type 'shared' >Thread-34::DEBUG::2014-07-10 09:58:57,139::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-10 09:58:57,140::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`f8d76974-e3c8-480c-b89b-ec684b2d35b5`::Granted request >Thread-34::DEBUG::2014-07-10 09:58:57,140::task::827::TaskManager.Task::(resourceAcquired) Task=`d164bfea-2fe3-4115-8e67-3f60e64bb72f`::_resourcesAcquired: Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee (shared) >Thread-34::DEBUG::2014-07-10 09:58:57,141::task::990::TaskManager.Task::(_decref) Task=`d164bfea-2fe3-4115-8e67-3f60e64bb72f`::ref 1 aborting False >Thread-34::INFO::2014-07-10 09:58:57,142::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '531976159232', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:58:57,142::task::1185::TaskManager.Task::(prepare) Task=`d164bfea-2fe3-4115-8e67-3f60e64bb72f`::finished: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '531976159232', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:58:57,142::task::595::TaskManager.Task::(_updateState) Task=`d164bfea-2fe3-4115-8e67-3f60e64bb72f`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-10 09:58:57,142::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee': < ResourceRef 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-10 09:58:57,142::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-10 09:58:57,143::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' >Thread-34::DEBUG::2014-07-10 09:58:57,143::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' (0 active users) >Thread-34::DEBUG::2014-07-10 09:58:57,143::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-10 09:58:57,143::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', Clearing records. >Thread-34::DEBUG::2014-07-10 09:58:57,144::task::990::TaskManager.Task::(_decref) Task=`d164bfea-2fe3-4115-8e67-3f60e64bb72f`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 09:58:57,754::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:58:57,905::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0598451 s, 17.1 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-10 09:58:59,359::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/metadata bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-10 09:58:59,439::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.0211057 s, 194 kB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:58:59,920::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:59:00,024::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0474189 s, 21.6 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:59:02,039::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:59:02,133::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0298352 s, 34.3 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:59:04,162::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:59:04,251::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0286935 s, 35.7 MB/s\n'; <rc> = 0 >Thread-64::DEBUG::2014-07-10 09:59:05,077::task::595::TaskManager.Task::(_updateState) Task=`2717f299-cb78-46a7-ac63-e4512636218c`::moving from state init -> state preparing >Thread-64::INFO::2014-07-10 09:59:05,078::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='aa20346a-4d3a-4e07-b8e1-52c0ebe4168c', volUUID='58fefce2-9bce-4bff-8949-8c6ce8122b27', options=None) >Thread-64::INFO::2014-07-10 09:59:05,078::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-64::DEBUG::2014-07-10 09:59:05,079::task::1185::TaskManager.Task::(prepare) Task=`2717f299-cb78-46a7-ac63-e4512636218c`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-64::DEBUG::2014-07-10 09:59:05,079::task::595::TaskManager.Task::(_updateState) Task=`2717f299-cb78-46a7-ac63-e4512636218c`::moving from state preparing -> state finished >Thread-64::DEBUG::2014-07-10 09:59:05,079::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-64::DEBUG::2014-07-10 09:59:05,079::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-64::DEBUG::2014-07-10 09:59:05,079::task::990::TaskManager.Task::(_decref) Task=`2717f299-cb78-46a7-ac63-e4512636218c`::ref 0 aborting False >Thread-40::DEBUG::2014-07-10 09:59:05,829::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lion.qa.lab.tlv.redhat.com:_export_yuri2_backup2/6a70504d-00df-4869-8695-0f442053f6b6/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-40::DEBUG::2014-07-10 09:59:05,850::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n369 bytes (369 B) copied, 0.000544595 s, 678 kB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:59:06,268::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:59:06,391::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.029993 s, 34.1 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 09:59:07,171::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-14::DEBUG::2014-07-10 09:59:07,172::task::595::TaskManager.Task::(_updateState) Task=`fbb1c5c3-8259-429d-a350-16559301f1f1`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 09:59:07,172::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-14::INFO::2014-07-10 09:59:07,173::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:59:07,173::task::1185::TaskManager.Task::(prepare) Task=`fbb1c5c3-8259-429d-a350-16559301f1f1`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:59:07,173::task::595::TaskManager.Task::(_updateState) Task=`fbb1c5c3-8259-429d-a350-16559301f1f1`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 09:59:07,174::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 09:59:07,174::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 09:59:07,174::task::990::TaskManager.Task::(_decref) Task=`fbb1c5c3-8259-429d-a350-16559301f1f1`::ref 0 aborting False >Thread-34::DEBUG::2014-07-10 09:59:07,178::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-34::DEBUG::2014-07-10 09:59:07,179::task::595::TaskManager.Task::(_updateState) Task=`2be9cd97-e341-4e3f-9687-fdc299cd2be6`::moving from state init -> state preparing >Thread-34::INFO::2014-07-10 09:59:07,179::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-34::DEBUG::2014-07-10 09:59:07,180::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`3a74adad-c3c2-4668-8aac-86af0dfe8e17`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-10 09:59:07,180::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' for lock type 'shared' >Thread-34::DEBUG::2014-07-10 09:59:07,180::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-10 09:59:07,181::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`3a74adad-c3c2-4668-8aac-86af0dfe8e17`::Granted request >Thread-34::DEBUG::2014-07-10 09:59:07,181::task::827::TaskManager.Task::(resourceAcquired) Task=`2be9cd97-e341-4e3f-9687-fdc299cd2be6`::_resourcesAcquired: Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee (shared) >Thread-34::DEBUG::2014-07-10 09:59:07,181::task::990::TaskManager.Task::(_decref) Task=`2be9cd97-e341-4e3f-9687-fdc299cd2be6`::ref 1 aborting False >Thread-34::INFO::2014-07-10 09:59:07,182::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '531976159232', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:59:07,183::task::1185::TaskManager.Task::(prepare) Task=`2be9cd97-e341-4e3f-9687-fdc299cd2be6`::finished: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '531976159232', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:59:07,183::task::595::TaskManager.Task::(_updateState) Task=`2be9cd97-e341-4e3f-9687-fdc299cd2be6`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-10 09:59:07,183::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee': < ResourceRef 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-10 09:59:07,183::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-10 09:59:07,184::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' >Thread-34::DEBUG::2014-07-10 09:59:07,184::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' (0 active users) >Thread-34::DEBUG::2014-07-10 09:59:07,184::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-10 09:59:07,184::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', Clearing records. >Thread-34::DEBUG::2014-07-10 09:59:07,184::task::990::TaskManager.Task::(_decref) Task=`2be9cd97-e341-4e3f-9687-fdc299cd2be6`::ref 0 aborting False >Thread-14::DEBUG::2014-07-10 09:59:07,855::task::595::TaskManager.Task::(_updateState) Task=`a9642b7c-608c-48f4-a268-255b3bbcf830`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 09:59:07,856::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::INFO::2014-07-10 09:59:07,860::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0211057', 'lastCheck': '8.3', 'valid': True}, '6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000544595', 'lastCheck': '2.0', 'valid': True}} >Thread-14::DEBUG::2014-07-10 09:59:07,860::task::1185::TaskManager.Task::(prepare) Task=`a9642b7c-608c-48f4-a268-255b3bbcf830`::finished: {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0211057', 'lastCheck': '8.3', 'valid': True}, '6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000544595', 'lastCheck': '2.0', 'valid': True}} >Thread-14::DEBUG::2014-07-10 09:59:07,860::task::595::TaskManager.Task::(_updateState) Task=`a9642b7c-608c-48f4-a268-255b3bbcf830`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 09:59:07,860::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 09:59:07,860::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 09:59:07,861::task::990::TaskManager.Task::(_decref) Task=`a9642b7c-608c-48f4-a268-255b3bbcf830`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 09:59:08,405::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Thread-54::DEBUG::2014-07-10 09:59:08,450::task::595::TaskManager.Task::(_updateState) Task=`e4cc4621-b230-4b73-bf63-e6f0456bf1a0`::moving from state init -> state preparing >Thread-73::DEBUG::2014-07-10 09:59:08,454::task::595::TaskManager.Task::(_updateState) Task=`4630abf3-d485-416d-a0bd-b15e0a9feeb6`::moving from state init -> state preparing >Thread-54::INFO::2014-07-10 09:59:08,459::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='28408446-e5fd-4565-a976-e760951593fe', volUUID='776303a2-5585-451e-826e-0e338d4a1e98', options=None) >Thread-73::INFO::2014-07-10 09:59:08,461::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='c01d693b-cba0-4fed-9ad7-0aaa28912a19', volUUID='4bb5d954-2a50-4028-b299-0b43c261270c', options=None) >Thread-54::INFO::2014-07-10 09:59:08,467::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-73::INFO::2014-07-10 09:59:08,470::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-54::DEBUG::2014-07-10 09:59:08,473::task::1185::TaskManager.Task::(prepare) Task=`e4cc4621-b230-4b73-bf63-e6f0456bf1a0`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-73::DEBUG::2014-07-10 09:59:08,476::task::1185::TaskManager.Task::(prepare) Task=`4630abf3-d485-416d-a0bd-b15e0a9feeb6`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-54::DEBUG::2014-07-10 09:59:08,478::task::595::TaskManager.Task::(_updateState) Task=`e4cc4621-b230-4b73-bf63-e6f0456bf1a0`::moving from state preparing -> state finished >Thread-73::DEBUG::2014-07-10 09:59:08,482::task::595::TaskManager.Task::(_updateState) Task=`4630abf3-d485-416d-a0bd-b15e0a9feeb6`::moving from state preparing -> state finished >Thread-54::DEBUG::2014-07-10 09:59:08,484::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-73::DEBUG::2014-07-10 09:59:08,487::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-54::DEBUG::2014-07-10 09:59:08,489::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-73::DEBUG::2014-07-10 09:59:08,493::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-54::DEBUG::2014-07-10 09:59:08,496::task::990::TaskManager.Task::(_decref) Task=`e4cc4621-b230-4b73-bf63-e6f0456bf1a0`::ref 0 aborting False >Thread-73::DEBUG::2014-07-10 09:59:08,500::task::990::TaskManager.Task::(_decref) Task=`4630abf3-d485-416d-a0bd-b15e0a9feeb6`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 09:59:08,566::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0980603 s, 10.4 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-10 09:59:09,546::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/metadata bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-10 09:59:09,568::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000760636 s, 5.4 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:59:10,582::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:59:10,671::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0324215 s, 31.6 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:59:12,688::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:59:12,770::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0263062 s, 38.9 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:59:14,787::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:59:14,881::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0349511 s, 29.3 MB/s\n'; <rc> = 0 >Thread-40::DEBUG::2014-07-10 09:59:15,878::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lion.qa.lab.tlv.redhat.com:_export_yuri2_backup2/6a70504d-00df-4869-8695-0f442053f6b6/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-40::DEBUG::2014-07-10 09:59:15,904::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n369 bytes (369 B) copied, 0.000427445 s, 863 kB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:59:16,907::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:59:17,009::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0379208 s, 27.0 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 09:59:17,271::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-14::DEBUG::2014-07-10 09:59:17,272::task::595::TaskManager.Task::(_updateState) Task=`30ea51cd-7adc-4a00-b880-14dabe663809`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 09:59:17,273::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-14::INFO::2014-07-10 09:59:17,273::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:59:17,273::task::1185::TaskManager.Task::(prepare) Task=`30ea51cd-7adc-4a00-b880-14dabe663809`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:59:17,274::task::595::TaskManager.Task::(_updateState) Task=`30ea51cd-7adc-4a00-b880-14dabe663809`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 09:59:17,274::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 09:59:17,274::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 09:59:17,274::task::990::TaskManager.Task::(_decref) Task=`30ea51cd-7adc-4a00-b880-14dabe663809`::ref 0 aborting False >Thread-34::DEBUG::2014-07-10 09:59:17,279::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-34::DEBUG::2014-07-10 09:59:17,280::task::595::TaskManager.Task::(_updateState) Task=`979da7a4-1813-4823-bda7-2772abdf6081`::moving from state init -> state preparing >Thread-34::INFO::2014-07-10 09:59:17,280::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-34::DEBUG::2014-07-10 09:59:17,281::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`e4b0c854-ba06-4272-8eed-78d2f62de4eb`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-10 09:59:17,281::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' for lock type 'shared' >Thread-34::DEBUG::2014-07-10 09:59:17,281::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-10 09:59:17,282::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`e4b0c854-ba06-4272-8eed-78d2f62de4eb`::Granted request >Thread-34::DEBUG::2014-07-10 09:59:17,282::task::827::TaskManager.Task::(resourceAcquired) Task=`979da7a4-1813-4823-bda7-2772abdf6081`::_resourcesAcquired: Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee (shared) >Thread-34::DEBUG::2014-07-10 09:59:17,282::task::990::TaskManager.Task::(_decref) Task=`979da7a4-1813-4823-bda7-2772abdf6081`::ref 1 aborting False >Thread-34::INFO::2014-07-10 09:59:17,284::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '531976159232', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:59:17,284::task::1185::TaskManager.Task::(prepare) Task=`979da7a4-1813-4823-bda7-2772abdf6081`::finished: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '531976159232', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:59:17,284::task::595::TaskManager.Task::(_updateState) Task=`979da7a4-1813-4823-bda7-2772abdf6081`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-10 09:59:17,284::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee': < ResourceRef 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-10 09:59:17,284::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-10 09:59:17,285::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' >Thread-34::DEBUG::2014-07-10 09:59:17,285::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' (0 active users) >Thread-34::DEBUG::2014-07-10 09:59:17,285::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-10 09:59:17,285::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', Clearing records. >Thread-34::DEBUG::2014-07-10 09:59:17,286::task::990::TaskManager.Task::(_decref) Task=`979da7a4-1813-4823-bda7-2772abdf6081`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 09:59:19,038::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:59:19,127::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0293565 s, 34.9 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-10 09:59:19,676::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/metadata bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-10 09:59:19,698::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000670644 s, 6.1 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:59:21,143::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:59:21,236::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0325789 s, 31.4 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 09:59:23,050::task::595::TaskManager.Task::(_updateState) Task=`a12b0b69-2ba3-4aca-9b63-3ebb7159bd97`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 09:59:23,050::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::INFO::2014-07-10 09:59:23,051::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000670644', 'lastCheck': '3.3', 'valid': True}, '6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000427445', 'lastCheck': '7.1', 'valid': True}} >Thread-14::DEBUG::2014-07-10 09:59:23,051::task::1185::TaskManager.Task::(prepare) Task=`a12b0b69-2ba3-4aca-9b63-3ebb7159bd97`::finished: {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000670644', 'lastCheck': '3.3', 'valid': True}, '6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000427445', 'lastCheck': '7.1', 'valid': True}} >Thread-14::DEBUG::2014-07-10 09:59:23,051::task::595::TaskManager.Task::(_updateState) Task=`a12b0b69-2ba3-4aca-9b63-3ebb7159bd97`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 09:59:23,051::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 09:59:23,052::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 09:59:23,052::task::990::TaskManager.Task::(_decref) Task=`a12b0b69-2ba3-4aca-9b63-3ebb7159bd97`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 09:59:23,250::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:59:23,347::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0255936 s, 40.0 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:59:25,362::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:59:25,450::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0306148 s, 33.4 MB/s\n'; <rc> = 0 >Thread-57::DEBUG::2014-07-10 09:59:25,471::task::595::TaskManager.Task::(_updateState) Task=`e766f8e5-4aba-4381-ab3c-0bb6b4609582`::moving from state init -> state preparing >Thread-57::INFO::2014-07-10 09:59:25,471::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='b6f6c0da-e67f-4902-b9ac-3069571a42fe', volUUID='c4cd1da8-05b7-45e0-80b1-1183d21443d9', options=None) >Thread-57::INFO::2014-07-10 09:59:25,472::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-57::DEBUG::2014-07-10 09:59:25,472::task::1185::TaskManager.Task::(prepare) Task=`e766f8e5-4aba-4381-ab3c-0bb6b4609582`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-57::DEBUG::2014-07-10 09:59:25,472::task::595::TaskManager.Task::(_updateState) Task=`e766f8e5-4aba-4381-ab3c-0bb6b4609582`::moving from state preparing -> state finished >Thread-57::DEBUG::2014-07-10 09:59:25,472::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-57::DEBUG::2014-07-10 09:59:25,473::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-57::DEBUG::2014-07-10 09:59:25,473::task::990::TaskManager.Task::(_decref) Task=`e766f8e5-4aba-4381-ab3c-0bb6b4609582`::ref 0 aborting False >Thread-40::DEBUG::2014-07-10 09:59:25,945::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lion.qa.lab.tlv.redhat.com:_export_yuri2_backup2/6a70504d-00df-4869-8695-0f442053f6b6/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-40::DEBUG::2014-07-10 09:59:25,963::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n369 bytes (369 B) copied, 0.000515869 s, 715 kB/s\n'; <rc> = 0 >Thread-67::DEBUG::2014-07-10 09:59:26,213::task::595::TaskManager.Task::(_updateState) Task=`b818c48b-c33e-4952-ae01-91a70a035776`::moving from state init -> state preparing >Thread-67::INFO::2014-07-10 09:59:26,214::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='f30c2cb7-a43a-4bf5-82b5-cfe07336f65c', volUUID='b0fbb3c9-55af-4a3a-95ad-fc56a80b9cf5', options=None) >Thread-67::INFO::2014-07-10 09:59:26,214::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-67::DEBUG::2014-07-10 09:59:26,215::task::1185::TaskManager.Task::(prepare) Task=`b818c48b-c33e-4952-ae01-91a70a035776`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-67::DEBUG::2014-07-10 09:59:26,215::task::595::TaskManager.Task::(_updateState) Task=`b818c48b-c33e-4952-ae01-91a70a035776`::moving from state preparing -> state finished >Thread-67::DEBUG::2014-07-10 09:59:26,215::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-67::DEBUG::2014-07-10 09:59:26,215::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-67::DEBUG::2014-07-10 09:59:26,215::task::990::TaskManager.Task::(_decref) Task=`b818c48b-c33e-4952-ae01-91a70a035776`::ref 0 aborting False >Thread-48::DEBUG::2014-07-10 09:59:26,323::task::595::TaskManager.Task::(_updateState) Task=`05ca1e1f-16f1-4225-9f65-79b1b58dbe97`::moving from state init -> state preparing >Thread-48::INFO::2014-07-10 09:59:26,323::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='0cd7d6ce-f497-4243-a690-c57744861eea', volUUID='10b6a7dd-dc6c-43fa-ba17-92e4331b0e0b', options=None) >Thread-48::INFO::2014-07-10 09:59:26,323::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-48::DEBUG::2014-07-10 09:59:26,324::task::1185::TaskManager.Task::(prepare) Task=`05ca1e1f-16f1-4225-9f65-79b1b58dbe97`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-48::DEBUG::2014-07-10 09:59:26,324::task::595::TaskManager.Task::(_updateState) Task=`05ca1e1f-16f1-4225-9f65-79b1b58dbe97`::moving from state preparing -> state finished >Thread-48::DEBUG::2014-07-10 09:59:26,324::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-48::DEBUG::2014-07-10 09:59:26,324::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-48::DEBUG::2014-07-10 09:59:26,324::task::990::TaskManager.Task::(_decref) Task=`05ca1e1f-16f1-4225-9f65-79b1b58dbe97`::ref 0 aborting False >Thread-14::DEBUG::2014-07-10 09:59:27,321::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-14::DEBUG::2014-07-10 09:59:27,322::task::595::TaskManager.Task::(_updateState) Task=`a4022f7f-b2f6-45b4-9270-371a4d449174`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 09:59:27,323::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-14::INFO::2014-07-10 09:59:27,323::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:59:27,323::task::1185::TaskManager.Task::(prepare) Task=`a4022f7f-b2f6-45b4-9270-371a4d449174`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:59:27,324::task::595::TaskManager.Task::(_updateState) Task=`a4022f7f-b2f6-45b4-9270-371a4d449174`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 09:59:27,324::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 09:59:27,324::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 09:59:27,324::task::990::TaskManager.Task::(_decref) Task=`a4022f7f-b2f6-45b4-9270-371a4d449174`::ref 0 aborting False >Thread-34::DEBUG::2014-07-10 09:59:27,329::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-34::DEBUG::2014-07-10 09:59:27,330::task::595::TaskManager.Task::(_updateState) Task=`39c7e50c-c74e-40b4-8c28-394f738dcce4`::moving from state init -> state preparing >Thread-34::INFO::2014-07-10 09:59:27,330::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-34::DEBUG::2014-07-10 09:59:27,331::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`a15cd854-1fe5-4a6b-bccd-7120f7958903`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-10 09:59:27,331::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' for lock type 'shared' >Thread-34::DEBUG::2014-07-10 09:59:27,332::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-10 09:59:27,332::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`a15cd854-1fe5-4a6b-bccd-7120f7958903`::Granted request >Thread-34::DEBUG::2014-07-10 09:59:27,332::task::827::TaskManager.Task::(resourceAcquired) Task=`39c7e50c-c74e-40b4-8c28-394f738dcce4`::_resourcesAcquired: Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee (shared) >Thread-34::DEBUG::2014-07-10 09:59:27,333::task::990::TaskManager.Task::(_decref) Task=`39c7e50c-c74e-40b4-8c28-394f738dcce4`::ref 1 aborting False >Thread-34::INFO::2014-07-10 09:59:27,334::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '531976159232', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:59:27,334::task::1185::TaskManager.Task::(prepare) Task=`39c7e50c-c74e-40b4-8c28-394f738dcce4`::finished: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '531976159232', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:59:27,334::task::595::TaskManager.Task::(_updateState) Task=`39c7e50c-c74e-40b4-8c28-394f738dcce4`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-10 09:59:27,334::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee': < ResourceRef 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-10 09:59:27,334::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-10 09:59:27,335::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' >Thread-34::DEBUG::2014-07-10 09:59:27,335::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' (0 active users) >Thread-34::DEBUG::2014-07-10 09:59:27,335::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-10 09:59:27,335::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', Clearing records. >Thread-34::DEBUG::2014-07-10 09:59:27,335::task::990::TaskManager.Task::(_decref) Task=`39c7e50c-c74e-40b4-8c28-394f738dcce4`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 09:59:27,465::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:59:27,555::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0294331 s, 34.8 MB/s\n'; <rc> = 0 >Thread-76::DEBUG::2014-07-10 09:59:28,220::task::595::TaskManager.Task::(_updateState) Task=`64016233-695e-4eec-8da6-da7adb909a3b`::moving from state init -> state preparing >Thread-76::INFO::2014-07-10 09:59:28,220::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='e4c65229-4247-4b33-b72a-f1d5ce72ad05', volUUID='cad94284-3ca9-4c30-933d-997f4460309e', options=None) >Thread-76::INFO::2014-07-10 09:59:28,221::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-76::DEBUG::2014-07-10 09:59:28,221::task::1185::TaskManager.Task::(prepare) Task=`64016233-695e-4eec-8da6-da7adb909a3b`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-76::DEBUG::2014-07-10 09:59:28,221::task::595::TaskManager.Task::(_updateState) Task=`64016233-695e-4eec-8da6-da7adb909a3b`::moving from state preparing -> state finished >Thread-76::DEBUG::2014-07-10 09:59:28,221::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-76::DEBUG::2014-07-10 09:59:28,222::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-76::DEBUG::2014-07-10 09:59:28,222::task::990::TaskManager.Task::(_decref) Task=`64016233-695e-4eec-8da6-da7adb909a3b`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 09:59:29,570::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:59:29,678::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.050162 s, 20.4 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-10 09:59:29,731::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/metadata bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-10 09:59:29,752::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000613708 s, 6.7 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:59:31,693::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:59:31,780::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.028581 s, 35.8 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:59:33,795::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:59:33,889::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0357682 s, 28.6 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:59:35,905::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Thread-40::DEBUG::2014-07-10 09:59:36,234::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lion.qa.lab.tlv.redhat.com:_export_yuri2_backup2/6a70504d-00df-4869-8695-0f442053f6b6/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-40::DEBUG::2014-07-10 09:59:36,280::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n369 bytes (369 B) copied, 0.000413919 s, 891 kB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:59:36,320::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.145836 s, 7.0 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 09:59:37,371::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-14::DEBUG::2014-07-10 09:59:37,372::task::595::TaskManager.Task::(_updateState) Task=`ba0ac7b0-403d-4528-8078-5f00a5594d2e`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 09:59:37,372::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-14::INFO::2014-07-10 09:59:37,373::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:59:37,373::task::1185::TaskManager.Task::(prepare) Task=`ba0ac7b0-403d-4528-8078-5f00a5594d2e`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:59:37,373::task::595::TaskManager.Task::(_updateState) Task=`ba0ac7b0-403d-4528-8078-5f00a5594d2e`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 09:59:37,373::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 09:59:37,373::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 09:59:37,374::task::990::TaskManager.Task::(_decref) Task=`ba0ac7b0-403d-4528-8078-5f00a5594d2e`::ref 0 aborting False >Thread-34::DEBUG::2014-07-10 09:59:37,377::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-34::DEBUG::2014-07-10 09:59:37,378::task::595::TaskManager.Task::(_updateState) Task=`57cdb02c-0dd6-45c4-8cbd-6b869a24783a`::moving from state init -> state preparing >Thread-34::INFO::2014-07-10 09:59:37,378::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-34::DEBUG::2014-07-10 09:59:37,379::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`5186810e-e329-4f26-8bfa-764d2b68e967`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-10 09:59:37,379::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' for lock type 'shared' >Thread-34::DEBUG::2014-07-10 09:59:37,379::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-10 09:59:37,379::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`5186810e-e329-4f26-8bfa-764d2b68e967`::Granted request >Thread-34::DEBUG::2014-07-10 09:59:37,380::task::827::TaskManager.Task::(resourceAcquired) Task=`57cdb02c-0dd6-45c4-8cbd-6b869a24783a`::_resourcesAcquired: Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee (shared) >Thread-34::DEBUG::2014-07-10 09:59:37,380::task::990::TaskManager.Task::(_decref) Task=`57cdb02c-0dd6-45c4-8cbd-6b869a24783a`::ref 1 aborting False >Thread-34::INFO::2014-07-10 09:59:37,381::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '531976159232', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:59:37,381::task::1185::TaskManager.Task::(prepare) Task=`57cdb02c-0dd6-45c4-8cbd-6b869a24783a`::finished: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '531976159232', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:59:37,382::task::595::TaskManager.Task::(_updateState) Task=`57cdb02c-0dd6-45c4-8cbd-6b869a24783a`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-10 09:59:37,382::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee': < ResourceRef 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-10 09:59:37,382::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-10 09:59:37,382::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' >Thread-34::DEBUG::2014-07-10 09:59:37,383::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' (0 active users) >Thread-34::DEBUG::2014-07-10 09:59:37,383::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-10 09:59:37,383::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', Clearing records. >Thread-34::DEBUG::2014-07-10 09:59:37,383::task::990::TaskManager.Task::(_decref) Task=`57cdb02c-0dd6-45c4-8cbd-6b869a24783a`::ref 0 aborting False >Thread-14::DEBUG::2014-07-10 09:59:38,240::task::595::TaskManager.Task::(_updateState) Task=`111d291a-8b18-4712-85b6-a0c84a27f3f9`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 09:59:38,240::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::INFO::2014-07-10 09:59:38,241::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000613708', 'lastCheck': '8.5', 'valid': True}, '6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000413919', 'lastCheck': '2.0', 'valid': True}} >Thread-14::DEBUG::2014-07-10 09:59:38,241::task::1185::TaskManager.Task::(prepare) Task=`111d291a-8b18-4712-85b6-a0c84a27f3f9`::finished: {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000613708', 'lastCheck': '8.5', 'valid': True}, '6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000413919', 'lastCheck': '2.0', 'valid': True}} >Thread-14::DEBUG::2014-07-10 09:59:38,241::task::595::TaskManager.Task::(_updateState) Task=`111d291a-8b18-4712-85b6-a0c84a27f3f9`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 09:59:38,241::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 09:59:38,242::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 09:59:38,242::task::990::TaskManager.Task::(_decref) Task=`111d291a-8b18-4712-85b6-a0c84a27f3f9`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 09:59:38,330::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:59:38,422::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0297943 s, 34.4 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-10 09:59:39,781::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/metadata bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-10 09:59:39,814::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000650716 s, 6.3 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:59:40,437::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:59:40,530::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.035801 s, 28.6 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:59:42,546::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:59:42,631::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0274131 s, 37.4 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:59:44,646::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:59:44,752::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0503268 s, 20.3 MB/s\n'; <rc> = 0 >Thread-70::DEBUG::2014-07-10 09:59:45,148::task::595::TaskManager.Task::(_updateState) Task=`7e375964-725e-4e2f-90fc-4bd8238dbf60`::moving from state init -> state preparing >Thread-70::INFO::2014-07-10 09:59:45,148::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='cfaeead2-7caa-467c-b389-c89840ae6605', volUUID='567fe32d-31a6-4ff6-90f3-fd6a656fbecc', options=None) >Thread-70::INFO::2014-07-10 09:59:45,149::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-70::DEBUG::2014-07-10 09:59:45,149::task::1185::TaskManager.Task::(prepare) Task=`7e375964-725e-4e2f-90fc-4bd8238dbf60`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-70::DEBUG::2014-07-10 09:59:45,149::task::595::TaskManager.Task::(_updateState) Task=`7e375964-725e-4e2f-90fc-4bd8238dbf60`::moving from state preparing -> state finished >Thread-70::DEBUG::2014-07-10 09:59:45,149::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-70::DEBUG::2014-07-10 09:59:45,150::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-70::DEBUG::2014-07-10 09:59:45,150::task::990::TaskManager.Task::(_decref) Task=`7e375964-725e-4e2f-90fc-4bd8238dbf60`::ref 0 aborting False >Thread-40::DEBUG::2014-07-10 09:59:46,313::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lion.qa.lab.tlv.redhat.com:_export_yuri2_backup2/6a70504d-00df-4869-8695-0f442053f6b6/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-40::DEBUG::2014-07-10 09:59:46,333::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n369 bytes (369 B) copied, 0.000508564 s, 726 kB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:59:46,767::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:59:46,859::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0324618 s, 31.5 MB/s\n'; <rc> = 0 >Thread-60::DEBUG::2014-07-10 09:59:47,117::task::595::TaskManager.Task::(_updateState) Task=`54106664-c3f2-4f3f-bd09-e6d54e46c6df`::moving from state init -> state preparing >Thread-51::DEBUG::2014-07-10 09:59:47,118::task::595::TaskManager.Task::(_updateState) Task=`f200e826-9ba6-4b86-a035-6ec3ff65a71e`::moving from state init -> state preparing >Thread-60::INFO::2014-07-10 09:59:47,120::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='b034d5b0-e1e0-4011-b49b-4d45ddb11556', volUUID='3d7f62b5-328f-4d8e-8b69-873cfb5ae14d', options=None) >Thread-51::INFO::2014-07-10 09:59:47,120::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='76fdb054-02cd-42ed-9721-b3e65b34c3a4', volUUID='022dfe46-2cf7-4915-80b3-883158e3ca83', options=None) >Thread-60::INFO::2014-07-10 09:59:47,122::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-51::INFO::2014-07-10 09:59:47,123::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-60::DEBUG::2014-07-10 09:59:47,124::task::1185::TaskManager.Task::(prepare) Task=`54106664-c3f2-4f3f-bd09-e6d54e46c6df`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-51::DEBUG::2014-07-10 09:59:47,124::task::1185::TaskManager.Task::(prepare) Task=`f200e826-9ba6-4b86-a035-6ec3ff65a71e`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-51::DEBUG::2014-07-10 09:59:47,126::task::595::TaskManager.Task::(_updateState) Task=`f200e826-9ba6-4b86-a035-6ec3ff65a71e`::moving from state preparing -> state finished >Thread-60::DEBUG::2014-07-10 09:59:47,126::task::595::TaskManager.Task::(_updateState) Task=`54106664-c3f2-4f3f-bd09-e6d54e46c6df`::moving from state preparing -> state finished >Thread-51::DEBUG::2014-07-10 09:59:47,127::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-60::DEBUG::2014-07-10 09:59:47,128::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-51::DEBUG::2014-07-10 09:59:47,129::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-60::DEBUG::2014-07-10 09:59:47,129::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-51::DEBUG::2014-07-10 09:59:47,131::task::990::TaskManager.Task::(_decref) Task=`f200e826-9ba6-4b86-a035-6ec3ff65a71e`::ref 0 aborting False >Thread-60::DEBUG::2014-07-10 09:59:47,131::task::990::TaskManager.Task::(_decref) Task=`54106664-c3f2-4f3f-bd09-e6d54e46c6df`::ref 0 aborting False >Thread-14::DEBUG::2014-07-10 09:59:47,411::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-14::DEBUG::2014-07-10 09:59:47,411::task::595::TaskManager.Task::(_updateState) Task=`69fb802e-a94d-4fc5-8811-3a8997cd3f38`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 09:59:47,412::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-14::INFO::2014-07-10 09:59:47,412::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:59:47,412::task::1185::TaskManager.Task::(prepare) Task=`69fb802e-a94d-4fc5-8811-3a8997cd3f38`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:59:47,413::task::595::TaskManager.Task::(_updateState) Task=`69fb802e-a94d-4fc5-8811-3a8997cd3f38`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 09:59:47,413::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 09:59:47,413::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 09:59:47,413::task::990::TaskManager.Task::(_decref) Task=`69fb802e-a94d-4fc5-8811-3a8997cd3f38`::ref 0 aborting False >Thread-34::DEBUG::2014-07-10 09:59:47,457::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-34::DEBUG::2014-07-10 09:59:47,458::task::595::TaskManager.Task::(_updateState) Task=`5a9b39a8-2fb5-4f36-aa53-469ddbe732b6`::moving from state init -> state preparing >Thread-34::INFO::2014-07-10 09:59:47,458::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-34::DEBUG::2014-07-10 09:59:47,459::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`77544afa-fcb9-430d-a07d-9c0bec63eb2b`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-10 09:59:47,459::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' for lock type 'shared' >Thread-34::DEBUG::2014-07-10 09:59:47,459::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-10 09:59:47,459::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`77544afa-fcb9-430d-a07d-9c0bec63eb2b`::Granted request >Thread-34::DEBUG::2014-07-10 09:59:47,460::task::827::TaskManager.Task::(resourceAcquired) Task=`5a9b39a8-2fb5-4f36-aa53-469ddbe732b6`::_resourcesAcquired: Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee (shared) >Thread-34::DEBUG::2014-07-10 09:59:47,460::task::990::TaskManager.Task::(_decref) Task=`5a9b39a8-2fb5-4f36-aa53-469ddbe732b6`::ref 1 aborting False >Thread-34::INFO::2014-07-10 09:59:47,462::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '531976159232', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:59:47,462::task::1185::TaskManager.Task::(prepare) Task=`5a9b39a8-2fb5-4f36-aa53-469ddbe732b6`::finished: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '531976159232', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:59:47,463::task::595::TaskManager.Task::(_updateState) Task=`5a9b39a8-2fb5-4f36-aa53-469ddbe732b6`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-10 09:59:47,463::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee': < ResourceRef 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-10 09:59:47,464::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-10 09:59:47,464::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' >Thread-34::DEBUG::2014-07-10 09:59:47,465::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' (0 active users) >Thread-34::DEBUG::2014-07-10 09:59:47,465::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-10 09:59:47,465::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', Clearing records. >Thread-34::DEBUG::2014-07-10 09:59:47,466::task::990::TaskManager.Task::(_decref) Task=`5a9b39a8-2fb5-4f36-aa53-469ddbe732b6`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 09:59:48,875::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:59:48,962::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0297511 s, 34.4 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-10 09:59:49,843::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/metadata bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-10 09:59:49,865::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000752274 s, 5.4 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:59:50,977::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:59:51,074::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0395075 s, 25.9 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:59:53,088::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:59:53,178::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.030503 s, 33.6 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 09:59:53,413::task::595::TaskManager.Task::(_updateState) Task=`c9b46a3c-c469-4225-9146-bc7ea1de1d44`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 09:59:53,414::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::INFO::2014-07-10 09:59:53,414::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000752274', 'lastCheck': '3.5', 'valid': True}, '6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000508564', 'lastCheck': '7.1', 'valid': True}} >Thread-14::DEBUG::2014-07-10 09:59:53,414::task::1185::TaskManager.Task::(prepare) Task=`c9b46a3c-c469-4225-9146-bc7ea1de1d44`::finished: {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000752274', 'lastCheck': '3.5', 'valid': True}, '6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000508564', 'lastCheck': '7.1', 'valid': True}} >Thread-14::DEBUG::2014-07-10 09:59:53,415::task::595::TaskManager.Task::(_updateState) Task=`c9b46a3c-c469-4225-9146-bc7ea1de1d44`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 09:59:53,415::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 09:59:53,415::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 09:59:53,415::task::990::TaskManager.Task::(_decref) Task=`c9b46a3c-c469-4225-9146-bc7ea1de1d44`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 09:59:55,194::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:59:55,298::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0447078 s, 22.9 MB/s\n'; <rc> = 0 >Thread-40::DEBUG::2014-07-10 09:59:56,455::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lion.qa.lab.tlv.redhat.com:_export_yuri2_backup2/6a70504d-00df-4869-8695-0f442053f6b6/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-40::DEBUG::2014-07-10 09:59:56,484::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n369 bytes (369 B) copied, 0.000466349 s, 791 kB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 09:59:57,315::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:59:57,402::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.029829 s, 34.3 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 09:59:57,505::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-14::DEBUG::2014-07-10 09:59:57,506::task::595::TaskManager.Task::(_updateState) Task=`60a5111a-a17c-4b03-a55d-e0e19fd0f84d`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 09:59:57,506::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-14::INFO::2014-07-10 09:59:57,507::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:59:57,507::task::1185::TaskManager.Task::(prepare) Task=`60a5111a-a17c-4b03-a55d-e0e19fd0f84d`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 09:59:57,507::task::595::TaskManager.Task::(_updateState) Task=`60a5111a-a17c-4b03-a55d-e0e19fd0f84d`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 09:59:57,508::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 09:59:57,508::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 09:59:57,508::task::990::TaskManager.Task::(_decref) Task=`60a5111a-a17c-4b03-a55d-e0e19fd0f84d`::ref 0 aborting False >Thread-34::DEBUG::2014-07-10 09:59:57,512::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-34::DEBUG::2014-07-10 09:59:57,513::task::595::TaskManager.Task::(_updateState) Task=`56b28874-1c00-433f-b0f9-03d98150971a`::moving from state init -> state preparing >Thread-34::INFO::2014-07-10 09:59:57,513::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-34::DEBUG::2014-07-10 09:59:57,514::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`c589435a-7252-4519-9b27-d557a8796449`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-10 09:59:57,514::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' for lock type 'shared' >Thread-34::DEBUG::2014-07-10 09:59:57,514::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-10 09:59:57,514::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`c589435a-7252-4519-9b27-d557a8796449`::Granted request >Thread-34::DEBUG::2014-07-10 09:59:57,515::task::827::TaskManager.Task::(resourceAcquired) Task=`56b28874-1c00-433f-b0f9-03d98150971a`::_resourcesAcquired: Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee (shared) >Thread-34::DEBUG::2014-07-10 09:59:57,515::task::990::TaskManager.Task::(_decref) Task=`56b28874-1c00-433f-b0f9-03d98150971a`::ref 1 aborting False >Thread-34::INFO::2014-07-10 09:59:57,516::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '531976159232', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:59:57,517::task::1185::TaskManager.Task::(prepare) Task=`56b28874-1c00-433f-b0f9-03d98150971a`::finished: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '531976159232', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 09:59:57,517::task::595::TaskManager.Task::(_updateState) Task=`56b28874-1c00-433f-b0f9-03d98150971a`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-10 09:59:57,517::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee': < ResourceRef 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-10 09:59:57,517::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-10 09:59:57,517::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' >Thread-34::DEBUG::2014-07-10 09:59:57,518::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' (0 active users) >Thread-34::DEBUG::2014-07-10 09:59:57,518::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-10 09:59:57,518::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', Clearing records. >Thread-34::DEBUG::2014-07-10 09:59:57,518::task::990::TaskManager.Task::(_decref) Task=`56b28874-1c00-433f-b0f9-03d98150971a`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 09:59:59,417::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 09:59:59,539::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0376729 s, 27.2 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-10 09:59:59,949::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/metadata bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-10 09:59:59,972::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000808075 s, 5.1 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 10:00:01,553::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 10:00:01,642::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0291148 s, 35.2 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 10:00:03,660::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 10:00:03,749::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0292015 s, 35.1 MB/s\n'; <rc> = 0 >Thread-64::DEBUG::2014-07-10 10:00:05,333::task::595::TaskManager.Task::(_updateState) Task=`88e9c8e0-5a49-42ed-bca1-d48f7c3b2a7f`::moving from state init -> state preparing >Thread-64::INFO::2014-07-10 10:00:05,334::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='aa20346a-4d3a-4e07-b8e1-52c0ebe4168c', volUUID='58fefce2-9bce-4bff-8949-8c6ce8122b27', options=None) >Thread-64::INFO::2014-07-10 10:00:05,335::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-64::DEBUG::2014-07-10 10:00:05,335::task::1185::TaskManager.Task::(prepare) Task=`88e9c8e0-5a49-42ed-bca1-d48f7c3b2a7f`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-64::DEBUG::2014-07-10 10:00:05,335::task::595::TaskManager.Task::(_updateState) Task=`88e9c8e0-5a49-42ed-bca1-d48f7c3b2a7f`::moving from state preparing -> state finished >Thread-64::DEBUG::2014-07-10 10:00:05,335::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-64::DEBUG::2014-07-10 10:00:05,335::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-64::DEBUG::2014-07-10 10:00:05,336::task::990::TaskManager.Task::(_decref) Task=`88e9c8e0-5a49-42ed-bca1-d48f7c3b2a7f`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 10:00:05,765::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 10:00:05,857::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0348333 s, 29.4 MB/s\n'; <rc> = 0 >Thread-40::DEBUG::2014-07-10 10:00:06,521::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lion.qa.lab.tlv.redhat.com:_export_yuri2_backup2/6a70504d-00df-4869-8695-0f442053f6b6/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-40::DEBUG::2014-07-10 10:00:06,541::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n369 bytes (369 B) copied, 0.000495646 s, 744 kB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 10:00:07,539::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-14::DEBUG::2014-07-10 10:00:07,540::task::595::TaskManager.Task::(_updateState) Task=`39aed85d-ea2e-40a9-bb22-877db0fac270`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 10:00:07,540::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-14::INFO::2014-07-10 10:00:07,541::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 10:00:07,541::task::1185::TaskManager.Task::(prepare) Task=`39aed85d-ea2e-40a9-bb22-877db0fac270`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 10:00:07,541::task::595::TaskManager.Task::(_updateState) Task=`39aed85d-ea2e-40a9-bb22-877db0fac270`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 10:00:07,541::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 10:00:07,542::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 10:00:07,542::task::990::TaskManager.Task::(_decref) Task=`39aed85d-ea2e-40a9-bb22-877db0fac270`::ref 0 aborting False >Thread-34::DEBUG::2014-07-10 10:00:07,546::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-34::DEBUG::2014-07-10 10:00:07,546::task::595::TaskManager.Task::(_updateState) Task=`93d73a18-b573-4076-8082-5c2eb53c9bdb`::moving from state init -> state preparing >Thread-34::INFO::2014-07-10 10:00:07,546::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-34::DEBUG::2014-07-10 10:00:07,547::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`7611fe14-31b8-421e-8ab0-ca495c383e4c`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-10 10:00:07,547::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' for lock type 'shared' >Thread-34::DEBUG::2014-07-10 10:00:07,548::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-10 10:00:07,548::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`7611fe14-31b8-421e-8ab0-ca495c383e4c`::Granted request >Thread-34::DEBUG::2014-07-10 10:00:07,548::task::827::TaskManager.Task::(resourceAcquired) Task=`93d73a18-b573-4076-8082-5c2eb53c9bdb`::_resourcesAcquired: Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee (shared) >Thread-34::DEBUG::2014-07-10 10:00:07,548::task::990::TaskManager.Task::(_decref) Task=`93d73a18-b573-4076-8082-5c2eb53c9bdb`::ref 1 aborting False >Thread-34::INFO::2014-07-10 10:00:07,550::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '531976159232', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 10:00:07,550::task::1185::TaskManager.Task::(prepare) Task=`93d73a18-b573-4076-8082-5c2eb53c9bdb`::finished: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '531976159232', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 10:00:07,550::task::595::TaskManager.Task::(_updateState) Task=`93d73a18-b573-4076-8082-5c2eb53c9bdb`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-10 10:00:07,550::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee': < ResourceRef 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-10 10:00:07,550::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-10 10:00:07,551::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' >Thread-34::DEBUG::2014-07-10 10:00:07,551::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' (0 active users) >Thread-34::DEBUG::2014-07-10 10:00:07,551::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-10 10:00:07,551::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', Clearing records. >Thread-34::DEBUG::2014-07-10 10:00:07,552::task::990::TaskManager.Task::(_decref) Task=`93d73a18-b573-4076-8082-5c2eb53c9bdb`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 10:00:07,872::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 10:00:07,964::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.03354 s, 30.5 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 10:00:08,638::task::595::TaskManager.Task::(_updateState) Task=`958581f9-5944-48e4-a9b2-d92031a5860b`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 10:00:08,638::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::INFO::2014-07-10 10:00:08,639::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000808075', 'lastCheck': '8.6', 'valid': True}, '6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000495646', 'lastCheck': '2.1', 'valid': True}} >Thread-14::DEBUG::2014-07-10 10:00:08,639::task::1185::TaskManager.Task::(prepare) Task=`958581f9-5944-48e4-a9b2-d92031a5860b`::finished: {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000808075', 'lastCheck': '8.6', 'valid': True}, '6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000495646', 'lastCheck': '2.1', 'valid': True}} >Thread-14::DEBUG::2014-07-10 10:00:08,639::task::595::TaskManager.Task::(_updateState) Task=`958581f9-5944-48e4-a9b2-d92031a5860b`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 10:00:08,639::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 10:00:08,640::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 10:00:08,640::task::990::TaskManager.Task::(_decref) Task=`958581f9-5944-48e4-a9b2-d92031a5860b`::ref 0 aborting False >Thread-54::DEBUG::2014-07-10 10:00:08,800::task::595::TaskManager.Task::(_updateState) Task=`04e7b59a-1584-46df-be32-6790884b22a3`::moving from state init -> state preparing >Thread-73::DEBUG::2014-07-10 10:00:08,801::task::595::TaskManager.Task::(_updateState) Task=`fac2bf36-fe8c-45ff-a979-df5278bd12b5`::moving from state init -> state preparing >Thread-54::INFO::2014-07-10 10:00:08,802::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='28408446-e5fd-4565-a976-e760951593fe', volUUID='776303a2-5585-451e-826e-0e338d4a1e98', options=None) >Thread-73::INFO::2014-07-10 10:00:08,802::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='c01d693b-cba0-4fed-9ad7-0aaa28912a19', volUUID='4bb5d954-2a50-4028-b299-0b43c261270c', options=None) >Thread-73::INFO::2014-07-10 10:00:08,804::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-54::INFO::2014-07-10 10:00:08,804::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-73::DEBUG::2014-07-10 10:00:08,805::task::1185::TaskManager.Task::(prepare) Task=`fac2bf36-fe8c-45ff-a979-df5278bd12b5`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-54::DEBUG::2014-07-10 10:00:08,806::task::1185::TaskManager.Task::(prepare) Task=`04e7b59a-1584-46df-be32-6790884b22a3`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-73::DEBUG::2014-07-10 10:00:08,806::task::595::TaskManager.Task::(_updateState) Task=`fac2bf36-fe8c-45ff-a979-df5278bd12b5`::moving from state preparing -> state finished >Thread-54::DEBUG::2014-07-10 10:00:08,807::task::595::TaskManager.Task::(_updateState) Task=`04e7b59a-1584-46df-be32-6790884b22a3`::moving from state preparing -> state finished >Thread-73::DEBUG::2014-07-10 10:00:08,807::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-54::DEBUG::2014-07-10 10:00:08,808::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-73::DEBUG::2014-07-10 10:00:08,808::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-54::DEBUG::2014-07-10 10:00:08,809::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-73::DEBUG::2014-07-10 10:00:08,809::task::990::TaskManager.Task::(_decref) Task=`fac2bf36-fe8c-45ff-a979-df5278bd12b5`::ref 0 aborting False >Thread-54::DEBUG::2014-07-10 10:00:08,811::task::990::TaskManager.Task::(_decref) Task=`04e7b59a-1584-46df-be32-6790884b22a3`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 10:00:09,980::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Thread-18::DEBUG::2014-07-10 10:00:10,057::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/metadata bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-10 10:00:10,209::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000722835 s, 5.7 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 10:00:10,753::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0348506 s, 29.4 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 10:00:12,768::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 10:00:12,857::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0313054 s, 32.7 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 10:00:14,872::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 10:00:14,969::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0371036 s, 27.6 MB/s\n'; <rc> = 0 >Thread-40::DEBUG::2014-07-10 10:00:16,566::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lion.qa.lab.tlv.redhat.com:_export_yuri2_backup2/6a70504d-00df-4869-8695-0f442053f6b6/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-40::DEBUG::2014-07-10 10:00:16,586::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n369 bytes (369 B) copied, 0.000396838 s, 930 kB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 10:00:16,985::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 10:00:17,076::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0351028 s, 29.2 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 10:00:17,580::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-14::DEBUG::2014-07-10 10:00:17,581::task::595::TaskManager.Task::(_updateState) Task=`976f71e9-065f-4b1f-9854-7197fc4f39ea`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 10:00:17,582::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-14::INFO::2014-07-10 10:00:17,582::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 10:00:17,582::task::1185::TaskManager.Task::(prepare) Task=`976f71e9-065f-4b1f-9854-7197fc4f39ea`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 10:00:17,583::task::595::TaskManager.Task::(_updateState) Task=`976f71e9-065f-4b1f-9854-7197fc4f39ea`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 10:00:17,583::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 10:00:17,583::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 10:00:17,583::task::990::TaskManager.Task::(_decref) Task=`976f71e9-065f-4b1f-9854-7197fc4f39ea`::ref 0 aborting False >Thread-34::DEBUG::2014-07-10 10:00:17,587::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-34::DEBUG::2014-07-10 10:00:17,588::task::595::TaskManager.Task::(_updateState) Task=`2cd587be-9337-4c18-b70f-3b2a53916027`::moving from state init -> state preparing >Thread-34::INFO::2014-07-10 10:00:17,588::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-34::DEBUG::2014-07-10 10:00:17,589::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`c9242a2e-c90a-41df-ad43-abc435c5d46f`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-10 10:00:17,589::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' for lock type 'shared' >Thread-34::DEBUG::2014-07-10 10:00:17,589::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-10 10:00:17,590::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`c9242a2e-c90a-41df-ad43-abc435c5d46f`::Granted request >Thread-34::DEBUG::2014-07-10 10:00:17,590::task::827::TaskManager.Task::(resourceAcquired) Task=`2cd587be-9337-4c18-b70f-3b2a53916027`::_resourcesAcquired: Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee (shared) >Thread-34::DEBUG::2014-07-10 10:00:17,590::task::990::TaskManager.Task::(_decref) Task=`2cd587be-9337-4c18-b70f-3b2a53916027`::ref 1 aborting False >Thread-34::INFO::2014-07-10 10:00:17,591::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '531976159232', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 10:00:17,592::task::1185::TaskManager.Task::(prepare) Task=`2cd587be-9337-4c18-b70f-3b2a53916027`::finished: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '531976159232', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 10:00:17,592::task::595::TaskManager.Task::(_updateState) Task=`2cd587be-9337-4c18-b70f-3b2a53916027`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-10 10:00:17,592::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee': < ResourceRef 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-10 10:00:17,592::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-10 10:00:17,593::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' >Thread-34::DEBUG::2014-07-10 10:00:17,593::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' (0 active users) >Thread-34::DEBUG::2014-07-10 10:00:17,593::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-10 10:00:17,593::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', Clearing records. >Thread-34::DEBUG::2014-07-10 10:00:17,593::task::990::TaskManager.Task::(_decref) Task=`2cd587be-9337-4c18-b70f-3b2a53916027`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 10:00:19,091::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 10:00:19,181::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0320901 s, 31.9 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-10 10:00:20,748::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/metadata bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-10 10:00:20,769::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00088212 s, 4.6 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 10:00:21,196::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 10:00:21,307::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0362475 s, 28.3 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 10:00:23,329::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 10:00:23,417::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0303516 s, 33.7 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 10:00:23,836::task::595::TaskManager.Task::(_updateState) Task=`cd897238-0310-45a4-a1bb-10501f966bcb`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 10:00:23,837::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::INFO::2014-07-10 10:00:23,837::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00088212', 'lastCheck': '3.0', 'valid': True}, '6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000396838', 'lastCheck': '7.2', 'valid': True}} >Thread-14::DEBUG::2014-07-10 10:00:23,837::task::1185::TaskManager.Task::(prepare) Task=`cd897238-0310-45a4-a1bb-10501f966bcb`::finished: {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00088212', 'lastCheck': '3.0', 'valid': True}, '6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000396838', 'lastCheck': '7.2', 'valid': True}} >Thread-14::DEBUG::2014-07-10 10:00:23,838::task::595::TaskManager.Task::(_updateState) Task=`cd897238-0310-45a4-a1bb-10501f966bcb`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 10:00:23,838::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 10:00:23,838::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 10:00:23,838::task::990::TaskManager.Task::(_decref) Task=`cd897238-0310-45a4-a1bb-10501f966bcb`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 10:00:25,433::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 10:00:25,539::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0468674 s, 21.8 MB/s\n'; <rc> = 0 >Thread-57::DEBUG::2014-07-10 10:00:25,730::task::595::TaskManager.Task::(_updateState) Task=`5a39b4e2-e082-4901-a8eb-c25ecf8095cb`::moving from state init -> state preparing >Thread-57::INFO::2014-07-10 10:00:25,731::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='b6f6c0da-e67f-4902-b9ac-3069571a42fe', volUUID='c4cd1da8-05b7-45e0-80b1-1183d21443d9', options=None) >Thread-57::INFO::2014-07-10 10:00:25,731::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-57::DEBUG::2014-07-10 10:00:25,732::task::1185::TaskManager.Task::(prepare) Task=`5a39b4e2-e082-4901-a8eb-c25ecf8095cb`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-57::DEBUG::2014-07-10 10:00:25,732::task::595::TaskManager.Task::(_updateState) Task=`5a39b4e2-e082-4901-a8eb-c25ecf8095cb`::moving from state preparing -> state finished >Thread-57::DEBUG::2014-07-10 10:00:25,732::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-57::DEBUG::2014-07-10 10:00:25,732::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-57::DEBUG::2014-07-10 10:00:25,732::task::990::TaskManager.Task::(_decref) Task=`5a39b4e2-e082-4901-a8eb-c25ecf8095cb`::ref 0 aborting False >Thread-67::DEBUG::2014-07-10 10:00:26,514::task::595::TaskManager.Task::(_updateState) Task=`2f93ef58-763c-41f3-b9a4-5c50995a19c2`::moving from state init -> state preparing >Thread-67::INFO::2014-07-10 10:00:26,514::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='f30c2cb7-a43a-4bf5-82b5-cfe07336f65c', volUUID='b0fbb3c9-55af-4a3a-95ad-fc56a80b9cf5', options=None) >Thread-67::INFO::2014-07-10 10:00:26,515::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-67::DEBUG::2014-07-10 10:00:26,515::task::1185::TaskManager.Task::(prepare) Task=`2f93ef58-763c-41f3-b9a4-5c50995a19c2`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-67::DEBUG::2014-07-10 10:00:26,515::task::595::TaskManager.Task::(_updateState) Task=`2f93ef58-763c-41f3-b9a4-5c50995a19c2`::moving from state preparing -> state finished >Thread-67::DEBUG::2014-07-10 10:00:26,516::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-67::DEBUG::2014-07-10 10:00:26,516::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-67::DEBUG::2014-07-10 10:00:26,516::task::990::TaskManager.Task::(_decref) Task=`2f93ef58-763c-41f3-b9a4-5c50995a19c2`::ref 0 aborting False >Thread-48::DEBUG::2014-07-10 10:00:26,616::task::595::TaskManager.Task::(_updateState) Task=`855b7687-9010-49f2-89ab-f43d1f298d06`::moving from state init -> state preparing >Thread-48::INFO::2014-07-10 10:00:26,619::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='0cd7d6ce-f497-4243-a690-c57744861eea', volUUID='10b6a7dd-dc6c-43fa-ba17-92e4331b0e0b', options=None) >Thread-48::INFO::2014-07-10 10:00:26,620::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-48::DEBUG::2014-07-10 10:00:26,620::task::1185::TaskManager.Task::(prepare) Task=`855b7687-9010-49f2-89ab-f43d1f298d06`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-48::DEBUG::2014-07-10 10:00:26,620::task::595::TaskManager.Task::(_updateState) Task=`855b7687-9010-49f2-89ab-f43d1f298d06`::moving from state preparing -> state finished >Thread-48::DEBUG::2014-07-10 10:00:26,622::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-48::DEBUG::2014-07-10 10:00:26,623::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-40::DEBUG::2014-07-10 10:00:26,624::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lion.qa.lab.tlv.redhat.com:_export_yuri2_backup2/6a70504d-00df-4869-8695-0f442053f6b6/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-48::DEBUG::2014-07-10 10:00:26,625::task::990::TaskManager.Task::(_decref) Task=`855b7687-9010-49f2-89ab-f43d1f298d06`::ref 0 aborting False >Thread-40::DEBUG::2014-07-10 10:00:26,648::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n369 bytes (369 B) copied, 0.000448769 s, 822 kB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 10:00:27,555::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Thread-14::DEBUG::2014-07-10 10:00:27,628::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-14::DEBUG::2014-07-10 10:00:27,635::task::595::TaskManager.Task::(_updateState) Task=`2fae6ee6-cfec-4467-b80e-a070a639243d`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 10:00:27,638::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-14::INFO::2014-07-10 10:00:27,645::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 10:00:27,648::task::1185::TaskManager.Task::(prepare) Task=`2fae6ee6-cfec-4467-b80e-a070a639243d`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 10:00:27,650::task::595::TaskManager.Task::(_updateState) Task=`2fae6ee6-cfec-4467-b80e-a070a639243d`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 10:00:27,653::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 10:00:27,656::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 10:00:27,659::task::990::TaskManager.Task::(_decref) Task=`2fae6ee6-cfec-4467-b80e-a070a639243d`::ref 0 aborting False >Thread-34::DEBUG::2014-07-10 10:00:27,675::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-34::DEBUG::2014-07-10 10:00:27,679::task::595::TaskManager.Task::(_updateState) Task=`9feb656e-791a-4a6f-92e0-e483043c0356`::moving from state init -> state preparing >Thread-34::INFO::2014-07-10 10:00:27,683::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-34::DEBUG::2014-07-10 10:00:27,690::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`3d0abe25-f970-439d-8c32-826533abeafe`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-10 10:00:27,693::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' for lock type 'shared' >Thread-34::DEBUG::2014-07-10 10:00:27,698::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-10 10:00:27,701::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`3d0abe25-f970-439d-8c32-826533abeafe`::Granted request >Thread-34::DEBUG::2014-07-10 10:00:27,708::task::827::TaskManager.Task::(resourceAcquired) Task=`9feb656e-791a-4a6f-92e0-e483043c0356`::_resourcesAcquired: Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee (shared) >Thread-34::DEBUG::2014-07-10 10:00:27,711::task::990::TaskManager.Task::(_decref) Task=`9feb656e-791a-4a6f-92e0-e483043c0356`::ref 1 aborting False >Thread-34::INFO::2014-07-10 10:00:27,725::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '531976159232', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 10:00:27,728::task::1185::TaskManager.Task::(prepare) Task=`9feb656e-791a-4a6f-92e0-e483043c0356`::finished: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '531976159232', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 10:00:27,731::task::595::TaskManager.Task::(_updateState) Task=`9feb656e-791a-4a6f-92e0-e483043c0356`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-10 10:00:27,734::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee': < ResourceRef 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-10 10:00:27,737::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-10 10:00:27,742::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' >Thread-34::DEBUG::2014-07-10 10:00:27,747::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' (0 active users) >Thread-34::DEBUG::2014-07-10 10:00:27,749::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-10 10:00:27,752::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', Clearing records. >Thread-34::DEBUG::2014-07-10 10:00:27,756::task::990::TaskManager.Task::(_decref) Task=`9feb656e-791a-4a6f-92e0-e483043c0356`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 10:00:27,797::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.045759 s, 22.4 MB/s\n'; <rc> = 0 >Thread-76::DEBUG::2014-07-10 10:00:28,520::task::595::TaskManager.Task::(_updateState) Task=`9ecf374f-ed38-4c11-bee2-acb543069c0a`::moving from state init -> state preparing >Thread-76::INFO::2014-07-10 10:00:28,520::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='e4c65229-4247-4b33-b72a-f1d5ce72ad05', volUUID='cad94284-3ca9-4c30-933d-997f4460309e', options=None) >Thread-76::INFO::2014-07-10 10:00:28,521::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-76::DEBUG::2014-07-10 10:00:28,521::task::1185::TaskManager.Task::(prepare) Task=`9ecf374f-ed38-4c11-bee2-acb543069c0a`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-76::DEBUG::2014-07-10 10:00:28,521::task::595::TaskManager.Task::(_updateState) Task=`9ecf374f-ed38-4c11-bee2-acb543069c0a`::moving from state preparing -> state finished >Thread-76::DEBUG::2014-07-10 10:00:28,522::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-76::DEBUG::2014-07-10 10:00:28,522::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-76::DEBUG::2014-07-10 10:00:28,522::task::990::TaskManager.Task::(_decref) Task=`9ecf374f-ed38-4c11-bee2-acb543069c0a`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 10:00:29,813::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 10:00:29,914::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0308439 s, 33.2 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-10 10:00:30,799::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/metadata bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-10 10:00:30,824::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00541119 s, 757 kB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 10:00:31,930::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 10:00:32,036::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0497905 s, 20.6 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 10:00:34,050::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 10:00:34,166::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.056573 s, 18.1 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 10:00:36,181::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 10:00:36,289::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.049578 s, 20.7 MB/s\n'; <rc> = 0 >Thread-40::DEBUG::2014-07-10 10:00:36,674::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lion.qa.lab.tlv.redhat.com:_export_yuri2_backup2/6a70504d-00df-4869-8695-0f442053f6b6/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-40::DEBUG::2014-07-10 10:00:36,695::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n369 bytes (369 B) copied, 0.000440313 s, 838 kB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 10:00:37,839::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-14::DEBUG::2014-07-10 10:00:37,840::task::595::TaskManager.Task::(_updateState) Task=`cc85232d-2188-4316-aeb0-292e91dd43bb`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 10:00:37,841::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-14::INFO::2014-07-10 10:00:37,841::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 10:00:37,842::task::1185::TaskManager.Task::(prepare) Task=`cc85232d-2188-4316-aeb0-292e91dd43bb`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 10:00:37,842::task::595::TaskManager.Task::(_updateState) Task=`cc85232d-2188-4316-aeb0-292e91dd43bb`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 10:00:37,842::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 10:00:37,842::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 10:00:37,842::task::990::TaskManager.Task::(_decref) Task=`cc85232d-2188-4316-aeb0-292e91dd43bb`::ref 0 aborting False >Thread-34::DEBUG::2014-07-10 10:00:37,847::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-34::DEBUG::2014-07-10 10:00:37,848::task::595::TaskManager.Task::(_updateState) Task=`ebe0ccf9-7d74-4070-8e8b-96dac68bb75c`::moving from state init -> state preparing >Thread-34::INFO::2014-07-10 10:00:37,848::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-34::DEBUG::2014-07-10 10:00:37,849::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`6175f12d-b7c6-4896-9c2f-22f4d7d71824`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-10 10:00:37,849::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' for lock type 'shared' >Thread-34::DEBUG::2014-07-10 10:00:37,849::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-10 10:00:37,849::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`6175f12d-b7c6-4896-9c2f-22f4d7d71824`::Granted request >Thread-34::DEBUG::2014-07-10 10:00:37,850::task::827::TaskManager.Task::(resourceAcquired) Task=`ebe0ccf9-7d74-4070-8e8b-96dac68bb75c`::_resourcesAcquired: Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee (shared) >Thread-34::DEBUG::2014-07-10 10:00:37,850::task::990::TaskManager.Task::(_decref) Task=`ebe0ccf9-7d74-4070-8e8b-96dac68bb75c`::ref 1 aborting False >Thread-34::INFO::2014-07-10 10:00:37,851::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '531976159232', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 10:00:37,852::task::1185::TaskManager.Task::(prepare) Task=`ebe0ccf9-7d74-4070-8e8b-96dac68bb75c`::finished: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '531976159232', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 10:00:37,852::task::595::TaskManager.Task::(_updateState) Task=`ebe0ccf9-7d74-4070-8e8b-96dac68bb75c`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-10 10:00:37,852::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee': < ResourceRef 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-10 10:00:37,852::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-10 10:00:37,852::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' >Thread-34::DEBUG::2014-07-10 10:00:37,853::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' (0 active users) >Thread-34::DEBUG::2014-07-10 10:00:37,853::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-10 10:00:37,853::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', Clearing records. >Thread-34::DEBUG::2014-07-10 10:00:37,853::task::990::TaskManager.Task::(_decref) Task=`ebe0ccf9-7d74-4070-8e8b-96dac68bb75c`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 10:00:38,305::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 10:00:38,399::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.03584 s, 28.6 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 10:00:39,035::task::595::TaskManager.Task::(_updateState) Task=`a7ffc500-6658-42f5-a7da-faa3a838deec`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 10:00:39,036::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::INFO::2014-07-10 10:00:39,036::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00541119', 'lastCheck': '8.2', 'valid': True}, '6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000440313', 'lastCheck': '2.3', 'valid': True}} >Thread-14::DEBUG::2014-07-10 10:00:39,037::task::1185::TaskManager.Task::(prepare) Task=`a7ffc500-6658-42f5-a7da-faa3a838deec`::finished: {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00541119', 'lastCheck': '8.2', 'valid': True}, '6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000440313', 'lastCheck': '2.3', 'valid': True}} >Thread-14::DEBUG::2014-07-10 10:00:39,037::task::595::TaskManager.Task::(_updateState) Task=`a7ffc500-6658-42f5-a7da-faa3a838deec`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 10:00:39,037::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 10:00:39,037::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 10:00:39,038::task::990::TaskManager.Task::(_decref) Task=`a7ffc500-6658-42f5-a7da-faa3a838deec`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 10:00:40,415::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 10:00:40,503::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0331064 s, 30.9 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-10 10:00:40,856::domainMonitor::192::Storage.DomainMonitorThread::(_monitorDomain) Refreshing domain 9e1aa540-1f4e-4ee3-a152-be381ef6c3bd >Thread-18::DEBUG::2014-07-10 10:00:40,857::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with LvMetadataRW backend >Thread-18::DEBUG::2014-07-10 10:00:40,857::blockSD::336::Storage.Misc.excCmd::(readlines) '/bin/dd iflag=direct skip=0 bs=2048 if=/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/metadata count=1' (cwd None) >Thread-18::DEBUG::2014-07-10 10:00:40,878::blockSD::336::Storage.Misc.excCmd::(readlines) SUCCESS: <err> = '1+0 records in\n1+0 records out\n2048 bytes (2.0 kB) copied, 0.000734469 s, 2.8 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-10 10:00:40,879::misc::282::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '2048 bytes (2.0 kB) copied, 0.000734469 s, 2.8 MB/s'], size: 2048 >Thread-18::DEBUG::2014-07-10 10:00:40,879::persistentDict::234::Storage.PersistentDict::(refresh) read lines (LvMetadataRW)=[] >Thread-18::WARNING::2014-07-10 10:00:40,879::persistentDict::256::Storage.PersistentDict::(refresh) data has no embedded checksum - trust it as it is >Thread-18::DEBUG::2014-07-10 10:00:40,879::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with VGTagMetadataRW backend >Thread-18::DEBUG::2014-07-10 10:00:40,880::lvm::503::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-18::DEBUG::2014-07-10 10:00:40,880::lvm::505::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-18::DEBUG::2014-07-10 10:00:40,880::lvm::513::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-18::DEBUG::2014-07-10 10:00:40,881::lvm::525::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-18::DEBUG::2014-07-10 10:00:40,881::lvm::373::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-18::DEBUG::2014-07-10 10:00:40,882::lvm::296::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/3600601601282300032826addbbdae311|/dev/mapper/360060160f4a030003840ec867ddee311|/dev/mapper/367cad74c2fcba00019e6afd20c781e67|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name 9e1aa540-1f4e-4ee3-a152-be381ef6c3bd' (cwd None) >Thread-18::DEBUG::2014-07-10 10:00:41,247::lvm::296::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-18::DEBUG::2014-07-10 10:00:41,250::lvm::415::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-18::DEBUG::2014-07-10 10:00:41,250::persistentDict::234::Storage.PersistentDict::(refresh) read lines (VGTagMetadataRW)=['LEASETIMESEC=60', 'VGUUID=9CsMxb-YbRc-yRG7-cQKD-xY3G-GLi5-YxUyPC', 'VERSION=3', 'TYPE=ISCSI', 'LOGBLKSIZE=512', u'PV0=pv:3600601601282300032826addbbdae311,uuid:7qEb8v-jk2X-3CPk-k4XB-eIBk-onYD-807hcV,pestart:0,pecount:8189,mapoffset:0', 'LEASERETRIES=3', 'IOOPTIMEOUTSEC=10', 'LOCKRENEWALINTERVALSEC=5', 'PHYBLKSIZE=512', 'SDUUID=9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'CLASS=Data', 'LOCKPOLICY=', 'DESCRIPTION=SD_REAL', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=DC_REAL', 'ROLE=Master', 'POOL_UUID=4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', 'POOL_SPM_ID=1', 'POOL_SPM_LVER=0', '_SHA_CKSUM=013b5a7910962201c4cceab31b9c6d9c79f7316f', u'POOL_DOMAINS=9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active'] >Thread-18::INFO::2014-07-10 10:00:41,252::sd::384::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 9e1aa540-1f4e-4ee3-a152-be381ef6c3bd_imageNS already registered >Thread-18::INFO::2014-07-10 10:00:41,253::sd::392::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 9e1aa540-1f4e-4ee3-a152-be381ef6c3bd_volumeNS already registered >Thread-18::INFO::2014-07-10 10:00:41,255::blockSD::452::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 9e1aa540-1f4e-4ee3-a152-be381ef6c3bd_lvmActivationNS already registered >Thread-18::DEBUG::2014-07-10 10:00:41,256::lvm::296::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgck --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/3600601601282300032826addbbdae311|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } " 9e1aa540-1f4e-4ee3-a152-be381ef6c3bd' (cwd None) >Thread-18::DEBUG::2014-07-10 10:00:41,486::lvm::296::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-18::DEBUG::2014-07-10 10:00:41,488::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/metadata bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-10 10:00:41,510::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000572487 s, 7.2 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 10:00:42,520::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 10:00:42,622::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.029503 s, 34.7 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 10:00:44,640::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 10:00:44,745::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0471245 s, 21.7 MB/s\n'; <rc> = 0 >Thread-70::DEBUG::2014-07-10 10:00:45,464::task::595::TaskManager.Task::(_updateState) Task=`83328180-3d04-4a48-b403-2812d097030b`::moving from state init -> state preparing >Thread-70::INFO::2014-07-10 10:00:45,464::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='cfaeead2-7caa-467c-b389-c89840ae6605', volUUID='567fe32d-31a6-4ff6-90f3-fd6a656fbecc', options=None) >Thread-70::INFO::2014-07-10 10:00:45,465::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-70::DEBUG::2014-07-10 10:00:45,465::task::1185::TaskManager.Task::(prepare) Task=`83328180-3d04-4a48-b403-2812d097030b`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-70::DEBUG::2014-07-10 10:00:45,465::task::595::TaskManager.Task::(_updateState) Task=`83328180-3d04-4a48-b403-2812d097030b`::moving from state preparing -> state finished >Thread-70::DEBUG::2014-07-10 10:00:45,465::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-70::DEBUG::2014-07-10 10:00:45,465::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-70::DEBUG::2014-07-10 10:00:45,466::task::990::TaskManager.Task::(_decref) Task=`83328180-3d04-4a48-b403-2812d097030b`::ref 0 aborting False >Thread-40::DEBUG::2014-07-10 10:00:46,729::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lion.qa.lab.tlv.redhat.com:_export_yuri2_backup2/6a70504d-00df-4869-8695-0f442053f6b6/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-40::DEBUG::2014-07-10 10:00:46,750::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n369 bytes (369 B) copied, 0.000456855 s, 808 kB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 10:00:46,761::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 10:00:46,859::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0409078 s, 25.0 MB/s\n'; <rc> = 0 >Thread-51::DEBUG::2014-07-10 10:00:47,469::task::595::TaskManager.Task::(_updateState) Task=`26a70377-d45b-4418-b6fe-d938e5211a81`::moving from state init -> state preparing >Thread-51::INFO::2014-07-10 10:00:47,471::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='76fdb054-02cd-42ed-9721-b3e65b34c3a4', volUUID='022dfe46-2cf7-4915-80b3-883158e3ca83', options=None) >Thread-60::DEBUG::2014-07-10 10:00:47,471::task::595::TaskManager.Task::(_updateState) Task=`4665ceaa-0953-49a7-893e-ce55cc9973ca`::moving from state init -> state preparing >Thread-60::INFO::2014-07-10 10:00:47,473::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='b034d5b0-e1e0-4011-b49b-4d45ddb11556', volUUID='3d7f62b5-328f-4d8e-8b69-873cfb5ae14d', options=None) >Thread-51::INFO::2014-07-10 10:00:47,473::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-51::DEBUG::2014-07-10 10:00:47,474::task::1185::TaskManager.Task::(prepare) Task=`26a70377-d45b-4418-b6fe-d938e5211a81`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-60::INFO::2014-07-10 10:00:47,474::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-51::DEBUG::2014-07-10 10:00:47,475::task::595::TaskManager.Task::(_updateState) Task=`26a70377-d45b-4418-b6fe-d938e5211a81`::moving from state preparing -> state finished >Thread-60::DEBUG::2014-07-10 10:00:47,476::task::1185::TaskManager.Task::(prepare) Task=`4665ceaa-0953-49a7-893e-ce55cc9973ca`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-51::DEBUG::2014-07-10 10:00:47,476::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-60::DEBUG::2014-07-10 10:00:47,477::task::595::TaskManager.Task::(_updateState) Task=`4665ceaa-0953-49a7-893e-ce55cc9973ca`::moving from state preparing -> state finished >Thread-51::DEBUG::2014-07-10 10:00:47,478::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-60::DEBUG::2014-07-10 10:00:47,478::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-51::DEBUG::2014-07-10 10:00:47,479::task::990::TaskManager.Task::(_decref) Task=`26a70377-d45b-4418-b6fe-d938e5211a81`::ref 0 aborting False >Thread-60::DEBUG::2014-07-10 10:00:47,480::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-60::DEBUG::2014-07-10 10:00:47,480::task::990::TaskManager.Task::(_decref) Task=`4665ceaa-0953-49a7-893e-ce55cc9973ca`::ref 0 aborting False >Thread-14::DEBUG::2014-07-10 10:00:47,889::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-14::DEBUG::2014-07-10 10:00:47,890::task::595::TaskManager.Task::(_updateState) Task=`ee29f427-ff7b-48b3-8810-8d52a10dff85`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 10:00:47,890::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-14::INFO::2014-07-10 10:00:47,891::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 10:00:47,891::task::1185::TaskManager.Task::(prepare) Task=`ee29f427-ff7b-48b3-8810-8d52a10dff85`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 10:00:47,891::task::595::TaskManager.Task::(_updateState) Task=`ee29f427-ff7b-48b3-8810-8d52a10dff85`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 10:00:47,891::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 10:00:47,892::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 10:00:47,892::task::990::TaskManager.Task::(_decref) Task=`ee29f427-ff7b-48b3-8810-8d52a10dff85`::ref 0 aborting False >Thread-34::DEBUG::2014-07-10 10:00:47,896::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-34::DEBUG::2014-07-10 10:00:47,897::task::595::TaskManager.Task::(_updateState) Task=`3a6587f4-aee5-44dd-b177-83050b33a226`::moving from state init -> state preparing >Thread-34::INFO::2014-07-10 10:00:47,897::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-34::DEBUG::2014-07-10 10:00:47,898::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`22694a5c-7f0f-4755-bee2-b8099aaec9f9`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-10 10:00:47,898::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' for lock type 'shared' >Thread-34::DEBUG::2014-07-10 10:00:47,898::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-10 10:00:47,898::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`22694a5c-7f0f-4755-bee2-b8099aaec9f9`::Granted request >Thread-34::DEBUG::2014-07-10 10:00:47,899::task::827::TaskManager.Task::(resourceAcquired) Task=`3a6587f4-aee5-44dd-b177-83050b33a226`::_resourcesAcquired: Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee (shared) >Thread-34::DEBUG::2014-07-10 10:00:47,899::task::990::TaskManager.Task::(_decref) Task=`3a6587f4-aee5-44dd-b177-83050b33a226`::ref 1 aborting False >Thread-34::INFO::2014-07-10 10:00:47,900::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '531976159232', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 10:00:47,900::task::1185::TaskManager.Task::(prepare) Task=`3a6587f4-aee5-44dd-b177-83050b33a226`::finished: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '531976159232', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 10:00:47,901::task::595::TaskManager.Task::(_updateState) Task=`3a6587f4-aee5-44dd-b177-83050b33a226`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-10 10:00:47,901::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee': < ResourceRef 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-10 10:00:47,901::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-10 10:00:47,901::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' >Thread-34::DEBUG::2014-07-10 10:00:47,902::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' (0 active users) >Thread-34::DEBUG::2014-07-10 10:00:47,902::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-10 10:00:47,902::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', Clearing records. >Thread-34::DEBUG::2014-07-10 10:00:47,902::task::990::TaskManager.Task::(_decref) Task=`3a6587f4-aee5-44dd-b177-83050b33a226`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 10:00:48,887::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 10:00:48,986::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0422628 s, 24.2 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 10:00:51,001::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 10:00:51,098::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0356603 s, 28.7 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-10 10:00:51,552::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/metadata bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-10 10:00:51,580::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00688649 s, 595 kB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 10:00:53,114::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 10:00:53,220::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0444797 s, 23.0 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 10:00:54,243::task::595::TaskManager.Task::(_updateState) Task=`9edf0e45-f7ba-472d-82f0-717b488693e5`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 10:00:54,243::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::INFO::2014-07-10 10:00:54,244::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00688649', 'lastCheck': '2.6', 'valid': True}, '6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000456855', 'lastCheck': '7.5', 'valid': True}} >Thread-14::DEBUG::2014-07-10 10:00:54,244::task::1185::TaskManager.Task::(prepare) Task=`9edf0e45-f7ba-472d-82f0-717b488693e5`::finished: {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00688649', 'lastCheck': '2.6', 'valid': True}, '6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000456855', 'lastCheck': '7.5', 'valid': True}} >Thread-14::DEBUG::2014-07-10 10:00:54,244::task::595::TaskManager.Task::(_updateState) Task=`9edf0e45-f7ba-472d-82f0-717b488693e5`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 10:00:54,244::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 10:00:54,245::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 10:00:54,245::task::990::TaskManager.Task::(_decref) Task=`9edf0e45-f7ba-472d-82f0-717b488693e5`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 10:00:55,236::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 10:00:55,399::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.049809 s, 20.6 MB/s\n'; <rc> = 0 >Thread-40::DEBUG::2014-07-10 10:00:56,781::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lion.qa.lab.tlv.redhat.com:_export_yuri2_backup2/6a70504d-00df-4869-8695-0f442053f6b6/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-40::DEBUG::2014-07-10 10:00:56,800::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n369 bytes (369 B) copied, 0.00043604 s, 846 kB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 10:00:57,427::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 10:00:57,517::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0329179 s, 31.1 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 10:00:57,932::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-14::DEBUG::2014-07-10 10:00:57,933::task::595::TaskManager.Task::(_updateState) Task=`dfcb0e92-9565-450f-8df2-f8c254d300bf`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 10:00:57,933::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-14::INFO::2014-07-10 10:00:57,934::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 10:00:57,934::task::1185::TaskManager.Task::(prepare) Task=`dfcb0e92-9565-450f-8df2-f8c254d300bf`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 10:00:57,934::task::595::TaskManager.Task::(_updateState) Task=`dfcb0e92-9565-450f-8df2-f8c254d300bf`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 10:00:57,934::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 10:00:57,934::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 10:00:57,935::task::990::TaskManager.Task::(_decref) Task=`dfcb0e92-9565-450f-8df2-f8c254d300bf`::ref 0 aborting False >Thread-34::DEBUG::2014-07-10 10:00:57,939::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-34::DEBUG::2014-07-10 10:00:57,939::task::595::TaskManager.Task::(_updateState) Task=`ecac8b72-3813-4b63-828b-660ee232ed33`::moving from state init -> state preparing >Thread-34::INFO::2014-07-10 10:00:57,940::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-34::DEBUG::2014-07-10 10:00:57,940::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`57d94bb2-1092-4928-956c-802e10243b94`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-10 10:00:57,940::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' for lock type 'shared' >Thread-34::DEBUG::2014-07-10 10:00:57,941::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-10 10:00:57,941::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`57d94bb2-1092-4928-956c-802e10243b94`::Granted request >Thread-34::DEBUG::2014-07-10 10:00:57,942::task::827::TaskManager.Task::(resourceAcquired) Task=`ecac8b72-3813-4b63-828b-660ee232ed33`::_resourcesAcquired: Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee (shared) >Thread-34::DEBUG::2014-07-10 10:00:57,942::task::990::TaskManager.Task::(_decref) Task=`ecac8b72-3813-4b63-828b-660ee232ed33`::ref 1 aborting False >Thread-34::INFO::2014-07-10 10:00:57,943::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '531976159232', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 10:00:57,943::task::1185::TaskManager.Task::(prepare) Task=`ecac8b72-3813-4b63-828b-660ee232ed33`::finished: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '531976159232', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 10:00:57,944::task::595::TaskManager.Task::(_updateState) Task=`ecac8b72-3813-4b63-828b-660ee232ed33`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-10 10:00:57,944::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee': < ResourceRef 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-10 10:00:57,944::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-10 10:00:57,944::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' >Thread-34::DEBUG::2014-07-10 10:00:57,944::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' (0 active users) >Thread-34::DEBUG::2014-07-10 10:00:57,945::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-10 10:00:57,945::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', Clearing records. >Thread-34::DEBUG::2014-07-10 10:00:57,945::task::990::TaskManager.Task::(_decref) Task=`ecac8b72-3813-4b63-828b-660ee232ed33`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 10:00:59,532::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 10:00:59,648::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0521744 s, 19.6 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-10 10:01:01,648::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/metadata bs=4096 count=1' (cwd None) >Dummy-33::DEBUG::2014-07-10 10:01:01,666::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Thread-18::DEBUG::2014-07-10 10:01:01,771::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000596753 s, 6.9 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 10:01:02,241::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.516951 s, 2.0 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 10:01:04,257::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 10:01:04,363::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0493302 s, 20.8 MB/s\n'; <rc> = 0 >Thread-64::DEBUG::2014-07-10 10:01:05,633::task::595::TaskManager.Task::(_updateState) Task=`980a737b-165d-445a-9cb0-b404ef385cd2`::moving from state init -> state preparing >Thread-64::INFO::2014-07-10 10:01:05,634::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='aa20346a-4d3a-4e07-b8e1-52c0ebe4168c', volUUID='58fefce2-9bce-4bff-8949-8c6ce8122b27', options=None) >Thread-64::INFO::2014-07-10 10:01:05,635::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-64::DEBUG::2014-07-10 10:01:05,635::task::1185::TaskManager.Task::(prepare) Task=`980a737b-165d-445a-9cb0-b404ef385cd2`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-64::DEBUG::2014-07-10 10:01:05,635::task::595::TaskManager.Task::(_updateState) Task=`980a737b-165d-445a-9cb0-b404ef385cd2`::moving from state preparing -> state finished >Thread-64::DEBUG::2014-07-10 10:01:05,635::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-64::DEBUG::2014-07-10 10:01:05,636::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-64::DEBUG::2014-07-10 10:01:05,636::task::990::TaskManager.Task::(_decref) Task=`980a737b-165d-445a-9cb0-b404ef385cd2`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 10:01:06,379::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 10:01:06,471::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0341302 s, 30.0 MB/s\n'; <rc> = 0 >Thread-40::DEBUG::2014-07-10 10:01:06,835::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lion.qa.lab.tlv.redhat.com:_export_yuri2_backup2/6a70504d-00df-4869-8695-0f442053f6b6/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-40::DEBUG::2014-07-10 10:01:06,857::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n369 bytes (369 B) copied, 0.000486103 s, 759 kB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 10:01:07,973::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-14::DEBUG::2014-07-10 10:01:07,974::task::595::TaskManager.Task::(_updateState) Task=`c5736f7e-b64e-49fb-b723-b8db806ec208`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 10:01:07,974::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-14::INFO::2014-07-10 10:01:07,975::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 10:01:07,975::task::1185::TaskManager.Task::(prepare) Task=`c5736f7e-b64e-49fb-b723-b8db806ec208`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 10:01:07,975::task::595::TaskManager.Task::(_updateState) Task=`c5736f7e-b64e-49fb-b723-b8db806ec208`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 10:01:07,975::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 10:01:07,975::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 10:01:07,976::task::990::TaskManager.Task::(_decref) Task=`c5736f7e-b64e-49fb-b723-b8db806ec208`::ref 0 aborting False >Thread-34::DEBUG::2014-07-10 10:01:07,990::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-34::DEBUG::2014-07-10 10:01:07,990::task::595::TaskManager.Task::(_updateState) Task=`64f4698d-2e3a-49d5-aba8-7271ab65cfad`::moving from state init -> state preparing >Thread-34::INFO::2014-07-10 10:01:07,991::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-34::DEBUG::2014-07-10 10:01:07,991::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`3c1336a0-bd9c-4d9d-b1fd-b009fa9b8448`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-10 10:01:07,992::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' for lock type 'shared' >Thread-34::DEBUG::2014-07-10 10:01:07,992::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-10 10:01:07,992::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`3c1336a0-bd9c-4d9d-b1fd-b009fa9b8448`::Granted request >Thread-34::DEBUG::2014-07-10 10:01:07,993::task::827::TaskManager.Task::(resourceAcquired) Task=`64f4698d-2e3a-49d5-aba8-7271ab65cfad`::_resourcesAcquired: Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee (shared) >Thread-34::DEBUG::2014-07-10 10:01:07,993::task::990::TaskManager.Task::(_decref) Task=`64f4698d-2e3a-49d5-aba8-7271ab65cfad`::ref 1 aborting False >Thread-34::INFO::2014-07-10 10:01:07,994::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '531976159232', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 10:01:07,994::task::1185::TaskManager.Task::(prepare) Task=`64f4698d-2e3a-49d5-aba8-7271ab65cfad`::finished: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '531976159232', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 10:01:07,995::task::595::TaskManager.Task::(_updateState) Task=`64f4698d-2e3a-49d5-aba8-7271ab65cfad`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-10 10:01:07,995::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee': < ResourceRef 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-10 10:01:07,995::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-10 10:01:07,995::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' >Thread-34::DEBUG::2014-07-10 10:01:07,996::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' (0 active users) >Thread-34::DEBUG::2014-07-10 10:01:07,996::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-10 10:01:07,996::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', Clearing records. >Thread-34::DEBUG::2014-07-10 10:01:07,996::task::990::TaskManager.Task::(_decref) Task=`64f4698d-2e3a-49d5-aba8-7271ab65cfad`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 10:01:08,486::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 10:01:08,580::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0359243 s, 28.5 MB/s\n'; <rc> = 0 >Thread-73::DEBUG::2014-07-10 10:01:09,145::task::595::TaskManager.Task::(_updateState) Task=`98d86886-bd4e-4938-b181-dff2acdcd11b`::moving from state init -> state preparing >Thread-73::INFO::2014-07-10 10:01:09,147::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='c01d693b-cba0-4fed-9ad7-0aaa28912a19', volUUID='4bb5d954-2a50-4028-b299-0b43c261270c', options=None) >Thread-54::DEBUG::2014-07-10 10:01:09,147::task::595::TaskManager.Task::(_updateState) Task=`bc58ccc5-d33e-4b6d-86ae-811b5732c4f7`::moving from state init -> state preparing >Thread-54::INFO::2014-07-10 10:01:09,149::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='28408446-e5fd-4565-a976-e760951593fe', volUUID='776303a2-5585-451e-826e-0e338d4a1e98', options=None) >Thread-73::INFO::2014-07-10 10:01:09,149::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-73::DEBUG::2014-07-10 10:01:09,150::task::1185::TaskManager.Task::(prepare) Task=`98d86886-bd4e-4938-b181-dff2acdcd11b`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-54::INFO::2014-07-10 10:01:09,151::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-73::DEBUG::2014-07-10 10:01:09,151::task::595::TaskManager.Task::(_updateState) Task=`98d86886-bd4e-4938-b181-dff2acdcd11b`::moving from state preparing -> state finished >Thread-54::DEBUG::2014-07-10 10:01:09,152::task::1185::TaskManager.Task::(prepare) Task=`bc58ccc5-d33e-4b6d-86ae-811b5732c4f7`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-73::DEBUG::2014-07-10 10:01:09,153::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-54::DEBUG::2014-07-10 10:01:09,153::task::595::TaskManager.Task::(_updateState) Task=`bc58ccc5-d33e-4b6d-86ae-811b5732c4f7`::moving from state preparing -> state finished >Thread-73::DEBUG::2014-07-10 10:01:09,154::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-54::DEBUG::2014-07-10 10:01:09,154::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-54::DEBUG::2014-07-10 10:01:09,155::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-73::DEBUG::2014-07-10 10:01:09,155::task::990::TaskManager.Task::(_decref) Task=`98d86886-bd4e-4938-b181-dff2acdcd11b`::ref 0 aborting False >Thread-54::DEBUG::2014-07-10 10:01:09,157::task::990::TaskManager.Task::(_decref) Task=`bc58ccc5-d33e-4b6d-86ae-811b5732c4f7`::ref 0 aborting False >Thread-14::DEBUG::2014-07-10 10:01:09,428::task::595::TaskManager.Task::(_updateState) Task=`0add2a95-6190-4a69-9399-24924596b609`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 10:01:09,428::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::INFO::2014-07-10 10:01:09,429::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000596753', 'lastCheck': '7.2', 'valid': True}, '6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000486103', 'lastCheck': '2.6', 'valid': True}} >Thread-14::DEBUG::2014-07-10 10:01:09,429::task::1185::TaskManager.Task::(prepare) Task=`0add2a95-6190-4a69-9399-24924596b609`::finished: {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000596753', 'lastCheck': '7.2', 'valid': True}, '6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000486103', 'lastCheck': '2.6', 'valid': True}} >Thread-14::DEBUG::2014-07-10 10:01:09,429::task::595::TaskManager.Task::(_updateState) Task=`0add2a95-6190-4a69-9399-24924596b609`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 10:01:09,429::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 10:01:09,429::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 10:01:09,430::task::990::TaskManager.Task::(_decref) Task=`0add2a95-6190-4a69-9399-24924596b609`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 10:01:10,595::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 10:01:10,687::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0308541 s, 33.2 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-10 10:01:12,201::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/metadata bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-10 10:01:12,228::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00530603 s, 772 kB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 10:01:12,703::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 10:01:12,800::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0365914 s, 28.0 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 10:01:14,816::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 10:01:14,942::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0553711 s, 18.5 MB/s\n'; <rc> = 0 >Thread-40::DEBUG::2014-07-10 10:01:16,882::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lion.qa.lab.tlv.redhat.com:_export_yuri2_backup2/6a70504d-00df-4869-8695-0f442053f6b6/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-40::DEBUG::2014-07-10 10:01:16,904::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n369 bytes (369 B) copied, 0.000930657 s, 396 kB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 10:01:16,962::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 10:01:17,069::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.04901 s, 20.9 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 10:01:18,031::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-14::DEBUG::2014-07-10 10:01:18,033::task::595::TaskManager.Task::(_updateState) Task=`2903139e-372a-4cda-9b65-3ce2bac2f7dd`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 10:01:18,033::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-14::INFO::2014-07-10 10:01:18,034::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 10:01:18,034::task::1185::TaskManager.Task::(prepare) Task=`2903139e-372a-4cda-9b65-3ce2bac2f7dd`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 10:01:18,035::task::595::TaskManager.Task::(_updateState) Task=`2903139e-372a-4cda-9b65-3ce2bac2f7dd`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 10:01:18,035::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 10:01:18,035::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 10:01:18,035::task::990::TaskManager.Task::(_decref) Task=`2903139e-372a-4cda-9b65-3ce2bac2f7dd`::ref 0 aborting False >Thread-34::DEBUG::2014-07-10 10:01:18,039::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-34::DEBUG::2014-07-10 10:01:18,040::task::595::TaskManager.Task::(_updateState) Task=`a98bfd21-b64a-4863-a5da-6c6300d3979b`::moving from state init -> state preparing >Thread-34::INFO::2014-07-10 10:01:18,040::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-34::DEBUG::2014-07-10 10:01:18,041::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`ac87b469-dddd-4d45-b95c-d2e0a1cf2b9b`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-10 10:01:18,041::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' for lock type 'shared' >Thread-34::DEBUG::2014-07-10 10:01:18,041::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-10 10:01:18,042::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`ac87b469-dddd-4d45-b95c-d2e0a1cf2b9b`::Granted request >Thread-34::DEBUG::2014-07-10 10:01:18,042::task::827::TaskManager.Task::(resourceAcquired) Task=`a98bfd21-b64a-4863-a5da-6c6300d3979b`::_resourcesAcquired: Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee (shared) >Thread-34::DEBUG::2014-07-10 10:01:18,042::task::990::TaskManager.Task::(_decref) Task=`a98bfd21-b64a-4863-a5da-6c6300d3979b`::ref 1 aborting False >Thread-34::INFO::2014-07-10 10:01:18,044::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '531976159232', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 10:01:18,044::task::1185::TaskManager.Task::(prepare) Task=`a98bfd21-b64a-4863-a5da-6c6300d3979b`::finished: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '531976159232', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 10:01:18,044::task::595::TaskManager.Task::(_updateState) Task=`a98bfd21-b64a-4863-a5da-6c6300d3979b`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-10 10:01:18,044::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee': < ResourceRef 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-10 10:01:18,044::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-10 10:01:18,045::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' >Thread-34::DEBUG::2014-07-10 10:01:18,045::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' (0 active users) >Thread-34::DEBUG::2014-07-10 10:01:18,045::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-10 10:01:18,045::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', Clearing records. >Thread-34::DEBUG::2014-07-10 10:01:18,045::task::990::TaskManager.Task::(_decref) Task=`a98bfd21-b64a-4863-a5da-6c6300d3979b`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 10:01:19,084::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 10:01:19,186::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0299409 s, 34.2 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 10:01:21,202::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 10:01:21,316::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0570517 s, 17.9 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-10 10:01:22,257::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/metadata bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-10 10:01:22,283::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00481156 s, 851 kB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 10:01:23,332::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 10:01:23,440::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0502371 s, 20.4 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 10:01:24,598::task::595::TaskManager.Task::(_updateState) Task=`66feaa12-f9d8-4ea7-a361-36099cd5d612`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 10:01:24,599::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::INFO::2014-07-10 10:01:24,599::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00481156', 'lastCheck': '2.3', 'valid': True}, '6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000930657', 'lastCheck': '7.7', 'valid': True}} >Thread-14::DEBUG::2014-07-10 10:01:24,599::task::1185::TaskManager.Task::(prepare) Task=`66feaa12-f9d8-4ea7-a361-36099cd5d612`::finished: {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00481156', 'lastCheck': '2.3', 'valid': True}, '6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000930657', 'lastCheck': '7.7', 'valid': True}} >Thread-14::DEBUG::2014-07-10 10:01:24,599::task::595::TaskManager.Task::(_updateState) Task=`66feaa12-f9d8-4ea7-a361-36099cd5d612`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 10:01:24,600::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 10:01:24,600::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 10:01:24,600::task::990::TaskManager.Task::(_decref) Task=`66feaa12-f9d8-4ea7-a361-36099cd5d612`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 10:01:25,455::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 10:01:25,560::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0471322 s, 21.7 MB/s\n'; <rc> = 0 >Thread-57::DEBUG::2014-07-10 10:01:26,018::task::595::TaskManager.Task::(_updateState) Task=`0f2a58e1-a676-4db5-a291-d5fe70d2cf4d`::moving from state init -> state preparing >Thread-57::INFO::2014-07-10 10:01:26,019::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='b6f6c0da-e67f-4902-b9ac-3069571a42fe', volUUID='c4cd1da8-05b7-45e0-80b1-1183d21443d9', options=None) >Thread-57::INFO::2014-07-10 10:01:26,020::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-57::DEBUG::2014-07-10 10:01:26,020::task::1185::TaskManager.Task::(prepare) Task=`0f2a58e1-a676-4db5-a291-d5fe70d2cf4d`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-57::DEBUG::2014-07-10 10:01:26,020::task::595::TaskManager.Task::(_updateState) Task=`0f2a58e1-a676-4db5-a291-d5fe70d2cf4d`::moving from state preparing -> state finished >Thread-57::DEBUG::2014-07-10 10:01:26,020::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-57::DEBUG::2014-07-10 10:01:26,020::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-57::DEBUG::2014-07-10 10:01:26,021::task::990::TaskManager.Task::(_decref) Task=`0f2a58e1-a676-4db5-a291-d5fe70d2cf4d`::ref 0 aborting False >Thread-67::DEBUG::2014-07-10 10:01:26,814::task::595::TaskManager.Task::(_updateState) Task=`aea3e6f4-e428-4f2c-8b83-07168986ff2c`::moving from state init -> state preparing >Thread-67::INFO::2014-07-10 10:01:26,815::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='f30c2cb7-a43a-4bf5-82b5-cfe07336f65c', volUUID='b0fbb3c9-55af-4a3a-95ad-fc56a80b9cf5', options=None) >Thread-67::INFO::2014-07-10 10:01:26,815::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-67::DEBUG::2014-07-10 10:01:26,815::task::1185::TaskManager.Task::(prepare) Task=`aea3e6f4-e428-4f2c-8b83-07168986ff2c`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-67::DEBUG::2014-07-10 10:01:26,816::task::595::TaskManager.Task::(_updateState) Task=`aea3e6f4-e428-4f2c-8b83-07168986ff2c`::moving from state preparing -> state finished >Thread-67::DEBUG::2014-07-10 10:01:26,816::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-67::DEBUG::2014-07-10 10:01:26,816::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-67::DEBUG::2014-07-10 10:01:26,817::task::990::TaskManager.Task::(_decref) Task=`aea3e6f4-e428-4f2c-8b83-07168986ff2c`::ref 0 aborting False >Thread-48::DEBUG::2014-07-10 10:01:26,934::task::595::TaskManager.Task::(_updateState) Task=`1276c922-bd48-4dd8-8dff-8c06bb876209`::moving from state init -> state preparing >Thread-48::INFO::2014-07-10 10:01:26,936::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='0cd7d6ce-f497-4243-a690-c57744861eea', volUUID='10b6a7dd-dc6c-43fa-ba17-92e4331b0e0b', options=None) >Thread-48::INFO::2014-07-10 10:01:26,936::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-48::DEBUG::2014-07-10 10:01:26,936::task::1185::TaskManager.Task::(prepare) Task=`1276c922-bd48-4dd8-8dff-8c06bb876209`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-48::DEBUG::2014-07-10 10:01:26,937::task::595::TaskManager.Task::(_updateState) Task=`1276c922-bd48-4dd8-8dff-8c06bb876209`::moving from state preparing -> state finished >Thread-48::DEBUG::2014-07-10 10:01:26,939::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-48::DEBUG::2014-07-10 10:01:26,940::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-40::DEBUG::2014-07-10 10:01:26,941::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lion.qa.lab.tlv.redhat.com:_export_yuri2_backup2/6a70504d-00df-4869-8695-0f442053f6b6/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-48::DEBUG::2014-07-10 10:01:26,961::task::990::TaskManager.Task::(_decref) Task=`1276c922-bd48-4dd8-8dff-8c06bb876209`::ref 0 aborting False >Thread-40::DEBUG::2014-07-10 10:01:26,987::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n369 bytes (369 B) copied, 0.000411425 s, 897 kB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 10:01:27,576::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 10:01:27,684::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0470305 s, 21.8 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 10:01:28,072::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-14::DEBUG::2014-07-10 10:01:28,074::task::595::TaskManager.Task::(_updateState) Task=`961dae08-5836-4dea-907d-a8080ef6511a`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 10:01:28,074::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-14::INFO::2014-07-10 10:01:28,075::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 10:01:28,075::task::1185::TaskManager.Task::(prepare) Task=`961dae08-5836-4dea-907d-a8080ef6511a`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 10:01:28,075::task::595::TaskManager.Task::(_updateState) Task=`961dae08-5836-4dea-907d-a8080ef6511a`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 10:01:28,075::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 10:01:28,075::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 10:01:28,076::task::990::TaskManager.Task::(_decref) Task=`961dae08-5836-4dea-907d-a8080ef6511a`::ref 0 aborting False >Thread-34::DEBUG::2014-07-10 10:01:28,080::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-34::DEBUG::2014-07-10 10:01:28,080::task::595::TaskManager.Task::(_updateState) Task=`b346f0d4-a341-40b2-984f-4283da2cd4b2`::moving from state init -> state preparing >Thread-34::INFO::2014-07-10 10:01:28,081::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-34::DEBUG::2014-07-10 10:01:28,083::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`17cb6de5-fa0b-4fdc-ad3c-c39767728d47`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-10 10:01:28,083::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' for lock type 'shared' >Thread-34::DEBUG::2014-07-10 10:01:28,083::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-10 10:01:28,083::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`17cb6de5-fa0b-4fdc-ad3c-c39767728d47`::Granted request >Thread-34::DEBUG::2014-07-10 10:01:28,084::task::827::TaskManager.Task::(resourceAcquired) Task=`b346f0d4-a341-40b2-984f-4283da2cd4b2`::_resourcesAcquired: Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee (shared) >Thread-34::DEBUG::2014-07-10 10:01:28,084::task::990::TaskManager.Task::(_decref) Task=`b346f0d4-a341-40b2-984f-4283da2cd4b2`::ref 1 aborting False >Thread-34::INFO::2014-07-10 10:01:28,085::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '531976159232', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 10:01:28,085::task::1185::TaskManager.Task::(prepare) Task=`b346f0d4-a341-40b2-984f-4283da2cd4b2`::finished: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '531976159232', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 10:01:28,086::task::595::TaskManager.Task::(_updateState) Task=`b346f0d4-a341-40b2-984f-4283da2cd4b2`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-10 10:01:28,086::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee': < ResourceRef 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-10 10:01:28,086::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-10 10:01:28,086::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' >Thread-34::DEBUG::2014-07-10 10:01:28,087::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' (0 active users) >Thread-34::DEBUG::2014-07-10 10:01:28,087::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-10 10:01:28,087::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', Clearing records. >Thread-34::DEBUG::2014-07-10 10:01:28,088::task::990::TaskManager.Task::(_decref) Task=`b346f0d4-a341-40b2-984f-4283da2cd4b2`::ref 0 aborting False >Thread-76::DEBUG::2014-07-10 10:01:28,823::task::595::TaskManager.Task::(_updateState) Task=`0e8870ea-363d-448c-94b9-d3a15ada6343`::moving from state init -> state preparing >Thread-76::INFO::2014-07-10 10:01:28,823::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='e4c65229-4247-4b33-b72a-f1d5ce72ad05', volUUID='cad94284-3ca9-4c30-933d-997f4460309e', options=None) >Thread-76::INFO::2014-07-10 10:01:28,824::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-76::DEBUG::2014-07-10 10:01:28,824::task::1185::TaskManager.Task::(prepare) Task=`0e8870ea-363d-448c-94b9-d3a15ada6343`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-76::DEBUG::2014-07-10 10:01:28,824::task::595::TaskManager.Task::(_updateState) Task=`0e8870ea-363d-448c-94b9-d3a15ada6343`::moving from state preparing -> state finished >Thread-76::DEBUG::2014-07-10 10:01:28,824::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-76::DEBUG::2014-07-10 10:01:28,825::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-76::DEBUG::2014-07-10 10:01:28,825::task::990::TaskManager.Task::(_decref) Task=`0e8870ea-363d-448c-94b9-d3a15ada6343`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 10:01:29,700::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 10:01:29,810::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0512809 s, 20.0 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 10:01:31,825::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 10:01:31,974::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0535514 s, 19.1 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-10 10:01:32,313::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/metadata bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-10 10:01:32,341::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.0074483 s, 550 kB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 10:01:33,989::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 10:01:34,069::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.025417 s, 40.3 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 10:01:36,085::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 10:01:36,175::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0339147 s, 30.2 MB/s\n'; <rc> = 0 >Thread-40::DEBUG::2014-07-10 10:01:37,013::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lion.qa.lab.tlv.redhat.com:_export_yuri2_backup2/6a70504d-00df-4869-8695-0f442053f6b6/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-40::DEBUG::2014-07-10 10:01:37,033::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n369 bytes (369 B) copied, 0.000460624 s, 801 kB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 10:01:38,114::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-14::DEBUG::2014-07-10 10:01:38,116::task::595::TaskManager.Task::(_updateState) Task=`b8af34b0-ed7f-4ec5-b5b4-f168e99c3f34`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 10:01:38,116::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-14::INFO::2014-07-10 10:01:38,117::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 10:01:38,118::task::1185::TaskManager.Task::(prepare) Task=`b8af34b0-ed7f-4ec5-b5b4-f168e99c3f34`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 10:01:38,118::task::595::TaskManager.Task::(_updateState) Task=`b8af34b0-ed7f-4ec5-b5b4-f168e99c3f34`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 10:01:38,118::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 10:01:38,118::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 10:01:38,119::task::990::TaskManager.Task::(_decref) Task=`b8af34b0-ed7f-4ec5-b5b4-f168e99c3f34`::ref 0 aborting False >Thread-34::DEBUG::2014-07-10 10:01:38,123::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-34::DEBUG::2014-07-10 10:01:38,123::task::595::TaskManager.Task::(_updateState) Task=`5ef67d0d-40d5-4f7f-9ff6-1749f1f08a95`::moving from state init -> state preparing >Thread-34::INFO::2014-07-10 10:01:38,124::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-34::DEBUG::2014-07-10 10:01:38,124::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`6cd49aed-e230-4dfa-8bed-66c75e9591cb`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-10 10:01:38,124::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' for lock type 'shared' >Thread-34::DEBUG::2014-07-10 10:01:38,125::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-10 10:01:38,125::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`6cd49aed-e230-4dfa-8bed-66c75e9591cb`::Granted request >Thread-34::DEBUG::2014-07-10 10:01:38,126::task::827::TaskManager.Task::(resourceAcquired) Task=`5ef67d0d-40d5-4f7f-9ff6-1749f1f08a95`::_resourcesAcquired: Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee (shared) >Thread-34::DEBUG::2014-07-10 10:01:38,126::task::990::TaskManager.Task::(_decref) Task=`5ef67d0d-40d5-4f7f-9ff6-1749f1f08a95`::ref 1 aborting False >Thread-34::INFO::2014-07-10 10:01:38,127::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '531976159232', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 10:01:38,127::task::1185::TaskManager.Task::(prepare) Task=`5ef67d0d-40d5-4f7f-9ff6-1749f1f08a95`::finished: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '531976159232', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 10:01:38,127::task::595::TaskManager.Task::(_updateState) Task=`5ef67d0d-40d5-4f7f-9ff6-1749f1f08a95`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-10 10:01:38,128::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee': < ResourceRef 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-10 10:01:38,128::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-10 10:01:38,128::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' >Thread-34::DEBUG::2014-07-10 10:01:38,128::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' (0 active users) >Thread-34::DEBUG::2014-07-10 10:01:38,128::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-10 10:01:38,129::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', Clearing records. >Thread-34::DEBUG::2014-07-10 10:01:38,129::task::990::TaskManager.Task::(_decref) Task=`5ef67d0d-40d5-4f7f-9ff6-1749f1f08a95`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 10:01:38,190::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 10:01:38,323::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0716676 s, 14.3 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 10:01:39,801::task::595::TaskManager.Task::(_updateState) Task=`33749ca9-09c2-498a-b09f-1c71d50265bf`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 10:01:39,802::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::INFO::2014-07-10 10:01:39,802::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0074483', 'lastCheck': '7.4', 'valid': True}, '6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000460624', 'lastCheck': '2.8', 'valid': True}} >Thread-14::DEBUG::2014-07-10 10:01:39,802::task::1185::TaskManager.Task::(prepare) Task=`33749ca9-09c2-498a-b09f-1c71d50265bf`::finished: {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0074483', 'lastCheck': '7.4', 'valid': True}, '6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000460624', 'lastCheck': '2.8', 'valid': True}} >Thread-14::DEBUG::2014-07-10 10:01:39,802::task::595::TaskManager.Task::(_updateState) Task=`33749ca9-09c2-498a-b09f-1c71d50265bf`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 10:01:39,802::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 10:01:39,803::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 10:01:39,803::task::990::TaskManager.Task::(_decref) Task=`33749ca9-09c2-498a-b09f-1c71d50265bf`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 10:01:40,346::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 10:01:40,433::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0296521 s, 34.5 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-10 10:01:42,370::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/metadata bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-10 10:01:42,393::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000755795 s, 5.4 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 10:01:42,449::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 10:01:42,538::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0304442 s, 33.6 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 10:01:44,553::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 10:01:44,647::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.035148 s, 29.1 MB/s\n'; <rc> = 0 >Thread-70::DEBUG::2014-07-10 10:01:45,739::task::595::TaskManager.Task::(_updateState) Task=`f8523bbc-79ab-4f1a-951b-d15873edf5fe`::moving from state init -> state preparing >Thread-70::INFO::2014-07-10 10:01:45,740::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='cfaeead2-7caa-467c-b389-c89840ae6605', volUUID='567fe32d-31a6-4ff6-90f3-fd6a656fbecc', options=None) >Thread-70::INFO::2014-07-10 10:01:45,741::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-70::DEBUG::2014-07-10 10:01:45,741::task::1185::TaskManager.Task::(prepare) Task=`f8523bbc-79ab-4f1a-951b-d15873edf5fe`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-70::DEBUG::2014-07-10 10:01:45,741::task::595::TaskManager.Task::(_updateState) Task=`f8523bbc-79ab-4f1a-951b-d15873edf5fe`::moving from state preparing -> state finished >Thread-70::DEBUG::2014-07-10 10:01:45,741::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-70::DEBUG::2014-07-10 10:01:45,741::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-70::DEBUG::2014-07-10 10:01:45,741::task::990::TaskManager.Task::(_decref) Task=`f8523bbc-79ab-4f1a-951b-d15873edf5fe`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 10:01:46,670::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 10:01:46,774::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0311178 s, 32.9 MB/s\n'; <rc> = 0 >Thread-40::DEBUG::2014-07-10 10:01:47,064::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lion.qa.lab.tlv.redhat.com:_export_yuri2_backup2/6a70504d-00df-4869-8695-0f442053f6b6/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-40::DEBUG::2014-07-10 10:01:47,083::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n369 bytes (369 B) copied, 0.000520981 s, 708 kB/s\n'; <rc> = 0 >Thread-51::DEBUG::2014-07-10 10:01:47,795::task::595::TaskManager.Task::(_updateState) Task=`3c44bd07-d956-4a62-bf2b-d49568713c88`::moving from state init -> state preparing >Thread-51::INFO::2014-07-10 10:01:47,796::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='76fdb054-02cd-42ed-9721-b3e65b34c3a4', volUUID='022dfe46-2cf7-4915-80b3-883158e3ca83', options=None) >Thread-60::DEBUG::2014-07-10 10:01:47,797::task::595::TaskManager.Task::(_updateState) Task=`b97a3288-0770-424c-bd95-f9d1335aede9`::moving from state init -> state preparing >Thread-51::INFO::2014-07-10 10:01:47,798::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-51::DEBUG::2014-07-10 10:01:47,799::task::1185::TaskManager.Task::(prepare) Task=`3c44bd07-d956-4a62-bf2b-d49568713c88`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-60::INFO::2014-07-10 10:01:47,799::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='b034d5b0-e1e0-4011-b49b-4d45ddb11556', volUUID='3d7f62b5-328f-4d8e-8b69-873cfb5ae14d', options=None) >Thread-51::DEBUG::2014-07-10 10:01:47,800::task::595::TaskManager.Task::(_updateState) Task=`3c44bd07-d956-4a62-bf2b-d49568713c88`::moving from state preparing -> state finished >Thread-60::INFO::2014-07-10 10:01:47,802::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-51::DEBUG::2014-07-10 10:01:47,802::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-60::DEBUG::2014-07-10 10:01:47,803::task::1185::TaskManager.Task::(prepare) Task=`b97a3288-0770-424c-bd95-f9d1335aede9`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-51::DEBUG::2014-07-10 10:01:47,803::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-60::DEBUG::2014-07-10 10:01:47,804::task::595::TaskManager.Task::(_updateState) Task=`b97a3288-0770-424c-bd95-f9d1335aede9`::moving from state preparing -> state finished >Thread-60::DEBUG::2014-07-10 10:01:47,805::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-51::DEBUG::2014-07-10 10:01:47,805::task::990::TaskManager.Task::(_decref) Task=`3c44bd07-d956-4a62-bf2b-d49568713c88`::ref 0 aborting False >Thread-60::DEBUG::2014-07-10 10:01:47,806::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-60::DEBUG::2014-07-10 10:01:47,807::task::990::TaskManager.Task::(_decref) Task=`b97a3288-0770-424c-bd95-f9d1335aede9`::ref 0 aborting False >Thread-14::DEBUG::2014-07-10 10:01:48,206::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-14::DEBUG::2014-07-10 10:01:48,207::task::595::TaskManager.Task::(_updateState) Task=`09fd92ad-be79-4396-aa2b-fa2797baab84`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 10:01:48,207::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-14::INFO::2014-07-10 10:01:48,208::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 10:01:48,208::task::1185::TaskManager.Task::(prepare) Task=`09fd92ad-be79-4396-aa2b-fa2797baab84`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 10:01:48,208::task::595::TaskManager.Task::(_updateState) Task=`09fd92ad-be79-4396-aa2b-fa2797baab84`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 10:01:48,208::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 10:01:48,209::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 10:01:48,209::task::990::TaskManager.Task::(_decref) Task=`09fd92ad-be79-4396-aa2b-fa2797baab84`::ref 0 aborting False >Thread-34::DEBUG::2014-07-10 10:01:48,213::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-34::DEBUG::2014-07-10 10:01:48,213::task::595::TaskManager.Task::(_updateState) Task=`4a856ea2-286b-4298-b219-79b1c5e688f7`::moving from state init -> state preparing >Thread-34::INFO::2014-07-10 10:01:48,214::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-34::DEBUG::2014-07-10 10:01:48,214::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`a44ff0f4-7349-4413-a3c1-ea2f94a84994`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-10 10:01:48,215::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' for lock type 'shared' >Thread-34::DEBUG::2014-07-10 10:01:48,215::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-10 10:01:48,215::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`a44ff0f4-7349-4413-a3c1-ea2f94a84994`::Granted request >Thread-34::DEBUG::2014-07-10 10:01:48,216::task::827::TaskManager.Task::(resourceAcquired) Task=`4a856ea2-286b-4298-b219-79b1c5e688f7`::_resourcesAcquired: Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee (shared) >Thread-34::DEBUG::2014-07-10 10:01:48,216::task::990::TaskManager.Task::(_decref) Task=`4a856ea2-286b-4298-b219-79b1c5e688f7`::ref 1 aborting False >Thread-34::INFO::2014-07-10 10:01:48,217::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '531976159232', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 10:01:48,217::task::1185::TaskManager.Task::(prepare) Task=`4a856ea2-286b-4298-b219-79b1c5e688f7`::finished: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '531976159232', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 10:01:48,217::task::595::TaskManager.Task::(_updateState) Task=`4a856ea2-286b-4298-b219-79b1c5e688f7`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-10 10:01:48,218::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee': < ResourceRef 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-10 10:01:48,218::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-10 10:01:48,218::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' >Thread-34::DEBUG::2014-07-10 10:01:48,218::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' (0 active users) >Thread-34::DEBUG::2014-07-10 10:01:48,219::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-10 10:01:48,219::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', Clearing records. >Thread-34::DEBUG::2014-07-10 10:01:48,219::task::990::TaskManager.Task::(_decref) Task=`4a856ea2-286b-4298-b219-79b1c5e688f7`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 10:01:48,791::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 10:01:48,885::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0351627 s, 29.1 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 10:01:50,900::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 10:01:50,997::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0356386 s, 28.7 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-10 10:01:52,422::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/metadata bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-10 10:01:52,444::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000838065 s, 4.9 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 10:01:53,013::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 10:01:53,106::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0342292 s, 29.9 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 10:01:54,975::task::595::TaskManager.Task::(_updateState) Task=`365cacc3-a760-499b-9f57-39710d112a26`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 10:01:54,976::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::INFO::2014-07-10 10:01:54,976::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000838065', 'lastCheck': '2.5', 'valid': True}, '6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000520981', 'lastCheck': '7.9', 'valid': True}} >Thread-14::DEBUG::2014-07-10 10:01:54,977::task::1185::TaskManager.Task::(prepare) Task=`365cacc3-a760-499b-9f57-39710d112a26`::finished: {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000838065', 'lastCheck': '2.5', 'valid': True}, '6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000520981', 'lastCheck': '7.9', 'valid': True}} >Thread-14::DEBUG::2014-07-10 10:01:54,977::task::595::TaskManager.Task::(_updateState) Task=`365cacc3-a760-499b-9f57-39710d112a26`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 10:01:54,977::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 10:01:54,977::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 10:01:54,977::task::990::TaskManager.Task::(_decref) Task=`365cacc3-a760-499b-9f57-39710d112a26`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 10:01:55,125::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 10:01:55,212::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0310991 s, 32.9 MB/s\n'; <rc> = 0 >Thread-40::DEBUG::2014-07-10 10:01:57,114::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lion.qa.lab.tlv.redhat.com:_export_yuri2_backup2/6a70504d-00df-4869-8695-0f442053f6b6/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-40::DEBUG::2014-07-10 10:01:57,135::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n369 bytes (369 B) copied, 0.000423767 s, 871 kB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 10:01:57,227::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 10:01:57,321::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0353751 s, 28.9 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 10:01:58,247::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-14::DEBUG::2014-07-10 10:01:58,248::task::595::TaskManager.Task::(_updateState) Task=`b5a802e9-c324-4388-ad63-af2bd19074c4`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 10:01:58,249::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-14::INFO::2014-07-10 10:01:58,249::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 10:01:58,249::task::1185::TaskManager.Task::(prepare) Task=`b5a802e9-c324-4388-ad63-af2bd19074c4`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 10:01:58,250::task::595::TaskManager.Task::(_updateState) Task=`b5a802e9-c324-4388-ad63-af2bd19074c4`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 10:01:58,250::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 10:01:58,250::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 10:01:58,250::task::990::TaskManager.Task::(_decref) Task=`b5a802e9-c324-4388-ad63-af2bd19074c4`::ref 0 aborting False >Thread-34::DEBUG::2014-07-10 10:01:58,254::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-34::DEBUG::2014-07-10 10:01:58,254::task::595::TaskManager.Task::(_updateState) Task=`be566fb5-b21f-4223-a0e2-b3753489cafc`::moving from state init -> state preparing >Thread-34::INFO::2014-07-10 10:01:58,255::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-34::DEBUG::2014-07-10 10:01:58,255::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`fb2916fc-1bc1-400f-8d2a-cd6bebed3d4b`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-10 10:01:58,255::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' for lock type 'shared' >Thread-34::DEBUG::2014-07-10 10:01:58,256::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-10 10:01:58,256::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`fb2916fc-1bc1-400f-8d2a-cd6bebed3d4b`::Granted request >Thread-34::DEBUG::2014-07-10 10:01:58,256::task::827::TaskManager.Task::(resourceAcquired) Task=`be566fb5-b21f-4223-a0e2-b3753489cafc`::_resourcesAcquired: Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee (shared) >Thread-34::DEBUG::2014-07-10 10:01:58,257::task::990::TaskManager.Task::(_decref) Task=`be566fb5-b21f-4223-a0e2-b3753489cafc`::ref 1 aborting False >Thread-34::INFO::2014-07-10 10:01:58,258::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '531976159232', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 10:01:58,258::task::1185::TaskManager.Task::(prepare) Task=`be566fb5-b21f-4223-a0e2-b3753489cafc`::finished: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '531976159232', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 10:01:58,258::task::595::TaskManager.Task::(_updateState) Task=`be566fb5-b21f-4223-a0e2-b3753489cafc`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-10 10:01:58,258::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee': < ResourceRef 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-10 10:01:58,258::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-10 10:01:58,259::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' >Thread-34::DEBUG::2014-07-10 10:01:58,259::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' (0 active users) >Thread-34::DEBUG::2014-07-10 10:01:58,259::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-10 10:01:58,259::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', Clearing records. >Thread-34::DEBUG::2014-07-10 10:01:58,259::task::990::TaskManager.Task::(_decref) Task=`be566fb5-b21f-4223-a0e2-b3753489cafc`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 10:01:59,336::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 10:01:59,432::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0357759 s, 28.6 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 10:02:01,448::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 10:02:01,537::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0301079 s, 34.0 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-10 10:02:02,473::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/metadata bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-10 10:02:02,495::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00079107 s, 5.2 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 10:02:03,552::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 10:02:03,639::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0297421 s, 34.4 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 10:02:05,655::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 10:02:05,749::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.035209 s, 29.1 MB/s\n'; <rc> = 0 >Thread-64::DEBUG::2014-07-10 10:02:05,884::task::595::TaskManager.Task::(_updateState) Task=`a6323e1c-ba19-436b-bdcc-6f5b13287a6f`::moving from state init -> state preparing >Thread-64::INFO::2014-07-10 10:02:05,885::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='aa20346a-4d3a-4e07-b8e1-52c0ebe4168c', volUUID='58fefce2-9bce-4bff-8949-8c6ce8122b27', options=None) >Thread-64::INFO::2014-07-10 10:02:05,886::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-64::DEBUG::2014-07-10 10:02:05,886::task::1185::TaskManager.Task::(prepare) Task=`a6323e1c-ba19-436b-bdcc-6f5b13287a6f`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-64::DEBUG::2014-07-10 10:02:05,886::task::595::TaskManager.Task::(_updateState) Task=`a6323e1c-ba19-436b-bdcc-6f5b13287a6f`::moving from state preparing -> state finished >Thread-64::DEBUG::2014-07-10 10:02:05,886::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-64::DEBUG::2014-07-10 10:02:05,886::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-64::DEBUG::2014-07-10 10:02:05,887::task::990::TaskManager.Task::(_decref) Task=`a6323e1c-ba19-436b-bdcc-6f5b13287a6f`::ref 0 aborting False >Thread-40::DEBUG::2014-07-10 10:02:07,163::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lion.qa.lab.tlv.redhat.com:_export_yuri2_backup2/6a70504d-00df-4869-8695-0f442053f6b6/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-40::DEBUG::2014-07-10 10:02:07,188::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n369 bytes (369 B) copied, 0.00240088 s, 154 kB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 10:02:07,764::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 10:02:07,874::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0502407 s, 20.4 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 10:02:08,282::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-14::DEBUG::2014-07-10 10:02:08,283::task::595::TaskManager.Task::(_updateState) Task=`4b5099f0-5743-4def-8db1-a1150d2afd68`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 10:02:08,283::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-14::INFO::2014-07-10 10:02:08,284::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 10:02:08,284::task::1185::TaskManager.Task::(prepare) Task=`4b5099f0-5743-4def-8db1-a1150d2afd68`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 10:02:08,284::task::595::TaskManager.Task::(_updateState) Task=`4b5099f0-5743-4def-8db1-a1150d2afd68`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 10:02:08,285::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 10:02:08,285::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 10:02:08,285::task::990::TaskManager.Task::(_decref) Task=`4b5099f0-5743-4def-8db1-a1150d2afd68`::ref 0 aborting False >Thread-34::DEBUG::2014-07-10 10:02:08,291::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-34::DEBUG::2014-07-10 10:02:08,292::task::595::TaskManager.Task::(_updateState) Task=`b921b605-deab-4b15-bfcc-6e2f84e4935a`::moving from state init -> state preparing >Thread-34::INFO::2014-07-10 10:02:08,292::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-34::DEBUG::2014-07-10 10:02:08,293::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`795e5290-1990-4570-a0e2-b7b7edf0cba0`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-10 10:02:08,293::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' for lock type 'shared' >Thread-34::DEBUG::2014-07-10 10:02:08,294::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-10 10:02:08,294::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`795e5290-1990-4570-a0e2-b7b7edf0cba0`::Granted request >Thread-34::DEBUG::2014-07-10 10:02:08,294::task::827::TaskManager.Task::(resourceAcquired) Task=`b921b605-deab-4b15-bfcc-6e2f84e4935a`::_resourcesAcquired: Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee (shared) >Thread-34::DEBUG::2014-07-10 10:02:08,295::task::990::TaskManager.Task::(_decref) Task=`b921b605-deab-4b15-bfcc-6e2f84e4935a`::ref 1 aborting False >Thread-34::INFO::2014-07-10 10:02:08,296::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '531976159232', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 10:02:08,296::task::1185::TaskManager.Task::(prepare) Task=`b921b605-deab-4b15-bfcc-6e2f84e4935a`::finished: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '531976159232', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 10:02:08,296::task::595::TaskManager.Task::(_updateState) Task=`b921b605-deab-4b15-bfcc-6e2f84e4935a`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-10 10:02:08,296::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee': < ResourceRef 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-10 10:02:08,297::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-10 10:02:08,297::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' >Thread-34::DEBUG::2014-07-10 10:02:08,297::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' (0 active users) >Thread-34::DEBUG::2014-07-10 10:02:08,297::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-10 10:02:08,297::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', Clearing records. >Thread-34::DEBUG::2014-07-10 10:02:08,298::task::990::TaskManager.Task::(_decref) Task=`b921b605-deab-4b15-bfcc-6e2f84e4935a`::ref 0 aborting False >Thread-54::DEBUG::2014-07-10 10:02:09,499::task::595::TaskManager.Task::(_updateState) Task=`7e54326d-0c5a-49dc-9e7d-213af57a2dc3`::moving from state init -> state preparing >Thread-54::INFO::2014-07-10 10:02:09,500::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='28408446-e5fd-4565-a976-e760951593fe', volUUID='776303a2-5585-451e-826e-0e338d4a1e98', options=None) >Thread-54::INFO::2014-07-10 10:02:09,500::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-54::DEBUG::2014-07-10 10:02:09,500::task::1185::TaskManager.Task::(prepare) Task=`7e54326d-0c5a-49dc-9e7d-213af57a2dc3`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-54::DEBUG::2014-07-10 10:02:09,500::task::595::TaskManager.Task::(_updateState) Task=`7e54326d-0c5a-49dc-9e7d-213af57a2dc3`::moving from state preparing -> state finished >Thread-54::DEBUG::2014-07-10 10:02:09,501::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-54::DEBUG::2014-07-10 10:02:09,501::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-54::DEBUG::2014-07-10 10:02:09,501::task::990::TaskManager.Task::(_decref) Task=`7e54326d-0c5a-49dc-9e7d-213af57a2dc3`::ref 0 aborting False >Thread-73::DEBUG::2014-07-10 10:02:09,502::task::595::TaskManager.Task::(_updateState) Task=`00eb5f7c-0db6-4cd7-b85e-31b733cf799f`::moving from state init -> state preparing >Thread-73::INFO::2014-07-10 10:02:09,502::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='c01d693b-cba0-4fed-9ad7-0aaa28912a19', volUUID='4bb5d954-2a50-4028-b299-0b43c261270c', options=None) >Thread-73::INFO::2014-07-10 10:02:09,502::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-73::DEBUG::2014-07-10 10:02:09,503::task::1185::TaskManager.Task::(prepare) Task=`00eb5f7c-0db6-4cd7-b85e-31b733cf799f`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-73::DEBUG::2014-07-10 10:02:09,503::task::595::TaskManager.Task::(_updateState) Task=`00eb5f7c-0db6-4cd7-b85e-31b733cf799f`::moving from state preparing -> state finished >Thread-73::DEBUG::2014-07-10 10:02:09,503::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-73::DEBUG::2014-07-10 10:02:09,503::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-73::DEBUG::2014-07-10 10:02:09,503::task::990::TaskManager.Task::(_decref) Task=`00eb5f7c-0db6-4cd7-b85e-31b733cf799f`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 10:02:09,891::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 10:02:09,987::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0329721 s, 31.1 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 10:02:10,158::task::595::TaskManager.Task::(_updateState) Task=`739cdf7f-011c-420e-a75c-93f6e2f152f3`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 10:02:10,159::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::INFO::2014-07-10 10:02:10,159::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00079107', 'lastCheck': '7.6', 'valid': True}, '6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00240088', 'lastCheck': '3.0', 'valid': True}} >Thread-14::DEBUG::2014-07-10 10:02:10,160::task::1185::TaskManager.Task::(prepare) Task=`739cdf7f-011c-420e-a75c-93f6e2f152f3`::finished: {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00079107', 'lastCheck': '7.6', 'valid': True}, '6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00240088', 'lastCheck': '3.0', 'valid': True}} >Thread-14::DEBUG::2014-07-10 10:02:10,160::task::595::TaskManager.Task::(_updateState) Task=`739cdf7f-011c-420e-a75c-93f6e2f152f3`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 10:02:10,160::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 10:02:10,160::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 10:02:10,160::task::990::TaskManager.Task::(_decref) Task=`739cdf7f-011c-420e-a75c-93f6e2f152f3`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 10:02:12,002::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 10:02:12,113::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0395699 s, 25.9 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-10 10:02:12,525::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/metadata bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-10 10:02:12,546::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000680394 s, 6.0 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 10:02:14,131::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 10:02:15,011::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.730911 s, 1.4 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 10:02:17,027::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 10:02:17,132::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0313603 s, 32.7 MB/s\n'; <rc> = 0 >Thread-40::DEBUG::2014-07-10 10:02:17,220::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lion.qa.lab.tlv.redhat.com:_export_yuri2_backup2/6a70504d-00df-4869-8695-0f442053f6b6/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-40::DEBUG::2014-07-10 10:02:17,240::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n369 bytes (369 B) copied, 0.000490923 s, 752 kB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 10:02:18,332::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-14::DEBUG::2014-07-10 10:02:18,333::task::595::TaskManager.Task::(_updateState) Task=`6ce904c1-ecb5-460a-a476-9978d78007c8`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 10:02:18,334::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-14::INFO::2014-07-10 10:02:18,334::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 10:02:18,335::task::1185::TaskManager.Task::(prepare) Task=`6ce904c1-ecb5-460a-a476-9978d78007c8`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 10:02:18,335::task::595::TaskManager.Task::(_updateState) Task=`6ce904c1-ecb5-460a-a476-9978d78007c8`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 10:02:18,335::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 10:02:18,335::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 10:02:18,335::task::990::TaskManager.Task::(_decref) Task=`6ce904c1-ecb5-460a-a476-9978d78007c8`::ref 0 aborting False >Thread-34::DEBUG::2014-07-10 10:02:18,340::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-34::DEBUG::2014-07-10 10:02:18,340::task::595::TaskManager.Task::(_updateState) Task=`cf3e2570-8008-4651-8ee5-766464fada63`::moving from state init -> state preparing >Thread-34::INFO::2014-07-10 10:02:18,340::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-34::DEBUG::2014-07-10 10:02:18,341::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`9f397a9e-b9a8-4eda-a889-6122ca715396`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-10 10:02:18,341::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' for lock type 'shared' >Thread-34::DEBUG::2014-07-10 10:02:18,342::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-10 10:02:18,342::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`9f397a9e-b9a8-4eda-a889-6122ca715396`::Granted request >Thread-34::DEBUG::2014-07-10 10:02:18,342::task::827::TaskManager.Task::(resourceAcquired) Task=`cf3e2570-8008-4651-8ee5-766464fada63`::_resourcesAcquired: Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee (shared) >Thread-34::DEBUG::2014-07-10 10:02:18,343::task::990::TaskManager.Task::(_decref) Task=`cf3e2570-8008-4651-8ee5-766464fada63`::ref 1 aborting False >Thread-34::INFO::2014-07-10 10:02:18,344::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '531976159232', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 10:02:18,344::task::1185::TaskManager.Task::(prepare) Task=`cf3e2570-8008-4651-8ee5-766464fada63`::finished: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '531976159232', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 10:02:18,344::task::595::TaskManager.Task::(_updateState) Task=`cf3e2570-8008-4651-8ee5-766464fada63`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-10 10:02:18,344::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee': < ResourceRef 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-10 10:02:18,345::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-10 10:02:18,345::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' >Thread-34::DEBUG::2014-07-10 10:02:18,345::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' (0 active users) >Thread-34::DEBUG::2014-07-10 10:02:18,345::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-10 10:02:18,345::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', Clearing records. >Thread-34::DEBUG::2014-07-10 10:02:18,346::task::990::TaskManager.Task::(_decref) Task=`cf3e2570-8008-4651-8ee5-766464fada63`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 10:02:19,148::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 10:02:19,232::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0284831 s, 36.0 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 10:02:21,250::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 10:02:21,337::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0310161 s, 33.0 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-10 10:02:22,575::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/metadata bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-10 10:02:22,597::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000748628 s, 5.5 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 10:02:23,352::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 10:02:23,457::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0312666 s, 32.8 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 10:02:25,332::task::595::TaskManager.Task::(_updateState) Task=`4d467355-a41c-4161-a9d4-c06cf3235f86`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 10:02:25,333::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::INFO::2014-07-10 10:02:25,333::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000748628', 'lastCheck': '2.7', 'valid': True}, '6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000490923', 'lastCheck': '8.1', 'valid': True}} >Thread-14::DEBUG::2014-07-10 10:02:25,334::task::1185::TaskManager.Task::(prepare) Task=`4d467355-a41c-4161-a9d4-c06cf3235f86`::finished: {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000748628', 'lastCheck': '2.7', 'valid': True}, '6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000490923', 'lastCheck': '8.1', 'valid': True}} >Thread-14::DEBUG::2014-07-10 10:02:25,334::task::595::TaskManager.Task::(_updateState) Task=`4d467355-a41c-4161-a9d4-c06cf3235f86`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 10:02:25,334::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 10:02:25,334::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 10:02:25,334::task::990::TaskManager.Task::(_decref) Task=`4d467355-a41c-4161-a9d4-c06cf3235f86`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 10:02:25,472::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 10:02:25,569::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0379168 s, 27.0 MB/s\n'; <rc> = 0 >Thread-57::DEBUG::2014-07-10 10:02:26,283::task::595::TaskManager.Task::(_updateState) Task=`0e43d37b-6db3-4bcc-81df-15854d2f1e76`::moving from state init -> state preparing >Thread-57::INFO::2014-07-10 10:02:26,284::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='b6f6c0da-e67f-4902-b9ac-3069571a42fe', volUUID='c4cd1da8-05b7-45e0-80b1-1183d21443d9', options=None) >Thread-57::INFO::2014-07-10 10:02:26,284::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-57::DEBUG::2014-07-10 10:02:26,285::task::1185::TaskManager.Task::(prepare) Task=`0e43d37b-6db3-4bcc-81df-15854d2f1e76`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-57::DEBUG::2014-07-10 10:02:26,285::task::595::TaskManager.Task::(_updateState) Task=`0e43d37b-6db3-4bcc-81df-15854d2f1e76`::moving from state preparing -> state finished >Thread-57::DEBUG::2014-07-10 10:02:26,285::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-57::DEBUG::2014-07-10 10:02:26,285::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-57::DEBUG::2014-07-10 10:02:26,285::task::990::TaskManager.Task::(_decref) Task=`0e43d37b-6db3-4bcc-81df-15854d2f1e76`::ref 0 aborting False >Thread-67::DEBUG::2014-07-10 10:02:27,105::task::595::TaskManager.Task::(_updateState) Task=`1cb27056-6925-4692-95c7-4ea6c2b18252`::moving from state init -> state preparing >Thread-67::INFO::2014-07-10 10:02:27,105::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='f30c2cb7-a43a-4bf5-82b5-cfe07336f65c', volUUID='b0fbb3c9-55af-4a3a-95ad-fc56a80b9cf5', options=None) >Thread-67::INFO::2014-07-10 10:02:27,106::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-67::DEBUG::2014-07-10 10:02:27,106::task::1185::TaskManager.Task::(prepare) Task=`1cb27056-6925-4692-95c7-4ea6c2b18252`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-67::DEBUG::2014-07-10 10:02:27,106::task::595::TaskManager.Task::(_updateState) Task=`1cb27056-6925-4692-95c7-4ea6c2b18252`::moving from state preparing -> state finished >Thread-67::DEBUG::2014-07-10 10:02:27,106::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-67::DEBUG::2014-07-10 10:02:27,107::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-67::DEBUG::2014-07-10 10:02:27,107::task::990::TaskManager.Task::(_decref) Task=`1cb27056-6925-4692-95c7-4ea6c2b18252`::ref 0 aborting False >Thread-48::DEBUG::2014-07-10 10:02:27,268::task::595::TaskManager.Task::(_updateState) Task=`4c36a99c-268c-46d2-8cad-2c68fb00ec86`::moving from state init -> state preparing >Thread-48::INFO::2014-07-10 10:02:27,270::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='0cd7d6ce-f497-4243-a690-c57744861eea', volUUID='10b6a7dd-dc6c-43fa-ba17-92e4331b0e0b', options=None) >Thread-48::INFO::2014-07-10 10:02:27,272::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-48::DEBUG::2014-07-10 10:02:27,274::task::1185::TaskManager.Task::(prepare) Task=`4c36a99c-268c-46d2-8cad-2c68fb00ec86`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-48::DEBUG::2014-07-10 10:02:27,275::task::595::TaskManager.Task::(_updateState) Task=`4c36a99c-268c-46d2-8cad-2c68fb00ec86`::moving from state preparing -> state finished >Thread-48::DEBUG::2014-07-10 10:02:27,276::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-48::DEBUG::2014-07-10 10:02:27,278::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-48::DEBUG::2014-07-10 10:02:27,279::task::990::TaskManager.Task::(_decref) Task=`4c36a99c-268c-46d2-8cad-2c68fb00ec86`::ref 0 aborting False >Thread-40::DEBUG::2014-07-10 10:02:27,285::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lion.qa.lab.tlv.redhat.com:_export_yuri2_backup2/6a70504d-00df-4869-8695-0f442053f6b6/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-40::DEBUG::2014-07-10 10:02:27,306::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n369 bytes (369 B) copied, 0.000442679 s, 834 kB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 10:02:27,584::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 10:02:27,680::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0390098 s, 26.2 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 10:02:28,395::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-14::DEBUG::2014-07-10 10:02:28,396::task::595::TaskManager.Task::(_updateState) Task=`614ee8f0-44c9-43c7-9039-c6b524b5b496`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 10:02:28,396::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-14::INFO::2014-07-10 10:02:28,397::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 10:02:28,397::task::1185::TaskManager.Task::(prepare) Task=`614ee8f0-44c9-43c7-9039-c6b524b5b496`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 10:02:28,397::task::595::TaskManager.Task::(_updateState) Task=`614ee8f0-44c9-43c7-9039-c6b524b5b496`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 10:02:28,397::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 10:02:28,398::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 10:02:28,398::task::990::TaskManager.Task::(_decref) Task=`614ee8f0-44c9-43c7-9039-c6b524b5b496`::ref 0 aborting False >Thread-34::DEBUG::2014-07-10 10:02:28,442::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-34::DEBUG::2014-07-10 10:02:28,443::task::595::TaskManager.Task::(_updateState) Task=`156d72a1-2863-4a37-81a7-f217038794ec`::moving from state init -> state preparing >Thread-34::INFO::2014-07-10 10:02:28,443::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-34::DEBUG::2014-07-10 10:02:28,444::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`7d4c1c64-f8cf-4324-b87c-43f4cff18a38`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-10 10:02:28,444::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' for lock type 'shared' >Thread-34::DEBUG::2014-07-10 10:02:28,444::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-10 10:02:28,445::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`7d4c1c64-f8cf-4324-b87c-43f4cff18a38`::Granted request >Thread-34::DEBUG::2014-07-10 10:02:28,445::task::827::TaskManager.Task::(resourceAcquired) Task=`156d72a1-2863-4a37-81a7-f217038794ec`::_resourcesAcquired: Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee (shared) >Thread-34::DEBUG::2014-07-10 10:02:28,445::task::990::TaskManager.Task::(_decref) Task=`156d72a1-2863-4a37-81a7-f217038794ec`::ref 1 aborting False >Thread-34::INFO::2014-07-10 10:02:28,447::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '531976159232', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 10:02:28,447::task::1185::TaskManager.Task::(prepare) Task=`156d72a1-2863-4a37-81a7-f217038794ec`::finished: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '531976159232', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 10:02:28,447::task::595::TaskManager.Task::(_updateState) Task=`156d72a1-2863-4a37-81a7-f217038794ec`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-10 10:02:28,447::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee': < ResourceRef 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-10 10:02:28,447::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-10 10:02:28,448::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' >Thread-34::DEBUG::2014-07-10 10:02:28,448::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' (0 active users) >Thread-34::DEBUG::2014-07-10 10:02:28,448::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-10 10:02:28,448::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', Clearing records. >Thread-34::DEBUG::2014-07-10 10:02:28,449::task::990::TaskManager.Task::(_decref) Task=`156d72a1-2863-4a37-81a7-f217038794ec`::ref 0 aborting False >Thread-76::DEBUG::2014-07-10 10:02:29,110::task::595::TaskManager.Task::(_updateState) Task=`30c74b02-f361-425c-994b-c0c3f861764a`::moving from state init -> state preparing >Thread-76::INFO::2014-07-10 10:02:29,111::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='e4c65229-4247-4b33-b72a-f1d5ce72ad05', volUUID='cad94284-3ca9-4c30-933d-997f4460309e', options=None) >Thread-76::INFO::2014-07-10 10:02:29,111::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-76::DEBUG::2014-07-10 10:02:29,111::task::1185::TaskManager.Task::(prepare) Task=`30c74b02-f361-425c-994b-c0c3f861764a`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-76::DEBUG::2014-07-10 10:02:29,112::task::595::TaskManager.Task::(_updateState) Task=`30c74b02-f361-425c-994b-c0c3f861764a`::moving from state preparing -> state finished >Thread-76::DEBUG::2014-07-10 10:02:29,112::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-76::DEBUG::2014-07-10 10:02:29,112::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-76::DEBUG::2014-07-10 10:02:29,112::task::990::TaskManager.Task::(_decref) Task=`30c74b02-f361-425c-994b-c0c3f861764a`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 10:02:29,696::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 10:02:29,796::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0312557 s, 32.8 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 10:02:31,811::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 10:02:31,908::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0251442 s, 40.7 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-10 10:02:32,626::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/metadata bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-10 10:02:32,649::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000921361 s, 4.4 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 10:02:33,926::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 10:02:34,014::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.030795 s, 33.3 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 10:02:36,032::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 10:02:36,131::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0415375 s, 24.7 MB/s\n'; <rc> = 0 >Thread-40::DEBUG::2014-07-10 10:02:37,332::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lion.qa.lab.tlv.redhat.com:_export_yuri2_backup2/6a70504d-00df-4869-8695-0f442053f6b6/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-40::DEBUG::2014-07-10 10:02:37,351::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n369 bytes (369 B) copied, 0.000455888 s, 809 kB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 10:02:38,146::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 10:02:38,237::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0329086 s, 31.1 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 10:02:38,474::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-14::DEBUG::2014-07-10 10:02:38,475::task::595::TaskManager.Task::(_updateState) Task=`426d4725-5f67-41d6-a8a4-19e0536f68bd`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 10:02:38,475::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-14::INFO::2014-07-10 10:02:38,476::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 10:02:38,476::task::1185::TaskManager.Task::(prepare) Task=`426d4725-5f67-41d6-a8a4-19e0536f68bd`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 10:02:38,476::task::595::TaskManager.Task::(_updateState) Task=`426d4725-5f67-41d6-a8a4-19e0536f68bd`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 10:02:38,476::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 10:02:38,477::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 10:02:38,477::task::990::TaskManager.Task::(_decref) Task=`426d4725-5f67-41d6-a8a4-19e0536f68bd`::ref 0 aborting False >Thread-34::DEBUG::2014-07-10 10:02:38,481::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-34::DEBUG::2014-07-10 10:02:38,482::task::595::TaskManager.Task::(_updateState) Task=`9e7d9634-86c9-4944-ba0d-605e124b0041`::moving from state init -> state preparing >Thread-34::INFO::2014-07-10 10:02:38,482::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-34::DEBUG::2014-07-10 10:02:38,483::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`6602b8c5-b32a-4741-a6a3-d4b344c4d265`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-10 10:02:38,483::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' for lock type 'shared' >Thread-34::DEBUG::2014-07-10 10:02:38,483::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-10 10:02:38,483::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`6602b8c5-b32a-4741-a6a3-d4b344c4d265`::Granted request >Thread-34::DEBUG::2014-07-10 10:02:38,484::task::827::TaskManager.Task::(resourceAcquired) Task=`9e7d9634-86c9-4944-ba0d-605e124b0041`::_resourcesAcquired: Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee (shared) >Thread-34::DEBUG::2014-07-10 10:02:38,484::task::990::TaskManager.Task::(_decref) Task=`9e7d9634-86c9-4944-ba0d-605e124b0041`::ref 1 aborting False >Thread-34::INFO::2014-07-10 10:02:38,485::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '531976159232', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 10:02:38,486::task::1185::TaskManager.Task::(prepare) Task=`9e7d9634-86c9-4944-ba0d-605e124b0041`::finished: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '531976159232', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 10:02:38,486::task::595::TaskManager.Task::(_updateState) Task=`9e7d9634-86c9-4944-ba0d-605e124b0041`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-10 10:02:38,486::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee': < ResourceRef 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-10 10:02:38,486::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-10 10:02:38,487::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' >Thread-34::DEBUG::2014-07-10 10:02:38,487::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' (0 active users) >Thread-34::DEBUG::2014-07-10 10:02:38,487::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-10 10:02:38,487::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', Clearing records. >Thread-34::DEBUG::2014-07-10 10:02:38,487::task::990::TaskManager.Task::(_decref) Task=`9e7d9634-86c9-4944-ba0d-605e124b0041`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 10:02:40,252::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 10:02:40,341::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0295147 s, 34.7 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 10:02:40,516::task::595::TaskManager.Task::(_updateState) Task=`ed80ff20-5644-43ad-be01-adb7dd42e073`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 10:02:40,517::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::INFO::2014-07-10 10:02:40,517::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000921361', 'lastCheck': '7.8', 'valid': True}, '6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000455888', 'lastCheck': '3.2', 'valid': True}} >Thread-14::DEBUG::2014-07-10 10:02:40,518::task::1185::TaskManager.Task::(prepare) Task=`ed80ff20-5644-43ad-be01-adb7dd42e073`::finished: {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000921361', 'lastCheck': '7.8', 'valid': True}, '6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000455888', 'lastCheck': '3.2', 'valid': True}} >Thread-14::DEBUG::2014-07-10 10:02:40,518::task::595::TaskManager.Task::(_updateState) Task=`ed80ff20-5644-43ad-be01-adb7dd42e073`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 10:02:40,519::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 10:02:40,519::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 10:02:40,519::task::990::TaskManager.Task::(_decref) Task=`ed80ff20-5644-43ad-be01-adb7dd42e073`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 10:02:42,356::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 10:02:42,453::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0385118 s, 26.6 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-10 10:02:42,678::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/metadata bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-10 10:02:42,699::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000853543 s, 4.8 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 10:02:44,469::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 10:02:44,561::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0348273 s, 29.4 MB/s\n'; <rc> = 0 >Thread-70::DEBUG::2014-07-10 10:02:46,003::task::595::TaskManager.Task::(_updateState) Task=`0d7a39e0-228b-4caa-90f3-a98fb15124aa`::moving from state init -> state preparing >Thread-70::INFO::2014-07-10 10:02:46,004::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='cfaeead2-7caa-467c-b389-c89840ae6605', volUUID='567fe32d-31a6-4ff6-90f3-fd6a656fbecc', options=None) >Thread-70::INFO::2014-07-10 10:02:46,004::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-70::DEBUG::2014-07-10 10:02:46,004::task::1185::TaskManager.Task::(prepare) Task=`0d7a39e0-228b-4caa-90f3-a98fb15124aa`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-70::DEBUG::2014-07-10 10:02:46,004::task::595::TaskManager.Task::(_updateState) Task=`0d7a39e0-228b-4caa-90f3-a98fb15124aa`::moving from state preparing -> state finished >Thread-70::DEBUG::2014-07-10 10:02:46,005::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-70::DEBUG::2014-07-10 10:02:46,005::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-70::DEBUG::2014-07-10 10:02:46,005::task::990::TaskManager.Task::(_decref) Task=`0d7a39e0-228b-4caa-90f3-a98fb15124aa`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 10:02:46,577::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 10:02:46,669::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0322043 s, 31.8 MB/s\n'; <rc> = 0 >Thread-40::DEBUG::2014-07-10 10:02:47,382::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lion.qa.lab.tlv.redhat.com:_export_yuri2_backup2/6a70504d-00df-4869-8695-0f442053f6b6/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-40::DEBUG::2014-07-10 10:02:47,402::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n369 bytes (369 B) copied, 0.000506959 s, 728 kB/s\n'; <rc> = 0 >Thread-60::DEBUG::2014-07-10 10:02:48,112::task::595::TaskManager.Task::(_updateState) Task=`8dd262a7-8c8e-4834-bfee-19c3ca188b4f`::moving from state init -> state preparing >Thread-51::DEBUG::2014-07-10 10:02:48,114::task::595::TaskManager.Task::(_updateState) Task=`470c35d7-3857-4003-823b-aedf0939c07a`::moving from state init -> state preparing >Thread-60::INFO::2014-07-10 10:02:48,114::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='b034d5b0-e1e0-4011-b49b-4d45ddb11556', volUUID='3d7f62b5-328f-4d8e-8b69-873cfb5ae14d', options=None) >Thread-51::INFO::2014-07-10 10:02:48,116::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='76fdb054-02cd-42ed-9721-b3e65b34c3a4', volUUID='022dfe46-2cf7-4915-80b3-883158e3ca83', options=None) >Thread-60::INFO::2014-07-10 10:02:48,117::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-51::INFO::2014-07-10 10:02:48,118::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-60::DEBUG::2014-07-10 10:02:48,118::task::1185::TaskManager.Task::(prepare) Task=`8dd262a7-8c8e-4834-bfee-19c3ca188b4f`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-51::DEBUG::2014-07-10 10:02:48,119::task::1185::TaskManager.Task::(prepare) Task=`470c35d7-3857-4003-823b-aedf0939c07a`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-60::DEBUG::2014-07-10 10:02:48,119::task::595::TaskManager.Task::(_updateState) Task=`8dd262a7-8c8e-4834-bfee-19c3ca188b4f`::moving from state preparing -> state finished >Thread-51::DEBUG::2014-07-10 10:02:48,120::task::595::TaskManager.Task::(_updateState) Task=`470c35d7-3857-4003-823b-aedf0939c07a`::moving from state preparing -> state finished >Thread-60::DEBUG::2014-07-10 10:02:48,121::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-51::DEBUG::2014-07-10 10:02:48,121::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-60::DEBUG::2014-07-10 10:02:48,122::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-51::DEBUG::2014-07-10 10:02:48,122::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-51::DEBUG::2014-07-10 10:02:48,124::task::990::TaskManager.Task::(_decref) Task=`470c35d7-3857-4003-823b-aedf0939c07a`::ref 0 aborting False >Thread-60::DEBUG::2014-07-10 10:02:48,123::task::990::TaskManager.Task::(_decref) Task=`8dd262a7-8c8e-4834-bfee-19c3ca188b4f`::ref 0 aborting False >Thread-14::DEBUG::2014-07-10 10:02:48,565::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-14::DEBUG::2014-07-10 10:02:48,566::task::595::TaskManager.Task::(_updateState) Task=`2b73bf7d-e838-4daf-bedf-39db72ed2bcc`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 10:02:48,567::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-14::INFO::2014-07-10 10:02:48,567::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 10:02:48,567::task::1185::TaskManager.Task::(prepare) Task=`2b73bf7d-e838-4daf-bedf-39db72ed2bcc`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 10:02:48,567::task::595::TaskManager.Task::(_updateState) Task=`2b73bf7d-e838-4daf-bedf-39db72ed2bcc`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 10:02:48,568::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 10:02:48,568::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 10:02:48,568::task::990::TaskManager.Task::(_decref) Task=`2b73bf7d-e838-4daf-bedf-39db72ed2bcc`::ref 0 aborting False >Thread-34::DEBUG::2014-07-10 10:02:48,572::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-34::DEBUG::2014-07-10 10:02:48,572::task::595::TaskManager.Task::(_updateState) Task=`628b7766-9342-43fc-922c-eab6946d1286`::moving from state init -> state preparing >Thread-34::INFO::2014-07-10 10:02:48,573::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-34::DEBUG::2014-07-10 10:02:48,573::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`87e081a5-dedc-4340-97c7-1edfcfb9c96a`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-10 10:02:48,573::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' for lock type 'shared' >Thread-34::DEBUG::2014-07-10 10:02:48,574::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-10 10:02:48,574::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`87e081a5-dedc-4340-97c7-1edfcfb9c96a`::Granted request >Thread-34::DEBUG::2014-07-10 10:02:48,574::task::827::TaskManager.Task::(resourceAcquired) Task=`628b7766-9342-43fc-922c-eab6946d1286`::_resourcesAcquired: Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee (shared) >Thread-34::DEBUG::2014-07-10 10:02:48,574::task::990::TaskManager.Task::(_decref) Task=`628b7766-9342-43fc-922c-eab6946d1286`::ref 1 aborting False >Thread-34::INFO::2014-07-10 10:02:48,576::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '531976159232', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 10:02:48,576::task::1185::TaskManager.Task::(prepare) Task=`628b7766-9342-43fc-922c-eab6946d1286`::finished: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '531976159232', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 10:02:48,576::task::595::TaskManager.Task::(_updateState) Task=`628b7766-9342-43fc-922c-eab6946d1286`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-10 10:02:48,576::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee': < ResourceRef 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-10 10:02:48,576::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-10 10:02:48,576::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' >Thread-34::DEBUG::2014-07-10 10:02:48,577::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' (0 active users) >Thread-34::DEBUG::2014-07-10 10:02:48,577::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-10 10:02:48,577::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', Clearing records. >Thread-34::DEBUG::2014-07-10 10:02:48,577::task::990::TaskManager.Task::(_decref) Task=`628b7766-9342-43fc-922c-eab6946d1286`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 10:02:48,685::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 10:02:48,772::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.029905 s, 34.2 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 10:02:50,787::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 10:02:50,889::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0345271 s, 29.7 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-10 10:02:52,728::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/metadata bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-10 10:02:52,769::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000734452 s, 5.6 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 10:02:52,905::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 10:02:53,079::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0402958 s, 25.4 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 10:02:55,095::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 10:02:55,186::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.035068 s, 29.2 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 10:02:55,775::task::595::TaskManager.Task::(_updateState) Task=`c08e7e1a-175d-489d-a69a-6b5f7f7c158e`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 10:02:55,775::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::INFO::2014-07-10 10:02:55,776::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000734452', 'lastCheck': '3.0', 'valid': True}, '6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000506959', 'lastCheck': '8.4', 'valid': True}} >Thread-14::DEBUG::2014-07-10 10:02:55,776::task::1185::TaskManager.Task::(prepare) Task=`c08e7e1a-175d-489d-a69a-6b5f7f7c158e`::finished: {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000734452', 'lastCheck': '3.0', 'valid': True}, '6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000506959', 'lastCheck': '8.4', 'valid': True}} >Thread-14::DEBUG::2014-07-10 10:02:55,776::task::595::TaskManager.Task::(_updateState) Task=`c08e7e1a-175d-489d-a69a-6b5f7f7c158e`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 10:02:55,777::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 10:02:55,777::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 10:02:55,777::task::990::TaskManager.Task::(_decref) Task=`c08e7e1a-175d-489d-a69a-6b5f7f7c158e`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 10:02:57,202::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 10:02:57,295::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0332085 s, 30.8 MB/s\n'; <rc> = 0 >Thread-40::DEBUG::2014-07-10 10:02:57,433::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lion.qa.lab.tlv.redhat.com:_export_yuri2_backup2/6a70504d-00df-4869-8695-0f442053f6b6/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-40::DEBUG::2014-07-10 10:02:57,455::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n369 bytes (369 B) copied, 0.000983831 s, 375 kB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 10:02:58,607::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-14::DEBUG::2014-07-10 10:02:58,608::task::595::TaskManager.Task::(_updateState) Task=`41d65006-14a3-4675-b556-ebc205cb7629`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 10:02:58,609::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-14::INFO::2014-07-10 10:02:58,609::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 10:02:58,609::task::1185::TaskManager.Task::(prepare) Task=`41d65006-14a3-4675-b556-ebc205cb7629`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 10:02:58,610::task::595::TaskManager.Task::(_updateState) Task=`41d65006-14a3-4675-b556-ebc205cb7629`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 10:02:58,610::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 10:02:58,610::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 10:02:58,610::task::990::TaskManager.Task::(_decref) Task=`41d65006-14a3-4675-b556-ebc205cb7629`::ref 0 aborting False >Thread-34::DEBUG::2014-07-10 10:02:58,654::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-34::DEBUG::2014-07-10 10:02:58,654::task::595::TaskManager.Task::(_updateState) Task=`b635cee5-af97-4d8e-af4b-888bf5614d4d`::moving from state init -> state preparing >Thread-34::INFO::2014-07-10 10:02:58,654::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-34::DEBUG::2014-07-10 10:02:58,655::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`dcb4a833-b9fa-47de-a271-415a2bba73a8`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-10 10:02:58,655::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' for lock type 'shared' >Thread-34::DEBUG::2014-07-10 10:02:58,655::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-10 10:02:58,655::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`dcb4a833-b9fa-47de-a271-415a2bba73a8`::Granted request >Thread-34::DEBUG::2014-07-10 10:02:58,656::task::827::TaskManager.Task::(resourceAcquired) Task=`b635cee5-af97-4d8e-af4b-888bf5614d4d`::_resourcesAcquired: Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee (shared) >Thread-34::DEBUG::2014-07-10 10:02:58,656::task::990::TaskManager.Task::(_decref) Task=`b635cee5-af97-4d8e-af4b-888bf5614d4d`::ref 1 aborting False >Thread-34::INFO::2014-07-10 10:02:58,657::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '531976159232', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 10:02:58,657::task::1185::TaskManager.Task::(prepare) Task=`b635cee5-af97-4d8e-af4b-888bf5614d4d`::finished: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '531976159232', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 10:02:58,657::task::595::TaskManager.Task::(_updateState) Task=`b635cee5-af97-4d8e-af4b-888bf5614d4d`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-10 10:02:58,658::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee': < ResourceRef 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-10 10:02:58,658::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-10 10:02:58,658::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' >Thread-34::DEBUG::2014-07-10 10:02:58,658::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' (0 active users) >Thread-34::DEBUG::2014-07-10 10:02:58,658::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-10 10:02:58,659::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', Clearing records. >Thread-34::DEBUG::2014-07-10 10:02:58,659::task::990::TaskManager.Task::(_decref) Task=`b635cee5-af97-4d8e-af4b-888bf5614d4d`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 10:02:59,314::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 10:02:59,402::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0281607 s, 36.4 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 10:03:01,417::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 10:03:01,534::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0351613 s, 29.1 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-10 10:03:02,798::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/metadata bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-10 10:03:02,820::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000752109 s, 5.4 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 10:03:03,549::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 10:03:03,634::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0292241 s, 35.0 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 10:03:05,649::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 10:03:05,817::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0419537 s, 24.4 MB/s\n'; <rc> = 0 >Thread-64::DEBUG::2014-07-10 10:03:06,150::task::595::TaskManager.Task::(_updateState) Task=`cec72f28-6a3c-43db-8a12-19f4b4e4b244`::moving from state init -> state preparing >Thread-64::INFO::2014-07-10 10:03:06,151::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='aa20346a-4d3a-4e07-b8e1-52c0ebe4168c', volUUID='58fefce2-9bce-4bff-8949-8c6ce8122b27', options=None) >Thread-64::INFO::2014-07-10 10:03:06,151::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-64::DEBUG::2014-07-10 10:03:06,151::task::1185::TaskManager.Task::(prepare) Task=`cec72f28-6a3c-43db-8a12-19f4b4e4b244`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-64::DEBUG::2014-07-10 10:03:06,151::task::595::TaskManager.Task::(_updateState) Task=`cec72f28-6a3c-43db-8a12-19f4b4e4b244`::moving from state preparing -> state finished >Thread-64::DEBUG::2014-07-10 10:03:06,152::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-64::DEBUG::2014-07-10 10:03:06,152::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-64::DEBUG::2014-07-10 10:03:06,152::task::990::TaskManager.Task::(_decref) Task=`cec72f28-6a3c-43db-8a12-19f4b4e4b244`::ref 0 aborting False >Thread-40::DEBUG::2014-07-10 10:03:07,490::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lion.qa.lab.tlv.redhat.com:_export_yuri2_backup2/6a70504d-00df-4869-8695-0f442053f6b6/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-40::DEBUG::2014-07-10 10:03:07,511::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n369 bytes (369 B) copied, 0.000473919 s, 779 kB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 10:03:07,833::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 10:03:07,926::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0358239 s, 28.6 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 10:03:08,682::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-14::DEBUG::2014-07-10 10:03:08,683::task::595::TaskManager.Task::(_updateState) Task=`ccb314a1-4f52-446e-b8b9-1cb3959da164`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 10:03:08,684::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-14::INFO::2014-07-10 10:03:08,684::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 10:03:08,685::task::1185::TaskManager.Task::(prepare) Task=`ccb314a1-4f52-446e-b8b9-1cb3959da164`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 10:03:08,685::task::595::TaskManager.Task::(_updateState) Task=`ccb314a1-4f52-446e-b8b9-1cb3959da164`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 10:03:08,685::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 10:03:08,685::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 10:03:08,686::task::990::TaskManager.Task::(_decref) Task=`ccb314a1-4f52-446e-b8b9-1cb3959da164`::ref 0 aborting False >Thread-34::DEBUG::2014-07-10 10:03:08,690::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-34::DEBUG::2014-07-10 10:03:08,690::task::595::TaskManager.Task::(_updateState) Task=`d7c647ec-8289-4b5d-9b0b-0f72d343ae79`::moving from state init -> state preparing >Thread-34::INFO::2014-07-10 10:03:08,691::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-34::DEBUG::2014-07-10 10:03:08,692::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`d73084cd-9e7d-4430-ba47-81c3949afc8a`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-10 10:03:08,692::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' for lock type 'shared' >Thread-34::DEBUG::2014-07-10 10:03:08,692::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-10 10:03:08,693::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`d73084cd-9e7d-4430-ba47-81c3949afc8a`::Granted request >Thread-34::DEBUG::2014-07-10 10:03:08,694::task::827::TaskManager.Task::(resourceAcquired) Task=`d7c647ec-8289-4b5d-9b0b-0f72d343ae79`::_resourcesAcquired: Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee (shared) >Thread-34::DEBUG::2014-07-10 10:03:08,694::task::990::TaskManager.Task::(_decref) Task=`d7c647ec-8289-4b5d-9b0b-0f72d343ae79`::ref 1 aborting False >Thread-34::INFO::2014-07-10 10:03:08,696::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '531976159232', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 10:03:08,696::task::1185::TaskManager.Task::(prepare) Task=`d7c647ec-8289-4b5d-9b0b-0f72d343ae79`::finished: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '531976159232', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 10:03:08,697::task::595::TaskManager.Task::(_updateState) Task=`d7c647ec-8289-4b5d-9b0b-0f72d343ae79`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-10 10:03:08,697::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee': < ResourceRef 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-10 10:03:08,697::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-10 10:03:08,698::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' >Thread-34::DEBUG::2014-07-10 10:03:08,698::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' (0 active users) >Thread-34::DEBUG::2014-07-10 10:03:08,698::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-10 10:03:08,699::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', Clearing records. >Thread-34::DEBUG::2014-07-10 10:03:08,699::task::990::TaskManager.Task::(_decref) Task=`d7c647ec-8289-4b5d-9b0b-0f72d343ae79`::ref 0 aborting False >Thread-73::DEBUG::2014-07-10 10:03:09,806::task::595::TaskManager.Task::(_updateState) Task=`a0e0dbb8-a1c6-44e8-8ba5-7f48f0c88831`::moving from state init -> state preparing >Thread-73::INFO::2014-07-10 10:03:09,807::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='c01d693b-cba0-4fed-9ad7-0aaa28912a19', volUUID='4bb5d954-2a50-4028-b299-0b43c261270c', options=None) >Thread-54::DEBUG::2014-07-10 10:03:09,807::task::595::TaskManager.Task::(_updateState) Task=`c8bed2eb-a450-4b14-9f20-7036b6360fd3`::moving from state init -> state preparing >Thread-54::INFO::2014-07-10 10:03:09,808::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='28408446-e5fd-4565-a976-e760951593fe', volUUID='776303a2-5585-451e-826e-0e338d4a1e98', options=None) >Thread-73::INFO::2014-07-10 10:03:09,808::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-73::DEBUG::2014-07-10 10:03:09,808::task::1185::TaskManager.Task::(prepare) Task=`a0e0dbb8-a1c6-44e8-8ba5-7f48f0c88831`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-54::INFO::2014-07-10 10:03:09,809::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-73::DEBUG::2014-07-10 10:03:09,809::task::595::TaskManager.Task::(_updateState) Task=`a0e0dbb8-a1c6-44e8-8ba5-7f48f0c88831`::moving from state preparing -> state finished >Thread-54::DEBUG::2014-07-10 10:03:09,809::task::1185::TaskManager.Task::(prepare) Task=`c8bed2eb-a450-4b14-9f20-7036b6360fd3`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-73::DEBUG::2014-07-10 10:03:09,809::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-54::DEBUG::2014-07-10 10:03:09,810::task::595::TaskManager.Task::(_updateState) Task=`c8bed2eb-a450-4b14-9f20-7036b6360fd3`::moving from state preparing -> state finished >Thread-73::DEBUG::2014-07-10 10:03:09,810::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-54::DEBUG::2014-07-10 10:03:09,810::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-73::DEBUG::2014-07-10 10:03:09,810::task::990::TaskManager.Task::(_decref) Task=`a0e0dbb8-a1c6-44e8-8ba5-7f48f0c88831`::ref 0 aborting False >Thread-54::DEBUG::2014-07-10 10:03:09,810::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-54::DEBUG::2014-07-10 10:03:09,811::task::990::TaskManager.Task::(_decref) Task=`c8bed2eb-a450-4b14-9f20-7036b6360fd3`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 10:03:09,964::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 10:03:10,051::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.029746 s, 34.4 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 10:03:10,960::task::595::TaskManager.Task::(_updateState) Task=`e3c2146d-7b36-4662-8747-6f57ec200a60`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 10:03:10,961::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::INFO::2014-07-10 10:03:10,961::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000752109', 'lastCheck': '8.1', 'valid': True}, '6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000473919', 'lastCheck': '3.4', 'valid': True}} >Thread-14::DEBUG::2014-07-10 10:03:10,961::task::1185::TaskManager.Task::(prepare) Task=`e3c2146d-7b36-4662-8747-6f57ec200a60`::finished: {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000752109', 'lastCheck': '8.1', 'valid': True}, '6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000473919', 'lastCheck': '3.4', 'valid': True}} >Thread-14::DEBUG::2014-07-10 10:03:10,961::task::595::TaskManager.Task::(_updateState) Task=`e3c2146d-7b36-4662-8747-6f57ec200a60`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 10:03:10,962::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 10:03:10,962::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 10:03:10,962::task::990::TaskManager.Task::(_decref) Task=`e3c2146d-7b36-4662-8747-6f57ec200a60`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 10:03:12,067::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 10:03:12,159::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0322423 s, 31.8 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-10 10:03:12,849::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/metadata bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-10 10:03:12,870::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000741892 s, 5.5 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 10:03:14,174::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 10:03:14,271::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0355419 s, 28.8 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 10:03:16,289::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 10:03:16,374::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0267613 s, 38.3 MB/s\n'; <rc> = 0 >Thread-40::DEBUG::2014-07-10 10:03:17,518::domainMonitor::192::Storage.DomainMonitorThread::(_monitorDomain) Refreshing domain 6a70504d-00df-4869-8695-0f442053f6b6 >Thread-40::DEBUG::2014-07-10 10:03:17,561::fileSD::150::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/lion.qa.lab.tlv.redhat.com:_export_yuri2_backup2/6a70504d-00df-4869-8695-0f442053f6b6 >Thread-40::DEBUG::2014-07-10 10:03:17,564::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend >Thread-40::DEBUG::2014-07-10 10:03:17,567::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Backup', 'DESCRIPTION=test', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=0', 'POOL_UUID=4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', 'REMOTE_PATH=lion.qa.lab.tlv.redhat.com:/export/yuri2/backup2', 'ROLE=Regular', 'SDUUID=6a70504d-00df-4869-8695-0f442053f6b6', 'TYPE=NFS', 'VERSION=0', '_SHA_CKSUM=aab6b8e901ec435cd5f9de3c9e3f8b45dca569e0'] >Thread-40::DEBUG::2014-07-10 10:03:17,568::fileSD::609::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images [] >Thread-40::INFO::2014-07-10 10:03:17,569::sd::384::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 6a70504d-00df-4869-8695-0f442053f6b6_imageNS already registered >Thread-40::INFO::2014-07-10 10:03:17,569::sd::392::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 6a70504d-00df-4869-8695-0f442053f6b6_volumeNS already registered >Thread-40::DEBUG::2014-07-10 10:03:17,594::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lion.qa.lab.tlv.redhat.com:_export_yuri2_backup2/6a70504d-00df-4869-8695-0f442053f6b6/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-40::DEBUG::2014-07-10 10:03:17,615::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n369 bytes (369 B) copied, 0.000423278 s, 872 kB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 10:03:18,388::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 10:03:18,482::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0354282 s, 28.9 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 10:03:18,732::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-14::DEBUG::2014-07-10 10:03:18,733::task::595::TaskManager.Task::(_updateState) Task=`9a5d70c8-4944-4912-ba1c-5f0ca13f5cd0`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 10:03:18,733::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-14::INFO::2014-07-10 10:03:18,734::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 10:03:18,734::task::1185::TaskManager.Task::(prepare) Task=`9a5d70c8-4944-4912-ba1c-5f0ca13f5cd0`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 10:03:18,734::task::595::TaskManager.Task::(_updateState) Task=`9a5d70c8-4944-4912-ba1c-5f0ca13f5cd0`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 10:03:18,735::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 10:03:18,735::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 10:03:18,735::task::990::TaskManager.Task::(_decref) Task=`9a5d70c8-4944-4912-ba1c-5f0ca13f5cd0`::ref 0 aborting False >Thread-34::DEBUG::2014-07-10 10:03:18,739::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-34::DEBUG::2014-07-10 10:03:18,740::task::595::TaskManager.Task::(_updateState) Task=`8a2720fd-02a8-42f8-930d-0089908a3743`::moving from state init -> state preparing >Thread-34::INFO::2014-07-10 10:03:18,740::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-34::DEBUG::2014-07-10 10:03:18,741::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`e3c303f7-678c-4451-af29-3ad4283b03e6`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-10 10:03:18,741::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' for lock type 'shared' >Thread-34::DEBUG::2014-07-10 10:03:18,741::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-10 10:03:18,741::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`e3c303f7-678c-4451-af29-3ad4283b03e6`::Granted request >Thread-34::DEBUG::2014-07-10 10:03:18,742::task::827::TaskManager.Task::(resourceAcquired) Task=`8a2720fd-02a8-42f8-930d-0089908a3743`::_resourcesAcquired: Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee (shared) >Thread-34::DEBUG::2014-07-10 10:03:18,742::task::990::TaskManager.Task::(_decref) Task=`8a2720fd-02a8-42f8-930d-0089908a3743`::ref 1 aborting False >Thread-34::INFO::2014-07-10 10:03:18,743::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '531976159232', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 10:03:18,743::task::1185::TaskManager.Task::(prepare) Task=`8a2720fd-02a8-42f8-930d-0089908a3743`::finished: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '531976159232', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 10:03:18,743::task::595::TaskManager.Task::(_updateState) Task=`8a2720fd-02a8-42f8-930d-0089908a3743`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-10 10:03:18,743::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee': < ResourceRef 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-10 10:03:18,744::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-10 10:03:18,744::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' >Thread-34::DEBUG::2014-07-10 10:03:18,744::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' (0 active users) >Thread-34::DEBUG::2014-07-10 10:03:18,744::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-10 10:03:18,744::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', Clearing records. >Thread-34::DEBUG::2014-07-10 10:03:18,745::task::990::TaskManager.Task::(_decref) Task=`8a2720fd-02a8-42f8-930d-0089908a3743`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 10:03:20,510::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 10:03:20,599::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0292295 s, 35.0 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 10:03:22,615::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 10:03:22,710::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0376496 s, 27.2 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-10 10:03:22,903::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/metadata bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-10 10:03:22,924::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000617523 s, 6.6 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 10:03:24,725::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 10:03:24,812::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0292498 s, 35.0 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 10:03:26,150::task::595::TaskManager.Task::(_updateState) Task=`026b42f6-298d-4098-83b0-a6f161be772a`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 10:03:26,151::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::INFO::2014-07-10 10:03:26,151::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000617523', 'lastCheck': '3.2', 'valid': True}, '6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000423278', 'lastCheck': '8.5', 'valid': True}} >Thread-14::DEBUG::2014-07-10 10:03:26,151::task::1185::TaskManager.Task::(prepare) Task=`026b42f6-298d-4098-83b0-a6f161be772a`::finished: {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000617523', 'lastCheck': '3.2', 'valid': True}, '6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000423278', 'lastCheck': '8.5', 'valid': True}} >Thread-14::DEBUG::2014-07-10 10:03:26,151::task::595::TaskManager.Task::(_updateState) Task=`026b42f6-298d-4098-83b0-a6f161be772a`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 10:03:26,152::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 10:03:26,152::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 10:03:26,152::task::990::TaskManager.Task::(_decref) Task=`026b42f6-298d-4098-83b0-a6f161be772a`::ref 0 aborting False >Thread-57::DEBUG::2014-07-10 10:03:26,551::task::595::TaskManager.Task::(_updateState) Task=`67ed9f2b-6ce8-486c-9214-301b3ec4bccf`::moving from state init -> state preparing >Thread-57::INFO::2014-07-10 10:03:26,552::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='b6f6c0da-e67f-4902-b9ac-3069571a42fe', volUUID='c4cd1da8-05b7-45e0-80b1-1183d21443d9', options=None) >Thread-57::INFO::2014-07-10 10:03:26,554::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-57::DEBUG::2014-07-10 10:03:26,555::task::1185::TaskManager.Task::(prepare) Task=`67ed9f2b-6ce8-486c-9214-301b3ec4bccf`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-57::DEBUG::2014-07-10 10:03:26,556::task::595::TaskManager.Task::(_updateState) Task=`67ed9f2b-6ce8-486c-9214-301b3ec4bccf`::moving from state preparing -> state finished >Thread-57::DEBUG::2014-07-10 10:03:26,558::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-57::DEBUG::2014-07-10 10:03:26,558::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-57::DEBUG::2014-07-10 10:03:26,560::task::990::TaskManager.Task::(_decref) Task=`67ed9f2b-6ce8-486c-9214-301b3ec4bccf`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 10:03:26,827::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 10:03:26,921::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0356461 s, 28.7 MB/s\n'; <rc> = 0 >Thread-67::DEBUG::2014-07-10 10:03:27,415::task::595::TaskManager.Task::(_updateState) Task=`ac543a8c-7cee-4053-90f4-5b0242a7b9a9`::moving from state init -> state preparing >Thread-67::INFO::2014-07-10 10:03:27,416::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='f30c2cb7-a43a-4bf5-82b5-cfe07336f65c', volUUID='b0fbb3c9-55af-4a3a-95ad-fc56a80b9cf5', options=None) >Thread-67::INFO::2014-07-10 10:03:27,416::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-67::DEBUG::2014-07-10 10:03:27,417::task::1185::TaskManager.Task::(prepare) Task=`ac543a8c-7cee-4053-90f4-5b0242a7b9a9`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-67::DEBUG::2014-07-10 10:03:27,417::task::595::TaskManager.Task::(_updateState) Task=`ac543a8c-7cee-4053-90f4-5b0242a7b9a9`::moving from state preparing -> state finished >Thread-67::DEBUG::2014-07-10 10:03:27,417::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-67::DEBUG::2014-07-10 10:03:27,417::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-67::DEBUG::2014-07-10 10:03:27,417::task::990::TaskManager.Task::(_decref) Task=`ac543a8c-7cee-4053-90f4-5b0242a7b9a9`::ref 0 aborting False >Thread-48::DEBUG::2014-07-10 10:03:27,583::task::595::TaskManager.Task::(_updateState) Task=`18f7746e-9021-4800-8c87-ae308ce467cb`::moving from state init -> state preparing >Thread-48::INFO::2014-07-10 10:03:27,583::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='0cd7d6ce-f497-4243-a690-c57744861eea', volUUID='10b6a7dd-dc6c-43fa-ba17-92e4331b0e0b', options=None) >Thread-48::INFO::2014-07-10 10:03:27,584::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-48::DEBUG::2014-07-10 10:03:27,584::task::1185::TaskManager.Task::(prepare) Task=`18f7746e-9021-4800-8c87-ae308ce467cb`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-48::DEBUG::2014-07-10 10:03:27,584::task::595::TaskManager.Task::(_updateState) Task=`18f7746e-9021-4800-8c87-ae308ce467cb`::moving from state preparing -> state finished >Thread-48::DEBUG::2014-07-10 10:03:27,584::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-48::DEBUG::2014-07-10 10:03:27,584::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-48::DEBUG::2014-07-10 10:03:27,585::task::990::TaskManager.Task::(_decref) Task=`18f7746e-9021-4800-8c87-ae308ce467cb`::ref 0 aborting False >Thread-40::DEBUG::2014-07-10 10:03:27,641::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lion.qa.lab.tlv.redhat.com:_export_yuri2_backup2/6a70504d-00df-4869-8695-0f442053f6b6/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-40::DEBUG::2014-07-10 10:03:27,661::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n369 bytes (369 B) copied, 0.00049125 s, 751 kB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 10:03:28,774::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-14::DEBUG::2014-07-10 10:03:28,775::task::595::TaskManager.Task::(_updateState) Task=`0531fa7d-f262-4350-a6fa-00ed74446e81`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 10:03:28,776::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-14::INFO::2014-07-10 10:03:28,776::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 10:03:28,777::task::1185::TaskManager.Task::(prepare) Task=`0531fa7d-f262-4350-a6fa-00ed74446e81`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 10:03:28,777::task::595::TaskManager.Task::(_updateState) Task=`0531fa7d-f262-4350-a6fa-00ed74446e81`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 10:03:28,777::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 10:03:28,778::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 10:03:28,778::task::990::TaskManager.Task::(_decref) Task=`0531fa7d-f262-4350-a6fa-00ed74446e81`::ref 0 aborting False >Thread-34::DEBUG::2014-07-10 10:03:28,823::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-34::DEBUG::2014-07-10 10:03:28,824::task::595::TaskManager.Task::(_updateState) Task=`d45f357e-022b-4595-b62d-da9bbc5255b4`::moving from state init -> state preparing >Thread-34::INFO::2014-07-10 10:03:28,824::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-34::DEBUG::2014-07-10 10:03:28,825::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`ef171791-02c8-4360-8a48-55fef7330b8c`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-10 10:03:28,825::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' for lock type 'shared' >Thread-34::DEBUG::2014-07-10 10:03:28,826::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-10 10:03:28,826::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`ef171791-02c8-4360-8a48-55fef7330b8c`::Granted request >Thread-34::DEBUG::2014-07-10 10:03:28,826::task::827::TaskManager.Task::(resourceAcquired) Task=`d45f357e-022b-4595-b62d-da9bbc5255b4`::_resourcesAcquired: Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee (shared) >Thread-34::DEBUG::2014-07-10 10:03:28,827::task::990::TaskManager.Task::(_decref) Task=`d45f357e-022b-4595-b62d-da9bbc5255b4`::ref 1 aborting False >Thread-34::INFO::2014-07-10 10:03:28,828::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '531976159232', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 10:03:28,828::task::1185::TaskManager.Task::(prepare) Task=`d45f357e-022b-4595-b62d-da9bbc5255b4`::finished: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '531976159232', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 10:03:28,828::task::595::TaskManager.Task::(_updateState) Task=`d45f357e-022b-4595-b62d-da9bbc5255b4`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-10 10:03:28,828::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee': < ResourceRef 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-10 10:03:28,829::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-10 10:03:28,829::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' >Thread-34::DEBUG::2014-07-10 10:03:28,829::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' (0 active users) >Thread-34::DEBUG::2014-07-10 10:03:28,829::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-10 10:03:28,830::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', Clearing records. >Thread-34::DEBUG::2014-07-10 10:03:28,830::task::990::TaskManager.Task::(_decref) Task=`d45f357e-022b-4595-b62d-da9bbc5255b4`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 10:03:28,936::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 10:03:29,032::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0373589 s, 27.4 MB/s\n'; <rc> = 0 >Thread-76::DEBUG::2014-07-10 10:03:29,420::task::595::TaskManager.Task::(_updateState) Task=`64a52e63-5874-4550-9cdd-52c627a86f23`::moving from state init -> state preparing >Thread-76::INFO::2014-07-10 10:03:29,421::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='e4c65229-4247-4b33-b72a-f1d5ce72ad05', volUUID='cad94284-3ca9-4c30-933d-997f4460309e', options=None) >Thread-76::INFO::2014-07-10 10:03:29,421::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-76::DEBUG::2014-07-10 10:03:29,421::task::1185::TaskManager.Task::(prepare) Task=`64a52e63-5874-4550-9cdd-52c627a86f23`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-76::DEBUG::2014-07-10 10:03:29,422::task::595::TaskManager.Task::(_updateState) Task=`64a52e63-5874-4550-9cdd-52c627a86f23`::moving from state preparing -> state finished >Thread-76::DEBUG::2014-07-10 10:03:29,422::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-76::DEBUG::2014-07-10 10:03:29,422::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-76::DEBUG::2014-07-10 10:03:29,422::task::990::TaskManager.Task::(_decref) Task=`64a52e63-5874-4550-9cdd-52c627a86f23`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 10:03:31,047::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 10:03:31,134::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.030707 s, 33.3 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-10 10:03:32,953::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/metadata bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-10 10:03:32,974::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000898232 s, 4.6 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 10:03:33,150::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 10:03:33,240::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0312241 s, 32.8 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 10:03:35,255::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 10:03:35,360::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0311852 s, 32.8 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 10:03:37,375::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 10:03:37,462::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0277589 s, 36.9 MB/s\n'; <rc> = 0 >Thread-40::DEBUG::2014-07-10 10:03:37,699::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lion.qa.lab.tlv.redhat.com:_export_yuri2_backup2/6a70504d-00df-4869-8695-0f442053f6b6/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-40::DEBUG::2014-07-10 10:03:37,720::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n369 bytes (369 B) copied, 0.000408144 s, 904 kB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 10:03:38,974::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-14::DEBUG::2014-07-10 10:03:38,975::task::595::TaskManager.Task::(_updateState) Task=`dee8d29b-8e70-4ae5-b82a-bbe472b20a18`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 10:03:38,976::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-14::INFO::2014-07-10 10:03:38,976::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 10:03:38,977::task::1185::TaskManager.Task::(prepare) Task=`dee8d29b-8e70-4ae5-b82a-bbe472b20a18`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 10:03:38,977::task::595::TaskManager.Task::(_updateState) Task=`dee8d29b-8e70-4ae5-b82a-bbe472b20a18`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 10:03:38,977::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 10:03:38,977::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 10:03:38,977::task::990::TaskManager.Task::(_decref) Task=`dee8d29b-8e70-4ae5-b82a-bbe472b20a18`::ref 0 aborting False >Thread-34::DEBUG::2014-07-10 10:03:38,982::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-34::DEBUG::2014-07-10 10:03:38,982::task::595::TaskManager.Task::(_updateState) Task=`5c8d9c52-48d9-4cf1-b5cc-dfef472fb081`::moving from state init -> state preparing >Thread-34::INFO::2014-07-10 10:03:38,982::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-34::DEBUG::2014-07-10 10:03:38,983::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`b37d2472-9e17-433c-a906-b97259a92029`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-10 10:03:38,983::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' for lock type 'shared' >Thread-34::DEBUG::2014-07-10 10:03:38,984::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-10 10:03:38,984::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`b37d2472-9e17-433c-a906-b97259a92029`::Granted request >Thread-34::DEBUG::2014-07-10 10:03:38,984::task::827::TaskManager.Task::(resourceAcquired) Task=`5c8d9c52-48d9-4cf1-b5cc-dfef472fb081`::_resourcesAcquired: Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee (shared) >Thread-34::DEBUG::2014-07-10 10:03:38,985::task::990::TaskManager.Task::(_decref) Task=`5c8d9c52-48d9-4cf1-b5cc-dfef472fb081`::ref 1 aborting False >Thread-34::INFO::2014-07-10 10:03:38,986::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '531976159232', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 10:03:38,986::task::1185::TaskManager.Task::(prepare) Task=`5c8d9c52-48d9-4cf1-b5cc-dfef472fb081`::finished: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '531976159232', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 10:03:38,986::task::595::TaskManager.Task::(_updateState) Task=`5c8d9c52-48d9-4cf1-b5cc-dfef472fb081`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-10 10:03:38,986::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee': < ResourceRef 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-10 10:03:38,987::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-10 10:03:38,987::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' >Thread-34::DEBUG::2014-07-10 10:03:38,987::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' (0 active users) >Thread-34::DEBUG::2014-07-10 10:03:38,987::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-10 10:03:38,987::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', Clearing records. >Thread-34::DEBUG::2014-07-10 10:03:38,988::task::990::TaskManager.Task::(_decref) Task=`5c8d9c52-48d9-4cf1-b5cc-dfef472fb081`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 10:03:39,477::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 10:03:39,619::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0394868 s, 25.9 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 10:03:41,347::task::595::TaskManager.Task::(_updateState) Task=`54ac7642-160e-4810-a3fc-97cfb5d10dc4`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 10:03:41,348::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::INFO::2014-07-10 10:03:41,348::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000898232', 'lastCheck': '8.3', 'valid': True}, '6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000408144', 'lastCheck': '3.6', 'valid': True}} >Thread-14::DEBUG::2014-07-10 10:03:41,348::task::1185::TaskManager.Task::(prepare) Task=`54ac7642-160e-4810-a3fc-97cfb5d10dc4`::finished: {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000898232', 'lastCheck': '8.3', 'valid': True}, '6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000408144', 'lastCheck': '3.6', 'valid': True}} >Thread-14::DEBUG::2014-07-10 10:03:41,349::task::595::TaskManager.Task::(_updateState) Task=`54ac7642-160e-4810-a3fc-97cfb5d10dc4`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 10:03:41,349::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 10:03:41,349::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 10:03:41,349::task::990::TaskManager.Task::(_decref) Task=`54ac7642-160e-4810-a3fc-97cfb5d10dc4`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 10:03:41,634::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 10:03:41,734::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0409717 s, 25.0 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-10 10:03:43,004::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/metadata bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-10 10:03:43,025::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000826792 s, 5.0 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 10:03:43,749::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 10:03:43,842::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0368342 s, 27.8 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 10:03:45,857::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 10:03:46,046::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.126609 s, 8.1 MB/s\n'; <rc> = 0 >Thread-70::DEBUG::2014-07-10 10:03:46,269::task::595::TaskManager.Task::(_updateState) Task=`e1c62936-5eaa-4c8d-8090-fccba927b55e`::moving from state init -> state preparing >Thread-70::INFO::2014-07-10 10:03:46,270::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='cfaeead2-7caa-467c-b389-c89840ae6605', volUUID='567fe32d-31a6-4ff6-90f3-fd6a656fbecc', options=None) >Thread-70::INFO::2014-07-10 10:03:46,271::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-70::DEBUG::2014-07-10 10:03:46,271::task::1185::TaskManager.Task::(prepare) Task=`e1c62936-5eaa-4c8d-8090-fccba927b55e`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-70::DEBUG::2014-07-10 10:03:46,271::task::595::TaskManager.Task::(_updateState) Task=`e1c62936-5eaa-4c8d-8090-fccba927b55e`::moving from state preparing -> state finished >Thread-70::DEBUG::2014-07-10 10:03:46,271::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-70::DEBUG::2014-07-10 10:03:46,271::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-70::DEBUG::2014-07-10 10:03:46,272::task::990::TaskManager.Task::(_decref) Task=`e1c62936-5eaa-4c8d-8090-fccba927b55e`::ref 0 aborting False >Thread-40::DEBUG::2014-07-10 10:03:47,755::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lion.qa.lab.tlv.redhat.com:_export_yuri2_backup2/6a70504d-00df-4869-8695-0f442053f6b6/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-40::DEBUG::2014-07-10 10:03:47,775::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n369 bytes (369 B) copied, 0.00051064 s, 723 kB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 10:03:48,062::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 10:03:48,171::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0352292 s, 29.1 MB/s\n'; <rc> = 0 >Thread-51::DEBUG::2014-07-10 10:03:48,425::task::595::TaskManager.Task::(_updateState) Task=`d1ece16e-b2ed-4699-91c6-2714eb1ad629`::moving from state init -> state preparing >Thread-60::DEBUG::2014-07-10 10:03:48,427::task::595::TaskManager.Task::(_updateState) Task=`58e25b26-eeb6-453d-a0e4-50607775c770`::moving from state init -> state preparing >Thread-51::INFO::2014-07-10 10:03:48,427::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='76fdb054-02cd-42ed-9721-b3e65b34c3a4', volUUID='022dfe46-2cf7-4915-80b3-883158e3ca83', options=None) >Thread-60::INFO::2014-07-10 10:03:48,428::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='b034d5b0-e1e0-4011-b49b-4d45ddb11556', volUUID='3d7f62b5-328f-4d8e-8b69-873cfb5ae14d', options=None) >Thread-51::INFO::2014-07-10 10:03:48,429::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-60::INFO::2014-07-10 10:03:48,430::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-51::DEBUG::2014-07-10 10:03:48,430::task::1185::TaskManager.Task::(prepare) Task=`d1ece16e-b2ed-4699-91c6-2714eb1ad629`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-60::DEBUG::2014-07-10 10:03:48,431::task::1185::TaskManager.Task::(prepare) Task=`58e25b26-eeb6-453d-a0e4-50607775c770`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-51::DEBUG::2014-07-10 10:03:48,432::task::595::TaskManager.Task::(_updateState) Task=`d1ece16e-b2ed-4699-91c6-2714eb1ad629`::moving from state preparing -> state finished >Thread-60::DEBUG::2014-07-10 10:03:48,433::task::595::TaskManager.Task::(_updateState) Task=`58e25b26-eeb6-453d-a0e4-50607775c770`::moving from state preparing -> state finished >Thread-51::DEBUG::2014-07-10 10:03:48,433::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-60::DEBUG::2014-07-10 10:03:48,434::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-51::DEBUG::2014-07-10 10:03:48,434::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-60::DEBUG::2014-07-10 10:03:48,435::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-51::DEBUG::2014-07-10 10:03:48,436::task::990::TaskManager.Task::(_decref) Task=`d1ece16e-b2ed-4699-91c6-2714eb1ad629`::ref 0 aborting False >Thread-60::DEBUG::2014-07-10 10:03:48,437::task::990::TaskManager.Task::(_decref) Task=`58e25b26-eeb6-453d-a0e4-50607775c770`::ref 0 aborting False >Thread-14::DEBUG::2014-07-10 10:03:49,016::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-14::DEBUG::2014-07-10 10:03:49,017::task::595::TaskManager.Task::(_updateState) Task=`c0a8e22a-5418-4590-9e76-027746e61bd3`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 10:03:49,017::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-14::INFO::2014-07-10 10:03:49,018::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 10:03:49,018::task::1185::TaskManager.Task::(prepare) Task=`c0a8e22a-5418-4590-9e76-027746e61bd3`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 10:03:49,018::task::595::TaskManager.Task::(_updateState) Task=`c0a8e22a-5418-4590-9e76-027746e61bd3`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 10:03:49,018::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 10:03:49,018::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 10:03:49,019::task::990::TaskManager.Task::(_decref) Task=`c0a8e22a-5418-4590-9e76-027746e61bd3`::ref 0 aborting False >Thread-34::DEBUG::2014-07-10 10:03:49,023::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-34::DEBUG::2014-07-10 10:03:49,023::task::595::TaskManager.Task::(_updateState) Task=`97e25c32-a7d1-4d4c-b4c1-900f3798d800`::moving from state init -> state preparing >Thread-34::INFO::2014-07-10 10:03:49,023::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-34::DEBUG::2014-07-10 10:03:49,024::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`534bbdb6-e1c2-4828-aba7-517904b2cbc3`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-10 10:03:49,024::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' for lock type 'shared' >Thread-34::DEBUG::2014-07-10 10:03:49,025::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-10 10:03:49,025::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`534bbdb6-e1c2-4828-aba7-517904b2cbc3`::Granted request >Thread-34::DEBUG::2014-07-10 10:03:49,025::task::827::TaskManager.Task::(resourceAcquired) Task=`97e25c32-a7d1-4d4c-b4c1-900f3798d800`::_resourcesAcquired: Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee (shared) >Thread-34::DEBUG::2014-07-10 10:03:49,025::task::990::TaskManager.Task::(_decref) Task=`97e25c32-a7d1-4d4c-b4c1-900f3798d800`::ref 1 aborting False >Thread-34::INFO::2014-07-10 10:03:49,026::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '531976159232', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 10:03:49,027::task::1185::TaskManager.Task::(prepare) Task=`97e25c32-a7d1-4d4c-b4c1-900f3798d800`::finished: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '531976159232', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 10:03:49,027::task::595::TaskManager.Task::(_updateState) Task=`97e25c32-a7d1-4d4c-b4c1-900f3798d800`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-10 10:03:49,027::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee': < ResourceRef 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-10 10:03:49,027::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-10 10:03:49,028::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' >Thread-34::DEBUG::2014-07-10 10:03:49,028::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' (0 active users) >Thread-34::DEBUG::2014-07-10 10:03:49,028::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-10 10:03:49,028::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', Clearing records. >Thread-34::DEBUG::2014-07-10 10:03:49,028::task::990::TaskManager.Task::(_decref) Task=`97e25c32-a7d1-4d4c-b4c1-900f3798d800`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 10:03:50,186::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 10:03:50,276::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0322557 s, 31.7 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 10:03:52,291::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 10:03:52,383::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0297583 s, 34.4 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-10 10:03:53,055::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/metadata bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-10 10:03:53,094::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000727331 s, 5.6 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 10:03:54,398::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 10:03:54,491::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0355633 s, 28.8 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 10:03:56,507::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Thread-14::DEBUG::2014-07-10 10:03:56,537::task::595::TaskManager.Task::(_updateState) Task=`edec184e-d3b8-44c1-a2cd-2bd765fa2150`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 10:03:56,538::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::INFO::2014-07-10 10:03:56,539::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000727331', 'lastCheck': '3.4', 'valid': True}, '6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00051064', 'lastCheck': '8.8', 'valid': True}} >Thread-14::DEBUG::2014-07-10 10:03:56,540::task::1185::TaskManager.Task::(prepare) Task=`edec184e-d3b8-44c1-a2cd-2bd765fa2150`::finished: {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000727331', 'lastCheck': '3.4', 'valid': True}, '6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00051064', 'lastCheck': '8.8', 'valid': True}} >Thread-14::DEBUG::2014-07-10 10:03:56,540::task::595::TaskManager.Task::(_updateState) Task=`edec184e-d3b8-44c1-a2cd-2bd765fa2150`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 10:03:56,541::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 10:03:56,541::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 10:03:56,542::task::990::TaskManager.Task::(_decref) Task=`edec184e-d3b8-44c1-a2cd-2bd765fa2150`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 10:03:56,648::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0717287 s, 14.3 MB/s\n'; <rc> = 0 >Thread-40::DEBUG::2014-07-10 10:03:57,813::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lion.qa.lab.tlv.redhat.com:_export_yuri2_backup2/6a70504d-00df-4869-8695-0f442053f6b6/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-40::DEBUG::2014-07-10 10:03:57,837::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n369 bytes (369 B) copied, 0.000392964 s, 939 kB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 10:03:58,664::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 10:03:58,761::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0356252 s, 28.7 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 10:03:59,071::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-14::DEBUG::2014-07-10 10:03:59,072::task::595::TaskManager.Task::(_updateState) Task=`fa8720e7-086d-4b44-97e7-93c6ec79a22b`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 10:03:59,073::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-14::INFO::2014-07-10 10:03:59,073::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 10:03:59,073::task::1185::TaskManager.Task::(prepare) Task=`fa8720e7-086d-4b44-97e7-93c6ec79a22b`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 10:03:59,074::task::595::TaskManager.Task::(_updateState) Task=`fa8720e7-086d-4b44-97e7-93c6ec79a22b`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 10:03:59,074::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 10:03:59,074::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 10:03:59,074::task::990::TaskManager.Task::(_decref) Task=`fa8720e7-086d-4b44-97e7-93c6ec79a22b`::ref 0 aborting False >Thread-34::DEBUG::2014-07-10 10:03:59,118::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-34::DEBUG::2014-07-10 10:03:59,118::task::595::TaskManager.Task::(_updateState) Task=`0d1807d5-70a5-4e43-a198-ef5bfcfd81f8`::moving from state init -> state preparing >Thread-34::INFO::2014-07-10 10:03:59,119::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-34::DEBUG::2014-07-10 10:03:59,119::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`20750943-a45f-438f-9e29-d59dbd3f6d56`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-10 10:03:59,120::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' for lock type 'shared' >Thread-34::DEBUG::2014-07-10 10:03:59,120::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-10 10:03:59,120::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`20750943-a45f-438f-9e29-d59dbd3f6d56`::Granted request >Thread-34::DEBUG::2014-07-10 10:03:59,121::task::827::TaskManager.Task::(resourceAcquired) Task=`0d1807d5-70a5-4e43-a198-ef5bfcfd81f8`::_resourcesAcquired: Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee (shared) >Thread-34::DEBUG::2014-07-10 10:03:59,121::task::990::TaskManager.Task::(_decref) Task=`0d1807d5-70a5-4e43-a198-ef5bfcfd81f8`::ref 1 aborting False >Thread-34::INFO::2014-07-10 10:03:59,122::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '531976159232', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 10:03:59,122::task::1185::TaskManager.Task::(prepare) Task=`0d1807d5-70a5-4e43-a198-ef5bfcfd81f8`::finished: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '531976159232', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 10:03:59,123::task::595::TaskManager.Task::(_updateState) Task=`0d1807d5-70a5-4e43-a198-ef5bfcfd81f8`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-10 10:03:59,123::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee': < ResourceRef 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-10 10:03:59,123::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-10 10:03:59,123::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' >Thread-34::DEBUG::2014-07-10 10:03:59,124::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' (0 active users) >Thread-34::DEBUG::2014-07-10 10:03:59,124::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-10 10:03:59,124::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', Clearing records. >Thread-34::DEBUG::2014-07-10 10:03:59,124::task::990::TaskManager.Task::(_decref) Task=`0d1807d5-70a5-4e43-a198-ef5bfcfd81f8`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 10:04:00,782::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 10:04:00,907::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.029671 s, 34.5 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 10:04:02,958::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 10:04:03,050::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0356221 s, 28.7 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-10 10:04:03,126::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/metadata bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-10 10:04:03,164::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000709367 s, 5.8 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 10:04:05,066::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 10:04:05,176::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0496111 s, 20.6 MB/s\n'; <rc> = 0 >Thread-64::DEBUG::2014-07-10 10:04:06,408::task::595::TaskManager.Task::(_updateState) Task=`940973b0-e29b-48cb-820d-f22651409b82`::moving from state init -> state preparing >Thread-64::INFO::2014-07-10 10:04:06,409::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='aa20346a-4d3a-4e07-b8e1-52c0ebe4168c', volUUID='58fefce2-9bce-4bff-8949-8c6ce8122b27', options=None) >Thread-64::INFO::2014-07-10 10:04:06,410::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-64::DEBUG::2014-07-10 10:04:06,410::task::1185::TaskManager.Task::(prepare) Task=`940973b0-e29b-48cb-820d-f22651409b82`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-64::DEBUG::2014-07-10 10:04:06,410::task::595::TaskManager.Task::(_updateState) Task=`940973b0-e29b-48cb-820d-f22651409b82`::moving from state preparing -> state finished >Thread-64::DEBUG::2014-07-10 10:04:06,410::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-64::DEBUG::2014-07-10 10:04:06,410::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-64::DEBUG::2014-07-10 10:04:06,411::task::990::TaskManager.Task::(_decref) Task=`940973b0-e29b-48cb-820d-f22651409b82`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 10:04:07,191::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 10:04:07,273::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0254426 s, 40.2 MB/s\n'; <rc> = 0 >Thread-40::DEBUG::2014-07-10 10:04:07,873::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lion.qa.lab.tlv.redhat.com:_export_yuri2_backup2/6a70504d-00df-4869-8695-0f442053f6b6/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-40::DEBUG::2014-07-10 10:04:07,897::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n369 bytes (369 B) copied, 0.000572975 s, 644 kB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 10:04:09,150::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-14::DEBUG::2014-07-10 10:04:09,151::task::595::TaskManager.Task::(_updateState) Task=`b380f41f-a907-4a6d-93c6-0b532e07a34a`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 10:04:09,152::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-14::INFO::2014-07-10 10:04:09,152::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 10:04:09,152::task::1185::TaskManager.Task::(prepare) Task=`b380f41f-a907-4a6d-93c6-0b532e07a34a`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 10:04:09,153::task::595::TaskManager.Task::(_updateState) Task=`b380f41f-a907-4a6d-93c6-0b532e07a34a`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 10:04:09,153::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 10:04:09,153::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 10:04:09,153::task::990::TaskManager.Task::(_decref) Task=`b380f41f-a907-4a6d-93c6-0b532e07a34a`::ref 0 aborting False >Thread-34::DEBUG::2014-07-10 10:04:09,157::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-34::DEBUG::2014-07-10 10:04:09,158::task::595::TaskManager.Task::(_updateState) Task=`ef167a33-5fab-41ab-a299-3131d415fee0`::moving from state init -> state preparing >Thread-34::INFO::2014-07-10 10:04:09,158::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-34::DEBUG::2014-07-10 10:04:09,159::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`2878a636-a248-4bc7-b8f3-bb85d05c386d`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-10 10:04:09,159::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' for lock type 'shared' >Thread-34::DEBUG::2014-07-10 10:04:09,159::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-10 10:04:09,160::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`2878a636-a248-4bc7-b8f3-bb85d05c386d`::Granted request >Thread-34::DEBUG::2014-07-10 10:04:09,160::task::827::TaskManager.Task::(resourceAcquired) Task=`ef167a33-5fab-41ab-a299-3131d415fee0`::_resourcesAcquired: Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee (shared) >Thread-34::DEBUG::2014-07-10 10:04:09,160::task::990::TaskManager.Task::(_decref) Task=`ef167a33-5fab-41ab-a299-3131d415fee0`::ref 1 aborting False >Thread-34::INFO::2014-07-10 10:04:09,161::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '531976159232', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 10:04:09,162::task::1185::TaskManager.Task::(prepare) Task=`ef167a33-5fab-41ab-a299-3131d415fee0`::finished: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '531976159232', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 10:04:09,162::task::595::TaskManager.Task::(_updateState) Task=`ef167a33-5fab-41ab-a299-3131d415fee0`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-10 10:04:09,162::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee': < ResourceRef 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-10 10:04:09,162::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-10 10:04:09,163::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' >Thread-34::DEBUG::2014-07-10 10:04:09,163::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' (0 active users) >Thread-34::DEBUG::2014-07-10 10:04:09,163::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-10 10:04:09,163::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', Clearing records. >Thread-34::DEBUG::2014-07-10 10:04:09,163::task::990::TaskManager.Task::(_decref) Task=`ef167a33-5fab-41ab-a299-3131d415fee0`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 10:04:09,289::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 10:04:09,381::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0334472 s, 30.6 MB/s\n'; <rc> = 0 >Thread-54::DEBUG::2014-07-10 10:04:10,137::task::595::TaskManager.Task::(_updateState) Task=`64eb1dba-8811-4136-8991-eeb3955c4b23`::moving from state init -> state preparing >Thread-54::INFO::2014-07-10 10:04:10,138::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='28408446-e5fd-4565-a976-e760951593fe', volUUID='776303a2-5585-451e-826e-0e338d4a1e98', options=None) >Thread-54::INFO::2014-07-10 10:04:10,138::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-54::DEBUG::2014-07-10 10:04:10,138::task::1185::TaskManager.Task::(prepare) Task=`64eb1dba-8811-4136-8991-eeb3955c4b23`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-54::DEBUG::2014-07-10 10:04:10,138::task::595::TaskManager.Task::(_updateState) Task=`64eb1dba-8811-4136-8991-eeb3955c4b23`::moving from state preparing -> state finished >Thread-54::DEBUG::2014-07-10 10:04:10,138::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-54::DEBUG::2014-07-10 10:04:10,139::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-54::DEBUG::2014-07-10 10:04:10,139::task::990::TaskManager.Task::(_decref) Task=`64eb1dba-8811-4136-8991-eeb3955c4b23`::ref 0 aborting False >Thread-73::DEBUG::2014-07-10 10:04:10,140::task::595::TaskManager.Task::(_updateState) Task=`3e08c50a-38de-4c81-b3b2-9a37a3040490`::moving from state init -> state preparing >Thread-73::INFO::2014-07-10 10:04:10,140::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='c01d693b-cba0-4fed-9ad7-0aaa28912a19', volUUID='4bb5d954-2a50-4028-b299-0b43c261270c', options=None) >Thread-73::INFO::2014-07-10 10:04:10,141::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-73::DEBUG::2014-07-10 10:04:10,141::task::1185::TaskManager.Task::(prepare) Task=`3e08c50a-38de-4c81-b3b2-9a37a3040490`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-73::DEBUG::2014-07-10 10:04:10,141::task::595::TaskManager.Task::(_updateState) Task=`3e08c50a-38de-4c81-b3b2-9a37a3040490`::moving from state preparing -> state finished >Thread-73::DEBUG::2014-07-10 10:04:10,141::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-73::DEBUG::2014-07-10 10:04:10,141::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-73::DEBUG::2014-07-10 10:04:10,141::task::990::TaskManager.Task::(_decref) Task=`3e08c50a-38de-4c81-b3b2-9a37a3040490`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 10:04:11,397::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 10:04:11,483::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0300358 s, 34.1 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 10:04:11,792::task::595::TaskManager.Task::(_updateState) Task=`34a7a153-9d02-4762-810d-d2d8ef25fbfa`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 10:04:11,793::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::INFO::2014-07-10 10:04:11,793::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000709367', 'lastCheck': '8.6', 'valid': True}, '6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000572975', 'lastCheck': '3.9', 'valid': True}} >Thread-14::DEBUG::2014-07-10 10:04:11,793::task::1185::TaskManager.Task::(prepare) Task=`34a7a153-9d02-4762-810d-d2d8ef25fbfa`::finished: {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000709367', 'lastCheck': '8.6', 'valid': True}, '6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000572975', 'lastCheck': '3.9', 'valid': True}} >Thread-14::DEBUG::2014-07-10 10:04:11,794::task::595::TaskManager.Task::(_updateState) Task=`34a7a153-9d02-4762-810d-d2d8ef25fbfa`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 10:04:11,794::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 10:04:11,794::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 10:04:11,794::task::990::TaskManager.Task::(_decref) Task=`34a7a153-9d02-4762-810d-d2d8ef25fbfa`::ref 0 aborting False >Thread-18::DEBUG::2014-07-10 10:04:13,193::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/metadata bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-10 10:04:13,214::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00069049 s, 5.9 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 10:04:13,498::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 10:04:13,591::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0360751 s, 28.4 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 10:04:15,606::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 10:04:15,700::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0293212 s, 34.9 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 10:04:17,715::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 10:04:17,806::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0348818 s, 29.4 MB/s\n'; <rc> = 0 >Thread-40::DEBUG::2014-07-10 10:04:17,929::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lion.qa.lab.tlv.redhat.com:_export_yuri2_backup2/6a70504d-00df-4869-8695-0f442053f6b6/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-40::DEBUG::2014-07-10 10:04:17,955::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n369 bytes (369 B) copied, 0.00781014 s, 47.2 kB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 10:04:19,191::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-14::DEBUG::2014-07-10 10:04:19,193::task::595::TaskManager.Task::(_updateState) Task=`3d04d6bd-f853-4d2d-a23a-31e2d990c4c7`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 10:04:19,193::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-14::INFO::2014-07-10 10:04:19,194::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 10:04:19,194::task::1185::TaskManager.Task::(prepare) Task=`3d04d6bd-f853-4d2d-a23a-31e2d990c4c7`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 10:04:19,194::task::595::TaskManager.Task::(_updateState) Task=`3d04d6bd-f853-4d2d-a23a-31e2d990c4c7`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 10:04:19,194::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 10:04:19,194::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 10:04:19,195::task::990::TaskManager.Task::(_decref) Task=`3d04d6bd-f853-4d2d-a23a-31e2d990c4c7`::ref 0 aborting False >Thread-34::DEBUG::2014-07-10 10:04:19,199::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-34::DEBUG::2014-07-10 10:04:19,199::task::595::TaskManager.Task::(_updateState) Task=`fd39a152-0669-4517-9500-4712d0e570cc`::moving from state init -> state preparing >Thread-34::INFO::2014-07-10 10:04:19,200::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-34::DEBUG::2014-07-10 10:04:19,200::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`2507896d-868e-4964-a796-dc950b302f91`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-10 10:04:19,201::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' for lock type 'shared' >Thread-34::DEBUG::2014-07-10 10:04:19,201::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-10 10:04:19,201::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`2507896d-868e-4964-a796-dc950b302f91`::Granted request >Thread-34::DEBUG::2014-07-10 10:04:19,202::task::827::TaskManager.Task::(resourceAcquired) Task=`fd39a152-0669-4517-9500-4712d0e570cc`::_resourcesAcquired: Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee (shared) >Thread-34::DEBUG::2014-07-10 10:04:19,202::task::990::TaskManager.Task::(_decref) Task=`fd39a152-0669-4517-9500-4712d0e570cc`::ref 1 aborting False >Thread-34::INFO::2014-07-10 10:04:19,203::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '531976159232', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 10:04:19,203::task::1185::TaskManager.Task::(prepare) Task=`fd39a152-0669-4517-9500-4712d0e570cc`::finished: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '531976159232', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 10:04:19,204::task::595::TaskManager.Task::(_updateState) Task=`fd39a152-0669-4517-9500-4712d0e570cc`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-10 10:04:19,204::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee': < ResourceRef 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-10 10:04:19,204::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-10 10:04:19,204::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' >Thread-34::DEBUG::2014-07-10 10:04:19,205::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' (0 active users) >Thread-34::DEBUG::2014-07-10 10:04:19,205::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-10 10:04:19,205::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', Clearing records. >Thread-34::DEBUG::2014-07-10 10:04:19,205::task::990::TaskManager.Task::(_decref) Task=`fd39a152-0669-4517-9500-4712d0e570cc`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 10:04:19,822::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 10:04:19,925::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0332392 s, 30.8 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 10:04:21,940::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 10:04:22,033::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0296857 s, 34.5 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-10 10:04:23,245::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/metadata bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-10 10:04:23,297::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00060614 s, 6.8 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 10:04:24,048::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 10:04:24,216::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0359761 s, 28.5 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 10:04:26,232::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 10:04:26,417::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.126179 s, 8.1 MB/s\n'; <rc> = 0 >Thread-57::DEBUG::2014-07-10 10:04:26,824::task::595::TaskManager.Task::(_updateState) Task=`d60e2f07-9f79-4f99-9c14-b59b8f62e555`::moving from state init -> state preparing >Thread-57::INFO::2014-07-10 10:04:26,825::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='b6f6c0da-e67f-4902-b9ac-3069571a42fe', volUUID='c4cd1da8-05b7-45e0-80b1-1183d21443d9', options=None) >Thread-57::INFO::2014-07-10 10:04:26,825::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-57::DEBUG::2014-07-10 10:04:26,826::task::1185::TaskManager.Task::(prepare) Task=`d60e2f07-9f79-4f99-9c14-b59b8f62e555`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-57::DEBUG::2014-07-10 10:04:26,826::task::595::TaskManager.Task::(_updateState) Task=`d60e2f07-9f79-4f99-9c14-b59b8f62e555`::moving from state preparing -> state finished >Thread-57::DEBUG::2014-07-10 10:04:26,826::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-57::DEBUG::2014-07-10 10:04:26,826::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-57::DEBUG::2014-07-10 10:04:26,826::task::990::TaskManager.Task::(_decref) Task=`d60e2f07-9f79-4f99-9c14-b59b8f62e555`::ref 0 aborting False >Thread-14::DEBUG::2014-07-10 10:04:26,977::task::595::TaskManager.Task::(_updateState) Task=`ded4614f-04d2-4d63-87aa-d1d048ec9769`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 10:04:26,978::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::INFO::2014-07-10 10:04:26,978::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00060614', 'lastCheck': '3.7', 'valid': True}, '6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00781014', 'lastCheck': '9.0', 'valid': True}} >Thread-14::DEBUG::2014-07-10 10:04:26,978::task::1185::TaskManager.Task::(prepare) Task=`ded4614f-04d2-4d63-87aa-d1d048ec9769`::finished: {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00060614', 'lastCheck': '3.7', 'valid': True}, '6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00781014', 'lastCheck': '9.0', 'valid': True}} >Thread-14::DEBUG::2014-07-10 10:04:26,979::task::595::TaskManager.Task::(_updateState) Task=`ded4614f-04d2-4d63-87aa-d1d048ec9769`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 10:04:26,979::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 10:04:26,979::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 10:04:26,979::task::990::TaskManager.Task::(_decref) Task=`ded4614f-04d2-4d63-87aa-d1d048ec9769`::ref 0 aborting False >Thread-67::DEBUG::2014-07-10 10:04:27,715::task::595::TaskManager.Task::(_updateState) Task=`16a36c3e-645d-411a-8da8-9affa4f8445f`::moving from state init -> state preparing >Thread-67::INFO::2014-07-10 10:04:27,716::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='f30c2cb7-a43a-4bf5-82b5-cfe07336f65c', volUUID='b0fbb3c9-55af-4a3a-95ad-fc56a80b9cf5', options=None) >Thread-67::INFO::2014-07-10 10:04:27,716::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-67::DEBUG::2014-07-10 10:04:27,717::task::1185::TaskManager.Task::(prepare) Task=`16a36c3e-645d-411a-8da8-9affa4f8445f`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-67::DEBUG::2014-07-10 10:04:27,717::task::595::TaskManager.Task::(_updateState) Task=`16a36c3e-645d-411a-8da8-9affa4f8445f`::moving from state preparing -> state finished >Thread-67::DEBUG::2014-07-10 10:04:27,717::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-67::DEBUG::2014-07-10 10:04:27,717::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-67::DEBUG::2014-07-10 10:04:27,717::task::990::TaskManager.Task::(_decref) Task=`16a36c3e-645d-411a-8da8-9affa4f8445f`::ref 0 aborting False >Thread-48::DEBUG::2014-07-10 10:04:27,878::task::595::TaskManager.Task::(_updateState) Task=`7f2f498a-99e9-4610-81e6-87e33dd92f5e`::moving from state init -> state preparing >Thread-48::INFO::2014-07-10 10:04:27,879::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='0cd7d6ce-f497-4243-a690-c57744861eea', volUUID='10b6a7dd-dc6c-43fa-ba17-92e4331b0e0b', options=None) >Thread-48::INFO::2014-07-10 10:04:27,879::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-48::DEBUG::2014-07-10 10:04:27,879::task::1185::TaskManager.Task::(prepare) Task=`7f2f498a-99e9-4610-81e6-87e33dd92f5e`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-48::DEBUG::2014-07-10 10:04:27,880::task::595::TaskManager.Task::(_updateState) Task=`7f2f498a-99e9-4610-81e6-87e33dd92f5e`::moving from state preparing -> state finished >Thread-48::DEBUG::2014-07-10 10:04:27,880::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-48::DEBUG::2014-07-10 10:04:27,880::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-48::DEBUG::2014-07-10 10:04:27,880::task::990::TaskManager.Task::(_decref) Task=`7f2f498a-99e9-4610-81e6-87e33dd92f5e`::ref 0 aborting False >Thread-40::DEBUG::2014-07-10 10:04:27,980::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lion.qa.lab.tlv.redhat.com:_export_yuri2_backup2/6a70504d-00df-4869-8695-0f442053f6b6/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-40::DEBUG::2014-07-10 10:04:28,001::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n369 bytes (369 B) copied, 0.000464705 s, 794 kB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 10:04:28,432::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 10:04:28,529::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0393042 s, 26.1 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 10:04:29,233::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-14::DEBUG::2014-07-10 10:04:29,234::task::595::TaskManager.Task::(_updateState) Task=`3409a03a-625a-41a9-8f06-ee56c912ae47`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 10:04:29,235::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-14::INFO::2014-07-10 10:04:29,235::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 10:04:29,235::task::1185::TaskManager.Task::(prepare) Task=`3409a03a-625a-41a9-8f06-ee56c912ae47`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 10:04:29,236::task::595::TaskManager.Task::(_updateState) Task=`3409a03a-625a-41a9-8f06-ee56c912ae47`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 10:04:29,236::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 10:04:29,236::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 10:04:29,236::task::990::TaskManager.Task::(_decref) Task=`3409a03a-625a-41a9-8f06-ee56c912ae47`::ref 0 aborting False >Thread-34::DEBUG::2014-07-10 10:04:29,281::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-34::DEBUG::2014-07-10 10:04:29,282::task::595::TaskManager.Task::(_updateState) Task=`7e14c25c-75e8-4c30-833c-02b8d94bab5c`::moving from state init -> state preparing >Thread-34::INFO::2014-07-10 10:04:29,282::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-34::DEBUG::2014-07-10 10:04:29,283::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`fe4d6111-5fb8-4f6a-9022-35c5601aa542`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-10 10:04:29,283::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' for lock type 'shared' >Thread-34::DEBUG::2014-07-10 10:04:29,284::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-10 10:04:29,284::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`fe4d6111-5fb8-4f6a-9022-35c5601aa542`::Granted request >Thread-34::DEBUG::2014-07-10 10:04:29,284::task::827::TaskManager.Task::(resourceAcquired) Task=`7e14c25c-75e8-4c30-833c-02b8d94bab5c`::_resourcesAcquired: Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee (shared) >Thread-34::DEBUG::2014-07-10 10:04:29,285::task::990::TaskManager.Task::(_decref) Task=`7e14c25c-75e8-4c30-833c-02b8d94bab5c`::ref 1 aborting False >Thread-34::INFO::2014-07-10 10:04:29,286::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '531976159232', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 10:04:29,286::task::1185::TaskManager.Task::(prepare) Task=`7e14c25c-75e8-4c30-833c-02b8d94bab5c`::finished: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '531976159232', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 10:04:29,286::task::595::TaskManager.Task::(_updateState) Task=`7e14c25c-75e8-4c30-833c-02b8d94bab5c`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-10 10:04:29,287::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee': < ResourceRef 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-10 10:04:29,287::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-10 10:04:29,287::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' >Thread-34::DEBUG::2014-07-10 10:04:29,287::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' (0 active users) >Thread-34::DEBUG::2014-07-10 10:04:29,288::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-10 10:04:29,288::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', Clearing records. >Thread-34::DEBUG::2014-07-10 10:04:29,288::task::990::TaskManager.Task::(_decref) Task=`7e14c25c-75e8-4c30-833c-02b8d94bab5c`::ref 0 aborting False >Thread-76::DEBUG::2014-07-10 10:04:29,723::task::595::TaskManager.Task::(_updateState) Task=`c626acd6-805f-4ac1-9c25-981afbd7a394`::moving from state init -> state preparing >Thread-76::INFO::2014-07-10 10:04:29,724::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='e4c65229-4247-4b33-b72a-f1d5ce72ad05', volUUID='cad94284-3ca9-4c30-933d-997f4460309e', options=None) >Thread-76::INFO::2014-07-10 10:04:29,725::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-76::DEBUG::2014-07-10 10:04:29,725::task::1185::TaskManager.Task::(prepare) Task=`c626acd6-805f-4ac1-9c25-981afbd7a394`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-76::DEBUG::2014-07-10 10:04:29,725::task::595::TaskManager.Task::(_updateState) Task=`c626acd6-805f-4ac1-9c25-981afbd7a394`::moving from state preparing -> state finished >Thread-76::DEBUG::2014-07-10 10:04:29,726::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-76::DEBUG::2014-07-10 10:04:29,726::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-76::DEBUG::2014-07-10 10:04:29,726::task::990::TaskManager.Task::(_decref) Task=`c626acd6-805f-4ac1-9c25-981afbd7a394`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 10:04:30,548::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 10:04:30,629::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0293424 s, 34.9 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 10:04:32,644::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 10:04:32,743::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0409981 s, 25.0 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-10 10:04:33,326::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/metadata bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-10 10:04:33,348::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000808221 s, 5.1 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 10:04:34,758::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 10:04:34,855::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0399589 s, 25.6 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 10:04:36,870::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 10:04:36,961::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0311636 s, 32.9 MB/s\n'; <rc> = 0 >Thread-40::DEBUG::2014-07-10 10:04:38,036::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lion.qa.lab.tlv.redhat.com:_export_yuri2_backup2/6a70504d-00df-4869-8695-0f442053f6b6/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-40::DEBUG::2014-07-10 10:04:38,057::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n369 bytes (369 B) copied, 0.000557157 s, 662 kB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 10:04:38,977::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 10:04:39,072::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.036878 s, 27.8 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 10:04:39,315::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-14::DEBUG::2014-07-10 10:04:39,317::task::595::TaskManager.Task::(_updateState) Task=`fab12f50-46f4-45f0-bdb3-32a60f4ff4a7`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 10:04:39,318::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-14::INFO::2014-07-10 10:04:39,319::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 10:04:39,319::task::1185::TaskManager.Task::(prepare) Task=`fab12f50-46f4-45f0-bdb3-32a60f4ff4a7`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 10:04:39,319::task::595::TaskManager.Task::(_updateState) Task=`fab12f50-46f4-45f0-bdb3-32a60f4ff4a7`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 10:04:39,320::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 10:04:39,320::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 10:04:39,320::task::990::TaskManager.Task::(_decref) Task=`fab12f50-46f4-45f0-bdb3-32a60f4ff4a7`::ref 0 aborting False >Thread-34::DEBUG::2014-07-10 10:04:39,325::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-34::DEBUG::2014-07-10 10:04:39,326::task::595::TaskManager.Task::(_updateState) Task=`a46e83c1-d3b9-4169-ab99-4ddb60d7ff8e`::moving from state init -> state preparing >Thread-34::INFO::2014-07-10 10:04:39,326::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-34::DEBUG::2014-07-10 10:04:39,327::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`40ea89c3-310f-47e3-bafe-f3ea630c2c4d`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-10 10:04:39,328::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' for lock type 'shared' >Thread-34::DEBUG::2014-07-10 10:04:39,328::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-10 10:04:39,328::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`40ea89c3-310f-47e3-bafe-f3ea630c2c4d`::Granted request >Thread-34::DEBUG::2014-07-10 10:04:39,329::task::827::TaskManager.Task::(resourceAcquired) Task=`a46e83c1-d3b9-4169-ab99-4ddb60d7ff8e`::_resourcesAcquired: Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee (shared) >Thread-34::DEBUG::2014-07-10 10:04:39,329::task::990::TaskManager.Task::(_decref) Task=`a46e83c1-d3b9-4169-ab99-4ddb60d7ff8e`::ref 1 aborting False >Thread-34::INFO::2014-07-10 10:04:39,330::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '531976159232', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 10:04:39,331::task::1185::TaskManager.Task::(prepare) Task=`a46e83c1-d3b9-4169-ab99-4ddb60d7ff8e`::finished: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '531976159232', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 10:04:39,331::task::595::TaskManager.Task::(_updateState) Task=`a46e83c1-d3b9-4169-ab99-4ddb60d7ff8e`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-10 10:04:39,331::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee': < ResourceRef 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-10 10:04:39,331::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-10 10:04:39,332::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' >Thread-34::DEBUG::2014-07-10 10:04:39,332::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' (0 active users) >Thread-34::DEBUG::2014-07-10 10:04:39,332::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-10 10:04:39,332::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', Clearing records. >Thread-34::DEBUG::2014-07-10 10:04:39,332::task::990::TaskManager.Task::(_decref) Task=`a46e83c1-d3b9-4169-ab99-4ddb60d7ff8e`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 10:04:41,087::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 10:04:41,183::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0355445 s, 28.8 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 10:04:42,154::task::595::TaskManager.Task::(_updateState) Task=`50ec2afb-922a-45f4-b76a-2d955f87955e`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 10:04:42,154::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::INFO::2014-07-10 10:04:42,155::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000808221', 'lastCheck': '8.8', 'valid': True}, '6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000557157', 'lastCheck': '4.1', 'valid': True}} >Thread-14::DEBUG::2014-07-10 10:04:42,155::task::1185::TaskManager.Task::(prepare) Task=`50ec2afb-922a-45f4-b76a-2d955f87955e`::finished: {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000808221', 'lastCheck': '8.8', 'valid': True}, '6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000557157', 'lastCheck': '4.1', 'valid': True}} >Thread-14::DEBUG::2014-07-10 10:04:42,155::task::595::TaskManager.Task::(_updateState) Task=`50ec2afb-922a-45f4-b76a-2d955f87955e`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 10:04:42,155::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 10:04:42,156::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 10:04:42,156::task::990::TaskManager.Task::(_decref) Task=`50ec2afb-922a-45f4-b76a-2d955f87955e`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 10:04:43,199::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 10:04:43,286::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.029945 s, 34.2 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-10 10:04:43,377::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/metadata bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-10 10:04:43,398::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000767957 s, 5.3 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 10:04:45,315::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 10:04:45,409::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0359954 s, 28.4 MB/s\n'; <rc> = 0 >Thread-70::DEBUG::2014-07-10 10:04:46,550::task::595::TaskManager.Task::(_updateState) Task=`86ec1eba-6196-4318-8038-3157444de498`::moving from state init -> state preparing >Thread-70::INFO::2014-07-10 10:04:46,550::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='cfaeead2-7caa-467c-b389-c89840ae6605', volUUID='567fe32d-31a6-4ff6-90f3-fd6a656fbecc', options=None) >Thread-70::INFO::2014-07-10 10:04:46,551::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-70::DEBUG::2014-07-10 10:04:46,551::task::1185::TaskManager.Task::(prepare) Task=`86ec1eba-6196-4318-8038-3157444de498`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-70::DEBUG::2014-07-10 10:04:46,551::task::595::TaskManager.Task::(_updateState) Task=`86ec1eba-6196-4318-8038-3157444de498`::moving from state preparing -> state finished >Thread-70::DEBUG::2014-07-10 10:04:46,552::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-70::DEBUG::2014-07-10 10:04:46,552::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-70::DEBUG::2014-07-10 10:04:46,552::task::990::TaskManager.Task::(_decref) Task=`86ec1eba-6196-4318-8038-3157444de498`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 10:04:47,424::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 10:04:47,517::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0344085 s, 29.8 MB/s\n'; <rc> = 0 >Thread-40::DEBUG::2014-07-10 10:04:48,089::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lion.qa.lab.tlv.redhat.com:_export_yuri2_backup2/6a70504d-00df-4869-8695-0f442053f6b6/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-40::DEBUG::2014-07-10 10:04:48,110::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n369 bytes (369 B) copied, 0.000551297 s, 669 kB/s\n'; <rc> = 0 >Thread-51::DEBUG::2014-07-10 10:04:48,736::task::595::TaskManager.Task::(_updateState) Task=`7e062ea0-5bbd-46ae-9cf0-3492e4244924`::moving from state init -> state preparing >Thread-51::INFO::2014-07-10 10:04:48,736::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='76fdb054-02cd-42ed-9721-b3e65b34c3a4', volUUID='022dfe46-2cf7-4915-80b3-883158e3ca83', options=None) >Thread-51::INFO::2014-07-10 10:04:48,737::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-60::DEBUG::2014-07-10 10:04:48,737::task::595::TaskManager.Task::(_updateState) Task=`d30c5e0f-727b-4320-9f36-d985020f418c`::moving from state init -> state preparing >Thread-51::DEBUG::2014-07-10 10:04:48,737::task::1185::TaskManager.Task::(prepare) Task=`7e062ea0-5bbd-46ae-9cf0-3492e4244924`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-51::DEBUG::2014-07-10 10:04:48,738::task::595::TaskManager.Task::(_updateState) Task=`7e062ea0-5bbd-46ae-9cf0-3492e4244924`::moving from state preparing -> state finished >Thread-60::INFO::2014-07-10 10:04:48,738::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='b034d5b0-e1e0-4011-b49b-4d45ddb11556', volUUID='3d7f62b5-328f-4d8e-8b69-873cfb5ae14d', options=None) >Thread-51::DEBUG::2014-07-10 10:04:48,738::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-51::DEBUG::2014-07-10 10:04:48,739::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-60::INFO::2014-07-10 10:04:48,739::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-51::DEBUG::2014-07-10 10:04:48,739::task::990::TaskManager.Task::(_decref) Task=`7e062ea0-5bbd-46ae-9cf0-3492e4244924`::ref 0 aborting False >Thread-60::DEBUG::2014-07-10 10:04:48,739::task::1185::TaskManager.Task::(prepare) Task=`d30c5e0f-727b-4320-9f36-d985020f418c`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-60::DEBUG::2014-07-10 10:04:48,740::task::595::TaskManager.Task::(_updateState) Task=`d30c5e0f-727b-4320-9f36-d985020f418c`::moving from state preparing -> state finished >Thread-60::DEBUG::2014-07-10 10:04:48,740::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-60::DEBUG::2014-07-10 10:04:48,740::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-60::DEBUG::2014-07-10 10:04:48,740::task::990::TaskManager.Task::(_decref) Task=`d30c5e0f-727b-4320-9f36-d985020f418c`::ref 0 aborting False >Thread-14::DEBUG::2014-07-10 10:04:49,366::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-14::DEBUG::2014-07-10 10:04:49,367::task::595::TaskManager.Task::(_updateState) Task=`15e95dd1-2655-46bd-aacc-42c3ebdf626e`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 10:04:49,367::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-14::INFO::2014-07-10 10:04:49,368::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 10:04:49,368::task::1185::TaskManager.Task::(prepare) Task=`15e95dd1-2655-46bd-aacc-42c3ebdf626e`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 10:04:49,368::task::595::TaskManager.Task::(_updateState) Task=`15e95dd1-2655-46bd-aacc-42c3ebdf626e`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 10:04:49,368::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 10:04:49,368::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 10:04:49,369::task::990::TaskManager.Task::(_decref) Task=`15e95dd1-2655-46bd-aacc-42c3ebdf626e`::ref 0 aborting False >Thread-34::DEBUG::2014-07-10 10:04:49,373::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-34::DEBUG::2014-07-10 10:04:49,374::task::595::TaskManager.Task::(_updateState) Task=`3bc72ff2-3123-460b-87e7-58d4a8ab6966`::moving from state init -> state preparing >Thread-34::INFO::2014-07-10 10:04:49,374::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-34::DEBUG::2014-07-10 10:04:49,375::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`36aff9a5-c031-4b59-9978-fc4d56da1b12`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-10 10:04:49,375::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' for lock type 'shared' >Thread-34::DEBUG::2014-07-10 10:04:49,375::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-10 10:04:49,375::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`36aff9a5-c031-4b59-9978-fc4d56da1b12`::Granted request >Thread-34::DEBUG::2014-07-10 10:04:49,376::task::827::TaskManager.Task::(resourceAcquired) Task=`3bc72ff2-3123-460b-87e7-58d4a8ab6966`::_resourcesAcquired: Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee (shared) >Thread-34::DEBUG::2014-07-10 10:04:49,376::task::990::TaskManager.Task::(_decref) Task=`3bc72ff2-3123-460b-87e7-58d4a8ab6966`::ref 1 aborting False >Thread-34::INFO::2014-07-10 10:04:49,377::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '531976159232', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 10:04:49,377::task::1185::TaskManager.Task::(prepare) Task=`3bc72ff2-3123-460b-87e7-58d4a8ab6966`::finished: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '531976159232', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 10:04:49,378::task::595::TaskManager.Task::(_updateState) Task=`3bc72ff2-3123-460b-87e7-58d4a8ab6966`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-10 10:04:49,378::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee': < ResourceRef 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-10 10:04:49,378::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-10 10:04:49,378::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' >Thread-34::DEBUG::2014-07-10 10:04:49,378::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' (0 active users) >Thread-34::DEBUG::2014-07-10 10:04:49,378::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-10 10:04:49,379::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', Clearing records. >Thread-34::DEBUG::2014-07-10 10:04:49,379::task::990::TaskManager.Task::(_decref) Task=`3bc72ff2-3123-460b-87e7-58d4a8ab6966`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 10:04:49,532::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 10:04:49,615::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0253224 s, 40.4 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 10:04:51,631::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 10:04:51,714::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0254482 s, 40.2 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-10 10:04:53,428::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/metadata bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-10 10:04:53,453::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000708067 s, 5.8 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 10:04:53,729::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 10:04:53,838::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0359612 s, 28.5 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 10:04:55,854::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 10:04:55,950::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0378751 s, 27.0 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 10:04:57,345::task::595::TaskManager.Task::(_updateState) Task=`44f9eef9-354d-4cff-a512-e7dd1ae98cde`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 10:04:57,345::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::INFO::2014-07-10 10:04:57,346::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000708067', 'lastCheck': '3.9', 'valid': True}, '6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000551297', 'lastCheck': '9.2', 'valid': True}} >Thread-14::DEBUG::2014-07-10 10:04:57,346::task::1185::TaskManager.Task::(prepare) Task=`44f9eef9-354d-4cff-a512-e7dd1ae98cde`::finished: {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000708067', 'lastCheck': '3.9', 'valid': True}, '6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000551297', 'lastCheck': '9.2', 'valid': True}} >Thread-14::DEBUG::2014-07-10 10:04:57,346::task::595::TaskManager.Task::(_updateState) Task=`44f9eef9-354d-4cff-a512-e7dd1ae98cde`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 10:04:57,346::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 10:04:57,346::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 10:04:57,347::task::990::TaskManager.Task::(_decref) Task=`44f9eef9-354d-4cff-a512-e7dd1ae98cde`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 10:04:57,974::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 10:04:58,067::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0303181 s, 33.8 MB/s\n'; <rc> = 0 >Thread-40::DEBUG::2014-07-10 10:04:58,140::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lion.qa.lab.tlv.redhat.com:_export_yuri2_backup2/6a70504d-00df-4869-8695-0f442053f6b6/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-40::DEBUG::2014-07-10 10:04:58,161::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n369 bytes (369 B) copied, 0.000467479 s, 789 kB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 10:04:59,401::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-14::DEBUG::2014-07-10 10:04:59,402::task::595::TaskManager.Task::(_updateState) Task=`4806ba21-63a0-4121-a87b-9f08af499956`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 10:04:59,402::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-14::INFO::2014-07-10 10:04:59,403::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 10:04:59,403::task::1185::TaskManager.Task::(prepare) Task=`4806ba21-63a0-4121-a87b-9f08af499956`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 10:04:59,403::task::595::TaskManager.Task::(_updateState) Task=`4806ba21-63a0-4121-a87b-9f08af499956`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 10:04:59,403::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 10:04:59,404::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 10:04:59,404::task::990::TaskManager.Task::(_decref) Task=`4806ba21-63a0-4121-a87b-9f08af499956`::ref 0 aborting False >Thread-34::DEBUG::2014-07-10 10:04:59,449::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-34::DEBUG::2014-07-10 10:04:59,450::task::595::TaskManager.Task::(_updateState) Task=`ee2b0b1d-d5ca-4b43-859f-cbd670eb00b0`::moving from state init -> state preparing >Thread-34::INFO::2014-07-10 10:04:59,450::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-34::DEBUG::2014-07-10 10:04:59,452::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`3dfbc4e4-d6bb-4bc9-94fe-559521a9617f`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-10 10:04:59,452::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' for lock type 'shared' >Thread-34::DEBUG::2014-07-10 10:04:59,452::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-10 10:04:59,453::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`3dfbc4e4-d6bb-4bc9-94fe-559521a9617f`::Granted request >Thread-34::DEBUG::2014-07-10 10:04:59,453::task::827::TaskManager.Task::(resourceAcquired) Task=`ee2b0b1d-d5ca-4b43-859f-cbd670eb00b0`::_resourcesAcquired: Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee (shared) >Thread-34::DEBUG::2014-07-10 10:04:59,453::task::990::TaskManager.Task::(_decref) Task=`ee2b0b1d-d5ca-4b43-859f-cbd670eb00b0`::ref 1 aborting False >Thread-34::INFO::2014-07-10 10:04:59,455::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '531976159232', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 10:04:59,455::task::1185::TaskManager.Task::(prepare) Task=`ee2b0b1d-d5ca-4b43-859f-cbd670eb00b0`::finished: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '531976159232', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 10:04:59,455::task::595::TaskManager.Task::(_updateState) Task=`ee2b0b1d-d5ca-4b43-859f-cbd670eb00b0`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-10 10:04:59,455::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee': < ResourceRef 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-10 10:04:59,455::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-10 10:04:59,456::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' >Thread-34::DEBUG::2014-07-10 10:04:59,456::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' (0 active users) >Thread-34::DEBUG::2014-07-10 10:04:59,456::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-10 10:04:59,456::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', Clearing records. >Thread-34::DEBUG::2014-07-10 10:04:59,457::task::990::TaskManager.Task::(_decref) Task=`ee2b0b1d-d5ca-4b43-859f-cbd670eb00b0`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 10:05:00,083::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 10:05:00,175::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0341119 s, 30.0 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 10:05:02,190::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 10:05:02,296::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0468644 s, 21.9 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-10 10:05:03,485::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/metadata bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-10 10:05:03,513::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00545859 s, 750 kB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 10:05:04,311::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 10:05:04,416::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0454778 s, 22.5 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 10:05:06,432::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 10:05:06,551::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0429751 s, 23.8 MB/s\n'; <rc> = 0 >Thread-64::DEBUG::2014-07-10 10:05:06,697::task::595::TaskManager.Task::(_updateState) Task=`a726b990-3a6d-4a92-afa2-3be98f28a724`::moving from state init -> state preparing >Thread-64::INFO::2014-07-10 10:05:06,702::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='aa20346a-4d3a-4e07-b8e1-52c0ebe4168c', volUUID='58fefce2-9bce-4bff-8949-8c6ce8122b27', options=None) >Thread-64::INFO::2014-07-10 10:05:06,711::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-64::DEBUG::2014-07-10 10:05:06,713::task::1185::TaskManager.Task::(prepare) Task=`a726b990-3a6d-4a92-afa2-3be98f28a724`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-64::DEBUG::2014-07-10 10:05:06,716::task::595::TaskManager.Task::(_updateState) Task=`a726b990-3a6d-4a92-afa2-3be98f28a724`::moving from state preparing -> state finished >Thread-64::DEBUG::2014-07-10 10:05:06,718::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-64::DEBUG::2014-07-10 10:05:06,721::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-64::DEBUG::2014-07-10 10:05:06,725::task::990::TaskManager.Task::(_decref) Task=`a726b990-3a6d-4a92-afa2-3be98f28a724`::ref 0 aborting False >Thread-40::DEBUG::2014-07-10 10:05:08,187::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lion.qa.lab.tlv.redhat.com:_export_yuri2_backup2/6a70504d-00df-4869-8695-0f442053f6b6/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-40::DEBUG::2014-07-10 10:05:08,208::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n369 bytes (369 B) copied, 0.000523562 s, 705 kB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 10:05:08,566::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 10:05:08,658::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0328446 s, 31.2 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 10:05:09,492::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-14::DEBUG::2014-07-10 10:05:09,493::task::595::TaskManager.Task::(_updateState) Task=`b4f3aeb1-ecbb-43b1-8286-1bc84e8e01b9`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 10:05:09,493::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-14::INFO::2014-07-10 10:05:09,494::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 10:05:09,494::task::1185::TaskManager.Task::(prepare) Task=`b4f3aeb1-ecbb-43b1-8286-1bc84e8e01b9`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 10:05:09,494::task::595::TaskManager.Task::(_updateState) Task=`b4f3aeb1-ecbb-43b1-8286-1bc84e8e01b9`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 10:05:09,495::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 10:05:09,495::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 10:05:09,495::task::990::TaskManager.Task::(_decref) Task=`b4f3aeb1-ecbb-43b1-8286-1bc84e8e01b9`::ref 0 aborting False >Thread-34::DEBUG::2014-07-10 10:05:09,499::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-34::DEBUG::2014-07-10 10:05:09,500::task::595::TaskManager.Task::(_updateState) Task=`40136dfe-65cc-4c1e-ac12-06e36529bdb6`::moving from state init -> state preparing >Thread-34::INFO::2014-07-10 10:05:09,500::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-34::DEBUG::2014-07-10 10:05:09,501::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`b4577d8e-52fb-4e8f-bba4-c9c1291f36fb`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-10 10:05:09,501::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' for lock type 'shared' >Thread-34::DEBUG::2014-07-10 10:05:09,501::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-10 10:05:09,501::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`b4577d8e-52fb-4e8f-bba4-c9c1291f36fb`::Granted request >Thread-34::DEBUG::2014-07-10 10:05:09,502::task::827::TaskManager.Task::(resourceAcquired) Task=`40136dfe-65cc-4c1e-ac12-06e36529bdb6`::_resourcesAcquired: Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee (shared) >Thread-34::DEBUG::2014-07-10 10:05:09,502::task::990::TaskManager.Task::(_decref) Task=`40136dfe-65cc-4c1e-ac12-06e36529bdb6`::ref 1 aborting False >Thread-34::INFO::2014-07-10 10:05:09,503::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '531976159232', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 10:05:09,504::task::1185::TaskManager.Task::(prepare) Task=`40136dfe-65cc-4c1e-ac12-06e36529bdb6`::finished: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '531976159232', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 10:05:09,504::task::595::TaskManager.Task::(_updateState) Task=`40136dfe-65cc-4c1e-ac12-06e36529bdb6`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-10 10:05:09,504::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee': < ResourceRef 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-10 10:05:09,504::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-10 10:05:09,504::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' >Thread-34::DEBUG::2014-07-10 10:05:09,505::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' (0 active users) >Thread-34::DEBUG::2014-07-10 10:05:09,505::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-10 10:05:09,505::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', Clearing records. >Thread-34::DEBUG::2014-07-10 10:05:09,505::task::990::TaskManager.Task::(_decref) Task=`40136dfe-65cc-4c1e-ac12-06e36529bdb6`::ref 0 aborting False >Thread-54::DEBUG::2014-07-10 10:05:10,470::task::595::TaskManager.Task::(_updateState) Task=`31898e22-034f-4305-9298-366c106f3807`::moving from state init -> state preparing >Thread-54::INFO::2014-07-10 10:05:10,471::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='28408446-e5fd-4565-a976-e760951593fe', volUUID='776303a2-5585-451e-826e-0e338d4a1e98', options=None) >Thread-73::DEBUG::2014-07-10 10:05:10,472::task::595::TaskManager.Task::(_updateState) Task=`699161c4-595d-4310-ae63-49c1638e6ab7`::moving from state init -> state preparing >Thread-54::INFO::2014-07-10 10:05:10,473::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-73::INFO::2014-07-10 10:05:10,474::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='c01d693b-cba0-4fed-9ad7-0aaa28912a19', volUUID='4bb5d954-2a50-4028-b299-0b43c261270c', options=None) >Thread-54::DEBUG::2014-07-10 10:05:10,474::task::1185::TaskManager.Task::(prepare) Task=`31898e22-034f-4305-9298-366c106f3807`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-54::DEBUG::2014-07-10 10:05:10,475::task::595::TaskManager.Task::(_updateState) Task=`31898e22-034f-4305-9298-366c106f3807`::moving from state preparing -> state finished >Thread-54::DEBUG::2014-07-10 10:05:10,476::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-73::INFO::2014-07-10 10:05:10,476::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-54::DEBUG::2014-07-10 10:05:10,476::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-73::DEBUG::2014-07-10 10:05:10,477::task::1185::TaskManager.Task::(prepare) Task=`699161c4-595d-4310-ae63-49c1638e6ab7`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-54::DEBUG::2014-07-10 10:05:10,477::task::990::TaskManager.Task::(_decref) Task=`31898e22-034f-4305-9298-366c106f3807`::ref 0 aborting False >Thread-73::DEBUG::2014-07-10 10:05:10,478::task::595::TaskManager.Task::(_updateState) Task=`699161c4-595d-4310-ae63-49c1638e6ab7`::moving from state preparing -> state finished >Thread-73::DEBUG::2014-07-10 10:05:10,478::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-73::DEBUG::2014-07-10 10:05:10,479::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-73::DEBUG::2014-07-10 10:05:10,479::task::990::TaskManager.Task::(_decref) Task=`699161c4-595d-4310-ae63-49c1638e6ab7`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 10:05:10,673::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 10:05:10,761::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.028584 s, 35.8 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 10:05:12,552::task::595::TaskManager.Task::(_updateState) Task=`e688a9d2-7870-4f2f-b1b5-4514f9c66beb`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 10:05:12,552::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::INFO::2014-07-10 10:05:12,553::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00545859', 'lastCheck': '9.0', 'valid': True}, '6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000523562', 'lastCheck': '4.3', 'valid': True}} >Thread-14::DEBUG::2014-07-10 10:05:12,553::task::1185::TaskManager.Task::(prepare) Task=`e688a9d2-7870-4f2f-b1b5-4514f9c66beb`::finished: {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00545859', 'lastCheck': '9.0', 'valid': True}, '6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000523562', 'lastCheck': '4.3', 'valid': True}} >Thread-14::DEBUG::2014-07-10 10:05:12,553::task::595::TaskManager.Task::(_updateState) Task=`e688a9d2-7870-4f2f-b1b5-4514f9c66beb`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 10:05:12,554::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 10:05:12,554::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 10:05:12,554::task::990::TaskManager.Task::(_decref) Task=`e688a9d2-7870-4f2f-b1b5-4514f9c66beb`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 10:05:12,775::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 10:05:12,861::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0281799 s, 36.3 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-10 10:05:13,541::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/metadata bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-10 10:05:13,567::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00457988 s, 894 kB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 10:05:14,876::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 10:05:15,045::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.110263 s, 9.3 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 10:05:17,060::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 10:05:17,160::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0410734 s, 24.9 MB/s\n'; <rc> = 0 >Thread-40::DEBUG::2014-07-10 10:05:18,239::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lion.qa.lab.tlv.redhat.com:_export_yuri2_backup2/6a70504d-00df-4869-8695-0f442053f6b6/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-40::DEBUG::2014-07-10 10:05:18,259::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n369 bytes (369 B) copied, 0.000488625 s, 755 kB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 10:05:19,175::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 10:05:19,264::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0306534 s, 33.4 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 10:05:19,534::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-14::DEBUG::2014-07-10 10:05:19,535::task::595::TaskManager.Task::(_updateState) Task=`9bfde794-9955-474d-8fe2-add54aac96c0`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 10:05:19,536::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-14::INFO::2014-07-10 10:05:19,536::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 10:05:19,537::task::1185::TaskManager.Task::(prepare) Task=`9bfde794-9955-474d-8fe2-add54aac96c0`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 10:05:19,537::task::595::TaskManager.Task::(_updateState) Task=`9bfde794-9955-474d-8fe2-add54aac96c0`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 10:05:19,537::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 10:05:19,537::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 10:05:19,538::task::990::TaskManager.Task::(_decref) Task=`9bfde794-9955-474d-8fe2-add54aac96c0`::ref 0 aborting False >Thread-34::DEBUG::2014-07-10 10:05:19,542::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-34::DEBUG::2014-07-10 10:05:19,543::task::595::TaskManager.Task::(_updateState) Task=`39b0b7ea-7c1f-4235-aba9-e42dda1016ed`::moving from state init -> state preparing >Thread-34::INFO::2014-07-10 10:05:19,543::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-34::DEBUG::2014-07-10 10:05:19,544::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`5c3e1908-f6bb-4b5b-b513-be8e2e925098`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-10 10:05:19,544::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' for lock type 'shared' >Thread-34::DEBUG::2014-07-10 10:05:19,545::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-10 10:05:19,545::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`5c3e1908-f6bb-4b5b-b513-be8e2e925098`::Granted request >Thread-34::DEBUG::2014-07-10 10:05:19,545::task::827::TaskManager.Task::(resourceAcquired) Task=`39b0b7ea-7c1f-4235-aba9-e42dda1016ed`::_resourcesAcquired: Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee (shared) >Thread-34::DEBUG::2014-07-10 10:05:19,546::task::990::TaskManager.Task::(_decref) Task=`39b0b7ea-7c1f-4235-aba9-e42dda1016ed`::ref 1 aborting False >Thread-34::INFO::2014-07-10 10:05:19,547::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '531976159232', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 10:05:19,547::task::1185::TaskManager.Task::(prepare) Task=`39b0b7ea-7c1f-4235-aba9-e42dda1016ed`::finished: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '531976159232', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 10:05:19,547::task::595::TaskManager.Task::(_updateState) Task=`39b0b7ea-7c1f-4235-aba9-e42dda1016ed`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-10 10:05:19,548::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee': < ResourceRef 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-10 10:05:19,548::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-10 10:05:19,548::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' >Thread-34::DEBUG::2014-07-10 10:05:19,549::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' (0 active users) >Thread-34::DEBUG::2014-07-10 10:05:19,549::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-10 10:05:19,549::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', Clearing records. >Thread-34::DEBUG::2014-07-10 10:05:19,549::task::990::TaskManager.Task::(_decref) Task=`39b0b7ea-7c1f-4235-aba9-e42dda1016ed`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 10:05:21,280::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 10:05:21,391::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0549858 s, 18.6 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 10:05:23,406::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 10:05:23,493::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0280035 s, 36.6 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-10 10:05:23,596::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/metadata bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-10 10:05:23,619::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000850212 s, 4.8 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 10:05:25,508::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 10:05:25,637::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0281046 s, 36.4 MB/s\n'; <rc> = 0 >Thread-57::DEBUG::2014-07-10 10:05:27,118::task::595::TaskManager.Task::(_updateState) Task=`41f6943a-e8b5-46f2-927d-4038a1a692b8`::moving from state init -> state preparing >Thread-57::INFO::2014-07-10 10:05:27,123::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='b6f6c0da-e67f-4902-b9ac-3069571a42fe', volUUID='c4cd1da8-05b7-45e0-80b1-1183d21443d9', options=None) >Thread-57::INFO::2014-07-10 10:05:27,126::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-57::DEBUG::2014-07-10 10:05:27,127::task::1185::TaskManager.Task::(prepare) Task=`41f6943a-e8b5-46f2-927d-4038a1a692b8`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-57::DEBUG::2014-07-10 10:05:27,129::task::595::TaskManager.Task::(_updateState) Task=`41f6943a-e8b5-46f2-927d-4038a1a692b8`::moving from state preparing -> state finished >Thread-57::DEBUG::2014-07-10 10:05:27,130::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-57::DEBUG::2014-07-10 10:05:27,131::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-57::DEBUG::2014-07-10 10:05:27,131::task::990::TaskManager.Task::(_decref) Task=`41f6943a-e8b5-46f2-927d-4038a1a692b8`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 10:05:27,652::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Thread-14::DEBUG::2014-07-10 10:05:27,745::task::595::TaskManager.Task::(_updateState) Task=`76d647c0-450b-4bcf-86d6-d6e830b2583f`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 10:05:27,748::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::INFO::2014-07-10 10:05:27,751::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000850212', 'lastCheck': '4.1', 'valid': True}, '6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000488625', 'lastCheck': '9.5', 'valid': True}} >Thread-14::DEBUG::2014-07-10 10:05:27,753::task::1185::TaskManager.Task::(prepare) Task=`76d647c0-450b-4bcf-86d6-d6e830b2583f`::finished: {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000850212', 'lastCheck': '4.1', 'valid': True}, '6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000488625', 'lastCheck': '9.5', 'valid': True}} >Thread-14::DEBUG::2014-07-10 10:05:27,755::task::595::TaskManager.Task::(_updateState) Task=`76d647c0-450b-4bcf-86d6-d6e830b2583f`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 10:05:27,756::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 10:05:27,758::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 10:05:27,761::task::990::TaskManager.Task::(_decref) Task=`76d647c0-450b-4bcf-86d6-d6e830b2583f`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 10:05:27,994::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0383849 s, 26.7 MB/s\n'; <rc> = 0 >Thread-67::DEBUG::2014-07-10 10:05:28,011::task::595::TaskManager.Task::(_updateState) Task=`feacce33-8dfb-4cd9-91f5-bb7810fef869`::moving from state init -> state preparing >Thread-67::INFO::2014-07-10 10:05:28,013::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='f30c2cb7-a43a-4bf5-82b5-cfe07336f65c', volUUID='b0fbb3c9-55af-4a3a-95ad-fc56a80b9cf5', options=None) >Thread-67::INFO::2014-07-10 10:05:28,015::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-67::DEBUG::2014-07-10 10:05:28,017::task::1185::TaskManager.Task::(prepare) Task=`feacce33-8dfb-4cd9-91f5-bb7810fef869`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-67::DEBUG::2014-07-10 10:05:28,018::task::595::TaskManager.Task::(_updateState) Task=`feacce33-8dfb-4cd9-91f5-bb7810fef869`::moving from state preparing -> state finished >Thread-67::DEBUG::2014-07-10 10:05:28,019::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-67::DEBUG::2014-07-10 10:05:28,020::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-67::DEBUG::2014-07-10 10:05:28,021::task::990::TaskManager.Task::(_decref) Task=`feacce33-8dfb-4cd9-91f5-bb7810fef869`::ref 0 aborting False >Thread-48::DEBUG::2014-07-10 10:05:28,138::task::595::TaskManager.Task::(_updateState) Task=`30e801f4-5dd8-46c9-8424-c5b653c8c837`::moving from state init -> state preparing >Thread-48::INFO::2014-07-10 10:05:28,139::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='0cd7d6ce-f497-4243-a690-c57744861eea', volUUID='10b6a7dd-dc6c-43fa-ba17-92e4331b0e0b', options=None) >Thread-48::INFO::2014-07-10 10:05:28,139::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-48::DEBUG::2014-07-10 10:05:28,139::task::1185::TaskManager.Task::(prepare) Task=`30e801f4-5dd8-46c9-8424-c5b653c8c837`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-48::DEBUG::2014-07-10 10:05:28,140::task::595::TaskManager.Task::(_updateState) Task=`30e801f4-5dd8-46c9-8424-c5b653c8c837`::moving from state preparing -> state finished >Thread-48::DEBUG::2014-07-10 10:05:28,140::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-48::DEBUG::2014-07-10 10:05:28,140::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-48::DEBUG::2014-07-10 10:05:28,140::task::990::TaskManager.Task::(_decref) Task=`30e801f4-5dd8-46c9-8424-c5b653c8c837`::ref 0 aborting False >Thread-40::DEBUG::2014-07-10 10:05:28,290::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lion.qa.lab.tlv.redhat.com:_export_yuri2_backup2/6a70504d-00df-4869-8695-0f442053f6b6/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-40::DEBUG::2014-07-10 10:05:28,311::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n369 bytes (369 B) copied, 0.000457031 s, 807 kB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 10:05:29,580::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-14::DEBUG::2014-07-10 10:05:29,581::task::595::TaskManager.Task::(_updateState) Task=`109fa25a-9430-4c3b-8d64-c7af9027c732`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 10:05:29,581::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-14::INFO::2014-07-10 10:05:29,581::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 10:05:29,582::task::1185::TaskManager.Task::(prepare) Task=`109fa25a-9430-4c3b-8d64-c7af9027c732`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 10:05:29,582::task::595::TaskManager.Task::(_updateState) Task=`109fa25a-9430-4c3b-8d64-c7af9027c732`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 10:05:29,582::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 10:05:29,582::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 10:05:29,583::task::990::TaskManager.Task::(_decref) Task=`109fa25a-9430-4c3b-8d64-c7af9027c732`::ref 0 aborting False >Thread-34::DEBUG::2014-07-10 10:05:29,587::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-34::DEBUG::2014-07-10 10:05:29,587::task::595::TaskManager.Task::(_updateState) Task=`b392d5d3-dd12-499c-af8f-18d405619515`::moving from state init -> state preparing >Thread-34::INFO::2014-07-10 10:05:29,588::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-34::DEBUG::2014-07-10 10:05:29,588::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`753f6db4-796f-480d-ba1e-f17f31b16bb3`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-10 10:05:29,589::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' for lock type 'shared' >Thread-34::DEBUG::2014-07-10 10:05:29,589::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-10 10:05:29,589::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`753f6db4-796f-480d-ba1e-f17f31b16bb3`::Granted request >Thread-34::DEBUG::2014-07-10 10:05:29,590::task::827::TaskManager.Task::(resourceAcquired) Task=`b392d5d3-dd12-499c-af8f-18d405619515`::_resourcesAcquired: Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee (shared) >Thread-34::DEBUG::2014-07-10 10:05:29,590::task::990::TaskManager.Task::(_decref) Task=`b392d5d3-dd12-499c-af8f-18d405619515`::ref 1 aborting False >Thread-34::INFO::2014-07-10 10:05:29,591::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '531976159232', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 10:05:29,592::task::1185::TaskManager.Task::(prepare) Task=`b392d5d3-dd12-499c-af8f-18d405619515`::finished: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '531976159232', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 10:05:29,592::task::595::TaskManager.Task::(_updateState) Task=`b392d5d3-dd12-499c-af8f-18d405619515`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-10 10:05:29,592::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee': < ResourceRef 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-10 10:05:29,592::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-10 10:05:29,593::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' >Thread-34::DEBUG::2014-07-10 10:05:29,593::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' (0 active users) >Thread-34::DEBUG::2014-07-10 10:05:29,593::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-10 10:05:29,593::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', Clearing records. >Thread-34::DEBUG::2014-07-10 10:05:29,593::task::990::TaskManager.Task::(_decref) Task=`b392d5d3-dd12-499c-af8f-18d405619515`::ref 0 aborting False >Thread-76::DEBUG::2014-07-10 10:05:30,015::task::595::TaskManager.Task::(_updateState) Task=`a1986339-7723-4178-aaae-60066b99612f`::moving from state init -> state preparing >Thread-76::INFO::2014-07-10 10:05:30,016::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='e4c65229-4247-4b33-b72a-f1d5ce72ad05', volUUID='cad94284-3ca9-4c30-933d-997f4460309e', options=None) >Thread-76::INFO::2014-07-10 10:05:30,016::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-76::DEBUG::2014-07-10 10:05:30,016::task::1185::TaskManager.Task::(prepare) Task=`a1986339-7723-4178-aaae-60066b99612f`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-76::DEBUG::2014-07-10 10:05:30,017::task::595::TaskManager.Task::(_updateState) Task=`a1986339-7723-4178-aaae-60066b99612f`::moving from state preparing -> state finished >Thread-76::DEBUG::2014-07-10 10:05:30,017::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-76::DEBUG::2014-07-10 10:05:30,017::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-76::DEBUG::2014-07-10 10:05:30,017::task::990::TaskManager.Task::(_decref) Task=`a1986339-7723-4178-aaae-60066b99612f`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 10:05:30,030::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 10:05:30,166::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.03786 s, 27.0 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 10:05:32,181::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 10:05:32,284::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0355624 s, 28.8 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-10 10:05:33,650::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/metadata bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-10 10:05:33,672::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000785118 s, 5.2 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 10:05:34,300::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 10:05:34,395::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0355344 s, 28.8 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 10:05:36,410::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 10:05:36,501::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0325979 s, 31.4 MB/s\n'; <rc> = 0 >Thread-40::DEBUG::2014-07-10 10:05:38,342::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lion.qa.lab.tlv.redhat.com:_export_yuri2_backup2/6a70504d-00df-4869-8695-0f442053f6b6/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-40::DEBUG::2014-07-10 10:05:38,363::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n369 bytes (369 B) copied, 0.000479799 s, 769 kB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 10:05:38,518::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 10:05:38,612::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.035208 s, 29.1 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 10:05:39,618::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-14::DEBUG::2014-07-10 10:05:39,619::task::595::TaskManager.Task::(_updateState) Task=`852ec98a-bca1-46d0-b4c6-662df04dd0ed`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 10:05:39,619::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-14::INFO::2014-07-10 10:05:39,620::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 10:05:39,620::task::1185::TaskManager.Task::(prepare) Task=`852ec98a-bca1-46d0-b4c6-662df04dd0ed`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 10:05:39,620::task::595::TaskManager.Task::(_updateState) Task=`852ec98a-bca1-46d0-b4c6-662df04dd0ed`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 10:05:39,620::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 10:05:39,621::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 10:05:39,621::task::990::TaskManager.Task::(_decref) Task=`852ec98a-bca1-46d0-b4c6-662df04dd0ed`::ref 0 aborting False >Thread-34::DEBUG::2014-07-10 10:05:39,625::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-34::DEBUG::2014-07-10 10:05:39,625::task::595::TaskManager.Task::(_updateState) Task=`a744e719-a08b-4fcd-aff7-92d212debb43`::moving from state init -> state preparing >Thread-34::INFO::2014-07-10 10:05:39,626::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-34::DEBUG::2014-07-10 10:05:39,626::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`d2ac5543-d47d-4ed8-8315-21611aca1f20`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-10 10:05:39,627::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' for lock type 'shared' >Thread-34::DEBUG::2014-07-10 10:05:39,627::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-10 10:05:39,627::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`d2ac5543-d47d-4ed8-8315-21611aca1f20`::Granted request >Thread-34::DEBUG::2014-07-10 10:05:39,628::task::827::TaskManager.Task::(resourceAcquired) Task=`a744e719-a08b-4fcd-aff7-92d212debb43`::_resourcesAcquired: Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee (shared) >Thread-34::DEBUG::2014-07-10 10:05:39,628::task::990::TaskManager.Task::(_decref) Task=`a744e719-a08b-4fcd-aff7-92d212debb43`::ref 1 aborting False >Thread-34::INFO::2014-07-10 10:05:39,629::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '531976159232', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 10:05:39,629::task::1185::TaskManager.Task::(prepare) Task=`a744e719-a08b-4fcd-aff7-92d212debb43`::finished: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '531976159232', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 10:05:39,629::task::595::TaskManager.Task::(_updateState) Task=`a744e719-a08b-4fcd-aff7-92d212debb43`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-10 10:05:39,630::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee': < ResourceRef 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-10 10:05:39,630::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-10 10:05:39,630::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' >Thread-34::DEBUG::2014-07-10 10:05:39,630::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' (0 active users) >Thread-34::DEBUG::2014-07-10 10:05:39,630::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-10 10:05:39,631::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', Clearing records. >Thread-34::DEBUG::2014-07-10 10:05:39,631::task::990::TaskManager.Task::(_decref) Task=`a744e719-a08b-4fcd-aff7-92d212debb43`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 10:05:40,627::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 10:05:40,717::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0277126 s, 37.0 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 10:05:42,733::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 10:05:42,826::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0300519 s, 34.1 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 10:05:43,145::task::595::TaskManager.Task::(_updateState) Task=`2867b34b-5785-48de-84bd-437a712740a6`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 10:05:43,147::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::INFO::2014-07-10 10:05:43,147::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000785118', 'lastCheck': '9.4', 'valid': True}, '6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000479799', 'lastCheck': '4.8', 'valid': True}} >Thread-14::DEBUG::2014-07-10 10:05:43,147::task::1185::TaskManager.Task::(prepare) Task=`2867b34b-5785-48de-84bd-437a712740a6`::finished: {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000785118', 'lastCheck': '9.4', 'valid': True}, '6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000479799', 'lastCheck': '4.8', 'valid': True}} >Thread-14::DEBUG::2014-07-10 10:05:43,147::task::595::TaskManager.Task::(_updateState) Task=`2867b34b-5785-48de-84bd-437a712740a6`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 10:05:43,148::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 10:05:43,148::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 10:05:43,148::task::990::TaskManager.Task::(_decref) Task=`2867b34b-5785-48de-84bd-437a712740a6`::ref 0 aborting False >Thread-18::DEBUG::2014-07-10 10:05:43,701::domainMonitor::192::Storage.DomainMonitorThread::(_monitorDomain) Refreshing domain 9e1aa540-1f4e-4ee3-a152-be381ef6c3bd >Thread-18::DEBUG::2014-07-10 10:05:43,702::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with LvMetadataRW backend >Thread-18::DEBUG::2014-07-10 10:05:43,702::blockSD::336::Storage.Misc.excCmd::(readlines) '/bin/dd iflag=direct skip=0 bs=2048 if=/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/metadata count=1' (cwd None) >Thread-18::DEBUG::2014-07-10 10:05:43,722::blockSD::336::Storage.Misc.excCmd::(readlines) SUCCESS: <err> = '1+0 records in\n1+0 records out\n2048 bytes (2.0 kB) copied, 0.000767929 s, 2.7 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-10 10:05:43,723::misc::282::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '2048 bytes (2.0 kB) copied, 0.000767929 s, 2.7 MB/s'], size: 2048 >Thread-18::DEBUG::2014-07-10 10:05:43,723::persistentDict::234::Storage.PersistentDict::(refresh) read lines (LvMetadataRW)=[] >Thread-18::WARNING::2014-07-10 10:05:43,723::persistentDict::256::Storage.PersistentDict::(refresh) data has no embedded checksum - trust it as it is >Thread-18::DEBUG::2014-07-10 10:05:43,723::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with VGTagMetadataRW backend >Thread-18::DEBUG::2014-07-10 10:05:43,724::lvm::503::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-18::DEBUG::2014-07-10 10:05:43,724::lvm::505::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-18::DEBUG::2014-07-10 10:05:43,725::lvm::513::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-18::DEBUG::2014-07-10 10:05:43,725::lvm::525::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-18::DEBUG::2014-07-10 10:05:43,725::lvm::373::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-18::DEBUG::2014-07-10 10:05:43,726::lvm::296::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/3600601601282300032826addbbdae311|/dev/mapper/360060160f4a030003840ec867ddee311|/dev/mapper/367cad74c2fcba00019e6afd20c781e67|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name 9e1aa540-1f4e-4ee3-a152-be381ef6c3bd' (cwd None) >Thread-18::DEBUG::2014-07-10 10:05:44,065::lvm::296::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-18::DEBUG::2014-07-10 10:05:44,069::lvm::415::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-18::DEBUG::2014-07-10 10:05:44,076::persistentDict::234::Storage.PersistentDict::(refresh) read lines (VGTagMetadataRW)=['LEASETIMESEC=60', 'VGUUID=9CsMxb-YbRc-yRG7-cQKD-xY3G-GLi5-YxUyPC', 'VERSION=3', 'TYPE=ISCSI', 'LOGBLKSIZE=512', u'PV0=pv:3600601601282300032826addbbdae311,uuid:7qEb8v-jk2X-3CPk-k4XB-eIBk-onYD-807hcV,pestart:0,pecount:8189,mapoffset:0', 'LEASERETRIES=3', 'IOOPTIMEOUTSEC=10', 'LOCKRENEWALINTERVALSEC=5', 'PHYBLKSIZE=512', 'SDUUID=9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'CLASS=Data', 'LOCKPOLICY=', 'DESCRIPTION=SD_REAL', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=DC_REAL', 'ROLE=Master', 'POOL_UUID=4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', 'POOL_SPM_ID=1', 'POOL_SPM_LVER=0', '_SHA_CKSUM=013b5a7910962201c4cceab31b9c6d9c79f7316f', u'POOL_DOMAINS=9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active'] >Thread-18::INFO::2014-07-10 10:05:44,078::sd::384::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 9e1aa540-1f4e-4ee3-a152-be381ef6c3bd_imageNS already registered >Thread-18::INFO::2014-07-10 10:05:44,078::sd::392::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 9e1aa540-1f4e-4ee3-a152-be381ef6c3bd_volumeNS already registered >Thread-18::INFO::2014-07-10 10:05:44,078::blockSD::452::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 9e1aa540-1f4e-4ee3-a152-be381ef6c3bd_lvmActivationNS already registered >Thread-18::DEBUG::2014-07-10 10:05:44,079::lvm::296::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgck --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/3600601601282300032826addbbdae311|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } " 9e1aa540-1f4e-4ee3-a152-be381ef6c3bd' (cwd None) >Thread-18::DEBUG::2014-07-10 10:05:44,308::lvm::296::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-18::DEBUG::2014-07-10 10:05:44,310::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/metadata bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-10 10:05:44,331::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000731423 s, 5.6 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 10:05:44,842::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 10:05:44,935::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0322648 s, 31.7 MB/s\n'; <rc> = 0 >Thread-70::DEBUG::2014-07-10 10:05:46,838::task::595::TaskManager.Task::(_updateState) Task=`afb12acd-edc1-4905-a1b6-c3e88b1815c4`::moving from state init -> state preparing >Thread-70::INFO::2014-07-10 10:05:46,839::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='cfaeead2-7caa-467c-b389-c89840ae6605', volUUID='567fe32d-31a6-4ff6-90f3-fd6a656fbecc', options=None) >Thread-70::INFO::2014-07-10 10:05:46,839::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-70::DEBUG::2014-07-10 10:05:46,839::task::1185::TaskManager.Task::(prepare) Task=`afb12acd-edc1-4905-a1b6-c3e88b1815c4`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-70::DEBUG::2014-07-10 10:05:46,839::task::595::TaskManager.Task::(_updateState) Task=`afb12acd-edc1-4905-a1b6-c3e88b1815c4`::moving from state preparing -> state finished >Thread-70::DEBUG::2014-07-10 10:05:46,840::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-70::DEBUG::2014-07-10 10:05:46,840::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-70::DEBUG::2014-07-10 10:05:46,840::task::990::TaskManager.Task::(_decref) Task=`afb12acd-edc1-4905-a1b6-c3e88b1815c4`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 10:05:46,951::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 10:05:47,039::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0308157 s, 33.2 MB/s\n'; <rc> = 0 >Thread-40::DEBUG::2014-07-10 10:05:48,398::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lion.qa.lab.tlv.redhat.com:_export_yuri2_backup2/6a70504d-00df-4869-8695-0f442053f6b6/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-40::DEBUG::2014-07-10 10:05:48,419::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n369 bytes (369 B) copied, 0.000492825 s, 749 kB/s\n'; <rc> = 0 >Thread-51::DEBUG::2014-07-10 10:05:49,053::task::595::TaskManager.Task::(_updateState) Task=`ca64e900-132f-4582-9137-32ab7ec0a0ce`::moving from state init -> state preparing >Thread-51::INFO::2014-07-10 10:05:49,054::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='76fdb054-02cd-42ed-9721-b3e65b34c3a4', volUUID='022dfe46-2cf7-4915-80b3-883158e3ca83', options=None) >Thread-60::DEBUG::2014-07-10 10:05:49,054::task::595::TaskManager.Task::(_updateState) Task=`30169591-e308-4757-bc8f-66a357b2a174`::moving from state init -> state preparing >Thread-51::INFO::2014-07-10 10:05:49,055::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-60::INFO::2014-07-10 10:05:49,055::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='b034d5b0-e1e0-4011-b49b-4d45ddb11556', volUUID='3d7f62b5-328f-4d8e-8b69-873cfb5ae14d', options=None) >Thread-51::DEBUG::2014-07-10 10:05:49,055::task::1185::TaskManager.Task::(prepare) Task=`ca64e900-132f-4582-9137-32ab7ec0a0ce`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-51::DEBUG::2014-07-10 10:05:49,055::task::595::TaskManager.Task::(_updateState) Task=`ca64e900-132f-4582-9137-32ab7ec0a0ce`::moving from state preparing -> state finished >Thread-51::DEBUG::2014-07-10 10:05:49,056::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-60::INFO::2014-07-10 10:05:49,056::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-51::DEBUG::2014-07-10 10:05:49,056::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-60::DEBUG::2014-07-10 10:05:49,056::task::1185::TaskManager.Task::(prepare) Task=`30169591-e308-4757-bc8f-66a357b2a174`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-51::DEBUG::2014-07-10 10:05:49,056::task::990::TaskManager.Task::(_decref) Task=`ca64e900-132f-4582-9137-32ab7ec0a0ce`::ref 0 aborting False >Thread-60::DEBUG::2014-07-10 10:05:49,057::task::595::TaskManager.Task::(_updateState) Task=`30169591-e308-4757-bc8f-66a357b2a174`::moving from state preparing -> state finished >Thread-60::DEBUG::2014-07-10 10:05:49,057::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-60::DEBUG::2014-07-10 10:05:49,057::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Dummy-33::DEBUG::2014-07-10 10:05:49,058::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Thread-60::DEBUG::2014-07-10 10:05:49,058::task::990::TaskManager.Task::(_decref) Task=`30169591-e308-4757-bc8f-66a357b2a174`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 10:05:49,151::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.030311 s, 33.8 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 10:05:49,708::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-14::DEBUG::2014-07-10 10:05:49,709::task::595::TaskManager.Task::(_updateState) Task=`5d899b44-ef11-4fa0-a790-85369ba5d458`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 10:05:49,709::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-14::INFO::2014-07-10 10:05:49,710::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 10:05:49,710::task::1185::TaskManager.Task::(prepare) Task=`5d899b44-ef11-4fa0-a790-85369ba5d458`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 10:05:49,710::task::595::TaskManager.Task::(_updateState) Task=`5d899b44-ef11-4fa0-a790-85369ba5d458`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 10:05:49,711::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 10:05:49,711::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 10:05:49,711::task::990::TaskManager.Task::(_decref) Task=`5d899b44-ef11-4fa0-a790-85369ba5d458`::ref 0 aborting False >Thread-34::DEBUG::2014-07-10 10:05:49,715::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-34::DEBUG::2014-07-10 10:05:49,715::task::595::TaskManager.Task::(_updateState) Task=`3b5d83b0-5bcd-4d22-868a-0781c2a3ab56`::moving from state init -> state preparing >Thread-34::INFO::2014-07-10 10:05:49,716::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-34::DEBUG::2014-07-10 10:05:49,716::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`86a4d2c7-a335-47e1-97a2-4457fe038d88`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-10 10:05:49,717::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' for lock type 'shared' >Thread-34::DEBUG::2014-07-10 10:05:49,717::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-10 10:05:49,717::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`86a4d2c7-a335-47e1-97a2-4457fe038d88`::Granted request >Thread-34::DEBUG::2014-07-10 10:05:49,718::task::827::TaskManager.Task::(resourceAcquired) Task=`3b5d83b0-5bcd-4d22-868a-0781c2a3ab56`::_resourcesAcquired: Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee (shared) >Thread-34::DEBUG::2014-07-10 10:05:49,718::task::990::TaskManager.Task::(_decref) Task=`3b5d83b0-5bcd-4d22-868a-0781c2a3ab56`::ref 1 aborting False >Thread-34::INFO::2014-07-10 10:05:49,719::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '531976159232', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 10:05:49,719::task::1185::TaskManager.Task::(prepare) Task=`3b5d83b0-5bcd-4d22-868a-0781c2a3ab56`::finished: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '531976159232', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 10:05:49,719::task::595::TaskManager.Task::(_updateState) Task=`3b5d83b0-5bcd-4d22-868a-0781c2a3ab56`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-10 10:05:49,720::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee': < ResourceRef 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-10 10:05:49,720::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-10 10:05:49,720::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' >Thread-34::DEBUG::2014-07-10 10:05:49,720::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' (0 active users) >Thread-34::DEBUG::2014-07-10 10:05:49,720::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-10 10:05:49,721::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', Clearing records. >Thread-34::DEBUG::2014-07-10 10:05:49,721::task::990::TaskManager.Task::(_decref) Task=`3b5d83b0-5bcd-4d22-868a-0781c2a3ab56`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 10:05:51,166::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 10:05:51,258::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0342644 s, 29.9 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 10:05:53,276::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 10:05:53,368::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0330248 s, 31.0 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-10 10:05:54,362::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/metadata bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-10 10:05:54,384::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000792279 s, 5.2 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 10:05:55,384::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 10:05:55,542::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0300403 s, 34.1 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 10:05:57,557::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 10:05:57,684::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0522421 s, 19.6 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 10:05:58,329::task::595::TaskManager.Task::(_updateState) Task=`d42ff9b5-4f4a-4021-8aec-8dae67755a8a`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 10:05:58,330::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::INFO::2014-07-10 10:05:58,330::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000792279', 'lastCheck': '3.9', 'valid': True}, '6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000492825', 'lastCheck': '9.9', 'valid': True}} >Thread-14::DEBUG::2014-07-10 10:05:58,330::task::1185::TaskManager.Task::(prepare) Task=`d42ff9b5-4f4a-4021-8aec-8dae67755a8a`::finished: {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000792279', 'lastCheck': '3.9', 'valid': True}, '6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000492825', 'lastCheck': '9.9', 'valid': True}} >Thread-14::DEBUG::2014-07-10 10:05:58,330::task::595::TaskManager.Task::(_updateState) Task=`d42ff9b5-4f4a-4021-8aec-8dae67755a8a`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 10:05:58,331::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 10:05:58,331::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 10:05:58,331::task::990::TaskManager.Task::(_decref) Task=`d42ff9b5-4f4a-4021-8aec-8dae67755a8a`::ref 0 aborting False >Thread-40::DEBUG::2014-07-10 10:05:58,450::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lion.qa.lab.tlv.redhat.com:_export_yuri2_backup2/6a70504d-00df-4869-8695-0f442053f6b6/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-40::DEBUG::2014-07-10 10:05:58,484::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n369 bytes (369 B) copied, 0.000423802 s, 871 kB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 10:05:59,701::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Thread-14::DEBUG::2014-07-10 10:05:59,747::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-14::DEBUG::2014-07-10 10:05:59,752::task::595::TaskManager.Task::(_updateState) Task=`71e0b465-935d-4f9b-a57f-e2fde53ee08d`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 10:05:59,755::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-14::INFO::2014-07-10 10:05:59,760::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 10:05:59,762::task::1185::TaskManager.Task::(prepare) Task=`71e0b465-935d-4f9b-a57f-e2fde53ee08d`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 10:05:59,764::task::595::TaskManager.Task::(_updateState) Task=`71e0b465-935d-4f9b-a57f-e2fde53ee08d`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 10:05:59,766::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 10:05:59,769::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 10:05:59,772::task::990::TaskManager.Task::(_decref) Task=`71e0b465-935d-4f9b-a57f-e2fde53ee08d`::ref 0 aborting False >Thread-34::DEBUG::2014-07-10 10:05:59,824::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-34::DEBUG::2014-07-10 10:05:59,829::task::595::TaskManager.Task::(_updateState) Task=`2dec1aea-32df-4c3e-b619-fcc17e14c561`::moving from state init -> state preparing >Thread-34::INFO::2014-07-10 10:05:59,832::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-34::DEBUG::2014-07-10 10:05:59,839::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`a23d4788-a6b0-4454-a441-e7466b89a579`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-10 10:05:59,841::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' for lock type 'shared' >Thread-34::DEBUG::2014-07-10 10:05:59,845::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-10 10:05:59,847::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`a23d4788-a6b0-4454-a441-e7466b89a579`::Granted request >Thread-34::DEBUG::2014-07-10 10:05:59,852::task::827::TaskManager.Task::(resourceAcquired) Task=`2dec1aea-32df-4c3e-b619-fcc17e14c561`::_resourcesAcquired: Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee (shared) >Thread-34::DEBUG::2014-07-10 10:05:59,855::task::990::TaskManager.Task::(_decref) Task=`2dec1aea-32df-4c3e-b619-fcc17e14c561`::ref 1 aborting False >Thread-34::INFO::2014-07-10 10:05:59,868::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '531976159232', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 10:05:59,871::task::1185::TaskManager.Task::(prepare) Task=`2dec1aea-32df-4c3e-b619-fcc17e14c561`::finished: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '531976159232', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 10:05:59,873::task::595::TaskManager.Task::(_updateState) Task=`2dec1aea-32df-4c3e-b619-fcc17e14c561`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-10 10:05:59,875::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee': < ResourceRef 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-10 10:05:59,878::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-10 10:05:59,881::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' >Thread-34::DEBUG::2014-07-10 10:05:59,885::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' (0 active users) >Thread-34::DEBUG::2014-07-10 10:05:59,887::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-10 10:05:59,890::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', Clearing records. >Thread-34::DEBUG::2014-07-10 10:05:59,895::task::990::TaskManager.Task::(_decref) Task=`2dec1aea-32df-4c3e-b619-fcc17e14c561`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 10:05:59,914::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0725418 s, 14.1 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 10:06:01,930::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 10:06:02,018::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0289683 s, 35.3 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 10:06:04,032::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 10:06:04,120::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0304606 s, 33.6 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-10 10:06:04,417::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/metadata bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-10 10:06:04,438::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000678714 s, 6.0 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 10:06:06,135::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 10:06:06,232::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0381094 s, 26.9 MB/s\n'; <rc> = 0 >Thread-64::DEBUG::2014-07-10 10:06:07,003::task::595::TaskManager.Task::(_updateState) Task=`58f1c92d-76e1-4a2e-aa62-ea25ebfbdbd6`::moving from state init -> state preparing >Thread-64::INFO::2014-07-10 10:06:07,004::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='aa20346a-4d3a-4e07-b8e1-52c0ebe4168c', volUUID='58fefce2-9bce-4bff-8949-8c6ce8122b27', options=None) >Thread-64::INFO::2014-07-10 10:06:07,004::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-64::DEBUG::2014-07-10 10:06:07,005::task::1185::TaskManager.Task::(prepare) Task=`58f1c92d-76e1-4a2e-aa62-ea25ebfbdbd6`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-64::DEBUG::2014-07-10 10:06:07,005::task::595::TaskManager.Task::(_updateState) Task=`58f1c92d-76e1-4a2e-aa62-ea25ebfbdbd6`::moving from state preparing -> state finished >Thread-64::DEBUG::2014-07-10 10:06:07,005::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-64::DEBUG::2014-07-10 10:06:07,005::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-64::DEBUG::2014-07-10 10:06:07,005::task::990::TaskManager.Task::(_decref) Task=`58f1c92d-76e1-4a2e-aa62-ea25ebfbdbd6`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 10:06:08,253::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 10:06:08,351::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0363113 s, 28.2 MB/s\n'; <rc> = 0 >Thread-40::DEBUG::2014-07-10 10:06:08,514::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lion.qa.lab.tlv.redhat.com:_export_yuri2_backup2/6a70504d-00df-4869-8695-0f442053f6b6/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-40::DEBUG::2014-07-10 10:06:08,533::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n369 bytes (369 B) copied, 0.000428924 s, 860 kB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 10:06:09,926::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-14::DEBUG::2014-07-10 10:06:09,927::task::595::TaskManager.Task::(_updateState) Task=`e3e5d9c2-c589-4673-ad97-99a5842e91bf`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 10:06:09,928::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-14::INFO::2014-07-10 10:06:09,928::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 10:06:09,928::task::1185::TaskManager.Task::(prepare) Task=`e3e5d9c2-c589-4673-ad97-99a5842e91bf`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 10:06:09,929::task::595::TaskManager.Task::(_updateState) Task=`e3e5d9c2-c589-4673-ad97-99a5842e91bf`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 10:06:09,929::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 10:06:09,929::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 10:06:09,929::task::990::TaskManager.Task::(_decref) Task=`e3e5d9c2-c589-4673-ad97-99a5842e91bf`::ref 0 aborting False >Thread-34::DEBUG::2014-07-10 10:06:09,933::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-34::DEBUG::2014-07-10 10:06:09,934::task::595::TaskManager.Task::(_updateState) Task=`d259f873-760a-49d5-b9d3-e8bbce4c3b69`::moving from state init -> state preparing >Thread-34::INFO::2014-07-10 10:06:09,934::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-34::DEBUG::2014-07-10 10:06:09,934::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`0c6caab5-179d-4f99-a351-08b4bee32759`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-10 10:06:09,935::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' for lock type 'shared' >Thread-34::DEBUG::2014-07-10 10:06:09,935::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-10 10:06:09,935::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`0c6caab5-179d-4f99-a351-08b4bee32759`::Granted request >Thread-34::DEBUG::2014-07-10 10:06:09,936::task::827::TaskManager.Task::(resourceAcquired) Task=`d259f873-760a-49d5-b9d3-e8bbce4c3b69`::_resourcesAcquired: Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee (shared) >Thread-34::DEBUG::2014-07-10 10:06:09,936::task::990::TaskManager.Task::(_decref) Task=`d259f873-760a-49d5-b9d3-e8bbce4c3b69`::ref 1 aborting False >Thread-34::INFO::2014-07-10 10:06:09,937::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '531976159232', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 10:06:09,937::task::1185::TaskManager.Task::(prepare) Task=`d259f873-760a-49d5-b9d3-e8bbce4c3b69`::finished: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '531976159232', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 10:06:09,937::task::595::TaskManager.Task::(_updateState) Task=`d259f873-760a-49d5-b9d3-e8bbce4c3b69`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-10 10:06:09,937::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee': < ResourceRef 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-10 10:06:09,938::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-10 10:06:09,938::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' >Thread-34::DEBUG::2014-07-10 10:06:09,938::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' (0 active users) >Thread-34::DEBUG::2014-07-10 10:06:09,938::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-10 10:06:09,938::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', Clearing records. >Thread-34::DEBUG::2014-07-10 10:06:09,938::task::990::TaskManager.Task::(_decref) Task=`d259f873-760a-49d5-b9d3-e8bbce4c3b69`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 10:06:10,366::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 10:06:10,454::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0324029 s, 31.6 MB/s\n'; <rc> = 0 >Thread-54::DEBUG::2014-07-10 10:06:10,786::task::595::TaskManager.Task::(_updateState) Task=`e21349fc-26ec-4d3c-98fa-02d599ab4b3d`::moving from state init -> state preparing >Thread-54::INFO::2014-07-10 10:06:10,786::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='28408446-e5fd-4565-a976-e760951593fe', volUUID='776303a2-5585-451e-826e-0e338d4a1e98', options=None) >Thread-54::INFO::2014-07-10 10:06:10,787::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-54::DEBUG::2014-07-10 10:06:10,787::task::1185::TaskManager.Task::(prepare) Task=`e21349fc-26ec-4d3c-98fa-02d599ab4b3d`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-54::DEBUG::2014-07-10 10:06:10,787::task::595::TaskManager.Task::(_updateState) Task=`e21349fc-26ec-4d3c-98fa-02d599ab4b3d`::moving from state preparing -> state finished >Thread-54::DEBUG::2014-07-10 10:06:10,788::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-54::DEBUG::2014-07-10 10:06:10,788::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-54::DEBUG::2014-07-10 10:06:10,788::task::990::TaskManager.Task::(_decref) Task=`e21349fc-26ec-4d3c-98fa-02d599ab4b3d`::ref 0 aborting False >Thread-73::DEBUG::2014-07-10 10:06:10,792::task::595::TaskManager.Task::(_updateState) Task=`74b23afc-f52f-4f1c-bbce-e81859c83362`::moving from state init -> state preparing >Thread-73::INFO::2014-07-10 10:06:10,792::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='c01d693b-cba0-4fed-9ad7-0aaa28912a19', volUUID='4bb5d954-2a50-4028-b299-0b43c261270c', options=None) >Thread-73::INFO::2014-07-10 10:06:10,793::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-73::DEBUG::2014-07-10 10:06:10,793::task::1185::TaskManager.Task::(prepare) Task=`74b23afc-f52f-4f1c-bbce-e81859c83362`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-73::DEBUG::2014-07-10 10:06:10,793::task::595::TaskManager.Task::(_updateState) Task=`74b23afc-f52f-4f1c-bbce-e81859c83362`::moving from state preparing -> state finished >Thread-73::DEBUG::2014-07-10 10:06:10,794::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-73::DEBUG::2014-07-10 10:06:10,794::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-73::DEBUG::2014-07-10 10:06:10,795::task::990::TaskManager.Task::(_decref) Task=`74b23afc-f52f-4f1c-bbce-e81859c83362`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 10:06:12,470::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 10:06:12,561::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0357295 s, 28.7 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 10:06:13,522::task::595::TaskManager.Task::(_updateState) Task=`6f24c82a-257c-449d-8a28-1eb7a74692d1`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 10:06:13,523::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::INFO::2014-07-10 10:06:13,523::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000678714', 'lastCheck': '9.0', 'valid': True}, '6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000428924', 'lastCheck': '5.0', 'valid': True}} >Thread-14::DEBUG::2014-07-10 10:06:13,523::task::1185::TaskManager.Task::(prepare) Task=`6f24c82a-257c-449d-8a28-1eb7a74692d1`::finished: {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000678714', 'lastCheck': '9.0', 'valid': True}, '6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000428924', 'lastCheck': '5.0', 'valid': True}} >Thread-14::DEBUG::2014-07-10 10:06:13,523::task::595::TaskManager.Task::(_updateState) Task=`6f24c82a-257c-449d-8a28-1eb7a74692d1`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 10:06:13,524::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 10:06:13,524::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 10:06:13,524::task::990::TaskManager.Task::(_decref) Task=`6f24c82a-257c-449d-8a28-1eb7a74692d1`::ref 0 aborting False >Thread-18::DEBUG::2014-07-10 10:06:14,487::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/metadata bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-10 10:06:14,509::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00089067 s, 4.6 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 10:06:14,577::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 10:06:14,671::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0355582 s, 28.8 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 10:06:16,686::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 10:06:16,774::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0297144 s, 34.5 MB/s\n'; <rc> = 0 >Thread-40::DEBUG::2014-07-10 10:06:18,564::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lion.qa.lab.tlv.redhat.com:_export_yuri2_backup2/6a70504d-00df-4869-8695-0f442053f6b6/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-40::DEBUG::2014-07-10 10:06:18,586::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n369 bytes (369 B) copied, 0.000501811 s, 735 kB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 10:06:18,789::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 10:06:18,877::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.029577 s, 34.6 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 10:06:19,967::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-14::DEBUG::2014-07-10 10:06:19,968::task::595::TaskManager.Task::(_updateState) Task=`8644284e-799e-440f-a6ca-608775b58e10`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 10:06:19,969::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-14::INFO::2014-07-10 10:06:19,969::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 10:06:19,970::task::1185::TaskManager.Task::(prepare) Task=`8644284e-799e-440f-a6ca-608775b58e10`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 10:06:19,970::task::595::TaskManager.Task::(_updateState) Task=`8644284e-799e-440f-a6ca-608775b58e10`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 10:06:19,970::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 10:06:19,970::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 10:06:19,970::task::990::TaskManager.Task::(_decref) Task=`8644284e-799e-440f-a6ca-608775b58e10`::ref 0 aborting False >Thread-34::DEBUG::2014-07-10 10:06:19,974::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-34::DEBUG::2014-07-10 10:06:19,975::task::595::TaskManager.Task::(_updateState) Task=`6d083597-e31d-4ba6-97fa-31dd79355451`::moving from state init -> state preparing >Thread-34::INFO::2014-07-10 10:06:19,975::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-34::DEBUG::2014-07-10 10:06:19,976::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`0fe6492c-229a-4c90-a854-19426bade4c7`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-10 10:06:19,976::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' for lock type 'shared' >Thread-34::DEBUG::2014-07-10 10:06:19,976::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-10 10:06:19,977::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`0fe6492c-229a-4c90-a854-19426bade4c7`::Granted request >Thread-34::DEBUG::2014-07-10 10:06:19,977::task::827::TaskManager.Task::(resourceAcquired) Task=`6d083597-e31d-4ba6-97fa-31dd79355451`::_resourcesAcquired: Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee (shared) >Thread-34::DEBUG::2014-07-10 10:06:19,977::task::990::TaskManager.Task::(_decref) Task=`6d083597-e31d-4ba6-97fa-31dd79355451`::ref 1 aborting False >Thread-34::INFO::2014-07-10 10:06:19,979::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '531976159232', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 10:06:19,979::task::1185::TaskManager.Task::(prepare) Task=`6d083597-e31d-4ba6-97fa-31dd79355451`::finished: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '531976159232', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 10:06:19,979::task::595::TaskManager.Task::(_updateState) Task=`6d083597-e31d-4ba6-97fa-31dd79355451`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-10 10:06:19,979::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee': < ResourceRef 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-10 10:06:19,979::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-10 10:06:19,980::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' >Thread-34::DEBUG::2014-07-10 10:06:19,980::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' (0 active users) >Thread-34::DEBUG::2014-07-10 10:06:19,980::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-10 10:06:19,980::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', Clearing records. >Thread-34::DEBUG::2014-07-10 10:06:19,981::task::990::TaskManager.Task::(_decref) Task=`6d083597-e31d-4ba6-97fa-31dd79355451`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 10:06:20,897::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 10:06:21,003::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0323957 s, 31.6 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 10:06:23,018::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 10:06:23,106::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0296455 s, 34.5 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-10 10:06:24,539::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/metadata bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-10 10:06:24,560::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000820688 s, 5.0 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 10:06:25,122::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 10:06:25,209::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.026929 s, 38.0 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 10:06:27,225::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 10:06:27,339::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0529644 s, 19.3 MB/s\n'; <rc> = 0 >Thread-57::DEBUG::2014-07-10 10:06:27,413::task::595::TaskManager.Task::(_updateState) Task=`5d3c8148-b46f-422b-a90b-5eb9eefaf17a`::moving from state init -> state preparing >Thread-57::INFO::2014-07-10 10:06:27,414::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='b6f6c0da-e67f-4902-b9ac-3069571a42fe', volUUID='c4cd1da8-05b7-45e0-80b1-1183d21443d9', options=None) >Thread-57::INFO::2014-07-10 10:06:27,415::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-57::DEBUG::2014-07-10 10:06:27,415::task::1185::TaskManager.Task::(prepare) Task=`5d3c8148-b46f-422b-a90b-5eb9eefaf17a`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-57::DEBUG::2014-07-10 10:06:27,415::task::595::TaskManager.Task::(_updateState) Task=`5d3c8148-b46f-422b-a90b-5eb9eefaf17a`::moving from state preparing -> state finished >Thread-57::DEBUG::2014-07-10 10:06:27,415::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-57::DEBUG::2014-07-10 10:06:27,415::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-57::DEBUG::2014-07-10 10:06:27,416::task::990::TaskManager.Task::(_decref) Task=`5d3c8148-b46f-422b-a90b-5eb9eefaf17a`::ref 0 aborting False >Thread-67::DEBUG::2014-07-10 10:06:28,325::task::595::TaskManager.Task::(_updateState) Task=`fc9f01d5-7fed-4f5c-84eb-c29c1da7138a`::moving from state init -> state preparing >Thread-67::INFO::2014-07-10 10:06:28,326::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='f30c2cb7-a43a-4bf5-82b5-cfe07336f65c', volUUID='b0fbb3c9-55af-4a3a-95ad-fc56a80b9cf5', options=None) >Thread-67::INFO::2014-07-10 10:06:28,326::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-67::DEBUG::2014-07-10 10:06:28,327::task::1185::TaskManager.Task::(prepare) Task=`fc9f01d5-7fed-4f5c-84eb-c29c1da7138a`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-67::DEBUG::2014-07-10 10:06:28,327::task::595::TaskManager.Task::(_updateState) Task=`fc9f01d5-7fed-4f5c-84eb-c29c1da7138a`::moving from state preparing -> state finished >Thread-67::DEBUG::2014-07-10 10:06:28,327::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-67::DEBUG::2014-07-10 10:06:28,327::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-67::DEBUG::2014-07-10 10:06:28,327::task::990::TaskManager.Task::(_decref) Task=`fc9f01d5-7fed-4f5c-84eb-c29c1da7138a`::ref 0 aborting False >Thread-48::DEBUG::2014-07-10 10:06:28,398::task::595::TaskManager.Task::(_updateState) Task=`f548d1d0-b758-47a0-ba6f-e858c1930227`::moving from state init -> state preparing >Thread-48::INFO::2014-07-10 10:06:28,398::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='0cd7d6ce-f497-4243-a690-c57744861eea', volUUID='10b6a7dd-dc6c-43fa-ba17-92e4331b0e0b', options=None) >Thread-48::INFO::2014-07-10 10:06:28,399::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-48::DEBUG::2014-07-10 10:06:28,399::task::1185::TaskManager.Task::(prepare) Task=`f548d1d0-b758-47a0-ba6f-e858c1930227`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-48::DEBUG::2014-07-10 10:06:28,399::task::595::TaskManager.Task::(_updateState) Task=`f548d1d0-b758-47a0-ba6f-e858c1930227`::moving from state preparing -> state finished >Thread-48::DEBUG::2014-07-10 10:06:28,399::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-48::DEBUG::2014-07-10 10:06:28,399::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-48::DEBUG::2014-07-10 10:06:28,400::task::990::TaskManager.Task::(_decref) Task=`f548d1d0-b758-47a0-ba6f-e858c1930227`::ref 0 aborting False >Thread-40::DEBUG::2014-07-10 10:06:28,614::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lion.qa.lab.tlv.redhat.com:_export_yuri2_backup2/6a70504d-00df-4869-8695-0f442053f6b6/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-40::DEBUG::2014-07-10 10:06:28,637::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n369 bytes (369 B) copied, 0.00195845 s, 188 kB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 10:06:28,732::task::595::TaskManager.Task::(_updateState) Task=`421bb7a4-884c-42ff-b6dd-d6a481c28bbd`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 10:06:28,733::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::INFO::2014-07-10 10:06:28,734::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000820688', 'lastCheck': '4.1', 'valid': True}, '6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00195845', 'lastCheck': '0.1', 'valid': True}} >Thread-14::DEBUG::2014-07-10 10:06:28,734::task::1185::TaskManager.Task::(prepare) Task=`421bb7a4-884c-42ff-b6dd-d6a481c28bbd`::finished: {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000820688', 'lastCheck': '4.1', 'valid': True}, '6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00195845', 'lastCheck': '0.1', 'valid': True}} >Thread-14::DEBUG::2014-07-10 10:06:28,734::task::595::TaskManager.Task::(_updateState) Task=`421bb7a4-884c-42ff-b6dd-d6a481c28bbd`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 10:06:28,734::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 10:06:28,735::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 10:06:28,735::task::990::TaskManager.Task::(_decref) Task=`421bb7a4-884c-42ff-b6dd-d6a481c28bbd`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 10:06:29,354::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 10:06:29,450::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0371263 s, 27.6 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 10:06:30,001::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-14::DEBUG::2014-07-10 10:06:30,002::task::595::TaskManager.Task::(_updateState) Task=`8536dfb1-892a-4c92-99ef-371aee326644`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 10:06:30,002::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-14::INFO::2014-07-10 10:06:30,003::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 10:06:30,003::task::1185::TaskManager.Task::(prepare) Task=`8536dfb1-892a-4c92-99ef-371aee326644`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 10:06:30,003::task::595::TaskManager.Task::(_updateState) Task=`8536dfb1-892a-4c92-99ef-371aee326644`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 10:06:30,003::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 10:06:30,003::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 10:06:30,004::task::990::TaskManager.Task::(_decref) Task=`8536dfb1-892a-4c92-99ef-371aee326644`::ref 0 aborting False >Thread-34::DEBUG::2014-07-10 10:06:30,048::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-34::DEBUG::2014-07-10 10:06:30,049::task::595::TaskManager.Task::(_updateState) Task=`e66742fe-7378-4603-9021-dccf2085e5a1`::moving from state init -> state preparing >Thread-34::INFO::2014-07-10 10:06:30,050::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-34::DEBUG::2014-07-10 10:06:30,050::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`a41e9ba3-3398-485b-8dff-6e77ddcca506`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-10 10:06:30,050::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' for lock type 'shared' >Thread-34::DEBUG::2014-07-10 10:06:30,051::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-10 10:06:30,051::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`a41e9ba3-3398-485b-8dff-6e77ddcca506`::Granted request >Thread-34::DEBUG::2014-07-10 10:06:30,052::task::827::TaskManager.Task::(resourceAcquired) Task=`e66742fe-7378-4603-9021-dccf2085e5a1`::_resourcesAcquired: Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee (shared) >Thread-34::DEBUG::2014-07-10 10:06:30,052::task::990::TaskManager.Task::(_decref) Task=`e66742fe-7378-4603-9021-dccf2085e5a1`::ref 1 aborting False >Thread-34::INFO::2014-07-10 10:06:30,053::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '531976159232', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 10:06:30,053::task::1185::TaskManager.Task::(prepare) Task=`e66742fe-7378-4603-9021-dccf2085e5a1`::finished: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '531976159232', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 10:06:30,054::task::595::TaskManager.Task::(_updateState) Task=`e66742fe-7378-4603-9021-dccf2085e5a1`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-10 10:06:30,054::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee': < ResourceRef 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-10 10:06:30,054::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-10 10:06:30,054::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' >Thread-34::DEBUG::2014-07-10 10:06:30,054::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' (0 active users) >Thread-34::DEBUG::2014-07-10 10:06:30,055::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-10 10:06:30,055::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', Clearing records. >Thread-34::DEBUG::2014-07-10 10:06:30,055::task::990::TaskManager.Task::(_decref) Task=`e66742fe-7378-4603-9021-dccf2085e5a1`::ref 0 aborting False >Thread-76::DEBUG::2014-07-10 10:06:30,333::task::595::TaskManager.Task::(_updateState) Task=`ec5df059-094b-46dd-90bc-576e963f9bb7`::moving from state init -> state preparing >Thread-76::INFO::2014-07-10 10:06:30,334::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='e4c65229-4247-4b33-b72a-f1d5ce72ad05', volUUID='cad94284-3ca9-4c30-933d-997f4460309e', options=None) >Thread-76::INFO::2014-07-10 10:06:30,334::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-76::DEBUG::2014-07-10 10:06:30,334::task::1185::TaskManager.Task::(prepare) Task=`ec5df059-094b-46dd-90bc-576e963f9bb7`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-76::DEBUG::2014-07-10 10:06:30,334::task::595::TaskManager.Task::(_updateState) Task=`ec5df059-094b-46dd-90bc-576e963f9bb7`::moving from state preparing -> state finished >Thread-76::DEBUG::2014-07-10 10:06:30,335::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-76::DEBUG::2014-07-10 10:06:30,335::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-76::DEBUG::2014-07-10 10:06:30,335::task::990::TaskManager.Task::(_decref) Task=`ec5df059-094b-46dd-90bc-576e963f9bb7`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 10:06:31,466::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 10:06:31,555::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0286232 s, 35.8 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 10:06:33,570::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 10:06:33,677::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0481567 s, 21.3 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-10 10:06:34,603::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/metadata bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-10 10:06:34,625::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000766702 s, 5.3 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 10:06:35,692::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 10:06:35,809::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0578704 s, 17.7 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 10:06:37,826::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 10:06:37,927::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0292116 s, 35.1 MB/s\n'; <rc> = 0 >Thread-40::DEBUG::2014-07-10 10:06:38,674::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lion.qa.lab.tlv.redhat.com:_export_yuri2_backup2/6a70504d-00df-4869-8695-0f442053f6b6/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-40::DEBUG::2014-07-10 10:06:38,695::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n369 bytes (369 B) copied, 0.000413355 s, 893 kB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 10:06:39,942::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 10:06:40,058::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0270661 s, 37.8 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 10:06:40,076::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-14::DEBUG::2014-07-10 10:06:40,078::task::595::TaskManager.Task::(_updateState) Task=`2390db50-825a-4b19-b26c-a52ac07fbe7a`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 10:06:40,078::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-14::INFO::2014-07-10 10:06:40,079::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 10:06:40,079::task::1185::TaskManager.Task::(prepare) Task=`2390db50-825a-4b19-b26c-a52ac07fbe7a`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 10:06:40,079::task::595::TaskManager.Task::(_updateState) Task=`2390db50-825a-4b19-b26c-a52ac07fbe7a`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 10:06:40,079::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 10:06:40,079::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 10:06:40,080::task::990::TaskManager.Task::(_decref) Task=`2390db50-825a-4b19-b26c-a52ac07fbe7a`::ref 0 aborting False >Thread-34::DEBUG::2014-07-10 10:06:40,084::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-34::DEBUG::2014-07-10 10:06:40,085::task::595::TaskManager.Task::(_updateState) Task=`d2f357a3-6e1b-4cb1-9842-d76d13b9f0ec`::moving from state init -> state preparing >Thread-34::INFO::2014-07-10 10:06:40,085::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-34::DEBUG::2014-07-10 10:06:40,086::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`b06eb0e0-fa4f-4a4d-bd59-518c884da48b`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-10 10:06:40,086::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' for lock type 'shared' >Thread-34::DEBUG::2014-07-10 10:06:40,086::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-10 10:06:40,087::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`b06eb0e0-fa4f-4a4d-bd59-518c884da48b`::Granted request >Thread-34::DEBUG::2014-07-10 10:06:40,087::task::827::TaskManager.Task::(resourceAcquired) Task=`d2f357a3-6e1b-4cb1-9842-d76d13b9f0ec`::_resourcesAcquired: Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee (shared) >Thread-34::DEBUG::2014-07-10 10:06:40,087::task::990::TaskManager.Task::(_decref) Task=`d2f357a3-6e1b-4cb1-9842-d76d13b9f0ec`::ref 1 aborting False >Thread-34::INFO::2014-07-10 10:06:40,089::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '531976159232', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 10:06:40,089::task::1185::TaskManager.Task::(prepare) Task=`d2f357a3-6e1b-4cb1-9842-d76d13b9f0ec`::finished: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '531976159232', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 10:06:40,089::task::595::TaskManager.Task::(_updateState) Task=`d2f357a3-6e1b-4cb1-9842-d76d13b9f0ec`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-10 10:06:40,089::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee': < ResourceRef 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-10 10:06:40,089::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-10 10:06:40,090::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' >Thread-34::DEBUG::2014-07-10 10:06:40,090::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' (0 active users) >Thread-34::DEBUG::2014-07-10 10:06:40,092::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-10 10:06:40,095::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', Clearing records. >Thread-34::DEBUG::2014-07-10 10:06:40,101::task::990::TaskManager.Task::(_decref) Task=`d2f357a3-6e1b-4cb1-9842-d76d13b9f0ec`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 10:06:42,074::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 10:06:42,170::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0338116 s, 30.3 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 10:06:43,925::task::595::TaskManager.Task::(_updateState) Task=`cc95682f-526c-47ad-aa5c-7fd35490f594`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 10:06:43,926::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::INFO::2014-07-10 10:06:43,926::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000766702', 'lastCheck': '9.3', 'valid': True}, '6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000413355', 'lastCheck': '5.2', 'valid': True}} >Thread-14::DEBUG::2014-07-10 10:06:43,926::task::1185::TaskManager.Task::(prepare) Task=`cc95682f-526c-47ad-aa5c-7fd35490f594`::finished: {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000766702', 'lastCheck': '9.3', 'valid': True}, '6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000413355', 'lastCheck': '5.2', 'valid': True}} >Thread-14::DEBUG::2014-07-10 10:06:43,926::task::595::TaskManager.Task::(_updateState) Task=`cc95682f-526c-47ad-aa5c-7fd35490f594`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 10:06:43,927::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 10:06:43,927::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 10:06:43,927::task::990::TaskManager.Task::(_decref) Task=`cc95682f-526c-47ad-aa5c-7fd35490f594`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 10:06:44,185::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 10:06:44,272::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0275308 s, 37.2 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-10 10:06:44,655::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/metadata bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-10 10:06:44,677::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000759971 s, 5.4 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 10:06:46,287::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 10:06:46,374::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0287962 s, 35.6 MB/s\n'; <rc> = 0 >Thread-70::DEBUG::2014-07-10 10:06:47,118::task::595::TaskManager.Task::(_updateState) Task=`1b0d9892-6d91-4734-adea-2d5a8a9a47ff`::moving from state init -> state preparing >Thread-70::INFO::2014-07-10 10:06:47,118::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='cfaeead2-7caa-467c-b389-c89840ae6605', volUUID='567fe32d-31a6-4ff6-90f3-fd6a656fbecc', options=None) >Thread-70::INFO::2014-07-10 10:06:47,119::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-70::DEBUG::2014-07-10 10:06:47,119::task::1185::TaskManager.Task::(prepare) Task=`1b0d9892-6d91-4734-adea-2d5a8a9a47ff`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-70::DEBUG::2014-07-10 10:06:47,119::task::595::TaskManager.Task::(_updateState) Task=`1b0d9892-6d91-4734-adea-2d5a8a9a47ff`::moving from state preparing -> state finished >Thread-70::DEBUG::2014-07-10 10:06:47,119::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-70::DEBUG::2014-07-10 10:06:47,120::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-70::DEBUG::2014-07-10 10:06:47,120::task::990::TaskManager.Task::(_decref) Task=`1b0d9892-6d91-4734-adea-2d5a8a9a47ff`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 10:06:48,389::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 10:06:48,485::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.033202 s, 30.8 MB/s\n'; <rc> = 0 >Thread-40::DEBUG::2014-07-10 10:06:48,724::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lion.qa.lab.tlv.redhat.com:_export_yuri2_backup2/6a70504d-00df-4869-8695-0f442053f6b6/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-40::DEBUG::2014-07-10 10:06:48,744::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n369 bytes (369 B) copied, 0.000525574 s, 702 kB/s\n'; <rc> = 0 >Thread-51::DEBUG::2014-07-10 10:06:49,404::task::595::TaskManager.Task::(_updateState) Task=`659329ad-5198-4d4b-90e8-ddf8a90124de`::moving from state init -> state preparing >Thread-60::DEBUG::2014-07-10 10:06:49,404::task::595::TaskManager.Task::(_updateState) Task=`0df5bb4e-c924-4f76-af6f-db08aae1b7f8`::moving from state init -> state preparing >Thread-51::INFO::2014-07-10 10:06:49,406::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='76fdb054-02cd-42ed-9721-b3e65b34c3a4', volUUID='022dfe46-2cf7-4915-80b3-883158e3ca83', options=None) >Thread-60::INFO::2014-07-10 10:06:49,406::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='b034d5b0-e1e0-4011-b49b-4d45ddb11556', volUUID='3d7f62b5-328f-4d8e-8b69-873cfb5ae14d', options=None) >Thread-51::INFO::2014-07-10 10:06:49,408::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-60::INFO::2014-07-10 10:06:49,408::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-51::DEBUG::2014-07-10 10:06:49,409::task::1185::TaskManager.Task::(prepare) Task=`659329ad-5198-4d4b-90e8-ddf8a90124de`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-60::DEBUG::2014-07-10 10:06:49,409::task::1185::TaskManager.Task::(prepare) Task=`0df5bb4e-c924-4f76-af6f-db08aae1b7f8`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-51::DEBUG::2014-07-10 10:06:49,410::task::595::TaskManager.Task::(_updateState) Task=`659329ad-5198-4d4b-90e8-ddf8a90124de`::moving from state preparing -> state finished >Thread-60::DEBUG::2014-07-10 10:06:49,410::task::595::TaskManager.Task::(_updateState) Task=`0df5bb4e-c924-4f76-af6f-db08aae1b7f8`::moving from state preparing -> state finished >Thread-51::DEBUG::2014-07-10 10:06:49,411::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-60::DEBUG::2014-07-10 10:06:49,412::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-51::DEBUG::2014-07-10 10:06:49,413::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-60::DEBUG::2014-07-10 10:06:49,413::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-51::DEBUG::2014-07-10 10:06:49,414::task::990::TaskManager.Task::(_decref) Task=`659329ad-5198-4d4b-90e8-ddf8a90124de`::ref 0 aborting False >Thread-60::DEBUG::2014-07-10 10:06:49,414::task::990::TaskManager.Task::(_decref) Task=`0df5bb4e-c924-4f76-af6f-db08aae1b7f8`::ref 0 aborting False >Thread-14::DEBUG::2014-07-10 10:06:50,134::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-14::DEBUG::2014-07-10 10:06:50,136::task::595::TaskManager.Task::(_updateState) Task=`5f5e9b36-1f20-488c-a3f6-4c546272095e`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 10:06:50,137::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-14::INFO::2014-07-10 10:06:50,137::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 10:06:50,138::task::1185::TaskManager.Task::(prepare) Task=`5f5e9b36-1f20-488c-a3f6-4c546272095e`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 10:06:50,138::task::595::TaskManager.Task::(_updateState) Task=`5f5e9b36-1f20-488c-a3f6-4c546272095e`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 10:06:50,138::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 10:06:50,138::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 10:06:50,138::task::990::TaskManager.Task::(_decref) Task=`5f5e9b36-1f20-488c-a3f6-4c546272095e`::ref 0 aborting False >Thread-34::DEBUG::2014-07-10 10:06:50,145::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-34::DEBUG::2014-07-10 10:06:50,146::task::595::TaskManager.Task::(_updateState) Task=`e5595a19-f5cd-4884-b57d-12f5a7c6b78b`::moving from state init -> state preparing >Thread-34::INFO::2014-07-10 10:06:50,147::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-34::DEBUG::2014-07-10 10:06:50,149::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`b9473fc3-f80f-4216-9061-8b74e4b40e55`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-10 10:06:50,149::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' for lock type 'shared' >Thread-34::DEBUG::2014-07-10 10:06:50,149::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-10 10:06:50,149::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`b9473fc3-f80f-4216-9061-8b74e4b40e55`::Granted request >Thread-34::DEBUG::2014-07-10 10:06:50,150::task::827::TaskManager.Task::(resourceAcquired) Task=`e5595a19-f5cd-4884-b57d-12f5a7c6b78b`::_resourcesAcquired: Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee (shared) >Thread-34::DEBUG::2014-07-10 10:06:50,150::task::990::TaskManager.Task::(_decref) Task=`e5595a19-f5cd-4884-b57d-12f5a7c6b78b`::ref 1 aborting False >Thread-34::INFO::2014-07-10 10:06:50,151::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '531976159232', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 10:06:50,152::task::1185::TaskManager.Task::(prepare) Task=`e5595a19-f5cd-4884-b57d-12f5a7c6b78b`::finished: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '531976159232', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 10:06:50,152::task::595::TaskManager.Task::(_updateState) Task=`e5595a19-f5cd-4884-b57d-12f5a7c6b78b`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-10 10:06:50,152::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee': < ResourceRef 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-10 10:06:50,152::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-10 10:06:50,152::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' >Thread-34::DEBUG::2014-07-10 10:06:50,153::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' (0 active users) >Thread-34::DEBUG::2014-07-10 10:06:50,153::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-10 10:06:50,153::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', Clearing records. >Thread-34::DEBUG::2014-07-10 10:06:50,153::task::990::TaskManager.Task::(_decref) Task=`e5595a19-f5cd-4884-b57d-12f5a7c6b78b`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 10:06:50,501::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 10:06:50,594::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0358018 s, 28.6 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 10:06:52,609::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 10:06:52,695::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0289441 s, 35.4 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-10 10:06:54,707::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/metadata bs=4096 count=1' (cwd None) >Dummy-33::DEBUG::2014-07-10 10:06:54,724::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Thread-18::DEBUG::2014-07-10 10:06:54,781::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000677506 s, 6.0 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 10:06:54,985::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.200393 s, 5.1 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 10:06:57,000::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 10:06:57,100::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0419807 s, 24.4 MB/s\n'; <rc> = 0 >Thread-40::DEBUG::2014-07-10 10:06:58,771::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lion.qa.lab.tlv.redhat.com:_export_yuri2_backup2/6a70504d-00df-4869-8695-0f442053f6b6/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-40::DEBUG::2014-07-10 10:06:58,791::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n369 bytes (369 B) copied, 0.000382856 s, 964 kB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 10:06:59,093::task::595::TaskManager.Task::(_updateState) Task=`6c0ddb2c-c4b0-4f89-b683-830015809ac3`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 10:06:59,093::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::INFO::2014-07-10 10:06:59,094::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000677506', 'lastCheck': '4.2', 'valid': True}, '6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000382856', 'lastCheck': '0.3', 'valid': True}} >Thread-14::DEBUG::2014-07-10 10:06:59,094::task::1185::TaskManager.Task::(prepare) Task=`6c0ddb2c-c4b0-4f89-b683-830015809ac3`::finished: {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000677506', 'lastCheck': '4.2', 'valid': True}, '6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000382856', 'lastCheck': '0.3', 'valid': True}} >Thread-14::DEBUG::2014-07-10 10:06:59,094::task::595::TaskManager.Task::(_updateState) Task=`6c0ddb2c-c4b0-4f89-b683-830015809ac3`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 10:06:59,094::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 10:06:59,095::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 10:06:59,095::task::990::TaskManager.Task::(_decref) Task=`6c0ddb2c-c4b0-4f89-b683-830015809ac3`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 10:06:59,119::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 10:06:59,365::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.185982 s, 5.5 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 10:07:00,189::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-14::DEBUG::2014-07-10 10:07:00,190::task::595::TaskManager.Task::(_updateState) Task=`c307a2fc-7d65-41d6-87e8-73c6ccd45672`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 10:07:00,191::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-14::INFO::2014-07-10 10:07:00,191::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 10:07:00,192::task::1185::TaskManager.Task::(prepare) Task=`c307a2fc-7d65-41d6-87e8-73c6ccd45672`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 10:07:00,192::task::595::TaskManager.Task::(_updateState) Task=`c307a2fc-7d65-41d6-87e8-73c6ccd45672`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 10:07:00,192::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 10:07:00,192::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 10:07:00,192::task::990::TaskManager.Task::(_decref) Task=`c307a2fc-7d65-41d6-87e8-73c6ccd45672`::ref 0 aborting False >Thread-34::DEBUG::2014-07-10 10:07:00,197::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-34::DEBUG::2014-07-10 10:07:00,197::task::595::TaskManager.Task::(_updateState) Task=`5a6a9d9d-4aab-4b5d-b7d5-086029e2790e`::moving from state init -> state preparing >Thread-34::INFO::2014-07-10 10:07:00,198::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-34::DEBUG::2014-07-10 10:07:00,199::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`c1aed35e-d8ff-4da0-9009-cb68189e69fe`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-10 10:07:00,199::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' for lock type 'shared' >Thread-34::DEBUG::2014-07-10 10:07:00,200::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-10 10:07:00,200::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`c1aed35e-d8ff-4da0-9009-cb68189e69fe`::Granted request >Thread-34::DEBUG::2014-07-10 10:07:00,201::task::827::TaskManager.Task::(resourceAcquired) Task=`5a6a9d9d-4aab-4b5d-b7d5-086029e2790e`::_resourcesAcquired: Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee (shared) >Thread-34::DEBUG::2014-07-10 10:07:00,201::task::990::TaskManager.Task::(_decref) Task=`5a6a9d9d-4aab-4b5d-b7d5-086029e2790e`::ref 1 aborting False >Thread-34::INFO::2014-07-10 10:07:00,202::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '531976159232', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 10:07:00,203::task::1185::TaskManager.Task::(prepare) Task=`5a6a9d9d-4aab-4b5d-b7d5-086029e2790e`::finished: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '531976159232', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 10:07:00,203::task::595::TaskManager.Task::(_updateState) Task=`5a6a9d9d-4aab-4b5d-b7d5-086029e2790e`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-10 10:07:00,203::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee': < ResourceRef 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-10 10:07:00,203::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-10 10:07:00,204::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' >Thread-34::DEBUG::2014-07-10 10:07:00,204::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' (0 active users) >Thread-34::DEBUG::2014-07-10 10:07:00,204::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-10 10:07:00,205::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', Clearing records. >Thread-34::DEBUG::2014-07-10 10:07:00,205::task::990::TaskManager.Task::(_decref) Task=`5a6a9d9d-4aab-4b5d-b7d5-086029e2790e`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 10:07:01,381::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 10:07:01,469::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0305793 s, 33.5 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 10:07:03,484::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 10:07:03,577::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0324033 s, 31.6 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-10 10:07:04,934::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/metadata bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-10 10:07:04,955::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000765749 s, 5.3 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 10:07:05,591::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 10:07:05,683::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0341035 s, 30.0 MB/s\n'; <rc> = 0 >Thread-64::DEBUG::2014-07-10 10:07:07,291::task::595::TaskManager.Task::(_updateState) Task=`78fe6c6a-88ba-4b8f-a737-a3bbf8671aad`::moving from state init -> state preparing >Thread-64::INFO::2014-07-10 10:07:07,291::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='aa20346a-4d3a-4e07-b8e1-52c0ebe4168c', volUUID='58fefce2-9bce-4bff-8949-8c6ce8122b27', options=None) >Thread-64::INFO::2014-07-10 10:07:07,292::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-64::DEBUG::2014-07-10 10:07:07,292::task::1185::TaskManager.Task::(prepare) Task=`78fe6c6a-88ba-4b8f-a737-a3bbf8671aad`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-64::DEBUG::2014-07-10 10:07:07,292::task::595::TaskManager.Task::(_updateState) Task=`78fe6c6a-88ba-4b8f-a737-a3bbf8671aad`::moving from state preparing -> state finished >Thread-64::DEBUG::2014-07-10 10:07:07,292::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-64::DEBUG::2014-07-10 10:07:07,292::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-64::DEBUG::2014-07-10 10:07:07,293::task::990::TaskManager.Task::(_decref) Task=`78fe6c6a-88ba-4b8f-a737-a3bbf8671aad`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 10:07:07,698::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 10:07:07,784::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.027545 s, 37.2 MB/s\n'; <rc> = 0 >Thread-40::DEBUG::2014-07-10 10:07:08,822::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lion.qa.lab.tlv.redhat.com:_export_yuri2_backup2/6a70504d-00df-4869-8695-0f442053f6b6/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-40::DEBUG::2014-07-10 10:07:08,842::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n369 bytes (369 B) copied, 0.000475937 s, 775 kB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 10:07:09,798::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 10:07:09,887::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0311779 s, 32.8 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 10:07:10,236::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-14::DEBUG::2014-07-10 10:07:10,237::task::595::TaskManager.Task::(_updateState) Task=`d93677b8-8894-4097-9572-c5f8867d6f30`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 10:07:10,239::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-14::INFO::2014-07-10 10:07:10,239::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 10:07:10,239::task::1185::TaskManager.Task::(prepare) Task=`d93677b8-8894-4097-9572-c5f8867d6f30`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 10:07:10,240::task::595::TaskManager.Task::(_updateState) Task=`d93677b8-8894-4097-9572-c5f8867d6f30`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 10:07:10,240::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 10:07:10,240::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 10:07:10,240::task::990::TaskManager.Task::(_decref) Task=`d93677b8-8894-4097-9572-c5f8867d6f30`::ref 0 aborting False >Thread-34::DEBUG::2014-07-10 10:07:10,244::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-34::DEBUG::2014-07-10 10:07:10,245::task::595::TaskManager.Task::(_updateState) Task=`2e6b2039-d9b7-4a8a-8c93-a5d9f0240d93`::moving from state init -> state preparing >Thread-34::INFO::2014-07-10 10:07:10,245::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-34::DEBUG::2014-07-10 10:07:10,246::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`d196b300-fcff-4f65-bdfd-cc2b0b327b0b`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-10 10:07:10,246::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' for lock type 'shared' >Thread-34::DEBUG::2014-07-10 10:07:10,246::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-10 10:07:10,246::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`d196b300-fcff-4f65-bdfd-cc2b0b327b0b`::Granted request >Thread-34::DEBUG::2014-07-10 10:07:10,247::task::827::TaskManager.Task::(resourceAcquired) Task=`2e6b2039-d9b7-4a8a-8c93-a5d9f0240d93`::_resourcesAcquired: Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee (shared) >Thread-34::DEBUG::2014-07-10 10:07:10,247::task::990::TaskManager.Task::(_decref) Task=`2e6b2039-d9b7-4a8a-8c93-a5d9f0240d93`::ref 1 aborting False >Thread-34::INFO::2014-07-10 10:07:10,248::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '531976159232', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 10:07:10,249::task::1185::TaskManager.Task::(prepare) Task=`2e6b2039-d9b7-4a8a-8c93-a5d9f0240d93`::finished: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '531976159232', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 10:07:10,249::task::595::TaskManager.Task::(_updateState) Task=`2e6b2039-d9b7-4a8a-8c93-a5d9f0240d93`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-10 10:07:10,249::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee': < ResourceRef 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-10 10:07:10,249::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-10 10:07:10,249::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' >Thread-34::DEBUG::2014-07-10 10:07:10,250::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' (0 active users) >Thread-34::DEBUG::2014-07-10 10:07:10,250::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-10 10:07:10,250::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', Clearing records. >Thread-34::DEBUG::2014-07-10 10:07:10,250::task::990::TaskManager.Task::(_decref) Task=`2e6b2039-d9b7-4a8a-8c93-a5d9f0240d93`::ref 0 aborting False >Thread-54::DEBUG::2014-07-10 10:07:11,101::task::595::TaskManager.Task::(_updateState) Task=`fe641fbd-c654-47b2-bffc-ae5dfcbc071f`::moving from state init -> state preparing >Thread-73::DEBUG::2014-07-10 10:07:11,102::task::595::TaskManager.Task::(_updateState) Task=`e66c14ae-c6db-4df8-86c9-c322a5eb816e`::moving from state init -> state preparing >Thread-54::INFO::2014-07-10 10:07:11,104::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='28408446-e5fd-4565-a976-e760951593fe', volUUID='776303a2-5585-451e-826e-0e338d4a1e98', options=None) >Thread-73::INFO::2014-07-10 10:07:11,104::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='c01d693b-cba0-4fed-9ad7-0aaa28912a19', volUUID='4bb5d954-2a50-4028-b299-0b43c261270c', options=None) >Thread-54::INFO::2014-07-10 10:07:11,106::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-73::INFO::2014-07-10 10:07:11,106::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-54::DEBUG::2014-07-10 10:07:11,107::task::1185::TaskManager.Task::(prepare) Task=`fe641fbd-c654-47b2-bffc-ae5dfcbc071f`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-73::DEBUG::2014-07-10 10:07:11,107::task::1185::TaskManager.Task::(prepare) Task=`e66c14ae-c6db-4df8-86c9-c322a5eb816e`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-54::DEBUG::2014-07-10 10:07:11,108::task::595::TaskManager.Task::(_updateState) Task=`fe641fbd-c654-47b2-bffc-ae5dfcbc071f`::moving from state preparing -> state finished >Thread-73::DEBUG::2014-07-10 10:07:11,109::task::595::TaskManager.Task::(_updateState) Task=`e66c14ae-c6db-4df8-86c9-c322a5eb816e`::moving from state preparing -> state finished >Thread-54::DEBUG::2014-07-10 10:07:11,110::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-73::DEBUG::2014-07-10 10:07:11,110::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-54::DEBUG::2014-07-10 10:07:11,111::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-73::DEBUG::2014-07-10 10:07:11,111::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-54::DEBUG::2014-07-10 10:07:11,112::task::990::TaskManager.Task::(_decref) Task=`fe641fbd-c654-47b2-bffc-ae5dfcbc071f`::ref 0 aborting False >Thread-73::DEBUG::2014-07-10 10:07:11,113::task::990::TaskManager.Task::(_decref) Task=`e66c14ae-c6db-4df8-86c9-c322a5eb816e`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 10:07:11,903::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 10:07:11,995::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.03531 s, 29.0 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 10:07:14,011::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 10:07:14,113::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0324887 s, 31.5 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 10:07:14,444::task::595::TaskManager.Task::(_updateState) Task=`5ef7a0ea-47e1-49ed-886a-3c83f1c40f65`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 10:07:14,445::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::INFO::2014-07-10 10:07:14,446::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000765749', 'lastCheck': '9.5', 'valid': True}, '6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000475937', 'lastCheck': '5.6', 'valid': True}} >Thread-14::DEBUG::2014-07-10 10:07:14,446::task::1185::TaskManager.Task::(prepare) Task=`5ef7a0ea-47e1-49ed-886a-3c83f1c40f65`::finished: {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000765749', 'lastCheck': '9.5', 'valid': True}, '6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000475937', 'lastCheck': '5.6', 'valid': True}} >Thread-14::DEBUG::2014-07-10 10:07:14,446::task::595::TaskManager.Task::(_updateState) Task=`5ef7a0ea-47e1-49ed-886a-3c83f1c40f65`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 10:07:14,446::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 10:07:14,446::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 10:07:14,447::task::990::TaskManager.Task::(_decref) Task=`5ef7a0ea-47e1-49ed-886a-3c83f1c40f65`::ref 0 aborting False >Thread-18::DEBUG::2014-07-10 10:07:14,985::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/metadata bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-10 10:07:15,007::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000726251 s, 5.6 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 10:07:16,129::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 10:07:16,241::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0293053 s, 34.9 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 10:07:18,256::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 10:07:18,349::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0355591 s, 28.8 MB/s\n'; <rc> = 0 >Thread-40::DEBUG::2014-07-10 10:07:18,867::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lion.qa.lab.tlv.redhat.com:_export_yuri2_backup2/6a70504d-00df-4869-8695-0f442053f6b6/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-40::DEBUG::2014-07-10 10:07:18,888::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n369 bytes (369 B) copied, 0.000455173 s, 811 kB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 10:07:20,285::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-14::DEBUG::2014-07-10 10:07:20,286::task::595::TaskManager.Task::(_updateState) Task=`15ff591f-67f5-4b6f-bdf0-63457d3dcdde`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 10:07:20,286::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-14::INFO::2014-07-10 10:07:20,287::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 10:07:20,287::task::1185::TaskManager.Task::(prepare) Task=`15ff591f-67f5-4b6f-bdf0-63457d3dcdde`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 10:07:20,287::task::595::TaskManager.Task::(_updateState) Task=`15ff591f-67f5-4b6f-bdf0-63457d3dcdde`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 10:07:20,287::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 10:07:20,288::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 10:07:20,288::task::990::TaskManager.Task::(_decref) Task=`15ff591f-67f5-4b6f-bdf0-63457d3dcdde`::ref 0 aborting False >Thread-34::DEBUG::2014-07-10 10:07:20,292::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-34::DEBUG::2014-07-10 10:07:20,292::task::595::TaskManager.Task::(_updateState) Task=`80aa4855-0ae9-4759-b86c-fcf6fba9d89c`::moving from state init -> state preparing >Thread-34::INFO::2014-07-10 10:07:20,293::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-34::DEBUG::2014-07-10 10:07:20,293::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`23b2f271-c702-4a30-b7a9-13a3c46f5165`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-10 10:07:20,294::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' for lock type 'shared' >Thread-34::DEBUG::2014-07-10 10:07:20,294::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-10 10:07:20,294::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`23b2f271-c702-4a30-b7a9-13a3c46f5165`::Granted request >Thread-34::DEBUG::2014-07-10 10:07:20,295::task::827::TaskManager.Task::(resourceAcquired) Task=`80aa4855-0ae9-4759-b86c-fcf6fba9d89c`::_resourcesAcquired: Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee (shared) >Thread-34::DEBUG::2014-07-10 10:07:20,295::task::990::TaskManager.Task::(_decref) Task=`80aa4855-0ae9-4759-b86c-fcf6fba9d89c`::ref 1 aborting False >Thread-34::INFO::2014-07-10 10:07:20,296::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '531976159232', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 10:07:20,296::task::1185::TaskManager.Task::(prepare) Task=`80aa4855-0ae9-4759-b86c-fcf6fba9d89c`::finished: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '531976159232', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 10:07:20,296::task::595::TaskManager.Task::(_updateState) Task=`80aa4855-0ae9-4759-b86c-fcf6fba9d89c`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-10 10:07:20,297::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee': < ResourceRef 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-10 10:07:20,297::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-10 10:07:20,297::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' >Thread-34::DEBUG::2014-07-10 10:07:20,297::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' (0 active users) >Thread-34::DEBUG::2014-07-10 10:07:20,298::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-10 10:07:20,298::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', Clearing records. >Thread-34::DEBUG::2014-07-10 10:07:20,298::task::990::TaskManager.Task::(_decref) Task=`80aa4855-0ae9-4759-b86c-fcf6fba9d89c`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 10:07:20,366::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 10:07:20,460::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.035822 s, 28.6 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 10:07:22,511::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 10:07:22,644::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0713618 s, 14.3 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 10:07:24,659::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 10:07:24,753::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0375048 s, 27.3 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-10 10:07:25,036::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/metadata bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-10 10:07:25,059::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000748087 s, 5.5 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 10:07:26,763::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 10:07:26,856::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0376048 s, 27.2 MB/s\n'; <rc> = 0 >Thread-57::DEBUG::2014-07-10 10:07:27,683::task::595::TaskManager.Task::(_updateState) Task=`ed6a6584-03e8-44bf-895f-32adf2f6a933`::moving from state init -> state preparing >Thread-57::INFO::2014-07-10 10:07:27,683::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='b6f6c0da-e67f-4902-b9ac-3069571a42fe', volUUID='c4cd1da8-05b7-45e0-80b1-1183d21443d9', options=None) >Thread-57::INFO::2014-07-10 10:07:27,684::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-57::DEBUG::2014-07-10 10:07:27,684::task::1185::TaskManager.Task::(prepare) Task=`ed6a6584-03e8-44bf-895f-32adf2f6a933`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-57::DEBUG::2014-07-10 10:07:27,684::task::595::TaskManager.Task::(_updateState) Task=`ed6a6584-03e8-44bf-895f-32adf2f6a933`::moving from state preparing -> state finished >Thread-57::DEBUG::2014-07-10 10:07:27,684::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-57::DEBUG::2014-07-10 10:07:27,685::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-57::DEBUG::2014-07-10 10:07:27,685::task::990::TaskManager.Task::(_decref) Task=`ed6a6584-03e8-44bf-895f-32adf2f6a933`::ref 0 aborting False >Thread-67::DEBUG::2014-07-10 10:07:28,611::task::595::TaskManager.Task::(_updateState) Task=`a470491e-8825-4b15-8b7b-51b56c1ca5bd`::moving from state init -> state preparing >Thread-67::INFO::2014-07-10 10:07:28,612::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='f30c2cb7-a43a-4bf5-82b5-cfe07336f65c', volUUID='b0fbb3c9-55af-4a3a-95ad-fc56a80b9cf5', options=None) >Thread-67::INFO::2014-07-10 10:07:28,612::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-67::DEBUG::2014-07-10 10:07:28,612::task::1185::TaskManager.Task::(prepare) Task=`a470491e-8825-4b15-8b7b-51b56c1ca5bd`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-67::DEBUG::2014-07-10 10:07:28,612::task::595::TaskManager.Task::(_updateState) Task=`a470491e-8825-4b15-8b7b-51b56c1ca5bd`::moving from state preparing -> state finished >Thread-67::DEBUG::2014-07-10 10:07:28,613::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-67::DEBUG::2014-07-10 10:07:28,613::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-67::DEBUG::2014-07-10 10:07:28,613::task::990::TaskManager.Task::(_decref) Task=`a470491e-8825-4b15-8b7b-51b56c1ca5bd`::ref 0 aborting False >Thread-48::DEBUG::2014-07-10 10:07:28,647::task::595::TaskManager.Task::(_updateState) Task=`e7aa4df2-4d73-4b3b-83e6-f2e2790a2b7b`::moving from state init -> state preparing >Thread-48::INFO::2014-07-10 10:07:28,648::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='0cd7d6ce-f497-4243-a690-c57744861eea', volUUID='10b6a7dd-dc6c-43fa-ba17-92e4331b0e0b', options=None) >Thread-48::INFO::2014-07-10 10:07:28,648::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-48::DEBUG::2014-07-10 10:07:28,648::task::1185::TaskManager.Task::(prepare) Task=`e7aa4df2-4d73-4b3b-83e6-f2e2790a2b7b`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-48::DEBUG::2014-07-10 10:07:28,648::task::595::TaskManager.Task::(_updateState) Task=`e7aa4df2-4d73-4b3b-83e6-f2e2790a2b7b`::moving from state preparing -> state finished >Thread-48::DEBUG::2014-07-10 10:07:28,649::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-48::DEBUG::2014-07-10 10:07:28,649::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-48::DEBUG::2014-07-10 10:07:28,649::task::990::TaskManager.Task::(_decref) Task=`e7aa4df2-4d73-4b3b-83e6-f2e2790a2b7b`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 10:07:28,871::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Thread-40::DEBUG::2014-07-10 10:07:28,922::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lion.qa.lab.tlv.redhat.com:_export_yuri2_backup2/6a70504d-00df-4869-8695-0f442053f6b6/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-40::DEBUG::2014-07-10 10:07:28,962::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n369 bytes (369 B) copied, 0.000368793 s, 1.0 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 10:07:29,033::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.103504 s, 9.9 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 10:07:29,627::task::595::TaskManager.Task::(_updateState) Task=`6580f036-c667-45af-bb21-ee61fde222fa`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 10:07:29,627::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::INFO::2014-07-10 10:07:29,628::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000748087', 'lastCheck': '4.5', 'valid': True}, '6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000368793', 'lastCheck': '0.7', 'valid': True}} >Thread-14::DEBUG::2014-07-10 10:07:29,628::task::1185::TaskManager.Task::(prepare) Task=`6580f036-c667-45af-bb21-ee61fde222fa`::finished: {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000748087', 'lastCheck': '4.5', 'valid': True}, '6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000368793', 'lastCheck': '0.7', 'valid': True}} >Thread-14::DEBUG::2014-07-10 10:07:29,628::task::595::TaskManager.Task::(_updateState) Task=`6580f036-c667-45af-bb21-ee61fde222fa`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 10:07:29,628::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 10:07:29,629::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 10:07:29,629::task::990::TaskManager.Task::(_decref) Task=`6580f036-c667-45af-bb21-ee61fde222fa`::ref 0 aborting False >Thread-14::DEBUG::2014-07-10 10:07:30,326::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-14::DEBUG::2014-07-10 10:07:30,327::task::595::TaskManager.Task::(_updateState) Task=`8a05507a-102f-4a96-880f-705b0fafae05`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 10:07:30,327::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-14::INFO::2014-07-10 10:07:30,328::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 10:07:30,328::task::1185::TaskManager.Task::(prepare) Task=`8a05507a-102f-4a96-880f-705b0fafae05`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 10:07:30,328::task::595::TaskManager.Task::(_updateState) Task=`8a05507a-102f-4a96-880f-705b0fafae05`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 10:07:30,328::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 10:07:30,329::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 10:07:30,329::task::990::TaskManager.Task::(_decref) Task=`8a05507a-102f-4a96-880f-705b0fafae05`::ref 0 aborting False >Thread-34::DEBUG::2014-07-10 10:07:30,373::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-34::DEBUG::2014-07-10 10:07:30,373::task::595::TaskManager.Task::(_updateState) Task=`8c8dfea2-260a-46ba-8afe-ae7d4834cb4e`::moving from state init -> state preparing >Thread-34::INFO::2014-07-10 10:07:30,373::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-34::DEBUG::2014-07-10 10:07:30,374::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`e7a284ef-ba17-492b-93d7-dda044adad6d`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-10 10:07:30,374::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' for lock type 'shared' >Thread-34::DEBUG::2014-07-10 10:07:30,375::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-10 10:07:30,375::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`e7a284ef-ba17-492b-93d7-dda044adad6d`::Granted request >Thread-34::DEBUG::2014-07-10 10:07:30,375::task::827::TaskManager.Task::(resourceAcquired) Task=`8c8dfea2-260a-46ba-8afe-ae7d4834cb4e`::_resourcesAcquired: Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee (shared) >Thread-34::DEBUG::2014-07-10 10:07:30,375::task::990::TaskManager.Task::(_decref) Task=`8c8dfea2-260a-46ba-8afe-ae7d4834cb4e`::ref 1 aborting False >Thread-34::INFO::2014-07-10 10:07:30,377::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '531976159232', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 10:07:30,377::task::1185::TaskManager.Task::(prepare) Task=`8c8dfea2-260a-46ba-8afe-ae7d4834cb4e`::finished: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '531976159232', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 10:07:30,377::task::595::TaskManager.Task::(_updateState) Task=`8c8dfea2-260a-46ba-8afe-ae7d4834cb4e`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-10 10:07:30,377::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee': < ResourceRef 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-10 10:07:30,377::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-10 10:07:30,378::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' >Thread-34::DEBUG::2014-07-10 10:07:30,378::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' (0 active users) >Thread-34::DEBUG::2014-07-10 10:07:30,378::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-10 10:07:30,378::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', Clearing records. >Thread-34::DEBUG::2014-07-10 10:07:30,378::task::990::TaskManager.Task::(_decref) Task=`8c8dfea2-260a-46ba-8afe-ae7d4834cb4e`::ref 0 aborting False >Thread-76::DEBUG::2014-07-10 10:07:30,617::task::595::TaskManager.Task::(_updateState) Task=`787795d6-9d3c-40a1-b0cb-fc65f96acbb4`::moving from state init -> state preparing >Thread-76::INFO::2014-07-10 10:07:30,618::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='e4c65229-4247-4b33-b72a-f1d5ce72ad05', volUUID='cad94284-3ca9-4c30-933d-997f4460309e', options=None) >Thread-76::INFO::2014-07-10 10:07:30,618::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-76::DEBUG::2014-07-10 10:07:30,619::task::1185::TaskManager.Task::(prepare) Task=`787795d6-9d3c-40a1-b0cb-fc65f96acbb4`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-76::DEBUG::2014-07-10 10:07:30,619::task::595::TaskManager.Task::(_updateState) Task=`787795d6-9d3c-40a1-b0cb-fc65f96acbb4`::moving from state preparing -> state finished >Thread-76::DEBUG::2014-07-10 10:07:30,619::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-76::DEBUG::2014-07-10 10:07:30,619::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-76::DEBUG::2014-07-10 10:07:30,619::task::990::TaskManager.Task::(_decref) Task=`787795d6-9d3c-40a1-b0cb-fc65f96acbb4`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 10:07:31,048::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 10:07:31,152::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0433636 s, 23.6 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 10:07:33,167::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 10:07:33,254::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0312679 s, 32.7 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-10 10:07:35,088::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/metadata bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-10 10:07:35,109::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000649735 s, 6.3 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 10:07:35,270::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 10:07:35,367::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0378508 s, 27.1 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 10:07:37,383::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 10:07:37,492::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0307164 s, 33.3 MB/s\n'; <rc> = 0 >Thread-40::DEBUG::2014-07-10 10:07:39,000::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lion.qa.lab.tlv.redhat.com:_export_yuri2_backup2/6a70504d-00df-4869-8695-0f442053f6b6/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-40::DEBUG::2014-07-10 10:07:39,021::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n369 bytes (369 B) copied, 0.000459454 s, 803 kB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 10:07:39,508::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 10:07:39,603::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0364167 s, 28.1 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 10:07:40,402::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-14::DEBUG::2014-07-10 10:07:40,403::task::595::TaskManager.Task::(_updateState) Task=`1ef634e6-acd2-4e28-a599-5da1c371d30c`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 10:07:40,403::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-14::INFO::2014-07-10 10:07:40,404::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 10:07:40,404::task::1185::TaskManager.Task::(prepare) Task=`1ef634e6-acd2-4e28-a599-5da1c371d30c`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 10:07:40,404::task::595::TaskManager.Task::(_updateState) Task=`1ef634e6-acd2-4e28-a599-5da1c371d30c`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 10:07:40,404::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 10:07:40,405::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 10:07:40,405::task::990::TaskManager.Task::(_decref) Task=`1ef634e6-acd2-4e28-a599-5da1c371d30c`::ref 0 aborting False >Thread-34::DEBUG::2014-07-10 10:07:40,409::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-34::DEBUG::2014-07-10 10:07:40,409::task::595::TaskManager.Task::(_updateState) Task=`cd7af641-9702-40b8-8fc2-905e097532c4`::moving from state init -> state preparing >Thread-34::INFO::2014-07-10 10:07:40,409::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-34::DEBUG::2014-07-10 10:07:40,410::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`14d8b51e-a985-406e-b848-20ad9d8de702`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-10 10:07:40,410::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' for lock type 'shared' >Thread-34::DEBUG::2014-07-10 10:07:40,411::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-10 10:07:40,411::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`14d8b51e-a985-406e-b848-20ad9d8de702`::Granted request >Thread-34::DEBUG::2014-07-10 10:07:40,411::task::827::TaskManager.Task::(resourceAcquired) Task=`cd7af641-9702-40b8-8fc2-905e097532c4`::_resourcesAcquired: Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee (shared) >Thread-34::DEBUG::2014-07-10 10:07:40,411::task::990::TaskManager.Task::(_decref) Task=`cd7af641-9702-40b8-8fc2-905e097532c4`::ref 1 aborting False >Thread-34::INFO::2014-07-10 10:07:40,412::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '531976159232', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 10:07:40,413::task::1185::TaskManager.Task::(prepare) Task=`cd7af641-9702-40b8-8fc2-905e097532c4`::finished: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '531976159232', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 10:07:40,413::task::595::TaskManager.Task::(_updateState) Task=`cd7af641-9702-40b8-8fc2-905e097532c4`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-10 10:07:40,413::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee': < ResourceRef 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-10 10:07:40,413::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-10 10:07:40,413::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' >Thread-34::DEBUG::2014-07-10 10:07:40,414::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' (0 active users) >Thread-34::DEBUG::2014-07-10 10:07:40,414::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-10 10:07:40,414::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', Clearing records. >Thread-34::DEBUG::2014-07-10 10:07:40,414::task::990::TaskManager.Task::(_decref) Task=`cd7af641-9702-40b8-8fc2-905e097532c4`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 10:07:41,619::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 10:07:41,730::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0451663 s, 22.7 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 10:07:43,746::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 10:07:43,840::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0279702 s, 36.6 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 10:07:44,817::task::595::TaskManager.Task::(_updateState) Task=`6aef9649-1fe8-4d48-bd5b-c60ef7c9fbdf`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 10:07:44,818::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::INFO::2014-07-10 10:07:44,819::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000649735', 'lastCheck': '9.7', 'valid': True}, '6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000459454', 'lastCheck': '5.8', 'valid': True}} >Thread-14::DEBUG::2014-07-10 10:07:44,819::task::1185::TaskManager.Task::(prepare) Task=`6aef9649-1fe8-4d48-bd5b-c60ef7c9fbdf`::finished: {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000649735', 'lastCheck': '9.7', 'valid': True}, '6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000459454', 'lastCheck': '5.8', 'valid': True}} >Thread-14::DEBUG::2014-07-10 10:07:44,820::task::595::TaskManager.Task::(_updateState) Task=`6aef9649-1fe8-4d48-bd5b-c60ef7c9fbdf`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 10:07:44,821::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 10:07:44,822::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 10:07:44,824::task::990::TaskManager.Task::(_decref) Task=`6aef9649-1fe8-4d48-bd5b-c60ef7c9fbdf`::ref 0 aborting False >Thread-18::DEBUG::2014-07-10 10:07:45,138::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/metadata bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-10 10:07:45,160::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000767491 s, 5.3 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 10:07:45,856::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 10:07:45,959::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0296917 s, 34.5 MB/s\n'; <rc> = 0 >Thread-70::DEBUG::2014-07-10 10:07:47,386::task::595::TaskManager.Task::(_updateState) Task=`7a0b0713-8e11-4971-bfcb-bf4773ef4ad0`::moving from state init -> state preparing >Thread-70::INFO::2014-07-10 10:07:47,387::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='cfaeead2-7caa-467c-b389-c89840ae6605', volUUID='567fe32d-31a6-4ff6-90f3-fd6a656fbecc', options=None) >Thread-70::INFO::2014-07-10 10:07:47,387::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-70::DEBUG::2014-07-10 10:07:47,388::task::1185::TaskManager.Task::(prepare) Task=`7a0b0713-8e11-4971-bfcb-bf4773ef4ad0`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-70::DEBUG::2014-07-10 10:07:47,388::task::595::TaskManager.Task::(_updateState) Task=`7a0b0713-8e11-4971-bfcb-bf4773ef4ad0`::moving from state preparing -> state finished >Thread-70::DEBUG::2014-07-10 10:07:47,388::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-70::DEBUG::2014-07-10 10:07:47,388::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-70::DEBUG::2014-07-10 10:07:47,388::task::990::TaskManager.Task::(_decref) Task=`7a0b0713-8e11-4971-bfcb-bf4773ef4ad0`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 10:07:47,975::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 10:07:48,126::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0892341 s, 11.5 MB/s\n'; <rc> = 0 >Thread-40::DEBUG::2014-07-10 10:07:49,047::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lion.qa.lab.tlv.redhat.com:_export_yuri2_backup2/6a70504d-00df-4869-8695-0f442053f6b6/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-40::DEBUG::2014-07-10 10:07:49,068::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n369 bytes (369 B) copied, 0.000418928 s, 881 kB/s\n'; <rc> = 0 >Thread-60::DEBUG::2014-07-10 10:07:49,744::task::595::TaskManager.Task::(_updateState) Task=`b3738eb7-0516-402d-8969-32af408114c8`::moving from state init -> state preparing >Thread-51::DEBUG::2014-07-10 10:07:49,746::task::595::TaskManager.Task::(_updateState) Task=`704691e3-bb34-442e-bfb7-35e44ddd4ee6`::moving from state init -> state preparing >Thread-60::INFO::2014-07-10 10:07:49,748::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='b034d5b0-e1e0-4011-b49b-4d45ddb11556', volUUID='3d7f62b5-328f-4d8e-8b69-873cfb5ae14d', options=None) >Thread-51::INFO::2014-07-10 10:07:49,751::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='76fdb054-02cd-42ed-9721-b3e65b34c3a4', volUUID='022dfe46-2cf7-4915-80b3-883158e3ca83', options=None) >Thread-60::INFO::2014-07-10 10:07:49,753::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-60::DEBUG::2014-07-10 10:07:49,755::task::1185::TaskManager.Task::(prepare) Task=`b3738eb7-0516-402d-8969-32af408114c8`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-51::INFO::2014-07-10 10:07:49,757::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-60::DEBUG::2014-07-10 10:07:49,757::task::595::TaskManager.Task::(_updateState) Task=`b3738eb7-0516-402d-8969-32af408114c8`::moving from state preparing -> state finished >Thread-51::DEBUG::2014-07-10 10:07:49,760::task::1185::TaskManager.Task::(prepare) Task=`704691e3-bb34-442e-bfb7-35e44ddd4ee6`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-60::DEBUG::2014-07-10 10:07:49,761::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-51::DEBUG::2014-07-10 10:07:49,763::task::595::TaskManager.Task::(_updateState) Task=`704691e3-bb34-442e-bfb7-35e44ddd4ee6`::moving from state preparing -> state finished >Thread-60::DEBUG::2014-07-10 10:07:49,765::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-51::DEBUG::2014-07-10 10:07:49,767::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-60::DEBUG::2014-07-10 10:07:49,768::task::990::TaskManager.Task::(_decref) Task=`b3738eb7-0516-402d-8969-32af408114c8`::ref 0 aborting False >Thread-51::DEBUG::2014-07-10 10:07:49,770::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-51::DEBUG::2014-07-10 10:07:49,771::task::990::TaskManager.Task::(_decref) Task=`704691e3-bb34-442e-bfb7-35e44ddd4ee6`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 10:07:50,141::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 10:07:50,254::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.037189 s, 27.5 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 10:07:50,442::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-14::DEBUG::2014-07-10 10:07:50,444::task::595::TaskManager.Task::(_updateState) Task=`025bd42f-8523-4886-8ee3-d2a55142b26c`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 10:07:50,444::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-14::INFO::2014-07-10 10:07:50,445::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 10:07:50,445::task::1185::TaskManager.Task::(prepare) Task=`025bd42f-8523-4886-8ee3-d2a55142b26c`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 10:07:50,445::task::595::TaskManager.Task::(_updateState) Task=`025bd42f-8523-4886-8ee3-d2a55142b26c`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 10:07:50,445::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 10:07:50,445::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 10:07:50,446::task::990::TaskManager.Task::(_decref) Task=`025bd42f-8523-4886-8ee3-d2a55142b26c`::ref 0 aborting False >Thread-34::DEBUG::2014-07-10 10:07:50,450::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-34::DEBUG::2014-07-10 10:07:50,450::task::595::TaskManager.Task::(_updateState) Task=`8b956b98-0692-400c-8bcb-fe4f2dfb9772`::moving from state init -> state preparing >Thread-34::INFO::2014-07-10 10:07:50,450::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-34::DEBUG::2014-07-10 10:07:50,451::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`dfca067f-a3e7-463a-8017-000c8003cfcf`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-10 10:07:50,451::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' for lock type 'shared' >Thread-34::DEBUG::2014-07-10 10:07:50,452::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-10 10:07:50,452::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`dfca067f-a3e7-463a-8017-000c8003cfcf`::Granted request >Thread-34::DEBUG::2014-07-10 10:07:50,452::task::827::TaskManager.Task::(resourceAcquired) Task=`8b956b98-0692-400c-8bcb-fe4f2dfb9772`::_resourcesAcquired: Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee (shared) >Thread-34::DEBUG::2014-07-10 10:07:50,453::task::990::TaskManager.Task::(_decref) Task=`8b956b98-0692-400c-8bcb-fe4f2dfb9772`::ref 1 aborting False >Thread-34::INFO::2014-07-10 10:07:50,454::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '531976159232', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 10:07:50,454::task::1185::TaskManager.Task::(prepare) Task=`8b956b98-0692-400c-8bcb-fe4f2dfb9772`::finished: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '531976159232', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 10:07:50,454::task::595::TaskManager.Task::(_updateState) Task=`8b956b98-0692-400c-8bcb-fe4f2dfb9772`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-10 10:07:50,455::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee': < ResourceRef 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-10 10:07:50,455::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-10 10:07:50,455::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' >Thread-34::DEBUG::2014-07-10 10:07:50,455::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' (0 active users) >Thread-34::DEBUG::2014-07-10 10:07:50,455::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-10 10:07:50,456::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', Clearing records. >Thread-34::DEBUG::2014-07-10 10:07:50,456::task::990::TaskManager.Task::(_decref) Task=`8b956b98-0692-400c-8bcb-fe4f2dfb9772`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 10:07:52,269::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 10:07:52,364::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0362446 s, 28.3 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 10:07:54,380::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 10:07:54,472::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0346728 s, 29.5 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-10 10:07:55,193::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/metadata bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-10 10:07:55,215::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000695754 s, 5.9 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 10:07:56,488::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 10:07:56,581::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0359654 s, 28.5 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 10:07:58,596::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 10:07:58,683::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0291324 s, 35.1 MB/s\n'; <rc> = 0 >Thread-40::DEBUG::2014-07-10 10:07:59,098::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lion.qa.lab.tlv.redhat.com:_export_yuri2_backup2/6a70504d-00df-4869-8695-0f442053f6b6/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-40::DEBUG::2014-07-10 10:07:59,119::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n369 bytes (369 B) copied, 0.000489098 s, 754 kB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 10:08:00,065::task::595::TaskManager.Task::(_updateState) Task=`a5976a2f-548d-4f36-bea1-30d908369d81`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 10:08:00,066::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::INFO::2014-07-10 10:08:00,066::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000695754', 'lastCheck': '4.8', 'valid': True}, '6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000489098', 'lastCheck': '0.9', 'valid': True}} >Thread-14::DEBUG::2014-07-10 10:08:00,066::task::1185::TaskManager.Task::(prepare) Task=`a5976a2f-548d-4f36-bea1-30d908369d81`::finished: {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000695754', 'lastCheck': '4.8', 'valid': True}, '6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000489098', 'lastCheck': '0.9', 'valid': True}} >Thread-14::DEBUG::2014-07-10 10:08:00,066::task::595::TaskManager.Task::(_updateState) Task=`a5976a2f-548d-4f36-bea1-30d908369d81`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 10:08:00,067::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 10:08:00,067::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 10:08:00,067::task::990::TaskManager.Task::(_decref) Task=`a5976a2f-548d-4f36-bea1-30d908369d81`::ref 0 aborting False >Thread-14::DEBUG::2014-07-10 10:08:00,484::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-14::DEBUG::2014-07-10 10:08:00,485::task::595::TaskManager.Task::(_updateState) Task=`3692e825-7d71-46ca-b24f-958ecffe9070`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 10:08:00,486::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-14::INFO::2014-07-10 10:08:00,486::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 10:08:00,486::task::1185::TaskManager.Task::(prepare) Task=`3692e825-7d71-46ca-b24f-958ecffe9070`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 10:08:00,486::task::595::TaskManager.Task::(_updateState) Task=`3692e825-7d71-46ca-b24f-958ecffe9070`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 10:08:00,487::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 10:08:00,487::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 10:08:00,487::task::990::TaskManager.Task::(_decref) Task=`3692e825-7d71-46ca-b24f-958ecffe9070`::ref 0 aborting False >Thread-34::DEBUG::2014-07-10 10:08:00,531::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-34::DEBUG::2014-07-10 10:08:00,531::task::595::TaskManager.Task::(_updateState) Task=`f41681b0-7d03-440b-9929-7e063c3720a3`::moving from state init -> state preparing >Thread-34::INFO::2014-07-10 10:08:00,531::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-34::DEBUG::2014-07-10 10:08:00,532::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`6243a250-03d1-437b-afe7-f7bbb00343e9`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-10 10:08:00,532::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' for lock type 'shared' >Thread-34::DEBUG::2014-07-10 10:08:00,533::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-10 10:08:00,533::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`6243a250-03d1-437b-afe7-f7bbb00343e9`::Granted request >Thread-34::DEBUG::2014-07-10 10:08:00,533::task::827::TaskManager.Task::(resourceAcquired) Task=`f41681b0-7d03-440b-9929-7e063c3720a3`::_resourcesAcquired: Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee (shared) >Thread-34::DEBUG::2014-07-10 10:08:00,534::task::990::TaskManager.Task::(_decref) Task=`f41681b0-7d03-440b-9929-7e063c3720a3`::ref 1 aborting False >Thread-34::INFO::2014-07-10 10:08:00,535::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '531976159232', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 10:08:00,535::task::1185::TaskManager.Task::(prepare) Task=`f41681b0-7d03-440b-9929-7e063c3720a3`::finished: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '531976159232', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 10:08:00,535::task::595::TaskManager.Task::(_updateState) Task=`f41681b0-7d03-440b-9929-7e063c3720a3`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-10 10:08:00,535::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee': < ResourceRef 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-10 10:08:00,536::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-10 10:08:00,536::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' >Thread-34::DEBUG::2014-07-10 10:08:00,536::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' (0 active users) >Thread-34::DEBUG::2014-07-10 10:08:00,536::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-10 10:08:00,536::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', Clearing records. >Thread-34::DEBUG::2014-07-10 10:08:00,537::task::990::TaskManager.Task::(_decref) Task=`f41681b0-7d03-440b-9929-7e063c3720a3`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 10:08:00,699::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 10:08:00,791::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0355234 s, 28.8 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 10:08:02,803::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 10:08:02,897::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0383312 s, 26.7 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 10:08:04,912::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 10:08:05,003::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0317279 s, 32.3 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-10 10:08:05,253::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/metadata bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-10 10:08:05,278::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00416712 s, 983 kB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 10:08:07,019::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 10:08:07,168::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0377328 s, 27.1 MB/s\n'; <rc> = 0 >Thread-64::DEBUG::2014-07-10 10:08:07,555::task::595::TaskManager.Task::(_updateState) Task=`37496139-75e7-4d74-b6e5-6aeea8111b09`::moving from state init -> state preparing >Thread-64::INFO::2014-07-10 10:08:07,556::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='aa20346a-4d3a-4e07-b8e1-52c0ebe4168c', volUUID='58fefce2-9bce-4bff-8949-8c6ce8122b27', options=None) >Thread-64::INFO::2014-07-10 10:08:07,556::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-64::DEBUG::2014-07-10 10:08:07,557::task::1185::TaskManager.Task::(prepare) Task=`37496139-75e7-4d74-b6e5-6aeea8111b09`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-64::DEBUG::2014-07-10 10:08:07,557::task::595::TaskManager.Task::(_updateState) Task=`37496139-75e7-4d74-b6e5-6aeea8111b09`::moving from state preparing -> state finished >Thread-64::DEBUG::2014-07-10 10:08:07,557::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-64::DEBUG::2014-07-10 10:08:07,557::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-64::DEBUG::2014-07-10 10:08:07,557::task::990::TaskManager.Task::(_decref) Task=`37496139-75e7-4d74-b6e5-6aeea8111b09`::ref 0 aborting False >Thread-40::DEBUG::2014-07-10 10:08:09,150::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lion.qa.lab.tlv.redhat.com:_export_yuri2_backup2/6a70504d-00df-4869-8695-0f442053f6b6/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-40::DEBUG::2014-07-10 10:08:09,173::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n369 bytes (369 B) copied, 0.000419479 s, 880 kB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 10:08:09,189::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 10:08:09,345::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0962194 s, 10.6 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 10:08:10,567::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-14::DEBUG::2014-07-10 10:08:10,569::task::595::TaskManager.Task::(_updateState) Task=`e065e9b8-05f9-4f95-a87a-52286447a4a5`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 10:08:10,569::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-14::INFO::2014-07-10 10:08:10,569::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 10:08:10,570::task::1185::TaskManager.Task::(prepare) Task=`e065e9b8-05f9-4f95-a87a-52286447a4a5`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 10:08:10,570::task::595::TaskManager.Task::(_updateState) Task=`e065e9b8-05f9-4f95-a87a-52286447a4a5`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 10:08:10,570::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 10:08:10,570::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 10:08:10,570::task::990::TaskManager.Task::(_decref) Task=`e065e9b8-05f9-4f95-a87a-52286447a4a5`::ref 0 aborting False >Thread-34::DEBUG::2014-07-10 10:08:10,574::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-34::DEBUG::2014-07-10 10:08:10,574::task::595::TaskManager.Task::(_updateState) Task=`10548ba2-082a-4d55-8f8e-4b0ec243e3c8`::moving from state init -> state preparing >Thread-34::INFO::2014-07-10 10:08:10,575::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-34::DEBUG::2014-07-10 10:08:10,575::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`6bc4bbb5-3dd9-4895-b239-c7bcae9666fb`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-10 10:08:10,575::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' for lock type 'shared' >Thread-34::DEBUG::2014-07-10 10:08:10,576::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-10 10:08:10,576::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`6bc4bbb5-3dd9-4895-b239-c7bcae9666fb`::Granted request >Thread-34::DEBUG::2014-07-10 10:08:10,576::task::827::TaskManager.Task::(resourceAcquired) Task=`10548ba2-082a-4d55-8f8e-4b0ec243e3c8`::_resourcesAcquired: Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee (shared) >Thread-34::DEBUG::2014-07-10 10:08:10,577::task::990::TaskManager.Task::(_decref) Task=`10548ba2-082a-4d55-8f8e-4b0ec243e3c8`::ref 1 aborting False >Thread-34::INFO::2014-07-10 10:08:10,578::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '531976159232', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 10:08:10,578::task::1185::TaskManager.Task::(prepare) Task=`10548ba2-082a-4d55-8f8e-4b0ec243e3c8`::finished: {'info': {'name': 'DC_REAL', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd:Active,6a70504d-00df-4869-8695-0f442053f6b6:Active', 'master_uuid': '9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'status': u'Active', 'diskfree': '1073473388544', 'isoprefix': '', 'alerts': [], 'disktotal': '1099108974592', 'version': 3}, u'6a70504d-00df-4869-8695-0f442053f6b6': {'status': u'Active', 'diskfree': '531976159232', 'isoprefix': '', 'alerts': [], 'disktotal': '1056894353408', 'version': 0}}} >Thread-34::DEBUG::2014-07-10 10:08:10,578::task::595::TaskManager.Task::(_updateState) Task=`10548ba2-082a-4d55-8f8e-4b0ec243e3c8`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-10 10:08:10,578::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee': < ResourceRef 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-10 10:08:10,578::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-10 10:08:10,579::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' >Thread-34::DEBUG::2014-07-10 10:08:10,579::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' (0 active users) >Thread-34::DEBUG::2014-07-10 10:08:10,579::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-10 10:08:10,579::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', Clearing records. >Thread-34::DEBUG::2014-07-10 10:08:10,579::task::990::TaskManager.Task::(_decref) Task=`10548ba2-082a-4d55-8f8e-4b0ec243e3c8`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 10:08:11,368::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Thread-54::DEBUG::2014-07-10 10:08:11,458::task::595::TaskManager.Task::(_updateState) Task=`0cecf580-5c34-474e-8b9f-bcdaecf8c8c0`::moving from state init -> state preparing >Thread-73::DEBUG::2014-07-10 10:08:11,460::task::595::TaskManager.Task::(_updateState) Task=`6fca89ba-dacc-4d7b-b93b-ab329adf1a12`::moving from state init -> state preparing >Thread-54::INFO::2014-07-10 10:08:11,465::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='28408446-e5fd-4565-a976-e760951593fe', volUUID='776303a2-5585-451e-826e-0e338d4a1e98', options=None) >Thread-73::INFO::2014-07-10 10:08:11,466::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='9e1aa540-1f4e-4ee3-a152-be381ef6c3bd', spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', imgUUID='c01d693b-cba0-4fed-9ad7-0aaa28912a19', volUUID='4bb5d954-2a50-4028-b299-0b43c261270c', options=None) >Thread-54::INFO::2014-07-10 10:08:11,472::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-73::INFO::2014-07-10 10:08:11,474::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-54::DEBUG::2014-07-10 10:08:11,477::task::1185::TaskManager.Task::(prepare) Task=`0cecf580-5c34-474e-8b9f-bcdaecf8c8c0`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-73::DEBUG::2014-07-10 10:08:11,479::task::1185::TaskManager.Task::(prepare) Task=`6fca89ba-dacc-4d7b-b93b-ab329adf1a12`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-54::DEBUG::2014-07-10 10:08:11,482::task::595::TaskManager.Task::(_updateState) Task=`0cecf580-5c34-474e-8b9f-bcdaecf8c8c0`::moving from state preparing -> state finished >Thread-73::DEBUG::2014-07-10 10:08:11,485::task::595::TaskManager.Task::(_updateState) Task=`6fca89ba-dacc-4d7b-b93b-ab329adf1a12`::moving from state preparing -> state finished >Thread-54::DEBUG::2014-07-10 10:08:11,487::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-73::DEBUG::2014-07-10 10:08:11,489::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-54::DEBUG::2014-07-10 10:08:11,491::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-73::DEBUG::2014-07-10 10:08:11,494::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-54::DEBUG::2014-07-10 10:08:11,497::task::990::TaskManager.Task::(_decref) Task=`0cecf580-5c34-474e-8b9f-bcdaecf8c8c0`::ref 0 aborting False >Thread-73::DEBUG::2014-07-10 10:08:11,499::task::990::TaskManager.Task::(_decref) Task=`6fca89ba-dacc-4d7b-b93b-ab329adf1a12`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-10 10:08:11,534::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0509774 s, 20.1 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 10:08:13,551::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 10:08:13,664::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.052382 s, 19.5 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 10:08:15,286::task::595::TaskManager.Task::(_updateState) Task=`76131ac8-a389-4a87-9417-8b6be6e7ccbf`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 10:08:15,287::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::INFO::2014-07-10 10:08:15,288::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00416712', 'lastCheck': '10.0', 'valid': True}, '6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000419479', 'lastCheck': '6.1', 'valid': True}} >Thread-14::DEBUG::2014-07-10 10:08:15,288::task::1185::TaskManager.Task::(prepare) Task=`76131ac8-a389-4a87-9417-8b6be6e7ccbf`::finished: {'9e1aa540-1f4e-4ee3-a152-be381ef6c3bd': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00416712', 'lastCheck': '10.0', 'valid': True}, '6a70504d-00df-4869-8695-0f442053f6b6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000419479', 'lastCheck': '6.1', 'valid': True}} >Thread-14::DEBUG::2014-07-10 10:08:15,288::task::595::TaskManager.Task::(_updateState) Task=`76131ac8-a389-4a87-9417-8b6be6e7ccbf`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 10:08:15,288::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 10:08:15,288::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 10:08:15,289::task::990::TaskManager.Task::(_decref) Task=`76131ac8-a389-4a87-9417-8b6be6e7ccbf`::ref 0 aborting False >Thread-18::DEBUG::2014-07-10 10:08:15,314::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/9e1aa540-1f4e-4ee3-a152-be381ef6c3bd/metadata bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-10 10:08:15,458::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00457911 s, 894 kB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 10:08:15,697::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 10:08:15,889::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.111091 s, 9.2 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 10:08:17,905::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 10:08:18,026::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.052961 s, 19.3 MB/s\n'; <rc> = 0 >Thread-40::DEBUG::2014-07-10 10:08:19,182::domainMonitor::192::Storage.DomainMonitorThread::(_monitorDomain) Refreshing domain 6a70504d-00df-4869-8695-0f442053f6b6 >Thread-40::DEBUG::2014-07-10 10:08:19,207::fileSD::150::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/lion.qa.lab.tlv.redhat.com:_export_yuri2_backup2/6a70504d-00df-4869-8695-0f442053f6b6 >Thread-40::DEBUG::2014-07-10 10:08:19,208::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend >Thread-40::DEBUG::2014-07-10 10:08:19,211::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Backup', 'DESCRIPTION=test', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=0', 'POOL_UUID=4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', 'REMOTE_PATH=lion.qa.lab.tlv.redhat.com:/export/yuri2/backup2', 'ROLE=Regular', 'SDUUID=6a70504d-00df-4869-8695-0f442053f6b6', 'TYPE=NFS', 'VERSION=0', '_SHA_CKSUM=aab6b8e901ec435cd5f9de3c9e3f8b45dca569e0'] >Thread-40::DEBUG::2014-07-10 10:08:19,213::fileSD::609::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images [] >Thread-40::INFO::2014-07-10 10:08:19,213::sd::384::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 6a70504d-00df-4869-8695-0f442053f6b6_imageNS already registered >Thread-40::INFO::2014-07-10 10:08:19,213::sd::392::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 6a70504d-00df-4869-8695-0f442053f6b6_volumeNS already registered >Thread-40::DEBUG::2014-07-10 10:08:19,236::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lion.qa.lab.tlv.redhat.com:_export_yuri2_backup2/6a70504d-00df-4869-8695-0f442053f6b6/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-40::DEBUG::2014-07-10 10:08:19,264::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n369 bytes (369 B) copied, 0.000411343 s, 897 kB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-10 10:08:20,041::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-10 10:08:20,163::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0630844 s, 16.2 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-10 10:08:20,610::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-14::DEBUG::2014-07-10 10:08:20,611::task::595::TaskManager.Task::(_updateState) Task=`cfeee7fc-109e-4999-9d3f-f7dcc4fb3d76`::moving from state init -> state preparing >Thread-14::INFO::2014-07-10 10:08:20,612::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-14::INFO::2014-07-10 10:08:20,612::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 10:08:20,612::task::1185::TaskManager.Task::(prepare) Task=`cfeee7fc-109e-4999-9d3f-f7dcc4fb3d76`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-10 10:08:20,613::task::595::TaskManager.Task::(_updateState) Task=`cfeee7fc-109e-4999-9d3f-f7dcc4fb3d76`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-10 10:08:20,613::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-10 10:08:20,613::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-10 10:08:20,613::task::990::TaskManager.Task::(_decref) Task=`cfeee7fc-109e-4999-9d3f-f7dcc4fb3d76`::ref 0 aborting False >Thread-34::DEBUG::2014-07-10 10:08:20,618::BindingXMLRPC::251::vds::(wrapper) client [10.35.3.13] >Thread-34::DEBUG::2014-07-10 10:08:20,618::task::595::TaskManager.Task::(_updateState) Task=`a0bba00a-c0cf-4a38-8887-aaa51e73f3b5`::moving from state init -> state preparing >Thread-34::INFO::2014-07-10 10:08:20,618::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee', options=None) >Thread-34::DEBUG::2014-07-10 10:08:20,619::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`7da61a23-3590-4f8c-8c92-800852f418a1`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-10 10:08:20,619::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' for lock type 'shared' >Thread-34::DEBUG::2014-07-10 10:08:20,620::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-10 10:08:20,620::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee`ReqID=`7da61a23-3590-4f8c-8c92-800852f418a1`::Granted request >Thread-34::DEBUG::2014-07-10 10:08:20,620::task::827::TaskManager.Task::(resourceAcquired) Task=`a0bba00a-c0cf-4a38-8887-aaa51e73f3b5`::_resourcesAcquired: Storage.4581f8c5-5ac7-42af-8f9f-90e9e6a8bbee (shared) >Thread-34::DEBUG::2014-07-10 10:08:20,620::task::990::TaskManager.Task::(_decref) Task=`a0bba00a-c0cf-4a38-8887-aaa51e73f3b5`::ref 1 aborting False >